KR20150082030A - Electronic device and method for operating the electronic device - Google Patents

Abstract

Various embodiments of the disclosure relate to a method for operating an electronic device, which comprises operations of: displaying multiple applications including at least a first application and a second application on a screen of the electronic device; detecting a user input for the second application; generating a first virtual input for the first application based on the user input; generating a second virtual input different from the first virtual input based on additional information relating to the user input; and performing a function corresponding to at least one among the first virtual input or the second virtual input through the first application. Various embodiments of the disclosure enable other embodiments.

Description

TECHNICAL FIELD [0001] The present invention relates to an electronic device and a method of operating the electronic device,

Various embodiments of the present disclosure are directed to electronic devices and methods of operation of electronic devices.

Various electronic apparatuses recently used have been developed to use various functions such as photographs, music, video, multimedia, games, and the like as well as functions of wireless communication. A front surface of such an electronic device is provided with a display unit so as to more effectively utilize various functions. For example, in recent smartphones, a display unit (e.g., a touch screen) is provided in which the front surface of a device is sensitive by a touch.

In electronic devices, various applications (also referred to as " apps ") may be installed and executed. A plurality of applications may be executed simultaneously in one electronic device, and some applications may operate as a background application.

Various input means (e.g., a touch screen, a button, a mouse, a keyboard, a sensor, etc.) can be used to execute and control the above applications on an electronic device.

Although a function of simultaneously executing a plurality of applications in one electronic device is provided, there is a problem in that a technique for simultaneously controlling a plurality of applications is not provided due to limitation of a function of a framework or the like. For example, when a plurality of applications being simultaneously executed are displayed on the screen, a plurality of applications can be sequentially controlled, but there is a problem that they can not be controlled at the same time.

In various embodiments of the present disclosure, electronic devices and electronic devices that detect events that are delivered to a plurality of applications running concurrently in one electronic device and enable each application to be controlled simultaneously according to the detected event A method of operation can be provided.

The method of operating an electronic device according to any one of the various embodiments of the present disclosure includes: displaying on a screen of the electronic device a plurality of applications including at least a first application and a second application; Detecting a user input to the second application; Generating a first virtual input for the first application based on the user input; Generating a second virtual input different from the first virtual input based on the additional information associated with the user input; And executing the function corresponding to at least one of the first virtual input or the second virtual input through the first application.

An electronic device according to any one of the various embodiments of the present disclosure is an electronic device that executes a plurality of applications, the electronic device including at least a first application and a second application, Display; The method of claim 1, further comprising: sensing a user input to the second application; generating a first virtual input for the first application based on the user input; and based on the additional information associated with the user input, And a processor that executes a function corresponding to at least one of the first virtual input and the second virtual input through the first application.

According to various embodiments of the present disclosure, a plurality of applications may be used simultaneously by a plurality of users in one electronic device by detecting events transmitted from the software platform to a plurality of applications and processing a plurality of applications to be controlled simultaneously .

According to various embodiments of the present disclosure, an auxiliary input application (e.g., a mouse pad type application) in the form of a Graphical User Interface (GUI) is provided on the screen of an electronic device, Applications can be controlled at the same time.

According to various embodiments of the present disclosure, a plurality of functions can be performed simultaneously by controlling a plurality of applications simultaneously. Accordingly, the functions of the multi-window can be expanded to various forms.

1 is a diagram illustrating a network environment according to an embodiment of the present disclosure;
2 is a diagram showing a configuration example of an electronic device according to an embodiment of the present disclosure.
3 is a diagram showing multi-focus processing in a multi-window according to the embodiment of the present disclosure.
4 is a diagram showing an example of controlling a plurality of applications simultaneously using an auxiliary input app according to the embodiment of the present disclosure.
5 is a flow chart illustrating operational procedures of an electronic device according to an embodiment of the present disclosure;
6 is a diagram showing a concept of setting multi-focus on multi-window according to the embodiment of the present disclosure.
FIGS. 7 and 8 are views showing a screen for operating a background application using an auxiliary input application according to the embodiment of the present disclosure.
9 is a diagram showing another example of controlling a plurality of applications simultaneously using multi-focus according to the embodiment of the present disclosure.
Figure 10 is an illustration of an example of executing the auxiliary input app of Figure 4 in an electronic device according to an embodiment of the present disclosure;
11 is a flow diagram illustrating a touch event processing procedure on an electronic device according to an embodiment of the present disclosure.
12 is a diagram illustrating a focus setting concept for a plurality of overlapping applications according to an embodiment of the present disclosure;
13 is a diagram showing a state where a cursor is positioned in an area of an auxiliary input app according to the embodiment of the present disclosure.
Fig. 14 is a diagram showing the touch event processing concept in Fig. 13 according to the embodiment of the present disclosure.
15 is a flow diagram illustrating a touch event processing procedure in a nested application according to an embodiment of the present disclosure.
16 is a block diagram showing a detailed structure of an electronic device according to an embodiment of the present disclosure;

The present disclosure will be described below with reference to the accompanying drawings. The present disclosure is capable of various modifications and various embodiments, and specific embodiments are illustrated in the drawings and detailed description of the invention is set forth. It is to be understood, however, that this disclosure is not intended to be limited to the specific embodiments, but includes all changes and / or equivalents and alternatives falling within the spirit and scope of the disclosure. In connection with the description of the drawings, like reference numerals have been used for like elements.

The use of the terms "comprises" or "comprising" may be used in the present disclosure to indicate the presence of a corresponding function, operation, or element, etc., and does not limit the presence of one or more other features, operations, or components. Also, in this disclosure, the terms "comprises" or "having ", and the like, specify that the presence of stated features, integers, But do not preclude the presence or addition of other features, numbers, steps, operations, components, parts, or combinations thereof.

The " or " in the present disclosure includes any and all combinations of words listed together. For example, " A or B " may comprise A, comprise B, or both A and B.

The expressions " first, " " second, " " first, " or " second, " and the like in the present disclosure may modify various elements of the disclosure, but do not limit the elements. For example, the representations do not limit the order and / or importance of the components. The representations may be used to distinguish one component from another. For example, both the first user equipment and the second user equipment are user equipment and represent different user equipment. For example, without departing from the scope of the present disclosure, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this disclosure is used only to describe a specific embodiment and is not intended to limit the disclosure. The singular expressions may include plural expressions unless the context clearly dictates otherwise.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the relevant art and are to be interpreted as either ideal or overly formal in the sense of the art unless explicitly defined in this disclosure Do not.

The electronic device according to the present disclosure may be an apparatus including a communication function, but is not limited thereto. For example, the electronic device can be a smartphone, a tablet personal computer, a mobile phone, a videophone, an e-book reader, a desktop personal computer, a laptop Such as a laptop personal computer (PC), a netbook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical device, a camera, or a wearable device Such as a head-mounted-device (HMD) such as electronic glasses, an electronic garment, an electronic bracelet, an electronic necklace, an electronic app apparel, an electronic tattoo, or a smartwatch.

According to some embodiments, the electronic device may be a smart home appliance with communication capabilities. [0003] Smart household appliances, such as electronic devices, are widely used in the fields of television, digital video disk (DVD) player, audio, refrigerator, air conditioner, vacuum cleaner, oven, microwave oven, washing machine, air cleaner, set- And may include at least one of a box (e.g., Samsung HomeSyncTM, Apple TVTM, or Google TVTM), game consoles, an electronic dictionary, an electronic key, a camcorder, or an electronic frame.

According to some embodiments, the electronic device may be used in various medical devices (e.g., magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), camera, ultrasound, etc.), navigation devices, a global positioning system receiver, an event data recorder (EDR), a flight data recorder (FDR), an automotive infotainment device, a marine electronic device (e.g., marine navigation device and gyro compass), avionics, An automotive head unit, an industrial or home robot, an ATM (automatic teller's machine) of a financial institution, or a point of sale (POS) of a store.

According to some embodiments, the electronic device may be a piece of furniture or a structure / structure including a communication function, an electronic board, an electronic signature receiving device, a projector, (E. G., Water, electricity, gas, or radio wave measuring instruments, etc.). An electronic device according to the present disclosure may be one or more of the various devices described above. Further, the electronic device according to the present disclosure may be a flexible device. It should also be apparent to those skilled in the art that the electronic device according to the present disclosure is not limited to the above-described devices.

Hereinafter, an electronic device according to various embodiments will be described with reference to the accompanying drawings. The term user, as used in various embodiments, may refer to a person using an electronic device or an apparatus using an electronic device (e.g., an artificial intelligence electronic device).

1 illustrates a network environment 100 including an electronic device 101, in accordance with various embodiments. 1, the electronic device 101 includes a bus 110, a processor 120, a memory 130, an input / output interface 140, a display 150, a communication interface 160, and a multi- 170).

The bus 110 may be a circuit that couples the components described above to one another and communicates communication (e.g., control messages) between the components described above.

The processor 120 may be configured to communicate with other components (e.g., the memory 130, the input / output interface 140, the display 150, the communication interface 160, or the multi-focus processing module 170), decode the received command, and execute an operation or data processing according to the decoded command.

The memory 130 may be coupled to the processor 120 or other components (e.g., the input / output interface 140, the display 150, the communication interface 160, Or store instructions or data generated by the processor 120 or other components. The memory 130 may include programming modules such as, for example, a kernel 131, a middleware 132, an application programming interface (API) 133, or an application 134. Each of the above-described programming modules may be composed of software, firmware, hardware, or a combination of at least two of them.

The kernel 131 may include system resources used to execute operations or functions implemented in other programming modules, such as the middleware 132, the API 133, or the application 134 The bus 110, the processor 120, or the memory 130, etc.). The kernel 131 may also provide an interface through which the individual components of the electronic device 101 may be accessed and controlled or managed in the middleware 132, the API 133 or the application 134 have.

The middleware 132 can act as an intermediary for the API 133 or the application 134 to communicate with the kernel 131 to exchange data. In addition, the middleware 132 may be configured to communicate with at least one of the applications 134, in association with work requests received from the application 134, system resources (e.g., (E.g., scheduling or load balancing) a work request using a method such as assigning a priority that can be used by the processor 110 (e.g., the bus 110, the processor 120, or the memory 130) .

The API 133 is an interface for the application 134 to control the functions provided by the kernel 131 or the middleware 132. For example, the API 133 may be a file control, a window control, (E. G., Instructions) for the < / RTI >

According to various embodiments, the application 134 may be an SMS / MMS application, an email application, a calendar application, an alarm application, a health care application (e.g., an application that measures momentum or blood glucose) E.g., applications that provide air pressure, humidity, or temperature information, etc.). Additionally or alternatively, the application 134 may be an application related to the exchange of information between the electronic device 101 and an external electronic device (e.g., electronic device 104). The application associated with the information exchange may include, for example, a notification relay application for communicating specific information to the external electronic device, or a device management application for managing the external electronic device .

For example, the notification delivery application can send notification information generated in another application (e.g., an SMS / MMS application, an email application, a healthcare application, or an environmental information application) of the electronic device 101 to an external electronic device (E.g., device 104). Additionally or alternatively, the notification delivery application may receive notification information from, for example, an external electronic device (e.g., electronic device 104) and provide it to the user. The device management application may be configured to perform functions (e. G., The external electronic device itself (or some component < RTI ID = 0.0 > (E.g., adjusting the turn on / turn off of the external electronic device or adjusting the brightness (or resolution) of the display), managing applications (e.g., , Deleted or updated).

According to various embodiments, the application 134 may include an application designated according to an attribute of the external electronic device (e.g., electronic device 104) (e.g., the type of electronic device). For example, if the external electronic device is an MP3 player, the application 134 may include an application related to music playback. Similarly, if the external electronic device is a mobile medical device, the application 134 may include applications related to healthcare. According to one embodiment, the application 134 may include at least one of an application specified in the electronic device 101 or an application received from an external electronic device (e.g., server 106 or electronic device 104) .

The input / output interface 140 connects commands or data input from a user via an input / output device (e.g., a sensor, a keyboard, or a touch screen) to the processor 120, To the communication interface 130, the communication interface 160, or the multi-focus processing module 170. For example, the input / output interface 140 may provide the processor 120 with data on the user's touch input through the touch screen. The input / output interface 140 may be connected to the processor 120, the memory 130, the communication interface 160, or the multi-focus processing module 170 via the bus 110, for example. And output the received command or data through the input / output device (e.g., a speaker or a display). For example, the input / output interface 140 may output voice data processed through the processor 120 to a user through a speaker.

The display 150 may display various information (e.g., multimedia data or text data) to the user.

The communication interface 160 may connect communication between the electronic device 101 and an external device (e.g., the electronic device 104 or the server 106). For example, the communication interface 160 may be connected to the network 162 via wireless or wired communication to communicate with the external device. The wireless communication may include, for example, wireless fidelity, Bluetooth, near field communication (NFC), global positioning system (GPS) , WiBro or GSM, etc.). The wired communication may include at least one of, for example, a universal serial bus (USB), a high definition multimedia interface (HDMI), a recommended standard 232 (RS-232) or a plain old telephone service (POTS).

According to one embodiment, the network 162 may be a telecommunications network. The communication network may include at least one of a computer network, an internet, an internet of things, or a telephone network. According to one embodiment, a protocol (e.g., transport layer protocol, data link layer protocol, or physical layer protocol) for communication between the electronic device 101 and an external device may include an application 134, an application programming interface 133, May be supported by at least one of the middleware 132, the kernel 131, or the communication interface 160.

1, electronic device 101 is illustrated as having communication interface 160 to communicate with external electronic device 104 or server 106, etc., over network 120, but in other embodiments of the present disclosure The electronic device 101 may be implemented to operate independently within the electronic device 101 without a separate communication function.

The multi-focus processing module 170 may receive at least one of information acquired from other components (e.g., the processor 120, the memory 130, the input / output interface 140, or the communication interface 160) Some of which can be handled and presented to the user in a variety of ways. For example, the multi-focus processing module 170 sets multi-focus for a plurality of applications being executed according to an input event sensed through the input / output interface 140, Through the processor 120, so that a plurality of applications can be simultaneously controlled. Additional information on the multi-focus processing module 170 is provided through FIG.

2 illustrates a block diagram of an electronic device (e.g., the multi-focus processing module 170 of the electronic device 101), according to various embodiments. Referring to FIG. 2, the electronic device includes an input device 210, The focus processing module 220, the application processor 230, the memory 240, the display 250, etc. The multi-focus processing module 170 includes an input sensing unit 221, an input position determination unit The input type determining unit 223, the focus setting unit 224 and the input event transmitting unit 225. According to various embodiments of the present disclosure, the multi- May set the focus for each of a plurality of applications running on the electronic device and cause events to be processed simultaneously in a plurality of applications in which focus is set according to an input event sensed by the input device 210 or the like.

  The input sensing unit 221 may sense an event input from the various input devices 210. The input position determination unit 222 may determine a position at which the event sensed through the input sensing unit 221 (e.g., an input event) occurs. The location where the event occurs may be information (for example, pixel information) about at least a partial area on a display screen of the electronic device, and may include selection information for a plurality of applications displayed on the display (E.g., the execution region of the first application or the execution region of the second application). The detailed description thereof will be more specifically described in various embodiments described later.

The input type determination unit 223 may perform a function of determining the type of an event that has occurred according to various embodiments of the present disclosure. For example, the input type may be a type of input means (e.g., a touch screen, a keyboard, a mouse, etc.), and an input type for each input means (for example, , Tap, double touch, flick, drag and drop, swipe, multi-swipe, pinch, touch and hold, shake, rotate, etc.).

The focus setting unit 224 performs a function of setting a focus for at least one of a plurality of applications according to the determination result of the input position determination unit 222 and the input type determination unit 223 .

The input event forwarding unit 225 may perform a function of forwarding a corresponding input event to each application set in focus by the focus setting unit 224. [

The application processor 230 may perform a function of processing a corresponding input event in the application according to an input event for each application determined by the multi-focus processing module 220. For example, in accordance with various embodiments of the present disclosure, each of a plurality of focuses is set for a plurality of applications, and when a plurality of input events are delivered for each application, a plurality of applications simultaneously processes the transmitted input events . The application processor 230 executes each of the applications 241 stored in the memory 240 and generates a plurality of applications currently being executed based on focus setting information and input event information provided from the multi- Can handle input events for that application.

The display 250 may display the results processed by the application processor 230 on the screen. For example, in accordance with various embodiments of the present disclosure, it is possible to show the result of processing input events simultaneously in each of a plurality of applications being displayed on the screen.

2, the multi-focus processing module 220 is illustrated as a separate module from the application processor 230, but at least some of the functions of the multi-focus processing module 220 may be implemented by the application processor 230 or the input device 210 And the entire function of the multi-focus processing module 220 may be embodied in the application processor 230 or another processor.

An electronic device according to any one of the various embodiments of the present disclosure is an electronic device that executes a plurality of applications, the electronic device including at least a first application and a second application, Display; The method of claim 1, further comprising: sensing a user input to the second application; generating a first virtual input for the first application based on the user input; and based on the additional information associated with the user input, And a processor that executes a function corresponding to at least one of the first virtual input and the second virtual input through the first application.

The processor may generate a new focus for the first application when generating a first virtual input for the first application.

The second application may be an auxiliary input application.

Wherein when the position of the cursor displayed on the screen is located on the screen area of the auxiliary input application in accordance with the execution of the auxiliary input application, the user input to the second application is input by the user It can be switched to input and processed.

The user input may comprise a touch input.

The first virtual input may include focusing or position shifting for the touched position, and the second virtual input may include a scroll event.

The additional information may include a time at which the touch is maintained or information about a second touch input generated after the first touch input.

The first application and the second application may be displayed in a superimposed manner on the screen.

When a user input occurs in the overlapping area of the first application and the second application, the processor is configured to cause the generated user input to be associated with a user for a top-ranked application on the Z-order among the first application and the second application Input can be processed.

3 is a diagram showing multi-focus processing in a multi-window according to the embodiment of the present disclosure. Referring to FIG. 3, a plurality of applications currently being executed may be displayed on the full screen 300 of the electronic device. For example, as shown in the figure, a web page screen for the Internet portal site can be displayed in the first application screen area 310 and a map related application can be displayed in the second application screen area 320. [ As shown in FIG. 3, the plurality of applications may occupy a predetermined area on the screen and may be separately displayed, and at least some screens of the respective applications may be displayed superimposed on each other. When the plurality of applications are displayed superimposed, the overlapped portion may be displayed as transparent, translucent, or opaque.

3, when a touch event occurs simultaneously on each of the display screens of a plurality of applications, or when a touch event for another application occurs before the touch event for one application is terminated, conventionally, The input event for the other application is processed after the processing of the input event for one of the plurality of applications is completed because the focus can not be set for each of the plurality of applications or the multi- I could. However, according to various embodiments of the present disclosure, focus can be set for each of a plurality of applications being displayed on the screen, and even if an input event occurs simultaneously for a plurality of applications, It is possible to process them simultaneously.

For example, in FIG. 3, when a first touch event 321 occurs in the second application screen area 320 and before the first touch event 321 is terminated (for example, The second touch event 311 occurs in the first application screen region 310, the plurality of touch events may be processed simultaneously for each application according to various embodiments of the present disclosure.

On the other hand, in the conventional case, even if a user desires to control the respective applications separately, as shown in FIG. 3, when a plurality of input events occur simultaneously for a plurality of applications, The application for the input event that occurred first was handled as multi-touch. Therefore, unlike the user's intention, it is not possible to individually control the plurality of applications separately. As described above, according to the multi-window function, the screens of two applications can be displayed on one screen at the same time, but they are not controlled at the same time. For example, conventionally, as shown in the figure, even if a user touches an upper / lower application at the same time, focus is set on a touched application, and a touch event to be input subsequently is transmitted to an application that is already in focus. Accordingly, when touching the display areas of different applications at the same time, the touch events for each application are not processed but processed as multi-touch events for the first touch application.

3, the touch event is described as an example of the input event, but the input event of the present disclosure is not limited to the touch event. And controls a plurality of applications at the same time. Referring to FIG. 4, when an input event occurs in an auxiliary input application according to other embodiments of the present disclosure, a control event corresponding to the input event may be simultaneously processed in another application. For example, in the case of a person (e.g., a disabled person) who can not accurately touch the screen of the electronic device, input can be facilitated by providing a separate auxiliary input application (e.g., a mouse pad type application) .

According to various embodiments, a plurality of applications currently being executed may be displayed on the full screen 400 of the electronic device. For example, as shown, a list of executable applications of the electronic device may be displayed in the first application screen area 410, and an auxiliary input application for screen control of the electronic device may be displayed in the second application screen area 420 . The plurality of applications may be displayed by superimposing at least some areas as shown in FIG. For example, the overlapped portion of the first application screen region 410 and the second application screen region 420 may be displayed in a translucent manner.

Conventionally, when a touch event occurs in the second application screen region 420, after the touch event ends, a control event corresponding to the touch event is generated to control the first application. According to various embodiments of the present disclosure, an event generated for the first application may be passed to the first event and processed at the same time even before the touch event in the second application screen area 420 is terminated.

For example, when the first touch event 421 is generated in the screen scroll function in the auxiliary input application, which is the second application screen area 410, the auxiliary input application generates the first touch event 421 simultaneously with the generation of the first touch event 421, 1 control event for the first application and forwards the generated control event to the first application before the one touch event 421 ends. The first application may process the generated control event concurrently with the processing of the input event for the second application. Accordingly, when the user generates an input event in the auxiliary input application, the user can control the entire screen (the first application screen) simultaneously in real time.

The auxiliary input application of FIG. 4 can provide a convenient user interface environment so that a user (for example, a physically disabled person) who is not easy to input in the electronic device can easily control the screen. According to the embodiment of the present disclosure, it is possible to simultaneously control through the auxiliary input application, thereby increasing convenience of use.

For example, conventionally, due to technical limitations, the first application and the second application operate as separate applications, so that when any one application is focused first, the event can not be delivered to another application. According to the embodiment of the present disclosure, since the multi-focus is possible, simultaneous control of the first application and the second application can be made possible. For example, if the user continuously presses the scroll button in the auxiliary input application, the scroll operation in the top level application running under the cursor can be continuously executed at the same time. Accordingly, the user can perform the control operation for the first application desired by the user simultaneously with the touch of the second application.

In various embodiments of the present disclosure, as described in the description of FIGS. 3 and 4, multi-focus may be configured to provide various functions to enable simultaneous control of each of a plurality of applications being executed. Hereinafter, a method of setting multi-focus for a plurality of applications according to various embodiments of the present disclosure will be described in more detail.

5 is a flow chart illustrating operational procedures of an electronic device according to an embodiment of the present disclosure; Referring to FIG. 5, at operation 501, N applications currently being executed may be displayed on the screen of the electronic device. The N applications may be displayed separately in the entire screen, or at least a part of them may be displayed in a superimposed manner. The user can input N events to each of the N applications to be controlled. The input may include any input such as a touch gesture, a motion gesture, a button input, a key input, a voice input, a motion input, a mouse input, and a keyboard input.

The input event can be detected in an input system and transmitted to an input controller. In the input controller, information including at least one of the number, the area, and the type of the input event can be confirmed and transmitted to the application system. In an application system, an event can be defined as an event that can be transmitted to an application controller based on event information received from an input layer. In an application system, information is analyzed in a received event, and an application type, an event type (for example, a single touch, a multi-touch, a long touch, etc.) .

 In accordance with various embodiments of the present disclosure, at operation 503, if an input event occurs in the electronic device and an input is sensed, at operation 505, the attributes of the sensed input event and the location where the input event occurred can be identified. The attribute (or type) of the input event may be a type of the input means (for example, a touch screen, a keyboard, a mouse, or the like) as described above, and an input type (e.g., Drag, drop, swipe, multi-swipe, pinch, touch and hold, shake, rotate, etc.). The position where the input event occurs may be information (for example, pixel information) of at least a partial area on the display screen provided in the electronic device as described above, and may be a plurality of (E.g., an execution region of the first application or an execution region of the second application) for the application.

At operation 507, the attributes and location of the input event can be referenced to identify the application to be focused and the type of event to deliver to each application. For example, when a plurality of touch events occur at the same time, the touch events may be processed as a multi-touch input for one application or a single touch input for each of a plurality of applications. The detailed embodiments will be described later with reference to FIG.

At act 509, a corresponding event is dispatched for each of the focused applications, and each application can simultaneously execute the dispatched events.

At least one of the operations shown in FIG. 5 may be omitted and at least one other operation may be added between the operations. The operations of FIG. 5 may be processed in the order shown, and the execution order for at least one operation may be modified and processed in accordance with the execution order of the other operations.

The method of operating an electronic device according to various embodiments of the present disclosure includes: displaying on a screen of the electronic device a plurality of applications including at least a first application and a second application; Detecting a user input to the second application; Generating a first virtual input for the first application based on the user input; Generating a second virtual input different from the first virtual input based on the additional information associated with the user input; And executing the function corresponding to at least one of the first virtual input or the second virtual input through the first application.

The act of creating a first virtual input for the first application may include generating a new focus for the first application.

The second application may be an auxiliary input application.

When the position of the cursor displayed on the screen as the execution of the auxiliary input application is located on the screen area of the auxiliary input application, the user input for the second application is switched to the user input for the first application Can be processed.

The user input may comprise a touch input.

The first virtual input may include focusing or position shifting for the touched position, and the second virtual input may include a scroll event.

The additional information may include a time at which the touch is maintained or information about a second touch input generated after the first touch input.

The first application and the second application may be displayed in a superimposed manner on the screen.

Wherein when a user input occurs in the overlapping area of the first application and the second application, the user input is processed to process a user input for an application located at the top of the Z-order among the first application and the second application .

6 is a diagram showing a concept of setting multi-focus on multi-window according to the embodiment of the present disclosure. Referring to FIG. 6, a plurality of applications currently being executed may be displayed on the full screen 600 of the electronic device. For example, as shown in FIG. 6, a first application screen area 610, a second application screen area 620, and a third application screen area 630 may be displayed. In FIG. 6, the second application screen area 620 and the third application screen area 630 are displayed in a superimposed manner on the first application screen area 610.

First, an embodiment for branching upward in Fig. 6 will be described according to various embodiments of the present disclosure. When a first touch event 641 occurs in the first application screen area 610, focus is set on the first application according to the embodiment of the present disclosure, and the first touch event (641). 6, when the second touch event 642a occurs again in the first application screen region 610 in which the focus is set before the first touch event 641 is terminated, In the electronic device, the first touch event 641 and the second touch event 642a can be determined by multi-touch for the first application and processed. If a third touch event 643a occurs in the second application screen area 620 before the first touch event 641 and the second touch event 642a are terminated, According to the example, a new focus is set on the second application (multi-focus is generated in the first application and the second application) and the third touch event 643a generated in the new focus is simultaneously processed Can

Hereinafter, an embodiment for branching down in FIG. 6 will be described according to various embodiments of the present disclosure. When a first touch event 641 occurs in the first application screen area 610, focus is set on the first application according to the embodiment of the present disclosure, and the first touch event (641). Thereafter, when the second touch event 642b occurs in the third application screen area 630 where the focus has not been set yet before the first touch event 641 is ended as shown in the screen that branches to the lower part of FIG. 6 , The electronic device sets a new focus to the third application (multi-focus is generated in the first application and the third application), and the second touch generated in the third application in which the new focus is set in accordance with the embodiment of the present disclosure Event 642b at the same time. When a third touch event 643b occurs in the third application screen area 630 before the first touch event 641 and the second touch event 642b are terminated, The second touch event 642b and the third touch event 643b can be determined by multi-touch for the third application and processed because the focus is already set in the third application according to the example. And FIG. 8 is a diagram illustrating a screen for operating a background application using an auxiliary input application according to an embodiment of the present disclosure.

Referring to FIG. 7, when an input event occurs in an auxiliary input application according to various embodiments of the present disclosure, a control event corresponding to the input event may be simultaneously processed in another application.

According to various embodiments, a plurality of applications may be displayed on the full screen 700 of the electronic device. For example, as shown, an executable application of the electronic device may be displayed in the first application screen area 720 in the form of an icon 721, and an auxiliary input application for screen control of the electronic device may be displayed in the second application screen area 710). The plurality of applications may be displayed by superimposing at least some areas as shown in FIG. For example, the overlapped portion of the first application screen region 720 and the second application screen region 710 may be displayed in a translucent manner.

The auxiliary input application may be implemented in various forms. 7, a left / right cursor movement button 711, an up / down cursor movement button 712, an auxiliary input movement button 713, an auxiliary input end button 714, an auxiliary input touch area 715, And the like.

When the user touches the auxiliary input touch area 715 of the auxiliary input application in a state where the cursor 722 is positioned on a specific application icon (e.g., a message box icon) of the first application screen area 720, And a control event corresponding to the occurrence of the touch event can be simultaneously transmitted to the first application. Accordingly, in the first application, a touch event may be generated where the cursor 722 is located. The message box application can be executed by touching the message box icon by the touch event.

The event generation and processing in the first application can be processed simultaneously with the occurrence of the event in the second application by the multi-focus according to the embodiments of the present disclosure as described above.

Referring to FIG. 8, when an input event occurs in an auxiliary input application according to various embodiments of the present disclosure, a control event corresponding to the input event may be simultaneously processed in another application. Even when a continuous event such as a long touch event occurs, the multi-focus function according to the embodiment of the present disclosure can simultaneously control other applications in real time.

According to various embodiments, a web page screen may be displayed as a first application screen area 820 on the full screen 800 of the electronic device. An auxiliary input application for screen control of the electronic device may be displayed in the second application screen area 810. [ The plurality of applications may be displayed by superimposing at least some areas as shown in FIG. For example, the overlapped portion of the first application screen region 820 and the second application screen region 810 may be displayed in a translucent manner.

The auxiliary input application may be implemented in various forms as described above. For example, as shown in FIG. 8, a scroll key 811, an up / down scroll button 812, an auxiliary input shift button 813, an auxiliary input end button 814, an auxiliary input touch area 815, Lt; / RTI >

When the user touches the auxiliary input touch area 815 of the auxiliary input application in a state where the cursor 821 is positioned on the specific text of the first application screen area 820, a touch event occurs according to the touch, The control event according to the occurrence of the event can be simultaneously transmitted to the first application. Accordingly, in the first application, a touch event can be generated at a place where the cursor 821 is located. The corresponding function in the first application can be executed by touching the corresponding text where the cursor 821 is located by the touch event.

As in the description of FIG. 7, the event generation and processing in the first application can be processed simultaneously with the occurrence of the event in the second application by the multi-focus according to the embodiments of the present disclosure, as described above.

As shown in FIGS. 7 and 8, when the up / down scroll button or the left / right scroll button is pressed once in the auxiliary input application and the touch event is forcibly generated at a constant value defined in the auxiliary input application, 1 application). Also, in accordance with various embodiments of the present disclosure, when a user presses a button for a continuous operation, the auxiliary input application may detect a long touch event and cause the other application (e.g., the first application) It is possible to continuously generate and process a touch event that can process the scroll operation in the screen area.

The operations to be performed in the embodiments of FIGS. 7 and 8 are as follows. For example, the electronic device may include displaying on the screen of the electronic device a plurality of applications including at least a first application (e.g., a browser) and a second application (e.g., a virtual auxiliary input application); Detecting a user input (e.g., a touch event) for the second application; Generating, based on the user input, a first virtual input for the first application (e.g., focusing or moving to a location where the touch event occurred); A second virtual input different from the first virtual input based on additional information related to the user input (e.g., the time at which the touch event was maintained, another touch event occurring after the touch event (e.g., double tap or multi- (E.g., scrolling), and performing operations corresponding to at least one of the first virtual input or the second virtual input through the first application.

9 is a diagram showing another example of controlling a plurality of applications simultaneously using multi-focus according to the embodiment of the present disclosure. Referring to FIG. 9, a plurality of applications can be displayed on the full screen of the electronic device 900. For example, as shown, a first application including a web page or various executable buttons may be displayed as a first application screen area 910, and a dummy application that does not process the touch input may be displayed as a second application screen Area 920. < / RTI > The plurality of applications may be displayed by overlapping at least some areas as shown in FIG. The dummy application can ignore the touch event even if a touch event occurs by the user in the display area of the dummy application.

For example, as shown in FIG. 9, by setting a dummy area which can be ignored in at least a part of the area of the electronic device, it is possible to use a large electronic device (e.g., a tablet device) The convenience of input can be increased.

The second application screen area 920 of FIG. 9 is a dummy area, and the touch event for the area can be ignored. The dummy area may be configured to allow a user to adjust the size, shape, direction, and position of the dummy area. The touch event detected in the second application screen area 920 is ignored in the second application and is not transmitted to the first application disposed in the overlapped state below.

As described above, according to various embodiments of the present disclosure, it is possible to set a plurality of focuses set in the application, so that the first application screen area 910 and the second application screen area 920 (e.g., dummy area) The touch event for the first application screen area 910 can be normally executed as desired by the user. Therefore, when a user touches the first application screen area 910 with a finger, even if a part of the user's hand 930 touches the second application screen area 920, only the touch of the first application screen area 910 Touch can be realized.

Figure 10 is an illustration of an example of executing the auxiliary input app of Figure 4 in an electronic device according to an embodiment of the present disclosure;

Referring to Figure 10 (a), a screen 1010 including one or more application icons may be displayed in at least some areas of the display of the electronic device. While the screen is being displayed, the first portion 1020 may be displayed in at least a portion of the display.

When the user selects the first portion 1020, a second portion 1040, which is larger than the first portion, may be displayed in at least a portion of the display, as shown in Figure 10 (b). The second portion 1040 may include items that can select at least one of the functions of the electronic device. The items may be text, symbols, or icons, respectively. The second part 1040 includes a first item 1041 for cursor display / movement / control on the screen, a second item 1042 for volume control / control, a third item 1043 for lock display / ), Or a fourth item 1044 for displaying other items.

When the user selects (1031) the first item 1041 through the tap gesture, the cursor 1050 and the auxiliary input application screen 1060 are displayed on the display at least It can be displayed in some areas. The auxiliary input application screen 1060 may include items for movement / control of the cursor 1050 and movement / control of the auxiliary input application screen 1060. For example, the auxiliary input application screen 1060 includes an upper movement button 1061, a lower movement button 1062, a left movement button 1063, a right movement button 1064, And a window moving button 1065 for moving the auxiliary input application screen 1060. [

11 is a flow diagram illustrating a touch event processing procedure on an electronic device according to an embodiment of the present disclosure. In operation 1101, when a touch event occurs, a touch event can be sensed in operation 1103. [ According to the detection of the touch event, information such as coordinates on the screen where the touch event occurs, attribute of the touch event, and the like can be confirmed.

In operation 1105, it is determined whether the sensed touch event is a first touch event. The first touch event may refer to the first touch event that occurs in the absence of the currently occurring touch event. For example, when all previous touch events are completed and a new touch event occurs, the newly generated touch event can be determined as the first touch event.

If it is determined that the sensed touch event is the first touch event, the operation 107 can check the top window on the Z-order at the occurrence position of the first touch event. The uppermost window on the Z-order may be an application screen placed at the top in view of the user when multiple applications are displayed superimposed on the screen. A detailed description thereof will be given later in the description of FIG.

In operation 1109, the focus is set on the uppermost window on the identified Z-order. In operation 1111, the first touch event is delivered to the application corresponding to the top window in which the focus is set. The application receiving the touch event can execute the function corresponding to the touch event.

If it is determined in operation 1105 that the touch event detected in operation 1103 is not the first touch event, operation 1113 determines whether the touch event is detected on the Z- You can see the top window. After confirming the top window, in operation 1115, it can be determined whether the focus is already set in the identified top window. If it is determined in step 1117 that the focus has already been set in the identified top window, the multi-touch event may be transmitted to the application corresponding to the identified top window in step 1117.

If it is determined in operation 1115 that no focus has been set on the identified uppermost window, in operation 1119, focus is set on the uppermost window on the identified Z-order. In operation 1121, the sensed touch event is delivered to an application corresponding to the top window in which the focus is set. The application receiving the touch event can execute the function corresponding to the touch event.

12 is a diagram illustrating a focus setting concept for a plurality of overlapping applications according to an embodiment of the present disclosure; Referring to FIG. 12, a plurality of applications currently being executed may be displayed on the entire screen of the electronic device. For example, the first application screen region 1210, the second application screen region 1220, and the third application screen region 1230 can be displayed as shown in FIG. 12, the second application screen area 1220 and the third application screen area 1230 are displayed in a superimposed manner on a partial area of the first application screen area 1210. [

An uppermost region on the Z axis among the overlapped application screen regions may be referred to as a top window on the Z-order. For example, in the area where the first application screen area 1210 and the second application screen area 1220 overlap in FIG. 12, the second application screen area 1220 may be the top window on the Z-order. 12, in the area where the first application screen area 1210 and the third application screen area 1230 are overlapped, the third application screen area 1230 can be the top window on the Z-order.

12, the location where the first touch event 1241 occurs may be a region where the first application screen region 1210 and the second application screen region 1220 overlap. 11, the uppermost window on the Z-order at the position where the first touch event 1241 occurs may be the second application screen area 1220. [ According to the embodiment of the present disclosure, the first touch event 1241 is the first touch event, so a new focus is set in the second application screen area 1220, and the first touch event 1241 is set in the second application And executed.

In FIG. 12, the location where the second touch event 1242 occurs may be an area in which the first application screen area 1210 and the third application screen area 1230 overlap. As described above with reference to FIG. 11, the uppermost window on the Z-order at the position where the second touch event 1242 occurs may be the third application screen region 1230. According to the embodiment of the present disclosure, there is no set focus in the third application screen area 1230, so a new focus can be set. Since the new focus is set in the third application screen area 1230, the second touch event 1242 can be transferred to the third application and executed. The focus is simultaneously set in the second application screen area 1220 and the third application screen area 1230 so that even if the first touch event and the second touch event occur at the same time, Instead of processing them as events, you can handle them simultaneously with separate input events that occur for each application.

12, the position where the third touch event 1243 occurs may be a region in which the first application screen region 1210 and the third application screen region 1230 are overlapped with each other as in the position where the second touch event 1242 occurs . As described above with reference to FIG. 11, the uppermost window on the Z-order at the position where the third touch event 1243 occurs may be the third application screen area 1230. The third touch screen 1230 may have the focus already set by the second touch event 1242 and the third touch event 1243 may be the second touch event 1242, Touch event for the third application.

13 is a diagram showing a state where a cursor is positioned in an area of an auxiliary input app according to the embodiment of the present disclosure. Referring to FIG. 13, when an input event occurs in the auxiliary input application according to various embodiments of the present disclosure, a control event corresponding to the input event may be simultaneously processed in another application. 13 illustrates a method of processing a touch event when the cursor 1330 is at a position where the screen area of the auxiliary input application overlaps the screen area of the target application.

According to various embodiments, a web page screen may be displayed as a first application screen area 1310 on the full screen 1300 of the electronic device. In addition, an auxiliary input application for screen control of the electronic device may be displayed in the second application screen area 1320. [ The plurality of applications may be displayed by overlapping at least some areas as shown in FIG. Also, for example, the overlapped portion of the first application screen region 1310 and the second application screen region 1320 may be displayed in a translucent manner.

The auxiliary input application may be implemented in various forms as described above. For example, as shown in FIG. 13, the display area 1320 includes left and right scroll buttons 1321, an up and down scroll button 1322, an auxiliary input shift button 1323, an auxiliary input end button 1324, an auxiliary input touch area 13255, Lt; / RTI >

In accordance with various embodiments of the present disclosure, in the state where the cursor 1330 is positioned in the overlapping area of the first application screen area 1310 and the second application screen area 1320, When a specific application execution icon 1311 in the application screen area 1310 is to be selected and executed, a processing method therefor will be described in the following description.

Fig. 14 is a diagram showing the touch event processing concept in Fig. 13 according to the embodiment of the present disclosure. Referring to FIG. 14, when a first touch event 1400 occurs in an area where the first application screen area 1310 and the second application screen area 1320 are overlapped as shown in FIG. 13, The touch event 1400 may be intended to be executed in the second application screen area 1310 rather than in the second application screen area 1320. [ For example, when the cursor 1330 is positioned in the overlapped area as shown in FIG. 13, when the user touches the cursor 1330, a touch on the first application (e.g., an auxiliary input application) A touch on the specific icon 1311 may be intended to be executed.

If the second application displayed in superposition with the first application is a preset specific application (for example, an auxiliary input application), the touch event 1400 for the overlapped area is displayed on the uppermost application screen area (For example, the second application screen area 1320) but is processed as a touch event for the next highest application screen area (e.g., the first application screen area 1310).

15 is a flow diagram illustrating a touch event processing procedure in a nested application according to various embodiments of the present disclosure. At operation 1501, when a touch event occurs, a touch event may be sensed at operation 1503. [ According to the detection of the touch event, information such as coordinates on the screen where the touch event occurs, attribute of the touch event, and the like can be confirmed.

In operation 1505, it is determined whether the position of the mouse pointer (e.g., cursor) is the screen area of the auxiliary input application and the overlapped screen area of another application.

As a result of the above determination, if the position of the mouse pointer is above the screen area of the auxiliary input application, a touch event flag (e.g., 'AMOTION_EVENT_FLAG_WINDOWS_IS_ACCESSIBILITY') is added in operation 1507. The touch event flag may be added to the kernel 131 of the input system.

At 1509, the detected motion event (e.g., a touch event) can be delivered to the auxiliary input application, which is the uppermost application on the Z-order.

In operation 1511, the auxiliary input application determines whether or not there is a flag in the touch event. If there is a flag added in operation 1507, in operation 1513, the application (for example, auxiliary input application) And passes the touch event to the next highest level application. For example, when a touch event occurs at the cursor position while the cursor is positioned on the auxiliary input application, the touch event is not processed as a touch event for the auxiliary input application which is the highest application on the Z-order, It may pass through the auxiliary input application and process it as a touch event for the next highest application according to various embodiments. For example, as shown in FIG. 13, a specific application execution icon displayed in the lower application screen area overlapped with the auxiliary input application can be selected.

As a result of the determination in operation 1505, if the position of the mouse point is not above the screen area of the auxiliary input application, it is possible to transmit a motion event without a flag (e.g., a touch event) in operation 1515. At operation 1517, the flagless motion event may be delivered to the top level application on the Z-order (e.g., an auxiliary input app).

If it is determined that there is no flag in the motion event delivered in operation 1511, operation 1517 may forward the unflagged motion event to the top-level application on the Z-order.

16 shows a block diagram 1600 of an electronic device 1601 in accordance with various embodiments. The electronic device 1601 may constitute all or part of the electronic device 101 shown in Fig. 1, for example. 16, the electronic device 1601 includes one or more application processors (APs) 1610, a communication module 1620, a SIM (subscriber identification module) card 1624, a memory 1630, Module 1660, input device 1650, display 1660, interface 1670, audio module 1680, camera module 1691, power management module 1695, battery 1696, indicator 1697, And a motor 1698.

The AP 1610 may control a plurality of hardware or software components connected to the AP 1610 by driving an operating system or an application program, and may perform various data processing and operations including multimedia data. The AP 1610 may be implemented as a system on chip (SoC), for example. According to one embodiment, the AP 1610 may further include a graphics processing unit (GPU) (not shown).

The communication module 1620 (e.g., the communication interface 160) may communicate with other electronic devices (e. G., Electronic device 104) that are networked with the electronic device 1601 The communication module 1620 may include a cellular module 1621, a Wifi module 1623, a BT module 1625, a GPS module (not shown) 1627, an NFC module 1628, and a radio frequency (RF) module 1629.

The cellular module 1621 may provide voice, video, text, or Internet services over a communication network (e.g., LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro or GSM). In addition, the cellular module 1621 can perform identification and authentication of electronic devices within the communication network, for example, using a subscriber identity module (e.g., SIM card 1624). According to one embodiment, the cellular module 1621 may perform at least some of the functions that the AP 1610 may provide. For example, the cellular module 1621 may perform at least a portion of the multimedia control functions.

According to one embodiment, the cellular module 1621 may include a communication processor (CP). In addition, the cellular module 1621 may be implemented in a system-on-chip (SoC) format, for example. 16, components such as the cellular module 1621 (e.g., a communications processor), the memory 1630 or the power management module 1695 are shown as separate components from the AP 1610, According to an embodiment, the AP 1610 may be implemented to include at least a portion of the components described above (e.g., a cellular module 1621).

According to one embodiment, the AP 1610 or the cellular module 1621 (e.g., a communications processor) may load or read commands or data received from at least one of non-volatile memory or other components connected thereto, load. In addition, the AP 1610 or the cellular module 1621 may receive data from at least one of the other components, or may store data generated by at least one of the other components in the non-volatile memory.

Each of the Wifi module 1623, the BT module 1625, the GPS module 1627 or the NFC module 1628 includes a processor for processing data transmitted and received through a corresponding module . Although the cellular module 1621, the WiFi module 1623, the BT module 1625, the GPS module 1627 or the NFC module 1628 are shown as separate blocks in FIG. 16, according to one embodiment, At least some (e.g., two or more) of the wireless module 1621, the Wifi module 1623, the BT module 1625, the GPS module 1627, or the NFC module 1628 may be integrated into one integrated circuit Lt; / RTI > At least some of the processors (e.g., cellular module 1621) corresponding to each of cellular module 1621, Wifi module 1623, BT module 1625, GPS module 1627 or NFC module 1628, ) And a Wifi processor corresponding to the Wifi module 1623) may be implemented as one SoC.

The RF module 1629 can transmit and receive data, for example, transmit and receive RF signals. The RF module 1629 may include, for example, a transceiver, a power amplifier module (PAM), a frequency filter, or a low noise amplifier (LNA). In addition, the RF module 1629 may further include a component, for example, a conductor or a conductor, for transmitting and receiving electromagnetic waves in free space in wireless communication. 16, the cellular module 1621, the Wifi module 1623, the BT module 1625, the GPS module 1627, and the NFC module 1628 are shown sharing one RF module 1629, At least one of the cellular module 1621, the Wifi module 1623, the BT module 1625, the GPS module 1627 or the NFC module 1628 transmits and receives RF signals through separate RF modules, according to an embodiment. can do.

The SIM card 1624 may be a card including a subscriber identity module and may be inserted into a slot formed at a specific location of the electronic device. The SIM card 1624 may include unique identification information (e.g., an integrated circuit card identifier (ICCID)) or subscriber information (e.g., international mobile subscriber identity (IMSI)).

The memory 1630 (e.g., the memory 130) may include an internal memory 1632 or an external memory 1634. The built-in memory 1632 may be a nonvolatile memory such as a volatile memory (for example, a dynamic random access memory (DRAM), a static random access memory (SRAM), a synchronous dynamic RAM (SDRAM) (EEPROM), a mask ROM, a flash ROM, a NAND flash memory, a NOR flash memory, and the like), a ROM (Read Only Memory) Or the like.

According to one embodiment, the internal memory 1632 may be a solid state drive (SSD). The external memory 1634 may be a flash drive such as a compact flash (CF), a secure digital (SD), a micro secure digital (SD), a mini secure digital (SD) extreme digital) or a memory stick. The external memory 1634 may be functionally connected to the electronic device 1601 through various interfaces. According to one embodiment, the electronic device 1601 may further include a storage device (or storage medium) such as a hard drive.

The sensor module 1640 may measure a physical quantity or sense an operating state of the electronic device 1601, and convert the measured or sensed information into an electrical signal. The sensor module 1640 includes a gesture sensor 1640A, a gyro sensor 1640B, an air pressure sensor 1640C, a magnetic sensor 1640D, an acceleration sensor 1640E, a grip sensor 1640F, A light sensor 1640G, a color sensor 1640H (e.g., an RGB (red, green, blue) sensor), a living body sensor 1640I, a temperature / humidity sensor 1640J, ) Sensor 1640M. ≪ / RTI > Additionally or alternatively, the sensor module 1640 may include, for example, an olfactory sensor (not shown), an electromyography sensor (not shown), an electroencephalogram sensor (not shown), an ECG (Not shown), an iris sensor (not shown), or a fingerprint sensor (not shown). The sensor module 1640 may further include a control circuit for controlling at least one sensor included therein.

The input device 1650 includes a touch panel 1652, a (digital) pen sensor 1654, a key 1656, or an ultrasonic input device 1658 . The touch panel 1652 can recognize the touch input in at least one of an electrostatic type, a pressure sensitive type, an infrared type, and an ultrasonic type. In addition, the touch panel 1652 may further include a control circuit. In electrostatic mode, physical contact or proximity recognition is possible. The touch panel 1652 may further include a tactile layer. In this case, the touch panel 1652 may provide a tactile response to the user.

The (digital) pen sensor 1654 can be implemented using the same or similar method as receiving the touch input of the user, or using a separate recognizing sheet, for example. The key 1656 may include, for example, a physical button, an optical key or a keypad. The ultrasonic input device 1658 is an apparatus that can confirm data by sensing sound waves from an electronic device 1601 to a microphone (for example, a microphone 1688) through an input tool for generating an ultrasonic signal, Recognition is possible. According to one embodiment, the electronic device 1601 may receive user input from an external device (e.g., a computer or a server) connected thereto using the communication module 1620.

The display 1660 (e.g., the display 150) may include a panel 1662, a hologram device 1664, or a projector 1666). The panel 1662 may be, for example, a liquid crystal display (LCD) or an active matrix organic light-emitting diode (AM-OLED). The panel 1662 can be embodied, for example, flexible, transparent or wearable. The panel 1662 may be formed of a single module with the touch panel 1652. The hologram device 1664 can display a stereoscopic image in the air using interference of light. The projector 1666 can display an image by projecting light onto a screen. The screen may be located, for example, inside or outside the electronic device 1601. According to one embodiment, the display 1660 may further include control circuitry for controlling the panel 1662, the hologram device 1664, or the projector 1666.

The interface 1670 may include a high-definition multimedia interface (HDMI) 1672, a universal serial bus (USB) 1674, an optical interface 1676, or a D- ) 1678. < / RTI > The interface 1670 may, for example, be included in the communication interface 160 shown in FIG. Additionally or alternatively, the interface 1670 may be implemented using a mobile high-definition link (MHL) interface, a secure digital (SD) card / multi-media card (MMC) Interface.

The audio module 1680 can bidirectionally convert sound and electrical signals. At least some of the components of the audio module 1680 may be included in, for example, the input / output interface 140 shown in FIG. The audio module 1680 may process sound information input or output through, for example, a speaker 1682, a receiver 1684, an earphone 1686, a microphone 1688, or the like.

According to one embodiment, the camera module 1691 may include at least one image sensor (e.g., a front sensor or a rear sensor), a lens (not shown), an image signal processor (ISP) (Not shown) or a flash (not shown) (e.g., an LED or xenon lamp).

The power management module 1695 may manage the power of the electronic device 1601. Although not shown, the power management module 1695 may include, for example, a power management integrated circuit (PMIC), a charger integrated circuit (PMIC), or a battery or fuel gauge.

The PMIC can be mounted, for example, in an integrated circuit or a SoC semiconductor. The charging method can be classified into wired and wireless. The charging IC can charge the battery, and can prevent an overvoltage or an overcurrent from the charger. According to one embodiment, the charging IC may comprise a charging IC for at least one of a wired charging mode or a wireless charging mode. The wireless charging system may be, for example, a magnetic resonance system, a magnetic induction system or an electromagnetic wave system, and additional circuits for wireless charging may be added, such as a coil loop, a resonant circuit or a rectifier have.

The battery gauge can measure the remaining amount of the battery 1696, the voltage during charging, the current or the temperature, for example. The battery 1696 may store or generate electricity, and may supply power to the electronic device 1601 using the stored or generated electricity. The battery 1696 may include, for example, a rechargeable battery or a solar battery.

The indicator 1697 may indicate the electronic device 1601 or a portion thereof (e.g., a particular state of the AP 1610, e.g., a boot state, a message state, (Not shown), the electronic device 1601 may include a processing unit (e. G., A GPU) for mobile TV support. ≪ RTI ID = 0.0 & The apparatus can process media data conforming to standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or media flow, for example.

Each of the above-described components of the electronic device according to the present disclosure can be composed of one or more components, and the name of the component can be changed according to the type of the electronic device. The electronic device according to the present disclosure may be configured to include at least one of the above-described components, and some components may be omitted or further include other additional components. In addition, some of the components of the electronic device according to the present disclosure may be combined and configured as an entity, so that the functions of the corresponding components before being combined can be performed in the same manner.

The term " module " as used herein may mean a unit comprising, for example, one or a combination of two or more of hardware, software or firmware. A " module " may be interchangeably used with terms such as, for example, unit, logic, logical block, component or circuit. A " module " may be a minimum unit or a portion of an integrally constructed component. A " module " may be a minimum unit or a portion thereof that performs one or more functions. &Quot; Modules " may be implemented either mechanically or electronically. For example, a "module" in accordance with the present disclosure may be implemented as an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs) or programmable logic arrays (FPGAs) logic device).

According to various embodiments, at least a portion of a device (e.g., modules or functions thereof) or a method (e.g., operations) according to the present disclosure may be stored in a computer readable storage medium -readable storage media). The instructions may be executed by one or more processors (e.g., when executed by the processor 210, the one or more processors may perform functions corresponding to the instructions.) A computer readable storage medium may, At least a portion of the programming module may be implemented (e.g., executed) by, for example, the processor 210. At least a portion of the programming module may be one May include, for example, a module, a program, a routine, a set of instructions or a process for performing the above functions.

The computer-readable recording medium may be a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, an optical recording medium such as a compact disc read only memory (CD-ROM), a digital versatile disc (DVD) a magneto-optical medium such as a floppy disk and a magneto-optical medium such as a magneto-optical medium such as a magneto-optical medium such as a magneto-optical disk, Module) that is configured to store and perform the functions described herein. The program instructions may also include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of this disclosure, and vice versa.

A module or programming module according to the present disclosure may include at least one or more of the elements described above, some of which may be omitted, or may further include other additional elements. Operations performed by modules, programming modules, or other components in accordance with the present disclosure may be performed in a sequential, parallel, iterative, or heuristic manner. Also, some operations may be performed in a different order, omitted, or other operations may be added.

According to various embodiments, there is provided a storage medium storing instructions which, when executed by at least one processor, cause the at least one processor to be configured to perform at least one operation, Displaying, on the screen of the electronic device, a plurality of applications including at least a first application and a second application; Detecting a user input to the second application; Generating a first virtual input for the first application based on the user input; Generating a second virtual input different from the first virtual input based on the additional information associated with the user input; And executing the function corresponding to at least one of the first virtual input or the second virtual input through the first application.

And the embodiments of the present disclosure disclosed in this specification and the drawings are merely illustrative of specific examples for the purpose of facilitating the understanding of the present disclosure and the description of the present disclosure, and are not intended to limit the scope of the present disclosure. Accordingly, the scope of the present disclosure should be construed as being included within the scope of the present disclosure in addition to the embodiments disclosed herein, all changes or modifications derived from the technical idea of the present disclosure.

100: Network environment 101: Electronic device
104: Electronic device 106: Server
110: bus 120: processor
130: memory 131: kernel
132: Middleware 133: API
134: application 140: input / output interface
150: Display 160: Communication interface
162: network 210: input device
220: Multi-focus processing module 221:
222: input position determination unit 223: input type determination unit
224: Focus setting unit 225: Input event transmitting unit
230: application processor 240: memory
241: Application 250: Display

Claims (18)

A method of operating an electronic device,
Displaying on the screen of the electronic device a plurality of applications including at least a first application and a second application;
Detecting a user input to the second application;
Generating a first virtual input for the first application based on the user input;
Generating a second virtual input different from the first virtual input based on the additional information associated with the user input; And
And executing, via the first application, a function corresponding to at least one of the first virtual input or the second virtual input.
2. The method of claim 1, wherein generating a first virtual input for the first application comprises:
And generating a new focus for the first application.
2. The method of claim 1,
A secondary input application, the method of operation of an electronic device.
4. The method according to claim 3, wherein, when the position of the cursor displayed on the screen according to the execution of the auxiliary input application is located on the screen area of the auxiliary input application, And switching to a user input for the user.
4. The method of claim 3, wherein the user input comprises a touch input.
6. The method of claim 5, wherein the first virtual input comprises focusing or locating for a touched position, and wherein the second virtual input comprises a scroll event.
6. The method according to claim 5,
A time at which the touch is maintained, or information about a second touch input occurring after the first touch input.
The method according to claim 1, wherein the first application and the second application are displayed in a superimposed manner on at least a part of the screen.
9. The method of claim 8, further comprising: when a user input occurs in an overlapped region of the first application and the second application, the generated user input is applied to an application located at the highest position on the Z-order among the first application and the second application ≪ / RTI > wherein the method further comprises processing the user input.
1. An electronic device for executing a plurality of applications,
A display that displays the plurality of applications including at least a first application and a second application on a screen of the electronic device; And
The method comprising: sensing a user input to the second application; generating a first virtual input for the first application based on the user input; and based on the additional information associated with the user input, And a processor for generating a different second virtual input and executing a function corresponding to at least one of the first virtual input or the second virtual input through the first application.
11. The apparatus of claim 10,
And generates a new focus for the first application when generating a first virtual input for the first application.
11. The method of claim 10,
An auxiliary input application.
13. The system of claim 12,
When the position of the cursor displayed on the screen as the execution of the auxiliary input application is located on the screen area of the auxiliary input application, the user input for the second application is switched to the user input for the first application Electronic device.
13. The electronic device of claim 12, wherein the user input comprises a touch input.
15. The electronic device of claim 14, wherein the first virtual input comprises focusing or position shifting for a touched position, and wherein the second virtual input comprises a scroll event.
15. The method of claim 14,
And information about a second touch input occurring after the first touch input.
11. The electronic device as claimed in claim 10, wherein the first application and the second application are displayed on the screen at least partially overlapping each other.
18. The method of claim 17, wherein when a user input occurs in an overlapped region of the first application and the second application,
Wherein the processor processes the user input for the application located at the top of the Z-order among the first application and the second application.

Images