WO2021201490A1

WO2021201490A1 - Method for controlling background application and electronic device supporting same

Info

Publication number: WO2021201490A1
Application number: PCT/KR2021/003655
Authority: WO
Inventors: 강지영; 노연희; 안수정; 이진아; 최윤정
Original assignee: 삼성전자 주식회사
Priority date: 2020-03-31
Filing date: 2021-03-24
Publication date: 2021-10-07
Also published as: KR20210121923A

Abstract

Disclosed is an electronic device comprising: a display; at least one sensor; a processor; and a memory operatively connected to the display, the at least one sensor, and the processor, wherein the processor: displays an execution screen of a first application among multiple applications installed in the electronic device on the display in a state in which the multiple applications are executed; detects, through the at least one sensor, a first user input made without contact with the electronic device; displays, on a designated area of the display on the basis of the detected first user input, a first user interface related to control of a second application that is being executed in the background, among the multiple applications; detects a second user input through the at least one sensor; changes, on the basis of the detected second user input, the first user interface to a second user interface related to control of a third application that is being executed in the background, among the multiple applications; and controls the third application on the basis of a third user input when the third user input is detected through the at least one sensor. Various other embodiments inferred from the present document are also possible.

Description

Background application control method and electronic device supporting the same

Various embodiments of the present disclosure relate to a method of controlling an application executed in a background and an electronic device supporting the same.

An electronic device such as a smart phone may execute a plurality of applications. For example, the electronic device may play music by executing a music playback application. When the electronic device executes an e-book application such as an e-book in a state in which the music playback application is running, the music playback application that was previously playing music may play music in a background state. Also, the e-book application may be in a foreground state, and the e-book application in the foreground state may be displayed on the display in a focusing state controlled by a user input currently received by the electronic device.

Conventional electronic devices can control an application running in a foreground state through a user input such as a key input or a touch input, but it is difficult to control an application running in the background. For example, the electronic device may make a foreground call to control an application running in the background state. As the call is made to the foreground that is running in the background state, the flow of use of the foreground application being used may be interrupted.

Various embodiments of the present disclosure may provide a method for controlling a background application through a user input (eg, a gesture or a hovering input) not in contact with the electronic device, and an electronic device supporting the method.

An electronic device according to various embodiments of the present disclosure includes a display, at least one sensor, a processor, and a memory operatively connected to the display, the at least one sensor, and the processor, wherein the processor includes the electronic device In a state in which a plurality of applications installed in . are executed, an execution screen of a first application among the plurality of applications is displayed on the display, and a first user input that is not in contact with the electronic device is detected through the at least one sensor, , based on the detected first user input, a first user interface related to control of a second application running in the background among the plurality of applications is displayed on a designated area of the display, and through the at least one sensor detecting a second user input, and changing the first user interface to a second user interface related to control of a third application running in the background among the plurality of applications based on the detected second user input; When a third user input is detected through the at least one sensor, the electronic device may control the third application based on the third user input.

An electronic device according to various embodiments of the present disclosure includes a display, at least one sensor, a communication module, a processor, and a memory operatively connected to the display, the at least one sensor, the communication module, and the processor, The processor transmits data related to the execution screen of the first application installed in the electronic device to the external electronic device through the communication module, displays the execution screen of the second application installed in the electronic device, on the display, and A first user input not in contact with the electronic device is detected through at least one sensor, and a first user interface related to control of the first application is displayed on a designated area of the display based on the detected first user input. , detects a second user input through the at least one sensor, and transmits a control signal for the first application to the external electronic device through the communication module based on the detected second user input It may include an electronic device that

In a method of operating an electronic device according to various embodiments of the present disclosure, in a state in which a plurality of applications installed in the electronic device are executed, an execution screen of a first application among the plurality of applications is displayed on a display of the electronic device. operation, detecting a first user input that is not in contact with the electronic device through a sensor of the electronic device, and detecting a second application running in the background among the plurality of applications based on the detected first user input Based on an operation of displaying a control-related first user interface on a designated area of the display, an operation of detecting a second user input through the sensor, and an operation of the detected second user input, the plurality of first user interfaces When a third user input is detected through an operation of changing to a second user interface related to control of a third application running in the background among applications, and a third user input is detected through the sensor, based on the third user input, the third application is accessed. It may include an operation for performing control of the .

According to various embodiments of the present disclosure, a background application may be controlled based on an input that is not in contact with the electronic device.

Also, according to various embodiments of the present disclosure, when data on a background application of the electronic device is transmitted to an external electronic device communicatively connected to the electronic device and the external electronic device displays an execution screen of the background application, the electronic device A background application running in the external electronic device may be controlled based on a user input detected by the device.

In addition, various effects directly or indirectly identified through this document may be provided.

1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure;

2 is a block diagram of an electronic device for controlling an application executed in the background according to an embodiment of the present invention.

3 is a diagram for explaining a method of controlling a plurality of applications executed in the background according to an embodiment of the present invention.

4 is a diagram for explaining a method of controlling an application executed in a background while being connected to an external electronic device according to an embodiment of the present invention.

5 is a diagram for explaining a method of controlling an application being executed in an electronic device based on a user input according to an embodiment of the present invention.

6 is a diagram for explaining a user interface according to an embodiment of the present invention.

7 is a diagram for explaining a method of receiving a user input through a touch screen according to an embodiment of the present invention.

8 is a diagram for explaining a method of controlling a function of a background application according to an embodiment of the present invention.

9 is a diagram for explaining a method of selecting and controlling one of a plurality of applications running in a background according to an embodiment of the present invention.

10 is a diagram for explaining a method of stopping activation of a sensor according to an embodiment of the present invention.

11 is a diagram for explaining a method of controlling a background application while connected to an external electronic device according to an embodiment of the present invention.

12 is a diagram for explaining a method of controlling a plurality of applications displayed through a multi-window according to an embodiment of the present invention.

13A to 13C are diagrams for explaining a method of controlling a plurality of applications displayed through a multi-window while connected to an external electronic device according to an embodiment of the present invention.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. For convenience of description, the sizes of the components shown in the drawings may be exaggerated or reduced, and the present invention is not necessarily limited to the illustrated ones.

Referring to FIG. 1 , in a network environment 100 , the electronic device 101 communicates with the electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input device 150 , a sound output device 155 , a display device 160 , an audio module 170 , and a sensor module ( 176 , interface 177 , haptic module 179 , camera module 180 , power management module 188 , battery 189 , communication module 190 , subscriber identification module 196 , or antenna module 197 . ) may be included. In some embodiments, at least one of these components (eg, the display device 160 or the camera module 180 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components may be implemented as a single integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 160 (eg, a display).

The processor 120, for example, executes software (eg, the program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to an embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190) to the volatile memory 132 . may be loaded into the volatile memory 132 , process commands or data stored in the volatile memory 132 , and store the resulting data in the non-volatile memory 134 . According to an embodiment, the processor 120 includes a main processor 121 (eg, a central processing unit or an application processor), and an auxiliary processor 123 (eg, a graphic processing unit or an image signal processor) that can be operated independently or together with the main processor 121 . , a sensor hub processor, or a communication processor). Additionally or alternatively, the auxiliary processor 123 may be configured to use less power than the main processor 121 or to be specialized for a designated function. The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 may be, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or when the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display device 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the auxiliary processor 123 (eg, an image signal processor or a communication processor) may be implemented as a part of another functionally related component (eg, the camera module 180 or the communication module 190). have.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176 ) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input device 150 may receive a command or data to be used by a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen).

The sound output device 155 may output a sound signal to the outside of the electronic device 101 . The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive incoming calls. According to an embodiment, the receiver may be implemented separately from or as a part of the speaker.

The display device 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display device 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device. According to an embodiment, the display device 160 may include a touch circuitry configured to sense a touch or a sensor circuit (eg, a pressure sensor) configured to measure the intensity of a force generated by the touch. have.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input device 150 , or an external electronic device (eg, a sound output device 155 ) connected directly or wirelessly with the electronic device 101 . The electronic device 102) (eg, a speaker or headphones) may output a sound.

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more specified protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to an embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a local area network (LAN) communication module, or a power line communication module). Among these communication modules, a corresponding communication module may be a first network 198 (eg, a short-range communication network such as Bluetooth, WiFi direct, or infrared data association (IrDA)) or a second network 199 (eg, a cellular network, the Internet, or It may communicate with an external electronic device via a computer network (eg, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified and authenticated.

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, RFIC) other than the radiator may be additionally formed as a part of the antenna module 197 .

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the

electronic devices

102 and 104 may be the same or a different type of the electronic device 101 . According to an embodiment, all or part of the operations performed by the electronic device 101 may be performed by one or more of the external

electronic devices

102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. The one or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

2 is a block diagram of an electronic device for controlling a background application according to an embodiment of the present invention.

Referring to FIG. 2 , the electronic device 200 (eg, the electronic device 101 of FIG. 1 ) may execute a plurality of applications stored in a memory 204 (eg, the memory 130 of FIG. 1 ). have. The electronic device 200 may display at least one of a plurality of applications being executed through the display 201 (eg, the display device 160 of FIG. 1 ). The electronic device 200 may display one application among the plurality of applications in a foreground state on the display. The application executed in the foreground state may be an application in a focusing state that is displayed through the display 201 and controlled based on a user input received by the electronic device 200 . Hereinafter, when various embodiments of the present invention are described, the application in the foreground state will be described as a foreground application. In the electronic device 200 , when the foreground application is executed or switched, a plurality of applications other than the foreground application may be executed or switched to a background state. The application executed or switched to the background state may be an application that is not in a focusing state that is not controlled based on a user input received by the electronic device 200 regardless of whether the application is displayed on the display 201 . Hereinafter, when describing various embodiments of the present invention, the application in the background state will be described as a background application. The data being executed in the foreground is not limited to the data related to the plurality of applications, and while being displayed on the display 201, focused content (text, image, video, icon or symbol) data.

According to an embodiment, while the electronic device 200 displays the foreground application on the display 201, through the sensor 202 (eg, the sensor module 176 of FIG. 1 ), the electronic device ( 200) may receive a user input that is not in contact. For example, the user input that is not in contact with the electronic device 200 may be a gesture, hovering, or proximity input. The electronic device 200 controls one of a plurality of background applications based on a user input that is not in contact with the electronic device 200 received through the sensor 202 . A user interface related to may be displayed on a designated area of the display 201 .

According to an embodiment, while the electronic device 200 displays the user interface in the designated area, another user input (eg, a user input that does not come into contact with the electronic device or a user interface through the sensor 202 ) user input detected on the screen) can be detected. The electronic device 200 may change the user interface to another user interface related to control of another background application among the plurality of background applications based on another user input detected through the sensor 202 . have. The electronic device 200 may detect another user input (eg, a user input not in contact with the electronic device or a user input detected on the user interface) while the other user interface is displayed in the designated area. The electronic device 200 may control the other background application running in the background based on the detected another user input.

The electronic device 200 includes the display 201 , the sensor 202 , a communication module 203 (eg, the communication module 190 of FIG. 1 ), and a memory 204 (eg, the memory 130 of FIG. 1 ). )) and a processor 205 (eg, the processor 120 of FIG. 1 ). However, the configuration of the electronic device 200 is not limited thereto. According to various embodiments, the electronic device 200 may omit at least one of the above-described components, and may further include at least one other component. For example, the electronic device 200 may include a speaker (eg, the sound output device 155 of FIG. 1 ).

When at least one of a plurality of applications installed in the electronic device 200 is executed, the display 201 may display the at least one executed application. The display 201 may display various contents (eg, text, image, video, icon or symbol) acquired through a wired/wireless network as well as the executed application. The display 201 may include a touch screen. For example, the display 201 may receive a touch, gesture, proximity, or hovering input using a body part of the user.

The sensor 202 may detect a user input that is in contact with or not in contact with the electronic device 200 . The sensor 202 may include at least one of a touch sensor, an image sensor, and a motion sensor. However, the configuration of the sensor 202 is not limited thereto. According to various embodiments, the sensor 202 may omit at least one of the above-described components, and may further include at least one other component. As an example, the sensor 202 may include a pressure sensor. The electronic device 200 may detect a user input through the sensor 202 and control at least one of the plurality of applications based on the detected user input. For example, the sensor 202 may detect a touch, gesture, proximity, or hovering input using a body part of a user who wants to control the plurality of applications.

The communication module 203 may support communication between the electronic device 200 and an external electronic device. According to an embodiment, data related to at least one application among the plurality of applications may be transmitted/received from the external electronic device through the communication module 203 . However, the function of the communication module 203 is not limited thereto. For example, the communication module 203 may transmit/receive a signal for controlling the at least one application from the external electronic device.

The memory 204 may store various data used by at least one component of the electronic device 200 . According to an embodiment, the memory 204 may store information related to the user interface displayed through the display 201 . Also, the memory 204 may store information related to a gesture for controlling at least one application among the plurality of applications. For example, the information related to the gesture may be information related to a shape of a gesture matched with a function of the application in order to execute a function of at least one of the plurality of applications.

The processor 205 may control at least one other component of the electronic device 200 and may process or operate various data. The processor 205 may execute a plurality of applications installed in the electronic device 200 .

According to an embodiment, the processor 205 may execute a plurality of applications stored in the memory 204 . The processor 205 may execute one of the plurality of applications as a foreground application (eg, a first application) in a focused state that can be controlled by a currently received user input. The processor 205 may display the foreground application on the display 201 . The processor 205 receives a user input (eg, a first user input) that is not in contact with the electronic device 200 through the sensor 202 while the foreground application is displayed on the display 201 . can do. The user input not in contact with the electronic device 200 may include a gesture, a hovering, and a proximity input. The processor 205 is configured to control a user interface (eg, a first application) related to control of one background application (eg, a second application) among the plurality of background applications running in the background based on the received user input. user interface) may be displayed on a designated area of the display 201 .

According to an embodiment, while the processor 205 displays the foreground application through the display 201 , the user interface may be displayed on a designated area of the display 201 . The processor 205 does not contact the electronic device 200 through the sensor 202 or the display 201 while displaying the user interface, or other user input detected on the user interface (eg, second 2 user input). The processor 205 may control the one background application based on the received other user input. When the other user input is an input that comes into contact with the electronic device 200 , the processor 205 determines that the pore is displayed on the display 201 based on another user input that comes into contact with the electronic device 200 . Ground applications can be controlled.

According to an embodiment, the other user input that is not in contact with the electronic device 200 or received on the user interface is not a user input for controlling the one background application, but a plurality of applications running in the background. Among them, it may be a user input for selecting another background application (eg, a third application). The processor 205 may receive the other user input (a user input not in contact with the electronic device or an input detected on a user interface) for switching to the other background application in order to control the another background application. can The processor 205 may change the user interface displayed in the designated area to another user interface (eg, a second user interface) related to control of the other application based on the received other user input. As an example, a user interface displayed on at least a partial area (eg, a designated area) of the upper end of the display 201 may be changed to another user interface.

According to an embodiment, the processor 205 may provide another user input (an input not in contact with the electronic device or an input detected on a second user interface) through the display 201 or the sensor 202 (eg: a third user input). Upon receiving the another user input, the processor 205 may control the another application based on the another user input.

As described above, according to various embodiments, the electronic device (eg, the electronic device 101 of FIG. 1 or the electronic device 200 of FIG. 2 ) may include a display (eg, the display device 160 of FIG. 1 or FIG. 2 ). display 201 of ), at least one sensor (eg, sensor module 176 of FIG. 1 or sensor 202 of FIG. 2 ), a processor (eg, processor 120 of FIG. 1 or processor 205 of FIG. 2 ) )), and a memory operatively coupled to the display, the sensor, and the processor (eg, the memory 130 of FIG. 1 or the memory 204 of FIG. 2 ), wherein the processor is installed in the electronic device. In a state in which a plurality of applications are executed, an execution screen of a first application among the plurality of applications is displayed on the display, a first user input not in contact with the electronic device is detected through the sensor, and the detected first user input is detected. Based on one user input, a first user interface related to control of a second application running in the background among the plurality of applications is displayed on a designated area of the display, and a second user input is received through the at least one sensor. detecting, and changing the first user interface to a second user interface related to control of a third application running in the background among the plurality of applications based on the detected second user input, and the at least one sensor When a third user input is detected through , control of the third application may be performed based on the third user input.

According to various embodiments, the first user interface includes an object representing first control information related to a function of the second application, and the second user interface includes a second control related to a function of the third application It may contain objects representing information.

According to various embodiments, the first control information may include an object guiding a fourth user input, and the second control information may include an object guiding the third user input.

According to various embodiments, the processor may divide and display each of the execution screens of the plurality of applications on the screen of the display, and may focus the execution screen of the first application.

According to various embodiments, when detecting the first user input, the processor may display the first user interface on the execution screen of the second application.

According to various embodiments, when detecting the second user input, the processor may display the second user interface on the execution screen of the third application.

According to various embodiments, the sensor may include at least one of a touch sensor, an image sensor, and a motion sensor.

As described above, according to various embodiments, the electronic device (eg, the electronic device 101 of FIG. 1 or the electronic device 200 of FIG. 2 ) may include a display (eg, the display device 160 of FIG. 1 or FIG. 2 ). display 201 of ), at least one sensor (eg, sensor module 176 of FIG. 1 or sensor 202 of FIG. 2 ), a processor (eg, processor 120 of FIG. 1 or processor 205 of FIG. 2 ) )), and a memory operatively coupled to the display, the sensor, and the processor (eg, the memory 130 of FIG. 1 or the memory 204 of FIG. 2 ), wherein the processor is installed in the electronic device. data related to the execution screen of the first application is transmitted to the external electronic device through the communication module, the execution screen of the second application installed in the electronic device is displayed on the display, and the electronic device is transmitted through the at least one sensor Detects a first user input that is not in contact with the device, and displays a first user interface related to control of the first application on a designated area of the display based on the detected first user input, and the at least one A second user input may be detected through a sensor, and a control signal for the first application may be transmitted to the external electronic device through the communication module based on the detected second user input.

According to various embodiments, the processor detects a third user input, and changes to a second user interface related to control of at least one third application installed in the electronic device based on the detected third user input and, in response to changing to the second user interface, data related to the execution screen of the third application may be transmitted to the external electronic device.

According to various embodiments, the processor divides and displays the execution screens of the first application, the second application, and the third application on the screen of the display, and focuses the execution screen of the second application )can do.

According to various embodiments, the processor may display the first user interface on the execution screen of the first application based on the detected first user input.

According to various embodiments, the processor may display the second user interface on the execution screen of the at least one third application based on the detected third user input.

Referring to FIG. 3 , in operation 301 , a processor (eg, the processor 120 of FIG. 1 or the processor of FIG. 2 ) of an electronic device (eg, the electronic device 101 of FIG. 1 or the electronic device 200 of FIG. 2 ) 205) may execute the plurality of applications based on data related to the plurality of applications stored in the memory of the electronic device (eg, the memory 130 of FIG. 1 or the memory 204 of FIG. 2). have. The processor may execute or switch one application among the plurality of applications to a foreground application in a focusing state controlled by a user input received by the electronic device. The processor may display the foreground application on a display of the electronic device (eg, the display device 160 of FIG. 1 or the display 201 of FIG. 2 ). The processor may execute or convert a plurality of applications other than the foreground application as a background application. The background application is an unfocused application other than a foreground application among a plurality of applications, and may be an application that is not controlled based on a user input received by the electronic device.

According to an embodiment, the processor may execute or switch a first application among a plurality of applications as a foreground application to be displayed in a focus state on the display. When the processor executes or switches the first application (eg, a foreground application), the processor may display the first application on the display.

In operation 303, if one of the plurality of applications is displayed as a foreground application through the display, the processor may execute or convert a plurality of applications excluding the foreground application as a background application.

In operation 305 , the processor may detect a user input that is not in contact with the electronic device 200 through a sensor of the electronic device (eg, the sensor module 176 or the sensor 202 of FIG. 1 ). The processor may display a user interface related to control of one background application among a plurality of background applications running in the background on the designated area of the display based on the detected user input.

According to an embodiment, the processor may receive a first user input (eg, a user input) that is an input (eg, a hovering input or a gesture) that is not in contact with the electronic device through the sensor. The processor is configured to control a first user interface (eg, one background application) related to control of a second application (eg, one background application) among a plurality of background applications running in the background of the display based on the received first user input. : user interface) can be displayed in a designated area of the display.

According to another embodiment, when the first user input is an input in contact with the electronic device (eg, a key input or a touch input), the processor performs the display on the basis of the first user input in contact with the electronic device. It is possible to control the first application being displayed through .

In operation 307, the processor is configured to receive another user input (a user input not in contact with the electronic device or a user input detected on the user interface) through the sensor or the display while the user interface is displayed in the designated area. can The processor may change the user interface displayed in the designated area to another user interface related to control of another background application among a plurality of background applications running in the background based on the received other user input. .

According to an embodiment, the processor may receive a second user input (a user input not in contact with the electronic device or a user input detected on the first user interface) through the sensor. The processor may change the first user interface displayed in the designated area to a second user interface (another user interface) based on the received second user input. The second user interface may be an interface related to control of a third application (another background application) among a plurality of applications running in the background of the display.

According to another embodiment, the second user input received by the processor may be a user input for controlling the second application, not a user input for controlling the third application. The operation of the processor determining whether to control the second application among the background applications or to call the second user interface for controlling the third application based on the received user input not in contact with the electronic device is illustrated in FIG. 6 . to be explained in detail in

In operation 309, the processor receives another user input (a user input not in contact with the electronic device or a user input detected on another user interface) through the display or the sensor while displaying the other user interface in the designated area. can receive

In operation 311, the processor may control the other background application running in the background of the display based on the received another user input.

According to an embodiment, the processor may receive a third user input (eg, another user input) through the sensor or the display. The processor may control a third application among a plurality of applications running in the background of the display based on the received third user input while displaying the second user interface.

According to another embodiment, the processor may control the third application by touch-inputting an object representing control information displayed on the second user interface. An object representing the control information will be described in detail with reference to FIG. 6 .

As described above, according to various embodiments of the present disclosure, in the method of operating an electronic device (eg, the electronic device 101 of FIG. 1 or the electronic device 200 of FIG. 2 ), a plurality of applications installed in the electronic device are executed. state, displaying an execution screen of a first application among the plurality of applications on a display (eg, the display device 160 of FIG. 1 or the display 201 of FIG. 2 ) of the electronic device, An operation of detecting a first user input that is not in contact with the electronic device through a sensor (eg, the sensor module 176 of FIG. 1 or the sensor 202 of FIG. 2 ), based on the detected first user input, Displaying a first user interface related to control of a second application running in the background among the plurality of applications in a designated area of the display, detecting a second user input through the sensor, and the detected second Changing the first user interface to a second user interface related to control of a third application running in the background among the plurality of applications based on a user input and detecting a third user input through the sensor, and performing control of the third application based on the third user input.

According to various embodiments, the displaying of the execution screen of the first application on the display of the electronic device includes dividing and displaying each of the execution screens of the plurality of applications on the screen of the display, and executing the first application An operation of focusing the screen may be further included.

According to various embodiments, the method of operating the electronic device may further include displaying the first user interface on an execution screen of the second application when the first user input is detected.

According to various embodiments of the present disclosure, the method of operating the electronic device may further include displaying the second user interface on an execution screen of the third application when the second user input is detected.

According to various embodiments, the first user interface includes an operation of displaying an object representing first control information related to a function of the second application, and the second user interface includes a function of the third application and a function of the third application. and displaying an object indicating related second control information.

Referring to FIG. 4 , in operation 401 , a processor (eg, the processor 120 of FIG. 1 or the processor of FIG. 2 ) of the electronic device (eg, the electronic device 101 of FIG. 1 or the electronic device 200 of FIG. 2 ) 205) may execute the plurality of applications based on data related to the plurality of applications stored in the memory of the electronic device (eg, the memory 130 of FIG. 1 or the memory 204 of FIG. 2). have. The processor may execute or switch one application among the plurality of applications to a foreground application in a focusing state controlled by a user input received by the electronic device. The processor may display the foreground application on the display of the electronic device (eg, the display device 160 of FIG. 1 or the display 201 of FIG. 2 ) in a focused state. The processor is communicatively connected to an external electronic device (eg, the

electronic device

102 or 104 of FIG. 1 ) through a communication module (eg, the communication module 190 of FIG. 1 or the communication module 203 of FIG. 2 ) data related to the execution screen of the foreground application being displayed through the display may be transmitted.

According to an embodiment, the processor may control a first application (eg, a foreground application) among a plurality of applications based on a received user input while displaying it on the display. The processor may transmit data related to an execution screen of the foreground application to the external electronic device through the communication module while displaying the foreground application through the display. The external electronic device may display the foreground application on the display of the external electronic device based on the received data related to the execution screen of the foreground application.

In operation 403, the processor of the electronic device may execute another application among the plurality of applications. When the processor executes the other application, the previously executed foreground application may be converted into a background application to be executed in the background. When the foreground application is switched to a background application, the processor may display the other application as a foreground application in a focus state through the display. That is, the processor displays the foreground application in a focused state through the display in order to control it based on a user input for receiving the other application, and releases the focus of the foreground application that is being displayed on the display; You can switch to a background application.

According to an embodiment, the processor may execute a second application among a plurality of applications. When the processor executes the second application, in order to display the second application in a focused state through the display, the processor may release the focusing state of the previously executed first application and switch to a background application. have. However, even when the first application is switched to a background application, the external electronic device may display an execution screen of the first application.

According to another embodiment, the operation 401 and the operation 403 may be performed in a state in which the execution order is reversed. The processor may execute a plurality of applications. The processor may display a second application among the plurality of executed applications as a foreground application in a focused state through the display.

The processor may transmit data related to an execution screen of a first application among the plurality of background applications being executed in a background to the external electronic device while displaying the second application through the display. have.

In operation 405 , the processor may detect a user input that is not in contact with the electronic device through a sensor (eg, the sensor module 176 or the sensor 202 of FIG. 1 ) of the electronic device. The processor may display a user interface related to control of one background application among the plurality of background applications running in the background on the designated area of the display based on the detected user input.

According to an embodiment, the processor may receive a first user input (eg, a user input) that is an input (eg, a hovering input or a gesture) that is not in contact with the electronic device through the sensor. The processor may display a first user interface related to control of a first application among a plurality of background applications running in the background of the display on a designated area of the display based on the received first user input. .

According to another embodiment, when the first user input is an input in contact with the electronic device, the processor is configured to perform the second application (eg, a foreground application) based on the first user input in contact with the electronic device can be controlled.

In operation 407, the processor may receive another user input through the display or the sensor while displaying the user interface in the designated area.

In operation 409, the processor may transmit a control signal for the one background application to the external electronic device through the communication module in response to the received other user input.

According to an embodiment, the processor of the electronic device may receive a second user input (eg, another user input) through the sensor or the display. While the processor displays a first user interface (eg, a user interface) in the designated area, a first application among a plurality of background applications running in the background of the display based on the received second user input can be controlled. The processor may transmit a control signal for controlling the first application displayed on the external electronic device to the external electronic device through the communication module in response to controlling the first application running in the background. have. When the second user input is a user input for adjusting the volume of the first application, the processor transmits a control signal for adjusting the volume of the first application output from the external electronic device to the external electronic device may control the volume of the first application being output from the external electronic device.

According to another embodiment, the processor may control the first application running in the background by touch-inputting an object representing control information displayed on the first user interface. The processor may control the first application that is running in the background based on an input of touching an object representing control information. In response to controlling the first application, the processor may transmit a control signal for controlling a volume function of the first application outputting a voice signal from the external electronic device to the external electronic device. An object representing the control information will be described in detail with reference to FIG. 6 .

Referring to FIG. 5 , in a state 510 , a processor (eg, the processor 120 of FIG. 1 or the processor of FIG. 2 ) of an electronic device (eg, the electronic device 101 of FIG. 1 or the electronic device 200 of FIG. 2 ) 205) may execute the plurality of applications based on data related to the plurality of applications stored in the memory of the electronic device (eg, the memory 130 of FIG. 1 or the memory 204 of FIG. 2). have. The processor may execute or switch one application among the plurality of applications to a foreground application in a focusing state controlled by a user input received by the electronic device. The processor may display at least a partial execution screen 500 of the foreground application through a touch screen of the electronic device (eg, the display device 160 of FIG. 1 or the display 201 of FIG. 2 ). While displaying the foreground application on the display, the processor may execute or switch a plurality of applications other than the foreground application to a background application that is not in a focus state.

As in the state 530 , the processor may receive an input 513 (eg, a key input or a touch input) that comes into contact with the electronic device through the touch screen. The processor may control the foreground application being displayed in a focused state on the touch screen based on the received input 513 that comes into contact with the electronic device.

According to an embodiment, the processor may execute or switch a first application among the plurality of applications to a foreground application to be displayed through the touch screen in a focused state. While the first application is displayed on the touch screen in a focused state, the processor may execute or switch the plurality of applications excluding the first application to a non-focused background application.

According to an embodiment, the processor may receive a first user input 513 through the touch screen. The processor is configured to generate a partial screen of the first application currently being displayed on the touch screen based on the received first user input 513 (a user input (eg, a key input or a touch input) contacting the electronic device). By scrolling 500 , another screen 531 may be displayed.

Also, the processor of the electronic device may display a sensor icon 512 indicating that a sensor (eg, the sensor module 176 or the sensor 202 of FIG. 1 ) is activated on at least a partial area of the touch screen. The processor may receive an input 511 (eg, gesture or hovering) that is not in contact with the electronic device through the sensor while the sensor icon 512 is displayed.

When the processor receives an input 511 that is not in contact with the electronic device through the sensor in state 550, a user input 511 that is not currently in contact with the electronic device is detected in at least a partial area of the touch screen A gesture icon 551 notifying the user may be displayed. The processor may control based on a user input detected on a user interface related to control of a background application running in the background while displaying the gesture icon 551 .

According to an embodiment, while the processor displays at least a partial screen 500 of a first application (eg, a foreground application), a second user input (eg, other user input). The processor may display a gesture icon 551 indicating that the second user input is being received on at least a partial area of the touch screen. The processor may control a second application among a plurality of applications running in the background based on the received second user input.

Referring to FIG. 6 , a processor (eg, the processor 120 of FIG. 1 or the processor of FIG. 2 ) of an electronic device 600 (eg, the electronic device 101 of FIG. 1 or the electronic device 200 of FIG. 2 ) 205)) may execute the plurality of applications based on data related to the plurality of applications stored in the memory of the electronic device (eg, the memory 130 of FIG. 1 or the memory 204 of FIG. 2 ). . The processor may execute or switch one application among the plurality of applications to a foreground application in a focusing state controlled by a user input received by the electronic device. The processor displays at least a partial execution screen 610 of the foreground application (eg, at least a partial execution screen 500 of the first application of FIG. 5 ) on the touch screen of the electronic device (eg, the display device 160 of FIG. 1 ). ) or on the display 201 of FIG. 2 ). As the processor executes or switches the foreground application, the processor may execute or switch a plurality of applications other than the foreground application to a background application that is not in a focused state.

The processor may detect a user input that is not in contact with the electronic device 600 through a sensor of the electronic device (eg, the sensor module 176 or the sensor 202 of FIG. 1 ). The processor displays a user interface 650 related to control of one background application among a plurality of background applications running in the background based on the detected user input not in contact with the electronic device on the designated area of the display. can be displayed

According to an embodiment, the user interface 650 includes an icon 651 of the one background application, title information 652 of the one background application, an object 653 representing control information, and the one background application. At least one of guide icons 654 for controlling a background application may be included. The icon 651 of the one background application may be an icon representing a background application installed in the electronic device. The title information 652 of the one background application may be the title of the one background application installed in the electronic device or the title of content being executed in the one background application.

According to an embodiment, the object 653 representing the control information is an object corresponding to at least one function included in the second application (another background application), and the user is an object representing the control information ( 653), it is possible to check which function among the functions included in the second application is to be controlled. For example, the object 653 representing the control information may represent a volume control function, a rewind function, a fast forward function, and a stop function of the second application. In addition, the object 653 representing the control information is a swap for changing the first user interface 650 to a second user interface related to the control of the third application in order to control a third application instead of the second application. (swap) may contain an object representing a function.

According to an embodiment, the guide icon 654 for controlling the second application may include an object guiding each function of the second application in order to control the functions of the second application. For example, the guide icon 654 may be an icon indicating a shape of a gesture matched with a function of the second application. When the processor detects a gesture (user input) similar to the shape of the guide icon 654 for controlling the second application through the sensor, the processor determines the function of the second application matching the detected guide icon. can run

Referring to FIG. 7 , in a state 710 , a processor (eg, the processor 120 of FIG. 1 or FIG. 2 ) of the electronic device 700 (eg, the electronic device 101 of FIG. 1 or the electronic device 200 of FIG. 2 ) The processor 205 of the may receive user input. The processor of the electronic device is a user contacting the electronic device 700 such as a key input or a touch input through a touch screen 711 (eg, the display device 160 of FIG. 1 or the display 201 of FIG. 2 ). input can be received. Also, the processor of the electronic device 700 may receive a user input that is not in contact with the electronic device 700 through the touch screen 711 .

In state 730 , the processor of the electronic device 700 may receive a user input that is not in contact with the electronic device 700 in at least a partial area 731 of the touch screen 711 . For example, the processor of the electronic device 700 detects a user input that is not in contact with the electronic device 700 based on a change in capacitance sensed in at least a partial region 731 of the touch screen 711 . can do.

In state 750 , when the processor of the electronic device 700 receives a user input that is not in contact with the electronic device 700 in at least a partial area 731 of the touch screen 711 , the touch screen 711 is displayed. may display a gesture icon 752 and a processing object 751 . The gesture icon 752 and the processing object 751 may be other types of user interfaces displayed on at least a portion of the touch screen 711 . The gesture icon 752 may be an icon indicating that the electronic device 700 is currently receiving a user input that is not in contact with the electronic device 700 . The processing object 751 may be an object indicating the progress of a task performed based on a user input that is not in contact with the received electronic device 700 . The color of the processing object 751 may be changed according to the progress of the work being performed, and the shape of the processing object 751 may be changed.

Referring to FIG. 8 , in state 810 , a processor (eg, the processor 120 of FIG. 1 or the processor of FIG. 2 ) of the electronic device (eg, the electronic device 101 of FIG. 1 or the electronic device 200 of FIG. 2 ) 205) may execute the plurality of applications based on data related to the plurality of applications stored in the memory of the electronic device (eg, the memory 130 of FIG. 1 or the memory 204 of FIG. 2). have. The processor may execute or switch one application among the plurality of applications to a foreground application in a focusing state controlled by a user input received by the electronic device. The processor may display the executed foreground application on the display of the electronic device (eg, the display device 160 of FIG. 1 or the display 201 of FIG. 2 ). The processor may execute or switch a plurality of applications other than the foreground application to a background application that is not in a focused state.

According to an embodiment, the processor may designate a first application among a plurality of applications as a foreground application to be displayed on the display in a focused state. The first application may be an application that is displayed on the display in a focused state and can be controlled based on a user input received by the processor. When the processor selects the first application as a foreground application, the plurality of applications other than the first application may be switched or executed as a background application.

The processor may display the foreground application through the display. When the processor receives a user input (eg, a gesture or a hovering input) that is not in contact with the electronic device for a specified time in the vicinity of the electronic device through the sensor while displaying the foreground application, at least A sensor icon 811 may be displayed in some area. The sensor icon 811 may be an icon indicating that the sensor can detect an input that is not in contact with the electronic device.

In state 830 , the processor may receive a user input that is not in contact with the electronic device through the sensor while the sensor icon 811 is displayed on at least a partial area of the display. The processor uses a user interface 831 (eg, the user interface 650 of FIG. 6 ) related to control of one background application among the plurality of background applications based on the received user input not in contact with the electronic device. may be displayed on a designated area of the display. The user interface 831 may include at least one of an icon of one background application, title information of one background application, an object representing control information, and a guide icon for controlling one background application. .

According to an embodiment, while the processor displays the first application in the focusing state through the display, a first user input that is not in contact with the electronic device may be received through the sensor. The processor may display a first user interface 831 related to control of a second application among a plurality of background applications on a designated area of the display based on the received first user input. The processor may display the icon of the second application through the first user interface 831 . The processor may display a title (eg, My station) of the content being reproduced by the second application through the user interface 831 . The processor may display an object representing control information of the second application. The object representing the control information may be an object representing a volume control function, a rewind function, a fast forward function, and/or a stop function, which are functions of the second application.

According to an embodiment, the processor may display a guide icon for controlling a second application through the first user interface 831 . The guide icon may be a gesture icon matched with the function of the second application in order to control the function of the second application. When receiving a shape of a gesture similar to the guide icon through the sensor, the processor may control a function of a second application matching the shape of the gesture.

In state 850 , the processor may receive another user input 852 through the sensor. The other user input 852 may include a user input not in contact with the electronic device or a user input detected on the user interface 831 .

In state 870 , the processor may control the one background application running in the background based on the received other user input 852 . In response to increasing the sound of the one background application, the processor may display an object 871 representing the sound of the one background application on at least a partial area of the display.

According to an embodiment, the processor is configured to detect a second user input 852 (a user input not in contact with the electronic device or a user input detected on the first user interface) for controlling the second application through the sensor. can The processor may control the second application among a plurality of background applications based on the detected second user input 852 . When the received second user input 852 is a user input for selecting a guide icon matched with a sound increasing function among functions of the second application, the processor is configured to provide a sound of content being played by the second application. can increase The processor may display an object 871 indicating a sound level of the content on at least a partial area of the display in response to increasing the sound of the content being reproduced by the second application.

Referring to FIG. 9 , in state 910 , a processor (eg, the processor 120 of FIG. 1 or the processor of FIG. 2 ) of the electronic device (eg, the electronic device 101 of FIG. 1 or the electronic device 200 of FIG. 2 ) 205) may execute the plurality of applications based on data related to the plurality of applications stored in the memory of the electronic device (eg, the memory 130 of FIG. 1 or the memory 204 of FIG. 2). have. The processor may execute or switch one application among the plurality of applications to a foreground application in a focusing state controlled by a user input received by the electronic device. The processor displays the foreground application in a focused state through a display of the electronic device (eg, the display device 160 of FIG. 1 or the display 201 of FIG. 2 ), so as to receive the user input received by the electronic device. can be controlled based on The processor may execute or switch the plurality of applications other than the foreground application from the unfocused background to the unfocused state.

According to an embodiment, the processor may execute or switch a first application among a plurality of applications to a foreground application to be displayed through the display in a focused state. The processor may execute or convert the plurality of applications other than the first application to an unfocused background application. When the processor detects a user input (eg, a gesture or a hovering input) that has not touched the electronic device for a specified period of time in the vicinity of the electronic device through the sensor, a sensor icon 911 is displayed on at least a partial area of the display. can be displayed The sensor icon 911 may be an icon indicating that the sensor can detect a user input that is not in contact with the electronic device.

In state 930 , the processor may receive a user input that is not in contact with the electronic device through the sensor while the sensor icon 911 is displayed on the display. The processor displays a user interface 931 (eg, the user interface 650 of FIG. 6 ) related to control of one background application among the plurality of background applications based on the received user input on the designated area of the display. can be displayed in The user interface 931 may include at least one of an icon of the one background application, title information of the one background application, an object representing control information, and a guide icon for controlling the one background application. can

According to an embodiment, the processor may receive a first user input that is not in contact with the electronic device through the sensor while the first application is displayed on the display. The processor may display a first user interface 931 related to control of a second application among the background applications through a designated area of the display based on the received first user input. The processor may display first control information 932 related to a function of the second application on the first user interface 931 . The processor may display a title (eg, Black Car) of the content being reproduced by the second application through the first user interface 931 . The object representing the first control information may be an object representing a volume control function, a rewind function, a fast forward function, and/or a stop function, which are functions of the second application.

In the 930 state, the processor determines that while the user interface 931 is displayed on the designated area of the display, other user input (user input not in contact with the electronic device or user input detected on the user interface) through the sensor or the display ) can be received. The processor may control the one background application based on the received other user input. However, the received other user input may be an input for selecting another background application in order to control another background application among the plurality of background applications. When the form of the other user input detected through the sensor is similar to the form indicated by the control information of the function of changing the one background application to the other background application, the processor displays the user interface 931 to the other user. It can be changed to the interface 951 . The processor may obtain a user input (gesture) through the sensor, and identify a form of the acquired user input based on characteristic points of the acquired user input (eg, edge points of a gesture).

According to an embodiment, the processor may display a first user interface 931 related to control of the second application in a designated area of the display. The processor may receive a second user input (a user input not in contact with the electronic device) through the sensor while the first user interface 931 is displayed. The processor may extract feature points of the second user input received through the sensor, and identify the shape of the second user input (gesture) based on the extracted feature points.

According to an embodiment, the processor may compare the identified shape of the second user input with the shape of the guide icon included in the first control information 932 displayed on the first user interface 931 . The guide icon may be an icon matching the function of changing from the second application to the third application. When the shape of the second user input is similar to the shape indicated by the guide icon, the processor selects a function matching the guide icon (selecting an application to be controlled as a video playback application (third application)) can run The processor may change the first user interface 931 related to the control of the second application displayed in the designated area of the display to the second user interface 951 related to the control of the third application.

In state 950, the processor may display another user interface 951 related to control of another background application among a plurality of background applications in a designated area of the display. The processor may receive a user input 952 through the sensor while displaying the other user interface 951 . The processor may control another background application of the electronic device based on the received third user input 952 . When the received user input 952 is an input for increasing the volume of the other background application, the processor may increase the volume of the other background application.

In state 970, the processor may control the other background application based on the received user input 952 and display an object 971 indicating that the other background application is being controlled.

According to an embodiment, the processor may display a second user interface 951 related to control of a third application (other background application) in a designated area of the display. The processor may receive a third user input 952 through the sensor while displaying the second user interface 951 . The third user input 952 may be an input that is not in contact with the electronic device (eg, a gesture or a hovering input), and an input detected on the area of the second user interface 951 (eg, a key input or a touch input). ) can be When the received third user input 952 is an input for increasing the volume of another background application among the plurality of background applications, the processor determines the other background application based on the third user input 952 . can increase the volume of

According to an embodiment, the processor may display an object 971 indicating a volume gauge of the other background application on at least a partial area of the display in response to increasing the volume of the other background application. The object 971 may be an object related not only to the volume gauge but also to the function being controlled when the function of one of a plurality of applications running in the background is controlled based on the user input received by the processor. have.

Referring to FIG. 10 , in a state 1010 , a processor (eg, the processor 120 of FIG. 1 or FIG. 1 ) of the electronic device 1000 (eg, the electronic device 101 of FIG. 1 or the electronic device 200 of FIG. 2 ) The processor 205 of 2 ) based on data related to a plurality of applications stored in the memory (eg, the memory 130 of FIG. 1 or the memory 204 of FIG. 2 ) of the electronic device 1000 , Multiple applications can be executed. The processor may execute or switch one application among the plurality of applications to a foreground application in a focusing state controlled by a user input received by the electronic device. The processor may display the foreground application on the display of the electronic device 1000 (eg, the display device 160 of FIG. 1 or the display 201 of FIG. 2 ). While displaying the foreground application on the display in a focused state, the processor may execute or convert a plurality of applications excluding the foreground application to the non-focused background application.

According to an embodiment, the processor may receive a user input through a sensor (eg, the sensor module 176 of FIG. 1 or the sensor 202 of FIG. 2 ). The user input may be a user input that is in contact with or not in contact with the electronic device. The processor may receive a user input that is an input (eg, a gesture or a hovering input) that is not in contact with the electronic device through the sensor (eg, an image sensor). The processor may receive a user input that is not in contact with the electronic device when the sensor is being activated. The processor may display a sensor icon 1001 (eg, the sensor icon 512 of FIG. 5 ) indicating that the sensor is being activated on at least a partial area of the display.

According to an embodiment, the processor may receive a first user input (a user input not in contact with the electronic device) while the sensor icon 1001 is displayed. When the processor receives the first user input through the sensor, the processor generates a gesture icon 1002 (eg, a gesture icon 551 in FIG. 5 ) indicating that a user input that is not in contact with the electronic device is being received. can be displayed on the display. The gesture icon 1002 may be an icon displayed when the processor receives an input that is not in contact with the electronic device 1000 through the sensor. The gesture icon 1002 may be another type of user interface.

According to an embodiment, when the first user input is an input for terminating the activation of the sensor, the processor may prevent the sensor icon 1001 and the gesture icon 1002 from being displayed on the display as in the state 1030. can

According to another embodiment, the processor may re-activate the sensor (eg, an image sensor). The processor may re-activate the sensor when a gesture for activating the sensor is received near the sensor through another sensor (eg, a motion sensor) or when a gesture maintained for a specified time or longer is received. The processor may control the other sensor to maintain activation of the other sensor when the power of the electronic device 1000 is in an on state, and may not separately display the sensor icon 1001 .

Referring to FIG. 11 , in a state 1110 , a processor (eg, the processor 120 of FIG. 1 or FIG. 1 ) of an electronic device 1111 (eg, the electronic device 101 of FIG. 1 or the electronic device 200 of FIG. 2 ) The processor 205 of 2 ) based on data related to a plurality of applications stored in the memory (eg, the memory 130 of FIG. 1 or the memory 204 of FIG. 2 ) of the electronic device 1111 , Multiple applications can be executed. The processor may execute or switch one application among the plurality of applications to a foreground application in a focusing state controlled by a user input received by the electronic device. The processor may display the foreground application in a focused state through a display (eg, the display device 160 of FIG. 1 or the display 201 of FIG. 2 ).

According to an embodiment, while the processor displays at least a partial area 1112 of the execution screen of the foreground application on the display, the execution screen of one background application among a plurality of background applications excluding the foreground application data related to the external electronic device 1115 (eg, the

electronic device

102 or 104 of FIG. 1) through a communication module (eg, the communication module 190 of FIG. 1 or the communication module 203 of FIG. 2) can be transmitted The processor may transmit/receive data through the communication module using a wired/wireless network. The wired/wireless network may include at least one of wifi-direction, Bluetooth, near field communication (NFC), and universal serial bus (USB), but is not limited thereto. The one background application may be an application that is not in a focused state and is not controlled by a user input received by the processor.

According to an embodiment, in the state 1130 , the processor of the electronic device 1111 may receive a user input 1113 that is not in contact with the electronic device 1111 through the sensor. Upon receiving the user input 1113 , the processor of the electronic device 1111 may display a user interface related to control of one background application among a plurality of background applications on a designated area of the display. While the processor of the electronic device 1111 outputs a user interface related to control of the one background application, another user input (a user input not in contact with the electronic device or a user detected on the user interface) through the sensor or display input) can be received. The processor of the electronic device may control the one background application based on the received other user input.

According to an embodiment, when the other user input received by the processor of the electronic device 1111 is an input for adjusting the volume of the one background application, the processor of the electronic device 1111 is the one back You can adjust the volume of the ground application. As the volume of the one background application is adjusted, the processor may display an object 1132 related to the volume of the one background application on at least a partial area of the display of the electronic device 1111 .

The processor displays an execution screen of the one background application in response to adjusting the volume of the one background application based on a user input 1113 that is not in contact with the electronic device 1111 A signal to adjust the volume may be transmitted to the external electronic device 1115 through the communication module. The external electronic device 1115 displays a separate object 1131 corresponding to the object 1132 on the display of the external electronic device 1115 based on the received signal, while the external electronic device 1115 It is possible to control the volume of the one background application displayed by .

According to an embodiment, in the 1150 state, the processor receives a user input contacting the electronic device 1111 through a sensor (eg, the sensor module 176 of FIG. 1 or the sensor 202 of FIG. 2 ) or the display. (1114) can be received. The processor may control a foreground application displayed through the display of the electronic device 1111 based on the received user input 1114 contacting the electronic device 1111 . For example, when the user input 1114 contacting the received electronic device 1111 is an input for scrolling a part of a screen of a foreground application displayed through the display, the processor Based on the user input 1114 in contact with 1111 , the screen of the foreground application may be scrolled. Since the processor controls a foreground application displayed in a focused state on the display based on a user input 1114 contacted to the electronic device 1111 , the external electronic device 1115 displaying the background application ) may not separately transmit a signal to control the background application.

Referring to FIG. 12 , in a state 1210 , a processor (eg, the processor 120 of FIG. 1 or the processor of FIG. 2 ) of an electronic device (eg, the electronic device 101 of FIG. 1 or the electronic device 200 of FIG. 2 ) 205) may execute the plurality of applications based on data related to the plurality of applications stored in the memory of the electronic device (eg, the memory 130 of FIG. 1 or the memory 204 of FIG. 2). have. The processor may display the plurality of executed applications through a divided screen (eg, a multi-window) of the display (eg, the display device 160 of FIG. 1 or the display 201 of FIG. 2 ).

According to an embodiment, in the 1210 state, the processor executes each of the first application 1213 , the second application 1214 , the third application 1215 , and the fourth application 1216 among the plurality of applications, so that the It can be displayed through the split screen of the display. The processor may designate the first application 1213 as a foreground application in a focused state. As the processor designates the first application 1213 as a foreground application, the applications (the second application 1214 and the third application 1215) except for the first application 1213 (foreground application). and the fourth application 1216) may be designated as a background application. The processor may apply a graphic effect 1211 for distinguishing a foreground application (eg, the first application 1213 ) and the

background applications

1214 , 1215 , and 1216 to at least a partial area of the display. For the graphic effect, a color shading may be applied to a screen border displaying the foreground application 1213 , or a semi-transparent effect may be applied to the

background applications

1214 , 1215 and 1216 , and the focused Various graphic effects that can distinguish applications can be applied.

According to an embodiment, in the processor, a sensor (eg, the sensor module 176 or the sensor 202 of FIG. 1 ) is activated on a screen on which the foreground application (the first application 1213 ) in the focusing state is displayed. A sensor icon 1212 indicating that it has been completed may be displayed. The processor may receive a user input (eg, a first user input) that is not in contact with the electronic device through the sensor while the sensor icon 1212 is activated. The user input not in contact with the electronic device may be a gesture input or a hovering input. The processor is related to the control of one of the background applications (the second application 1214) among the applications being displayed on one of the divided screens of the display based on the received user input not in contact with the electronic device. A user interface 1231 (eg, a first user interface) may be displayed. The second application 1214 may be one background application among a plurality of background applications. The processor may display the user interface 1231 on at least a partial area of the execution screen of the second application 1214 .

In state 1230 , the processor may receive another user input (eg, a second user input) while displaying the user interface 1231 . The other user input may be an input not in contact with the electronic device or a user input detected on a user interface related to control of the second application 1214 .

The processor may control the one background application (the second application 1214 ) based on the received other user input. When the other user input received by the processor is an input for controlling a volume function of the one background application (second application 1214), the processor processes the one background application (second application 1214). ) can be controlled. On the other hand, the other user input received by the processor may be a user input for controlling another background application (the third application 1215 ) among applications being displayed on the divided screen of the display. When the processor receives the user input for selecting the other background application to control the other background application, the processor is related to the control of the other background application in at least a partial area of a screen displaying the other background application. Another user interface 1251 may be displayed.

According to another embodiment, while the user interface 1231 is displayed, the processor may receive a user input (eg, a key input or a touch input) that is a user input that comes into contact with the electronic device. The processor may control the foreground application (the first application 1213 ) being displayed in a focused state through the display based on the received user input contacting the electronic device.

In state 1250, the processor may receive another user input (eg, a third user input) through the sensor or the display. The another user input may be a user input not in contact with the electronic device or a user input detected on the other user interface.

According to an embodiment, when the other user input received by the processor is an input related to a function of adjusting the volume of the other background application, the processor is configured to perform the other background application based on the other user input. You can control the volume of the application.

In state 1270, in response to controlling the volume of the other background application (the third application 1215) based on the received another user input, the processor performs at least a screen displayed on the display of the electronic device. A volume gauge object 1271 may be displayed in a partial area. The volume gauge object 1271 may be another form of the user interface.

Referring to FIG. 13A , a processor (eg, the processor 120 of FIG. 1 or the processor 205 of FIG. 2 ) of an electronic device (eg, the electronic device 101 of FIG. 1 or the electronic device 200 of FIG. 2 ) may execute the plurality of applications based on data related to the plurality of applications stored in the memory of the electronic device (eg, the memory 130 of FIG. 1 or the memory 204 of FIG. 2 ). The processor may display the plurality of executed applications on each of the divided screens of the display (eg, the display device 160 of FIG. 1 or the display 201 of FIG. 2 ). The processor is configured to display execution screens of the first application 1313 , the second application 1314 , the third application 1315 , and the fourth application 1316 among the plurality of applications through each of the divided screens of the display. can The processor selects the first application 1312 from among the plurality of applications (a first application 1313 , a second application 1314 , a third application 1315 , and a fourth application 1316 ) in a focusing state. It can be specified as a foreground application. The processor is configured to display a sensor icon 1312 indicating that a sensor (eg, the sensor module 176 of FIG. 1 or the sensor 202 of FIG. 2 ) is activated on at least some of the screens on which the execution screen of the focused first application is displayed. ) can be displayed. Also, the processor may apply a graphic effect to at least a partial area of the display to distinguish a foreground application from a background application that is not in a focused state.

According to an embodiment, the processor of the electronic device may receive a user input that is not in contact with the electronic device through the sensor. The user input not in contact with the electronic device may include one of a gesture input and a hovering input. The processor may display the user interface 1317a on the execution screen of one of the plurality of background applications based on the received user input that is not in contact with the electronic device. The user interface 1317a may be an interface related to control of one background application among a plurality of background applications selected based on a user input that is not in contact with the electronic device. The processor may transmit data related to an execution screen of one of the background applications to be controlled through the user interface 1317a to the external electronic device 1320 .

According to an embodiment, the processor may receive a first user input (input not in contact with the electronic device) through the sensor. The processor may display a first user interface related to control of a second application among a plurality of background applications in a designated area of the display based on the received first user input. For example, the processor may display the first user interface on an upper region of the display. As another example, the processor may display the first user interface on an execution screen of a second application to be controlled through the first user interface. The processor may transmit data related to an execution screen of a second application to be controlled through the first user interface to the external electronic device 1320 .

Referring to FIG. 13B , the processor may receive another user input through the sensor. The other user input may be a user input not in contact with the electronic device or a user input detected on the user interface 1317a. Also, the other user input may be a user input for selecting another background application to control another background application (eg, the third application 1315) among the plurality of background applications. The processor may change the user interface 1317a to another user interface 1317b based on the received other user input and display it through a designated area of the display. For example, the processor may display the other user interface 1317b on the execution screen of the other background application to be controlled through the other user interface 1317b. As the user interface 1317a is changed to the other user interface 1317b, the processor may transmit data related to the execution screen of the other background application to the external electronic device 1320 through the communication module. .

According to an embodiment, the processor may receive a second user input (a user input not in contact with the electronic device or a user input detected on the first user interface) through the sensor. The processor may display a second user interface 1317b related to control of a third application (another background application) among a plurality of background applications based on the received second user input. The processor may display the second user interface 1317b on the execution screen of the third application. The processor may transmit data related to the execution screen of the third application to the external electronic device 1320 through the communication module in response to displaying the second user interface 1317b.

Referring to FIG. 13C , the processor may receive another user input (eg, a third user input) through the sensor. The other user input may be a user input not in contact with the electronic device or a user input detected on the other user interface 1317b. The processor may control one of the functions of the other background applications included in the other user interface 1317b based on the received another user input. The processor may receive the other user input similar to the shape of the guide icon matched with the function of the other background application among the control information of the other user interface 1317b. For example, the processor determines that the detected form of another user input matches the function of adjusting the volume of the other background application among the control information displayed through the other user interface 1317b. Similarly to , it is possible to adjust the volume of the other background application.

The processor may display a volume gauge object 1317c related to volume control of the other background application in response to adjusting the volume of the other background application. The processor may transmit a signal to control the volume of another background application displayed by the external electronic device 1320 to the external electronic device 1320 in response to adjusting the volume of the other background application. . The external electronic device 1320 receiving the signal may display a separate object 1321 corresponding to the volume gauge object 1317c.

According to an embodiment, the processor may receive a third user input through the sensor. The processor may control a function of the third application based on a third user input. When the third user input is an input for controlling the volume of the third application, the processor is configured to display a volume gauge object related to the volume of the third application through the display while adjusting the volume of the third application. can The processor may transmit a signal to control the volume of the third application to the external electronic device in response to controlling the volume of the third application in the shopping mall. The external electronic device may adjust the volume of the displayed third application based on the received signal.

Electronic devices according to various embodiments disclosed in this document may be devices of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of this document is not limited to the above-described devices.

The various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first", "second" may simply be used to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to various embodiments of the present disclosure, one or more stored in a storage medium (eg, the internal memory 136 or the external memory 138 ) readable by a machine (eg, the electronic device 101 ) It may be implemented as software (eg, program 140) including instructions. For example, the processor (eg, the processor 120 ) of the device (eg, the electronic device 101 ) may call at least one of one or more instructions stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the at least one command called. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term refers to the case where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to an embodiment, the method according to various embodiments disclosed in this document may be provided by being included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, omitted, or , or one or more other operations may be added.

Claims

In an electronic device,

display;

at least one sensor;

processor; and

a memory operatively coupled to the display, the at least one sensor, and the processor;

The processor is:

displaying an execution screen of a first application among the plurality of applications on the display in a state in which a plurality of applications installed in the electronic device are executed;

detecting a first user input that is not in contact with the electronic device through the at least one sensor,

based on the detected first user input, displaying a first user interface related to control of a second application running in the background among the plurality of applications on a designated area of the display;

detecting a second user input through the at least one sensor,

changing the first user interface to a second user interface related to control of a third application running in the background among the plurality of applications based on the detected second user input;

When a third user input is detected through the at least one sensor, the electronic device controls the third application based on the third user input.
According to claim 1,

The first user interface includes an object representing first control information related to a function of the second application,

The second user interface includes an object representing second control information related to a function of the third application.
3. The method of claim 2,

The first control information includes an object for guiding a fourth user input,

The second control information includes an object for guiding the third user input.
According to claim 1,

The processor is

The electronic device divides and displays each of the execution screens of the plurality of applications on the screen of the display, and focuses the execution screen of the first application.
5. The method of claim 4,

The processor is

When detecting the first user input, the electronic device displays the first user interface on an execution screen of the second application.
6. The method of claim 5,

The processor is

When detecting the second user input, the electronic device displays the second user interface on an execution screen of a third application.
According to claim 1,

the at least one sensor,

An electronic device comprising at least one of a touch sensor, an image sensor, and a motion sensor.
In an electronic device,

display;

at least one sensor;

communication module;

processor; and

a memory operatively coupled to the display, the at least one sensor, the communication module, and the processor;

The processor is:

transmitting data related to an execution screen of a first application installed in the electronic device to an external electronic device through the communication module;

displaying an execution screen of a second application installed in the electronic device on the display;

detecting a first user input that is not in contact with the electronic device through the at least one sensor,

based on the detected first user input, displaying a first user interface related to control of the first application in a designated area of the display;

detecting a second user input through the at least one sensor,

An electronic device that transmits a control signal for the first application to the external electronic device through the communication module based on the detected second user input.
9. The method of claim 8,

The processor is

detecting a third user input;

changing to a second user interface related to control of at least one third application installed in the electronic device based on the detected third user input;

In response to changing to the second user interface, the electronic device transmits data related to the execution screen of the third application to the external electronic device.
10. The method of claim 9,

The processor is

The electronic device divides and displays the execution screens of the first application, the second application, and the third application on the screen of the display, and focuses the execution screen of the second application.
A method of operating an electronic device, comprising:

displaying an execution screen of a first application among the plurality of applications on a display of the electronic device while a plurality of applications installed in the electronic device are running;

detecting a first user input that is not in contact with the electronic device through a sensor of the electronic device;

displaying a first user interface related to control of a second application running in a background among the plurality of applications on a designated area of the display based on the detected first user input;

detecting a second user input through the sensor;

changing the first user interface to a second user interface related to control of a third application running in a background among the plurality of applications based on the detected second user input; and

and performing control on the third application based on the third user input when detecting a third user input through the sensor.
12. The method of claim 11,

The operation of displaying the execution screen of the first application on the display of the electronic device includes:

The method of operating an electronic device further comprising: dividing and displaying each of the execution screens of the plurality of applications on the screen of the display, and focusing the execution screen of the first application.
13. The method of claim 12,

and displaying the first user interface on an execution screen of the second application when the first user input is detected.
14. The method of claim 13,

and displaying the second user interface on an execution screen of the third application when the second user input is detected.
12. The method of claim 11,

The first user interface includes an operation of displaying an object representing first control information related to a function of the second application,

and displaying, in the second user interface, an object representing second control information related to a function of the third application.