KR20210129575A - Vehicle infotainment apparatus using widget and operation method thereof - Google Patents

Abstract

Disclosed are an infotainment device for a vehicle using a widget and an operation method thereof. According to various embodiments, it is possible to provide a simple control function and information by displaying some UIs of functions, running in background, as a background widget in an area that is always accessible within a screen of an infotainment device. The present invention relates to a computer readable storage medium storing one or more programs that are included in a vehicle. The one or more programs, when executed by at least one processor of an electronic device having a display, display the execution screen of a first application, display a first executable object, display the execution screen of a second application, display a second executable object, and display, through a second executable element, at least one visual item available.

Description

Infotainment device for vehicle using widget and method of operation thereof {VEHICLE INFOTAINMENT APPARATUS USING WIDGET AND OPERATION METHOD THEREOF}

The following description relates to an infotainment device for a vehicle using a widget and an operating method thereof.

An infotainment device for a vehicle combines IT technology with a vehicle, and can implement information and entertainment functions within the vehicle.

Recently, in-vehicle infotainment devices include media (music, video, etc.) playback as well as an environment in which a platform for the use of an Internet environment or application programs is mounted.

Due to the development of technologies and trends of infotainment devices for vehicles, ease of use for various sub-tasks other than route guidance in a driving environment is required.

Meanwhile, as ADAS (Advanced Driver Assistance System) technology develops in vehicle navigation systems, information to be delivered to drivers is diversifying.

Existing infotainment devices provide information by switching to a new work screen or dividing the screen to perform a task different from the currently displayed screen. This way of expression complicates the screen and makes the driver unable to focus on any other task as well as the driving task that should be given the highest priority.

Although there is a form that provides route information on the execution screen of tasks other than navigation, there is a limitation in that it is briefly exposed and then disappears because it covers a part of the screen.

There is also a form in which the background or sub-task window is divided into small screens and provided together with the main screen. .

In addition, the existing ADAS notification system has a limitation in expressing the situation for only one event when multiple events occur at the same time, but it is expected that the number of notifications provided by ADAS will increase with the development of ADAS technology.

ADAS notifications are usually implemented in a form that covers the center of the screen, so there is a clear disadvantage that graphic notifications cover the route guidance screen. ADAS notifications are notifications that must be given in a dangerous situation, but there are notifications that are displayed unnecessarily depending on the driving situation, contrary to the design intent.

In case another event is detected in the middle of ADAS notification being displayed, the existing notification being displayed is maintained and the event detected subsequently is displayed after the predetermined display time of the existing notification is over, and the event notification is There is a method of ignoring secondary events that occurred during the process.

In the former method, if the display time of the notification is long, a late event may cause confusion due to a large time difference from the actual occurrence time. On the contrary, if the display time is too short, it is difficult to properly recognize the previous event. Since the latter method usually does not inform the event itself including sound, there is a problem that may cause a dangerous situation to the driver.

An infotainment device according to various embodiments of the present disclosure includes at least one processor implemented to execute computer readable instructions included in a memory, and the at least one processor includes a navigation function and a function of any one of a plurality of other functions. When at least one other function is executed in the background in addition to the function currently running in the foreground in the context of being executed in the foreground, it is maintained in an active state along with the foreground execution screen and placed in an area that can be accessed at all times. The process of displaying an interface related to a function running in the background in the form of a widget can be processed.

In the infotainment operating method according to various embodiments, when at least one other function is executed in the background in addition to the function being executed in the foreground in a situation in which any one of a navigation function and a plurality of other functions is executed in the foreground, The method may include displaying an interface related to a function running in the background in the form of a widget on an area that is always accessible by maintaining an active state together with the foreground execution screen.

According to various embodiments of the present disclosure, even if the user or a passenger manipulates the screen for other tasks while driving, it is possible to always focus on driving information. In addition, when working with media and other tasks, simple tasks can be performed quickly even with glanced information, so time and attention are not taken away from looking ahead. In addition, it can be quickly restored to its original state at any time during more complex and multi-procedural work.

According to various embodiments, it is possible to repeatedly display a plurality of ADAS notifications that may occur while driving. In addition, the type of event can be recognized even with a glance at the navigation screen, and after a few learnings, the type of event can be easily remembered with only auditory information. In addition, after the driver recognizes the type of event through auditory information, he or she can recognize what kind of event situation occurs even by listening to the sound while looking ahead while driving, so that safe driving is possible.

1 is a diagram illustrating an internal configuration of an infotainment device according to various embodiments of the present disclosure;
2 is a diagram illustrating a method of operating an infotainment device according to various embodiments of the present disclosure;
3 to 17 are diagrams illustrating specific UI examples of an infotainment device according to various embodiments of the present disclosure;
18 is a diagram illustrating a vehicle on which a control device according to various embodiments is mounted.
Fig. 19 is a diagram showing the control device of Fig. 18;
20A illustrates an example of an environment including an electronic device according to various embodiments.
20B illustrates another example of an environment including an electronic device according to various embodiments of the present disclosure;
21 is a simplified block diagram of an electronic device according to various embodiments of the present disclosure;
22 is a flowchart illustrating a method of an electronic device for controlling a screen displayed on a display according to various embodiments of the present disclosure;
23 illustrates an example of a screen displayed on a display of an electronic device according to various embodiments of the present disclosure;
24 illustrates an example of switching a screen displayed on a display of an electronic device based on a user input for a widget, according to various embodiments of the present disclosure;
25 illustrates an example of switching a screen displayed on a display of an electronic device based on another user input for a widget, according to various embodiments of the present disclosure.
26 is a flowchart illustrating a method of an electronic device for converting a widget displayed on a display into an extended widget according to various embodiments of the present disclosure;
27 illustrates an example of converting a widget of an application into an extended widget of the application according to various embodiments of the present disclosure.
28 is a flowchart illustrating a method of an electronic device for converting a widget displayed on a display into a reduced widget according to various embodiments of the present disclosure;
29 illustrates an example of converting a widget of an application into a reduced widget of the application according to various embodiments of the present disclosure;
30 is a flowchart illustrating a method of an electronic device for converting an executable object displayed on a display into a widget according to various embodiments of the present disclosure;
31 illustrates an example of converting an executable object into a widget of an application according to various embodiments of the present disclosure;
32 is a flowchart illustrating a method of an electronic device that provides a service based on a user input to an empty space of a second partial area according to various embodiments of the present disclosure;
33 illustrates an example of displaying an executable object and executing a function indicated by the executable object based on a user input for an empty space of a second partial region, according to various embodiments.
34 is a flowchart illustrating a method of an electronic device for converting a third executable object defined through the description of FIGS. 32 and 33 into a fourth executable object, according to various embodiments of the present disclosure;
35 illustrates an example of converting a third executable object defined through the description of FIGS. 32 and 33 into a fourth executable object according to various embodiments.
36 is a flowchart illustrating a method of an electronic device for executing a function of an application providing an execution screen based on a user input for an empty space of a second partial area, according to various embodiments of the present disclosure;
37 illustrates an example of changing a state of an execution screen displayed in a first partial area based on a user input for an empty space of the second partial area according to various embodiments of the present disclosure;
38 is a flowchart illustrating a method of an electronic device for executing a function of an application providing a widget based on a user input for an empty space of a second partial area, according to various embodiments of the present disclosure;
39 illustrates an example of changing a state of a widget of an application displayed in the second partial area based on a user input for an empty space of the second partial area according to various embodiments of the present disclosure;
40 is a flowchart illustrating a method of an electronic device for displaying a handwriting input field based on a user input for an empty space of a second partial area, according to various embodiments of the present disclosure;
41 illustrates an example of a handwriting input field displayed according to a user input for an empty space of a second partial region, according to various embodiments of the present disclosure;
42 is a flowchart illustrating a method of an electronic device for processing a drag input initiated from a displayed handwriting input field according to various embodiments of the present disclosure;
43 illustrates an example of processing a drag input passing a portion of a first partial region from a handwriting input field beyond the handwriting input field according to various embodiments of the present disclosure;
44 is a flowchart illustrating a method of an electronic device for displaying an executable object for guiding a recommended function within a portion of a second partial region, according to various embodiments.
45 illustrates an example of an executable object for guiding a recommended function displayed within a portion of a second partial region according to various embodiments;
46 is a flowchart illustrating a method of an electronic device for displaying a plurality of executable objects extending from a portion of a second partial region according to various embodiments.
47 illustrates an example of a plurality of executable objects extending from a portion of a second sub-region in accordance with various embodiments.
48 is a flowchart illustrating a method of an electronic device for displaying a split screen in a first partial area by dropping a widget of an application displayed in the second partial area from the first partial area, according to various embodiments of the present disclosure.
49 illustrates an example of a split screen in the first partial area displayed by dropping a widget of an application displayed in the second partial area from the first partial area, according to various embodiments of the present disclosure.
50 is a flowchart illustrating a method of an electronic device for displaying a split screen in a first partial region by dropping a plurality of executable objects displayed in a second partial region from the first partial region, according to various embodiments of the present disclosure;
51 illustrates an example of a split screen displayed in the first partial region by dropping a plurality of executable objects displayed in the second partial region from the first partial region, according to various embodiments.
52 illustrates an example of a split screen having a changed arrangement according to a position within a first sub-region for dropping a plurality of executable objects displayed within a second sub-region according to various embodiments;
53 is a diagram illustrating an electronic device displaying a split screen in a first partial area by dropping a plurality of executable objects displayed in a second partial area from a first partial area including an execution screen of an application according to various embodiments of the present disclosure; It is a flow chart showing the method.
54 illustrates an example of a split screen displayed in the first partial area by dropping a plurality of executable objects displayed in the second partial area from the first partial area including the execution screen of an application according to various embodiments; do.
FIG. 55 is a flowchart illustrating a method of an electronic device for moving a widget or an executable object within a second partial area based on identifying a designated event from a passenger seat according to various embodiments.
56 illustrates an example of a widget or executable object within the second sub-area that is moved based on identifying a designated event from the passenger seat in accordance with various embodiments.
57 is a flowchart illustrating a method of an electronic device for expanding a second partial region based on a hovering input, according to various embodiments of the present disclosure;
58 illustrates an example of a second partial region that is enlarged based on a hovering input, according to various embodiments.
59 is a flowchart illustrating a method of an electronic device for expanding at least one executable element in an execution screen of an application in a first partial region based on a hovering input, according to various embodiments of the present disclosure;
60 illustrates an example of at least one executable element in an execution screen of an application in a first partial area that is enlarged based on a hovering input, according to various embodiments of the present disclosure;
61 is a flowchart illustrating a method of an electronic device for displaying a notification message based on a hovering input according to various embodiments of the present disclosure;
62 illustrates an example of a notification message displayed based on a hovering input according to various embodiments of the present disclosure;
63 is a flowchart illustrating a method of an electronic device for processing a notification related to another application generated while displaying an execution screen of an application according to various embodiments of the present disclosure;
64 illustrates an example of a screen switched based on processing of a notification according to various embodiments of the present disclosure;
65 is a flowchart illustrating a method of an electronic device for displaying a split screen based on a user input according to various embodiments of the present disclosure;
66 illustrates an example of a split screen displayed based on a user input according to various embodiments of the present disclosure;
67 is a flowchart illustrating a method of an electronic device for converting an execution screen of an application in a display area of a display to an execution screen of another application that provides a reduced execution screen in the display area of another display, according to various embodiments of the present disclosure;
68 illustrates an example of exchanging a screen displayed on a display with a screen displayed on another display according to various embodiments of the present disclosure;
69 illustrates a signal flow for controlling an electronic device through a second other electronic device among a first other electronic device and a second other electronic device included in a vehicle according to various embodiments of the present disclosure;
70 illustrates an example of a screen of an electronic device controlled by another second electronic device according to various embodiments of the present disclosure;
71 illustrates a method of an electronic device for controlling a screen displayed on a display based on a user input received through another display according to various embodiments of the present disclosure.
72 illustrates an example of a screen on a display that changes a display state based on a user input received through another display according to various embodiments of the present disclosure;
73 is a method of an electronic device for moving at least one executable element in an execution screen of a first application in a first partial area or a widget of a second application in a second partial area based on a hovering input, according to various embodiments of the present disclosure; shows
74 illustrates an example of at least one executable element in an execution screen of a first application in a first partial area moved according to a hovering input or a widget of a second application in a second partial area, according to various embodiments of the present disclosure;
75 is a method of an electronic device for expanding at least one executable element in an execution screen of a first application in a first partial area or a widget of a second application in a second partial area based on a hovering input according to various embodiments of the present disclosure; shows
76 illustrates an example of at least one executable element in an execution screen of a first application in a first partial region that is expanded according to a hovering input or a widget of a second application in a second partial region, according to various embodiments of the present disclosure;
77 is a flowchart illustrating a method of an electronic device for adaptively controlling event information to be displayed in an execution screen of a first application displayed in a first partial region based on an eye gaze input, according to various embodiments of the present disclosure; .
78 illustrates an example of event information in an execution screen of a first application within a first partial area that is adaptively displayed based on an eye gaze input, according to various embodiments of the present disclosure;
79 illustrates a method of an electronic device for controlling event information to be displayed on an execution screen of an application in the first partial area according to whether a destination is initially set, according to various embodiments of the present disclosure;

Hereinafter, various embodiments of the present document will be described with reference to the accompanying drawings.

Various embodiments of this document and terms used therein are not intended to limit the technology described in this document to a specific embodiment, but it should be understood to include various modifications, equivalents, and/or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for like components. The singular expression may include the plural expression unless the context clearly dictates otherwise. In this document, expressions such as “A or B”, “at least one of A and/or B”, “A, B or C” or “at least one of A, B and/or C” refer to all of the items listed together. Possible combinations may be included. Expressions such as “first”, “second”, “first” or “second” can modify the corresponding components regardless of order or importance, and are only used to distinguish one component from another. The components are not limited. When an (eg, first) component is referred to as being “connected (functionally or communicatively)” or “connected” to another (eg, second) component, that component is It may be directly connected to the component or may be connected through another component (eg, a third component).

As used herein, the term “module” includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of one or more functions. For example, the module may be configured as an application-specific integrated circuit (ASIC).

1 is a diagram illustrating an internal configuration of an infotainment device according to various embodiments of the present disclosure;

As shown in FIG. 1 , the infotainment device 100 is a component for executing the operating method of FIG. 2 , and includes a processor 110 , a memory 120 , a persistent storage device 130 , a bus 140 , and an input/output interface. 150 and a network interface 160 .

Processor 110 may include or be part of any apparatus capable of processing a sequence of instructions. Processor 110 may include, for example, a computer processor, a processor in a mobile device, or other electronic device and/or a digital processor. The processor 110 may be connected to the memory 120 through the bus 140 .

Memory 120 may include volatile memory, permanent, virtual or other memory for storing information used by or output by infotainment device 100 . The memory 120 may include, for example, random access memory (RAM) and/or dynamic RAM (DRAM). The memory 120 may be used to store any information, such as state information of the infotainment device 100 . The memory 120 may also be used to store instructions of the infotainment device 100 including, for example, instructions for controlling an infotainment operation. The infotainment device 100 may include one or more processors 110 as needed or appropriate.

Bus 140 may include a communication infrastructure that enables interaction between various components of infotainment device 100 . Bus 140 may carry data between components of infotainment device 100 , for example between processor 110 and memory 120 . Bus 140 may include wireless and/or wired communication media between components of infotainment device 100 , and may include parallel, serial, or other topological arrangements.

Persistent storage device 130 is a component, such as a memory or other persistent storage device, as used by infotainment device 100 to store data for an extended period of time (eg, compared to memory 120 ). may include Persistent storage device 130 may include non-volatile main memory as used by processor 110 in infotainment device 100 . Persistent storage 130 may include, for example, flash memory, a hard disk, an optical disk, or other computer readable medium.

The input/output interface 150 may include interfaces to touch, display, voice command input, keyboard, or other input or output device. Configuration commands and/or inputs related to infotainment operations may be received via the input/output interface 150 .

Network interface 160 may include one or more interfaces to networks such as a local area network or the Internet. Network interface 160 may include interfaces for wired or wireless connections. The configuration commands may be received via network interface 160 . In addition, information related to the infotainment operation may be received or transmitted through the network interface 160 .

Also, in other embodiments, the infotainment apparatus 100 may include more components than those of FIG. 1 . However, there is no need to clearly show most of the prior art components. For example, the infotainment device 100 is implemented to include at least some of the input/output devices connected to the input/output interface 150 described above, or a transceiver, a global positioning system (GPS) module, a camera, various sensors, It may further include other components such as a database and the like.

2 is a diagram illustrating a method of operating an infotainment device according to various embodiments of the present disclosure;

The processor 110 may perform steps S210 to S250 included in the method of operating the infotainment of FIG. 2 . For example, the processor 110 may be implemented to execute a code of an operating system included in the memory 120 and an instruction according to at least one program code described above. Here, at least one program code may correspond to a code of a program implemented to process an infotainment operation method.

The infotainment operation method according to various embodiments may not occur in the illustrated order, and some of the steps may be omitted or additional processes may be further included.

In step S210 , when the navigation function is executed in the foreground state, the processor 110 may display the execution screen of the navigation function as an activated screen. For example, the infotainment device 100 for a vehicle includes a navigation function for route guidance, an air conditioning control function for controlling the vehicle air conditioner, a hands-free call function, a media playback function for playing media contents such as music or video, etc. may include. The processor 110 may execute a navigation function in the foreground according to a user's request and display it on the screen.

In step S220 , the processor 110 determines whether any one of functions other than the navigation function, for example, an air conditioning control function, a hands-free call function, and a media playback function, is running in the background in a situation where the navigation function is running in the foreground. to judge

In step S230 , when another function is running in the background, the processor 110 may display an interface related to the background running function in the form of a widget. The processor 110 uses a predetermined specific area on the screen of the infotainment device 100 to display a UI item including at least one UI related to a function being executed in the background in the form of a widget (hereinafter referred to as a 'background widget') can be displayed as The processor 110 may use a partial area of the screen of the infotainment apparatus 100 , for example, any one of a lower area, an upper area, a left area, and a right area, as a background widget. For example, the processor 110 may display a background widget on the taskbar when an area that can be always accessed by maintaining an active state on the screen of the infotainment device 100, for example, a taskbar is included.

The processor 110 maintains the execution screen of the navigation function in the foreground state when there is no other function being executed in the background.

In step S240, the processor 110 determines whether to enter the screen of another function from the execution screen of the navigation function. In other words, the processor 110 may check whether the function currently being executed in the foreground is switched from the navigation function to another function.

In step S250 , the processor 110 switches the corresponding function to the foreground state and the navigation function to the background state when entering the screen of another function, that is, when a function currently running in the foreground is switched to another function. In the meantime, the interface related to the navigation function can be displayed in the form of a widget. Similarly, the processor 110 maintains an active state within the screen of the infotainment device 100 to display a UI item including at least one UI related to a navigation function in an area that is always accessible, for example, a taskbar, as a background widget. can be displayed

Accordingly, the processor 110 may provide a simple manipulation function and information by displaying some UIs of functions being executed in the background as background widgets in an area that is always accessible within the screen of the infotainment device 100 .

3 to 6 are diagrams illustrating screens of an infotainment device according to various embodiments of the present disclosure;

Referring to FIG. 3 , the screen 300 of the infotainment device includes an execution screen of a foreground function (hereinafter, referred to as a 'foreground execution screen') 310 , and in particular, a foreground execution screen within the screen 300 . The task bar 320 may be included as an example of an area that is always accessible while maintaining an active state together with the 310 .

The processor 110 configures the icon list (hereinafter, referred to as 'favorite list') 30 of the work functions frequently used by the driver of the vehicle as a quick menu, that is, a shortcut icon to form a task bar ( 320) can be placed. The favorites list 30 includes a home button 31 indicating an icon for moving to the home screen, a navigation button 32 indicating an icon for a navigation function, an air conditioning button 33 indicating an icon for an air conditioning control function, and a hands-free call. A call button 34 indicating an icon of a function, a media button 35 indicating an icon of a media playback function, and the like may be included.

Some of the functions included in the favorite list 30 may be configured by default, and icons of functions other than the default function may be set through a driver's selection. For example, in the favorites list 30 , the home button 31 and the navigation button 32 are fixed functions by default, and the air conditioning button 33 , the call button 34 , and the media button 35 are provided by the driver. It may be a function set as a frequently used task function.

The icons included in the favorites list 30 may be sorted according to a predetermined schedule criteria (eg, name order, recent execution order, etc.) added to ), the most recently executed order, or the order specified directly by the driver.

In addition, the maximum number of icons included in the favorite list 30 may be determined by default or may be directly set by the driver.

3 is a situation in which a route guidance screen, which is an execution screen of any one task function, for example, a navigation function, is displayed on the foreground execution screen 310, and shows a screen 300 when there is no function being executed in the background. .

4 shows a screen 300 when a media playback function is being executed in the background in a situation in which a route guidance screen, which is an execution screen of a navigation function, is displayed on the foreground execution screen 310 . A background widget 400 of a media playback function may be displayed on the task bar 320 , wherein the background widget 400 is displayed at a position adjacent to the media button 35 , for example, on the right side of the media button 35 . can be

FIG. 5 shows a screen 300 when a navigation function is being executed in the background in a situation in which a media playback function execution screen, that is, a media playback screen, is displayed on the foreground execution screen 310 . A background widget 500 of the navigation function may be displayed on the task bar 320 , in which case the background widget 500 is displayed at a position adjacent to the navigation button 32 , for example, to the right of the navigation button 32 . can As shown in FIG. 5 , while the background widget 500 of the navigation function is displayed on the right side of the navigation button 32 , the icons (the air conditioning button 33 , the call button 34 , and the media button 35 ) are arranged previously. )) can be adjusted automatically.

Accordingly, the background widgets 400 and 500 of the function being executed in the background may be displayed in a position adjacent to the icon of the corresponding function.

Although it has been described that the background widgets 400 and 500 are displayed in a position adjacent to the icon of the function being executed in the background, the present invention is not limited thereto, and the positions of the background widgets 400 and 500 can be changed at will. For example, referring to FIG. 6 , the position of the background widget 600 may be fixed and displayed at a predetermined specific position (eg, a left region and a right region) within the task bar 320 .

If there is no function running in the background, the favorites list 30 is custom-arranged on the left side of the task bar 320 as shown in FIG. 3, and when there is a function running in the background, as shown in FIG. The background widget 600 on the left side of the task bar 320 and the favorite list 30 may be customized in order.

In other words, the position of the widget is not determined according to the function executed in the background, but the background widget 600 may be displayed in a fixed position of the task bar 320 irrespective of the function executed in the background.

Although it has been described above that one function operates in the background, the present invention is not limited thereto. When there are two or more functions operating in the background, as an example, all background widgets for each function may be displayed on the taskbar 320 , and as another example, a preset is set on the taskbar 320 according to the priority of each function. A number of background widgets may be displayed. For example, assuming that the priority of the air conditioning control function, the hands-free call function, and the media playback function is high in the order, only one background widget may be displayed at a time according to the corresponding priority. When the hands-free calling function and the media playback function are running in the background, only the hands-free calling function widget may be displayed and the media playback function widget may be hidden. When two or more background widgets are simultaneously displayed at a time, the background widgets may be displayed in order of priority of each function.

The infotainment device according to various embodiments of the present disclosure provides a user experience capable of concisely performing other tasks while constantly showing driving information while driving so as not to lose focus on driving. In addition, it provides a device that allows the driver to quickly return to the original driving state even if it is shifted to a state for detailed work, providing the driver with a safe driving experience and a pleasant entertainment experience.

Hereinafter, a background widget is provided by distinguishing between a situation in which another function is running in the background while a navigation function is running in the foreground and a situation in which the navigation function enters a screen of another function during route guidance. In particular, when media is being played, a function for searching the media list may be additionally provided, and an intuitive and easy UI for searching the list during operation may be provided on the detailed entry screen.

FIG. 7 shows a screen 300 of a situation in which the route guidance screen of the navigation function is activated on the foreground execution screen 310 and music is playing in the background.

Referring to FIG. 7 , a widget, that is, a background widget 700 , is provided on the task bar 320 during route guidance, in which information of a media playback function and operation buttons are simplified and displayed. A background widget 700 of a media playback function may be displayed at a position adjacent to the media button 35 in the task bar 320 , for example, on the right side of the media button 35 .

As an example, the background widget 700 of the media playback function may include a progress bar 701 and song information (eg, song name, album name, artist name) 702 of the music being played, When the media playback function is a function capable of calling list information, a search button 703 for searching the media list in the background widget 700 may be further included and provided.

When the driver selects the search button 703 in the background widget 700, the processor 110 performs an interface screen (hereinafter, 'list search') for searching the media list on the screen 300 as shown in FIG. 8 . screen ') 810 may be provided in an unfolded state. In this case, the list search screen 810 may be displayed at a position adjacent to the background widget 700 , for example, at the top of the background widget 700 .

Referring to FIG. 9 , the list search screen 810 may include a playlist 90 including the currently playing music, and a scroll bar ( 91), an adjustment bar 92 capable of adjusting the size of the list search screen 810, and the like may be included. The list search screen 810 is applied in a form that can be adjusted in size through the adjustment bar 92 at the top of the screen.

The list search screen 810 may also be applied in a more functional form in which a playlist other than the playlist 90 including the currently played music can be searched. For example, as shown in FIG. 10 , the left and right navigation buttons 101 and 102 for searching the playlist left and right or the full search button 103 for searching the entire list for the playlist are displayed on the list search screen. 810 may be included.

11 shows a screen 300 of a situation in which the foreground execution screen 310 is switched to a media playback screen as another function, for example, a media playback function, is entered during route guidance. The screen 300 of FIG. 11 can be entered at once by selecting the background widget 700 of the media playback function on the screen 300 of FIGS. 7 and 8 or by selecting the media button 35 from the favorite list 30. have.

Referring to FIG. 11 , when the navigation function is switched to the background state, the processor 110 displays a widget in which main guide information of the navigation function is simplified and displayed on the taskbar 320 , that is, the background widget 1100 . A position adjacent to the navigation button 32 in the task bar 320 , for example, a background widget 1100 of a navigation function may be displayed on the right side of the navigation button 32 . For example, the next-to-next direction information and the next-to-next direction information may be displayed on the background widget 1100 of the navigation function as route guidance information.

The processor 110 is an interface that allows you to quickly and intuitively search for a song by viewing a song-related image by flipping the playlist 1110 including the currently playing music in the media playback screen, which is the foreground execution screen 310, left and right. A search function in the form of a cover flow UI may be provided. For each song included in the playlist 1110 , an icon composed of an image related to the corresponding song may be displayed according to the sorting criteria.

When entering the media playback screen, by default, the currently playing song may be displayed with focus on the center of the initial screen, and a playback gauge of the currently playing song may be displayed through the progress bar 1101 . By touching the progress bar 1101, the play position of the song can be moved to a position corresponding to the touch point, and a play button 1102 for controlling play and pause in the center of the icon representing the currently playing song. may be included.

When the cover flow of the playlist 1110 is turned left and right based on the currently playing song, as shown in FIG. 12 , a song search is performed as the item focused in the center is changed to the song in the corresponding direction. When a song other than the currently playing song is focused on the center item according to the song search, information about the currently playing song is displayed at a predetermined location, for example, in the form of a separate icon 1220 at the lower left corner. can Information on the currently playing song can be displayed through the icon 1220 even while searching for a song, and when the icon 1220 is selected, as shown in FIG. can When the currently playing song is focused again on the center, the icon 1220 may be hidden.

13 shows a screen 300 of a situation in which the hands-free call function is executed in the background while the route guidance screen of the navigation function is activated on the foreground execution screen 310 . When the driver receives a call while the navigation function is running in the foreground, the hands-free call function is executed in the background according to the call reception, and the widget 1300 of the hands-free call function may be displayed on the taskbar 320. . The widget 1300 of the hands-free call function may include a call reception button, a call end button, call time, counterpart information, and the like, and some or all of the information may be displayed in the form of a toast notification on the taskbar 320 . may be The widget 1300 of the hands-free call function is maintained while a call is being made, and disappears from the task bar 320 when the call is ended.

14 illustrates a screen 300 of a situation in which the air conditioning control function is executed in the background while the route guidance screen of the navigation function is activated on the foreground execution screen 310 . When the driver controls the air conditioning operation, for example, the wind speed in a situation where the navigation function is running in the foreground, the widget 1400 of the air conditioning control function is displayed on the task bar 320 as the air conditioning control function is executed in the background Also, some or all of the information may be displayed in the form of a toast notification on the task bar 320 . The widget 1400 of the air conditioning control function according to the driver's air conditioning operation may include contents of the air conditioning operation. The widget 1400 of the air conditioning control function is maintained for a predetermined time from the time when the driver's manipulation is completed, and disappears from the task bar 320 when the corresponding time elapses.

The infotainment UI according to various embodiments is based on the following study. First, in the tasks that drivers frequently use while driving, the media playback function, music listening, ranks high, followed by the air conditioning control function and the hands-free calling function. Second, one of the reasons drivers operate devices (smartphones, navigation terminals, etc.) while driving is the act of searching for a music list, which ranks high, but it is investigated as a more dangerous behavior than manipulating the navigation or sending a text message. do. Third, according to several studies, it is known that the human brain has a faster response rate for recognizing images than texts.

Based on these reasons, tasks frequently used by drivers are displayed as widgets that provide simplified information and functions by turning them into background widgets so that they do not interfere with driving. It can provide an interface that can recognize and react quickly.

The infotainment device according to various embodiments may provide functions frequently used by the driver, including the navigation function, as shortcut icons (quick menus) that can be accessed at all times, and the shortcut icons change to background widgets according to screen switching. interface can be implemented. In the case of the background widget of the media playback function, a playback progress bar 701, song information 702, and a search button 703 are provided in the form of a widget, and when the search button 703 is selected, the list is searched on the current screen without screen switching. A screen 810 may be provided.

The infotainment device according to various embodiments may take a form that can provide a plurality of notifications at the exact time when an event occurs while minimizing visual information related to an ADAS notification, thereby ensuring the safety of the driver and taking all of the technical accuracy.

When an ADAS event is detected, the processor 110 may output a visual notification (visual information) along with a sound notification (auditory information) related to the detected event, wherein the visual notification identifies the type of the detected event. It can contain icons and text for

When a plurality of ADAS events are detected within a predetermined time, the processor 110 may output multiple event notifications in duplicate, but the latest notification may display both an icon and text, and the previous notification may display only the icon.

FIG. 15 shows a screen 300 in a case in which a route guidance screen of a navigation function is displayed on the foreground execution screen 310 and there is no function being executed in the background. 15 is an example screen in which forward attention is detected as an example of an ADAS event, and shows a screen when one event occurs.

Referring to FIG. 15 , the processor 110 displays an forward attention event notification 1500 at a predetermined location of the foreground execution screen 310 , for example, at the top of the screen when an forward attention event is detected as one of the ADAS events. can do. The forward attention event notification 1500 may include an icon 1501 and text 1502 indicating the forward attention event.

When another event, for example, a lane departure event is detected following the forward attention event, the processor 110 generates a lane departure event notification 1600 as a previous event, a forward attention event notification 1500 and as shown in FIG. 16 . can be displayed together.

When another event, for example, a sharp curve event, is detected following the lane departure event, the processor 110 transmits the sharp curve event notification 1700 as shown in FIG. 17 with the lane departure event notification 1600 as the previous event. It may be displayed together with the forward attention event notification 1500 .

The processor 110 overlaps the forward attention event notification 1500, the lane departure event notification 1600, and the sharp curve event notification 1700 when a forward attention event, a lane departure event, and a sharp curve event are consecutively detected within a predetermined time. In this case, the latest event notifications are displayed on the front according to the order in which ADAS events are detected, and the previously detected event notifications are pushed in a predetermined direction, for example, to the right.

The most recent event notifications are displayed on the leftmost and frontmost sides and can be highlighted, for example, with the darkest or most vivid colored icons and text, while previously detected event notifications are sequentially pushed to the right and dimmed. It can be displayed only in the form of a processed icon. The most recent event notification, the sharp curve event notification 1700, displays both an icon and text indicating a sharp curve event, and the previous event notification, the forward attention event notification 1500 and lane departure event notification 1600, displays only the icon. can

Although it is described that the ADAS event notification is displayed in a fixed position, the present invention is not limited thereto, and the display position of the ADAS event notification can be changed. As an example, the ADAS event notification may be displayed in a location that does not overlap with route information or direction information displayed on the route guidance screen, for example, in an area opposite to the left turn route on the screen 300 during left turn route guidance.

The number of ADAS events that occur simultaneously during operation or within a certain period of time may be limited to a maximum of not more than three, but the number may vary depending on the case.

The infotainment device according to various embodiments may provide visual information together with auditory information for an ADAS event, and in this case, a minimized icon is displayed as the visual information, so that the driver's attention is less captured through a small icon. This makes the driver more dependent on auditory information while focusing on the forward vision. Even if multiple ADAS events occur, notifications are all displayed on one screen, so just by looking at the route guidance screen, you can accurately recognize which event occurred and remember the type of event.

The UI of the infotainment device according to various embodiments may be used as a UI of the navigation software regardless of the hardware type.

18 is a diagram illustrating a vehicle on which a control device according to various embodiments is mounted, and FIG. 19 is a diagram illustrating the control device of FIG. 18 .

18 and 19 , a control device 2100 (eg, corresponding to the infotainment device 100 of FIG. 1 ) according to various embodiments may be mounted on a vehicle. In this case, the vehicle may be the autonomous driving vehicle 2000 .

In this embodiment, the control device 2100 includes a memory 2122 (eg, corresponding to the memory 120 and/or the persistent storage device 130 of FIG. 1 ) and a processor 2124 (eg, the processor 110 of FIG. 1 ). (corresponding to) including a controller 2120, a sensor 2110, a wireless communication device 2130 (corresponding to the network interface 160 of FIG. 1 for example), a LIDAR 2140 and a camera module 2150. can do.

In the present embodiment, the controller 2120 may be configured at the time of manufacturing by the vehicle manufacturer or may be additionally configured to perform the function of autonomous driving after manufacturing. Alternatively, a configuration for continuously performing additional functions may be included through an upgrade of the controller 2120 configured during manufacturing.

The controller 2120 transmits a control signal to the sensor 2110 , the engine 2006 , the user interface 2008 , the wireless communication device 2130 , the LIDAR 2140 , and the camera module 2150 including other components in the vehicle. can be forwarded to Also, although not shown, a control signal may be transmitted to an accelerator, a braking system, a steering device, or a navigation device related to driving of a vehicle.

In the present embodiment, the controller 2120 may control the engine 2006 and, for example, detect the speed limit of the road on which the autonomous vehicle 2000 is traveling and prevent the driving speed from exceeding the speed limit. ) or the engine 2006 to accelerate the driving speed of the autonomous vehicle 2000 within a range that does not exceed the speed limit. In addition, when the sensing modules 2004a, 2004b, 2004c, and 2004d sense the environment outside the vehicle and transmit it to the sensor 2110, the controller 2120 receives it and controls the engine 2006 or the steering device (not shown). By generating a control signal, it is possible to control the driving of the vehicle.

The controller 2120 may control the engine 2006 or the braking system to decelerate the driving vehicle when there is another vehicle or an obstacle in front of the vehicle, and may control the trajectory, the driving path, and the steering angle in addition to the speed. . Alternatively, the controller 2120 may control the driving of the vehicle by generating a necessary control signal according to recognition information of other external environments, such as a driving lane of the vehicle, a driving signal, and the like.

The controller 2120 may control the driving of the vehicle by performing communication with a surrounding vehicle or a central server in addition to generating its own control signal and transmitting a command for controlling the surrounding devices through the received information.

In addition, when the position of the camera module 2150 is changed or the angle of view is changed, the controller 2120 may make it difficult to accurately recognize a vehicle or a lane. It is also possible to generate a control signal to control. Accordingly, in the present embodiment, the controller 2120 generates a calibration control signal to the camera module 2150 so that the mounting position of the camera module 2150 is determined by vibration or shock generated according to the movement of the autonomous vehicle 2000 . Even if it is changed, the normal mounting position, direction, angle of view, etc. of the camera module 2150 may be continuously maintained. In the controller 2120, the initial mounting position, direction, and angle of view information of the camera module 2120 stored in advance and the initial mounting position, direction, and angle of view information of the camera module 2120 measured during driving of the autonomous vehicle 2000 are critical. When the value is different than the value, a control signal may be generated to perform calibration of the camera module 2120 .

In this embodiment, the controller 2120 may include a memory 2122 and a processor 2124 . The processor 2124 may execute software stored in the memory 2122 according to a control signal of the controller 2120 . Specifically, the controller 2120 stores data and instructions for performing the infotainment operation method according to various embodiments in the memory 2122, and the instructions are executed by the processor 2124 to implement one or more methods disclosed herein. can be executed

In this case, the memory 2122 may be stored in a recording medium executable by the non-volatile processor 2124 . Memory 2122 may store software and data via suitable internal and external devices. The memory 2122 may include random access memory (RAM), read only memory (ROM), a hard disk, and a memory 2122 device connected to a dongle.

The memory 2122 may store at least an operating system (OS), a user application, and executable commands. The memory 2122 may also store application data and array data structures.

Processor 2124 may be a controller, microcontroller, or state machine with a microprocessor or suitable electronic processor.

The processor 2124 may be implemented as a combination of computing devices, and the computing device may be a digital signal processor, a microprocessor, or a suitable combination thereof.

Also, in the present embodiment, the control device 2100 may monitor internal and external characteristics of the autonomous driving vehicle 2000 using at least one sensor 2110 and detect a state.

The sensor 2110 may include at least one sensing module 2004, and the sensing module 2004 may be implemented at a specific location of the autonomous vehicle 2000 according to a sensing purpose. It may be located at the lower, rear, front, upper, or side end of the autonomous vehicle 2000 , and may also be located in internal parts or tires of the vehicle.

Through this, the sensing module 2004 may sense driving-related information such as the engine 2006 , tires, steering angle, speed, and weight of the vehicle as internal information of the vehicle. In addition, at least one sensing module 2004 may include an acceleration sensor 2110, a gyroscope, an image sensor 2110, RADAR, an ultrasonic sensor, a LiDAR sensor, etc. can detect

The sensing module 2004 receives, as external information, specific data on external environmental conditions such as road state information, surrounding vehicle information, and weather on which the autonomous driving vehicle 2000 is located, and it is also possible to detect the parameters of the vehicle accordingly. do. The sensed information may be temporarily or long-term stored in the memory 2122 according to a purpose.

In the present embodiment, the sensor 2110 may integrate and collect information of the sensing modules 2004 for collecting information generated inside and outside the autonomous driving vehicle 2000 .

The control device 2100 may further include a wireless communication device 2130 .

The wireless communication device 2130 is configured to implement wireless communication between the autonomous vehicles 2000 . For example, it enables the autonomous vehicle 2000 to communicate with a user's mobile phone, another wireless communication device 2130 , another vehicle, a central device (traffic control device), a server, and the like. The wireless communication device 2130 may transmit/receive a wireless signal according to an access wireless protocol. The wireless communication protocol can be Wi-Fi, Bluetooth, Long-Term Evolution (LTE), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Global Systems for Mobile Communications (GSM), and the communication protocol is It is not limited thereto.

Also, in the present embodiment, the autonomous vehicle 2000 may implement inter-vehicle communication through the wireless communication device 2130 . That is, the wireless communication device 2130 may communicate with other vehicles and other vehicles on the road through vehicle-to-vehicle communication (V2V). The autonomous vehicle 2000 may transmit and receive information such as a driving warning and traffic information through vehicle-to-vehicle communication, and may request information from or receive a request from another vehicle. For example, the wireless communication device 2130 may perform V2V communication as a dedicated short-range communication (DSRC) device or a Celluar-V2V (C-V2V) device. In addition to communication between vehicles, communication (V2X, Vehicle to Everything communication) between a vehicle and other things (eg, an electronic device carried by a pedestrian) may also be implemented through the wireless communication device 2130 .

Also, the control device 2100 may include a LIDAR device 2140 . The LIDAR device 2140 may detect an object around the autonomous driving vehicle 2000 during operation using data sensed through the LIDAR sensor. The LIDAR device 2140 may transmit the detected information to the controller 2120 , and the controller 2120 may operate the autonomous vehicle 2000 according to the detected information. For example, the controller 2120 may instruct the vehicle to slow down through the engine 2006 when there is a vehicle ahead traveling at a low speed in the detection information. Alternatively, the vehicle may be ordered to slow down according to the curvature of the curve into which it enters.

The control device 2100 may further include a camera module 2150 . The controller 2120 may extract object information from an external image captured by the camera module 2150 and allow the controller 2120 to process the information.

Also, the control device 2100 may further include imaging devices for recognizing an external environment. In addition to the LIDAR 2140, RADAR, a GPS device, an odometer, and other computer vision devices may be used, and these devices may be selected or operated simultaneously as needed to enable more precise detection.

The autonomous vehicle 2000 may further include a user interface 2008 for a user's input to the above-described control device 2100 . User interface 2008 may allow a user to enter information with appropriate interaction. For example, it may be implemented as a touch screen, a keypad, an operation button, and the like. The user interface 2008 may transmit an input or command to the controller 2120 , and the controller 2120 may perform a vehicle control operation in response to the input or command.

Also, the user interface 2008 may be an external device of the autonomous vehicle 2000 and may communicate with the autonomous vehicle 2000 through the wireless communication device 2130 . For example, the user interface 2008 may be operable with a mobile phone, tablet, or other computer device.

Furthermore, although the autonomous vehicle 2000 is described as including the engine 2006 in this embodiment, it is also possible to include other types of propulsion systems. For example, the vehicle may be driven by electric energy, and may be driven by hydrogen energy or a hybrid system combining them. Accordingly, the controller 2120 may include a propulsion mechanism according to the propulsion system of the autonomous vehicle 2000 , and may provide a corresponding control signal to the components of each propulsion mechanism.

Hereinafter, a detailed configuration of the control device 2100 for performing the infotainment operating method according to various embodiments will be described in more detail with reference to FIG. 18 .

The control device 2100 includes a processor 2124 . The processor 2124 may be a general purpose single or multi-chip microprocessor, a dedicated microprocessor, microcontroller, programmable gate array, or the like. A processor may also be referred to as a central processing unit (CPU). Also, in this embodiment, the processor 2124 may be used as a combination of a plurality of processors.

The control device 2100 also includes a memory 2122 . Memory 2122 may be any electronic component capable of storing electronic information. Memory 2122 may also include a combination of memories 2122 in addition to a single memory.

Data and instructions 2122a for performing the infotainment operating method according to various embodiments may be stored in the memory 2122 . When the processor 2124 executes the instructions 2122a , all or part of the instructions 2122a and data 2122b necessary for execution of the instructions may be loaded 2124a and 2124b onto the processor 2124 .

The control device 2100 may include a transmitter 2130a, a receiver 2130b, or a transceiver 2130c for allowing transmission and reception of signals. One or more antennas 2132a, 2132b may be electrically coupled to transmitter 2130a, receiver 2130b, or each transceiver 2130c, and may additionally include antennas.

The control device 2100 may include a digital signal processor (DSP) 2170 . The DSP 2170 may enable the vehicle to quickly process a digital signal.

The control device 2100 may include a communication interface 2180 . The communication interface 2180 may include one or more ports and/or communication modules for connecting other devices with the control device 2100 . The communication interface 2180 may enable a user and the control device 2100 to interact.

The various components of the control device 2100 may be coupled together by one or more buses 2190 , which may include a power bus, a control signal bus, a status signal bus, a data bus, and the like. Under the control of the processor 2124 , the components may transfer information to each other through the bus 2190 and perform a desired function.

20A illustrates an example of an environment including an electronic device according to various embodiments. Such an environment may include at least one of the infotainment device 100 and the control device 2100 illustrated through FIGS. 1 to 19 .

Referring to FIG. 20A , the environment 2200 may include an electronic device 2210 (eg, the infotainment device 100 or the control device 2100 ). In various embodiments, the electronic device 2210 may be located within the environment 2200 to provide information to a user within the environment 2200 . In various embodiments, the electronic device 2210 may be a device temporarily included in a vehicle while having mobility. For example, the electronic device 2210 may include a smart phone, a tablet, a personal computer (PC), or a laptop that can be connected to a wired or wireless connection through a connector embedded in the vehicle. computer) and a computer program product having a universal serial bus (USB) port. In various embodiments, the electronic device 2210 may be a fixed device embedded in the vehicle.

In various embodiments, the electronic device 2210 may be a device that provides an in-vehicle infotainment (IVI) service. In various embodiments, the electronic device 2210 may be referred to as an IVI device or an IVI system in this document in terms of providing an IVI service. In various embodiments, the electronic device 2210 may be referred to as a head unit or a main unit within this document in the sense that it is embedded in a vehicle (eg, the environment 2200 ). In various embodiments, the electronic device 2210 may be configured to control a plurality of components within the environment 2200 .

In various embodiments, the electronic device 2210 may control a device related to the provision of a wind speed of an air conditioner (or heater) within the environment 2200 or a device related to the provision of a wind direction of the air conditioner (or heater) within the environment 2200 . can For example, the electronic device 2210 may change a wind speed or a wind direction through the device based on an input received by the electronic device 2210 .

In various embodiments, the electronic device 2210 may control at least one display in the environment 2200 . For example, the electronic device 2210 may display a screen (or user interface) for a navigation service through the at least one display. As another example, the electronic device 2210 may display a user interface for content such as music and moving pictures through the at least one display.

In various embodiments, the electronic device 2210 may control a device related to a communication function in the environment 2200 . For example, the electronic device 2210 may transmit an emergency call or an outgoing call through the device, or may receive an incoming call through the device.

In various embodiments, the electronic device 2210 may control a device related to an audio function in the environment 2200 . For example, the electronic device 2210 may output music through a speaker.

In various embodiments, the electronic device 2210 may control sensor devices embedded in the environment 2200 . For example, the electronic device 2210 may activate a front camera or a rear camera according to the state of the vehicle. As another example, the electronic device 2210 may control operation of a plurality of sensors for an advanced driver assistance system (ADAS).

20B illustrates another example of an environment including an electronic device according to various embodiments of the present disclosure; Such an environment may include at least one of the infotainment device 100 and the control device 2100 illustrated through FIGS. 1 to 19 .

Referring to FIG. 20B , an environment 2250 may include an electronic device 2210 and an electronic device 2220 . In various embodiments, the electronic device 2210 may correspond to the electronic device 2210 defined through the description of FIG. 20A . In various embodiments, the electronic device 2220 may be a device connected to the electronic device 2210 . In various embodiments, the electronic device 2220 is a device having mobility, such as a smartphone, a tablet, a personal computer (PC), a laptop computer, and a universal serial bus (USB) port. It may be any one of a computer program product (computer program product) having.

In various embodiments, the electronic device 2210 may display a screen on at least one display of the electronic device 2210 based on data received from the electronic device 2220 .

In some embodiments, the data transmitted from the electronic device 2220 to the electronic device 2210 may be display data generated by the electronic device 2220 . In an embodiment, the display data may be data for displaying a screen corresponding to a screen displayed on the display of the electronic device 2220 on the at least one display of the electronic device 2210 . For example, the display data may be data for supporting mirroring from the electronic device 2220 to the electronic device 2210 . In another embodiment, the display data may be data for displaying a screen different from a screen displayed on the display of the electronic device 2220 on the at least one display of the electronic device 2210 . In other words, the display data may be data for supporting casting from the electronic device 2220 to the electronic device 2210 . However, it is not limited thereto.

In an embodiment, the electronic device 2220 obtains information about the at least one display of the electronic device 2210 (eg, aspect ratio information, size information, etc. of the at least one display), Based on the display data, the display data may be generated and the generated display data may be transmitted to the electronic device 2210 . The electronic device 2210 receives the display data from the electronic device 2220 and, based on the received display data, without converting it to suit the aspect ratio of the at least one display or the size of the at least one display , a screen may be displayed on the at least one display. However, it is not limited thereto.

In another embodiment, the electronic device 2220 may generate the display data without information on the at least one display of the electronic device 2210 and transmit the display data to the electronic device 2210 . The electronic device 2210 converts the received display data based on the information on the at least one display of the electronic device 2210 and displays a screen on the at least one display based on the converted display data. can be displayed However, it is not limited thereto.

In some other embodiments, the data transmitted from the electronic device 2220 to the electronic device 2210 may be data for execution of a virtual machine executed in the electronic device 2210 . For example, the data may include a memory state of the electronic device 2220 associated with the virtual machine, a processor state of the electronic device 2220 associated with the virtual machine, and an input device of the electronic device 2220 associated with the virtual machine. may include information about the state of the virtual machine, the state of the display of the electronic device 2220 related to the virtual machine, or a combination thereof. In other words, the data may be migrated from the electronic device 2220 to the electronic device 2210 . The electronic device 2210 may display the screen on at least one display of the electronic device 2210 by receiving the transferred data and executing the virtual machine based on the transferred data. However, it is not limited thereto.

20A and 20B , the electronic device 2210 may independently provide a service within a vehicle (eg, the environment 2200) without interworking with an external electronic device, and an external electronic device (eg, an electronic device) may provide a service. A service may be provided in a vehicle (eg, the environment 2250) based on interworking with the device 2220). Accordingly, in this document, that the electronic device 2210 or the processor of the electronic device 2210 (eg, the processor 2230 of FIG. 21 ) executes an application (or program) means that the electronic device 2210 In addition to directly executing the application installed in the electronic device 2210 , the electronic device 2210 executes the application installed in the external electronic device by accessing the external electronic device, and the application executed by the external electronic device The electronic device 2210 may include receiving information on an application installed in the external electronic device.

21 is a simplified block diagram of an electronic device according to various embodiments of the present disclosure; This simplified block diagram may indicate a functional configuration of the electronic device 2210 in the environment 2200 of FIG. 20A or the electronic device 2210 in the environment 2250 of FIG. 20B .

Referring to FIG. 21 , an electronic device 2210 may include a processor 2230 , a memory 2235 , a display 2240 , a communication circuit 2245 , a camera 2247 , and/or a sensor 2249 . .

The processor 2230 may control the overall operation of the electronic device 2210 . The processor 2230 may execute applications that provide an advertisement service, an Internet service, a game service, a multimedia service, a navigation service, and the like. In various embodiments, the processor 2230 may include one processor core or a plurality of processor cores. For example, the processor 2230 may include a multi-core such as a dual-core, a quad-core, or a hexa-core. According to embodiments, the processor 2230 may further include a cache memory located internally or externally.

The processor 2230 may receive commands from other components of the electronic device 2210 , interpret the received commands, and perform calculations or process data according to the interpreted commands.

The processor 2230 may process data or signals generated or generated by an application. For example, the processor 2230 may request a command, data, or signal from the memory 2235 to execute or control an application. The processor 2230 may write (or store) or update a command, data, or signal to the memory 2235 to execute or control an application.

The processor 2230 may interpret and process a message, data, command, or signal received from the memory 2235 , the display 2240 , the communication circuit 2245 , the camera 2247 , or the sensor 2249 . can In addition, the processor 2230 may generate a new message, data, command, or signal based on the received message, data, command, or signal. The processor 2230 may provide a processed or generated message, data, command, or signal to the memory 2235 , the display 2240 , the communication circuit 2245 , the camera 2247 , or the sensor 2249 , etc. .

All or part of the processor 2230 may include other components within the electronic device 2210 (eg, memory 2235, display 2240, communication circuitry 2245, camera 2247, or sensor 2249). may be electrically or operably coupled with or connected to.

According to embodiments, the processor 2230 may include one or more processors. For example, the processor 2230 includes an application processor (AP) that controls a higher layer program such as an application program, a graphics processing unit (GPU) that configures a screen displayed on the display 2240 and controls the screen, It may include an image signal processor for controlling the camera 2247, a sensor hub for controlling the sensor 2249, or a communication processor (CP) for controlling communication. have.

The memory 2235 may store a command for controlling the electronic device 2210 , a control command code, control data, or user data. For example, the memory 2235 may include an application, an operating system (OS), middleware, and/or a device driver.

The memory 2235 may include one or more of volatile memory and non-volatile memory. Volatile memory includes dynamic random access memory (DRAM), static RAM (SRAM), synchronous DRAM (SDRAM), phase-change RAM (PRAM), magnetic RAM (MRAM), resistive RAM (RRAM), and ferroelectric RAM (FeRAM). may include The nonvolatile memory may include a read only memory (ROM), a programmable ROM (PROM), an electrically programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a flash memory, and the like.

The memory 2235 includes a nonvolatile medium (medium) such as a hard disk drive (HDD), a solid state disk (SSD), an embedded multi media card (eMMC), and a universal flash storage (UFS). may include

The display 2240 may output content, data, or a signal. In various embodiments, the display 2240 may display an image signal processed by the processor 2230 . For example, display 2240 may display a capture or still image. As another example, the display 2240 may display a video or a camera preview image. As another example, the display 2240 may display a graphical user interface (GUI) so that the user can interact with the electronic device 2210 .

The display 2240 may be configured with a liquid crystal display (LCD) or an organic light emitting diode (OLED).

According to embodiments, the display 2240 may be configured with an integrated touch screen by being coupled with a sensor capable of receiving a touch input or the like.

The communication circuit 2245 may be used to create a communication path between the electronic device 2210 and another electronic device (eg, an external electronic device (eg, the electronic device 2220 ), a device embedded in a vehicle). The communication circuit 2245 may support a designated protocol capable of connecting to the other electronic device in a wired or wireless manner. For example, the communication circuit 2245 is a Bluetooth (bluetooth) communication technique, a BLE (bluetooth low energy) communication technique, a Wi-Fi (wireless fidelity) communication technique, a cellular (cellular, or mobile) communication technique, or It may include a module (or circuit) for at least one of a wire communication technique. For another example, the communication circuit 2245 is connected to a connection terminal such as a high definition multimedia interface (HDMI) connector, a universal serial bus (USB) connector, an SD card connector, or an audio connector (eg, a headphone connector) ( in association with) HDMI, USB interface, SD card interface, or audio interface.

The communication circuit 2245 may provide the processor 2230 with information or data received from the other electronic device through the communication path. The communication circuit 2245 may transmit information or data provided from the processor 2230 to the other electronic device through the communication path.

The camera 2247 may capture a still image or a moving image. In various embodiments, camera 2247 may include at least one of one or more lenses (eg, a lens assembly), an image sensor, flash, an image stabilizer, or a buffer memory. For example, the one or more lenses may collect light emitted from a subject to be imaged.

According to embodiments, the camera 2247 may include a plurality of lens assemblies. For example, the plurality of lens assemblies may have the same lens property (eg, angle of view, focal length, low dynamic focus, f number, or optical zoom). For example, at least one of the plurality of lens assemblies may have a lens property that is different from other at least one of the plurality of lens assemblies. For example, at least one of the plurality of lens assemblies may be configured for a wide-angle lens, and at least another of the plurality of lens assemblies may be configured for a telephoto lens.

In various embodiments, the flash may emit a light source that is used to enhance light emitted from a subject. For example, the flash may include one or more light emitting diodes (eg, a red-green-blue (RGB) LED, a white LED, an infrared LED, or an ultraviolet LED), or a xenon lamp.

In various embodiments, the image sensor converts the light transmitted from the subject through the one or more lenses into an electrical signal, thereby generating an image corresponding to the subject (eg, an image related to a vehicle including the electronic device 2210 ). can be obtained. In an embodiment, the image sensor includes one image sensor selected from image sensors having different properties, such as an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor, and a plurality of image sensors having the same property. , or a plurality of image sensors having different properties. Each image sensor included in the image sensor may be implemented as, for example, a charged coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.

In various embodiments, the image stabilizer responds to a movement of the camera 2247 or the electronic device 2210 to at least partially compensate for a negative effect (eg, image shake) caused by the movement on a photographed image. One or more lenses or the image sensor may be moved or controlled in a specific direction (eg, read-out timing is adjusted, etc.). In an embodiment, the image stabilizer may be implemented as an optical image stabilizer, and a gyro sensor (eg, sensor 2249) or an acceleration sensor (eg, sensor 2249) disposed inside or outside the electronic device 2210 or camera 2247 : The motion can be detected using the sensor 2249).

In various embodiments, the buffer memory may at least temporarily store at least a portion of the image acquired through the image sensor for a next image processing operation. For example, when delay in image acquisition according to the shutter or high-speed acquisition of a plurality of images is executed, the acquired original image (eg, high-resolution image) is stored in the buffer memory, A copy image (eg, a lower resolution image) may be previewed via the display 2240 . When a specified condition is satisfied after the preview (eg, a user input or a system command), at least a part of the original image stored in the buffer memory may be acquired and processed by the image signal processor. In an embodiment, the buffer memory may be configured as at least a part of the memory 2235 or a separate memory operated independently of the memory 2235 .

The sensor 2249 may detect an internal operating state of the electronic device 2210 (eg, power or temperature) or an external environmental state of the electronic device 2210 (eg, the state of the environment 2200 or environment 2250 ). A corresponding electrical signal or data value may be generated. For example, the sensor 2249 may include a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor. It may include a sensor.

In various embodiments, at least one of the communication circuit 2245 , the camera 2247 , or the sensor 2249 may be disposed outside the electronic device 2210 . For example, at least one of the communication circuit 2245 , the camera 2247 , and the sensor 2249 may be a component included in the environment 2210 rather than a component of the electronic device 2210 . However, it is not limited thereto.

In various embodiments, the processor 2230 may generate a first partial area constituting the display area of the display 2240 and a second partial area adjacent to the first partial area while the first application and the second application are executed. a widget of the second application that displays an execution screen of the first application in the first partial region and includes a first executable element and a second executable element in the second partial region; 1 Display a first executable object for indicating an application, display an execution screen of the first application in the first partial area, and display the widget of the second application and the second application in the second partial area Based on receiving a first user input for the first executable element of the widget of the second application while displaying the first executable object, from the execution screen of the first application in the first partial region display the switched execution screen of the second application, and the widget of the first application switched from the first executable object and the widget of the second application switched from the widget of the second application in the second partial area, the second application display a second executable object for indicating, display an execution screen of the first application in the first partial area, and display the widget of the second application and the first executable in the second partial area Based on receiving a second user input for the second executable element of the widget of the second application while displaying the object, superimposed on the execution screen of the first application displayed in the first partial region, and display at least one visual item available through the second executable element within an area extending from the widget of the second application.

In various embodiments, the processor 2230 may be configured to display an execution screen of the first application in the first partial area in a state in which no user input is received while the first application and the second application are being executed. and display the widget of the second application and the first executable object within the second partial area.

In various embodiments, the first user input may be a single tap input to the first executable element, and the second user input may be a single tap input to the second executable element. The processor 2230 is configured to display the execution screen of the first application in the first partial region and display the widget of the second application and the first executable object in the second partial region. Based on receiving a third user input for dragging the widget of the second application in the first direction, the extended widget of the second application switched from the widget of the second application is displayed in the second partial area; , while displaying the execution screen of the second application in the first partial area and displaying the widget of the first application and the second executable object in the second partial area, the widget of the first application is the based on receiving a fourth user input for dragging in a first direction, display an extended widget of the first application switched from the widget of the first application in the second partial area, wherein The display position of the first executable object may be determined by displaying the widget of the second application through the third user input in a state in which the direction from the widget of the second application to the first executable object is the first direction. When switching to the extended widget of the second application, the second application is moved in the first direction according to the transition from the widget of the second application to the extended widget of the second application, and the first execution is performed from the widget of the second application When the widget of the second application is switched to the extended widget of the second application through the third user input in a state that the direction to the possible object is a second direction opposite to the first direction, of the second application from the widget of the second application. Independently of the transition to the extended widget, the display position of the second executable object may be maintained in a state in which the direction from the widget of the first application to the second executable object is the first direction. When the widget of the first application is switched to the extended widget of the first application through the fourth user input, according to the transition from the widget of the first application to the extended widget of the first application, the first direction, and in a state in which the direction from the widget of the first application to the second executable object is the second direction, the widget of the first application is extended by the first application through the fourth user input. When the widget is switched, it may be maintained independently of the transition from the widget of the first application to the extended widget of the first application.

In some embodiments, the processor 2230 is configured to display an execution screen of the first application in the first partial region and display a widget of the second application and the first executable object in the second partial region. Based on receiving a fifth user input for dragging the widget of the second application in the second direction during display, the reduced widget of the second application switched from the widget of the second application is displayed as the second part while displaying in a region, displaying an execution screen of the second application in the first partial region, and displaying the widget of the first application and the second executable object in the second partial region, the first Based on receiving a sixth user input for dragging the widget of the application in the second direction, the reduced widget of the first application switched from the widget of the first application may be displayed in the second partial area The display position of the first executable object may be determined by the widget of the second application through the fifth user input in a state in which the direction from the widget of the second application to the first executable object is the first direction. When the second application is switched to the reduced widget, the widget may be moved in the second direction according to the transition from the widget of the second application to the reduced widget of the second application, and the widget of the second application When the widget of the second application is switched to the reduced widget of the second application through the fifth user input in a state in which the direction from the to the first executable object is the second direction, independent of the transition from the widget to the reduced widget of the second application, wherein the display position of the second executable object is such that the direction from the widget of the first application to the second executable object is In the first direction, through the sixth user input, the first When the widget of the application is switched to the reduced widget of the first application, it is moved in the second direction according to the transition from the widget of the first application to the reduced widget of the first application, When the widget of the first application is switched to the reduced widget of the first application through the sixth user input while the direction from the widget to the second executable object is the second direction, the first application may be maintained independently of the transition from the widget of the first application to the reduced widget of the first application.

In various embodiments, the widget of the second application and the first executable object may be displayed in the second partial area together with a third executable object for indicating a third application, and the processor 2230 ) displays the execution screen of the first application in the first partial area and displays the widget of the second application and the first executable object together with the third executable object in the second partial area based on receiving a third user input for dragging the third executable object in a first direction while maintaining the display of the execution screen of the first application in the first partial area, execute an application, and display the widget of the third application switched from the third executable object together with the widget of the second application and the first executable object in the second partial region .

In various embodiments, the processor 2230 receives a third user input for another area in the second partial area that is distinct from the display area of the widget of the second application and the display area of the first executable object. a third executable object for indicating a function distinct from the functions available through the first application and the second application together with the widget of the second application and the first executable object display within the second sub-area, and execute, based on receiving a fourth user input for the third executable object, the function indicated by the third executable object.

In some embodiments, in response to the execution of the function indicated by the third executable object, the processor 2230 may display an execution screen of the first application displayed in the first partial area of the function. To switch to an execution screen, it may be configured.

In some embodiments, the processor 2230 is configured to, in response to the execution of the function indicated by the third executable object, cause the third executable object displayed in the second sub-region to execute the function. It may be configured to switch to a widget for indicating a state.

In some embodiments, the function is a function that is available through the electronic device and is distinguished from the functions available through the first application and the second application. It may be a function provided through

In some other embodiments, the function is most often the electronic device among a plurality of functions that are available through the electronic device and are distinct from the functions available through the first application and the second application. It may be a function provided through .

In some embodiments, the processor 2230 is configured to use the third executable object through the first application and the second application based on receiving a fifth user input for the third executable object. switch to a fourth executable object for indicating another function distinct from the possible functions, and based on receiving a sixth user input for the fourth executable object, and the fourth user input may be a single tap input for the third executable object, and the fifth user input may be configured to execute the other function indicated by the third executable object. It may be an input for dragging in a specified direction.

In some embodiments, the processor 2230 is configured to receive a fifth user input for the other area within the second partial area that is distinct from the display area of the widget of the second application and the display area of the first executable object. based on receiving, execute the function of the first application indicated by the fifth user input, and based on the execution of the function of the first application, the first application displayed in the first partial area may be configured to change a state of an execution screen of , and a property of the fifth user input may be distinguished from a property of the third user input.

In some embodiments, the processor 2230 is configured to receive a fifth user input for the other area within the second partial area that is distinct from the display area of the widget of the second application and the display area of the first executable object. based on receiving, execute the function of the second application indicated by the fifth user input, and based on the execution of the function of the second application, the second application displayed in the second partial area can be configured to change the state of the widget of

In some embodiments, the processor 2230 is configured to receive a fifth user input for the other area within the second partial area that is distinct from the display area of the widget of the second application and the display area of the first executable object. Based on receiving, displaying a handwriting input field in an overlapping manner on the execution screen of the first application displayed in the first partial area, and receiving at least one drag input initiated from the handwriting input field , to recognize a character indicated by a path of the at least one drag input, and to execute a function corresponding to the recognized character, wherein the attribute of the fifth user input is that of the third user input. properties can be distinguished.

In an embodiment, the handwriting input field may extend from at least a part of the other area within the second partial area, and a part of the execution screen of the first application disposed under the handwriting input field may be visible. , may be translucent.

In an embodiment, the processor 2230 is displayed as being superimposed on the execution screen of the first application displayed in the first partial area, along with the handwriting input field, based on the fifth user input, a sixth for displaying a plurality of executable objects, respectively, for indicating a plurality of applications including a first application and the second application, and selecting one (a) executable object from among the plurality of executable objects Based on receiving the at least one drag input initiated from the handwriting input field after receiving the user input, the character indicated by the path of the at least one drag input is recognized, and the sixth user input is and to execute an application indicated by the executable object selected by and a function corresponding to the recognized character.

In one embodiment, the processor 2230 is configured to pass a part of the execution screen of the first application beyond the handwriting input field while the at least one drag input initiated from the handwriting input field is received. It may be configured to recognize a path of at least one drag input as a part of the text instead of a user input for the first application. For example, the processor 2230 may be configured to display a part of the path of the at least one drag input on the execution screen of the first application displayed in the first partial area.

In various embodiments, the processor 2230 displays an execution screen of the first application in the first partial region and displays the widget of the second application and the first executable object in the second partial region. a third for guiding a recommended function in another area within the second partial area distinct from the display area of the widget of the second application and the display area of the first executable object during display display an executable object, display an execution screen of the first application in the first partial region, and execute the third execution together with the widget of the second application and the first executable object in the second partial region be configured to execute the recommended function based on receiving a third user input for the third executable object while displaying the possible object, wherein the recommended function is associated with the electronic device and , may be identified from a model configured to predict a future execution pattern of the electronic device based on past execution heuristics including a past execution history of the electronic device.

In some embodiments, the processor 2230 is configured to display an execution screen of the first application in the first partial region, and include a widget of the second application and the first executable object in the second partial region. a fourth for guiding another recommended function distinct from the recommended function based on receiving a fourth user input for the third executable object while displaying the third executable object together display an executable object, and execute the other recommended function based on receiving a fifth user input for the fourth executable object, wherein the attribute of the fourth user input includes: It can be distinguished from the attribute of the third user input.

In some embodiments, the processor 2230 is configured to display an execution screen of the first application in the first partial region, and include a widget of the second application and the first executable object in the second partial region. based on receiving a fourth user input for the third executable object while presenting the third executable object together, maintain the display of the third executable object, and Displaying a plurality of executable objects for guiding, respectively, a plurality of other recommended functions distinguished from the recommended function in an area extending from the third executable object, superimposed on the execution screen of the first application, , based on receiving a fifth user input for selecting (a) the third executable object and one (a) executable object of the plurality of executable objects, the executable selected by the fifth user input and execute a recommended function guided by an object, and the attribute of the fourth user input may be distinguished from the attribute of the third user input.

In various embodiments, the processor 2230 displays an execution screen of the first application in the first partial region and displays the widget of the second application and the first executable object in the second partial region. On the basis of receiving a third user input dropped from the first partial area after dragging the widget of the second application during display, the reduced execution screen of the first application in the first partial area and the display a reduced execution screen of a second application, and display the first executable object and the second executable object switched from the widget of the second application in the second partial region, The attribute of the third user input may be distinguished from the attribute of the first user input and the attribute of the second user input.

In some embodiments, the arrangement of the reduced execution screen of the first application and the reduced execution screen of the second application displayed in the first partial region may include the second It may be determined based on the location of the widget of the application.

In various embodiments, the processor 2230 is configured to display the first executable object and the second executable object in the second sub-region without displaying any execution screen in the first sub-region. , receiving a third user input dropping from the first partial region after dragging both the first executable object and the second executable object, and based on receiving the third user input, the first Execute an application and the second application, and display the reduced execution screen of the first application and the reduced execution screen of the second application in the first partial area in response to the execution of the first application and the second application The first executable object and the second executable object displayed within the second subregion may be maintained independently of receipt of the third user input.

In some embodiments, the processor 2230 is configured to display the reduced execution screen of the first application and the reduced execution screen of the second application in the first partial region, and the second partial region in the second partial region. While displaying the first executable object and the second executable object, a boundary between the reduced execution screen of the first application and the reduced execution screen of the second application displayed in the first partial region is first defined On the basis of receiving a fourth user input for moving in the direction, the display area of the reduced execution screen of the first application is expanded and the display area of the reduced execution screen of the second application is reduced, and the first while displaying the reduced execution screen of the first application and the reduced execution screen of the second application in the partial region and displaying the first executable object and the second executable object in the second partial region , a fifth user for moving a boundary between the reduced execution screen of the first application and the reduced execution screen of the second application displayed in the first partial region in a second direction opposite to the first direction Based on receiving the input, the display area of the reduced execution screen of the first application may be reduced and the display area of the reduced execution screen of the second application may be expanded.

In an embodiment, the arrangement of at least one of the plurality of visual objects in the reduced execution screen of the first application may include an expansion of a display area of the reduced execution screen of the first application caused by the fourth user input may change according to a reduction in the display area of the reduced execution screen of the first application caused by the fifth user input, and a plurality of visual objects in the reduced execution screen of the second application The arrangement of at least one of the following is changed according to the reduction of the display area of the reduced execution screen of the second application caused by the fourth user input, and the reduction of the second application caused by the fifth user input It may be changed according to the expansion of the display area of the executed execution screen.

In some embodiments, the processor 2230 is configured to execute the reduced execution of the first application while displaying the reduced execution screen of the first application and the reduced execution screen of the second application in the first partial area. Receive a fourth user input for a screen, and switch from the reduced execution screen of the first application and the reduced execution screen of the second application in the first partial region based on the reception of the fourth user input displaying an execution screen of the first application, and displaying the widget of the first executable object and the second application switched from the second executable object in the second partial area, Receive a fifth user input for the reduced execution screen of the second application while displaying the reduced execution screen and the reduced execution screen of the second application in the first partial region, based on reception, display the reduced execution screen of the first application and the execution screen of the second application switched from the reduced execution screen of the second application in the first partial region, and the second partial region and display the widget of the first application switched from the first executable object and the second executable object in the .

In some embodiments, the drag path of the third user input according to claim 24, wherein the arrangement of the reduced execution screen of the first application and the reduced execution screen of the second application in the first partial region can be determined based on

In various embodiments, the processor 2230 is configured to display an execution screen of a third application in the first partial region, and display the first executable object, the second executable object, and the second executable object in the second partial region. receiving a third user input for dragging both the first executable object and the second executable object and then dropping from the first partial area while displaying a third executable object for indicating a third application; , based on receiving the third user input, execute the first application and the second application, and switch from the execution screen of the third application in response to the execution of the first application and the second application display the reduced execution screen of the first application and the reduced execution screen of the second application in the first partial region, and the first executable object and the second executable in the second partial region and display an object, and a widget of the third application switched from the third executable object.

In some embodiments, the arrangement in the first partial area of the reduced execution screen of the first application and the reduced execution screen of the second application switched from the execution screen of the third application may include: It may be determined based on a drag path of a user input.

In various embodiments, the processor 2230 displays an execution screen of the first application in the first partial region and displays the widget of the second application and the first executable object in the second partial region. During display, a designated event is identified from the passenger seat of the vehicle, and based on the identification, the widget or the second application of the second application in the second partial area displayed closer to the driver's seat of the vehicle than to the passenger seat of the vehicle and move at least one of one executable object, wherein at least one of the moved second application widget or the first executable object is closer to the passenger seat of the vehicle than to the driver's seat of the vehicle. It may be displayed within a partial area.

In some embodiments, the processor 2230 may be configured to identify the designated event by identifying a hovering input or gesture input over the display area while identifying that both hands are in contact with the steering wheel of the vehicle. can

In some embodiments, the processor 2230 is configured to identify at least one of a change in the weight of the user seated in the passenger seat of the vehicle or a change in tension of the seat belt worn by the user seated in the passenger seat of the vehicle. may be configured to identify a designated event.

In some embodiments, the processor 2230 may be configured to identify the designated event by identifying a location where the user's hand entered the display area is closer to the passenger seat of the vehicle than to the driver's seat of the vehicle. and identifying that the position at which the user's hand entered the display area is closer to the passenger seat of the vehicle than to the driver's seat of the vehicle may be performed before the user's finger comes into contact with the display area.

In some embodiments, the processor 2230 may be configured to, based on the identification, at least one executable in the execution screen of the first application in the first partial region displayed closer to the driver's seat of the vehicle than to the passenger seat of the vehicle. The element may be configured to move, and the moved at least executable element may be displayed in the first partial region closer to a passenger seat of the vehicle than to a driver seat of the vehicle.

In various embodiments, the processor 2230 displays an execution screen of the first application in the first partial region while the vehicle is moving, and displays a widget of the second application in the second partial region and while displaying the first executable object, identifying a hovering input resulting from a user's hand positioned over the second subregion and spaced apart from the second subregion, based on identifying the hovering input, expand the second subregion and expand the widget and the first executable object of the second application within the second subregion and expand the first executable element and the second executable element of the widget of the second application It can be configured to expand

In some embodiments, the size of the first partial region may be maintained independently of the expansion of the second partial region, and a portion of the expanded second partial region may display the execution screen of the first application. It may overlap the first partial region.

In some embodiments, the processor 2230 may be configured to reduce the first partial region and reduce an execution screen of the first application within the first partial region based on identifying the hovering input. have.

In some embodiments, the second partial region may be expanded to a size corresponding to the speed of the moving vehicle, based on identifying the hovering input, the widget of the second application and the first Each of the executable objects may be expanded to a size corresponding to the speed based on identifying the hovering input, and wherein each of the first executable element and the second executable element identifies the hovering input. Based on that, it may be expanded to a size corresponding to the speed.

In various embodiments, the processor 2230 displays an execution screen of the first application in the first partial region while the vehicle is moving, and displays a widget of the second application in the second partial region and while displaying the first executable object, identifying a hovering input resulting from a hand of a user positioned over the first subregion and spaced apart from the first subregion, based on identifying the hovering input, and expand at least one executable element in the execution screen of the first application displayed in the first partial area.

In various embodiments, the processor 2230 displays an execution screen of the first application in the first partial region while the vehicle is moving, and displays a widget of the second application in the second partial region and while displaying the first executable object, identify a hovering input resulting from a user's hand spaced from the display area and positioned above the display area, and in a state where the speed of the vehicle being moved is equal to or greater than a specified speed. Based on the identification of the hovering input, a notification message for guiding that control of the execution screen of the first application and the widget of the second application is limited through the user input, the execution screen of the first application and display, superimposed on, and stop displaying the notification message based on identifying that a specified time has elapsed from the timing of displaying the notification message.

In various embodiments, the processor 2230 displays an execution screen of the first application in the first partial area while executing the first application among the first application and the second application, and Display the first executable object and the second executable object in a second partial region, display an execution screen of the first application in the first partial region, and display the first execution in the second partial region Distinguish between functions supported by the first application and supported by the second application, via at least one communication circuit of the electronic device, while displaying the possible object and the second executable object Receiving a signal related to functions to be performed, and based on receiving the signal, execute the second application, and superimpose on the execution screen of the first application displayed in the first partial area, the received A notification for a signal is displayed using the executed second application, and the display of the notification is displayed in response to receiving a user input for the notification based on identifying that the first application is a designated application. stop, maintain displaying the execution screen of the first application in the first partial region, and in the second partial region, the first executable object and the second transitioned from the second executable object The widget of the second application may be configured to display a widget of the application, and the widget of the second application switched from the second executable object may include information related to the notification.

In some embodiments, the processor 2230 is configured to stop displaying the notification in response to receiving a user input for the notification, based on identifying that the first application is not a designated application, and to convert the execution screen of the first application displayed in the first partial region to the execution screen of the second application, and to convert the first executable object displayed in the second partial region to a widget of the first application; may be configured, and the execution screen of the second application may include information related to the notification.

In various embodiments, the processor 2230 displays an execution screen of the first application in the first partial area while executing the first application among the first application and the second application, and Display the first executable object and the second executable object in a second partial region, display an execution screen of the first application in the first partial region, and display the first execution in the second partial region Distinguish between functions supported by the first application and supported by the second application, via at least one communication circuit of the electronic device, while displaying the possible object and the second executable object Receiving a signal, based on receiving the signal, based on receiving the signal, and executing the second application, based on identifying that the first application is a designated application, in executing the second application In response, maintaining displaying the execution screen of the first application in the first partial region, converting the second executable object displayed in the second partial region into a widget of the second application, and Based on identifying that the first application is not the designated application, the execution screen of the first application displayed in the first partial area is switched to the execution screen of the second application in response to the execution of the second application and to convert the first executable object displayed in the second partial region into a widget of the first application, the widget of the second application converted from the second executable object and the second executable object Each of the execution screens of the second application switched from the execution screen of the first application may include information related to the signal.

In various embodiments, the processor 2230 displays an execution screen of the first application in the first partial region and displays the widget of the second application and the first executable object in the second partial region. Receiving a third user input during display, and based on receiving the third user input, a reduced execution screen of the first application and the execution screen of the first application displayed in the first partial area Switching to a reduced execution screen of a second application, converting a widget of the second application displayed in the second partial area to the second executable object, and changing the widget of the second application displayed in the second partial area to the second executable object Based on receiving a fourth user input for selecting the reduced execution screen of the first application from among the reduced execution screen and the reduced execution screen of the second application, the first displayed in the first partial area The reduced execution screen of the application and the reduced execution screen of the second application are converted into the execution screen of the first application, and the second executable object displayed in the second partial area is converted into a widget of the second application and receiving a fifth user input for selecting a reduced execution screen of the second application from among the reduced execution screen of the first application and the reduced execution screen of the second application displayed in the first partial region Based on that, the reduced execution screen of the first application and the reduced execution screen of the second application displayed in the first partial area are switched to the execution screen of the second application, and displayed in the second partial area and convert the first executable object into a widget of the first application, and a property of the third user input may be distinguished from a property of each of the first user input and the second user input .

In some embodiments, the third user input may be a hovering input spaced from the display area and having a designated pattern resulting from a user's hand positioned on the display area.

In some embodiments, the third user input displays an execution screen of the first application in the first partial region and includes a widget of the second application and the first executable object in the second partial region. may be an eye gaze input for looking at the display area for a specified period of time while displaying, wherein the eye gaze input includes the electronic device or another in the vehicle operatively coupled to the electronic device. ) may be identified based on an image acquired through at least one camera of the electronic device.

In an embodiment, the fourth user input includes a reduced execution screen of the first application from among the reduced execution screens of the first application and the reduced execution screens of the second application displayed in the first partial area. It may be an eye gaze input viewed for a specified time, and the fifth user input may include the second of the reduced execution screen of the first application and the reduced execution screen of the second application displayed in the first partial region. It may be an eye-gaze input that looks at the reduced execution screen of the application for a specified time.

In some embodiments, the third user input displays an execution screen of the first application in the first partial region and includes a widget of the second application and the first executable object in the second partial region. may be an input to a physical input means included in a steering wheel in the vehicle while displaying , the physical input means may include at least one of a rotatable structure or a physical button.

In some embodiments, the third user input may be a gesture input having a specified pattern resulting from a user sitting in the driver's seat of the vehicle or a user sitting in the passenger seat of the vehicle, and the gesture input having the specified pattern may be , may be identified based on an image obtained via at least one camera of the electronic device or another electronic device in the vehicle operatively coupled with the electronic device.

In various embodiments, the processor 2230 displays an execution screen of the first application in the first partial region and displays the first executable object and the second executable object in the second partial region. and receiving a third user input while displaying the reduced execution screen of the second application on another display of the electronic device, which is distinguished from the electronic device, based on receiving the third user input , converts the execution screen of the first application displayed in the first partial area to the execution screen of the second application, and converts the reduced execution screen of the second application displayed on the other display to the reduced execution of the first application It may be configured to switch to a screen, and a property of the third user input may be distinguished from a property of each of the first user input and the second user input.

In various embodiments, the processor 2230 establishes a connection between the electronic device and a first other electronic device located in the vehicle using at least one communication circuit of the electronic device, and performs the at least one communication Data received from the first other electronic device through the connection between the electronic device and the first other electronic device by establishing a connection between the electronic device and a second other electronic device located in the vehicle using a circuit based on: displaying the execution screen of the first application in the first partial area and displaying the first executable object and the widget of the second application in the second partial area, based on the data While displaying the execution screen of the first application in the first partial region and displaying the first executable object and the widget of the second application in the second partial region, the second electronic device and the Information on the execution screen of the first application displayed in the first partial region to the second other electronic device through the connection between the electronic devices and information on the widget of the second application displayed in the second partial region through the connection between the second other electronic device and the electronic device from the second other electronic device that transmits and receives information on the execution screen of the first application and information on the widget of the second application, information on at least one user input for changing at least one of the state of the execution screen of the first application displayed in the first partial region or the state of the widget of the second application displayed in the second partial region receiving, and transmitting information on the at least one user input to the first other electronic device through a connection between the first other electronic device and the electronic device, and from the first other electronic device to the first other electronic device through the connection between the device and the electronic device, Receiving other data about at least one of the state of the execution screen of the first application changed according to the at least one user input or the state of the widget of the second application changed according to the at least one user input, Based on the other data, it may be configured to display at least one of a changed state of the execution screen of the first application and a changed state of a widget of the second application.

In some embodiments, in the processor 2230, the second other electronic device that has received the information on the execution screen of the first application and the information on the widget of the second application receives the at least one user input. while at least one of the first application or the second application is controlled by the user of the second other electronic device through a connection between the second other electronic device and the electronic device from the second other electronic device receiving a signal for notifying that a signal is being received, and based on receiving the signal, information for notifying that at least one of the first application or the second application is controlled by the user of the second other electronic device The display may be configured to overlap the execution screen of the first application displayed in the first partial area.

In various embodiments, the processor 2230 displays an execution screen of the first application in the first partial region and displays the widget of the second application and the first executable object in the second partial region. During display, in the third partial area among a third partial area constituting another display of the electronic device that is distinct from the display and a fourth partial area of the other display adjacent to the third partial area Display the execution screen of the first application, display the widget of the second application and the first executable object in the fourth partial area, and display the execution screen of the first application displayed in the third partial area based on receiving the third user input, execute a function indicated by the third user input, and execute the function in the execution screen of the first application displayed in the first partial area. providing a result, providing a result of execution of the function in an execution screen of the first application displayed in the third partial area, and providing a fourth user to the widget of the second application displayed in the fourth partial area based on receiving the input, execute another function indicated by the fourth user input, and display the result of the execution of the other function within the widget of the second application displayed in the second partial area. and provide a result of execution of the other function within the widget of the second application displayed in the fourth partial area.

In various embodiments, the processor 2230 displays an execution screen of the first application in the first partial region and displays the widget of the second application and the first executable object in the second partial region. based on identifying that the first hovering input caused by the user's hand spaced from the first partial region and positioned over the first partial region during display is maintained for a specified time, within the execution screen of the first application. Move at least one executable element to an area in which the first hovering input is received, display an execution screen of the first application in the first partial area, and display a widget of the second application in the second partial area and a second hovering input caused by a user's hand spaced from and positioned over the second sub-region while displaying the first executable object is maintained for a specified amount of time, The widget of the second application may be configured to move to an area where the second hovering input is received.

In various embodiments, the processor 2230 displays an execution screen of the first application in the first partial region and displays the widget of the second application and the first executable object in the second partial region. receiving the first hovering input based on identifying that a first hovering input caused by a user's hand spaced from the first subregion and positioned over the first subregion during display is maintained for a specified time; Enlarging at least one executable element in the execution screen of the first application located in the region, displaying the execution screen of the first application in the first partial region, and displaying the second application in the second partial region a second hovering input caused by the user's hand spaced from the display area of the widget of the second application and positioned above the display area of the widget of the second application while displaying the widget and the first executable object of based on identifying that it is maintained for a period of time, it may be configured to enlarge the widget of the second application.

In various embodiments, the processor 2230 monitors whether an eye gaze input for viewing the display area for a specified time is received while the execution screen of the first application is displayed in the first partial area. and, based on monitoring that the eye-gaze input is not received, display event information in the execution screen of the first application using a designated timing or a designated period, and monitor reception of the eye-gaze input Based on that, it may be further configured to display the event information in the execution screen of the first application using another specified timing distinct from the specified timing or another specified period different from the specified period.

In various embodiments, the first application may be an application for providing a navigation service, and the processor 2230 selects a destination while displaying an execution screen of the first application in the first partial area. Based on receiving a user input for setting, identifying whether the destination set by the user input is a destination initially set in the electronic device, and identifying that the destination is not a destination initially set in the electronic device to display event information in the execution screen of the first application using a specified timing or a specified period, and based on identifying that the destination is a destination initially set in the electronic device, another It may be further configured to display the event information in the execution screen of the first application using a designated timing or another designated period that is different from the designated period.

22 is a flowchart illustrating a method of an electronic device for controlling a screen displayed on a display according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

23 illustrates an example of a screen displayed on a display of an electronic device according to various embodiments of the present disclosure.

24 illustrates an example of switching a screen displayed on a display of an electronic device based on a user input for a widget, according to various embodiments of the present disclosure.

25 illustrates an example of switching a screen displayed on a display of an electronic device based on another user input for a widget, according to various embodiments of the present disclosure.

Referring to FIG. 22 , in operation 2255 , the processor 2230 may execute a first application and a second application. For example, the first application may be an application installed in the electronic device 2210 . For another example, the first application is an electronic device that is distinct from the electronic device 2210 (eg, an electronic device in a vehicle that is distinct from the electronic device 2220 or the electronic device 2220 ). It may be an application installed within. However, it is not limited thereto. For example, the second application may be an application installed in the electronic device 2210 . As another example, the second application may be an application installed in the other electronic device that is distinguished from the electronic device 2210 . However, it is not limited thereto.

In operation 2257 , the processor 2230 performs a first partial area constituting a display area of the display 2240 and adjacent to the first partial area while the first application and the second application are executed. a first executable for displaying an execution screen of the first application in the first partial area of the second partial area and instructing a widget of the second application and the first application in the second partial area object can be displayed. For example, the display area of the display 2240 may include only the first partial area and the second partial area. As another example, the display area of the display 2240 may further include another partial area distinct from the first partial area and the second partial area. However, it is not limited thereto.

In various embodiments, the relative positional relationship between the first partial region and the second partial region may be defined in various ways. For example, referring to FIG. 23 , such as state 2300 , first subregion 2302 may be defined directly above second subregion 2304 . For another example, such as state 2320 , first subregion 2302 can be defined directly below second subregion 2304 . As another example, as state 2340 , first subregion 2302 may be defined to the right of second subregion 2304 . As another example, as state 2360 , first subregion 2302 can be defined to the left of second subregion 2304 . However, it is not limited thereto.

In various embodiments, the first partial area may be an area for displaying an execution screen of at least one application among a plurality of applications being executed by the electronic device 2210 . In various embodiments, the second partial area is at least some of the remaining applications except for at least one application providing a screen in the first partial area among a plurality of applications being executed by the electronic device 2210 . It may be an area for displaying a widget or an executable object of In various embodiments, the second partial area may be an area for displaying at least one executable object for indicating at least one application that is not being executed by the electronic device 2210 . For example, the second partial area may be an area for displaying at least one executable object for indicating at least one application frequently executed by the electronic device 2210 . The identification of the at least one application may be executed by the processor 2230 without a user input. As another example, the second partial area may be an area for displaying at least one executable object for indicating at least one application identified by a user input of the electronic device 2210 . However, it is not limited thereto.

In various embodiments, the processor 2230 displays only the execution screen of the first application in the first partial area, and only the first executable object and the widget of the second application in the second partial area rather than at least one other executable object. For example, referring to FIG. 23 , in a state 2300 , the processor 2230 is configured to display the first application in a first partial area 2302 while the first application and the second application are being executed. An executable object ( 2314 ) for displaying only the execution screen 2310 of 2315) (eg, an object for controlling air conditioning in a vehicle), an executable object 2316 (eg, an object for providing a list of applications that can be executed in a vehicle), an executable object 2317 ) (object for providing call service), and executable object 2318 (object for providing voice input-based service). However, it is not limited thereto.

For example, the first executable object 2314 may include an executable object 2315 , an executable object 2316 , and an executable object 2317 to indicate that the first application is running. ), and relative to executable object 2318 may be highlighted. For example, referring to FIG. 23 , as in a state 2300 , the first executable object 2314 is an executable object 2315 and an executable object to indicate that the first application is in a running state. Unlike 2316 , executable object 2317 , and executable object 2318 , there may be an underline. However, it is not limited thereto.

For example, the widget 2312 of the second application includes a first executable object 2314 , an executable object 2315 , an executable object 2316 , an executable object 2317 , and an executable object 2318 . ) can be larger than For example, the widget 2312 of the second application may display information on a service provided from the running second application (eg, information about a song currently being played when the second application is a music playback application). may include For example, the widget 2312 of the second application may further include an element (eg, a second executable element) for controlling the second application. For example, the widget 2312 of the second application includes a first executable element 2312 - 1 for displaying an execution screen of the second application in the first partial area 2302 and a function of the second application. and a second executable element 2312 - 2 for controlling the second application without displaying an execution screen in the first partial area 2302 . However, it is not limited thereto.

In various embodiments, the widget 2312 of the second application displays the execution screen 2310 of the first application in the first partial region 2302 and the second application in the second partial region 2304 . While displaying the widget 2312 and the first executable object 2314 of the second application, in a state in which no user input is received, it may have the shape shown in the state 2300 of FIG. 23 . For example, in the widget 2312 of the second application, an input means (eg, a user's finger) is positioned on a second executable object 2414 (to be described later) for instructing the second application or the second application. 2 The second executable object 2414 is not transformed from the second executable object 2414 based on the location of a pointer for indicating the location pointed to by the input means. The execution screen 2310 of the first application may be displayed in the entire first partial area 2302 and may be displayed without a separate user input while the second application is executed. However, it is not limited thereto.

In operation 2259, the processor 2230 displays the execution screen of the first application in the first partial region and displays the widget of the second application and the first executable object in the second partial region A user input for the widget of the second application may be received. For example, referring to FIG. 23 , the user input may be a first user input for a first executable element 2312-1 or a second user input for a second executable element 2312-2. have.

In operation 2261, the processor 2230 may identify whether the received user input is the first user input or the second user input. For example, the processor 2230 may execute operation 2263 when the received user input is the first user input, and execute operation 2265 when the received user input is the second user input.

In operation 2263, the processor 2230 displays an execution screen of the second application switched from the execution screen of the first application in the first partial area based on receiving the first user input, display a second executable object for indicating the widget of the first application switched from the first executable object and the widget of the second application switched from the widget of the second application in the second partial area; can For example, referring to FIG. 24 , the processor 2230 may perform a first user input 2400 for a first executable element 2312 - 1 of the widget 2312 of the second application in a state 2300 . In response to receiving , state 2300 may transition to state 2401 . For example, in the state 2401 , the processor 2230 may switch the execution screen 2310 of the first application displayed in the first partial area 2302 to the execution screen 2402 of the second application. have. For example, in the state 2401 , the processor 2230 may convert the widget 2312 of the second application displayed in the second partial region 2304 into a second executable object 2414 . The transition from the widget 2312 of the second application to the second executable object 2414 is performed by the transition from the execution screen 2310 of the first application to the execution screen 2402 of the second application. can be executed For example, in the state 2401 , the processor 2230 may convert the first executable object 2314 displayed in the second partial region 2304 to the widget 2412 of the first application. The transition from the first executable object 2314 to the widget 2412 of the first application may be executed by the transition from the execution screen 2310 of the first application to the execution screen 2402 of the second application. have.

In various embodiments, the second executable object 2414 transitioned from the widget 2312 of the second application is, in the state 2401, an executable state to indicate that the second application is in a running state. Relative to object 2315 , executable object 2316 , executable object 2317 , and executable object 2318 may be highlighted. For example, second executable object 2414 may be underlined, unlike executable object 2315 , executable object 2316 , executable object 2317 , and executable object 2318 . . However, it is not limited thereto.

In various embodiments, the widget 2412 of the first application switched from the first executable object 2314 displays the execution screen 2310 of the first application in the state 2300 in the state 2401 . It may include at least some of the information provided through the For example, the widget 2412 of the first application indicates that, in the state 2401 , the vehicle including the electronic device 2210 should be moved to the left after moving 500 m in order to move to the destination. It may contain information for

In various embodiments, the widget 2412 of the first application in the state 2401 may include a first executable element 2412 - 1 . For example, the widget 2412 of the first application in the state 2401 may include a plurality of executable elements (eg, a first executable element 2312-1 and a second executable element 2312-2). ), unlike the widget 2312 of the second application in the state 2300 including the first executable element 2412 - 1 may be included. For example, the first executable element 2412 - 1 may be used to display the execution screen 2310 of the first application in the first partial area 2302 .

In various embodiments, an executable element included in a widget of an application displayed in the second partial region 2304 may be configured differently according to properties of the application. For example, when the application is an application that requires interaction between the user and the electronic device 2210 relatively frequently, the widget of the application displays the execution screen of the application within the first partial area 2302 . It further includes an executable element for controlling the application without displaying an execution screen of the application as well as an executable element for displaying, wherein the application does not require interaction between the user and the electronic device 2210 relatively often In the case of an application, the widget of the application may include only executable elements for displaying the execution screen of the application in the first partial area 2302 . As another example, when the application is an application controlled by a user input having a relatively low complexity, the widget of the application is an executable element for displaying the execution screen of the application in the first partial area 2302 . In addition, the application further includes an executable element for controlling the application according to the user input without displaying an execution screen of the application, and when the application is an application controlled by a user input having a relatively high complexity, the application The widget of may include only executable elements for displaying the execution screen of the application in the first partial area 2302 . However, it is not limited thereto.

In operation 2265, the processor 2230 superimposes on the execution screen of the first application displayed in the first partial area and expands from the widget of the second application based on receiving the second user input. In the region, at least one visual item available through the second executable element may be displayed. For example, referring to FIG. 25 , the processor 2230, in a state 2300 , a second user input 2500 for a second executable element 2312 - 2 of the widget 2312 of the second application In response to receiving , state 2300 may transition to state 2501 . For example, in the state 2501 , the processor 2230 may display the execution screen 2310 of the first application displayed in the first partial area 2302 in the state 2300 of the second user input 2500 . can remain independent of reception. For example, in state 2501 , processor 2230 is configured to generate first executable object 2314 displayed within second subregion 2304 in state 2300 upon receipt of second user input 2500 . can be maintained independently. For example, in the state 2501 , the processor 2230 receives the second user input 2500 , the widget 2312 of the second application displayed in the second partial region 2304 in the state 2300 . can be maintained independently of For example, in the state 2501 , the processor 2501 superimposes on the execution screen 2310 of the first application, and within an area extending from the widget 2312 of the second application, the at least one visual An area 2502 containing an item may be displayed. For example, the at least one visual item included in the area 2502 may be used to respectively indicate a plurality of songs including a song (eg, Motion) being played through the second application. However, it is not limited thereto. In various embodiments, the at least one visual item may be configured to be executable such that, in response to an input for the at least one visual item, a function corresponding to the at least one visual item is executed. .

25 shows an example in which the area 2502 including the at least one visual item is extended from the widget 2312 of the second application, but the location of the area 2502 including the at least one visual item may be changed. For example, the priority of information included in the partial region of the execution screen 2310 of the first application located under the region 2502 extended from the widget 2312 of the second application is the region ( If the priority of the information provided through the at least one visual item included in 2502 is higher than the priority of the information provided, the area 2502 includes an area within the second partial area 2304 displaying the widget 2312 of the second application and It may extend from other regions of the distinct second sub-region 2304 . However, it is not limited thereto.

In various embodiments, the region 2502 may be configured to be translucent so that at least a partial region of the execution screen 2310 of the first application located below the region 2502 can be viewed. However, it is not limited thereto.

In various embodiments, the region 2502 may be floated on the execution screen 2310 of the first application so that the region 2502 is movable. For example, the region 2502 may be moved based on a drag input for changing the display position of the region 2502 . When the area 2502 is floated over the execution screen 2310 of the first application, the area 2502 is located below the area 2502 while the drag input for changing the display position of the area 2502 is maintained. It may be changed from an opaque state to a semi-transparent state so as to recognize what information is provided through a part of the located execution screen 2310 of the first application. However, it is not limited thereto.

As described above, while displaying the execution screen of the first application being executed, the electronic device 2210 according to various embodiments displays the widget of the second application being executed on the execution screen of the first application. Visibility of the execution screen of the first application may be improved by displaying the display in another area that does not overlap the image. The electronic device 2210 according to various embodiments may enhance delivery of information on the execution state of the second application by displaying the widget of the second application. The electronic device 2210 according to various embodiments of the present disclosure may perform switching of an execution screen displayed in the first partial region or the first partial region according to a region in which a user input for a widget of the second application is received. By providing a pop-up window overlapping the top, it is possible to improve the convenience of controlling the first application and the second application executed in the vehicle.

26 is a flowchart illustrating a method of an electronic device for converting a widget displayed on a display into an extended widget according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

27 illustrates an example of converting a widget of an application into an extended widget of the application according to various embodiments of the present disclosure;

Referring to FIG. 26 , in operation 2602 , the processor 2230 may display the widget of the second application and the first executable object in the second partial area.

In various embodiments, the arrangement of the widget of the second application and the first executable object displayed in the second partial area may be set in various ways. For example, the arrangement of the widget of the second application and the first executable object may be set according to a user input. As another example, the arrangement of the widget of the second application and the first executable object may be set according to the execution frequency of the first application and the execution frequency of the second application. As another example, the arrangement of the widget of the second application and the first executable object may be set according to which of the first application and the second application has been recently executed. As another example, the arrangement of the widget of the second application and the first executable object may be determined according to the local city of the region where the electronic device 2210 is located and the electronic device 2210 of the user of the electronic device 2210 . It may be set according to the usage history. As another example, the arrangement of the widget of the second application and the first executable object may be set differently depending on where the electronic device 2210 is located. However, it is not limited thereto.

For example, the arrangement of the widget of the second application and the first executable object may be a first arrangement in which a direction from the widget of the second application to the first executable object is a first direction or the second application a second arrangement in which a direction from the widget of to the first executable object is a second direction opposite to the first direction.

For example, referring to FIG. 27 , as in a state 2700 , the arrangement of the widget 2312 and the first executable object 2314 of the second application is performed from the widget 2312 of the second application. The direction to one executable object 2314 may be the first direction, the first arrangement.

For another example, referring to FIG. 27 , as in the state 2720 , the arrangement of the widget 2312 and the first executable object 2314 of the second application is performed from the widget 2312 of the second application. It may also be a second arrangement in which the direction to the first executable object 2314 is the second direction.

In operation 2604 , the processor 2230 is configured to: a user dragging a widget of the second application in the first direction while displaying the widget of the second application and the first executable object in the second partial area input can be received. For example, referring to FIG. 27 , in state 2700 , the processor 2230 selects the widget 2312 and the first executable object 2314 of the second application within the second partial region 2304 . During display, a user input 2702 for dragging the widget 2312 of the second application in the first direction may be received. For example, user input 2702 may originate from a first executable element 2312 - 1 and may originate from a second executable element 2312 - 2 . For another example, referring to FIG. 27 , in a state 2720 , the processor 2230 is configured to include a widget 2312 and a first executable object 2314 of the second application within the second partial region 2304 . is displayed, a user input 2722 for dragging the widget 2312 of the second application in the first direction may be received. For example, user input 2722 may originate from a first executable element 2312 - 1 and may originate from a second executable element 2312 - 2 .

In operation 2606, the processor 2230 is configured to, in response to receiving the user input for dragging the widget of the second application displayed in the second partial area in the first direction, is displayed in the second partial area The widget of the second application may be converted into an extended widget of the second application. In various embodiments, the amount of information provided through the extended widget of the second application may be greater than or equal to the amount of information provided through the widget of the second application. In various embodiments, the number of executable elements included in the extended widget of the second application may be greater than or equal to the number of executable elements included in the widget of the second application. In various embodiments, the size of each of the executable elements included in the extended widget of the second application may be greater than or equal to the size of each of the executable elements included in the widget of the second application. However, it is not limited thereto.

For example, referring to FIG. 27 , processor 2230 can transition state 2700 to state 2710 in response to receiving user input 2702 . In the state 2710 , the processor 2230 may display the extended widget 2712 of the second application switched from the widget 2312 of the second application. The extended widget 2712 of the second application may include a greater number of executable elements than the number of executable elements included in the widget 2312 of the second application. For example, the extended widget 2712 of the second application is for replaying a song being played through the second application from the beginning or playing a previous song of the song being played through the second application. and an executable element for pausing a song being played through the second application, and an executable element for playing a next song of the song being played through the second application. .

In various embodiments, the length of the extended widget 2712 of the second application may be changed according to the length of the drag path of the user input 2702 . For example, when the length of the drag path of the user input 2702 is the first length, the length of the extended widget 2712 of the second application has the third length, and the length of the drag path of the user input 2702 is When the second length is longer than the first length, the extended widget 2712 of the second application may have a fourth length longer than the third length. The extended widget 2712 of the second application having the fourth length includes a larger amount of information or includes a larger number of executables than the extended widget 2712 of the second application having the third length. It may contain elements. However, it is not limited thereto.

On the other hand, the first executable object 2314 disposed on the right side of the widget 2312 of the second application is in the transition from the widget 2312 of the second application to the extended widget 2712 of the second application. Accordingly, it can be moved. For example, the distance between the left edge or left periphery of the first executable object 2314 and the second subregion 2304 in the state 2700 is the first executable object 2314 in the state 2710 ( It may be shorter than the distance between 2314 and the left edge of the second partial region 2304 .

As another example, referring to FIG. 27 , the processor 2230 may transition the state 2720 to the state 2730 in response to receiving the user input 2722 . The display position of the first executable object 2314 disposed on the left side of the widget 2312 of the second application in the state 2720 is from the widget 2312 of the second application to the extended widget 2712 of the second application. ) can be maintained independently of the conversion to For example, the distance between the left edge of the first executable object 2314 and the second subregion 2304 in the state 2720 is the first executable object 2314 and the second subregion in the state 2730 . may be equal to the distance between the left edges of (2304).

As described above, the electronic device 2210 according to various embodiments converts the widget of the application into the extended widget of the application based on a user input for the widget of the application being executed, and thus the first partial region It is possible to provide an interface for controlling the application without switching the execution screen of another application displayed within the application. The electronic device 2210 according to various embodiments may provide an enhanced user experience by providing such an interface.

28 is a flowchart illustrating a method of an electronic device for converting a widget displayed on a display into a reduced widget according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

29 illustrates an example of converting a widget of an application into a reduced widget of the application according to various embodiments of the present disclosure;

Referring to FIG. 28 , in operation 2802 , the processor 2230 may display the widget of the second application and the first executable object in the second partial area.

In various embodiments, the arrangement of the widget of the second application and the first executable object displayed in the second partial area may be set in various ways. For example, the arrangement of the widget of the second application and the first executable object may be determined by various methods defined through the description of FIG. 26 .

For example, the arrangement of the widget of the second application and the first executable object may be a first arrangement in which a direction from the widget of the second application to the first executable object is a first direction or the second application a second arrangement in which a direction from the widget of to the first executable object is a second direction opposite to the first direction.

For example, referring to FIG. 29 , as in the state 2700 , the arrangement of the widget 2312 and the first executable object 2314 of the second application is performed from the widget 2312 of the second application. 1 may be the first arrangement in which a direction to an executable object 2314 is the first direction.

For another example, referring to FIG. 29 , as in the state 2720 , the arrangement of the widget 2312 and the first executable object 2314 of the second application is performed from the widget 2312 of the second application. It may be a second arrangement in which the direction to the first executable object 2314 is the second direction.

In operation 2804, the processor 2230 displays a user input for dragging the widget of the second application in the second direction while displaying the widget of the second application and the first executable object in the second partial area can receive For example, referring to FIG. 29 , in a state 2700 , the processor 2230 selects the widget 2312 and the first executable object 2314 of the second application within the second partial region 2304 . During display, a user input 2902 for dragging the widget 2312 of the second application in the second direction may be received. For example, user input 2902 may originate from a first executable element 2312 - 1 and may originate from a second executable element 2312 - 2 . For another example, referring to FIG. 29 , in a state 2720 , the processor 2230 is configured to: a widget 2312 and a first executable object 2314 of the second application within the second partial region 2304 . is displayed, a user input 2922 for dragging the widget 2312 of the second application in the second direction may be received. For example, user input 2922 may originate from a first executable element 2312 - 1 and may originate from a second executable element 2312 - 2 .

In operation 2806 , the processor 2230 is configured to, in response to receiving the user input for dragging the widget of the second application displayed in the second partial region in the second direction, is displayed in the second partial region The widget of the second application may be converted into a reduced widget of the second application. In various embodiments, the amount of information provided through the reduced widget of the second application may be less than or equal to the amount of information provided through the widget of the second application. In various embodiments, the number of executable elements included in the reduced widget of the second application may be less than or equal to the number of executable elements included in the widget of the second application. In various embodiments, the size of each of the executable elements included in the reduced widget of the second application may be less than or equal to the size of each of the executable elements included in the widget of the second application. However, it is not limited thereto.

In various embodiments, since the reduced widget of the second application has a shorter length than the widget of the second application, while the second partial region includes the reduced widget of the second application, the second The partial region may provide additional information than when the widget of the second application is included. Although not shown in FIG. 29 , when the second partial area includes the reduced widget of the second application, the second partial area is not provided while the second partial area includes the widget of the second application It is also possible to further provide information that has not been provided or an executable object that has not been provided while the second partial region includes the widget of the second application. However, it is not limited thereto.

For example, referring to FIG. 29 , processor 2230 can transition state 2700 to state 2910 in response to receiving user input 2902 . In the state 2910 , the processor 2230 may display the reduced widget 2912 of the second application switched from the widget 2312 of the second application. The reduced widget 2912 of the second application may provide a smaller amount of information than the widget 2312 of the second application. For example, the reduced widget 2912 of the second application may not include information about a song being played included in the widget 2312 of the second application.

In various embodiments, the length of the reduced widget 2912 of the second application may be changed according to the length of the drag path of the user input 2902 . For example, when the length of the drag path of the user input 2902 is the first length, the length of the reduced widget 2912 of the second application has the third length, and the length of the drag path of the user input 2902 is When the second length is longer than the first length, the reduced widget 2912 of the second application may have a fourth length shorter than the third length. The reduced widget 2912 of the second application having the fourth length includes a smaller amount of information or a smaller number of executables than the reduced widget 2912 of the second application having the third length. It may contain elements. However, it is not limited thereto. According to embodiments, when the length of the drag path of the user input 2902 becomes shorter than the specified length, the widget 2312 of the second application may be converted into the second executable object 2414 . When the widget 2312 of the second application is switched to the second executable object 2414 , the processor 2230 may stop executing the second application. However, it is not limited thereto.

On the other hand, the first executable object 2314 disposed on the right side of the widget 2312 of the second application is in the transition from the widget 2312 of the second application to the reduced widget 2912 of the second application. Accordingly, it can be moved. For example, the distance between the left edge or left periphery of the first executable object 2314 and the second subregion 2304 in the state 2700 is the first executable object 2314 in the state 2910 ( It may be longer than the distance between 2314 and the left edge of the second partial region 2304 .

For another example, referring to FIG. 29 , the processor 2230 may transition the state 2720 to the state 2930 in response to receiving the user input 2922 . The display position of the first executable object 2314 disposed on the left side of the widget 2312 of the second application in the state 2720 is from the widget 2312 of the second application to the reduced widget 2912 of the second application. ) can be maintained independently of the conversion to For example, the distance between the left edge of the first executable object 2314 and the second subregion 2304 in the state 2720 is the first executable object 2314 and the second subregion in the state 2930 . may be equal to the distance between the left edges of (2304).

28 and 29 show an example in which the widget of the second application is converted into a reduced widget of the second application, but this is for convenience of description. The method defined through the description of FIGS. 28 and 29 may be used to reduce the extended widget of the second application defined through the description of FIGS. 26 and 27 .

As described above, the electronic device 2210 according to various embodiments converts the widget of the application into a reduced widget of the application based on a user input for the widget of the application being executed, thereby the second partial region An interface may be provided to provide additional information within the . The electronic device 2210 according to various embodiments may provide an enhanced user experience by providing such an interface.

30 is a flowchart illustrating a method of an electronic device for converting an executable object displayed on a display into a widget according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

31 illustrates an example of converting an executable object into a widget of an application according to various embodiments of the present disclosure;

Referring to FIG. 30 , in operation 3002 , the processor 2230 displays an execution screen of the first application in the first partial region, and displays the widget of the second application and the first application in the second partial region. A third executable object for indicating a third application may be displayed together with the executable object. For example, referring to FIG. 30 , the processor 2230 displays the execution screen 2310 of the first application in the first partial area 2302 as in the state 2300 and displays the second partial area ( In 2304 ), a third executable object 2315 may be displayed together with the widget 2312 and the first executable object 2314 of the second application.

In operation 3004, the processor 2230 displays the execution screen of the first application in the first partial region, and together with the widget of the second application and the first executable object in the second partial region While displaying the third executable object, a user input of dragging the third executable object in the first direction may be received. For example, referring to FIG. 31 , the processor 2230 may receive a user input 3110 in a state 2300 .

In operation 3006 , the processor 2230 may execute the third application in response to receiving the user input. For example, the third application may be an application installed in the electronic device 2210 . As another example, the third application may be an application installed in another electronic device distinct from the electronic device 2210 (eg, an electronic device 2220 or an electronic device in a vehicle distinct from the electronic device 2220 ). However, it is not limited thereto.

In operation 3008 , the processor 2230 may convert the third executable object displayed in the second partial area into a widget of the third application in response to the execution of the third application.

Meanwhile, the processor 2230 is configured to display an execution screen of the first application in the first partial area and to display the execution screen of the first application in the second partial area independently of the reception of the user input and the execution of the third application. It is possible to maintain displaying the widget of the second application and the first executable object. For example, the third application may be executed based on the user input received in operation 3004 as well as another user input for the third executable object. For example, the third application may be executed based on a single tap input for the third executable object. The processor 2230, in response to receiving the single tap input for the third executable object, executes the third application, and in response to the execution of the third application, is displayed in the first partial region. The execution screen of the first application may be converted into an execution screen of the third application, and the first executable object displayed in the second partial area may be converted into a widget of the first application. In other words, based on the user input in operation 3004 that is distinguished from the other user input, the processor 2230 may display the execution screen of the first application displayed in the first partial area as the execution screen of the third application. instead of switching to and converting the first executable object displayed in the second partial region into a widget of the first application, displaying an execution screen of the first application in the first partial region; and Displaying the widget of the second application and the first executable object in the second partial area may be maintained.

For example, referring to FIG. 31 , the processor 2230 may switch the state 2300 to the state 3120 in response to the execution of the third application caused by the user input 3110 . In the state 3120 , the processor 2230 may convert the third executable object 2315 displayed in the second partial region 2304 into a widget 3122 of the third application. In the state 3120 , the processor 2230 displays the execution screen 2310 of the first application in the first partial region 2302 independently of the transition from the state 2300 to the state 3120 . and maintain display of the widget 2312 and the first executable object 2314 of the second application within the second partial region 2304 .

In various embodiments, the widget 3122 of the third application includes a visual object for selecting a target temperature around the driver's seat in the vehicle, a visual object for selecting a wind direction, a visual object for selecting whether to activate the air conditioner, It may include a visual object for selecting an air volume, and a visual object for selecting a target temperature around the passenger seat in the vehicle. In various embodiments, the widget 3122 of the third application includes a visual object for selecting a target temperature around the driver's seat in the vehicle, a visual object for selecting a wind direction, a visual object for selecting whether to activate the air conditioner, Each of the visual object for selecting the air volume and the visual object for selecting the target temperature around the passenger seat in the vehicle may be configured as an executable object. However, it is not limited thereto.

As described above, the electronic device 2210 according to various embodiments may perform an operation of switching an execution screen displayed in the first partial area by variously setting a type of a user input for executing an application, and Instead of switching the execution screen, an operation of maintaining the execution screen displayed in the first partial region and converting the executable object displayed in the second partial region into a widget may be selectively provided. The electronic device 2210 according to various embodiments may provide an enhanced user experience through such alternative provision.

32 is a flowchart illustrating a method of an electronic device that provides a service based on a user input to an empty space of a second partial area according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

33 illustrates an example of displaying an executable object and executing a function indicated by the executable object based on a user input for an empty space of the second partial region, according to various embodiments.

Referring to FIG. 32 , in operation 3202 , the processor 2230 receives a user input for another area within the second partial area that is distinct from the display area of the widget of the second application and the display area of the first executable object. can receive For example, the other area within the second partial area may be an area within the second partial area that is not occupied by the widget and the first executable object of the second application. For example, referring to FIG. 33 , in a state 2300 , the processor 2230 is configured to (in) an empty space of the second partial area 2304 that displays the widget of the second application and the first executable object. : A user input 3300 for another region within the second partial region may be received.

In operation 3204 , the processor 2230 is configured to, in response to receiving the user input, indicate a third executable function for indicating a function distinct from functions available through the first application and the second application. An object may be displayed in the second partial area together with the widget of the second application and the first executable object. For example, the function indicated by the third executable object includes a plurality of functions available through the electronic device 2210 and distinct from functions available through the first application and the second application. Among the functions, it may be a function provided through the most recent electronic device 2210 . For another example, the function indicated by the third executable object is available through the electronic device 2210 and is distinguished from functions available through the first application and the second application. Among the functions, it may be a function provided through the electronic device 2210 most often. However, it is not limited thereto.

In various embodiments, the third executable object may be displayed at a location within the second partial region that receives the user input in operation 3202 . For example, referring to FIG. 33 , the processor 2230 may transition the state 2300 to the state 3301 in response to receiving the user input 3300 . In the state 3301 , the processor 2230 may additionally display the third executable object 3310 within the second partial region 2304 . For example, the third executable object 3310 may be displayed at a location within the second partial region that has received the user input 3300 . As another example, the third executable object 3310 may be displayed in an empty space in the second partial region 2304 . However, it is not limited thereto.

In various embodiments, the third executable object 3310 may include information for guiding a function executed via the third executable object 3310 (eg, “Call XX”).

In operation 3206 , the processor 2230 may receive a user input for the third executable object displayed in the second partial region. For example, referring to FIG. 33 , the processor 2230 may receive a user input 3311 in a state 3301 .

In operation 3208 , the processor 2230 may execute a function indicated by the third executable object in response to receiving the user input in operation 3206 .

For example, referring to FIG. 33 , the processor 2230 is configured to provide functionality that is executed via a third executable object 3310 in response to receiving the user input 3311 in state 3301 . The call application may be executed, and the state 3301 may be switched to the state 3312 . In the state 3312 , the processor 2230 performs an execution screen 3314 of a third application (eg, the call application) switched from the execution screen 2310 of the first application in the first partial area 2302 . can be displayed. In the state 3312 , the processor 2230 may display the widget 2412 of the first application switched from the first executable object 2314 in the second partial region 2304 . The transition from the first executable object 2314 to the widget 2412 of the first application is based on the transition from the execution screen 2310 of the first application to the execution screen 3314 of the third application, can be executed In the state 3312 , the processor 2230 may maintain displaying the widget 2312 of the second application in the second partial region 2304 . At state 3312 , processor 2230 can stop displaying third executable object 3310 within second subregion 2304 .

For another example, referring to FIG. 33 , the processor 2230 is configured to, in response to receiving the user input 3311 in state 3301 , provide functionality to be executed via the third executable object 3310 . To this end, a call application may be executed, and the state 3301 may be switched to the state 3320 . In the state 3320 , the processor 2230 may maintain displaying the execution screen 2310 of the first application in the first partial area 2302 . In the state 3320 , the processor 2230 may maintain displaying the widget 2312 of the second application in the second partial area 2304 . In the state 3320 , the processor 2230 is configured to display the widget 3322 of the third application transitioned from the executable object 2317 for indicating the third application in the second partial region 2304 . can The transition from the executable object 2317 to the widget 3322 of the third application may be executed based on the execution of the third application. The widget 3322 of the third application transitioned from the executable object 2317 is a first executable element for indicating that it is in a state of executing an outgoing call to XX and the execution of the outgoing call to XX. a second executable element for stopping In various embodiments, processor 2230 may transition state 3320 to state 3312 based on receiving user input for the first executable element. In various embodiments, processor 2230 may abort execution of the outgoing call to XX based on receiving user input for the second executable element. Meanwhile, in the state 3320 , the processor 2230 may stop displaying the third executable object 3310 in the second partial region 2304 .

In various embodiments, processor 2230 provides both a transition from state 3301 to state 3312 and a transition from state 3301 to state 3320 , or a transition from state 3301 to state 3312 . Transition and transition from state 3301 to state 3320 may be provided. For example, when there is one user input defined in the electronic device 2210 to execute a function indicated by the third executable object 3310 , the processor 2230 moves from the state 3301 to the state 3312 . ) and transition from state 3301 to state 3320 . As another example, when there are two or more user inputs defined in the electronic device 2210 to execute a function indicated by the third executable object 3310 , the processor 2230 may display a state 3301 . It can provide both a transition from state to state 3312 and a transition from state 3301 to state 3320 . For example, when the attribute of the user input 3311 is the first attribute, the processor 2230 executes a transition from the state 3301 to the state 3312 , and the attribute of the user input 3311 is the first attribute. In the case of a second attribute distinct from the attribute, a transition from the state 3301 to the state 3320 may be executed.

As described above, the electronic device 2210 according to various embodiments includes at least one available through at least one application being executed, based on receiving a user input for the empty space of the second partial region. An executable object for executing another function, which is distinct from the function of , may be displayed, and the other function may be executed based on receiving a user input for the executable object. The electronic device 2210 according to various embodiments may simplify a user input for executing the other function provided through the executable object by displaying the executable object and executing the other function. . In other words, the electronic device 2210 according to various embodiments may provide an enhanced user experience.

34 is a flowchart illustrating a method of an electronic device for converting a third executable object defined through the description of FIGS. 32 and 33 into a fourth executable object, according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

35 illustrates an example of converting a third executable object defined through the description of FIGS. 32 and 33 into a fourth executable object according to various embodiments.

Referring to FIG. 34 , in operation 3402 , the processor 2230 may display the third executable object defined through the descriptions of FIGS. 32 and 33 in the second partial region. For example, referring to FIG. 35 , in a state 3301 , the processor 2230 displays the execution screen 2310 of the first application in the first partial area 2302 and the second partial area 2304 . ) of the second application, the widget 2312 , the first executable object 2314 , and the third executable object 3310 may be displayed.

In operation 3404 , the processor 2230 may receive a user input for the third executable object displayed in the second partial region. The user input received in operation 3404 may be distinguished from the user input received in operation 3206 . For example, the user input received in operation 3206 may be a single tap input for the third executable object, and the user input received in operation 3404 may be a drag input for the third executable object. For example, referring to FIG. 35 , in a state 3301 , the processor 2230 may receive a user input 3500 for the third executable object 3310 . In various embodiments, when the user input 3500 is a drag input, a drag direction of the drag input may be set in various ways. For example, the user input 3500 may be an input for dragging the third executable object 3310 like the state 3301 toward the execution screen 2310 of the first application. As another example, the user input 3500 may be an input for dragging the third executable object 3310 to the right, unlike the state 3301 . However, it is not limited thereto.

In operation 3406 , the processor 2230 may convert the third executable object into a fourth executable object in response to receiving the user input in operation 3404 . In various embodiments, the fourth executable object may be used to indicate a function distinct from functions available through the first application, the second application, and the third executable object. For example, the function indicated by the fourth executable object may be available through the electronic device 2210 and available through the first application, the second application, and the third executable object. It may be a function that is most recently provided through the electronic device 2210 among a plurality of functions that are distinguished from the functions. As another example, the function indicated by the fourth executable object is available through the electronic device 2210 and is used through the first application, the second application, and the third executable object. It may be a function provided through the electronic device 2210 most frequently among the plurality of functions, which is distinguished from possible functions. However, it is not limited thereto.

In various embodiments, the fourth executable object may be displayed in a region corresponding to a region in which the third executable object is displayed. For example, referring to FIG. 35 , the processor 2230 may transition the state 3301 to the state 3501 in response to receiving the user input 3500 . In the state 3501 , the processor 2230 may display the fourth executable object 3510 transitioned from the third executable object 3310 within the second partial region 2304 .

In various embodiments, the fourth executable object 3510 may include information for guiding a function executed through the fourth executable object 3510 (eg, defogging windows in the vehicle).

In operation 3408 , the processor 2230 may receive a user input for the fourth executable object displayed in the second partial region. For example, referring to FIG. 35 , the processor 2230 may receive a user input 3515 in a state 3501 .

In operation 3410 , the processor 2230 may execute a function indicated by the fourth executable object in response to receiving the user input in operation 3408 . For example, referring to FIG. 35 , the processor 2230 may, in response to receiving a user input 3515 for a fourth executable object 3510 , use an air conditioner in the vehicle to You can run the function to remove the fogging.

Although not shown in FIG. 35 , in some embodiments, the processor 2230 is, in response to receiving the user input 3515 for the fourth executable object 3510 , within the first subregion 2302 . The displayed execution screen 2310 of the first application may be switched to an execution screen of the application for de-fogging, and the display of the fourth executable object 3510 in the second partial area 2304 may be stopped. Although not shown in FIG. 35 , in some other embodiments, the processor 2230 is, in response to receiving the user input 3515 for the fourth executable object 3510 , within the second subregion 2304 . It may turn the displayed executable object 2315 into a widget of the application for defogging and stop displaying the fourth executable object 3510 within the second partial area 2304 . However, it is not limited thereto.

As described above, the electronic device 2210 according to various embodiments may provide a service for converting the third executable object defined through the descriptions of FIGS. 32 and 33 into the fourth executable object. have. The electronic device 2210 according to various embodiments may simplify a user input for a user to execute a function provided through the fourth executable object by providing such a service. In other words, the electronic device 2210 according to various embodiments may provide an enhanced user experience by providing such a service.

36 is a flowchart illustrating a method of an electronic device for executing a function of an application providing an execution screen based on a user input for an empty space of a second partial area, according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

37 illustrates an example of changing a state of an execution screen displayed in a first partial area based on a user input for an empty space of the second partial area according to various embodiments of the present disclosure;

Referring to FIG. 36 , in operation 3602 , the processor 2230 displays the execution screen of the first application in the first partial region, and displays the widget of the second application and the first application in the second partial region. An executable object can be represented. For example, referring to FIG. 37 , the processor 2230 displays the execution screen 2310 of the first application in the first partial area 2302 as in the state 2300 , and the second partial area 2300 . A widget 2312 and a first executable object 2314 of the second application may be displayed in 2304 .

In operation 3604, the processor 2230 may receive a user input for another area in the second partial area that is distinct from the display area of the widget of the second application and the display area of the first executable object. For example, the other area within the second partial area may be an area within the second partial area that is not occupied by the widget and the first executable object of the second application.

For example, the user input received in operation 3604 may be distinguished from the user input received in operation 3202 and the user input received in operation 3404 . However, it is not limited thereto.

For example, referring to FIG. 37 , in a state 2300 , the processor 2230 may display an empty space (eg, a second partial area 2304 ) that displays the widget of the second application and the first executable object. : A user input 3700 for another region within the second partial region may be received.

In operation 3606 , in response to receiving the user input, the processor 2230 may execute a function of the first application indicated by the user input for another area within the second partial area. In various embodiments, the function of the first application indicated by the user input received in operation 3604 may be configured in various ways. For example, the function of the first application indicated by the user input received in operation 3604 may be a function distinguished from functions available through the execution screen of the first application. As another example, the function of the first application indicated by the user input received in operation 3604 may be a function provided most frequently among functions available through the first application. As another example, the function of the first application indicated by the user input received in operation 3604 may include a function related to a service provided through the first application (eg, changing a route to a destination to another route). function to change). As another example, the function of the first application indicated by the user input received in operation 3604 may be the most recently provided function among functions available through the first application. However, it is not limited thereto.

In operation 3608 , the processor 2230 may change the state of the execution screen of the first application displayed in the first partial area based on the execution of the function of the first application in operation 3606 . For example, referring to FIG. 37 , the processor 2230 executes a function of the first application indicated by the user input 3700 in response to receiving the user input 3700 , and the first application may transition state 2300 to state 3701 in response to execution of the function of In the state 3701, the processor 2230 may change the path provided in the state 2300 to another path, and change the state of the execution screen 2310 of the first application to guide the changed other path. have. For example, in the state 3701 , the processor 2230 may change the path guided in the execution screen 2310 of the first application provided in the state 2300 to another path.

As described above, the electronic device 2210 according to various embodiments executes an application that provides an execution screen displayed in the first partial region based on a user input for an empty space in the second partial region. can be controlled The electronic device 2210 according to various embodiments may simplify a user input required for the control by providing such control. In other words, the electronic device 2210 according to various embodiments may provide an enhanced user experience by simplifying the user input.

38 is a flowchart illustrating a method of an electronic device for executing a function of an application providing a widget based on a user input for an empty space of a second partial area, according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

39 illustrates an example of changing a state of a widget of an application displayed in the second partial area based on a user input for an empty space of the second partial area according to various embodiments of the present disclosure;

Referring to FIG. 38 , in operation 3802 , the processor 2230 displays an execution screen of the first application in the first partial region, and displays the widget of the second application and the first application in the second partial region. An executable object can be represented. For example, referring to FIG. 39 , the processor 2230 displays the execution screen 2310 of the first application in the first partial area 2302 as in the state 2300 , and the second partial area 2300 . A widget 2312 and a first executable object 2314 of the second application may be displayed in 2304 .

In operation 3804, the processor 2230 may receive a user input for another area within the second partial area that is distinct from the display area of the widget of the second application and the display area of the first executable object. For example, the other area within the second partial area may be an area within the second partial area that is not occupied by the widget and the first executable object of the second application.

For example, the user input received in operation 3804 may be distinguished from the user input received in operation 3202 and the user input received in operation 3404 . According to embodiments, the user input received in operation 3804 may be distinguished from the user input received in operation 3604 . However, it is not limited thereto.

For example, referring to FIG. 39 , in a state 2300 , the processor 2230 may display an empty space (eg, a second partial area 2304 ) that displays the widget of the second application and the first executable object. : A user input 3900 for another region within the second partial region may be received.

In operation 3806 , in response to receiving the user input, the processor 2230 may execute the function of the second application indicated by the user input for another area within the second partial area. In various embodiments, the function of the second application indicated by the user input received in operation 3804 may be configured in various ways. For example, the function of the second application indicated by the user input received in operation 3804 may be a function differentiated from functions available through the widget of the second application. As another example, the function of the second application indicated by the user input received in operation 3804 may be the most frequently provided function among functions available through the second application. As another example, the function of the second application indicated by the user input received in operation 3804 may include a function related to a service provided through the second application (eg, a function related to a song next to a song being played). function to play). As another example, the function of the second application indicated by the user input received in operation 3804 may be the most recently provided function among functions available through the second application. However, it is not limited thereto.

In operation 3808 , the processor 2230 may change the state of the widget of the second application displayed in the second partial area based on the execution of the function of the second application in operation 3806 . For example, referring to FIG. 39 , the processor 2230 executes a function of the second application indicated by the user input 3900 in response to receiving the user input 3900 , and the second application may transition state 2300 to state 3901 in response to execution of the function of In the state 3901, the processor 2230 changes the song (eg, Motion) played in the state 2300 to the next song (eg, Everything), and in order to guide that the next song is being played, the 2 The state of the widget 2312 of the application may be changed. For example, in the state 3901 , the processor 2230 may change the playing song guided in the widget 2312 of the second application provided in the state 2300 to the next song.

FIG. 39 shows an example in which the drag direction of the user input 3900 is configured in the same manner as the drag direction of the user input 3700 of FIG. 37 , but the electronic device 2210 is defined through the description of FIGS. 36 and 37 . Note that when configured to execute both the method described above and the method defined through the description of FIGS. 38 and 39 , the user input 3700 and the user input 3900 may be defined differently in the electronic device 2210 . shall. In other words, when the electronic device 2210 is configured to execute both the method defined through the description of FIGS. 36 and 37 and the method defined through the description of FIGS. 38 and 39 , the user input received in operation 3804 is It may be distinguished from the user input received in operation 3604 .

As described above, the electronic device 2210 according to various embodiments controls an application providing a widget displayed in the second partial region based on a user input for an empty space in the second partial region. can do. The electronic device 2210 according to various embodiments may simplify a user input required for the control by providing such control. In other words, the electronic device 2210 according to various embodiments may provide an enhanced user experience by simplifying the user input.

40 is a flowchart illustrating a method of an electronic device for displaying a handwriting input field based on a user input for an empty space of a second partial area, according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

41 illustrates an example of a handwriting input field displayed according to a user input for an empty space of a second partial region, according to various embodiments of the present disclosure;

Referring to FIG. 40 , in operation 4002 , the processor 2230 displays an execution screen of the first application in the first partial region, and displays the widget of the second application and the first application in the second partial region. An executable object can be represented. For example, referring to FIG. 41 , the processor 2230 displays the execution screen 2310 of the first application in the first partial area 2302 as in the state 2300 , and the second partial area 2300 . A widget 2312 and a first executable object 2314 of the second application may be displayed in 2304 .

In operation 4004 , the processor 2230 may receive a user input for another area within the second partial area that is distinct from the display area of the widget of the second application and the display area of the first executable object. For example, the other area within the second partial area may be an area within the second partial area that is not occupied by the widget and the first executable object of the second application.

For example, the user input received in operation 4004 may be distinguished from the user input received in operation 3202 . For example, the user input received in operation 4004 may be distinguished from the user input received in operation 3404 . For example, the user input received in operation 4004 may be distinguished from at least one of the user input received in operation 3604 or the user input received in operation 3804 . However, it is not limited thereto.

For example, referring to FIG. 41 , in a state 2300 , the processor 2230 may display an empty space (eg, a second partial area 2304 ) that displays the widget of the second application and the first executable object. : A user input 4100 for another area within the second partial area) may be received.

In operation 4006 , in response to receiving the user input, the processor 2230 may display the handwriting input field in an overlapping manner on the execution screen of the first application displayed in the first partial area. In various embodiments, the handwriting input field may extend from at least a portion of the second partial region. In some embodiments, the handwriting input field may be configured to be translucent so that a part of the execution screen of the first application located below the handwriting field is visible.

For example, referring to FIG. 41 , the processor 2230 may transition the state 2300 to the state 4101 in response to receiving the user input 4100 in the state 2300 . In the state 4101 , the processor 2230 may display the handwriting input field 4102 superimposed on the execution screen 2310 of the first application. In various embodiments, handwriting input field 4102 may provide space for receiving handwriting input and displaying the received handwriting input.

In operation 4008, the processor 2230 may receive at least one drag input initiated from the handwriting input field. In various embodiments, the processor 2230 is configured to: based on identifying the first drag input received first after displaying the handwriting input field, for a specified time from the timing at which the first drag input is received It may be identified whether the second drag input following the first drag input is received. For example, the processor 2230 may be configured to: based on identifying that the second drag input is received for the specified time from the timing of receiving the first drag input, the first drag input and the second drag input can be recognized as the handwritten input. As another example, the processor 2230 may be configured to handwrite only the first drag input based on identifying that the second drag input is not received for the specified time from the timing of receiving the first drag input. can be recognized as input. However, it is not limited thereto.

For example, referring to FIG. 41 , in a state 4101 , the processor 2230 may receive at least one drag input 4104 initiated from the handwriting input field 4102 .

In operation 4010, the processor 2230 may recognize a character indicated by the path of the at least one drag input. For example, the processor 2230 may be configured to: based on identifying that the third drag input is not received for the specified time from a timing at which the second drag input following the first drag input is received, A character indicated by the path of the drag input and the path of the second drag input may be recognized. For example, referring to FIG. 41 , the processor 2230 may recognize a character (eg, house) indicated by a path of at least one drag input 4104 received in a state 4101 .

In operation 4012, the processor 2230 may execute a function corresponding to the recognized character. For example, referring to FIG. 41 , a function (eg: A function of making an outgoing call home using a call application, a function of setting the destination of the vehicle to home using a navigation application, a function of playing back a song that is a song title using a music application, etc.) can be executed.

In some embodiments, the handwriting input field 4102 includes a plurality of executable objects ( 4106) may be further indicated. The handwriting input field 4102 further comprises a plurality of executable objects 4106 and upon receiving user input 4108 for selecting one (a) executable object of the plurality of executable objects 4106 . In this case, the processor 2230 executes an application indicated by the executable object selected by the user input 4108 and a function corresponding to the recognized character (eg, executes an outgoing call to the home using a call application) can do.

As described above, the electronic device 2210 according to various embodiments displays a handwriting input field based on a user input for the empty space of the second partial area and at least one drag received through the handwriting input field. By recognizing an input path, a function corresponding to the path can be executed. The electronic device 2210 according to various embodiments may simplify a user input required to execute the function through the handwriting input field. In other words, the electronic device 2210 according to various embodiments may provide an enhanced user experience by simplifying the user input.

42 is a flowchart illustrating a method of an electronic device for processing a drag input initiated from a displayed handwriting input field according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

43 illustrates an example of processing a drag input passing a portion of a first partial region from a handwriting input field beyond the handwriting input field according to various embodiments of the present disclosure;

Referring to FIG. 42 , in operation 4202 , the processor 2230 may display the handwriting input field in an overlapping manner on the execution screen of the first application displayed in the first partial area. For example, operation 4202 may correspond to operation 4006 .

In operation 4204, the processor 2230 may receive at least one drag input initiated from the handwriting input field. For example, referring to FIG. 43 , the processor 2230 may receive at least one drag input 4305 initiated from the handwriting input field 4102 in a state 4301 .

In operation 4206 , the processor 2230 recognizes the path of the at least one drag input passing a part of the execution screen of the first application beyond the handwriting input field as a part of the character while the at least one drag input is received can do. For example, referring to FIG. 43 , the processor 2230 may receive at least one drag input 4305 initiated from the handwriting input field 4102 in a state 4301 . The processor 2230 is, while receiving the at least one drag input 4305, of the at least one drag input 4305 passing a part of the execution screen 2310 of the first application in the first partial area 2302. The path 4307 may be recognized as a part of text instead of a user input to the execution screen 2310 of the first application. In various embodiments, the processor 2230 displays a part of the path of the at least one drag input (eg, the path 4307) on the execution screen 2310 of the first application displayed in the first partial area. can do.

As described above, in response to identifying that a drag input is initiated from the handwriting input field, the electronic device 2210 according to various embodiments moves beyond the handwriting input field to the first application in the first partial area. A path of the drag input passing through the execution screen may be recognized as a part of the handwriting input, and a character may be recognized based on the recognition. For example, in response to identifying that a drag input is initiated from the handwriting input field, the electronic device 2210 according to various embodiments maintains the display of the execution screen of the first application in the first partial area, and By deactivating the recognition of a touch input of the execution screen of the first application in the first partial region, the path of the drag input passing through the execution screen of the first application in the first partial region beyond the handwriting input field is handwritten It is recognized as a part of , and a character can be recognized based on the recognition. The electronic device 2230 according to various embodiments may enhance user convenience through such recognition.

44 is a flowchart illustrating a method of an electronic device for displaying an executable object for guiding a recommended function within a portion of a second partial region, according to various embodiments. This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

45 illustrates an example of an executable object for guiding a recommended function displayed within a portion of a second partial region according to various embodiments;

Referring to FIG. 44 , in operation 4402 , the processor 2230 displays an execution screen of the first application in the first partial area, and displays the first executable object and the second executable in the second partial area. 2 An executable object for guiding a recommended function can be displayed together with the widget of the application. In various embodiments, the recommended function is related to the electronic device 2210 and is based on past execution heuristics including a past execution history of the electronic device 2210 . can be identified from a model configured to predict future performance patterns of For example, the model may be located within the electronic device 2210 or located outside the electronic device 2210 . For example, when the model is located outside the electronic device 2210 , the model may be stored in a server located outside the electronic device 2210 and accessed by the electronic device 2210 . However, it is not limited thereto. The model may be a model that receives information on execution caused in the electronic device 2210 and trains based on the received information.

In various embodiments, the executable object for guiding the recommended function may be located in another area within the second partial area that is distinct from an area displaying widgets of the first executable object and the second application. can be displayed. For example, referring to FIG. 45 , the processor 2230, in the state 2300 , displays a second part distinct from an area displaying the widget 2312 and the first executable object 2314 of the second application. An executable object 4500 for guiding the recommended function within another area of area 2304 may be displayed. For example, the executable object 4500 may include text for guiding the recommended function (eg, shall we run briskly on the way to work on Monday?).

In operation 4404 , the processor 2230 may identify whether the user input received for the executable object is a drag input. For example, the user input received for the executable object may include user input for executing the recommended function guided by the executable object and other recommendations to distinguish the executable object from the recommended function. It may include user input to switch to another executable object for guiding a given function. The processor 2230 is configured to determine whether the user input received for the executable object is the user input for executing the recommended function guided by the executable object, or assigns the executable object to the other recommended function. In order to identify whether the user input for switching to the other executable object for guiding a user input is the drag input, it may be identified whether the user input received for the executable object is the drag input. For example, if the user input received for the executable object is the drag input, the processor 2230 may execute operation 4406 , and otherwise execute operation 4408 .

In operation 4406 , the processor 2230 may convert the executable object to the other executable object in response to identifying that the user input received for the executable object is the drag input. For example, the other recommended function guided by the other executable object is a function identified from the model, which is immediately following a priority of the recommended function among a plurality of recommended functions identified by the model. It may be a function having priority. For example, referring to FIG. 45 , the processor 2230 converts state 2300 to state 4506 in response to receiving user input 4504 for executable object 4500 in state 2300 . can be converted to In state 4506 , processor 2230 may display another executable object 4510 transitioned from executable object 4500 within second subregion 2304 . For example, the other executable object 4510 may include text (eg, do you want to search for nearby restaurants?) for guiding the other recommended function. In various embodiments, the processor 2230 may execute operation 4404 again after completing execution of operation 4406 .

In operation 4408 , the processor 2230 is configured to identify that the user input received for the executable object is not the drag input or that the user input received for the executable object is distinct from the drag input. In response to identifying, a function indicated by the executable object (eg, the recommended function) may be executed. For example, referring to FIG. 45 , processor 2230 is guided by executable object 4500 in response to receiving user input 4502 for executable object 4500 in state 2300 . A recommended function can be executed (eg, route guidance to work using a navigation application). However, it is not limited thereto.

As described above, the electronic device 2210 according to various embodiments provides a service suitable for the electronic device 2210 or the user's situation within a part of the second partial area. An executable object for executing a function recommended from the trained model may be displayed. The electronic device 2210 according to various embodiments may enhance user convenience by displaying the executable object.

46 is a flowchart illustrating a method of an electronic device for displaying a plurality of executable objects extending from a portion of a second partial region according to various embodiments. This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

47 illustrates an example of a plurality of executable objects extending from a portion of a second sub-region in accordance with various embodiments.

Referring to FIG. 46 , in operation 4602, the processor 2230 displays an execution screen of the first application in the first partial region, and displays the first executable object and the second executable in the second partial region. 2 An executable object for guiding a recommended function can be displayed together with the widget of the application. For example, operation 4602 may correspond to operation 4402 . For example, referring to FIG. 47 , the processor 2230, in the state 2300 , displays a second part distinct from an area displaying the widget 2312 and the first executable object 2314 of the second application. An executable object 4500 for guiding the recommended function within another area of area 2304 may be displayed. For example, the executable object 4500 may include text for guiding the recommended function (eg, shall we run briskly on the way to work on Monday?).

In operation 4604 , the processor 2230 may identify whether the user input received for the executable object is a drag input. For example, the user input received for the executable object maintains displaying the executable object and user input for executing the recommended function guided by the executable object and the recommended function and a user input for displaying a plurality of executable objects for respectively guiding a plurality of recommended functions, which are distinguished from each other, on an execution screen of the first application displayed in the first partial area in an overlapping manner. The processor 2230 maintains displaying whether the user input received for the executable object is the user input for executing the recommended function guided by the executable object, or displaying the executable object; Whether it is a user input for displaying a plurality of executable objects for respectively guiding a plurality of recommended functions that are distinguished from the recommended function on an execution screen of the first application displayed in the first partial region To identify, it may be identified whether the user input received for the executable object is the drag input. For example, if the user input received for the executable object is the drag input, the processor 2230 may execute operation 4606 , and otherwise execute operation 4612 .

In operation 4606, the processor 2230, in response to identifying that the user input received for the executable object is the drag input, maintains an indication of the executable object, and assigns the plurality of executable objects to the The display may be overlapped on the execution screen of the first application in the first partial area. For example, the plurality of executable objects may be extended from the executable object. For example, the plurality of recommended functions each guided by the plurality of executable objects may be functions identified from the model and have a lower priority than the priority of the recommended function. For example, referring to FIG. 47 , the processor 2230 moves state 2300 to state 4706 in response to receiving user input 4704 for executable object 4500 in state 2300 . can be switched In state 4706 , processor 2230 may maintain display of executable object 4500 . In the state 4706 , the processor 2230 is configured to superimpose on the execution screen of the first application in the first partial region 2302 , and in an area extending from the executable object 4500 , a plurality of executable objects (4708) may be displayed.

In operation 4608 , the processor 2230 may receive the executable object and a user input for selecting one (a) executable object from among the plurality of executable objects. For example, referring to FIG. 47 , the processor 2230, in state 4706 , is configured to select (a) one (a) executable object from among executable object 4500 and plurality of executable objects 4708 . may receive a user input 4710 for

In operation 4610 , the processor 2230 may execute a recommended function guided by the executable object selected by the user input in response to the user input received in operation 4608 . For example, referring to FIG. 47 , processor 2230, in state 4706 , in response to receiving user input 4710 , is a function guided by the executable object selected by user input 4710 . You can run the function for defogging.

In operation 4612 , the processor 2230 is configured to, in response to identifying that the user input received for the executable object is the drag input, or that the user input received for the executable object is distinct from the drag input In response to identifying, the function indicated by the executable may be executed. For example, referring to FIG. 47 , processor 2230 is guided by executable object 4500 in response to receiving user input 4502 for executable object 4500 in state 2300 . A recommended function may be executed (eg, route guidance to work using a navigation application). However, it is not limited thereto.

As described above, the electronic device 2210 according to various embodiments performs a plurality of recommended functions in order to expand the selection range of the electronic device 2210 or services suitable for a user's situation of the electronic device 2210 . A plurality of executable objects can each be displayed for guiding. The electronic device 2210 according to various embodiments may enhance user convenience by displaying the plurality of executable objects.

48 is a flowchart illustrating a method of an electronic device for displaying a split screen in a first partial area by dropping a widget of an application displayed in the second partial area from the first partial area, according to various embodiments of the present disclosure. This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

49 illustrates an example of a split screen in the first partial area displayed by dropping a widget of an application displayed in the second partial area from the first partial area, according to various embodiments of the present disclosure.

Referring to FIG. 48 , in operation 4802 , the processor 2230 displays an execution screen of the first application in the first partial region, and the first executable object and the second application in the second partial region. of widgets can be displayed. For example, referring to FIG. 49 , in the state 2300 , the processor 2230 displays the execution screen 2310 of the first application in the first partial area 2302 and the second partial area 2304 . ), the widget 2312 and the first executable object 2314 of the second application may be displayed.

In operation 4804, the processor 2230 may receive a user input dropped from the first partial area after dragging the widget of the second application. For example, referring to FIG. 49 , in the state 2300 , the processor 2230 drags the widget 2312 of the second application and then drops the user input 4900 from the first partial area 2302 . Alternatively, a user input 4910 may be received. Although not shown in FIG. 49 , in some embodiments, the processor 2230 controls the widget 2312 of the second application to display the user input 4900 while the user input 4900 or the user input 4910 is maintained. Alternatively, a shadow image of the widget 2312 of the second application may be displayed in order to compensate for at least a part of being obscured by the user's finger causing the user input 4910 . In an embodiment, the shadow image may be configured to be translucent in order to enhance the visibility of a part of the execution screen 2310 of the first application in the first partial region 2302 positioned below the shadow image. .

In operation 4806, in response to receiving the user input in operation 4804, the processor 2230 performs a reduced execution screen of the first application switched from the execution screen of the first application in the first partial area; The reduced execution screen of the second application may be displayed, and the executable object of the second application switched from the widget of the first executable object and the second application may be displayed in the second partial area.

For example, referring to FIG. 49 , processor 2230 can transition state 2300 to state 4902 in response to receiving user input 4900 in state 2300 . In the state 4902 , the processor 2230 performs the reduced execution screen 4906 of the first application and the second execution screen 4906 switched from the execution screen 2310 of the first application in the first partial region 2302 . A reduced execution screen 4904 of the application may be displayed. In state 4902 , the processor 2230 is configured to, within the second subregion 2304 , the first executable object 2314 and the second executable object 2414 transitioned from the widget 2312 of the second application. can be displayed. In various embodiments, the reduced execution screen 4906 of the first application may have a reduced size than the execution screen 2310 of the first application. In various embodiments, the reduced execution screen 4906 of the first application may include visual objects having a reduced size than that of the execution screen 2310 of the first application. In various embodiments, the reduced execution screen 4906 of the first application may display a smaller amount of information than the execution screen 2310 of the first application. In various embodiments, the reduced execution screen 4906 of the first application may display a smaller amount of executable elements than the execution screen 2310 of the first application. In various embodiments, the arrangement of the visual objects and executable elements in the reduced execution screen 4906 of the first application is similar to the arrangement of the visual objects and executable elements in the execution screen 2310 of the first application. can be distinguished. However, it is not limited thereto.

Although the execution screen 2402 of the second application is not illustrated in FIG. 49 , in various embodiments, the reduced execution screen 4904 of the second application is smaller than the execution screen 2402 of the second application. may have the same size. In various embodiments, the reduced execution screen 4904 of the second application may include visual objects of reduced size than the execution screen 2402 of the second application. In various embodiments, the reduced execution screen 4904 of the second application may display a smaller amount of information than the execution screen 2402 of the second application. In various embodiments, the reduced execution screen 4904 of the second application may display a smaller amount of executable elements than the execution screen 2402 of the second application. In various embodiments, the placement of visual objects and executable elements in the reduced execution screen 4904 of the second application is identical to the placement of the visual objects and executable elements in the execution screen 2402 of the second application. can be distinguished. However, it is not limited thereto.

For another example, referring to FIG. 49 , the processor 2230 may transition the state 2300 to the state 4912 in response to receiving the user input 4910 in the state 2300 . In the state 4912 , the processor 2230 performs the reduced execution screen 4906 of the first application and the second execution screen 4906 switched from the execution screen 2310 of the first application in the first partial region 2302 . A reduced execution screen 4904 of the application may be displayed. In state 4912 , the processor 2230 is configured to: a first executable object 2314 within a second subregion 2304 and a second executable object 2414 transitioned from a widget 2312 of the second application can be displayed.

In various embodiments, the processor 2230 may reduce the first application displayed in the first partial area according to a location where the widget of the second application is dropped by the user input received in operation 4804 . The arrangement of the executed execution screen and the reduced execution screen of the second application may be configured differently. For example, referring to FIG. 49 , in a state 2300 , the processor 2230 is configured to display the widget 2312 of the second application in a region formed on the left side of the first partial region 2302 in the vertical direction based on the center line. ) may transition state 2300 to state 4902 , in response to receiving user input 4900 that drops the . The arrangement of the reduced execution screen 4906 of the first application and the reduced execution screen 4904 of the second application in the state 4902 is determined by the location where the widget 2312 of the second application is dropped. The reduced execution screen 4904 of the second application may be disposed on the left side of the reduced execution screen 4906 of the first application. For another example, referring to FIG. 49 , in the state 2300 , the processor 2230 displays the widget ( In response to receiving user input 4910 dropping 2312 , state 2300 may transition to state 4912 . The arrangement of the reduced execution screen 4906 of the first application and the reduced execution screen 4904 of the second application in the state 4912 is determined by the location where the widget 2312 of the second application is dropped. The reduced execution screen 4904 of the second application may be arranged to be located on the right side of the reduced execution screen 4906 of the first application.

As described above, the electronic device 2210 according to various embodiments receives a user input for dropping a widget of an application displayed in the second partial region on an execution screen of another application displayed in the first partial region. In response, a split screen including the reduced execution screen of the application and the reduced execution screen of the other application may be displayed in the first partial area. The electronic device 2210 according to various embodiments may provide an enhanced user experience by providing a split screen through an intuitive user input such as the user input.

50 is a flowchart illustrating a method of an electronic device for displaying a split screen in a first partial region by dropping a plurality of executable objects displayed in a second partial region from the first partial region, according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

51 illustrates an example of a split screen displayed in the first partial region by dropping a plurality of executable objects displayed in the second partial region from the first partial region, according to various embodiments.

52 illustrates an example of a split screen having a changed arrangement according to a position within a first sub-region for dropping a plurality of executable objects displayed within a second sub-region according to various embodiments;

Referring to FIG. 50 , in operation 5002 , the processor 2230 may display the first executable object and the second executable object in the second partial region. Meanwhile, in various embodiments, the processor 2230 may display any execution screen in the first partial area while displaying the first executable object and the second executable object in the second partial area. may not be displayed. For example, when the application executed in relation to the electronic device 2210 is only a system application, the processor 2230 displays the first executable object and the second executable object in the second partial area. During the operation, no execution screen may be displayed in the first partial area. For example, referring to FIG. 51 , in state 5100 , the processor 2230 displays a blank screen 5102 within the first subregion 2302 , and the second subregion 2304 . ) within the first executable object 2314 and the second executable object 2414 may be displayed.

In operation 5004, the processor 2230 is configured to, while displaying the first executable object and the second executable object in the second partial region without displaying any execution screen in the first partial region, After dragging both the first executable object and the second executable object, a user input for dropping from the first partial area may be received. For example, referring to FIG. 51 , the processor 2230, in the state 5100 , drags both the first executable object 2314 and the second executable object 2414 and then performs a second operation including a blank screen. 1 may receive a user input 5104 that is dropped from the partial area 2302 .

In operation 5006 , the processor 2230 may execute the first application and the second application in response to receiving the user input in operation 5004 . In various embodiments, the processor 2230 allows the user to adjust the execution speed of the plurality of applications when simultaneously executing a plurality of applications or when a time interval between timings of executing each of the plurality of applications is less than or equal to a specified time. In response to the start of the user input received in operation 5004, at least a part of the instructions constituting the first application and at least a part of the instructions constituting the second application are stored in the memory 2235 so that the user can feel it quickly. It can be prefetched. For example, as soon as both the first executable object and the executable object are dragged by the user input in operation 5004 , the processor 2230 may be configured to: 2 At least some of the instructions for executing the application may be prefetched into the memory 2235 . The processor 2230 is configured to, after executing the prefetch, in response to identifying that the first executable object and the second executable object are dropped within the first sub-region by the user input of operation 5004, By providing the remaining instructions among the instructions for executing the first application to the memory 2235 and providing the remaining instructions among the instructions for executing the second application to the memory 2235, the first application and the The second application can be quickly executed. However, it is not limited thereto.

In operation 5008, in response to executing the first application and the second application, the processor 2230 performs a reduced execution screen of the first application and a reduced execution screen of the second application in the first partial area. The execution screen can be displayed. For example, referring to FIG. 51 , the processor 2230 executes the first application and the second application in response to receiving the user input 5104 in the state 5100 , and the first application and in response to completing executions of the second application, transition state 5100 to state 5106 . In the state 5106 , the processor 2230 may display the reduced execution screen 4906 of the first application and the reduced execution screen 4904 of the second application in the first partial area 2302 . have. For example, in the state 5106 transitioned from the state 5100, the blank screen 5102 included in the first partial area 2302 is the reduced execution screen 4906 of the first application and the second application. may be switched to a reduced execution screen 4904 of Meanwhile, in state 5106 , first executable object 2314 and second executable object 2414 may be highlighted relative to other executable objects in second sub-area 2304 . .

In the state 5106, the processor 2230 receives a user input 5108 for moving a boundary between the reduced execution screen 4906 of the first application and the reduced execution screen 4904 of the second application. can receive The processor 2230 may change the size of the reduced execution screen 4906 of the first application and the size of the reduced execution screen 4904 of the second application in response to receiving the user input 5108 . have. For example, upon receiving the user input 5108 configured as a drag input in the first direction, the processor 2230 expands the reduced execution screen 4906 of the first application and expands the first application. 2 The reduced execution screen 4904 of the application may be reduced. For another example, when receiving a user input 5108 configured as a drag input in the second direction opposite to the first direction, the processor 2230 may perform a reduced execution screen 4906 of the first application. can be reduced and the reduced execution screen 4904 of the second application can be expanded.

In the state 5106 , the processor 2230 may receive a user input 5110 for the reduced execution screen 4906 of the first application. In various embodiments, the user input 5110 may have a property distinct from user inputs for executable elements in the reduced execution screen 4906 of the first application. This is because even if the user input 5110 is caused in the area where the executable elements in the reduced execution screen 4906 of the first application are located, the user input 5110 is the reduced execution screen 4906 of the first application. This may be to distinguish it from user inputs for executable elements in the . For example, the user input 5110 is configured as an input of double-tapping the reduced screen 4906 of the first application, and a user for executable elements in the reduced execution screen 4906 of the first application. The inputs may consist of inputs that single tap the executable elements. In response to receiving the user input 5110 , the processor 2230 is configured to display a reduced execution screen 4906 of the first application and a reduced execution screen of the second application displayed in the first partial region 2302 . 4904 may be switched to the execution screen 2310 of the first application. The processor 2230 may, in response to receiving the user input 5110 , convert the second executable object 2414 displayed in the second partial region 2304 to a widget 2312 of the second application. have.

In the state 5106 , the processor 2230 may receive a user input 5112 for the reduced execution screen 4904 of the second application. In various embodiments, user input 5112 may have a property that is distinct from user inputs for executable elements in reduced execution screen 4904 of the second application. This means that even though user input 5112 is caused in the area where executable elements in the reduced execution screen 4904 of the second application are located, the user input 5112 is the reduced execution screen 4904 of the second application. This may be to distinguish it from user inputs for executable elements in the . For example, the user input 5112 consists of an input of double-tapping the reduced screen 4904 of the second application, and a user for executable elements within the reduced screen 4904 of the second application. The inputs may consist of inputs that single tap the executable elements. In response to receiving the user input 5112 , the processor 2230 is configured to display a reduced execution screen 4906 of the first application and a reduced execution screen of the second application displayed in the first partial region 2302 . 4904 may be switched to the execution screen 2402 of the second application. The processor 2230 may, in response to receiving the user input 5112 , convert the first executable object 2314 displayed in the second partial region 2304 to a widget 2412 of the first application. have.

In various embodiments, the processor 2230 is configured to display the first executable object and the second executable object within the first sub-region according to a location where the first executable object and the second executable object are dropped by the user input received in operation 5004 . The arrangement of the reduced execution screen of the first application and the reduced execution screen of the second application may be configured differently. For example, referring to FIG. 52 , in the state 5100 , the processor 2230 generates a first executable object 2314 in a region formed on the left side with respect to the centerline in the vertical direction of the first partial region 2302 . and in response to receiving user input 5202 that drops the second executable object 2414 , transition state 5100 to state 5214 . The collapsed execution screen 4906 of the first application and the collapsed execution screen 4906 of the second application in the state 5214 by the location where the first executable object 2314 and the second executable object 2414 are dropped The arrangement of the execution screen 4904 is the same arrangement as the arrangement of the first executable object 2314 and the second executable object 2414 , the reduced execution screen 4904 of the second application is that of the first application. It may be an arrangement located on the right side of the reduced execution screen 4906 . For another example, referring to FIG. 52 , in the state 5100 , the processor 2230 displays the first executable object 2314 in a region formed on the right side with respect to the centerline in the vertical direction of the first partial region 2302 . ) and a second executable object 2414 , in response to receiving user input 5212 dropping the second executable object 2414 , state 5100 may transition to state 5106 . The collapsed execution screen 4906 of the first application and the collapsed execution screen 4906 of the second application in state 5106 by the location where the first executable object 2314 and the second executable object 2414 are dropped The arrangement of the execution screen 4904 is different from the arrangement of the first executable object 2314 and the second executable object 2414 , and the reduced execution screen 4904 of the second application is that of the first application. It may be an arrangement located on the left side of the reduced execution screen 4906 .

As described above, the electronic device 2210 according to various embodiments of the present disclosure responds to receiving a user input for dropping a plurality of executable objects displayed in the second partial region to the first partial region. Execution screens of a plurality of applications indicated by the plurality of executable objects in the partial area may be displayed in a split screen. The electronic device 2210 according to various embodiments may provide an enhanced user experience by providing a split screen through an intuitive user input such as the user input.

53 is a diagram illustrating an electronic device displaying a split screen in a first partial area by dropping a plurality of executable objects displayed in a second partial area from a first partial area including an execution screen of an application according to various embodiments of the present disclosure; It is a flow chart showing the method. This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

54 illustrates an example of a split screen displayed in the first partial area by dropping a plurality of executable objects displayed in the second partial area from the first partial area including the execution screen of an application according to various embodiments; do.

Referring to FIG. 53 , in operation 5302 , the processor 2230 displays an execution screen of the third application in the first partial region, and displays the first executable object and the second execution in the second partial region. a possible object, and the third executable object. For example, referring to FIG. 54 , in a state 5400 , the processor 2230 displays the execution screen 5401 of the third application in the first partial area 2302 and the second partial area 2304 . ) may display a first executable object 2314 , a second executable object 2414 , and a third executable object 2317 . The third executable object 2317 may be highlighted relative to the first executable object 2314 and the second executable object 2414 to indicate that the third application is being executed. have.

In operation 5304, the processor 2230 may receive a user input dropping from the first partial area after dragging both the first executable object and the second executable object displayed in the second partial area. have. For example, referring to FIG. 54 , the processor 2230, in the state 5400 , drags both the first executable object 2314 and the second executable object 2414 and then executes the third application A user input 5402 that is dropped from the first partial region 2302 including the screen 5401 may be received.

In operation 5306 , the processor 2230 may execute the first application and the second application in response to receiving the user input in operation 5304 . In various embodiments, when a plurality of applications are simultaneously executed or when a time interval between timings of executing each of the plurality of applications is equal to or less than a specified time, the processor 2230 allows the user to adjust the execution speed of the plurality of applications. In response to the initiation of the user input received in operation 5304, at least a portion of the instructions constituting the first application and at least a portion of the instructions constituting the second application are stored in the memory 2235 so that the user can feel it quickly. It can be prefetched. For example, as soon as both the first executable object and the executable object are dragged by the user input in operation 5304 , the processor 2230 may be configured to: 2 At least some of the instructions for executing the application may be prefetched into the memory 2235 . The processor 2230 is, after executing the prefetch, in response to identifying that the first executable object and the second executable object are dropped within the first sub-region by the user input of operation 5304, By providing the remaining instructions among the instructions for executing the first application to the memory 2235 and providing the remaining instructions among the instructions for executing the second application to the memory 2235, the first application and the The second application can be quickly executed. However, it is not limited thereto.

In operation 5308, in response to the execution of the first application and the second application, the processor 2230 performs a reduced execution screen of the first application and a reduced execution screen of the second application in the first partial area. An execution screen may be displayed, and a widget of the third application switched from the third executable object may be displayed in the second partial area. For example, the execution screen of the third application displayed in the first partial area may reduce the first application in the first partial area in response to the execution of the first application and the second application. It may be switched to a reduced execution screen and a reduced execution screen of the second application. For example, the execution screen of the third application displayed in the first partial area may be converted into a widget of the third application displayed in the second partial area. For example, referring to FIG. 54 , the processor 2230, in response to receiving the user input 5402 in the state 5400 , executes the first application and the second application, and the first application and in response to completing the executions of the second application, the state 5400 may be switched to the state 5410. The processor 2230, in the state 5410, the reduced execution screen of the first application ( 4906 ) and a reduced execution screen 4904 of the second application may be displayed in the first partial area 2302 . For example, in the state 5410 transitioned from the state 5400 , the execution screen 5401 of the third application included in the first partial region 2302 is the reduced execution screen 4906 of the first application. and a reduced execution screen 4904 of the second application. For example, in the state 5410 transitioned from the state 5400 , the execution screen 5401 of the third application included in the first partial region 2302 is displayed in the second partial region 5410 in the second partial region 5410 . It may be switched to the widget 5405 of the third application in 2304 .

Although not shown in FIG. 54 , the processor 2230 is configured according to the position of the first executable object 2314 and the second executable object 2414 dropped by the user input 5402 received in the state 5400 . , the arrangement of the reduced execution screen 4906 of the first application and the reduced execution screen 4904 of the second application may be determined.

As described above, the electronic device 2210 according to various embodiments receives a user input for dropping a plurality of executable objects displayed in the second partial area to the first partial area including an execution screen of an application. In response to receiving, display execution screens of a plurality of applications indicated by the plurality of executable objects in the first partial region in a split screen and display a widget of the application in the second partial region have. The electronic device 2210 according to various embodiments may provide an enhanced user experience by providing a split screen and a widget through an intuitive user input such as the user input.

FIG. 55 is a flowchart illustrating a method of an electronic device for moving a widget or an executable object within a second partial region based on identifying a designated event from a passenger seat according to various embodiments. This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

56 illustrates an example of a widget or executable object within the second sub-area that is moved based on identifying a designated event from the passenger seat in accordance with various embodiments.

Referring to FIG. 55 , in operation 5502, the processor 2230 displays an execution screen of the first application in the first partial region, and displays the widget of the second application and the first application in the second partial region. An executable object can be represented. For example, referring to FIG. 56 , in a state 2300 , the processor 2230 displays the execution screen 2310 of the first application in the first partial area 2302 and the second partial area 2304 . ), the widget 2312 and the first executable object 2314 of the second application may be displayed.

In operation 5504, the processor 2230 is configured to display the execution screen of the first application in the first partial region and display the widget of the second application and the first executable object in the second partial region During the operation, the designated event may be identified from the passenger seat of the vehicle. Identification of the designated event may be set in various ways. For example, the identification of the designated event may include a hovering input or a gesture input over the display area composed of the first partial area and the second partial area while identifying that both hands are in contact with the steering wheel of the vehicle. This can be done by identifying For example, the identification of the designated event may be performed by identifying at least one of a change in the weight of a user sitting in the passenger seat of the vehicle or a change in tension of a seat belt worn by the user sitting in the passenger seat of the vehicle. have. For example, the identification of the designated event may be performed by identifying that the position where the user's hand entered the display area is closer to the passenger seat of the vehicle than to the driver's seat of the vehicle.

For example, referring to FIG. 56 , the processor 2230 may identify a designated event 5610 in the state 2300 . For example, the identification of a designated event 5610 may include a hovering input, gesture, etc., over the display area comprising the first partial area and the second partial area while identifying that both hands are in contact with the steering wheel of the vehicle. It may be performed by identifying an input, or a touch input. For example, the hovering input, the gesture input, or the touch input may be identified through at least one touch sensor in the display 2240 . As another example, the hovering input, the gesture input, or the touch input may be identified through the camera 2247 . However, it is not limited thereto.

For another example, referring to FIG. 56 , the processor 2230 may identify a designated event 5620 in the state 2300 . For example, the identification of the designated event 5620 may be performed by identifying at least one of a change in the weight of a user sitting in the passenger seat of the vehicle or a change in tension of a seat belt worn by the user sitting in the passenger seat of the vehicle. can For example, the change in weight may be identified through a sensor 2249 mounted in relation to the passenger seat. For example, the change in the tension may be identified through a sensor 2249 mounted in relation to the seat belt of the passenger. However, it is not limited thereto.

For another example, referring to FIG. 56 , the processor 2230 may identify a designated event 5630 in the state 2300 . For example, the identification of the designated event 5630 may be performed by identifying that the position where the user's hand entered the display area is closer to the passenger seat of the vehicle than to the driver's seat of the vehicle. For example, identifying that the position where the user's hand entered the display area is closer to the passenger seat of the vehicle than to the driver's seat of the vehicle may be performed through at least one touch sensor in the display 2240 . However, it is not limited thereto.

In operation 5506 , the processor 2230 is configured to, in response to identifying the specified event in operation 5504 , the widget or the second application in the second partial region displayed closer to the driver's seat of the vehicle than to the passenger seat of the vehicle. At least one of the first executable objects may be moved. For example, when the widget of the second application in the second partial area and the widget of the second application among the first executable object are located closer to the driver's seat of the vehicle than the passenger seat of the vehicle, the processor 2230 ) may move only the widget of the second application among the widget of the second application and the first executable object. The moved widget of the second application may be displayed in the second partial area closer to the passenger's seat of the vehicle than to the driver's seat of the vehicle. For another example, when the first executable object among the widget of the second application and the first executable object in the second partial region is located closer to the driver's seat of the vehicle than the passenger seat of the vehicle, the processor ( 2230) may move only the first executable object among the widget of the second application and the first executable object. The moved first executable object may be displayed in the second partial region closer to the passenger seat of the vehicle than to the driver seat of the vehicle. As another example, when both the widget of the second application and the first executable object in the second partial region are located closer to the driver's seat of the vehicle than to the passenger seat of the vehicle, the processor 2230 is configured to: Both the widget of the second application and the first executable object may be moved. The moved widget of the second application and the moved first executable object may be displayed in the second partial area closer to a passenger seat of the vehicle than to a driver's seat of the vehicle.

For example, referring to FIG. 56 , the processor 2230, in response to identifying at least one of a designated event 5610 , a designated event 5620 , or a designated event 5630 in a state 2300 , is configured to: 2300 may transition to state 5650 . In the state 5650 , the processor 2230 executes the widget 2312 of the second application, a first execution, at a position in the second subregion 2304 moved to the right relative to the state 2300 . An executable object 2314 , an executable object 2315 , an executable object 2316 , and an executable object 2317 may be displayed. In the state 5650, the processor 2230 displays information that cannot receive a user input (eg, time information), the widget 2312 of the second application, the first executable object 2314, and the executable object. Unlike the 2315 , the executable object 2316 , and the executable object 2317 , it can be displayed in a position moved to the left.

Meanwhile, although not shown in FIGS. 55 and 56 , in response to identifying the designated event in operation 5504 , the processor 2230 within the first partial region displayed closer to the driver's seat of the vehicle than to the passenger seat of the vehicle. At least one executable element in the execution screen of the first application may be moved. For example, the moved at least executable element may be displayed in the first partial region closer to a passenger seat of the vehicle than to a driver seat of the vehicle.

As described above, the electronic device 2210 according to various embodiments identifies a designated event from the passenger's seat, and, in response to the identification, allows a user sitting in the passenger's seat to more easily access the first partial area or the first partial area. to be able to control at least one executable object, at least one executable element, or at least one widget contained within a two-part region, the at least one executable object, the at least one executable element, or the at least one At least one of one widget may be moved. The electronic device 2210 according to various embodiments may provide an enhanced user experience through movement of at least one of the at least one executable object, the at least one executable element, or the at least one widget. can

57 is a flowchart illustrating a method of an electronic device for expanding a second partial region based on a hovering input, according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

58 illustrates an example of a second partial region that is enlarged based on a hovering input, according to various embodiments.

Referring to FIG. 57 , in operation 5702 , the processor 2230 displays an execution screen of the first application in the first partial area while the vehicle including the electronic device 2210 is moving, and The widget of the second application and the first executable object may be displayed in the second partial area. For example, referring to FIG. 58 , in a state 2300 , the processor 2230 displays the execution screen 2310 of the first application in the first partial area 2302 and the second partial area 2304 . ), the widget 2312 and the first executable object 2314 of the second application may be displayed.

In operation 5704 , the processor 2230 displays an execution screen of the first application in the first partial area while the vehicle including the electronic device 2210 is moving, and displays the execution screen of the first application within the second partial area. While displaying the widget of the second application and the first executable object, a hovering input for the second partial region may be identified. For example, the hovering input may be a hovering input resulting from a user's hand spaced from the second partial area and positioned on the second partial area. For example, referring to FIG. 58 , in state 2300 , the processor 2230 may identify a hovering input 5800 for the second partial region 2304 .

In operation 5706 , in response to identifying the hovering input in operation 5704 , the processor 2230 expands the second subregion and the widget and the first executable object of the second application within the second subregion can be expanded.

In some embodiments, the size of the first partial region may be maintained independently of the expansion of the second partial region. When the size of the first partial region is maintained independently of the expansion of the second partial region, a portion of the expanded second partial region is disposed on at least a portion of the first partial region on which the execution screen of the first application is displayed. can be nested. For example, referring to FIG. 58 , the processor 2230 may transition the state 2300 to the state 5801 in response to receiving the hovering input 5800 in the state 2300 . In the state 5801 , the processor 2230 may expand the second partial region 2304 . In state 5801 , the processor 2230 may maintain the size of the first subregion 2302 independently of the expansion of the second subregion 2304 . Due to the above maintenance of the size of the first subregion 2302 , a portion of the expanded second subregion 2304 may overlap a portion of the first subregion 2302 . For example, a portion of the execution screen 2310 of the first application in the first partial area 2302 may be covered by a part of the expanded second partial area 2304 . In some other embodiments, the size of the first partial region may be reduced by expansion of the second partial region. When the size of the first partial region is reduced, the expanded second partial region may be adjacent to or separated from the reduced first partial region. In other words, when the size of the first partial region is reduced, the expanded second partial region may not overlap the reduced first partial region. Meanwhile, the execution screen of the first application may be reduced by the reduction of the first partial region. Due to the reduction of the execution screen of the first application, a portion of the reduced first partial area may be displayed as a black screen. For example, referring to FIG. 58 , the processor 2230 can transition the state 2300 to the state 5805 in response to receiving the hovering input 5800 in the state 2300 . In the state 5805 , the processor 2230 may expand the second partial region 2304 . In the state 5805 , the processor 2230 may reduce the size of the first partial region 2302 according to the expansion of the second partial region 2304 . Due to the reduction in the size of the first partial area 2302 , the execution screen 2310 of the first application in the first partial area 2302 may be reduced. Meanwhile, at least a portion of the first partial area 2302 may be configured as a black screen according to the reduction of the execution screen 2310 of the first application.

In some embodiments, the second sub-region may expand to a size corresponding to the speed of the vehicle being moved based on identifying the hovering input. In some embodiments, each of the widget of the second application and the first executable object may be expanded to a size corresponding to the speed of the vehicle, based on identifying the hovering input. In some embodiments, each of the first executable element and the second executable element may be expanded to a size corresponding to the speed of the vehicle, based on identifying the hovering input.

As described above, the electronic device 2210 according to various embodiments expands the second partial area based on the hovering input for the second partial area, thereby receiving the second partial area after reception of the hovering input. It is possible to improve the accuracy of the user input for the partial region. The electronic device 2210 according to various embodiments may provide an enhanced user experience by improving the accuracy.

59 is a flowchart illustrating a method of an electronic device for expanding at least one executable element in an execution screen of an application in a first partial region based on a hovering input, according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

60 illustrates an example of at least one executable element in an execution screen of an application within a first partial area that is enlarged based on a hovering input, according to various embodiments of the present disclosure;

Referring to FIG. 59 , in operation 5902 , the processor 2230 displays an execution screen of the first application in the first partial area while the vehicle including the electronic device 2210 is moving, and displays the second A widget of the second application and the first executable object may be displayed in the second partial area. For example, referring to FIG. 60 , in a state 2300 , the processor 2230 displays the execution screen 2310 of the first application in the first partial area 2302 and the second partial area 2304 . ), the widget 2312 and the first executable object 2314 of the second application may be displayed.

In operation 5904 , the processor 2230 displays an execution screen of the first application in the first partial region while the vehicle including the electronic device 2210 is moving, and displays the execution screen of the first application in the second partial region. While displaying the widget of the second application and the first executable object, a hovering input for the first partial region may be identified. For example, the hovering input may be a hovering input caused by a user's hand spaced from the first partial area and positioned on the first partial area. For example, referring to FIG. 60 , in state 2300 , the processor 2230 may identify a hovering input 6000 for the first partial region 2302 .

In operation 5906 , the processor 2230 may expand at least one executable element in the execution screen of the first application in the first partial region in response to identifying the hovering input in operation 5904 . In various embodiments, the size of the first subregion may remain independent of the expansion of the at least one executable element. In various embodiments, the size of the second subregion may remain independent of the expansion of the at least one executable element. In some embodiments, the size of the at least one visual object in the execution screen of the first application in the first partial region, which is distinct from the at least one executable element, is independent of the expansion of the at least one executable element can be maintained as For example, referring to FIG. 60 , the processor 2230 may transition the state 2300 to the state 6001 in response to receiving the hovering input 6000 in the state 2300 . In the state 6001 , the processor 2230 may expand at least one executable element 6003 in the execution screen 2310 of the first application in the first partial area 2302 . In state 6001 , the size of the first subregion 2302 may remain independent of the expansion of the at least one executable element 6003 . In state 6001 , the size of the second subregion 2304 may remain independent of the expansion of the at least one executable element 6003 . In some embodiments, at least one visual object (eg, at least one constituting an electronic map) in the execution screen 2310 of the first application in the first partial region 2302 that is distinct from the at least one executable element The size of the visual object of ) may remain independent of the expansion of the at least one executable element 6003 . However, it is not limited thereto.

As described above, the electronic device 2210 according to various embodiments expands at least one executable element of an execution screen of an application in the first partial region based on a hovering input for the first partial region. thereby improving the accuracy of the user input for the at least one executable element received after receiving the hovering input. The electronic device 2210 according to various embodiments may provide an enhanced user experience by improving the accuracy.

61 is a flowchart illustrating a method of an electronic device for displaying a notification message based on a hovering input according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

62 illustrates an example of a notification message displayed based on a hovering input according to various embodiments of the present disclosure;

Referring to FIG. 61 , in operation 6102 , the processor 2230 displays an execution screen of the first application in the first partial area while the vehicle including the electronic device 2210 is moving, and The widget of the second application and the first executable object may be displayed in the second partial area. For example, referring to FIG. 62 , in a state 2300 , the processor 2230 displays the execution screen 2310 of the first application in the first partial area 2302 and the second partial area 2304 . ), the widget 2312 and the first executable object 2314 of the second application may be displayed.

In operation 6104 , the processor 2230 may identify a hovering input for the display area including the first partial area and the second partial area when the speed of the moving vehicle is equal to or greater than a specified speed. . For example, when the vehicle moves at a speed greater than or equal to the specified speed, the specified speed indicates that an accident occurs due to causing a user input to an execution screen, an executable object, or a widget displayed in the display area. To prevent this, it may be a parameter that is set. In various embodiments, the specified speed may be configured by a setting of a system or may be configured by a user setting. Meanwhile, the hovering input may be a hovering input caused by a user's hand spaced from the display area and positioned on the display area. For example, referring to FIG. 62 , in a state 2300 , the processor 2230 may identify a hovering input 6200 for the display area. 62 shows an example in which the hovering input 6200 is identified within the first partial region 2302, this is for convenience of description. In various embodiments, the hovering input 6200 may be identified within the second sub-region 2304 .

In operation 6106, in response to identifying the hovering input in operation 6104, the processor 2230 displays a notification message for guiding that control of the execution screen of the first application and the widget of the second application is limited. can In various embodiments, the notification message may be displayed in an overlapping manner on the execution screen of the first application in the first partial area. In various embodiments, the processor 2230 may inactivate all executable elements in the execution screen of the first application and the widget of the second application while displaying the notification message. In some embodiments, the display of all executable elements in the execution screen of the first application and the widget of the second application may be maintained independently of the deactivation. In some other embodiments, the display of all executable elements in the execution screen of the first application and the widget of the second application may be changed to indicate the deactivation. For example, the display of all executable elements in the execution screen of the first application and the widget of the second application may be blurred to indicate the inactivation. However, it is not limited thereto.

For example, referring to FIG. 62 , the processor 2230 may transition the state 2300 to the state 6201 in response to receiving the hovering input 6200 in the state 2300 . In the state 6201 , the processor 2230 may further display a notification message 6205 . In various embodiments, the notification message 6205 includes text for guiding the specified speed and text for guiding that control of the execution screen 2310 of the first application and the widget 2312 of the second application is limited. may include. In various embodiments, the notification message 6205 may be superimposed on the execution screen 2310 of the first application.

In operation 6108 , the processor 2230 may stop displaying the notification message based on identifying that a specified time has elapsed from the timing of displaying the notification message. For example, referring to FIG. 62 , the processor 2230 identifies whether the specified time elapses from the timing at which the notification message 6205 is displayed in the state 6201, and the specified time elapses from the timing Based on the identification that is, state 6201 may transition or restore state 6201 to state 2300 . In the state 2300 , the processor 2300 may stop displaying the notification message 6205 .

Meanwhile, the processor 2230 may identify whether another hovering input distinct from the hovering input identified in operation 6104 is identified while identifying whether the specified time has elapsed from the timing of displaying the notification message. have. When the other hovering input is identified, the processor 2230 may maintain the display of the notification message, unlike operation 6108 . However, it is not limited thereto.

As described above, when the speed of the vehicle is equal to or greater than the specified speed, the electronic device 2210 according to various embodiments may display a portion of the user input within the display area of the display 2240 capable of receiving the user input. By limiting reception and displaying the notification message, it is possible to prevent an accident caused by the user input.

63 is a flowchart illustrating a method of an electronic device for processing a notification related to another application generated while displaying an execution screen of an application according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

64 illustrates an example of a screen switched based on processing of a notification according to various embodiments of the present disclosure;

Referring to FIG. 63 , in operation 6302 , the processor 2230 may execute the first application. For example, the first application may be an application for providing a navigation service.

In operation 6304 , in response to the execution of the first application, the processor 2230 displays an execution screen of the first application in the first partial region, and executes the first application in the second partial region A possible object and the second executable object may be displayed. For example, referring to FIG. 64 , in a state 6400 , the processor 2230 displays the execution screen 2310 of the first application in the first partial area 2302, and the second partial area ( 2304 ) may display a first executable object 2314 and a second executable object 2317 . For example, the second executable object 2317 may be an executable object for indicating a second application. 63 and 64, the second application may be an application for a call service. In various embodiments, the second application indicated by the executable object 2317 may be in an unexecuted state, unlike the first application.

In operation 6306 , the processor 2230 displays an execution screen of the first application in the first partial region in response to executing the first application, and executes the first application in the second partial region based on receiving a signal, which is distinguished from functions supported by the first application, and is related to functions supported by the second application, while displaying the possible object and the second executable object; A second application may be executed.

In operation 6308, in response to the execution of the second application, the processor 2230 superimposes a notification about the received signal using the executed second application on the execution screen of the first application. can be displayed as For example, referring to FIG. 64 , the processor 2230 receives the signal in a state 6400 , executes the second application in response to receiving the signal, and performs the execution of the second application. In response, state 6400 may transition to state 6405 . In the state 6405 , the processor 2230 may display the notification 6407 as superimposed on the execution screen 2310 of the first application displayed in the first partial area 2302 . In state 6405 , the processor 2230 can transition the state of the second executable object 2317 in the second partial region 2304 from the non-executing state to the running state. For example, the second executable object 2317 in state 6405 may be highlighted.

In operation 6310, the processor 2230 may receive a user input for the displayed notification. For example, referring to FIG. 64 , processor 2230 may receive user input 6409 for notification 6407 in state 6405 .

In operation 6312 , in response to receiving the user input in operation 6310 , the processor 2230 may identify whether the first application providing an execution screen in the first partial area is a designated application. In various embodiments, the specified application may be a parameter that is defined to determine whether to convert an execution screen of an application displayed in the first partial area to an execution screen of another application. For example, when the execution screen of the application displayed in the first partial area is the execution screen of the application related to the movement of the vehicle including the electronic device 2210 , the application related to the movement of the vehicle is the designated It can be an application. For another example, when the execution screen of the application displayed in the first partial region is an execution screen of an application that is not related to the movement of the vehicle including the electronic device 2210 , it is not related to the movement of the vehicle. The non-applicable application may not be the designated application. In various embodiments, the designated application may be registered by setting of the processor 2230 without a user input or may be set by registration according to a user input.

The processor 2230 may execute operation 6314 if the first application is the designated application, and may execute operation 6316 otherwise.

In operation 6314 , in response to identifying that the first application is the designated application, the processor 2230 maintains displaying an execution screen of the first application in the first partial area and maintains the display of the execution screen of the first application in the second partial area The second executable object within may be converted into a widget of the second application. For example, referring to FIG. 64 , processor 2230 can transition state 6405 to state 6411 in response to receiving user input 6409 in state 6405 . At state 6411 , processor 2230 can stop displaying alert 6407 within first subregion 2302 . In the state 6411 , the processor 2230 may display the widget 3322 of the second application switched from the second executable object 2317 in the second partial region 2304 .

In operation 6316 , the processor 2230 is configured to: in response to identifying that the first application is not the designated application or in response to identifying that the first application is distinct from the designated application, in the first partial region The execution screen of the first application may be converted into an execution screen of the second application, and the first executable object in the second partial area may be converted into a widget of the first application. For example, referring to FIG. 64 , processor 2230 can transition state 6405 to state 6413 in response to receiving user input 6409 in state 6405 . At state 6413 , processor 2230 can stop displaying alert 6407 within first subregion 2302 . In the state 6413 , the processor 2230 may display the execution screen 6415 of the second application switched from the execution screen 2310 of the first application in the first partial area 2302 . In the state 6413 , the processor 2230 may display the widget 2412 of the first application switched from the first executable object 2314 in the second partial region 2304 . In various embodiments, the execution screen 6415 of the second application may include content related to the notification 6407 .

63 shows an example of displaying a notification for a signal related to functions supported by the second application and receiving a user input for the notification, but this is for convenience of description. For example, when the signal does not require the display of the notification or the second application is an application that does not support the display of the notification, execution of operation 6308 and execution of operation 6310 may be omitted or bypassed. In this case, after executing operation 6306 , the processor 2230 may execute operation 6312 without execution of operations 6308 and 6310 .

Also, FIG. 63 shows an example of executing operation 6314 or operation 6316 depending on whether the first application is the designated application, but this is for convenience of description. For example, in operation 6312 , the processor 2230 compares the priority of the first application with the priority of the second application, instead of identifying whether the first application is the designated application, and If the priority of the first application is higher than the priority of the second application, operation 6314 may be executed, otherwise operation 6316 may be executed. In various embodiments, the priority of the first application and the priority of the second application may be determined by the processor 2230 without a user input or may be determined based on a user setting.

As described above, the electronic device 2210 according to various embodiments of the present disclosure performs switching of the execution screen of the application according to a signal related to another application received while displaying the execution screen of the application in the first partial area. It can be adaptively processed according to the type of the application. The electronic device 2210 according to various embodiments may provide an enhanced user experience through such processing.

65 is a flowchart illustrating a method of an electronic device for displaying a split screen based on a user input according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

66 illustrates an example of a split screen displayed based on a user input according to various embodiments of the present disclosure;

Referring to FIG. 65 , in operation 6502, the processor 2230 displays an execution screen of the first application in the first partial region, and displays the first executable object and the second in the second partial region. Applicable widgets can be displayed. For example, referring to FIG. 66 , in a state 2300 , the processor 2230 displays the execution screen 2310 of the first application in the first partial area 2302, and the second partial area ( 2304), the widget 2312 and the first executable object 2314 of the second application may be displayed.

In operation 6504, the processor 2230 is configured to display the execution screen of the first application in the first partial region and display the first executable object and the widget of the second application in the second partial region During this time, a user input may be received. For example, referring to FIG. 66 , in a state 2300 , the processor 2230 displays a user input 6600-1, a user input 6600-2, a user input 6600-3, and a user input 6600-4. ) can receive at least one of. For example, the user input 6600-1 may be a hovering input spaced from the display area of the display 2240 and having a designated pattern resulting from a user's hand positioned over the display area. The hovering input may be obtained through a touch sensor associated with the display 2240 . As another example, the user input 6600 - 2 may be an eye gaze input for looking at the display area for a specified time. The eye gaze input may be identified based on an image obtained through the camera 2247 . As another example, the user input 6600 - 3 may be an input to a physical input means included in a steering wheel in a vehicle including the electronic device 2210 . The physical input means may include at least one of a rotatable structure and a physical button. As another example, the user input 6600 - 4 may be a gesture input having a designated pattern caused by a user sitting in the driver's seat of the vehicle or a user sitting in the passenger seat of the vehicle. The gesture input may be identified based on an image obtained through the camera 2247 .

In operation 6506, in response to receiving the user input in operation 6504, the processor 2230 displays the execution screen of the first application in the first partial area as the reduced execution screen of the first application and the second execution screen. It is possible to switch to a reduced execution screen of the application, and to convert the widget of the second application in the second partial area into the second executable object. For example, referring to FIG. 66 , the processor 2230, in a state 2300 , a user input 6600-1, a user input 6600-2, a user input 6600-3, and a user input 6600- 4) may transition state 2300 to state 6602 in response to receiving at least one of. In the state 6602 , the processor 2230 performs the reduced execution screen 4906 of the first application and the second application switched from the execution screen 2310 of the first application in the first partial region 2302 . may display a reduced execution screen 4904 of In the state 6602 , the processor 2230 may display the second executable object 2414 transitioned from the widget 2312 of the second application in the second partial region 2304 .

In some embodiments, the reduced execution screen 4906 of the first application and the reduced execution screen 4904 of the second application displayed in the state 6602 are the control of the first application and the second application. may be in a state in which it cannot receive user input for The reduced execution screen 4906 of the first application and the reduced execution screen 4904 of the second application displayed in the state 6602 are the reduced execution screen 4906 of the first application and the second application. It may be in a state that can receive only a user input for selecting only one execution screen among the reduced execution screens 4904 of . For example, state 6602 may be an intermediate state for transitioning to one of state 2300 and state 2401 . For example, in the state 6602, the processor 2230 may display a reduced execution screen of the first application among the reduced execution screen 4906 of the first application and the reduced execution screen 4904 of the second application. User input 6604 for selecting 4906 may be received. Processor 2230 can transition state 6602 to state 2300 in response to receiving user input 6604 in state 6602 . For another example, in the state 6602 , the processor 2230 may display a reduced execution screen of the second application among the reduced execution screen 4906 of the first application and the reduced execution screen 4904 of the second application. User input 6606 for selecting 4904 may be received. Processor 2230 can transition state 6602 to state 2401 in response to receiving user input 6606 in state 6602 . However, it is not limited thereto.

In some embodiments, when the user input received in state 2300 is user input 6600 - 2 , user input 6604 and user input 6606 may also be configured as the eye gaze input. For example, the user input 6604 is an eye-gaze input that looks at the reduced execution screen 4906 of the first application for a specified time, and the user input 6606 is the reduced execution screen of the second application. It may consist of an eye gaze input looking at 4904 for a specified amount of time. However, it is not limited thereto.

As described above, the electronic device 2230 according to various embodiments receives a user input for changing the arrangement of a screen provided through the display 2240 by displaying a split screen based on a user input distinguished from a touch input. can be simplified. The electronic device 2230 according to various embodiments may provide an enhanced user experience through the simplification of the user input.

67 is a flowchart illustrating a method of an electronic device for converting an execution screen of an application in a display area of a display into an execution screen of another application that provides a reduced execution screen in a display area of another display, according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

68 illustrates an example of exchanging a screen displayed on a display with a screen displayed on another display according to various embodiments of the present disclosure.

Referring to FIG. 67 , in operation 6702 , the processor 2230 displays an execution screen of the first application in the first partial region, and displays the first executable object and the second execution in the second partial region. Possible objects may be displayed, and a reduced screen of the second application may be displayed on another display. In various embodiments, the other display may be a display distinct from the display having the display area composed of the first partial area and the second partial area. For example, the other display may be a cluster display configured with a display in the vehicle for indicating the speed of the vehicle including the electronic device 2210 . As another example, the other display may be a head up display (HUD) in the vehicle including the electronic device 2210 . However, it is not limited thereto. For example, referring to FIG. 68 , in state 6800 , processor 2230 provides state 2300 on the display and states 6805 on another display distinct from the display (eg, the cluster display). ) can be provided. For example, the display providing the status 2300 may display the execution screen 2310 of the first application within the first partial area 2302, and the other display providing the status 6805 may include: A reduced execution screen of the second application may be displayed.

In operation 6704, the processor 2230 displays the execution screen of the first application in the first partial region and displays the first executable object and the second executable object in the second partial region, , while displaying the reduced screen of the second application on another display, a user input may be received. For example, the user input may be an input to a physical input means included in a steering wheel in a vehicle including the electronic device 2210 . The physical input means may include at least one of a rotatable structure and a physical button. However, it is not limited thereto.

In operation 6706 , in response to receiving the user input in operation 6704 , the processor 2230 converts the execution screen of the first application in the first partial region to the execution screen of the second application and displays the other display. The reduced execution screen of the second application may be switched to the reduced execution screen of the first application. For example, referring to FIG. 68 , processor 2230 may transition state 6800 to state 6810 in response to receiving user input in state 6800 . For example, in state 6810 , processor 2230 provides state 2401 transitioned from state 2300 on the display and provides state 6815 transitioned from state 6805 on the other display. can do. For example, the display providing the status 2401 displays the execution screen 2401 of the second application switched from the execution screen 2310 of the first application in the first partial area 2302 and The other display providing the state 6815 may display the execution screen of the first application switched from the reduced execution screen of the second application.

69 illustrates a signal flow for controlling an electronic device through a second other electronic device among a first other electronic device and a second other electronic device included in a vehicle according to various embodiments of the present disclosure; This signal flow may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be caused by the processor 2230 , and may include a first other electronic device (eg, an electronic device) in the vehicle. device 2220) and a second other electronic device.

70 illustrates an example of a screen of an electronic device controlled by another second electronic device according to various embodiments of the present disclosure;

Referring to FIG. 69 , in operation 6922 , the electronic device 2210 may establish a connection between the electronic device 2210 and the first other electronic device 6910 . In various embodiments, the first other electronic device 6910 may be an electronic device included in a vehicle. In various embodiments, the first other electronic device 6910 may be an electronic device for a user sitting in a driver's seat of a vehicle including the electronic device 2210 .

In operation 6924 , the electronic device 2210 may establish a connection between the electronic device 2210 and the second other electronic device 6920 . In various embodiments, the second other electronic device 6920 may be an electronic device included in a vehicle. In various embodiments, the second other electronic device 6920 may be an electronic device for a user sitting in a passenger seat of a vehicle including the electronic device 2210 .

In operation 6926 , the electronic device 2210 may receive data from the first other electronic device 6910 . In various embodiments, the data displays the execution screen of the first application in the first partial region using the display 2240 of the electronic device 2210 and the first execution in the second partial region It may include information for displaying possible objects and widgets of the second application.

In operation 6928 , the electronic device 2210 displays an execution screen of the first application in the first partial region based on the data received in operation 6926 and performs the first execution in the second partial region Possible objects and widgets of the second application may be displayed. For example, referring to FIG. 70 , the electronic device 2210 and the second other electronic device 6920 may be in a state 7000 . The state 7000 may include a state 2300 of the electronic device 2210 and a state 7005 of the second other electronic device 6920 . In the state 2300 , the electronic device 2210 displays the execution screen 2310 of the first application in the first partial area 2302 based on the data received from the first other electronic device 6910 . and a widget 2312 of the second application may be displayed in the second partial area 2304 . In the state 7005 , the second other electronic device 6920 may be in a state that does not cause any user input with respect to the electronic device 2210 .

In operation 6930 , the electronic device 2210 may transmit information on the execution screen of the first application and information on the widget of the second application to the second other electronic device 6920 . In various embodiments, the information in operation 6930 controls the execution screen of the first application displayed in the first partial area in the second other electronic device 6920 or the second other electronic device 6920 In order to control the widget of the second application displayed in the second partial area, the data may be transmitted to another second electronic device 6920 . In various embodiments, the information transmitted in operation 6930 may include an execution screen corresponding to the execution screen of the first application and a widget of the second application on the display of the second other electronic device 6920 for the control. may be configured to display a widget corresponding to .

Meanwhile, the second other electronic device 6920 may receive the information from the electronic device 2210 . In response to receiving the information, the second other electronic device 6920 may display a screen on the display of the second other electronic device 6920 based on the information. The screen may control the execution screen of the first application displayed in the first partial area in the second other electronic device 6920 or the second electronic device 6920 displayed in the second partial area In order to control the widget of the second application, a screen corresponding to the execution screen of the first application and a screen corresponding to the widget of the second application may be included.

In operation 6932, the second other electronic device 6920 may receive at least one user input for the screen displayed in operation 6930. For example, referring to FIG. 70 , a state 7000 may be converted to a state 7010 by the at least one user input in operation 6932 . The state 7010 may include a state 7012 of the electronic device 2210 and a state 7016 of the second other electronic device 6920 . In the state 7012 , the electronic device 2210 controls the execution screen 2310 of the first application displayed in the first partial area 2302 or the second application displayed in the second partial area 2304 . Information 7014 for informing that at least one of the widgets 2312 is being controlled by a passenger may be displayed. Although not shown in FIG. 69 , the information 6914 includes a first partial region ( 2302 may be displayed as overlapping on the execution screen 2310 of the first application. However, it is not limited thereto. Meanwhile, in the state 7016 , the second other electronic device 6920 may receive the at least one input for the screen displayed in operation 6930 .

In operation 6934 , the second other electronic device 6920 may transmit information on the at least one user input to the electronic device 2210 . In various embodiments, the information in operation 6934 may include selecting at least one of an execution screen of the first application displayed in the first partial region or a widget of the second application displayed in the second partial region. To control, it can be transmitted. Meanwhile, the electronic device 2210 may receive the information from the second other electronic device 6920 .

In operation 6936 , the electronic device 2210 may transmit information on the at least one user input to the first other electronic device 6910 . For example, the electronic device 2210 may display an execution screen of the first application or the second application displayed in the first partial area according to the at least one user input caused by the user of the second other electronic device 6920 . In order to control the widget of the second application displayed in the second partial area, the information may be transmitted to the first other electronic device 6910 . Meanwhile, the first other electronic device 6910 may receive the information from the electronic device 2210 . The first other electronic device 6910 may be configured to display a display state of an execution screen of the first application in the first partial region to be changed according to the at least one user input or the at least one user based on the received information. Other data for the display state of the widget of the second application in the second partial region to be changed according to an input may be acquired or generated.

In operation 6938 , the first other electronic device 6910 may transmit the other data obtained based on the information to the electronic device 2210 . Meanwhile, the first other electronic device 6910 may receive the other data from the electronic device 2210 .

In operation 6940, the electronic device 2210 changes the display state of the execution screen of the first application in the first partial region or displays the widget of the second application in the second partial region based on the other data state can be changed. For example, referring to FIG. 70 , a state 7010 may be converted to a state 7020 by changing the display state in operation 6940 . The state 7020 may include a state 7022 of the electronic device 2210 and a state 7005 of the second other electronic device 6920 . In the state 7022 , the electronic device 2210 may display the execution screen 7024 of the first application switched from the execution screen 2310 of the first application in the first partial area 2302 . For example, the execution screen 7024 of the first application may be an execution screen obtained by changing the execution screen 2310 of the first application in the state 7012 based on the at least one user input. For example, in the state 7005 , the second other electronic device 6920 may be in a state that does not cause any user input with respect to the electronic device 2210 .

As described above, the electronic device 2210 according to various embodiments changes information displayed on the display 2240 of the electronic device 2210 under the control of the second other electronic device 6920, It is possible to prevent a user in a vehicle including the electronic device 2210 from causing a user input for controlling the displayed information while driving. In other words, the electronic device 2210 according to various embodiments may prevent an accident of the vehicle including the electronic device 2210 .

71 illustrates a method of an electronic device for controlling a screen displayed on a display based on a user input received through another display according to various embodiments of the present disclosure. This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

72 illustrates an example of a screen on a display that changes a display state based on a user input received through another display according to various embodiments of the present disclosure;

Referring to FIG. 71 , in operation 7102 , the processor 2230 displays the execution screen of the first application in the first partial region of the display and the first executable object in the second partial region of the display. and a widget of the second application.

In operation 7104 , the processor 2230 displays the execution screen of the first application in the first partial region of the display and displays the first executable object and the second in the second partial region of the display. While displaying a widget of an application, display the execution screen of the first application in a third partial region of another display that is distinct from the display, and display the first executable object and the first executable object in a fourth partial region of the other display A widget of the second application may be displayed. In various embodiments, the other display is a display distinct from the display, and may be a display arranged for the second row of seats. In various embodiments, the size of the other display may correspond to or be distinct from the size of the display. In various embodiments, the aspect ratio of the other display may correspond to or be distinct from the aspect ratio of the display.

In various embodiments, the display area of the other display may include the third partial area and a fourth partial area adjacent to the third partial area. In various embodiments, the disposition of the third partial region and the fourth partial region may correspond to the arrangement of the first partial region and the second partial region, and the first partial region and the second partial region It can also be distinguished from the arrangement of

For example, referring to FIG. 72 , the display and the other display may be in state 7200 . For example, state 7200 may include state 2300 of the display and state 7202 of the other display. In the state 2300 , the display displays the execution screen 2310 of the first application in the first partial area 2302 and displays the widget 2312 of the second application in the second partial area 2304 . can be displayed In the state 7202 , the other display displays an execution screen corresponding to the execution screen 2310 of the first application within the third partial area 7203 and the second application within the fourth partial area 7204 . A widget corresponding to the widget 2312 of may be displayed.

In operation 7106 , the processor 2230 may receive a user input for the third partial region or the fourth partial region while performing operation 7104 . For example, referring to FIG. 72 , the electronic device 2210 may receive a user input 7205 or a user input 7220 in a state 7200 .

In operation 7108 , in response to receiving the user input in operation 7106 , the processor 2230 may execute a function indicated by the user input and provide a result of the execution of the function. For example, when the user input relates to an execution screen displayed in the third partial region, the processor 2230 may be configured to: an execution screen of the first application in the first partial region and the execution screen in the third partial region By changing the display state of the execution screen, the result of the execution of the function can be provided. For example, referring to FIG. 72 , a state 7200 may be converted to a state 7207 by a user input 7205 . State 7207 may include state 7210 of the display and state 7212 of the other display. In the state 7210 , the display may display the execution screen 7211 of the first application in the first partial area 2302 changed according to the user input 7205 . In the state 7212 , the other display may display the execution screen 7213 in the third partial region 7203 changed according to the user input 7205 . As another example, when the user input relates to an execution screen displayed in the fourth partial region, the processor 2230 may be configured to: a widget of the second application in the second partial region and the widget in the fourth partial region By changing the display state of the widget, it is possible to provide the result of the execution of the function. For example, referring to FIG. 72 , a state 7200 may be converted to a state 7225 by a user input 7220 . State 7225 may include state 7227 of the display and state 7229 of the other display. In the state 7227 , the display may display the widget 7228 of the second application in the second partial area 2304 changed according to the user input 7220 . In the state 7229 , the other display may display the widget 7230 in the fourth partial region 7204 changed according to the user input 7220 .

As described above, the electronic device 2210 according to various embodiments may change the display state of the electronic device 2210 by changing the display state of the display based on a user input to another display that is distinguished from the display disposed closer to the driver's seat. ) can be prevented from causing a user input for controlling the displayed information while driving by a user in a vehicle including the . In other words, the electronic device 2210 according to various embodiments may prevent an accident of the vehicle including the electronic device 2210 .

73 is a method of an electronic device for moving at least one executable element in an execution screen of a first application in a first partial region or a widget of a second application in a second partial region based on a hovering input according to various embodiments of the present disclosure; shows This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

74 illustrates an example of at least one executable element in an execution screen of a first application in a first partial region moved according to a hovering input or a widget of a second application in a second partial region, according to various embodiments of the present disclosure;

Referring to FIG. 73 , in operation 7302 , the processor 2230 displays an execution screen of the first application in the first partial region, and displays the first executable object and the second application in the second partial region. of widgets can be displayed. For example, referring to FIG. 74 , in a state 2300 , the processor 2230 displays the execution screen 2310 of the first application in the first partial area 2302 and the second partial area 2304 . ), a widget 2312 of the second application may be displayed.

In operation 7304 , the processor 2230 may identify that the hovering input for the display area including the first partial area and the second partial area is maintained for a specified time. In various embodiments, the hovering input may be a hovering input caused by a user's hand spaced from the display area and positioned on the display area. In various embodiments, for the specified time, when the hovering input moves at least one executable element in an execution screen of the first application in the first partial region or a widget of the second application in the second partial region It may be a parameter that is defined to identify whether it is an input for The specified length of time may be set by the processor 2230 without a user input or may be set by a user setting.

In operation 7306 , the processor 2230 may identify whether the hovering input is maintained over the first partial area or over the second partial area. For example, the hovering input may be maintained on the first partial region for the specified time, and on the second partial region for the specified time. The processor 2230 may execute operation 7308 if the hovering input is maintained over the first partial region, otherwise execute operation 7310 .

In operation 7308 , in response to identifying that the hovering input is maintained on the first partial region for the specified time, in operation 7308 , the processor 2230 returns to the region in which the hovering input is received. One executable element can be moved. For example, referring to FIG. 74 , the processor 2230 may change state 2300 to state 7402 in response to receiving a hover input 7400 for first subregion 2302 in state 2300 . ) can be converted to In the state 7402 , the processor 2230 is configured to include at least one executable element 7404 in the execution screen 2310 of the first application in the first partial region 2302 to the region where the hovering input 7400 is received. can be moved Due to the movement, the user can easily control the execution screen 2310 of the first application through a user input (eg, a touch input) following the hovering input 7400 .

In operation 7310 , the processor 2230 may move the widget of the second application to the area where the hovering input is received in response to identifying that the hovering input is maintained on the second partial area for the specified time. For example, referring to FIG. 74 , the processor 2230 may change state 2300 to state 7408 in response to receiving a hover input 7406 for second subregion 2304 in state 2300 . ) can be converted to In the state 7408 , the processor 2230 may move the widget 2312 of the second application in the second partial area 2304 to the area where the hovering input 7406 is received. Due to the movement, the user may control the widget 2312 of the second application through a user input (eg, a touch input) following the hovering input 7406 .

As described above, the electronic device 2210 according to various embodiments is an executable element to a location from which a hovering input is received so that a user can control an execution screen or widget displayed on the display 2240 at a desired location. Or you can move the widget. The electronic device 2210 according to various embodiments may provide an enhanced user experience through the movement.

75 is a method of an electronic device for expanding at least one executable element in an execution screen of a first application in a first partial area or a widget of a second application in a second partial area based on a hovering input according to various embodiments of the present disclosure; shows This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

76 illustrates an example of at least one executable element in an execution screen of a first application in a first partial area that is expanded according to a hovering input or a widget of a second application in a second partial area, according to various embodiments of the present disclosure;

Referring to FIG. 75 , in operation 7502 , the processor 2230 displays an execution screen of the first application in the first partial area, and displays the first executable object and the second in the second partial area. Applicable widgets can be displayed. For example, referring to FIG. 76 , in a state 2300 , the processor 2230 displays the execution screen 2310 of the first application in the first partial area 2302 and the second partial area 2304 . ), a widget 2312 of the second application may be displayed.

In operation 7504, the processor 2230 may identify that the hovering input for the display area including the first partial area and the second partial area is maintained for a specified time. In various embodiments, the hovering input may be a hovering input caused by a user's hand spaced from the display area and positioned on the display area. In various embodiments, the specified time may be determined whether the hovering input is an input for expanding at least one executable element in an execution screen of the first application within the first partial area or the second partial area within the second partial area. 2 It may be a parameter that is defined to identify whether it is an input for extending a widget of an application. The specified length of time may be set by the processor 2230 without a user input or may be set by a user setting.

In operation 7506 , the processor 2230 may identify whether the hovering input is maintained over the first partial area or over the second partial area. For example, the hovering input may be maintained on the first partial region for the specified time, and on the second partial region for the specified time. The processor 2230 may execute operation 7508 if the hovering input is maintained over the first partial region, otherwise execute operation 7510 .

In operation 7508 , the processor 2230 is configured to expand the at least one executable element in the execution screen of the first application in response to identifying that the hovering input is maintained over the first partial region for the specified time. can For example, referring to FIG. 76 , the processor 2230 may change state 2300 to state 7602 in response to receiving a hover input 7601 for first subregion 2302 in state 2300 . ) can be converted to In the state 7602 , the processor 2230 is configured to: at least one executable element 7604 in the execution screen 2310 of the first application in the first partial region 2302 in the region in which the hovering input 7601 is received can be expanded. Due to the expansion, the user can easily control the execution screen 2310 of the first application through a user input (eg, a touch input) following the hovering input 7400 .

In operation 7510 , the processor 2230 may expand the widget of the second application in response to identifying that the hovering input is maintained on the second partial region for the specified time. For example, referring to FIG. 75 , the processor 2230 may change state 2300 to state 7606 in response to receiving a hover input 7605 for second subregion 2304 in state 2300 . ) can be converted to In the state 7606 , the processor 2230 may expand the widget 2312 of the second application in the second partial area 2304 within the area in which the hovering input 7605 is received. In various embodiments, the widget 2312 of the extended second application may overlap at least a portion on the execution screen 2310 of the first application. Due to the movement, the user can easily control the widget 2312 of the second application through a user input (eg, a touch input) following the hovering input 7605 .

As described above, the electronic device 2210 according to various embodiments enables a user to control an execution screen or a widget displayed on the display 2240 at a desired location, which may be executed related to a region from which a hovering input is received. Elements or widgets can be extended. The electronic device 2210 according to various embodiments may provide an enhanced user experience through the expansion.

77 is a flowchart illustrating a method of an electronic device for adaptively controlling event information to be displayed in an execution screen of a first application displayed in a first partial region based on an eye gaze input, according to various embodiments of the present disclosure; . This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

78 illustrates an example of event information in an execution screen of a first application within a first partial area that is adaptively displayed based on an eye gaze input, according to various embodiments of the present disclosure;

Referring to FIG. 77 , in operation 7702 , the processor 2230 may display an execution screen of the first application in the first partial area. For example, referring to FIG. 78 , in a state 7800 , the processor 2230 may display the execution screen 2310 of the first application in the first partial area 2302 . In various embodiments, the processor 2230 may display a widget of the second application in the second partial area while displaying the execution screen of the first application in the first partial area.

In operation 7704, while displaying the execution screen of the first application in the first partial area, the processor 2230 displays the execution screen of the first application in the display area or the first partial area for a specified time. It can monitor or identify whether it identifies a staring eye gaze input. In various embodiments, the eye gaze input may be identified based on an image obtained via camera 2247 . For example, referring to FIG. 78 , in a state 7800 , the processor 2230 is in a state 7830 while displaying the execution screen 2310 of the first application in the first partial area 2302 . monitor or identify whether it identifies the eye gaze input caused by In various embodiments, the processor 2230 performs operation 7708 based on monitoring identifying the eye gaze input while displaying the execution screen of the first application in the first partial region, , otherwise operation 7706 may be executed.

77 and 78 illustrate an example of monitoring whether the processor 2230 identifies the eye gaze input while displaying the execution screen of the first application in the first partial region, but this This is for convenience of explanation. The eye gaze input may be replaced with another user input. For example, the other user input may be configured as a user action caused by the user paying attention to the execution screen of the first application. For example, the user action may be at least one of a change in the weight of the driver's seat of the vehicle caused by the user paying attention to the execution screen of the first application or a change in tension of a seat belt worn by the user sitting in the driver's seat. can be one However, it is not limited thereto. For example, if the eye gaze input is replaced by the other user input, the processor 2230, based on monitoring identifying the other user input, executes operation 7708 , otherwise performs operation 7706 . can run

77 and 78 illustrate an example of monitoring whether the processor 2230 identifies the eye gaze input while displaying the execution screen of the first application in the first partial region, but this This is for convenience of explanation. The operation of monitoring whether the eye-gaze input is identified may be replaced with an operation of monitoring whether the frequency at which the eye-gaze input is caused is equal to or greater than a reference number. For example, the frequency at which the eye gaze input is induced may mean the number of times the eye gaze input is induced during a unit time. In this case, the processor 2230 may execute operation 7708 , otherwise perform operation 7706 , based on monitoring that the frequency of the eye gaze input is equal to or greater than the reference number.

In operation 7706 , the processor 2230 is configured to perform at a specified timing or a specified period based on monitoring that the eye gaze input is not identified while the execution screen of the first application is displayed in the first partial region. Based on this, event information may be displayed in the execution screen of the first application. In various embodiments, the event information may be displayed to provide new information or other information that is distinct from information currently being provided. For example, when the first application is an application for providing a navigation service, the event information is provided before the vehicle including the electronic device 2210 enters an area within a specified distance from a junction or intersection. The moving direction information of the vehicle displayed in the execution screen of the first application may be included. For another example, when the first application is an application for providing the navigation service, the event information may be a lane to be changed by the vehicle in order for the vehicle to move according to a route being guided by the first application. may contain information. As another example, when the first application is an application for providing the navigation service, the event information may include route guidance information displayed before the vehicle enters an underground lane. However, it is not limited thereto.

In various embodiments, the specified timing may be a timing of displaying the event information when the eye gaze input is not identified in operation 7704 . For example, the designated timing may be a timing at which a distance between a place related to the event information and the vehicle including the electronic device 2210 reaches a designated distance. For example, if the event information is information on the moving direction of the vehicle at the junction and the designated distance is 100 m, the processor 2230 is based on identifying that the distance between the vehicle and the junction is 100 m, the Event information may be displayed in the execution screen of the first application. For another example, the specified timing may be a timing prior to a predefined time from a timing at which the vehicle is expected to enter the place related to the event information. For example, the event information is route guidance information displayed before the vehicle enters the underground lane, the expected time for the vehicle to enter the underground lane is 1 minute after the current time, and the predefined When the time is 10 seconds, the processor 2230 may display the event information in the execution screen of the first application after 50 seconds from the current time. However, it is not limited thereto.

For example, referring to FIG. 78 , the processor 2230 may change state 7800 to state 7800 in response to monitoring that it does not identify the eye gaze input caused by state 7830 in state 7800 . state 7805. In the state 7805 , the processor 2230 may display event information 7810 in the execution screen 2310 of the first application in the first partial area 2302 based on the specified timing. For example, in the state 7805 , the specified timing may be a timing 7815 for identifying that a distance between the electronic device 2210 and a place (eg, a junction) related to the event information 7810 is 150 m. As another example, in the state 7805 , the specified timing may be the timing 7820 at which N seconds (N is a real number greater than zero) have elapsed from the state 7800 . However, it is not limited thereto.

In various embodiments, the specified period may be a period for displaying the event information when the eye gaze input is not identified in operation 7704 . For example, when the specified period is 10 seconds, the processor 2230 may display the event information every 10 seconds in response to monitoring that the eye gaze input is not identified in operation 7704 . However, it is not limited thereto.

In operation 7708 , the processor 2230 is configured to, based on monitoring that the eye gaze input is identified while displaying the execution screen of the first application in the first partial region, is configured to be different from the specified timing. (another) The event information may be displayed in the execution screen of the first application based on a specified timing or another specified period distinct from the specified period.

In various embodiments, the other designated timing may be set earlier than the designated timing. For example, the other specified timing is a timing at which the distance of the vehicle including the location related to the event information and the electronic device 2210 reaches another specified distance distinguished from the specified distance in operation 7706 . can be For example, when the event information is information on the moving direction of the vehicle at the junction and the designated distance is 100m, the other designated distance may be 300m. For example, unlike operation 7706 , the processor 2230 may display the event information in the execution screen of the first application based on identifying that the distance between the vehicle and the junction is 300 m. For another example, the specified timing may be a timing prior to another predefined time from the timing at which the vehicle is expected to enter the location related to the event information. For example, the event information is route guidance information displayed before the vehicle enters the underground lane, the expected time for the vehicle to enter the underground lane is 1 minute after the current time, and the predefined If the time taken is 10 seconds, the other predefined time may be 20 seconds. For example, the processor 2230 may display the event information in the execution screen of the first application after 40 seconds from the current time. However, it is not limited thereto.

For example, referring to FIG. 78 , processor 2230 may change state 7800 to state ( 7850. In the state 7850, the processor 2230 provides event information in the execution screen 2310 of the first application in the first partial region 2302 based on the other specified timing. 7860. For example, in the state 7850, the other specified timing identifies that the distance between the electronic device 2210 and the location (eg, a junction) associated with the event information 7860 is 500 m In another example, in state 7850, the other designated timing is timing 7870 at which NM seconds (M is a real number less than or equal to N greater than 0) elapsed from state 7800. may be, but is not limited thereto.

In various embodiments, the other designated period may be a period for displaying the event information when the eye gaze input is identified in operation 7704 . The other designated period may be set to be shorter than the designated period. For example, the other designated period may be 5 seconds shorter than the designated period of 10 seconds. For example, if the other designated period is 5 seconds, the processor 2230 may display the event information every 5 seconds in response to monitoring identifying the eye gaze input in operation 7704 . However, it is not limited thereto.

In various embodiments, at least one of the other designated timing or the other designated period may be set by a user input or may be set by the processor 2230 without a user input.

77 and 78 show examples of displaying the event information through the display 2240 of the electronic device 2210, the event information may be provided in relation to the electronic device 2210 in various formats. . For example, the event information may be provided through a voice signal. However, it is not limited thereto.

Meanwhile, in various embodiments, the processor 2230 may further perform other operations in addition to operation 7708 while identifying the eye gaze input. For example, while identifying the eye gaze input or receiving the eye gaze input, independent of executing operation 7708 , the processor 2230 may perform an operation of the sensor 2249 of the electronic device 2210 . You can increase the frequency. For example, when the user of the electronic device 2210 causes the eye gaze input, it may mean that the user does not look forward while the vehicle including the electronic device 2210 is moving. The processor 2230 is configured to operate the sensor 2249 while identifying the eye-gaze input to prevent an accident of the vehicle including the electronic device 2210 from occurring due to the occurrence of the eye-gaze input. You can increase the frequency. Through the increase of the operating frequency of the sensor 2249 , the processor 2230 may more accurately identify the state of the environment around the vehicle including the electronic device 2210 while identifying the eye-gaze input. have. Meanwhile, the processor 2230 may restore the raised operating frequency of the sensor 2249 based on the identification of completion of the eye gaze input.

As described above, the electronic device 2210 according to various embodiments may adaptively change a timing for providing event information or a period for providing the event information according to whether the eye gaze input is identified. , can provide an enhanced user experience.

79 illustrates a method of an electronic device for controlling event information to be displayed on an execution screen of an application in a first partial area according to whether a destination is initially set, according to various embodiments of the present disclosure; This method may be executed by the infotainment device 100 , the control device 2100 , or the electronic device 2210 , or may be executed by the processor 2230 .

Referring to FIG. 79 , in operation 7902 , the processor 2230 may display an execution screen of the first application in the first partial area. For example, operation 7902 may correspond to operation 7702 .

In operation 7904, the processor 2230 may receive a user input for setting a destination while displaying the execution screen of the first application in the first partial area. In various embodiments, when the first application is an application for providing a navigation service, the destination may mean a place to which a vehicle including the electronic device 2210 is to be moved. In various embodiments, the user input may be received through at least one executable element in an execution screen of the first application in the first partial area. In various embodiments, the user input may be received through a voice signal. However, it is not limited thereto.

In operation 7906 , in response to receiving the user input in operation 7904 , the processor 2230 may identify whether the set destination is a destination initially set by the electronic device 2210 . For example, the processor 2230 may store history information of destinations input to the electronic device 2210 to guide the route of the vehicle. The processor 2230 may identify whether the destination set by the user input is the first set destination in operation 7904 based on the history information. If the set destination is the first set destination, the processor 2230 may execute operation 7708 , otherwise, perform operation 7706 .

In operation 7908, in response to identifying that the set destination is not the first set destination, the processor 2230 may display event information in the execution screen of the first application based on a specified timing or a specified period. have. For example, the event information may be event information defined through the descriptions of FIGS. 77 and 78 . For example, the designated timing may be a designated timing defined through the descriptions of FIGS. 77 and 78 . For example, the designated period may be a designated period defined through the descriptions of FIGS. 77 and 78 .

In operation 7910, the processor 2230, in response to identifying that the set destination is the first set destination, based on another designated timing distinct from the designated timing or another designated period different from the designated period, the first The event information may be displayed in the execution screen of the application. For example, the event information may be event information defined through the descriptions of FIGS. 77 and 78 . For example, the other designated timing may be another designated timing defined through the descriptions of FIGS. 77 and 78 . For example, the other designated period may be another designated period defined through the descriptions of FIGS. 77 and 78 .

Although not shown in FIG. 79 , the processor 2230 may change the timing or period of displaying the event information according to the frequency of setting the destination. For example, when the destination is a destination A that the user inputs once every day, the processor 2230 sets the length of the period for displaying the event information to X, and when the destination is a destination B inputted by the user once every month The processor 2230 may set the length of the period for displaying the event information to Y, which is shorter than X. However, it is not limited thereto.

As described above, the electronic device 2210 according to various embodiments is enhanced by adaptively changing a timing for providing event information or a period for providing the event information according to whether an initially set destination is input. User experience can be provided.

The device described above may be implemented as a hardware component, a software component, and/or a combination of the hardware component and the software component. For example, the apparatus and components described in the embodiments may include a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), and a programmable logic unit (PLU). It may be implemented using one or more general purpose or special purpose computers, such as a logic unit, microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For convenience of understanding, although one processing device is sometimes described as being used, one of ordinary skill in the art will recognize that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that can include For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

The software may comprise a computer program, code, instructions, or a combination of one or more thereof, which configures a processing device to operate as desired or is independently or collectively processed You can command the device. The software and/or data may be embodied in any type of machine, component, physical device, computer storage medium or device for interpretation by or providing instructions or data to the processing device. have. The software may be distributed over networked computer systems, and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. In this case, the medium may be to continuously store a program executable by a computer, or to temporarily store it for execution or download. In addition, the medium may be a variety of recording means or storage means in the form of a single or several hardware combined, it is not limited to a medium directly connected to any computer system, and may exist distributed on a network. Examples of the medium include a hard disk, a magnetic medium such as a floppy disk and a magnetic tape, an optical recording medium such as CD-ROM and DVD, a magneto-optical medium such as a floppy disk, and those configured to store program instructions, including ROM, RAM, flash memory, and the like. In addition, examples of other media include recording media or storage media managed by an app store that distributes applications, sites that supply or distribute various other software, and servers.

As described above, although the embodiments have been described with reference to the limited embodiments and drawings, various modifications and variations are possible for those skilled in the art from the above description. For example, the described techniques are performed in a different order than the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (58)

A computer readable storage medium storing one or more programs, comprising:
the one or more programs,
When included in a vehicle and executed by at least one processor of an electronic device having a display,
While the first application and the second application are being executed, among the first partial area constituting the display area of the display and the second partial area adjacent to the first partial area, the first application is displayed in the first partial area. A widget of the second application including a first executable element and a second executable element within the second partial region and a first executable object for displaying an execution screen and indicating the first application display,
the second application of the widget of the second application while displaying the execution screen of the first application in the first partial area and displaying the widget of the second application and the first executable object in the second partial area Display an execution screen of the second application switched from the execution screen of the first application in the first partial area on the basis of receiving a first user input for one executable element, and in the second partial area display a second executable object for indicating the second application, the widget of the first application switched from the first executable object and the widget of the second application, in
the second application of the widget of the second application while displaying the execution screen of the first application in the first partial area and displaying the widget of the second application and the first executable object in the second partial area 2 Based on receiving a second user input for the executable element, in an area extending from a widget of the second application, superimposed on the execution screen of the first application displayed in the first partial area, the display the at least one visual item available via a second executable element;
A computer readable storage medium comprising instructions for causing the electronic device.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
While no user input is received while the first application and the second application are being executed, an execution screen of the first application is displayed in the first partial area, and the second application is displayed in the second partial area. 2 to display the widget of the application and the first executable object,
A computer readable storage medium comprising instructions for causing the electronic device.
The method according to claim 1, The first user input,
a single tap input to the first executable element;
The second user input is
a single tap input to the second executable element;
When the one or more programs are executed by the at least one processor of the electronic device,
While displaying the execution screen of the first application in the first partial region and displaying the widget of the second application and the first executable object in the second partial region, the widget of the second application is displayed as a first based on receiving a third user input for dragging in the direction, displaying the extended widget of the second application switched from the widget of the second application in the second partial area,
While displaying the execution screen of the second application in the first partial region and displaying the widget of the first application and the second executable object in the second partial region, the widget of the first application is displayed as the first to display the extended widget of the first application switched from the widget of the first application in the second partial area based on receiving a fourth user input for dragging in the first direction;
instructions for further causing the electronic device,
The display position of the first executable object is,
When the widget of the second application is switched to the extended widget of the second application through the third user input while the direction from the widget of the second application to the first executable object is the first direction , moved in the first direction according to the transition from the widget of the second application to the extended widget of the second application,
In a state in which the direction from the widget of the second application to the first executable object is in a second direction opposite to the first direction, the widget of the second application is selected through the third user input. When switching to the extended widget of the second application, it is maintained independently of the transition from the widget of the second application to the extended widget of the second application,
The display position of the second executable object is,
When the widget of the first application is switched to the extended widget of the first application through the fourth user input while the direction from the widget of the first application to the second executable object is the first direction , is moved in the first direction according to the transition from the widget of the first application to the extended widget of the first application,
When the widget of the first application is switched to the extended widget of the first application through the fourth user input while the direction from the widget of the first application to the second executable object is the second direction , a computer-readable storage medium maintained independently of the transition from the widget of the first application to the extended widget of the first application.
The method according to claim 3, wherein the one or more programs, when executed by the at least one processor of the electronic device,
While displaying the execution screen of the first application in the first partial area and displaying the widget of the second application and the first executable object in the second partial area, the widget of the second application is displayed in the second partial area. based on receiving a fifth user input for dragging in two directions, displaying a reduced widget of the second application switched from the widget of the second application in the second partial area;
While displaying the execution screen of the second application in the first partial region and displaying the widget of the first application and the second executable object in the second partial region, the widget of the first application is displayed as the first display a reduced widget of the first application switched from the widget of the first application in the second partial area based on receiving a sixth user input for dragging in two directions;
instructions for further causing the electronic device,
The display position of the first executable object is,
When the widget of the second application is switched to the reduced widget of the second application through the fifth user input in a state in which the direction from the widget of the second application to the first executable object is the first direction , moved in the second direction according to the transition from the widget of the second application to the reduced widget of the second application,
When the widget of the second application is switched to the reduced widget of the second application through the fifth user input in a state in which the direction from the widget of the second application to the first executable object is the second direction , maintained independently of the transition from the widget of the second application to the reduced widget of the second application,
The display position of the second executable object is,
When the widget of the first application is switched to the reduced widget of the first application through the sixth user input in a state in which the direction from the widget of the first application to the second executable object is the first direction , is moved in the second direction according to the transition from the widget of the first application to the reduced widget of the first application,
When the widget of the first application is switched to the reduced widget of the first application through the sixth user input in a state in which the direction from the widget of the first application to the second executable object is the second direction , a computer-readable storage medium maintained independently of the transition from the widget of the first application to the reduced widget of the first application.
The method according to claim 1, The widget of the second application and the first executable object,
displayed in the second sub-area together with a third executable object for indicating a third application;
When the one or more programs are executed by the at least one processor of the electronic device,
while displaying the execution screen of the first application in the first partial region and displaying the widget of the second application and the first executable object together with the third executable object in the second partial region Based on receiving a third user input for dragging a third executable object in a first direction, the execution screen of the first application is maintained in the first partial area, and the third application is executed and display the widget of the third application switched from the third executable object together with the widget of the second application and the first executable object in the second partial region,
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
Based on receiving a third user input for another region in the second partial region distinct from the display region of the widget of the second application and the display region of the first executable object, the first application and the second application 2 Display a third executable object for indicating a function distinct from functions available through the application in the second partial area together with the widget of the second application and the first executable object,
based on receiving a fourth user input for the third executable object, execute the function indicated by the third executable object;
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 6, wherein the one or more programs, when executed by the at least one processor of the electronic device,
in response to the execution of the function indicated by the third executable object, to switch the execution screen of the first application displayed in the first partial region to the execution screen of the function;
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 6, wherein the one or more programs, when executed by the at least one processor of the electronic device,
in response to the execution of the function indicated by the third executable object, convert the third executable object displayed in the second partial region into a widget for indicating an execution state of the function;
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 6, The function,
A computer-readable storage medium which is a function provided through the electronic device most recently among a plurality of functions, which is available through the electronic device and is distinct from the functions available through the first application and the second application.
The method according to claim 6, The function,
A computer-readable storage medium which is a function most frequently provided through the electronic device among a plurality of functions available through the electronic device and distinct from the functions available through the first application and the second application.
The method according to claim 6, wherein the one or more programs, when executed by the at least one processor of the electronic device,
based on receiving a fifth user input for the third executable object, assigning the third executable object another function to distinguish it from functions available through the first application and the second application. switch to a fourth executable object for pointing,
to execute the other function indicated by the fourth executable object based on receiving a sixth user input for the fourth executable object;
instructions for further causing the electronic device,
The fourth user input is
a single tap input to the third executable object,
The fifth user input is,
an input for dragging the third executable object in a specified direction.
The method according to claim 6, wherein the one or more programs, when executed by the at least one processor of the electronic device,
Based on receiving a fifth user input for the other region in the second partial region distinct from the display region of the widget of the second application and the display region of the first executable object, Execute the function of the first application indicated by
to change the state of the execution screen of the first application displayed in the first partial area based on the execution of the function of the first application;
instructions for further causing the electronic device,
The attribute of the fifth user input is,
a computer-readable storage medium distinct from an attribute of the third user input.
The method according to claim 6, wherein the one or more programs, when executed by the at least one processor of the electronic device,
Based on receiving a fifth user input for the other region in the second partial region distinct from the display region of the widget of the second application and the display region of the first executable object, Execute the function of the second application indicated by
to change the state of the widget of the second application displayed in the second partial area based on the execution of the function of the second application;
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 6, wherein the one or more programs, when executed by the at least one processor of the electronic device,
based on receiving a fifth user input for the other region in the second partial region distinct from the display region of the widget of the second application and the display region of the first executable object, in the first partial region Displaying a handwriting input field as superimposed on the execution screen of the first application displayed in
Recognizing a character indicated by a path of the at least one drag input based on receiving the at least one drag input initiated from the handwriting input field,
to execute a function corresponding to the recognized character,
instructions for further causing the electronic device,
The attribute of the fifth user input is,
a computer-readable storage medium distinct from an attribute of the third user input.
The method according to claim 14, wherein the handwriting input field,
extending from at least a portion of the other region within the second sub-region;
A computer-readable storage medium that is translucent, such that a portion of the execution screen of the first application disposed below the handwriting input field is visible.
The method according to claim 14, wherein the one or more programs, when executed by the at least one processor of the electronic device,
Based on the fifth user input, along with the handwriting input field, a plurality of pieces including the first application and the second application are displayed as overlapping on the execution screen of the first application displayed in the first partial area. Display a plurality of executable objects, each for indicating the applications of
based on receiving the at least one drag input initiated from the handwriting input field after receiving a sixth user input for selecting one (a) executable object of the plurality of executable objects, the at least Recognize the character indicated by the path of one drag input,
to execute an application indicated by the executable object selected by the sixth user input and a function corresponding to the recognized character,
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 14, wherein the one or more programs, when executed by the at least one processor of the electronic device,
While the at least one drag input initiated from the handwriting input field is received, a path of the at least one drag input passing a part of the execution screen of the first application beyond the handwriting input field is defined as the first to recognize as part of the text instead of user input to the application;
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 17, wherein the one or more programs, when executed by the at least one processor of the electronic device,
to display a part of the path of the at least one drag input on the execution screen of the first application displayed in the first partial area;
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
Display of the widget of the second application while displaying the execution screen of the first application in the first partial area and displaying the widget of the second application and the first executable object in the second partial area display a third executable object for guiding a recommended function in a region and another region in the second partial region distinct from the display region of the first executable object;
while displaying the execution screen of the first application in the first partial region and displaying the third executable object together with the widget of the second application and the first executable object in the second partial region to execute the recommended function based on receiving a third user input for a third executable object;
instructions for further causing the electronic device,
The recommended functions are:
The computer-readable storage medium associated with the electronic device and identified from a model configured to predict a future execution pattern of the electronic device based on past execution heuristics comprising a past execution history of the electronic device. .
The method according to claim 19, wherein the one or more programs, when executed by the at least one processor of the electronic device,
while displaying the execution screen of the first application in the first partial region and displaying the third executable object together with the widget of the second application and the first executable object in the second partial region display, based on receiving a fourth user input for the third executable object, a fourth executable object for guiding another recommended function distinct from the recommended function;
to execute the other recommended function based on receiving a fifth user input for the fourth executable object;
instructions for further causing the electronic device,
The attribute of the fourth user input is,
a computer-readable storage medium distinct from an attribute of the third user input.
The method of claim 19, wherein the one or more programs, when executed by the at least one processor of the electronic device,
while displaying the execution screen of the first application in the first partial region and displaying the third executable object together with the widget of the second application and the first executable object in the second partial region based on receiving a fourth user input for a third executable object, maintain display of the third executable object, and superimpose on the execution screen of the first application displayed within the first partial region, the displaying a plurality of executable objects for respectively guiding a plurality of other recommended functions distinct from the recommended function within an area extending from the third executable object,
based on receiving a fifth user input for selecting (a) the third executable object and one (a) executable object of the plurality of executable objects, the executable object selected by the fifth user input to implement the recommended functions guided by
instructions for further causing the electronic device,
The attribute of the fourth user input is,
a computer-readable storage medium distinct from an attribute of the third user input.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
Dragging the widget of the second application while displaying the execution screen of the first application in the first partial area and displaying the widget of the second application and the first executable object in the second partial area Then, based on receiving a third user input dropped from the first partial region, display a reduced execution screen of the first application and a reduced execution screen of the second application in the first partial region; display the second executable object switched from the widget of the first executable object and the second application in the second partial region;
instructions for further causing the electronic device,
The attribute of the third user input is,
A computer-readable storage medium distinct from an attribute of the first user input and an attribute of the second user input.
The method of claim 22, wherein the arrangement of the reduced execution screen of the first application and the reduced execution screen of the second application displayed in the first partial area comprises:
A computer-readable storage medium determined based on a location of a widget of the second application that is dropped by the third user input.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
the first executable object and the second execution while displaying the first executable object and the second executable object in the second sub-region without displaying any execution screen in the first sub-region Receive a third user input dropping from the first partial area after dragging all possible objects,
based on receiving the third user input, execute the first application and the second application;
display the reduced execution screen of the first application and the reduced execution screen of the second application in the first partial area in response to the execution of the first application and the second application;
instructions for further causing the electronic device,
The first executable object and the second executable object displayed in the second partial region include:
A computer readable storage medium maintained independently of receipt of the third user input.
The method of claim 24, wherein the one or more programs, when executed by the at least one processor of the electronic device,
Display the reduced execution screen of the first application and the reduced execution screen of the second application in the first partial region, and display the first executable object and the second executable object in the second partial region receiving a fourth user input for moving a boundary between the reduced execution screen of the first application and the reduced execution screen of the second application displayed in the first partial region during display in a first direction based on that, expand the display area of the reduced execution screen of the first application and reduce the display area of the reduced execution screen of the second application,
Display the reduced execution screen of the first application and the reduced execution screen of the second application in the first partial region, and display the first executable object and the second executable object in the second partial region During display, for moving a boundary between the reduced execution screen of the first application and the reduced execution screen of the second application displayed in the first partial region in a second direction opposite to the first direction based on receiving the fifth user input, to reduce the display area of the reduced execution screen of the first application and expand the display area of the reduced execution screen of the second application;
A computer readable storage medium comprising instructions for further causing the electronic device.
The method of claim 25, wherein the arrangement of at least one of the plurality of visual objects in the reduced execution screen of the first application comprises:
is changed according to the expansion of the display area of the reduced execution screen of the first application caused by the fourth user input,
is changed according to the reduction of the display area of the reduced execution screen of the first application caused by the fifth user input,
The arrangement of at least one of the plurality of visual objects in the reduced execution screen of the second application comprises:
is changed according to the reduction of the display area of the reduced execution screen of the second application caused by the fourth user input,
A computer-readable storage medium that is changed according to the expansion of the display area of the reduced execution screen of the second application caused by the fifth user input.
The method of claim 24, wherein the one or more programs, when executed by the at least one processor of the electronic device,
receiving a fourth user input for the reduced execution screen of the first application while displaying the reduced execution screen of the first application and the reduced execution screen of the second application in the first partial area;
displaying the reduced execution screen of the first application and the execution screen of the first application switched from the reduced execution screen of the second application in the first partial region based on the reception of the fourth user input; , displaying a widget of the second application switched from the first executable object and the second executable object in the second partial area;
receiving a fifth user input for the reduced execution screen of the second application while displaying the reduced execution screen of the first application and the reduced execution screen of the second application in the first partial area;
displaying the reduced execution screen of the first application and the execution screen of the second application switched from the reduced execution screen of the second application in the first partial region based on the reception of the fifth user input; , to display the widget and the second executable object of the first application switched from the first executable object in the second partial area;
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 24, wherein the arrangement of the reduced execution screen of the first application and the reduced execution screen of the second application in the first partial area comprises:
A computer-readable storage medium determined based on a drag path of the third user input.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
A third executable object for displaying an execution screen of a third application in the first partial region and for instructing the first executable object, the second executable object, and the third application in the second partial region receiving a third user input for dragging both the first executable object and the second executable object and dropping from the first partial area while displaying;
based on receiving the third user input, execute the first application and the second application;
In response to the execution of the first application and the second application, the reduced execution screen of the first application and the reduced execution screen of the second application switched from the execution screen of the third application are displayed in the first partial area to display the widgets of the first executable object, the second executable object, and the third application switched from the third executable object in the second partial region,
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 29, wherein the arrangement of the reduced execution screen of the first application and the reduced execution screen of the second application switched from the execution screen of the third application in the first partial area comprises:
A computer-readable storage medium determined based on a drag path of the third user input.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
Event designated from the passenger seat of the vehicle while displaying the execution screen of the first application in the first partial area and displaying the widget of the second application and the first executable object in the second partial area to identify,
further causing the electronic device to move at least one of the widget of the second application or the first executable object in the second partial region displayed closer to the driver's seat of the vehicle than to the passenger seat of the vehicle, based on the identification including instructions to
At least one of the moved widget of the second application or the first executable object,
A computer-readable storage medium displayed in the second partial area closer to a passenger seat of the vehicle than to a driver's seat of the vehicle.
The method of claim 31 , wherein the one or more programs, when executed by the at least one processor of the electronic device,
to identify the designated event by identifying a hovering input or a gesture input over the display area while identifying that both hands are in contact with the steering wheel of the vehicle;
A computer readable storage medium comprising instructions for causing the electronic device.
The method of claim 31 , wherein the one or more programs, when executed by the at least one processor of the electronic device,
To identify the specified event by identifying at least one of a change in weight of the user sitting in the passenger seat of the vehicle or a change in tension of a seat belt worn by the user sitting in the passenger seat of the vehicle,
A computer readable storage medium comprising instructions for causing the electronic device.
The method of claim 31 , wherein the one or more programs, when executed by the at least one processor of the electronic device,
To identify the designated event by identifying the position where the user's hand entered the display area is closer to the passenger seat of the vehicle than to the driver's seat of the vehicle,
instructions for causing the electronic device,
Recognizing that the position where the user's hand entered the display area is closer to the passenger seat of the vehicle than to the driver's seat of the vehicle,
a computer-readable storage medium that is executed before the user's finger touches the display area.
The method of claim 31 , wherein the one or more programs, when executed by the at least one processor of the electronic device,
instructions to further cause the electronic device to move the at least one executable element in the execution screen of the first application in the first partial region displayed closer to the driver's seat of the vehicle than to the passenger seat of the vehicle, based on the identification including those,
The moved at least executable element comprises:
A computer-readable storage medium displayed in the first partial region closer to a passenger seat of the vehicle than to a driver seat of the vehicle.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
While displaying the execution screen of the first application in the first partial region and displaying the widget of the second application and the first executable object in the second partial region in a state in which the vehicle is moving, identify a hovering input resulting from a user's hand spaced from and positioned over the second subregion;
based on identifying the hovering input, expand the second sub-region and expand the widget of the second application and the first executable object within the second sub-region, and expand the first of the widget of the second application expand the executable element and the second executable element;
A computer readable storage medium comprising instructions for further causing the electronic device.
37. The method of claim 36, wherein the size of the first partial region is:
remains independent of the expansion of the second subregion,
A part of the extended second partial region is
A computer-readable storage medium overlapping the first partial area on which the execution screen of the first application is displayed.
The method of claim 36, wherein the one or more programs, when executed by the at least one processor of the electronic device,
based on identifying the hovering input, to reduce the first partial region and reduce the execution screen of the first application in the first partial region;
A computer readable storage medium comprising instructions for further causing the electronic device.
37. The method of claim 36, wherein the second partial region comprises:
based on identifying the hovering input, expand to a size corresponding to the speed of the vehicle being moved;
Each of the widget and the first executable object of the second application,
based on identifying the hovering input, expand to a size corresponding to the speed;
each of the first executable element and the second executable element comprises:
a computer-readable storage medium that expands to a size corresponding to the speed based on identifying the hovering input.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
While displaying the execution screen of the first application in the first partial region and displaying the widget of the second application and the first executable object in the second partial region in a state in which the vehicle is moving, identify a hovering input resulting from a user's hand spaced from the first subregion and positioned over the first subregion;
to expand at least one executable element in an execution screen of the first application displayed in the first partial region based on identifying the hovering input;
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
While displaying the execution screen of the first application in the first partial region and displaying the widget of the second application and the first executable object in the second partial region in a state in which the vehicle is moving, identify a hovering input resulting from a user's hand spaced from the display area and positioned over the display area;
Notification for guiding that the control of the execution screen of the first application and the widget of the second application through a user input is limited based on the identification of the hovering input in a state in which the speed of the moving vehicle is greater than or equal to a specified speed Displaying a message (notification message), superimposed on the execution screen of the first application,
To stop displaying the notification message based on identifying that a specified time has elapsed from the timing of displaying the notification message,
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
During the execution of the first application among the first application and the second application, an execution screen of the first application is displayed in the first partial area, and the first executable object in the second partial area; display the second executable object;
At least one communication of the electronic device while displaying the execution screen of the first application in the first partial area and displaying the first executable object and the second executable object in the second partial area receive, through circuitry, a signal distinct from functions supported by the first application and related to functions supported by the second application;
based on receiving the signal, execute the second application,
Displaying a notification about the received signal by overlapping on the execution screen of the first application displayed in the first partial area, using the executed second application,
Based on identifying that the first application is a designated application, the display of the notification is stopped in response to receiving a user input for the notification, and an execution screen of the first application is displayed in the first partial area to display the widgets of the first executable object and the second application transitioned from the second executable object within the second sub-area,
instructions for further causing the electronic device,
The widget of the second application switched from the second executable object,
A computer-readable storage medium comprising information related to the notification.
43. The method of claim 42, wherein the one or more programs, when executed by the at least one processor of the electronic device,
Based on identifying that the first application is not a designated application, in response to receiving a user input for the notification, the display of the notification is stopped, and the first application displayed in the first partial area is executed to convert a screen to an execution screen of the second application, and to convert the first executable object displayed in the second partial area into a widget of the first application;
instructions for further causing the electronic device,
The execution screen of the second application is,
A computer-readable storage medium comprising information related to the notification.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
During the execution of the first application among the first application and the second application, an execution screen of the first application is displayed in the first partial area, and the first executable object in the second partial area; display the second executable object;
At least one communication of the electronic device while displaying the execution screen of the first application in the first partial area and displaying the first executable object and the second executable object in the second partial area receive, through circuitry, a signal distinct from functions supported by the first application and related to functions supported by the second application;
based on receiving the signal, execute the second application,
Based on identifying that the first application is a designated application, in response to executing the second application, maintain displaying an execution screen of the first application in the first partial area, and wherein the second partial area converting the second executable object displayed in the widget into a widget of the second application;
Based on identifying that the first application is not the designated application, the execution screen of the first application displayed in the first partial area in response to the execution of the second application is displayed as the execution screen of the second application to convert the first executable object displayed in the second partial area into a widget of the first application,
instructions for further causing the electronic device,
Each of the widget of the second application switched from the second executable object and the execution screen of the second application switched from the execution screen of the first application,
A computer readable storage medium comprising information related to the signal.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
receiving a third user input while displaying the execution screen of the first application in the first partial region and displaying the widget of the second application and the first executable object in the second partial region;
based on receiving the third user input, converting the execution screen of the first application displayed in the first partial area into a reduced execution screen of the first application and a reduced execution screen of the second application; , converting the widget of the second application displayed in the second partial area into the second executable object,
Based on receiving a fourth user input for selecting the reduced execution screen of the first application from among the reduced execution screen of the first application and the reduced execution screen of the second application displayed in the first partial region to convert the reduced execution screen of the first application and the reduced execution screen of the second application displayed in the first partial region to the execution screen of the first application, and the second partial region displayed in the second partial region 2 convert the executable object into a widget of the second application,
Based on receiving a fifth user input for selecting the reduced execution screen of the second application from among the reduced execution screen of the first application and the reduced execution screen of the second application displayed in the first partial region to convert the reduced execution screen of the first application and the reduced execution screen of the second application displayed in the first partial region to the execution screen of the second application, and the second partial region displayed in the second partial region 1 further causing the electronic device to convert an executable object into a widget of the first application,
The attribute of the third user input is,
a computer-readable storage medium distinct from an attribute of each of the first user input and the second user input.
46. The method of claim 45, wherein the third user input is:
A computer-readable storage medium that is a hovering input spaced from and having a designated pattern resulting from a user's hand positioned over the display area.
46. The method of claim 45, wherein the third user input is:
Displaying the execution screen of the first application in the first partial area and viewing the display area for a specified time while displaying the widget of the second application and the first executable object in the second partial area It is an eye gaze input,
The eye gaze input is,
A computer-readable storage medium identified based on an image obtained via at least one camera of the electronic device or another electronic device in the vehicle operatively coupled to the electronic device.
The method of claim 47, wherein the fourth user input is:
It is an eye-gaze input for viewing the reduced execution screen of the first application among the reduced execution screen of the first application and the reduced execution screen of the second application displayed in the first partial region for a specified time,
The fifth user input is,
Computer reading which is an eye-gaze input for looking at the reduced execution screen of the second application among the reduced execution screen of the first application and the reduced execution screen of the second application displayed in the first partial area for a specified time Available storage media.
46. The method of claim 45, wherein the third user input is:
Physical included in the steering wheel in the vehicle while displaying the execution screen of the first application in the first partial region and displaying the widget of the second application and the first executable object in the second partial region input to a physical input means,
The physical input means,
A computer-readable storage medium comprising at least one of a rotatable structure or a physical button.
46. The method of claim 45, wherein the third user input is:
It is a gesture input having a specified pattern caused by a user sitting in the driver's seat of the vehicle or a user sitting in the passenger seat of the vehicle,
The gesture input having the specified pattern,
A computer-readable storage medium identified based on an image obtained via at least one camera of the electronic device or another electronic device in the vehicle operatively coupled to the electronic device.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
of the electronic device that displays an execution screen of the first application in the first partial region and displays the first executable object and the second executable object in the second partial region, and is distinguished from the electronic device receiving a third user input while displaying the reduced execution screen of the second application on another display;
Based on receiving the third user input, the execution screen of the first application displayed in the first partial area is switched to the execution screen of the second application, and the reduced screen of the second application displayed on the other display and instructions for further causing the electronic device to switch the execution screen to the reduced execution screen of the first application,
The attribute of the third user input is,
a computer-readable storage medium distinct from an attribute of each of the first user input and the second user input.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
establishing a connection between the electronic device and a first other electronic device located in the vehicle using at least one communication circuit of the electronic device;
establishing a connection between the electronic device and a second other electronic device located in the vehicle using the at least one communication circuit;
Based on data received from the first other electronic device through a connection between the electronic device and the first other electronic device, an execution screen of the first application is displayed in the first partial area, and the second part display the widgets of the first executable object and the second application in the area;
While displaying the execution screen of the first application in the first partial region based on the data and displaying the first executable object and the widget of the second application in the second partial region, the second Information on the execution screen of the first application displayed in the first partial region and the second application displayed in the second partial region to the second other electronic device through a connection between the electronic device and the electronic device send information about the widget of
Through a connection between the second other electronic device and the electronic device from the second other electronic device that has received the information on the execution screen of the first application and the information on the widget of the second application, the first portion Receive information on at least one user input for changing at least one of the state of the execution screen of the first application displayed in the region or the state of the widget of the second application displayed in the second partial region,
transmitting information on the at least one user input to the first other electronic device through a connection between the first other electronic device and the electronic device;
According to the at least one user input or the state of the execution screen of the first application changed according to the at least one user input through the connection between the first other electronic device and the electronic device from the first other electronic device Receive another data about at least one of the changed state of the widget of the second application,
to display at least one of a changed state of an execution screen of the first application or a changed state of a widget of the second application based on the other data;
A computer readable storage medium comprising instructions for further causing the electronic device.
The method of claim 52 , wherein the one or more programs, when executed by the at least one processor of the electronic device,
While the second other electronic device that has received the information on the execution screen of the first application and the information on the widget of the second application receives the at least one user input, the second electronic device 2 receiving a signal for notifying that at least one of the first application or the second application is being controlled by a user of the second other electronic device through a connection between the other electronic device and the electronic device;
Based on receiving the signal, information for notifying that at least one of the first application or the second application is being controlled by the user of the second other electronic device is displayed in the first partial area. To display as a superposition on the application's execution screen,
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
The electronic device distinguished from the display while displaying the execution screen of the first application in the first partial area and displaying the widget of the second application and the first executable object in the second partial area displaying an execution screen of the first application in the third partial region among a third partial region constituting another display of displaying the widget of the second application and the first executable object within the 4 partial area;
Based on receiving a third user input for the execution screen of the first application displayed in the third partial area, a function indicated by the third user input is executed, and within the first partial area providing a result of the execution of the function within the execution screen of the first application displayed in
based on receiving a fourth user input for the widget of the second application displayed in the fourth partial region, execute another function indicated by the fourth user input, and within the second partial region to provide a result of the execution of the other function within the widget of the second application displayed in
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
spaced apart from the first partial area while displaying the execution screen of the first application in the first partial area and displaying the widget of the second application and the first executable object in the second partial area Based on identifying that the first hovering input caused by the user's hand positioned over the first partial region is maintained for a specified time, at least one executable element in the execution screen of the first application is moved to the first hovering input move to the received area,
spaced apart from the second partial area while displaying the execution screen of the first application in the first partial area and displaying the widget of the second application and the first executable object in the second partial area based on identifying that the second hovering input caused by the user's hand positioned over the second partial area is maintained for a specified time, move the widget of the second application to the area where the second hovering input is received;
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
spaced apart from the first partial area while displaying the execution screen of the first application in the first partial area and displaying the widget of the second application and the first executable object in the second partial area Based on identifying that the first hovering input caused by the user's hand positioned over the first partial region is maintained for a specified time, within the execution screen of the first application positioned within the region that received the first hovering input magnify at least one viable element,
Display area of the widget of the second application while displaying the execution screen of the first application in the first partial area and displaying the widget of the second application and the first executable object in the second partial area to enlarge the widget of the second application based on identifying that a second hovering input caused by the user's hand spaced from and positioned over the display area of the widget of the second application is maintained for a specified time,
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 1, wherein the one or more programs, when executed by the at least one processor of the electronic device,
while displaying the execution screen of the first application in the first partial area, monitoring whether an eye gaze input for looking at the display area for a specified time is received;
Based on monitoring that the eye gaze input is not received, event information is displayed in the execution screen of the first application using a specified timing or a specified period,
Based on monitoring that the eye gaze input is received, the event information is displayed in the execution screen of the first application using another specified timing distinct from the specified timing or another specified period different from the specified period so,
A computer readable storage medium comprising instructions for further causing the electronic device.
The method according to claim 1, The first application,
It is an application for providing a navigation service,
When the one or more programs are executed by the at least one processor of the electronic device,
receiving a user input for setting a destination while displaying the execution screen of the first application in the first partial area;
Identifies whether the destination set by the user input is a destination initially set in the electronic device,
Based on identifying that the destination is not a destination initially set in the electronic device, event information is displayed in the execution screen of the first application using a specified timing or a specified period,
On the basis of identifying that the destination is a destination initially set in the electronic device, the first application execution screen is displayed using another specified timing distinct from the specified timing or another specified period different from the specified period. to display event information,
A computer readable storage medium comprising instructions for further causing the electronic device.

Images