KR20210022027A - Operating Method For Multi-Window And Electronic Device supporting the same - Google Patents

Abstract

The present invention includes an electronic device and a multi-window operation method thereof. The electronic device comprises: a display module outputting a plurality of windows according to function execution; and a control module controlling to change at least one of the display form and display type of other windows or to output a window with a new function when at least one of the display form and display type of specific window is changed in response to the occurrence of an event.

Description

Operating Method For Multi-Window And Electronic Device supporting the same}

Various embodiments of the present invention relate to multi-window operation of an electronic device.

With the recent development of digital technology, various electronic devices capable of communicating and processing personal information while moving, such as mobile communication terminals, personal digital assistants (PDAs), electronic notebooks, smart phones, and tablet PCs (Personal Computers), have been released. These electronic devices are reaching a stage of mobile convergence that covers the areas of other terminals instead of staying in their respective traditional unique areas.

Typically, electronic devices include calling functions such as voice and video calls, SMS (Short Message Service)/MMS (Multimedia Message Service), and message transmission/reception functions such as e-mail, electronic notebook functions, shooting functions, broadcast playback functions, and video playback. A function, a music playback function, an Internet function, a messenger function, and a social networking service (SNS) function may be provided.

Meanwhile, the electronic device provides a screen corresponding to the function execution in the form of a window. In addition, the electronic device may display each window in response to performing a plurality of functions.

However, conventional electronic devices are designed to output a plurality of windows to a predefined arbitrary position of the display unit. Accordingly, in an environment in which a user operates a plurality of windows, it is inconvenient to adjust the size and position of each window in order to check appropriate information.

Accordingly, various embodiments of the present invention provide a multi-window operating method that supports simpler window use by minimizing window adjustment by a user by adaptively controlling a display method of a plurality of windows, and an electronic device supporting the same. .

One of the various embodiments of the present invention for solving the above problems is a display module that outputs a plurality of windows according to execution of a function, and a display form of at least one specific window among the plurality of windows in response to an event occurrence. And a control module configured to change a display type of at least one other window among the plurality of windows or to additionally output a window of a new function when at least one of the display types is changed, wherein the control module changes the display type A configuration of an electronic device that controls to output a window according to execution of another program having the same or similar function as the function of the previous window is disclosed.

The present invention also provides a change operation of changing the display type of the first function-related window when the execution of the second function is requested while the first function-related window is being displayed, the window in which the display type is changed, and the execution of the second function. Disclosed is a configuration of a multi-window operating method including an output operation of outputting a window according to the present invention. The present invention also discloses an operation of outputting a plurality of windows according to execution of a function, and a first function among the plurality of windows in response to an event An operation in which at least one of the change in the display type of the related window and the change in the window display type according to the execution of another program having the same or similar function as the first function, and a second function among a plurality of windows in response to the change of the window related to the first function Disclosed is a configuration of a multi-window operating method including an output operation of changing a window display type according to execution of another program having the same or similar function as the second function or outputting a new third function related window.

The above-described content is a rather broad summary of the features and technical advantages of the various embodiments in order to allow those of ordinary skill in the art to better understand from the detailed description of the various embodiments of the present invention to be described later. In addition to these features and advantages, additional features and advantages of various embodiments that form the subject of the claims of the present invention will be well understood from the detailed description that follows.

As described above, according to the multi-window operation method and the electronic device supporting the multi-window operation method proposed in the various embodiments of the present invention, various embodiments of the present invention support to enable proper function operation while minimizing multi-window operation.

1 is a diagram illustrating a configuration of an electronic device applied to various embodiments of the present invention.
2 is a diagram showing the configuration of a control module described in various embodiments of the present invention.
3 is a diagram illustrating a method of operating a multi-window of an electronic device according to an embodiment of the present invention.
4 is a diagram illustrating an example of a screen interface for changing a display type of another window while operating a multi-window according to an embodiment of the present invention.
FIG. 5 is a diagram illustrating another example of a screen interface for changing a display type of another window among a method of operating a multi-window according to an embodiment of the present invention.
6 is a view for explaining another example of a screen interface for changing a display type of another window among a method of operating a multi-window according to an embodiment of the present invention.
7 is a diagram illustrating a method of operating a multi-window of an electronic device according to another embodiment of the present invention.
8 is a diagram for explaining an example of a screen interface for changing a display type of a designated window during multi-window operation according to an embodiment of the present invention.
9 is a view for explaining another example of a screen interface for changing a designated window display type during multi-window operation according to an embodiment of the present invention.
10 is a diagram illustrating a method of operating a multi-window of an electronic device according to another embodiment of the present invention.
11 is a diagram illustrating an example of a screen interface for outputting a new window during multi-window operation according to an embodiment of the present invention.
12 is a diagram illustrating examples of a screen interface related to multi-window operation that can be applied to various embodiments of the present invention.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this case, it should be noted that the same components in the accompanying drawings are indicated by the same reference numerals as possible. In addition, detailed descriptions of known functions and configurations that may obscure the subject matter of the present invention will be omitted. That is, in the following description, it should be noted that only parts necessary to understand operations according to various embodiments of the present invention will be described, and descriptions of other parts will be omitted so as not to obscure the gist of the present invention.

In the following description, an electronic device is an application processor (AP), a graphical processing unit (GPU), and a central CPU (CPU), such as all information and communication devices, multimedia devices, and application devices supporting the functions described in various embodiments of the present invention. Processing Unit). For example, the electronic device includes a mobile communication terminal that operates based on communication protocols corresponding to various communication systems, a tablet PC (Personal Computer), a smart phone, and Devices such as a digital camera, a portable multimedia player (PMP), a media player, a portable game terminal, and a personal digital assistant (PDA) may be included.

In addition, in the following description, the window may be a predetermined area in which information according to execution of a function of the electronic device is output. Here, the information may include various screen elements related to function execution. For example, the information may include at least one of various items such as text, still or moving images, icons, virtual key buttons, slide bars, progress bars, list items, and thumbnail items. According to an embodiment, the window may be output in the form of a new layer on the background screen. The multi-window can be configured by dividing the upper layer area of the background screen and outputting a plurality of windows on the divided layer area. Alternatively, a multi-window may be configured by pushing up a partial area of a single window or resizing it to a certain size while outputting a single window, and outputting another window in response thereto.

According to another embodiment, the window may be formed by updating a certain area of the background screen to display new information. For example, the electronic device may configure a window by removing information displayed on some areas of the background screen and displaying information according to execution of a specific function in the corresponding area, or overwriting information according to execution of a function in some areas. The multi-window can be configured by dividing the background screen into a plurality of areas, and displaying or overwriting information according to execution of a plurality of functions in the divided areas.

As described above, the method of operating a multi-window described in various embodiments of the present invention and an electronic device supporting the same indicate a region displaying information as a window according to execution of a specific function in the electronic device. It is not limited to the name of “window”. Accordingly, the window may be understood in various terms such as an information display area according to function execution, an information display layer, a pop-up, a player, and a screen.

1 is a diagram illustrating a configuration of an electronic device applied to various embodiments of the present invention.

Referring to FIG. 1, the electronic device 100 includes a communication module 110, an input module 120, an audio processing module 130, a display module 140, a storage module 150, and a control module 160. can do.

The electronic device 100 having such a configuration may automatically change at least one of a display type and a display type of another window when at least one of a display type and a display type for a specific window is changed in a multi-window output environment. According to various embodiments, when a preset event occurs, the electronic device 100 may change a display type of a specific window designated by the event. Also, according to various embodiments, when at least one of a display type and a display type for a specific window is changed, the electronic device 100 may automatically output a new window of a function related to the corresponding window. In this case, the electronic device 100 may adjust the shape and type of the new window in response to the change of the specific window. Through the above-described window display control, the electronic device 100 allows a plurality of windows to mutually adaptively change at least one of the display form and type, thereby making it easier and easier to check and operate information included in the window. Support.

According to various embodiments of the present disclosure, the above-described display type change may include changing at least one of a size, shape, and information arrangement within a window, and an information display size within a window. The display type corresponds to a window type, and may include various types for each program execution such as an app execution type and a widget execution type. These display types differ in the template structure constituting the window for each program type, such as the size of the area constituting the window, the arrangement of a plurality of areas, the number of areas, the type and number of virtual key buttons included in at least one area, etc. It can be defined differently for each program according to the execution of this function.

The communication module 110 may include at least one communication unit related to a communication function of the electronic device 100. For example, the communication module 110 may include various communication units such as a mobile communication unit, a broadcast receiving unit, and a short-range communication unit. In response to operation of the communication module 110, the electronic device 100 may output a specific window to the display module 140. For example, the electronic device 100 may output a window related to a call function related to support of the voice call function of the communication module 110 to the display module 140. According to various embodiments, the electronic device 100 may output a web browser window related to support of the web access function of the communication module 110 to the display module 140. According to various embodiments, the electronic device 100 may output a broadcast screen window related to a broadcast reception function of the communication module 110 to the display module 140. According to various embodiments, the electronic device 100 may output an image screen window according to reception of streaming data from the communication module 110 to the display module 140. According to various embodiments, the electronic device 100 may output a screen window according to the formation of a short-range communication channel of the communication module 110 to the display module 140.

When the above-described functions based on the communication module 110 are performed in combination, the electronic device 100 may output a plurality of windows to the display module 140. When a plurality of windows are output based on the communication module 110, the electronic device 100 may adjust the size and position of windows corresponding to each function. For example, when an output of a new window is requested while one window is displayed in full screen, the electronic device 100 may adjust the display type or display type of the previous window. According to various embodiments, the electronic device 100 may adjust the display type or display type of a new window according to the number of previous windows being output to the display module 140 or the display type or type of windows.

The input module 120 may generate an input signal of the electronic device 100. The input module 120 may include, for example, at least one of a key pad, a dome switch, a touch pad (positive pressure/static power), a jog wheel, and a jog switch. I can. The input module 120 may be implemented in the form of a button outside the electronic device 100, and some buttons may be implemented as a touch panel. According to an embodiment, the input module 120 may include a plurality of keys for receiving numeric or character information and setting various functions. These keys may include a menu call key, a screen on/off key, a power on/off key and a volume control key, a home key, and the like.

The input module 120 includes an input signal for requesting activation of at least one function, an input signal for adjusting at least one window display type or display form in a state in which a multi-window is output to the display module 140, and the display module 140 You can create an input signal that requests multi-window output. The input signal related to the multi-window output request may be generated by selecting a specific menu item or icon designed to simultaneously execute a plurality of functions. Alternatively, the input signal related to the multi-window output request may be an input signal for requesting to additionally execute a specific function while a specific window is output. The input module 120 may generate an input signal for setting an app of a specific function to be associated with an app or widget of another function. In addition, the input module 120 may generate an input signal for setting a widget of a specific function to be associated with an app or widget of another function.

The audio processing module 130 may process an audio signal of the electronic device 100. For example, the audio processing module 130 may transmit an audio signal received from the control module 160 to a speaker (SPK). The audio processing module 130 may perform a function of transmitting an audio signal such as a voice received from a microphone (MIC) to the control module 160. The audio processing module 130 may convert an audio signal such as voice received from the microphone into a digital signal and transmit it to the control module 160. According to an embodiment, the audio processing module 130 may output audio data related to a specific window in an environment in which a multi-window is output. Here, the audio processing module 130 may output audio data of a specific window designated among the multi-windows. When the window designation is changed to another window, the audio processing module 130 may output audio data related to the changed window.

According to various embodiments, when a display type or display type of a specific window is changed in a multi-window output environment, the audio processing module 130 may output a guide sound or sound effect corresponding thereto. Also, when a new window is output in a multi-window output environment, the audio processing module 130 may output audio data related to the newly output window. Alternatively, the audio processing module 130 may output audio data related to a window whose display type or display type has been changed. The audio data output method for a plurality of windows being output to the display module 140 may be adjusted according to a designer method or user setting, or audio data output may be omitted.

The display module 140 displays (outputs) at least one of various windows corresponding to functions processed by the electronic device 100. For example, when the electronic device 100 is in a call mode, a user interface (UI) or graphic user interface (GUI) related to a call is displayed in a window form. In addition, when the electronic device 100 is in a video call mode or a photographing mode, the display module 140 displays a photographed or/and received image, a UI, or a GUI in the form of a window. According to an embodiment, the display module 140 displays app windows for various functions (or applications) executed in the electronic device 100. In addition, the display module 140 activates and displays a virtual input device (eg, a virtual touch pad) under the control of the control module 160 in the app window, and transmits a signal input through the virtual input device to the control module ( 160). In addition, the display module 140 may output a widget window according to the execution of the widget. In the present invention, the widget window will be described as a screen element output to the display module 140 in response to execution of the widget program stored in the storage module 150. In addition, in the present invention, the app window will be described as a screen element that is output to the display module 140 in response to execution of the app program stored in the storage module 150.

According to an embodiment, the display module 140 may output a plurality of app windows corresponding to at least one function. The app window may be a screen element corresponding to activation of a program prepared in connection with supporting a specific function. For example, the app window may be a window related to a call function according to execution of a call function. The app window may be a window related to a memo function according to execution of the memo function. The app window may be a video related window according to video playback.

According to various embodiments, the display type or display type of the app window may be changed in response to an input event. For example, the app window may be a web browser window. When a specific video playback is requested from the web browser window, the display module 140 may remove the web browser window and output an app window according to the execution of the video player. That is, the display module 140 may output an app window corresponding to another app having the same or similar function. The display module 140 may output app windows in a toggle manner. For example, a first web browser-related app window and a video playback-related second app window may be alternately output to the display module 140 according to an input event. According to an embodiment, when a second app window removal event occurs in response to a video playback end, the display module 140 may output a web browser-related first app window.

According to various embodiments, the display module 140 may output at least one widget window. The display module 140 may output at least one widget window according to an execution setting or an input event. The display module 140 may adjust the size of the widget window according to an input event. According to various embodiments, the display module 140 may output at least one app window and at least one widget window. For example, the display module 140 may output an app window corresponding to a memo function and a widget window corresponding to a music playback function. The display module 140 may adjust at least one of the size and arrangement of the app window and the widget window according to the control of the control module 160.

According to various embodiments, the display module 140 may output another window in which the display type or display type is adjusted in response to a change in the display type or display type of the window being displayed. For example, when the app window of the first function and the app window of the second function are displayed and the app window of the first function is changed to the widget window of the first function, the display form or display type of the app window of the second function Can be adjusted. According to an embodiment, the display module 140 may expand the size of the app window of the second function or may arrange and output more information in the app window. According to various embodiments, the display module 140 may change the app window of the second function to the widget window of the second function and output the change according to the control of the control module 160.

In the above description, it may be a specific function supported by the electronic device 100 having the first function and the second function. For example, the first function and the second function may be various functions such as a camera-related function, a memo function, a document editing function, a search function, a video playback function, and a chatting function. In addition, the app window and the widget window may have different window structures. According to an embodiment, the chat app window and the chat widget window are implemented by different program operations, and each window may have a different information arrangement structure. Alternatively, the chat app window and the chat widget window are implemented by a single program operation capable of supporting app and widget functions, but the types of windows output to the display module 140 may have different information arrangement structures.

When the display type or display type of the window related to the first function is changed in the multi-window environment, the display module 140 may output a window related to the new third function according to the control of the control module 160. The new third function related window may be a window according to execution of an app or widget related to the first function. Alternatively, the third function related window may be a window according to execution of an app or widget related to the second function. The third function may be designed to be associated with the first function or the second function, may be designated by user settings, or may be defined by a user history.

According to various embodiments, the display module 140 may display a plurality of windows, such as two windows, to fill the entire screen. For example, the display module 140 may display a plurality of windows on the entire screen in a full screen form. In this operation, the display module 140 may divide areas of the entire screen and arrange a plurality of windows in each area. Alternatively, the display module 140 may arrange a plurality of windows in areas of the entire screen, and display a part of the background area or at least a part of the background screen in some areas. When windows are arranged for each divided area, and when a display type or display type of a specific window is changed, the display module 140 changes the display type or display type of other windows according to the control of the control module 160 so that the entire screen is displayed. You can keep it displayed as windows. Alternatively, the display module 140 may output a window related to a new function in the remaining area or the remaining area according to the change of the display type or display type of the window according to the control of the control module 160. Correspondingly, the display module 140 may have a full screen state in which the entire screen is composed of a plurality of function related windows. Alternatively, the display module 140 may display a background area or some background screens in the remaining area. As described above, the control module 160 may adjust the size of the windows so that the entire screen is filled with a plurality of windows even if the size of at least one of the plurality of windows is changed, and the control module 140 A background area or at least a part of a background screen may be displayed according to a change in the size of at least one of the windows.

According to various embodiments, the display module 140 may display a plurality of windows in a layered manner (a form in which layers corresponding to windows are stacked). For example, the display module 140 may output a first function related window on the entire screen, and may output a second function related window smaller than the size of the first function related window on the first function related window. In addition, the display module 140 may have a full-screen state in which a plurality of windows are arranged on the entire screen even if the size of the corresponding windows is adjusted according to the display type or display type adjustment of the first function related window or the second function related window. have.

The display module 140 may support a screen display in a landscape mode, a screen display in a portrait mode, and a screen change display according to a change between a landscape mode and a portrait mode according to the rotation direction (or placement direction) of the electronic device 100. have. When a horizontal mode or a vertical mode change occurs in a multi-window environment, the display module 140 may change the arrangement form or display form of windows in response thereto. In addition, when the display type or display type of a specific window is changed in a multi-window environment, the display module 140 can automatically change output from landscape mode to portrait mode or portrait mode to landscape mode according to the control of the control module 160. have.

The display module 140 includes a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), a light emitting diode (LED), and an organic light emitting diode (OLED, Organic LED). , Active Matrix OLED (AMOLED), a flexible display, a bent display, and a 3D display. Some of these displays may be implemented as a transparent display configured as a transparent type or a light transparent type so that the outside can be seen.

In addition, the display module 140 may be provided as a touchscreen including a touch panel and used as an input device in addition to an output device. The touch panel may be configured to convert a change in pressure applied to a specific portion of the display module 140 or a capacitance generated in a specific portion of the display module 140 into an electrical input signal. The touch panel may be configured to detect not only a touched position and area, but also a pressure when touched. Meanwhile, as mentioned above, the display module 140 of the present invention includes a touch panel and a display panel. The touch panel may be placed on the display unit. The touch panel may be implemented as an add-on type positioned on the display panel, an on-cell type inserted into the display panel, or an in-cell type. The touch panel transmits a user input in response to a user's gesture to the display module 140 to the control module 160. Here, user input generated by a touch means such as a finger or a touch pen is touch, multi-touch, tap, double tap, long tap, tap & touch, drag ), flick, press, pinch in, pinch out, and the like. The above-described user input is defined and used as an input signal for requesting multi-window output, an input signal related to a request to change the display type or display type of a specific window in the multi-window output state, and an input signal for requesting display removal of a specific window. I can.

The storage module 150 may store a program for processing and controlling the control module 160, an app 151, a widget 153, and the like.

The app 151 may include program routines that support various functions supported by the electronic device 100. For example, the app 151 includes an app supporting a music playback function, an app supporting a video playback function, a file editing function app, a camera function app, a chat function app, a game function app, an alarm app, a web browser app, a gallery app, It can include a variety of apps, such as a calculator app, a voice search app, a map app, and a weather app. The app 151 may be activated in response to an execution request and may output a screen corresponding thereto to the display module 140 in the form of a window.

The widget 153 may include widget routines that support various functions supported by the electronic device 100. For example, the widget 153 may include various widgets such as a weather widget, an alarm widget, a chat widget, a message widget, a memo widget, and a music playback widget. The widget 153 may be composed of specific program routines or may be composed of some routines of the app 151 above. The widget 153 may be provided to output an information arrangement or structure window with the app window according to the execution of the app 151.

The app 151 and the widget 153 may be provided as a menu item, or may be provided as an icon on a standby screen or a menu screen. Here, the icon may have a certain size or may have various sizes according to the design shape.

The storage module 150 may store information on a related function linked to a specific function. The linking function may be a function that can be executed according to a display type or display type change of at least one window in a multi-window environment. The storage module 150 may store a list of programs related to a specific function. For example, the storage module 150 may store a list of app programs, widget programs, and pop-up programs related to a memo function. The control module 160 may change a window related to a specific function to a window according to execution of another program having the same function or similar function based on the related program list. Alternatively, related program information may be included in each program and stored. For example, the memo app program may include information for calling a memo widget program as a related program.

The storage module 150 described above is a flash memory type, a hard disk type, a micro type, and a card type (e.g., an SD card (Secure Digital Card) or an XD card ( eXtream Digital Card)), RAM (Random Access Memory), SRAM (Static RAM), ROM (Read-Only Memory), PROM (Programmable ROM), EEPROM (Electrically Erasable PROM), magnetic memory It may include at least one type of storage medium among (MRAM, Magnetic RAM), magnetic disk, and optical disk type memory. The electronic device 100 may operate in connection with a web storage that performs a storage function of the storage module 150 on the Internet.

The control module 160 may support outputting a standby screen or a menu screen related to at least one app 151 and widget 153 stored in the storage module 150. The control module 160 may output at least one window in response to selection of at least one specific function on a standby screen or a menu screen. For example, the control module 160 may output an app window in response to selection of the app 151. The control module 160 may output a widget window in response to a request for executing a specific widget 153. The control module 160 may support a multi-window environment, such as a plurality of app window output environments, a plurality of widget window output environments, at least one app window, and at least one widget window output environment.

According to an embodiment, the control module 160 may change the display type or display type of another window when the display type or display type of a specific window is changed in a multi-window environment in response to the occurrence of an input event. The control module 160 may transmit execution information, for example, activity when switching windows having different display types. Here, the execution information may be information related to a function running in a specific app. For example, the execution information may include information on the type and playback time of a specific sound source, and channel information of a specific broadcast. The execution information may include text or image information written in execution of a specific app, execution page or execution location information of a specific app, web access information of a specific app, and the like. The control module 160 may support the converted window to maintain the same function as the previous window even if a window switching of a different display type occurs based on execution information delivery. For example, the control module 160 controls to maintain the same function by transmitting execution information when switching between app windows, switching between widget windows, switching between app windows and widget windows, or switching between widget windows and between app windows. I can.

According to various embodiments, the control module 160 may output a window for a new function when a display type or display type of a specific window is changed in a multi-window environment. The control module 160 may include a configuration as shown in FIG. 2 in connection with supporting multi-window operation of the present invention.

Meanwhile, in the description of the present invention, it is described that the window shape is different based on an app and a widget in relation to a specific function, but various embodiments of the present invention are not limited thereto. That is, in the present invention, examples of apps and widgets are presented to explain that the display type is changed as the information arrangement structure of the window is changed. As a result, even if the app is the same, different developers or developers may have app windows of different display types that support the same function if they are produced by different developers or developers. Likewise, even if the widget is the same, it may have a widget window of a different display type that supports the same function according to the developer intention or policy. In the multi-window operation function of the present invention, a plurality of multi-windows are associated with each other in response to an input signal, and a display form or a display type is changed to have an optimal display state.

Meanwhile, various embodiments described in the present invention may be implemented in a recording medium that can be read by a computer or a similar device using software, hardware, or a combination thereof. According to the hardware implementation, the embodiments described in the present invention are ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays). ), processor (processors), controllers (controllers), micro-controllers (micro-controllers), microprocessors (microprocessors), may be implemented using at least one of the electrical unit (unit) for performing other functions. In some cases, the embodiments described herein may be implemented by the control module 160 itself. According to software implementation, embodiments such as procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

2 is a diagram showing a configuration of a control module described in various embodiments of the present invention.

Referring to FIG. 2, the control module 160 of the present invention may include an event collection module 161, a function processing module 163, and an output processing module 165.

The event collection module 161 may collect an event occurring in the electronic device 100. For example, the event collection module 161 may collect an input signal generated from the input module 120 as an event. The event collection module 161 may control power supply of the touch panel in connection with supporting the input function of the display module 140. The event collection module 161 may collect touch events that occur in the display module 140 of an input function. When the electronic device 100 supports a voice recognition and command function, the event collection module 161 may activate a microphone and collect a voice recognition event in response thereto. When the electronic device 100 provides various sensors, the event collection module 161 may collect sensor information corresponding to a gesture as an event. For example, the event collection module 161 may collect at least one sensing information generated from at least one sensor, such as acceleration sensing information, geomagnetic sensing information, contact or pressure sensing information, as an event. The events collected by the event collection module 161 may be provided to the function processing module 163.

The function processing module 163 may be a module supporting each function processing. The function processing module 163 may allocate a processing module related to a specific function according to an event provided by the event collection module 161. For example, the function processing module 163 may allocate the first function processing module 61 when receiving an event requesting execution of the first function from the event collection module 161. In addition, the function processing module 163 may allocate the second function processing module 62 when receiving an event requesting execution of the second function from the event collection module 161 while the first function is being executed. The function processing module 163 may transmit a specific event transmitted from the event collection module 161 to the first function processing module 61 or the second function processing module 62.

According to various embodiments, the function processing module 163 may allocate an additional processing module when an additional function execution is requested while the first function and the second function are being executed. As described above, the operation of the function processing module 163 of the present invention is not limited to the number of functions, and additional function processing modules may be further allocated if necessary.

According to various embodiments, the function processing module 163 may automatically allocate a processing module related to execution of a third function in response to a change in a display type or a display type. The function processing module 163 may perform allocation of a processing module related to execution of a predefined third function when a change in a window display format or display type related to a first function or a second function is requested, for example.

The first function processing module 61 may process data related to the first function requested to be executed. For example, the first function processing module 61 may support processing any one of various functions supported by the electronic device 100, such as a music reproduction function, a broadcast reception function, a web access function, and a file editing function. In this case, the first function processing module 61 may control playback of a specific music file designated by a transmitted event. The first function processing module 61 may transmit various data related to supporting the first function, such as window data and audio data related to the first function, to the output processing module 165. The first function-related window data may include various data output to the display module 140 in relation to the first function during execution of the first function. According to an embodiment, the first function processing module 61 may activate an app related to the first function and transmit app window data according to the activation of the app to the output processing module 165.

According to various embodiments, the first function processing module 61 may request the output processing module 165 to change the display type or display type of the app window in response to a transmitted event. For example, the first function processing module 61 may transmit widget window data related to the first function to the output processing module 165 in response to a transmitted event. In this operation, the first function processing module 61 may request the output processing module 165 to delete an app window previously being output to the display module 140.

According to various embodiments, the first function processing module 61 transmits widget window data related to the first function to the output processing module 165, and then outputs the app window data of the first function in response to an event. Can be passed on to (165). Here, the first function processing module 61 may request the output processing module 165 to delete the widget window previously being output from the display module 140.

According to various embodiments, the first function processing module 61 transmits widget window data or app window data related to the first function to the output processing module 165, and then, in response to an event, another app window of the first function. Data may be delivered to the output processing module 165. As mentioned above, the other app window of the first function supports the same function, such as a music playback function, but the executed program may be a window of another app. For another example, the music playback function may be executed by various apps such as a web browser app, a music playback app, and a video playback app. Each of the apps may have a different app window shape according to a design type of a corresponding program or a user setting. In addition, the music playback function may be executed by at least one of a plurality of music playback apps produced by different developers or developers. Here, the plurality of music playback apps may have different window shapes according to a design method or user setting.

The second function processing module 62 may process data related to a second function different from the first function. For example, the second function processing module 62 may support memo function processing. The second function processing module 62 may transmit screen window data related to support of the memo function to the output processing module 165. The second function processing module 62 may request the output processing module 165 to adjust a window display type or a display type of a corresponding function in response to an event transmitted from the event collection module 161.

The output processing module 165 may output a specific window to the display module 140 based on data transmitted from at least one of the first function processing module 61 and the second function processing module 62. For example, the output processing module 165 may receive window data related to the first function from the first function processing module 61. The output processing module 165 outputs the window related to the first function in the full screen of the display module 140 or in a user-set size when there is no output of a separate function related window in the display module 140. Or, you can print it in the default size. The output processing module 165 performs screen division or division of the display module 140 when output of a plurality of windows, such as a first function related window and a second function related window, is requested, and divides the divided screen areas. Each window can be displayed in. In this case, the screen division may be performed in an even or non-uniform form. Alternatively, the output processing module 165 may output the first function related window as a full screen, and the second function related window may be overlaid on the first function related window and output. In this case, the output processing module 165 may output the second function related window to cover a partial area of the first function related window. The first function related window and the second function related window may be output to occupy the entire area of the display module 140.

According to an embodiment, the output processing module 165 may output a first function-related window that is temporally executed earlier than a second function-related window that is temporally executed later. According to various embodiments, the output processing module 165 outputs a function having a relatively high execution frequency in a multi-window environment or a function window set to have a higher priority than other functions in a multi-window environment. can do. According to various embodiments, the output processing module 165 may control the corresponding function related windows to be output in the same size for concurrently executing functions.

The output processing module 165 changes the display type or display type of the corresponding window in response to a request to change the display type or display type of a specific window in a multi-window environment, and also changes the display type or display type of another window. I can. According to an embodiment, the function processing module 163 may support execution of a new third function in response to a change in a display type or display format of a window related to a first function or a window related to a second function. The output processing module 165 may receive window data related to a third function from a processing module related to processing a new third function. The output processing module 165 may output a third function related window to the display module 140 based on the received third function related window data. In this case, the output processing module 165 may output a third function related window in a predetermined area provided in response to a change in a display type or a display type.

As described above, the electronic device 100 according to various embodiments of the present disclosure includes the display module 140 outputting a plurality of windows according to execution of a function, and at least one specific window among a plurality of windows in response to an event occurrence. When at least one of the display type and the display type is changed, a control module 160 for controlling to change at least one of the display type and display type of at least one other window among the plurality of windows or to output a window of a new function may be included. I can. Here, when the display type is changed, the control module 160 may control to output a window according to execution of another program having the same or similar function as the function of the previous window.

Multi-window operation according to the present invention may be to describe an operation according to operation of a control module of a specific electronic device. That is, while the control module of the electronic device is outputting the first function related window to the display module, when another function execution is requested, data processing is performed to output the second function execution window together with the display type change of the first function related window. Can be controlled. In addition, multi-window operation may be an operation for describing operation of a display module of an electronic device. That is, while the display module is outputting the first function-related window, the second function-related window is output in response to data processing, but the change window in which the display type of the first function-related window is changed is displayed together with the second function-related window. Can be printed.

In addition, the above-described'output' may be understood as a form of displaying data of the display module as well as a situation in which data is transmitted to the display module to the control module. For example, embodiments of the present invention can be applied to a form in which the control module and the display module are provided in a physically separated space. In this case, the control module may output the window change of the multi-window to the external display device, and the display device may display window-related data received from the electronic device. Application of this embodiment may be performed between, for example, an electronic device in the form of a smart watch and an electronic device such as a smart pad or a smart phone. Therefore, the multi-window operation of the present invention not only adjusts the window through data processing between the control module and the display module disposed in one device, but also an external accessory that is separately separated and receives data from the control module according to at least one method of wired or wireless. The same could be applied to window adjustment on the device.

According to various embodiments, the display module 140 arranges the plurality of windows on the divided full screen to display a full screen composed of the plurality of windows, or arranges the plurality of windows so that they do not overlap, and at least partially You can display a background area or some background screen area.

When the size change of the specific window is more than a certain size, the control module 160 controls to output a window according to execution of another program having the same or similar function as another window-related function, or change the size of the specific window or other window If it is larger than a certain size, it can be controlled to display a window of a new function.

According to various embodiments of the present disclosure, the electronic device 100 may further include a storage module that stores association information having the specific window-related function or other function information related to the other window-related function.

According to various embodiments, the control module 160 executes the specific window-related function or a function pre-linked with the other window-related function based on the association information, and outputs a window of a new function according to the execution of the function. Can be controlled to do.

According to various embodiments, the control module 160 changes a specific window to a window of a preset size in response to the occurrence of the event, and controls to output a window of a new function according to the size of the remaining area generated according to the change. I can.

According to various embodiments, the control module 160 may execute a program of a new function having a different display type based on the association information according to the size of the remaining area.

According to various embodiments, the control module 160 may adjust the size of another window whose display type is changed in response to an event occurrence.

According to various embodiments, the control module 160 may change the display type of a specific window whose display type is changed or another window whose display type is changed in response to an event occurrence.

3 is a diagram illustrating a method of operating a multi-window of an electronic device according to an embodiment of the present invention.

Referring to FIG. 3, in the method of operating a multi-window of the present invention, first in operation 301, the control module 160 may perform a function operation or a function standby. In this operation, the control module 160 may output a standby screen to the display module 140 or a predefined menu screen to the display module 140. Alternatively, the control module 160 may output a window corresponding to execution of a specific function to the display module 140 in response to a user input. The multi-window application may be selectively performed in response to the menu item selecting an icon. If multi-window operation is not applied, a window related to a specific function requested or selected for execution may be displayed on the entire display module 140 on a full screen. When the multi-window operation is applied, a plurality of windows are arranged in certain areas of the screen of the display module 140 to be output in a full screen format that fills the entire display module 140, or at least partially to display a background area or background screen. Can be output as Schedule information may be displayed on some background areas or background screens.

In operation 303, for example, the control module 160 may check whether there is an event or setting for applying a multi-window. The electronic device 100 may provide an icon or menu item related to a multi-window application setting. Alternatively, the electronic device 100 may be designed to apply a multi-window function as a default. Alternatively, the electronic device 100 may be designed to apply a multi-window function as a default when a specific function is executed. For example, when a video playback function or a call function is executed, the electronic device 100 may apply a multi-window by default. If there is no setting for applying the multi-window or an event occurs in operation 303, the control module 160 may branch to operation 305 and support execution of a specific function based on a single window output. When setting a single window output, the control module 160 may output a window related to an executed function or a designated function on the entire screen of the display module 140. Correspondingly, a window related to another function being executed or loaded may be entirely covered by a window currently output on the front of the display module 140.

If there is a multi-window application event or setting in operation 303, in operation 307, the control module 160 may check whether a multi-function processing situation is present. In this operation, the control module 160 may check whether a situation in which a multi-window is to be outputted according to execution of a plurality of functions. When a single function is being executed in operation 307, the control module 160 may support single window output as in operation 305.

In operation 307, in a multi-function processing situation, the control module 160 may execute a plurality of window outputs in operation 309. For example, the control module 160 may output a window related to a first function and a window related to a second function in response to a function requested to be executed. The control module 160 may output the first function related window and the second function related window to have a predetermined area on the display module 140. In this operation, the control module 160 may collect preset size information related to the first function related window output and preset size information related to the second function related window output. The control module 160 may output the first function related window and the second function related window to the entire display module 140 at a predetermined ratio according to the collected size information.

According to various embodiments, the control module 160 may check window size information related to the first function to be output in a multi-window environment and output the information to the display module 140 in the corresponding size. The control module 160 may output the second function related window to fit the remaining area after the first function related window is output.

According to various embodiments, the control module 160 may collect size information of a second function related window to be applied in a multi-window environment when a second function related window output is requested while the first function related window is output. have. The control module 160 may output the second function related window to the display module 140 according to the second function related window size information, and adjust the size of the first function related window to fit the remaining display module 140 space.

According to various embodiments, when an output of a second function-related window is requested in a state of outputting a first function-related window, the control module 160 displays the second function-related window according to the first function-related window size information to be applied to the multi-window environment. You can select the display type. For example, the control module 160 may output an app window having a schedule information arrangement related to the second function, or output a widget window having a different structure or different information arrangement than the app window.

According to various embodiments, when output of a second function related window is requested in a state of outputting a first function related window, the control module 160 determines the first function related window according to the second function related window size information to be applied to the multi-window environment. The display type of can be changed. For example, the control module 160 may maintain the output of the window related to the first function, or may output a window related to the first function having a different structure or arrangement of information different from the window currently being output.

In operation 311, the control module 160 may check whether an event related to a specific window adjustment occurs. If there is no occurrence of an event related to a specific window adjustment in operation 311, the control module 160 may branch to before operation 303 and perform the following operation again. Meanwhile, the control module 160 may perform an information display state update in response to an event generated in operation 309 or support execution of a function related to a specific window. For example, information update according to link selection in a specific function window, text writing, or item editing may be supported.

If an event related to a specific window adjustment occurs in operation 311, the control module 160 may perform switching to another window display type in operation 313. According to an embodiment, an event for resizing the first function related window may occur while the first function related window and the second function related window are displayed. For example, a touch drag event related to resizing a window related to the first function may occur. The control module 160 may change the display type of the second function related window when the size of the first function related window is adjusted. According to an embodiment, the control module 160 may change the second function related app window designed to correspond to the execution of the app to the second function related widget window. Alternatively, the control module 160 may change the second function related widget window designed to correspond to the widget execution to the second function related app window.

As described above, in the multi-window operating method according to various embodiments of the present invention, when a second function execution is requested while a first function-related window is being output, a change operation of changing the display type of the first function-related window and An output operation of outputting a window in which the display type is changed and a window according to execution of the second function may be included.

Here, the multi-window operation method of the present invention includes not only window adjustment through data processing between the control module and the display module disposed in one device, but also an external accessory that is separately separated and receives data from the control module according to at least one of wired and wireless. The same could be applied to window adjustment on the device. For example, the above-described change operation and output operation may be performed by one electronic device, but may be performed by specific electronic devices, respectively. According to an embodiment, an electronic device such as a smart watch, a smart necklace, or a smart bracelet may receive and output multi-window related data from an electronic device such as a smart pad or a smart phone. In this operation, an electronic device such as a smart pad or a smart phone may process and output multi-window data, and an electronic device such as a smart watch may process the display of received multi-window-related data.

According to various embodiments, the changing operation may include changing the display type of the first function related window according to the size information of the second function related window to be applied to the multi-window environment.

According to various embodiments, in the output operation, the second function related window is output according to size information of the second function related window to be applied to a multi-window environment, and the second function related window is output, and the display type suitable for the remaining area. Any one of an operation of outputting the changed window and an operation of selecting a display type of the second function-related window according to information on the size of the first function-related window to be applied to the multi-window environment.

According to various embodiments, the output operation may include an operation of outputting a window in which the display type is changed and outputting a second function related window suitable for a remaining area.

4 is a diagram illustrating an example of a screen interface for changing a display type of another window during multi-window operation according to an embodiment of the present invention.

Referring to FIG. 4, the electronic device 100 may output a function related window to the display module 140 in response to a function execution request. According to an embodiment, the electronic device 100 may receive a request to execute the second function while the window related to the first function is output to the display module 140. The electronic device 100 may adjust a window related to the first function in an operation of outputting a window related to the second function. For example, the electronic device 100 may output the window 410 and the window 420 to the display module 140 as in the screen 401. The windows 410 and 420 may be output in correspondence with predefined size information to be applied to a multi-window environment.

In addition, according to various embodiments, a specific type of window output on the display module 140 in full screen in relation to the first function may be changed to a window 410 having a different display type in response to a request to execute the second function. For example, the electronic device 100 may change an app window related to the first function to a widget window type together with the window 420 output.

According to various embodiments, the display type of the window 420 may also be adaptively changed according to a multi-window environment. For example, even if a widget execution is requested in connection with execution of the second function, the electronic device 100 may output an app window related to execution of the second function as the window 420 in response to the window 410. In addition, even if an app execution is requested in connection with execution of the second function, the electronic device 100 may output a widget window related to execution of the second function as the window 420 in response to the window 410. In screen 401, an app window related to a first function and an app window related to a second function are displayed. As mentioned above, this environment may be changed according to the characteristics of the windows 410 and 420.

On screen 401, an event related to window 410 adjustment may occur. For example, the control module 160 may receive a touch event for adjusting the size of the window 410. The display module 140 may output a resized window 411 that has been resized as in the screen 403 in response to resizing the window 410. In addition, the display module 140 may output the resize window 421 by adjusting the size of the window 420 in response to the output of the resize window 411.

On the other hand, when the resizing window 421 is reduced to a predetermined predetermined size, or when the resizing window 411 is reduced to a predetermined predetermined size, the control module 160 changes the resizing window 421 to the change window 422 as in screen 405. Can be changed to. According to various embodiments, the control module 160 may output the change window 422 as in the screen 405 when a predetermined time elapses after the window 420 is converted to the resizing window 421. Alternatively, the control module 160 may switch to the change window 422 when the size of the window 420 is changed to be less than a predetermined predetermined size. The change window 422 may have a different shape from the window 420 in at least one of a type of information, an information arrangement, a size of a window, a position of a window, and a shape of a window. This change window 422 may be a window corresponding to execution of a program routine different from the window 420. The program related to the window 420 may deliver the aforementioned execution information to the program related to the execution of the modified window 422. A program related to the change window 422 may execute a second function based on the transmitted execution information and output information accordingly.

5 is a view for explaining another example of a screen interface for changing a display type of another window among a method of operating a multi-window according to an embodiment of the present invention.

Referring to FIG. 5, a window 510 and a window 520 may be output in a multi-window environment as in a screen 501 corresponding to a preset setting. The output types of the windows 510 and 520 may be adjusted according to the multi-window operation setting as described at the beginning of FIG. 4. In the drawing, the window 510 and the window 520 are respectively outputted in the form of an app window.

On the screen 501, an event related to resizing the window 510, for example, a drag event may occur. The control module 160 may adjust the size of the window 510 according to the occurrence of the drag event. In response to this, the display module 140 may output a window 511 that has been resized as in the screen 503. The control module 160 may change the window 520 to a change window 521 as shown in the screen 503 when the window 520 is adjusted to the size of the window 510 and falls below a predetermined size.

Meanwhile, the control module 160 may receive an event related to resizing the change window 521. The display module 140 may output a size change window 522 having a changed size as in the screen 505 in response to an event related to the change window 521 size adjustment. The control module 160 may additionally adjust the size of the resized window 511 in response to the resizing of the change window 521. In response to this, the display module 140 may output a resizing window 512 as in the screen 505.

6 is a diagram for explaining another example of a screen interface for changing a display type of another window among a method of operating a multi-window according to an embodiment of the present invention.

Referring to FIG. 6, a window 610 and a window 620 may be output to the display module 140 as in the screen 601 corresponding to a preset setting. As for the output form of the window 610 and the window 620, the display form or the display type may be adjusted in correspondence with the multi-window operation setting as described at the beginning of FIG. 4. In the drawing, the window 610 and the window 620 are respectively outputted in the form of an app window.

On the screen 601, the control module 160 may receive an event for resizing the window 610. For example, the control module 160 may receive a touch drag event of touching an edge area of the window 610 and then dragging in a predetermined direction. The control module 160 may change the window 610 to a full window 611 as in the screen 603 in response to the size of the touch drag event. For example, the control module 160 may control the first function-related window to occupy the entire display module 140 when the size of the window 610 is expanded in response to the moving distance of the touch drag event and then moved by a predetermined distance or more. In response to this, the display module 140 may change and output the window 610 to the full window 611.

The window 620 may gradually decrease in size as the size of the window 610 is expanded. In addition, when the window 610 is changed to the full window 611, the window 620 may be changed to the pop window 621 as in the screen 603. The pop window 621 may be output at a predetermined predetermined position or may be disposed on a predetermined area at the edge of the screen. The pop window 621 may have a predefined predetermined size.

As in the screen 603, the control module 160 may receive an event related to resizing of the full window 611. For example, a touch drag event related to a reduction in the size of the full window 611 may occur. The control module 160 may gradually reduce the size of the full window 611 according to the touch drag event. The display module 140 may output in the form of a window 612 that is resized as shown in response to a decrease in the size of the full window 611. Alternatively, when a sweep event or a flick event having a certain acceleration occurs, the control module 160 may change the full window 611 to a predefined size-adjusted window 612 in response to the occurrence of the event.

When the full window 611 is changed to the resized window 612, the control module 160 may change the pop window 621 to the resized window 622. The display module 140 may output the resized window 622 to a predetermined position. For example, the display module 140 may output the resized window 622 to the remaining area as the full window 611 is changed to the resized window 612. Additionally, the size of the resized window 622 may be resized according to a touch drag event. For example, the resized window 622 may be changed to the size of the window 620 according to the occurrence of an event.

7 is a diagram illustrating a method of operating a multi-window of an electronic device according to another embodiment of the present invention.

Referring to FIG. 7, in the method for operating a multi-window of the present invention, operations 701 to 709 may be the same or similar to operations 401 to 409 described in FIG. 4. For example, in operation 701, the control module 160 may perform function operation or function standby. In operation 703, it is possible to check whether there is an event or setting related to multi-window application. In operation 703, when multi-window is applied, the control module 160 may check whether a multi-function processing situation is in operation 705. In operations 703 and 705, when there is no request to apply a multi-window or processing multiple functions, respectively, in operation 707, the control module 160 may support single window output. In operation 705, in a multi-function processing situation, in operation 709, the control module 160 may output a plurality of windows. As for the operation of the electronic device 100 in each operation, examples described in each operation of FIG. 4 may be applied.

In operation 711, for example, the electronic device 100 may check whether a set event is received. For example, the electronic device 100 may determine reception of a preset specific key button input signal, a preset specific gesture input signal, a preset specific voice recognition signal, and a preset specific message as reception of a preset event. The specific gesture input signal may include various user inputs generated on the display module 140 of the input function, such as a sweep event, a flick event or a drag event, and a touch gesture event corresponding to a specific pattern. The specific gesture input signal may be an input signal according to analysis of sensor information collected from at least one sensor provided in the electronic device 100. For example, the specific gesture input signal may be a signal composed of sensor information corresponding to an operation such as tilting, shaking, or tapping the electronic device 100 in a predetermined direction. Alternatively, the specific gesture input signal may include a combination of a touch gesture signal and a sensor-based gesture signal. As an example, the specific gesture input signal may include sensor information and a touch signal corresponding to an operation of tilting or shaking the electronic device 100 while touching a specific window area.

In operation 711, if there is no reception of a set event, the electronic device 100 may branch to operation 713 and perform a function according to the generated event characteristic. For example, the control module 160 may update information in at least one window among the multi-windows currently being output in response to the generated event.

In operation 711, when a set event is received, in operation 715, the control module 160 may change a window display type according to a specific event. According to an embodiment, when a specific event occurs on a specified window by a touch event or the like, the control module 160 may change the display type of the specified window in response to the occurrence of the event. For example, the control module 160 may change the app window to a widget window in response to the occurrence of a touch event. Alternatively, the control module 160 may change the widget window to an app window.

In operation 717, the control module 160 may check whether a change in the size of the window of the changed type occurs according to the operation of changing the display type of the window. If the size of the window of the changed type is different from the previous window, in operation 719, the control module 160 may change the display type or display type of another window in response thereto.

8 is a diagram for explaining an example of a screen interface for changing a display type of a designated window during multi-window operation according to an embodiment of the present invention.

Referring to FIG. 8, when a request to execute a first function and a second function occurs, the control module 160 may execute a first function and a second function related to the first function. As in the screen 801, the display module 140 may output a window 810 related to execution of the first function and a window 820 related to the second function. According to various embodiments, the display module 140 may output a window related to a first function in response to a first function execution request, and then output a window 810 and a window 820 according to the second function execution request. The illustrated drawings illustrate a state in which an app window according to execution of a first function-related app and an app window according to execution of a second function-related app are respectively output to a predetermined location.

Referring to the screen 801, the display module 140 outputs the window 810 and the window 820 to be full screen. The control module 160 configures the window 810 and the window 820 in a predetermined ratio, for example, 1:1 according to predefined information. This ratio can be defined differently according to the change of predefined information.

Meanwhile, as in the screen 801, an event set on the window 820 may occur. The control module 160 may support reception of a set event by activating a touch panel in connection with supporting an input function. When, for example, a drag event or a sweep event in a certain direction occurs, the control module 160 may recognize it as a set event through checking predefined information. When a set event occurs, the control module 160 may change the window 820 to the widget window 821 as in the screen 803. In relation to the widget window 821 output, the electronic device 100 may have information for executing a widget related to the second function in response to occurrence of an event set in a multi-window environment.

The display module 140 may output the widget window 821 by replacing the window 820 in response to execution of the second function related widget. Here, the widget window 821 may have predefined predetermined size information. According to an embodiment, the size information of the widget window 821 may have a smaller size than the previously output window 820. The display module 140 may output a widget window 821 having a size smaller than that of the window 820 by replacing the window 820. The control module 160 may adjust the size of the window 810 in response to the widget window 821 output. The display module 140 may output a window 821 in which the size of the window 810 is adjusted.

Meanwhile, when an event set on the widget window 821 of the screen 803 occurs, the control module 160 may control to remove the widget window 821 and output the window 820. In this case, the control module 160 may perform resizing of the resized window 811 together. The display module 140 may return to the window 810 and window 820 output state as in the screen 801.

9 is a view for explaining another example of a screen interface for changing a designated window display type during multi-window operation according to an embodiment of the present invention.

Referring to FIG. 9, when a request to execute a first function and a second function occurs, the control module 160 may execute a first function and a second function related to the first function. As in the screen 901, the display module 140 may output a window 910 related to execution of the first function and a window 920 related to the second function. According to various embodiments, the display module 140 includes a window 910 of a first size related to a first function according to a request to execute a first function, and a window 920 of a second size different from the first size according to a request to execute a second function. Can be printed. In the drawing, the window 910 occupies a relatively large area compared to the window 920.

Referring to the screen 901, the display module 140 may output a window 910 having a first size disposed at the top and a window 920 having a second size smaller than the first size at the bottom. Alternatively, while the first function related window and the second function related window of the same size are output, the display module 140 displays the size of the first function related window larger than the size of the second function related window in response to the input signal. can do.

A preset event may occur on the area of the display module 140 on which the window 920 is output. The control module 160 may collect a preset event, for example, a touch event corresponding to an operation of dragging or sweeping the window 920 in a predetermined direction. When the set event occurs, the control module 160 may switch the window 920 to the change window 921. As with the screen 901, the display module 140 may remove the window 920 or output a change window 921 on the upper layer of the window 920. In this case, the change window 921 may have the same size as the window 920. In response to switching between the change windows 921 and 920 of the same size, the window 910 may maintain the previous state without a separate size change.

In screen 903, a preset event may occur on the display module 140 on which the change window 921 is output. The control module 160 may convert the change window 921 into a window 920 in response to occurrence of a set event. Correspondingly, the display module 140 may remove the change window 921 as in the screen 905 or may output the window 920 on the upper layer. That is, the window 920 may be switched to the change window 921 in response to a set event occurrence, and the change window 921 may be switched to the window 920 in response to a set event occurrence.

10 is a diagram illustrating a method of operating a multi-window of an electronic device according to another embodiment of the present invention.

Referring to FIG. 10, in the method of operating a multi-window of the present invention, first in operation 1001, the control module 160 may perform a function operation or a function standby. For example, the control module 160 may control execution of a specific function in response to schedule information or an input event, and control a screen output corresponding thereto. In operation 1003, the control module 160 may check whether the multi-window is executed. For example, the control module 160 may check whether there is a multi-window setting or whether there is an input event requesting the multi-window setting. If there is no request to execute the multi-window in operation 1003, the control module 160 may support application of a single window in operation 1005.

In operation 1003, when there is a request to execute a multi-window, the control module 160 may arrange a plurality of windows in a predetermined form. In operation 1007, the control module 160 may check whether a set event is received. The event set here may be at least one of various events or gesture input signals described in operation 711 of FIG. 7 above. If there is no event reception set in operation 1007, the control module 160 may branch to operation 1009 and control the execution of a function according to a corresponding event type or characteristic. For example, the control module 160 may adjust a volume or perform a page change in relation to a previously executed function.

When an event set in operation 1007 is received, in operation 1011 the control module 160 may adjust the window display type or display type according to the set event. For example, the control module 160 may adjust the size of a specific window in response to an event. Alternatively, the control module 160 may switch the display type of a specific window to another display type in response to the event.

In operation 1013, the control module 160 may check whether the adjusted window-related function exists. The electronic device 100 may associate another function with at least one specific function. According to various embodiments, the electronic device 100 may associate a memo function with a video playback function or a music playback function. The electronic device 100 may associate a file editing function with a chat function. The electronic device 100 may associate a web access function with a memo function. The electronic device 100 may associate a web access function with a dictionary function. The electronic device 100 may associate a call function with a memo function. The electronic device 100 may associate a schedule function with a memo function. The electronic device 100 may associate a call function with a language conversion function. The electronic device 100 may associate a camera function with a memo function or a gallery function. The electronic device 100 may store the associated information in the storage module 150. When a size adjustment or display type change of a specific window occurs, the control module 160 may check a function associated with the corresponding function based on the association information stored in the storage module 150. If the window-related function adjusted in operation 1013 does not exist, the control module 160 may adjust another window display type or display type according to the remaining area size in 1017. Alternatively, the control module 160 may maintain the remaining area as an empty space, a form filled with a specific color scheme, a background screen, or the like.

If the linkage function exists in operation 1013, the control module 160 may output a window of the new function according to the remaining area size in operation 1015. For example, the control module 160 may determine a function associated with the adjusted window as a specific display type and output a window corresponding to the display type. According to an embodiment, the control module 160 may output an app window or a widget window corresponding to a new function according to the adjusted size or the adjusted display type of the adjusted window. In this case, the control module 160 may adjust the size of the app window or the widget window corresponding to the adjusted window size. Alternatively, the control module 160 may further perform resizing of the adjusted window in connection with outputting the app window or widget window of a predetermined size.

As described above, the method of operating a multi-window according to various embodiments of the present invention includes an operation of outputting a plurality of windows according to execution of a function, changing a display type of a first function-related window among the plurality of windows in response to an event occurrence, and In response to an operation of changing at least one of the window display type change according to the execution of another program having the same or similar function as the first function, and the change of the first function related window, the second function related window among the plurality of windows is transferred to the second function. An output operation of changing a window display type according to execution of another program having the same or similar function or outputting a new third function related window may be included.

According to various embodiments, the output operation may include an operation of changing a display type of the second function related window when the size change in the display format of the first function related window is greater than a predetermined size.

According to various embodiments, the output operation may include outputting the third function related window when the size of the first function related window or the size of the second function related window is greater than or equal to a predetermined size.

According to various embodiments, the method may further include an operation of executing the first function or a third function previously associated with the second function based on the association information, and the output operation is the execution of the third function. It may include an operation of outputting a third function related window according to.

According to various embodiments, the output operation is an operation of changing the first function related window to a window of a preset size in response to the occurrence of the event, and according to the size of a residual area generated according to the change of the first function related window. An operation of outputting a third function related window having a different display type may be included.

According to various embodiments, the method may further include an operation of receiving an event, and an operation of adjusting a size of a second function-related window whose display type is changed in response to the reception of the event.

According to various embodiments of the present disclosure, the method further includes an operation of receiving an event, re-changing a display type of a first function-related window whose display type has been changed or a second function-related window whose display type has been changed in response to receiving the event. Can include.

11 is a view for explaining an example of a screen interface for outputting a new window during multi-window operation according to an embodiment of the present invention.

Referring to FIG. 11, the control module 160 of the electronic device 100 may output a multi-window to the display module 140 in response to execution of a plurality of functions. For example, as on the screen 1101, the display module 140 may output a window 1110 corresponding to execution of a first function and a window 1120 corresponding to execution of a second function. The window 1110 and the window 1120 may be displayed by dividing a predetermined area on the entire screen of the display module 140.

The control module 160 may receive an event for adjusting the display format of the window 1120. For example, the user may generate a drag event using an electronic pen or a finger to adjust the display shape of the window 1120. The control module 160 may adjust the display format of the window 1120 in response to an event that occurs. For example, the control module 160 may adjust the size of the window 1120 in response to the drag event and output the resizing window 1121 as shown in the screen 1103. Here, the control module 160 may output a new function related window 1130 to the remaining area generated in response to the output of the resizing window 1121.

According to an embodiment, the new function related window 1130 may be a window of another function disposed in the background area of the window 1120 or may be at least a partial area of the background screen. The window 1120 may be layered on a background screen or another function window to be output. When the window 1120 is resized to provide a residual area, the control module 160 may output at least a part of the background screen or a window of another function to the residual area. In this case, the control module 160 may readjust information included in the background screen according to the size of the remaining area and output at least a portion of the information to the remaining area. Alternatively, the control module 160 may output information obtained by reducing the background screen in the remaining area. Alternatively, the control module 160 may output only a partial area of the window of another function to the remaining area, or may output a reduced window of the other function. Alternatively, the control module 160 may output a window of another function suitable for the size of the remaining area. For example, if various windows such as an app window or a widget window exist for different functions, the control module 160 may execute a widget or an app corresponding to the size of the corresponding remaining area, and perform a window output corresponding to the execution.

According to another embodiment, the new function related window 1130 may be a window corresponding to execution of a specific function that is pre-linked with the second function. The control module 160 may check association information stored in the storage module 150 when resizing of the window 1120 occurs or resizing of a predetermined size or more occurs. The control module 160 may check a new function linked to the second function and check the size of the remaining area. The control module 160 may execute a program corresponding to the size of the remaining area. The display module 140 may output a new function related window 1130 corresponding to program execution in the remaining area.

According to various embodiments, an event for adjusting the display type of the resizing window 1121 may occur. For example, the user may perform a drag operation to additionally adjust the size of the resize window 1121. When an event according to a drag operation is received, the control module 160 may output the additional adjustment window 1131 as in the screen 1105 by additionally adjusting the display form of the resizing window 1121. Here, when the display type adjustment of the resizing window 1121 is adjusted to a predetermined size or less, the control module 160 may execute another program related to the second function. The display module 140 may output a window according to execution of a corresponding program in the additional adjustment window 1131 area.

The control module 160 may adjust at least one of a display type or a display type of the new function related window 1130 in response to additional adjustment of the resize window 1121. For example, the control module 160 may expand the new function related window 1130 to a remaining area generated according to the reduction of the resize window 1121. The display module 140 may output a window 1131 related to an expanded new function. Alternatively, when the remaining area is expanded as the resizing window 1121 is reduced, the control module 160 may execute a new function-related program corresponding to the size of the expanded remaining area. As shown in the screen 1107, the display module 140 may output another window 1140 related to a new function corresponding to execution of a program related to the new function. According to an embodiment, the control module 160 may execute the gallery function as a function linked to the second function on the screen 1103 and the screen 1105. The control module 160 may execute the memo function as a new function when the remaining area is expanded beyond a predetermined predetermined size according to the resizing of the window 1120. The display module 140 may output another window 1140 related to a new function according to the execution of the memo function. The association information may include information on functions associated with a specific function according to the size of the remaining area.

12 is a diagram illustrating examples of a screen interface related to multi-window operation that can be applied to various embodiments of the present invention.

Referring to FIG. 12, as in the screen 1201, the display module 140 of the electronic device 100 may output a plurality of windows in response to a multi-window support environment. For example, the display module 140 may output a window 1210 related to a first function and a window 1220 related to a second function.

Here, a preset event for adjusting the display type of the window 1220 may occur. For example, the control module 160 may receive a preset event in the form of multi-touch or zoom-in or zoom-out. When a preset event occurs, the display module 140 adjusts the display form of the window 1220 and outputs the resizing window 1221, as in the screen 1203, and also outputs the window 1230 related to the third function related to the second function can do. According to various embodiments, the control module 160 may adjust the size of the window 1220 according to reception of a preset event, or may output a window according to execution of another program having the same or similar function as the window 1220. For example, the window 1220 may be a window according to execution of an app program, and the resize window 1221 may be a window according to execution of a widget program. The control module 160 may check linkage information to output the window 1230. The control module 160 may check a third function linked to the second function. The control module 160 may execute a third function. The display module 140 may output a window 1230 according to execution of the third function. The control module 160 may control to output the display module 140 together with a resizing window 1221 having a preset size and a window 1230 having a preset size according to occurrence of a preset event.

According to various embodiments, the control module 160 may execute a fourth function related to the first function when a preset event is received on the window 1220 or on the display module 140. The control module 160 may change the size of the window 1220 to a predefined size adjustment window 1221. Alternatively, the control module 160 may control the output of the resizing window 1221 by executing a program related to a second function having a different display type. As in the screen 1205, the display module 140 may output a window 1240 related to the fourth function to the remaining area generated in response to the output of the resizing window 1221.

According to various embodiments, when a preset event occurs on the window 1210, the control module 160 may execute a third function related to the second function. In addition, the control module 160 may adjust the display type or display type of the window 1210 to prepare a residual area, and may arrange a third function window in the residual area.

According to various embodiments, the control module 160 may adjust the display format of the window 1220 upon receiving a preset event. The control module 160 may adjust the display type of the window 1210 according to the adjustment of the window 1220 display type. The display module 140 may output a window 1222 whose size and direction are adjusted as in the screen 1207. Also, the display module 140 may output a window 1211 whose size and direction are adjusted. For example, the display module 140 may arrange and output windows in a horizontal mode direction in a vertical mode direction.

As described above, the screen display according to the execution of the functions described in various embodiments of the present invention may automatically and adaptively change the arrangement of multi-windows, addition of related information, and change of display form. have. Accordingly, various embodiments of the present invention support to make it easier to check information according to function execution without a user's input manipulation for additional and repetitive window adjustment.

Meanwhile, according to various embodiments, the control module 160 of the electronic device 100 described above may include a bus and at least one processor. Here, the processor may include, for example, at least one of the event collection module 161, the function processing module 163, and the output processing module 165 described in the electronic device 100. Alternatively, processing modules included in the function processing module 163 may be implemented with at least one processor.

The bus may be a circuit that connects components (eg, a processor, a storage module, an input module, a display module, or a communication module) included in electronic devices to each other and transfers communication (eg, a control message) between the components. .

The processor may receive commands from components included in electronic devices through a bus, decode the received command, and perform an operation or data processing according to the decoded command. In this case, the processor executes at least one application stored in the storage module 150 and controls to provide a service based on the application.

Also, the processor may include one or more application processors (APs) or one or more communication processors (CPs). Here, the AP or CP may be included in the processor or may be included in different IC packages, respectively. Also, the AP or CP may be included in one IC package. The AP may drive an operating system or an application program to control a plurality of hardware or software components connected to the AP, and perform various data processing and operations including multimedia data. Here, the AP may be implemented as a system on chip (SoC). In addition, the CP may perform at least a part of the multimedia control function. In addition, the CP may distinguish and authenticate a terminal within a communication network using a subscriber identification module (eg, a SIM card). In this case, the CP may provide a service including a voice call, a video call, a text message, or packet data to the user. In addition, the CP may control data transmission/reception of the communication module 260. The AP or CP may load and process commands or data received from at least one of a nonvolatile memory or other components connected to each of the volatile memory. In addition, the AP or CP may store data received from at least one of the other components or generated by at least one of the other components in a nonvolatile memory. The CP may manage a data link and convert a communication protocol in communication between an electronic device including hardware and other electronic devices connected through a network. Here, the CP may be implemented as an SoC. Additionally, the processor may further include a graphic processing unit (GPU).

On the other hand, depending on the convergence trend of digital devices, variations are very diverse and cannot be listed, but the electronic device 100 includes an acceleration sensor, a gyro sensor, a GPS module, a Near Filed Communication (NFC) module, a vibration motor, and an accessory. Components not mentioned above may be further included, such as. In addition, the electronic device 100 may exclude a specific configuration from the above-described configurations or be replaced with other configurations according to the form of provision thereof.

In addition, the embodiments of the present disclosure disclosed in the present specification and drawings are merely provided with specific examples to easily describe the technical content of the present disclosure and to aid understanding of the present disclosure, and are not intended to limit the scope of the present disclosure. Therefore, the scope of the present disclosure should be construed that all changes or modified forms derived based on the technical idea of the present disclosure in addition to the embodiments disclosed herein are included in the scope of the present disclosure.

100: electronic device 110: communication module
120: input module 130: audio processing module
140: display module 150: storage module
160: control module

Claims (2)

display;
Includes; a processor functionally connected to the display,
The processor is
In response to the first input, a first window related to execution of the first application is output, and
When a second input related to execution of a second application is received, a second window related to execution of the second application is displayed together with the first window, and
When receiving a third input related to adjusting the size of the second window, the electronic device controls to output a new third window to the display while adjusting the size of the second window. The method of claim 1,
And the third window includes a screen corresponding to execution of a third application.

Images