KR102382074B1 - Operating Method For Multi-Window And Electronic Device supporting the same - Google Patents

Abstract

The present invention provides a display module that outputs a plurality of windows according to function execution and when at least one of a display form and a display type of a specific window is changed in response to an event occurrence, at least one of the display form and display type of another window is changed or It includes a configuration of an electronic device including a control module for controlling to output a window of a new function, and a method for operating a multi-window thereof.

Description

Multi-window operating method and electronic device supporting the same

Various embodiments of the present invention relate to multi-window operation of an electronic device.

With the recent development of digital technology, various electronic devices capable of communicating and processing personal information while moving, such as a mobile communication terminal, a personal digital assistant (PDA), an electronic notebook, a smart phone, and a tablet PC (Personal Computer) have been released. These electronic devices are reaching the stage of mobile convergence in which they do not stay in their traditional unique areas but also cover the areas of other terminals.

Typically, the electronic device includes a call function such as a voice call and a video call, a message transmission and reception function such as Short Message Service (SMS)/Multimedia Message Service (MMS) and e-mail, an electronic organizer function, a shooting function, a broadcast playback function, and a video playback function. A function, a music reproduction function, an Internet function, a messenger function, and a social network service (SNS, Social Networking Service) function may be provided.

Meanwhile, the electronic device provides a screen corresponding to performing a function in the form of a window. In addition, the electronic device may display each window in response to performing a plurality of functions.

However, the conventional electronic device is designed to output a plurality of windows to a predefined arbitrary position of the display unit. Accordingly, in an environment in which a user operates a plurality of windows, it is inconvenient to have to adjust the size and position of each window in order to check appropriate information.

Accordingly, various embodiments of the present invention provide a method for operating a multi-window and an electronic device supporting the same, which minimizes a user's window adjustment by adaptively controlling a display method of a plurality of windows to enable more convenient window use. .

One embodiment of various embodiments of the present invention for solving the above problems is a display module that outputs a plurality of windows according to function execution, and a display form of at least one specific window among the plurality of windows in response to an event occurrence and a control module controlling to change the display type of at least one other window among the plurality of windows or additionally output a window of a new function when at least one of the display types is changed, wherein the control module changes the display type Disclosed is a configuration of an electronic device that controls to output a window according to the execution of another program having the same or similar function as that of the previous window.

The present invention also provides a change operation of changing the display type of the first function-related window when a second function execution is requested while the first function-related window is being output, and the window in which the display type is changed and the second function execution Disclosed is a configuration of a multi-window operating method including an output operation of outputting a window according to the present invention. The present invention also provides an operation of outputting a plurality of windows according to function execution, and a first function of the plurality of windows in response to an event occurrence. An operation in which at least one of a change in the display form of a related window and a change in a window display type according to execution of another program having the same or similar function as the first function is changed, and a second function of the plurality of windows in response to the change of the window related to the first function Disclosed is a configuration of a multi-window operation method including an output operation of changing a window display type according to the execution of another program having the same or similar function to a second function or outputting a new third function related window.

The foregoing has outlined rather broadly the features and technical advantages of various embodiments in order that those skilled in the art may better understand them from the detailed description of various embodiments of the present invention described below. In addition to these features and advantages, additional features and advantages of various embodiments that form the subject matter of the claims of the present invention will become better understood from the detailed description set forth below.

As described above, according to the multi-window operating method proposed in various embodiments of the present invention and an electronic device supporting the same, various embodiments of the present invention support to enable appropriate function operation while minimizing the multi-window operation.

1 is a diagram showing the configuration of an electronic device applied to various embodiments of the present invention.
2 is a diagram showing the configuration of a control module described in various embodiments of the present invention.
3 is a diagram illustrating a method for operating a multi-window of an electronic device according to an embodiment of the present invention.
4 is a view for explaining an example of a screen interface related to changing the display type of another window during multi-window operation according to an embodiment of the present invention.
FIG. 5 is a view for explaining another example of a screen interface related to changing a display type of another window among the multi-window operating method according to an embodiment of the present invention.
6 is a view for explaining another example of a screen interface related to changing another window display type among the multi-window operating method according to an embodiment of the present invention.
7 is a diagram illustrating a method for operating a multi-window of an electronic device according to another embodiment of the present invention.
8 is a view for explaining an example of a screen interface for changing a display type of a specified window during multi-window operation according to an embodiment of the present invention.
9 is a view for explaining another example of a screen interface for changing a specified window display type during multi-window operation according to an embodiment of the present invention.
10 is a diagram illustrating a method of operating a multi-window of an electronic device according to another embodiment of the present invention.
11 is a view for explaining an example of a screen interface for outputting a new window during multi-window operation according to an embodiment of the present invention.
12 is a view for explaining examples of a screen interface related to multi-window operation that can be applied to various embodiments of the present invention.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this case, it should be noted that in the accompanying drawings, the same components are denoted by the same reference numerals as much as possible. In addition, detailed descriptions of well-known functions and configurations that may obscure the gist of the present invention will be omitted. That is, it should be noted that, in the following description, only parts necessary for understanding the operation according to various embodiments of the present invention will be described, and descriptions of other parts will be omitted so as not to obscure the gist of the present invention.

In the following description, electronic devices are AP (Application Processor), GPU (Graphic Processing Unit), CPU (Central), like all information and communication devices, multimedia devices, and their application devices that support the functions described in various embodiments of the present invention. It can include any device that uses the Processing Unit). For example, the electronic device includes a mobile communication terminal operating based on respective communication protocols corresponding to various communication systems, a tablet PC (Personal Computer), a smart phone (Smart Phone), It may include devices such as a digital camera, a portable multimedia player (PMP), a media player, a portable game terminal, and a personal digital assistant (PDA).

Also, in the following description, a window may be a predetermined area in which information according to function execution of the electronic device is output. Here, the information may include various screen elements related to function execution. For example, the information may include at least one of various items such as text, a still or moving image, an icon, a virtual key button, a slide bar, a progress bar, a list item, and a thumbnail item. According to an embodiment, the window may be output in the form of a new layer on the background screen. The multi-window can be configured by dividing the upper layer area of the background screen and outputting a plurality of windows on the divided layer area. Alternatively, the multi-window may be configured by pushing up a portion of a single window or adjusting the size to a certain size while outputting a single window and outputting another window in response thereto.

According to another embodiment, the window may be formed by updating a predetermined area of the background screen to display new information. For example, the electronic device may configure a window by removing information displayed in some areas of the background screen and displaying information according to execution of a specific function in the corresponding area or overwriting information according to execution of a function in some areas. The multi-window can be configured by dividing the background screen into a plurality of areas, and displaying or overwriting information according to the execution of a plurality of functions in the divided areas.

As described above, the multi-window operating method described in various embodiments of the present invention and the electronic device supporting the same indicate an area for displaying information as a window according to the execution of a specific function in the electronic device, which is described in the text. It is not limited to the name of "window". Accordingly, the window may be understood as various terms such as an information display area according to function execution, an information display layer, a pop-up, a player, and a screen.

1 is a diagram illustrating a configuration of an electronic device applied to various embodiments of the present disclosure.

Referring to FIG. 1 , the electronic device 100 includes a communication module 110 , an input module 120 , an audio processing module 130 , a display module 140 , a storage module 150 , and a control module 160 . can do.

The electronic device 100 having such a configuration may automatically change at least one of a display form and a display type of another window when at least one of a display form and a display type of a specific window is changed in the multi-window output environment. According to various embodiments, when a preset event occurs, the electronic device 100 may change the display type of a specific window designated by the event. Also, according to various embodiments, when at least one of a display form and a display type of a specific window is changed, the electronic device 100 may automatically output a new window having a function related to the window. In this case, the electronic device 100 may adjust the shape and type of the new window in response to the change of the specific window. Through the above-described window display control, the electronic device 100 allows a plurality of windows to mutually adaptively change at least one of a display form and type, thereby making it easier and easier to check and operate information included in the window. Support.

According to various embodiments, the above-described display form change may include a change in at least one of the size and shape of the window, information arrangement in the window, and the information display size in the window. The display type corresponds to the window type, and may include various types for each program execution, such as an app execution type and a widget execution type. These display types have different template structures constituting the window for each program type, such as the size of the region constituting the window, the arrangement of a plurality of regions, the number of regions, the type and number of virtual key buttons included in at least one region, etc. Depending on the execution of this function, it may be defined differently for each program.

The communication module 110 may include at least one communication unit related to a communication function of the electronic device 100 . For example, the communication module 110 may include various communication units such as a mobile communication unit, a broadcast receiving unit, and a short-range communication unit. In response to the operation of the communication module 110 , the electronic device 100 may output a specific window to the display module 140 . For example, the electronic device 100 may output a call function related window related to the voice call function support of the communication module 110 to the display module 140 . According to various embodiments, the electronic device 100 may output a web browser window related to the web access function support of the communication module 110 to the display module 140 . According to various embodiments, the electronic device 100 may output a broadcast screen window related to the broadcast reception function of the communication module 110 to the display module 140 . According to various embodiments, the electronic device 100 may output an image screen window according to the reception of streaming data of the communication module 110 to the display module 140 . According to various embodiments, the electronic device 100 may output a screen window according to the short-range communication channel formation of the communication module 110 to the display module 140 .

The electronic device 100 may output a plurality of windows to the display module 140 when the functions based on the communication module 110 are complexly performed. When a plurality of windows are output based on the communication module 110 , the electronic device 100 may perform size and position adjustment of windows corresponding to each function. For example, when a new window output is requested while one window is output in full screen, the electronic device 100 may adjust the display form or display type of the previous window. According to various embodiments, the electronic device 100 may adjust the display form or display type of the new window according to the number of previous windows being output to the display module 140 or the display forms or types of windows.

The input module 120 may generate an input signal of the electronic device 100 . The input module 120 may include, for example, at least one of a keypad, a dome switch, a touch pad (static pressure/capacitance), a jog wheel, and a jog switch. can The input module 120 may be implemented in the form of a button outside the electronic device 100 , and some buttons may be implemented as a touch panel. According to an embodiment, the input module 120 may include a plurality of keys for receiving numeric or character information and setting various functions. These keys may include a menu call key, a screen on/off key, a power on/off key and a volume control key, a home key, and the like.

The input module 120 includes an input signal for requesting activation of at least one function, an input signal for adjusting at least one window display type or display form in a state in which the multi-window is output to the display module 140 , and the display module 140 . You can create an input signal that requests multi-window output on the . An input signal related to a multi-window output request may be generated by selecting a specific menu item or icon designed to simultaneously execute a plurality of functions. Alternatively, the input signal related to the multi-window output request may be an input signal for requesting to additionally execute a specific function while a specific window is output. The input module 120 may generate an input signal for setting an app of a specific function to be associated with an app or widget of another function. Also, the input module 120 may generate an input signal for setting a widget of a specific function to be associated with an app or widget of another function.

The audio processing module 130 may process an audio signal of the electronic device 100 . For example, the audio processing module 130 may transmit an audio signal input from the control module 160 to a speaker (SPK, speaker). The audio processing module 130 may perform a function of transmitting an audio signal such as a voice input from a microphone (microphone) to the control module 160 . The audio processing module 130 may convert an audio signal such as voice received from the microphone into a digital signal and transmit it to the control module 160 . According to an embodiment, the audio processing module 130 may output audio data related to a specific window in an environment in which a multi-window is output. Here, the audio processing module 130 may output audio data of a specified specific window among the multi-windows. When the window designation is changed to another window, the audio processing module 130 may output audio data related to the changed window.

According to various embodiments, when a display type or display form of a specific window is changed in a multi-window output environment, the audio processing module 130 may output a guide sound or sound effect corresponding thereto. Also, when a new window is output in the multi-window output environment, the audio processing module 130 may output audio data related to the newly output window. Alternatively, the audio processing module 130 may output audio data related to a display form or a window in which the display type is changed. An audio data output method for a plurality of windows being output to the display module 140 may be adjusted according to a designer method or a user setting, or audio data output may be omitted.

The display module 140 displays (outputs) at least one of various windows corresponding to functions processed by the electronic device 100 . For example, when the electronic device 100 is in a call mode, a user interface (UI) or a graphic user interface (GUI, Graphical UI) related to a call is displayed in the form of a window. In addition, when the electronic device 100 is in a video call mode or a shooting mode, the display module 140 displays a captured and/or received image, UI, or GUI in the form of a window. According to an embodiment, the display module 140 displays app windows for various functions (or applications) executed in the electronic device 100 . In addition, the display module 140 activates and displays a virtual input device (eg, a virtual touchpad) according to the control of the control module 160 in the app window, and displays a signal input through the virtual input device to the control module ( 160). Also, the display module 140 may output a widget window according to the execution of the widget. In the present invention, the widget window will be described as a screen element output to the display module 140 in response to the execution of the widget program stored in the storage module 150 . Also, in the present invention, the app window will be described as a screen element output to the display module 140 in response to the execution of the app program stored in the storage module 150 .

According to an embodiment, the display module 140 may output a plurality of app windows in response to at least one function. The app window may be a screen element corresponding to activation of a program prepared in connection with supporting a specific function. For example, the app window may be a call function related window according to the execution of the call function. The app window may be a window related to the memo function according to the execution of the memo function. The app window may be a video related window according to video playback.

According to various embodiments, the display form or display type of the app window may be changed in response to an input event. For example, the app window may be a web browser window. When a specific video playback is requested in the web browser window, the display module 140 may remove the web browser window and output an app window according to the execution of the video playback player. That is, the display module 140 may output an app window corresponding to another app having the same or similar function. The display module 140 may output the app windows in a toggle method. For example, the web browser-related first app window and the video playback-related second app window may be alternately output to the display module 140 according to the occurrence of an input event. According to an embodiment, when a second app window removal event occurs in response to the end of video playback, the display module 140 may output a web browser-related first app window.

According to various embodiments, the display module 140 may output at least one widget window. The display module 140 may output at least one widget window according to an execution setting or an input event. The display module 140 may resize the widget window according to an input event. According to various embodiments, the display module 140 may output at least one app window and at least one widget window. For example, the display module 140 may output an app window corresponding to a memo function and a widget window corresponding to a music playback function. The display module 140 may adjust at least one of the size and arrangement of the app window and the widget window according to the control of the control module 160 .

According to various embodiments of the present disclosure, the display module 140 may output another window whose display form or display type is adjusted in response to a change in the display form or display type of the window being displayed. For example, if the app window of the first function is changed to the widget window of the first function while the app window of the first function and the app window of the second function are output, the display form or display type of the app window of the second function This can be adjusted. According to an embodiment, the display module 140 may expand the size of the app window of the second function or may output more information by arranging it in the app window. According to various embodiments, the display module 140 may change and output the app window of the second function to the widget window of the second function according to the control of the control module 160 .

In the above description, the first function and the second function may be specific functions supported by the electronic device 100 . For example, the first function and the second function may be various functions, such as a camera-related function, a memo function, a document editing function, a search function, an image reproduction function, a chatting function, and the like. Also, the app window and the widget window may have different window structures. According to one embodiment, the chat app window and the chat widget window are implemented by different program operations, and each window may have a different information arrangement structure. Alternatively, although the chat app window and the chat widget window are implemented by one program operation capable of supporting the app and widget functions, the window shape output to the display module 140 may have different information arrangement structures.

When the display form or display type of the window related to the first function is changed in the multi-window environment, the display module 140 may output a window related to the new third function according to the control of the control module 160 . The new third function related window may be a window according to the execution of an app or widget related to the first function. Alternatively, the third function-related window may be a window according to the execution of an app or widget related to the second function. The third function may be designed to be related to the first function or the second function, may be designated by a user setting, or may be defined by a user history.

According to various embodiments, the display module 140 may display a plurality of windows, for example, two windows to fill the entire screen. For example, the display module 140 may display a plurality of windows in a full screen form on the entire screen. In this operation, the display module 140 may divide regions of the entire screen and arrange a plurality of windows in each region. Alternatively, the display module 140 may arrange a plurality of windows in areas of the entire screen and display a part of the background area or at least a part of the background screen in some areas. When windows are arranged for each divided area and a change in the display form or display type of a specific window occurs, the display module 140 changes the display form or display type of other windows according to the control of the control module 160 so that the entire screen is displayed. You can keep them displayed as windows. Alternatively, the display module 140 may output a window related to a new function in the remaining area or the remaining area according to a change in the display type or display type of the window according to the control of the control module 160 . Correspondingly, the display module 140 may have a full screen state in which the entire screen is composed of a plurality of function-related windows. Alternatively, the display module 140 may display a background area or a partial background screen in the remaining area. As described above, the control module 160 may adjust the size of the windows so that the entire screen is filled with the plurality of windows even if the size of at least one of the plurality of windows is changed, and the control module 140 may also It is possible to control display of at least a portion of a background area or a background screen according to a change in the size of at least one of the windows.

According to various embodiments, the display module 140 may display a plurality of windows in a layered manner (a form in which layers corresponding to the windows are stacked). For example, the display module 140 may output the first function-related window to the entire screen, and output a second function-related window smaller than the first function-related window size on the first function-related window. In addition, the display module 140 may have a full-screen state in which a plurality of windows are arranged on the entire screen, even if the size of the corresponding windows is adjusted according to the display type or display type adjustment of the first function-related window or the second function-related window. there is.

The display module 140 may support a screen display in a landscape mode, a screen display in a portrait mode, and a screen change display according to a change between the landscape mode and the portrait mode according to the rotation direction (or the laying direction) of the electronic device 100 . there is. When a horizontal mode or vertical mode change occurs in the multi-window environment, the display module 140 may change the arrangement or display shape of windows in response thereto. In addition, the display module 140 can automatically change from landscape mode to portrait mode or from portrait mode to landscape mode according to the control of the control module 160 when the display form or display type of a specific window is changed in a multi-window environment. there is.

The display module 140 includes a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), a light emitting diode (LED, Light Emitting Diode), and an organic light emitting diode (OLED, Organic LED). , active-type OLED (AMOLED, Active Matrix OLED), flexible display (flexible display), bent display (bended display), and may include at least one of a three-dimensional display (3D display). Some of these displays may be implemented as a transparent display (transparent display) composed of a transparent type or a light transparent type so that the outside can be seen.

In addition, the display module 140 is provided as a touch screen including a touch panel and may be used as an input device in addition to an output device. The touch panel may be configured to convert a change in pressure applied to a specific part of the display module 140 or capacitance generated in a specific part of the display module 140 into an electrical input signal. The touch panel may be configured to detect not only the touched position and area, but also the pressure at the time of the touch. On the other hand, as mentioned above, the display module 140 of the present invention is configured to include a touch panel and a display panel. The touch panel may be placed on the display panel (place on the display unit). The touch panel may be implemented as an add-on type positioned on the display panel, an on-cell type inserted into the display panel, or an in-cell type. The touch panel transmits a user input in response to the user's gesture on the display module 140 to the control module 160 . Here, the user input generated by a touch means such as a finger or a touch pen is touch, multi-touch, tap, double tap, long tap, tap & touch, and drag. ), flick (Flick), press (Press), pinch in (pinch in) and pinch out (pinch out) and the like may include. The above-described user input may be defined and used as an input signal for requesting multi-window output, an input signal related to a request to change the display form or display type of a specific window in the multi-window output state, an input signal for requesting display removal of a specific window, etc. can

The storage module 150 may store a program or an app 151 for processing and control of the control module 160 , a widget 153 , and the like.

The app 151 may include program routines that support various functions supported by the electronic device 100 . For example, the app 151 is an app supporting a music playback function, an app supporting a video playback function, a file editing function app, a camera function app, a chat function app, a game function app, an alarm app, a web browser app, a gallery app, It can include a variety of apps, such as a calculator app, a voice search app, a map app, a weather app, and more. The app 151 may be activated in response to an execution request and output a screen corresponding thereto to the display module 140 in the form of a window.

The widget 153 may include widget routines that support various functions supported by the electronic device 100 . For example, the widget 153 may include various widgets such as a weather widget, an alarm widget, a chat widget, a message widget, a memo widget, and a music play widget. The widget 153 may be composed of specific program routines or may be composed of some routines of the above app 151 . The widget 153 may be provided to output a window of information arrangement or structure with the app window according to the execution of the app 151 .

The app 151 and the widget 153 may be provided as menu items or in the form of icons on a standby screen or a menu screen. Here, the icon may have a predetermined size or may have various sizes according to a design form.

The storage module 150 may store information of a linked function associated with a specific function. The linkage function may be a function that can be executed according to a change in the display type or display type of at least one window in a multi-window environment. The storage module 150 may store a program list related to a specific function. For example, the storage module 150 may store a list of app programs, widget programs, pop-up programs, etc. related to the memo function. The control module 160 may change a window related to a specific function to a window according to execution of another program having the same function or a similar function based on the related program list. Alternatively, related program information may be included in each program and stored. For example, the memo app program may include information for calling the memo widget program as a related program.

The above-described storage module 150 is a flash memory type, a hard disk type, a micro type, and a card type (eg, SD card (Secure Digital Card) or XD card ( eXtream Digital Card)), RAM (Random Access Memory), SRAM (Static RAM), ROM (Read-Only Memory), PROM (Programmable ROM), EEPROM (Electrically Erasable PROM), magnetic memory It may include a storage medium of at least one type of (MRAM, Magnetic RAM), a magnetic disk, and an optical disk type memory. The electronic device 100 may operate in relation to a web storage that performs a storage function of the storage module 150 on the Internet.

The control module 160 may support output of a standby screen or a menu screen related to at least one app 151 and a widget 153 stored in the storage module 150 . The control module 160 may output at least one window in response to selection of at least one specific function on the standby screen or the menu screen. For example, the control module 160 may output an app window in response to the selection of the app 151 . The control module 160 may output a widget window in response to a specific widget 153 execution request. The control module 160 may support a multi-window environment, for example, a plurality of app window output environments, a plurality of widget window output environments, at least one app window, and at least one widget window output environment.

According to an embodiment, the control module 160 may change the display form or display type of another window when the display form or display type of a specific window is changed in a multi-window environment in response to the occurrence of an input event. The control module 160 may transfer execution information, for example, an activity, when windows having different display types are switched. Here, the execution information may be information related to a function being executed in a specific app. For example, the execution information may include information on the type and playback time of a specific sound source, channel information of a specific broadcast, and the like. The execution information may include text or image information written in execution of a specific app, information on an execution page or execution location of a specific app, web access information of a specific app, and the like. The control module 160 may support the switched window to maintain the same function as the previous window even if a window change of a different display type occurs based on the execution information transfer. For example, the control module 160 performs control to maintain the same function by performing execution information transfer when switching between app windows, switching between widget windows, switching between app windows and widget windows, or switching between widget windows and app windows. can

According to various embodiments, the control module 160 may output a window related to a new function when the display form or display type of a specific window is changed in a multi-window environment. Such a control module 160 may include a configuration as shown in FIG. 2 in relation to the multi-window operation support of the present invention.

Meanwhile, although the description of the present invention describes that the window shape is different based on the app and the widget in relation to a specific function, various embodiments of the present invention are not limited thereto. That is, the examples of apps and widgets in the present invention are presented to explain that the display type is changed as the information arrangement structure of the window is changed. As a result, even the same app may have different display types of app windows supporting the same function if different developers or developers make it. Likewise, even the same widget may have widget windows of different display types supporting the same function according to developer intention or policy. The multi-window operation function of the present invention can have an optimal display state by changing a display form or a display type while a plurality of multi-windows are correlated with each other in response to an input signal.

Meanwhile, various embodiments described in the present invention may be implemented in a recording medium readable by a computer or a similar device using software, hardware, or a combination thereof. According to the hardware implementation, the embodiments described in the present invention are ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays) ), processors, controllers, micro-controllers, microprocessors, and other electrical units for performing other functions may be implemented using at least one. In some cases, the embodiments described herein may be implemented by the control module 160 itself. According to the software implementation, embodiments such as the procedures and functions described in this specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

2 is a diagram showing the configuration of a control module described in various embodiments of the present invention.

Referring to FIG. 2 , the control module 160 of the present invention may include an event collection module 161 , a function processing module 163 , and an output processing module 165 .

The event collection module 161 may collect events occurring in the electronic device 100 . For example, the event collection module 161 may collect an input signal generated from the input module 120 as an event. The event collection module 161 may control power supply of the touch panel in connection with the input function support of the display module 140 . The event collection module 161 may collect touch events that occur in the display module 140 of the input function. When the electronic device 100 supports the voice recognition and command function, the event collection module 161 may activate a microphone and collect a voice recognition event. When the electronic device 100 provides various sensors, the event collection module 161 may collect sensor information corresponding to a gesture as an event. For example, the event collection module 161 may collect at least one piece of sensing information generated from at least one sensor, such as acceleration sensing information, geomagnetic sensing information, and contact or pressure sensing information, as an event. The event collected by the event collection module 161 may be provided to the function processing module 163 .

The function processing module 163 may be a module supporting each function processing. The function processing module 163 may allocate a processing module related to a specific function according to the event provided by the event collection module 161 . For example, the function processing module 163 may allocate the first function processing module 61 when receiving an event requesting execution of the first function from the event collection module 161 . In addition, the function processing module 163 may allocate the second function processing module 62 when receiving an event requesting execution of the second function from the event collection module 161 while the first function is being executed. The function processing module 163 may transmit a specific event transmitted from the event collection module 161 to the first function processing module 61 or the second function processing module 62 .

According to various embodiments, when another function execution is requested while the first function and the second function are being executed, the function processing module 163 may allocate an additional processing module. As described above, the operation of the function processing module 163 of the present invention is not limited to the number of functions, and additional function processing modules may be further allocated as needed.

According to various embodiments of the present disclosure, the function processing module 163 may automatically allocate processing modules related to the execution of the third function in response to a change in a display form or a display type. The function processing module 163 may allocate a processing module related to the execution of a predefined third function when, for example, a change of a window display form or a display type related to the first function or the second function is requested.

The first function processing module 61 may process data related to the first function requested to be executed. For example, the first function processing module 61 may support function processing of any one of various functions supported by the electronic device 100 , such as a music reproduction function, a broadcast reception function, a web access function, and a file editing function. In this case, the first function processing module 61 may control the reproduction of a specific music file designated by the transmitted event. The first function processing module 61 may transmit various data related to the first function support, for example, first function related window data and audio data to the output processing module 165 . The first function related window data may include various data output to the display module 140 in relation to the first function during execution of the first function. According to an embodiment, the first function processing module 61 may activate an app related to the first function, and transmit app window data according to the activation of the app to the output processing module 165 .

According to various embodiments, the first function processing module 61 may request the output processing module 165 to change the display form or change the display type of the app window in response to the transmitted event. For example, the first function processing module 61 may transmit widget window data related to the first function to the output processing module 165 in response to the transmitted event. In this operation, the first function processing module 61 may request the output processing module 165 to delete the app window that has been previously output to the display module 140 .

According to various embodiments, the first function processing module 61 transmits the widget window data related to the first function to the output processing module 165, and outputs the app window data of the first function in response to the occurrence of an event to the output processing module You can pass it to (165). Here, the first function processing module 61 may request the output processing module 165 to delete the previously output widget window from the display module 140 .

According to various embodiments, the first function processing module 61 transmits widget window data or app window data related to the first function to the output processing module 165, and in response to the occurrence of an event, another app window of the first function The data may be passed to the output processing module 165 . The other app window of the first function may be a window of an app that supports the same function, for example, a music playback function, as mentioned above, but an executed program is different. As another example, the music playback function may be executed by various apps, such as a web browser app, a music playback app, and a video playback app. Each app may have a different app window shape according to a design form of a corresponding program or user settings. Also, the music playback function may be executed by at least one of a plurality of music playback apps produced by different developers or developers. Here, each of the plurality of music playback apps may have a different window shape according to a design method or a user setting.

The second function processing module 62 may perform data processing related to a second function different from the first function. For example, the second function processing module 62 may support a memo function processing. The second function processing module 62 may transmit screen window data related to the memo function support to the output processing module 165 . The second function processing module 62 may request the output processing module 165 to adjust the window display form or display type of the corresponding function in response to the event transmitted by the event collection module 161 .

The output processing module 165 may output a specific window to the display module 140 based on data transmitted from at least one of the first function processing module 61 and the second function processing module 62 . For example, the output processing module 165 may receive window data related to the first function from the first function processing module 61 . The output processing module 165 outputs the window related to the first function to the full screen of the display module 140 or outputs the window related to the first function in a user-set size when there is no separate function-related window output to the display module 140 . Alternatively, it can be output in the size set by default. The output processing module 165 performs screen division or area division of the display module 140 when output of a plurality of windows, for example, the output of the first function related window and the second function related window is requested, and divides the divided screen areas. You can print each window in . In this case, the screen division may be performed in a uniform or non-uniform form. Alternatively, the output processing module 165 may output the first function-related window as a full screen and overlay the second function-related window on the first function-related window. In this case, the output processing module 165 may output the second function related window to cover a partial area of the first function related window. The first function-related window and the second function-related window may be output to occupy the entire area of the display module 140 .

According to an embodiment, the output processing module 165 may output the first function-related window executed temporally earlier to be larger or smaller than the second function-related window executed temporally later. According to various embodiments, the output processing module 165 outputs a function having a relatively high execution frequency in a multi-window environment or a window of a function set to have a high priority compared to other functions larger or smaller than the windows of other functions can do. According to various embodiments, the output processing module 165 may control the corresponding function-related windows for simultaneous execution functions to be output in the same size.

The output processing module 165 performs a display form or display type change of a corresponding window in response to a request to change the display form or display type of a specific window in a multi-window environment, and also performs a display form or display type change of another window. can According to an embodiment, the function processing module 163 may support execution of a new third function in response to a change in the display type or display form of the window related to the first function or the window related to the second function. The output processing module 165 may receive the window data related to the third function from the processing module related to the processing of the new third function. The output processing module 165 may output the third function related window to the display module 140 based on the received third function related window data. In this case, the output processing module 165 may output the third function-related window to a predetermined area provided in response to the change of the display form or the display type.

As described above, the electronic device 100 according to various embodiments of the present disclosure includes the display module 140 for outputting a plurality of windows according to the execution of a function, and at least one specific window among the plurality of windows in response to the occurrence of an event. When at least one of the display form and the display type is changed, the control module 160 for controlling to change at least one of the display form and display type of at least one other window among the plurality of windows or to output a window of a new function; can Here, the control module 160 may control to output a window according to execution of another program having the same or similar function as that of the previous window when the display type is changed.

The multi-window operation of the present invention may describe an operation according to the operation of a control module of a specific electronic device. That is, in a state in which the control module of the electronic device is outputting the first function-related window to the display module, when another function execution is requested, the data processing is performed to output the second function execution window together with the display type change of the first function-related window. can be controlled In addition, the multi-window operation may be an operation describing operation of the display module of the electronic device. That is, in a state in which the display module outputs the first function-related window, the second function-related window is output in response to data processing, but the change window in which the display type of the first function-related window is changed is displayed together with the second function-related window can be printed out.

In addition, the above-described 'output' may be understood as a form of displaying data of the display module as well as a situation in which data is transmitted to the display module from the control module. For example, embodiments of the present invention may be applied to a form in which a control module and a display module are provided in a physically separated space. In this case, the control module may output the window change of the multi-window to the external display device, and the display device may display window related data received from the electronic device. Application of this embodiment may be performed between, for example, an electronic device in the form of a smart watch and an electronic device such as a smart pad or a smart phone. Therefore, the multi-window operation of the present invention is not only a window adjustment through data processing between a control module and a display module disposed in one device, but also an external accessory that is separated and receives data from the control module according to at least one method of wired or wireless. The same could be applied to window adjustments on the device.

According to various embodiments, the display module 140 displays the full screen including the plurality of windows by arranging the plurality of windows on the divided entire screen, or disposing the plurality of windows so that they do not overlap and at least some of them. A background area or some background screen area can be displayed.

The control module 160 controls to output a window according to the execution of another program having the same or similar function as the function related to another window, when the size change of the specific window is greater than or equal to a certain size, or changes the size of the specific window or another window When this size is greater than a certain size, it can be controlled to output a window of a new function.

According to various embodiments of the present disclosure, the electronic device 100 may further include a storage module configured to store association information having information about the specific window-related function or other function information associated with the other window-related function.

According to various embodiments, the control module 160 executes the specific window-related function or a function previously linked with the other window-related function based on the linkage information, and outputs a window of a new function according to the execution of the function can be controlled to do so.

According to various embodiments, the control module 160 changes a specific window to a window of a preset size in response to the occurrence of the event and controls to output a window of a new function according to the size of the remaining area created according to the change. can

According to various embodiments, the control module 160 may execute a program of a new function having a different display type based on the linkage information according to the size of the remaining area.

According to various embodiments, the control module 160 may adjust the size of another window whose display type is changed in response to the occurrence of an event.

According to various embodiments, the control module 160 may change the display type of a specific window whose display type is changed or another window whose display type is changed in response to the occurrence of an event.

3 is a diagram illustrating a method for operating a multi-window of an electronic device according to an embodiment of the present invention.

Referring to FIG. 3 , in the multi-window operating method of the present invention, in operation 301 , the control module 160 may perform function operation or function standby. In this operation, the control module 160 may output a standby screen to the display module 140 or may output a predefined menu screen to the display module 140 . Alternatively, the control module 160 may output a window corresponding to execution of a specific function to the display module 140 in response to a user input. Multi-window application may be selectively performed in response to a menu item being selected as an icon. If the multi-window operation is not applied, a window related to a specific function requested to be executed or selected may be output to the entire display module 140 in a full screen. When multi-window operation is applied, a plurality of windows are arranged in certain areas of the screen of the display module 140 and output in the form of a full screen that fills the entire display module 140, or partially so that at least some background areas or background screens are displayed. can be output as Schedule information may be displayed on some background areas or background screens.

In operation 303, for example, the control module 160 may check whether there is a setting for multi-window application or occurrence of an event. The electronic device 100 may provide an icon or menu item related to the multi-window application setting. Alternatively, the electronic device 100 may be designed to apply a multi-window function by default. Alternatively, the electronic device 100 may be designed such that a multi-window function is applied as a default when a specific function is executed. For example, when a video playback function or a call function is executed, the electronic device 100 may perform multi-window application by default. If there is no setting or event occurrence for multi-window application in operation 303, the control module 160 branches to operation 305 to support execution of a specific function based on the output of a single window. When setting a single window output, the control module 160 may output a window related to an executed function or a specified function on the entire screen of the display module 140 . Correspondingly, a window related to another function being executed or loaded may be entirely covered by the window currently output on the front of the display module 140 .

If there is a multi-window application event or setting in operation 303, the control module 160 may determine whether a multi-function processing situation is present in operation 307. In this operation, the control module 160 may check whether a situation in which to output a multi-window according to the execution of a plurality of functions. When a single function is being executed in operation 307 , the control module 160 may support a single window output as in operation 305 .

If the multi-function processing situation is determined in operation 307 , the control module 160 may output a plurality of windows in operation 309 . For example, the control module 160 may output a first function-related window and a second function-related window in response to a function requested to be executed. The control module 160 may output the first function-related window and the second function-related window to have a predetermined area on the display module 140 . In this operation, the control module 160 may collect preset size information related to the first function related window output and preset size information related to the second function related window output. The control module 160 may output the first function-related window and the second function-related window to the entire display module 140 at a predetermined ratio according to the collected size information.

According to various embodiments, the control module 160 may check the window size information related to the first function to be output in the multi-window environment and output it to the display module 140 in the corresponding size. The control module 160 may output the second function related window to fit the remaining area after the first function related window is output.

According to various embodiments, when the output of the second function-related window is requested while the first function-related window is output, the control module 160 may collect information on the size of the second function-related window to be applied in the multi-window environment. there is. The control module 160 may output the second function-related window to the display module 140 according to the second function-related window size information and adjust the size of the first function-related window to fit the remaining space of the display module 140 .

According to various embodiments, when a second function-related window output is requested in the first function-related window output state, the control module 160 controls the second function-related window according to the first function-related window size information to be applied to the multi-window environment. You can select the display type. For example, the control module 160 may output an app window having a predetermined information arrangement in relation to the second function or a widget window having a different structure or information arrangement than the app window.

According to various embodiments, when outputting a second function-related window is requested in the output state of the first function-related window, the control module 160 controls the first function-related window according to the second function-related window size information to be applied to the multi-window environment. You can change the display type of For example, the control module 160 may maintain the output of the window related to the first function or output the window related to the first function having a structure or information arrangement different from that of the previously output window.

In operation 311 , the control module 160 may check whether an event related to adjustment of a specific window occurs. If there is no occurrence of an event related to adjusting a specific window in operation 311 , the control module 160 may branch to before operation 303 and re-perform the following operations. Meanwhile, the control module 160 may perform an information display state update in response to an event generated in operation 309 or support execution of a function related to a specific window. For example, information update according to link selection, text entry, or item editing may be supported in a window of a specific function.

If an event related to adjustment of a specific window occurs in operation 311 , the control module 160 may perform another window display type change in operation 313 . According to an embodiment, an event for resizing the first function-related window may occur while the first function-related window and the second function-related window are output. For example, a touch drag event related to resizing the first function related window may occur. The control module 160 may change the display type of the second function related window when the size of the first function related window is adjusted. According to an embodiment, the control module 160 may change the second function-related app window designed to correspond to the execution of the app to the second function-related widget window. Alternatively, the control module 160 may change the second function related widget window designed to correspond to the widget execution into the second function related app window.

As described above, in the multi-window operating method according to various embodiments of the present invention, when execution of a second function is requested while the first function-related window is being output, a change operation of changing the display type of the first function-related window and An output operation of outputting a window in which the display type is changed and a window according to the execution of the second function may be included.

Here, the multi-window operation method of the present invention is not only window adjustment through data processing between a control module and a display module disposed in one device, but also an external accessory that is separated and receives data from the control module according to at least one method of wired or wireless The same could be applied to window adjustments on the device. For example, the above-described change operation and output operation may be performed in one electronic device, but may be respectively performed in specific electronic devices. According to an embodiment, an electronic device such as a smart watch, a smart necklace, or a smart bracelet may receive and output multi-window related data from an electronic device such as a smart pad or a smart phone. In this operation, an electronic device such as a smart pad or a smart phone may process and output multi-window data, and an electronic device such as a smart watch may process the display of the received multi-window related data.

According to various embodiments, the changing operation may include changing the display type of the first function-related window according to the second function-related window size information to be applied to the multi-window environment.

According to various embodiments, the output operation outputs the second function-related window according to the size information of the second function-related window to be applied to the multi-window environment, and the display type fits the area remaining after the second function-related window is output. The operation may include any one of an operation of outputting the changed window and an operation of selecting a display type of the second function-related window according to the first function-related window size information to be applied to the multi-window environment.

According to various embodiments, the output operation may include outputting the window in which the display type is changed and outputting a second function related window suitable for the remaining area.

4 is a view for explaining an example of a screen interface related to changing the display type of another window during multi-window operation according to an embodiment of the present invention.

Referring to FIG. 4 , the electronic device 100 may output a function related window to the display module 140 in response to a function execution request. According to an embodiment, the electronic device 100 may receive a request to execute the second function while the window related to the first function is output to the display module 140 . The electronic device 100 may adjust the window related to the first function in the operation of outputting the window related to the second function. For example, the electronic device 100 may output the windows 410 and 420 to the display module 140 as in the screen 401 . The windows 410 and 420 may be output in response to predefined size information to be applied to a multi-window environment.

Also, according to various embodiments, a window 410 of a specific type outputted as a full screen to the display module 140 in relation to the first function may be changed to a window 410 having a different display type in response to a request for executing the second function. For example, the electronic device 100 may change the app window related to the first function to the widget window type along with the output of the window 420 .

According to various embodiments, the display type of the window 420 may also be adaptively changed according to a multi-window environment. For example, even if the widget execution is requested in relation to the execution of the second function, the electronic device 100 may output an app window related to the execution of the second function to the window 420 in response to the window 410 . Also, even if the application execution is requested in relation to the execution of the second function, the electronic device 100 may output a widget window related to the execution of the second function to the window 420 in response to the window 410 . The screen 401 exemplifies a state in which the app window related to the first function and the app window related to the second function are output. As mentioned above, this environment may be changed according to the characteristics of Windows 410 and Windows 420.

At screen 401 , an event related to window 410 adjustment may occur. For example, the control module 160 may receive a touch event for resizing the window 410 . The display module 140 may output a resizing window 411 whose size has been adjusted as shown in the screen 403 in response to the window 410 resizing. Also, the display module 140 may output the size adjustment window 421 by adjusting the size of the window 420 in response to the output of the size adjustment window 411 .

On the other hand, when the resizing window 421 is reduced to a predefined size, or when the resizing window 411 is reduced to a predefined size, as shown in screen 405, the control module 160 changes the resizing window 421 to the change window 422 can be changed to According to various embodiments, when a predetermined time elapses after the window 420 is converted to the resizing window 421 , the control module 160 may output the change window 422 as shown in the screen 405 . Alternatively, the control module 160 may switch to the change window 422 when the size of the window 420 is changed to be less than or equal to a predefined predetermined size. The change window 422 may have a form different from that of the window 420 in at least one of information type, information arrangement, window size, window position, and window shape. The change window 422 may be a window corresponding to the execution of a program routine different from the window 420 . The program related to Windows 420 may transmit the aforementioned execution information to the program related to the execution of the changed Windows 422. The program related to the change window 422 may execute the second function based on the transmitted execution information and output the corresponding information.

FIG. 5 is a view for explaining another example of a screen interface related to changing a display type of another window among the multi-window operating method according to an embodiment of the present invention.

Referring to FIG. 5 , windows 510 and 520 may be output in a multi-window environment as in the screen 501 in response to preset settings. The output form of the window 510 and the window 520 may be adjusted according to the multi-window operation setting as described above with reference to the introduction of FIG. 4 . In the drawing, the window 510 and the window 520 exemplify the output state in the form of an app window, respectively.

In the screen 501, an event related to resizing of the window 510, for example, a drag event may occur. The control module 160 may adjust the size of the window 510 according to the occurrence of a drag event. Correspondingly, the display module 140 may output a window 511 whose size has been adjusted as shown in the screen 503 . The control module 160 may change the window 520 to a change window 521 as shown in the screen 503 when the window 520 is adjusted to a predetermined size or less in response to the size adjustment of the window 510 .

Meanwhile, the control module 160 may receive an event related to resizing the change window 521 . The display module 140 may output the size change window 522 whose size is changed as shown in the screen 505 in response to an event related to the size adjustment of the change window 521 . The control module 160 may further adjust the size of the resized window 511 in response to the resizing of the change window 521 . Correspondingly, the display module 140 may output the resizing window 512 as shown in the screen 505 .

FIG. 6 is a view for explaining another example of a screen interface related to changing a display type of another window among the multi-window operating method according to an embodiment of the present invention.

Referring to FIG. 6 , windows 610 and 620 may be output to the display module 140 as in the screen 601 in response to preset settings. As for the output form of the window 610 and the window 620, the display form or the display type may be adjusted in response to the multi-window operation setting as described above with reference to the introduction of FIG. 4 . In the illustrated drawings, windows 610 and 620 are each exemplified in an output state in the form of an app window.

In a screen 601 , the control module 160 may receive an event for resizing the window 610 . For example, the control module 160 may receive a touch drag event of dragging in a predetermined direction after touching the edge area of the window 610 . The control module 160 may change the window 610 to the full window 611 as shown in the screen 603 in response to the size of the touch drag event. For example, the control module 160 may control the first function-related window to occupy the entire display module 140 when the size of the window 610 is expanded in response to the movement distance of the touch drag event and moved over a predetermined distance. Correspondingly, the display module 140 may change and output the window 610 to the full window 611 .

The size of the window 620 may be gradually reduced according to the size expansion of the window 610 . And when the window 610 is changed to the full window 611, as shown in the screen 603, the window 620 may be changed to the pop window 621. The pop window 621 may be output at a predetermined location or may be disposed on a predetermined area at the edge of the screen. The pop window 621 may have a predetermined size.

As shown in screen 603 , the control module 160 may receive an event related to resizing the full window 611 . For example, a touch drag event related to a size reduction of the full window 611 may occur. The control module 160 may gradually reduce the size of the full window 611 according to a touch drag event. The display module 140 may output the size of the full window 612 in the form of a resized window 612 as shown in response to the reduction in size. Alternatively, when a sweep event or a flick event having a certain acceleration occurs, the control module 160 may change the full window 611 to a predefined resized window 612 in response to the occurrence of the corresponding event.

When the full window 611 is changed to the resized window 612 , the control module 160 may change the pop window 621 to the resized window 622 . The display module 140 may output the resized window 622 to a predetermined position. For example, the display module 140 may output the resized window 622 to an area remaining as the full window 611 is changed to the resized window 612 . Additionally, the resized window 622 may be resized according to a touch drag event. For example, the size of the resized window 622 may be changed to the size of the window 620 according to the occurrence of an event.

7 is a diagram illustrating a multi-window operation method of an electronic device according to another embodiment of the present invention.

Referring to FIG. 7 , operations 701 to 709 in the multi-window operating method of the present invention may be the same or similar to operations 401 to 409 described above with reference to FIG. 4 . For example, in operation 701, the control module 160 may perform function operation or function standby. In operation 703, it may be checked whether there is an event or setting related to multi-window application. If there is multi-window application in operation 703 , the control module 160 may determine whether the multi-function processing situation is in operation 705 . When there is no multi-window application request or no multi-function processing in operations 703 and 705, respectively, in operation 707, the control module 160 may support output of a single window. If it is determined in operation 705 that a plurality of functions are processed, in operation 709 , the control module 160 may output a plurality of windows. For the operation of the electronic device 100 in each operation, the examples described above in each operation of FIG. 4 may be applied.

In operation 711, for example, the electronic device 100 may determine whether a set event is received. For example, the electronic device 100 may determine reception of a preset specific key button input signal, a preset specific gesture input signal, a preset specific voice recognition signal, and a preset specific message as a preset event reception. The specific gesture input signal may include various user inputs generated on the display module 140 of the input function, for example, a sweep event, a flick event or a drag event, and a touch gesture event corresponding to a specific pattern. The specific gesture input signal may be an input signal according to analysis of sensor information collected from at least one sensor provided in the electronic device 100 . For example, the specific gesture input signal may be a signal composed of sensor information corresponding to an operation such as tilting, shaking, or tapping the electronic device 100 in a predetermined direction. Alternatively, the specific gesture input signal may include a complex form of a touch gesture signal and a sensor-based gesture signal. For example, the specific gesture input signal may include sensor information and a touch signal corresponding to an operation of tilting or shaking the electronic device 100 while touching a specific window area.

If there is no reception of a set event in operation 711, the electronic device 100 may branch to operation 713 and perform a function according to the characteristics of the generated event. For example, the control module 160 may update information in at least one of the multi-windows currently being output in response to the generated event.

In operation 711 , when a set event is received, in operation 715 , the control module 160 may change the window display type according to a specific event. According to an embodiment, when a specific event occurs on a window designated by a touch event or the like, the control module 160 may change the display type of the designated window in response to the occurrence of the corresponding event. For example, the control module 160 may change the app window into a widget window in response to the occurrence of a touch event. Alternatively, the control module 160 may change the widget window into an app window.

In operation 717 , the control module 160 may determine whether a change in the size of the window of the changed type has occurred according to the operation of changing the display type of the window. When the size of the changed type of window is different from that of the previous window, in operation 719 , the control module 160 may change the display form or display type of another window correspondingly.

8 is a view for explaining an example of a screen interface for changing a display type of a specified window during multi-window operation according to an embodiment of the present invention.

Referring to FIG. 8 , when a request for execution of the first function and the second function is generated, the control module 160 may execute the first function and the second function related to the first function. The display module 140 may output the window 810 related to the execution of the first function and the window 820 related to the second function as shown in the screen 801 . According to various embodiments of the present disclosure, the display module 140 may output a window related to a first function according to a first function execution request, and then output a window 810 and a window 820 according to a second function execution request. The illustrated diagram exemplifies a state in which the app window according to the execution of the first function-related app and the app window according to the execution of the second function-related app are output to a predetermined location, respectively.

Referring to screen 801 , the display module 140 outputs the windows 810 and 820 to be full screens. The control module 160 configures the windows 810 and 820 in a predetermined ratio, for example, 1:1 according to predefined information. This rate may be defined differently according to predefined information change.

Meanwhile, as shown in screen 801, an event set on Windows 820 may occur. The control module 160 may support reception of a set event by activating the touch panel in relation to input function support. When, for example, a drag event or a sweep event in a certain direction occurs, the control module 160 may recognize it as a set event by checking predefined information. When a set event occurs, the control module 160 may change the window 820 to the widget window 821 as shown in screen 803. In relation to the widget window 821 output, the electronic device 100 may have information for executing the widget related to the second function in response to the occurrence of an event set in the multi-window environment.

The display module 140 may output the widget window 821 by replacing the window 820 in response to the execution of the second function-related widget. Here, the widget window 821 may have predetermined size information. According to an embodiment, the size information of the widget window 821 may have a smaller size than the previously output window 820 . The display module 140 may replace the widget window 821 having a size smaller than that of the window 820 to the window 820 and output it. The control module 160 may adjust the size of the window 810 in response to the output of the widget window 821 . The display module 140 may output the window 821 in which the size of the window 810 is adjusted.

Meanwhile, when a set event occurs on the widget window 821 of the screen 803 , the control module 160 may remove the widget window 821 and control to output the window 820 . In this case, the control module 160 may also perform resizing of the size-adjusted window 811 . The display module 140 may return to the window 810 and window 820 output states as in screen 801 .

9 is a view for explaining another example of a screen interface for changing a specified window display type during multi-window operation according to an embodiment of the present invention.

Referring to FIG. 9 , when a request for execution of the first function and the second function is generated, the control module 160 may execute the first function and the second function related to the first function. The display module 140 may output a window 910 related to the execution of the first function and a window 920 related to the second function as shown in screen 901 . According to various embodiments, the display module 140 may provide a window 910 of a first size related to a first function in response to a request for executing a first function, and a window 920 having a second size different from the first size in response to a request for executing a second function. can be printed out. In the illustrated drawing, the window 910 occupies a relatively large area compared to the window 920 .

Referring to screen 901 , the display module 140 may output a window 910 of a first size disposed at the top and a window 920 of a second size smaller than the first size at the bottom. Alternatively, in a state in which the first function-related window and the second function-related window of the same size are output, the display module 140 displays the size of the first function-related window larger than the size of the second function-related window in response to the input signal can do.

A preset event may occur on the area of the display module 140 in which the window 920 is output. The control module 160 may collect a preset event, for example, a touch event corresponding to an operation of dragging or sweeping the window 920 in a certain direction. The control module 160 may switch the window 920 to the change window 921 when the set event occurs. The display module 140 may remove the window 920 as in the screen 901 or output the change window 921 on the upper layer of the window 920 . In this case, the change window 921 may have the same size as the window 920 . In response to the transition between the window 921 and the window 920 having the same size, the window 910 may maintain the previous state without a separate size change.

In a screen 903 , a preset event may occur on the display module 140 on which the change window 921 is output. The control module 160 may convert the change window 921 to the window 920 in response to occurrence of a set event. Correspondingly, the display module 140 may remove the change window 921 as shown in the screen 905 or output the window 920 on an upper layer thereof. That is, the window 920 may be switched to the change window 921 in response to the occurrence of a set event, and the change window 921 may be switched to the window 920 in response to the occurrence of the set event.

10 is a diagram illustrating a method of operating a multi-window of an electronic device according to another embodiment of the present invention.

Referring to FIG. 10 , in the multi-window operating method of the present invention, first, in operation 1001 , the control module 160 may perform function operation or function standby. For example, the control module 160 may control execution of a specific function in response to schedule information or an input event, and control a screen output corresponding thereto. In operation 1003, the control module 160 may check whether the multi-window is executed. For example, the control module 160 may check whether there is multi-window setting or occurrence of an input event requesting multi-window setting. If there is no multi-window execution request in operation 1003 , the control module 160 may support application of a single window in operation 1005 .

In operation 1003 , if there is a request to execute a multi-window, the control module 160 may arrange a plurality of windows in a predetermined form. In operation 1007 , the control module 160 may determine whether a set event is received. The event set here may be at least one of the various events and gesture input signals described above in operation 711 of FIG. 7 . If there is no event reception set in operation 1007 , the control module 160 branches to operation 1009 to control the execution of a function according to the type or characteristic of the corresponding event. For example, the control module 160 may adjust a volume or perform a page change in relation to a previously executed function.

If the event set in operation 1007 is received, in operation 1011 , the control module 160 may adjust the window display form or display type according to the set event. For example, the control module 160 may adjust the size of a specific window in response to an event. Alternatively, the control module 160 may change the display type of the specific window to another display type in response to the event.

In operation 1013 , the control module 160 may determine whether an adjusted window-related function exists. The electronic device 100 may link other functions in relation to at least one specific function. According to various embodiments, the electronic device 100 may associate a memo function with a video playback function or a music playback function. The electronic device 100 may associate a file editing function with a chatting function. The electronic device 100 may link the web access function with the memo function. The electronic device 100 may associate the web access function with the dictionary function. The electronic device 100 may associate a call function with a memo function. The electronic device 100 may associate the schedule function with the memo function. The electronic device 100 may associate a call function with a language conversion function. The electronic device 100 may associate a camera function with a memo function or a gallery function. The electronic device 100 may store the associated information in the storage module 150 . When the size of a specific window or a display type change occurs, the control module 160 may check a function related to the corresponding function based on the linkage information stored in the storage module 150 . If the adjusted window-related function does not exist in operation 1013 , the control module 160 may adjust another window display form or display type according to the size of the remaining area in operation 1017 . Alternatively, the control module 160 may maintain the remaining area in an empty space or a form filled with a specific color scheme, a form in which a background screen is output, or the like.

If the associated function exists in operation 1013 , in operation 1015 , the control module 160 may output a window of the new function according to the size of the remaining area. For example, the control module 160 may determine a function associated with the adjusted window as a specific display type, and output a window corresponding to the corresponding display type. According to an embodiment, the control module 160 may output an app window or a widget window corresponding to the new function according to the adjusted size of the adjusted window or the adjusted display type. In this case, the control module 160 may adjust the size of the app window or the widget window to correspond to the adjusted window size. Alternatively, the control module 160 may further perform resizing of the window adjusted in relation to the output of an app window or widget window of a certain size.

As described above, the multi-window operating method according to various embodiments of the present invention includes an operation of outputting a plurality of windows according to function execution, a change in the display form of a first function-related window among the plurality of windows in response to an event occurrence, and In response to an operation of changing at least one of a window display type change according to the execution of another program having the same or similar function as the first function and the change of the first function-related window, a second function-related window among the plurality of windows is divided into a second function and a second function An output operation of changing a window display type according to execution of another program having the same or similar function or outputting a new third function related window may be included.

According to various embodiments, the output operation may include an operation of changing the display type of the second function-related window when the size change in the display form of the first function-related window is greater than or equal to a predetermined size.

According to various embodiments, the output operation may include outputting the third function-related window when the size change of the first function-related window or the size change of the second function-related window is greater than or equal to a predetermined size.

According to various embodiments, the method may further include executing a third function pre-associated with the first function or the second function based on the association information, and the output operation is executing the third function It may include an operation of outputting a third function-related window according to .

According to various embodiments, the output operation may include changing the first function-related window to a window having a preset size in response to the occurrence of the event, and according to the size of the remaining area generated according to the change of the first function-related window. The operation may include outputting a third function-related window having a different display type.

According to various embodiments of the present disclosure, the method may further include receiving an event and adjusting a size of a second function-related window whose display type is changed in response to receiving the event.

According to various embodiments, the method further includes an operation of receiving an event, an operation of changing the display type of the first function-related window whose display type is changed in response to the reception of the event, or the display type of the second function-related window whose display type is changed further may include

11 is a view for explaining an example of a screen interface for outputting a new window during multi-window operation according to an embodiment of the present invention.

Referring to FIG. 11 , the control module 160 of the electronic device 100 may output a multi-window to the display module 140 in response to execution of a plurality of functions. For example, as shown in the screen 1101 , the display module 140 may output a window 1110 corresponding to the execution of the first function and a window 1120 corresponding to the execution of the second function. The windows 1110 and 1120 may be output by dividing a predetermined area on the entire screen of the display module 140 .

The control module 160 may receive an event for adjusting the display form of the window 1120 . For example, the user may generate a drag event using an electronic pen or a finger to adjust the display form of the window 1120 . The control module 160 may adjust the display form of the window 1120 in response to the generated event. For example, the control module 160 may adjust the size of the window 1120 in response to the drag event and output the resizing window 1121 as in the screen 1103 . Here, the control module 160 may output the new function related window 1130 in the remaining area generated in response to the output of the resizing window 1121 .

According to an embodiment, the new function related window 1130 may be a window of another function that has been disposed in the background area of the window 1120 or may be at least a partial area of the background screen. The window 1120 may be output as a layer on the background screen or other function windows. When the window 1120 is resized to provide a remaining area, the control module 160 may output at least a part of the background screen or a window having another function in the remaining area. In this case, the control module 160 may readjust information included in the background screen according to the size of the remaining area and output at least a portion of the information to the remaining area. Alternatively, the control module 160 may output information obtained by reducing the background screen to the remaining area. Alternatively, the control module 160 may output only a partial area of the windows of other functions to the remaining area or reduce and output the windows of other functions. Alternatively, the control module 160 may output a window of another function suitable for the size of the remaining area. For example, if various windows such as an app window and a widget window exist for other functions, the control module 160 may execute a widget or an app corresponding to the size of the remaining area, and output a window corresponding to the execution.

According to another embodiment, the new function related window 1130 may be a window corresponding to the execution of a specific function pre-associated with the second function. The control module 160 may check the linkage information stored in the storage module 150 when a size adjustment of the window 1120 occurs or a size adjustment of a predetermined size or more occurs. The control module 160 may check the new function associated with the second function and check the size of the remaining area. The control module 160 may execute a program corresponding to the size of the remaining area. The display module 140 may output the new function related window 1130 corresponding to the execution of the program in the remaining area.

According to various embodiments, an event for adjusting the display form of the resizing window 1121 may occur. For example, the user may perform a drag operation for further adjusting the size of the resizing window 1121 . When an event according to the drag operation is received, the control module 160 may further adjust the display form of the size adjustment window 1121 to output the additional adjustment window 1131 as in the screen 1105 . Here, when the display form adjustment of the size adjustment window 1121 is adjusted to a predetermined size or less, the control module 160 may execute another program related to the second function. The display module 140 may output a window according to the execution of the corresponding program to the area of the additional adjustment window 1131 .

The control module 160 may adjust at least one of a display form or a display type of the new function related window 1130 in response to additional adjustment of the size adjustment window 1121 . For example, the control module 160 may extend the new function related window 1130 to the remaining area generated according to the reduction of the resizing window 1121 . The display module 140 may output an extended new function related window 1131 . Alternatively, when the remaining area is expanded according to the reduction of the size adjustment window 1121 , the control module 160 may execute a new function related program corresponding to the size of the expanded remaining area. The display module 140 may output another window 1140 related to the new function corresponding to the execution of the program related to the new function as shown in the screen 1107 . According to an embodiment, the control module 160 may execute the gallery function as a function associated with the second function on the screens 1103 and 1105 of the control module 160 . The control module 160 may execute the memo function as a new function when the remaining area is expanded to a predetermined size or more according to the size adjustment of the window 1120 . The display module 140 may output another window 1140 related to a new function according to the execution of the memo function. The association information may include information on functions associated with a specific function according to the size of the remaining area.

12 is a view for explaining examples of screen interfaces related to multi-window operation that can be applied to various embodiments of the present invention.

Referring to FIG. 12 , as shown in screen 1201 , the display module 140 of the electronic device 100 may output a plurality of windows in response to a multi-window support environment. For example, the display module 140 may output a window 1210 related to the first function and a window 1220 related to the second function.

Here, a preset event for adjusting the display form of the window 1220 may occur. For example, the control module 160 may receive a preset event in the form of multi-touch or zoom-in or zoom-out. When a preset event occurs, as shown in screen 1203, the display module 140 adjusts the display form of the window 1220 to output a size adjustment window 1221, and outputs a third function related window 1230 associated with the second function can do. According to various embodiments, the control module 160 may adjust the size of the window 1220 according to reception of a preset event or output a window according to execution of another program having the same or similar function as that of Windows 1220. For example, the window 1220 may be a window according to the execution of an app program, and the resizing window 1221 may be a window according to the execution of the widget program. The control module 160 may check the linkage information for the window 1230 output. The control module 160 may identify a third function associated with the second function. The control module 160 may execute a third function. The display module 140 may output a window 1230 according to the execution of the third function. The control module 160 may control the display module 140 to output the size adjustment window 1221 of the preset size and the window 1230 of the preset size according to the occurrence of a preset event.

According to various embodiments, when receiving a preset event on the window 1220 or on the display module 140 , the control module 160 may execute a fourth function related to the first function. The control module 160 may change the size of the window 1220 into a predefined resizing window 1221 . Alternatively, the control module 160 may control the output of the size adjustment window 1221 by executing a second function-related program having a different display type. The display module 140 may output the window 1240 related to the fourth function to the remaining area generated in response to the output of the size adjustment window 1221 as shown in the screen 1205 .

According to various embodiments, when a preset event occurs on Windows 1210, the control module 160 may execute a third function related to the second function. In addition, the control module 160 may adjust the display form or display type of the window 1210 to prepare the remaining area and arrange the third function window in the remaining area.

According to various embodiments, when receiving a preset event, the control module 160 may adjust the display form of the window 1220 . The control module 160 may adjust the display form of the window 1210 according to the adjustment of the display form of the window 1220 . The display module 140 may output a window 1222 whose size and orientation are adjusted as in the screen 1207 . Also, the display module 140 may output the window 1211 whose size and orientation are adjusted. For example, the display module 140 may arrange and output the windows in the horizontal mode direction in the vertical mode direction.

As described above, in the screen display according to the execution of functions described in various embodiments of the present invention, mutual arrangement of multi-windows, addition of related information, change of display form, etc. can be automatically and adaptively changed. there is. Accordingly, various embodiments of the present invention support to more easily check information according to function execution without the user's additional and repetitive input manipulation for window adjustment.

Meanwhile, according to various embodiments, the control module 160 of the above-described electronic device 100 may include a bus and at least one processor. Here, the processor may include, for example, at least one of the event collection module 161 , the function processing module 163 , and the output processing module 165 described in the electronic device 100 . Alternatively, the processing modules included in the function processing module 163 may be implemented by at least one processor.

The bus may be a circuit that connects components (eg, a processor, a storage module, an input module, a display module, or a communication module) included in electronic devices to each other and transmits communication (eg, a control message) between the components. .

The processor may receive a command from components included in the electronic devices through a bus, decode the received command, and perform an operation or data processing according to the decoded command. In this case, the processor executes at least one application stored in the storage module 150 and controls to provide a service based on the application.

In addition, the processor may include one or more application processors (APs) or one or more communication processors (CPs). Here, the AP or the CP may be included in the processor or may be included in different IC packages, respectively. Also, the AP or CP may be included in one IC package. The AP may control a plurality of hardware or software components connected to the AP by driving an operating system or application program, and may perform various data processing and operations including multimedia data. Here, the AP may be implemented as a system on chip (SoC). In addition, the CP may perform at least a part of a multimedia control function. In addition, the CP may use a subscriber identification module (eg, a SIM card) to perform identification and authentication of a terminal within a communication network. In this case, the CP may provide a service including a voice call, a video call, a text message, or packet data to the user. Also, the CP may control data transmission/reception of the communication module 260 . The AP or the CP may load and process a command or data received from at least one of a non-volatile memory or other components connected thereto to the volatile memory. In addition, the AP or the CP may store data received from at least one of the other components or generated by at least one of the other components in a non-volatile memory. The CP may perform a function of managing a data link and converting a communication protocol in communication between an electronic device including hardware and other electronic devices connected through a network. Here, the CP may be implemented as an SoC. Additionally, the processor may further include a graphic processing unit (GPU).

On the other hand, there are many variations depending on the convergence trend of digital devices, so it is impossible to enumerate all of them. It may further include components not mentioned above, such as. Also, in the electronic device 100 , a specific component may be excluded from the above components or may be replaced with another component according to the type of provision thereof.

In addition, the embodiments of the present disclosure disclosed in the present specification and drawings are merely provided for specific examples to easily explain the technical content of the present disclosure and help the understanding of the present disclosure, and are not intended to limit the scope of the present disclosure. Therefore, the scope of the present disclosure should be construed as including all changes or modifications derived from the technical spirit of the present disclosure in addition to the embodiments disclosed herein as being included in the scope of the present disclosure.

100: electronic device 110: communication module
120: input module 130: audio processing module
140: display module 150: storage module
160: control module

Claims (16)

One display showing multiple windows;
Including a; processor functionally connected to the display;
the processor is
displaying a first screen corresponding to a first application on a first window of the display;
displaying a second screen corresponding to a second application on a second window of the display;
When a first user input for moving a boundary line between the first window and the second window in a first direction is received, the position of the boundary line is changed in response to the first user input, so that the first screen Enlarging the first window to display a third screen including an additional area that was hidden due to the size of , and reducing the second window to display a fourth screen with reduced graphic objects output on the second screen
When receiving a second user input for moving the boundary line between the first window and the second window in a second direction different from the first direction, in response to the second user input, changing the position of the boundary line Accordingly, the first window is reduced to output a fifth screen including only a part of the first screen, and the second window is enlarged to display a sixth screen in which the graphic object of the second screen is enlarged,
The first screen, the third screen, and the fifth screen are screens according to the execution of the same first application, and the second screen, the fourth screen, and the sixth screen are screens according to the execution of the same second application characterized by an electronic device.
According to claim 1,
The first application includes a music playback application,
the processor is
While the screen displayed on the first window is changed from the first screen to the fifth screen, removing the album image from the first screen and controlling to display a virtual controller related to music playback on the fifth screen Electronic device, characterized in that.
According to claim 1,
the processor is
and controlling to generate the third screen by adding a new graphic object at a location spaced apart from a boundary of the first screen by a predetermined distance.
According to claim 1,
the processor is
generating the third screen or the fourth screen based on a graphic object disposed at a location spaced apart from the boundary line of the first screen or the second screen by a predetermined distance;
and generating the fourth screen by reducing a size of a graphic object disposed at a location spaced apart from a boundary of the second screen by a predetermined distance.
According to claim 1,
the processor is
and controlling to change a display size of information displayed on the second screen while the screen displayed on the second window is changed from the second screen to the fourth screen.
According to claim 1,
the processor is
while the screen displayed on the second window is changed from the second screen to the fourth screen, controlling the display size of the information displayed on the second screen to be enlarged and displayed corresponding to the enlarged size of the second window characterized by an electronic device.
According to claim 1,
the processor is
Electronic, characterized in that while the screen displayed on the second window is changed from the second screen to the fourth screen, controlling to generate the fourth screen by changing the arrangement of information displayed on the second screen Device.
According to claim 1,
the processor is
Controlling to generate the sixth screen by changing the display positions of graphic objects displayed on the second screen while the screen displayed on the second window is changed from the second screen to the sixth screen electronic device.
In the multi-window operating method of an electronic device,
displaying a second screen corresponding to the second application on the second window of the display while displaying the first screen corresponding to the first application on the first window of the display;
When a first user input for moving a boundary line between the first window and the second window in a first direction is received, the position of the boundary line is changed in response to the first user input, so that the first screen A first method for enlarging the first window to display a third screen including an additional area that was hidden due to the size of movement; or
When receiving a second user input for moving the boundary line between the first window and the second window in a second direction different from the first direction, changing the position of the boundary line in response to the second user input Accordingly, a second operation of reducing the first window to output a fifth screen including only a part of the first screen and enlarging the second window to display a sixth screen in which the graphic object of the second screen is enlarged ; including any one of the actions,
that the first screen, the third screen, and the fifth screen are screens according to the execution of the same first application, and the second screen, the fourth screen, and the sixth screen are screens according to the execution of the same second application A method for operating a multi-window of an electronic device, characterized in that.
10. The method of claim 9,
The second application includes a music playback application,
The first operation is
removing an album image from the first screen and displaying a virtual controller related to music reproduction on the third screen while the screen displayed on the first window is changed from the first screen to the third screen; A method for operating a multi-window of an electronic device, comprising:
10. The method of claim 9,
The second operation is
and generating the third screen by adding a new graphic object at a location spaced apart from the boundary line of the first screen by a predetermined distance.
10. The method of claim 9,
The first operation is
generating the third screen or the fourth screen based on a graphic object disposed at a location spaced apart from the boundary line of the first screen or the second screen by a predetermined distance;
and generating the fourth screen by reducing the size of a graphic object disposed at a location spaced apart from the boundary of the second screen by a predetermined distance.
10. The method of claim 9,
The first operation is
and changing a display size of information displayed on the second screen while the screen displayed on the second window is changed from the second screen to the fourth screen. How to operate windows.
10. The method of claim 9,
The first operation is
while the screen displayed on the second window is changed from the second screen to the fourth screen, enlarging and displaying the display size of the information displayed on the second screen corresponding to the enlarged size of the second window; A multi-window operating method of an electronic device, comprising:
10. The method of claim 9,
The first operation is
and generating the fourth screen by changing the arrangement of information displayed on the second screen while the screen displayed on the second window is changed from the second screen to the fourth screen. A multi-window operation method of an electronic device with
10. The method of claim 9,
The second operation is
and generating the sixth screen by changing the arrangement of information displayed on the second screen while the screen displayed on the second window is changed from the second screen to the sixth screen. A multi-window operation method of an electronic device with

Images