KR20220061797A - Electronic device and screen control method thereof - Google Patents

Abstract

An electronic device and a screen control method thereof are disclosed. The electronic device includes: a display; and at least one processor connected to the display. The at least one processor can display a plurality of elements on a screen area of the display, receive a user input requesting resizing of the screen area, identify a core element among the plurality of elements, and display the resized screen area based on the received user input and the core element. In the resized screen area, the size of a window including the core element can be displayed in response to the changed size of the screen area. Various other embodiments are possible. Therefore, the present invention can reflect the needs of a user according to the size change of the screen area.

Description

Electronic device and screen control method thereof

The present disclosure relates to an electronic device and a screen control method thereof.

In an electronic device including a display, when the size of a window displayed on a screen area is changed, a layout configured to suit the size change of the window is required.

Recently, the use of a flexible type electronic device capable of changing a physical shape of a screen area is spreading. For example, in the case of a foldable type, rollable type, or slideable type smartphone, by adopting a structure capable of expanding or reducing the screen area, it provides a wide screen by expanding the screen size as needed while maintaining excellent portability can do.

Unlike the case in which the screen area is fixed, the flexible type electronic device may have various screen shapes according to usage states (eg, roll-in/roll-out state, slide-in/slide-out state). Therefore, the layout configuration method used for the fixed screen may not be suitable for application to the variable screen of the flexible type electronic device.

When the size of the screen area is physically variable, a user interface (UI)/user experience (UX) different from that of the fixed screen area may be required.

For example, if an electronic device having a fixed display is focused on how to display information on a fixed screen, the flexible type electronic device determines how the screen expands or contracts, and the information desired by the user on the flexible screen is reflected. The focus is on how to effectively show

Various embodiments may provide an electronic device and a method for controlling a screen thereof, capable of recognizing a user's intention according to a change in the size of a screen area and effectively displaying and delivering information desired by the user.

Various embodiments may provide an electronic device and a method for controlling a screen thereof, enabling a core function to be used at a size suitable for a user's request when the screen area is enlarged/reduced.

The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. There will be.

An electronic device according to various embodiments may include a display and at least one processor connected to the display. The at least one processor displays a plurality of elements on a screen area of the display, receives a user input for changing a size of the screen area, identifies a key element among the plurality of elements, and the received user A screen area re-sized based on an input and the key element is displayed, and in the resized screen area, the size of a window including the key element is set to be displayed corresponding to the changed size of the screen area can be

According to various embodiments of the present disclosure, a method for controlling a screen of an electronic device including a display includes displaying a plurality of elements on a screen area of the display, receiving a user input for changing a size of the screen area, and It may include an operation of identifying a core element among the elements, and an operation of displaying a re-sized screen area based on the received user input and the core element. In the size-changed screen area, a size of a window including the key element may be displayed corresponding to the changed size of the screen area.

According to various embodiments, a user's needs according to a change in the size of the screen area may be reflected, and information desired by the user may be effectively displayed and delivered.

According to various embodiments, when the screen area is enlarged/reduced, it is possible to use a core function with a size suitable for a user's request.

In addition, various effects directly or indirectly identified through the present disclosure may be provided.

1 is a block diagram of an electronic device according to an exemplary embodiment.
2 is a flowchart illustrating a screen control method of an electronic device according to an exemplary embodiment.
3A, 3B, and 3C are screen examples of an electronic device according to an exemplary embodiment.
4, 5, 6, 7, 8, 9, 10, 11, 12, and 13 are screen examples of an electronic device having a variable form factor according to an embodiment.
14 is a flowchart illustrating a screen control method of an electronic device according to an exemplary embodiment.
15 is a screen example of an electronic device having a fixed form factor according to an embodiment.
16 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure;

Hereinafter, various embodiments are described with reference to the accompanying drawings.

1 is a block diagram of an electronic device according to an exemplary embodiment.

Referring to FIG. 1 , an electronic device 100 according to an embodiment may include a display 110 and at least one processor 120 . The display 110 and the processor 120 included in the electronic device 100 may be electrically and/or operatively connected to each other to exchange signals (eg, commands or data) with each other.

The electronic device 100 may include at least a part of the electronic device 1600 illustrated in FIG. 16 , which will be described later. For example, the display 110 may include the display module 1660 of FIG. 16 . The processor 120 may include at least a portion of the processor 1620 of FIG. 16 .

The display 110 may include a screen area in which content is displayed according to the control of the processor 120 or a user's manipulation. The screen area may mean any one of a physical screen, a virtual screen, a full screen, or at least a part of the full screen of the display 110 . For example, when the display 110 has a variable form factor, the physical screen area of the display 110 may be changed by a user input (eg, roll-in/roll-out input, slide-in/slide-out input). The size may be changed. When the display 110 has a fixed form factor, the size of the screen area being displayed on the display 110 is changed by a user input (eg, touch and spread input or pinch zoom in/out for two points on the screen area boundary) (eg zoom in/out).

The processor 120 may display a plurality of elements on the screen area of the display 110 .

Each element may be a component of the screen area. Each element may be various types of displayable elements. For example, the element may be at least one of text, image, video, banner, icon, button, menu, javascript, function object, object, object group, symbol, symbol group, blank, item, item group, content . Each element may be a graphic element (or a user interface (UI)/user experience (UX) element or a visual element).

For example, the plurality of elements may be elements related to a first application (eg, a foreground application). Some of the plurality of elements may be elements related to a first application (eg, a foreground application), and others may be elements related to a second application (eg, a background application, a launcher application). Some of the plurality of elements may be elements related to a first screen (eg, a current screen, a basic screen), and others may be elements related to a second screen (eg, a previous screen or a home screen).

The processor 120 may receive a user input for changing (eg, enlarging or reducing) the size of the screen area of the display 110 .

For example, the display 110 may be a rollable display. In this case, the user input for changing the size of the screen area may be an input according to a rolling operation for changing the screen size of the rollable display. The rolling operation may be a manual rolling operation of a user or an automatic or semi-automatic rolling operation by a driving body (eg, a motor) included in the electronic device 100 according to a user input. The display 110 may be a slideable display. In this case, the user input for changing the size of the screen area may be an input according to a sliding operation for changing the screen size of the slideable display. The sliding operation may be a manual sliding operation by a user or an automatic or semi-automatic sliding operation by a driving body (eg, a motor) included in the electronic device 100 according to a user input.

For example, the user input includes a roll-out input for enlarging the size of the screen area, a roll-in input for reducing the size of the screen area, a slide-out input for increasing the size of the screen area, and reducing the size of the screen area. It may be any one of a slide-in input to increase or decrease the size of a window displayed on the screen area (eg, multi-touch and spread).

The processor 120 may identify a core element among a plurality of elements displayed on the screen area.

For example, all of the plurality of elements displayed on the screen area may be elements related to the first application (eg, a music app). Some of the plurality of elements displayed on the screen area may be elements related to a first application (eg, a music app), and others may be elements related to a second application (eg, a chatting app).

For example, the key element may include at least one object, a region including at least one object, or an expanded/reduced state (eg, a full screen state, a state displayed as one of multi-windows, a mini-cropped ( It may be any one of windows of (mini cropped) state and floating state).

The processor 120 may display a re-sized (eg, enlarged or reduced) screen area based on the changed size and key elements of the screen area. In the size-changed screen area, a size of a window including the key element may be displayed corresponding to the changed size of the screen area.

The changed size of the screen area of the display 110 and the size of a window including a key element in the screen area may be linked with each other. For example, as the size of the screen area increases, the size of a window including a key element may increase. As the size of the screen area is increased, the size of the window including the key element may be reduced. As the size of the screen area is reduced, the size of the window including the key element may be increased. As the size of the screen area is reduced, the size of the window including the key element may be reduced.

For example, in the screen area of the display 110 and the resized screen area, the display of the key element may be maintained regardless of the size change. The display size and display state of the key element may be maintained regardless of the changed size of the screen area. Alternatively, the display size and display state of the key element may be changed according to the changed size of the screen area.

The size of the window including the key element may be changed (eg, enlarged or reduced) according to the changed size of the screen area. According to the changed size of the screen area and the size of the window (eg, first application area, foreground application area, current screen area), the second window (second application area, background application area, launcher application area, previous screen area) may be enlarged or reduced.

For example, as the size of the screen area is enlarged, the display of the key element may be maintained in the window among the enlarged screen area, and peripheral elements of the key element may gradually disappear or be reduced. In the second window of the enlarged screen area, a plurality of elements may be gradually displayed or enlarged.

For example, as the size of the screen area is reduced, the display of the key element may be maintained in the window among the reduced screen area, and peripheral elements of the key element may appear or enlarged gradually. In the second window among the reduced screen areas, a plurality of elements may gradually disappear or be reduced.

A key element is a touch input (eg, touch, multi-touch, tap, double tap, long tap, touch and hold, tap and hold, press, spread, pinch, etc.) for at least a portion of the screen area displayed on the display 110 . can be identified based on The touch input includes a touch input received while maintaining a user input for changing the size of the screen area, a touch input received within a predetermined time (eg 1 to 3 seconds) before the user input, and a predetermined time (eg, 1 to 3 seconds) after the user input. 3 seconds) may be any one of the received touch inputs.

The electronic device 100 according to an embodiment may further include a memory (eg, the memory 1630 of FIG. 16 ). The memory may store default information or priority information described in an embodiment.

The core element may be identified based on default information for each screen area size. Default information for each screen area size may be previously stored, and a key element may be identified based on the default information for each screen area size. The default information for each size of the screen area may be previously stored in the memory of the electronic device 100 .

For example, the default information for each screen area size may include the size of the screen area and information on a key element corresponding to the size of the screen area. The default information for each screen area size may further include information on a first window including the key element and an area (eg, a second window) excluding the first window among the screen areas.

For example, when a key element is selected by the user in a state in which the screen area is enlarged/reduced, the processor 120 may display information on the current screen (eg, identification information of a key element and a key element among the enlarged/reduced screen area). Information on the size of the first window including the element and information on the area excluding the first window among the enlarged/reduced screen area) may be stored by matching the enlarged/reduced size of the screen area.

Priority information for designating priorities of at least some of the plurality of elements displayed on the screen area may be stored in advance. In this case, the processor 120 may determine at least one element to be displayed on the resized screen area based on the changed size, key element, and priority information of the screen area. The priority information may be stored in advance in the memory of the electronic device 100 .

For example, for elements related to a first application (eg, a music app), a play button (ranked 1), a music profile picture (ranked 2), a status bar (ranked 3), a pause button (ranked 4), and pause The priority may be set in the order of the button and the fast forward button (fifth priority). In this case, when the play button is selected as a key element by the user, one or more elements to be additionally displayed in the first window including the play button may be determined according to priority.

In the case of elements having a low priority, they may not be displayed on the screen area, reduced or deformed and displayed according to the size of the first window.

While a user input for changing the size of the screen area (eg, slide-in/out input, roll-in/out input) is received, or according to a user input for changing the size of the screen area, the size of the screen area is changed In the meantime, a touch input may be received for a key element in the screen area or a region corresponding to the core element. The size of the screen area may be changed according to the user input. A key element may be identified (selected) by the touch input.

As the screen area is expanded/reduced, the size of the window including the key element may be changed. The size of the window including the core element may be fixed based on the release of the touch input to the core element or the touch input to the area corresponding to the core element. When the user input for changing the size of the screen area is maintained while the size of the window including the key element is fixed by releasing the touch input, the screen area may be expanded/reduced independently of the fixed size of the window there is.

2 is a flowchart illustrating a screen control method of an electronic device according to an exemplary embodiment.

The screen control method illustrated in FIG. 2 may be performed by an electronic device (eg, the electronic device 100 or the processor 120 of FIG. 1 ). For convenience, it is assumed that each operation is performed under the control of the processor 120 of FIG. 1 . The processor 120 may be set to perform at least some of the operations of the screen control method according to an embodiment. In various embodiments, at least one of operations 210 to 240 may be omitted, the order of some operations may be changed, or other operations may be added.

Referring to FIG. 2 , the screen control method according to an embodiment may include operations 210 to 240 .

In operation 210 , the processor 120 may display a plurality of elements on the screen area of the display 110 . For example, the plurality of elements may be graphic elements (or UI/UX elements or visual elements) related to the first application or the second application. Each of the plurality of elements may include at least one object.

In operation 220 , the processor 120 may receive a user input for changing (eg, enlarging or reducing) the size of the screen area of the display 110 . For example, the user input includes a roll-out input for increasing the size of the screen area, a roll-in input for reducing the size of the screen area, a slide-out input for increasing the size of the screen area, and a It may be any one of a slide-in input for reducing the size and a touch input (eg, spread, pinch) for enlarging or reducing the size of a window displayed on the screen area.

In operation 230 , the processor 120 may identify a core element among a plurality of elements displayed on the screen area of the display 110 .

The key element may be identified based on a touch input to at least a part of the screen area.

The touch input includes a touch input received while maintaining the user input, a touch input received within a predetermined time (eg, 1 second) before the user input, and a touch input received within a predetermined time (eg, 1 second) after the user input. It can be any one.

The key element may be identified based on default information for each screen area size. Default information for each screen area size may be stored (or set) in advance by a user. The screen control method according to an embodiment may further include the operation of storing default information for each size of the screen area.

Priority information for designating a priority of at least some of the plurality of elements displayed on the screen area of the display 110 may be stored in advance. In this case, the processor 120 may determine at least one element to be displayed on the size-changed screen area based on the changed size, key element, and priority information of the screen area of the display 110 . For example, the at least one element may be one or more elements selected based on the changed size and priority information of the screen area among surrounding elements displayed adjacent to the core element. The screen control method according to an embodiment may further include the operation of storing priority information for designating priorities of at least some of the plurality of elements displayed on the screen area. In operation 240, the processor 120 ) may display a re-sized screen area based on the changed size and key elements of the screen area of the display 110 . In the size-changed screen area, a size of a window including a key element may be displayed corresponding to the changed size of the screen area.

In the screen area whose size has been changed (eg, expanded/reduced), the display of key elements may be maintained. The display of the key element may be maintained irrespective of the size change of the screen area (or independent of the size change). The display size or display form of the core element or the window including the core element may be changed in association with a change in the size of the screen area.

For example, a first application (eg, a music app) may be displayed in a first form (eg, one of a full screen and a multi-window) in the screen area before the size change. When expanding/reducing the screen area, only key elements selected by the user's touch input (eg, tap and hold) may be activated and displayed in a second form (eg, mini-cropped window). .

The size of the window including the key element may be changed (eg, enlarged or reduced) corresponding to the size of the screen area.

For example, as the size of the screen area is enlarged, the size of the window including the key element may be gradually reduced (or enlarged) and displayed. As the size of the screen area is reduced, the size of the window including the key element may be gradually enlarged (or reduced) and displayed.

While a user input for changing the size of the screen area is received, or while the size of the screen area is changed (eg, enlarged or reduced) according to the user input, a key element or an area corresponding to the key element is placed on the screen area. A touch input may be received. The processor 120 may identify the core element based on a touch input to the core element or an area corresponding to the core element.

While the size of the screen area is being changed, a touch input for at least a part of the screen area may be received and released. The size of the window including the key element may be fixed based on the release of the touch input. FIGS. 3A, 3B, and 3C are examples of screens of an electronic device according to an embodiment, and an operation of identifying a key element ( Example: This is to explain operation 230 of FIG. 2 .

Reference numerals 310, 312, and 314 are examples of selection areas. Reference numerals 320, 322, and 324 are examples of objects. Reference numeral 330 exemplifies a pivot of the first object 330 . Reference numeral 332 exemplifies the center of the selection area including the first object 322 and the second object 324 . Reference numeral 334 exemplifies the center of the selection area 314 including a plurality of objects.

Referring to FIG. 3A , the processor 120 may identify a key element based on a touch input (eg, a tap, a long tap, a tap and hold, and a press) to the first object 320 being displayed. For example, when the user taps and holds the first object 320 to select the first object 320 as a key element, the first object 320 or the first area including the first object 320 . 310 may be selected as the key element. The processor 120 may identify the center 330 of the object or region selected as a key element.

Referring to FIG. 3B , the processor 120 may identify a key element based on a touch input (eg, multi-touch) for the first object 322 and the second object 324 that are being displayed. For example, when the user selects the first object 322 and the second object 324 with a multi-touch or touches an intermediate point between the first object 322 and the second object 324, the two objects 322 , 324 , or a second region 312 including two objects 322 , 324 may be selected as a key element. The processor 120 may identify the center 332 of the object or region selected as a key element.

Referring to FIG. 3C , the processor 120 may identify a key element based on a touch input (eg, multi-touch, spread) for selecting a specific area. For example, when the user selects the third area 314 including a plurality of objects by a multi-touch or spread operation on the third area 314 , the plurality of objects included in the third area 314 . , or the third region 314 may be selected as a key element. The processor 120 may identify a plurality of objects selected as a key element or a center 334 of the selected region.

When the size of the screen area is changed (eg, enlarged or reduced), a screen change may be performed based on a core element (eg, 310, 312, 314) or a center (eg, 330, 332, 334) of the core element. For example, when the screen area is enlarged/reduced and any one of the first area 310 , the second area 312 , and the third area 314 is selected as a key element, the center of the first area 310 is Based on 330 , the center 332 of the second area 312 , and the center 334 of the third area 314 , an enlarged/reduced screen area may be displayed. Among the enlarged/reduced screen areas, the size of the window including the first area 310 , the second area 312 , and the third area 314 identified as key elements may be varied in association with the size of the screen area. there is.

4 is an example of a screen of an electronic device according to an embodiment. 4 exemplifies a case in which the screen area is expanded while the play button 420 of the first application (eg, a music app) is touched.

When expanding, the size of the screen area may be expanded in the order of the first screen area 400 , the second screen area 402 , the third screen area 404 , and the fourth screen area 406 .

Reference numeral 400 denotes an example of a screen area before expansion. Reference numerals 402 and 404 are examples of screen areas in the expanding state. Reference numeral 406 is an example of a screen area in an expanded state.

A play button at reference numeral 420 is an example of a key element selected by the user. Reference numerals 410 , 412 , 414 , and 416 are examples of a first window including key elements. For example, at least one element (eg, an object) related to a first application (eg, a music app, a foreground app) may be displayed in the first windows 410 , 412 , 414 , and 416 . At least one element (eg, an object) related to a second application (eg, a chatting app, a launcher app, and a background app) may be displayed in the second windows 432 , 434 , and 436 .

In the case of reduction, the size of the screen area is reduced in the order of the fourth screen area 406 , the third screen area 404 , the second screen area 402 , and the first screen area 400 , opposite to the expansion direction. can be

A plurality of elements may be displayed in the screen area. For example, the first window 410 may be displayed on the first screen area 400 . A plurality of elements related to a first application (eg, a music app) may be displayed in the first window 410 . A first window 416 and a second window 436 may be displayed in the fourth screen area 406 . A play button 416 that is a key element related to a first application (eg, a music app) may be displayed in the first window 416 . Elements related to a second application (eg, a chatting app) may be displayed in the second window 436 .

While a plurality of elements are being displayed on the screen area, a user input (eg, a roll-out input or a slide-out input) for extending the size of the screen area may be received.

As the deformation state (eg, rolling state, sliding state) of the display 110 is changed by the user input, the screen area may be gradually expanded (in the order of 400 , 402 , 404 , 406 ).

While the user input is being received or the size of the screen area is changed according to the user input, the play button 420 or a user's touch input to the area corresponding to the play button 420 may be received. According to a user's touch input on the play button 420 , the play button 420 may be identified (selected) as a key element among the elements displayed on the screen area.

While the user input is received or the size of the screen area is changed according to the user input, the screen area gradually expands based on the play button 420 or the area corresponding to the play button 420, which is a key element can be displayed.

The size of the first windows 410 , 412 , 414 , and 416 including the play button 420 , which is a key element, may be changed (eg, expanded or reduced) in response to the expanded size of the screen area. For example, the sizes of the first windows 410 , 412 , 414 , and 416 may be inversely proportional to the size of the screen area. For example, as illustrated, as the size of the screen area increases, the sizes of the first windows 410 , 412 , 414 , and 416 may be gradually reduced and displayed. The sizes of the first windows 410 , 412 , 414 , and 416 may be proportional to the size of the screen area. In this case, as the size of the screen area increases, the sizes of the first windows 410 , 412 , 414 , and 416 may also gradually increase.

In this way, the screen area extended around the core element may be displayed, and the size of the screen area and the size of the window including the core element may be linked.

Accordingly, a user-centered intuitive UI/UX that reflects the user's needs and context can be implemented.

For example, when the screen area is expanded, the user may want to stop using a first application currently being used (eg, a music app) and use a previously used second application (eg, a chatting app) again. . In this case, by reducing the first application area being used and expanding and displaying the second application area, it is possible to provide an efficient UI/UX that meets the user's needs.

For example, in a state where a plurality of elements (eg, a play button and various objects of a music app) related to a first application (eg, a music app) are displayed on the screen area, the user touches the play button Assume that a slide-out operation is performed. In this case, the user's request may be to expand the entire screen area, leave the play button 420 when the screen area is expanded, and use the second application (eg, a chatting app).

As shown, the processor 120 identifies the play button 420 touched by the user as a key element and maintains the display of the play button 420, but as the size of the screen area expands, the play button 420 ) may be displayed by gradually reducing the size of the first windows 410 , 412 , 414 , and 416 (eg, the first application area).

In the expanded screen area, the play button 420, which is a key element, may remain activated. The processor 120 maintains the display of the play button 420, which is a key element, but gradually expands the sizes of the second windows 432, 434, and 436 (eg, the second application area) according to the expansion of the screen area. can be displayed

For example, in the first windows 412 , 414 , 416 (eg, first application area) including the play button 420 , which is a key element among the enlarged screen areas, the display of the play button 420 is maintained. During this time, surrounding elements of the play button 420 (eg, elements related to the first application) may gradually disappear or be reduced. In the second windows 432 , 434 , and 436 (eg, the second application area) among the enlarged screen areas, a plurality of elements (eg, elements related to the second application) may be gradually displayed or enlarged.

4 exemplifies a case in which the screen area is expanded and the size of the window including the key element is gradually reduced as the screen area is expanded.

Similarly, an embodiment in which the screen area is reduced and the size of the window including the key element is gradually enlarged as the screen area is reduced is possible.

The user may perform a slide-in operation while the expanded screen area is being displayed. In this case, the user's request may be to reduce the overall screen area, but return to the execution screen of the first application related to the play button 420 remaining as a key element when the screen area is reduced.

Accordingly, the size of the screen area may be gradually reduced in the order of reference numerals 406, 404, 402 and 400. In the reduced screen area, the display of the play button 420 which is a key element may be maintained, and the sizes of the first windows 416 , 414 , 412 , and 410 including the play button 420 may be gradually enlarged.

For example, when the size of the screen area is reduced, as the size of the screen area is reduced, the first windows 416 , 414 , 412 , 410 including the play button 420 , which is a key element among the reduced screen areas, are included. (eg, the first application area) is gradually enlarged, and elements surrounding the play button 420 (eg, elements related to the first application) appear gradually in the first windows 416 , 414 , 412 , and 410 . or can be enlarged. Among the reduced screen areas, the second windows 436, 434, 432 (eg, the second application area) are gradually reduced, and a plurality of elements (eg, the second application and the second window 436, 434, 432) related elements) may gradually disappear or be reduced.

5 is an example of a screen of an electronic device according to an embodiment. 5 exemplifies a case in which the screen area is expanded while the music profile picture 520 of the first application (eg, music app) is touched.

In the case of expansion, the screen area may be expanded in the order of reference numerals 500, 502, and 504.

Reference numeral 500 is an example of a screen area before expansion. Reference numeral 502 denotes an example of a screen area in an expanding state. Reference numeral 504 denotes an example of a screen area in an expanded state.

The music profile picture at reference numeral 520 is an example of a key element selected by the user. Reference numerals 510, 512, and 514 are examples of the first window including key elements. For example, elements (eg, objects) related to a first application (eg, a music app, a foreground app) may be displayed in the first windows 510 , 512 , and 514 . Elements (eg, objects) related to a second application (eg, a chatting app, a launcher app, and a background app) may be displayed in the second windows 532 and 534 .

As the size of the overall screen area is gradually increased, the sizes of the first windows 510 , 512 , and 514 including the music profile picture 520 , which are key elements, may be gradually reduced and displayed.

As the size of the screen area is enlarged, the display of the music profile picture 520, which is a key element, is maintained in the first windows 510, 512, and 514 of the enlarged screen area, and surrounding elements of the music profile picture 520 are maintained. Elements (eg, objects in the music app) may gradually disappear or shrink. Upon expansion, in the first windows 510 , 512 , and 514 , the music profile picture 520 may remain activated. As the size of the screen area is enlarged, in the second windows 532 and 534 of the enlarged screen area, a plurality of elements (eg, objects of a chatting app) may gradually appear or be enlarged.

When reducing, the screen area may be reduced in the order of reference numerals 504, 502, and 500. Referring to FIG.

As the size of the overall screen area is gradually reduced, the sizes of the first windows 514 , 512 , and 510 including the music profile picture 520 , which are a key element, may be gradually enlarged and displayed.

As the size of the screen area is reduced, the display of the music profile picture 520, which is a key element, is maintained in the first windows 514, 512, and 510 among the reduced screen areas, and elements surrounding the music profile picture 520 are maintained. Elements (eg objects in a music app) may appear or expand gradually.

Upon reduction, in the first windows 514 , 512 , and 510 , the music profile picture 520 may remain active. As the size of the screen area is reduced, in the second windows 534 and 532 of the reduced screen area, a plurality of elements (eg, objects of a chatting app) may gradually disappear or be reduced.

6 is an example of a screen of an electronic device according to an embodiment. 6 exemplifies a case in which the screen area is expanded while the button area 620 of the first application (eg, a music app) is selected.

In the case of expansion, the screen area may be expanded in the order of 600, 602, 604, and 606.

Reference numeral 600 denotes an example of a screen area before expansion. Reference numerals 602 and 604 are examples of screen areas in an expanding state. Reference numeral 606 is an example of a screen area in an expanded state.

A button area at reference numeral 620 is an example of a key element selected by the user. Reference numerals 610 , 612 , 614 , and 616 are examples of a first window including key elements.

As the size of the screen area is gradually increased, the sizes of the first windows 610 , 612 , 614 , and 616 including the button area 620 , which are key elements, may be gradually reduced and displayed. In the first window (610, 612, 614, 616) of the enlarged screen area, the display of the button area 620, which is a key element, is maintained, and elements surrounding the button area 620 (eg, objects of the music app) are maintained. ) may gradually disappear or be reduced. Upon expansion, in the first windows 610 , 612 , 614 , and 616 , the button region 620 may remain activated. As the size of the screen area is enlarged, in the second windows 632 , 634 , and 636 of the enlarged screen area, a plurality of elements (eg, objects of a chatting app) may gradually appear or be enlarged.

When reducing, the screen area may be reduced in the order of reference numerals 606, 604, 602, and 600. FIG.

As the size of the screen area is gradually reduced, the sizes of the first windows 610 , 612 , 614 , and 616 including the button area 620 , which are key elements, may be gradually enlarged and displayed.

As the size of the screen area is reduced, in the first window (610, 612, 614, 616) of the reduced screen area, the display of the button area 620, which is a key element, is maintained, and the music profile picture 620 is Elements (eg objects in a music app) may appear or expand gradually. Upon reduction, in the first windows 610 , 612 , 614 , and 616 , the button region 620 may remain activated. As the size of the screen area is reduced, in the second windows 632 , 634 , and 636 among the reduced screen areas, a plurality of elements (eg, objects of a chatting app) may gradually disappear or be reduced.

7 is an example of a screen of an electronic device according to an embodiment.

The display 110 of the electronic device 100 illustrated in FIG. 7 may be a vertically rollable type display having a variable form factor. The screen area is the area of the display 110 that is visually exposed as substantially the front side of the electronic device, and is either extended vertically or can be reduced Multi-windows 710 and 730 may be displayed on the display 110 .

7 illustrates a case in which a screen area is vertically reduced by a user input (eg, a roll-in input) while the play button 720 of a first application (eg, a music app) is selected by a user's touch input. to exemplify

When reducing, the screen area may be reduced in the order of 700, 702, 704, 706, 708, and 709.

Reference numeral 700 is an example of a screen area before reduction. Reference numerals 702, 704, 706 and 708 are examples of screen areas in a state of being reduced. Reference numeral 709 denotes an example of a screen area in a reduced state.

The play button at reference numeral 720 is an example of a key element selected by the user. Reference numerals 710 , 712 , 714 , 716 , 718 and 719 are examples of a first window including key elements. Reference numerals 730, 732, 734, 738 and 739 are examples of the second window. Elements related to the first application (eg, a music app) may be displayed in the first windows 710 , 712 , 714 , 716 , 718 , and 719 . Elements related to a second application (eg, a chatting app) may be displayed on the second windows 730 , 732 , 734 , 738 , and 739 .

As the size of the screen area is gradually reduced, the size of the first windows 710 , 712 , 714 , 716 , 718 , and 719 including the play button 720 , which is a key element, may be gradually reduced and displayed. In the first window (710, 712, 714, 716, 718, 719), the display of the play button 720, which is a key element, is maintained, and elements surrounding the play button 720 (eg, objects of the music app) This may gradually disappear or be reduced. Upon reduction, in the first windows 710 , 712 , 714 , 716 , 718 , and 719 , the play button 720 may remain activated. Regardless of the size reduction of the screen area, the sizes of the second windows 730 , 732 , 734 , 738 , and 739 may be fixedly maintained. When the reduction is completed, the first window 719 including only the play button 720, which is a key element, may remain in the screen area as a floating window. The user can use the core function using the play button 720, which is a key element, regardless of the expansion/reduction of the screen area.

In the case of expansion, the screen area may be expanded in the order of reference numerals 709, 708, 706, 704, 702, and 700.

As the size of the screen area gradually expands, the sizes of the first windows 719 , 718 , 716 , 714 , 712 , and 710 including the play button 720 , which are a key element, may be gradually enlarged and displayed. In the enlarged first window 719, 718, 716, 714, 712, 710, the display of the play button 720, which is a key element, is maintained, and elements surrounding the play button 720 (eg, an object of the music app) ) may appear gradually or be enlarged. Upon enlargement, in the first windows 719 , 718 , 716 , 714 , 712 , and 710 , the play button 720 may be maintained in an activated state. Regardless of the enlargement of the size of the screen area, the sizes of the second windows 739 , 738 , 736 , 734 , 732 , and 730 may be fixedly maintained.

8 is an example of a screen of an electronic device according to an embodiment.

In FIG. 8 , the display 110 of the electronic device 100 may be a horizontally rollable type display having a variable form factor. The screen area is the area of the display 110 that is visually exposed to the substantially front side of the electronic device, and is horizontally expanded or can be reduced Multi-windows 810 and 830 may be displayed on the display 110 .

8 exemplifies a case in which the screen area is reduced in the horizontal direction while the play button 820 of the first application (eg, a music app) is selected by a user's touch input.

When reducing, the screen area may be reduced in the order of reference numerals 800, 802, 804, and 806.

Reference numeral 800 denotes an example of a screen area before reduction. Reference numerals 802 and 804 are examples of screen areas in a shrinking state. Reference numeral 806 denotes an example of a screen area in a reduced state.

A play button at reference numeral 820 is an example of a key element selected by the user. Reference numerals 810, 812, 814, and 816 are examples of the first window including key elements. Reference numerals 830, 832, 834, and 836 are examples of the second window. Elements related to a first application (eg, a music app) may be displayed in the first windows 810 , 812 , 814 , and 816 . Elements related to a second application (eg, a chatting app) may be displayed in the second windows 830 , 832 , 834 , and 836 .

As the size of the screen area is gradually reduced, the sizes of the first windows 810 , 812 , 814 , and 816 including the play button 820 , which are key elements, may be gradually reduced and displayed. Upon reduction, in the first window 810 , 812 , 814 , and 816 , the display of the play button 820 , which is a key element, is maintained, and elements surrounding the play button 820 (eg, objects of the music app) are displayed. It may gradually disappear or be reduced. Upon reduction, in the first windows 810 , 812 , 814 , and 816 , the play button 820 may remain activated.

When the size of the screen area is larger than the size of the second window (eg, screen areas 800, 802, 804), the size of the second windows 830, 832, and 834 is fixed regardless of the size reduction of the screen area. can be When the size of the screen area is reduced to less than or equal to the size of the second window (eg, screen area 806), the reduced first window 816 is overlapped with a part of the second window 836 (mini-cropped window) ) can be expressed as

When the reduction is completed, the reduced first window 816 including the play button 820, which is a key element, may remain in the screen area in a mini-cropped state. The user can use the core function using the play button 820, which is a key element, regardless of the expansion/reduction of the screen area.

In the case of extension, the screen area may be extended in the order of reference numerals 806, 804, 802 and 800.

As the size of the screen area gradually expands, the sizes of the first windows 816 , 814 , 812 , and 810 including the play button 820 , which are key elements, may be gradually enlarged and displayed. Upon enlargement, in the first window 816 , 814 , 812 , 810 , the display of the play button 820 , which is a key element, is maintained, and elements surrounding the play button 820 (eg, objects of the music app) are displayed. It may appear gradually or be enlarged. Upon enlargement, in the first windows 816 , 814 , 812 , and 810 , the play button 820 may be maintained in an activated state. When the size of the screen area becomes larger than the size of the second window (eg, screen areas 804, 802, 800), the size of the first window 816, 814, 812, 810 gradually expands, and Regardless, the sizes of the second windows 834 , 832 , and 830 may be fixedly maintained.

9 is an example of a screen of an electronic device according to an embodiment.

In FIG. 9 , the display 110 of the electronic device 100 may be a horizontally rollable type display having a variable form factor. Multi-windows 930 and 910 may be displayed on the screen area of the display 110 before reduction. 9 exemplifies a case in which the screen area is horizontally reduced while the play button 920 of the first application (eg, a music app) is selected by a user's touch input.

In the example of FIG. 9 , elements related to a first application (eg, a music app) are included in the first windows 910 , 912 , and 914 displayed in the mini-cropped state/or floating state. The second windows 930 , 932 , and 934 include elements related to a second application (eg, a chatting app).

When reducing, the screen area may be reduced in the order of reference numerals 900, 902, and 904.

Reference numeral 900 is an example of a screen area before reduction. Reference numeral 902 denotes an example of a screen area in a reduced state. Reference numeral 904 denotes an example of a screen area in a reduced state.

When the size of the screen area is reduced to the size of the second windows 930 , 932 , and 934 , the first windows 910 and 912 displayed in the mini-cropped state according to the size reduction of the screen area are displayed in the floating state. One window 914 may be changed and displayed.

Accordingly, the first window 914 may be reduced to a minimum size including only the play button 920 , and the user opens a second application (eg, a chatting app) through the second windows 930 , 932 , and 934 . freely available. The first window 914 in the floating state may be moved according to a user's touch input.

In the case of expansion, the screen area may be expanded in the order of reference numerals 904, 902, and 900.

10 is an example of a screen of an electronic device according to an embodiment.

10 exemplifies a case in which the screen area is horizontally expanded while the play button 1020 of the first application (eg, a music app) is selected by a user's touch input.

In the case of expansion, the screen area may be expanded in the order of reference numerals 1000, 1002, 1004, and 1006.

Reference numeral 1000 is an example of a screen area before expansion. Reference numerals 1002 and 1004 are examples of screen areas in an expanding state. Reference numeral 1006 denotes an example of a screen area in an expanded state.

The size of the screen area may be gradually expanded according to a user input (eg, a horizontal roll-out input).

When the screen area is expanded, the play button 1020 may be identified as a key element based on a user's touch input to the play button 1020 .

As shown, as the screen area is expanded, the size of the first windows 1010 , 1012 , and 1014 (eg, the music app area) including the play button 1020 which is a key element and the second windows 1032 and 1034 , 1036) (eg, a chatting app area) may have a variable size.

While the size of the screen area is extended, a touch input to at least a part of the screen area may be received and released. Based on the release of the touch input, the size of the first window 1014 including the play button 1020, which is a key element, may be fixed.

For example, when the size of the screen area is expanded by a user input (eg, a roll-out input) while the user touches the play button 1020 , the size of the first windows 1010 , 1012 , and 1014 is It may be reduced according to the size of the screen area. According to a touch input to the play button 1020 , the play button 1020 may be identified as a key element. An expanded screen area may be displayed based on the play button 1020 which is a key element. The size of the first windows 1010 , 1012 , and 1014 including the play button 1020 , which is a key element, may be gradually reduced in response to the size of the expanded screen area.

Based on the release of the touch input, the size of the first window 1014 including the play button 1020, which is a key element, may be fixed.

Reference numerals 1004 and 1006 illustrate a screen area in which the size of the first window 1004 is fixed.

For example, the user may extend the screen area of the display 110 by performing a roll-out operation while touching the play button 1020 with a finger. When the user releases the touch input to the play button 1020 by releasing the user's finger while the screen area is expanding, the size (and display state) of the first window 1014 (eg, the music app window) is changed in response to the touch release time. can be fixed. Thereafter, even if the user resumes the expansion of the screen area by the roll-out operation, the size and display state of the first window 1014 may be maintained as it is, independently of the screen area expansion (extension from 1004 to 1006).

11 is an example of a screen of an electronic device according to an embodiment.

When the play button 1120 is selected as the core element based on the user's touch input, the core element selected by the user or default information about the window 1100 including the core element may be stored.

For example, when a touch input (eg, a long tap) for the play button 1120 on the reduced window 1100 occurs, the processor 120 responds to the touch input, the reduced window 1100 In the vicinity, a default setting icon 1140 for setting the reduced window 1100 as a default core element may be displayed.

When the default setting icon 1140 is selected by the user, information on the size (and display state) of the reduced window 1100 is matched with the current size of the screen area and stored as default information for each screen area size. there is. The default information may be freely modified or changed by the user through settings (not shown) of the electronic device 100 .

12 and 13 are screen examples of an electronic device according to an exemplary embodiment.

Default information for each screen area size may be utilized in various ways.

For example, when the user does not separately select a key element when the display 110 is expanded/reduced, a predefined operation (enlargement/reduction operation of the first window) may be executed. Referring to FIG. 12 , as the display 110 expands, the first windows 1200 , 1202 , 1204 , and 1206 displayed on the screen area of the display 110 may gradually expand.

When the user presets a core element or a window including the core element as a default core element and expands/reduces the display 110 , the default core is irrespective of a touch input generated when the display 110 is expanded/reduced. A screen area of the display 110 may be displayed based on an object or window set as an element. Even when the user does not separately select a key element when the display 110 is expanded/reduced, the display 110 is based on the key element or the first window including the key element designated in the pre-stored default information for each size of the screen area. may be displayed.

Referring to FIG. 13 , when expanding, the screen area may be expanded in the order of reference numerals 1300 , 1302 , 1304 , and 1306 .

When default information for setting the first window (eg, 1316 ) in a reduced state including the play button 1320 or the play button 1320 as the default key element is stored, as the display 110 expands, the default key element An expanded screen area of the display 110 may be displayed based on the first window 1316 or the play button 1320 set to .

When the screen areas 1300 , 1302 , 1304 , and 1306 are expanded, the sizes of the first windows 1310 , 1312 , 1314 , and 1316 set as key elements may be gradually reduced according to the expanded size of the screen area.

When a default core element is designated in advance, even if there is a touch input to a partial area 1325 of the screen area, the core element may not be changed.

In this case, in order for the user to directly select the core element, it may be necessary to cancel the setting of the previously set default core element. When the user selects a core element when the display 110 is expanded/reduced after setting the default core element is released, a screen area to be expanded/reduced based on the core element selected by the user may be displayed.

14 is a flowchart illustrating a screen control method of an electronic device according to an exemplary embodiment.

The electronic device 100 may operate in an idle state before expansion/reduction of the display 110 occurs.

In operation 1420 , the electronic device 100 may determine whether expansion/reduction of the display 110 has occurred. For example, when a user input (eg, a slide-in/slide-out input, a roll-in/roll-out input) for expanding the size of the display 110 is received, the electronic device 100 receives the display 110 . ) of the expansion/reduction event can be identified.

When the expansion/reduction of the display 110 does not occur as a result of determination in operation 1420 , the electronic device 100 may maintain an idle state.

If it is determined in operation 1420 that the display 110 is expanded/reduced, the electronic device 100 may proceed to operation 1430 .

In operation 1430, the electronic device 100 may determine whether a key element selected by the user exists. For example, while expanding/reducing the screen area of the display 110 according to the user input, the electronic device 100 identifies whether a touch input for at least a part (eg, a key element) of the screen area is received. can Alternatively, the electronic device 100 may identify whether a default core element preset by the user in relation to the first window (eg, a music app) being displayed on the screen area exists.

If it is determined in operation 1430 that the key element selected by the user does not exist, the electronic device 100 may proceed to operation 1440 . In operation 1440, the electronic device 100 may execute a predefined default operation (enlargement/reduction operation of the first window including the core element).

If it is determined in operation 1430 that there is a key element selected by the user, in operation 1450 , the electronic device 100 calculates a center of the selected core element and stores information about it. The electronic device 100 may store information on the entire screen area (eg, a full screen screen or a multi-window screen) including the selected key element. The information may include a size of each window being displayed, a display state of each window (eg, a display position, a graphic element, and an operation mode).

In operation 1460, the electronic device 100 may switch the first window including the key element to a freeform mode in which the size can be freely changed. In the free-form mode, the size and display state of the first window may be changed in response to the changed size of the screen area.

In operation 1470 , the electronic device 100 calculates the movement of the center of the core element according to the degree of expansion/reduction (eg, the expansion/reduction distance or area) of the screen area of the electronic device 100 , and based on the moved center can be displayed by expanding/reducing the size of the first window including the key element.

A method of changing the size of the first window according to the size change of the screen area is exemplified as follows.

In order to change the size and display state of the first window according to the size of the screen area, the electronic device 100 provides information on the entire area (full resolution) of the first window that is being displayed on the screen area before being changed to the free-form mode. can be saved.

For example, when the first window is a first application area (eg, a music app area), when the screen area is expanded/reduced, the framework of the electronic device 100 responds to the size of the expanded/reduced screen area. The size of the first window may be reduced to be displayed on the expanded/reduced screen area. The changed size of the first window may not be notified to the first application (eg, a music app).

Alternatively, if the first window is a first application area (eg, a music app area), the framework may define an event in relation to the first application and intentionally not respond to the window size when the event occurs. . In this case, when the screen area is expanded/reduced, the framework of the electronic device 100 may transmit the event to the first application, and the first application may ignore the subsequently changed window size without processing.

The above method of changing the size of the first window is merely an example, and does not limit the scope of the present disclosure, and various applications or modifications for controlling the size of the window in the screen area in conjunction with the size of the screen area are possible.

15 illustrates a case in which the reduced first window 1510 including the play button 1520 of the first application (eg, a music app) is preset as a default core element.

The play button at reference numeral 1520 is an example of a preset key element. Reference numerals 1510 , 1512 , 1514 , and 1516 are examples of first windows including key elements. Reference numerals 1532, 1534 and 1536 are examples of the second window. Elements related to a first application (eg, a music app) may be displayed in the first windows 1510 , 1512 , 1514 , and 1516 . Elements related to a second application (eg, a chatting app) may be displayed on the second windows 15352 , 1534 , and 1536 .

With respect to the first window 1510, 1512, 1514, 1516 being displayed in the screen area, the play button of the first application (eg, music app) on the first window 1510, 1512, 1514, 1516 by the user ( 1520) is selected as the core element, and information about the core element or windows 1510 , 1512 , 1514 , and 1516 including the core element may be stored as default information.

Reference numeral 1500 denotes an example of a screen area before expansion. Reference numerals 1502 and 1504 are examples of screen areas in an expanding state. Reference numeral 1506 denotes an example of a screen area in an expanded state.

As the size of the screen area is gradually expanded, the size of the first windows 1510 , 1512 , 1514 , and 1516 including the play button 1520 , which is a key element, among the enlarged screen areas may be gradually enlarged and displayed. .

In the enlarged first windows 1512 , 1514 , and 1516 , the display of the play button 1520 , which is a key element, is maintained, and elements around the play button 1520 (eg, objects of the music app) gradually appear or can be enlarged. Upon enlargement, in the first windows 1510 , 1512 , 1514 , and 1516 , the play button 1520 may remain activated.

When reducing, the screen area may be reduced in the order of reference numerals 1506, 1504, 1502, and 1500.

As the size of the screen area is gradually reduced, the sizes of the first windows 1516 , 1514 , 1512 , and 1510 including the play button 1520 , which are a key element, may be gradually reduced and displayed.

As the size of the screen area is gradually reduced, the display of the play button 1520, which is a key element, is maintained in the first windows 1514, 1512, and 1510 among the reduced screen areas, and elements surrounding the play button 1520 are maintained. (eg objects in the music app) may gradually disappear or collapse.

Upon reduction, in the first windows 1516 , 1514 , 1512 , and 1510 , the play button 1520 may remain activated.

16 is a block diagram of an electronic device 1601 in a network environment 1600, according to various embodiments. Referring to FIG. 16 , in a network environment 1600 , the electronic device 1601 communicates with the electronic device 1602 through a first network 1698 (eg, a short-range wireless communication network) or a second network 1699 . It may communicate with the electronic device 1604 or the server 1608 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 1601 may communicate with the electronic device 1604 through the server 1608 . According to an embodiment, the electronic device 1601 includes a processor 1620 , a memory 1630 , an input module 1650 , a sound output module 1655 , a display module 1660 , an audio module 1670 , and a sensor module ( 1676), interface 1677, connection terminal 1678, haptic module 1679, camera module 1680, power management module 1688, battery 1689, communication module 1690, subscriber identification module 1696 , or an antenna module 1697 . In some embodiments, at least one of these components (eg, the connection terminal 1678 ) may be omitted or one or more other components may be added to the electronic device 1601 . In some embodiments, some of these components (eg, sensor module 1676 , camera module 1680 , or antenna module 1697 ) are integrated into one component (eg, display module 1660 ). can be

The processor 1620, for example, executes software (eg, a program 1640) to execute at least one other component (eg, a hardware or software component) of the electronic device 1601 connected to the processor 1620. It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or arithmetic, the processor 1620 converts commands or data received from other components (eg, the sensor module 1676 or the communication module 1690) to the volatile memory 1632 . may store the command or data stored in the volatile memory 1632 , and store the result data in the non-volatile memory 1634 . According to an embodiment, the processor 1620 is the main processor 1621 (eg, a central processing unit or an application processor) or a secondary processor 1623 (eg, a graphics processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 1601 includes the main processor 1621 and the auxiliary processor 1623 , the auxiliary processor 1623 uses less power than the main processor 1621 or is set to be specialized for a specified function. can The coprocessor 1623 may be implemented separately from or as part of the main processor 1621 .

The coprocessor 1623 may, for example, act on behalf of the main processor 1621 while the main processor 1621 is in an inactive (eg, sleep) state, or when the main processor 1621 is active (eg, executing an application). ), together with the main processor 1621, at least one of the components of the electronic device 1601 (eg, the display module 1660, the sensor module 1676, or the communication module 1690) It is possible to control at least some of the related functions or states. According to one embodiment, the coprocessor 1623 (eg, image signal processor or communication processor) may be implemented as part of another functionally related component (eg, camera module 1680 or communication module 1690). there is. According to an embodiment, the auxiliary processor 1623 (eg, a neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 1601 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 1608). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 1630 may store various data used by at least one component (eg, the processor 1620 or the sensor module 1676 ) of the electronic device 1601 . The data may include, for example, input data or output data for software (eg, a program 1640 ) and instructions related thereto. The memory 1630 may include a volatile memory 1632 or a non-volatile memory 1634 .

The program 1640 may be stored as software in the memory 1630 , and may include, for example, an operating system 1642 , middleware 1644 , or an application 1646 .

The input module 1650 may receive a command or data to be used by a component (eg, the processor 1620 ) of the electronic device 1601 from the outside (eg, a user) of the electronic device 1601 . The input module 1650 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 1655 may output a sound signal to the outside of the electronic device 1601 . The sound output module 1655 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 1660 may visually provide information to the outside (eg, a user) of the electronic device 1601 . The display module 1660 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device. According to an embodiment, the display module 1660 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 1670 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 1670 acquires a sound through the input module 1650 or an external electronic device (eg, a sound output module 1655 ) directly or wirelessly connected to the electronic device 1601 . A sound may be output through the electronic device 1602 (eg, a speaker or headphones).

The sensor module 1676 detects an operating state (eg, power or temperature) of the electronic device 1601 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to one embodiment, the sensor module 1676 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 1677 may support one or more designated protocols that may be used for the electronic device 1601 to directly or wirelessly connect with an external electronic device (eg, the electronic device 1602 ). According to an embodiment, the interface 1677 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 1678 may include a connector through which the electronic device 1601 can be physically connected to an external electronic device (eg, the electronic device 1602 ). According to an embodiment, the connection terminal 1678 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 1679 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 1679 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 1680 may capture still images and moving images. According to one embodiment, the camera module 1680 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 1688 may manage power supplied to the electronic device 1601 . According to an embodiment, the power management module 1688 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 1689 may supply power to at least one component of the electronic device 1601 . According to one embodiment, battery 1689 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 1690 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 1601 and an external electronic device (eg, the electronic device 1602, the electronic device 1604, or the server 1608). It can support establishment and communication performance through the established communication channel. The communication module 1690 may include one or more communication processors that operate independently of the processor 1620 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 1690 is a wireless communication module 1692 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 1694 (eg, : It may include a LAN (local area network) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 1698 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 1699 (eg, legacy). It may communicate with the external electronic device 1604 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 1692 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 1696 within a communication network, such as the first network 1698 or the second network 1699 . The electronic device 1601 may be identified or authenticated.

The wireless communication module 1692 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 1692 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 1692 uses various techniques for securing performance in a high frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 1692 may support various requirements specified in the electronic device 1601 , an external electronic device (eg, the electronic device 1604 ), or a network system (eg, the second network 1699 ). According to an embodiment, the wireless communication module 1692 includes a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).

The antenna module 1697 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 1697 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 1697 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network such as the first network 1698 or the second network 1699 is connected from the plurality of antennas by, for example, the communication module 1690 . can be selected. A signal or power may be transmitted or received between the communication module 1690 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 1697 .

According to various embodiments, the antenna module 1697 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 1601 and the external electronic device 1604 through the server 1608 connected to the second network 1699 . Each of the external electronic devices 1602 and 1604 may be the same or a different type of the electronic device 1601 . According to an embodiment, all or a part of operations executed by the electronic device 1601 may be executed by one or more external electronic devices 1602 , 1604 , or 1608 . For example, when the electronic device 1601 needs to perform a function or service automatically or in response to a request from a user or other device, the electronic device 1601 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 1601 . The electronic device 1601 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 1601 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 1604 may include an Internet of things (IoT) device. Server 1608 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 1604 or the server 1608 may be included in the second network 1699 . The electronic device 1601 may be applied to an intelligent service (eg, a smart home, a smart city, a smart car, or health care) based on 5G communication technology and IoT-related technology.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include one or more instructions stored in a storage medium (eg, internal memory 1636 or external memory 1638) readable by a machine (eg, electronic device 1601). may be implemented as software (eg, a program 1640) including For example, a processor (eg, processor 1620 ) of a device (eg, electronic device 1601 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed online (eg download or upload), directly between smartphones (eg smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

According to various embodiments, the electronic device (eg, the electronic device 100 of FIG. 1 ) includes a display (eg, the display 110 of FIG. 1 ) and at least one processor connected to the display (eg, the electronic device 100 of FIG. 1 ) processor 120). The at least one processor displays a plurality of elements on a screen area of the display, receives a user input for changing a size of the screen area, identifies a key element among the plurality of elements, and the received user input and a re-sized screen area based on the key element may be displayed. In the size-changed screen area, a size of a window including the key element may be set to be displayed corresponding to the changed size of the screen area.

According to various embodiments, as the size of the screen area increases, the size of the window including the key element may be gradually reduced or enlarged to be displayed.

According to various embodiments, as the size of the screen area is reduced, the size of the window including the key element may be gradually reduced or enlarged to be displayed.

According to various embodiments, the key element may be identified based on a touch input to at least a part of the screen area.

According to various embodiments, the touch input may be any one of a touch input received while maintaining the user input, a touch input received within a predetermined time before the user input, and a touch input received within a predetermined time after the user input can

According to various embodiments, the electronic device may further include a memory (eg, the memory 1630 of FIG. 16 ). Default information for each screen area size may be previously stored in the memory of the electronic device. The core element may be identified based on the default information for each size of the screen area.

According to various embodiments, the electronic device may further include a memory. Priority information for designating priorities of at least some of the plurality of elements displayed on the screen area may be previously stored in the memory of the electronic device. At least one element to be displayed on the size-changed screen area may be determined based on the changed size of the screen area, the core element, and the priority information.

According to various embodiments, as the size of the screen area is changed, the display of the key element is maintained in the window among the changed screen areas, peripheral elements of the key element are gradually disappeared or reduced, and the changed screen area is displayed. In the second window of the screen area, a plurality of elements may be gradually displayed or enlarged.

According to various embodiments, as the size of the screen area is changed, the display of the key element is maintained in the window among the changed screen areas, peripheral elements of the key element are gradually displayed or enlarged, and the changed screen area is displayed. In the second window of the screen area, a plurality of elements may gradually disappear or be reduced.

According to various embodiments, while the user input for changing the size of the screen area is received, a touch input for at least a part of the screen area may be received, and the key element may be identified based on the touch input there is.

According to various embodiments, while the size of the screen area is changed according to the user input for changing the size of the screen area, a touch input for an area corresponding to the key element among the screen area is received, and the The key element may be identified based on the touch input.

According to various embodiments, while the user input for changing the size of the screen area is received, a touch input for at least a portion of the screen area is received and released, and based on the release of the touch input, the core The size of the window containing the element may be fixed.

According to various embodiments, the display may be a rollable display, and the user input may be an input according to a rolling operation for changing the size of the rollable display area exposed to the front part of the electronic device. The rolling operation may be an automatic or semi-automatic rolling operation by a user's manual rolling operation or a driving body (eg, a motor) included in the electronic device according to a user input.

According to various embodiments, the display may be a slideable display, and the user input may be an input according to a sliding operation for changing the size of the slideable display area exposed to the front of the electronic device. The sliding operation may be a manual sliding operation of a user or an automatic or semi-automatic sliding operation by a driving body (eg, a motor) included in the electronic device according to a user input.

According to various embodiments, a method of controlling a screen of an electronic device including a display includes displaying a plurality of elements on a screen area of the display, receiving a user input for changing a size of the screen area, and It may include an operation of identifying a core element among the elements of , and an operation of displaying a re-sized screen area based on the received user input and the core element. In the size-changed screen area, a size of a window including the key element may be displayed corresponding to the changed size of the screen area.

According to various embodiments, the key element may be identified based on a touch input to at least a part of the screen area.

According to various embodiments, the touch input may be any one of a touch input received while maintaining the user input, a touch input received within a predetermined time before the user input, and a touch input received within a predetermined time after the user input can

According to various embodiments, the screen control method may further include the operation of storing default information for each screen area size. The core element may be identified based on the default information for each size of the screen area.

According to various embodiments, the screen control method may further include the operation of storing priority information for designating a priority of at least some of the plurality of elements displayed on the screen area. At least one element to be displayed on the size-changed screen area may be determined based on the changed size of the screen area, the core element, and the priority information.

According to various embodiments, while the user input for changing the size of the screen area is received, a touch input for the key element in the screen area is received, and the key element is identified based on the touch input. can

According to various embodiments, while the size of the screen area is changed according to the user input for changing the size of the screen area, a touch input for an area corresponding to the key element among the screen area is received; The key element may be identified based on the touch input.

According to various embodiments, while the user input for changing the size of the screen area is received, a touch input for at least a portion of the screen area is received and released, and based on the release of the touch input, the core The size of the window containing the element may be fixed.

Claims (20)

In an electronic device,
display; and
at least one processor coupled to the display;
the at least one processor,
displaying a plurality of elements in a screen area of the display;
receiving a user input for changing the size of the screen area;
identifying a key element among the plurality of elements;
Displaying a re-sized screen area based on the received user input and the key element,
The electronic device configured to display a size of a window including the key element in the size-changed screen area corresponding to the changed size of the screen area. According to claim 1, wherein the key element,
An electronic device identified based on a touch input to at least a portion of the screen area. The method of claim 2, wherein the touch input comprises:
a touch input received while maintaining the user input;
a touch input received within a predetermined time before the user input; and
An electronic device that is any one of touch inputs received within a predetermined time after the user input. The method of claim 1, further comprising a memory;
Default information for each screen area size is stored in the memory in advance,
The electronic device for identifying the key element based on the default information for each size of the screen area. The method of claim 1 further comprising a memory;
Priority information for designating a priority for at least some of the plurality of elements displayed on the screen area is stored in advance in the memory;
An electronic device for determining at least one element to be displayed on the size-changed screen area based on the changed size of the screen area, the core element, and the priority information. According to claim 1,
As the size of the screen area is changed,
In the window of the changed screen area, the display of the key element is maintained, and the surrounding elements of the key element gradually disappear or are reduced;
An electronic device in which a plurality of elements are gradually displayed or enlarged in a second window of the changed screen area. According to claim 1,
As the size of the screen area is changed,
In the window of the changed screen area, the display of the key element is maintained, and the surrounding elements of the key element appear or enlarge gradually;
In the second window of the changed screen area, a plurality of elements gradually disappear or are reduced. According to claim 1,
While the user input for changing the size of the screen area is received, a touch input for at least a part of the screen area is received;
an electronic device in which the key element is identified based on the touch input. According to claim 1,
While the size of the screen area is changed according to the user input for changing the size of the screen area, a touch input for an area corresponding to the key element among the screen area is received;
an electronic device in which the key element is identified based on the touch input. According to claim 1,
While the user input for changing the size of the screen area is received, a touch input for at least a part of the screen area is received and released;
The size of the window including the key element is fixed based on the release of the touch input. According to claim 1,
The display is a rollable display,
The user input is an input according to a rolling operation for changing a size of the rollable display area exposed to the front of the electronic device. According to claim 1,
The display is a slideable display,
The user input is an input according to a sliding operation for changing a size of the slideable display area exposed to the front of the electronic device. A method for controlling a screen of an electronic device including a display, the method comprising:
displaying a plurality of elements on a screen area of the display;
receiving a user input for changing the size of the screen area;
identifying a key element among the plurality of elements; and
Displaying a re-sized screen area based on the received user input and the key element,
In the size-changed screen area, the size of a window including the key element is displayed in response to the changed size of the screen area. 14. The method of claim 13, wherein the key element,
A method for identifying based on a touch input to at least a portion of the screen area. The method of claim 14, wherein the touch input comprises:
a touch input received while maintaining the user input;
a touch input received within a predetermined time before the user input; and
any one of the touch inputs received within a predetermined time after the user input. 14. The method of claim 13,
Further comprising the operation of storing default information for each screen area size,
The method of identifying the key element based on the default information for each size of the screen area. 14. The method of claim 13,
The method further comprising: storing priority information for designating a priority for at least some of the plurality of elements displayed on the screen area;
A method of determining at least one element to be displayed on the size-changed screen area based on the changed size of the screen area, the core element, and the priority information. 14. The method of claim 13,
While the user input for changing the size of the screen area is received, a touch input for the key element in the screen area is received;
and the key element is identified based on the touch input. 14. The method of claim 13,
While the size of the screen area is changed according to the user input for changing the size of the screen area, a touch input for an area corresponding to the key element among the screen area is received;
and the key element is identified based on the touch input. 14. The method of claim 13,
While the user input for changing the size of the screen area is received, a touch input for at least a part of the screen area is received and released;
A method in which the size of the window including the key element is fixed based on the release of the touch input.

Images