WO2022119276A1

WO2022119276A1 - Flexible display electronic device and operation method thereof

Info

Publication number: WO2022119276A1
Application number: PCT/KR2021/017863
Authority: WO
Inventors: 우광택; 이창호; 김병국; 오득규; 안진완
Original assignee: 삼성전자 주식회사
Priority date: 2020-12-04
Filing date: 2021-11-30
Publication date: 2022-06-09
Also published as: KR20220079189A

Abstract

Provided may be a device for controlling a screen configuration according to the change in a screen size in a flexible display electronic device, and an operation method thereof. An electronic device may: display, on an initial screen, one or multiple items corresponding to an event received in a first state before initiation of a screen extension operation; and in a second state having an extended screen size due to the screen extension operation, and on the extended screen, display content executed in conjunction with at least one item among the one or multiple items.

Description

Flexible display electronic device and operating method thereof

The present disclosure relates to a flexible display electronic device that controls a screen configuration according to a change in screen size, and an operating method thereof.

Electronic devices such as digital portable terminals are commercializing the application of flexible displays. An electronic device to which the flexible display is applied (hereinafter referred to as a "flexible display electronic device") may change the physical shape of the screen area. For example, in the case of a foldable type, rollable type, or slideable type smartphone, by adopting a structure capable of expanding or reducing the screen area, it provides a wide screen by expanding the screen size as needed while maintaining excellent portability can do. This may result in diversification of product design and/or improvement of display performance.

Unlike an electronic device having a fixed screen area, a flexible display electronic device may have various screen shapes according to usage states (eg, roll-in/roll-out state, slide-in/slide-out state). Accordingly, it may not be easy to apply the layout configuration method used for the fixed screen to the variable screen of the flexible display electronic device.

SUMMARY The present disclosure can be made to solve the problems and disadvantages described above, and to provide at least the advantages described below.

One aspect of the present disclosure may provide an apparatus for adjusting a screen configuration in response to a change in screen size in a flexible display electronic device, and an operating method thereof.

Another aspect of the present disclosure may provide an apparatus for displaying a screen according to an interlocking scenario when a screen size is changed in a flexible display and an operating method thereof.

According to one aspect of the present disclosure, an electronic device includes a memory, a display having a flexible structure, at least one sensor sensing a change in a screen size of the display, and electrically connecting the memory, the display, and the at least one sensor. at least one processor connected to are displayed on the screen, and in the second state in which the screen size is expanded by the screen expansion operation, instructions for displaying content executed in association with at least one of the one or a plurality of items on the expanded screen can be saved

According to another aspect of the present disclosure, an operation method in a flexible type electronic device includes an operation of displaying one or a plurality of items corresponding to an event received in a first state before a screen expansion operation is started on an initial screen, and the In the second state in which the screen size is expanded by the screen expansion operation, the operation may include displaying content executed in association with at least one of the one or a plurality of items on the expanded screen.

Various respective aspects and features of the invention are defined in the appended claims. Combinations of features of the dependent claims may be combined with features of the independent claims as appropriate, not just expressly set forth in the claims.

In addition, one or more features selected in any one embodiment described in the present disclosure may be combined with one or more features selected in any other embodiment described in the present disclosure. Moreover, alternative combinations of these features may at least partially alleviate one or more technical problems discussed in this disclosure, or at least partially alleviate a technical problem that can be discerned by those skilled in the art from this disclosure. have. Further, combinations are possible, unless a particular combination or permutation of embodiment features is understood to be incompatible by one of ordinary skill in the art.

In any described example implementation, two or more physically separate components may alternatively be integrated into a single component if their integration is possible. Conversely, a single component of any embodiment described in this disclosure may alternatively be implemented with two or more separate components that achieve the same function, where appropriate.

It is an object of certain embodiments of the present disclosure to solve, mitigate, or eliminate, at least in part, at least one of the problems and/or disadvantages associated with the prior art. Certain embodiments aim to provide at least one of the advantages described below.

1 is a diagram illustrating an electronic device in a network environment, according to an embodiment.

2 is a diagram illustrating an electronic device supporting multiple frequency bands, according to an embodiment.

3 is a diagram illustrating an operation example of expanding a screen size in a flexible display electronic device having a sliding structure, according to an embodiment.

4A is a diagram illustrating a display structure of an electronic device in a sliding-in state, according to an exemplary embodiment.

4B is a diagram illustrating a display structure of an electronic device in a sliding-out state, according to an exemplary embodiment.

5 is a diagram illustrating a scenario in which a screen is configured during an expansion operation in a flexible display electronic device having a sliding structure, according to an embodiment.

6 is a diagram illustrating a scenario in which a screen is configured during an expansion operation in a flexible display electronic device having a sliding structure, according to another exemplary embodiment.

7 is a diagram illustrating an implementation example of configuring a screen during an expansion operation in a flexible display electronic device having a sliding structure, according to an embodiment.

8 is a diagram illustrating another implementation example of configuring a screen during an expansion operation in a flexible display electronic device having a sliding structure, according to an embodiment.

9 is a diagram illustrating another implementation example of configuring a screen during an expansion operation in a flexible display electronic device having a sliding structure, according to an embodiment.

10 is a diagram illustrating another implementation example of configuring a screen during an expansion operation in a flexible display electronic device having a sliding structure, according to an embodiment.

11 is a diagram illustrating another implementation example of configuring a screen during an expansion operation in a flexible display electronic device having a sliding structure, according to an embodiment.

12 is a diagram illustrating a block configuration for adjusting touch sensitivity in consideration of a change in a screen size in an electronic device, according to an embodiment.

13 is a diagram illustrating an example of signal processing for touch setting control in a platform structure of a flexible type electronic device, according to an embodiment.

14 is a diagram illustrating a control flow for configuring a screen according to a change in screen size in a flexible display electronic device, according to an embodiment.

15 is a diagram illustrating a control flow for configuring a screen according to a change in screen size in a flexible display electronic device according to another exemplary embodiment.

Hereinafter, various embodiments will be described in detail with reference to the accompanying drawings. In the following description, specific details, such as detailed configurations and components, will only be provided to help the general understanding of the embodiments of the present disclosure. Accordingly, it should be apparent to those skilled in the art that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. In addition, descriptions of well-known functions and configurations may be omitted for clarity and brevity.

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments of the present disclosure.

Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included. In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to an embodiment, as at least part of data processing or operation, the processor 120 stores a command or data received from another component (eg, the sensor module 176 or the communication module 190 ) into the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 may use less power than the main processor 121 or may be set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the auxiliary processor 123 (eg, an image signal processor or a communication processor) may be implemented as a part of another functionally related component (eg, the camera module 180 or the communication module 190). have. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted Boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver may be used to receive an incoming call. According to an embodiment, the receiver may be implemented separately from or as a part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 or an external electronic device (eg, a sound output module 155 ) directly or wirelessly connected to the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to an embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 includes a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a specified high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external

electronic devices

102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or part of the operations performed by the electronic device 101 may be executed by one or more external

electronic devices

102 , 104 , or 108 . For example, when the electronic device 101 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

2 is a block diagram 200 of a display device 160 according to various embodiments of the present disclosure.

Referring to FIG. 2 , the display device 160 may include a display 210 and a display driver IC (DDI) 230 for controlling the display 210 . The DDI 230 may include an interface module 231 , a memory 233 (eg, a buffer memory), an image processing module 235 , or a mapping module 237 . The DDI 230 transmits, for example, image data or image information including an image control signal corresponding to a command for controlling the image data to other components of the electronic device 101 through the interface module 231 . can be received from For example, according to an embodiment, the image information is provided by the processor 120 (eg, the main processor 121 (eg, an application processor) or the auxiliary processor 123 ( For example, a graphic processing device) The DDI 230 may communicate with the touch circuit 250 or the sensor module 176 through the interface module 231. In addition, the DDI 230 is the At least a portion of the received image information may be stored in the memory 233, for example, in units of frames, for example, the image processing module 235 may store at least a portion of the image data, Pre-processing or post-processing (eg, resolution, brightness, or size adjustment) may be performed based on at least the characteristics of the display 210. The mapping module 237 may perform pre-processing or post-processing through the image processing module 135. A voltage value or a current value corresponding to the image data may be generated. According to an embodiment, the generation of the voltage value or the current value may include, for example, a property of pixels of the display 210 (eg, an arrangement of pixels ( RGB stripe or pentile structure), or the size of each sub-pixel) At least some pixels of the display 210 are driven at least in part based on, for example, the voltage value or the current value Accordingly, visual information (eg, text, image, or icon) corresponding to the image data may be displayed through the display 210 .

According to an embodiment, the display device 160 may further include a touch circuit 250 . The touch circuit 250 may include a touch sensor 251 and a touch sensor IC 253 for controlling the touch sensor 251 . The touch sensor IC 253 may control the touch sensor 251 to sense a touch input or a hovering input for a specific position of the display 210 , for example. For example, the touch sensor IC 253 may detect a touch input or a hovering input by measuring a change in a signal (eg, voltage, light amount, resistance, or electric charge amount) for a specific position of the display 210 . The touch sensor IC 253 may provide information (eg, location, area, pressure, or time) regarding the sensed touch input or hovering input to the processor 120 . According to an embodiment, at least a part of the touch circuit 250 (eg, the touch sensor IC 253 ) is disposed as a part of the display driver IC 230 , the display 210 , or outside the display device 160 . may be included as a part of another component (eg, the coprocessor 123).

According to an embodiment, the display device 160 may further include at least one sensor (eg, a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor) of the sensor module 176 , or a control circuit therefor. The at least one sensor or a control circuit therefor may be embedded in a part of the display device 160 (eg, the display 210 or the DDI 230 ) or a part of the touch circuit 250 . For example, when the sensor module 176 embedded in the display device 160 includes a biometric sensor (eg, a fingerprint sensor), the biometric sensor provides biometric information related to a touch input through a partial area of the display 210 . (eg fingerprint image) can be acquired. As another example, when the sensor module 176 embedded in the display device 160 includes a pressure sensor, the pressure sensor may acquire pressure information related to a touch input through a part or the entire area of the display 210 . can According to an embodiment, the touch sensor 251 or the sensor module 176 may be disposed between pixels of the pixel layer of the display 210 or above or below the pixel layer.

The electronic device according to various embodiments disclosed in this document may be a device of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as “first”, “second”, or “first” or “second” may simply be used to distinguish the component from other components in question, and may refer to components in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, for example, and interchangeably with terms such as logic, logic block, component, or circuit. can be used A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to various embodiments of the present document, one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101) may be implemented as software (eg, the program 140) including For example, a processor (eg, processor 120 ) of a device (eg, electronic device 101 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to an embodiment, the method according to various embodiments disclosed in this document may be provided by being included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store™) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly between smartphones (eg: smartphones) and online. In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. . According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repetitively, or heuristically, or one or more of the operations are executed in a different order, omitted, or , or one or more other operations may be added.

FIG. 3 is a diagram illustrating an operation example of expanding a screen size in a flexible display electronic device having a sliding structure (eg, the electronic device 101 of FIG. 1 ), according to an embodiment.

Referring to FIG. 3 , in the electronic device, a screen size may be increased by a sliding out operation (hereinafter referred to as an “expanding operation”), and a sliding in operation (hereinafter referred to as a “reducing operation”) may be performed. may reduce the screen size. The expansion operation may be a series of operations for switching from a sliding-in state (a) having a small screen size 310a to a sliding-out state (b) having a large screen size 310b. The reduction operation may be a series of operations for switching from a sliding-out state (b) having a large screen size 310b to a sliding-in state (a) having a small screen size 310a.

According to an embodiment, in the case of an electronic device in which an expansion operation (or a reduction operation) is manually performed, the user touches the

screens

310a and 310b in the sliding-out direction r (or sliding-in) in the

state

320a or 320b. direction) to move the hand. Some of information (eg, icons) related to content displayed on the screen may be selected by a user's touch for the expansion operation or the reduction operation. The selection is, for example, by the occurrence of a press by a touch at the start of the expansion operation (or reduction operation), and then releasing the press upon completion of the expansion operation (or reduction operation). can occur.

Therefore, due to the operation for adjusting the screen size (eg, expanding or reducing operation), while the screen size is changing (eg, expanding or reducing), the function selected by the user's touch is displayed after the screen size change is completed. It may be desirable to come up with an efficient method.

4A is a diagram illustrating a display structure of an electronic device (eg, the electronic device 101 of FIG. 1 ) in a sliding-in state, according to an exemplary embodiment.

Referring to FIG. 4A , the electronic device has a sliding structure including a sliding housing 420 , a main housing 430 , and a sliding axis 440 to change a screen size. It is possible to provide a flexible display with The sliding shaft 440 may be a rolling shaft. The electronic device may provide a screen size corresponding to the main area 410a in the sliding-in state. The main area 410a may be a screen of the smallest size that can be provided by the electronic device.

According to an embodiment, in the sliding-in state, the sliding housing 420 may have an overlapping structure overlapping the main housing 430 . For example, in the sliding-in state, the sliding housing 420 may be positioned to cover the main housing 430 or may be positioned to be inserted under the main housing 430 . In the sliding-in state, a partial area of the slideable display may be exposed to the outside as the main area 410a, and the remaining area of the slideable display may be hidden so as not to be exposed to the outside. The remaining area of the slideable display may be hidden behind the sliding axis 440 based on the sliding axis 440 or may be wound around a rolling axis that may be provided instead of the sliding axis 440 . The electronic device may have a structure in which, for example, in a sliding-in state, the remaining area of the slideable display can enter the electronic device based on the sliding axis 440 .

4B is a diagram illustrating a display structure of an electronic device (eg, the electronic device 101 of FIG. 1 ) in a sliding-out state, according to an embodiment.

Referring to FIG. 4B , the electronic device may provide a flexible display having a sliding structure including a sliding housing 420 , a main housing 430 , and a sliding shaft 440 to change a screen size. The sliding shaft 440 may be a rolling shaft. The full screen 410b in the sliding-out state of the electronic device may include a main area 412b and an alpha area 414b. The main area 412b is an area corresponding to a basic screen provided by the electronic device in a sliding-in state, and the alpha area 414b is an area corresponding to an expanded screen in a sliding-out state. The expanded screen size may be determined in proportion to the distance the display moves by the sliding-out operation.

According to an embodiment, in the sliding-out state, the sliding housing 420 may have a structure separated from the main housing 430 . For example, during an expansion operation (eg, a sliding-out operation) changing from a sliding-in state to a sliding-out state, the sliding housing 420 may slide along the main housing 430 in the r direction. When the sliding housing 420 slides along the main housing 430 in the r direction, the flexible display wound on the sliding shaft 440 is unwound or the display corresponding to the alpha region 414b hidden in the rear or inside is expanded. can be

Although not shown, during a reduction operation (eg, a sliding-in operation) changing from a sliding-out state to a sliding-in state, the sliding housing 420 may slide along the main housing 430 in a direction opposite to the r-direction. When the sliding housing 420 is slid along the main housing 430 in the opposite direction to the r direction, the flexible display corresponding to the screen corresponding to the alpha region 414b moves to the rear or the inside based on the sliding axis 440 . can be inserted. Alternatively, when the rolling axis replaces the sliding axis 440 , when the sliding housing 420 slides along the main housing 430 in the opposite direction to the r direction, a flexible screen corresponding to the alpha region 414b A display may be wound around the rolling axis.

The above-described electronic device (eg, the electronic device 101 of FIG. 1 ) may provide three operating states in an operation (eg, an expansion operation or a reduction operation) of changing a screen size. The three operation states may include an initial state before the corresponding operation starts, a driving state in which the corresponding operation is in progress, and a completion state where the corresponding operation is finished. The driving state is not limited only when the change in the screen size is continuously made without interruption. For example, even if a predetermined delay occurs in the middle of a screen size change, the driving state may be determined.

According to an embodiment, the electronic device may display one or a plurality of items corresponding to the event received in the first state before the screen expansion operation starts on the first state screen that is the initial screen. In the second state in which the screen size is expanded to the second state screen by the screen extension operation, the electronic device is configured to display content executed in association with at least one of one or a plurality of items displayed on the initial screen on the extended screen. can

The screen expansion operation may be a sliding-out operation, an expansion rolling operation, or a folder opening operation. The sliding-out operation may instruct a screen expansion operation in the slideable electronic device, the expansion rolling operation may indicate a screen expansion operation in the rollable electronic device, and the folder opening operation may be performed in the foldable electronic device. may instruct the screen expansion operation of

The first state is a state before a screen expansion operation is started in the electronic device, and may be a state in which an initial screen is provided. The initial screen may be a full screen provided by the electronic device in the first state. The initial screen may be the main screen in the entire screen provided by the electronic device in the second state after the screen expansion. The entire screen in the second state may include an extended screen in addition to the main screen. The extended screen may be deactivated or hidden in the first state, but may be activated or viewed externally in the second state after the screen expansion operation. The size of the entire screen in the second state may be equal to or greater than the sum of the size of the main screen corresponding to the initial screen and the size of the extended screen obtained by the screen expansion operation. In the following description, a 'screen' refers to a technical space that displays an electrical image or image according to the execution of one or a plurality of applications or indicates a physical space in which one or a plurality of contents can be displayed as an electrical image or image. will be used for meaning. In addition, depending on the description before and after the sentence, 'screen' may be used as a technical meaning indicating a displayed image or video.

According to an embodiment, the electronic device may support a user setting an interworking scenario to be performed when a screen is expanded for each event, application, or content. The electronic device may select an interworking scenario to be performed after the screen expansion in consideration of an event generated in the first state before the screen expansion operation is performed, an executed application, or content displayed on the screen.

FIG. 5 is a diagram illustrating a scenario in which a screen is configured during an expansion operation in a flexible display electronic device having a sliding structure (eg, the electronic device 101 of FIG. 1 ), according to an embodiment.

Referring to FIG. 5 , an operation state of the electronic device may proceed from a “first initial state (a)” to a “second initial state (b)” to a “completed state (c)” during the expansion operation. The first initial state (a) is a state before an expansion operation starts, such as a sliding-in state in the electronic device, and a specific application may be executed to provide an initial screen. The second initial state (b) is a state in which an event such as reception of content by the electronic device in the first initial state (a) occurs, and information about the event may be additionally provided on the initial screen. The completion state (c) may be a state in which a screen expansion operation is performed after an event occurs, and content corresponding to the event is displayed on the expanded screen.

The screen size of the first initial state (a), the second initial state (b), and the completion state (c) may be different from each other. The screen in the initial states (a or b) may have a minimum size that the flexible display can provide or a size extended to a certain extent (a first size). The screen in the completion state (c) may have a maximum size that the flexible display can provide or a size extended to a certain extent (a second size larger than the first size). The screen size in the completion state (c) should be turned on relative to the screen size in the initial state (a or b).

According to an embodiment, when a user requests or performs a screen expansion for the purpose of checking content information corresponding to an event displayed in an application for displaying content, the electronic device may display the content information in the expanded area. That is, the electronic device may provide an operation according to a scenario linked to an application being executed only by expanding the screen.

According to an embodiment, in the first initial state (a), a specific application may be executed, and a service screen of the executed specific application may be displayed. In the first initial state (a), when the screen is expanded, the electronic device may monitor whether an event of receiving or inputting content to be driven in association according to a set interworking scenario occurs. For example, when receiving content corresponding to a specific event, the electronic device may switch to the second initial state (b) in which the event occurred in operation 510 .

According to an embodiment, in the second initial state (b) in which the event according to the content reception occurs, the content 520 corresponding to the generated event may be displayed on the initial screen that is the screen before the screen expansion operation. After displaying the content corresponding to the event on the initial screen, the electronic device may monitor whether a screen expansion operation is performed. When the screen expansion operation is detected, the electronic device may switch to a screen expansion completion state (c) in operation 530 .

According to an embodiment, in a state (c) in which the screen expansion is completed after the event occurs, the content that generated the event may be displayed on the expanded screen 540 . For example, when the content is an image, the electronic device may display a corresponding image in the extended area 540 , and if the content is a moving picture, the electronic device may play the corresponding video in the extended area 540 . As another example, when the content is an address of a specific store, the electronic device may display a map corresponding to the address in the extended area 540 , and when the content is a web page address, a map corresponding to the web page address is displayed. A web page may be displayed in the extended area 540 .

According to the previously proposed method, after the screen expansion is performed, the electronic device with the flexible display may display the content according to the interworking scenario using the expanded screen while maintaining the original page before the expansion. In addition, when an electronic device having a flexible display performs a screen expansion operation, such as a sliding-out operation, in an expanded area (alpha area), an initial area (main area) The screen according to the currently running application may be enlarged and displayed, or specific content may be displayed in the expanded area.

6 is a diagram illustrating a scenario in which a screen is configured during an expansion operation in a flexible display electronic device having a sliding structure (eg, the electronic device 101 of FIG. 1 ) according to another exemplary embodiment.

Referring to FIG. 6 , in the case of the expansion operation, the operation state of the electronic device is “first initial state (a)” → “second initial state (b)” → “third initial state (c)” → “completed state ( d)". In the first initial state (a), the electronic device may provide an initial screen in which a specific application is executed in a state before an expansion operation is started (eg, a sliding-in state). In the second initial state (b), the electronic device may display the content 620 that generates an event such as receiving the content in the first initial state (a) together with the notification icon 630 on the initial screen. In the third initial state (c), the electronic device may display a notification icon 650 activated by a notification selection by the user on the initial screen. After a notification is selected and the screen expansion operation is performed, in the completion state (d), the electronic device may display content corresponding to the event on the expansion screen. If the notification is not selected, in the completion state (d) in which the screen expansion operation is performed, the screen displayed on the initial screen may be displayed on the full screen after the expansion.

The screen sizes of the first to third initial states (a, b, c) and the completion state (d) may be different from each other. The screens in the first to third initial states (a, b, and c) may have a minimum size that the flexible display can provide or a size that is expanded to a certain extent. The screen in the completion state (d) may have a maximum size that the flexible display can provide or a size extended to a certain extent. The screen size in the completion state (d) should be turned on relatively compared to the screen size in the initial state (a to c).

According to an embodiment, when a notification is set for the purpose of checking content information corresponding to an event displayed in an application for displaying content, and the user requests or performs screen expansion, the electronic device displays the content information in the expanded area. can be displayed That is, the electronic device may provide an operation according to a scenario linked to an application being executed only by expanding the screen.

According to an embodiment, in the first initial state (a) in which the application is executed, a specific application may be executed, and a service screen of the executed specific application may be displayed. In the first initial state (a), when the screen is expanded, the electronic device may monitor whether content to be driven is received or an input event occurs according to a set interworking scenario. For example, when receiving content corresponding to a specific event, the electronic device may switch to the second initial state (b) in which the event occurred in operation 610 .

According to an embodiment, in the second initial state (b) in which an event according to content reception occurs, the content 620 corresponding to the generated event and the notification icon 630 corresponding to the content 620 are displayed on the initial screen. can be displayed. The notification icon displayed on the initial screen may be in an inactive state. After displaying the content corresponding to the event and the notification icon on the initial screen, the electronic device may monitor whether a notification selection activated by the notification icon occurs. When a notification selection occurs, the electronic device may switch to the third initial state (c) in which the notification icon 630 is activated in operation 640 .

According to an embodiment, in the third initial state (c) in which the notification icon is activated, the electronic device displays the activated notification icon 650 on the initial screen so that the user can recognize that the interworking scenario will be applied to the content displayed on the screen. can be displayed in The electronic device may monitor whether a screen expansion operation is performed in the third initial state (c). When the screen expansion operation is detected, the electronic device may switch to the screen expansion state (d) in operation 660 .

According to an embodiment, in the state (d) in which the screen expansion is completed after the event occurs, the content that generated the event may be displayed on the expanded screen 670 . For example, when the content is an image, the electronic device may display a corresponding image in the extended area 670 , and if the content is a moving picture, the electronic device may play the corresponding video in the extended area 670 . As another example, when the content is an address of a specific store, the electronic device may display a map corresponding to the address in the extended area 670 , and when the content is a web page address, a web page corresponding to the web page address may be displayed in the extended area 670 .

According to the previously proposed method, after the screen expansion is performed, the electronic device with the flexible display may display the content according to the interworking scenario using the expanded screen while maintaining the original page before the expansion. In addition, when an electronic device having a flexible display performs a screen expansion operation such as a sliding-out operation, in the expanded area (alpha area), in the initial area (main area), in consideration of the properties of content displayed on the screen according to the application being executed The screen according to the currently running application may be enlarged and displayed, or specific content may be displayed in the expanded area.

7 is a diagram illustrating an implementation example of configuring a screen during an expansion operation in a flexible display electronic device having a sliding structure (eg, the electronic device 101 of FIG. 1 ), according to an embodiment.

Referring to FIG. 7 , the electronic device may execute the messenger application in the first state (a) before the screen expansion, and display a message exchange image according to the executed messenger application on the initial screen. The electronic device may recognize the occurrence of an event in which a plurality of contents capable of interworking with other applications, such as a photo or a video, are input or received. When there are a plurality of contents displayed on the initial screen, the electronic device may display

notification icons

710 and 720 corresponding to each of the plurality of contents. The

notification icons

710 and 720 may be used to set whether to selectively expose displayed contents using an extended screen. The

notification icons

710 and 720 may be initially in an inactive state.

In the first state (b), the electronic device may activate the

notification icons

740 and 750 according to the user's request, that is, the notification selection 730 . When the

notification icons

740 and 750 are activated, the electronic device executes an application related to a plurality of contents displayed on the initial screen in the second state (c) in which the screen is expanded by the screen expansion operation 770 . and an operation according to an interworking scenario of displaying the plurality of contents on the expanded screen 770 may be performed.

When notification icons for a plurality of contents are activated, the electronic device may sequentially display them on the screen in consideration of the priority of the plurality of contents. For example, assuming that the first content displayed on the initial screen is an image to be reproduced after the second content, the electronic device may give the first content a higher priority than the second content. In this case, when the screen is expanded, the electronic device may reproduce the first content through the extended screen, and may continuously play the second content on the extended screen after the image corresponding to the first content is reproduced.

According to the above-described implementation example, the user can selectively check the plurality of contents through the expanded screen simply by expanding the screen after confirming input of a plurality of contents while using the message service through the initial screen. In order to support such an operation, the electronic device may request that the screen be expanded before a set time elapses after the notification icon is activated or content is input.

FIG. 8 is a diagram illustrating another implementation example of configuring a screen during an expansion operation in a flexible display electronic device having a sliding structure (eg, the electronic device 101 of FIG. 1 ), according to an embodiment.

Referring to FIG. 8 , in the first state (a) before the screen expansion, the electronic device may execute an SNS application such as Instagram and display contents according to the executed SNS application on the initial screen. When there are a plurality of contents displayed on the initial screen, the electronic device may display a notification icon 810 corresponding to each of the plurality of contents. The notification icon 810 may be used to set whether to expose the displayed content using the extended screen. The notification icon 810 may be initially in an inactive state.

In the first state (b), the electronic device may activate the notification icon 830 according to the user's request, that is, the notification selection 820 . When the notification icon 830 is activated, the electronic device displays the contents for which the notification icon is activated on the expanded screen 860 in the second state (c) in which the screen is expanded by the screen expansion operation 840 . An operation may be performed according to a scenario.

According to the above-described implementation example, the user can check the desired content through the expanded screen simply by expanding the screen while using the SNS service through the initial screen. In order to support such an operation, the electronic device may request that a notification icon be activated or a screen extension is performed before a set time elapses after a specific content is displayed on the initial screen.

9 is a diagram illustrating another implementation example of configuring a screen during an expansion operation in a flexible display electronic device having a sliding structure (eg, the electronic device 101 of FIG. 1 ), according to an embodiment.

Referring to FIG. 9 , the electronic device may execute the messenger application in the first state (a) before the screen expansion, and display a message exchange image according to the executed messenger application on the initial screen. The electronic device may recognize the occurrence of an event in which a message capable of interworking with another application, such as a web page address, is input or received. When a web page address is input as an interworking support event, the electronic device may display a notification icon 910 corresponding to the web page address. The notification icon 910 may be used to set whether to display a web page corresponding to a web page address using an extended screen. The notification icon 910 may be initially in an inactive state.

The electronic device may activate the notification icon 930 in response to a user's request, that is, the notification selection 920 in the first state (b). When the notification icon 930 is activated, the electronic device executes the Internet application in the second state (c) in which the screen is expanded by the screen expansion operation 940 to provide content information corresponding to the web page address 950 . An operation according to an interworking scenario of displaying (eg, a web page) on the expanded screen 960 may be performed.

According to the above-described implementation example, the user can check the web page according to the web page address through the expanded screen simply by expanding the screen after confirming the input of the web page address while using the message service through the initial screen. . In order to support such an operation, the electronic device may request that the screen be expanded before a set time elapses after a notification icon is activated or a web page address is input.

FIG. 10 is a diagram illustrating another implementation example of configuring a screen during an expansion operation in a flexible display electronic device having a sliding structure (eg, the electronic device 101 of FIG. 1 ), according to an embodiment.

Referring to FIG. 10 , the electronic device may execute the messenger application in the first state (a) before the screen expansion, and display a message exchange image according to the executed messenger application on the initial screen. The electronic device may recognize the occurrence of an event in which a message capable of interworking with another application, such as an address, a business name, or a local phone number, is input or received. When address information is input as an interworking support event, the electronic device may display a notification icon 1010 corresponding to the address information. The notification icon 1010 may be used to set whether to expose the location on the map for the address information using the extended screen. The notification icon 1010 may be initially in an inactive state.

The electronic device may activate the notification icon 1030 in response to a user's request, that is, the notification selection 1020 in the first state (b). When the notification icon 1030 is activated, the electronic device executes the map application in the second state (c) in which the screen is expanded by the screen expansion operation 1040 to provide content information corresponding to the address information 1050 ( For example, an operation according to an interworking scenario of displaying a map) on the expanded screen 1060 may be performed.

According to the above-described implementation example, the user can check the map according to the address information through the expanded screen simply by expanding the screen after confirming the input of address information while using the message service through the initial screen. In order to support such an operation, the electronic device may request that the screen be expanded before a set time elapses after the notification icon is activated or address information is input.

11 is a diagram illustrating another implementation example of configuring a screen during an expansion operation in a flexible display electronic device having a sliding structure (eg, the electronic device 101 of FIG. 1 ), according to an embodiment.

Referring to FIG. 11 , in the first state (a) before the screen expansion, the electronic device may execute an application for servicing an e-mail and display an e-mail image according to the executed application on the initial screen. When an attached file exists in the e-mail displayed on the screen, the electronic device may display a notification icon 1110 corresponding to the attached file. The notification icon 1110 may be used to set whether to expose an attached file existing in an e-mail using an extended screen. The notification icon 1110 may be initially in an inactive state.

In the first state (b), the electronic device may activate the notification icon 1130 according to the user's request, that is, the notification selection 1120 . When the notification icon 1130 is activated, the electronic device transmits the attachment included in the e-mail to the user through the expanded screen 1160 in the second state (c) in which the screen is expanded by the screen expansion operation 1140 . It is possible to perform an operation according to the displayed interworking scenario to be confirmed.

According to the above-described implementation example, the user can check the attachment through the extended screen simply by expanding the screen after confirming the reception of the e-mail including the attached file through the initial screen. In order to support such an operation, the electronic device may request that a notification icon be activated or that the screen is expanded before a set time elapses after an e-mail is received.

Although not shown, when a screen is expanded while a specific article is being displayed on the initial screen, the electronic device may display a comment on the specific article in association with the expanded screen.

12 is a diagram illustrating a block configuration for adjusting touch sensitivity in consideration of a change in screen size in an electronic device (eg, the electronic device 101 of FIG. 1 ), according to an embodiment.

12 , the electronic device includes a control unit 1210 , a display unit 1220 , an input unit 1230 , a wireless communication unit 1240 , a motor unit 1250 , a sensor unit 1260 , and/or a storage unit 1270 ). may include The storage unit 1270 may include an operating system 1271 , a user interface 1273 , and an application program 1275 . In various embodiments, the electronic device may include additional components in addition to the components illustrated in FIG. 12 , or may omit at least one of the components illustrated in FIG. 12 .

According to an embodiment, the wireless communication unit 1240 may provide an interface for communication with other systems or devices. The wireless communication unit 1240 may include a network interface card or a wireless transmission/reception unit that enables communication through an external network (eg, a network). The wireless communication unit 1210 may perform signal processing for accessing a wireless network. The wireless network may include, for example, at least one of a wireless LAN and a cellular network (eg, long term evolution (LTE)).

According to an embodiment, the input unit 1230 may detect an input from an external (eg, a user) and provide data corresponding to the detected input to the controller 1210 . The input unit 1220 may include at least one hardware module for detecting an input from the outside. The at least one hardware module may include, for example, at least one of a sensor, a keyboard, a key pad, a touch pad, and a touch panel. When the input unit 1230 is implemented as a touch panel, the input unit 1230 may be coupled to the display unit 1220 to provide a touch screen. In this case, the input unit 1230 may perform a user's touch input (eg, tap, press, pinch, stretch, slide, swipe, rotate). etc.) may be provided to the controller 1210 .

According to an embodiment, the display unit 1220 may perform functions for outputting information in the form of numbers, characters, images, graphics, and the like. The display unit 1220 may include at least one hardware module for output. The at least one hardware module is, for example, a liquid crystal display (LCD), a light emitting diode (LED), a light emitting polymer display (LPD), an organic light emitting diode (OLED), an active matrix organic light emitting diode (AMOLED). ), and may include at least one of a flexible LED (FLED). The display unit 1220 may display a screen corresponding to data received from the control unit 1210 . The display unit 1220 may be referred to as an 'output unit', a 'display unit', or other terms having an equivalent technical meaning.

According to an embodiment, the storage unit 1270 may store data such as a basic program for operation of the electronic device, the user interface 1273 , the application program 1275 , or setting information. The storage unit 1270 may be configured as a volatile memory, a non-volatile memory, or a combination of a volatile memory and a non-volatile memory. The storage unit 1270 may provide stored data according to a request of the control unit 1210 . The storage unit 1270 may store an operating system (OS) program 1271 and at least one application.

In an embodiment, the motor unit 1250 may be electrically connected to the rolling shaft and the control unit 1210 . The motor unit 1250 may rotate the rolling shaft using a voltage applied under the control of the controller 1210 . The motor unit 1250 may determine the degree of rotation of the rolling shaft based on sliding state information of the display 1220 obtained from the control unit 1210 . The rotation of the rolling shaft by the motor unit 1250 may move the flexible display to change (eg, expand or reduce) the screen size.

According to an embodiment, the sensor unit 1260 may include at least one sensor. The sensor unit 1260 may have an electrical/operational connection relationship with a speaker, a microphone, and a camera. The sensor unit 1260 may provide a sensing result obtained through at least one sensor to the control unit 1210 . The sensing result obtained through the at least one sensor may include information such as whether or not the screen size of the flexible display has been changed and the changed screen size.

According to an embodiment, the controller 1210 may execute an operation or data processing related to control and/or communication of at least one other component of the electronic device by using the instructions stored in the storage unit 1270 . The control unit 1210 includes a central processing unit (CPU), a graphic processing unit (GPU), a micro controller unit (MCU), a sensor hub, a supplementary processor, a communication processor, and an application processor. , an application specific integrated circuit (ASIC), and field programmable gate arrays (FPGA), and may have a plurality of cores.

According to an embodiment, the controller 1210 may process data obtained from the input unit 1230 and the sensor unit 1260 , or control operation states of the input unit 1230 and the sensor unit 1260 . The control unit 1210 may transmit and/or receive a signal through the wireless communication unit 1240 . The control unit 1210 may display various screens through the display unit 1220 .

According to an embodiment, the controller 1210 is configured to respond to information or signals from the wireless communication unit 1240 or the input unit 1230 in a first state before the start of the screen expansion operation is detected by the sensor unit 1260 . You can monitor if an event occurs. When detecting the occurrence of an event, the control unit 1210 may display one or more items corresponding to the detected event as an initial screen through the display unit 1220 . When it is detected by the sensor unit 1260 that the screen expansion operation is started, the controller 1210 is configured to at least one of one or a plurality of items displayed on the initial screen in a second state in which the screen size is expanded by the screen expansion operation. A content may be executed in association with one item, and the executed content may be displayed on an expanded screen due to the screen expansion operation.

13 is a diagram illustrating an example of signal processing for touch setting control in a platform structure of a flexible type electronic device (eg, the electronic device 101 of FIG. 1 ), according to an embodiment.

Referring to FIG. 13 , a platform applicable to a flexible type electronic device includes a hardware (HW) layer, a kernel (eg, Linux kernel) layer, a hardware abstraction layer (HAL), and a framework. A layer and an application layer may have a sequentially stacked structure. The hardware layer may include, for example, a touch controller, a sensor controller, a motor controller, a hardware codec, or a display panel. The kernel layer includes, for example, an input device driver 1311 , a sensor driver 1319 , a motor driver 1329 , and a power controller 1339 . ), a graphic compositor 1335 or a frame buffer driver 1337 . The kernel layer may further include a codec driver or a DDI controller. The HAL may include, for example, an event hub 1313 . The framework layer includes, for example, an input dispatcher 1315 , an input manager 1326 , an orientation state manager 1341 , a sensor manager ( 1321 , a display expanding state manager 1323 , a display manager 1327 , a power manager 1325 , a buffer queue 1331 or a hardware renderer ( 1333) may be included. The application layer, for example, may include a plurality of apps (APP1, APP2, APP3) and a system user interface (user UI).

According to an embodiment, the input device driver 1311 may be a device control module for receiving an input using an input means such as a touch, a key, or a mouse. The sensor driver 1319 may be a sensor (eg, ToF, Illumination, Bending, Hall, Motion) for detecting a display extension state, and an interface module for measuring an orientation of a device. The motor device driver 1329 may be a module that performs driving to expand the display according to a system signal. The power controller 1339 may be a module that controls the supply of power related to the operation of the electronic device according to a system state. The graphic configurator 1335 may be a module for combining graphic bitmap information from several separate sources and outputting it as one bitmap information for output to a display. The frame buffer driver 1337 may be a module that controls a buffer containing graphic information to be output to a display.

According to an embodiment, the event hub 1313 may be a module that receives events generated from various components, such as touch and sensor modules, and converts them into standard input events of an operating system (OS).

According to an embodiment, the input dispatcher 1315 may be a module for distributing and delivering an input event to an event receiving target (window, process) module. The input manager 1317 may be a module that provides information on an input device provided by the electronic device and sets display viewport information for interpreting raw data of the input device. The sensor manager 1321 may be a module that converts events generated from various sensor devices into standardized sensor events suitable for the OS through conversion such as fusing and controls event flow. The display extended state manager 1323 may be a module that can analyze one or a plurality of sensor events to determine an extended state of the display and provide this information to each module that needs it. The power manager 1325 may be a module that manages battery capacity, temperature, or power according to a system state, and determines or provides related information necessary for operation of an electronic device by using the corresponding information. The display manager 1327 manages the lifecycle (connection/property, control/removal) of a display, which is a display device, and manages hardware display mapping to output a screen GUI element (window). It can be a module that does The display manager 1327 may further perform a role of changing a display to be output according to a system event such as a folding state change. The window manager may be a module that manages one or more GUI resources used in a screen. The hardware renderer 1333 may be an acceleration module for drawing various graphic elements generated by an application to the buffer queue 1331 for delivering to the graphic configurator 1335 . The hardware renderer 1333 may be omitted when a related function is processed by a central processing unit (CPU). The buffer queue 1331 may be a module for receiving graphic bitmap information from an image stream producer (eg, an application, etc.) and transmitting the graphic bitmap information to the graphic configurator 1335 . To this end, the buffer queue 1331 may include a memory buffer control module.

According to an embodiment, the sensor controller included in the hardware layer may provide a sensing value obtained from at least one sensor to the sensor driver 1319 included in the kernel layer. The kernel layer may provide a sensing value to the event hub 1313 included in the HAL layer. The event hub 1313 may transmit a sensing value to the framework layer. The sensor manager 1321 , the window manager 1329 , and the display extended state manager 1323 included in the framework layer work together so that at least one app (eg, APP3) included in the application layer responds to the sensed value You can do one action. The operation in response to the sensing value may be, for example, an operation of composing an application screen according to the sensing value input by the sensor driver 1319 and provided through the kernel layer and the framework layer, and displaying it on the display. have.

According to an embodiment, the display extended state manager 1323 may analyze one or a plurality of events based on events occurring in various sensor devices received from the sensor manager 1321 and transmit the analyzed results to a related module. have. The display manager 1327 receiving the analysis result may display content corresponding to the corresponding event on the expanded screen.

14 is a diagram illustrating a control flow for configuring a screen according to a change in screen size in a flexible display electronic device (eg, the electronic device 101 of FIG. 1 ), according to an embodiment.

Referring to FIG. 14 , in operation 1410 according to an embodiment, the electronic device may identify occurrence of an event. The electronic device may execute at least one application, and may identify an event based on content generated or acquired due to the executed application. The at least one application may include, for example, a messenger application, a social network service (SNS) application, or an e-mail application.

According to various embodiments, refer to FIGS. 7 (a), 8 (a), 9 (a), 10 (a), or 11 (a) for an event that may occur in the electronic device. It may be one of the events described. 7 (a) corresponds to an example in which an event occurs in which a plurality of contents capable of interworking with other applications, such as photos and videos, are input or received by executing a messenger application and exchanging messages according to the executed messenger application. do. 8( a ) corresponds to an example in which an event in which an SNS application such as Instagram is executed and contents according to the executed SNS application are received or input occurs. FIG. 9(a) corresponds to an example in which an event occurs in which a message capable of interworking with another application, such as a web page address, is input or received by executing a messenger application and exchanging a message according to the executed messenger application. 10A shows an example in which an event occurs in which a message capable of interworking with other applications, such as an address, business name, and local phone number, is input or received by executing a messenger application and exchanging messages according to the executed messenger application corresponds to 11(a) corresponds to an example in which an e-mail service application is executed, and an event in which an attachment file exists in an e-mail image according to the executed application occurs.

In operation 1420 according to an embodiment, the electronic device may detect a screen expansion operation for expanding a screen size of the flexible display. The display extension example detected by the electronic device may correspond to one of operation 760 of FIG. 7 , operation 830 of FIG. 8 , operation 940 of FIG. 9 , operation 1040 of FIG. 10 , or 1140 of FIG. 11 . The electronic device may include at least one sensor for detecting a screen expansion operation. The electronic device may sense the movement of the flexible display using at least one sensor. The electronic device may detect whether the movement of the flexible display is a movement for screen expansion. The at least one sensor, for example, detects the rotation direction and number of rotations of the sliding axis (eg, the sliding axis 440 in FIG. 4A ) and/or the rolling axis, or detects the moving direction and distance of the flexible display, It may include a sensor that generates a sensing signal according to the result. The electronic device may detect that a screen expansion operation for increasing the screen size of the flexible display is requested or being performed based on a sensing signal generated by at least one sensor. The screen expansion operation may be, for example, a sliding-out operation in the slideable electronic device, an expansion rolling operation in the rollable electronic device, or an open operation in the foldable electronic device.

In operation 1430 according to an embodiment, the electronic device may display a screen corresponding to the event on the expanded display. The electronic device activates, for example, a specific function connected to at least one of one or a plurality of items displayed on the main area in a second state in which an expansion operation is completed, and content resulting from the activation of the specific function can be displayed in the alpha area, which is an extended screen. In this case, the electronic device may maintain a screen including one or a plurality of items displayed before the expansion operation in the main area that is the initial screen as it is.

According to various embodiments, refer to FIGS. 7(c), 8(c), 9(c), 10(c), or 11(c) for an event that may occur in the electronic device. It may be one of the events described. 7C corresponds to an example in which at least one content among a plurality of content such as a photo and a video acquired through message exchange according to a messenger application is displayed on the extended screen. 8C corresponds to an example in which at least one content among a plurality of contents registered in an SNS application such as Instagram is displayed on the extended screen. FIG. 9(c) corresponds to an example in which contents such as a web page address displayed on the screen are displayed on the extended screen by exchanging messages according to a messenger application. 10C corresponds to an example in which contents such as an address, business name, and local phone number displayed on the screen are displayed on the extended screen by exchanging messages according to a messenger application. 11( c ) corresponds to an example in which content attached to an e-mail received or transmitted according to an e-mail service application is displayed on an extended screen.

15 is a diagram illustrating a control flow for configuring a screen according to a change in screen size in a flexible display electronic device (eg, the electronic device 101 of FIG. 1 ) according to another exemplary embodiment.

Referring to FIG. 15 , the electronic device may identify occurrence of an event in operation 1510 . The electronic device may determine whether a set time related to the event has elapsed in operation 1520 . The setting time may be arbitrarily set by the user in consideration of at least one requirement of an application, content, or event type.

If the display expansion is not started or completed until a set time according to the identified event elapses, the electronic device may display a notification in operation 1530 . The electronic device may, for example, display a notification icon for at least one of one or a plurality of items displayed on the initial screen in a first state before the expansion operation is performed. The notification icon may be an icon indicating whether to execute content in association with a screen expansion operation.

According to an embodiment, when a specified time has elapsed after receiving the event, in the first state before the expansion operation is performed, the electronic device relates to at least one item among one or a plurality of items displayed on the initial screen. A notification icon that allows the user to set whether or not to execute the content in association with the screen expansion operation may be displayed.

According to various embodiments, examples of displaying a notification icon in the electronic device are shown in FIGS. 7(b), 8(b), 9(b), 10(b), or 11(b). can be one of 7 (b) corresponds to an example of displaying a notification icon for setting whether or not to display at least one of a plurality of contents such as photos and videos acquired through message exchange according to a messenger application on the extended screen do. 8B corresponds to an example of displaying a notification icon for setting whether to display at least one content among a plurality of contents registered in an SNS application such as Instagram on the extended screen. 9(b) corresponds to an example of displaying a notification icon for setting whether to display content such as a web page address displayed on the screen on the extended screen by exchanging messages according to a messenger application. 10 (b) corresponds to an example of displaying a notification icon for setting whether or not to display content such as an address, business name, and local phone number displayed on the screen by message exchange according to a messenger application on the extended screen. 11 (b) corresponds to an example of displaying a notification icon for setting whether to display content attached to a received or transmitted e-mail according to an e-mail service application on the extended screen.

The electronic device may determine whether the displayed notification icon is activated by the user's request in operation 1540 . The notification icon may be activated by a user touching the notification icon or inputting a specific key through a keypad. When the notification icon is activated by the user, the electronic device may change the notification icon displayed on the screen to an activated state and display it.

If the notification icon is not deactivated, the electronic device may determine whether display expansion has started or completed in operation 1550 . When the notification icon is activated, the electronic device may determine whether display expansion has started or completed in operation 1570 .

When display expansion is started or completed while the notification icon is inactive, the electronic device may display content displayed on an existing screen (initial screen or main screen) on the expanded display, that is, the expanded full screen, in operation 1560 . When the display expansion is started or completed while the notification icon is activated, the electronic device displays the content linked to the identified event on the expanded display, that is, the expanded area (alpha area) of the expanded entire screen, on the screen in operation 1580. can be displayed In this case, the electronic device may maintain the display of content displayed on an existing screen (initial screen or main screen) in the main area.

If the electronic device detects that the display expansion is started or completed before a set time for displaying the notification icon has elapsed in operation 1590 , the electronic device may display a screen corresponding to the event on the extended display in operation 1580 .

While this disclosure has been particularly shown and described with reference to specific embodiments, various changes in form and detail may be made therein without departing from the spirit and scope of the disclosure as defined by the appended claims and their equivalents. It will be understood by those skilled in the art that there is.

According to an embodiment of the present disclosure, an electronic device (eg, the electronic device 101 of FIG. 1 ) may include: a memory; a display having a flexible structure; at least one sensor for detecting a change in the screen size of the display; and at least one processor electrically connected to the memory, the display, and the at least one sensor, wherein, when the memory is executed, the at least one processor causes the at least one processor before a screen expansion operation is started. One or a plurality of items corresponding to the event received in the first state are displayed on the screen, and in the second state in which the screen size is expanded by the screen expansion operation, the screen is linked to at least one of the one or a plurality of items Instructions for displaying the executed content on the expanded screen may be stored.

According to an embodiment of the present disclosure, when the memory is executed, a notification indicating whether the processor executes content in conjunction with the screen expansion operation for at least one item among the one or a plurality of items You can store instructions for displaying an icon.

According to an embodiment of the present disclosure, when executed, the processor may store instructions for displaying the notification icon when a specified time elapses after receiving the event.

According to an embodiment of the present disclosure, when the memory is executed, when the screen expansion operation is started before the specified time elapses after the processor receives the event, the one or more items Instruction for displaying content executed in association with at least one of the items on the expanded screen may be stored.

According to an embodiment of the present disclosure, when the memory is executed, if the screen expansion operation is not started until a specified time elapses after the processor receives the event, the one or more items Instructions for displaying a notification icon indicating whether to execute content in association with the screen expansion operation for at least one of the items may be stored.

According to an embodiment of the present disclosure, when the memory is executed, the screen expansion operation is completed in a state in which the processor displays notification icons for at least two of the one or a plurality of items are activated If done, instructions for displaying contents executed in association with each of the two items on the expanded screen may be stored.

According to an embodiment of the present disclosure, the one or more items are at least one of content included in a message provided by a messenger application, content according to social network services (SNS), or content attached to an e-mail. may include

According to an embodiment of the present disclosure, when the memory is executed, the processor, in the second state, sequentially considers priorities of contents linked to at least two of the one or a plurality of items. It is possible to store instructions to be executed and displayed on the extended screen.

According to an embodiment of the present disclosure, when the memory is executed, instructions for causing the processor to sequentially execute contents linked to the at least two items in response to a user's request in consideration of the priority can be saved

According to an embodiment of the present disclosure, when the memory is executed, a user request an interworking scenario in which the processor connects a target item displayed on a screen in the first state and content to be executed in association in the second state You can store instructions to set according to

According to an embodiment of the present disclosure, an operating method in a flexible display electronic device includes: displaying one or more items corresponding to an event received in a first state before a screen expansion operation is started on an initial screen; and displaying, on the expanded screen, content executed in association with at least one of the one or a plurality of items in a second state in which the screen size is expanded by the screen expansion operation.

According to an embodiment of the present disclosure, in the first state, an operation of displaying a notification icon indicating whether to execute content in conjunction with the screen expansion operation for at least one of the one or a plurality of items is performed. may include more.

According to an embodiment of the present disclosure, when a specified time elapses after receiving the event, a notification indicating whether to execute content in conjunction with the screen expansion operation for at least one of the one or a plurality of items An operation of displaying an icon may be further included.

According to an embodiment of the present disclosure, the operation of displaying on the extended screen may include, after receiving the event, if the screen expansion operation is started before the specified time elapses, at least one of the one or a plurality of items It may include an operation of displaying content executed in association with one item on the expanded screen.

According to an embodiment of the present disclosure, if the screen expansion operation is not started until a specified time elapses after receiving the event, the screen expansion operation is performed with respect to at least one of the one or a plurality of items The method may further include an operation of displaying a notification icon indicating whether to execute the content in conjunction with the .

According to an embodiment of the present disclosure, the displaying on the expanded screen may include, when the screen expansion operation is completed while notification icons displayed for at least two items among the one or a plurality of items are activated, It may include an operation of displaying contents executed in association with each of the two items on the expanded screen.

According to an embodiment of the present disclosure, one or more items include at least one of content included in a message provided by a messenger application, content according to social network services (　SNS), or content attached to an e-mail. may include

According to an embodiment of the present disclosure, the operation of displaying on the expanded screen is sequentially performed in the second state in consideration of priority of contents linked to at least two of the one or a plurality of items Thus, it may be an operation of displaying on the expanded screen.

According to an embodiment of the present disclosure, the operation of displaying on the expanded screen may include an operation of sequentially executing contents linked to the at least two items in consideration of the priority in response to a user's request. have.

According to an embodiment of the present disclosure, the method may further include, according to a user's request, setting an interworking scenario in which the target item displayed on the screen in the first state and the content to be executed by interworking in the second state are connected.

Methods according to the embodiments described in the claims or specifications of the present disclosure may be implemented in the form of hardware, software, or a combination of hardware and software.

When implemented in software, a computer-readable storage medium storing one or more programs (software modules) may be provided. One or more programs stored in the computer-readable storage medium are configured to be executable by one or more processors in an electronic device (device). One or more programs include instructions for causing an electronic device to execute methods according to embodiments described in a claim or specification of the present disclosure.

Such programs (software modules, software) include random access memory, non-volatile memory including flash memory, read only memory (ROM), electrically erasable programmable ROM (EEPROM: electrically erasable programmable read only memory), magnetic disc storage device, compact disc ROM (CD-ROM), digital versatile discs (DVDs), or other types of It may be stored in an optical storage device or a magnetic cassette. Alternatively, it may be stored in a memory composed of a combination of some or all thereof. In addition, each configuration memory may be included in plurality.

In addition, the program is transmitted through a communication network such as the Internet, an intranet, a local area network (LAN), a wide LAN (WLAN), or a storage area network (SAN), or a communication network composed of a combination thereof. It may be stored on an attachable storage device that can be accessed. Such a storage device may be connected to a device implementing an embodiment of the present disclosure through an external port. In addition, a separate storage device on the communication network may be connected to the device implementing the embodiment of the present disclosure.

The scope of protection is defined by the appended independent claims. Further features are specified by the appended dependent claims. Example implementations may be realized by including one or more features taken jointly and individually from any claim, in any and all permutations.

Examples described in this disclosure include non-limiting example implementations of components corresponding to one or more features specified by the appended independent claims, including those features (or their corresponding components), individually or in combination, may contribute to improving one or more technical problems that can be inferred by a person skilled in the art from the present disclosure.

Also, one or more selected components of any one example described in this disclosure may be combined with one or more selected components of one or more other examples described in this disclosure, or alternatively It may be combined with the features of the independently appended independent claims to form further examples.

Additional example implementations include one or more components taken jointly and individually, in any and all permutations of any implementation described herein. can be realized by Still other example implementations may also be realized by combining one or more features of the appended claims with selected one or more components of any example implementation described in this disclosure.

In forming such additional example implementations, some components of any example implementation described in this disclosure may be omitted. One or more components that may be omitted are components that a person skilled in the art would directly and clearly recognize as not so essential to the function of the present technology in light of technical problems discernable from the present disclosure. A person of ordinary skill in the art believes that even if such omitted components are replaced or removed, there is no need to modify other components or features of the further alternative example to compensate for the change. would recognize the point. Accordingly, further example implementations, in accordance with the present technology, may be included within this disclosure, even if a selected combination of features and/or components thereof is not specifically recited.

Two or more physically separate components of any described example implementation may alternatively be incorporated into a single component, where their integration is possible, in a single component so formed. Integration is possible if the same function is performed by Conversely, a single component of any example implementation described in this disclosure may alternatively be implemented as two or more separate components that achieve the same functionality, where appropriate.

In the specific embodiments of the present disclosure described above, elements included in the disclosure are expressed in the singular or plural according to the specific embodiments presented. However, the singular or plural expression is appropriately selected for the context presented for convenience of description, and the present disclosure is not limited to the singular or plural element, and even if the element is expressed in plural, it is composed of the singular or singular. Even an expressed component may be composed of a plurality of components.

Meanwhile, although specific embodiments have been described in the detailed description of the present disclosure, various modifications are possible without departing from the scope of the present disclosure. Therefore, the scope of the present disclosure should not be limited to the described embodiments and should be defined by the claims described below as well as the claims and equivalents.

Claims

In an electronic device,

Memory;

a display having a flexible structure;

at least one sensor for detecting a change in the screen size of the display; and

at least one processor electrically connected to the memory, the display, and the at least one sensor;

The memory may, when executed, cause the at least one processor to:

One or more items corresponding to the event received in the first state before the screen expansion operation is started are displayed on the screen,

and storing instructions for displaying content executed in association with at least one of the one or a plurality of items on the expanded screen in a second state in which the screen size is expanded by the screen expansion operation.
According to claim 1,

The memory, when executed, causes the processor to:

and storing instructions for displaying a notification icon indicating whether to execute content in association with the screen expansion operation with respect to at least one of the one or a plurality of items.
3. The method of claim 2,

The memory, when executed, causes the processor to:

and storing instructions for displaying the notification icon when a specified time elapses after receiving the event.
4. The method of claim 3,

The memory, when executed, causes the processor to:

After receiving the event, if the screen expansion operation is started before the specified time elapses, an instruction for displaying content executed in association with at least one of the one or a plurality of items on the expanded screen Electronic devices that store things.
According to claim 1,

The memory, when executed, causes the processor to:

If the screen expansion operation is not started until a specified time elapses after receiving the event, it indicates whether to execute content in conjunction with the screen expansion operation for at least one of the one or a plurality of items An electronic device that stores instructions for displaying a notification icon to
According to claim 1,

The memory, when executed, causes the processor to:

When the screen expansion operation is completed while the notification icons displayed for at least two of the one or a plurality of items are activated, contents executed in association with each of the two items are displayed on the expanded screen An electronic device that stores instructions for doing so.
According to claim 1,

The one or more items include at least one of content included in a message provided by a messenger application, content according to social network services (SNS), or content attached to an e-mail.
According to claim 1,

The memory, when executed, causes the processor to:

In the second state, the electronic device stores instructions for sequentially executing contents linked to at least two of the one or a plurality of items in consideration of priorities and displaying them on the expanded screen.
9. The method of claim 8,

The memory, when executed, causes the processor to:

In response to a user's request, the electronic device stores instructions for sequentially executing contents linked to the at least two items in consideration of the priority.
According to claim 1,

The memory, when executed, causes the processor to:

and storing instructions for setting, according to a user's request, an interworking scenario in which a target item displayed on a screen in the first state and a content to be executed by interworking in the second state are connected.
A method of operation in a flexible display electronic device, the method comprising:

displaying one or more items corresponding to the event received in the first state before the screen expansion operation is started on the initial screen; and

and displaying, on the expanded screen, content executed in association with at least one of the one or a plurality of items in a second state in which the screen size is expanded by the screen expansion operation.
12. The method of claim 11,

In the first state, displaying a notification icon indicating whether to execute content in association with the screen expansion operation with respect to at least one of the one or a plurality of items, the method further comprising: displaying.
12. The method of claim 11,

When a specified time elapses after receiving the event, displaying a notification icon indicating whether to execute content in conjunction with the screen expansion operation for at least one of the one or a plurality of items , Way.
The method of claim 11, wherein the displaying on the expanded screen comprises:

After receiving the event, if the screen expansion operation is started before the specified time elapses, displaying content executed in association with at least one of the one or a plurality of items on the expanded screen Including method.
12. The method of claim 11,

If the screen expansion operation is not started until a specified time elapses after receiving the event, it indicates whether to execute content in conjunction with the screen expansion operation for at least one of the one or a plurality of items The method further comprising displaying a notification icon to