WO2022108096A1 - Dispositif électronique à affichage extensible - Google Patents

Dispositif électronique à affichage extensible Download PDF

Info

Publication number
WO2022108096A1
WO2022108096A1 PCT/KR2021/013348 KR2021013348W WO2022108096A1 WO 2022108096 A1 WO2022108096 A1 WO 2022108096A1 KR 2021013348 W KR2021013348 W KR 2021013348W WO 2022108096 A1 WO2022108096 A1 WO 2022108096A1
Authority
WO
WIPO (PCT)
Prior art keywords
execution screen
processor
active area
preview
display
Prior art date
Application number
PCT/KR2021/013348
Other languages
English (en)
Korean (ko)
Inventor
최양수
이상언
한종현
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020210001902A external-priority patent/KR20220067459A/ko
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Publication of WO2022108096A1 publication Critical patent/WO2022108096A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
    • G09F9/30—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements

Definitions

  • Various embodiments relate to an electronic device having a structure capable of changing an active region in which visual information is to be displayed on a display.
  • the electronic device may have a slider (or roller) structure.
  • the electronic device includes a first housing and a slideable housing including a second housing, a roller (or slider) that allows a part of the second housing to be drawn into or drawn out from the first housing, and a flexible (flexible) may include a display.
  • the display may be disposed in a space defined by the slideable housing.
  • the display may include a first display area disposed adjacent to the first housing and a second display area disposed on the inner space while surrounding the roller.
  • the second display area may be exposed to the outside from the inner space as the second housing slides away from the first housing. Accordingly, the active area may extend over the entire display from the first display area to the second display area.
  • the electronic device may change the layout of the screen (visual information) to be displayed as the size of the display area (active area) exposed to the substantially front part of the electronic device is expanded or reduced according to the sliding movement of the device to which the display is coupled. have.
  • the electronic device may provide the user with a configuration of a screen to be applied to the changed active area in a preview form.
  • the electronic device may guide the user with a visual element how much the active area needs to be changed (enlarged or reduced in size) in order to apply the configuration identified through the preview to the screen.
  • a portable electronic device includes: a housing; a flexible display, at least a portion of which is drawn into or out of the housing; a sensor that generates data used to determine an active area in which information is to be displayed in a visually exposed area of the display; a processor coupled to the sensor and the display; and a memory coupled to the processor, wherein, when executed, the processor: provides a first execution screen of a plurality of execution screens of an application through the activation area, while providing data received from the sensor; An operation of recognizing that the size of the active area has changed based on the first execution screen and a preview corresponding to a second execution screen among previews corresponding to the plurality of execution screens in response to the change in size. Instructions for performing an operation of providing through the activation area together and an operation of providing the second execution screen through the activation area instead of the first execution screen after the preview is provided may be stored.
  • a portable electronic device includes: a housing; a flexible display, at least a portion of which is drawn into or out of the housing; a sensor that generates data used to determine an active area in which information is to be displayed in a visually exposed area of the display; a processor coupled to the sensor and the display; and a memory coupled to the processor, wherein the memory, when executed, causes the processor to: in response to a width of the active area being enlarged, enlarge an image to a specified aspect ratio, and wherein the height of the image is at a specified maximum height.
  • the first visual cue stops the enlargement of the image and recommends to the user to reduce the active region in the blank space created in the active region by stopping the enlargement of the image It is possible to store instructions for displaying .
  • a portable electronic device includes a housing; a flexible display, at least a portion of which is drawn into or out of the housing; a sensor that generates data used to identify the size of the active area exposed outside the housing on the display; a processor coupled to the sensor and the display; and a memory coupled to the processor, wherein the memory, when executed, causes the processor to: identify a size of the active region based on data received via the sensor, and provide an image via the active region. , a graphic element that changes the size of the image based on the size of the identified active area, and guides the user to how much the size of the active area needs to be adjusted in order for the resized image to be provided through the active area It is possible to store instructions for providing ? through the activation region.
  • Various embodiments may provide an electronic device that notifies a user of a change in visual information according to expansion or reduction of a display in advance.
  • various effects directly or indirectly identified through this document may be provided.
  • FIG. 1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure
  • FIGS. 2A and 2B illustrate a portable electronic device having a sliding structure, according to an exemplary embodiment.
  • 3A and 3B illustrate a portable electronic device having a sliding structure, according to an exemplary embodiment.
  • 4A, 4B, and 4C illustrate a portable electronic device having a sliding structure, according to an exemplary embodiment.
  • FIG. 5 is a diagram illustrating an electrical block configuration of an electronic device having a sliding structure according to various embodiments of the present disclosure
  • 6A to 6E are diagrams for explaining an embodiment of an operation of providing a preview of an execution screen in response to an expansion of an active area.
  • 7 to 14 are diagrams for explaining other embodiments of an operation of providing a preview of an execution screen in response to an expansion of an active area.
  • 15, 16, and 17 are diagrams for explaining embodiments of an operation of guiding a user how much the size of the active area should be enlarged in order to provide an execution screen to be displayed next to the execution screen being displayed.
  • 18, 19, and 20 are diagrams for explaining embodiments of an operation of providing a guide (visual cue) regarding enlargement of a specific UI element based on an aspect ratio specified for the specific UI element on an execution screen.
  • 21 is a diagram for explaining an embodiment of an operation of changing an arrangement of execution screens according to an extension of an active area.
  • 22 is a diagram for explaining an embodiment of an operation of providing a preview of an execution screen in response to reduction of an active area.
  • 23 is a flowchart illustrating operations for providing a preview of an execution screen.
  • FIG. 1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments of the present disclosure.
  • an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • a first network 198 eg, a short-range wireless communication network
  • a second network 199 e.g., a second network 199
  • the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included.
  • at least one of these components eg, the connection terminal 178
  • may be omitted or one or more other components may be added to the electronic device 101 .
  • some of these components are integrated into one component (eg, display module 160 ). can be
  • the processor 120 for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 .
  • software eg, a program 140
  • the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 .
  • the volatile memory 132 may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 .
  • the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor).
  • the main processor 121 e.g, a central processing unit or an application processor
  • a secondary processor 123 eg, a graphic processing unit, a neural network processing unit
  • NPU neural processing unit
  • an image signal processor e.g., a sensor hub processor, or a communication processor.
  • the main processor 121 e.g, a central processing unit or an application processor
  • a secondary processor 123 eg, a graphic processing unit, a neural network processing unit
  • NPU neural processing unit
  • an image signal processor e.g., a sensor hub processor, or a communication processor.
  • the main processor 121 e.g, a central processing unit or an application processor
  • a secondary processor 123
  • the secondary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep or IDLE) state, or when the main processor 121 is active (eg, At least one of the components of the electronic device 101 (eg, the display module 160 , the sensor module 176 , or the communication module 190 ) together with the main processor 121 while in the application execution) state )) associated with at least some of the functions or states.
  • the coprocessor 123 eg, an image signal processor or a communication processor
  • may be implemented as part of another functionally related component eg, the camera module 180 or the communication module 190). have.
  • the auxiliary processor 123 may include a hardware structure specialized for processing an artificial intelligence model.
  • Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108).
  • the learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited
  • the artificial intelligence model may include a plurality of artificial neural network layers.
  • Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example.
  • the artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.
  • the memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ).
  • the data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto.
  • the memory 130 may include a volatile memory 132 or a non-volatile memory 134 .
  • the program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .
  • the input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 .
  • the input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).
  • the sound output module 155 may output a sound signal to the outside of the electronic device 101 .
  • the sound output module 155 may include, for example, a speaker or a receiver.
  • the speaker can be used for general purposes such as multimedia playback or recording playback.
  • the receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.
  • the display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 .
  • the display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device.
  • the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.
  • the audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 or an external electronic device (eg, a sound output module 155 ) directly or wirelessly connected to the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).
  • an external electronic device eg, a sound output module 155
  • a sound may be output through the electronic device 102 (eg, a speaker or headphones).
  • the sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do.
  • the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.
  • the interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ).
  • the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
  • HDMI high definition multimedia interface
  • USB universal serial bus
  • SD card interface Secure Digital Card
  • the connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ).
  • the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).
  • the haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense.
  • the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
  • the camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
  • the power management module 188 may manage power supplied to the electronic device 101 .
  • the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
  • PMIC power management integrated circuit
  • the battery 189 may supply power to at least one component of the electronic device 101 .
  • battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.
  • the communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel.
  • the communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication.
  • the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module).
  • GNSS global navigation satellite system
  • a corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN).
  • a first network 198 eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)
  • a second network 199 eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN).
  • a telecommunication network
  • the wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 .
  • the electronic device 101 may be identified or authenticated.
  • the wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR).
  • NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)).
  • eMBB enhanced mobile broadband
  • mMTC massive machine type communications
  • URLLC ultra-reliable and low-latency
  • the wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example.
  • a high frequency band eg, mmWave band
  • the wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna.
  • the wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ).
  • the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).
  • a peak data rate eg, 20 Gbps or more
  • loss coverage eg, 164 dB or less
  • U-plane latency for realizing URLLC
  • the antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device).
  • the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern.
  • the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna.
  • other components eg, a radio frequency integrated circuit (RFIC)
  • RFIC radio frequency integrated circuit
  • the antenna module 197 may form a mmWave antenna module.
  • the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, underside) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.
  • peripheral devices eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)
  • GPIO general purpose input and output
  • SPI serial peripheral interface
  • MIPI mobile industry processor interface
  • the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 .
  • Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 .
  • all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 .
  • the electronic device 101 may perform the function or service itself instead of executing the function or service itself.
  • one or more external electronic devices may be requested to perform at least a part of the function or the service.
  • One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 .
  • the electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request.
  • cloud computing distributed computing, mobile edge computing (MEC), or client-server computing technology may be used.
  • the electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing.
  • the external electronic device 104 may include an Internet of things (IoT) device.
  • Server 108 may be an intelligent server using machine learning and/or neural networks.
  • the external electronic device 104 or the server 108 may be included in the second network 199 .
  • the electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.
  • the electronic device may have various types of devices.
  • the electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device.
  • a portable communication device eg, a smart phone
  • a computer device e.g., a smart phone
  • a portable multimedia device e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a wearable device e.g., a smart bracelet
  • a home appliance device e.g., a home appliance
  • first, second, or first or second may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively”. When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.
  • module used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit.
  • a module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions.
  • the module may be implemented in the form of an application-specific integrated circuit (ASIC).
  • ASIC application-specific integrated circuit
  • one or more instructions stored in a storage medium may be implemented as software (eg, the program 140) including
  • a processor eg, processor 120
  • a device eg, electronic device 101
  • the one or more instructions may include code generated by a compiler or code executable by an interpreter.
  • the device-readable storage medium may be provided in the form of a non-transitory storage medium.
  • 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.
  • a signal eg, electromagnetic wave
  • the method according to various embodiments disclosed in this document may be included in a computer program product (computer program product) and provided.
  • Computer program products may be traded between sellers and buyers as commodities.
  • the computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store TM ) or on two user devices ( It can be distributed online (eg download or upload), directly between smartphones (eg smartphones).
  • a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.
  • each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. have.
  • one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added.
  • a plurality of components eg, a module or a program
  • the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. .
  • operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.
  • the surface on which the display is visually exposed to the user may be referred to as the front surface of the electronic device 101 .
  • the opposite surface of the front surface may be referred to as the rear surface of the electronic device 101 .
  • a surface surrounding the space between the front surface and the rear surface may be referred to as a side surface of the electronic device 101 .
  • the term “state” may refer to a structural form, posture, shape, or shape of the electronic device 101 (or a display or housing constituting the electronic device 101 ).
  • a roller for allowing the first housing, the second housing, and the second housing to be drawn into the first housing and the second housing to be drawn out from the first housing, and a flag It may include a sub-display.
  • the second housing may be divided into a portion that can be entered into the first housing (hereinafter, referred to as an inlet portion) and a portion maintained in a state exposed to the outside.
  • an inlet portion a portion that can be entered into the first housing
  • the entire display or display Most of the area
  • the display may also be drawn into the first housing.
  • the display may also be divided into a portion that remains exposed to the outside (eg, a first display area) and a portion that can enter the inside of the first housing (eg, a second display area).
  • a state eg, a reduced state, a slide-in state, or a roll-in state
  • the display The entire second display area may be introduced into the first housing.
  • a portion of the display may be disposed to move toward the rear side through the side without being drawn into the first housing.
  • the electronic device 101 may have a sliding structure in which a part of the display is drawn into the housing, or a sliding structure in which a part of the display is moved from the front to the rear. In the display, only a portion exposed through the front surface may be determined as an active area for displaying visual information. A portion introduced into the housing or disposed to be moved to the rear side may be determined as an inactive area.
  • the electronic device 10 may have a sliding structure different from that exemplified above.
  • the electronic device 101 may include a housing, a roller disposed within the housing, and a flexible (or rollable) display that is drawn into the housing by being wound around the roller or pulled out of the housing by unwinding from the roller. have. Even if the display is wound around the roller, a portion of the display (eg, the first display area) may be maintained exposed to the outside. As another example, the entire display area may be introduced into the housing.
  • the portable electronic device 200 (eg, the electronic device 101 of FIG. 1 ) includes a first housing 210 , a second housing 220 , a roller, and a slideable housing 210 .
  • the portable electronic device 200 may include a flexible display 230 disposed in a space formed by.
  • the second housing 220 may be coupled to the first housing 210 to be slidable.
  • the roller may be disposed in the inner space of the second housing 220 .
  • the roller may rotate, but it is not necessary to roll (rolling, rotating), and may serve as a mechanical guide when the display is wound or unwound.
  • the display 230 includes a first display area 231 disposed adjacent to the first housing 210 and visually exposed through the front surface of the electronic device 200 and a second display area 232 retractable into the inner space. may include When the second housing 220 slides toward the first housing 210 , the second display area 232 may enter the inside of the second housing 220 and be wound around the roller.
  • the second display area 232 is released from the roller when the second housing 220 is slid in a direction away from the first housing 210 (eg, the -y-axis direction as shown in FIG. 2A ) to release the electronic device 200 . ) can be visually exposed through the front.
  • the state of the electronic device 200 may be defined based on the rotation angle of the roller (eg, the rotation angle of the roller in the direction in which the display 230 is unwound from the roller (eg, clockwise)). .
  • the rotation angle of the roller exceeds the first threshold value
  • the state of the electronic device 200 is that only the first display area 231 of the display 230 is exposed (or the second display area 232 ). It can be defined as a state (eg, normal state, reduced state, slide-in state) placed in this interior space.
  • the state of the electronic device 200 is changed to the entire display 230 (eg, the first display area 231 and the second display area ( 232)) may be defined as an exposed state (eg, extended state, slide-out state).
  • the second display area 232 may be maintained in a partially exposed (or partially hidden) state (eg, an intermediate state).
  • the state of the electronic device 200 may be defined based on a curvature (degree of curvature) of a designated portion on the display 230 .
  • a curvature degree of curvature
  • the state of the electronic device 200 may be defined as the first state.
  • the state of the electronic device 200 may be defined as a second state. Based on the state of the electronic device 200 , an active region in which visual information (eg, an application execution screen) is displayed on the display 230 may be determined.
  • the active area when the electronic device 200 is in the first state, the active area is determined to be the first display area 231 , and thus visual information may be displayed on the first display area 231 .
  • the active area is determined to be the entire area of the display 230 (eg, the first display area 231 and the second display area 232 ), and accordingly, the entire area is visually displayed. Information may be displayed.
  • 3A and 3B illustrate a portable electronic device 300 having a sliding structure, according to an exemplary embodiment.
  • the portable electronic device 300 eg, the electronic device 101 of FIG. 1
  • the portable electronic device 300 includes a first housing 310 , a second housing 320 , a roller (not shown), and a slide.
  • a flexible display 330 disposed in a space formed by the double housings 310 and 320 may be included.
  • the display 330 is disposed adjacent to the first housing 310 and surrounds the first display area 331 visually exposed through the front surface of the electronic device 200 and the roller and disposed on the inner space.
  • the second display area 332 is released from the roller when the second housing 320 is slid in a direction away from the first housing 310 (eg, the x-axis direction as shown in FIG. 3A ) to release the electronic device 200 . can be visually exposed through the front of the
  • the portable electronic device 400 (eg, the electronic device 101 of FIG. 1 ) includes a housing 410 , a ruler (not shown) disposed inside the housing 410 , and A flexible (or rollable) display 420 may be included.
  • the display 420 may be released from the ruler to be exposed to the outside of the housing 410 , or may be wound around a roller to enter the housing 410 .
  • the state of the electronic device 400 based on the rotation angle of the roller in the housing 410 can be defined.
  • the state of the electronic device 400 is a first partially unlocked state indicating that the display 420 is partially unlocked. (eg, the reduced state or the slide-in state).
  • the rotation angle B of the roller exceeds the second threshold value, which is greater than the first threshold value, the state of the electronic device 400 indicates that the display 420 is more released than the first partially released state.
  • a second partially unlocked state eg, a partially extended state, a partial slide-out state
  • the state of the electronic device 400 is more unlocked than when the second partially released state (or the display 420 )
  • a fully released state eg, the expanded state or the slide-out state
  • the state of the electronic device 400 may be defined based on a curvature (degree of curvature) of a designated portion on the display 420 .
  • a curvature degree of curvature
  • a first portion 421 , a second portion 422 , and a third portion 423 for determining a state may be designated.
  • a portion parallel to the rotation axis of the display 420 may be set as the portions 421 , 422 , and 423 .
  • the state of the electronic device 400 may be defined as a first partially unlocked state.
  • the curvature of the first portion 421 and the second portion 422 corresponds to a value (or within a range) indicating flatness
  • the curvature of the third portion 423 corresponds to a value (or within a range) indicating that it is concave (or convex).
  • the state of the electronic device 400 may be defined as a second partially unlocked state.
  • the state of the electronic device 400 may be defined as a fully unwrapped state.
  • an active area may be determined on the display 420 .
  • the active area may be determined as the first display area 431 .
  • the active area may be determined as the first display area 431 and the second display area 432 extending therefrom.
  • the first display area 431 , the second display area 432 , and the third display area 433 extending from the second display area 432 eg: The entire display 420 may be determined as an active area.
  • the state of the electronic device 200 may be defined by identifying the size of the active area of the display exposed to the front through the state detection sensor, where the state detection sensor determines the amount of light according to the sliding of the housing. At least one of a change in a sensing value, a change in a capacitance sensing value, a change in a magnetic force or magnetic flux sensing value, a change in a resistance sensing value, a change in a pressure sensing value, and a change in a rotation angle sensing value can be detected. It means a sensor, and a representative sensor will be described later.
  • the electronic device 500 (eg, the electronic device 101 of FIG. 1 ) is configured to change visual information as the active area of the display is changed (its size is enlarged or reduced) and to provide the changed visual information through the active area can be
  • the electronic device 500 may include a touch-sensitive display 510 , a state detection sensor 520 , a memory 530 , and a processor 599 .
  • the display 510 may be divided into a first display area 511 and a second display area 512 .
  • the first display area 511 is a portion in which visual exposure is maintained through the front surface of the electronic device 500
  • the second display area 512 is inserted into the electronic device 500 or moved to the rear side. It may be an arranged part.
  • both the first display area 511 and the second display area 512 can be retracted into the electronic device 500, but the first display area 511 enters before the second display area 512, It may be a minimum area (eg, the first display area 431 of FIG. 4 ) designated as an active area in which visual information is to be displayed.
  • the active area may be determined as a portion of the display 510 that is visually exposed to the user.
  • the active area may be a first display area 511 , a first display area 511 , and a second display area according to a state (eg, a reduced state, an expanded state, or an intermediate state) of the electronic device 500 . It may be determined as a part of 512 or the entire display 510 (eg, the first display area 511 and the second display area 512 ).
  • the state detection sensor 520 (eg, the sensor module 176 of FIG. 1 ) recognizes a state (eg, a reduced state, an expanded state, an intermediate state) of the electronic device 400 and determines an active area in which visual information is to be displayed.
  • the state sensor 520 may include a sensor (eg, an encoder, a hall sensor) that is attached to the roller and generates and outputs data corresponding to the rotation angle when the roller rotates.
  • the state detection sensor 520 is disposed on a designated portion of the display 510 (eg, the second display area 232 of FIG. 2 or the second display area 332 of FIG. 3 ) to detect the curvature of the corresponding portion. It may also include sensors (eg pressure sensors) that generate corresponding data.
  • the memory 530 may store visual information to be displayed in the active area.
  • the visual information may include a background element and a user interface (UI) element (or a user experience (UX) element or a foreground element).
  • the UI element is a graphic element that enables interaction between the electronic device 500 and a user, and includes, for example, a video, an image, a guide (eg, a visual cue) related to a size change of an active area, text, It may include thumbnails, emoticons, icons, keypads, buttons, or menus.
  • UI elements can be operatively linked to specific functions. Accordingly, the processor 599 may execute a function connected to the UI element in response to a user's touch input for the UI element.
  • the background element is a graphic element that is not related to an interaction between the electronic device 500 and a user and is not connected to a specific function, and may include, for example, a background image or text.
  • the visual information may include a plurality of application execution screens classified according to a specified size (or a state of the electronic device 500 ) of the active area.
  • the application eg, the application 146 of FIG. 1
  • the execution screen to be displayed through the first display area 511 and the active area are displayed in the first display area 511 . 2
  • the display area 512 is enlarged to a designated place
  • An execution screen to be displayed may be provided to the processor 599 .
  • the application may provide a preview corresponding to each execution screen to the processor 599 .
  • the preview may include a thumbnail image that is a thumbnail of the corresponding execution screen.
  • the preview may include an icon representing a characteristic element of the corresponding execution screen.
  • the preview may include text expressing characteristic elements of the corresponding execution screen.
  • the processor 599 may provide an execution screen and a preview through the activation area. For example, when it is assumed that a first preview corresponding to the first execution screen and a second preview corresponding to the second execution screen are provided to the processor 599, the processor 599 performs the first execution screen and the second execution screen. A preview or a second execution screen and a first preview may be provided through the activation area. Accordingly, the user may recognize in advance the execution screen to be changed according to the change in the size of the active area through the preview.
  • Execution screens provided by the application to the processor 599 may be different in content (content) to be displayed to the user, amount of content, properties, or layout thereof. For example, as the active area increases, a larger amount of content (eg, text amount, number of images, number of pages) may be included in the execution screen. Properties (eg, size, resolution, pixel density, color, brightness) may be different for each execution screen. For example, a size (eg, width and/or height) of a background element and/or a foreground element may increase as the active area increases, and conversely, a size of the corresponding element decreases as the active area becomes smaller.
  • content content
  • properties eg, as the active area increases, a larger amount of content (eg, text amount, number of images, number of pages) may be included in the execution screen.
  • Properties eg, size, resolution, pixel density, color, brightness
  • a size of corresponding element decreases as the active area becomes smaller.
  • the portrait mode or portrait mode
  • landscape mode or landscape
  • the content may be different for each execution screen For example, as the active area increases, a new UI element is provided through the active area, or an existing UI element It can be replaced with other UI elements.
  • the memory 530 may store layout information used to configure visual information to be displayed in the active area. For example, in the application stored in the memory 530 , layout information for configuring an execution screen to be displayed through the first display area 511 , an active area is the second display area in the first display area 511 . Layout information for configuring an execution screen to be displayed through the active area when enlarged to the place specified in (512), and activated when the active area is enlarged from the first display area 511 to the entire second display area 512 A resource file (eg, an xml file) including layout information for configuring an execution screen to be displayed through the region may be provided to the processor 599 . The processor 599 may generate an execution screen using layout information corresponding to the active area in the resource file and display it in the active area. Additionally, the processor 599 may generate a preview with other layout information and provide the preview together with the execution screen through the activation area.
  • layout information for configuring an execution screen to be displayed through the first display area 511 an active area is the second display area in the first
  • the memory 430 is a portion of the display 510 set as the active area (eg, the first display area 511) through the application (eg, album, phone, calendar, email, calculator, web browser, video player)
  • a first execution screen is provided, and while the first execution screen is provided, based on the fact that the active area is extended to another part (eg, the second display area 512 ) extended from the part, the active area is divided into the first window and an instruction for causing the processor 599 to perform a function of dividing into a second window, providing a first execution screen through the first window, and providing a preview corresponding to a second execution screen of the application through the second window
  • the instructions are based on the processor 599 expanding when a preview is selected by the user or the active area is expanded by a specified size (eg, a size set to display the second execution screen).
  • the classification of the active area into the multi-window may be terminated and the function of providing the second execution screen through the entire active area may be further performed.
  • the active region may be divided into a first window and a second window along the x-axis direction of FIG. 3A .
  • the processor 599 provides the second execution screen of the application through the activation area (eg, the entire display 510), and based on the reduction in the activation area while the second execution screen is provided, the activation area may be divided into a first window and a second window, and a function of providing a second execution screen through the first window and providing a preview corresponding to the first execution screen through the second window may be further performed.
  • the processor 599 classifies the active area into multi-windows based on whether the preview is selected by the user or the active area is reduced by a specified size (eg, a size set to display the first execution screen). It is possible to further perform the function of providing the first execution screen through the entire activation area and ending the operation.
  • the processor 599 may divide the active region into a first window and a second window along a reduction direction (eg, the 'y-axis direction' of FIG. 2B and the -x-axis direction of FIG. 3B ).
  • the instructions may cause the processor 599 to perform a function of providing a preview when expanding and/or reducing the active area without dividing the active area in two.
  • the processor 599 designates a preview as an uppermost layer among elements (or objects) to be displayed in the active area, and superimposes the preview on the execution screen in the form of a pop-up window. can be displayed
  • the processor 599 may provide a visual effect in which a portion overlapping with the preview on the execution screen is blurred by adjusting the transparency of the preview.
  • the instructions allow the processor 599 to recognize a state change of the electronic device 500 based on data received from the state detection sensor 520 and respond to the state change of the electronic device 500 in real time.
  • the activation region may be expanded or contracted by reacting hysteresis.
  • the processor 599 recognizes a portion exposed to the outside in the second display area 512 , and extends the active area from the first display area 512 to the exposed portion of the second display area 512 . can be expanded When the entire second display area 512 is exposed, the processor 599 sets the active area from the first display area 512 to the entire area of the display 510 (the first display area 511 and the second display area). (512)) can be extended.
  • the processor 599 may fix the size of the second window and extend the size of the first window in response to the expansion of the active area.
  • the instructions, the processor 599 provides a plurality of previews through the first execution screen and the second window through the first window, and the size of the active area is changed (eg, reduced or enlarged) a second execution screen is provided through the first window instead of the first execution screen based at least on the basis of the It can be made to perform the function of distinguishing emphasis. Accordingly, the user can intuitively recognize which execution screen corresponding to a preview is displayed in the preview list through the highlighted preview or that the preview disappears from the list.
  • the instructions provide the processor 599 with a plurality of previews through the first execution screen and the second window through the first window based on the change in the size of the active area, and the first execution screen
  • the second execution screen to be provided through the first window is determined based on the direction (reduction or enlargement) of the change, and the function of emphasizing the preview of the second execution screen among the previews is performed. can do. Accordingly, the user can intuitively recognize through the highlighted preview which execution screen will be displayed in the future when the active area is continuously reduced or enlarged.
  • the instructions, the processor 599 provides a preview of the first execution screen through the first window and the second execution screen through the second window, the second execution screen instead of the first execution screen
  • a function of providing a graphic element guiding the user how much the size of the active area should be adjusted through the active area may be performed.
  • the instructions may cause the processor 599 to further perform a function of changing a graphic element in response to a change in the size of the active area in real time.
  • the instructions indicate that the processor 599 displays a direction indicator (eg, an arrow, a rail) having a straight line shape parallel to the direction in which the size of the active area changes in the active area, and when the size of the active area is changed in real time to provide a visual effect that the length of the direction indicator changes, based on the change (reduced or enlarged) of the active area by a specified size (eg, the size set to display the second launch screen), It is possible to end the classification of the .
  • the processor 599 may provide a visual effect in which the length of the direction indicator increases as the size of the activation region increases.
  • the processor 599 may provide a visual effect that the length of the direction indicator is reduced as the size of the activation region is reduced.
  • the instructions provide the processor 599 with the first execution screen through the first window, and display a plurality of previews (eg, icons) arranged in an order corresponding to the size of the active area. It is provided through the second window, and among the previews, the preview of the first execution screen is emphasized to be distinguished from others, and the size of the active area is changed based on the changed direction (reduction or enlargement), followed by the first execution screen.
  • a function of determining a second execution screen to be provided through the first window and providing a direction indicator indicating a preview of the second execution screen through the second window may be performed. Accordingly, the user can intuitively recognize through the highlighted preview which execution screen corresponding to a preview is displayed in the preview list. In addition, the user may intuitively recognize, through the direction indicator, which execution screen will be displayed in the future when the active area is continuously reduced or enlarged.
  • the instructions provide the processor 599 with the first execution screen through the first window, a straight line parallel to the direction in which the size of the active area changes, and the size of the active area.
  • a plurality of previews eg, icons
  • the length of the straight line is changed in real time in response to a change in the size of the active area.
  • the second execution screen is provided through the first window instead of the first execution screen and removing the preview of the second execution screen from the second window.
  • the user can intuitively recognize which execution screen corresponding to a preview is displayed in the preview list through the disappearance of the corresponding preview in a straight line.
  • the user may intuitively recognize which execution screen will be displayed when the active area is continuously reduced or enlarged through previews arranged in an order corresponding to the size of the active area.
  • the instructions are, the processor 599, based on the aspect ratio (height to width ratio) specified for a specific UI element of the execution screen, even if the active area is expanded, stops the expansion of the execution screen, the specific UI element It is possible to perform a function of providing a first visual cue for recommending a user to reduce the active area to fit the height or width of the screen through a blank space of the active area generated as the size of the execution screen is fixed.
  • UI elements such as images or videos can be scaled to a specified aspect ratio. For example, when the width of an image having an aspect ratio of 1:2 is enlarged by 2, the height may be automatically enlarged by 1.
  • the UI element when the UI element is enlarged in real time in response to the extension of the width of the active area while the height of the UI element is expanded to a fixed height of the active area, the upper/lower part of the UI element is out of the screen (active area) This can happen.
  • the instructions may cause the processor 599 to perform a function of providing, through the active area, a second visual cue informing the user that the blank space may be generated when the active area is expanded.
  • the instructions provide the processor 599 through the activation area a third visual cue to enlarge the UI element even when a part out of the screen occurs according to the specified aspect ratio, and a user reaction to the third visual cue (eg, touch input) ), the function of enlarging the UI element can be performed so that there is no blank space in the active area.
  • the instructions are provided by the processor 599 through the active area by arranging a plurality of execution screens according to the first layout, and in response to a size change (expansion or reduction) of the active area, the execution screen A preview of the second layout (eg, horizontal arrangement) to be applied to the arrangement of items is provided through the active area (eg, displayed overlaid on at least one of the execution screens), and the size of the active area is specified in the second layout
  • a function of rearranging the plurality of execution screens according to the second layout may be performed.
  • the processor 599 (eg, the processor 120 of FIG. 1 ) may be operatively coupled to the display 510 , the state sensor 520 , and the memory 530 .
  • the processor 599 may recognize the state of the electronic device 500 using data received from the state detection sensor 520 , and based on the recognized state of the electronic device 500 , visual information (eg, : You can determine the active area to be displayed (execution screen, preview). For example, when the electronic device 500 is recognized as a reduced state, the processor 599 may determine the first display area 511 as the active area. As the electronic device 500 is recognized in the expanded state, the processor 599 may determine the entire display 510 (eg, the first display area 511 and the second display area 512 ) as the active area.
  • visual information eg, : You can determine the active area to be displayed (execution screen, preview). For example, when the electronic device 500 is recognized as a reduced state, the processor 599 may determine the first display area 511 as the active area. As the electronic device 500 is recognized in the expanded state, the processor 599 may determine the entire display 510 (eg, the first display area 511 and the second display area 512 ) as the active area.
  • the processor 599 determines a portion visually exposed to the outside in the second display area 512 based on the rotation angle of the roller, and performs the first display
  • the exposed portion together with the region 511 may be determined as an active region.
  • Various methods for determining the activation region in the intermediate state have been previously described.
  • the processor 599 may be configured to perform operations defined by the instructions stored in the memory 530 .
  • the operations of the processor 599 are described in detail below. Further operations of the processor 599 are described below.
  • 6A to 6E are diagrams for explaining an embodiment of an operation of providing a preview of an execution screen in response to an expansion of an active area.
  • the processor 599 recognizes that the first display area 511 is visually exposed to the user through the front surface of the electronic device 500 based on the data received from the state detection sensor 520, Accordingly, the first display area 511 may be determined as an active area in which visual information is to be displayed.
  • the processor 599 recognizes the second display area 512 as an area that is located inside the housing of the electronic device 500 and is not visually exposed to the user based on the data received from the state detection sensor 520 . Accordingly, the second display area 512 may be determined as an inactive area.
  • the processor 599 may provide the first execution screen 610 of the album application through the first display area 511 determined as the active area. For example, the processor 599 may provide the first execution screen 610 including a plurality of photos arranged in n (row) * 1 (column) through the first display area 511 .
  • the processor 599 may generate an activation area based on data received from the state detection sensor 520 , including: a first portion 512a of the second display area 512 extending from the first display area 511 ; It can be extended up to FIG. 6(a)).
  • the first width w1 from the first display area 511 to the first portion 512a of the second display area 512 in the extension direction may be a reference value set to provide a preview through the active area. Accordingly, the processor 599 divides the active area into a first window 601 and a second window 602 and divides the first window 601 in response to the active area being expanded by the first width w1.
  • the first execution screen 610 may be provided and a plurality of previews 621 , 631 , and 641 may be provided through the second window 602 .
  • the processor 599 may designate the first display area 511 as the first window 601 and designate a portion 512a of the second display area 512 as the second window 602 .
  • the plurality of previews 621 , 631 , and 641 may be previews of a layout or shape that may be displayed when the active area is further expanded. In the state of the first width w1, a highlight may be displayed on the edge of the preview 621 that can be displayed in the first width, and the user's touch input may be maintained in the first width for a certain period of time or in the first preview 621. If there is, the content (the second execution screen 620 in FIG. 6C ) may be displayed in the form corresponding to the first preview in the first width.
  • the processor 599 responds in real time to the expansion of the active area after switching from the single window to the dual window, fixing the size of the second window 602 and fixing its position in the direction of expansion, but the first window 601 is You can continue to expand. Also, the processor 599 may enlarge at least some of the components of the first execution screen 610 provided through the first window 601 . For example, the processor 599 may continue to enlarge the size of the picture in real time in response to the expansion of the active area while maintaining the arrangement as n*1.
  • the processor 599 sets the activation area based on the data received from the state detection sensor 520 to a second portion 512b extending from the first portion 512a of the second display area 512 ( FIG. 6C ). It can be extended up to 6(a)).
  • the second width w2 from the first display area 511 to the second part 512b of the second display area 512 based on the extension direction is set to provide the second execution screen 620 through the active area. It may be a reference value. Accordingly, the processor 599 provides the second execution screen 620 through the first window 601 instead of the first execution screen 610 in response to the activation area being expanded by the second width w2. can do.
  • the processor 599 may provide the second execution screen 620 including a plurality of photos arranged in m (row) * 2 (column) through the first window 601 .
  • the processor 599 removes the preview 621 corresponding to the second execution screen 620 and another preview corresponding to the second width or the third width. Only the elements 631 and 641 may be provided through the second window 602 .
  • the processor 599 sets the activation area based on the data received from the state detection sensor 520 to a third portion 512c extending from the second portion 512b of the second display area 512 ( FIG. 6D ). It can be extended up to 6(a)).
  • a third width w3 from the first display area 511 to the third portion 512c of the second display area 512 based on the extension direction is set to provide the third execution screen 630 through the active area It may be a reference value. Accordingly, the processor 599 provides the second execution screen 630 through the first window 601 instead of the second execution screen 620 in response to the activation area being expanded by the third width w2. can do.
  • the processor 599 may provide the third execution screen 630 including a plurality of photos arranged in l (row) * 3 (column) through the first window 601 .
  • the processor 599 removes the preview 631 corresponding to the third execution screen 630 and another preview ( 641) may be provided through the second window 602.
  • the processor 599 may extend the active area to the end of the second display area 512 based on data received from the state detection sensor 520 .
  • the processor 599 in response to the active area being expanded to the entire display 510 , terminates the display of the preview 641 corresponding to the fourth execution screen 640 and displays a fourth through the entire display 510 .
  • An execution screen 640 may be provided.
  • the processor 599 may provide the fourth execution screen 640 including a plurality of photos arranged in k (row) * 4 (column) through the entire display 510 .
  • the processor 599 may arrange the previews in an order corresponding to the size of the active area. For example, since the first execution screen 610 is displayed in the order of the second execution screen 620, the third execution screen 630, and the fourth execution screen 640 according to the expansion of the activation area after the display, The processor 599 may sort the previews 621 , 631 , and 641 in ascending order as shown in FIG. 6( b ).
  • FIGS. 7 to 14 are diagrams for explaining other embodiments of an operation of providing a preview of an execution screen in response to an expansion of an active area.
  • FIGS. 7 to 14 portions overlapping with the description of FIG. 6 will be omitted or briefly described.
  • the processor 599 determines the first portion 701 of the display as an active area based on data received from the state detection sensor 520 (eg, the first display area 511 of FIG. 5 ). )), the first execution screen 710 of the call application may be provided.
  • the processor 599 may provide a first execution screen 710 including a numeric keypad and a call button through a portion 701 of the display.
  • the processor 599 may extend the activation area to the second portion 702 based on data received from the state detection sensor 520 .
  • the processor 599 responds to the width of the activation regions 701 and 702 being expanded by a reference value (eg, the first width w1 in FIG. 6A ) designated to provide a preview based on the extension direction.
  • a reference value eg, the first width w1 in FIG. 6A
  • the activation regions 701 and 702 are divided into a first window 702a and a second window 702b, and then the first execution screen 710 and the second window 702b through the first window 702a.
  • a plurality of previews 721 and 731 may be provided through .
  • the processor 599 ends providing the dual window and displays the first execution screen through the entire active area. 710 may be displayed.
  • the occurrence of the end event is, for example, when a user's touch input for the first window 702a is received from the display 510 or when a specified time elapses from the time point when the single window is switched to the dual windows 702a and 702b This may correspond to a case in which the user maintains the size of the active area until .
  • the processor 599 generally fixes the size of the first window providing the first execution screen 710 in real time in response to the expansion of the active area after switching from the single window to the dual window (eg : Fixed size without changing or enlarged relatively less compared to the second window), the second window and the previews 721 and 731 located therein can be continuously enlarged.
  • the processor 599 may extend the activation area to the third portion 703 based on data received from the state detection sensor 520 .
  • the processor 599 is configured so that the width of the activation regions 701 , 702 , and 703 based on the extension direction is a reference value designated to provide the second execution screen 720 (eg, the second width w2 of FIG. 6A ) )) in response to being expanded, instead of the first execution screen 710, a second execution screen 720 including a function menu 722 is provided through the first window 703a, and the second execution screen (
  • the preview 721 corresponding to 720 may be emphasized, for example, by applying a shadow effect to its border.
  • the processor 599 ends providing the dual windows 703a and 703b and displays the entire active area.
  • the second execution screen 720 may be displayed.
  • the occurrence of the end event is, for example, the user's touch input for the first window 703a or the highlighted preview 721 is received from the display 510, or the second execution screen 720 from the first execution screen 710 ) may correspond to a case in which the user maintains the size of the active area from the time it is replaced to the specified time elapses.
  • the processor 599 based on the data received from the state detection sensor 520, sets the active area up to the fourth part 704 on the entire display (eg, the first display). area 511 and the second display area 512). Accordingly, the processor 599 may emphasize the preview 731 corresponding to the third execution screen 730 to be applied to the first window 704a.
  • the processor 599 ends providing the dual window and includes the contact list 732 through the entire display.
  • a third execution screen 730 may be displayed. The occurrence of the selection event may correspond to, for example, a case in which a touch input for the preview 731 highlighted in the second window 704b is received from the display 510 or the active area is extended to the entire display.
  • the processor 599 displays the active area 801 in the dual window 801a in response to the width of the active area 801 being expanded by the length set for preview. , 801b), the first execution screen 810 and previews 821 and 831 of the calendar application may be provided through each window.
  • the processor 599 may emphasize the preview 821 corresponding to the execution screen to be displayed next to the first execution screen 810 based on the size of the active area, for example, by applying a shadow effect to the edge thereof.
  • the processor 599 responds to the fact that the width of the activation area 802 is extended by the length for providing the second execution screen 820, and the first window ( Instead of the first execution screen 810 through 802a), the second execution screen 820 including the function menu 822 may be provided.
  • the processor 599 displays the preview 831 of the execution screen to be displayed next to the second execution screen 820 through the second window 802b in an emphasized state (eg, a state in which a shadow effect is applied to the border). can provide
  • the processor 599 in response to the active area 803 being extended to the entire display, the processor 599 ends providing the dual window and includes a screen 832 for schedule input through the entire display. 3 An execution screen 830 may be displayed.
  • the processor 599 divides the active area into dual windows 901a and 901b in response to the width of the active area being extended by the length set for preview, and then, A first execution screen 910 and previews 911 and 921 including a list of received mail of the mail application may be provided through each window.
  • the processor 599 may emphasize the preview 911 of the first execution screen 910 being displayed by, for example, applying a shadow effect to the edge thereof.
  • the processor 599 may continuously enlarge the first execution screen 910 and previews 911 and 921 in real time in response to the expansion of the active area. For example, the processor 599 may gradually increase the number of characters included in one line on the first execution screen 910 as the width of the first window 901a gradually increases. The processor 599 may gradually enlarge the sizes of the previews 911 and 921 as the width of the second window 901b gradually increases.
  • the processor 599 responds to the expansion of the active area to the entire display, ends providing the dual windows 901a and 901b, and displays the received letter list 922 and the selected letter through the entire display.
  • a second execution screen 920 including detailed content 923 may be provided.
  • the processor 599 divides the active area into dual windows 1001 and 1002 in response to the width of the active area being extended by the length set for preview, and then,
  • the first execution screen 1010 and previews 1011 and 1021 for a portrait mode (eg, a general calculator) of the calculator application may be provided through each window.
  • the preview 1011 corresponding to the first execution screen 1010 being displayed may be omitted or displayed in an emphasized state in the second window 1002 .
  • the processor 599 responds to the active area being extended to the entire display, and ends providing the dual windows 1001 and 1002 and uses the entire display for a landscape mode (eg, a scientific calculator). 2
  • the execution screen 1020 may be provided.
  • the processor 599 divides the active area into dual windows 1101 and 1102 , in response to the width of the active area being expanded by the length set for preview, and then,
  • the first execution screen 1110 including the video playback screen 1112 of the web browser and previews 1111 and 1121 may be provided through each window.
  • the first preview 1111 may correspond to the first execution screen 1110 being displayed, and the second preview 1112 may be an image representing the full screen mode.
  • the processor 599 provides information 1111a through the second window 1102 so that the user can know that the first execution screen 1110 can be enlarged when the display is expanded, together with the first preview 1111 . can do.
  • the processor 599 may provide information 1121a through the second window 1102 together with the second preview 1121 so that the user can know that the display can be switched to the full screen mode when the display is expanded. .
  • the processor 599 responds to the expansion of the active area to such a degree that the width w of the active area becomes greater than the height h, and displays the first preview 1111 and
  • the corresponding information 111a may be removed from the second window 1121 and only the second preview 1121 and the corresponding information 1121a may be left.
  • the processor 599 ends providing the dual windows 1101 and 1102 and provides a video playback screen 1112 through the entire display. ) can be provided.
  • the processor 599 provides a first preview 1111 and corresponding information 1111a when the width w of the active area is smaller than the height h, and the width w is the height ( h), the second preview 1121 and the corresponding information 1121a may be provided through the second window 1102 .
  • the processor 599 may provide a first execution screen 1210 in which photos are arranged in n*1 through the first portion 1201 of the display determined as the active area. have.
  • the processor 599 divides the activation area into the first window 1202a and the second window 1202a. After dividing into the window 1202b, a plurality of previews 1211, 1221, 1231, 1241 are provided through the first execution screen 1210 and the second window 1202b through the first window 1202a.
  • the previews 1211 , 1221 , 1231 , and 1241 may be icons representing an arrangement method of photos.
  • the processor 599 may arrange the previews 1211 , 1221 , 1231 , and 1241 in an order corresponding to the size of the active area.
  • the processor 599 may display the preview 1211 corresponding to the first execution screen 1210 being displayed to be distinguished from other previews. For example, the processor 599 may put only the background color in the preview 1211 and express other previews without the background color.
  • the processor 599 displays, on the second window 1202b, a direction indicator 1250 pointing to a preview 1221 corresponding to an execution screen to be displayed next to the first execution screen 1210 when the active area is continuously expanded. can do.
  • the processor 599 responds to the expansion of the active area to the third part 1203 , which is a reference for providing the second execution screen 1220 , to the first execution screen 1210 .
  • the second execution screen 1220 in which the photos are arranged in m*2 may be provided through the first window 1203a.
  • the processor 599 displays a preview 1221 corresponding to the second execution screen 1220 being displayed from among the previews 1211 , 1221 , 1231 , and 1241 provided through the second window 1203b in another preview. It can be displayed to be distinct from the view.
  • the processor 599 displays a direction indicator 1260 pointing to a preview 1321 corresponding to an execution screen to be displayed next to the second execution screen 1220 in the second window 1203b. can be displayed in
  • the processor 599 has an overlapping stack structure 1320 , a list form 1330 listed one by one in a specified direction, and is arranged in a list form with a specific preview highlighted (eg, during display (or next By arranging the previews (a, b, c, d) in the form 1340, in which the preview (b) corresponding to the execution screen (to be displayed in ) is displayed relatively large), or in the form of a grid (1350) It may be provided through the activation area 1301 together with the execution screen 1310 .
  • the processor 599 performs previews a, b, and c of the execution screen A in response to the expansion of the active area while the first execution screen A is displayed. You can switch to the preview screen that is displayed.
  • the processor 599 may emphasize the preview a corresponding to the execution screen A among the previews a, b, and c. If the preview a after screen change is selected by the user or the size of the active area is maintained from the time of screen change until a specified time elapses, the processor 599 converts the preview screen to the enlarged execution screen A'.
  • the previews a, b, and c may be arranged in the form shown in FIG. 13 .
  • the processor 599 removes the preview a from the preview screen and removes the preview a from the preview screen in response to the width of the active area being extended to the reference value for providing the execution screen B.
  • the preview b corresponding to the execution screen B may be emphasized. If the size of the active area is maintained from the point when the highlighted preview b is selected by the user or the preview a is excluded from the preview screen until a specified time elapses, the processor 599 displays the execution screen B instead of the preview screen can be provided through the activation area. When the active area is extended to the entire display, the processor 599 may display the execution screen C instead of the preview screen.
  • FIGS. 15 to 17 are diagrams for explaining embodiments of an operation of guiding a user how much the size of the active area should be enlarged in order to provide an execution screen to be displayed next to the execution screen being displayed.
  • FIGS. 15 to 17 portions overlapping with the description of FIG. 6 will be omitted or briefly described.
  • the processor 599 may provide a preview 1521 through the first execution screen 1510 of the calculator application through the first window 1501a and the second window 1501b.
  • the processor 599 has a direction indicator 1530 directed to the side to be enlarged (eg, the x-axis direction in the drawing) at the boundary between the first window 1501a and the second window 1501b and a message inducing the user to enlarge the display. 1540 may be displayed on the second window 1501b.
  • the processor 599 may extend the direction indicator 1530 in response to the expansion of the activation region and maintain the display of the message 1540 .
  • the processor 599 terminates the provision of the dual windows 1501a and 1501b, and The second execution screen 1520 may be provided through the entire activation area.
  • the processor 599 may provide a first execution screen 1610 for general calculation of a calculator application through the first window 1601a.
  • the processor 599 provides a rail 1630 in a straight line parallel to the direction in which the activation region is expanded (eg, the x-axis direction in the drawing) through the second window 1601b and one end thereof (eg, the activation region is A visual cue 1631 located at the end of the extended side) may be provided.
  • the processor 599 may gradually decrease the width of the rail 1630 toward the side of the visual cue 1631 in response to the expansion of the activation area.
  • the processor 599 provides a visual effect that the width of the rail 1630 decreases as the active area continues to expand, and eventually the other end of the rail 1630 comes into contact with the visual cue 1631 in the second window 1601b. can be provided through
  • the width of the active area is a reference value for providing the second execution screen 1620 for engineering calculation (eg, the overall width of the display). ) can match.
  • the processor 599 may end the provision of the dual windows 1601a and 1601b and provide the second execution screen 1620 through the entire active area.
  • the processor 599 may provide a first execution screen 1710 of the mail application, which is composed of one section (eg, a list of received mail) through the first window 1701a.
  • the processor 599 includes a rail 1730 in a straight line parallel to the direction in which the activation area is expanded (eg, the x-axis direction in the drawing) through the second window 1701b and a lever 1740 positioned on the line. and multiple visual cues (previews) 1751 , 1752 , and 1753 .
  • the processor 599 arranges a lever 1740 and a third visual cue 1753 at both ends of the rail 1730, and a second visual cue 1752 and a third visual cue 1753 between them 1740 and 1753. can be placed.
  • the visual cue may be composed of icons embodying the characteristics of the corresponding execution screen. For example, the first visual cue 1751 indicates that there is a change in the section of the execution screen of the mail application, the second visual cue 1752 indicates that the execution screen consists of two sections, and the third visual cue ( 1753) may indicate that the execution screen is composed of three sections.
  • the processor 599 may move the lever 1740 toward the first visual cue 1751 in response to the expansion of the activation region.
  • the processor 599 has a visual effect that the lever 1740 comes into contact with the first visual cue 1751 as the activation region continues to expand, and thus the first visual cue 1751 is removed from the rail 1730 . may be provided through the second window 1702b.
  • the width of the active area may match a first reference value for providing an execution screen different from the first execution screen 1710 .
  • a second execution screen 1720 that further includes a function menu 1721 and a button 1722 for writing a letter in addition to the list of received letters. ) may be provided through the first window 1702a.
  • the processor 599 may move the lever 1740 toward the second visual cue 1752 in response to the continued expansion of the activation region.
  • the processor 599 has the visual effect that the lever 1740 abuts the second visual cue 1752 as the activation area continues to expand and thus removes the second visual cue 1752 on the rail 1730 . may be provided through the second window 1703b.
  • the width of the active area may match a second reference value for providing an execution screen different from the second execution screen 1720 .
  • the processor 599 In response to the width of the activation area reaching the second reference value, the processor 599 is configured to generate a second section (eg, details of the selected letter) 1732 in addition to the first section (inbox list) 1731 .
  • the further included third execution screen 1730 may be provided through the first window 1703a.
  • the processor 599 may generate vibration by using the haptic module 179 together with a visual effect that the visual cue is removed from the screen.
  • FIGS. 18 to 20 are diagrams for explaining embodiments of an operation of providing a visual cue related to magnification of a specific UI element based on an aspect ratio specified for the specific UI element on an execution screen.
  • FIGS. 18 to 20 portions overlapping with the description of FIG. 6 will be omitted or briefly described.
  • the processor 599 may provide the execution screen 1810 of the social network service program through the first portion 1801 of the display determined as the active area.
  • the processor 599 may extend the active region to the second portion 1802 .
  • the processor 599 may adjust the width of the image 1811 to the expanded width of the active region according to the expansion of the active region, and enlarge the height of the image 1811 to h2 according to an aspect ratio specified in the image 1811 .
  • the processor 599 may recognize that h2 is the maximum height of the image 1811 based on the fixed height of the active region. Accordingly, despite the fact that the active region extends beyond the second portion 1802 to, for example, the third portion 1803 , the processor 599 does not enlarge the execution screen 1810 to the third portion 1803 and does not extend the third portion 1803 .
  • the portion 1803 may be treated as a blank space.
  • the processor 599 may provide the first visual cue 1830 through the third portion 1803 to recommend the user to reduce the active area to fit the width of the image 1811 .
  • the processor 599 may provide a message 1840 related to margin adjustment together with the first visual queue 1830 through the blank space.
  • the processor 599 may provide an image 1910 through the first portion 1901 of the display determined as the active area.
  • the processor 599 adjusts the width of the image 1910 to the width of the first portion 1901, sets the height of the image 1910 to h1 based on the aspect ratio specified in the image 1910, and sets the size to this
  • the image 1910 may be provided through the first portion 1901 .
  • the processor 599 may extend the active region to the second portion 1902 .
  • the processor 599 adjusts the width of the image 1910 to the width of the expanded active regions 1901 and 1902 according to the expansion of the active region, and adjusts the height of the image 1910 to h2 according to the aspect ratio specified for the image 1910 . can be enlarged.
  • the processor 599 may calculate the maximum width W_max of the image 1910 based on an aspect ratio and a maximum height (eg, a fixed height H of the active region) specified for the image 1910 .
  • the second visual cue 1920 may be provided through the activation area.
  • the processor 599 may maintain the display of the second visual cue 1920 until the active area is extended to the maximum width W-max of the image 1910 . Additionally, the processor 599 configures the haptic module 179 when the activation area extends to the maximum width (W-max) of the image 1910 or when the activation area extends close to the maximum width of the image 1910. It can be used to generate vibration or a sound can be generated using a speaker module.
  • the processor 599 responds in real time to the expansion of the active area until the width w1 of the active area reaches the maximum width W_max specified in the image 2010 . can be enlarged.
  • the processor 599 no longer displays the image 2010 even if the active area is expanded from the moment the width w2 of the active area exceeds the maximum width W-max. You can fix the size without enlarging it.
  • the processor 599 provides, through the active area, a third visual cue 2020 that enlarges the image 2010 in response to the expansion of the active area regardless of the occurrence of a part out of the screen according to the specified aspect ratio. can do.
  • the processor 599 may display the third visual cue 2020 when the width w2 of the active region reaches the maximum width W-max.
  • the processor 599 may generate vibration using the haptic module 179 .
  • the processor 599 may enlarge the image 2010 so that a blank space 2030 is not generated. Accordingly, the upper part 2011 and the lower part 2012 of the image 2010 may be out of the screen without being displayed according to the specified aspect ratio.
  • FIG. 21 is a diagram for explaining an embodiment of an operation of changing an arrangement of execution screens according to an extension of an active area.
  • FIG. 21 portions overlapping with the description of FIG. 6 will be omitted or briefly described.
  • the processor 599 may provide a plurality of execution screens A, B, and C arranged according to the first layout through the activation area.
  • the active area may be divided into left and right, and the execution screen A may be provided through the left portion.
  • the right part may be divided into upper and lower parts again, the execution screen B may be provided on the upper part, and the execution screen C may be provided on the lower part.
  • the execution screens A, B, and C may be different sections of the same application (eg, a list of received mail, detailed content of selected content, and contact list).
  • the execution screens A, B, and C may be execution screens of different applications.
  • the processor 599 may provide a preview 2100 of the second layout through the active area based on the extension of the active area.
  • the processor 599 displays a plurality of execution screens A, B, C) can be rearranged.
  • the active area may be divided into three left and right, and an execution screen may be arranged in each part.
  • 22 is a diagram for explaining an embodiment of an operation of providing a preview of an execution screen in response to reduction of an active area.
  • the processor 599 performs the entire display 2200 (eg, the first display area 511 and the second display area 511 of FIG. 5 ) based on the data received from the state detection sensor 520 . 2) It is recognized that the display area 512 is visually exposed to the user, and the entire display 2200 may be determined as the active area. The processor 599 may provide the execution screen A of the application through the entire display 2200 determined as the active area. The processor 599 may determine a portion 2201 of the display as an inactive area based on data received from the state detection sensor 520 and adjust the remaining portion 2202 as an active area. The processor 599 may provide the execution screen A through the remaining portion 2202 adjusted to the active area.
  • the entire display 2200 eg, the first display area 511 and the second display area 511 of FIG. 5
  • the processor 599 may provide the execution screen A of the application through the entire display 2200 determined as the active area.
  • the processor 599 may determine a portion 2201 of the display as an inactive area based on data received from the state
  • the processor 599 may provide a preview of another execution screen of the application through the activation area. For example, in response to the width w1 of the remaining portion 2202 reaching a reference value set to provide a preview, the processor 599 may provide a preview through the activation area in a floating form. can For example, the processor 599 may overlap previews b and c on the execution screen A as illustrated.
  • the processor 599 additionally determines another part 2203 extending from the part 2201 as an inactive area based on data received from the state detection sensor 520 and the remaining part 2204 ) can be determined as the active region.
  • the processor 599 may provide B instead of the execution screen A through the activation area.
  • the processor 599 may remove the preview b from the active area and display only the preview c overlaid on the execution screen B.
  • the processor 599 additionally determines another part 2205 extending from the part 2203 as an inactive area based on data received from the state detection sensor 520 , and the remaining part 2206 . ) (eg, the first display area 511 of FIG. 5 ) may be determined as the active area. In response to the width w3 of the remaining portion 2206 reaching a reference value set to provide the execution screen C, the processor 599 may provide C instead of the execution screen B through the activation area.
  • 23 is a flowchart illustrating operations for providing a preview of an execution screen.
  • the processor 599 may recognize that the size of the active area is changed (reduced or enlarged) based on data received from the state detection sensor 520 .
  • the processor 599 may acquire previews from the memory 530 that provides a source for the execution screen displayed in the active area in response to a change in the size of the active area. For example, the processor 599 may obtain previews by accessing a resource file (eg, an xml file) of the application. As another example, when previews do not exist in the resource file, the processor 599 may generate previews using layout information obtained from the resource file. Previews may be defined as one of an image, an icon, and text corresponding to the size of the active area, but is not limited thereto. Previews may be obtained from an application, or, if not included in the application, may be generated using screen information (eg, screen capture) or application information (eg, a resource file) currently being displayed by the processor.
  • screen information eg, screen capture
  • application information eg, a resource file
  • the processor 599 may determine at least one of the obtained previews as a preview to be provided through the active area based on the direction in which the size of the active area changes.
  • the processor 599 provides a preview of the execution screen currently displayed in the active area among the previews and a preview of the execution screen designated to be displayed when the active area becomes larger through the active area. You can decide what preview to do.
  • the processor 599 may determine, among the previews, only a preview of an execution screen designated to be displayed when the active area becomes larger as a preview to be provided through the active area.
  • the processor 599 displays a preview of the execution screen currently displayed in the active area among the previews and a preview of the execution screen designated to be displayed when the active area becomes smaller through the active area. You can decide which preview to provide. As another example, the processor 599 may determine, among the previews, only a preview of an execution screen designated to be displayed when the active area becomes smaller as a preview to be provided through the active area. In addition, when the direction is reduced, previews may be overlapped on the currently displayed execution screen and displayed in the form of a floating window (eg, previews b and c in FIG. 22 ).
  • the processor 599 may provide the determined preview together with the execution screen through the activation area.
  • the processor 599 may divide the active area into dual windows, provide an execution screen through the first window, and provide a preview through the second window.
  • the processor 599 may overlap and display a preview on the execution screen being displayed.
  • the processor 599 terminates the provision of preview(s) according to a user reaction while the execution screen and the preview list are simultaneously provided through the activation area, and displays the execution screen corresponding to the user reaction in the activation area.
  • the processor 599 may terminate the preview provision and provide an execution screen corresponding to the preview selected by the user through the activation area.
  • the processor 599 removes the preview list from the active area and sets only the execution screen to the active area.
  • the processor 599 may end preview provision when the active area is enlarged to the entire display by the user and provide a designated execution screen to be provided when the active area is the entire display through the active area.
  • the processor 599 activates a designated execution screen to be provided when the active area is the reduced area. area can be provided.
  • a portable electronic device (eg, the portable electronic device 500 of FIG. 5 ) includes a housing; a flexible display (eg, the touch sensitive display 510 of FIG. 5 ) at least a portion of which is drawn into or out of the housing; a sensor (eg, state detection sensor 520 in FIG. 5 ) that generates data used to determine an active area in which information is to be displayed in a visually exposed area of the display; a processor coupled to the sensor and the display (eg, processor 599 in FIG. 5 ); and a memory connected to the processor (eg, the memory 530 of FIG.
  • the processor displays a first execution screen among a plurality of execution screens of an application through the activation area During providing, the operation of recognizing that the size of the active area has changed based on the data received from the sensor, in response to the change in size, is displayed on the second execution screen among the previews corresponding to the plurality of execution screens. providing a corresponding preview together with the first execution screen through the activation area, and providing the second execution screen through the activation area instead of the first execution screen after the preview is provided You can store instructions to be executed.
  • the instructions are a part of an operation in which the processor provides a preview corresponding to the second execution screen and the first execution screen, and in response to an enlargement of the size of the active area, the active area is divided into the first window and The second window may be divided, and the first execution screen may be provided through the first window, and a preview corresponding to the second execution screen may be provided through the second window.
  • the instructions include, as part of the operation of the processor providing the second execution screen, based on the fact that the size of the active area reaches a reference value set to provide the second execution screen, the second execution screen is displayed. It may be provided through the activation area.
  • Previews corresponding to the plurality of execution screens are provided through the activation area, and the instructions are performed by the processor when the size of the activation area reaches a reference value set to provide the second execution screen.
  • the preview of the second execution screen may be removed from the active area and another preview may be left in the active area.
  • Previews corresponding to the plurality of execution screens are provided through the activation area, and the instructions are performed by the processor when the size of the activation area reaches a reference value set to provide the second execution screen.
  • the preview corresponding to the second execution screen may be emphasized to be visually distinguished from other previews.
  • the instructions may cause the processor to remove the preview from the active area and provide the second execution screen through the entire active area in response to a user selecting a preview of the second execution screen.
  • Previews corresponding to the plurality of execution screens are provided through the activation area, and the instructions enable the processor to preview the second execution screen when the first execution screen is provided through the activation area. You can highlight it visually to distinguish it from other previews.
  • the second execution screen may be provided next to the first execution screen in order according to whether the size change is reduced or enlarged.
  • the instructions may cause the processor to enlarge at least one of a preview of the second execution screen and the first execution screen in response to an increase in the size of the active area.
  • the instructions include, by the processor, a graphic element guiding the user how much the size of the active area should be adjusted in order for the second execution screen to be provided through the activation area instead of the first execution screen. can be provided through
  • the instructions may cause the processor to provide a visual effect in which the length of the graphic element is adjusted through the active area in real time in response to a change in the size of the active area.
  • Previews corresponding to the plurality of execution screens are provided through the activation area, and the instructions include, by the processor, a direction indicator pointing to a preview of the second execution screen when the first execution screen is provided. It can be provided through the activation area.
  • the second execution screen may be provided next to the first execution screen in order according to whether the size change is reduced or enlarged.
  • the instructions allow the processor to view previews corresponding to the plurality of execution screens, arranged on the straight line in a straight line parallel to a direction in which the size of the active area changes and in an order corresponding to the size of the active area.
  • the second execution screen may be provided through the activation area.
  • the instructions may cause the processor to configure the second execution screen differently from the first execution screen by setting at least one of a layout, a property, and content as part of an operation of providing the second execution screen.
  • the first execution screen includes a video playback screen, wherein the instructions provide the processor with an image representing a full-screen mode as a preview of the second execution screen through the active area, and the active area is the display
  • the video playback screen may be displayed on the entire display.
  • a portable electronic device (eg, the portable electronic device 500 of FIG. 5 ) includes a housing; a flexible display (eg, the touch sensitive display 510 of FIG. 5 ) at least a portion of which is drawn into or out of the housing; a sensor (eg, state detection sensor 520 in FIG. 5 ) that generates data used to determine an active area in which information is to be displayed in a visually exposed area of the display; a processor coupled to the sensor and the display (eg, processor 599 in FIG.
  • the memory when executed, causes the processor to: in response to a width of the active area being enlarged, enlarge an image to a specified aspect ratio, and wherein the height of the image is at a specified maximum height.
  • the width of the active area is additionally enlarged in the reached state, the image is stopped enlarged, and the first visual cue for recommending the user to reduce the active area in a blank space created in the active area by stopping the enlargement of the image It is possible to store instructions for displaying .
  • the processor calculates the maximum width of the image based on the aspect ratio and the maximum height, calculates a ratio of the maximum width to the width of the active area, and when the ratio is smaller than a specified reference value, A second visual cue for notifying the user that the blank space may be generated may be displayed.
  • the instructions include, by the processor, in response to the width of the active region reaching the maximum width, to display a third visual cue, and in response to a user input to the third visual cue, to display the image to the blank space. can be enlarged.
  • the instructions may cause the processor to generate vibration in the haptic module provided in the portable electronic device in response to the width of the activation region reaching the maximum width.
  • a portable electronic device includes a housing; a flexible display, at least a portion of which is drawn into or out of the housing; a sensor that generates data used to identify the size of the active area exposed outside the housing on the display; a processor coupled to the sensor and the display; and a memory coupled to the processor, wherein the memory, when executed, causes the processor to: identify a size of the active region based on data received via the sensor, and provide an image via the active region. , a graphic element that changes the size of the image based on the size of the identified active area, and guides the user to how much the size of the active area needs to be adjusted in order for the resized image to be provided through the active area It is possible to store instructions for providing ? through the activation region.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Selon divers modes de réalisation, un dispositif électronique portable comprend : un logement ; un affichage flexible qui est partiellement tiré à l'intérieur ou à l'extérieur du logement ; un capteur qui génère des données utilisées pour déterminer une zone d'activation dans laquelle l'affichage doit être exposé visuellement de façon à afficher des informations ; un processeur connecté au capteur et à l'affichage ; et une mémoire connectée au processeur. La mémoire peut stocker des instructions qui, lorsqu'elles sont exécutées, amènent le processeur à effectuer les opérations consistant à : reconnaître un changement de la taille de la zone d'activation sur la base des données reçues du capteur tout en présentant un premier écran d'exécution parmi une pluralité d'écrans d'exécution d'une application par l'intermédiaire de la zone d'activation ; en réponse au changement de taille, présenter une prévisualisation correspondant à un second écran d'exécution parmi des prévisualisations correspondant à la pluralité d'écrans d'exécution, la prévisualisation étant présentée par l'intermédiaire de la zone d'activation en même temps que le premier écran d'exécution ; et, après la présentation de la prévisualisation, présenter le second écran d'exécution à la place du premier écran d'exécution par l'intermédiaire de la zone d'activation. Divers autres modes de réalisation sont également possibles.
PCT/KR2021/013348 2020-11-17 2021-09-29 Dispositif électronique à affichage extensible WO2022108096A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR20200153909 2020-11-17
KR10-2020-0153909 2020-11-17
KR10-2021-0001902 2021-01-07
KR1020210001902A KR20220067459A (ko) 2020-11-17 2021-01-07 확장이 가능한 디스플레이를 갖는 전자 장치

Publications (1)

Publication Number Publication Date
WO2022108096A1 true WO2022108096A1 (fr) 2022-05-27

Family

ID=81709152

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2021/013348 WO2022108096A1 (fr) 2020-11-17 2021-09-29 Dispositif électronique à affichage extensible

Country Status (1)

Country Link
WO (1) WO2022108096A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101454685B1 (ko) * 2012-02-29 2014-10-27 주식회사 팬택 플렉서블 디스플레이의 휘어짐을 이용해서 인터페이스 제공하는 장치, 휴대용 단말 및 방법
KR20170038308A (ko) * 2015-09-30 2017-04-07 엘지전자 주식회사 이동 단말기 및 그 제어 방법
KR101752750B1 (ko) * 2015-05-28 2017-07-11 한국과학기술연구원 확장 가능한 디스플레이를 갖는 디스플레이 장치, 그 제어 방법 및 그 방법을 수행하기 위한 기록 매체
KR20190041995A (ko) * 2019-04-16 2019-04-23 삼성전자주식회사 플렉서블 디스플레이 장치 및 제어 방법
KR20190101184A (ko) * 2018-02-22 2019-08-30 삼성전자주식회사 디스플레이 영역의 크기 변경이 가능한 플렉시블 디스플레이를 포함하는 전자 장치 및 그 제어 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101454685B1 (ko) * 2012-02-29 2014-10-27 주식회사 팬택 플렉서블 디스플레이의 휘어짐을 이용해서 인터페이스 제공하는 장치, 휴대용 단말 및 방법
KR101752750B1 (ko) * 2015-05-28 2017-07-11 한국과학기술연구원 확장 가능한 디스플레이를 갖는 디스플레이 장치, 그 제어 방법 및 그 방법을 수행하기 위한 기록 매체
KR20170038308A (ko) * 2015-09-30 2017-04-07 엘지전자 주식회사 이동 단말기 및 그 제어 방법
KR20190101184A (ko) * 2018-02-22 2019-08-30 삼성전자주식회사 디스플레이 영역의 크기 변경이 가능한 플렉시블 디스플레이를 포함하는 전자 장치 및 그 제어 방법
KR20190041995A (ko) * 2019-04-16 2019-04-23 삼성전자주식회사 플렉서블 디스플레이 장치 및 제어 방법

Similar Documents

Publication Publication Date Title
WO2022114416A1 (fr) Dispositif électronique pour fournir une multifenêtre en utilisant un écran extensible
WO2022019635A1 (fr) Dispositif électronique pour fournir un écran partagé et un écran privé, et procédé de commande associé
WO2022055255A1 (fr) Dispositif électronique fournissant une interface utilisateur, et procédé associé
WO2022097858A1 (fr) Dispositif électronique pouvant étendre une région d'affichage et procédé de commande d'écran associé
WO2022108192A1 (fr) Dispositif électronique et procédé de commande multi-fenêtre de dispositif électronique
WO2022060041A1 (fr) Dispositif électronique pliable permettant la génération de contenu et son procédé de fonctionnement
WO2022030890A1 (fr) Procédé de capture d'image à fenêtres multiples et dispositif électronique associé
WO2022103174A1 (fr) Dispositif électronique comportant un affichage à zone d'affichage variable et procédé permettant de faire varier un rapport d'aspect au moyen d'une icône d'application
WO2022119276A1 (fr) Dispositif électronique d'affichage souple et procédé de fonctionnement associé
WO2023048390A1 (fr) Procédé de fourniture d'une interface utilisateur et dispositif électronique associé
WO2023063720A1 (fr) Procédé permettant d'étendre une unité d'affichage d'un dispositif électronique, et dispositif électronique permettant de le prendre en charge
WO2022108096A1 (fr) Dispositif électronique à affichage extensible
WO2022119319A1 (fr) Dispositif électronique de déplacement et d'affichage d'au moins un objet en fonction de l'extension d'un écran flexible, et son procédé de commande
WO2022114548A1 (fr) Procédé et appareil permettant de commander une interface utilisateur d'un écran souple
WO2022055215A1 (fr) Dispositif électronique permettant de fournir une disposition multifenêtre, et son procédé de fonctionnement
WO2022114509A1 (fr) Dispositif électronique conçu pour présenter un écran à visibilité modifiée en fonction de l'extension d'un affichage flexible et procédé de commande dudit dispositif
WO2022080883A1 (fr) Dispositif électronique et procédé de fonctionnement de dispositif électronique
WO2022080939A1 (fr) Dispositif électronique et procédé de fonctionnement de pavé numérique de dispositif électronique
WO2022030921A1 (fr) Dispositif électronique, et procédé de commande de son écran
WO2023191305A1 (fr) Dispositif électronique présentant une unité d'affichage flexible
WO2022154449A1 (fr) Dispositif électronique et son procédé de fonctionnement
WO2024034865A1 (fr) Dispositif électronique et procédé d'exploitation de contenu à base de texte par un dispositif électronique
WO2024054038A1 (fr) Dispositif électronique pliable et procédé d'utilisation d'un dispositif électronique pliable
WO2022098038A1 (fr) Appareil électronique à affichage extensible
WO2022250309A1 (fr) Dispositif électronique comprenant un écran extensible, et procédé de fourniture de contenu

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21894868

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21894868

Country of ref document: EP

Kind code of ref document: A1