WO2023101179A1 - Dispositif électronique à écran flexible et procédé de commande de module d'appareil de prise de vues correspondant - Google Patents

Dispositif électronique à écran flexible et procédé de commande de module d'appareil de prise de vues correspondant Download PDF

Info

Publication number
WO2023101179A1
WO2023101179A1 PCT/KR2022/014561 KR2022014561W WO2023101179A1 WO 2023101179 A1 WO2023101179 A1 WO 2023101179A1 KR 2022014561 W KR2022014561 W KR 2022014561W WO 2023101179 A1 WO2023101179 A1 WO 2023101179A1
Authority
WO
WIPO (PCT)
Prior art keywords
center
camera
flexible display
electronic device
processor
Prior art date
Application number
PCT/KR2022/014561
Other languages
English (en)
Korean (ko)
Inventor
최용하
발레리프루신스키
박건중
박지영
신민수
여형석
이다솜
한단비
유주완
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Publication of WO2023101179A1 publication Critical patent/WO2023101179A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1686—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated camera
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1615—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function
    • G06F1/1624—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function with sliding enclosures, e.g. sliding keyboard or display
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
    • G06F1/1652—Details related to the display arrangement, including those related to the mounting of the display in the housing the display being flexible, e.g. mimicking a sheet of paper, or rollable
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/557—Depth or shape recovery from multiple images from light fields, e.g. from plenoptic cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
    • G09F9/30—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
    • G09F9/30—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements
    • G09F9/301—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements flexible foldable or roll-able electronic displays, e.g. thin LCD, OLED

Definitions

  • an electronic device having a flexible display (eg, a rollable device, a slidable device) and a method for controlling a camera module thereof.
  • a flexible display eg, a rollable device, a slidable device
  • the electronic device may be implemented using a form factor capable of providing a relatively larger screen while having a size in which a user does not feel uncomfortable when holding the electronic device.
  • a slideable form factor or a rollable form factor is drawing attention as a next-generation form factor because it can expand a display in a sliding manner.
  • the slide method may include a slide-in method in which a portion of the flexible display is drawn into the inner space of the electronic device or a slide-out method in which a portion of the flexible display is drawn out of the inner space of the electronic device. there is.
  • An electronic device implemented with a slideable form factor can be implemented to have a relatively small size by sliding the flexible display into the electronic device in a state carried by a user, and in a sliding out state, the flexible display can slide into the electronic device. By sliding out to the outside, content can be displayed on a relatively large screen.
  • a subject eg, the user
  • a subject may be moved around the display module by opening (or rolling) the display module. Therefore, in an electronic device including a flexible display, a subject is out of the shooting range of a fixed camera module or eccentricity occurs, and among image information acquired from the camera module, the user's image is provided by being disposed on the side of the display module. can Accordingly, the user may have to move the electronic device again so that the subject is located in the photographing range of the camera module.
  • a tolerance may occur between the transparent area (or hole) of the display panel and the camera. Tolerance may mean a small error in the range in which an electronic device can operate, and due to this tolerance, the transmission area of the camera and display may not be properly matched.
  • the camera may be positioned within the transmission area.
  • the size of the display hall visible to the user on the display increases, and the user may feel uncomfortable.
  • An electronic device includes a camera, a sensor module, a flexible display including a first end and a second end spaced apart from the first end, a first roller winding around the first end, and a second roller winding around the second end. , a sensor module, and a processor operatively connected to the flexible display.
  • the first end includes a transmissive area through which external light is transmitted
  • the processor determines an amount of change in movement of the flexible display using a sensor module, and based on the amount of change in movement of the flexible display, the center of the camera and the center of the transmissive area are located within a specified distance Control to do so, capture an image using a camera, determine whether the center of the camera and the center of the transmission area are located within a specified distance based on the guideline on the captured image, and determine whether the center of the camera and the center of the transmission area
  • the flexible display may be moved so that the center of the camera and the center of the transmission area are located within the specified distance based on the shape of the guideline on the captured image.
  • a method for controlling a camera module of an electronic device determines an amount of change in movement of a flexible display using a sensor module, and controls the center of the camera and the center of a transmission area to be located within a predetermined distance based on the amount of change in movement of the flexible display
  • An operation of capturing an image using a camera and determining whether the center of the camera and the center of the transmission area are located within a certain distance based on a guideline on the captured image, the center of the camera and the center of the transmission area In response to confirming that the location is not located within the predetermined distance, an operation of moving the flexible display so that the center of the camera and the center of the transmission area are located within a predetermined distance based on the shape of the guideline on the captured image.
  • An electronic device including a flexible display and a method for controlling a camera module thereof may reduce tolerance by using tolerance correction while having a small hole (or transmission area).
  • the electronic device according to the present document may have a small hole (or a transmission area) to enhance design aesthetics and provide an improved user experience.
  • FIG. 1 is a block diagram of an electronic device in a network environment, according to various embodiments.
  • 2A is a front perspective view of an electronic device showing a slide-in state according to various embodiments of the present disclosure.
  • 2B is a front perspective view of an electronic device showing a slide-out state according to various embodiments of the present disclosure.
  • 3A is a rear perspective view of an electronic device showing a retracted state according to various embodiments of the present disclosure.
  • 3B is a rear perspective view of an electronic device showing a drawn-out state according to various embodiments of the present disclosure.
  • Figure 4a is a front perspective view of the slide structure 250 according to various embodiments of the present invention.
  • Figure 4b is an exemplary view showing a process of assembling the gear unit 410 to perform the rolling operation of the slide structure 250 according to various embodiments of the present invention.
  • 5 is a block diagram of an electronic device according to various embodiments.
  • FIG. 6 is a cross-sectional view taken along line K-K′ of the electronic device shown in FIG. 4A.
  • FIG. 7A and 7B illustrate a camera module control operation of an electronic device according to various embodiments.
  • 8A to 8C illustrate a matching method using a light emitting device of an electronic device according to various embodiments.
  • FIG 9 illustrates a matching method using a light emitting device of an electronic device according to various embodiments.
  • 10A and 10B illustrate a matching method using a magnetic member of an electronic device according to various embodiments.
  • FIG. 11 illustrates a matching method using rotational resistance of an electronic device according to various embodiments.
  • FIG. 12 illustrates a detailed matching method using a camera of an electronic device according to various embodiments.
  • FIG. 13 is a flowchart of a method for controlling a camera module of an electronic device according to various embodiments.
  • FIG. 14 is a diagram illustrating effects of a method for controlling an electronic device and a camera module according to various embodiments.
  • FIG. 1 is a block diagram of an electronic device 101 within a network environment 100, according to various embodiments.
  • an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It may communicate with at least one of the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • a first network 198 eg, a short-range wireless communication network
  • the server 108 e.g, a long-distance wireless communication network
  • the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or the antenna module 197 may be included.
  • at least one of these components eg, the connection terminal 178) may be omitted or one or more other components may be added.
  • some of these components eg, sensor module 176, camera module 180, or antenna module 197) are integrated into a single component (eg, display module 160). It can be.
  • the processor 120 for example, executes software (eg, the program 140) to cause at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or calculations. According to one embodiment, as at least part of data processing or operation, the processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 .
  • software eg, the program 140
  • the processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 .
  • the processor 120 may include a main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit ( NPU: neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor).
  • a main processor 121 eg, a central processing unit or an application processor
  • a secondary processor 123 eg, a graphic processing unit, a neural network processing unit ( NPU: neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor.
  • NPU neural network processing unit
  • the secondary processor 123 may be implemented separately from or as part of the main processor 121 .
  • the secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, running an application). ) state, together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states.
  • the auxiliary processor 123 eg, image signal processor or communication processor
  • the auxiliary processor 123 may include a hardware structure specialized for processing an artificial intelligence model.
  • AI models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself where the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108).
  • the learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, but in the above example Not limited.
  • the artificial intelligence model may include a plurality of artificial neural network layers.
  • Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the foregoing, but is not limited to the foregoing examples.
  • the artificial intelligence model may include, in addition or alternatively, software structures in addition to hardware structures.
  • the memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 .
  • the data may include, for example, input data or output data for software (eg, program 140) and commands related thereto.
  • the memory 130 may include volatile memory 132 or non-volatile memory 134 .
  • the program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142 , middleware 144 , or an application 146 .
  • the input module 150 may receive a command or data to be used by a component (eg, the processor 120) of the electronic device 101 from the outside of the electronic device 101 (eg, a user).
  • the input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).
  • the sound output module 155 may output sound signals to the outside of the electronic device 101 .
  • the sound output module 155 may include, for example, a speaker or a receiver.
  • the speaker can be used for general purposes such as multimedia playback or recording playback.
  • a receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.
  • the display module 160 may visually provide information to the outside of the electronic device 101 (eg, a user).
  • the display module 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device.
  • the display module 160 may include a touch sensor set to detect a touch or a pressure sensor set to measure the intensity of force generated by the touch.
  • the audio module 170 may convert sound into an electrical signal or vice versa. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).
  • the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).
  • the sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do.
  • the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, or light sensor.
  • the interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102).
  • the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
  • HDMI high definition multimedia interface
  • USB universal serial bus
  • SD card interface Secure Digital Card interface
  • audio interface audio interface
  • connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102).
  • the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).
  • the haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or motion) or electrical stimuli that a user may perceive through tactile or kinesthetic senses.
  • the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
  • the camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
  • the power management module 188 may manage power supplied to the electronic device 101 .
  • the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.
  • PMIC power management integrated circuit
  • the battery 189 may supply power to at least one component of the electronic device 101 .
  • the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.
  • the communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). Establishment and communication through the established communication channel may be supported.
  • the communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication.
  • the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : a local area network (LAN) communication module or a power line communication module).
  • a wireless communication module 192 eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module
  • GNSS global navigation satellite system
  • wired communication module 194 eg, : a local area network (LAN) communication module or a power line communication module.
  • a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a telecommunications network such as a computer network (eg, a LAN or a WAN).
  • a telecommunications network such as a computer network (eg, a LAN or a WAN).
  • These various types of communication modules may be integrated as one component (eg, a single chip) or implemented as a plurality of separate components (eg, multiple chips).
  • the wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199.
  • subscriber information eg, International Mobile Subscriber Identifier (IMSI)
  • IMSI International Mobile Subscriber Identifier
  • the electronic device 101 may be identified or authenticated.
  • the wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, NR access technology (new radio access technology).
  • NR access technologies include high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low latency (URLLC)).
  • eMBB enhanced mobile broadband
  • mMTC massive machine type communications
  • URLLC ultra-reliable and low latency
  • -latency communications can be supported.
  • the wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example.
  • the wireless communication module 192 uses various technologies for securing performance in a high frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. Technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna may be supported.
  • the wireless communication module 192 may support various requirements defined for the electronic device 101, an external electronic device (eg, the electronic device 104), or a network system (eg, the second network 199).
  • the wireless communication module 192 is a peak data rate for eMBB realization (eg, 20 Gbps or more), a loss coverage for mMTC realization (eg, 164 dB or less), or a U-plane latency for URLLC realization (eg, Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) may be supported.
  • eMBB peak data rate for eMBB realization
  • a loss coverage for mMTC realization eg, 164 dB or less
  • U-plane latency for URLLC realization eg, Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less
  • the antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device).
  • the antenna module 197 may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB).
  • the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna.
  • other components eg, a radio frequency integrated circuit (RFIC) may be additionally formed as a part of the antenna module 197 in addition to the radiator.
  • RFIC radio frequency integrated circuit
  • the antenna module 197 may form a mmWave antenna module.
  • the mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first surface (eg, a lower surface) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, array antennas) disposed on or adjacent to a second surface (eg, a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.
  • peripheral devices eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)
  • signal e.g. commands or data
  • commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 .
  • Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 .
  • all or part of operations executed in the electronic device 101 may be executed in one or more external electronic devices among the external electronic devices 102 , 104 , or 108 .
  • the electronic device 101 when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself.
  • one or more external electronic devices may be requested to perform the function or at least part of the service.
  • One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 .
  • the electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed.
  • cloud computing distributed computing, mobile edge computing (MEC), or client-server computing technology may be used.
  • the electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing.
  • the external electronic device 104 may include an internet of things (IoT) device.
  • Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199 .
  • the electronic device 101 may be applied to intelligent services (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.
  • Electronic devices may be devices of various types.
  • the electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance.
  • a portable communication device eg, a smart phone
  • a computer device e.g., a smart phone
  • a portable multimedia device e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a camera
  • a wearable device e.g., a smart bracelet
  • first, second, or first or secondary may simply be used to distinguish a given component from other corresponding components, and may be used to refer to a given component in another aspect (eg, importance or order) is not limited.
  • a (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.”
  • the certain component may be connected to the other component directly (eg by wire), wirelessly, or through a third component.
  • module used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logical blocks, parts, or circuits.
  • a module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions.
  • the module may be implemented in the form of an application-specific integrated circuit (ASIC).
  • ASIC application-specific integrated circuit
  • a storage medium eg, internal memory 136 or external memory 138
  • a machine eg, electronic device 101
  • a processor eg, the processor 120
  • a device eg, the electronic device 101
  • the one or more instructions may include code generated by a compiler or code executable by an interpreter.
  • the device-readable storage medium may be provided in the form of a non-transitory storage medium.
  • the storage medium is a tangible device and does not contain a signal (e.g. electromagnetic wave), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.
  • a signal e.g. electromagnetic wave
  • the method according to various embodiments disclosed in this document may be included and provided in a computer program product.
  • Computer program products may be traded between sellers and buyers as commodities.
  • a computer program product is distributed in the form of a device-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play StoreTM) or on two user devices (e.g. It can be distributed (eg downloaded or uploaded) online, directly between smart phones.
  • a device-readable storage medium e.g. compact disc read only memory (CD-ROM)
  • an application store e.g. Play StoreTM
  • two user devices e.g. It can be distributed (eg downloaded or uploaded) online, directly between smart phones.
  • at least part of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium such as a manufacturer's server, an application store server, or a relay server's memory.
  • each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is.
  • one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added.
  • a plurality of components eg modules or programs
  • the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. .
  • the actions performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the actions are executed in a different order, or omitted. or one or more other actions may be added.
  • 2A is a front perspective view of an electronic device showing a slide-in state according to various embodiments of the present disclosure.
  • 2B is a front perspective view of an electronic device showing a slide-out state according to various embodiments of the present disclosure.
  • 3A is a rear perspective view of an electronic device showing a retracted state according to various embodiments of the present disclosure.
  • 3B is a rear perspective view of an electronic device showing a drawn-out state according to various embodiments of the present disclosure.
  • the electronic device 200 (eg, the electronic device 101 of FIG. 1) includes a housing 210 (eg, a housing structure, a first housing or a base housing), a housing ( 210) coupled to a slide structure 250 (eg, a slide structure, a second housing or a slide housing) movably coupled in a designated direction (eg, an X-axis direction) and a designated reciprocating distance, coupled to one end of the slide structure 250 and a bendable member (bendable member or bendable support member) accommodated in the inner space of the housing 210 through bending in a slide-in state (eg, the bendable member 260 of FIG.
  • a housing 210 eg, a housing structure, a first housing or a base housing
  • a housing 210) coupled to a slide structure 250 (eg, a slide structure, a second housing or a slide housing) movably coupled in a designated direction (eg, an X-axis direction) and a designated reciprocating distance, coupled to one end of
  • the flexible display 230 can be accommodated in the inner space of the housing 210 while being at least partially supported by a bendable member (eg, the bendable member 260 of FIG. 4A ) in a retracted state. and a partial area of the flexible display 230 accommodated in the inner space of the housing 210 may be disposed invisible from the outside.
  • the flexible display 230 is a bendable member (for example, the bendable member 260 of FIG. 4A ) at least partially forming the same plane as the slide structure 250 in a slide-out state. )), it can be arranged so that it can be seen from the outside.
  • the slide structure 250 may be coupled in a sliding manner so as to be at least partially drawn in or drawn out of the housing 210 .
  • the electronic device 200 may be configured to have a first width w1 from the second side surface 2102 to the fourth side surface 2104 in the drawn-in state.
  • a bendable member eg, the bendable member 260 of FIG. 4A
  • retracted into the housing 210 extends the additional second width w2
  • it can be operated to have a third width (w) greater than the first width (w1) by moving in a designated direction (eg, the X-axis direction).
  • the flexible display 230 may have a display area substantially of the first width w1 in a drawn-in state, and may have an extended display area substantially of a third width w3 in a drawn-out state.
  • the slide structure 250 may be operated through a user's manipulation.
  • the electronic device 200 may be transitioned into a drawn-in state or a drawn-out state through a user's manipulation of pressing the outer surface of the flexible display 230 in a designated direction.
  • the electronic device 200 moves the slide structure 250 in a designated direction (eg, the X-axis direction) by manipulating a button (not shown) of a locker (not shown) exposed to the outside. may be withdrawn automatically.
  • a designated direction eg, the X-axis direction
  • the elastic member retains the restoring force to be drawn out and is controlled to maintain the retracted state through a rocker (not shown).
  • the slide structure 250 may be automatically operated by a drive mechanism (eg, a drive motor, a deceleration module, and/or a gear assembly) disposed in the inner space of the housing 210 .
  • a drive mechanism eg, a drive motor, a deceleration module, and/or a gear assembly
  • the electronic device 200 detects an event for the transition of the drawn in/out state of the electronic device 200 through a processor (eg, the processor 120 of FIG. 1 ), through a driving mechanism. It may be set to control the operation of the slide structure 250 .
  • the processor eg, the processor 120 of FIG. 1
  • the processor 120 of the electronic device 200 responds to the changed display area of the flexible display 230 according to a drawn-in state, a drawn-out state, or an intermediate state, in various ways.
  • the flexible display 230 may be controlled to display an object and execute an application program.
  • the processor 120 may divide the display area of the flexible display 230 into a plurality of areas (eg, a first area and a second area), and display a different image corresponding to each area.
  • the processor 120 may display a first image captured using a first camera (eg, a wide-angle camera) included in the camera module 180 in the first area, and the camera module 180 A second image photographed using a second camera (eg, a telephoto camera) included in may be displayed in the second area.
  • the processor 120 includes a main processor (eg, the main processor 121 of FIG. 1 ) and/or an auxiliary processor (eg, the auxiliary processor 123 of FIG. 1 ), and the auxiliary processor ( An image signal processor (ISP) of 123) may at least partially control the camera module 180 to display a plurality of images on a plurality of display areas.
  • ISP image signal processor
  • the processor 120 of the electronic device 200 may include a sliding sensor (eg, the sensor 550 of FIG. 5 , the sensor module 176 of FIG. 1 , and/or the Hall IC), , the sliding sensor 550 can sense the drawn-in state, drawn-out state, and/or intermediate state of the electronic device 200 .
  • the processor 120 may check the state (eg, incoming state, outgoing state, and/or intermediate state) of the electronic device 200 and differently perform an operation corresponding to the state.
  • the electronic device 200 includes an input device 203, sound output devices 206 and 207, sensor modules 204 and 217, and a camera module 205 (eg, the camera module of FIG. 1 ( 180)), a connector port 208, a key input device (not shown), or an indicator (not shown).
  • the electronic device 200 may be configured such that at least one of the above-described components is omitted or other components are additionally included.
  • the camera module 205 is disposed on the right corner of the display in FIG. 2A, the position of the camera module 205 is not limited thereto, and for example, the camera module 205 is located on the left corner of the display. can be located
  • the camera module 205 may be disposed on the back as well as the front of the display, and the number of camera modules 205 may not be limited to one.
  • the input device 203 may include a microphone. In some embodiments, the input device 203 may include a plurality of microphones arranged to detect the direction of sound.
  • the sound output devices 206 and 207 may include speakers.
  • the audio output devices 206 and 207 may include an external speaker 206 and a receiver 207 for communication.
  • the sound output devices 206 and 207 may include an operated speaker (eg, a piezo speaker) while excluding a separate speaker hole.
  • the sensor modules 204 and 217 may generate electrical signals or data values corresponding to an internal operating state of the electronic device 200 or an external environmental state.
  • the sensor modules 204 and 217 are, for example, the first sensor module 204 (eg, a proximity sensor or an illuminance sensor) disposed on the front surface 210a of the electronic device 200 and/or the rear surface 210b.
  • An arranged second sensor module 217 eg, a heart rate monitoring (HRM) sensor
  • HRM heart rate monitoring
  • the first sensor module 204 may be disposed below the flexible display 230 on the front surface 210a of the electronic device 200 .
  • the first sensor module 204 may include a proximity sensor, an illuminance sensor, a time of flight (TOF) sensor, an ultrasonic sensor, a fingerprint recognition sensor, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, It may include at least one of a grip sensor, a color sensor, an IR (infrared) sensor, a bio sensor, a temperature sensor, or a humidity sensor.
  • TOF time of flight
  • the camera module 205 may include a first camera module 205 disposed on the front surface 210a of the electronic device 200 .
  • the camera module 205 may include one or a plurality of lenses, an image sensor, and/or an image signal processor.
  • the first camera module 205 may be disposed below the flexible display 230 and may be configured to capture a subject through a part of an active area of the flexible display 230 .
  • flash 218 may include, for example, a light emitting diode or a xenon lamp.
  • some of the sensor modules 204 or indicators among the camera module 205 and the sensor modules 204 and 217 may be disposed to be exposed through the flexible display 230 .
  • some of the camera modules 205, some of the sensor modules 204, or indicators may be disposed in an internal space of the electronic device 200 so as to be in contact with the external environment through an opening or a transmission area punched in the flexible display 230.
  • a portion of the flexible display 230 facing the camera module 205 may be formed as a transmissive area having a designated transmittance as a part of an area displaying content.
  • the transmission region may be formed to have a transmittance in a range of about 5% to about 20%.
  • Such a transmission area may include an area overlapping an effective area (eg, a field of view area) of some camera modules 205 through which light for forming an image formed by an image sensor passes.
  • the transmissive area of the flexible display 230 may include an area in which pixel density and/or wiring density are lower than those of the surrounding area.
  • a transmissive region may replace the aforementioned opening.
  • some camera modules 205 may include an under display camera (UDC).
  • UDC under display camera
  • some of the sensor modules 204 may be arranged to perform their functions without being visually exposed through the flexible display 230 in the internal space of the electronic device 200 .
  • the electronic device 200 may include at least one antenna (eg, the antenna module 197 of FIG. 1 ) (eg, an antenna structure).
  • the antenna module 197 is, for example, at least one antenna for transmitting and receiving a signal for wirelessly communicating with an external electronic device (eg, the electronic device 104 of FIG. 1) and/or A coil antenna (eg, a wireless power consortium (WPC) antenna, a coil member for wireless charging, and/or a coil member) for wirelessly charging an internal battery through an external wireless charging device may be included.
  • the electronic device 200 may further include another antenna (not shown) disposed in an internal space.
  • another antenna may wirelessly transmit and receive power required for charging.
  • the antenna module 197 may include at least one of a legacy antenna, a mmWave antenna, a near field communication (NFC) antenna, a wireless charging antenna, and/or a magnetic secure transmission (MST) antenna. .
  • the electronic device 200 may perform an operation in which the slide structure 250 is at least partially drawn in or drawn out, and during the drawing in or out operation, the slide structure 250 is at least partially drawn in or out.
  • the arranged flexible display 230 may be designed to maintain a flat state.
  • the electronic device 200 may be implemented such that the edge regions of the flexible display 230 corresponding to the first side 2101 and the third side 2103 are at least partially fixed to the slide structure 250. .
  • An edge area of the flexible display 230 may be fixed by the slide structure 250 and may help the flexible display 230 to maintain a flat state.
  • the central region of the flexible display 230 eg, the central region 430 of FIG.
  • the flexible display 230 may have relatively weaker fixing force than the edge region, and when the slide structure 250 is pulled in or pulled out, the flexible display 230 There is a possibility that an excitation phenomenon in which the is excited may occur. According to one embodiment, when the slide structure 250 is moved in or out, a rolling (or rotation) motion may occur in the display area of the flexible display 230 to which the bendable member 260 is coupled, , The flexible display 230 may be lifted due to the rolling operation.
  • the electronic device 200 is at least partially coupled to a bendable member (eg, the bendable member 260 of FIG. 4A) coupled to the slide structure 250 at least partially and the base bracket 240.
  • a magnetic member may be disposed such that an attractive force (eg, magnetic force, magnetic force, or electromagnetic force) is generated between the shaft brackets (eg, the shaft bracket 401 of FIG. 4A ).
  • the magnetic member includes a magnetic member and a magnetic response member, and when the magnetic member is disposed on the bendable member 260 , the magnetic response member may be disposed on the shaft bracket 401 .
  • An attractive force may be generated between the magnetic member and the magnetic response member based on the magnetic force.
  • the electronic device 200 may generate magnetic force in response to a portion of the flexible display 230 with a high possibility of lifting (eg, the central region 430 of the flexible display 230 of FIG. 4A ).
  • the member and the magnetic response member may be disposed, and the lifting phenomenon of the flexible display 230 may be prevented (eg, minimized) by using the attractive force between the magnetic member and the magnetic response member.
  • the central region of the flexible display 230 eg, the central region 430 in FIG. 4A
  • the shaft bracket 401 are in close contact based on manpower. can keep
  • Figure 4a is a front perspective view of the slide structure 250 according to various embodiments of the present invention.
  • a flexible display 230 positioned on a front surface 210a of an electronic device eg, the electronic device 200 of FIG. 2A
  • the flexible display 230 may be at least partially coupled to the bendable member 260 and the slide structure 250 .
  • the slide structure 250 may perform a rolling (eg, rotation) motion at least partially in an area where the bendable member 260 is disposed in response to a pulling-in or pulling-out motion of the electronic device 200 .
  • the electronic device 200 may assist the rolling motion of the bendable member 260 by using the gear unit 410 during a retracting or retracting operation.
  • the gear unit 410 may be at least partially coupled to the shaft bracket 401 of the electronic device 200 .
  • teeth of gears may be formed at both ends of the bendable member 260 , and the teeth of the gears may be engaged with the gear unit 410 .
  • the electronic device 200 may assist the rolling operation of the bendable member 260 by using the gear unit 410 during a drawing-in or drawing-out operation, and the bendable member 260 Both ends of may be at least partially fixed.
  • the central region 430 of the flexible display 230 may have relatively weaker fixing force than both ends of the flexible display 230, and the central region 430 may be lifted when the electronic device 200 is pulled in or out. can happen
  • a magnetic member eg, a magnetic force generating member
  • the magnetic force may be applied to the shaft bracket 401.
  • a reaction member may be disposed.
  • a magnetic attraction may occur between the magnetic member of the bendable member 260 and the magnetic response member of the shaft bracket 401 .
  • the electronic device 200 may maintain a state in which the bendable member 260 and the axis bracket 401 are in close contact with each other during a drawing-in or drawing-out operation, and the center of the flexible display 230 Lifting of the region 430 may be prevented (eg, minimized).
  • Figure 4b is an exemplary view showing a process of assembling the gear unit 410 to perform the rolling operation of the slide structure 250 according to various embodiments of the present invention.
  • a flexible display 230 positioned on a front surface 210a of an electronic device eg, the electronic device 200 of FIG. 2A
  • the flexible display 230 may be at least partially coupled to the bendable member 260 and the slide structure 250 .
  • the slide structure 250 may perform a rolling (eg, rotation) motion at least partially in an area where the bendable member 260 is disposed in response to a pulling-in or pulling-out motion of the electronic device 200 .
  • the bendable member 260 may be disposed at one end or at both ends of the flexible display 230 .
  • the bendable member 260 may be disposed at both ends of the flexible display 230, and the electronic device may perform a rolling operation at both ends of the flexible display 230.
  • gear units 410 may be disposed at both ends of the flexible display 230 to assist in the drawing-in or drawing-out of the electronic device 200 .
  • the gear unit 410 may be at least partially coupled to the shaft bracket 401 of the electronic device 200 and may support a rolling (eg, rotation) motion of the bendable member 260.
  • the gear unit 410 may be protected from external impact by the gear cover 411 .
  • auxiliary gear parts 413 for assisting the gear part 410 may also be disposed at both ends of the flexible display 230 , and the auxiliary gear parts 413 are auxiliary gear covers 412 can be protected from external shocks.
  • gear units 410 may be disposed at both ends of the flexible display 230 and may at least partially fix the flexible display 230 .
  • the central region 430 of the flexible display 230 may have relatively weaker fixing force than both ends of the flexible display 230, and the central region 430 may be lifted when the electronic device 200 is pulled in or out. can happen
  • a magnetic member eg, a magnetic force generating member
  • the magnetic force may be applied to the shaft bracket 401.
  • a reaction member may be disposed.
  • a magnetic attraction may occur between the magnetic member of the bendable member 260 and the magnetic response member of the shaft bracket 401 .
  • the electronic device 200 may maintain a state in which the bendable member 260 and the axis bracket 401 are in close contact with each other during a drawing-in or drawing-out operation, and the center of the flexible display 230 Lifting of the region 430 may be prevented (eg, minimized).
  • Figure 4c is an exemplary view showing the front of the slide structure 250 according to various embodiments of the present invention.
  • Figure 4d is an exemplary view showing the rear surface of the slide structure 250 according to various embodiments of the present invention.
  • the front surface of the slide structure 250 is the same as the front surface 210a of an electronic device (eg, the electronic device 200 of FIG. 2A), and a flexible display 230 is provided on the front surface of the slide structure 250. can be placed.
  • an electronic device eg, the electronic device 200 of FIG. 2A
  • a flexible display 230 is provided on the front surface of the slide structure 250. can be placed.
  • the flexible display 230 may be disposed in a form that is at least partially divided based on the bendable member 260 .
  • the flexible display 230 may perform a sliding motion by a set distance along a first direction (eg, the X-axis direction).
  • a first direction eg, the X-axis direction
  • the bendable member 260 may at least partially perform a rolling (eg, rotation) motion.
  • the axis bracket 401 may be disposed at least partially on the rear surface of the slide structure 250, and a partial display area of the flexible display 230 attached to the bendable member 260 may be disposed. there is.
  • a first direction eg, the X-axis direction
  • a portion of the flexible display 230 attached to the bendable member 260 slides. It can move from the back of the structure 250 to the front.
  • the bendable member 260 may perform a rolling (eg, rotation) motion.
  • camera holes disposed in some of the camera modules 205 of the flexible display 230 may be moved to match the transmission area in response to the movement of the flexible display 230 . A method of moving the camera hole will be described with reference to FIGS. 6 to 12 .
  • 5 is a block diagram of an electronic device according to various embodiments.
  • an electronic device 500 may include a processor 510, a memory 520, a display 530, a communication module 540, a sensor 550, and a camera 560, as shown in FIG.
  • Various embodiments of the present document may be implemented even if at least some of the components are omitted and/or substituted.
  • the electronic device 500 may further include at least some of the configurations and/or functions of the electronic device 101 of FIG. 1 .
  • Some of the components shown in FIG. 5 and/or other components of the electronic device 500 not shown are the housing of the electronic device 500. (housing) (not shown) may be disposed inside, and at least a portion of some components (eg, the display 530) may be exposed to the outside of the housing.
  • the display 530 may display content provided from the processor 510 .
  • the display 530 displays main content (or first content) generated from an application executed through the processor 510 and/or shared content obtained from an external device through the communication module 540 (or second content). content) can be displayed.
  • the display 530 may include at least one extended display area that is expandable from the main display area in at least one of up, down, left, and right directions. For example, when the display 530 is drawn in, only the main display area is exposed to the outside to output a screen, and the extended display area accommodated inside the housing and not exposed to the outside may not output a screen in an inactive state. . When the display 530 is drawn out, at least a portion of the extended display area is exposed to the outside, and as such, a screen may be output by converting the extended display area into an active state.
  • Various forms of the expandable display 530 have been previously described with reference to FIGS. 3A to 3D and 4A to 4E, but are not limited thereto.
  • the display 530 may be configured as a touch screen that detects a touch and/or proximity touch (or hovering) input using a user's body part (eg, a finger) or an input device (eg, a stylus pen).
  • a touch and/or proximity touch or hovering
  • a user's body part eg, a finger
  • an input device eg, a stylus pen
  • the electronic device 500 may include at least one sensor 550 that senses contact or proximity.
  • the electronic device 500 uses various types of short-range sensors for detecting the proximity or contact of an object, such as near field communication (NFC), radio frequency identification (RFID), Bluetooth (or Bluetooth low energy), or a touch sensor.
  • NFC near field communication
  • RFID radio frequency identification
  • Bluetooth Bluetooth low energy
  • a touch sensor can include
  • At least one sensor 550 may be disposed in an upper, lower, left, and right bezel area of the display 530 and/or a corner area of the housing. Accordingly, when selecting an area to display the main content or shared content, a touch or proximity input may be made to the sensor 550 adjacent to the area intended by the user.
  • the electronic device 500 may place a plurality of sensors 550 at locations around the display 530 .
  • the camera 560 may be disposed on a bezel area around the display 530 or a notch area inside the display 530 to capture a surrounding subject.
  • Image data captured by the camera 560 is provided to the processor 510, and the processor 510 may analyze the corresponding image to determine the user's interaction position.
  • the communication module 540 may provide a wired or wireless communication interface with an external device.
  • the communication module 540 may include a high definition multimedia interface (HDMI) and a universal serial bus (USB) interface as examples of wired communication interfaces (eg, the interface 177 of FIG. 1 ).
  • the communication module 540 may include a wireless communication module (eg, the wireless communication module 192 of FIG. 1 ) supporting an external device and a short-distance communication module.
  • the wireless communication module can support various short-range wireless communication methods (e.g., Wi-Fi, Bluetooth, Bluetooth low energy (BLE)), and has independent hardware and/or software configuration to support each wireless communication method.
  • BLE Bluetooth low energy
  • the memory 520 may temporarily or permanently store various data including volatile memory and non-volatile memory.
  • the memory 520 may include at least some of the configuration and/or functions of the memory 130 of FIG. 1 and may store the program 140 of FIG. 1 .
  • the memory 520 may store various instructions that may be executed by the processor 510 . These instructions may include control commands such as arithmetic and logic operations, data movement, and input/output that can be recognized by the processor 510 .
  • the processor 510 may control an image captured using a camera module (eg, the camera module 180 of FIG. 1 ) to be stored in the memory 520 .
  • a camera module eg, the camera module 180 of FIG. 1
  • the processor 510 is a component capable of performing calculations or data processing related to control and/or communication of each component of the electronic device 500, and is composed of one or more processors 510.
  • the processor 510 may include at least some of the components and/or functions of the processor 120 of FIG. 1 .
  • the processor 510 operatively, functionally and/or interacts with each component of the electronic device 500, such as the display 530, the memory 520, the sensor 550, and the camera 560. They can be electrically connected.
  • calculation and data processing functions that the processor 510 can implement on the electronic device 500 will not be limited, but hereinafter, the extended length of the display 530 and the position of the camera 560 are determined , Various embodiments for matching the center of the camera 560 and the center of the transmission area of the display 530 will be mainly described. Operations of the processor 510 to be described below may be performed by loading instructions stored in the memory 520 .
  • the processor 510 may display main content (or first content) on the main display area in a state where the display 530 is not expanded.
  • the main content may refer to content generated when the electronic device 500 executes an application (eg, an Internet browser, a game, or a gallery).
  • an application eg, an Internet browser, a game, or a gallery.
  • the electronic device 500 when the electronic device 500 is implemented as a TV, it may be broadcast content received through terrestrial or cable channels.
  • the processor 510 may control the extended display area to be in an inactive state.
  • FIG. 6 is a cross-sectional view taken along line K-K′ of the electronic device shown in FIG. 4A.
  • the electronic device shown in FIG. 6 (eg, the electronic device 500 of FIG. 5) includes a first roller 611, a second roller 612, a multi-bar 620, a flexible display 630, and a transmissive area 635. ), a light emitting element 640, a magnetic member 642, a sensor 650, and a camera 660 may be included.
  • the first roller 611 and the second roller 612 may expand or contract the flexible display 630 by rotating clockwise or counterclockwise.
  • the multi-bar 620 may mean a central bar supporting the assembly of the flexible display 630 .
  • the multi-bar 620 includes a curved surface, and a groove corresponding to the outer surface of a rail stopper or a rotating shaft may be formed on the inner surface.
  • the multi-bar 620 may rotate in response to a rotational movement of a rail stopper or a rotating shaft.
  • a rail stopper or a rotating shaft may include, for example, a first roller 611 and a second roller 612 .
  • the flexible display 630 may be rolled by the first roller 611 and the second roller 612 so that the transmission area 635 may be exposed or not exposed to the outside.
  • the flexible display 630 is a rollable display panel and may include a plurality of pixels, but the transmissive area 635 may not include pixels.
  • the light emitting element 640 and the magnetic member 642 may be used to calculate a moving distance of the flexible display 630 when rolling.
  • a processor eg, the processor 510 of FIG. 5
  • the sensor 650 may include at least one of a photosensor, a magnetic force sensor, and a rotational resistance sensor.
  • positions of the magnetic force sensor and the rotational resistance sensor may be disposed differently from the position of the camera 660 .
  • the location of the magnetic force sensor will be described with reference to FIGS. 10A and 10B.
  • the location of the rotational resistance sensor will be described with reference to FIG. 11 .
  • the magnetic force sensor may recognize a change in the magnetic field through the magnetic member 642 and calculate the moving distance of the flexible display 630 based on the position of the magnetic member 642 . This will be explained in FIGS. 10A to 10B.
  • the rotational resistance sensor calculates a rotational angle by measuring the rotational resistance of the first roller 611 or the second roller 612 during rotation, and calculates the moving distance of the flexible display 630 based on the rotational angle and diameter of the roller. can This will be explained in FIG. 11 .
  • the camera 660 may recognize a change in intensity of light through the light emitting element 640 and calculate a moving distance of the flexible display 630 based on the position of the light emitting element 640 . This will be explained in FIGS. 8A to 9 . Also, the camera 660 may obtain an image on which the guide line is displayed. The processor 510 may move the flexible display 630 to align the transparent area 635 with the camera 660 based on the guide line on the image. This will be explained in FIG. 12 . Matching may not mean perfect matching, and may be a concept including being located within a certain distance.
  • the electronic device 500 does not determine that the center of the transmission area 635 and the center of the camera 660 are matched only when the center of the transmission area 635 and the camera 660 are completely matched.
  • the predetermined distance may vary according to settings, and may mean a relatively smaller distance than a distance in which the center of the transmission area 635 and the center of the camera 660 do not coincide on the electronic device according to the comparative embodiment.
  • the electronic device according to this document is not limited to the embodiment only when the center of the transmission area 635 and the center of the camera 660 completely match, and is relatively more transparent than the electronic device according to the comparative embodiment. ) and the center of the camera 660 may be further included.
  • the terms 'matching', 'matching' or 'corresponding' in this document can be understood based on the above-mentioned content.
  • FIG. 7A and 7B illustrate a camera module control operation of an electronic device according to various embodiments.
  • the electronic device moves the flexible display (eg, the flexible display 630 of FIG. 6 ) to control the transmission area 735 and the camera 760 to match.
  • the flexible display eg, the flexible display 630 of FIG. 6
  • Figure 701 may mean a state in which the transmission region 735 is not exposed to the outside.
  • the electronic device 500 may provide a user with an image through a full screen without a hole (display panel).
  • Figure 703 may mean a state in which the transmission region 735 is exposed to the outside and matched with the camera 760 .
  • the electronic device 500 rotates both rollers (eg, the first roller 611 and the second roller 612 of FIG. 6 ) clockwise or counterclockwise based on a user input to use the camera 760 .
  • the transmission region 735 may be exposed to the outside.
  • the transmission area 735 should be matched with the camera 760 to provide a clear image or an image that is not biased to either side to the user.
  • FIG. 705 of FIG. 7B may indicate a state in which the transparent region 735 is not exposed to the outside in a state in which the flexible display 630 is expanded.
  • the electronic device 500 may provide a user with an image through a full screen without a hole (display panel).
  • Figure 707 may indicate a state in which the transmission region 735 is exposed to the outside and matched with the camera 760 .
  • the electronic device 500 rotates both rollers (eg, the first roller 611 and the second roller 612 of FIG. 6 ) clockwise or counterclockwise based on a user input to use the camera 760 .
  • the transmission region 735 may be exposed to the outside.
  • the transmission area 735 should be matched with the camera 760 to provide a clear image or an image that is not biased to either side to the user.
  • the electronic device 500 may include an error in a position between the transparent area 635 and the camera 660 in the process of moving the flexible display 630 while rotating the roller left and right.
  • the electronic device 500 may obtain an image in which the subject is biased to one side due to such an error, and may execute a correction operation to prevent this.
  • a method for matching between the transmission area 635 and the camera 660 will be described in FIGS. 8A to 13 .
  • 8A to 8C illustrate a matching method using a light emitting device of an electronic device according to various embodiments.
  • FIG. 8A is a cross-sectional view taken along K-K′ of the electronic device shown in FIG. 4A.
  • the electronic device shown in FIG. 8A (eg, the electronic device 500 of FIG. 5 ) includes a plurality of multi-bars 820, a transmission region 835, a first light emitting element 840a, and a second light emitting element 840b. and a camera 860 .
  • the electronic device 500 may further include the components shown in FIG. 6 .
  • the first light emitting device 840a and the second light emitting device 840b may be positioned between a plurality of multi-bars 820.
  • the camera 860 may detect a change in brightness according to movement of the first light emitting element 840a and the second light emitting element 840b.
  • the camera 860 may detect a change in brightness due to the approach of the first light emitting device 840a.
  • a processor eg, the processor 510 of FIG. 5
  • the processor 510 may calculate the position of the first light emitting element 840a based on the sensed change in brightness.
  • the processor 510 may calculate a moving distance of a display (eg, the display 530 of FIG. 5 ) based on the position of the first light emitting element 840a.
  • the transmission region 835 may be located at a point separated from the first light emitting element 840a by a first distance 815.
  • the processor 510 moves the display 530 by a first distance 815 based on the position of the first light emitting element 840a to control the center of the camera 860 and the center of the transmission area 835 to match.
  • matching may not mean perfect matching as mentioned in FIG. 6, and may be a concept including being located within a certain distance.
  • the processor 510 measures the brightness of light generated by using the camera 860, and the first light emitting element 840a is positioned at the center of the camera 860 based on the measured brightness of the light. It is determined whether the first light-emitting element 840a is located at the center of the camera 860, and the display 530 is moved by a first distance 815 to determine whether the first light emitting element 840a is located at the center of the camera 860 and the transmission area ( 835) can be controlled to correspond.
  • Figures 807 to 809 of FIG. 8B are enlarged views of matching portions of the camera 860 and the light emitting element 840 in the operation of FIG. 8A.
  • the camera 860 may recognize a change in brightness due to the light emitting element 840 and transmit this information to the processor 510.
  • the processor 510 may calculate the position of the light emitting element 840 based on brightness information received from the camera 860 .
  • the processor 510 moves the display 530 by a first distance (eg, the first distance 815 of FIG. 8A) based on the calculated position of the light emitting element 840, and Camera 860 can be matched.
  • the first distance 815 may mean a distance between the center of the light emitting element 840 and the center of the transmission region 835 .
  • the matching operation of the transmission area 835 and the camera 860 may mean an operation of making the center of the transmission area 835 correspond to the center of the camera 860 .
  • the processor 510 determines that the center of the transparent area 835 corresponds to the center of the camera 860. It can be judged that Hereinafter, an operation in which the center of the transmission area 835 and the center of the camera 860 correspond to each other is an area on the display 530 corresponding to the center of the camera 860 or a certain distance from the center of the transmission area 835. It may mean an operation located within.
  • Figures 811 and 813 show a process of matching the transparent area 835 and the camera 860 by moving the display 530 in the opposite direction to Figures 807 and 809 .
  • the second light emitting element 840b may be used as a light source for an image-based matching method after the transmission area 835 and the camera 860 are matched in FIG. 809 .
  • the image-based registration method will be described with reference to FIG. 12 .
  • the second light emitting element 840b may be used to determine the positions of the display 530 and the transmissive area 835 when the display 530 moves opposite to Figure 807 .
  • the camera 860 may recognize a change in brightness due to the second light emitting element 840b and transmit this information to the processor 510 .
  • the processor 510 may calculate the position of the second light emitting element 840b based on brightness information received using the camera 860 .
  • the processor 510 may move the display 530 by the first distance 815 based on the calculated position of the second light emitting element 840b to align the transparent area 835 with the camera 860.
  • the first distance 815 may mean a distance between the center of the second light emitting element 840b and the center of the transmission region 835 .
  • the processor 510 checks that the brightness of light measured using the camera 860 exceeds a certain level, and selects which one of the first light emitting element 840a or the second light emitting element 840b. It may be determined that one is positioned at a point on the flexible display 530 corresponding to the position of the camera 860 or within a predetermined distance from the point.
  • FIG 9 illustrates a matching method using a light emitting device of an electronic device according to various embodiments.
  • the electronic device (eg, the electronic device 500 of FIG. 5) includes a first light emitting device 940a and a second light emitting device 940b between the plurality of multi-bars 920, and a camera 960. can do.
  • the first roller (eg, the first roller 611 of FIG. 6 ) may be coupled to the plurality of multi-bars 920 using grooves.
  • the plurality of multi-bars 920 may be moved in response to the rotational movement of the first roller 611 .
  • the camera 960 may measure the brightness of light and transmit it to the processor 510 .
  • the processor 510 may determine the position of the first light emitting device 940a and/or the second light emitting device 940b based on the measured brightness change.
  • the processor 510 may determine the position of the first light emitting device 940a based on the measured brightness change.
  • the processor 510 checks that the brightness of light measured using the camera 960 exceeds a certain level, and selects which one of the first light emitting element 940a or the second light emitting element 940b. It may be determined that one is located at a point on the flexible display 530 corresponding to the position of the camera 960 .
  • the processor 510 may determine the position of the second light emitting element 940b based on the measured brightness change.
  • the processor 510 may calculate a distance between the first light emitting device 940a and the second light emitting device 940b based on the positions of the first light emitting device 940a and the second light emitting device 940b.
  • the processor 510 confirms that the second light emitting element 940b is located at a point on the display corresponding to the position of the camera 960 (eg, the display 530 of FIG. 5), and displays 530. ) may be moved by a first distance in the first direction.
  • the first direction may mean a direction opposite to the direction in which the first light emitting device 940a and the second light emitting device 940b move.
  • the first distance may mean half of the distance between the first light emitting element 940a and the second light emitting element 940b.
  • the processor 510 measures the brightness of light generated using the camera 960, and based on the measured brightness of the light, the second light emitting element 940b is positioned at the center of the camera 960. It is determined whether or not the second light emitting element 940b is located at the center of the camera 960, and the display 530 is moved by a first distance so that the distance between the center of the camera 960 and the transmission area 935 is determined.
  • the center can be controlled to correspond.
  • the first distance may mean half of the distance between the first light emitting element 940a and the second light emitting element 940b.
  • the processor 510 stores the distance of the display 530 moved for matching in a memory (eg: It can be stored on the memory 520 of FIG. 5 .
  • a memory eg: It can be stored on the memory 520 of FIG. 5 .
  • the processor 510 may move the display 530 by the stored distance so that the transparent region 935 is not exposed within the bezel.
  • the processor 510 may move the display 530 by a stored distance to expose the transparent region 935 outside the bezel.
  • the processor 510 may reversely control the moving direction of the display 530 in an operation of hiding the transparent area 935 and an operation of exposing the transparent area 935 .
  • 10A and 10B illustrate a matching method using a magnetic member of an electronic device according to various embodiments.
  • an electronic device may include a camera 1060 , a hall sensor 1050 , and a plurality of magnetic members 1042 .
  • the processor eg, the processor 510 of FIG. 5 . measures the strength of the magnetic field generated from the magnetic member 1042 using the Hall sensor 1050, and based on the measured strength of the magnetic field It is determined whether the magnetic member 1042 is located within a certain distance from the center of the Hall sensor 1050, and it is confirmed that the magnetic member 1042 is located within a certain distance from the center of the Hall sensor 1050, and the center of the camera 1060 is determined. It may be determined whether the center of the transmissive region 1035 corresponds to .
  • the processor 510 measures the strength of the magnetic field using the Hall sensor 1050 and passes through the Hall sensor 1050 among the plurality of magnetic members 1042 based on the measured strength of the magnetic field. Calculate the number of one magnetic member 1042, calculate the moving distance of the flexible display (eg, the flexible display 630 of FIG. 6) based on the number of magnetic members 1042 that have passed, and The position of the transmissive area 1035 may be calculated based on the moving distance of , and the flexible display 630 may be moved so that the center of the camera 1060 and the center of the transmissive area 1035 correspond.
  • a plurality of magnetic members 1042 may be positioned between a plurality of multi-bars (eg, multi-bars 620 of FIG. 6).
  • the first roller eg, the first roller 611 of FIG. 6
  • the plurality of multi-bars 620 may be moved in response to the rotational movement of the first roller 611 .
  • the Hall sensor 1050 may measure a change in the magnetic field and transmit it to the processor 510.
  • the processor 510 may detect that the magnetic member 1042 passes through a point on the flexible display 630 corresponding to the position of the hall sensor 1050 based on the change in the magnetic field.
  • the processor 510 may calculate the position of the transmission region 1035 using the number of magnetic members 1042 among the plurality of magnetic members 1042 that have passed through the Hall sensor 1050 and the length between magnetic field pulses. For example, the processor 510 may use the Hall sensor 1050 to measure the number of magnetic members 1042 passing through a point on the flexible display 630 corresponding to the Hall sensor 1050 .
  • the hall sensor 1050 may determine whether the magnetic member 1042 passes based on a change in a magnetic field pulse generated when the magnetic member 1042 passes. Also, when a plurality of magnetic field pulse changes occur, the Hall sensor 1050 may measure the number of magnetic members 1042 that have passed based on the number of magnetic field pulse changes.
  • the processor 510 may calculate the position of the transmission region 1035 by multiplying the distance between the plurality of adjacent magnetic members 1042 based on the measured number of magnetic members 1042 and adding the first distance.
  • the first distance may mean a distance between the transmission region 1035 and an adjacent magnetic member 1042 .
  • the processor 510 may control the center of the camera 1060 to correspond to the center of the transmission area 1035 based on the calculated position of the transmission area 1035 .
  • an electronic device may include a camera 1060, a hall sensor 1050, a first magnetic member 1042a, and a second magnetic member 1042b.
  • the first magnetic member 1042a and the second magnetic member 1042b may be positioned between a plurality of multi-bars (eg, the multi-bar 620 of FIG. 6).
  • the first roller eg, the first roller 611 of FIG. 6
  • the plurality of multi-bars 620 may be moved in response to the rotational movement of the first roller 611 .
  • the hall sensor 1050 can detect a change in the magnetic field according to the approach of the first magnetic member 1042a.
  • the Hall sensor 1050 may transmit change information of the magnetic field to the processor 510 .
  • the processor 510 may detect a change in the magnetic field using the Hall sensor 1050 and determine the position of the first magnetic member 1042a based on the change in the magnetic field.
  • the processor 510 may detect that the first magnetic member 1042a passes through a point on the flexible display 630 corresponding to the hall sensor 1050 based on the location of the first magnetic member 1042a.
  • the processor 510 detects that the first magnetic member 1042a passes through a point on the flexible display 630 corresponding to the Hall sensor 1050, and stops the flexible display 630. Control is performed so that the transmission area 1035 on the camera 1060 and the flexible display 630 are matched.
  • a matching operation between the transmission area 1035 and the camera 1060 may refer to an operation for matching the center of the transmission area 1035 and the camera 1060 .
  • the processor 510 matches the center of the transmission area 1035 and the center of the camera 1060, and then performs detailed matching between the center of the transmission area 1035 and the center of the camera 1060 using an image-based matching method. You can control it to happen.
  • the image-based registration method will be described with reference to FIG. 12 .
  • FIG. 11 illustrates a matching method using rotational resistance of an electronic device according to various embodiments.
  • an electronic device (eg, the electronic device 500 of FIG. 5 ) includes a camera 1160, a rotational resistance sensor 1150, a first roller 1111, a second roller 1112, and a flexible display 1130. ) and a plurality of multi-bars 1120.
  • a processor may measure a rotation angle of a resistor mounted on the first roller 1111 and/or the second roller 1112 using the rotation resistance sensor 1150 .
  • the processor 510 may calculate the moving distance of the flexible display 1130 using the radii of the first roller 1111 and/or the second roller 1112 based on the measured rotation angle.
  • the processor 510 measures a rotational angle of the resistance using a sensor module (eg, the sensor 550 of FIG. 5 ), and determines the rotation angle of the flexible display 1130 based on the measured rotational angle of the resistance.
  • the movement distance may be calculated, and the flexible display 1130 may be moved by a predetermined distance based on the calculated movement distance of the flexible display 1130 so that the center of the camera 1160 and the center of the transmission area 1135 correspond to each other. there is.
  • FIG. 12 illustrates a detailed matching method using a camera of an electronic device according to various embodiments.
  • a processor moves a flexible display (eg, the flexible display 630 of FIG. 6 ) using a sensor module (eg, the sensor 550 of FIG. 5 ).
  • the change amount is determined, and based on the movement change amount of the flexible display 630, the center of the camera 1260 and the center of the transmission area (eg, the transmission area 635 of FIG. 6) are controlled to correspond, and the camera 1260 An image is captured using the image, it is determined whether the center of the camera 1260 and the center of the transmission region 635 correspond to each other based on the guideline on the captured image, and the center of the camera 1260 and the transmission region 635 are determined. ), the flexible display 630 may be moved so that the center of the camera 1260 and the center of the transmission area 635 correspond to each other based on the shape of the guideline on the captured image.
  • the processor 510 controls the flexible display 630 to move in the first direction 1215, capture
  • the flexible display 630 may be controlled to move in the second direction 1225.
  • the processor 510 may measure the extended length or the reduced length of the flexible display 630 using the sensor 550 or the camera 1260 .
  • the processor 510 may determine whether the transparent area 635 approaches the camera 1260 based on the measured length of the flexible display 630 .
  • the processor 510 may position the center of the transparent area 635 to correspond to the center of the camera 1260 using the processes of FIGS. 8A to 11 . Thereafter, the processor 510 may capture an image using the camera 1260 to check whether the center of the transparent area 635 corresponds to the center of the camera 1260 .
  • the processor 510 may determine whether the center of the transparent region 635 is matched with the center of the camera 1260 based on the shape of the guide line on the captured image.
  • the processor 510 may determine that the transmission area 635 and the camera 1260 are not matched based on the bias of the guide line in the image area captured by the camera 1260. .
  • the processor 510 may capture an image using the camera for detailed matching.
  • the processor 510 may determine whether matching has been achieved between the transmission area 635 and the camera 1260 based on the shape of the guideline on the captured image. As shown in Figure 1201, the processor 510 confirms that the transmission area 635 and the camera 1260 are not matched based on the shape of the guideline, and moves the flexible display 630 based on the shape of the guideline.
  • the processor 510 moves the flexible display 630 in the first direction 1215 to control the transmission area 635 and the camera 1260 to match. there is. Conversely, when the guide line is convex downward as shown in FIG. 1260) can be controlled to match. At this time, the processor 510 uses a first roller (eg, the first roller 611 of FIG. 6 ) and/or a second roller (eg, the second roller 612 of FIG. 6 ) to move the flexible display 630 . )) can be used.
  • a first roller eg, the first roller 611 of FIG. 6
  • a second roller eg, the second roller 612 of FIG. 6
  • the processor 510 may calculate the distance between the guide line on the captured image and the end of the captured image.
  • the processor 510 may calculate the moving distance of the flexible display 630 for matching based on the calculated guide line on the captured image and the distance to the end of the captured image.
  • the processor 510 calculates a rotation angle for moving the flexible display 630 based on the calculated movement distance of the flexible display 630, and moves the first roller 611 and/or the second roller by the calculated rotation angle.
  • a drive system including 612 may be rotated. An operation in which the processor 510 moves the flexible display 630 by using the rotation angle and the radius of the drive system has been previously described with reference to FIG. 11 .
  • the processor 510 may determine whether the transmission area 635 and the camera 1260 are matched based on the shape of the guide line on the captured image. For example, as shown in Figure 1203, when the guide line is not displayed because it is biased (1230) or when the guide line is not displayed because it is matched (1232), it can be determined that the transmission area 635 and the camera 1260 are matched. there is.
  • FIG. 13A is a flowchart of a method for controlling a camera module of an electronic device according to various embodiments.
  • Operations described through FIG. 13A may be implemented based on instructions that may be stored in a computer recording medium or memory (eg, the memory 520 of FIG. 5).
  • the illustrated method 1300 may be executed by the electronic device (eg, the electronic device 500 of FIG. 5 ) previously described with reference to FIGS. 1A to 12 , and technical features described above will be omitted below.
  • the electronic device 500 determines the center of the camera (eg, the camera 560 of FIG. 5 ) and the transmission area (eg, the display 530 of FIG. 5 ) based on the movement change amount of the display (eg, the display 530 of FIG. 5 ). It can be controlled so that the center of the transmission area 635 of .
  • the electronic device 500 confirms that the transmission area (eg, the transmission area 635 of FIG. 6 ) and the camera (eg, the camera 560 of FIG. 5 ) are in a corresponding state, and uses the camera. You can capture images.
  • a processor eg, the processor 510 of FIG. 5 ) determines that the center of the transparent area 635 is located in an area on the display (eg, the display 530 of FIG. 5 ) corresponding to the center of the camera 560. It may be determined that the center of the transmission area 835 corresponds to the center of the camera 860 .
  • the processor 510 may determine whether the camera 560 and the transparent area 635 are in a matching state located within a specified distance.
  • the matching state may mean a state in which the center of the transmission region 635 corresponds to the center of the camera 560 or a state in which the center of the transmission region 635 and the center of the camera 560 are located within a predetermined distance.
  • a processor moves a flexible display (eg, the flexible display 630 of FIG. 6 ) using a sensor module (eg, the sensor 550 of FIG. 5 ). Determining the amount of change, controlling the center of the camera 560 to correspond to the center of the transmission area 635 based on the amount of change in the movement of the flexible display 630, and capturing an image using the camera 560 , Based on the guideline on the captured image, it is determined whether the center of the camera 560 and the center of the transmission region 635 correspond, and if the center of the camera 560 and the center of the transmission region 635 do not correspond, Based on the shape of the guideline on the captured image, the flexible display 630 may be moved so that the center of the camera 560 and the center of the transmission area 635 correspond.
  • the processor 510 may confirm that the camera 560 and the transmission area 635 are not matched and may check the shape of the guide line on the image captured in operation 1330 .
  • the processor 510 may move the flexible display 630 so that the center of the camera 560 and the center of the transmission area 635 correspond to each other based on the shape of the guideline. This has been described above with reference to FIG. 12 .
  • the processor 510 moves the flexible display 630 in the first direction 1215 so that the transparent area 635 and the camera 560 are aligned. You can control it. Conversely, when the guide line is convex downward as shown in FIG. (560) can be controlled to match. At this time, the processor 510 uses a first roller (eg, the first roller 611 of FIG. 6 ) and/or a second roller (eg, the second roller 612 of FIG. 6 ) to move the flexible display 630 . )) can be used.
  • a first roller eg, the first roller 611 of FIG. 6
  • a second roller eg, the second roller 612 of FIG. 6
  • the processor 510 may calculate a distance between a guide line on the captured image and an end of the captured image.
  • the processor 510 may calculate the moving distance of the flexible display 630 for matching based on the calculated guide line on the captured image and the distance to the end of the captured image.
  • the processor 510 calculates a rotation angle for moving the flexible display 630 based on the calculated movement distance of the flexible display 630, and moves the first roller 611 and/or the second roller by the calculated rotation angle.
  • a drive system including 612 may be rotated.
  • the processor 510 may move the flexible display based on the shape of the guide line on the image captured using the camera. Thereafter, in operation 1320, the processor 510 may determine whether the center of the camera 560 and the center of the transparent region 635 are in a matching state located within a specified distance. The processor 510 controls to end the control operation of the camera 560 when the center of the camera 560 and the center of the transmission area 635 are located within a specified distance, and the center of the camera 560 and the transmission area 635 ) may be controlled to repeat operation 1325 when the center is not located within a specified distance.
  • 13B is a flowchart of a method for controlling a camera module of an electronic device according to various embodiments.
  • Operations described through FIG. 13B may be implemented based on instructions that may be stored in a computer recording medium or memory (eg, the memory 520 of FIG. 5).
  • the illustrated method 1300 may be executed by the electronic device (eg, the electronic device 500 of FIG. 5 ) previously described with reference to FIGS. 1A to 12 , and technical features described above will be omitted below.
  • the electronic device 500 determines the center of the camera (eg, the camera 560 of FIG. 5 ) and the transmission area (eg, the display 530 of FIG. 5 ) based on the movement change amount of the display (eg, the display 530 of FIG. 5 ). It can be controlled so that the center of the transmission area 635 of .
  • the electronic device 500 confirms that the transmission area (eg, the transmission area 635 of FIG. 6 ) and the camera (eg, the camera 560 of FIG. 5 ) are in a corresponding state, and uses the camera. You can capture images.
  • a processor eg, the processor 510 of FIG. 5 ) determines that the center of the transparent area 635 is located in an area on the display (eg, the display 530 of FIG. 5 ) corresponding to the center of the camera 560. It may be determined that the center of the transmission area 835 corresponds to the center of the camera 860 .
  • the processor 510 may determine whether the camera 560 and the transparent area 635 are in a matching state located within a specified distance.
  • the matching state may mean a state in which the center of the transmission region 635 corresponds to the center of the camera 560 or a state in which the center of the transmission region 635 and the center of the camera 560 are located within a predetermined distance.
  • a processor moves a flexible display (eg, the flexible display 630 of FIG. 6 ) using a sensor module (eg, the sensor 550 of FIG. 5 ). Determining the amount of change, controlling the center of the camera 560 to correspond to the center of the transmission area 635 based on the amount of change in the movement of the flexible display 630, and capturing an image using the camera 560 , Based on the guideline on the captured image, it is determined whether the center of the camera 560 and the center of the transmission region 635 correspond, and if the center of the camera 560 and the center of the transmission region 635 do not correspond, Based on the shape of the guideline on the captured image, the flexible display 630 may be moved so that the center of the camera 560 and the center of the transmission area 635 correspond.
  • the processor 510 may confirm that the camera 560 and the transmission area 635 are not matched and may check the shape of the guide line on the image captured in operation 1330 .
  • the processor 510 may move the flexible display 630 so that the center of the camera 560 and the center of the transmission area 635 correspond to each other based on the shape of the guideline. This has been described above with reference to FIG. 12 .
  • the processor 510 moves the flexible display 630 in the first direction 1215 so that the transparent area 635 and the camera 560 are aligned. You can control it. Conversely, when the guide line is convex downward as shown in FIG. (560) can be controlled to match. At this time, the processor 510 uses a first roller (eg, the first roller 611 of FIG. 6 ) and/or a second roller (eg, the second roller 612 of FIG. 6 ) to move the flexible display 630 . )) can be used.
  • a first roller eg, the first roller 611 of FIG. 6
  • a second roller eg, the second roller 612 of FIG. 6
  • the processor 510 may calculate a distance between a guide line on the captured image and an end of the captured image.
  • the processor 510 may calculate the moving distance of the flexible display 630 for matching based on the calculated guide line on the captured image and the distance to the end of the captured image.
  • the processor 510 calculates a rotation angle for moving the flexible display 630 based on the calculated movement distance of the flexible display 630, and moves the first roller 611 and/or the second roller by the calculated rotation angle.
  • a drive system including 612 may be rotated.
  • the processor 510 moves the flexible display 630 in the first direction 1215 in operation 1335 when the guide line is convex in the first direction (eg, the first direction 1215 of FIG. 12). , so that the transmission area 635 and the camera 560 are matched.
  • the flexible The display 630 may be moved in a direction 1225 opposite to the first direction so that the transmission area 635 and the camera 560 are matched.
  • the processor 510 may capture an image using the camera 560 again in operation 1310, and check whether the transmission region 635 and the camera 560 are matched based on a guideline on the captured image.
  • FIG. 14 is a diagram illustrating effects of a method for controlling an electronic device and a camera module according to various embodiments.
  • the electronic device may form a larger transmission area than the camera to match the transmission area to the camera.
  • the user can see a relatively large hole (or transmission area).
  • content including at least one of images and videos may be covered on the display by the size of the hole (or transmission area), causing inconvenience to the user.
  • the electronic device may contain a relatively small transmission area.
  • the user can see a relatively small hole (or transmission area).
  • the electronic device of Figure 1403 may reduce inconvenience experienced by the user.
  • the electronic device due to the size of the relatively small hole (or transmission area), the electronic device may have a relatively large tolerance probability. Tolerance may mean a small error in the range in which an electronic device can operate, and due to this tolerance, the transmission area of the camera and display may not be properly matched.
  • An electronic device including a flexible display and a method for controlling a camera module thereof according to the present document can reduce a tolerance by using tolerance correction while having a small hole (or transmission area).
  • the electronic device according to the present document may have a small hole (or a transmission area) to enhance design aesthetics and provide an improved user experience.
  • An electronic device includes a camera, a sensor module, a flexible display including a first end and a second end spaced apart from the first end, a first roller winding around the first end, and a second roller winding around the second end. , a sensor module, and a processor operatively connected to the flexible display.
  • the first end includes a transmissive area through which external light is transmitted
  • the processor determines an amount of change in movement of the flexible display using a sensor module, and based on the amount of change in movement of the flexible display, the center of the camera and the center of the transmissive area are located within a specified distance Control to do so, capture an image using a camera, determine whether the center of the camera and the center of the transmission area are located within a specified distance based on the guideline on the captured image, and determine whether the center of the camera and the center of the transmission area
  • the flexible display may be moved so that the center of the camera and the center of the transmission area are located within the specified distance based on the shape of the guideline on the captured image.
  • the processor controls the flexible display to move in a second direction opposite to the first direction, and the guideline on the captured image
  • the flexible display may be controlled to move in the first direction
  • the sensor module may include at least one of a photosensor, a magnetic force sensor, and a rotational resistance sensor.
  • the electronic device supports a flexible display, and includes a plurality of multi-bars having a groove corresponding to an outer surface shape of a first roller, and a first light emitting element and a second light emitting element positioned between the plurality of multi-bars.
  • the first light emitting element is located at a point away from the center of the transmission area by a first distance
  • the processor measures the brightness of light generated using a camera
  • the first light emitting element based on the measured brightness of light Determines whether is located within a certain distance from the center of the camera, confirms that the first light emitting element is located within a certain distance from the center of the camera, and moves the flexible display by the first distance so that the center of the camera and the center of the transmission area are constant It can be controlled to be located within the distance.
  • the electronic device supports a flexible display, and includes a plurality of multi-bars having a groove corresponding to an outer surface shape of a first roller, and a first light emitting element and a second light emitting element positioned between the plurality of multi-bars.
  • the first light emitting element is located at a point away from the center of the transmissive area by a first distance in a first direction
  • the second light emitting element is located at a point away from the center of the transmissive area by a first distance in a direction opposite to the first direction.
  • the processor measures the brightness of light generated using the camera, detects the first light emitting element and the second light emitting element based on the measured brightness of the light, and the first light emitting element and the second light emitting element The distance between the first light emitting element and the second light emitting element is calculated using the detected time difference, and the distance between the first light emitting element and the second light emitting element is calculated based on the point where the second light emitting element is detected.
  • the center of the camera and the center of the transmission area may be controlled to be located within a predetermined distance.
  • the processor checks that the brightness of the light measured using the camera exceeds a certain level, and either the first light emitting device or the second light emitting device displays an object on the flexible display corresponding to the position of the camera. It can be determined that it is located within a certain distance from the point.
  • the electronic device supports a flexible display, a plurality of multi-bars having a groove corresponding to the outer surface shape of the first roller, a magnetic member located between the plurality of multi-bars, and measuring a change in strength of a magnetic field.
  • a hall sensor may be further included.
  • the magnetic member may be positioned at a point away from the center of the transmission area by a first distance in a first direction
  • the center of the Hall sensor may be positioned at a point apart from the center of the camera by a first distance in a first direction.
  • the processor measures the strength of the magnetic field generated from the magnetic member using the Hall sensor, determines whether the magnetic member is located within a predetermined distance from the center of the Hall sensor based on the measured strength of the magnetic field, and determines whether the magnetic member is located at the center of the Hall sensor. It is possible to confirm that it is located within a certain distance from and determine whether the center of the camera and the center of the transmission area are located within a certain distance.
  • the electronic device supports a flexible display, a plurality of multi-bars having a groove corresponding to the outer surface shape of the first roller, a plurality of magnetic members located between the plurality of multi-bars, and a change in the strength of a magnetic field. It may further include a hall sensor for measuring . At this time, the plurality of magnetic members have a certain distance between adjacent magnetic members, the processor measures the strength of the magnetic field using the Hall sensor, and the magnetic field passing through the Hall sensor among the plurality of magnetic members is measured based on the measured strength of the magnetic field.
  • the number of members is calculated, the moving distance of the flexible display is calculated based on the number of passed magnetic members, the position of the transmission area is calculated based on the moving distance of the flexible display, and the center of the camera and the center of the transmission area are calculated.
  • the flexible display may be moved to be located within a certain distance.
  • the electronic device further includes a resistor mounted on the first roller, the processor measures a rotation angle of the resistor using a sensor module, and determines a moving distance of the flexible display based on the measured rotation angle of the resistor. , and moving the flexible display by a predetermined distance based on the calculated moving distance of the flexible display may be controlled so that the center of the camera and the center of the transmission area are located within a predetermined distance.
  • the processor controls the first end of the flexible display to be wound by a first roller in the first display mode so that the transparent area of the first end is not exposed to the outside, and controls the display of the flexible display in the second display mode.
  • the first end may be wound by a first roller so that the transmission region of the first end may be exposed to the outside.
  • the electronic device may further include a memory
  • the processor may store, in the memory, a moving distance and a moving direction of the flexible display so that the center of the camera and the center of the transparent area coincide.
  • the processor may determine that the center of the camera and the center of the transmission area are located within a predetermined distance when the guideline on the captured image is not visible or matched to the image without bias.
  • a method for controlling a camera module of an electronic device determines an amount of change in movement of a flexible display using a sensor module, and controls the center of the camera and the center of a transmission area to be located within a predetermined distance based on the amount of change in movement of the flexible display
  • An operation of capturing an image using a camera and determining whether the center of the camera and the center of the transmission area are located within a certain distance based on a guideline on the captured image, the center of the camera and the center of the transmission area In response to confirming that the location is not located within the predetermined distance, an operation of moving the flexible display so that the center of the camera and the center of the transmission area are located within a predetermined distance based on the shape of the guideline on the captured image.
  • an operation of capturing an image using a camera and determining whether the center of the camera and the center of the transmission area are located within a predetermined distance based on a guideline on the captured image is a guide on the captured image.
  • the operation of controlling the flexible display to move in the second direction opposite to the first direction and the shape of the guide line on the captured image is convex in the second direction may be further included.
  • a method for controlling a camera module of an electronic device includes an operation of measuring brightness of light generated using a camera, and determining whether a first light emitting element is located within a predetermined distance from the center of the camera based on the measured brightness of light.
  • the operation of determining and confirming that the first light emitting device is located within a predetermined distance from the center of the camera, and moving the flexible display by the first distance to control the center of the camera and the center of the transmission area to be located within a predetermined distance are further performed.
  • a method for controlling a camera module of an electronic device includes an operation of measuring brightness of light generated using a camera, detecting a first light emitting element and a second light emitting element based on the measured brightness of light, and a second light emitting element. Operation of calculating the distance between the first light emitting element and the second light emitting element using the time difference between the detection of the first light emitting element and the second light emitting element, and the first light emission of the flexible display based on the point where the second light emitting element is detected An operation of controlling the center of the camera and the center of the transmission area to be located within a predetermined distance by moving the device in a direction opposite to the first direction by half the distance between the device and the second light emitting device may be further included.
  • a method for controlling a camera module of an electronic device includes an operation of measuring the strength of a magnetic field generated from a magnetic member using a Hall sensor, and moving the magnetic member at a predetermined distance from the center of the Hall sensor based on the measured strength of the magnetic field.
  • the method may further include an operation of determining whether the magnetic member is located within a predetermined distance and an operation of determining whether the center of the camera and the center of the transmission area are located within a predetermined distance after confirming that the magnetic member is located at the center of the hall sensor.
  • an operation of measuring a rotational angle of a resistor mounted on a first roller using a sensor module, an operation of calculating a movement distance of a flexible display based on the measured rotational angle of the resistance, and an operation of the calculated flexible display An operation of moving the flexible display by a predetermined distance based on the movement distance to control the center of the camera and the center of the transmission area within a predetermined distance may be further included.
  • the method for controlling a camera module of an electronic device includes an operation of determining that the center of a camera and the center of a transmission area are located within a predetermined distance when a guideline on a captured image is not visible or is matched to the image without bias. may further include.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Mathematical Physics (AREA)
  • Telephone Function (AREA)

Abstract

Un dispositif électronique selon divers modes de réalisation peut comprendre un appareil de prise de vues, un module capteur, un écran flexible comportant une première extrémité et une seconde extrémité espacée de la première extrémité, un premier rouleau qui enroule la première extrémité et un second rouleau qui enroule la seconde extrémité, et un processeur connecté fonctionnellement au module capteur et à l'écran flexible. La première extrémité comporte une zone transmissive à travers laquelle la lumière externe est transmise et le processeur peut : déterminer une quantité de changement de mouvement de l'écran flexible à l'aide du module capteur ; réaliser, en fonction de la quantité de changement du mouvement de l'écran flexible, une commande de telle sorte que le centre de l'appareil de prise de vues et le centre de la zone transmissive sont situés dans les limites d'une distance spécifiée ; capturer une image au moyen de l'appareil de prise de vues ; en fonction d'une ligne de guidage sur l'image capturée, déterminer si le centre de l'appareil de prise de vues et le centre de la zone transmissive sont situés dans les limites de la distance spécifiée ; et, en réponse à la confirmation du fait que le centre de l'appareil de prise de vues et le centre de la zone de transmission ne sont pas situés dans les limites de la distance spécifiée, déplacer l'écran flexible de sorte que le centre de l'appareil de prise de vues et le centre de la zone de transmission sont situés dans les limites de la distance spécifiée en fonction de la forme de la ligne directrice sur l'image capturée.
PCT/KR2022/014561 2021-12-03 2022-09-28 Dispositif électronique à écran flexible et procédé de commande de module d'appareil de prise de vues correspondant WO2023101179A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2021-0172445 2021-12-03
KR1020210172445A KR20230083939A (ko) 2021-12-03 2021-12-03 플렉서블 디스플레이를 갖는 전자 장치 및 그의 카메라 모듈 제어 방법

Publications (1)

Publication Number Publication Date
WO2023101179A1 true WO2023101179A1 (fr) 2023-06-08

Family

ID=86612512

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2022/014561 WO2023101179A1 (fr) 2021-12-03 2022-09-28 Dispositif électronique à écran flexible et procédé de commande de module d'appareil de prise de vues correspondant

Country Status (2)

Country Link
KR (1) KR20230083939A (fr)
WO (1) WO2023101179A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20170089664A (ko) * 2016-01-27 2017-08-04 엘지전자 주식회사 롤러블 이동 단말기 및 이의 제어 방법
KR20190113128A (ko) * 2018-03-27 2019-10-08 삼성전자주식회사 이동 가능한 플렉서블 디스플레이를 포함하는 전자 장치 및 그 동작 방법
KR20200007510A (ko) * 2018-07-13 2020-01-22 삼성전자주식회사 플렉서블 디스플레이 및 이를 포함하는 전자 장치
WO2020168428A1 (fr) * 2019-02-19 2020-08-27 Fitskin Inc. Systèmes et procédés d'utilisation et d'alignement d'accessoires de dispositif mobile pour dispositifs mobiles
KR102256681B1 (ko) * 2020-10-19 2021-05-26 삼성전자 주식회사 화면 제어 방법 및 그 전자 장치

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20170089664A (ko) * 2016-01-27 2017-08-04 엘지전자 주식회사 롤러블 이동 단말기 및 이의 제어 방법
KR20190113128A (ko) * 2018-03-27 2019-10-08 삼성전자주식회사 이동 가능한 플렉서블 디스플레이를 포함하는 전자 장치 및 그 동작 방법
KR20200007510A (ko) * 2018-07-13 2020-01-22 삼성전자주식회사 플렉서블 디스플레이 및 이를 포함하는 전자 장치
WO2020168428A1 (fr) * 2019-02-19 2020-08-27 Fitskin Inc. Systèmes et procédés d'utilisation et d'alignement d'accessoires de dispositif mobile pour dispositifs mobiles
KR102256681B1 (ko) * 2020-10-19 2021-05-26 삼성전자 주식회사 화면 제어 방법 및 그 전자 장치

Also Published As

Publication number Publication date
KR20230083939A (ko) 2023-06-12

Similar Documents

Publication Publication Date Title
WO2022080616A1 (fr) Dispositif électronique et procédé d'induction d'entrée
WO2022004985A1 (fr) Dispositif électronique comprenant un écran souple et son procédé de fonctionnement
WO2022139376A1 (fr) Dispositif électronique comprenant une antenne à cadre
WO2023182760A1 (fr) Dispositif électronique comprenant un écran souple
WO2022098169A1 (fr) Dispositif électronique à affichage flexible et procédé de fonctionnement dudit dispositif
WO2022119398A1 (fr) Dispositif électronique souple et procédé d'opération de service d'avatar associé
WO2022108125A1 (fr) Dispositif électronique comprenant une batterie et procédé associé
WO2022030921A1 (fr) Dispositif électronique, et procédé de commande de son écran
WO2022080883A1 (fr) Dispositif électronique et procédé de fonctionnement de dispositif électronique
WO2022080730A1 (fr) Dispositif électronique comprenant un écran souple et procédé
WO2023101179A1 (fr) Dispositif électronique à écran flexible et procédé de commande de module d'appareil de prise de vues correspondant
WO2022015009A1 (fr) Dispositif électronique et procédé incluant un écran souple
WO2023121068A1 (fr) Dispositif électronique comprenant un numériseur et procédé de fonctionnement associé
WO2023058893A1 (fr) Dispositif électronique comprenant un capteur d'empreintes digitales
WO2023022338A1 (fr) Appareil électronique de détection d'un geste de mouvement, et son procédé de fonctionnement
WO2024049270A1 (fr) Dispositif électronique comprenant une unité d'affichage coulissante et son procédé de fonctionnement
WO2022108303A1 (fr) Dispositif électronique comprenant un écran souple et son procédé de fonctionnement
WO2022108124A1 (fr) Dispositif électronique à affichage flexible
WO2023106712A1 (fr) Dispositif électronique et procédé de fonctionnement de celui-ci
WO2023191245A1 (fr) Dispositif électronique comprenant des moteurs à double vibration
WO2024019285A1 (fr) Procédé et dispositif d'affichage d'écran d'application exécutée à l'aide d'informations de module d'identification d'abonné
WO2022103040A1 (fr) Dispositif électronique à affichage flexible et procédé de fonctionnement dudit dispositif
WO2023080459A1 (fr) Procédé de fourniture d'image et dispositif électronique prenant en charge ce procédé
WO2022080825A1 (fr) Procédé d'affichage d'écran de dispositif pliable, et dispositif associé
WO2022225162A1 (fr) Dispositif électronique et procédé de fonctionnement d'un dispositif électronique

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22901539

Country of ref document: EP

Kind code of ref document: A1