KR20230083939A - Electronic device having flexible display and method for controlling camera module thereof - Google Patents

Abstract

An electronic device according to various embodiments includes a camera, a sensor module, a flexible display including a first end and a second end spaced apart from the first end, a first roller winding around the first end, and a second roller winding around the second end. , a sensor module, and a processor operatively connected to the flexible display. The first end includes a transmissive area through which external light is transmitted, and the processor determines an amount of change in movement of the flexible display using a sensor module, and based on the amount of change in movement of the flexible display, the center of the camera and the center of the transmissive area are located within a specified distance Control to do so, capture an image using a camera, determine whether the center of the camera and the center of the transmission area are located within a specified distance based on the guideline on the captured image, and determine whether the center of the camera and the center of the transmission area In response to confirming that the center of the camera is not located within the specified distance, the flexible display may be moved so that the center of the camera and the center of the transmission area are located within the specified distance based on the shape of the guideline on the captured image.

Description

Electronic device having a flexible display and method for controlling a camera module thereof

Various embodiments of this document disclose an electronic device having a flexible display (eg, a rollable device, a slidable device) and a method for controlling a camera module thereof.

The electronic device may be implemented using a form factor capable of providing a relatively larger screen while having a size in which a user does not feel uncomfortable when holding the electronic device. Among the form factors of electronic devices, a slideable form factor or a rollable form factor is drawing attention as a next-generation form factor because it can expand a display in a sliding manner.

The slide method may include a slide-in method in which a portion of the flexible display is drawn into the inner space of the electronic device or a slide-out method in which a portion of the flexible display is drawn out of the inner space of the electronic device. there is.

An electronic device implemented with a slideable form factor can be implemented to have a relatively small size by sliding the flexible display into the electronic device in a state carried by a user, and in a sliding out state, the flexible display can slide into the electronic device. By sliding out to the outside, content can be displayed on a relatively large screen.

When a user takes a photograph using an electronic device including a flexible display, a subject (eg, the user) may be moved around the display module by opening (or rolling) the display module. Therefore, in an electronic device including a flexible display, a subject is out of the shooting range of a fixed camera module or eccentricity occurs, and among image information acquired from the camera module, the user's image is provided by being disposed on the side of the display module. can Accordingly, the user may have to move the electronic device again so that the subject is located in the photographing range of the camera module.

In the process of moving the electronic device, a tolerance may occur between the transparent area (or hole) of the display panel and the camera. Tolerance may mean a small error in the range in which an electronic device can operate, and due to this tolerance, the transmission area of the camera and display may not be properly matched.

In the case of forming a large transmission area of the display for this matching, the camera may be positioned within the transmission area. However, in this case, the size of the display hall visible to the user on the display increases, and the user may feel uncomfortable.

An electronic device according to various embodiments includes a camera, a sensor module, a flexible display including a first end and a second end spaced apart from the first end, a first roller winding around the first end, and a second roller winding around the second end. , a sensor module, and a processor operatively connected to the flexible display. The first end includes a transmissive area through which external light is transmitted, and the processor determines an amount of change in movement of the flexible display using a sensor module, and based on the amount of change in movement of the flexible display, the center of the camera and the center of the transmissive area are located within a specified distance Control to do so, capture an image using a camera, determine whether the center of the camera and the center of the transmission area are located within a specified distance based on the guideline on the captured image, and determine whether the center of the camera and the center of the transmission area In response to confirming that the center of the camera is not located within the specified distance, the flexible display may be moved so that the center of the camera and the center of the transmission area are located within the specified distance based on the shape of the guideline on the captured image.

A method for controlling a camera module of an electronic device according to various embodiments determines an amount of change in movement of a flexible display using a sensor module, and controls the center of the camera and the center of a transmission area to be located within a predetermined distance based on the amount of change in movement of the flexible display An operation of capturing an image using a camera and determining whether the center of the camera and the center of the transmission area are located within a certain distance based on a guideline on the captured image, the center of the camera and the center of the transmission area In response to confirming that the location is not located within the predetermined distance, an operation of moving the flexible display so that the center of the camera and the center of the transmission area are located within a predetermined distance based on the shape of the guideline on the captured image.

An electronic device including a flexible display and a method for controlling a camera module thereof according to various embodiments may reduce tolerance by using tolerance correction while having a small hole (or transmission area).

In addition, the electronic device according to the present document may have a small hole (or a transmission area) to enhance design aesthetics and provide an improved user experience.

1 is a block diagram of an electronic device in a network environment, according to various embodiments.
2A is a front perspective view of an electronic device showing a slide-in state according to various embodiments of the present disclosure. 2B is a front perspective view of an electronic device showing a slide-out state according to various embodiments of the present disclosure.
3A is a rear perspective view of an electronic device showing a retracted state according to various embodiments of the present disclosure. 3B is a rear perspective view of an electronic device showing a drawn-out state according to various embodiments of the present disclosure.
Figure 4a is a front perspective view of the slide structure 250 according to various embodiments of the present invention. Figure 4b is an exemplary view showing a process of assembling the gear unit 410 to perform the rolling operation of the slide structure 250 according to various embodiments of the present invention.
5 is a block diagram of an electronic device according to various embodiments.
6 is a cross-sectional view taken along line K-K′ of the electronic device shown in FIG. 4A.
7A and 7B illustrate a camera module control operation of an electronic device according to various embodiments.
8A to 8C illustrate a matching method using a light emitting device of an electronic device according to various embodiments.
9 illustrates a matching method using a light emitting device of an electronic device according to various embodiments.
10A and 10B illustrate a matching method using a magnetic member of an electronic device according to various embodiments.
11 illustrates a matching method using rotational resistance of an electronic device according to various embodiments.
12 illustrates a detailed matching method using a camera of an electronic device according to various embodiments.
13 is a flowchart of a method for controlling a camera module of an electronic device according to various embodiments.
14 is a diagram illustrating effects of a method for controlling an electronic device and a camera module according to various embodiments.

1 is a block diagram of an electronic device 101 within a network environment 100, according to various embodiments. Referring to FIG. 1 , in a network environment 100, an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It may communicate with at least one of the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or the antenna module 197 may be included. In some embodiments, in the electronic device 101, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added. In some embodiments, some of these components (eg, sensor module 176, camera module 180, or antenna module 197) are integrated into a single component (eg, display module 160). It can be.

The processor 120, for example, executes software (eg, the program 140) to cause at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or calculations. According to one embodiment, as at least part of data processing or operation, the processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 . According to one embodiment, the processor 120 may include a main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit ( NPU: neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, when the electronic device 101 includes the main processor 121 and the auxiliary processor 123, the auxiliary processor 123 may use less power than the main processor 121 or be set to be specialized for a designated function. can The secondary processor 123 may be implemented separately from or as part of the main processor 121 .

The secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, running an application). ) state, together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to one embodiment, the auxiliary processor 123 (eg, image signal processor or communication processor) may be implemented as part of other functionally related components (eg, camera module 180 or communication module 190). there is. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. AI models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself where the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, but in the above example Not limited. The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the foregoing, but is not limited to the foregoing examples. The artificial intelligence model may include, in addition or alternatively, software structures in addition to hardware structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, program 140) and commands related thereto. The memory 130 may include volatile memory 132 or non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used by a component (eg, the processor 120) of the electronic device 101 from the outside of the electronic device 101 (eg, a user). The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. A receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 may visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor set to detect a touch or a pressure sensor set to measure the intensity of force generated by the touch.

The audio module 170 may convert sound into an electrical signal or vice versa. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or motion) or electrical stimuli that a user may perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to one embodiment, the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). Establishment and communication through the established communication channel may be supported. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : a local area network (LAN) communication module or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a telecommunications network such as a computer network (eg, a LAN or a WAN). These various types of communication modules may be integrated as one component (eg, a single chip) or implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, NR access technology (new radio access technology). NR access technologies include high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low latency (URLLC)). -latency communications)) can be supported. The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 uses various technologies for securing performance in a high frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. Technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna may be supported. The wireless communication module 192 may support various requirements defined for the electronic device 101, an external electronic device (eg, the electronic device 104), or a network system (eg, the second network 199). According to one embodiment, the wireless communication module 192 is a peak data rate for eMBB realization (eg, 20 Gbps or more), a loss coverage for mMTC realization (eg, 164 dB or less), or a U-plane latency for URLLC realization (eg, Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) may be supported.

The antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module 197 in addition to the radiator.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first surface (eg, a lower surface) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, array antennas) disposed on or adjacent to a second surface (eg, a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or part of operations executed in the electronic device 101 may be executed in one or more external electronic devices among the external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself. Alternatively or additionally, one or more external electronic devices may be requested to perform the function or at least part of the service. One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 . The electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed. To this end, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199 . The electronic device 101 may be applied to intelligent services (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

Electronic devices according to various embodiments disclosed in this document may be devices of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. An electronic device according to an embodiment of the present document is not limited to the aforementioned devices.

Various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, like reference numbers may be used for like or related elements. The singular form of a noun corresponding to an item may include one item or a plurality of items, unless the relevant context clearly dictates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A Each of the phrases such as "at least one of , B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "secondary" may simply be used to distinguish a given component from other corresponding components, and may be used to refer to a given component in another aspect (eg, importance or order) is not limited. A (e.g., first) component is said to be "coupled" or "connected" to another (e.g., second) component, with or without the terms "functionally" or "communicatively." When mentioned, it means that the certain component may be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logical blocks, parts, or circuits. can be used as A module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of this document provide one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). It may be implemented as software (eg, the program 140) including them. For example, a processor (eg, the processor 120 ) of a device (eg, the electronic device 101 ) may call at least one command among one or more instructions stored from a storage medium and execute it. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium is a tangible device and does not contain a signal (e.g. electromagnetic wave), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store™) or on two user devices (e.g. It can be distributed (eg downloaded or uploaded) online, directly between smart phones. In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium such as a manufacturer's server, an application store server, or a relay server's memory.

According to various embodiments, each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. . According to various embodiments, the actions performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the actions are executed in a different order, or omitted. or one or more other actions may be added.

2A is a front perspective view of an electronic device showing a slide-in state according to various embodiments of the present disclosure. 2B is a front perspective view of an electronic device showing a slide-out state according to various embodiments of the present disclosure.

3A is a rear perspective view of an electronic device showing a retracted state according to various embodiments of the present disclosure. 3B is a rear perspective view of an electronic device showing a drawn-out state according to various embodiments of the present disclosure.

2A to 3B, the electronic device 200 (eg, the electronic device 101 of FIG. 1) includes a housing 210 (eg, a housing structure, a first housing or a base housing), a housing ( 210) coupled to a slide structure 250 (eg, a slide structure, a second housing or a slide housing) movably coupled in a designated direction (eg, an X-axis direction) and a designated reciprocating distance, coupled to one end of the slide structure 250 and a bendable member (bendable member or bendable support member) accommodated in the inner space of the housing 210 through bending in a slide-in state (eg, the bendable member 260 of FIG. 4A) (eg : A hinge rail, a multi-bar assembly, and/or an articulated hinge module) and a flexible display disposed to be supported by the slide structure 250 and the bendable member (eg, the bendable member 260 of FIG. 4A) ) (230) (eg, expandable display). According to one embodiment, the flexible display 230 can be accommodated in the inner space of the housing 210 while being at least partially supported by a bendable member (eg, the bendable member 260 of FIG. 4A ) in a retracted state. and a partial area of the flexible display 230 accommodated in the inner space of the housing 210 may be disposed invisible from the outside. According to one embodiment, the flexible display 230 is a bendable member (for example, the bendable member 260 of FIG. 4A ) at least partially forming the same plane as the slide structure 250 in a slide-out state. )), it can be arranged so that it can be seen from the outside.

According to various embodiments, the slide structure 250 may be coupled in a sliding manner so as to be at least partially drawn in or drawn out of the housing 210 . For example, the electronic device 200 may be configured to have a first width w1 from the second side surface 2102 to the fourth side surface 2104 in the drawn-in state. According to an embodiment, in the electronic device 200, in a drawn-out state, a bendable member (eg, the bendable member 260 of FIG. 4A) retracted into the housing 210 extends the additional second width w2 ), it can be operated to have a third width (w) greater than the first width (w1) by moving in a designated direction (eg, the X-axis direction). Accordingly, the flexible display 230 may have a display area substantially of the first width w1 in a drawn-in state, and may have an extended display area substantially of a third width w3 in a drawn-out state.

According to various embodiments, the slide structure 250 may be operated through a user's manipulation. For example, the electronic device 200 may be transitioned into a drawn-in state or a drawn-out state through a user's manipulation of pressing the outer surface of the flexible display 230 in a designated direction. In some embodiments, the electronic device 200 moves the slide structure 250 in a designated direction (eg, the X-axis direction) by manipulating a button (not shown) of a locker (not shown) exposed to the outside. may be withdrawn automatically. In this case, when the slide structure 250 is pressed in a designated direction (eg, -X axis direction), the elastic member retains the restoring force to be drawn out and is controlled to maintain the retracted state through a rocker (not shown). can In some embodiments, the slide structure 250 may be automatically operated by a drive mechanism (eg, a drive motor, a deceleration module, and/or a gear assembly) disposed in the inner space of the housing 210 . According to an embodiment, when the electronic device 200 detects an event for the transition of the drawn in/out state of the electronic device 200 through a processor (eg, the processor 120 of FIG. 1 ), through a driving mechanism. It may be set to control the operation of the slide structure 250 .

In some embodiments, the processor (eg, the processor 120 of FIG. 1 ) of the electronic device 200 responds to the changed display area of the flexible display 230 according to a drawn-in state, a drawn-out state, or an intermediate state, in various ways. The flexible display 230 may be controlled to display an object and execute an application program. According to an embodiment, the processor 120 may divide the display area of the flexible display 230 into a plurality of areas (eg, a first area and a second area), and display a different image corresponding to each area. can For example, the processor 120 may display a first image captured using a first camera (eg, a wide-angle camera) included in the camera module 180 in the first area, and the camera module 180 A second image photographed using a second camera (eg, a telephoto camera) included in may be displayed in the second area. According to one embodiment, the processor 120 includes a main processor (eg, the main processor 121 of FIG. 1 ) and/or an auxiliary processor (eg, the auxiliary processor 123 of FIG. 1 ), and the auxiliary processor ( An image signal processor (ISP) of 123) may at least partially control the camera module 180 to display a plurality of images on a plurality of display areas.

According to an embodiment, the processor 120 of the electronic device 200 may include a sliding sensor (eg, the sensor 550 of FIG. 5 , the sensor module 176 of FIG. 1 , and/or the Hall IC), , the sliding sensor 550 can sense the drawn-in state, drawn-out state, and/or intermediate state of the electronic device 200 . According to an embodiment, the processor 120 may check the state (eg, incoming state, outgoing state, and/or intermediate state) of the electronic device 200 and differently perform an operation corresponding to the state.

According to various embodiments, the electronic device 200 includes an input device 203, sound output devices 206 and 207, sensor modules 204 and 217, and a camera module 205 (eg, the camera module of FIG. 1 ( 180)), a connector port 208, a key input device (not shown), or an indicator (not shown). In another embodiment, the electronic device 200 may be configured such that at least one of the above-described components is omitted or other components are additionally included. In addition, although the camera module 205 is disposed on the right corner of the display in FIG. 2A, the position of the camera module 205 is not limited thereto, and for example, the camera module 205 is located on the left corner of the display. can be located In addition, the camera module 205 may be disposed on the back as well as the front of the display, and the number of camera modules 205 may not be limited to one.

According to various embodiments, the input device 203 may include a microphone. In some embodiments, the input device 203 may include a plurality of microphones arranged to detect the direction of sound. The sound output devices 206 and 207 may include speakers. The audio output devices 206 and 207 may include an external speaker 206 and a receiver 207 for communication. In another embodiment, the sound output devices 206 and 207 may include an operated speaker (eg, a piezo speaker) while excluding a separate speaker hole.

According to various embodiments, the sensor modules 204 and 217 may generate electrical signals or data values corresponding to an internal operating state of the electronic device 200 or an external environmental state. The sensor modules 204 and 217 are, for example, the first sensor module 204 (eg, a proximity sensor or an illuminance sensor) disposed on the front surface 210a of the electronic device 200 and/or the rear surface 210b. An arranged second sensor module 217 (eg, a heart rate monitoring (HRM) sensor) may be included. According to one embodiment, the first sensor module 204 may be disposed below the flexible display 230 on the front surface 210a of the electronic device 200 . According to one embodiment, the first sensor module 204 may include a proximity sensor, an illuminance sensor, a time of flight (TOF) sensor, an ultrasonic sensor, a fingerprint recognition sensor, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, It may include at least one of a grip sensor, a color sensor, an IR (infrared) sensor, a bio sensor, a temperature sensor, or a humidity sensor.

According to various embodiments, the camera module 205 may include a first camera module 205 disposed on the front surface 210a of the electronic device 200 . According to one embodiment, the camera module 205 may include one or a plurality of lenses, an image sensor, and/or an image signal processor. According to one embodiment, the first camera module 205 may be disposed below the flexible display 230 and may be configured to capture a subject through a part of an active area of the flexible display 230 . According to one embodiment, flash 218 may include, for example, a light emitting diode or a xenon lamp.

According to various embodiments, some of the sensor modules 204 or indicators among the camera module 205 and the sensor modules 204 and 217 may be disposed to be exposed through the flexible display 230 . For example, some of the camera modules 205, some of the sensor modules 204, or indicators may be disposed in an internal space of the electronic device 200 so as to be in contact with the external environment through an opening or a transmission area punched in the flexible display 230. can According to one embodiment, a portion of the flexible display 230 facing the camera module 205 may be formed as a transmissive area having a designated transmittance as a part of an area displaying content. According to one embodiment, the transmission region may be formed to have a transmittance in a range of about 5% to about 20%. Such a transmission area may include an area overlapping an effective area (eg, a field of view area) of some camera modules 205 through which light for forming an image formed by an image sensor passes. For example, the transmissive area of the flexible display 230 may include an area in which pixel density and/or wiring density are lower than those of the surrounding area. For example, a transmissive region may replace the aforementioned opening. For example, some camera modules 205 may include an under display camera (UDC). In another embodiment, some of the sensor modules 204 may be arranged to perform their functions without being visually exposed through the flexible display 230 in the internal space of the electronic device 200 .

According to various embodiments, the electronic device 200 may include at least one antenna (eg, the antenna module 197 of FIG. 1 ) (eg, an antenna structure). According to one embodiment, the antenna module 197 is, for example, at least one antenna for transmitting and receiving a signal for wirelessly communicating with an external electronic device (eg, the electronic device 104 of FIG. 1) and/or A coil antenna (eg, a wireless power consortium (WPC) antenna, a coil member for wireless charging, and/or a coil member) for wirelessly charging an internal battery through an external wireless charging device may be included. According to one embodiment, the electronic device 200 may further include another antenna (not shown) disposed in an internal space. According to one embodiment, another antenna may wirelessly transmit and receive power required for charging. According to one embodiment, the antenna module 197 may include at least one of a legacy antenna, a mmWave antenna, a near field communication (NFC) antenna, a wireless charging antenna, and/or a magnetic secure transmission (MST) antenna. .

According to various embodiments, the electronic device 200 may perform an operation in which the slide structure 250 is at least partially drawn in or drawn out, and during the drawing in or out operation, the slide structure 250 is at least partially drawn in or out. The arranged flexible display 230 may be designed to maintain a flat state. For example, the electronic device 200 may be implemented such that the edge regions of the flexible display 230 corresponding to the first side 2101 and the third side 2103 are at least partially fixed to the slide structure 250. . An edge area of the flexible display 230 may be fixed by the slide structure 250 and may help the flexible display 230 to maintain a flat state. The central region of the flexible display 230 (eg, the central region 430 of FIG. 4A ) may have relatively weaker fixing force than the edge region, and when the slide structure 250 is pulled in or pulled out, the flexible display 230 There is a possibility that an excitation phenomenon in which the is excited may occur. According to one embodiment, when the slide structure 250 is moved in or out, a rolling (or rotation) motion may occur in the display area of the flexible display 230 to which the bendable member 260 is coupled, , The flexible display 230 may be lifted due to the rolling operation.

According to one embodiment, the electronic device 200 is at least partially coupled to a bendable member (eg, the bendable member 260 of FIG. 4A) coupled to the slide structure 250 at least partially and the base bracket 240. A magnetic member may be disposed such that an attractive force (eg, magnetic force, magnetic force, or electromagnetic force) is generated between the shaft brackets (eg, the shaft bracket 401 of FIG. 4A ). For example, the magnetic member includes a magnetic member and a magnetic response member, and when the magnetic member is disposed on the bendable member 260 , the magnetic response member may be disposed on the shaft bracket 401 . An attractive force may be generated between the magnetic member and the magnetic response member based on the magnetic force. According to an embodiment, the electronic device 200 may generate magnetic force in response to a portion of the flexible display 230 with a high possibility of lifting (eg, the central region 430 of the flexible display 230 of FIG. 4A ). The member and the magnetic response member may be disposed, and the lifting phenomenon of the flexible display 230 may be prevented (eg, minimized) by using the attractive force between the magnetic member and the magnetic response member. For example, when the electronic device 200 is drawn in or pulled out, the central region of the flexible display 230 (eg, the central region 430 in FIG. 4A ) and the shaft bracket 401 are in close contact based on manpower. can keep

Figure 4a is a front perspective view of the slide structure 250 according to various embodiments of the present invention.

Referring to FIG. 4A , a flexible display 230 positioned on a front surface 210a of an electronic device (eg, the electronic device 200 of FIG. 2A ) is illustrated. According to one embodiment, the flexible display 230 may be at least partially coupled to the bendable member 260 and the slide structure 250 . According to an exemplary embodiment, the slide structure 250 may perform a rolling (eg, rotation) motion at least partially in an area where the bendable member 260 is disposed in response to a pulling-in or pulling-out motion of the electronic device 200 . can For example, the electronic device 200 may assist the rolling motion of the bendable member 260 by using the gear unit 410 during a retracting or retracting operation. According to one embodiment, the gear unit 410 may be at least partially coupled to the shaft bracket 401 of the electronic device 200 . For example, teeth of gears may be formed at both ends of the bendable member 260 , and the teeth of the gears may be engaged with the gear unit 410 . According to an embodiment, the electronic device 200 may assist the rolling operation of the bendable member 260 by using the gear unit 410 during a drawing-in or drawing-out operation, and the bendable member 260 Both ends of may be at least partially fixed. The central region 430 of the flexible display 230 may have relatively weaker fixing force than both ends of the flexible display 230, and the central region 430 may be lifted when the electronic device 200 is pulled in or out. can happen

According to an embodiment, a magnetic member (eg, a magnetic force generating member) may be disposed on the bendable member 260 corresponding to the central region 430 of the flexible display 230, and the magnetic force may be applied to the shaft bracket 401. A reaction member may be disposed. A magnetic attraction may occur between the magnetic member of the bendable member 260 and the magnetic response member of the shaft bracket 401 . According to an embodiment, the electronic device 200 may maintain a state in which the bendable member 260 and the axis bracket 401 are in close contact with each other during a drawing-in or drawing-out operation, and the center of the flexible display 230 Lifting of the region 430 may be prevented (eg, minimized).

Figure 4b is an exemplary view showing a process of assembling the gear unit 410 to perform the rolling operation of the slide structure 250 according to various embodiments of the present invention.

Referring to FIG. 4B , a flexible display 230 positioned on a front surface 210a of an electronic device (eg, the electronic device 200 of FIG. 2A ) is illustrated. According to one embodiment, the flexible display 230 may be at least partially coupled to the bendable member 260 and the slide structure 250 . According to an exemplary embodiment, the slide structure 250 may perform a rolling (eg, rotation) motion at least partially in an area where the bendable member 260 is disposed in response to a pulling-in or pulling-out motion of the electronic device 200 . can In this case, the bendable member 260 may be disposed at one end or at both ends of the flexible display 230 . 4B illustrates a situation in which the bendable member 260 is disposed at only one end of the flexible display 230, but the location of the bendable member 260 is not limited thereto. 6 to 12, the bendable member 260 may be disposed at both ends of the flexible display 230, and the electronic device may perform a rolling operation at both ends of the flexible display 230.

According to an embodiment, gear units 410 may be disposed at both ends of the flexible display 230 to assist in the drawing-in or drawing-out of the electronic device 200 . According to an embodiment, the gear unit 410 may be at least partially coupled to the shaft bracket 401 of the electronic device 200 and may support a rolling (eg, rotation) motion of the bendable member 260. . According to one embodiment, the gear unit 410 may be protected from external impact by the gear cover 411 . According to an embodiment, auxiliary gear parts 413 for assisting the gear part 410 may also be disposed at both ends of the flexible display 230 , and the auxiliary gear parts 413 are auxiliary gear covers 412 can be protected from external shocks.

According to an embodiment, gear units 410 may be disposed at both ends of the flexible display 230 and may at least partially fix the flexible display 230 . The central region 430 of the flexible display 230 may have relatively weaker fixing force than both ends of the flexible display 230, and the central region 430 may be lifted when the electronic device 200 is pulled in or out. can happen

According to an embodiment, a magnetic member (eg, a magnetic force generating member) may be disposed on the bendable member 260 corresponding to the central region 430 of the flexible display 230, and the magnetic force may be applied to the shaft bracket 401. A reaction member may be disposed. A magnetic attraction may occur between the magnetic member of the bendable member 260 and the magnetic response member of the shaft bracket 401 . According to an embodiment, the electronic device 200 may maintain a state in which the bendable member 260 and the axis bracket 401 are in close contact with each other during a drawing-in or drawing-out operation, and the center of the flexible display 230 Lifting of the region 430 may be prevented (eg, minimized).

Figure 4c is an exemplary view showing the front of the slide structure 250 according to various embodiments of the present invention. Figure 4d is an exemplary view showing the rear surface of the slide structure 250 according to various embodiments of the present invention.

Referring to FIG. 4C, the front surface of the slide structure 250 is the same as the front surface 210a of an electronic device (eg, the electronic device 200 of FIG. 2A), and a flexible display 230 is provided on the front surface of the slide structure 250. can be placed.

According to an embodiment, the flexible display 230 may be disposed in a form that is at least partially divided based on the bendable member 260 . The flexible display 230 may perform a sliding motion by a set distance along a first direction (eg, the X-axis direction). According to an embodiment, when the flexible display 230 performs a sliding motion, the bendable member 260 may at least partially perform a rolling (eg, rotation) motion.

Referring to FIG. 4D , the axis bracket 401 may be disposed at least partially on the rear surface of the slide structure 250, and a partial display area of the flexible display 230 attached to the bendable member 260 may be disposed. there is. According to an embodiment, when the flexible display 230 performs a sliding motion along a first direction (eg, the X-axis direction), a portion of the flexible display 230 attached to the bendable member 260 slides. It can move from the back of the structure 250 to the front. The bendable member 260 may perform a rolling (eg, rotation) motion. In addition, camera holes disposed in some of the camera modules 205 of the flexible display 230 may be moved to match the transmission area in response to the movement of the flexible display 230 . A method of moving the camera hole will be described with reference to FIGS. 6 to 12 .

5 is a block diagram of an electronic device according to various embodiments.

Referring to FIG. 5 , an electronic device 500 may include a processor 510, a memory 520, a display 530, a communication module 540, a sensor 550, and a camera 560, as shown in FIG. Various embodiments of the present document may be implemented even if at least some of the components are omitted and/or substituted. The electronic device 500 may further include at least some of the configurations and/or functions of the electronic device 101 of FIG. 1 .

Some of the components shown in FIG. 5 and/or other components of the electronic device 500 not shown (eg, the processor 510, the memory 520, and the communication module 540) are the housing of the electronic device 500. (housing) (not shown) may be disposed inside, and at least a portion of some components (eg, the display 530) may be exposed to the outside of the housing.

According to various embodiments, the display 530 may display content provided from the processor 510 . For example, the display 530 displays main content (or first content) generated from an application executed through the processor 510 and/or shared content obtained from an external device through the communication module 540 (or second content). content) can be displayed.

According to various embodiments, the display 530 may include at least one extended display area that is expandable from the main display area in at least one of up, down, left, and right directions. For example, when the display 530 is drawn in, only the main display area is exposed to the outside to output a screen, and the extended display area accommodated inside the housing and not exposed to the outside may not output a screen in an inactive state. . When the display 530 is drawn out, at least a portion of the extended display area is exposed to the outside, and as such, a screen may be output by converting the extended display area into an active state. Various forms of the expandable display 530 have been previously described with reference to FIGS. 3A to 3D and 4A to 4E, but are not limited thereto.

According to various embodiments, the display 530 may be configured as a touch screen that detects a touch and/or proximity touch (or hovering) input using a user's body part (eg, a finger) or an input device (eg, a stylus pen). can

According to various embodiments, the electronic device 500 may include at least one sensor 550 that senses contact or proximity. For example, the electronic device 500 uses various types of short-range sensors for detecting the proximity or contact of an object, such as near field communication (NFC), radio frequency identification (RFID), Bluetooth (or Bluetooth low energy), or a touch sensor. can include

According to various embodiments, at least one sensor 550 may be disposed in an upper, lower, left, and right bezel area of the display 530 and/or a corner area of the housing. Accordingly, when selecting an area to display the main content or shared content, a touch or proximity input may be made to the sensor 550 adjacent to the area intended by the user. In various embodiments, the electronic device 500 may place a plurality of sensors 550 at locations around the display 530 .

According to various embodiments, the camera 560 may be disposed on a bezel area around the display 530 or a notch area inside the display 530 to capture a surrounding subject. Image data captured by the camera 560 is provided to the processor 510, and the processor 510 may analyze the corresponding image to determine the user's interaction position.

According to various embodiments, the communication module 540 may provide a wired or wireless communication interface with an external device. For example, the communication module 540 may include a high definition multimedia interface (HDMI) and a universal serial bus (USB) interface as examples of wired communication interfaces (eg, the interface 177 of FIG. 1 ). In addition, the communication module 540 may include a wireless communication module (eg, the wireless communication module 192 of FIG. 1 ) supporting an external device and a short-distance communication module. The wireless communication module can support various short-range wireless communication methods (e.g., Wi-Fi, Bluetooth, Bluetooth low energy (BLE)), and has independent hardware and/or software configuration to support each wireless communication method. can include

According to various embodiments, the memory 520 may temporarily or permanently store various data including volatile memory and non-volatile memory. The memory 520 may include at least some of the configuration and/or functions of the memory 130 of FIG. 1 and may store the program 140 of FIG. 1 .

The memory 520 may store various instructions that may be executed by the processor 510 . These instructions may include control commands such as arithmetic and logic operations, data movement, and input/output that can be recognized by the processor 510 .

According to an embodiment, the processor 510 may control an image captured using a camera module (eg, the camera module 180 of FIG. 1 ) to be stored in the memory 520 .

According to various embodiments, the processor 510 is a component capable of performing calculations or data processing related to control and/or communication of each component of the electronic device 500, and is composed of one or more processors 510. can The processor 510 may include at least some of the components and/or functions of the processor 120 of FIG. 1 . The processor 510 operatively, functionally and/or interacts with each component of the electronic device 500, such as the display 530, the memory 520, the sensor 550, and the camera 560. They can be electrically connected.

According to various embodiments, calculation and data processing functions that the processor 510 can implement on the electronic device 500 will not be limited, but hereinafter, the extended length of the display 530 and the position of the camera 560 are determined , Various embodiments for matching the center of the camera 560 and the center of the transmission area of the display 530 will be mainly described. Operations of the processor 510 to be described below may be performed by loading instructions stored in the memory 520 .

According to various embodiments, the processor 510 may display main content (or first content) on the main display area in a state where the display 530 is not expanded. Here, the main content may refer to content generated when the electronic device 500 executes an application (eg, an Internet browser, a game, or a gallery). Alternatively, when the electronic device 500 is implemented as a TV, it may be broadcast content received through terrestrial or cable channels. In a state in which the display 530 is not expanded, the extended display area is retracted into the housing, and the processor 510 may control the extended display area to be in an inactive state.

6 is a cross-sectional view taken along line K-K′ of the electronic device shown in FIG. 4A.

The electronic device shown in FIG. 6 (eg, the electronic device 500 of FIG. 5) includes a first roller 611, a second roller 612, a multi-bar 620, a flexible display 630, and a transmissive area 635. ), a light emitting element 640, a magnetic member 642, a sensor 650, and a camera 660 may be included.

The first roller 611 and the second roller 612 may expand or contract the flexible display 630 by rotating clockwise or counterclockwise.

The multi-bar 620 may mean a central bar supporting the assembly of the flexible display 630 . The multi-bar 620 includes a curved surface, and a groove corresponding to the outer surface of a rail stopper or a rotating shaft may be formed on the inner surface. The multi-bar 620 may rotate in response to a rotational movement of a rail stopper or a rotating shaft. A rail stopper or a rotating shaft may include, for example, a first roller 611 and a second roller 612 .

The flexible display 630 may be rolled by the first roller 611 and the second roller 612 so that the transmission area 635 may be exposed or not exposed to the outside. The flexible display 630 is a rollable display panel and may include a plurality of pixels, but the transmissive area 635 may not include pixels.

The light emitting element 640 and the magnetic member 642 may be used to calculate a moving distance of the flexible display 630 when rolling. A processor (eg, the processor 510 of FIG. 5 ) may use the light emitting element 640 and/or the magnetic member 642 when the transparent region 635 and the camera 660 are matched.

According to one embodiment, the sensor 650 may include at least one of a photosensor, a magnetic force sensor, and a rotational resistance sensor. However, positions of the magnetic force sensor and the rotational resistance sensor may be disposed differently from the position of the camera 660 . The location of the magnetic force sensor will be described with reference to FIGS. 10A and 10B. The location of the rotational resistance sensor will be described with reference to FIG. 11 . The magnetic force sensor may recognize a change in the magnetic field through the magnetic member 642 and calculate the moving distance of the flexible display 630 based on the position of the magnetic member 642 . This will be explained in FIGS. 10A to 10B. The rotational resistance sensor calculates a rotational angle by measuring the rotational resistance of the first roller 611 or the second roller 612 during rotation, and calculates the moving distance of the flexible display 630 based on the rotational angle and diameter of the roller. can This will be explained in FIG. 11 .

According to an embodiment, the camera 660 may recognize a change in intensity of light through the light emitting element 640 and calculate a moving distance of the flexible display 630 based on the position of the light emitting element 640 . This will be explained in FIGS. 8A to 9 . Also, the camera 660 may obtain an image on which the guide line is displayed. The processor 510 may move the flexible display 630 to align the transparent area 635 with the camera 660 based on the guide line on the image. This will be explained in FIG. 12 . Matching may not mean perfect matching, and may be a concept including being located within a certain distance. For example, the electronic device 500 does not determine that the center of the transmission area 635 and the center of the camera 660 are matched only when the center of the transmission area 635 and the camera 660 are completely matched. When the center is located within a certain distance, it may be determined that the matched state is achieved. Here, the predetermined distance may vary according to settings, and may mean a relatively smaller distance than a distance in which the center of the transmission area 635 and the center of the camera 660 do not coincide on the electronic device according to the comparative embodiment. However, the electronic device according to this document is not limited to the embodiment only when the center of the transmission area 635 and the center of the camera 660 completely match, and is relatively more transparent than the electronic device according to the comparative embodiment. ) and the center of the camera 660 may be further included. Hereinafter, the terms 'matching', 'matching' or 'corresponding' in this document can be understood based on the above-mentioned content.

7A and 7B illustrate a camera module control operation of an electronic device according to various embodiments.

In FIG. 7A , the electronic device (eg, the electronic device 500 of FIG. 5 ) moves the flexible display (eg, the flexible display 630 of FIG. 6 ) to control the transmission area 735 and the camera 760 to match. can

Figure 701 may mean a state in which the transmission region 735 is not exposed to the outside. In this case, the electronic device 500 may provide a user with an image through a full screen without a hole (display panel). Figure 703 may mean a state in which the transmission region 735 is exposed to the outside and matched with the camera 760 . The electronic device 500 rotates both rollers (eg, the first roller 611 and the second roller 612 of FIG. 6 ) clockwise or counterclockwise based on a user input to use the camera 760 . Thus, the transmission region 735 may be exposed to the outside. At this time, the transmission area 735 should be matched with the camera 760 to provide a clear image or an image that is not biased to either side to the user.

705 of FIG. 7B may indicate a state in which the transparent region 735 is not exposed to the outside in a state in which the flexible display 630 is expanded. In this case, the electronic device 500 may provide a user with an image through a full screen without a hole (display panel). Figure 707 may indicate a state in which the transmission region 735 is exposed to the outside and matched with the camera 760 . The electronic device 500 rotates both rollers (eg, the first roller 611 and the second roller 612 of FIG. 6 ) clockwise or counterclockwise based on a user input to use the camera 760 . Thus, the transmission region 735 may be exposed to the outside. At this time, the transmission area 735 should be matched with the camera 760 to provide a clear image or an image that is not biased to either side to the user.

The electronic device 500 may include an error in a position between the transparent area 635 and the camera 660 in the process of moving the flexible display 630 while rotating the roller left and right. The electronic device 500 may obtain an image in which the subject is biased to one side due to such an error, and may execute a correction operation to prevent this. Hereinafter, a method for matching between the transmission area 635 and the camera 660 will be described in FIGS. 8A to 13 .

8A to 8C illustrate a matching method using a light emitting device of an electronic device according to various embodiments.

8A is a cross-sectional view taken along K-K′ of the electronic device shown in FIG. 4A.

The electronic device shown in FIG. 8A (eg, the electronic device 500 of FIG. 5 ) includes a plurality of multi-bars 820, a transmission region 835, a first light emitting element 840a, and a second light emitting element 840b. and a camera 860 . In addition to this, the electronic device 500 may further include the components shown in FIG. 6 .

According to Figure 801, the first light emitting device 840a and the second light emitting device 840b may be positioned between a plurality of multi-bars 820. The camera 860 may detect a change in brightness according to movement of the first light emitting element 840a and the second light emitting element 840b. For example, in Figure 803, the camera 860 may detect a change in brightness due to the approach of the first light emitting device 840a. A processor (eg, the processor 510 of FIG. 5 ) may determine the position of the first light emitting element 840a based on the sensed change in brightness. The processor 510 may calculate a moving distance of a display (eg, the display 530 of FIG. 5 ) based on the position of the first light emitting element 840a.

According to Figure 805, the transmission region 835 may be located at a point separated from the first light emitting element 840a by a first distance 815. The processor 510 moves the display 530 by a first distance 815 based on the position of the first light emitting element 840a to control the center of the camera 860 and the center of the transmission area 835 to match. can In this document, matching may not mean perfect matching as mentioned in FIG. 6, and may be a concept including being located within a certain distance.

According to an embodiment, the processor 510 measures the brightness of light generated by using the camera 860, and the first light emitting element 840a is positioned at the center of the camera 860 based on the measured brightness of the light. It is determined whether the first light-emitting element 840a is located at the center of the camera 860, and the display 530 is moved by a first distance 815 to determine whether the first light emitting element 840a is located at the center of the camera 860 and the transmission area ( 835) can be controlled to correspond.

Figures 807 to 809 of FIG. 8B are enlarged views of matching portions of the camera 860 and the light emitting element 840 in the operation of FIG. 8A.

According to Figure 807, the camera 860 may recognize a change in brightness due to the light emitting element 840 and transmit this information to the processor 510. The processor 510 may calculate the position of the light emitting element 840 based on brightness information received from the camera 860 . In Figure 809, the processor 510 moves the display 530 by a first distance (eg, the first distance 815 of FIG. 8A) based on the calculated position of the light emitting element 840, and Camera 860 can be matched. Here, the first distance 815 may mean a distance between the center of the light emitting element 840 and the center of the transmission region 835 . The matching operation of the transmission area 835 and the camera 860 may mean an operation of making the center of the transmission area 835 correspond to the center of the camera 860 . When the center of the transparent area 835 is located in an area on the display 530 corresponding to the center of the camera 860, the processor 510 determines that the center of the transparent area 835 corresponds to the center of the camera 860. It can be judged that Hereinafter, an operation in which the center of the transmission area 835 and the center of the camera 860 correspond to each other is an area on the display 530 corresponding to the center of the camera 860 or a certain distance from the center of the transmission area 835. It may mean an operation located within.

Figures 811 and 813 show a process of matching the transparent area 835 and the camera 860 by moving the display 530 in the opposite direction to Figures 807 and 809 .

According to an embodiment, the second light emitting element 840b may be used as a light source for an image-based matching method after the transmission area 835 and the camera 860 are matched in FIG. 809 . The image-based registration method will be described with reference to FIG. 12 . In addition, the second light emitting element 840b may be used to determine the positions of the display 530 and the transmissive area 835 when the display 530 moves opposite to Figure 807 .

The camera 860 may recognize a change in brightness due to the second light emitting element 840b and transmit this information to the processor 510 . The processor 510 may calculate the position of the second light emitting element 840b based on brightness information received using the camera 860 . In Figure 813, the processor 510 may move the display 530 by the first distance 815 based on the calculated position of the second light emitting element 840b to align the transparent area 835 with the camera 860. there is. Here, the first distance 815 may mean a distance between the center of the second light emitting element 840b and the center of the transmission region 835 .

According to an embodiment, the processor 510 checks that the brightness of light measured using the camera 860 exceeds a certain level, and selects which one of the first light emitting element 840a or the second light emitting element 840b. It may be determined that one is positioned at a point on the flexible display 530 corresponding to the position of the camera 860 or within a predetermined distance from the point.

9 illustrates a matching method using a light emitting device of an electronic device according to various embodiments.

In Figure 901, the electronic device (eg, the electronic device 500 of FIG. 5) includes a first light emitting device 940a and a second light emitting device 940b between the plurality of multi-bars 920, and a camera 960. can do. The first roller (eg, the first roller 611 of FIG. 6 ) may be coupled to the plurality of multi-bars 920 using grooves. The plurality of multi-bars 920 may be moved in response to the rotational movement of the first roller 611 .

According to an embodiment, the camera 960 may measure the brightness of light and transmit it to the processor 510 . The processor 510 may determine the position of the first light emitting device 940a and/or the second light emitting device 940b based on the measured brightness change. In Figure 903, the processor 510 may determine the position of the first light emitting device 940a based on the measured brightness change.

According to an embodiment, the processor 510 checks that the brightness of light measured using the camera 960 exceeds a certain level, and selects which one of the first light emitting element 940a or the second light emitting element 940b. It may be determined that one is located at a point on the flexible display 530 corresponding to the position of the camera 960 .

In Figure 905, the processor 510 may determine the position of the second light emitting element 940b based on the measured brightness change. The processor 510 may calculate a distance between the first light emitting device 940a and the second light emitting device 940b based on the positions of the first light emitting device 940a and the second light emitting device 940b.

In Figure 907, the processor 510 confirms that the second light emitting element 940b is located at a point on the display corresponding to the position of the camera 960 (eg, the display 530 of FIG. 5), and displays 530. ) may be moved by a first distance in the first direction. In this case, the first direction may mean a direction opposite to the direction in which the first light emitting device 940a and the second light emitting device 940b move. The first distance may mean half of the distance between the first light emitting element 940a and the second light emitting element 940b.

According to an embodiment, the processor 510 measures the brightness of light generated using the camera 960, and based on the measured brightness of the light, the second light emitting element 940b is positioned at the center of the camera 960. It is determined whether or not the second light emitting element 940b is located at the center of the camera 960, and the display 530 is moved by a first distance so that the distance between the center of the camera 960 and the transmission area 935 is determined. The center can be controlled to correspond. In this case, the first distance may mean half of the distance between the first light emitting element 940a and the second light emitting element 940b.

According to an embodiment, in a matching operation for controlling the center of the camera 960 to correspond to the center of the transmission area 935, the processor 510 stores the distance of the display 530 moved for matching in a memory (eg: It can be stored on the memory 520 of FIG. 5 . In the operation of hiding the transparent region 935, the processor 510 may move the display 530 by the stored distance so that the transparent region 935 is not exposed within the bezel. Conversely, in the operation of exposing the transparent region 935 , the processor 510 may move the display 530 by a stored distance to expose the transparent region 935 outside the bezel. The processor 510 may reversely control the moving direction of the display 530 in an operation of hiding the transparent area 935 and an operation of exposing the transparent area 935 .

10A and 10B illustrate a matching method using a magnetic member of an electronic device according to various embodiments.

According to FIG. 10A , an electronic device (eg, the electronic device 500 of FIG. 5 ) may include a camera 1060 , a hall sensor 1050 , and a plurality of magnetic members 1042 . According to an embodiment, the processor (eg, the processor 510 of FIG. 5 ) measures the strength of the magnetic field generated from the magnetic member 1042 using the Hall sensor 1050, and based on the measured strength of the magnetic field It is determined whether the magnetic member 1042 is located within a certain distance from the center of the Hall sensor 1050, and it is confirmed that the magnetic member 1042 is located within a certain distance from the center of the Hall sensor 1050, and the center of the camera 1060 is determined. It may be determined whether the center of the transmissive region 1035 corresponds to .

According to an embodiment, the processor 510 measures the strength of the magnetic field using the Hall sensor 1050 and passes through the Hall sensor 1050 among the plurality of magnetic members 1042 based on the measured strength of the magnetic field. Calculate the number of one magnetic member 1042, calculate the moving distance of the flexible display (eg, the flexible display 630 of FIG. 6) based on the number of magnetic members 1042 that have passed, and The position of the transmissive area 1035 may be calculated based on the moving distance of , and the flexible display 630 may be moved so that the center of the camera 1060 and the center of the transmissive area 1035 correspond.

In Figure 1001, a plurality of magnetic members 1042 may be positioned between a plurality of multi-bars (eg, multi-bars 620 of FIG. 6). The first roller (eg, the first roller 611 of FIG. 6 ) may be coupled to the plurality of multi-bars 620 using grooves. The plurality of multi-bars 620 may be moved in response to the rotational movement of the first roller 611 .

In Figure 1003, the Hall sensor 1050 may measure a change in the magnetic field and transmit it to the processor 510. The processor 510 may detect that the magnetic member 1042 passes through a point on the flexible display 630 corresponding to the position of the hall sensor 1050 based on the change in the magnetic field. The processor 510 may calculate the position of the transmission region 1035 using the number of magnetic members 1042 among the plurality of magnetic members 1042 that have passed through the Hall sensor 1050 and the length between magnetic field pulses. For example, the processor 510 may use the Hall sensor 1050 to measure the number of magnetic members 1042 passing through a point on the flexible display 630 corresponding to the Hall sensor 1050 . The hall sensor 1050 may determine whether the magnetic member 1042 passes based on a change in a magnetic field pulse generated when the magnetic member 1042 passes. Also, when a plurality of magnetic field pulse changes occur, the Hall sensor 1050 may measure the number of magnetic members 1042 that have passed based on the number of magnetic field pulse changes. The processor 510 may calculate the position of the transmission region 1035 by multiplying the distance between the plurality of adjacent magnetic members 1042 based on the measured number of magnetic members 1042 and adding the first distance. Here, the first distance may mean a distance between the transmission region 1035 and an adjacent magnetic member 1042 . The processor 510 may control the center of the camera 1060 to correspond to the center of the transmission area 1035 based on the calculated position of the transmission area 1035 .

10B, an electronic device (eg, the electronic device 500 of FIG. 5) may include a camera 1060, a hall sensor 1050, a first magnetic member 1042a, and a second magnetic member 1042b. there is. In Figure 1005, the first magnetic member 1042a and the second magnetic member 1042b may be positioned between a plurality of multi-bars (eg, the multi-bar 620 of FIG. 6). The first roller (eg, the first roller 611 of FIG. 6 ) may be coupled to the plurality of multi-bars 620 using grooves. The plurality of multi-bars 620 may be moved in response to the rotational movement of the first roller 611 .

In Figure 1007, the hall sensor 1050 can detect a change in the magnetic field according to the approach of the first magnetic member 1042a. The Hall sensor 1050 may transmit change information of the magnetic field to the processor 510 . In Figure 1009, the processor 510 may detect a change in the magnetic field using the Hall sensor 1050 and determine the position of the first magnetic member 1042a based on the change in the magnetic field. The processor 510 may detect that the first magnetic member 1042a passes through a point on the flexible display 630 corresponding to the hall sensor 1050 based on the position of the first magnetic member 1042a.

According to an embodiment, the processor 510 detects that the first magnetic member 1042a passes through a point on the flexible display 630 corresponding to the Hall sensor 1050, and stops the flexible display 630. Control is performed so that the transmission area 1035 on the camera 1060 and the flexible display 630 are matched. A matching operation between the transmission area 1035 and the camera 1060 may refer to an operation for matching the center of the transmission area 1035 and the camera 1060 . The processor 510 matches the center of the transmission area 1035 and the center of the camera 1060, and then performs detailed matching between the center of the transmission area 1035 and the center of the camera 1060 using an image-based matching method. You can control it to happen. The image-based registration method will be described with reference to FIG. 12 .

11 illustrates a matching method using rotational resistance of an electronic device according to various embodiments.

Referring to FIG. 11 , an electronic device (eg, the electronic device 500 of FIG. 5 ) includes a camera 1160, a rotational resistance sensor 1150, a first roller 1111, a second roller 1112, and a flexible display 1130. ) and a plurality of multi-bars 1120.

A processor (eg, the processor 510 of FIG. 5 ) may measure a rotation angle of a resistor mounted on the first roller 1111 and/or the second roller 1112 using the rotation resistance sensor 1150 . The processor 510 may calculate the moving distance of the flexible display 1130 using the radii of the first roller 1111 and/or the second roller 1112 based on the measured rotation angle.

The processor 510 may obtain the moving distance L of the flexible display 1130 by multiplying the measured rotation angle a by the radius r of the first roller 1111 and/or the second roller 1112. . Also, the processor 510 may calculate the moving distance of the flexible display 1130 in units of a measurable minimum rotation angle (a min) using the rotation resistance sensor 1150 . For example, when the radius (r) of the first roller 1111 and/or the second roller 1112 is 3 mm and the minimum rotation angle (a min) is 1°, the processor 510 operates at an interval of about 0.052 mm. The moving distance of the flexible display 1130 can be calculated as The calculation process is as follows. (3mm * 1°* 2π/360 = 0.052mm )

According to an embodiment, the processor 510 measures a rotational angle of the resistance using a sensor module (eg, the sensor 550 of FIG. 5 ), and determines the rotation angle of the flexible display 1130 based on the measured rotational angle of the resistance. The movement distance may be calculated, and the flexible display 1130 may be moved by a predetermined distance based on the calculated movement distance of the flexible display 1130 so that the center of the camera 1160 and the center of the transmission area 1135 correspond to each other. there is.

12 illustrates a detailed matching method using a camera of an electronic device according to various embodiments.

According to an embodiment, a processor (eg, the processor 510 of FIG. 5 ) moves a flexible display (eg, the flexible display 630 of FIG. 6 ) using a sensor module (eg, the sensor 550 of FIG. 5 ). The change amount is determined, and based on the movement change amount of the flexible display 630, the center of the camera 1260 and the center of the transmission area (eg, the transmission area 635 of FIG. 6) are controlled to correspond, and the camera 1260 An image is captured using the image, it is determined whether the center of the camera 1260 and the center of the transmission region 635 correspond to each other based on the guideline on the captured image, and the center of the camera 1260 and the transmission region 635 are determined. ), the flexible display 630 may be moved so that the center of the camera 1260 and the center of the transmission area 635 correspond to each other based on the shape of the guideline on the captured image.

According to an embodiment, when the shape of the guideline on the captured image is convex in the first direction 1215, the processor 510 controls the flexible display 630 to move in the first direction 1215, capture When the shape of the guideline on the image is convex in the second direction 1225, the flexible display 630 may be controlled to move in the second direction 1225.

The processor 510 may measure the extended length or the reduced length of the flexible display 630 using the sensor 550 or the camera 1260 . The processor 510 may determine whether the transparent area 635 approaches the camera 1260 based on the measured length of the flexible display 630 . The processor 510 may position the center of the transparent area 635 to correspond to the center of the camera 1260 using the processes of FIGS. 8A to 11 . Thereafter, the processor 510 may capture an image using the camera 1260 to check whether the center of the transparent area 635 corresponds to the center of the camera 1260 . The processor 510 may determine whether the center of the transparent region 635 is matched with the center of the camera 1260 based on the shape of the guide line on the captured image.

According to Figure 1201, the processor 510 may determine that the transmission area 635 and the camera 1260 are not matched based on the bias of the guide line in the image area captured by the camera 1260. .

When the transmission area 635 and the camera 1260 are matched through the matching operations of FIGS. 8A to 11 , the processor 510 may capture an image using the camera for detailed matching. The processor 510 may determine whether matching has been achieved between the transmission area 635 and the camera 1260 based on the shape of the guideline on the captured image. As shown in Figure 1201, the processor 510 confirms that the transmission area 635 and the camera 1260 are not matched based on the shape of the guideline, and moves the flexible display 630 based on the shape of the guideline. can

For example, when the guide line is upwardly convex as shown in FIG. 1210, the processor 510 moves the flexible display 630 in the first direction 1215 to control the transmission area 635 and the camera 1260 to match. there is. Conversely, when the guide line is convex downward as shown in FIG. 1260) can be controlled to match. At this time, the processor 510 uses a first roller (eg, the first roller 611 of FIG. 6 ) and/or a second roller (eg, the second roller 612 of FIG. 6 ) to move the flexible display 630 . )) can be used.

The processor 510 may calculate the distance between the guide line on the captured image and the end of the captured image. The processor 510 may calculate the moving distance of the flexible display 630 for matching based on the calculated guide line on the captured image and the distance to the end of the captured image. The processor 510 calculates a rotation angle for moving the flexible display 630 based on the calculated movement distance of the flexible display 630, and moves the first roller 611 and/or the second roller by the calculated rotation angle. A drive system including 612 may be rotated. An operation in which the processor 510 moves the flexible display 630 by using the rotation angle and the radius of the drive system has been previously described with reference to FIG. 11 .

The processor 510 may determine whether the transmission area 635 and the camera 1260 are matched based on the shape of the guide line on the captured image. For example, as shown in Figure 1203, when the guide line is not displayed because it is biased (1230) or when the guide line is not displayed because it is matched (1232), it can be determined that the transmission area 635 and the camera 1260 are matched. there is.

13A is a flowchart of a method for controlling a camera module of an electronic device according to various embodiments.

Operations described through FIG. 13A may be implemented based on instructions that may be stored in a computer recording medium or memory (eg, the memory 520 of FIG. 5). The illustrated method 1300 may be executed by the electronic device (eg, the electronic device 500 of FIG. 5 ) previously described with reference to FIGS. 1A to 12 , and technical features described above will be omitted below.

In operation 1305, the electronic device 500 determines the center of the camera (eg, the camera 560 of FIG. 5 ) and the transmission area (eg, the display 530 of FIG. 5 ) based on the movement change amount of the display (eg, the display 530 of FIG. 5 ). It can be controlled so that the center of the transmission area 635 of .

In operation 1310, the electronic device 500 confirms that the transmission area (eg, the transmission area 635 of FIG. 6 ) and the camera (eg, the camera 560 of FIG. 5 ) are in a corresponding state, and uses the camera. You can capture images. A processor (eg, the processor 510 of FIG. 5 ) determines that the center of the transparent area 635 is located in an area on the display (eg, the display 530 of FIG. 5 ) corresponding to the center of the camera 560. It may be determined that the center of the transmission area 835 corresponds to the center of the camera 860 .

In operation 1320, the processor 510 may determine whether the camera 560 and the transparent area 635 are in a matching state located within a specified distance. The matching state may mean a state in which the center of the transmission region 635 corresponds to the center of the camera 560 or a state in which the center of the transmission region 635 and the center of the camera 560 are located within a predetermined distance.

According to an embodiment, a processor (eg, the processor 510 of FIG. 5 ) moves a flexible display (eg, the flexible display 630 of FIG. 6 ) using a sensor module (eg, the sensor 550 of FIG. 5 ). Determining the amount of change, controlling the center of the camera 560 to correspond to the center of the transmission area 635 based on the amount of change in the movement of the flexible display 630, and capturing an image using the camera 560 , Based on the guideline on the captured image, it is determined whether the center of the camera 560 and the center of the transmission region 635 correspond, and if the center of the camera 560 and the center of the transmission region 635 do not correspond, Based on the shape of the guideline on the captured image, the flexible display 630 may be moved so that the center of the camera 560 and the center of the transmission area 635 correspond.

The processor 510 may confirm that the camera 560 and the transmission area 635 are not matched and may check the shape of the guide line on the image captured in operation 1330 . The processor 510 may move the flexible display 630 so that the center of the camera 560 and the center of the transmission area 635 correspond to each other based on the shape of the guideline. This has been described above with reference to FIG. 12 .

For example, when the guide line is convex upward as shown in FIG. 1210 of FIG. 12 , the processor 510 moves the flexible display 630 in the first direction 1215 so that the transparent area 635 and the camera 560 are aligned. You can control it. Conversely, when the guide line is convex downward as shown in FIG. (560) can be controlled to match. At this time, the processor 510 uses a first roller (eg, the first roller 611 of FIG. 6 ) and/or a second roller (eg, the second roller 612 of FIG. 6 ) to move the flexible display 630 . )) can be used.

According to an embodiment, the processor 510 may calculate a distance between a guide line on the captured image and an end of the captured image. The processor 510 may calculate the moving distance of the flexible display 630 for matching based on the calculated guide line on the captured image and the distance to the end of the captured image. The processor 510 calculates a rotation angle for moving the flexible display 630 based on the calculated movement distance of the flexible display 630, and moves the first roller 611 and/or the second roller by the calculated rotation angle. A drive system including 612 may be rotated. An operation in which the processor 510 moves the flexible display 630 by using the rotation angle and the radius of the drive system has been previously described with reference to FIG. 11 .

In operation 1325, the processor 510 may move the flexible display based on the shape of the guide line on the image captured using the camera. Thereafter, in operation 1320, the processor 510 may determine whether the center of the camera 560 and the center of the transparent region 635 are in a matching state located within a specified distance. The processor 510 controls to end the control operation of the camera 560 when the center of the camera 560 and the center of the transmission area 635 are located within a specified distance, and the center of the camera 560 and the transmission area 635 ) may be controlled to repeat operation 1325 when the center is not located within a specified distance.

13B is a flowchart of a method for controlling a camera module of an electronic device according to various embodiments.

Operations described through FIG. 13B may be implemented based on instructions that may be stored in a computer recording medium or memory (eg, the memory 520 of FIG. 5). The illustrated method 1300 may be executed by the electronic device (eg, the electronic device 500 of FIG. 5 ) previously described with reference to FIGS. 1A to 12 , and technical features described above will be omitted below.

In operation 1305, the electronic device 500 determines the center of the camera (eg, the camera 560 of FIG. 5 ) and the transmission area (eg, the display 530 of FIG. 5 ) based on the movement change amount of the display (eg, the display 530 of FIG. 5 ). It can be controlled so that the center of the transmission area 635 of .

In operation 1310, the electronic device 500 confirms that the transmission area (eg, the transmission area 635 of FIG. 6 ) and the camera (eg, the camera 560 of FIG. 5 ) are in a corresponding state, and uses the camera. You can capture images. A processor (eg, the processor 510 of FIG. 5 ) determines that the center of the transparent area 635 is located in an area on the display (eg, the display 530 of FIG. 5 ) corresponding to the center of the camera 560. It may be determined that the center of the transmission area 835 corresponds to the center of the camera 860 .

In operation 1320, the processor 510 may determine whether the camera 560 and the transparent area 635 are in a matching state located within a specified distance. The matching state may mean a state in which the center of the transmission region 635 corresponds to the center of the camera 560 or a state in which the center of the transmission region 635 and the center of the camera 560 are located within a predetermined distance.

According to an embodiment, a processor (eg, the processor 510 of FIG. 5 ) moves a flexible display (eg, the flexible display 630 of FIG. 6 ) using a sensor module (eg, the sensor 550 of FIG. 5 ). Determining the amount of change, controlling the center of the camera 560 to correspond to the center of the transmission area 635 based on the amount of change in the movement of the flexible display 630, and capturing an image using the camera 560 , Based on the guideline on the captured image, it is determined whether the center of the camera 560 and the center of the transmission region 635 correspond, and if the center of the camera 560 and the center of the transmission region 635 do not correspond, Based on the shape of the guideline on the captured image, the flexible display 630 may be moved so that the center of the camera 560 and the center of the transmission area 635 correspond.

The processor 510 may confirm that the camera 560 and the transmission area 635 are not matched and may check the shape of the guide line on the image captured in operation 1330 . The processor 510 may move the flexible display 630 so that the center of the camera 560 and the center of the transmission area 635 correspond to each other based on the shape of the guideline. This has been described above with reference to FIG. 12 .

For example, when the guide line is convex upward as shown in FIG. 1210 of FIG. 12 , the processor 510 moves the flexible display 630 in the first direction 1215 so that the transparent area 635 and the camera 560 are aligned. You can control it. Conversely, when the guide line is convex downward as shown in FIG. (560) can be controlled to match. At this time, the processor 510 uses a first roller (eg, the first roller 611 of FIG. 6 ) and/or a second roller (eg, the second roller 612 of FIG. 6 ) to move the flexible display 630 . )) can be used.

According to an embodiment, the processor 510 may calculate a distance between a guide line on the captured image and an end of the captured image. The processor 510 may calculate the moving distance of the flexible display 630 for matching based on the calculated guide line on the captured image and the distance to the end of the captured image. The processor 510 calculates a rotation angle for moving the flexible display 630 based on the calculated movement distance of the flexible display 630, and moves the first roller 611 and/or the second roller by the calculated rotation angle. A drive system including 612 may be rotated. An operation in which the processor 510 moves the flexible display 630 by using the rotation angle and the radius of the drive system has been previously described with reference to FIG. 11 .

In operation 1330, the processor 510 moves the flexible display 630 in the first direction 1215 in operation 1335 when the guide line is convex in the first direction (eg, the first direction 1215 of FIG. 12). , so that the transmission area 635 and the camera 560 are matched.

In operation 1330, if the guide line is convex in a direction opposite to the first direction 1215 (eg, the second direction 1225 of FIG. 12) instead of the first direction 1215, in operation 1340, the flexible The display 630 may be moved in a direction 1225 opposite to the first direction so that the transmission area 635 and the camera 560 are matched.

Thereafter, the processor 510 may capture an image using the camera 560 again in operation 1310, and check whether the transmission region 635 and the camera 560 are matched based on a guideline on the captured image.

14 is a diagram illustrating effects of a method for controlling an electronic device and a camera module according to various embodiments.

As shown in Figure 1401, the electronic device according to the comparative embodiment may form a larger transmission area than the camera to match the transmission area to the camera. In this case, the user can see a relatively large hole (or transmission area). In addition, content including at least one of images and videos may be covered on the display by the size of the hole (or transmission area), causing inconvenience to the user.

Unlike Figure 1401, like Figure 1403, the electronic device may contain a relatively small transmission area. In this case, the user can see a relatively small hole (or transmission area). Also, since the content may be less obscured when content including at least one of an image or a video is reproduced, the electronic device of Figure 1403 may reduce inconvenience experienced by the user. However, in the case of Figure 1403, due to the size of the relatively small hole (or transmission area), the electronic device may have a relatively large tolerance probability. Tolerance may mean a small error in the range in which an electronic device can operate, and due to this tolerance, the transmission area of the camera and display may not be properly matched.

An electronic device including a flexible display and a method for controlling a camera module thereof according to the present document can reduce a tolerance by using tolerance correction while having a small hole (or transmission area). In addition, the electronic device according to the present document may have a small hole (or a transmission area) to enhance design aesthetics and provide an improved user experience.

An electronic device according to various embodiments includes a camera, a sensor module, a flexible display including a first end and a second end spaced apart from the first end, a first roller winding around the first end, and a second roller winding around the second end. , a sensor module, and a processor operatively connected to the flexible display. The first end includes a transmissive area through which external light is transmitted, and the processor determines an amount of change in movement of the flexible display using a sensor module, and based on the amount of change in movement of the flexible display, the center of the camera and the center of the transmissive area are located within a specified distance Control to do so, capture an image using a camera, determine whether the center of the camera and the center of the transmission area are located within a specified distance based on the guideline on the captured image, and determine whether the center of the camera and the center of the transmission area In response to confirming that the center of the camera is not located within the specified distance, the flexible display may be moved so that the center of the camera and the center of the transmission area are located within the specified distance based on the shape of the guideline on the captured image.

According to one embodiment, when the shape of the guideline on the captured image is convex in the first direction, the processor controls the flexible display to move in a second direction opposite to the first direction, and the guideline on the captured image When the shape of is convex in the second direction, the flexible display may be controlled to move in the first direction.

According to one embodiment, the sensor module may include at least one of a photosensor, a magnetic force sensor, and a rotational resistance sensor.

According to an embodiment, the electronic device supports a flexible display, and includes a plurality of multi-bars having a groove corresponding to an outer surface shape of a first roller, and a first light emitting element and a second light emitting element positioned between the plurality of multi-bars. Further comprising, the first light emitting element is located at a point away from the center of the transmission area by a first distance, the processor measures the brightness of light generated using a camera, and the first light emitting element based on the measured brightness of light Determines whether is located within a certain distance from the center of the camera, confirms that the first light emitting element is located within a certain distance from the center of the camera, and moves the flexible display by the first distance so that the center of the camera and the center of the transmission area are constant It can be controlled to be located within the distance.

According to an embodiment, the electronic device supports a flexible display, and includes a plurality of multi-bars having a groove corresponding to an outer surface shape of a first roller, and a first light emitting element and a second light emitting element positioned between the plurality of multi-bars. The first light emitting element is located at a point away from the center of the transmissive area by a first distance in a first direction, and the second light emitting element is located at a point away from the center of the transmissive area by a first distance in a direction opposite to the first direction. Located in, the processor measures the brightness of light generated using the camera, detects the first light emitting element and the second light emitting element based on the measured brightness of the light, and the first light emitting element and the second light emitting element The distance between the first light emitting element and the second light emitting element is calculated using the detected time difference, and the distance between the first light emitting element and the second light emitting element is calculated based on the point where the second light emitting element is detected. By moving in a direction opposite to the first direction by half, the center of the camera and the center of the transmission area may be controlled to be located within a predetermined distance.

According to an embodiment, the processor checks that the brightness of the light measured using the camera exceeds a certain level, and either the first light emitting device or the second light emitting device displays an object on the flexible display corresponding to the position of the camera. It can be determined that it is located within a certain distance from the point.

According to an embodiment, the electronic device supports a flexible display, a plurality of multi-bars having a groove corresponding to the outer surface shape of the first roller, a magnetic member located between the plurality of multi-bars, and measuring a change in strength of a magnetic field. A hall sensor may be further included. In this case, the magnetic member may be positioned at a point away from the center of the transmission area by a first distance in a first direction, and the center of the Hall sensor may be positioned at a point apart from the center of the camera by a first distance in a first direction. The processor measures the strength of the magnetic field generated from the magnetic member using the Hall sensor, determines whether the magnetic member is located within a predetermined distance from the center of the Hall sensor based on the measured strength of the magnetic field, and determines whether the magnetic member is located at the center of the Hall sensor. It is possible to confirm that it is located within a certain distance from and determine whether the center of the camera and the center of the transmission area are located within a certain distance.

According to an embodiment, the electronic device supports a flexible display, a plurality of multi-bars having a groove corresponding to the outer surface shape of the first roller, a plurality of magnetic members located between the plurality of multi-bars, and a change in the strength of a magnetic field. It may further include a hall sensor for measuring . At this time, the plurality of magnetic members have a certain distance between adjacent magnetic members, the processor measures the strength of the magnetic field using the Hall sensor, and the magnetic field passing through the Hall sensor among the plurality of magnetic members is measured based on the measured strength of the magnetic field. The number of members is calculated, the moving distance of the flexible display is calculated based on the number of passed magnetic members, the position of the transmission area is calculated based on the moving distance of the flexible display, and the center of the camera and the center of the transmission area are calculated. The flexible display may be moved to be located within a certain distance.

According to an embodiment, the electronic device further includes a resistor mounted on the first roller, the processor measures a rotation angle of the resistor using a sensor module, and determines a moving distance of the flexible display based on the measured rotation angle of the resistor. , and moving the flexible display by a predetermined distance based on the calculated moving distance of the flexible display may be controlled so that the center of the camera and the center of the transmission area are located within a predetermined distance.

According to an embodiment, the processor controls the first end of the flexible display to be wound by a first roller in the first display mode so that the transparent area of the first end is not exposed to the outside, and controls the display of the flexible display in the second display mode. The first end may be wound by a first roller so that the transmission region of the first end may be exposed to the outside.

According to an embodiment, the electronic device may further include a memory, and the processor may store, in the memory, a moving distance and a moving direction of the flexible display so that the center of the camera and the center of the transparent area coincide.

According to an embodiment, the processor may determine that the center of the camera and the center of the transmission area are located within a predetermined distance when the guideline on the captured image is not visible or matched to the image without bias.

A method for controlling a camera module of an electronic device according to various embodiments determines an amount of change in movement of a flexible display using a sensor module, and controls the center of the camera and the center of a transmission area to be located within a predetermined distance based on the amount of change in movement of the flexible display An operation of capturing an image using a camera and determining whether the center of the camera and the center of the transmission area are located within a certain distance based on a guideline on the captured image, the center of the camera and the center of the transmission area In response to confirming that the location is not located within the predetermined distance, an operation of moving the flexible display so that the center of the camera and the center of the transmission area are located within a predetermined distance based on the shape of the guideline on the captured image.

According to an embodiment, an operation of capturing an image using a camera and determining whether the center of the camera and the center of the transmission area are located within a predetermined distance based on a guideline on the captured image is a guide on the captured image. When the shape of the line is convex in the first direction, the operation of controlling the flexible display to move in the second direction opposite to the first direction and the shape of the guide line on the captured image is convex in the second direction, the first An operation of controlling the flexible display to move in the direction may be further included.

According to an embodiment, a method for controlling a camera module of an electronic device includes an operation of measuring brightness of light generated using a camera, and determining whether a first light emitting element is located within a predetermined distance from the center of the camera based on the measured brightness of light. The operation of determining and confirming that the first light emitting device is located within a predetermined distance from the center of the camera, and moving the flexible display by the first distance to control the center of the camera and the center of the transmission area to be located within a predetermined distance are further performed. can include

According to an embodiment, a method for controlling a camera module of an electronic device includes an operation of measuring brightness of light generated using a camera, detecting a first light emitting element and a second light emitting element based on the measured brightness of light, and a second light emitting element. Operation of calculating the distance between the first light emitting element and the second light emitting element using the time difference between the detection of the first light emitting element and the second light emitting element, and the first light emission of the flexible display based on the point where the second light emitting element is detected An operation of controlling the center of the camera and the center of the transmission area to be located within a predetermined distance by moving the device in a direction opposite to the first direction by half the distance between the device and the second light emitting device may be further included.

According to an embodiment, a method for controlling a camera module of an electronic device includes an operation of measuring the strength of a magnetic field generated from a magnetic member using a Hall sensor, and moving the magnetic member at a predetermined distance from the center of the Hall sensor based on the measured strength of the magnetic field. The method may further include an operation of determining whether the magnetic member is located within a predetermined distance and an operation of determining whether the center of the camera and the center of the transmission area are located within a predetermined distance after confirming that the magnetic member is located at the center of the hall sensor.

According to an embodiment, an operation of measuring a rotational angle of a resistor mounted on a first roller using a sensor module, an operation of calculating a movement distance of a flexible display based on the measured rotational angle of the resistance, and an operation of the calculated flexible display An operation of moving the flexible display by a predetermined distance based on the movement distance to control the center of the camera and the center of the transmission area within a predetermined distance may be further included.

According to an embodiment, the method for controlling a camera module of an electronic device includes an operation of determining that the center of a camera and the center of a transmission area are located within a predetermined distance when a guideline on a captured image is not visible or is matched to the image without bias. may further include.

The embodiments of this document disclosed in this specification and drawings are only presented as specific examples to easily explain the technical contents according to the embodiments of this document and help understanding of the embodiments of this document, and limit the scope of the embodiments of this document. It's not what I want to do. Therefore, the scope of various embodiments of this document should be construed as including all changes or variations derived from the technical ideas of various embodiments of this document in addition to the embodiments disclosed herein.

Claims (20)

In electronic devices,
camera;
sensor module;
a flexible display including a first end and a second end spaced apart from the first end;
a first roller winding the first end;
a second roller winding the second end;
a processor operatively connected to the sensor module and the flexible display;
The first end portion includes a transmissive area through which external light is transmitted,
The processor
Determining an amount of change in movement of the flexible display using the sensor module, and controlling the center of the camera and the center of the transmission area to be positioned within a specified distance based on the amount of change in movement of the flexible display;
Capturing an image using the camera, and determining whether the center of the camera and the center of the transmission area are located within a specified distance based on a guideline on the captured image;
In response to confirming that the center of the camera and the center of the transmission area are not located within a specified distance, the center of the camera and the center of the transmission area are located within a specified distance based on the shape of the guideline on the captured image. An electronic device that moves the flexible display to
According to claim 1,
The processor
When the shape of the guideline on the captured image is convex in a first direction, controlling the flexible display to move in a second direction opposite to the first direction;
The electronic device controlling the flexible display to move in the first direction when the shape of the guideline on the captured image is convex in the second direction.
According to claim 1,
The sensor module
An electronic device including at least one of a photosensor, a magnetic force sensor, and a rotational resistance sensor.
According to claim 1,
The electronic device
A plurality of multi-bars supporting the flexible display and having grooves corresponding to the outer surface of the first roller; and
Further comprising a first light emitting element and a second light emitting element located between the plurality of multi-bars,
The first light emitting element is located at a point away from the center of the transmission area by a first distance,
The processor
Measure the brightness of light generated using the camera,
Based on the measured brightness of light, it is determined whether the first light emitting element is located within a predetermined distance from the center of the camera;
Electronic control for determining that the first light-emitting element is located within a predetermined distance from the center of the camera and moving the flexible display by the first distance so that the center of the camera and the center of the transmission area are located within a predetermined distance Device.
According to claim 1,
The electronic device
A plurality of multi-bars supporting the flexible display and having grooves corresponding to the outer surface of the first roller; and
Further comprising a first light emitting element and a second light emitting element located between the plurality of multi-bars,
The first light emitting element is located at a point away from the center of the transmissive area by a first distance in a first direction, and the second light emitting element is positioned by the first distance from the center of the transmissive area in a direction opposite to the first direction. located at a remote location,
The processor
Measure the brightness of light generated using the camera,
The first light emitting element and the second light emitting element are detected based on the measured brightness of light, and the first light emitting element and the second light emitting element are detected using a time difference in which the first light emitting element and the second light emitting element are detected. Calculate the distance between the two light-emitting elements,
Based on the point where the second light emitting element is detected, the flexible display is moved in a direction opposite to the first direction by half of the distance between the first light emitting element and the second light emitting element, and the center of the camera and the transmission An electronic device that controls the center of an area to be located within a certain distance.
According to claims 4 and 5,
The processor
It is confirmed that the brightness of light measured using the camera exceeds a certain level, and either the first light emitting element or the second light emitting element is constant at a point on the flexible display corresponding to the position of the camera. An electronic device that determines to be within range.
According to claim 1,
The electronic device
A plurality of multi-bars supporting the flexible display and having grooves corresponding to the outer surface of the first roller; and
a magnetic member located between the plurality of multi-bars;
Further comprising a hall sensor for measuring a change in the strength of the magnetic field,
The magnetic member is located at a point away from the center of the transmission area by a first distance in a first direction, and the center of the hall sensor is located at a point apart from the center of the camera by the first distance in the first direction,
The processor
Measuring the strength of a magnetic field generated from the magnetic member using the Hall sensor;
Based on the strength of the measured magnetic field, it is determined whether the magnetic member is located within a predetermined distance from the center of the Hall sensor;
An electronic device that confirms that the magnetic member is located within a predetermined distance from the center of the hall sensor and determines whether the center of the camera and the center of the transmission area are located within a predetermined distance.
According to claim 1,
The electronic device
A plurality of multi-bars supporting the flexible display and having grooves corresponding to the outer surface of the first roller; and
a plurality of magnetic members located between the plurality of multi-bars;
Further comprising a hall sensor for measuring a change in the strength of the magnetic field,
The plurality of magnetic members have a regular interval between adjacent magnetic members,
The processor
Measure the strength of the magnetic field using the Hall sensor,
Calculate the number of magnetic members that have passed through the Hall sensor among the plurality of magnetic members based on the strength of the measured magnetic field, and calculate the moving distance of the flexible display based on the number of magnetic members that have passed through;
An electronic device that calculates a position of the transmissive area based on a moving distance of the flexible display and moves the flexible display such that a center of the camera and a center of the transmissive area are located within a predetermined distance.
According to claim 1,
The electronic device
Further comprising a resistor mounted on the first roller,
The processor
using the sensor module
Measuring the rotation angle of the resistor,
calculating a moving distance of the flexible display based on the measured rotational angle of the resistance;
An electronic device that moves the flexible display by a predetermined distance based on the calculated movement distance of the flexible display so that the center of the camera and the center of the transmission area are located within a predetermined distance.
According to claim 1,
The processor
In a first display mode, the first end of the flexible display is wound by the first roller so that the transmissive area of the first end is not exposed to the outside;
In the second display mode, the first end of the flexible display is wound by the first roller so that the transmissive area of the first end is exposed to the outside.
According to claim 10,
contains more memory;
The processor
An electronic device that stores, in the memory, a distance and a movement direction by which the flexible display is moved so that the center of the camera and the center of the transmission area coincide.
According to claim 11,
The processor
Based on a user input, an electronic device that controls the transmissive area of the first end so that it is not exposed to the outside by reversely using a moving distance and a moving direction of the flexible display stored in the memory when the first display mode is switched. .
According to claim 1,
The processor
The electronic device that determines that the center of the camera and the center of the transmission area are located within a predetermined distance when the guideline on the captured image is not visible or is matched to the image without bias.
camera;
sensor module;
a flexible display including a first end and a second end spaced apart from the first end;
a first roller winding the first end; and
In the method for controlling a camera module of an electronic device including a second roller winding the second end,
The first end portion includes a transmissive area through which external light is transmitted,
determining an amount of change in movement of the flexible display using the sensor module, and controlling a center of the camera and a center of the transmission area to be located within a predetermined distance based on the amount of change in movement of the flexible display;
capturing an image using the camera, and determining whether a center of the camera and a center of the transmission area are located within a predetermined distance based on a guideline on the captured image;
In response to confirming that the center of the camera and the center of the transmission area are not located within a predetermined distance, the center of the camera and the center of the transmission area are located within a predetermined distance based on the shape of the guideline on the captured image. and moving the flexible display to
According to claim 14,
An operation of capturing an image using the camera and determining whether the center of the camera and the center of the transmission area are located within a predetermined distance based on a guideline on the captured image
When the shape of the guideline on the captured image is convex in a first direction, controlling the flexible display to move in a second direction opposite to the first direction; and
and controlling the flexible display to move in the first direction when the shape of the guideline on the captured image is convex in the second direction.
According to claim 14,
The sensor module
At least one of a photo sensor, a magnetic force sensor, and a rotational resistance sensor;
The electronic device
A plurality of multi-bars supporting the flexible display and having grooves corresponding to the outer surface of the first roller; and
Further comprising a first light emitting element and a second light emitting element located between the plurality of multi-bars,
The first light emitting element is located at a point away from the center of the transmission area by a first distance,
A method for controlling a camera module of the electronic device
measuring brightness of light generated using the camera;
determining whether the first light emitting element is located within a predetermined distance from the center of the camera based on the measured brightness of light;
Checking that the first light-emitting element is located within a predetermined distance from the center of the camera, and moving the flexible display by the first distance to control the center of the camera and the center of the transmission area to be located within a predetermined distance How to include more.
According to claim 14,
The electronic device
A plurality of multi-bars supporting the flexible display and having grooves corresponding to the outer surface of the first roller; and
Further comprising a first light emitting element and a second light emitting element located between the plurality of multi-bars,
The first light emitting element is located at a point away from the center of the transmissive area by a first distance in a first direction, and the second light emitting element is positioned by the first distance from the center of the transmissive area in a direction opposite to the first direction. located at a remote location,
A method for controlling a camera module of the electronic device
measuring brightness of light generated using the camera;
The first light emitting element and the second light emitting element are detected based on the measured brightness of light, and the first light emitting element and the second light emitting element are detected using a time difference in which the first light emitting element and the second light emitting element are detected. An operation of calculating a distance between two light emitting elements; and
Based on the point where the second light emitting element is detected, the flexible display is moved in a direction opposite to the first direction by half of the distance between the first light emitting element and the second light emitting element, and the center of the camera and the transmission The method further comprising an operation of controlling the center of the region to be located within a predetermined distance.
According to claim 14,
The electronic device
A plurality of multi-bars supporting the flexible display and having grooves corresponding to the outer surface of the first roller; and
a magnetic member located between the plurality of multi-bars;
Further comprising a hall sensor for measuring a change in the strength of the magnetic field,
The magnetic member is located at a point away from the center of the transmission area by a first distance in a first direction, and the center of the hall sensor is located at a point apart from the center of the camera by the first distance in the first direction,
A method for controlling a camera module of the electronic device
measuring the intensity of a magnetic field generated from the magnetic member using the hall sensor;
An operation of determining whether the magnetic member is located within a predetermined distance from the center of the Hall sensor based on the measured strength of the magnetic field; and
and determining whether the magnetic member is located at the center of the Hall sensor and determining whether a center of the camera and a center of the transmission area are located within a predetermined distance.
According to claim 14,
measuring a rotational angle of a resistor mounted on the first roller using the sensor module;
calculating a moving distance of the flexible display based on the measured rotational angle of the resistance; and
and moving the flexible display by a predetermined distance based on the calculated moving distance of the flexible display so that a center of the camera and a center of the transmission area are positioned within a predetermined distance.
According to claim 14,
The method further comprising determining that the center of the camera and the center of the transmission area are located within a predetermined distance when the guideline on the captured image is not visible or is matched to the image without bias.

Images