KR20220040935A - The method for displaying preview image and the electronic device supporting the same - Google Patents

Abstract

Disclosed is an electronic device to provide a user with an intuitive application experience. According to the present invention, the electronic device comprises a camera supporting first, second, and third angles of view, a first housing, a second housing, a hinge structure, a flexible display, a processor, and a memory operatively connected to the processor. The memory stores and the like instruction to allow the electronic device to display a user interface (UI) including a plurality of buttons for changing drawing properties of an input in a first area on a flexible display; display a first image acquired by using the camera set to the first angle of view on a second area on a flexible display; overlay and display an image generated on the basis of the drawing input within a designated range of the second area on the first image displayed in the second area; and display a second image acquired by changing the angle of view of the camera to the second angle of view wider than the first angle of view in the second area when the drawing input is detected in at least a part of the second area except for the designated range. Various embodiments understood through the specification are possible.

Description

A method for displaying a preview image and an electronic device supporting it

Various embodiments disclosed in this document relate to a method of displaying a preview image and an electronic device supporting the same.

Recently, digital drawing applications that provide various functions are being used. For example, the digital drawing application may provide a drawing environment based on a stylus pen and a user's touch input. The digital drawing application may provide a user interface for changing the properties of the tool corresponding to the input.

As the shape of the electronic device is diversified, a preview image provided by a digital drawing application may be acquired in various ways. For example, in a foldable type electronic device, the preview image may be acquired by changing the folding angle of the electronic device.

The electronic device may detect a specified touch input (eg, a pen touch input) and perform a preview image providing function of overlaying and displaying an image on a screen displayed on the display in response to the detected input.

The electronic device may not be able to display a preview image that matches the user's intention due to the limitation of the frame. For example, when a user captures an external environment while holding the electronic device in his hand, it may be difficult to photograph various angles of view.

While the digital drawing application is being executed, the user may be provided with a drawing function while the electronic device is fixed. In order to be provided with a preview image taken from an angle other than the provided preview image, the user had to change the fixed state of the electronic device.

An electronic device according to an embodiment disclosed herein includes a camera supporting a first angle of view, a second angle of view, and a third angle of view, a first housing, a second housing, and a space between the first housing and the second housing. a hinge structure disposed thereon, a flexible display, a processor, and a memory operatively coupled to the processor. When the electronic device is executed, the processor displays a user interface (UI) including a plurality of buttons for changing a drawing property of an input in a first area on the flexible display, and displays a user interface (UI) in a second area on the flexible display A first image acquired using the camera set to the first angle of view is displayed, and an image generated based on a drawing input within a specified range of the second area is displayed on the first image displayed in the second area. The second angle of view obtained by changing the angle of view of the camera to the second angle of view wider than the first angle of view when the drawing input is detected in at least a part of the second area except for the specified range 2 One or more instructions for displaying an image in the second area may be stored.

A method for a foldable electronic device to display a preview image according to an embodiment disclosed in this document includes a UI including a plurality of buttons for changing a drawing property of an input in a first area on a flexible display user interface), displaying a first image acquired using a camera set to a first angle of view in a second area on the flexible display and generating based on a drawing input within a specified range of the second area an operation of overlaying and displaying an image displayed in the second area on the first image displayed in the second area, and when the drawing input is sensed in at least a portion of the second area except for the specified range, the angle of view of the camera and displaying a second image obtained by changing to a second angle of view wider than the first angle of view on the second area.

According to various embodiments disclosed in this document, the electronic device may provide an intuitive application use experience to the user by changing the angle of view of the camera, the photographing angle, and/or the shape of the electronic device based on the drawing input.

According to various embodiments disclosed in this document, the electronic device may provide convenience to the user through a preview image obtained based on intuitively changing conditions.

In addition, various effects directly or indirectly identified through this document may be provided.

1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure;
2 is a block diagram illustrating a camera module according to various embodiments of the present disclosure;
3 is a block diagram of a display module according to various embodiments of the present disclosure;
4 is a block diagram illustrating components of an electronic device according to various embodiments of the present disclosure;
5 illustrates an electronic device that provides a preview image, according to various embodiments of the present disclosure.
6 illustrates an electronic device for acquiring a preview image at various angles of view, according to various embodiments of the present disclosure.
7 illustrates an electronic device for acquiring a preview image at various angles of view, according to various embodiments of the present disclosure.
8 illustrates an electronic device for acquiring a preview image by rotating a camera, according to various embodiments of the present disclosure;
9 illustrates an electronic device for acquiring a preview image by rotating a camera, according to various embodiments of the present disclosure;
10 illustrates an electronic device acquiring a preview image by changing a folding angle, according to various embodiments of the present disclosure;
11 illustrates an electronic device for acquiring a preview image in various forms, according to various embodiments of the present disclosure.
12 illustrates an electronic device for acquiring a preview image in various forms, according to various embodiments of the present disclosure.
13 illustrates an electronic device displaying various types of drawing images on a display, according to various embodiments of the present disclosure;
14 is a flowchart illustrating an operation of an electronic device according to various embodiments of the present disclosure;
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

Hereinafter, various embodiments of the present document will be described with reference to the accompanying drawings. However, this is not intended to limit the technology described in this document to specific embodiments, and it should be understood that various modifications, equivalents, and/or alternatives of the embodiments of this document are included. .

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments. Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included. In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 may use less power than the main processor 121 or may be set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the co-processor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). there is. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 , or an external electronic device (eg, a sound output module 155 ) connected directly or wirelessly with the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to various embodiments of the present document, one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101) may be implemented as software (eg, the program 140) including For example, a processor (eg, processor 120 ) of a device (eg, electronic device 101 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store™) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly between smartphones (eg: smartphones) and online. In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

2 is a block diagram 200 illustrating a camera module 180, in accordance with various embodiments. Referring to FIG. 2 , the camera module 180 includes a lens assembly 210 , a flash 220 , an image sensor 230 , an image stabilizer 240 , a memory 250 (eg, a buffer memory), or an image signal processor. (260). The lens assembly 210 may collect light emitted from a subject, which is an image to be captured. The lens assembly 210 may include one or more lenses. According to an embodiment, the camera module 180 may include a plurality of lens assemblies 210 . In this case, the camera module 180 may form, for example, a dual camera, a 360 degree camera, or a spherical camera. Some of the plurality of lens assemblies 210 may have the same lens properties (eg, angle of view, focal length, auto focus, f number, or optical zoom), or at least one lens assembly may be a different lens assembly. It may have one or more lens properties different from the lens properties of . The lens assembly 210 may include, for example, a wide-angle lens or a telephoto lens.

The flash 220 may emit light used to enhance light emitted or reflected from the subject. According to an embodiment, the flash 220 may include one or more light emitting diodes (eg, a red-green-blue (RGB) LED, a white LED, an infrared LED, or an ultraviolet LED), or a xenon lamp. The image sensor 230 may acquire an image corresponding to the subject by converting light emitted or reflected from the subject and transmitted through the lens assembly 210 into an electrical signal. According to one embodiment, the image sensor 230 is, for example, one image sensor selected from among image sensors having different properties, such as an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor, the same It may include a plurality of image sensors having properties, or a plurality of image sensors having different properties. Each image sensor included in the image sensor 230 may be implemented using, for example, a charged coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.

In response to the movement of the camera module 180 or the electronic device 101 including the same, the image stabilizer 240 moves at least one lens or the image sensor 230 included in the lens assembly 210 in a specific direction or Operation characteristics of the image sensor 230 may be controlled (eg, read-out timing may be adjusted, etc.). This makes it possible to compensate for at least some of the negative effects of the movement on the image being taken. According to an embodiment, the image stabilizer 240 is, according to an embodiment, the image stabilizer 240 is a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module 180 . can be used to detect such a movement of the camera module 180 or the electronic device 101 . According to an embodiment, the image stabilizer 240 may be implemented as, for example, an optical image stabilizer. The memory 250 may temporarily store at least a portion of the image acquired through the image sensor 230 for the next image processing operation. For example, when image acquisition is delayed according to the shutter or a plurality of images are acquired at high speed, the acquired original image (eg, Bayer-patterned image or high-resolution image) is stored in the memory 250 and , a copy image corresponding thereto (eg, a low-resolution image) may be previewed through the display device 160 . Thereafter, when a specified condition is satisfied (eg, a user input or a system command), at least a portion of the original image stored in the memory 250 may be obtained and processed by, for example, the image signal processor 260 . According to an embodiment, the memory 250 may be configured as at least a part of the memory 130 or as a separate memory operated independently of the memory 130 .

The image signal processor 260 may perform one or more image processing on an image acquired through the image sensor 230 or an image stored in the memory 250 . The one or more image processes may include, for example, depth map generation, 3D modeling, panorama generation, feature point extraction, image synthesis, or image compensation (eg, noise reduction, resolution adjustment, brightness adjustment, blurring ( blurring, sharpening, or softening. Additionally or alternatively, the image signal processor 260 may include at least one of the components included in the camera module 180 (eg, an image sensor). 230), for example, exposure time control, readout timing control, etc. The image processed by the image signal processor 260 is stored back in the memory 250 for further processing. or may be provided as an external component of the camera module 180 (eg, the memory 130 , the display device 160 , the electronic device 102 , the electronic device 104 , or the server 108 ). According to an example, the image signal processor 260 may be configured as at least a part of the processor 120 or as a separate processor operated independently of the processor 120. The image signal processor 260 may be configured as the processor 120 and a separate processor, the at least one image processed by the image signal processor 260 may be displayed through the display device 160 as it is by the processor 120 or after additional image processing.

According to an embodiment, the electronic device 101 may include a plurality of camera modules 180 each having different properties or functions. In this case, for example, at least one of the plurality of camera modules 180 may be a wide-angle camera, and at least the other may be a telephoto camera. Similarly, at least one of the plurality of camera modules 180 may be a front camera, and at least the other may be a rear camera.

3 is a block diagram 300 of a display module 160, according to various embodiments. Referring to FIG. 3 , the display module 160 may include a display 310 and a display driver IC (DDI) 330 for controlling the display 310 . The DDI 330 may include an interface module 331 , a memory 333 (eg, a buffer memory), an image processing module 335 , or a mapping module 337 . The DDI 330 receives, for example, image data or image information including an image control signal corresponding to a command for controlling the image data from other components of the electronic device 101 through the interface module 331 . can do. For example, according to one embodiment, the image information is the processor 120 (eg, the main processor 121 (eg, an application processor) or the auxiliary processor 123 (eg, an application processor) operated independently of the function of the main processor 121 ( For example: graphic processing device) The DDI 330 may communicate with the touch circuit 350 or the sensor module 176 through the interface module 331. Also, the DDI 330 may be At least a portion of the received image information may be stored in the memory 333, for example, in units of frames, for example, the image processing module 335 may store at least a portion of the image data, Pre-processing or post-processing (eg, resolution, brightness, or size adjustment) may be performed based at least on the characteristics of the display 310. The mapping module 337 may be pre-processed or post-processed through the image processing module 135. A voltage value or a current value corresponding to the image data may be generated. According to an exemplary embodiment, the generation of the voltage value or the current value may include, for example, a property of pixels of the display 310 (eg, an arrangement of pixels ( RGB stripe or pentile structure), or the size of each sub-pixel) At least some pixels of the display 310 are, for example, based at least in part on the voltage value or the current value. By being driven, visual information (eg, text, image, or icon) corresponding to the image data may be displayed through the display 310 .

According to an embodiment, the display module 160 may further include a touch circuit 350 . The touch circuit 350 may include a touch sensor 351 and a touch sensor IC 353 for controlling the touch sensor 351 . The touch sensor IC 353 may control the touch sensor 351 to sense, for example, a touch input or a hovering input for a specific location of the display 310 . For example, the touch sensor IC 353 may detect a touch input or a hovering input by measuring a change in a signal (eg, voltage, light amount, resistance, or electric charge amount) for a specific position of the display 310 . The touch sensor IC 353 may provide information (eg, location, area, pressure, or time) regarding the sensed touch input or hovering input to the processor 120 . According to an embodiment, at least a part of the touch circuit 350 (eg, the touch sensor IC 353 ) is disposed as a part of the display driver IC 330 , or the display 310 , or outside the display module 160 . may be included as a part of another component (eg, the coprocessor 123).

According to an embodiment, the display module 160 may further include at least one sensor (eg, a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor) of the sensor module 176 , or a control circuit therefor. In this case, the at least one sensor or a control circuit therefor may be embedded in a part of the display module 160 (eg, the display 310 or the DDI 330 ) or a part of the touch circuit 350 . For example, when the sensor module 176 embedded in the display module 160 includes a biometric sensor (eg, a fingerprint sensor), the biometric sensor provides biometric information related to a touch input through a partial area of the display 310 . (eg fingerprint image) can be acquired. For another example, if the sensor module 176 embedded in the display module 160 includes a pressure sensor, the pressure sensor may acquire pressure information related to a touch input through a part or the entire area of the display 310 . can According to an embodiment, the touch sensor 351 or the sensor module 176 may be disposed between pixels of the pixel layer of the display 310 , or above or below the pixel layer.

4 is a block diagram 400 illustrating components of an electronic device 401 according to various embodiments of the present disclosure.

According to various embodiments of the present disclosure, the electronic device 401 (eg, the electronic device 101 of FIG. 1 ) includes a processor 420 (eg, the processor 120 of FIG. 1 ), a memory 430 (eg: Memory 130 of FIG. 1 ), display 460 (eg, display 160 of FIG. 1 ), camera 480 (eg, camera module 180 of FIG. 1 ), and communication circuitry 490 (eg, display 160 of FIG. 1 ) : The communication module 190 of FIG. 1) may be included. The components shown in FIG. 4 are exemplary, and the electronic device 401 may further include components not shown or may not include some of the components shown.

Processor 420 may be operatively coupled to memory 430 , display 460 , camera 480 , and/or communication circuitry 490 . The memory 430 may store one or more instructions that, when executed, cause the processor 420 to perform various operations of the electronic device 401 .

According to an embodiment, the display 460 may detect a drawing input. For example, display 460 may include pen input sensing circuitry (eg, pen input interface) and/or touch input sensing circuitry for detecting touch input (eg, pen input or touch input by a user). can For example, the processor 420 may be configured to hover from the external input device 402 when the external input device 402 (eg, a stylus pen, digital pen, or digitizer pen) is spaced apart within a specified distance from the display 460 . (hovering) input can be detected. For another example, when one end of the external input device 402 is in contact with an area of the display 460 , the processor 420 may perform a pen input (eg, pen touch input or pen contact) from the external input device 402 . input) can be detected.

The display 460 may include various types of displays. For example, the display may include a flexible display. The flexible display may refer to a display in which at least a part is flexible. The flexible display may be folded or unfolded based on a hinge structure included in the electronic device 401 . For example, the display 460 may display different screens in each area of the display that is physically and/or logically separated under the control of the processor 420 .

According to an embodiment, the camera 480 may photograph the external environment from various angles and/or directions. For example, the processor 420 may photograph the external environment using the camera 480 set to the first angle of view, the second angle of view wider than the first angle of view, or the third angle of view wider than the second angle of view. When an input received from the outside satisfies a specified condition, the processor 420 may flexibly change the angle of view of the camera 480 to photograph the external environment. For another example, the camera 480 may rotate about a designated axis to photograph the external environment in various photographing directions. When an input received from the outside satisfies a specified condition, the processor 420 may rotate the camera based on a specified axis to change the direction the camera faces to photograph the external environment.

According to an embodiment, the communication circuit 490 may be configured to support short-range wireless communication based on a Bluetooth protocol (eg, legacy Bluetooth and/or BLE) and/or a wireless LAN. For example, communication circuitry 490 may provide communication with a digital pen.

The electronic device 401 may further include components not shown in FIG. 4 . For example, the electronic device 401 may further include a housing. The housing may include a magnetic pad for attachment of the external input device 402 and/or a slot for insertion of the external input device 402 .

The external input device 402 may be referred to as a stylus pen, a digital pen, or a digitizer pen. For example, the external input device 402 may receive an electromagnetic field signal (eg, a proximity signal) generated from a digitizer (eg, a pen input interface) of the electronic device 401 . For example, the external input device 402 may receive an electromagnetic field signal using a resonance circuit. The external input device 402 may transmit an electromagnetic resonance (EMR) input signal to the electronic device 401 . As another example, the external input device 402 may use at least one of an active electrostatic (AES) method and an electrically coupled resonance (ECR) method. When the external input device 402 transmits a signal using the AES method, the external input device 402 may generate a signal using the electronic device 401 and capacitive coupling. When the external input device 402 transmits a signal by the ECR method, the external input device 402 is based on the electric field generated from the capacitive device of the electronic device 401, the resonance frequency It is possible to generate a signal comprising

According to an embodiment, the external input device 402 may include a communication circuit for communication with the electronic device 401 . For example, the external input device 402 may communicate with the electronic device 401 using short-range wireless communication (eg, at least one of Bluetooth, Bluetooth low energy (BLE), or wireless LAN). In one example, the external input device 402 may include at least one button. When an input for at least one button is received, the external input device 402 may transmit a signal corresponding to the button input to the electronic device 401 using a resonance circuit and/or a communication circuit.

5 illustrates an electronic device 501 that provides a preview image, according to various embodiments of the present disclosure.

According to various embodiments, the user may use the electronic device 501 by holding it in various shapes. Referring to reference numeral 500a, the user may use the electronic device 501 by holding the electronic device 501 in the form of a first type in which the electronic device 501 is folded from side to side. The electronic device 501 may display screens corresponding to various functions on a flexible display (eg, the display 460 of FIG. 4 ). Referring to reference numeral 500b , the user may use the electronic device 501 by holding the electronic device 501 in a second type form in which the electronic device 501 is folded up and down. The description of FIG. 5, which will be described later, may be a description commonly referred to with respect to components having the same reference number in reference number 500a and reference number 500b.

According to an embodiment, the electronic device 501 may display a user interface (UI) including a plurality of buttons for changing a drawing property of an input in the first area 560a of the flexible display. The UI displayed in the first area 560a causes the first UI 551 and the camera 580 to set the type and/or color of the image generated based on the drawing input to start and/or stop the shooting function. and a second UI 553 that Based on the input to the first UI 551 , the electronic device 501 may change the property of the image generated based on the drawing input. For example, the first UI 551 may include a corresponding icon for executing a pen type change or pen color change function based on a specified touch input. For example, the thickness and/or transparency of the pen input may be changed according to the change of the pen type. As another example, the color of the pen input may be changed according to the change of the pen color. The electronic device 501 may photograph the external environment through the camera 580 based on the input to the second UI 553 .

According to an embodiment, the electronic device 501 may display at least one image acquired using the camera 580 on the second area 560b of the flexible display. For example, in response to an input to the second UI 553 of the first area 560a , the electronic device 501 displays at least one image acquired using the camera 580 to the second area 560b. can be displayed in

According to an embodiment, the electronic device 501 may change the direction in which the camera 580 faces by rotating the camera 580 based on a specified axis. For example, if a designated input is detected while the camera 580 faces the first direction 521 while executing a photographing function, the electronic device 501 determines the direction in which the camera 580 faces is the direction in which the designated input is detected. It can be rotated to track to execute the shooting function.

6 illustrates an electronic device 601 that acquires a preview image at various angles of view, according to various embodiments of the present disclosure.

Referring to FIG. 6 , according to various embodiments, the electronic device 601 may acquire at least one image using a camera 680 (eg, the camera 480 of FIG. 4 ) supporting a plurality of angles of view. there is.

Referring to reference numeral 600a, the electronic device 601 may display a UI including a plurality of buttons for changing the drawing attribute of an input in the first area 660a of the flexible display. The electronic device 601 may display the first image 610 obtained using the camera 680 set to the first angle of view on the second area 660b of the flexible display. The electronic device 601 may identify a drawing input (eg, a touch input by a user and/or a pen touch input) sensed on the second area 660b of the flexible display. For example, the electronic device 601 may identify the position of the drawing input sensed on the flexible display by using a sensor module (eg, the sensor module 176 of FIG. 1 ). As another example, when a drawing input based on a touch of an external input device (eg, the external input device 402 of FIG. 4 ) is sensed, the electronic device 601 wirelessly communicates with the external input device (eg, Bluetooth). communication) to identify the location of the drawing input. For example, the electronic device 601 may identify whether a drawing input sensed on the second area 660b of the flexible display is detected within a specified range 650 . For example, when a drawing input is detected in at least a portion of the second area 660b except for the designated range 650 , the electronic device 601 may change the angle of view of the camera 680 . As another example, the electronic device 601 may include a plurality of cameras. When a drawing input is sensed in at least a portion of the second area 660b except for the designated range 650 , the electronic device 601 acquires at least one image by using a camera having a relatively wider angle of view among a plurality of cameras. can do. An operation in which the electronic device 601 acquires an image by changing the angle of view of the camera 680 may be referred to as reference numeral 600b. In FIG. 6 , a second area 660b in which a drawing input is sensed is illustrated as an area corresponding to a right half of the flexible display with respect to the illustrated electronic device 601 , but is not limited thereto. For example, the second area 660b may be an area corresponding to the entire area of the flexible display. In this case, the first region 660a may be at least one region included in the second region 660b.

Referring to reference numeral 600b, the electronic device 601 detects a drawing input in at least a portion of the flexible display (eg, at least a portion of the first area 660a or the second area 660b) except for the specified range 650 . In this case, the angle of view of the camera 680 may be changed to a second angle of view wider than the first angle of view. For example, the electronic device 601 may display the second image 620 obtained by using the camera 680 set to the second angle of view on the second area 660b.

Reference numerals 600a and 600b illustrate a first image 610 and a second image 620 obtained by a camera 680 set to the first angle of view and the second angle of view, respectively, but is not limited thereto. Referring to reference numeral 600c, according to an embodiment, the electronic device 601 may display the third image 630 acquired using the camera 680 set to the third angle of view on the second area 660b. there is. For example, when a drawing input is detected in at least a portion of the second region 660b displaying the second image 620 , except for the designated range 650 , the electronic device 601 adjusts the angle of view of the camera 680 . The third image 630 obtained by changing to a third angle of view wider than the second angle of view may be displayed on the second area 660b.

7 illustrates an electronic device 701 that acquires a preview image at various angles of view, according to various embodiments of the present disclosure.

Referring to FIG. 7 , the electronic device 701 may acquire at least one image using a camera set to various angles of view (eg, the camera 480 of FIG. 4 ). The electronic device 701 may display a drawing image generated based on drawing inputs 711 , 713 , and 715 within a specified range of the second area by overlaying it on an image displayed in the second area. . The electronic device 701 may identify whether a drawing input sensed in one area of the flexible display (eg, the display 460 of FIG. 4 ) is within a specified range (eg, the specified range 650 of FIG. 6 ). . For example, when a drawing input is detected in a second area other than a specified range (eg, the second area 660b of FIG. 6 ), the electronic device 601 changes the angle of view of the camera to a wider range gradually and obtains at least one may be displayed on the second area 660b.

With reference to reference number 710 , the electronic device 701 may acquire at least one image using a camera supporting the first angle of view 721 , the second angle of view 723 , and the third angle of view 725 . . For example, when it is identified that a user's touch input (not shown) or a drawing input sensed through the external input device 702 is detected in at least a part of the range except for a specified range, the electronic device 701 adjusts the camera's angle of view. The first angle of view 721 , the second angle of view 723 , and the third angle of view 725 may be changed and set in the order.

Referring to reference number 720, the electronic device 701 may display at least one image obtained by changing the angle of view based on the drawing inputs 711, 713, and 715 sensed in the second area on the second area. there is. For example, when the first drawing input 711 is sensed in the second area, the electronic device 701 sets the first image (eg, the first image in FIG. 6 ) obtained by using the camera set to the first angle of view 721 . 1 image 610) may be displayed in the second area. Since the first drawing input 711 is detected only within a specified range, the electronic device 701 can display the image generated based on the first drawing input 711 superimposed on the first image without changing the angle of view. there is. As another example, when the second drawing input 713 is detected in the second area, the electronic device 701 changes the angle of view of the camera to a second angle of view 723 that is wider than the first angle of view 721 and is obtained A second image (eg, the second image 620 of FIG. 6 ) may be displayed on the second area. Since the second drawing input 713 is sensed within the specified range and at least a portion of the range except for the specified range, the electronic device 701 changes the angle of view of the camera to a second angle of view 723 wider than the first angle of view 721. An image generated based on the second drawing input 713 may be overlapped and displayed on the second image. As another example, when a third drawing input 715 is sensed in the second area, the electronic device 701 changes the angle of view of the camera to a third angle of view 725 that is wider than the second angle of view 723 and obtains the 3 images (eg, the third image 630 of FIG. 6 ) may be displayed on the second area. Since the third drawing input 715 is sensed within the specified range and at least a portion of the range except for the specified range, the electronic device 701 changes the angle of view of the camera to a third angle of view 725 wider than the second angle of view 723. An image generated based on the third drawing input 715 may be overlapped and displayed on the third image.

8 illustrates an electronic device 801 that acquires a preview image by rotating the camera 880, according to various embodiments of the present disclosure.

5 to 6 described above, the electronic device 801 of FIG. 8 (eg, the electronic device 101 of FIG. 1 ) is the first flexible display (eg, the display 460 of FIG. 4 ). A preview image is displayed in the area 860a and a UI including a plurality of buttons for changing the drawing property of the input is displayed in the second area 860b. The execution screens of the first area 860a and the second area 860b are exemplary, and various embodiments of the present document are not limited thereto, and the execution screens may be switched based on a specified input.

Referring to reference numeral 800a, according to an embodiment, the electronic device 801 may classify regions of the flexible display and display various different execution screens in each region. For example, the electronic device 801 may display at least one image acquired using the camera 880 on the first area 860a of the flexible display. For example, the electronic device 801 may acquire at least one image by setting the camera 880 to a third angle of view (eg, the third angle of view 725 of FIG. 7 ). As illustrated, the camera 880 may perform a photographing function in a state set to face the first direction 810 . For example, the electronic device 801 may display a UI including a plurality of buttons for changing the drawing property of an input on the second area 860b of the flexible display.

Referring to reference numeral 800b, according to an embodiment, the electronic device 801 may identify a drawing input (eg, a touch input by a user and/or a pen touch input) sensed on the flexible display. For example, the electronic device 801 may identify whether a drawing input sensed on the first area 860a of the flexible display is detected within a specified range 850 . When a drawing input is sensed in at least a portion of the first area 860a except for the designated range 850 in a state in which photographing is being executed with the camera 880 set to the third angle of view, the electronic device 801 displays the camera 880 can be rotated around a specified central axis. For example, when a drawing input is detected in at least a part of the electronic device 801 excluding the specified range 850, the direction in which the camera 880 is directed by rotating the camera 880 tracks the direction in which the drawing input is detected ( tracking) can be done. The electronic device 801 may display at least one image obtained by rotating the camera 880 to face the second direction 820 on the flexible display. In this case, at least one image displayed on the flexible display may be displayed in at least a portion of the second area 860b in excess of the first area 860a. When the preview image is displayed on at least a portion of the second area 860b, the UI that is being displayed may continue to be displayed in a reduced state.

9 illustrates an electronic device 901 that acquires a preview image by rotating a camera, according to various embodiments of the present disclosure.

Referring to FIG. 9 , the electronic device 901 may rotate the camera so that the direction the camera faces may track the direction in which a drawing input is sensed. The electronic device 901 is based on the drawing inputs 911 , 913 , and 915 (eg, a touch input by a user and/or a touch input of the pen 902 ) within a designated range 950 of the second region 960b. The generated drawing image may be displayed by being superimposed on the image displayed in the second area 960b. The electronic device 901 may identify whether a drawing input sensed in one area of the flexible display (eg, the display 460 of FIG. 4 ) is within a specified range.

According to an embodiment, the electronic device 901 may acquire at least one image using a camera set to a third angle of view (eg, the third angle of view 725 of FIG. 7 ). The electronic device 901 may superimpose and display an image generated based on the first drawing input 911 and the second drawing input 913 on at least one image acquired using the camera set to the third angle of view. there is. For example, the electronic device 901 may detect the third drawing input 913 . The third drawing input 913 may be referred to as an input sensed in at least a portion of the second area 960b except for the designated range 950 . When the third drawing input 913 is sensed, the electronic device 901 may rotate the camera so that the direction the camera faces may track the direction in which the third drawing input 915 is sensed. The electronic device 901 may overlap and display an image generated based on the third drawing input 915 on at least one image 917 acquired using a camera set to the third angle of view.

10 illustrates an electronic device 1001 acquiring a preview image by changing a folding angle, according to various embodiments of the present disclosure.

According to various embodiments, the user may hold and use the electronic device 1001 (eg, the electronic device 101 of FIG. 1 ) in various forms. Referring to reference numeral 1010 , for example, a user may indicate that a flexible display (eg, the display 460 in FIG. 4 ) is a first type (eg, in FIG. 4 ) that is folded from side to side through a hinge structure 1070 . 5), the electronic device 1001 may be used by holding it in the form of reference numeral 500a. Referring to reference number 1020, as another example, the user holds the flexible display in the form of a second type (for example, the second type according to reference number 500b in FIG. 5) in which the flexible display is folded up and down through the hinge structure 1070, and the electronic device ( 1001) can be used. The electronic device 1001 may change the direction the camera 1080 faces by changing the folding angle of the hinge structure 1070 . The description of FIG. 10, which will be described later, may be a description commonly referred to with reference to reference numerals 1010 and 1020 having the same reference numerals.

According to an embodiment, the electronic device 1001 may display different screens in the first area 1060a and the second area 1060b on the flexible display, respectively. For example, the electronic device 1001 has a camera set to the angle of view specified in the first area 1060a (eg, the first angle of view 721 , the second angle of view 723 , or the third angle of view 725 of FIG. 7 ). At least one image (eg, the first image 610 , the second image 620 , or the third image 630 of FIG. 6 ) obtained by using 1080 may be displayed. As another example, the electronic device 1001 may display a user interface (UI) including a plurality of buttons for changing drawing properties in the second area 1060b. For example, division of regions of the flexible display (eg, the first region 1060a and the second region 1060b) may be a physical division based on the hinge structure 1070 . As another example, the division of the flexible display area may be logical division of the display area.

The electronic device 1001 displays an image obtained by using the camera 1080 set to a field of view (eg, a third angle of view) specified in the first area 1060a, and a specified range of the first area 1060a on the flexible display. An image generated based on a drawing input to the interior 1050 may be displayed by overlaying it on the image displayed in the first area 1060a. For example, when the drawing input is detected in at least a part of the range 1050 except for the specified range 1050 , the electronic device 1001 rotates the camera 1080 so that the direction the camera 1080 faces is tracking the direction in which the drawing input is detected. (tracking) can be done. The description of the operation of the electronic device 1001 rotating the camera 1080 may be replaced with the description of FIGS. 8 and 9 described above. As another example, the electronic device 1001 may change the direction in which the camera 1080 faces by folding the flexible display based on the hinge structure 1070 . The electronic device 1001 may change the folding angle of the hinge structure 1070 so that the direction the camera 1080 faces tracks the direction in which the drawing input is sensed. As an example, the electronic device 1001 changes the direction the camera 1080 faces from the first direction 1021 to the second direction 1023 by changing the folding angle of the flexible display that is folded based on the hinge structure 1070 . can

11 illustrates an electronic device 1101 acquiring a preview image in various forms, according to various embodiments of the present disclosure.

According to an embodiment, the electronic device 1101 (eg, the electronic device 101 of FIG. 1 ) has an angle of view of the camera 1180 (eg, the camera 480 of FIG. 4 ), a direction in which the camera 1180 faces, Alternatively, as the folding angle of the hinge structure (eg, the hinge structure 1070 of FIG. 10 ) included in the electronic device 1101 is changed, various preview images may be acquired.

Referring to reference number 1111 , the electronic device 1101 may acquire a preview image included in the first direction 1121 by using the camera 1180 . For example, the user holds the electronic device 1101 in the form of a second type (eg, a second type according to reference number 500b of FIG. 5 ), and the camera 1180 moves in the first direction 1121 It can be made to perform the shooting function in the state facing. The electronic device may display an image acquired through the camera 1180 disposed to face the first direction 1121 on at least one area of the flexible display. For example, at least one image displayed by the electronic device 1101 according to reference number 1111 may be an image captured in a direction in which the user is present.

Referring to reference number 1112 , the electronic device 1101 may acquire a preview image included in the second direction 1122 by using the camera 1180 . For example, the user may hold the electronic device 1101 in a second type shape and perform a photographing function with the camera 1180 facing the second direction 1122 . The electronic device may display an image acquired through the camera 1180 disposed to face the second direction 1122 on at least one area of the flexible display. For example, at least one image displayed by the electronic device 1101 according to reference number 1112 may be an image photographed in a direction in which the user looks.

Referring to reference number 1113 , the electronic device 1101 may acquire a preview image included in the third direction 1123 using the camera 1180 . For example, the user may hold the electronic device 1101 in a second type shape and perform a photographing function with the camera 1180 facing the third direction 1123 . The electronic device may display an image acquired through the camera 1180 disposed to face the third direction 1123 on at least one area of the flexible display. For example, at least one image displayed by the electronic device 1101 according to reference number 1113 may be an image obtained by the camera 1180 in the direction of the lower end of the electronic device 1101 .

Referring to reference number 1114 , the electronic device 1101 may acquire a preview image included in the fourth direction 1124 using the camera 1180 . For example, the user may hold the electronic device 1101 in a second type shape and perform a photographing function with the camera 1180 facing the fourth direction 1124 . The electronic device may display an image acquired through the camera 1180 disposed to face the fourth direction 1124 on at least one area of the flexible display. For example, at least one image displayed by the electronic device 1101 according to reference number 1114 may be an image obtained by the camera 1180 in the direction of the upper end of the electronic device 1101 .

12 illustrates an electronic device 1201 that acquires a preview image in various forms, according to various embodiments of the present disclosure.

Referring to reference numerals 1210a and 1210b, according to various embodiments, the electronic device 1201 (eg, the electronic device 101 of FIG. 1 ) is a flexible display (eg, the display 460 of FIG. 4 ). A user interface (UI) including a plurality of buttons for changing the drawing property of an input is displayed in an area, and at least acquired using a camera (eg, the camera 480 in FIG. 4 ) in an area other than the one area One image can be displayed. For example, when a specified input to the first area 1260a or the second area 1260b of the flexible display is sensed, the electronic device 1201 displays the first area 1260a and the second area 1260b. You can switch the execution screen. For example, when the specified input is sensed while displaying the UI in the first area 1260a and displaying at least one image in the second area 1260b according to reference number 1210a, the electronic device 1201 Execution screens displayed in the first area 1260a and the second area 1260b may be switched as indicated by reference numeral 1210b. For example, the designated input may be a hovering drag input by an external electronic device (eg, the external electronic device 402 of FIG. 4 ) or a drag input by a user.

Referring to reference numerals 1220a and 1220b, according to various embodiments, the electronic device 1201 may display at least one image acquired using a camera on the second area 1260b. According to an embodiment, when a drawing input is sensed in at least a portion of the second area 1260b except for the designated range 1250 , the electronic device 1201 may expand and display the second area 1260b. For example, in a state in which the electronic device 1201 displays the first area 1260a and the second area 1260b at substantially the same ratio according to reference number 1220a, drawing in at least a part except for the designated range 1250 An input can be sensed. At this time, with reference to reference numeral 1220b, the electronic device 1260 detects the drawing input and then displays at least one image acquired using a camera to a part of the first area 1260a and the second area 1260b. It can be expanded to display.

13 illustrates an electronic device 1301 that displays various types of drawing images on a display, according to various embodiments of the present disclosure.

Referring to reference numeral 1300 , the electronic device 1301 (eg, the electronic device 101 of FIG. 1 ) is a drawing image of various shapes 1310a and 1310b on a flexible display (eg, the display 460 of FIG. 4 ). (1311, 1313, 1315, and 1317) can be displayed.

According to an embodiment, the electronic device 1301 may display a preview image acquired using the camera 1380 (eg, the camera 480 of FIG. 4 ) facing the first direction 1305 on the flexible display. there is. For example, the electronic device 1301 may display the preview image on both the first area 1360a and the second area 1360b of the flexible display. However, this is exemplary and not limited thereto, and the electronic device 1301 may display the preview image in part or all of each of the first area 1360a and the second area 1360b. According to an embodiment, the electronic device 1301 may display an image generated based on an input to the flexible display. For example, the electronic device 1301 may receive a touch input through the external electronic device 1302 (eg, a digital pen) using a pen input interface located in the flexible display. As another example, the electronic device 1301 may receive a user's touch input for the flexible display.

Referring to reference number 1310a, the electronic device 1301 may display the first drawing image 1311 and the second image 1313 generated based on an input to the flexible display. For example, the first drawing image 1311 and the second drawing image 1313 may be referred to as drawing images corresponding to two-dimensional figures.

Referring to reference number 1310b, the electronic device 1301 may display a third drawing image 1315 and a fourth drawing image 1317 generated based on an input to the flexible display. For example, the third drawing image 1315 and the fourth drawing image 1317 may be referred to as drawing images (eg, augmented reality (AR) images) corresponding to 3D figures. In other words, the third drawing image 1315 and the fourth drawing image 1317 may be referred to as 3D figures generated based on a specified input (eg, a touch and drag input). For example, the electronic device 1301 configures the third drawing image 1315 and the fourth drawing image 1315 and the fourth drawing image 1315 based on a specified input sensed in at least a portion of an area where the first drawing image 1311 and the second drawing image 1313 are displayed. An image 1317 may be displayed.

14 illustrates a flowchart 1400 of an operation of an electronic device according to various embodiments of the present disclosure.

According to an embodiment, the electronic device (eg, the electronic device 101 of FIG. 1 ) may perform the operations of FIG. 14 . For example, the processor of the electronic device (eg, the processor 120 of FIG. 1 ) may be set to perform the operations of FIG. 14 when instructions stored in the memory (eg, the memory 130 of FIG. 1 ) are executed. .

In operation 1405, the electronic device may display a user interface (UI) and a first image (eg, the first image 610 of FIG. 6 ) on one area of the flexible display (eg, the display 460 of FIG. 4 ). there is. For example, the UI may include a plurality of buttons for changing a drawing property of an input (eg, a touch input by a user or a pen touch input by an external electronic device) to an area of the flexible display. For example, the first image may correspond to at least one image acquired using a camera (eg, the camera 480 of FIG. 4 ) set to a designated angle of view (eg, the first angle of view 721 of FIG. 7 ). The electronic device may display the UI and the first image in the first area (eg, the first area 560a of FIG. 5 ) and the second area (eg, the second area 560b of FIG. 5 ), respectively.

In operation 1410, the electronic device may display the image generated based on the drawing input by superimposing it on the first image. For example, the electronic device receives a drawing input (eg, the first drawing input 711 , the second drawing input 713 , and/or the third drawing input 715 of FIG. 7 ) for one area of the flexible display. received, and a drawing image generated based on the drawing input may be displayed by overlaying the drawing image on the first image.

In operation 1415 , the electronic device may determine whether a drawing input is sensed in at least a part of the designated range (eg, the designated range 550 of FIG. 5 ). When a drawing input is sensed in at least a portion except for the specified range, the electronic device may perform operation 1420 . If the drawing input is not detected in at least a portion of the range except for the specified range, the electronic device may repeatedly perform operation 1410 .

In operation 1420, the electronic device acquires an image by changing the angle of view of the camera, rotating the camera based on a designated axis, or changing the folding angle, and displays the image on the second area. According to an embodiment, the electronic device may include a camera supporting various angles of view (eg, a first angle of view, a second angle of view, and a third angle of view). For example, in a state in which the electronic device is displaying a first image acquired using a camera set as the first angle of view, and a drawing input is sensed in at least a portion except for a specified range, the electronic device sets the angle of view of the camera to the first The second image obtained by changing to a second angle of view wider than the angle of view may be displayed on the second area. As another example, when a drawing input is sensed in at least a part of the second area displaying the second image except for a designated range, the electronic device changes the camera's angle of view to a third angle of view that is wider than the second angle of view. 3 An image may be displayed in the second area. According to an embodiment, the electronic device may change the direction the camera faces by rotating the camera based on a specified axis. For example, when a drawing input is detected in at least a part of the second area displaying the third image except for a specified range, the electronic device rotates the camera so that the direction the camera faces is tracking the direction in which the drawing input is detected. ) can be done. The electronic device may display the fourth image obtained by rotating the camera through a part of the first area and the second area. According to an embodiment, the electronic device may change the folding angle of the hinge structure (eg, the hinge structure 1070 of FIG. 10 ) so that the camera may take pictures in various directions. For example, when a drawing input is sensed in at least a part of the second area displaying the fourth image except for a specified range, the electronic device changes the folding angle of the hinge structure so that the direction the camera faces is the direction in which the touch input is sensed. can be tracked.

According to various embodiments of the present disclosure, a foldable electronic device (eg, the electronic device 101 of FIG. 1 ) includes a camera supporting a first angle of view, a second angle of view, and a third angle of view, a first housing, and a second and a housing, a hinge structure disposed between the first housing and the second housing, a flexible display, a processor, and a memory operatively connected to the processor.

According to an embodiment, the memory displays a user interface (UI) including a plurality of buttons that, when executed, cause the processor to change a drawing property of an input in a first area on the flexible display, and A first image acquired using the camera set to the first angle of view is displayed in a second area on the display, and an image generated based on a drawing input within a specified range of the second area is displayed in the second area When the drawing input is detected in at least a part of the second area except for the specified range, the camera's angle of view is set to be wider than the first angle of view. One or more instructions for displaying a second image obtained by changing to .

According to an embodiment, when the one or more instructions are executed, when the processor detects the drawing input in at least a portion of the second area displaying the second image except for the specified range, the camera A third image obtained by changing the angle of view to the third angle of view wider than the second angle of view may be displayed on the second area.

According to an embodiment, when the one or more instructions are executed, when the processor detects the drawing input in at least a part of the second area displaying the third image except for the specified range, the camera is By rotating it, the direction in which the camera faces may track the direction in which the drawing input is sensed.

According to an embodiment, the one or more instructions, when executed, may cause the processor to display a fourth image obtained by rotating the camera through a part of the first area and the second area.

According to an embodiment, when the one or more instructions are executed, when the processor detects the drawing input in at least a portion of the second area displaying the fourth image except for the designated range, the hinge structure By changing the folding angle of , the direction the camera faces may track the direction in which the drawing input is sensed.

According to an embodiment, the foldable electronic device further comprises a pen input interface configured to receive pen input from a digital pen and a wireless communication circuit operatively connected to the processor, the pen input interface positioned within the flexible display; The input may be a digital pen communicating with the wireless communication circuit or an input by a user's touch.

According to an embodiment, the one or more instructions, when executed, may cause the processor to switch execution screens displayed in the first area and the second area in response to a specified input to the flexible display. .

According to an embodiment, the designated input may be a hovering drag input by the digital pen or a drag input by a user.

According to an embodiment, the UI may include at least one of a color, a type, and a shooting start button of an image generated based on the drawing input.

According to an embodiment, the one or more instructions, when executed, cause the processor to display, on the second area, at least one image acquired using the camera when a touch input to the start shooting button is sensed. can do.

According to various embodiments of the present disclosure, a method for a foldable electronic device to display a preview image includes a UI ( user interface), displaying a first image acquired using a camera set to a first angle of view in a second area on the flexible display and generating based on a drawing input within a specified range of the second area an operation of overlaying and displaying an image displayed in the second area on the first image displayed in the second area, and when the drawing input is sensed in at least a portion of the second area except for the specified range, the angle of view of the camera and displaying a second image obtained by changing to a second angle of view wider than the first angle of view on the second area.

According to an embodiment, in the method of displaying a preview image by the foldable electronic device, the drawing input is sensed in at least a portion of the second area displaying the second image except for the specified range. , the method may further include displaying a third image obtained by changing the angle of view of the camera to the third angle of view wider than the second angle of view on the second area.

According to an embodiment, in the method of displaying a preview image by the foldable electronic device, the drawing input is sensed in at least a portion of the second area displaying the third image except for the specified range. The method may further include an operation of tracking a direction in which the drawing input is sensed in a direction in which the camera is directed by rotating the camera.

According to an embodiment, the method of displaying a preview image by the foldable electronic device includes displaying a fourth image obtained by rotating the camera through a part of the first area and the second area. movement; may further include.

According to an embodiment, in the method of displaying a preview image by the foldable electronic device, the drawing input is sensed in at least a portion of the second area displaying the fourth image except for the specified range. If it is, the method may further include tracking the direction in which the drawing input is sensed in the direction the camera faces by changing the folding angle of the hinge structure.

According to an embodiment, the drawing input may be an input by a user's touch or a digital pen communicating with a wireless communication circuit included in the foldable electronic device.

According to an embodiment, in the method for displaying a preview image by the foldable electronic device, execution screens displayed on the first area and the second area in response to a specified input to the flexible display are displayed. It may further include an operation of switching.

According to an embodiment, the designated input may be a hovering drag input by the digital pen or a drag input by a user.

According to an embodiment, the UI may include at least one of a color, a type, and a shooting start button of an image generated based on the drawing input.

According to an embodiment, in the method for displaying a preview image by the foldable electronic device, when a touch input to the start shooting button is detected, at least one image acquired using the camera is displayed as the second image. An operation of displaying in the second area may be further included.

Claims (20)

A foldable electronic device comprising:
a camera supporting a first angle of view, a second angle of view, and a third angle of view;
a first housing;
a second housing;
a hinge structure disposed between the first housing and the second housing;
flexible display;
processor; and
a memory operatively coupled to the processor; wherein the memory, when executed, causes the processor to:
displaying a user interface (UI) including a plurality of buttons for changing a drawing property of an input in a first area on the flexible display;
displaying a first image obtained using the camera set to the first angle of view on a second area on the flexible display;
an image generated based on a drawing input within a specified range of the second area is displayed by overlaying on the first image displayed in the second area,
When the drawing input is detected in at least a portion of the second area except for the specified range, a second image obtained by changing the angle of view of the camera to the second angle of view wider than the first angle of view is displayed in the second area An electronic device that stores one or more instructions to cause it to do so.
The method according to claim 1,
The one or more instructions, when executed, cause the processor to:
When the drawing input is sensed in at least a part of the second area displaying the second image except for the designated range, the third angle of view obtained by changing the angle of view of the camera to the third angle of view wider than the second angle of view and display an image in the second area.
3. The method according to claim 2,
The one or more instructions, when executed, cause the processor to:
When the drawing input is sensed in at least a part of the second area displaying the third image except for the specified range, the direction the camera faces by rotating the camera tracks the direction in which the drawing input is detected. ), an electronic device.
4. The method according to claim 3,
The one or more instructions, when executed, cause the processor to:
and displaying a fourth image obtained by rotating the camera through a part of the first area and the second area.
5. The method according to claim 4,
The one or more instructions, when executed, cause the processor to:
When the drawing input is sensed in at least a portion of the second area displaying the fourth image except for the designated range, the direction in which the camera is directed by changing the folding angle of the hinge structure is the direction in which the drawing input is sensed. An electronic device that allows tracking of
The method according to claim 1,
The foldable electronic device may include: a wireless communication circuit operatively coupled to the processor; and
a pen input interface configured to receive pen input from a digital pen, the pen input interface positioned within the flexible display; further comprising,
The drawing input is an input by a user's touch or a digital pen communicating with the wireless communication circuit.
7. The method of claim 6,
The one or more instructions, when executed, cause the processor to:
and switching the execution screen displayed on the first area and the second area in response to a specified input to the flexible display.
8. The method of claim 7,
The electronic device of claim 1, wherein the designated input is a hovering drag input by the digital pen or a drag input by a user.
The method according to claim 1,
The UI includes at least one of a color, a type, and a shooting start button of an image generated based on the drawing input.
10. The method of claim 9,
The one or more instructions, when executed, cause the processor to:
and displaying at least one image acquired using the camera on the second area when a touch input to the shooting start button is sensed.
A method for a foldable electronic device to display a preview image, comprising:
displaying a user interface (UI) including a plurality of buttons for changing a drawing property of an input in a first area on the flexible display;
displaying a first image acquired using a camera set to a first angle of view on a second area on the flexible display and operating;
an operation of overlaying and displaying an image generated based on a drawing input within a specified range of the second area on the first image displayed in the second area; and
When the drawing input is detected in at least a part of the second area except for the specified range, the second image obtained by changing the angle of view of the camera to a second angle of view wider than the first angle of view is displayed in the second area movement; A method comprising
12. The method of claim 11,
A method for the foldable electronic device to display a preview image,
When the drawing input is sensed in at least a part of the second area displaying the second image except for the designated range, the third angle of view obtained by changing the angle of view of the camera to the third angle of view wider than the second angle of view displaying an image on the second area; A method further comprising:
13. The method of claim 12,
A method for the foldable electronic device to display a preview image,
When the drawing input is sensed in at least a part of the second area displaying the third image except for the specified range, the direction the camera faces by rotating the camera tracks the direction in which the drawing input is detected. ) to act; A method further comprising:
14. The method of claim 13,
A method for the foldable electronic device to display a preview image,
displaying a fourth image obtained by rotating the camera through a portion of the first area and the second area; A method further comprising:
15. The method of claim 14,
A method for the foldable electronic device to display a preview image,
When the drawing input is sensed in at least a part of the second area displaying the fourth image except for the designated range, the direction in which the drawing input is sensed is determined by changing the folding angle of the hinge structure. tracking motion; A method further comprising:
12. The method of claim 11,
The method of claim 1, wherein the drawing input is an input by a user's touch or a digital pen communicating with a wireless communication circuit included in the foldable electronic device.
17. The method of claim 16,
A method for the foldable electronic device to display a preview image,
switching an execution screen displayed in the first area and the second area in response to a specified input to the flexible display; A method further comprising:
18. The method of claim 17,
The method of claim 1, wherein the designated input is a hovering drag input by the digital pen or a drag input by a user.
12. The method of claim 11,
The UI includes at least one of a color, a type, and a shooting start button of an image generated based on the drawing input.
12. The method of claim 11,
A method for the foldable electronic device to display a preview image,
displaying at least one image acquired using the camera on the second area when a touch input to the shooting start button is sensed; A method further comprising:

Images