KR20240072866A - Electronic device including flexible display and method processing imame of the same - Google Patents

Abstract

An electronic device including a flexible display according to an embodiment of the present disclosure is connected to a hinge structure and includes a first surface facing in a first direction and a second surface facing in a second direction opposite to the first direction. 1 housing, connected to the hinge structure, comprising a third side facing in a third direction and a fourth side facing in a fourth direction opposite to the third direction, the first housing structure being centered around the hinge structure; A foldable second housing, extending from the first side to a third side to form the first side and the third side, the second housing having a first region corresponding to the first side and a second region corresponding to the third side. A flexible first display including, a second display disposed on the second side, a first camera device disposed on at least a portion of the first side, a second camera device disposed on at least a portion of the second side, and May include a processor.

Description

Electronic device including flexible display and image processing method thereof {ELECTRONIC DEVICE INCLUDING FLEXIBLE DISPLAY AND METHOD PROCESSING IMAME OF THE SAME}

This disclosure relates to an electronic device including a flexible display and an image processing method for the electronic device.

Electronic devices are gradually becoming slimmer, their rigidity is increasing, design aspects are being strengthened, and their functional elements are being improved to differentiate them. Electronic devices are moving away from the uniform rectangular shape and are gradually being transformed into various shapes. Electronic devices can be convenient to carry and have a deformable structure that can utilize a display with a large screen.

For example, an electronic device may include foldable housings that operate in a folded or unfolded manner relative to one another. Electronic devices can provide users with a large screen and increase portability by including a flexible display in foldable housings.

Meanwhile, the number of electronic devices capable of providing video call functions is increasing. Users can make video calls using the rear camera among the front and rear cameras included in the electronic device. There is a demand from users who want realistic photos that make them feel like they are with the other video caller during a video call.

The electronic device including a flexible display and the image processing method of the electronic device of the present disclosure use a mechanical feature of the electronic device including a foldable housing to capture an image including a video call participant using a rear camera during a video call. There is a purpose to doing this.

An electronic device including a flexible display according to an embodiment of the present disclosure is connected to a hinge structure and includes a first surface facing in a first direction and a second surface facing in a second direction opposite to the first direction. 1 housing, connected to the hinge structure, comprising a third side facing in a third direction and a fourth side facing in a fourth direction opposite to the third direction, the first housing structure being centered around the hinge structure; A foldable second housing, extending from the first side to a third side to form the first side and the third side, the second housing having a first region corresponding to the first side and a second region corresponding to the third side. A flexible first display including, a second display disposed on the second side, a first camera device disposed on at least a portion of the first side, a second camera device disposed on at least a portion of the second side, and May include a processor.

A processor according to an embodiment of the present disclosure executes a video call, and while executing the video call, if there is a request to enter a mirror selfie operation, it displays a notification regarding the mirror selfie operation and performs the mirror selfie operation. When a consent message is received from another electronic device, the second display is controlled to display an image transmitted from the other party making the video call, and when a shooting command is received, the control is controlled to shoot using the second camera device. You can.

An image processing method of an electronic device including a flexible display according to an embodiment of the present disclosure includes the operation of executing a video call, and if there is a request to enter a mirror selfie operation while executing the video call, the mirror selfie operation is performed. An operation of displaying a notification related to the mirror selfie operation, an operation of controlling the sub display to display an image transmitted from the other party making the video call when a consent message for the mirror selfie operation is received from another electronic device, and if there is a shooting command, It may include an operation of taking pictures using a rear camera device disposed on the same side as the sub-display.

The electronic device including a flexible display and the image processing method of the electronic device of the present disclosure capture an image including a video call participant using a rear camera during a video call, thereby providing an effect as if the video call participant and the electronic device user are together. You can take pictures with .

1A is a front perspective view of an electronic device illustrating a flat state or unfolding state according to various embodiments of the present disclosure.
FIG. 1B is a plan view illustrating the front of an electronic device in an unfolded state according to various embodiments of the present disclosure.
FIG. 1C is a plan view illustrating the back of an electronic device in an unfolded state according to various embodiments of the present disclosure.
FIG. 2A is a perspective view of an electronic device illustrating a folding state according to various embodiments of the present disclosure.
FIG. 2B is a perspective view of an electronic device illustrating an intermediate state according to various embodiments of the present disclosure.
FIG. 3 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure.
4A and 4B are flowcharts showing an image processing method of a first electronic device according to an embodiment of the present disclosure.
Figure 5 is a flowchart showing an image processing method of a second electronic device according to an embodiment of the present disclosure.
FIG. 6 is a flowchart showing an image processing method of a first electronic device and a second electronic device according to an embodiment of the present disclosure.
FIG. 7A shows a screen when a first electronic device makes a video call with a second electronic device according to an embodiment of the present disclosure.
FIG. 7B is a diagram illustrating a case where an option related to a video call operation is selected in a first electronic device according to an embodiment of the present disclosure.
FIG. 7C is a diagram illustrating a case where a first electronic device requests entry into a mirror selfie operation according to an embodiment of the present disclosure.
FIG. 7D is a diagram illustrating a case where a mirror selfie operation is entered in a first electronic device according to an embodiment of the present disclosure.
FIG. 7E is a diagram illustrating a case where a notification requesting confirmation of a shooting status is displayed on a first electronic device according to an embodiment of the present disclosure.
FIG. 7F is a diagram illustrating a case where a photographing command is transmitted from a first electronic device according to an embodiment of the present disclosure.
FIG. 7G is a diagram illustrating a case where a first image is acquired by a first electronic device according to an embodiment of the present disclosure.
FIG. 8A is a diagram illustrating a first image acquired by a first electronic device according to an embodiment of the present disclosure.
FIG. 8B is a diagram illustrating a second image acquired by a first electronic device according to an embodiment of the present disclosure.
FIG. 9A shows a screen when a second electronic device makes a video call with a first electronic device according to an embodiment of the present disclosure.
FIG. 9B is a diagram illustrating a case where a second electronic device requests entry into a mirror selfie operation from a first electronic device according to an embodiment of the present disclosure.
FIG. 9C is a diagram illustrating an image displayed by a second electronic device when a first electronic device enters a mirror selfie operation according to an embodiment of the present disclosure.
FIG. 9D is a diagram illustrating a case where a second electronic device receives a notification requesting confirmation of a shooting status from a first electronic device according to an embodiment of the present disclosure.
FIG. 9E is a diagram illustrating a user interface of a second electronic device when a photographing command is transmitted from a first electronic device according to an embodiment of the present disclosure.
FIG. 9F is a diagram illustrating a case where a second electronic device acquires a first image from a first electronic device according to an embodiment of the present disclosure.

FIG. 1A is a perspective view of an electronic device illustrating a flat state or unfolded state of the electronic device according to various embodiments of the present disclosure.

FIG. 1B is a plan view illustrating the front of an electronic device in an unfolded state according to various embodiments of the present disclosure.

FIG. 1C is a plan view illustrating the back of an electronic device in an unfolded state according to various embodiments of the present disclosure.

FIG. 2A is a perspective view of an electronic device illustrating a folded state of the electronic device according to various embodiments of the present disclosure.

FIG. 2B is a perspective view of an electronic device illustrating an intermediate state of the electronic device according to various embodiments of the present disclosure.

1A to 2B, the electronic device 100 includes first and second housings 110 and 120 that are foldably coupled to each other based on a hinge device (e.g., the hinge device 140 of FIG. 1B). ) (e.g. foldable housing structure) may be included.

In one embodiment of the present disclosure, the hinge device (eg, the hinge device 140 in FIG. 1B) may be arranged in the X-axis direction or in the Y-axis direction.

In one embodiment of the present disclosure, the electronic device 100 includes a first display 400 (e.g., a flexible display) disposed in an area (e.g., a recess) formed by the first and second housings 110 and 120. , a foldable display, or a main display). In one embodiment, the first housing 110 and the second housing 120 are disposed on both sides of the folding axis (F) and may have a shape that is substantially symmetrical with respect to the folding axis (F).

In one embodiment of the present disclosure, the angle or distance between the first housing 110 and the second housing 120 may vary depending on the state of the electronic device 100. For example, the first housing 110 and the second housing 120 depending on whether the electronic device is in a flat state or unfolded state, a folded state, or an intermediate state. ) The angle or distance between them may vary.

In one embodiment of the present disclosure, the first housing 110 has a first surface 111 facing a first direction (e.g., front direction) (z-axis direction) and a second surface in the unfolded state of the electronic device 100. It may include a second surface 112 facing a second direction (e.g., back direction) (-z axis direction) opposite to the first surface 111.

In one embodiment of the present disclosure, the second housing 120 has a third surface 121 facing in the first direction (z-axis direction) and a third surface 121 facing in the second direction (-z axis) when the electronic device 100 is unfolded. direction) may include a fourth side 122 facing the direction.

In one embodiment of the present disclosure, in the unfolded state of the electronic device 100, the first side 111 of the first housing 110 and the third side 121 of the second housing 120 are substantially the same. It can be oriented in one direction (z-axis direction).

In one embodiment of the present disclosure, in the folded state of the electronic device 100, the first side 111 of the first housing 110 and the third side 121 of the second housing 120 may face each other. .

In one embodiment of the present disclosure, in the unfolded state of the electronic device 100, the second side 112 of the first housing 110 and the fourth side 122 of the second housing 120 are substantially the same. It can be oriented in two directions (-z axis direction).

In one embodiment of the present disclosure, in the folded state of the electronic device 100, the second side 112 of the first housing and the fourth side 122 of the second housing 120 may face in opposite directions. . For example, in the folded state of the electronic device 100, the second side 112 may face the first direction (z-axis direction), and the fourth side 122 may face the second direction (-z-axis direction). You can head towards it. In this case, the first display 400 may not be visible from the outside (in folding method).

In one embodiment of the present disclosure, the electronic device 100 may be folded so that the second side 112 of the first housing 110 and the fourth side 122 of the second housing 120 face each other. In this case, the first display 400 may be arranged to be visible from the outside (out folding method).

In one embodiment of the present disclosure, the first housing 110 (e.g., a first housing structure) includes a first side member 113 and a first side member 113 that at least partially form the exterior of the electronic device 100. ) and may include a first rear cover 114 that forms at least a portion of the second surface 112 of the electronic device 100.

In one embodiment of the present disclosure, the first side member 113 includes a first side 113a, a second side 113b extending from one end of the first side 113a, and a second side 113b extending from one end of the first side 113a. It may include an extended third side 113c.

In one embodiment of the present disclosure, the first side member 113 may be formed into a rectangular (e.g., square or rectangular) shape through the first side 113a, the second side 113b, and the third side 113c. You can.

In one embodiment of the present disclosure, the second housing 120 (e.g., a second housing structure) includes a second side member 123 and a second side member 123 that at least partially form the exterior of the electronic device 100. ) and may include a second rear cover 124 that forms at least a portion of the fourth side 122 of the electronic device 100.

In one embodiment of the present disclosure, the second side member 123 is formed from the fourth side 123a, the fifth side 123b extending from one end of the fourth side 123a, and the other end of the fourth side 123a. It may include an extended sixth side 123c.

In one embodiment of the present disclosure, the second side member 123 may be formed into a rectangular shape through the fourth side 123a, the fifth side 123b, and the sixth side 123c.

In one embodiment of the present disclosure, the first and second housings 110 and 120 are not limited to the shapes and combinations shown, and may be implemented by other shapes or combinations and/or combinations of parts.

In one embodiment of the present disclosure, the first side member 113 may be formed integrally with the first rear cover 114, and the second side member 123 may be formed integrally with the second rear cover 124. It can be.

In one embodiment of the present disclosure, in the unfolded state of the electronic device 100, the second side 113b of the first side member 113 and the fifth side 123b of the second side member 123 have a gap. ) can be connected without.

In one embodiment of the present disclosure, in the unfolded state of the electronic device 100, the third side 113c of the first side member 113 and the sixth side 123c of the second side member 123 have a gap ( It can be connected without a gap.

In one embodiment of the present disclosure, in the unfolded state of the electronic device 100, the sum of the lengths of the second side 113b and the fifth side 123b is equal to the first side 113a and/or the fourth side 123a. ) can be configured to be longer than the length of.

In one embodiment of the present disclosure, in the unfolded state of the electronic device 100, the sum of the lengths of the third side 113c and the sixth side 123c is equal to the first side 113a and/or the fourth side 123a. ) can be configured to be longer than the length of.

Referring to FIGS. 2A and 2B , the first side member 113 and/or the second side member 123 may be formed of metal or may further include a polymer injected into the metal. In one embodiment, the first side member 113 and/or the second side member 123 include at least one electrically segmented portion (1161, 1162 and/or 1261, 1262) formed of polymer. It may also include a conductive portion (116 and/or 126). In this case, the at least one conductive portion 116 and/or 126 is electrically connected to a wireless communication circuit included in the electronic device 100 and is connected to at least one antenna operating in at least one designated band (e.g., legacy band). It can be used as part of

In one embodiment of the present disclosure, the first back cover 114 and/or the second back cover 124 may be made of, for example, coated or colored glass, ceramic, polymer, or metal (e.g., aluminum, stainless steel (e.g., It may be formed by at least one of STS), or magnesium) or a combination of at least two.

In one embodiment of the present disclosure, the first display 400 is positioned across a hinge device (e.g., hinge device 140 in FIG. 1B) from the first side 111 of the first housing 110 to the second housing ( It may be arranged to extend to at least a portion of the third side 121 of 120).

In one embodiment of the present disclosure, the first display 400 includes a first area 130a substantially corresponding to the first surface 111, a second area 130b corresponding to the second surface 121, and a second area 130b substantially corresponding to the first surface 111. It may include a third area 130c (eg, a bendable area or a folding area) connecting the first area 130a and the second area 130b.

In one embodiment of the present disclosure, the third region 130c is part of the first region 120a and/or the second region 130b and corresponds to a hinge device (e.g., the hinge device 140 in FIG. 1B). It can be placed in a location where:

In one embodiment of the present disclosure, the electronic device 100 may include a hinge housing 141 (eg, a hinge cover) that supports a hinge device (eg, the hinge device 140 of FIG. 1B).

In one embodiment of the present disclosure, the hinge housing 141 is exposed to the outside when the electronic device 100 is in a folded state, and is exposed to the internal space of the first housing 110 when the electronic device 100 is in an unfolded state. And, by being introduced into the internal space of the second housing 120, it can be arranged to be invisible from the outside.

In one embodiment of the present disclosure, the electronic device 100 may include a second display 131 (eg, sub-display) disposed separately from the first display 400.

In one embodiment of the present disclosure, the second display 131 may be disposed on the second surface 112 of the first housing 110 to be exposed to the front.

In one embodiment of the present disclosure, the second display 131 may be disposed to be at least partially exposed on the second surface 112 of the first housing 110.

In one embodiment of the present disclosure, when the electronic device 100 is in a folded state, the second display 131 replaces at least part of the display function of the first display 400 to display at least the status information of the electronic device 100. Some parts can be displayed.

In one embodiment of the present disclosure, the electronic device 100 includes an input device 103 (e.g., a microphone), an audio output device 101 and 102, a sensor module 104, a camera device 105 and 108, and a key input device. It may include at least one of the device 106 or the connector port 107. In the illustrated embodiment, an input device 103 (e.g., a microphone), an audio output device 101, 102, a sensor module 104, a camera device 105, 108, a key input device 106, or a connector port ( 107) is shown as a hole or circular element formed in the first housing 110 or the second housing 120, but this is an exemplary illustration for explanation and is not limited thereto.

In one embodiment of the present disclosure, the input device 103 may include at least one microphone 103 disposed in the second housing 120.

In one embodiment of the present disclosure, the input device 103 may include a plurality of microphones 103 arranged to detect the direction of sound. In one embodiment, a plurality of microphones 103 may be disposed at appropriate positions in the first housing 110 and/or the second housing 120.

In one embodiment of the present disclosure, the sound output devices 101 and 102 may include at least one speaker 101 and 102. At least one speaker 101 or 102 may include a call receiver 101 disposed in the first housing 110 and a speaker 102 disposed in the second housing 120 .

In one embodiment of the present disclosure, the input device 103, the audio output devices 101 and 102, and the connector port 107 are located in the first housing 110 and/or the second housing 120 of the electronic device 100. It may be placed in a space provided in and exposed to the external environment through at least one hole formed in the first housing 110 and/or the second housing 120.

In one embodiment of the present disclosure, at least one connector port 107 may be used to transmit and receive power and/or data with an external electronic device. At least one connector port (eg, ear jack hole) may accommodate a connector (eg, ear jack) for transmitting and receiving audio signals to and from an external electronic device. The hole formed in the first housing 110 and/or the second housing 120 may be commonly used for the input device 103 and the audio output devices 101 and 102. The sound output devices 101 and 102 may include speakers (eg, piezo speakers) that are not exposed through holes formed in the first housing 110 and/or the second housing 120.

In one embodiment of the present disclosure, the sensor module 104 may generate an electrical signal or data value corresponding to an internal operating state of the electronic device 100 or an external environmental state. The sensor module 104 can detect the external environment through the first surface 111 of the first housing 110. The electronic device 100 may further include at least one sensor module disposed to detect the external environment through the second surface 112 of the first housing 110.

In one embodiment of the present disclosure, the sensor module 104 (eg, an illumination sensor) may be disposed below the first display 400 to detect the external environment through the first display 400 .

In one embodiment of the present disclosure, the sensor module 104 includes a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, It may include at least one of an illuminance sensor, a proximity sensor, a biometric sensor, an ultrasonic sensor, or an illuminance sensor 104.

In one embodiment of the present disclosure, the camera devices 105 and 108 include a first camera device 105 (e.g., a front camera device) disposed on the first side 111 of the first housing 110 and a first camera device 105 (e.g., a front camera device). It may include a second camera device 108 (eg, a rear camera device) disposed on the second surface 112 of housing 110.

In one embodiment of the present disclosure, the electronic device 100 may further include a flash 109 disposed near the second camera device 108. Camera devices 105 and 108 may include at least one lens, image sensor, and/or image signal processor. In one embodiment, the camera devices 105 and 108 include two or more lenses (e.g., a wide-angle lens, an ultra-wide-angle lens, or a telephoto lens) and two or more image sensors positioned on one side of the electronic device 100 (e.g., a first It may be arranged to be located on the surface 111, the second surface 112, the third surface 121, or the fourth surface 122). The camera devices 105 and 108 may include lenses and/or image sensors for time of flight (TOF).

In one embodiment of the present disclosure, the key input device 106 (eg, key button) may be disposed on the third side 113c of the first side member 113 of the first housing 110. The key input device 106 may be disposed on at least one of the other sides 113a and 113b of the first housing 110 and/or the sides 123a, 123b and 123c of the second housing 120. there is.

In one embodiment of the present disclosure, the electronic device 100 may not include some or all of the key input devices 106 and the key input devices 106 that are not included may be displayed as a soft display on the first display 400. It may be implemented in other forms such as keys. The key input device 106 may be implemented using a pressure sensor included in the first display 400.

In one embodiment of the present disclosure, some of the camera devices 105 and 108 (e.g., the first camera device 105) or the sensor module 104 are arranged to be exposed through the first display 400. You can.

In one embodiment of the present disclosure, the first camera device 105 or the sensor module 104 is an opening (e.g., a through hole) formed at least partially in the first display 400 in the internal space of the electronic device 100. It can be optically exposed to the outside.

In one embodiment of the present disclosure, at least a portion of the sensor module 104 may be arranged so as not to be visually exposed through the first display 400 in the internal space of the electronic device 100. Referring to FIG. 2B, the electronic device 100 may operate to maintain at least one specified folding angle in an intermediate state through a hinge device (eg, the hinge device 140 of FIG. 1B). In this case, the electronic device 100 may control the first display 400 to display different content on the display area corresponding to the first side 111 and the display area corresponding to the third side 121. there is. In one embodiment, the electronic device 100 holds the first housing 110 at a certain folding angle (e.g., when the electronic device 100 is in an intermediate state) through a hinge device (e.g., the hinge device 140 in FIG. 1B). and the second housing 120) may operate in a substantially unfolded state (e.g., the unfolded state in FIG. 1A) and/or in a substantially folded state (e.g., the folded state in FIG. 2A). In one embodiment, the electronic device 100 is unfolded at a certain folding angle through a hinge device (e.g., the hinge device 140 in FIG. 1B) when a pressing force is provided in the unfolding direction (direction A). , It may be operated to transition to the unfolded state (e.g., the unfolded state of FIG. 1A). In one embodiment, the electronic device 100 is unfolded at a certain folding angle, and a pressing force is provided in the direction in which it is to be folded (direction B) through a hinge device (e.g., the hinge device 140 in FIG. 1B). If so, it may be operated to transition to a folded state (e.g., the folded state of FIG. 2A). In one embodiment, the electronic device 100 may be operated to maintain the unfolded state (not shown) at various folding angles through a hinge device (e.g., the hinge device 140 in FIG. 1B) (free stop function). .

FIG. 3 is a block diagram of a first electronic device 301 in a network environment 300, according to various embodiments.

Referring to FIG. 3, in the network environment 300, the first electronic device 301 communicates with the second electronic device 302 through the first network 398 (e.g., a short-range wireless communication network), or through the second electronic device 302. It may communicate with at least one of the electronic device 304 or the server 308 through the network 399 (eg, a long-distance wireless communication network). According to one embodiment, the first electronic device 301 may communicate with the electronic device 304 through the server 308. According to one embodiment, the first electronic device 301 includes a processor 320, a memory 330, an input module 350, an audio output module 355, a display module 360, an audio module 370, and a sensor. Module 376, interface 377, connection terminal 378, haptic module 379, camera module 380, power management module 388, battery 389, communication module 390, subscriber identification module ( 396), or may include an antenna module 397. In some embodiments, at least one of these components (eg, the connection terminal 378) may be omitted, or one or more other components may be added to the first electronic device 301. In some embodiments, some of these components (e.g., sensor module 376, camera module 380, or antenna module 397) are integrated into one component (e.g., display module 360). It can be.

The processor 320, for example, executes software (e.g., program 340) to execute at least one other component (e.g., hardware or software component) of the first electronic device 301 connected to the processor 320. ) can be controlled and various data processing or operations can be performed. According to one embodiment, as at least part of data processing or computation, the processor 320 stores commands or data received from another component (e.g., sensor module 376 or communication module 390) in volatile memory 332. The commands or data stored in the volatile memory 332 can be processed, and the resulting data can be stored in the non-volatile memory 334. According to one embodiment, the processor 320 may include a main processor 321 (e.g., a central processing unit or an application processor) or an auxiliary processor 323 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the first electronic device 301 includes a main processor 321 and a auxiliary processor 323, the auxiliary processor 323 uses less power than the main processor 321 or is specialized for a designated function. can be set. The auxiliary processor 323 may be implemented separately from the main processor 321 or as part of it.

The auxiliary processor 323 may, for example, act on behalf of the main processor 321 while the main processor 321 is in an inactive (e.g., sleep) state, or while the main processor 321 is in an active (e.g., application execution) state. ), together with the main processor 321, at least one of the components of the first electronic device 301 (e.g., the display module 360, the sensor module 376, or the communication module 390) )) can control at least some of the functions or states related to it. According to one embodiment, coprocessor 323 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 380 or communication module 390). there is. According to one embodiment, the auxiliary processor 323 (eg, neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the first electronic device 301 itself on which the artificial intelligence model is performed, or may be performed through a separate server (e.g., server 308). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 330 may store various data used by at least one component (eg, the processor 320 or the sensor module 376) of the first electronic device 301. Data may include, for example, input data or output data for software (e.g., program 340) and instructions related thereto. Memory 330 may include volatile memory 332 or non-volatile memory 334.

The program 340 may be stored as software in the memory 330 and may include, for example, an operating system 342, middleware 344, or application 346.

The input module 350 may receive commands or data to be used in a component of the first electronic device 301 (e.g., the processor 320) from outside the first electronic device 301 (e.g., a user). . The input module 350 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The audio output module 355 may output an audio signal to the outside of the first electronic device 301. The sound output module 355 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 360 may visually provide information to the outside of the first electronic device 301 (eg, to the user). The display module 360 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 360 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 370 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 370 acquires sound through the input module 350, the sound output module 355, or an external electronic device ( Sound may be output through an electronic device 302 (e.g., a speaker or headphone).

The sensor module 376 detects the operating state (e.g., power or temperature) of the first electronic device 301 or the external environmental state (e.g., user state), and generates an electrical signal or data value corresponding to the detected state. can be created. According to one embodiment, the sensor module 376 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 377 may support one or more designated protocols that can be used to directly or wirelessly connect the first electronic device 301 to an external electronic device (eg, the electronic device 302). According to one embodiment, the interface 377 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 378 may include a connector through which the first electronic device 301 can be physically connected to an external electronic device (eg, the electronic device 302). According to one embodiment, the connection terminal 378 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 379 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 379 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 380 can capture still images and moving images. According to one embodiment, the camera module 380 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 388 can manage power supplied to the first electronic device 301. According to one embodiment, the power management module 388 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 389 may supply power to at least one component of the first electronic device 301. According to one embodiment, the battery 389 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

The communication module 390 provides a direct (e.g., wired) communication channel or wireless communication between the first electronic device 301 and an external electronic device (e.g., electronic device 302, electronic device 304, or server 308). It can support the establishment of a channel and the performance of communication through the established communication channel. Communication module 390 operates independently of processor 320 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 390 is a wireless communication module 392 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 394 (e.g., : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 398 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 399 (e.g., legacy It may communicate with an external electronic device 304 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 392 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 396 within a communication network such as the first network 398 or the second network 399. The first electronic device 301 can be confirmed or authenticated.

The wireless communication module 392 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low latency). -latency communications)) can be supported. The wireless communication module 392 may support high frequency bands (e.g., mmWave bands), for example, to achieve high data rates. The wireless communication module 392 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive MIMO (multiple-input and multiple-output), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 392 may support various requirements specified in the first electronic device 301, an external electronic device (e.g., electronic device 304), or a network system (e.g., second network 399). . According to one embodiment, the wireless communication module 392 supports peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 397 may transmit or receive signals or power to or from the outside (e.g., an external electronic device). According to one embodiment, the antenna module 397 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 397 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 398 or the second network 399 is, for example, connected to the plurality of antennas by the communication module 390. can be selected. Signals or power may be transmitted or received between the communication module 390 and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 397.

According to various embodiments, antenna module 397 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the first electronic device 301 and the external electronic device 304 through the server 308 connected to the second network 399. Each of the external electronic devices 302 or 304 may be of the same or different type as the first electronic device 301. According to one embodiment, all or part of the operations performed in the first electronic device 301 may be executed in one or more of the external electronic devices 302, 304, or 308. For example, when the first electronic device 301 needs to perform a certain function or service automatically or in response to a request from a user or another device, the first electronic device 301 performs the function or service on its own. Instead of or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the first electronic device 301. . The first electronic device 301 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The first electronic device 301 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 304 may include an Internet of Things (IoT) device. Server 308 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 304 or server 308 may be included in the second network 399. The first electronic device 301 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

The first electronic device 301 in FIG. 3 is the same as the electronic device 101 in FIG. 1 . The sensor module 376 in FIG. 3 is the same as the sensor module 104 in FIG. 1. The camera module 180 in FIG. 3 is the same as the camera devices 105 and 108 in FIG. 1. The display module 360 in FIG. 3 is the same as the first display 400 and the second display 131 in FIG. 1 . The input module 350 in FIG. 3 is the same as the input device 103 in FIG. 1. The audio output module 355 in FIG. 3 is the same as the audio output devices 101 and 102 in FIG. 1 .

FIGS. 4A and 4B are flowcharts showing an image processing method of the first electronic device 301 according to an embodiment of the present disclosure.

Referring to FIGS. 4A and 4B , the first electronic device 301 may execute a video call in operation 401 under the control of the processor 320.

In one embodiment of the present disclosure, the first electronic device 301 may execute a video call with the second electronic device 302 through the communication module 390 under the control of the processor 320.

In one embodiment of the present disclosure, when a video call is executed, the first electronic device 301 transmits images acquired through the camera devices 105 and 108 and sounds obtained through the input device 103 to the communication module 390. ) can be transmitted to the second electronic device 302. The first electronic device 301 may receive images and sounds transmitted from the second electronic device 302 through the communication module 390. The first electronic device 301 may output the received image and sound through the audio output devices 101 and 102 and the first display 400 and/or the second display 131.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, may determine whether there is a request to enter a mirror selfie operation in operation 403.

In one embodiment of the present disclosure, the first electronic device 301 may display an affordance or user interface related to entering a mirror selfie on a video call execution screen on the first display 400.

In one embodiment of the present disclosure, when the first electronic device 301 enters the mirror selfie operation, the first electronic device 301 captures an image using the second camera device (e.g., rear camera device) 108. In preparation for shooting, an image received from another electronic device (e.g., the second electronic device 302) that is making a video call with the first electronic device 301 may be displayed on the second display 131. .

For example, when the first electronic device 301 enters a mirror selfie operation, the user stands in front of the mirror and the user's image is displayed on another electronic device (e.g., the second electronic device 302) making a video call. The second display 131 can be directed toward the mirror. At this time, if the user of the second electronic device 302 consents to filming, and a filming request or capture command is transmitted to the first electronic device 301 based on the user's input, the first electronic device 301 displays the second display. An image showing the user of another electronic device (eg, the second electronic device 302) and the user of the first electronic device 301 displayed at 131 can be obtained.

In one embodiment of the present disclosure, if there is no request to enter the mirror selfie operation, the first electronic device 301 may branch from operation 403 to operation 423.

In one embodiment of the present disclosure, if there is a request to enter a mirror selfie operation, the first electronic device 301 may branch from operation 403 to operation 405.

In one embodiment of the present disclosure, if there is no request to enter a mirror selfie operation, the first electronic device 301 may maintain the video call in operation 423, under the control of the processor 320.

In one embodiment of the present disclosure, if there is a request to enter a mirror selfie operation, the first electronic device 301, under the control of the processor 320, displays a notification regarding the mirror selfie operation in operation 405. You can.

In one embodiment of the present disclosure, when there is a request to enter a mirror selfie operation, the first electronic device 301, under the control of the processor 320, in operation 405, sends another electronic device executing a video call ( Yes, a request for consent to a mirror selfie can be transmitted to the second electronic device 302.

In one embodiment of the present disclosure, while waiting for consent to a mirror selfie from another electronic device (e.g., the second electronic device 302), the first electronic device 301, under the control of the processor 320, In operation 405, a notification regarding the mirror selfie operation may be displayed on the first display 400. The notification regarding the mirror selfie operation may be a user interface indicating waiting for consent to the mirror selfie from the video call participant.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, determines whether a consent message for a mirror selfie has been received from the second electronic device 302 in operation 407. You can.

In one embodiment of the present disclosure, upon receiving a consent message for a mirror selfie from the second electronic device 302, the first electronic device 301 may branch from operation 407 to operation 409.

In one embodiment of the present disclosure, upon receiving a rejection message for the mirror selfie from the second electronic device 302, the first electronic device 301 may branch from operation 407 to operation 423.

In one embodiment of the present disclosure, upon receiving a rejection message for the mirror selfie from the second electronic device 302, the first electronic device 301, under control of the processor 320, makes a video call in operation 423. It can be maintained.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, displays the information of the other party participating in the video call on the sub-display (e.g., the second display 131) in operation 409. Images can be displayed. The image of the other party participating in the video call may be an image transmitted from the second electronic device 302.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, may determine whether the shooting quality is higher than a specified quality in operation 411.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, captures the image being acquired using the second camera device (e.g., rear camera device) 108 in operation 411. It can be displayed on the first display 400 as a preview image. At this time, the first electronic device 301, under the control of the processor 320, may determine whether the quality of the preview image is higher than the specified quality in operation 411. The quality of the preview image may be, for example, the clarity of the preview image and the degree of shaking of the preview image. However, it is not limited to this, and the first electronic device 301 detects the saturation of the preview image, the brightness of the preview image, the contrast of the preview image, and/or the hue of the preview image, etc. as the shooting quality, and the shooting quality is determined by the specified quality. You can judge whether it is abnormal or not.

For example, if the image being displayed on the second display 131 is acquired using the second camera device (eg, rear camera device) 108, light bleeding may occur due to the material characteristics of the display. The first electronic device 301 may detect image quality degradation, such as light blurring, on the preview image.

In one embodiment of the present disclosure, if it is determined that the shooting quality is higher than the specified quality, the first electronic device 301 may branch from operation 411 to operation 413.

In one embodiment of the present disclosure, if it is determined that the shooting quality is lower than the specified quality, the first electronic device 301 may branch from operation 411 to operation 425.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, may display a notification requesting confirmation of the shooting status on the first display 400 in operation 425. there is. The notification requesting confirmation of the shooting status includes information about the shooting quality detected by the first electronic device 301 and may request the user to move the shooting location or adjust the shooting lighting.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, captures the image being acquired using the second camera device (e.g., rear camera device) 108 in operation 413. It can be displayed on the first display 400 as a preview image. The first electronic device 301 can simultaneously process operations 413 and 411 under the control of the processor 320.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, determines whether there is a user's shooting request while displaying the preview image on the first display 400 in operation 415. You can judge. The first electronic device 301 may display a photographing button (eg, a photographing button icon) as a user interface on the first touchable display 400. When the user touches the photographing button, the first electronic device 301 may determine that there is a photographing request.

In one embodiment of the present disclosure, if there is a request to take a picture, the first electronic device 301 may branch from operation 415 to operation 417 under the control of the processor 320.

In one embodiment of the present disclosure, the first electronic device 301 may acquire the first image and the second image in operation 417 under the control of the processor 320.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, performs a countdown image (or, icon) can be displayed on the first display 400. The first electronic device 301 may acquire the first image and the second image after the countdown ends.

The first image is an image acquired using the second camera device (eg, rear camera device) 108. The second image may be an image transmitted from the second electronic device 302. The first image may include the subject of the video call participant displayed on the second display 131 and the subject of the user of the first electronic device 301. The second image may be an image captured from the image received from the second electronic device 302. The second image may include only the subject of the video call participant.

In one embodiment of the present disclosure, the first electronic device 301, under control of the processor 320, determines, at operation 419, that the quality of the third image associated with the second image included in the first image is equal to the specified quality. It is possible to determine whether or not it has been exceeded.

The third image may include the subject of a video call participant being displayed on the second display 131. The second image and the third image may include the subject of the video call participant. The third image may be an image displayed through the second display 131 and acquired by the second camera device 108, and the second image may be an image captured from the image received from the second electronic device 302.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, controls the sharpness, degree of shaking, saturation, brightness, and contrast of the third image related to the second image included in the first image. and/or it may be determined whether the color tone, etc. is equal to or greater than the specified quality.

In one embodiment of the present disclosure, if the quality of the third image associated with the second image included in the first image equals or exceeds the specified quality, the first electronic device 301 may branch from operation 419 to operation 421. there is.

In one embodiment of the present disclosure, if the quality of the third image related to the second image included in the first image is lower than the specified quality, the first electronic device 301 may branch from operation 419 to operation 427.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, stores the first image and the second image in operation 421, and stores the first image as a second image for the first electronic device 301 participating in the video call. 2 Can be transmitted to the electronic device 302.

In one embodiment of the present disclosure, the first electronic device 301 may correct the first image using the second image in operation 427, under the control of the processor 320. Under the control of the processor 320, the first electronic device 301 may correct the third image included in the first image to remove the third image and add the second image in operation 427. When a second image is added to the first image, the first electronic device 301, under the control of the processor 320, adjusts the size of the second image to correspond to the size of the second display 131 and the surrounding environment. You can adjust quality factors such as brightness and saturation of the image to match the quality.

FIG. 5 is a flowchart showing an image processing method of the second electronic device 302 according to an embodiment of the present disclosure.

In one embodiment of the present disclosure, the second electronic device 302 may execute a video call in operation 501 under the control of a processor (e.g., processor 320 of FIG. 3).

The first electronic device 301 and the second electronic device 302 may include the same components. For example, the second electronic device 302 may include the same components as the first electronic device 301 mentioned in FIGS. 1A to 3 . However, it is not limited to this.

In one embodiment of the present disclosure, the second electronic device 302, under the control of a processor (e.g., the processor 320 of FIG. 3), communicates the first electronic device 302 through a communication module (e.g., the communication module 390 of FIG. 3). A video call can be made with the electronic device 301.

In one embodiment of the present disclosure, when a video call is executed, the second electronic device 302 displays an image acquired through a camera device (e.g., the camera devices 105 and 108 of FIGS. 1A to 2B) and an input device ( For example, sound acquired through the input device 103 of FIGS. 1A to 2B can be transmitted to the first electronic device 301 through a communication module (eg, the communication module 390 of FIG. 3 ). The second electronic device 302 may receive images and sounds transmitted from the first electronic device 301 through (eg, the communication module 390 of FIG. 3). The second electronic device 302 transmits the received image and sound to an audio output device (e.g., the audio output devices 101 and 102 of FIGS. 1A and 2B) and a first display (e.g., the first display of FIGS. 1A and 2B). It may be output through the display 400) and/or the second display 131 (eg, the second display 131 in FIGS. 1A to 2B).

In one embodiment of the present disclosure, the second electronic device 302, under the control of a processor (e.g., the processor 320 of FIG. 3), receives a request to enter a mirror selfie operation from the first electronic device 301 in operation 503. You can determine whether it exists or not.

If there is a request to enter the mirror selfie operation from the first electronic device 301, the second electronic device 302 may branch from operation 503 to operation 505.

If there is no request to enter the mirror selfie operation from the first electronic device 301, the second electronic device 302 may branch from operation 503 to operation 513.

In one embodiment of the present disclosure, the second electronic device 302 may maintain a video call in operation 513 under the control of a processor (e.g., processor 320 of FIG. 3).

In one embodiment of the present disclosure, the second electronic device 302, under the control of a processor (e.g., the processor 320 of FIG. 3), displays a notification regarding mirror selfie entry on the first display (e.g., FIG. 3) in operation 505. It can be displayed on the first display 400 of FIGS. 1A to 2B.

The notification regarding mirror selfie entry may be a notification asking whether to accept or reject a request to take a mirror selfie from the first electronic device 301. Notifications regarding access to the mirror selfie may be displayed as a pop-up.

In one embodiment of the present disclosure, the second electronic device 302, under the control of a processor (e.g., the processor 320 of FIG. 3), may determine whether an input for consent has been received in operation 507. When the second electronic device 302 displays a notification regarding mirror selfie entry, the second electronic device 302 may receive a selection input of consent or rejection based on a user input.

In one embodiment of the present disclosure, upon receiving an input for consent, the second electronic device 302 may branch from operation 507 to operation 509.

In one embodiment of the present disclosure, upon receiving an input for rejection, the second electronic device 302 may branch from operation 507 to operation 513.

In one embodiment of the present disclosure, the second electronic device 302 may display guide information regarding image capturing in operation 509 under the control of a processor (e.g., the processor 320 of FIG. 3 ).

In one embodiment of the present disclosure, the guide information regarding image taking is information for obtaining an image of the same or higher quality as the specified quality, and is provided to the second electronic device 302 or the user of the second electronic device 302. It may include a request to move location or adjust shooting lighting.

In one embodiment of the present disclosure, guide information regarding image capture may include a countdown image regarding the start of image capture.

In one embodiment of the present disclosure, the first electronic device 301 displays a countdown image (or icon) on the first display 400 before acquiring the first image and the second image according to the shooting request. You can. At the same time, the second electronic device 302 may also display a countdown image.

In one embodiment of the present disclosure, the second electronic device 302, under the control of a processor (e.g., the processor 320 of FIG. 3), in operation 511, when the image capturing operation of the first electronic device 301 is completed , the first image (first image in FIG. 4) can be received and stored.

FIG. 6 is a flowchart showing an image processing method of the first electronic device 301 and the second electronic device 302 according to an embodiment of the present disclosure.

In one embodiment of the present disclosure, the first electronic device 301 and the second electronic device 302 may perform a video call in operation 601.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, may request the second electronic device 302 to enter a mirror selfie operation in operation 603.

In one embodiment of the present disclosure, the second electronic device 302, under the control of a processor (e.g., the processor 320 of FIG. 3), requests entry of the mirror selfie operation of the first electronic device 301 in operation 605. may be accepted, and a message regarding consent to the entry request may be transmitted to the first electronic device 301.

In one embodiment of the present disclosure, upon receiving a message regarding entry request consent, the first electronic device 301 displays the sub-display (or second display 131) in operation 607, under the control of the processor 320. ) can display the image transmitted from the second electronic device 301.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, displays guide information regarding mirror selfie shooting on the first display 400 in operation 609, and displays the second display 400. It can be transmitted to the electronic device 302.

In one embodiment of the present disclosure, the second electronic device 302, under the control of a processor (e.g., the processor 320 of FIG. 3), displays guide information about mirror selfie shooting on the first display (e.g., the mirror selfie capture) in operation 611. , can be displayed on the first display 400 of FIGS. 1A to 2B.

In one embodiment of the present disclosure, the guide information regarding image taking is information for obtaining an image of the same or higher quality as the specified quality, and is provided to the first electronic device 301 or the user of the first electronic device 301. It may include a request to move location or adjust shooting lighting.

In one embodiment of the present disclosure, the guide information regarding image taking is information for obtaining an image of the same or higher quality as the specified quality, and is provided to the second electronic device 302 or the user of the second electronic device 302. It may include a request to move location or adjust shooting lighting.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, may determine whether there is a user's request to take a photo in operation 611. The first electronic device 301 may display a photographing button (eg, a photographing button icon) as a user interface on the first touchable display 400. When the user touches the photographing button, the first electronic device 301 may determine that there is a photographing request. The first electronic device 301, under the control of the processor 320, may determine whether there is a user's request to take a photo while displaying the preview image in operation 611.

In one embodiment of the present disclosure, if there is a user's request to take a photo, the first electronic device 301 may branch from operation 613 to operation 615.

In one embodiment of the present disclosure, if there is no user's request for photography, the first electronic device 301 may branch from operation 613 to operation 609.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, may determine whether the quality of the captured image is higher than the specified quality in operation 615.

If the quality of the captured image is higher than the specified quality, the first electronic device 301 may branch from operation 615 to operation 617.

If the quality of the captured image is lower than the specified quality, the first electronic device 301 may branch from operation 615 to operation 619.

The captured image in FIG. 6 may be the first image and the second image in FIG. 4 . The first electronic device 301, under the control of the processor 320, may determine whether the quality of the third image associated with the second image included in the first image is equal to or exceeds the specified quality in operation 615. there is.

The third image may include the subject of a video call participant being displayed on the second display 131. The second image and the third image may include the subject of the video call participant. The third image may be an image displayed through the second display 131 and acquired by the second camera device 108, and the second image may be an image captured from the image received from the second electronic device 302.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, controls the sharpness, degree of shaking, saturation, brightness, and contrast of the third image related to the second image included in the first image. and/or it may be determined whether the color tone, etc. is equal to or greater than the specified quality.

In one embodiment of the present disclosure, the first electronic device 301, under the control of the processor 320, stores the captured images (e.g., the first image and the second image) in operation 617 and makes a video call. It can be transmitted to the participating second electronic device 302.

In one embodiment of the present disclosure, the first electronic device 301 may perform image correction in operation 619 under the control of the processor 320. The first electronic device 301, under the control of the processor 320, may correct the first image using the second image in operation 619. Under the control of the processor 320, the first electronic device 301 may correct the third image included in the first image to remove the third image and add the second image in operation 619. When a second image is added to the first image, the first electronic device 301, under the control of the processor 320, adjusts the size of the second image to correspond to the size of the second display 131 and the surrounding environment. You can adjust quality factors such as brightness and saturation of the image to match the quality.

In one embodiment of the present disclosure, the second electronic device 302 receives and stores an image from the first electronic device 301 in operation 621, under the control of a processor (e.g., processor 320 in FIG. 3). You can.

FIG. 7A shows a screen when the first electronic device 301 makes a video call with the second electronic device 302 according to an embodiment of the present disclosure.

In FIG. 7A , when a video call is made with another electronic device, the first electronic device 301 may display an image 510 transmitted from the second electronic device 302.

The first electronic device 301 may display the image 520 acquired through the front camera 105 on the screen of the first display 400. The first electronic device 301 may display the image 510 transmitted from the second electronic device 302 along with the image 520 acquired through the front camera 105. The image 520 acquired through the front camera 105 may include the user of the first electronic device 301 or a video call participant as the subject. The image 510 transmitted from the second electronic device 302 may include the user of the second electronic device 302 or a video call participant as the subject. When a video call is made with another electronic device, the first electronic device 301 acquires the image 510 transmitted from the second electronic device 302 through the front camera 105 on the screen of the first display 400. In addition to one image 510, options 530 regarding video call operations may be displayed.

FIG. 7B is a diagram illustrating a case where an option 530 related to a video call operation is selected in the first electronic device 301 according to an embodiment of the present disclosure.

Referring to FIGS. 7A and 7B , when a user input for an option 530 related to a video call operation is received, the first electronic device 301 may display an option list 540. The option list 540 may be displayed as a pop-up. The option list 540 may include a list of items related to settings 540, other options 542, and/or mirror selfie 543. In order to enter the mirror selfie, the user can select an item related to mirror selfie (543) from the option list (540). When an item related to a mirror selfie (mirror selfie, 543) is selected, the first electronic device 301 may transmit the entry of the mirror selfie operation to the second electronic device 302 participating in the video call.

FIG. 7C is a diagram illustrating a case where the first electronic device 301 requests to enter a mirror selfie operation according to an embodiment of the present disclosure.

Referring to FIG. 7C, when the first electronic device 301 requests to enter the mirror selfie operation, a notification 550 regarding the mirror selfie operation is sent until the second electronic device 302 accepts or rejects the mirror selfie operation. ) can be displayed on the first display 400. The notification 550 regarding the mirror selfie operation may be a user interface indicating waiting for consent to the mirror selfie from the video call participant. For example, the notification 550 regarding the mirror selfie operation includes a sentence such as “waiting Lisa to get ready for mirror selfie...”, and the notification 550 regarding the mirror selfie operation may be displayed as a pop-up.

FIG. 7D is a diagram illustrating a case where a mirror selfie operation is entered in the first electronic device 301 according to an embodiment of the present disclosure.

In FIG. 7D, when the user of the second electronic device 302 accepts entry into the mirror selfie, the first electronic device 301 displays the other party participating in the video call on the sub-display (e.g., the second display 131). Images can be displayed. The image of the other party participating in the video call may be an image transmitted from the second electronic device 302.

At this time, the first electronic device 301 displays a preview image 560 related to the mirror selfie on the first display 400, and displays a user interface 570 related to the shooting button on the preview image 560. You can.

FIG. 7E is a diagram illustrating a case where a notification requesting confirmation of a shooting status is displayed on the first electronic device 301 according to an embodiment of the present disclosure.

In FIG. 7E, the first electronic device 301 displays a preview image 560 related to a mirror selfie on the first display 400, and displays a user interface 570 related to a shooting button on the preview image 560. It can be displayed.

If it is determined that the shooting quality is lower than the specified quality, the first electronic device 301 may display a notification 580 on the first display 400 requesting confirmation of the shooting status. The notification 580 requesting confirmation of the shooting status includes information about the shooting quality detected by the first electronic device 301 and may request the user to move the shooting location or adjust the shooting lighting. For example, a notification (580) requesting confirmation of the shooting status is "There is light blur in the cover screen image. Adjust the phone position." It contains text such as and can be displayed as a pop-up.

FIG. 7F is a diagram illustrating a case where a photographing command is transmitted from the first electronic device 301 according to an embodiment of the present disclosure.

The first electronic device 301 may display a countdown image (or icon) on the preview image 560 before acquiring the first image and the second image according to a shooting request.

FIG. 7G is a diagram illustrating a case where the first image is acquired by the first electronic device 301 according to an embodiment of the present disclosure.

In one embodiment of the present disclosure, the first electronic device 301 may acquire the first image 701 after the countdown ends. The first image 701 may be displayed on the first display 400 in a pop-up form.

FIG. 8A is a diagram illustrating a first image acquired by the first electronic device 301 according to an embodiment of the present disclosure.

The first image 701 is an image acquired through the rear camera 108 of the first electronic device 301, and shows the subject of the user 810 of the first electronic device 301 and the second electronic device 302. May include user 820.

The user 820 of the second electronic device 302 is displayed through the second display 131, so that an image that gives the impression that the users 810 and 820 are together can be obtained.

FIG. 8B is a diagram illustrating a second image 702 acquired by the first electronic device 301 according to an embodiment of the present disclosure.

The second image 702 may be an image transmitted from the second electronic device 302. The second image 702 may be an image captured from the image received from the second electronic device 302. The second image 702 may include only the subject of the video call participant. The first electronic device 301 can simultaneously store the first image 701 and the second image 702. Alternatively, the first electronic device 301 may use the second image 702 to correct the image of the user 820 of the second electronic device 302 included in the first image 501.

FIG. 9A shows a screen when the second electronic device 302 makes a video call with the first electronic device 301 according to an embodiment of the present disclosure.

In FIG. 9A , when a video call is made with another electronic device, the second electronic device 302 may display the image 910 transmitted from the first electronic device 301.

The second electronic device 302 displays an image 920 acquired through a front camera (e.g., 105 in FIGS. 1A to 2B) on the screen of the display (e.g., the first display 400 in FIGS. 1A to 2B). It can be displayed. The second electronic device 302 can display the image 910 transmitted from the first electronic device 301 together with the image 920 acquired through the front camera (e.g., 105 in FIGS. 1A to 2B). there is. The image 920 acquired through the front camera (eg, 105 in FIGS. 1A to 2B) may include the user of the second electronic device 302 or a video call participant as the subject. The image 910 transmitted from the first electronic device 301 may include the user of the first electronic device 301 or a video call participant as the subject.

FIG. 9B is a diagram illustrating a case where the second electronic device 302 requests entry into a mirror selfie operation from the first electronic device 301 according to an embodiment of the present disclosure.

The first electronic device 301 may request the second electronic device 302 to enter a mirror selfie operation. The second electronic device 302 may display a notification 930 notifying the entry of a mirror selfie operation. The notification 930 notifying the entry of the mirror selfie operation may include a text 933 notifying that there is a request to enter the mirror selfie operation from the first electronic device 301 and a notification of acceptance 931 or rejection 932. For example, the text 933 indicating that there is a request to enter a mirror selfie operation is something like "'Jisu' wants to take a mirror selfie with you. Changing the layout for the mirror selfie. /save your picture to a gallery." May contain phrases.

FIG. 9C is a diagram illustrating an image displayed by the second electronic device 302 when the first electronic device 301 enters a mirror selfie operation according to an embodiment of the present disclosure.

In FIG. 9C, when the user of the second electronic device 302 accepts the mirror selfie entry, the first electronic device 301 displays the other party participating in the video call on the sub display (e.g., the second display 131). Images can be displayed. The image 940 acquired through the rear camera 108 of the first electronic device 301 may be transmitted to the second electronic device 302 and displayed. The second electronic device 302 may also display the image 920 acquired through the front camera (eg, 105 in FIGS. 1A to 2B).

FIG. 9D is a diagram illustrating a case where the second electronic device 302 receives a notification requesting confirmation of a shooting status from the first electronic device 301 according to an embodiment of the present disclosure.

In FIG. 9D, if it is determined that the shooting quality is lower than the specified quality, the first electronic device 301 may transmit a notification 950 requesting confirmation of the shooting status to the second electronic device 302.

The second electronic device 302 may display a notification 950 requesting confirmation of the shooting status on the display. The second electronic device 302 can display a notification 950 requesting confirmation of the shooting status on the display together with the image 940 acquired through the rear camera 108 of the first electronic device 301. there is.

The notification 950 requesting confirmation of the shooting status includes information about the shooting quality detected by the first electronic device 301 and may request the user to move the shooting location or adjust the shooting lighting. For example, a notification (950) requesting confirmation of the shooting status is "There is light blur in the cover screen image. Adjust the phone position." It contains text such as and can be displayed as a pop-up.

FIG. 9E is a diagram illustrating the user interface of the second electronic device 302 when a photographing command is transmitted from the first electronic device 301 according to an embodiment of the present disclosure.

When mirror selfie shooting begins in the first electronic device 301, the second electronic device 302 displays a countdown image (or icon) 960 through the rear camera 108 of the first electronic device 301. It can be displayed on the display together with the acquired image 940.

FIG. 9F is a diagram illustrating a case where the second electronic device 302 acquires the first image from the first electronic device 301 according to an embodiment of the present disclosure.

While the second electronic device 302 is displaying the image 940 acquired through the rear camera 108 of the first electronic device 301, the first image previously acquired by taking a selfie from the first electronic device 301 (701) can be received and stored. When the first image 701 is saved, the second electronic device 302 may display a message 970 indicating that the photo has been saved.

Electronic devices according to various embodiments disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. In this document, “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “A. Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one component from another, and to refer to those components in other respects (e.g., importance or order) is not limited. One (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.” When mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are one or more instructions stored in a storage medium (e.g., built-in memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). It may be implemented as software (e.g., program 140) including these. For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves). This term refers to cases where data is stored semi-permanently in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or through an application store (e.g. Play StoreTM) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smartphones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a single entity or a plurality of entities. According to various embodiments, one or more of the components or operations described above may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.

Claims (20)

In an electronic device including a flexible display,
A first housing connected to a hinge structure, the first housing including a first surface facing in a first direction and a second surface facing in a second direction opposite to the first direction;
a second housing connected to the hinge structure, including a third surface facing in a third direction, a fourth surface facing in a fourth direction opposite to the third direction, and folded with the first housing structure about the hinge structure; housing;
A flexible device extends from the first side to the third side to form the first side and the third side, and includes a first region corresponding to the first side and a second region corresponding to the third side. 1 display;
a second display disposed on the second surface;
a first camera device disposed on at least a portion of the first surface;
a second camera device disposed on at least a portion of the second surface; and
Contains a processor,
The processor is
Make a video call,
While executing the video call, if there is a request to enter the mirror selfie operation, a notification regarding the mirror selfie operation is displayed,
When receiving a consent message for the mirror selfie operation from another electronic device, control to display an image transmitted from the other party making the video call on the second display,
An electronic device that controls shooting using the second camera device when there is a shooting command.
According to clause 1,
The processor is
Determine whether the shooting quality is above the specified quality,
An electronic device that controls to display a preview image on the first display.
According to clause 2,
The processor is
An electronic device that controls to display a notification requesting confirmation of a shooting status on the first display when the shooting quality is lower than a specified quality.
According to clause 1,
The processor is
An electronic device that acquires a first image using the second camera device and acquires a second image from an image received from the other electronic device.
According to clause 4,
The processor is
An electronic device that determines whether the quality of a third image associated with the second image included in the first image equals or exceeds a specified quality.
According to clause 5,
The processor is
If the quality of the third image associated with the second image included in the first image is equal to or exceeds a specified quality, the first image and the second image are stored, and the first image is transmitted to the other electronic device. An electronic device that transmits to.
According to clause 6,
The processor is
An electronic device that corrects the first image using the second image when the quality of the third image related to the second image included in the first image is lower than a specified quality.
According to clause 1,
The processor is
An electronic device that displays a notification about entering the mirror selfie operation when receiving a request for entering the mirror selfie operation from the other electronic device.
According to clause 8,
The processor is
An electronic device that displays guide information regarding image taking when receiving an input accepting entry into the mirror selfie operation.
According to clause 9,
The processor is
An electronic device that receives and stores an image captured as a mirror selfie from the other electronic device.
In an image processing method for an electronic device including a flexible display,
making a video call;
During the video call, if there is a request to enter the mirror selfie operation, displaying a notification regarding the mirror selfie operation;
When receiving a consent message for the mirror selfie operation from another electronic device, controlling a sub-display to display an image transmitted from the other party making the video call; and
A method including an operation of taking a picture using a rear camera device disposed on the same side as the sub display when there is a picture command.
According to clause 11,
An operation to determine whether the shooting quality is greater than or equal to a specified quality; and
A method including displaying a preview image on the flexible display.
According to clause 12,
If the shooting quality is below a specified quality, displaying a notification requesting confirmation of the shooting status on the flexible display.
According to clause 11,
A method comprising acquiring a first image using the rear camera and acquiring a second image from an image received from the other electronic device.
According to clause 14,
A method comprising determining whether a quality of a third image associated with the second image included in the first image equals or exceeds a specified quality.
According to clause 15,
If the quality of the third image associated with the second image included in the first image is equal to or exceeds a specified quality, the first image and the second image are stored, and the first image is transmitted to the other electronic device. A method containing the action of sending to .
According to clause 16,
If the quality of the third image associated with the second image included in the first image is lower than a specified quality, correcting the first image using the second image.
According to clause 11,
When receiving a request for entering the mirror selfie operation from the other electronic device, displaying a notification regarding entering the mirror selfie operation.
According to clause 18,
A method comprising displaying guide information regarding image taking upon receiving an input accepting entry into the mirror selfie operation.
According to clause 19,
A method comprising receiving and storing an image captured as a mirror selfie from the other electronic device.

Images