KR102308201B1 - User terminal apparatus and control method thereof - Google Patents

Abstract

A user terminal device and a control method thereof are provided. The present user terminal device includes a display comprising a main display area disposed on the front of the user terminal device and a sub display area extending from one side of the main display area and disposed on at least one area of the rear side of the user terminal device, a camera for capturing an image, and The live view acquired through the camera is displayed on one of the main display area and the sub display area, and when the orientation of the user terminal device is changed, the display is configured to display the live view on the other of the main display area and the sub display area. It contains a controlling processor.

Description

User terminal device and its control method { USER TERMINAL APPARATUS AND CONTROL METHOD THEREOF }

The present invention relates to a user terminal device and a control method thereof, and more particularly, to a user terminal device and a control method thereof using a display disposed on the front and rear surfaces of the user terminal device when photographing.

BACKGROUND With the development of electronic technology, various types of electronic devices are being used in various fields. In particular, recently, an electronic device (Half Round Display) in which the display is extended to the rear side of the electronic device through out bending has been developed.

In general, a camera is provided on the back side of an electronic device, and as a display is provided on the back side of the electronic device, taking a selfie has become easier. In addition, even if only one camera is provided, it is possible to shoot while checking the shooting state using the rear display.

Accordingly, there is a need to secure various possibilities of using the rear display when using the photographing function.

SUMMARY OF THE INVENTION The present invention is to solve the above-described problems, and an object of the present invention is to provide a user terminal apparatus for controlling displays disposed on the front and rear surfaces of the user terminal apparatus based on a photographing situation, and a method for controlling the same.

A user terminal device according to an embodiment of the present invention for achieving the above object is a main display area disposed on the front side of the user terminal device, and extends from one side of the main display area to the rear surface of the user terminal device A display including a sub display area disposed in at least one area, a camera for capturing an image, and a live view acquired through the camera are displayed in one of the main display area and the sub display area, and the direction of the user terminal device ( orientation) is changed, and a processor controlling the live view to be displayed on the other one of the main display area and the sub display area.

In addition, the processor displays the live view on the main display area and does not provide information on the sub display area, and displays the live view on the sub display area when the direction of the user terminal device is changed, and Information may not be provided in the display area.

In addition, the processor displays the live view in the sub display area and does not provide information to the main display area, and when a user touch is detected in the main display area, an image may be captured and stored in response to the user touch. have.

In addition, when a swipe interaction in a preset direction is sensed from any one point in the main display area, the processor may change the shooting setting value to correspond to the preset direction.

Then, the processor displays the live view on the main display area, and when it is recognized that a human face is included in the live view, displays the display to display the face area included in the live view on the sub display area. can be controlled

Also, the processor may control the display to display on the sub display region by cropping one region of the live view to correspond to the size of the sub display region.

In addition, the processor may display the live view on the main display area, and when it is recognized that a person is included in the live view, control the display to display an animation on the sub display area.

In addition, the processor determines the distance to the subject, displays the live view on the sub display area if the determined distance is less than a preset distance, and displays the live view if the determined distance is greater than the preset distance The display may be controlled to display on the main display area.

And, it further includes a plurality of sensors, wherein the processor may determine that the direction of the user terminal device is changed based on at least one of a position, a movement, and a user's grip of the user terminal device sensed by the plurality of sensors have.

In addition, the processor is configured to change the direction of the user terminal device when a face of a person having a size larger than a preset size is recognized in the live view or when the face of a person is not recognized in a state where a face of a person larger than the preset size is recognized. can be considered to have changed.

On the other hand, according to an embodiment of the present invention for achieving the above object, the main display area disposed on the front of the user terminal device and the main display area extending from one side of the main display area are disposed on at least one area of the rear side of the user terminal device A method of controlling a user terminal device including a display configured with a sub display region that becomes and displaying the live view on the other one of the main display area and the sub display area when the orientation of the user terminal device is changed.

In addition, the displaying in one of the main display area and the sub display area may include displaying the live view in the main display area and not providing information to the sub display area, and selecting one of the main display area and the sub display area. In the displaying on the other one, when the direction of the user terminal device is changed, the live view may be displayed on the sub display area and information may not be provided on the main display area.

And, the displaying on the other one of the main display area and the sub display area includes displaying the live view in the sub display area and not providing information to the main display area, and detecting a user's touch in the main display area The method may further include capturing and storing an image in response to the user's touch.

The method may further include, when a swipe interaction in a preset direction is detected from any one point in the main display area, changing a shooting setting value to correspond to the preset direction.

The displaying of the live view on the other one of the main display area and the sub display area includes displaying the live view on the main display area, and when it is recognized that a human face is included in the live view, it is included in the live view The method may further include displaying the displayed face area on the sub display area.

In addition, the displaying on the sub display region may include cropping one region of the live view to correspond to the size of the sub display region and displaying the cropped region on the sub display region.

The displaying of the live view on the other one of the main display area and the sub display area includes displaying the live view on the main display area, and when it is recognized that a person is included in the live view, an animation is displayed on the sub display area It may further include the step of

In addition, the displaying on one of the main display area and the sub display area may include determining a distance to the subject, and displaying the live view on the sub display area if the determined distance is smaller than a preset distance, If the determined distance is greater than the preset distance, the live view may be displayed on the main display area.

And, the method further comprises the step of detecting at least one of a position, a movement, and a user's grip of the user terminal device, wherein the displaying on the other one of the main display area and the sub display area includes the location of the user terminal device, It may be determined that the direction of the user terminal device is changed based on at least one of the movement and the user's grip.

In addition, the step of displaying on the other one of the main display area and the sub display area may include a face of a person having a size larger than a preset size recognized in the live view, or a face of a person having a face size larger than the preset size being recognized in the live view. When the face is not recognized, it may be determined that the direction of the user terminal device is changed.

According to various embodiments of the present disclosure as described above, the user terminal device controls the displays disposed on the front and rear surfaces of the user terminal device based on various shooting situations so that the user can easily perform shooting.

1A and 1B are diagrams for explaining an example of a display structure of a user terminal device.
2A is a block diagram illustrating a configuration of a user terminal device according to an embodiment of the present invention.
2B is a block diagram illustrating an example of a detailed configuration of a user terminal device.
2C is a diagram for explaining various modules stored in storage.
3 is a diagram for explaining an example in which only one of a main display area, a sub display area, and a round display area is used.
FIG. 4 is a diagram for explaining an example in which at least two of a main display area, a sub display area, and a round display area are used.
5 is a diagram for explaining an example of an operation according to each region and a touch input.
6 is a diagram for explaining an operation when an orientation of a user terminal device is changed according to an embodiment of the present invention.
7A and 7B are diagrams for explaining an example of a method of changing an image provided according to a display area.
8A and 8B are diagrams for explaining an example of a method of executing a specific function through the main display area.
9 is a diagram for explaining a method of displaying a live view in both the main display area and the sub display area according to an embodiment of the present invention.
10 is a diagram for explaining a method of displaying a live view in a main display area and specific content in a sub display area according to an embodiment of the present invention.
11A and 11B are diagrams for explaining an example of a method of determining a region for displaying a live view. FIG. 12 is a method for detecting a change in the direction of a user terminal device according to an embodiment of the present invention It is a drawing for explanation.
13A and 13B are diagrams for explaining an example of an operation according to a direction change of a user terminal device.
14A and 14B are diagrams for explaining an example of a method for executing a photographing function.
15 is a diagram for explaining a method of using a round display area according to an embodiment of the present invention.
16 is a view for explaining a case in which a camera is provided on the front of the user terminal device according to another embodiment of the present invention.
17A to 17C are diagrams for explaining an example in which other applications are used.
18A and 18B are diagrams for explaining an example of a configuration of a display.
19 is a flowchart illustrating a method of controlling a user terminal device according to an embodiment of the present invention.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. It should be understood that the content described herein is not intended to limit the scope of the present invention to specific embodiments, and includes various modifications, equivalents, and/or alternatives of the embodiments. In connection with the description of the drawings, the same or similar reference numerals may be used for similar components.

In addition, expressions such as "first," "second," used in this specification are used to distinguish various elements from each other, regardless of order or importance. Accordingly, the order or importance of the corresponding components is not limited by these expressions. For example, without departing from the scope of the rights described in this document, a first component may be referred to as a second component, and similarly, the second component may also be renamed as a first component.

In addition, in the present specification, one component (eg, a first component) is functionally or communicatively coupled to, or connected to, another component (eg, a second component) It should be understood that stating that there is (connected to) may include all of the cases in which each element is directly connected or indirectly connected through another element (eg, a third element). On the other hand, when it is said that a component (eg, a first component) is "directly connected" or "directly connected" to another component (eg, a second component), a component different from a component It may be understood that no other component (eg, a third component) exists between the elements.

Terms used in this specification (disclosure) are used to describe certain embodiments, and may not be intended to limit the scope of other embodiments. In addition, although a singular expression may be used in the present specification for convenience of description, it may be interpreted to include a plural expression unless the context clearly indicates otherwise. In addition, terms used herein may have the same meanings as commonly understood by those of ordinary skill in the art. Among the terms used herein, terms defined in a general dictionary may be interpreted with the same or similar meaning as the meaning in the context of the related art, and unless explicitly defined in the present specification, have ideal or excessively formal meanings. is not interpreted as In some cases, even the terms defined in this specification cannot be construed to exclude the embodiments of the present specification.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1A and 1B are diagrams for explaining an example of a display structure of the user terminal device 100 .

The left view of FIG. 1A shows the front side of the user terminal device 100 , and the right side view of FIG. 1A shows the rear side of the user terminal device 100 . A front display is disposed on the front of the user terminal device 100 , and a rear display and a camera are disposed on the rear of the user terminal device 100 . The front display and the rear display may be connected to each other, and the rear display may be smaller than the front display. However, the present invention is not limited thereto, and the front display and the rear display may have the same size. Also, the camera may be disposed on the front of the user terminal device 100 . Hereinafter, the front display will be described as the main display area 10 and the rear display will be described as the sub display area 20 .

The left figure of FIG. 1B shows a front view of the entire display in which the main display area 10, the sub display area 20, and the round display area 30 are connected, and the right figure of FIG. 1B shows a rear view of the entire display.

The sub display area 20 may extend from one side of the main display area 10 and may be disposed on at least one area of the rear surface of the user terminal device 100 . In particular, the sub display area 20 may extend to be bent from the upper side of the main display area 10 . The bent region may have a curved shape, but is not limited thereto, and may form an angle depending on the type of display.

The round display area 30 is an area connecting the main display area 10 and the sub display area 20 . As described above, the round display area 30 may have a curved shape or an angular shape. The round display area 30 is separated from the main display area 10 and the sub display area 20 by boundary lines 30 - 1 and 30 - 2 .

The boundary lines 30 - 1 and 30 - 2 illustrated in FIG. 1B are merely exemplary, and the boundary lines 30 - 1 and 30 - 2 may be changed as much as possible. In addition, the boundary lines 30 - 1 and 30 - 2 may be determined by the manufacturer at the time of manufacture, but may be changed by the user. When the boundary lines 30 - 1 and 30 - 2 are changed, the area sizes of the main display area 10 , the sub display area 20 , and the round display area 30 are changed, and the size of content displayed in each area is changed. may be changed.

On the other hand, although FIGS. 1A and 1B show that the upper side of the user terminal device 100 is covered, it is also possible to cover any one of the lower side, the left side, and the right side of the user terminal device 100 . In addition, a configuration that surrounds a plurality of side surfaces instead of one side is also possible.

Meanwhile, the display surrounds the touch pad, and the display and the touch pad form a mutually layered structure to be implemented in the form of a touch screen. In this case, the touch pad is also bent similarly to the display, so that the touch input may be input opposite to what the user thinks. For example, when the user drags from a point on the main display area 10 to an upper point and when dragging from a point on the sub display area 10 to an upper point, the user touches in the same direction except for a difference in the touch area. can be judged as However, since the touchpad is curved, the direction of dragging from a point on the main display area 10 to an upper point and when dragging from one point on the sub display area 10 to an upper point are reversed. Accordingly, the user terminal device 100 may be set to recognize the direction of the touch input in one area in the opposite direction. For this, specific details are omitted as they go beyond the scope of the present invention.

Meanwhile, as the main display area 10 , the sub display area 20 , and the round display area 30 are connected, various sensors and receivers may be provided on the side or the lower side of the user terminal device 100 , in particular A directional server may be provided. Alternatively, the receiver may be provided in an integrated cover capable of interworking with the user terminal device 100 . On the other hand, when the receiver is provided at the bottom, the processor 130 may display the display by inverting the top and bottom during a phone call.

Hereinafter, a structure in which the sub display area 20 extends from the main display area 10 through the curved round display area 30 and a camera disposed at the rear of the user terminal device 100 will be described. In addition, a case where the positions of the display and the camera having a different structure are changed will also be described by expanding the embodiment.

And, hereinafter, the direction from the main display area 10 and the sub display area 20 toward the round display area 30 will be described as the upper side of the user terminal device 100 and the opposite side of the user terminal device 100 as the lower side. The left and right sides are described based on the display area the user is looking at. Accordingly, the left and right sides of the case where the user looks at the main display area 10 and the case where the user looks at the sub display area 20 will be described in reverse.

2A is a block diagram illustrating a configuration of a user terminal device 100 according to an embodiment of the present invention.

According to FIG. 2A , the user terminal device 100 includes a display 110 , a camera 120 , and a processor 130 .

Meanwhile, FIG. 2A shows various components in a comprehensive manner, taking the user terminal device 100 as a device having various functions, such as a display function and a control function, as an example. Accordingly, according to an embodiment, some of the components shown in FIG. 2A may be omitted or changed, and other components may be further added.

The display 110 includes a main display area 10 disposed on the front of the user terminal device 100 , and a sub-display area extending from one side of the main display area 10 and disposed on at least one area of the rear surface of the user terminal device 100 . The display area 20 and the round display area 30 connecting the main display area 10 and the sub display area 20 may be included. However, the present invention is not limited thereto, and for example, the sub display area 20 may be configured to completely cover the rear surface of the user terminal device 100 .

Here, the front and back are words used for convenience of description, and are not particularly limited to the meaning of the words. For example, for a specific electronic device, one side and the other side may be used. Meanwhile, although it has been described as extending from one side of the main display area 10 , the present invention is not limited thereto. For example, it may extend from all sides of the main display area 10 to cover the entire user terminal device 100 with the display.

The sub display area 20 of the display 110 may extend to be bent from the upper side of the main display area 10 and may be disposed in the upper area of the rear surface. For example, when the main display area 10 and the sub display area 20 are viewed from the side, the connecting portion may form a curve like a 'U'. However, the present invention is not limited thereto, and when the main display area 10 and the sub display area 20 are viewed from the side, the connecting portion may form an angle of 90° like a 'C'. In addition, various connection parts may be formed based on the shape of the user terminal device 100 .

The display 110 may display various UIs under the control of the processor 130 . For example, the display 110 may display a live view, a gallery application, an animation, and the like.

The display 110 may display different contents in the main display area 10 , the sub display area 20 , and the round display area 30 under the control of the processor 130 . For example, the display 110 may display a moving picture in the main display area 10 , an image in the sub display area 20 , and a UI for message transmission in the round display area 30 . .

Alternatively, the display 110 may display content by interlocking at least two of the main display area 10 , the sub display area 20 , and the round display area 30 . For example, the display 110 may display a video on the main display area 10 and a UI for controlling the video on the sub display area 20 . In addition, the display 110 may display a UI for providing a function unrelated to a video on the round display area 30 .

Alternatively, the display 110 may display the same content in at least two of the main display area 10 , the sub display area 20 , and the round display area 30 . For example, the display 110 may display the same content in the main display area 10 and the sub display area 20 , and display separate content in the round display area 30 .

The display 110 may be implemented as a liquid crystal display panel (LCD), an organic light emitting diode (OLED) display, a plasma display panel (PDP), or the like, but is not limited thereto. In addition, the display 110 may be implemented as a transparent display, a flexible display, etc. in some cases.

The camera 120 is configured to capture a still image or a moving image according to a user's control. The camera 120 may capture still images at a specific point in time, but may also continuously capture still images. The camera 120 provides the acquired image to the display 110 , and a live view may be displayed on at least one of the main display area 10 and the sub display area 20 . The camera 120 may photograph a user or photograph a background image according to the orientation of the user terminal device 100 . The camera 120 may be implemented in plurality, such as a front camera and a rear camera.

The camera 120 includes a lens, a shutter, an iris, a solid-state imaging device, an analog front end (AFE), and a timing generator (TG). The shutter adjusts the time at which the light reflected from the subject enters the user terminal device 100 , and the diaphragm adjusts the amount of light incident on the lens by mechanically increasing or decreasing the size of the opening through which the light enters. In the solid-state imaging device, when light reflected by a subject is accumulated as photocharges, the solid-state imaging device outputs an image of the photocharges as an electrical signal. The TG outputs a timing signal for reading out pixel data of the solid-state imaging device, and the AFE samples and digitizes the electrical signal output from the solid-state imaging device.

The processor 130 may control the overall operation of the user terminal device 100 .

The processor 130 displays the live view acquired through the camera 120 on one of the main display area 10 and the sub display area 20 , and when the orientation of the user terminal device 100 is changed, the live view The display 110 may be controlled to display the view on the other one of the main display area 10 and the sub display area 20 . The processor 130 may determine that the direction of the user terminal device 100 is changed using a gravity sensor, an acceleration sensor, and a gyro sensor. Alternatively, the processor 130 may analyze the live view acquired by the camera 120 to determine that the direction of the user terminal device 100 is changed. However, the present invention is not limited thereto, and the processor 130 may change the area in which the live view is to be displayed by moving, shaking, etc. in a specific direction as well as the direction of the user terminal device.

The processor 130 may display a live view and additionally display a guide line. In addition, the processor 130 may display a GUI for executing a gallery app, a GUI for executing an image correction app, etc. in addition to a GUI for photographing.

The processor 130 displays the live view in the main display area 10 and does not provide information to the sub display area 20 , and when the direction of the user terminal device 100 is changed, the live view is displayed in the sub display area 20 . may be displayed, and information may not be provided in the main display area 10 . As a method of not providing information, there may be various methods such as a method of not supplying power to the display 110 , a method of displaying the display 110 in black, and the like.

Meanwhile, the processor 130 may activate the touch function of the main display area 10 while displaying the live view on the sub display area 20 and not providing information to the main display area 10 . When a user touch is detected in the main display area 10 , the processor 130 may capture and store an image in response to the user's touch.

Here, when a swipe interaction in a preset direction is detected from any one point in the main display area 10 , the processor 130 may change the shooting setting value to correspond to the preset direction.

Meanwhile, the processor 130 displays the live view on the main display area 10 , and when it is recognized that a human face is included in the live view, displays the face area included in the live view on the sub display area 20 . The display 110 may be controlled.

Here, the processor 130 may control the display 110 to display on the sub display region 20 by cropping one region of the live view to correspond to the size of the sub display region 20 .

In addition, the processor 130 may display the live view on the main display area 10 , and when it is recognized that a person is included in the live view, the processor 130 may control the display 110 to display an animation on the sub display area 20 . .

Meanwhile, the processor 130 determines the distance to the subject, and displays the live view on the sub display area 20 if the determined distance is smaller than the preset distance, and displays the live view if the determined distance is greater than the preset distance. The display 110 may be controlled to display on the main display area 10 .

On the other hand, the user terminal device 100 further includes a plurality of sensors, and the processor 130 is the user terminal based on at least one of a position, a movement, and a user's grip of the user terminal device 100 sensed by the plurality of sensors. It may be determined that the direction of the device 100 is changed.

Alternatively, the processor 130 determines the direction of the user terminal device 100 when a face of a person having a size greater than or equal to a preset size is recognized in the live view, or when a face of a person greater than or equal to a preset size is not recognized in a state in which a face of a person greater than or equal to a preset size is recognized. It can be considered that this has changed.

2B is a block diagram illustrating an example of a detailed configuration of the user terminal device 100 . According to FIG. 2B , the user terminal device 100 includes a display 110 , a camera 120 , a processor 130 , a GPS chip 135 , a storage 140 , a detection unit 145 , a communication unit 150 , and a user. It includes an interface unit 155 , an audio processing unit 160 , a video processing unit 170 , a speaker 180 , a button 181 , and a microphone 182 . Among the components shown in FIG. 2B , detailed descriptions of parts overlapping with those shown in FIG. 2A will be omitted.

The display 110 may be divided into a main display area 10 , a sub display area 20 , and a round display area 30 as described above. The display 110 may be implemented as various types of displays, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a plasma display panel (PDP), and the like. The display 110 may also include a driving circuit, a backlight unit, and the like, which may be implemented in the form of an a-si TFT, a low temperature poly silicon (LTPS) TFT, or an organic TFT (OTFT). Meanwhile, the display 110 may be implemented as a touch screen in combination with the touch sensing unit included in the sensing unit 145 .

In this case, the touch sensing unit may include at least one of a touch panel and a pen recognition panel. The touch panel may detect a user's finger gesture input and output a touch event value corresponding to the sensed touch signal. The touch panel may be mounted under at least one of the main display area 10 , the sub display area 20 , and the round display area 30 of the display 110 .

A method for the touch panel to sense a user's finger gesture input may include a capacitive type and a pressure sensitive type. The capacitive method is a method of calculating touch coordinates by sensing micro-electricity caused by the user's body. The decompression type is a method of calculating touch coordinates by sensing that current flows by contacting the upper and lower plates of the touched point, including two electrode plates built into the touch panel.

The pen recognition panel detects a user's pen gesture input according to the user's operation of a touch pen (eg, a stylus pen or a digitizer pen), and outputs a pen proximity event value or a pen touch event value can do. The pen recognition panel may be mounted under at least one of the main display area 10 , the sub display area 20 , and the round display area 30 of the display 110 .

The pen recognition panel may be implemented, for example, in an EMR method, and may detect a touch or proximity input according to the proximity of the pen or a change in the intensity of an electromagnetic field due to the touch. In detail, the pen recognition panel includes an electromagnetic induction coil sensor (not shown) having a grid structure and an electronic signal processing unit (not shown) that sequentially provides an AC signal having a predetermined frequency to each loop coil of the electromagnetic induction coil sensor can be configured. When a pen having a built-in resonance circuit is present in the vicinity of the loop coil of the pen recognition panel, a magnetic field transmitted from the loop coil generates a current based on mutual electromagnetic induction in the resonance circuit in the pen. Based on this current, an induced magnetic field is generated from the coil constituting the resonance circuit in the pen, and the pen recognition panel detects this induced magnetic field in the loop coil in the signal receiving state, so that the approach or touch position of the pen is can be detected.

The pen recognition panel may be configured differently for each display area. For example, both the touch panel and the pen recognition panel may be provided in the main display area 10 , and only the touch panel may be provided in the sub display area 20 and the round display area 30 .

The processor 130 may deactivate the specific panel by turning off the power of the specific panel. Alternatively, the processor 130 supplies power to the touch panel and the pen recognition panel and receives a touch or pen input, but may inactivate the specific panel by ignoring the input to the specific panel by software.

In this case, depending on whether the touch panel and the pen recognition panel corresponding to the main display area 10 are activated, at least one of a hand touch and a pen touch may be input. For example, only the touch panel may be activated to receive only the hand touch input without receiving the pen touch input, or only the pen recognition panel may be activated to receive only the pen touch input without receiving the hand touch input.

Alternatively, the touch panel and the pen recognition panel may be provided in the entire display area, and the pen recognition panel in a partial area may be inactivated. For example, the processor 130 may inactivate only the pen recognition panel corresponding to the sub display area 20 and the round display area 30 .

Meanwhile, the touch panel and the pen recognition panel may be implemented as one panel. In this case, the processor 130 may detect a touch input and a pen input through the entire display area.

When the touch panel and the pen recognition panel are implemented as one panel, the processor 130 may perform an operation corresponding to the input based on at least one of an input type and an input area. For example, the processor 130 may ignore a specific input such as a pen input by software. Alternatively, the processor 130 may ignore the pen input to the sub display area 20 by software.

The processor 130 generally controls the operation of the user terminal device 100 using various programs stored in the storage 140 .

Specifically, the processor 130 includes the RAM 131 , the ROM 132 , the main CPU 133 , the graphic processing unit 134 , the first to n interfaces 135-1 to 135-n, and the bus 136 . include

The RAM 131 , the ROM 132 , the main CPU 133 , the graphic processing unit 134 , the first to n interfaces 135 - 1 to 135 - n, etc. may be connected to each other through the bus 136 .

The first to n-th interfaces 135-1 to 135-n are connected to the various components described above. One of the interfaces may be a network interface connected to an external device through a network.

The main CPU 133 accesses the storage 140 and performs booting using the O/S stored in the storage 140 . Then, various operations are performed using various programs stored in the storage 140 .

The ROM 132 stores an instruction set for system booting, and the like. When a turn-on command is input and power is supplied, the main CPU 133 copies the O/S stored in the storage 140 to the RAM 131 according to the command stored in the ROM 132, and executes the O/S to the system boot up When booting is completed, the main CPU 133 copies various application programs stored in the storage 140 to the RAM 131 , and executes the application programs copied to the RAM 131 to perform various operations.

The graphic processing unit 134 generates a screen including various objects such as icons, images, and texts by using an operation unit (not shown) and a rendering unit (not shown). An operation unit (not shown) calculates attribute values such as coordinate values, shape, size, color, etc. of each object to be displayed according to the layout of the screen based on the received control command. The rendering unit (not shown) generates screens of various layouts including objects based on the attribute values calculated by the calculation unit (not shown). The screen generated by the rendering unit (not shown) is displayed in the display area of the display 110 .

Meanwhile, the above-described operation of the processor 130 may be performed by a program stored in the storage 140 .

The storage 140 stores various data such as an O/S (Operating System) software module, a photographing module, and an application module for driving the user terminal device 100 .

In this case, the processor 130 may process and display the input image based on the information stored in the storage 140 .

The GPS chip 145 is a component for receiving a GPS signal from a Global Positioning System (GPS) satellite and calculating the current location of the user terminal device 100 . The processor 130 may calculate the user's location by using the GPS chip 145 when using a navigation program or when the user's current location is required.

The communication unit 150 is configured to communicate with various types of external devices according to various types of communication methods. The communication unit 150 includes a Wi-Fi chip 151 , a Bluetooth chip 152 , a wireless communication chip 153 , an NFC chip 154 , and the like. The processor 130 communicates with various external devices using the communication unit 150 .

The Wi-Fi chip 151 and the Bluetooth chip 152 perform communication using a WiFi method and a Bluetooth method, respectively. In the case of using the Wi-Fi chip 151 or the Bluetooth chip 152, various types of connection information such as an SSID and a session key are first transmitted/received, and then various types of information may be transmitted/received after communication connection using them. The wireless communication chip 153 refers to a chip that performs communication according to various communication standards such as IEEE, Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), and Long Term Evoloution (LTE). The NFC chip 154 refers to a chip operating in a Near Field Communication (NFC) method using a 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz, and 2.45 GHz.

Meanwhile, the communication unit 150 may perform one-way communication or two-way communication with the electronic device. When performing one-way communication, the communication unit 150 may receive a signal from the electronic device. When performing bidirectional communication, the communication unit 150 may receive a signal from the electronic device or transmit a signal to the electronic device.

The user interface unit 155 receives various user interactions. When the user terminal device 100 is implemented as a touch-based portable terminal, the user interface unit 155 may be implemented in the form of a touch screen that forms a layer structure with a touch pad. In this case, the user interface unit 155 can be used as the above-described display 110 .

The sensing unit (not shown) includes a touch sensor, a geomagnetic sensor, a gyro sensor, an acceleration sensor, a proximity sensor, a grip sensor, and the like. The sensing unit may sense various manipulations such as rotation, tilt, pressure, approach, and grip in addition to the above-described touch.

The touch sensor may be implemented as a capacitive type or a pressure-sensitive type. The capacitive touch sensor refers to a sensor that uses a dielectric coated on the display surface to detect micro-electricity that is excited by the user's body when a part of the user's body is touched on the display surface and calculates touch coordinates. The pressure-sensitive touch sensor includes two electrode plates embedded in the user terminal device 100, and when the user touches the touch point, the touch-sensitive touch sensor detects that the upper and lower plates of the touched point contact and current flows to calculate the touch coordinates. means the sensor. In addition, an infrared sensing method, a surface ultrasonic conduction method, an integral tension measurement method, a piezo effect method, etc. may be used to detect a touch interaction.

In addition, the user terminal device 100 may use a magnetic and magnetic field sensor, an optical sensor, or a proximity sensor instead of a touch sensor to determine whether a touch object such as a finger or a stylus pen has come into contact or proximity.

The geomagnetic sensor is a sensor for detecting a rotational state and a moving direction of the user terminal device 100 . The gyro sensor is a sensor for detecting a rotation angle of the user terminal device 100 . Both the geomagnetic sensor and the gyro sensor may be provided, but even if only one of them is provided, the user terminal device 100 may detect the rotational state.

The acceleration sensor is a sensor for detecting the degree of inclination of the user terminal device 100 .

The proximity sensor is a sensor for detecting a motion approaching the display surface without direct contact. Proximity sensor forms a high-frequency magnetic field and detects a current induced by magnetic field characteristics that change when an object is approached. It can be implemented with various types of sensors such as

The grip sensor is a sensor that is disposed on a rear surface, an edge, and a handle part separately from a touch sensor provided on the touch screen, and detects a user's grip. The grip sensor may be implemented as a pressure sensor in addition to the touch sensor.

The audio processing unit 160 is a component that processes audio data. The audio processing unit 160 may perform various processes such as decoding, amplification, and noise filtering on audio data.

The video processing unit 170 is a component that processes video data. The video processing unit 170 may perform various image processing, such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, and the like, on video data.

The speaker 180 is a component that outputs various types of audio data processed by the audio processing unit 160 as well as various notification sounds or voice messages.

The button 181 may be various types of buttons such as a mechanical button, a touch pad, a wheel, etc. formed in an arbitrary area such as the front, side, or rear of the main body of the user terminal device 100 .

The microphone 182 is configured to receive a user's voice or other sound and convert it into audio data.

In addition, although not shown in FIG. 2B , according to an embodiment, a USB port to which a USB connector can be connected in the user terminal device 100 or various external inputs for connecting to various external terminals such as a headset, a mouse, and a LAN Of course, it may further include a port, a DMB chip for receiving and processing a Digital Multimedia Broadcasting (DMB) signal, various sensors, and the like.

2C is a diagram for explaining various modules stored in the storage 140 .

The software of FIG. 2C may be stored in the storage 140 , but is not limited thereto, and may be stored in various types of storage means used in the user terminal device 100 . Referring to FIG. 2C , software including an OS 191 , a kernel 192 , middleware 193 , and an application 194 may be stored in the user terminal device 100 .

An operating system (OS, 191) controls and manages the overall operation of hardware. That is, the OS 191 is a layer in charge of basic functions such as hardware management, memory, and security.

The kernel 192 serves as a path for transmitting various signals including a touch signal detected by the display 110 to the middleware 193 .

The middleware 193 includes various software modules that control the operation of the user terminal device 100 . According to FIG. 2C , the middleware 193 includes a main UI framework 193-1, a window manager 193-2, a sub UI framework 193-3, a security module 193-4, and a system manager 193 -5), a connection manager 193-6, an X11 module 193-7, an APP manager 193-8, and a multimedia framework 193-9.

The main UI framework 193 - 1 is a module for providing various UIs to be displayed in the main display area 10 of the display 110 , and the sub UI framework 193 - 3 is located in the sub display area 20 . It is a module to provide various UIs to be displayed. The main UI framework 193-1 and the sub UI framework 193-3 include an image compositor module constituting various objects, a coordinate synthesizer for calculating coordinates for displaying objects, and coordinates for calculating the configured objects. It may include a 2D/3D UI toolkit that provides a rendering module for rendering to the UI, a tool for composing a 2D or 3D UI, and the like.

The window manager 193-2 may detect a touch event or other input event using the user's body or a pen. When such an event is detected, the window manager 193-2 transmits an event signal to the main UI framework 193-1 or the sub UI framework 193-3 to perform an operation corresponding to the event.

In addition, when the user touches and drags the screen, a writing module for drawing a line according to a drag trajectory or an angle calculation for calculating a pitch angle, a roll angle, a yaw angle, etc. based on a sensor value sensed by the sensing unit Various program modules such as modules may be stored.

The security module 193 - 4 is a module supporting hardware certification, request permission, secure storage, and the like.

The system manager 193 - 5 monitors the status of each component in the user terminal device 100 and provides the monitoring result to other modules. For example, when the remaining battery level is insufficient, an error occurs, or the communication connection state is cut off, the system manager 193-5 displays the monitoring result to the main UI framework 193-1 or the sub UI frame. It may be provided to the walk 193-3 to output a notification message or a notification sound.

The connection manager 193 - 6 is a module for supporting a wired or wireless network connection. The connection manager 193 - 6 may include various detailed modules such as a DNET module and a UPnP module.

The X11 module 193 - 7 is a module for receiving various event signals from various hardware provided in the user terminal device 100 . Here, the event may be variously set, such as an event in which a user manipulation is detected, an event in which a system alarm occurs, an event in which a specific program is executed or terminated, and the like.

The APP manager 193 - 8 is a module that manages execution states of various applications installed in the storage 140 . When an event to which an application execution command is input from the X11 module 193-7 is detected, the APP manager 193-8 calls and executes an application corresponding to the event. That is, when an event in which at least one object is selected is detected, the APP manager 193-8 calls and executes an application corresponding to the object.

The multimedia framework 193 - 9 is a module for playing multimedia content stored in the user terminal device 100 or provided from an external source. The multimedia framework 193 - 9 may include a player module, a camcorder module, a sound processing module, and the like. Accordingly, it is possible to perform an operation of reproducing various multimedia contents to generate a screen and sound.

Since the software structure shown in FIG. 2C is only an example, it is not necessarily limited thereto. Accordingly, it goes without saying that some may be omitted, modified, or added as necessary. For example, the storage 140 includes a sensing module for analyzing signals sensed by various sensors, a messaging module such as a messenger program, a short message service (SMS) & multimedia message service (MMS) program, an email program, and a phone information collector. Various programs such as a (Call Info Aggregator) program module, a VoIP module, and a web browser module may be additionally provided.

Meanwhile, as described above, the user terminal device 100 may be implemented as various types of devices such as a mobile phone, a tablet PC, a laptop PC, a PDA, an MP3 player, an electronic picture frame device, a TV, a PC, and a kiosk. Accordingly, the configuration described with reference to FIGS. 2B and 2C may be variously modified according to the type of the user terminal device 100 .

As described above, the user terminal device 100 may be implemented in various shapes and configurations.

Hereinafter, a basic configuration and various embodiments will be described to help the understanding of the present invention.

3 is a view for explaining an example in which only one of the main display area 10, the sub display area 20, and the round display area 30 is used.

3 , the processor 130 may determine an area to provide information based on the orientation of the user terminal device 100 . When the processor 130 provides information to one area, the processor 130 may not provide information to the other two areas.

The processor 130 may perform an operation of determining an area to provide information when there is a user input for pressing the power button. Alternatively, when receiving a call or text message, the processor 130 may perform an operation of determining an area to provide information.

Meanwhile, although it has been described above that an area to provide information is determined based on the orientation of the user terminal device 100 , the present invention is not limited thereto. For example, when there is a user input of pressing the power button, the processor 130 may recognize the user and provide information through an area close to the user's gaze. In this case, the provided information may be different depending on the executed application.

Meanwhile, the processor 130 may change the display area to which information is to be provided through a user's touch input to the area to which information is not provided. For example, when a user input of continuously touching one area of the sub display area 20 is received while providing information to the main display area 10 , the processor 130 provides information to the main display area 10 . Information may be displayed on the sub display area 20 .

Meanwhile, the processor 130 may display the same information differently depending on the area to be displayed. For example, as shown in FIG. 3 , the processor 130 may change and display the layout of the home screen for each display area.

Meanwhile, when the direction of the user terminal device 100 is changed, the processor 130 may change a region providing information. For example, if the user terminal device 100 is rotated by a predetermined angle or more while the home screen is displayed on the main display area 10 , the processor 130 may display the home screen on the sub display area 20 . have.

In particular, the processor 130 may change the layout of information to be provided when the display area is changed due to a change in the direction of the user terminal device 100 . When the area to provide information is changed, the processor 130 may change not only the object but also the size, content, and layout of the object.

Meanwhile, when the display area is changed due to a change in the direction of the user terminal device 100 , the processor 130 may change the operating state of the currently running application and provide it to another display area. Alternatively, when the direction of the user terminal device 100 is changed, the processor 130 may divide the displayed information and display it in different display areas.

FIG. 4 is a view for explaining an example in which at least two of the main display area 10 , the sub display area 20 and the round display area 30 are used.

4 , the processor 130 may provide information related to each other to two of the main display area 10 , the sub display area 20 , and the round display area 30 . For example, the processor 130 may display a video on the main display area 10 and display a UI for controlling the video on the round display area 30 .

However, the present invention is not limited thereto, and the processor 130 may provide unrelated information to two of the main display area 10 , the sub display area 20 , and the round display area 30 .

Alternatively, when a call is received while the UI for controlling the video is displayed on the round display area 30 as shown in FIG. 4 , the processor 130 displays the call reception UI on the round display area 30 and displays the video. The UI for controlling may be displayed by moving it to the sub display area 20 .

When a call is connected by touching the call reception UI, the processor 130 may display the phone call UI on the round display area 30 and continue to play the video. In this case, the processor 130 may mute the video. Alternatively, the processor 130 may pause the video.

Meanwhile, the processor 130 may provide information related to each other by using all of the main display area 10 , the sub display area 20 , and the round display area 30 . For example, the processor 130 displays a video in the main display area 10 , displays a UI for controlling the video in the sub display area 20 , and indicates a video playback time in the round display area 30 . UI can be displayed.

Alternatively, the processor 130 may provide information that is not related to each other by using all of the main display area 10 , the sub display area 20 , and the round display area 30 . Alternatively, the processor 130 provides information related to each other to two of the main display area 10 , the sub display area 20 , and the round display area 30 , and provides unrelated information to the other area. You may.

Meanwhile, when the direction of the user terminal device 100 is changed, the processor 130 may change the display area of information displayed in each area. In particular, the processor 130 may change the displayed area by combining or dividing information displayed in each area.

Meanwhile, when a touch input is received on the sub display region 20 , the processor 130 may display the UI displayed on the sub display region 20 on the main display region 10 . Alternatively, when a touch input is received on the main display area 10 , the processor 130 displays the UI displayed on the main display area 10 on at least one of the sub display area 20 and the round display area 30 . You may.

Meanwhile, even if the same user touch input is sensed, the processor 130 may vary the degree of adjustment of the setting value according to the touch area. For example, when a drag operation is input to the main display area 10 or the sub display area 20 while the moving picture is displayed on the main display area 10 , the processor 130 plays the video according to the direction of the drag operation. You can adjust the time or volume. In this case, the processor 130 may finely adjust the reproduction time or volume when the drag operation is performed in the sub display area 20 rather than in the case of the main display area 10 .

4 is only an example, and is not limited thereto. For example, the main display area 10 , the sub display area 20 , and the round display area 30 of FIG. 4 may be interchanged with each other. In addition, the operation with respect to FIG. 4 can be applied to any number of other applications.

5 is a diagram for explaining an example of an operation according to each region and a touch input.

5 , when a drag input from one area of the main display area 10 toward the round display area 30 is received, the processor 130 sub-displays information provided in the main display area 10 . It can be displayed in the area 20 .

The processor 130 may display information provided from the main display area 10 on the sub display area 20 only when there is a drag input greater than or equal to a preset size.

When there is information provided from the sub display area 20 before the drag input, the processor 130 may no longer provide the information provided to the sub display area 20 . Alternatively, the processor 130 may display the information provided to the sub display area 20 on the main display area 10 or the round display area 30 .

Although it has been described that only the main display area 10 and the sub display area 20 are used in FIG. 5 , the present invention is not limited thereto. For example, the processor 130 may display information provided to any one of the main display area 10 and the sub display area 20 on the round display area 30 according to the type of user input. Alternatively, the processor 130 may display the information provided in the round display area 30 on either the main display area 10 and the sub display area 20 .

Meanwhile, the processor 130 may receive a touch input even if information is not provided to a specific region. For example, when a user input for dragging the round display area 30 is received while the broadcast content is displayed on the main display area 10 , the processor 130 may change the channel or volume of the broadcast content. In this case, the round display area 30 may be in a state in which no information is provided.

6 is a diagram for explaining an operation when the orientation of the user terminal device 100 is changed according to an embodiment of the present invention.

As shown in FIG. 6 , the user terminal device 100 extends from one side of the main display area 10 disposed on the front of the user terminal device 100 , the main display area 10 , The display 110 includes a sub display area 20 disposed on at least one area on the rear surface and a round display area 30 connecting the main display area 10 and the sub display area 20 .

The user terminal device 100 may include a camera 120 for capturing an image on the rear side. For convenience of description, first, a structure in which the camera 120 is provided on the rear side of the user terminal device 100 will be described. A structure in which the camera 120 is provided on the front of the user terminal device 100 will be described later.

The processor 130 may display the live view acquired through the camera 110 on one of the main display area 10 and the sub display area 20 . The upper diagram of FIG. 6 is a diagram in which the processor 130 displays a live view on the main display area 10 . Alternatively, the processor 130 may display the live view on the sub display area 20 , and which area of the main display area 10 and the sub display area 20 will be described later.

When the orientation of the user terminal device 100 is changed, the processor 130 may control the display 110 to display the live view on the other one of the main display area 10 and the sub display area 20 . . In the lower diagram of FIG. 6 , in a state in which the processor 130 displays the live view on the main display area 10 , when rotational movement of a predetermined angle or more in a specific direction is detected, the live view is displayed on the sub display area 20 . It is a drawing. An image captured by the camera 120 may also vary as the direction of the user terminal device 100 is changed. The processor 130 may determine that the direction of the user terminal device 100 has changed through various methods, and details will be described later.

When the direction of the user terminal device 100 is changed and the area in which the live view is displayed is changed, the processor 130 may display a soft key, a control GUI, etc. to correspond to the corresponding area. For example, when a live view is displayed on the main display area 10 , the processor 130 may display a GUI for photographing on the right side of the main display area 10 . In addition, when the direction of the user terminal device 100 is changed and the live view is displayed on the sub display region 20 , the processor 130 does not display a GUI for photographing and touches the sub display region 20 . In some cases, shooting may be performed.

The processor 130 may display a shooting setting value on the main display area 10 when the direction of the user terminal device 100 is changed while the live view is displayed on the sub display area 20 .

The processor 130 displays the live view in the main display area 10 and does not provide information to the sub display area 20 , and when the direction of the user terminal device 100 is changed, the live view is displayed in the sub display area 20 . may be displayed, and information may not be provided in the main display area 10 . For example, in the upper view of FIG. 6 , the processor 130 may not provide information to the sub display area 20 . Alternatively, in the case of the lower drawing of FIG. 6 , the processor 130 may not provide information to the main display area 10 . However, the present invention is not limited thereto, and the live view may be displayed on both the main display area 10 and the sub display area 20 of the processor 130 .

The processor 130 may not provide information by displaying one of the main display area 10 and the sub display area 20 in black. Alternatively, the processor 130 may not supply power to the display 110 in one of the main display area 10 and the sub display area 20 . Even when the processor 130 does not provide information to one of the main display area 10 and the sub display area 20 , the processor 130 may receive a touch input by activating the touch function.

The processor 130 may change the photographing mode when the direction of the user terminal device 100 is changed. For example, when the direction of the user terminal device 100 is changed and it is recognized that the subject is nearby, the processor 130 may switch to the selfie shooting mode. The selfie mode is optimized for taking selfies and can automatically correct the user's skin.

Alternatively, when the direction of the user terminal device 100 is changed and it is recognized that the subject is far away, the processor 130 may switch to the background photographing mode. The background shooting mode is optimized for landscape photography, and contrast and white balance can be adjusted automatically.

Meanwhile, the processor 130 may change the angle of view according to the photographing mode. For example, the processor 130 may narrow the angle of view in the selfie shooting mode and widen the angle of view in the background shooting mode.

In addition, the processor 130 may vary the UI provided by the display according to the shooting mode. For example, the processor 130 provides a UI including a function for correcting the user's skin and a red-eye reduction function in the case of a selfie shooting mode, and a contrast control function, a white balance control function, etc., in the background shooting mode You can provide a UI that includes

7A and 7B are diagrams for explaining an example of a method of changing an image provided according to a display area.

7A , the processor 130 may display a live view on the main display area 10 . When the user performs a photographing operation, the processor 130 may store the same image as the image displayed on the main display area 10 .

Alternatively, as shown in FIG. 7B , the processor 130 may display the live view on the sub display area 20 . In this case, the processor 130 may display only a part of the image recognized through the camera 120 .

7A and 7B show that the same subject is photographed for convenience of explanation. That is, the processor 130 captures the image shown in FIG. 7A , but may display only a part of the captured image on the sub display area 20 as shown in FIG. 7B .

However, this is only an embodiment, and the processor 130 may rotate the entire captured image by 90 degrees to display it on the sub display area 20 .

Also, even when shooting is performed while the live view is displayed on the sub display area 20 , the processor 130 may store the entire image. For example, even if the user takes a selfie by composing the composition as shown in FIG. 7B , the processor 130 may capture the original image including the user's face as well as the upper body as shown in FIG. 7A .

In this case, the processor 130 may display the stored image differently according to an area in which the gallery app is executed and displayed. For example, when an image is displayed on the main display area 10 , the processor 130 may display the original image including the user's upper body. Alternatively, when an image is displayed on the sub display area 20 , the processor 130 may display a partial image including only the user's face.

The processor 130 may store both the original image and the partial image. Alternatively, the processor 130 may store only the original image and, if necessary, crop the image to correspond to the sub display area 20 and display it on the sub display area 20 . In this case, the original image may store information on the area to be cropped. FIGS. 8A and 8B are diagrams for explaining an example of a method of executing a specific function through the main display area 10 . The processor 130 displays a live view on the sub display area 20 and does not provide information on the main display area 10 , and executes a corresponding function according to a user input that touches the main display area 10 . can

8A illustrates capturing an image using the main display area 10 . For example, when a user touch is detected in the main display area 10 in a state where the processor 130 displays a live view on the sub display area 20 and does not provide information on the main display area 10 , the user In response to a touch, an image can be captured and saved.

The processor 130 may perform photographing only when a user's touch on the preset area 11 of the main display area 10 is sensed. The preset area 11 may be set by a manufacturer or set by a user. In this case, the processor 130 may activate the touch function of the preset area 11 of the main display area 10 and deactivate the touch function of the other area of the main display area 10 .

FIG. 8B is a diagram for changing a photographing setting value using the main display area 10 . For example, the processor 130 displays a live view in the sub display area 20 and does not provide information to the main display area 10 , and in a state in which information is not provided in the main display area 10 , a predetermined direction from any one point in the main display area 10 . When a swipe interaction to , the shooting setting value may be changed to correspond to a preset direction.

The processor 130 may change the shooting setting value only when a swipe interaction in a preset direction from any one point in the preset area 11 of the main display area 10 is detected. The preset area may be set by a manufacturer or set by a user. In this case, the processor 130 may activate the touch function of the preset area 10 of the main display area 10 and deactivate the touch function of the other area of the main display area 10 .

When a swipe interaction in the left and right directions 810 - 1 and 810 - 2 is detected, the processor 130 may display a live view by changing an exposure value. When the swipe interaction in the up-down directions 820 - 1 and 820 - 2 is detected, the processor 130 may zoom in or zoom out to display the live view. However, the present invention is not limited thereto, and the focus may be changed or the white balance may be changed through a swipe interaction of the processor 130 .

Although only the preset area 11 of the main display area 10 has been described in FIGS. 8A and 8B , the present invention is not limited thereto. For example, the processor 130 may activate a touch function of the entire main display area 10 , and when a user touch on a point of the main display area 10 is sensed, photographing may be performed. Alternatively, the processor 130 may divide the main display area 10 into a plurality of preset areas and allocate different functions to each area.

In addition to the touch and swipe interactions, the processor 130 may also execute functions corresponding to various interactions, such as a drag and drop interaction, a multi-touch interaction, and a stretch interaction that spreads two points apart. The interaction and its corresponding function may be set by the manufacturer or set by the user.

Meanwhile, although it has been described that a specific function is executed by touching the main display area 10 in FIGS. 8A and 8B , the present invention is not limited thereto. For example, when a user touch is detected in the sub display area 20 in a state where the processor 130 displays a live view on the main display area 10 and does not provide information on the sub display area 20 , the user In response to a touch, an image can be captured and saved. Alternatively, when a swipe interaction in a preset direction is detected from any one point in the sub display area 20 , the processor 130 may change the shooting setting value to correspond to the preset direction.

Alternatively, the processor 130 may display the live view on both the main display area 10 and the sub display area 20 and use an area opposite to the area the user is looking at as an area for receiving a touch input. .

Meanwhile, although only the case of using the camera 120 has been described in FIGS. 8A and 8B , a touch input may be received using an area located opposite to the area the user is looking at even when using another application. For example, the processor 130 may change a channel or a volume through a swipe interaction of the sub display area 20 while the broadcast content is being displayed on the main display area 10 .

In addition, although only the case of using the main display area 10 and the sub display area 20 has been described in FIGS. 8A and 8B , any one of the main display area 10 and the sub display area 20 and the round display area 30 ) can also be used. For example, the processor 130 may perform photographing according to a user input of touching the round display area 30 while the live view is displayed on the sub display area 20 .

9 is a diagram for explaining a method of displaying a live view on both the main display area 10 and the sub display area 20 according to an embodiment of the present invention.

As shown in FIG. 9 , the processor 130 displays the live view on the main display area 10 , and when it is recognized that a human face is included in the live view, the processor 130 displays the face area included in the live view as a sub display area. The display 110 may be controlled to display on 20 . For example, when the distance from the subject is long, the processor 130 may display the live view on the main display area 10 . Specific details on this will be described later.

The processor 130 may recognize a human face in the live view displayed on the main display area 10 . When a human face is recognized using a live view, the processor 130 divides a specific still image of the live view into a plurality of pixel blocks, and calculates a representative pixel value for each pixel block. The representative pixel value may be calculated as an average value of all pixels included in the pixel block, or may be calculated as a maximum distribution value, an intermediate value, or a maximum value. The processor 130 compares the representative pixel values of each pixel block with each other to determine whether pixel blocks having representative pixel values in a similar range are successively arranged. If they are consecutively arranged, the processor 130 determines that the pixel blocks constitute one object. The processor 130 determines whether an object having a pixel value range similar to a human skin color exists among the pixel blocks determined as objects. If such an object exists, the processor 130 may recognize the object as a human face area or other body area, and determine the remaining part as a surrounding background.

The processor 130 may control the display 110 to display on the sub display region 20 by cropping one region 910 of the live view to correspond to the size of the sub display region 20 . In particular, the processor 130 may crop one area 910 of the live view while maintaining the aspect ratio of the sub display area 20 . The processor 130 may crop one region 910 of the live view so that the face region included in the live view is located in the center of the sub display region 20 . Alternatively, the processor 130 may crop an area smaller than the one area 910 of the live view shown in FIG. 9 , enlarge the cropped area, and display it on the sub display area 20 .

When it is recognized that a plurality of human faces are included in the live view, the processor 130 may display the closest human face area among the plurality of human faces on the sub display area 20 . Alternatively, the processor 130 may display, on the sub display area 20 , a face region of a person who maintains a gaze in the direction of the user terminal device 100 among the faces of the plurality of people. Alternatively, the processor 130 may crop one area of the live view so that all of the plurality of people appear. When there are many people, the processor 130 may display the live view on the sub display area 20 without cropping. Accordingly, a person who is photographing using the user terminal device 100 can check the image to be photographed through the live view displayed on the main display area 10 , and the person being photographed can see the image to be photographed through the live view displayed on the main display area 10 . An image to be captured may be checked through one area of the displayed cropped live view.

Although the operation of displaying the live view on both the main display area 10 and the sub display area 20 has been described in FIG. 9 , the present invention is not limited thereto. For example, when the processor 130 operates in the selfie shooting mode, the sub display area 20 may display a live view and the main display area 10 may display a UI indicating that a selfie is being taken.

10 is a view for explaining a method of displaying a live view on the main display area 10 and specific content on the sub display area 20 according to an embodiment of the present invention.

As shown in FIG. 10 , the processor 130 displays the live view on the main display area 10 , and when it is recognized that a person is included in the live view, the display 110 displays an animation on the sub display area 20 . ) can be controlled. For example, when a child is recognized in the live view, the processor 130 may display an animation for children or an animal image on the sub display area 20 . The processor 130 may output a sound corresponding to the content displayed on the sub display area 20 . Accordingly, the gaze of the person being photographed may be directed toward the user terminal device 100 .

The processor 130 may determine the content to be displayed on the sub display area 20 based on at least one of an age group and a gender of the person recognized in the live view. For example, when the person recognized in the live view is a woman, the processor 130 may display a precious metal or the like on the sub display area 20 .

When a plurality of people are recognized in the live view, the processor 130 may determine content to be displayed on the sub display area 20 based on the closest person among the plurality of people. Alternatively, the processor 130 may determine the content to be displayed on the sub display area 20 based on a person who maintains his/her gaze in a direction other than the user terminal device 100 among a plurality of persons. Alternatively, the processor 130 may determine the content to be displayed on the sub display area 20 based on the person closest to the center area of the live view.

A case in which a person or a human face is recognized in the live view has been described with reference to FIGS. 9 and 10 , but the present invention is not limited thereto. For example, the processor 130 may display one area of the live view or an animation on the sub display area 20 even if an animal or the like is recognized in the live view. Alternatively, the processor 130 may display a live view area or animation on the sub display area 20 according to a user's manipulation.

11A and 11B are diagrams for explaining an example of a method of determining a region to display a live view. The processor 130 determines the distance to the subject, and displays the live view on the sub display area 20 if the determined distance is smaller than the preset distance, and displays the live view as the main if the determined distance is greater than the preset distance The display 110 may be controlled to display in the area 10 .

11A shows a case in which the distance to the subject is smaller than a preset distance, and FIG. 11B shows a case in which the distance to the subject is greater than the preset distance. The processor 130 may determine the distance to the subject by using auto-focusing. Alternatively, the processor 130 may analyze a still image at a specific point in time of the live view and determine the distance to the subject based on the outline of the subject. Accordingly, when the user looks at the rear of the user terminal device 100 and photographs the user himself, the live view is displayed on the sub display area 20 so that the image to be photographed can be checked and photographed. Alternatively, when the user looks at the front of the user terminal device 100 and shoots another person or landscape, a live view is displayed on the main display area 10 , so that the image to be captured can be checked and photographed.

However, the present invention is not limited thereto, and the processor 130 may display the live view in an area opposite to the above-described method, or may display the live view in both the main display area 10 and the sub display area 20 .

Alternatively, the processor 130 may display a live view in an area where a user's touch manipulation is performed.

Alternatively, the processor 130 may analyze the image captured by the camera 120 to determine a region in which to display the live view. For example, the processor 130 may recognize the user from the captured image and determine an area in which to display the live view.

Alternatively, the processor 130 may determine an area to display the live view through recognition of the user's iris.

12 is a diagram for explaining a method of detecting a change in the direction of the user terminal device 100 according to an embodiment of the present invention.

12 , when the direction of the user terminal device 100 is changed, the image of the live view may be changed. The user terminal device 100 may include a plurality of sensors as described above. The processor 130 may determine that the direction of the user terminal device 100 is changed based on at least one of a position, a movement, and a user's grip of the user terminal device 100 sensed by a plurality of sensors. For example, the processor 130 may determine the direction of the user terminal device 100 based on the rotation state and movement direction of the user terminal device 100 by the geomagnetic sensor and the rotation angle of the user terminal device 100 by the gyro sensor. It can be considered that this has changed.

The processor 130 may determine that the direction of the user terminal device 100 is changed when the user terminal device 100 rotates in a specific direction by a predetermined angle or more. For example, when the user terminal device 100 is rotated by 90° or more, the processor 130 may determine that the direction of the user terminal device 100 has changed and perform a corresponding operation.

Meanwhile, the processor 130 determines the direction of the user terminal device 100 when a face of a person having a size larger than a preset size is recognized in the live view or a face of a person larger than a preset size is not recognized in a state in which a face of a person larger than the preset size is recognized. It may be judged that this has changed. 12 sequentially shows a plurality of still images of a live view. The first still image 1210 is an image without a person, the second to fourth still images 1220-1240 are images with a person, and the fifth still image 1250 is an image without a person again. That is, FIG. 12 is a diagram in which the camera angle is moved from left to right and then moved to the left again.

As shown in FIG. 12 , the processor 130 may determine that the second still image 1220 is displayed and the fifth still image 1250 is displayed as the direction of the user terminal device 100 is changed.

However, the present invention is not limited thereto, and the processor 130 may determine that the direction of the user terminal device 100 is changed based on an object other than a human face. For example, the processor 130 extracts the outline of the slide from a specific still image of the live view, and sequentially extracts the outline of the slide of the next still image, so that the outline of the slide is moved more than a preset distance on the live view. In this case, it may be determined that the direction of the user terminal device 100 is changed.

Alternatively, the processor 130 may continuously detect the absolute posture using various sensors included in the user terminal device 100 and determine that the direction has been changed.

In this case, the processor 130 may determine the reference posture, and when the posture is changed from the reference posture by more than a preset value, it may be determined that the direction has been changed. Here, the reference posture may be a posture when the camera application is selected.

Alternatively, the processor 130 may determine that the direction of the user terminal device 100 is changed according to the user's touch manipulation.

13A and 13B are diagrams for explaining an example of an operation according to a direction change of the user terminal device 100 .

13A illustrates that the gallery app is executed when the direction of the user terminal device 100 is changed while the photographing function is being executed. For example, the processor 130 may display a live view on the sub display area 20 , and display the gallery app on the main display area 10 when the user terminal device 100 rotates about 180°. Alternatively, the processor 130 may display, on the main display area 10 , a phone function, an Internet function, etc. completely unrelated to the photographing function. Alternatively, the processor 130 may stop the photographing function.

In addition, when the user touches the main display area 10 in a state in which shooting is performed and the image stored in the sub display area 20 is being displayed, the processor 130 displays a gallery app or an app for correction in the sub display area (20) may be displayed. Alternatively, when photographing is performed, the processor 130 may display sequentially photographed images on the sub display area 20 , and change and display the images by touching the user's main display area 10 .

13B illustrates that the video recording function is stopped when the direction of the user terminal device 100 is changed while the video recording function is being executed. The upper drawing of FIG. 13B shows a shooting time, a GUI 1310 for terminating a moving picture, and a GUI 1320 for temporarily stopping a moving picture. The user may end video recording by touching the GUI 1310 for terminating video recording, but may also end video recording by changing the direction of the user terminal device 100 . The lower drawing of FIG. 13B shows a thumbnail image of a moving picture of which the current shooting has been completed, and the moving picture can be executed by touching the GUI 1330 for executing the moving picture.

However, the present invention is not limited thereto, and the processor 130 may touch the main display area 10 during video recording to temporarily stop or end video recording.

14A and 14B are diagrams for explaining an example of a method for executing a photographing function. The processor 130 may execute the photographing function through other methods other than touching an icon indicating the photographing function.

14A illustrates that a photographing function is executed when the direction of the user terminal device 100 is changed. For example, when the direction of the user terminal device 100 is changed while the lock screen is displayed on the main display area 10 , the processor 130 executes a photographing function and displays the live image on the sub display area 20 . view can be displayed. Alternatively, the processor 130 executes a photographing function when the direction of the user terminal device 100 is changed in a state in which information is not provided in the main display area 10 , and displays a live view in the sub display area 20 . You may.

14B illustrates that a photographing function is executed when a swipe interaction is detected in the sub display area 20 . For example, when the processor 130 detects a swipe interaction in the sub display region 20 while the lock screen is displayed on the sub display region 20 or information is not provided in the sub display region 20 , The shooting function can be executed. 14B shows a swipe interaction from left to right, but is not limited to a specific direction. In addition, it is possible to execute a shooting function through other interactions as well as a swipe interaction.

In addition to the embodiment of FIGS. 14A and 14B , a photographing function may be executed through various methods. For example, when the processor 130 activates at least one of the main display area 10 and the sub display area 20 in a state in which the main display area 10 and the sub display area 20 do not provide information. , it is also possible to recognize the user's intention and execute the shooting function. The processor 130 may execute a photographing function by recognizing at least one of a user's face, a user's gesture, and a grip shape when a specific region is activated. For example, when the user is making a "V" shape using a finger, the processor 130 may execute a photographing function.

15 is a diagram for explaining a method of using the round display area 30 according to an embodiment of the present invention.

15 , the round display area 30 is located between the main display area 10 and the sub display area 20 . A UI for controlling the user terminal device 100 may also be displayed on the round display area 30 . For example, when a photographing function is activated, the processor 130 may display a GUI 1520 for photographing and storing an image in the round display area 30 . When the user touches the GUI 1520 for capturing and storing an image, the processor 130 may capture and store the image.

When a swipe interaction in the left and right directions 1510 - 1 and 1510 - 2 of the round display area 30 is detected, the processor 130 may display a live view by changing an exposure value. Alternatively, the processor 130 may display the live view by zooming in or out. However, the present invention is not limited thereto, and the focus may be changed or the white balance may be changed through a swipe interaction of the processor 130 .

However, the present invention is not limited thereto, and the processor 130 may execute a photographing function when a swipe interaction with respect to the round display area 30 is detected. Alternatively, the processor 130 may change the area in which the live view is displayed by touching the round display area 30 .

The processor 130 may display a specific notification on the round display area 30 . For example, when the subject is not in focus, the processor 130 may display a notification for notifying the corresponding content on the round display area 30 . When the user touches the notification, the processor 130 may change settings or the like to focus on the subject or retry.

16 is a view for explaining a case in which the camera 120 is provided on the front side of the user terminal device 100 according to another embodiment of the present invention.

As shown in FIG. 16 , the user terminal device 100 may include a camera 120 under the main display area 10 . However, most of the operations of the above-described embodiment can be applied in the same manner by reversing the main display area 10 and the sub display area 20, and a detailed description thereof will be omitted.

In the above description, the camera application has been mainly described, but a similar operation is possible for other applications.

17A to 17C are diagrams for explaining an example in which other applications are used.

As shown in FIG. 17A , when an event occurs, the processor 130 may determine the display area based on the direction of the user terminal device 100 at the time when the event occurs. For example, when a call or message is received, the processor 130 detects the absolute posture of the user terminal device 100 at the time when the call or message is received, and displays the received content of the call or message on a preset display area. can In particular, when the main display area 10 touches the table, the processor 130 may display the received content of a call or message on the sub display area 20 .

Alternatively, as shown in FIG. 17B , when an event occurs, the processor 130 may determine the display area based on the user's location at the time when the event occurs. For example, when a call or message is received, the processor 130 recognizes the location of the user at the time the call or message is received through the camera 120 , and when the user is recognized, the call or message is displayed on the sub display area 20 . , and if the user is not recognized, the received content of a call or message may be displayed on the main display area 10 .

Alternatively, as shown in FIG. 17C , when an event occurs, the processor 130 may determine the display area based on the usage state of the user terminal device 100 at the time when the event occurs. For example, when a call or message is received while the user is watching a video through the main display area 10 , the processor 130 may display a call or message in the sub display area 20 or the round display area 30 . You can display the received contents of

Meanwhile, when the direction of the user terminal device 100 is changed, the processor 130 may change the display area. For example, when the processor 130 changes the direction of the user terminal device 100 to view the sub display region 20 while checking the content of the text message through the main display region 10 , the sub display region ( 20) can display the text message content.

As described above, the processor 130 may determine that the direction of the user terminal device 100 is changed by using various sensors or by using the camera 120 . A detailed description of the direction change of the user terminal device 100 will be omitted because it is redundant.

When the direction of the user terminal device 100 is changed and the display area is changed, the processor 130 may change the UI. Specifically, the processor 130 may change at least one of the amount of information included in the UI, the type of information, and the layout. For example, when displaying a text message on the main display area 10 , the processor 130 may additionally display a UI for writing a new text message, counterpart information, etc. as well as the content of the text message, and display the text message. When displaying on the sub display area 20, only the content of the text message may be displayed. Also, when displaying the text message on the round display area 30 , the processor 130 may sequentially display some contents of the text message.

In particular, the processor 130 may change a function provided according to the display area. For example, when the processor 130 displays the received text message on the main display area 10 , the processor 130 may display a UI including a reply message input function, a received message storage function, a received message deletion function, etc. When the displayed text message is displayed on the round display area 30, only the content of the received text message may be displayed and other functions may not be provided. FIGS. 18A and 18B are diagrams for explaining an example of a configuration of a display.

18A shows a flexible display. The user can use the flexible display by folding it. In this case, the folded upside down area 1810 corresponds to the sub display area 20 , and the unfolded area 1820 corresponds to the main display area 10 .

18A illustrates that the area of the inverted region 1810 is smaller than the area of the non-folded region 1820, but is not limited thereto. For example, the user may use the flexible display by folding it in exactly half.

Except for the round display area 30 of the above-described embodiments, most of the embodiments are applicable to the flexible display, and since they are overlapping descriptions, they will be omitted. However, when the flexible display is folded twice to form the round display area 30 , the above-described embodiment of the round display area 30 is also applicable.

18B illustrates the user terminal device 100 provided with a plurality of displays in front and back. In this case, the front display 1830 corresponds to the main display area 10 , and the rear display 1840 corresponds to the sub display area 20 . Similarly, with the exception of the round display area 30 among the above-described embodiments, most embodiments are applicable to the user terminal device 100 in which a plurality of displays are provided in front and back, and are omitted because they are overlapping descriptions.

19 is a flowchart illustrating a method of controlling a user terminal device according to an embodiment of the present invention.

First, the live view obtained through the camera is displayed on one of a main display area disposed on the front of the user terminal device and a sub display area extending from one side of the main display area and disposed on at least one area on the rear side of the user terminal device. (S1910). Then, when the orientation of the user terminal device is changed, the live view is displayed on the other one of the main display area and the sub display area (S1920).

Here, in the step of displaying on one of the main display area and the sub display area ( S1910 ), the live view is displayed on the main display area and information is not provided on the sub display area, and the display is displayed on the other of the main display area and the sub display area. In step S1920, when the direction of the user terminal device is changed, the live view may be displayed on the sub display area and information may not be provided on the main display area.

Meanwhile, in the step of displaying on the other one of the main display area and the sub display area ( S1420 ), the live view is displayed on the sub display area and information is not provided on the main display area, and when a user touch is detected on the main display area, the user The method may further include capturing and storing an image in response to the touch.

Here, when a swipe interaction in a preset direction is sensed from any one point in the main display area, the method may further include changing the shooting setting value to correspond to the preset direction.

Meanwhile, in the step of displaying the other one of the main display area and the sub display area ( S1920 ), the live view is displayed on the main display area, and when it is recognized that a human face is included in the live view, the face area included in the live view is displayed. The method may further include displaying on the sub display area.

Here, the step of displaying on the sub display region may include cropping one region of the live view to correspond to the size of the sub display region and displaying it on the sub display region.

In addition, the step of displaying the other one of the main display area and the sub display area (S1920) is to display the live view on the main display area, and when it is recognized that a person is included in the live view, displaying an animation on the sub display area. may include more.

Meanwhile, in the step of displaying in one of the main display area and the sub display area ( S1910 ), the distance to the subject is determined, and if the determined distance is smaller than a preset distance, the live view is displayed on the sub display area, and the determined distance is determined. If the distance is greater than the preset distance, the live view may be displayed on the main display area.

On the other hand, the method further includes the step of detecting at least one of the position and movement of the user terminal device and the user's grip, and the step of displaying on the other one of the main display area and the sub display area (S1920) is the position and movement of the user terminal device. And it may be determined that the direction of the user terminal device is changed based on at least one of the user's grip.

In addition, in the step of displaying in the other one of the main display area and the sub display area (S1920), a face of a person with a size larger than a preset size is recognized in the live view, or a face of a person with a face size larger than a preset size is recognized in the live view. If not recognized, it may be determined that the direction of the user terminal device is changed.

According to various embodiments of the present disclosure as described above, the user terminal device controls the displays disposed on the front and rear surfaces of the user terminal device based on various shooting situations so that the user can easily perform shooting.

Meanwhile, although the above description focuses on the case in which the photographing function is executed, the present invention is not limited thereto. For example, the processor may execute a preset application when the direction of the user terminal device is changed while the lock screen is displayed on the main display area. Alternatively, the processor may connect the call when the direction of the user terminal device is changed while the UI in which the call is being received is displayed on the main display area. The processor may display contact information and the like when the user terminal device moves away from the ear during a call.

Alternatively, the processor may display the execution state of the application executed in the background on the sub display area. For example, the processor may minimize power consumption by displaying an execution state of a specific game or music application on the sub display area. Alternatively, when the direction of the user terminal device is changed while a specific application is being executed and displayed on the main display area, the processor may display a UI displaying essential functions of the corresponding application on the sub display area.

Meanwhile, in the above description, only the direction of the user terminal device is changed, but other operations may be performed according to the changed direction. For example, a different function may be executed for each rotation of the user terminal device in an upward direction, a downward direction, a right direction, and a left direction. Alternatively, even if the user terminal device rotates in the upward direction, another function may be executed depending on whether the user terminal device is rotated in a clockwise or counterclockwise direction.

On the other hand, according to the above-described various embodiments of the present invention, a display including a main display area disposed on the front side of the user terminal device and a sub display area extending from one side of the main display area and disposed on at least one area on the rear side of the user terminal device and a method for controlling a user terminal device including a camera for capturing an image is implemented as a program code executable in a computer and stored in various non-transitory computer readable media to be executed by a processor. Or it may be provided to devices.

For example, displaying the live view acquired through the camera on one of the main display area and the sub display area, and when the orientation of the user terminal device is changed, the live view is displayed on the other one of the main display area and the sub display area A non-transitory computer readable medium in which a program for sequentially performing the displaying step is stored may be provided.

The non-transitory readable medium refers to a medium that stores data semi-permanently, rather than a medium that stores data for a short moment, such as a register, cache, memory, etc., and can be read by a device. Specifically, the various applications or programs described above may be provided by being stored in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention pertains without departing from the gist of the present invention as claimed in the claims Various modifications are possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

100: user terminal device 110: display
10: main display area 20: sub display area
30: round display area 120: camera
130: processor 140: storage
145: GPS chip 150: communication unit
155: user interface unit 160: audio processing unit
170: video processing unit 180: speaker
181: button 182: microphone

Claims (20)

In an electronic device,
flexible display;
at least one camera;
a memory storing at least one instruction; and
a processor executing the at least one instruction; including,
The processor is
acquiring a first image through the at least one camera while the flexible display is in a folding state;
controlling the flexible display to display the first image on a first area of the flexible display;
When a request for displaying a second image corresponding to the first image on the second area of the flexible display is received, the second image is displayed on the second area while the first image is displayed on the first area An electronic device for controlling the flexible display to be displayed on an area.
According to claim 1,
The processor is
When a request for selecting a selfie shooting mode from among a plurality of operation modes is received while the first image and the second image are displayed on the first area and the second area, respectively, the first image is displayed on the first area An electronic device controlling the display to display information indicating that the electronic device is operating in the selfie shooting mode on the second region while being displayed on the region.
According to claim 1,
The folding state is a state in which the flexible display is folded along a folding line,
The first area and the second area are divided based on the folding line.
4. The method of claim 3,
The second image is an image in which left and right sides of the first image are inverted.
5. The method of claim 4,
The size of the first region and the size of the second region are different,
The size of the first image and the size of the second image correspond to the size of the first area and the size of the second area, respectively.
6. The method of claim 5,
An aspect ratio of the second image corresponds to an aspect ratio of the second region.
According to claim 1,
The request for displaying the second image on the second area is received based on a user input for selecting a user interface item displayed on the first area.
According to claim 1,
The electronic device receiving the request for displaying the second image on the second region is received based on the identification of the first image as including the face of the person.
A method for controlling an electronic device including a flexible display and at least one camera, the method comprising:
acquiring a first image through the at least one camera while the flexible display is in a folding state;
displaying the first image on a first area of the flexible display; and
When a request for displaying a second image corresponding to the first image on the second area of the flexible display is received, the second image is displayed on the second area while the first image is displayed on the first area displaying on the area; A control method of an electronic device comprising a.
10. The method of claim 9,
When a request for selecting a selfie shooting mode from among a plurality of operation modes is received while the first image and the second image are displayed on the first area and the second area, respectively, the first image is displayed on the first area displaying information indicating that the electronic device is operating in the selfie capturing mode on the second area while being displayed on the area; Control method of an electronic device further comprising a.
10. The method of claim 9,
The folding state is a state in which the flexible display is folded along a folding line,
The first area and the second area are divided based on the folding line.
12. The method of claim 11,
The second image is an image in which left and right sides of the first image are inverted.
13. The method of claim 12,
The size of the first region and the size of the second region are different,
The size of the first image and the size of the second image correspond to the size of the first area and the size of the second area, respectively.
14. The method of claim 13,
An aspect ratio of the second image corresponds to an aspect ratio of the second region.
10. The method of claim 9,
The request for displaying the second image on the second area is received based on a user input for selecting a user interface item displayed on the first area.
10. The method of claim 9,
A method for controlling an electronic device, wherein the request for displaying the second image on the second area is received based on identification of a person's face as being included in the first image.
A non-transitory computer-readable recording medium comprising a program for executing a control method of an electronic device,
The electronic device includes a flexible display and at least one camera,
The control method of the electronic device,
acquiring a first image through the at least one camera while the flexible display is in a folding state;
displaying the first image on a first area of the flexible display; and
When a request for displaying a second image corresponding to the first image on the second area of the flexible display is received, the second image is displayed on the second area while the first image is displayed on the first area displaying on the area; A computer-readable recording medium comprising a. delete delete delete

Images