KR102304082B1 - Apparatus and method for controlling displays - Google Patents

Abstract

According to various embodiments, an electronic device may include a first display for displaying information; and a second display capable of changing a position with respect to the first display, wherein the second display may include a transparent display area capable of adjusting visibility of at least a portion of the information. Other embodiments are possible.

Description

Electronic device and method for controlling a plurality of displays {APPARATUS AND METHOD FOR CONTROLLING DISPLAYS}

Various embodiments relate to an electronic device and method for controlling a plurality of displays.

BACKGROUND With the development of information and communication industries, electronic devices function as important means for delivering various types of information to users. The electronic device may display various information through the display. In addition, the electronic device may provide a graphic user interface (GUI) using a display for user convenience. In order to provide more information to the user, the electronic device may include a plurality of displays. Such an electronic device may provide a user interface with improved user convenience, such as executing different applications through each of the plurality of displays.

According to the existing technology, when a plurality of displays functionally connected to an electronic device are positioned to overlap each other, information displayed by a specific display is obscured by another display, and thus information may not be transmitted accurately. In addition, as information displayed on a specific display is displayed in a state in which information displayed on a specific display is obscured by another display, information invisible to the user is displayed, so power consumption may be wasted unnecessarily.

Various embodiments may provide, for example, forming a transparent display area in at least one display among a plurality of displays, and using the transparent display area, at least a portion of information to be displayed on the other display is shown or is not shown. It is possible to provide an electronic device and a method capable of controlling so as not to do so. In addition, various embodiments use a point where a plurality of displays may be positioned to overlap each other and selectively overlap and display at least a portion of information, thereby delivering more diverse information and improving user convenience. An electronic device and method implementing an interface may be provided.

In order to solve the above-described problem or another problem, an electronic device according to an embodiment includes: a first display for displaying information; and a second display capable of changing a position with respect to the first display, wherein the second display may include a transparent display area capable of adjusting visibility of at least a portion of the information.

According to an embodiment, an electronic device includes: a first display formed on at least a portion of a body of the electronic device; and a second display formed on at least a portion of a cover functionally connected to the body and including a transparent display area.

According to an exemplary embodiment, a display device includes: a cover part capable of being attached to and detached from an electronic device and configured to cover at least a partial area of an outer surface of the electronic device; and a display formed in at least a partial area of the cover part and including a transparent display area.

A method according to an embodiment includes: displaying first information through a first display functionally connected to an electronic device; and when at least some information of the first information is displayed through a transparent display area of a second display connected to the electronic device so as to be able to change the position of the first display, the at least some information and the at least some information through the transparent display area It may include an operation of additionally displaying the second information in association.

A method according to an embodiment includes: displaying first information through a first display functionally connected to an electronic device; and when at least a part of the first information is viewed through a transparent display area of a second display functionally connected to the electronic device so as to change the position of the first display, an input to the transparent display area (eg: Based on a touch input, a key input, and biometric information (eg, fingerprint, iris, body temperature, pulse, skin aging index, skin humidity index, or electrocardiogram) information, at least a partial area of the first display corresponding to the transparent display area It may include an action to automatically change the setting.

According to an embodiment, a method of displaying an electronic device includes: a first display formed on at least a part of a body of the electronic device; and a second display formed on at least a portion of a cover functionally connected to the main body and including a transparent display area, and transmitted through the transparent display area using a sensor functionally connected to the electronic device. obtaining second information associated with the displayed first information; and displaying the second information through the transparent display area.

The electronic device and method according to various embodiments may effectively transmit information to be provided by each of a plurality of displays or other additional information to a user by using the transparent display area. In addition, the user's convenience can be improved by providing various user interfaces using the point that the plurality of displays can be positioned continuously without overlapping or overlapping each other according to the movement of the position of at least one of the plurality of displays. have.

1A is a diagram illustrating a network environment including an electronic device according to various embodiments of the present disclosure;
1B is a diagram illustrating a hardware structure of a display control module of an electronic device, according to various embodiments of the present disclosure;
1C is a diagram illustrating a hardware structure of a processor and a display control module of an electronic device, according to various embodiments of the present disclosure;
2A to 2E are diagrams illustrating electronic devices to which a plurality of displays are functionally connected, according to various embodiments of the present disclosure;
3A to 3C are diagrams illustrating an electronic device to which a plurality of displays are functionally connected, according to various embodiments of the present disclosure;
4A to 4C are diagrams illustrating an electronic device to which a plurality of displays are functionally connected, according to various embodiments of the present disclosure;
5A to 5B are diagrams illustrating a cross-section of a transparent display according to various embodiments of the present disclosure;
6A to 6C are diagrams illustrating examples of displaying information by adding a visual effect to given information using a plurality of displays functionally connected to an electronic device, according to various embodiments of the present disclosure;
7 is a diagram illustrating an example of displaying a stereoscopic image of a given image using a plurality of displays functionally connected to an electronic device, according to various embodiments of the present disclosure;
8A to 8C are diagrams illustrating examples of using an electronic device and a functionally transparent display area as a mirror display area according to various embodiments of the present disclosure;
9A to 9B are diagrams illustrating examples of selectively displaying information by adjusting transparency of at least a portion of a transparent display area functionally connected to an electronic device, according to various embodiments of the present disclosure;
10A to 10K are diagrams illustrating examples of controlling a plurality of displays functionally connected to an electronic device based on a user input, according to various embodiments of the present disclosure;
11 is a diagram illustrating an example of using a transparent display area formed in at least a portion of a plurality of displays functionally connected to an electronic device as an input means for another display, according to various embodiments of the present disclosure;
12 is a diagram illustrating an example of using a transparent display area formed in at least a portion of a plurality of displays functionally connected to an electronic device as an input means for another display, according to various embodiments of the present disclosure;
13 is a diagram illustrating an example of providing augmented reality content using a transparent display area functionally connected to an electronic device, according to various embodiments of the present disclosure;
14 is a diagram illustrating an example of changing a setting of another display overlapping a transparent display area among a plurality of displays functionally connected to an electronic device, according to various embodiments of the present disclosure;
15 is a flowchart illustrating a method of displaying information using a plurality of displays functionally connected to an electronic device, according to various embodiments of the present disclosure;
16 is a flowchart illustrating a method of generating a visual effect for given information using a plurality of displays functionally connected to an electronic device, according to various embodiments of the present disclosure;
17 is a flowchart illustrating a method of displaying information based on a user's gaze or face recognition information using a plurality of displays functionally connected to an electronic device, according to various embodiments of the present disclosure;
18 is a block diagram illustrating an electronic device according to various embodiments.

Hereinafter, the present disclosure will be described with reference to the accompanying drawings. As the present disclosure is capable of various changes and may have various embodiments, specific embodiments are illustrated in the drawings and the related detailed description is set forth. However, this is not intended to limit the present disclosure to specific embodiments, and should be understood to include all modifications and/or equivalents or substitutes included in the spirit and scope of the present disclosure. In connection with the description of the drawings, like reference numerals have been used for like components.

Expressions such as “comprises,” “may include”, etc. that may be used in the present disclosure indicate the existence of the disclosed corresponding function, operation, component, etc., and do not limit one or more additional functions, operations, components, and the like. In addition, in the present disclosure, terms such as "comprise" or "have" are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification is present, but one or more It should be understood that this does not preclude the possibility of addition or presence of other features or numbers, steps, operations, components, parts, or combinations thereof.

In the present disclosure, expressions such as “or” include any and all combinations of the words listed together. For example, “A or B” may include A, may include B, or include both A and B.

In the present disclosure, expressions such as “first,” “second,” “first,” “second” may modify various components of the present disclosure, but do not limit the components. For example, the above expressions do not limit the order and/or importance of corresponding components. The above expressions may be used to distinguish one component from another. For example, both the first user device and the second user device are user devices, and represent different user devices. For example, without departing from the scope of the present disclosure, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component.

When a component is referred to as being “connected” or “connected” to another component, it is understood that the other component may be directly connected or connected to the other component, but other components may exist in between. it should be On the other hand, when it is mentioned that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The terms used in the present disclosure are used only to describe specific embodiments, and are not intended to limit the present disclosure. The singular expression includes the plural expression unless the context clearly dictates otherwise.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present disclosure. does not

The electronic device according to the present disclosure may be a device including a communication function. For example, the electronic device includes a smart phone, a tablet personal computer (PC), a mobile phone, a video phone, an e-book reader, a desktop personal computer (PC), and a laptop computer. PC (laptop personal computer), netbook computer (netbook computer), PDA (personal digital assistant), PMP (portable multimedia player), MP3 player, mobile medical device, camera, or wearable device (eg: It may include at least one of a head-mounted-device (HMD) such as electronic glasses, an electronic garment, an electronic bracelet, an electronic band, an electronic necklace, other electronic accessories, or a smart watch).

According to some embodiments, the electronic device may be a smart home appliance having a communication function. Smart home appliances include, for example, a television, a digital video disk (DVD) player, an audio device, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washing machine, an air purifier, a set-top box, and a TV. It may include at least one of a box (eg, Samsung HomeSync™, Apple TV™, or Google TV™), game consoles, an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame.

According to some embodiments, the electronic device includes various medical devices (eg, magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), imagers, ultrasound machines, etc.), navigation devices, and GPS receivers. (global positioning system receiver), EDR (event data recorder), FDR (flight data recorder), automotive infotainment device, marine electronic equipment (such as marine navigation system and gyro compass, etc.), avionics, It may include at least one of a security device, or an industrial or household robot.

According to some embodiments, the electronic device is a piece of furniture or building/structure including a communication function, an electronic board, an electronic signature receiving device, a projector, or various It may include at least one of a measuring device (eg, water, electricity, gas, or electric wave, etc.). The electronic device according to the present disclosure may be a combination of one or more of the various devices described above. Also, it is apparent to those skilled in the art that the electronic device according to the present disclosure is not limited to the above-described devices.

Hereinafter, an electronic device according to various embodiments will be described with reference to the accompanying drawings. The term user used in various embodiments may refer to a person who uses an electronic device or a device (eg, an artificial intelligence electronic device) using the electronic device.

1A is a diagram illustrating a network environment 100 including an electronic device 101 according to various embodiments of the present disclosure. Referring to FIG. 1A , the electronic device 101 may include a bus 110 , a processor 120 , a memory 130 , an input/output interface 140 , a display 150 , a communication interface 160 , and a display control module 170 .

The bus 110 may be a circuit that connects the aforementioned components to each other and transmits communication (eg, a control message) between the aforementioned components.

The processor 120 is, for example, from the above-described other components (eg, the memory 130, the input/output interface 140, the display 150, the communication interface 160, or the display control module 170) through the bus 110. By receiving the command, the received command can be decoded, and an operation or data processing according to the decoded command can be executed.

The memory 130 is received from the processor 120 or other components (eg, the input/output interface 140, the display 150, the communication interface 160, the display control module 170, etc.) or is transmitted to the processor 120 or other components. It can store commands or data generated by The memory 130 may include, for example, programming modules such as a kernel 131 , middleware 132 , an application programming interface (API) 133 , or an application 134 . Each of the above-described programming modules may be composed of software, firmware, hardware, or a combination of at least two or more thereof.

The kernel 131 includes system resources (eg, the bus 110 and the processor 120) used to execute an operation or function implemented in the other programming modules, for example, the middleware 132, the API 133, or the application 134. or the memory 130) may be controlled or managed. Also, the kernel 131 may provide an interface capable of accessing, controlling or managing individual components of the electronic device 101 from the middleware 132, the API 133, or the application 134.

The middleware 132 may perform an intermediary role so that the API 133 or the application 134 communicates with the kernel 131 to exchange data. Also, in relation to the work requests received from the application 134, the middleware 132 provides, for example, a system resource (eg, the bus 110, the processor 120, or the The control (eg, scheduling or load balancing) of the work request may be performed by using a method such as allocating a priority in which the memory 130 can be used.

The API 133 is an interface for the application 134 to control a function provided by the kernel 131 or the middleware 132. For example, at least one interface or function for file control, window control, image processing, or character control. (eg command).

According to various embodiments, the application 134 is an SMS/MMS application, an e-mail application, a calendar application, an alarm application, a health care application (eg, an application for measuring an exercise amount or blood sugar) or an environment information application (eg: applications that provide information such as barometric pressure, humidity or temperature), and the like. Additionally or alternatively, the application 134 may be an application related to information exchange between the electronic device 101 and an external electronic device (eg, the electronic device 104 or the electronic device 105 ). The application related to the information exchange may include, for example, a notification relay application for transmitting specific information to the external electronic device, or a device management application for managing the external electronic device. can

For example, the notification delivery application transmits notification information generated by another application of the electronic device 101 (eg, an SMS/MMS application, an email application, a health management application, or an environment information application) to an external electronic device (eg, the electronic device 104 ). , a function of transmitting to the electronic device 105 . Additionally or alternatively, the notification delivery application may receive notification information from, for example, an external electronic device (eg, the electronic device 104 or the electronic device 105 ) and provide the notification information to the user. The device management application may include, for example, a function for at least a part of an external electronic device (eg, the electronic device 104, the electronic device 105) that communicates with the electronic device 101 (eg, the external electronic device itself (or some component parts) ) turn on/off or adjust the brightness (or resolution) of the display), and manage (eg, install) an application running on the external electronic device or a service (eg, call service or message service) provided by the external electronic device , delete or update).

According to various embodiments, the application 134 may include an application designated according to a property (eg, a type of the electronic device) of the external electronic device (eg, the electronic device 104 or the electronic device 105 ). For example, when the external electronic device is an MP3 player, the application 134 may include an application related to music reproduction. Similarly, when the external electronic device is a mobile medical device, the application 134 may include an application related to health management. According to an embodiment, the application 134 may include at least one of an application designated to the electronic device 101 or an application received from an external electronic device (eg, the server 106 or the electronic device 104 ).

The input/output interface 140 receives commands or data input from a user through an input/output device (eg, a sensor, a keyboard, or a touch screen), for example, the processor 120, the memory 130, and the communication interface 160 through the bus 110 , or may be transmitted to the display control module 170 . For example, the input/output interface 140 may provide data on a user's touch input through a touch screen to the processor 120 . In addition, the input/output interface 140 transmits, for example, a command or data received from the processor 120, the memory 130, the communication interface 160, or the display control module 170 through the bus 110 to the input/output device (eg, a speaker). or display). For example, the input/output interface 140 may output voice data processed through the processor 120 to the user through a speaker.

The display 150 may display various types of information (eg, multimedia data or text data) to the user. According to some embodiments, the display 150 may include, for example, a plurality of displays. According to an embodiment, the plurality of displays may be set to change positions relative to each other, for example. According to an embodiment, at least one display among the plurality of displays may include, for example, one or more transparent display regions or one or more mirror display regions.

According to some embodiments, the transparent display area refers to a display area having a property of transmitting light while displaying information on a display screen. The transparent display area allows, for example, a user in front of the transparent display area to visually recognize an object located at the back of the transparent display area. According to an embodiment, the transparent display area may be implemented in a form including, for example, a transparent oxide semiconductor film, and may be implemented to allow control of transparency.

According to some embodiments, the mirror display area refers to a display area having a property of reflecting light while displaying information on a display screen. The mirror display area allows, for example, a user in front of the mirror display area to visually recognize the user's own appearance. According to an embodiment, the mirror display area may be implemented, for example, by adjusting the transparency or reflectivity of the transparent display area.

According to an embodiment, the transparent display area is set to be able to adjust the visibility of at least a part of information displayed on a display other than a display in which the transparent display area is formed among a plurality of displays, for example can be

The communication interface 160 may connect communication between the electronic device 101 and an external device (eg, the electronic device 104 , the electronic device 105 , or the server 106 ). For example, the communication interface 160 is directly connected to an external electronic device (eg, electronic device 105) through wireless communication or wired communication, or via a network 162 (eg, electronic device 104 or server 106). may be connected to and communicate with an external electronic device (eg, the electronic device 104 , the electronic device 105 , or the server 106 ). The wireless communication is, for example, Wifi (wireless fidelity), BT (Bluetooth), NFC (near field communication), GPS (global positioning system) or cellular communication (eg, LTE, LTE-A, CDMA, WCDMA, UMTS) , WiBro, GSM, etc.). The wired communication may include, for example, at least one of universal serial bus (USB), high definition multimedia interface (HDMI), recommended standard 232 (RS-232), and plain old telephone service (POTS).

According to an embodiment, the network 162 may be a telecommunications network. The communication network may include at least one of a computer network, the Internet, the Internet of things, and a telephone network. According to an embodiment, a protocol (eg, a transport layer protocol, a data link layer protocol, or a physical layer protocol) for communication between the electronic device 101 and an external device is the application 134, the application programming interface 133, the middleware 132, the kernel 131, or It may be supported by at least one of the communication interfaces 160 .

The display control module 170 processes at least some of information obtained from other components (eg, the processor 120, the memory 130, the input/output interface 140, the communication interface 160, etc.) may control other components (eg, display(s) 150 ) to provide For example, the display control module 170 may generate information to be displayed through the display 150 using the processor 120 or independently thereof, and determine a position at which the generated information is to be displayed. For example, when the display 150 includes a plurality of displays, the display control module 170 may display information on at least one of the plurality of displays.

According to an embodiment, at least a portion of the display control module 170 may be, for example, a graphic processor. According to an embodiment, at least a part of the display control module 170 may be included as a part of logic executed by the processor 120 . Additional information on the display control module 170 is provided through FIGS. 1B to 1C, which will be described later.

FIG. 1B is a diagram illustrating a hardware structure of a display control module 170 of an electronic device (eg, electronic device 101) according to various embodiments of the present disclosure. Referring to FIG. 1B , the display control module 170 may be included as a part of logic executed by the processor 120 . The display 150 may include, for example, a first display 151 and a second display 152 . The second display 152 may include, for example, a transparent display area 153 . The processor 120 is, in addition to the display control module 170, an interface for transmitting, for example, a control signal generated by the display control module 170 to other external components (eg, the first display 151 and the second display 152). A circuit 125 may be further included. The display control module 170 may control at least one of the first display 151 and the second display 152 to display information on at least one of the first display 151 and the second display 152, for example.

According to some embodiments, the display control module 170 may include at least one attribute of the first display 151 and the second display 152, for example, size, shape, brightness, luminance, color, saturation, sharpness, transparency, and gamma. , resolution, contrast ratio, viewing angle, color gamut, color temperature, grayscale linearity, transmittance, or contrast can be adjusted. For example, the display control module 170 may adjust the transparency of the transparent display area 153 in a scale of 0-10. According to an embodiment, when at least a part of the first display 151 overlaps the transparent display area 153 according to the relative positions of the first display 151 and the second display 152, the first display At least some of the information displayed on 151 may be viewed through the transparent display area 153 . The display control module 170 may control the second display 152 to display information different from the at least some information through the transparent display area 153 in addition to or instead of the partial information.

When the transparent display area at least partially overlaps with the first display 151, for example, (1) the transparent display area 153 is in contact with at least a portion of the first display 151, so that the first display 151 is in contact (2) the viewing angle of the first display 151 in a state where the transparent display area 153 is spaced apart from at least a part of the first display 151 by a predetermined distance or inclination As a reference, it may include a case in which information displayed on a partial area of the first display 151 is transmitted and viewed (eg, a state in which a cover having a transparent display area is opened by about 10% to 45%).

According to various embodiments, the display control module 170 may include a relative position between the first display 151 and the second display 152, an open/closed state of a cover with respect to the main body of the electronic device 101, and the first display 151 Based on at least one of information to be displayed on, a function or application to be executed through the first display 151, information to be displayed on the second display 152, a function or application to be executed through the second display 152, or a user input, the first display The information to be displayed at 151 (or at least a part thereof) and other information may be determined. The display control module 170 may control the second display 152 to display the other information through the transparent display area 153 in addition or instead of the partial information.

According to various embodiments, the display control module 170 may include power state information of the electronic device 101, communication state information between the electronic device 101 and an external external electronic device (eg, 104, 105, or 106), or the electronic device 101 The other information may be determined based on at least one of external environment information and user-related context awareness information. The display control module 170 may control the second display 152 to display information different from the at least some information through the transparent display area 153 in addition to or instead of the partial information.

According to various embodiments, the expression control module 170 may generate, for example, a first control signal related to the first display 151 and/or a second control signal related to the second display 152, respectively. According to an embodiment, the first control signal may include, for example, a turn-on/turn-off control signal for the first display 151 and/or first information to be displayed on the first display 151 . According to an embodiment, at least a part of the first information may include, for example, a specific web page and/or a specific function execution screen output on the first display 151 . Alternatively, at least a part of the first information may include, for example, a background image of a screen output on the first display 151, a list, an icon or item, an object, and/or a preview image. Alternatively, at least a portion of the first information may include, for example, an image or text output on the first display 151 in response to a user input.

According to an embodiment, the second control signal is a turn-on/turn-off control signal for at least a portion of the second display 152 (eg, the transparent display area 153 ), and a second to be displayed on at least a portion of the second display 152 . may contain information. According to an embodiment, at least a part of the second information may include, for example, a specific web page and/or a specific function execution screen output to at least a part of the second display 152 (eg, the transparent display area 153). have. Alternatively, at least a part of the second information may include, for example, a background image, a list, an icon or item, an object, and/or a preview image of a screen output to at least a part of the second display 152 (eg, the transparent display area 153). may include. Alternatively, at least a portion of the second information may include, for example, data for adjusting the transparency of at least a portion of the transparent display area 153 .

According to an embodiment, the first information and the second information may each include data for executing different applications or playing different content in the first display 151 and the transparent display area 153, respectively. . According to an embodiment, at least a part of the second information may include, for example, at least one of transparency adjustment data of the transparent display area 153, 3D rendering related data, and/or augmented reality processing data. According to an embodiment, at least a portion of the second information is associated with data for setting at least a portion of the transparent display area 153 to a transparent state, the first display 151 and/or at least one object to be displayed on the transparent display area 153 data, data for displaying a region corresponding to at least one object and/or a region other than the at least one object in a transparent or opaque state, and information to be displayed on the first display 151 (eg, image or content) Information that adjusts display properties (eg, color, transparency, size, or sharpness, etc.) may be included. According to various embodiments, the display control module 170 may control the first display 151 and the second display 152 to display dual content set to be displayed at least in part through a plurality of different displays, for example. have. The dual content may be, for example, image content set to simultaneously reproduce the same image frame through the first display 151 and the transparent display area 153 . Alternatively, the dual content may be, for example, content configured to reproduce a portion of one content through the first display 151 and output another portion of the content through the transparent display area 153 . Alternatively, the dual content includes, for example, a graphic interface object (eg, an icon, a menu, etc.) and a background image, displays the background image through the first display 151, and displays the graphic interface object through the transparent display area 153 It may be content set to be displayed. Alternatively, the dual content includes, for example, main content and additional content for displaying additional information related to the main content, displaying the main content through the first display 151, and displaying the additional content through the transparent display area 153 It may be content set to do so.

According to various embodiments, the dual content may include, for example, at least one attribute of the first display 151 (eg, size, shape, brightness, luminance, color, saturation, sharpness, transparency, gamma, resolution, contrast ratio, viewing angle, at least one attribute (eg, size, shape, brightness, luminance, color, saturation, sharpness, Transparency, gamma, resolution, contrast ratio, viewing angle, color gamut, color temperature, grayscale linearity, data scanning speed, or contrast) may be included. According to an embodiment, the first content and the second content may have the same source or may include different objects. The first content may include, for example, a parameter value set to match a display characteristic (eg, resolution) of the first display 151 and content to be displayed on the first display 151 (eg, an image or text). The second content may include, for example, at least one attribute of the transparent display area 153 (eg, size, shape, brightness, luminance, color, saturation, sharpness, transparency, gamma, resolution, contrast ratio, viewing angle, color gamut, color temperature, It may include a parameter value set to suit grayscale linearity, transmittance, contrast, or data scanning speed) and content (eg, image or content) to be displayed on the transparent display area 153 . The parameter value may include, for example, a numerical value related to at least one of sharpness, sharpness, color, color, contrast, brightness, contrast, and saturation of the content to be output on the first display 151 and/or the transparent display area 153. can

FIG. 1C is a diagram illustrating a hardware structure of a processor (eg, processor 120 ) and a display control module (eg, display control module 170 ) of an electronic device (eg, electronic device 101 ) according to various embodiments of the present disclosure. Referring to FIG. 1C , a processor (eg, processor 120 ) may include a first processor 121 (eg, application processor) and a second processor 122 . The display control module (eg, the display control module 170 ) may include a first display control module 171 for controlling the first display 151 and a second display control module 172 for controlling the second display 162 . The first display control module 171 and the second display control module 172 may be included as part of logic executed by the first processor 121 and the second processor 122, respectively. The first display control module 171 may be connected to the second display control module 172 of the second processor 122 through the internal interface circuit 125 of the first processor 121 .

According to various embodiments of the present disclosure, the first display control module 171 may control events occurring in the electronic device 101, for example, a relative position between the first display 151 and the second display 152, and a cover of the main body of the electronic device 101. open/closed state, information to be displayed on the first display 151, a function or application to be executed through the first display 151, information to be displayed on the second display 152, a function or application to be executed through the second display 152, or Based on (or in response to) at least one of the user inputs, information display through the first display 151 may be controlled.

According to various embodiments, the second display control module 172, similarly to the first display control module 171, based on (or in response to) various events occurring in the electronic device 101, at least a portion of the second display 152 ( For example, the display of information through the transparent display area 153) can be controlled. According to an embodiment, the second display control module 172 may adjust the transparency of the transparent display area 153 in response to a specific event. According to an embodiment, the second display control module 172 may control a screen change of the transparent display area 153 in response to a specific event. The second display control module 172 may be configured to display an object (eg, an image or text) in an opaque state in at least a partial area of the transparent display area 153 and a remaining partial area to have a transparent state, for example. can be controlled. According to an embodiment, in response to a specific event, the second display control module may generate an image obtained by capturing a screen output on the transparent display area 153 . The second display control module 172 may be implemented in the form of a chip independent of the first display control module 172 (eg, the second processor 122), and may be disposed on either the main body or the cover of the electronic device 101 . According to an embodiment, the second display control module 172 may include, for example, a stereoscopic module 183 , a depth module 186 , an augmented reality processing module 189 , and/or a visibility processing module 192 . According to one embodiment, the stereoscopic module 183 is configured to, for example, to give a visual effect in which at least a part of the image displayed on the first display 151 is viewed through the transparent display area 153, the corresponding image is displayed three-dimensionally. , may be displayed on the transparent display area 153 by applying image processing (eg, shift) for a three-dimensional effect to the corresponding image. The stereoscopic module 183 may, for example, move the screen output on the first display 151 to display it on the transparent display area 153 . The stereoscopic module 183 may, for example, adjust a resolution of a screen output on the first display 151 or adjust a thickness or brightness of a boundary line, and display it on the transparent display area 153 . In addition to image shift, image processing for three-dimensional effects applied by the stereoscopic module 183 includes equalization, sharpening, noise removal, histogram transformation (image quality improvement), face recognition, high-frequency cutoff filtering (blurring), high frequency It may include enhancement filtering (sharpening), angle transformation, size transformation, saturation transformation, brightness transformation, or object finding (template matching). Here, when the image output through the first display 151 and the image output through the transparent display area 153 overlap at least partially, the object finding function may be a function of remarkably processing a specific object in the image.

According to an embodiment, the depth module 186 is configured to provide a visual effect in which the image is realistically viewed, for example, when at least a part of the image displayed on the first display 151 is viewed through the transparent display area 153. , image processing is applied to the corresponding image to generate images to be displayed on the upper surface 154 and the lower surface 155 of the transparent display area 153, respectively, and the depth of the corresponding image may be expressed using the generated images. The depth module 186 adjusts the size, shape, color, brightness, contrast, or boundary line processing of the first image to be displayed on the first display 151 according to the display characteristics of the first display 151, for example, A second image capable of imparting depth (a sense of depth) to the image may be generated. According to an embodiment, the second image may be, for example, an image obtained by reducing the first image by a certain ratio. The depth module 186 uses the first image displayed on the first display 151 by controlling the second image to which predetermined image processing is applied to be output through the transparent display area 153 . The second image may be expressed to be visually recognized by the user as a 3D image.

According to an embodiment, when the transparent display area 153 is configured in multiple layers, the depth module 186 may generate a second image, a third image, etc. obtained by reducing the first image at a plurality of different ratios, respectively. For example, the transparent display area 153 having a multilayer structure may include at least a first transparent display layer and a second transparent display layer. The first image is output from the first display and transmitted through the transparent display area 153, and at the same time, the second image is output through the first transparent display layer, and the third image is output through the second transparent display layer. can The second image and the third image, together with the first image, may be visually recognized by the user as three-dimensional images.

According to an embodiment, the depth module 186 may reduce the brightness of the screen output to the first display 151 or make the boundary of the first image more dim or lighten the color in order to recognize the perspective of the first image. . Alternatively, the depth module 186 may process the color of the second image to be darker or the boundary line to be sharper.

According to one embodiment, image processing for a three-dimensional effect applied by the depth module 186 includes shift, smoothing, sharpening, noise removal, histogram transformation (image quality improvement), face recognition, high-frequency cutoff filtering (blurring), and high-frequency enhancement filtering ( sharpening), angle conversion, size conversion, saturation conversion, brightness conversion, or finding an object.

According to an embodiment, the augmented reality processing module 189 may provide additional information about an object or a place in the user's field of view when it is determined that the user sees an external object or place through the transparent display area 153, for example. 156 may be displayed on the transparent display area 153 . The augmented reality processing module 153, for example, is located in the user's field of view based on context information obtained using a sensor (eg, a rear camera sensor) functionally connected to the electronic device, or the user's gaze or face recognition information. Additional information about objects or places can be obtained.

According to an embodiment, the augmented reality processing module 189 transmits, for example, a preview image captured using a rear camera sensor to an external server, and predicts information about an object or a place in the user's field of view from the external server. Alternatively, additional information to be displayed on the transparent display area 153 may be acquired. The additional information may include, for example, the location and height of the building in the user's field of view, information about shops or restaurants within the building, and the like. According to one embodiment, the augmented reality processing module 189 receives information to be displayed on the transparent display area 153 from an external server in order to reduce data processing inside the augmented reality processing module 189, and without additional processing, the received information is left intact. It may be set to be displayed on the transparent display area 153 . The augmented reality processing module 189 may reduce time delay or information distortion occurring in the augmented reality processing process through such real-time processing.

According to an embodiment, the visibility processing module 192 may, for example, perform image processing for improving visibility of information displayed through the transparent display area 153 and/or information displayed through the transparent display area 153 .

Visibility of information in which the same information is output through the first display 151 and the transparent display area 153 may be displayed differently. In the transparent display area 153, for example, due to light transmission, the clarity of displayed information may be relatively lower than that of the opaque display area. According to an embodiment, even when information of the same color is output through the first display 151 and the transparent display area 153, the color displayed through the transparent display area 153 may appear relatively pale compared to the color displayed through the first display 151. have. In this regard, the visibility processing module 192 may perform various types of image processing on information to be displayed through the transparent display area 153 in consideration of, for example, a transparent characteristic of the transparent display area 153 .

Also, the visibility of information displayed on the first display 151 may be different depending on whether the information displayed on the first display 151 passes through the transparent display area 153 . When the information displayed on the first display 151 is transmitted through the transparent display area 153, it may have relatively low sharpness compared to the case where the information is directly transmitted without passing through the transparent display area 153. FIG. According to an embodiment, when a specific color is displayed on the first display 151 and the displayed specific color is transmitted through the transparent display area 153, the user may recognize that the specific color is lighter than the specific color. In this regard, the visibility processing module 192 may perform various types of image processing on information to be displayed through the first display 151 in consideration of, for example, a transparent characteristic of the transparent display area 153 .

According to an embodiment, the visibility processing module 192 may clearly process a boundary area of an object such as an image or text in a screen to be displayed through the first display 151 and/or the transparent display area 153 . The visibility processing module 192 may apply, for example, a sharpness effect to a boundary region of an object. According to an embodiment, the visibility processing module 192 may darken the color or color of the screen to be displayed through the first display 151 and/or the transparent display area 153 . According to another embodiment, the visibility processing module 192 may process the color or color of the screen to be displayed on the first display 151 to be relatively dark compared to the screen to be displayed through the transparent display area 153 . Alternatively, the reverse case is also possible.

According to an embodiment, the visibility processing module 192 applies a specified transparency adjustment value to the first information (eg, the first screen) to be displayed on the first display 151, for example, to the transparent display area 153. Second information to be displayed (eg, a second screen) may be generated. According to an embodiment, the visibility processing module 192 applies a contrast adjustment value specified to first information (eg, a first screen) to be displayed on the first display 151 , for example, to apply a contrast adjustment value to be displayed on the transparent display area 153 . 2 information (eg, the second screen) may be generated. The contrast adjustment value may be, for example, a value (eg, a statistical value or an experimental value) set to have visibility of a certain standard or higher while the first screen is viewed through the transparent display area.

According to an embodiment, when the transparent display area 153 is formed in a multi-layer structure including, for example, at least a first transparent display panel and a second transparent display panel, the visibility processing module 192 may be configured to include the first transparent display panel or the second transparent display panel. At least one of the 2 transparent display panels may be designated as a panel to output the second information. Alternatively, the visibility processing module 192 may process the second information to be simultaneously output to the first transparent display panel and the second transparent display panel.

According to an embodiment, the visibility processing module 192 may determine, for example, an output direction of the second information in the transparent display area 153 . The visibility processing module 192 may determine an output direction of the second information, for example, based on a relative positional relationship between the first display 151 and the second display 152 . The visibility processing module 192 may output the second information in a horizontal writing direction, for example, when the first display 151 is disposed to at least partially overlap the transparent display area. Alternatively, the visibility processing module 192 may output the second information in a reverse horizontal writing direction, for example, when the first display 151 is disposed parallel to the transparent display area. Alternatively, the visibility processing module 192 may dynamically adjust the output direction of the second information according to an angle between the first display 151 and the second display 152 .

According to an embodiment, the visibility processing module 192 is configured to, for example, when the resolution of the first display 151 and the resolution of the transparent display area 153 are different from each other, the first information output to the first display 151 (eg, the first screen) ), the size of the second information (eg, the second screen) output to the transparent display area 153 may be adjusted to correspond to the size of the . In addition, the visibility processing module 192 may include, for example, the color, contrast, contrast, or saturation of the second information (eg, the second screen) output to the transparent display area 153, the first information output to the first display 151 ( For example, image processing may be performed on the first information and/or the second information to be similar to the color, contrast, contrast, saturation, etc. of the first screen).

According to an embodiment, the visibility processing module 192 may change the second information being output to the transparent display area 153 in response to, for example, an event recognized by a motion sensor related to the second display 152 . For example, in response to a bending or hinge operation of the second display, the visibility processing module 192 may be configured to perform at least one of sharpness, brightness, contrast, and color of the second information (eg, the second screen) being output to the transparent display area 153 . can be dynamically adjusted. Alternatively, the visibility processing module 192 may dynamically adjust transparency of at least a partial area of the transparent display area 153 in response to a bending or hinge operation of the second display.

In the above-described embodiment, the second display control module 172 is disclosed as including all of the stereoscopic module 183, the depth module 186, the augmented reality processing module 189, and the visibility processing module 192, but various embodiments are not limited thereto. , the second display control module 172 may be implemented in a form including at least one of the stereoscopic module 183, the depth module 186, the augmented reality processing module 189, and the visibility processing module 192. Hereinafter, additional information on the electronic device 101 is provided through drawings to be described later.

2A to 2D are diagrams illustrating electronic devices to which a plurality of displays are functionally connected, according to various embodiments of the present disclosure; First, referring to FIG. 2A , the electronic device 210 may include a first body part 211 , a first display 212 , a second body part 213 , a second display 214 , and a folder connection part 215 . According to an embodiment, the first body part 211 may include a first display 212 . The first display 212 may be formed, for example, on at least a portion of at least one surface (eg, a front surface) of the first body portion 211 . According to an embodiment, the second body part 213 may include a second display 214 . The second display 214 may be formed, for example, on at least a portion of at least one surface (eg, an upper surface) of the second body 213 .

According to an embodiment, the folder connecting part 215 may be coupled to the first body part 211 and the second body part 213 . The first body part 211 and the second body part 213 may be connected to each other through, for example, the folder connection part 215 . According to an embodiment, according to the relative positional relationship between the first body part 211 and the second body part 213, the first display 212 included in the first body part 211 and the second display part 214 included in the second body part 213 may be disposed at a position at least partially overlapping each other with respect to the user of the electronic device 210 .

According to an embodiment, the folder connection unit 215 may be made of, for example, a flexible material. For example, the outer and inner layers of the folder connector 215 may be made of one of materials such as leather, artificial leather, wool, carbon fiber reinforced plastics (CFRP), glass fiber reinforced plastics (GFRP), polycarbonate (PC), glass, sapphire, etc. more can be formed. According to one embodiment, the folder connection unit 215 is, for example, an electrical connection between a component of the first body unit 211 (eg, the first display 212 ) and a component of the second body unit 213 (eg, the second display 214 ). It may include a circuit for a flexible connection (eg, a flexible printed circuit board (FPCB)).

According to one embodiment, the folder connection part 215 is coupled to the first body part 211 and the second body part 213 through a hinge, for example, so that the first body part 211 and the second body part 213 are connected to the folder connection part 215. It may be formed to be rotatable independently of each other. A relative position between the first body part 211 and the second body part 213 may be changed by rotation of at least one of the first body part 211 and the second body part 213 . The second display 214 may be, for example, arranged to overlap at least partially with the first display, arranged side by side, or arranged to have a specific angle. In addition, according to a change in the relative position between the first body part 211 and the second body part 213, with respect to the user of the electronic device 210, the position or size of the region at least partially overlapping each other between the first display 212 and the second display 214 etc. may be changed.

According to one embodiment, the folder connection unit 215 includes information related to hinge coupling with the first body unit 211 and/or the second body unit 214, for example, information related to the first body unit 211 and/or the second body unit 213. It may further include a sensor for sensing whether the hinge is coupled and / or the hinged angle. The information related to the hinge coupling may be converted into a signal related to control of the first display 212 and/or the second display 214 by, for example, an internal component of the electronic device 210 (eg, the display control module 170 ). . The electronic device 210 may display information through, for example, at least a portion of the first display 212 or the second display 214 . According to an embodiment, the transparent display area 216 may be included in at least a portion of one or more of the first display 212 and the second display 214 (eg, the second display 214 formed in the second body 213). In the transparent display area 216, for example, at least a portion of information displayed on a display other than the display in which the transparent display area 216 is formed (eg, the first display 212) is optically transmitted through the transparent display area 216, so that electronic It can be set to be visible to the user of the device. The information transmitted through the transparent display area 216 and displayed may include, for example, at least a portion of information corresponding to an area that at least partially overlaps with each other between the first display 212 and the transparent display area 216 among the information displayed on the first display. may include

According to an embodiment, a cushion member (not shown) may be disposed on at least a portion of the first body part 211 and/or the second body part 213 . The cushion member may be, for example, a material having elasticity. For example, when the first display 212 and the transparent display area 216 are disposed to overlap each other, the cushion member may be disposed on some of the surfaces facing each other between the first display 212 and the transparent display area 216 . The cushion member may minimize impact or damage due to, for example, contact or collision between the first display 212 and the transparent display area 216 . In addition, the cushion member may maximize the 3D effect by, for example, maintaining a constant distance between the first display 212 and the transparent display area 216 .

Referring to FIG. 2B , the electronic device 220 may include a first body part 221 , a first display 222 , a second body part 223 , a second display 224 , and a slide connection part 225 . The first body part 221 , the first display 222 , the second body part 223 , and the second display 224 which are the components of the electronic device 220 include the first body part 211 , the first display 212 , and the second body part which are the components of the electronic device 210 . As components corresponding to the unit 213 and the second display 214, they may have the same or similar structures or may perform the same or similar functions.

According to one embodiment, the slide connection part 225 may be coupled to the first body part 221 and the second body part 223 . The slide connection part 225 may be set such that, for example, the first body part 221 and the second body part 223 are independently slidable while the first body part 221 and the second body part 223 are connected to each other. By sliding movement of at least one of the first body part 221 and the second body part 223, the location or size of a region open to the user of the electronic device 220 among the first display 222 and the second display 224 may be changed. The electronic device 220 may display information through, for example, at least a portion of an area open to the user of the electronic device 220 among the first display 222 and the second display 224 .

According to an embodiment, at least a portion of one or more of the first display 222 and the second display 224 (eg, the second display 224 ) may include the transparent display area 226 . The transparent display area 226 may include, for example, at least a portion of information displayed in an area closed to the user of the electronic device 220 among displays other than the display in which the transparent display area 226 is formed (eg, the first display 222). The display area 226 may be optically transmitted to be displayed to the user of the electronic device 220 . The information transmitted and viewed through the transparent display area 226 includes, for example, at least part of information corresponding to an overlapping area between the first display 222 and the transparent display area 226 among the information displayed on the first display 222. can do.

Referring to FIG. 2C , the electronic device 230 may include a first body part 231 , a first display 232 , a second body part 233 , a second display 234 , and an opening/closing connection part 235 . The first body part 231 , the first display 232 , the second body part 233 , the second display 234 , and the opening/closing connection part 235 which are the components of the electronic device 230 are the first body part 211 and the first display 212 which are the components of the electronic device 210 . , the second body 213 , the second display 214 , and the folder connection unit 215 may have the same or similar structures or may perform the same or similar functions.

The electronic device 230 may be, for example, a device that can be worn on a user's body. According to an embodiment, the first body part 231 may include, for example, a frame that can be worn on the user's body. Such a frame, for example, as shown in FIG. 2C, may be formed in a structure similar to a bracelet, a band, or a watch that can be worn on a user's wrist. This is only one embodiment, and the frame may be formed in the structure of various other devices (eg, glasses, clothes, headsets, earphones, etc.) that can be worn on the user's body according to the type of the electronic device. For example, in the case of electronic glasses, the glass portion of the electronic glasses corresponds to the first display 232, and is connected to at least one side of the frame of the electronic glasses so that the position of the electronic glasses can be changed so as to overlap above or below the glass portion. The glass or (retractable or rollable) flexible display may correspond to the second display 234 . According to some embodiments, such a wearable device may include only a secondary display (eg, a second display 234 ) without a main display (eg, the first display 232 ).

According to an embodiment, the opening/closing connection part 235 may be formed on at least a portion of the first body part 231 and may be detachably coupled to the second body part 233 . The opening/closing connection part 235 is, for example, in a state in which the first body part 231 and the second body part 233 are connected to each other, and the second body part 233 rotates with respect to the first body part 231 or slides in at least one direction of up, down, left and right. It can be set to enable. By the movement of the second body portion 233, the location or size of a region open to the user of the electronic device 230 among the first display 232 and the second display 234 may be changed. The electronic device 230 may display information through, for example, at least a portion of an area open to the user of the electronic device 230 among the first display 232 and the second display 234 .

According to an embodiment, at least a portion of one or more of the first display 232 and the second display 234 (eg, the second display 234 ) may include the transparent display area 236 . In the transparent display area 236, for example, at least a portion of information displayed in an area closed to the user of the electronic device 230 among other displays (eg, the first display 232) other than the display in which the transparent display area 236 is formed is the corresponding transparent area. The display area 236 may be optically transmitted to be displayed to the user of the electronic device 230 . The information transmitted and viewed through the transparent display area 236 may be, for example, at least a portion of information corresponding to an overlapping area between the first display 232 and the transparent display area 236 among the information displayed on the first display 232 .

Referring to FIG. 2D , the electronic device 240 includes a main body 241 and a first display 242 formed on one surface (eg, a front) of the main body, and a cover 243 detachable to the electronic device 240 is provided on one surface of the second second display 243 . Display 244 may be included. The main body 241, the first display 242, the cover 243, and the second display 244 formed on one surface of the electronic device 240 include a first body part 211, a first display 212, a second body part 213, and a second display 244 that are components of the electronic device 210. As components corresponding to the display 214, they may have the same or similar structures or may perform the same or similar functions.

According to one embodiment, the cover 243 may include, for example, the body 241 and a frame detachable. When the cover 243 is attached to the main body 241 through the frame, it may cover at least a portion (eg, a front or rear surface) of the main body 241 . According to one embodiment, the frame, for example, may be formed to be detachably coupled to at least a portion of the main body 241, or may be formed in a form capable of fixing at least a portion of the main body 241. The frame may be formed, for example, on at least a part of the rear cover 248, which will be described later.

According to one embodiment, the cover 243 is a front cover 247 for protecting a component (eg, the first display 242) formed on the front side of the body 241, for protecting a component (eg, a battery) formed on the back side of the body 241 At least one of the rear cover 248 may be included. According to one embodiment, when the cover 243 includes both the front cover 247 and the rear cover 248, the front cover 247 and the rear cover 248 are connected to each other, and the side surface (eg, the left side or the right side) of the main body 241 is removed from the outside. It may further include a side cover 249 for protecting from the impact of.

According to one embodiment, at least a portion of the side cover 249 may be made of an elastic material, for example, may be implemented with various materials such as a leather material and/or a polyurethane material. According to one embodiment, at least a portion of the side cover 249 may be made of a material having a certain rigidity, for example, may be implemented with various materials such as a plastic material or a metal material. The side cover 249 may be bent at a predetermined angle unit by, for example, a material having a predetermined rigidity. According to an embodiment, the electronic device may include a sensor on one side of the side cover 249 for detecting information about the bent state of the side cover 249, for example, whether the side cover 249 is bent and/or a bent angle. have.

According to an embodiment, the second display 244 may be formed on at least a portion of at least one surface (eg, an upper surface or a lower surface) of the front cover 247, for example. The second display 244 may include, for example, a transparent display area 246 . The transparent display area 246 is a portion of information displayed by the first display 242, for example, when the cover 243 is mounted on the main body 241 so that at least a part of the cover 243 (eg, the front cover 247) covers the main body 241 may be set to optically transmit through the corresponding transparent display area 246 to be visually displayed to the user of the electronic device 240 .

According to some embodiments, the electronic device 240 may further include a third display (not shown). The third display may be formed on one or more portions of another portion of the front cover 247 or at least a portion of the rear cover. According to an embodiment, when the third display (not shown) is formed on at least a part of the rear cover, the electronic device 240 performs a pattern of a specific color or a specific pattern, or a specific image through the third display (not shown). can be displayed. According to an embodiment, the electronic device 240 may control the third display (not shown) to operate in one of a turn-on state or a turn-off state.

According to various embodiments, the cover 243 may be formed of, for example, a display stacked structure (not shown) as follows.

Kinds external input/output device internal input/output device One electronic ink touch panel digitizer color
display touch panel digitizer 2 electronic ink - digitizer color
display touch panel digitizer 3 electronic ink touch panel - color
display touch panel - 4 electronic ink - - color
display touch panel - 5 - - - color
display touch panel digitizer 6 - - - color
display touch panel - 7 electronic ink touch panel digitizer - - - 8 electronic ink - digitizer - - -

According to an embodiment, the cover 243 may have input/output layers stacked on the outside and the inside. Each of the input/output layers may selectively include a display and a touch input means (eg, a touch panel, a digitizer). According to another embodiment, the cover 243 may form an input/output layer in a single layer at any one of the outside and the inside. The configurations described in the above table are only examples, and the cover 243 may be configured by additionally including various other components or by deleting or merging some of the above-described components.

Referring to FIG. 2E , the electronic device 250 may include a first body part 251 , a first display 252 , a second body part 253 , and a second display 254 . The main body 251, the first display 252, the cover 253, and the second display 254, which are the components of the electronic device 250, are the first body part 211, the first display 212, the second body part 213, and the second display part which are the components of the electronic device 210. As a component corresponding to 214, it may have the same or similar structure to each other, or may perform the same or similar function to each other.

According to an embodiment, the first body part 251 may include, for example, a first connector 257 detachably connected to at least a part (eg, a side surface) of the second body part 253 . According to an embodiment, the second body part 253 may include, for example, a second connecter 259 detachably connected to at least a part (eg, a side surface) of the first body part 251 . According to one embodiment, the second connection part 259 may include a pivotable hinge structure, for example, hinge-coupled to the first body part 251, each of the first body part 251 and the second body part 253, By using the second connection part 259, it may be formed to be rotatable. According to an embodiment, at least one of the first connection part 257 and the second connection part 259 may include a magnet for detachably connecting the first body part 251 and the second body part 253 using a magnetic force. According to an embodiment, the first connection part and the second connection part may be formed in a physical structure that is detachable from each other.

According to one embodiment, a physical structure detachable from each other is, for example, connecting the first connector 257 and the second connector 259 using a connector (eg, a connector header or a connector socket) connection. can According to another embodiment, the physical structure detachable from each other may be connected to the first connection part 257 using, for example, a contact (eg, a pogo pin, a spring pin, a plate spring) connection. The second connection part 259 may be connected.

According to an embodiment, the first body part 251 and the second body part 253 may be connected to each other through wireless communication even when they are detached from each other. For example, each of the first body part 251 and the second body part 253 includes a first communication module (not shown) and a second communication module (not shown), so that at least one of the first display and the second display is displayed. It is possible to transmit/receive a control command for controlling the display of the device or information to be displayed on at least one of the first display and the second display. According to one embodiment, the first communication module (not shown) and the second communication module (not shown) are, for example, a predetermined short-range communication protocol (eg, wireless fidelity (Wifi), Wifi-direct, wireless gigabit alliance), BT (bluetooth), BLE (bluetooth low energy), Zigbee, UWB (ultra wideband), NFC (near field communication), RFID (radio frequency identification), audio sync, HBC (human body communication) or VLC ( visible light communications) or certain network communications (e.g. Internet, local area network (LAN), wire area network (WAN), telecommunication network, cellular network, satellite network, or plain old telephone service (POTS), etc.) can

According to an embodiment, the first body part 251 may further include, for example, a frame that can be worn on the user's body. Such a frame, for example, as shown in FIG. 2C, may be formed in a structure similar to a bracelet, band, or watch that can be worn on a user's wrist. This is only one embodiment, and the frame may be formed in the structure of various other devices (eg, glasses, clothes, headsets, earphones, etc.) that can be worn on the user's body according to the type of the electronic device.

According to an embodiment, the second display 214 may be a separate accessory (eg, card type) display physically separated from the electronic device 210 . For example, the user may obtain the effects described above or below by carrying the accessory-type display separately from the electronic device 210 and overlapping at least a portion on the first display 212 formed on the electronic device 210 only when necessary. In this case, the accessory-type display may include at least one communication interface for supporting communication (eg, Bluetooth, BLE, NFC, WiFi, etc.) with the electronic device 210 . In addition, according to an embodiment, the accessory-type display is a separate input/output device (eg, at least one or more physical input keys, one or more virtual input keys, a touch pad capable of detecting a touch or hovering, a camera, or a sensor) may include. Additional information on the input/output device is provided in relation to FIG. 18 . 2A to 2E and related descriptions are some exemplary embodiments, and a structure to which a display in which a transparent display area is formed and a control method thereof can be applied is not limited thereto.

3A to 3C are diagrams illustrating an electronic device to which a plurality of displays are functionally connected, according to various embodiments of the present disclosure; Referring to FIG. 3A , the electronic device 300 (eg, the electronic device 101 ) may include, for example, a plurality of displays including at least a first display 310 and a second display 320 . The first display 310 may be formed, for example, on at least a portion (eg, a front surface) of the main body 330 of the electronic device 300 . The second display 320 may be formed, for example, on at least a portion of the cover 340 that may cover at least a portion of the main body 330 of the electronic device 300 (eg, the first display 310 ).

According to some embodiments, the second display 320 may include at least a transparent display area 322 . The second display may include, for example, an additional display area 324 . The additional display area 324 may have, for example, different attributes than the transparent display area 322, such as size, shape, brightness, color, saturation, sharpness, contrast, transmittance, gamma, resolution, contrast ratio, viewing angle, color gamut, color temperature, gradation linearity, or transparency), or have properties independent of the transparent display area 322 (such as size, shape, brightness, color, saturation, sharpness, contrast, transmittance, gamma, resolution, contrast ratio, viewing angle, color gamut, color temperature, gradation linearity, or transparency) can be adjusted. According to an embodiment, the additional display area 324 may be at least one of another transparent display area or a mirror display area. A description of an embodiment using a functionally transparent display area as a mirror display area is described, for example, in FIGS. 8A to 8C .

According to some embodiments, the electronic device 300 may further include a third display 350 . The third display 350 may be formed on another part of the cover 340 of the electronic device 300 . According to one embodiment, when the second display 320 is formed on at least a part of the upper surface of the cover 340, the third display 350 is, for example, another part of the top surface of the cover 340, the lower surface of the cover 340 ( It may be formed on one or more portions of at least a portion of an upper surface or a lower surface of at least a portion of the bottom surface or at least a portion of a portion covering at least a portion of a side surface of the body of the cover 340. According to an embodiment, the third display 350 may include, for example, another transparent display area or a mirror display area.

Referring to FIG. 3B , the electronic device 300 may further include, for example, at least a fourth display 360 . The fourth display 360 may be formed, for example, on at least a portion of another surface (eg, a rear surface) of the main body 330 of the electronic device 300 or a portion of the cover 340 that covers at least a portion of the rear surface of the main body.

According to some embodiments, the fourth display 360 may include at least a transparent display area 362 . The fourth display 360 may include, for example, an additional display area 364 . The additional display area 364 may have, for example, different properties than the transparent display area 362 (eg, display type (active organic light emitting diode, thin film transistor liquid crystal display, transparent display or mirror display, etc.), pixel structure, size, shape, brightness, color, saturation, sharpness, contrast, transmittance, transparency, saturation, gamma, resolution, contrast ratio, viewing angle, color gamut, color temperature, or gradation linearity, etc.) (active organic light emitting diode, thin film transistor liquid crystal display, transparent display or mirror display, etc.), pixel structure, size, shape, brightness, color, saturation, sharpness, contrast, transmittance or transparency, etc.) can be adjusted. According to an embodiment, the additional display area 364 may be at least one of another transparent display area or a mirror display area, and may be formed as a separate area in one display or each independent display physically separate.

According to an embodiment, the fifth display 370 may be formed on at least a portion of the upper surface of the cover 340 . According to some embodiments, the fifth display 370 may include at least a transparent display area 372 . The fifth display may include, for example, an additional display area 374 . The additional display area 374 may have, for example, different properties from the transparent display area 372 (eg, display type (active organic light emitting diode, thin film transistor liquid crystal display, transparent display, mirror display), pixel structure, size, shape, brightness, color , saturation, sharpness, contrast, transmittance, or transparency, etc.) or independent of the transparent display area 372 (eg, display type (active organic light emitting diode, thin film transistor liquid crystal display, transparent display, mirror display), pixel structure) , size, shape, brightness, color, saturation, sharpness, contrast, transmittance or transparency) can be adjusted. According to one embodiment, the additional display area 374 may be a mirror display area, and may be formed as a separate area in one display or each independent display physically separated.

According to an embodiment, the sixth display 380 may be formed on another portion of the upper surface of the cover 340 or at least a portion of the upper surface of a portion of the cover 340 that covers at least a portion of the side surface of the main body 330 . According to an embodiment, the sixth display 380 may be formed as a region separated from the fifth display 370 formed on at least a portion of the upper surface of the cover 340 and one display, or each independent display physically separated. According to another embodiment, the sixth display 380 may be formed as an area separated from the fourth display 360 formed on at least a portion of the rear surface of the main body 330 and a single display area or as each independent display physically separated. In this case, the fourth display 360 , the fifth display 370 , and the sixth display 380 may be positioned on the same plane as at least one of the main body 330 and the cover 340 is moved. According to one embodiment, the sixth display 380 may be formed as a separate area from the fifth display 370 in one display or as separate displays physically separated from each other.

According to an embodiment, the electronic device 300 uses the display control module 170 to, for example, when the fourth display 360, the fifth display 370, and the sixth display 380 are located on the same plane or similar (eg, designated ( specified) receiving a user input or receiving a command from an external electronic device), it is possible to control at least one of the displays 360 , 370 , and 380 to function as one display.

For example, under the control of the display control module 170, the fourth display, the fifth display 370, and the sixth display 378 may simultaneously display at least one content. In this case, the displayed at least one content is, for example, before being recognized as the same plane or before a specified user input is received, the first display 310, the second display 320, the third display 350, and the fourth It may be content being displayed on at least one of the display 360, the fifth display 370, and the sixth display 380. In addition, in expressing the corresponding portion of the at least one content, at least one display among the fourth display 360, the fifth display 370, and the sixth display 380 has the same or different properties (eg, size) from the other displays. , shape, brightness, color, saturation, sharpness, contrast, transmittance, transparency, saturation, gamma, resolution, contrast ratio, viewing angle, color gamut, color temperature, or grayscale linearity).

According to various embodiments, in the electronic device 300, one surface of the main body 330 (eg, a portion of the rear surface of the main body 330 in which the fourth display 360 is not located) or one surface of the cover 340 (eg, the fifth display 370 is not located) part), an additional component 392 or 394 may be further included. Additional components 392, 394 may include, for example, an audio output module (eg, a thin film speaker), an energy harvester (eg, a solar cell), storage, a sensor (eg, a biometric device). Information recognition sensors (such as fingerprint sensors, electrocardiogram sensors, body temperature sensors, pulse sensors, oxygen saturation sensors, body fat sensors, skin aging sensors, skin humidity sensors, heart rate monitor sensors); It may include at least one of a touch sensor, a pressure sensor, an antenna, a communication module (eg, RF, WiFi, NFC, cellular communication, Bluetooth, or BLE communication, etc.) a camera or a battery (eg, a thin film battery). have.

According to some embodiments, one of the additional components 392 and 394 may be additionally or alternatively formed at another location of the electronic device 300 or the cover 340 .

Referring to FIG. 3C , at least one display (eg, the second display 320 ) among a plurality of displays of the electronic device may include a main body when the cover 340 is closed with respect to the inner surface of the cover 340 , for example, the electronic device 300 . It may be formed on the surface in the direction toward 330. The other one of the plurality of displays of the electronic device (eg, the fifth display 370 ) may be formed on an outer surface of the cover 340 , for example, on a surface facing the outside of the main body 330 when the cover 340 is closed. can

According to an embodiment, the fifth display 370 may be driven with low power compared to the other displays among the plurality of displays, for example. For example, when the fifth display 370 is driven with low power and consumes less battery, information (eg, current time, battery status, electric field) designated to be always turned on before receiving a specified input (eg, a screen lock key input) is received. It can be set to display the situation or various notification information (message notification or missed call, etc.). According to an embodiment, the fifth display 370 may be set to be driven by a processor (eg, the processor 120 ) that controls overall functions of the electronic device 300 . Alternatively, the electronic device 300 may include a separate low-power processor for driving the fifth display with low power. When the electronic device includes a low-power processor, the function of displaying designated information through the fifth display may be performed by the low-power processor.

According to an embodiment, the electronic device 300 includes, according to the opening/closing state of the cover 340, specified information among a plurality of displays (eg, current time, battery status, electric field status, or various notification information (message notification or missed call, etc.)) You can decide which display to display. For example, when the cover 340 is closed, the electronic device 300 may display designated information through the fifth display 370 . Alternatively, when the cover 340 is opened, for example, the electronic device 300 may display designated information through the display (eg, the first display 310 ) formed on the second display 320 or the main body 330 . According to another embodiment, when the cover 340 is closed, the electronic device 300 sets the display (eg, the first display 310) formed on the second display 320 or the main body 330 to a low power state (eg, a sleep state). Alternatively, the screen on the display may be controlled in an off state (eg, power supplied to the display is turned off). Alternatively, when the cover 340 is opened, for example, the electronic device 300 sets the second display to a low power state (eg, a sleep state) or to an off state (eg, turn off power supplied to the display). can be controlled According to various embodiments, at least one display (eg, the display 320 ) among the plurality of displays of the electronic device may be configured as a transparent display having a cover 340 disposed at an edge thereof. When the display 320 is folded to face the display 310 in the electronic device 300, the other side of the display 320 among the plurality of displays of the electronic device 300, for example, the display 370, may be disposed on the outer side, for example, the opposite side of the display 320 .

According to an embodiment, when the cover 340 is folded so that the display 370 is disposed outward, the electronic device 300 may be driven with relatively low power compared to driving methods of other displays. For example, when the cover 330 and the cover 340 are arranged to have a specified angle or a specified first angle range (eg, the cover 330 and the cover 340 are arranged to have a range of 180 degrees or 120 to 210 degrees), the electronic device 300 may display the display 320 and the display. The 310 may be controlled to be driven with the first amount of power. In addition, when the cover 330 and the cover 340 are disposed to have a specified second angle range (eg, the cover 330 and the cover 340 are disposed in a range of 0 degrees or 30 degrees or less), the electronic device 300 is supplied to the display 320 and the display 310. It can be controlled to cut off the power. In this operation, the electronic device 300 may control the display 370 to be driven with a specified second level of power (eg, with a lower power level smaller than the first level of power).

According to various embodiments, the display 320 and the display 370 may be physically configured as one transparent display, or the transparent display 320 and the transparent display 370 may be provided in a double overlapping form. When configured as a single transparent display, the display 320 and the display 370 are configured as one piece of hardware, and the direction of displaying information and the amount of power supplied may be defined differently in response to the hinge angle of the cover 340 .

According to an embodiment, the transparent display 320 may display the object in the first display direction (eg, arranging text or images in the order from left to right) when the cover 340 is disposed to have a specified first angle range. . In addition, the transparent display 320 may be driven with a first power level when the cover 340 is disposed to have a specified first angle range. According to one embodiment, when the cover 340 is disposed to have a specified second angular range, the transparent display 320 displays the object in the second display direction (eg, arranging text or images in the order from right to left), It may be displayed like the display 370 as shown in the drawing. Here, the transparent display 320 may be driven with a second power level different from the first power level. In a state in which the cover 340 is disposed in the first angular range, the first information output to the transparent display 320 (eg, in the front direction) and the transparent display 320 (eg: The second information output to the rear direction of the display 320 or the front direction of the display 370 in the case of a dual panel structure) may be the same or different. As described above, the electronic device 300 according to various embodiments varies the driving power of the transparent display differently (eg, low power or designated normal power) in response to the hinge state of the transparent display (eg, at least one of the display 320 and the display 370). can be processed

4A to 4C are diagrams illustrating an electronic device to which a plurality of displays are functionally connected, according to various embodiments of the present disclosure; Referring to FIG. 4A , a display device 400 may be, for example, a device that can be attached to or detached from the electronic device 401 (eg, the electronic device 101 ). The electronic device 401 may include, for example, a first display 402 . According to an embodiment, the display device 400 may include, for example, a plurality of cover members 410 , 420 , and 430 . In this case, by using at least one of the plurality of cover members 410, 420, and 430, at least a portion (eg, front or rear) of the main body of the electronic device is covered, thereby protecting the electronic device from external impact. can Each of the plurality of cover members 410 , 420 , and 430 may be flexibly moved with respect to the electronic device 401 when mounted on the electronic device 401 , for example, in an unfolded or folded form.

According to another embodiment, the display device 400 is formed as an independent display device by combining the cover member 410 and the cover member 420, and includes a separate cover member (not shown) that can be mounted or detached on the rear surface of the cover member 420 . The cover member 430 may be combined to form another independent display device. In this case, the display device 400 may be configured using another display device independent of each other and another display device. Referring to FIG. 4B , the display device 400 may further include at least one second display 440 . The second display 440 may be formed on a portion other than a portion on which the main body of the electronic device 401 is mounted among at least one cover member (eg, 410 and 430 ) among the plurality of cover members 410 , 420 , and 430 . According to one embodiment, the cover member 430 may include an additional display (not shown). For example, an additional display (not shown) may be formed on at least a portion of a portion that covers at least a portion of another portion (eg, a rear surface) of the cover member 430 of the display device 400 .

According to an embodiment, when the display device 400 is mounted on the electronic device 401, the second display 440 of the display device 400 may operate in conjunction with the first display 402 of the electronic device 401 . For example, the first display 402 and the second display 440 may be controlled to simultaneously display at least one content. In this case, the displayed at least one content is, for example, before the display device 400 is mounted on the electronic device 401 or before a specified user input is received, at least one of the first display 402 and the second display 440 . It may be at least one piece of content being displayed in one piece. According to an embodiment, the at least one content may be information (eg, text, image, or video) that is newly displayed after the display device 400 is mounted on the electronic device 401 . In addition, in expressing content through the first display 402 or the second display 440, the same or different properties (eg, size, shape, brightness, color, saturation, sharpness, contrast, transmittance, transparency, saturation, Gamma, resolution, contrast ratio, viewing angle, color gamut, color temperature, or grayscale linearity).

According to some embodiments, the display device 400 may include, for example, a portion (eg, a part (eg, 410, 430) of at least one of the plurality of cover members 410, 420, and 430 to which the main body of the electronic device 401 is not mounted. Examples: 413, 416, 433, 436) may further include an additional component 422. The additional component 422 may include, for example, an audio output module (eg, a thin film speaker), an energy harvester (eg, a solar cell), storage, a sensor (eg, biometric information recognition). Sensors (such as fingerprint sensor, electrocardiogram sensor, body temperature sensor, pulse sensor, oxygen saturation sensor, body fat sensor, skin aging sensor, skin humidity sensor, heart rate monitor sensor (HRM sensor)), touch contains at least one of a sensor, pressure sensor, antenna, communication module (such as RF, WiFi, NFC, cellular communication, Bluetooth, or BLE communication), or a camera) or battery (such as a thin film battery) can do.

Referring to FIG. 4C , the display device 400 may further include at least one third display 450 . The third display 450 may be formed, for example, on at least a portion of an outer surface of at least one of the plurality of cover members 410 , 420 , and 430 (eg, 410 , 420 , 430 ). According to an embodiment, in the display device 400 , a portion of an outer surface of at least one of the plurality of cover members 410 , 420 and 430 (eg, 410 , 420 , or 430 ) on which the third display 450 is not formed. At least a portion (eg, 418, 428) of may further include an additional component. Additional components may include, for example, an audio output module (eg, a thin film speaker), an energy harvester (eg, a solar cell), storage, a sensor (eg, a biometric sensor). (Example: fingerprint sensor, electrocardiogram sensor, body temperature sensor, pulse sensor, oxygen saturation sensor, body fat sensor, skin aging sensor, skin humidity sensor, HRM sensor (heart rate monitor sensor)), touch sensor , a pressure sensor, an antenna, a communication module (such as RF, WiFi, NFC, cellular communication, Bluetooth, or BLE communication, etc.), or a camera) or a battery (such as a thin film battery). can

According to one embodiment, at least one cover member (eg, 410, 420, or 430) of the plurality of cover members 410, 420, 430 at least part of the inner surface or the outer surface (eg, the third display) It may include a solar cell. According to one embodiment, at least a part of the solar cell is integrally configured with at least a part of the display (eg, a transparent display area) formed on the cover member, for example, so that the display (or the corresponding area within the display) is integrally formed. (eg transparent display area)) or independently of it.

According to an embodiment, the amount of sunlight that can be received varies according to the coupling shape or relative position between the electronic device 401 and the cover members 410, 420, and 430, and accordingly, the amount of charging current charged by the solar cell can be changed do. According to an embodiment, for example, a user may adjust a position (eg, an open/closed state, an angle, a direction, etc.) of the electronic device 401 in order to charge the electronic device 401 using a solar cell. In this case, when the amount of energy or charging current that can be received by the solar cell becomes the specified optimal value or exceeds the specified threshold value, at least one of the electronic device 401 or the display device 400 may generate sound, vibration, lamp, or text message. , or by using at least one of various notification expression methods such as an image, the user may be notified. Through this, the electronic device 401 or the display device 400 may guide the user to use the solar cell more efficiently.

According to one embodiment, when the third display 450 is formed on the outer surface of at least one of the plurality of cover members 410, 420, and 430 (eg, 410, 420, or 430), the third display 450 Through this, additional image information related to the user's context information (eg, location, time, etc.) may be displayed. According to an embodiment, when the additional image information is composed of a repeated pattern (eg, a floral pattern, a wave pattern, a honeycomb pattern, a stripe pattern, or a specific background such as a mountain, sea, sky, or forest) or has a specific color In addition, the pattern or color of the additional image information may be dynamically changed so that the pattern or color of the additional image information corresponds to the user's context information. For example, when it is determined that the user's location is in the forest, the color of the additional image information may be changed to green. can According to some embodiments, the above-described additional image information may be displayed through the mirror image area of the corresponding display.

According to various embodiments, a plurality of locations (eg, at least two of a front or rear surface of the electronic device 401 , a front or rear surface of the cover member 410 , a front or rear surface of the cover member 420 , or a front or rear surface of the cover member 430 ) The same or various types of speakers may be formed in the . The electronic device 401 includes information outputted through one or more displays (eg, an image or a video), at least a partial opening/closing state of the cover member, situation information (eg, the location of the electronic device (eg, home, office, or movie theater, etc.), time You can select which speakers are activated or deactivated depending on (eg morning - wake-up call), user schedule (eg meeting or class, etc.), and the power state of the electronic device (eg low power state, etc.) Additionally or alternatively, electronic The device 401 may adjust the volume of at least one of the activated speaker(s), according to an example, the electronic device 401 may, for example, allow the speakers formed in a certain position (eg, the cover member 410 or 430 ) to emit radiation. According to an embodiment of the present disclosure, the electronic device 401 may detect, for example, an operation state (eg, an activated state or an inactive state) of a display formed at a certain position (eg, the cover member 410 or 430 ). According to an embodiment, the electronic device 401 may activate at least one display among displays formed in a certain position (eg, the cover member 410 , 420 , or 430 ). It is possible to control activation of at least one speaker(s) formed on a cover member including an activated display.

According to various embodiments, the electronic device 401 may provide various sound field effects (eg, surround, Dolby, or stereo). The electronic device 401 may, for example, be positioned at a certain position (eg, cover member 410, 420, or Alternatively, activation of at least one of the speaker(s) formed in the 430 or direction of sound may be controlled. According to an embodiment, in the electronic device 401, an angle formed by, for example, one surface (eg, inner surface) of the cover member 410 and one surface (eg, inner surface) of the cover member 430 is within a predetermined range (eg, 90). to 180 degrees). In this case, activation of the at least one speaker(s) formed on the cover member 410 and the cover member 430 or the directionality of sound may be controlled. In the same or similar method to the above-described method, the electronic device 401 may provide various sound field effects (eg, surround, Dolby, or stereophonic sound) through the cover member 420 and the speaker(s) formed on the cover member 430 . . According to an embodiment, the electronic device 401 may select a speaker to be activated or deactivated according to, for example, the cover member 410 or at least a partial opening/closing state of the cover member 420 . In the electronic device 401, for example, in a state in which the cover member 410 covers one surface (eg, a front surface) of the electronic device 401, one surface (eg, an inner surface) of the cover member 410 covering the one surface of the electronic device 401 . The at least one speaker(s) formed on the in-plane may be deactivated or the directionality of sound may be controlled, and the at least one speaker(s) formed on one surface (eg, an outer surface) of the cover member 410 may be activated or controlled. In the same or similar method to the above-described method, the electronic device 401 may activate at least one speaker formed on one surface (eg, an inner surface or an outer surface) of the cover member 420 or control the directionality of sound.

5A to 5B are diagrams illustrating a structure of a transparent display of a display device 500 according to various embodiments of the present disclosure. Referring to FIG. 5A , the display device 500 (eg, the display device 400 ) includes, for example, a plurality of layers (eg, a first layer 520 and a second layer 530 ) in an enclosure 510 . It may include a stacked structure penetrating the upper and lower surfaces of the display device 500 through the .

According to one embodiment, in the enclosure 510, for example, the first layer 520 is exposed through a surface (eg, a top surface) of the display device, and the second layer 530 is the other surface (eg, the top surface) of the display device. : It is possible to support components of the first layer 520 and the second layer 530 to be exposed through a bottom surface.

According to an embodiment, at least one transparent display module may be disposed on the first layer 520 and the second layer 530 . Each of the transparent display modules may include at least one of a transparent display panel for displaying information or a touch sensor for recognizing a touch input or proximity input related to the transparent display panel.

According to an embodiment, the stacked structure of the first layer 520 and the second layer 530 may be classified into four types, for example, according to the components of the first layer 520 and the second layer 530. .

Kinds first layer 2nd layer One transparent display panel
+ Touch sensor touch sensor 2 transparent display panel
+ Touch sensor etc
(Example: display, e-ink, digitizer, solar cell, thin-film speaker, polycarbonate, acrylic, clear plastic cover, none) 3 touch sensor transparent display panel
+ Touch sensor 4 etc
(Example: display, e-ink, digitizer, solar cell, thin-film speaker, polycarbonate, acrylic, clear plastic cover, none) transparent display panel
+ Touch sensor

According to an embodiment, in the first type, a transparent display panel is formed on at least a portion of the first layer 520, and is coupled to at least a portion of the transparent display panel (eg, a top surface of the transparent display) to receive an input related to the transparent display a second layer 530 coupled with at least a portion of a transparent display panel (eg, a bottom surface of a transparent display) formed in the first layer, the input associated with the transparent display or touch sensor formed in the first layer; Alternatively, it may include a touch sensor capable of receiving another input independent of this.

According to an embodiment, in the second type, a transparent display panel is formed on at least a portion of the first layer 520, and is combined with at least a portion of the transparent display panel (eg, a top surface of the transparent display) to receive an input related to the transparent display Including a touch sensor capable of performing, coupled with at least a portion of the transparent display panel formed on the second layer 530 (eg, the lower surface of the transparent display), the transparent display formed on the second layer 530 or various forms related to or independent of the touch sensor object (eg, display, e-ink, digitizer, solar cell, thin-film speaker, polycarbonate, acrylic, clear plastic cover, or none).

According to one embodiment, in the third type, a touch panel is formed on at least a portion of the first layer 520, and a transparent display panel related to or independent of the touch panel formed on the first layer is formed on at least a portion of the second layer 530; , may include a touch sensor coupled with at least a portion of the transparent display panel (eg, the upper surface of the transparent display) to receive an input related to the transparent display.

According to one embodiment, the fourth type includes various types of objects (eg, displays, electronic inks, digitizers, solar cells, thin film speakers, polycarbonate, acrylic, transparent plastic covers, or none) on at least a portion of the first layer 520 . ) is formed, and a transparent display panel related to or independent of various types of objects formed on the first layer is formed on at least a portion of the second layer 530, and is combined with at least a portion of the transparent display panel (eg, the upper surface of the transparent display) It may include a touch sensor capable of receiving an input related to the transparent display.

It is apparent to those skilled in the art that the above-described various display structures are one embodiment, and that various elements may be added to form displays of various structures. Referring to FIG. 5B , the display device 500 includes, for example, an enclosure. A single-layer structure penetrating the upper and lower surfaces of the display device 500 through, for example, one third layer 540 may be included in the enclosure 510 .

According to an embodiment, at least one transparent display module may be disposed on the third layer 540 . Each of the transparent display modules may include at least one of a transparent display panel for displaying information, a touch sensor for recognizing a touch input or proximity input related to the transparent display panel, and a digitizer.

According to an embodiment, the stacked structure of the third layer 540 may be classified into at least four types as follows, for example, according to components of the third layer 540 .

Kinds 3rd layer One transparent display panel
+ Single-sided touch sensor/digitizer 2 transparent display panel
+ Double-sided touch sensor/digitizer 3 transparent display panel 4 transparent display panel
+ Single-sided touch sensor/digitizer + solar cell

According to one embodiment, in the first type, a transparent display panel is formed on at least a portion of the third layer 540, and is combined with at least a portion of the transparent display panel (eg, a top surface of the transparent display) to receive an input related to the transparent display and a digitizer that is coupled to at least a portion of the transparent display panel (eg, a lower surface of the display) to receive an input related to or independent of the transparent display.

According to one embodiment, in the second type, a transparent display panel is formed on at least a portion of the third layer 540, and is combined with at least a portion of the transparent display panel (eg, upper and lower surfaces of the transparent display) to provide input related to the transparent display. It may include a plurality of touch sensors capable of receiving a digitizer that is coupled to at least a portion of the transparent display panel (eg, an upper surface or a lower surface of the display) to receive an input related to or independent of the transparent display.

According to an embodiment, the third type may include a transparent display panel in at least a portion of the third layer 540 .

According to an embodiment, in the fourth type, a transparent display panel is formed on at least a portion of the third layer 540, and is combined with at least a portion of the transparent display panel (eg, a top surface of the transparent display) to receive an input related to the transparent display It may include a solar cell capable of receiving sunlight associated with or independent of the transparent display by being coupled to at least a portion of the transparent display panel (eg, the lower surface of the display).

For example, the various display structures described above with reference to FIGS. 5A to 5B are only one embodiment, and some components may be configured in a display form of various structures in which they are added, deleted, or merged. For example, at least one of the first layer 520 , the second layer 530 , or the third layer 540 has the same thickness as the enclosure 510 in at least one direction (eg, a top direction or a bottom direction) ( FIG. 5A ), or At least one direction may be formed to have a thickness different from that of the enclosure 510 ( FIG. 5B ).

According to various embodiments, a first display for displaying information; and a second display capable of changing a position with respect to the first display, wherein the second display may include a transparent display area capable of adjusting visibility of at least a portion of the information. According to an embodiment, the visible state may indicate that the at least some information is invisible, a form is visible but content is not recognizable (barely visible but illegible), is faintly legible, or (relatively ) can be adjusted in several steps (eg scale 0-10), such as visible.

According to various embodiments, set to automatically control the adjustment of the visible state based on at least one of the information (to be displayed or displayed on the first display) or a change in the position of the transparent display area with respect to the first display It may further include a display control module.

According to various embodiments, the display control module may be configured to selectively display at least a part of the information (to be displayed or displayed on the first display) or at least one of other information through the transparent display area.

According to various embodiments, when the transparent display area at least partially overlaps with the first display, the display control module may be configured such that at least a portion of the information (to be displayed or displayed on the first display) is the transparent At least one of the transparency of the transparent display area and the luminance or brightness of the first display may be controlled so as to be transmitted through the display area and visible (to the user).

According to various embodiments, the display control module may be configured such that when the transparent display area at least partially overlaps with the first display, at least a portion of the information (to be displayed or displayed on the first display) overlaps the transparent display area. At least one of the transparency of the transparent display area and the luminance or brightness of the first display may be automatically adjusted so that the transparent display area is transmitted through and visible to the user.

According to various embodiments, the second display may constitute at least a part of a cover for the electronic device.

According to various embodiments, the second display may be formed to be attached to and detached from the electronic device.

According to various embodiments, an electronic device may include a first display for displaying information; and a second display capable of changing a position with respect to the first display, wherein the second display may include a transparent display area capable of adjusting visibility of at least a portion of the information.

According to various embodiments, at least one of the first display and the second display may include one or more transparent display regions or one or more mirror display regions.

According to various embodiments, an electronic device may include: a first display formed on at least a portion (eg, a front) of a body of the electronic device; and a second display formed on at least a portion (eg, a top surface) of a cover functionally connected to the body and including a transparent display area.

According to various embodiments, at least one of the first display or the second display may have at least one of size, shape, brightness, color, saturation, sharpness, transparency, transmittance or contrast dynamically changeable. It may include a display area.

According to various embodiments, at least one of the first display and the second display may be configured to detect a touch input or a proximity input.

According to various embodiments, a third display formed on another part of the cover may be further included.

According to various embodiments, at least one of the first display, the second display, and the third display may include one or more transparent display regions or one or more mirror display regions.

According to various embodiments, a third display formed on at least another portion (eg, a bottom surface) of the cover may be included.

According to various embodiments, the third display may include at least one of a transparent display area and a mirror display area.

According to various embodiments, the display device may further include a third display formed on a portion covering at least a portion of a side of the body among the at least a portion (eg, the top surface) of the cover.

According to various embodiments, the third display may include at least one of a transparent display area and a mirror display area.

According to various embodiments, a third display formed on a portion of a lower surface of the cover that covers at least a portion of a side surface of the main body may be further included.

According to various embodiments, the third display may include at least one of a transparent display area and a mirror display area.

According to various embodiments, a third display formed on another part (eg, back) of the main body may be further included.

According to various embodiments, the third display may include at least one of a transparent display area and a mirror display area.

According to various embodiments, a fourth display formed on the other part (eg, a rear surface) of the main body may be further included.

According to various embodiments, the cover may include an audio output module formed on one or more of the other part of the upper surface of the cover, at least part of the lower surface of the cover, or at least part of the rear surface of the main body.

According to various embodiments, the audio output module may include a thin film speaker.

According to various embodiments, the cover may include an energy harvester formed on one or more of another portion of the upper surface of the cover, at least a portion of a lower surface of the cover, or at least a portion of the rear surface of the body. have.

According to various embodiments, the energy harvester may be configured to generate power based on at least one of light, temperature, vibration, and pressure.

According to various embodiments, the energy harvester may include a solar cell.

According to various embodiments, an input module for recognizing an input associated with at least a portion of the transparent display area may be further included.

According to various embodiments, the input module may be configured to recognize, as the input, at least one of a first input associated with the upper surface of the cover and a second input associated with a lower surface of the cover.

According to various embodiments, the input module may include at least one of a touch sensor and a pressure sensor.

According to various embodiments, the display device further includes a display control module configured to control at least one of the first display and the second display, wherein the display control module includes at least some of the information displayed on the first display. When viewed through the transparent display area, information different from the at least some information may be set to be displayed through the transparent display area, additionally or instead of the partial information.

According to various embodiments, the display control module may include an open/closed state of the front cover or the rear cover with respect to the main body, information to be displayed on the first display, and information to be displayed on the first display. It may be configured to determine the other information based on at least one of a function or application, information to be displayed on the second display, a function or application to be executed through the second display, or a user input.

According to various embodiments, the display control module may include power state information of the electronic device, communication state information between the electronic device and an external device for the electronic device, or external environment information of the electronic device, and a user of the electronic device It may be configured to determine the other information based on at least one of context-aware information associated with the .

According to various embodiments, the cover may be detachably connected to the body.

According to various embodiments, the cover may be connected to the main body in at least one structure of a folder, a hinge, a flip, and a slide so that the cover can be opened and closed with respect to the main body.

According to various embodiments, a solar cell formed integrally with the second display may be further included.

According to various embodiments of the present disclosure, a display device may include a cover part capable of being attached to and detached from an electronic device and configured to cover at least a partial region of an outer surface of the electronic device; and a display formed in at least a partial area of the cover unit and including a transparent display area.

According to various embodiments, the electronic device may further include a communication unit for communicating with at least one of the electronic device and an external device for the electronic device.

According to various embodiments, at least one of size, shape, brightness, color, saturation, sharpness, transparency, and contrast of the transparent display area may be dynamically changed.

According to various embodiments, the display may further include a mirror display area.

According to various embodiments, the electronic device includes a first display for displaying information about a user and a second display capable of changing a position of the first display, wherein the second display includes at least a portion of the information may include a transparent display area in which visibility can be adjusted for the user.

According to various embodiments, the electronic device shows a first display and at least some information of the displayed information through the first display when the first display is closed, and displays other information when at least part of the information is opened with respect to the first display A second display set to be displayed may be included.

According to various embodiments, the display apparatus may be set to show an object or display information when the first surface faces the front, and display other information when the second surface faces the front.

6A to 6C are diagrams illustrating examples of displaying information by adding a visual effect (eg, a stereoscopic effect) to information to be displayed through a plurality of displays in an electronic device according to various embodiments of the present disclosure; The electronic device (eg, the electronic device 101) may include, for example, a plurality of displays including at least a first display (eg, the first display 151) and a second display (eg, the second display 152). . The second display includes, for example, a transparent display area (eg, a third display 153 ), wherein, depending on the relative position between the first display and the second display, at least a portion of the information displayed on the first display is the transparent display area It can be formed to be shown through.

Referring to FIG. 6A , the display control module (eg, the display control module 170 ) of the electronic device may control a plurality of displays to be displayed by adding a visual effect to information to be displayed. The display control module receives, for example, additional information (eg, first image information 615 or second image information 620) for adding a visual effect (eg, three-dimensional effect) to information to be displayed (eg, 2D image, 610) can create According to an embodiment, the display control module may, for example, at least one of a property of information to be displayed (eg, a display form or a display depth, etc.) or a type of a visual effect (eg, an embossed effect or an engraved effect, etc.) Based on one, additional information can be generated. According to an embodiment, when the information to be displayed is an image, image processing may be applied to a process of generating the additional information in the display control module. For example, the display control module may extract attributes such as shape or depth of image information to be displayed through image processing, and generate additional information based on the extracted attributes. According to an embodiment, the display control module may determine the type of the visual effect based on at least one of information to be displayed, image analysis information received from an external electronic device, or a user input, for example. For example, when the information to be displayed is an icon, the visual effect may be determined as, for example, an embossed effect.

According to various embodiments, the display control module, for example, when it is recognized that information to be displayed through the first display (eg, 2D image, 610) is transmitted through the transparent display area to be displayed, the display control module displays Additional information capable of adding a visual effect (eg, a three-dimensional effect) to the to-be-informed information 610 may be generated. According to an embodiment, the display control module is configured to, when the information 610 to be displayed is determined as an icon image, pass through the transparent display area to add a visual effect to the information 610 to be displayed as embossed. The first image information 615 to be displayed through the first display to be transmitted through and the second image information 620 to be displayed through the second display so as to be superimposed on the first image information 615 may be generated.

According to an embodiment, the first image information 615 may be generated in the same way as the information 610 to be displayed, and the second image information 620 may be generated as an image for expressing a visual effect of the information to be displayed. Conversely, the second image information 620 may be generated identically to the information to be displayed, and the first image information 615 may be generated as an image for expressing a visual effect of the information to be displayed. These are only one embodiment, and the first image information 615 and the second image information 620 may be generated in various ways.

According to an embodiment, in the process of generating at least one of the first image information 615 and the second image information 620, shift, smoothing, sharpening, noise removal, histogram transformation, face recognition, and high frequency cutoff in the image of the first information The first image information 615 may be generated as image information different from the information 610 to be displayed by applying at least one image processing technique of filtering, angle transformation, size transformation, saturation transformation, brightness transformation, or object finding.

The electronic device may form a plurality of physical layers by, for example, arranging the first display and the second display to overlap each other. The electronic device implements a visual effect by combining the visual representations of each of a plurality of physical layers with each other, for example, to achieve the same or similar visual effect through software image processing on a display having a single physical layer. Compared to a case in which a visual expression is implemented, a relatively superior visual effect can be derived.

Referring to FIG. 6B , the display control module (eg, the display control module 170 ) of the electronic device converts the 2D image 640 to be displayed through the first display and/or the second display into a 3D image and displays it. For this purpose, the 2D image 640 may be copied to generate copy images 641 and 642 . In this case, the copy images 641 and 642 may be the same image as the 2D image 640, respectively, or may be generated by applying image processing for a stereoscopic effect to the 2D image 640 . According to an embodiment, the display control module may perform 3D rendering on the 2D image to generate copy images 641 and 642 .

Referring to FIG. 6C , the display control module (eg, the display control module 170 ) of the electronic device provides, for example, a composite image 650 in which information to be displayed through a first display and/or a second display includes a plurality of layers. In the case of , the objects 651, 652, and 653 for each layer may be divided, and image processing (eg, 3D rendering) for the objects 651, 652, and 653 for each layer may be performed identically or differently. According to one embodiment, the display control module, for example, processes a boundary line for the first object 651 to be sharp, and sets the size of the first object to a predefined size or to another object (eg, the second object 652 or the second object 652). The first transform object 661 corresponding to the first object 651 may be generated by adjusting the size to a set size according to comparison with the 3 object 653 . For example, the display control module may generate a second transformation object 662 corresponding to the second object 652 by adjusting the sharpness and size of the second object 652 based on the first transformation object 661 . . The display control module, for example, based on at least one of the first transform object 661 and the second transform object 662, adjusts the sharpness and size of the third object 653, the third transform object corresponding to the third object 653 663 can be created. According to an embodiment, the display control module may adjust, for example, a relative arrangement position between the transform objects 661 , 662 , and 663 .

According to various embodiments, the display control module may perform, for example, analysis of a source image (eg, 610, 640, or 650), and a visual effect (eg, three-dimensional effect or depth) according to the analysis result. Image processing may be performed by calculating a parameter to be applied for the expression of , and applying the calculated parameter to a source image or an object in the source image. It is a diagram showing an example in which one stereoscopic image is reproduced. The electronic device (eg, the electronic device 101) may include, for example, a plurality of displays including at least a first display (eg, the first display 151) and a second display (eg, the second display 152). . The second display includes, for example, a transparent display area (eg, a transparent display area 153 ), wherein, depending on a relative position between the first display and the second display, at least a portion of the information displayed on the first display is the transparent display area It can be formed to be shown through.

Referring to FIG. 7 , the display control module (eg, the display control module 170 ) of the electronic device provides, for example, first information (eg, a 2D image, 710 ) related to information to be displayed through the first display (eg: display the left-eye image 720 or the right-eye image 730) and control the plurality of displays to display second information related to the information to be displayed through the second display (eg, the other one of the left-eye image 720 or the right-eye image 730) can do. Through this, the first information and the second information are displayed, for example, overlapping each other at the same time (eg, 3D red/blue method), each display through an additional filter (eg, polarizing filter) included in each display By being provided in a way that is displayed through (eg, 3D polarization method) or in a time-division display method (eg, 3D shutter glass method) through each display, it is possible to provide more diverse information or derive visual effects.

According to an embodiment, the display control module may generate or obtain a left-eye image 720 and a right-eye image 730 of the stereoscopic image to be reproduced, for example, in order to more effectively reproduce the stereoscopic image. For example, the display control module may allocate the left-eye image 720 to any one of the first display and the second display, and allocate the right-eye image 730 to the other one of the first display or the second display. The display control module may control the first display and the second display in various ways according to a stereoscopic image realization method (eg, a red-blue glasses method, a shutter glass method, a polarization method, etc.).

According to an embodiment, the display control module may allocate, for example, a left eye image 720 to the first display and a right eye image 730 to the second display. , in the first display, for example, the left-eye image 720 is reproduced through a red filter-based image processing process, and at the same time, in the second display, the right-eye image 730 is reproduced through, for example, a blue filter-based image processing process. The first display and the second display can be controlled to play.

According to an embodiment, the display control module is configured to, for example, when the stereoscopic image realization method is a shutter glass method, the first image (eg, the left eye image 720 ) allocated to the first display and the first image (eg, the left eye image 720 ) allocated to the second display. The first display and the second display may be controlled to alternately reproduce the second image (eg, the right eye image 730 ) in a time division manner. Through this, the electronic device can not only implement a stereoscopic image, but also derive the effect of reproducing an image with the number of frames that are the sum of the number of frames that can be reproduced on the first display and the second display, so that better performance (e.g., : 3D image can be played by reducing flicker. For example, the electronic device may reproduce an image at 60 frames per second (FPS) through the first display, and may reproduce an image at 60 frames per second (FPS) through the second display. According to the present embodiment, when three-dimensional images are alternately reproduced through the first display and the second display in a time-division manner, the electronic device displays the left-eye image 720 and the right-eye image 730 at 60 frames per second (FPS), respectively. ) can be provided, resulting in the effect of reproducing the image at a total frame rate of 30 seconds.

According to an embodiment, the display control module applies a polarization angle corresponding to either the left eye or the right eye to the first image allocated to the first display when the stereoscopic image implementation method is a polarization method, for example. The first display and the second display may be controlled to reproduce and reproduce the second image allocated to the second display by applying a polarization angle corresponding to the other one of the left eye and the right eye. In addition, other stereoscopic image implementation methods are also applicable, and a multi-view stereoscopic image or a stereoscopic image may be implemented using a 2D image display method based on gaze recognition using a plurality of displays.

8A to 8C are diagrams illustrating examples of using a transparent display area as a mirror display area in an electronic device according to various embodiments of the present disclosure. The electronic device (eg, electronic device 101) may include, for example, a plurality of displays including at least a first display 802 (eg, first display 151) and a second display 812 (eg, second display 152). can The second display 812 includes, for example, a transparent display area 814 (eg, a transparent display area 153 ), wherein, depending on a relative position between the first display 802 and the second display 812 , at least one of the information displayed on the first display 802 is A portion may be formed to be viewed through the transparent display area. In the transparent display area 814, for example, transparency can be adjusted. The electronic device may additionally include a front camera sensor for recognizing a user's face.

According to various embodiments, the electronic device 801 may include a camera sensor (eg, a front camera sensor 804, a dynamic vision sensor (DVS)) or a motion recognition sensor (eg, a roughness sensor, a 3D depth sensor) for recognizing a user's face, a gesture sensor, an acceleration sensor, a gyro sensor, a geomagnetic sensor, etc.). According to an embodiment, the electronic device 801 may obtain information on the user's face or the user's movement through a partial transparent area or a partial blank area of the second display using, for example, a camera sensor. According to another embodiment, the electronic device 801 may obtain information on the user's movement using, for example, a motion recognition sensor.

Referring to FIG. 8A , when the display control module (eg, the display control module 170) of the electronic device recognizes the user's face using the front camera sensor 804, it adjusts the transparency or reflectivity of the transparent display area 814 to display a transparent display. The second display can be controlled so that the area functions as a mirror.

According to an embodiment, the display control module may adjust the transparency or reflectivity of the partial region of the transparent display region so that only a specified region based on a user input or the like functions as a mirror.

According to an embodiment, the display control module transmits at least a portion of the information of the first display area to the transparent display area while being visible. At the same time, it is possible to adjust the transparency or reflectivity of the transparent display area so that it overlaps with at least a part of the transmitted information of the first display area so that the user's face image can be reflected and viewed.

Referring to FIG. 8B , when the display control module (eg, the display control module 170) of the electronic device recognizes the user's face using the front camera sensor 804, it adjusts the transparency of the transparent display area, so that the transparent display area 814 is Simultaneously with the change to the mirror display area 816, additional information 819 in the mirror display area 816 (eg date, weather, news, schedule, temperature, weight, environmental information, clock, calendar, image information, text information, icon, or situational awareness) information, etc.) can be displayed. According to an embodiment, the display control module may control the second display so that the additional information overlaps with the user's face image reflected by the mirror display area.

According to an embodiment, the additional information obtains the user's context information (eg, location, time, surrounding environment, health, etc.) using context-aware technology, and is displayed on the mirror display area based on the obtained context information. You can create additional information to do (eg news, weather, schedule, recommended content, behavior guide, appearance guide or health guide, etc.).

According to an embodiment, the display control module may control the second display to display additional information in a designated partial area of the mirror display area based on a user's input or the like.

According to an embodiment, the transparent display area 814 and the mirror display area 816 may be the same area. For example, the transparent display area 814 and the mirror display area 816 may provide a transparent function and a mirror function in the same area. According to another exemplary embodiment, the transparent display area 814 and the mirror display area 816 may be formed as separate or independent displays in different areas on the same display. For example, the transparent display area 814 and the mirror display area 816 may provide a transparent function and a mirror function in different areas, respectively.

Referring to FIG. 8C , the display control module (eg, the display control module 170 ) of the electronic device may provide (eg, display) additional information corresponding to the user's situation in various expressions (eg, avatar). According to an embodiment, the display control module may include, for example, a front camera sensor (eg, a front camera sensor 804, a dynamic vision sensor (DVS)) or a motion recognition sensor (eg, a roughness sensor, a 3D depth sensor, a gesture sensor). , accelerometer, gyro sensor, geomagnetic sensor, etc.) in response to the user's face or user's movement, based on the recognized user's face or a previously stored image avatar content 825 can be generated. The display control module provides a more user-friendly interface by, for example, playing back the avatar content 814 so that at least a part thereof is displayed on the mirror display area, in the reflected image of the user's face, in the overlapping or non-overlapping area. can do.

9A to 9B are diagrams illustrating examples of selectively displaying information by adjusting the transparency of a portion of a transparent display area in an electronic device according to various embodiments of the present disclosure; The electronic device 901 (eg, the electronic device 101) includes, for example, a plurality of displays including at least a first display 902 (eg, the first display 151) and a second display 912 (eg, the second display 152) can do. The second display includes, for example, a transparent display area 914 (eg, a transparent display area 153 ), wherein, depending on a relative position between the first display 902 and the second display 912 , at least a portion of the information displayed on the first display 902 is may be formed to be viewed through the transparent display area 914, and information may be selectively displayed by adjusting the transparency of a partial area 916 of the transparent display area 914. The transparent display area 914 may be, for example, adjustable in transparency do. The electronic device 901 may additionally include a sensor capable of recognizing a user's input (eg, a touch sensor associated with at least one of the first display and the second display, a digitizer, a gesture sensor, a front camera sensor 904, a dynamic vision sensor (DVS), It may include a motion recognition sensor (eg, a roughness sensor, a 3D depth sensor, an acceleration sensor, a gyro sensor, or a geomagnetic sensor, etc.).

Referring to FIG. 9A , in the electronic device 901 , for example, in a state in which at least a portion of the second display 912 (eg, the transparent display area 914 ) covers the first display 902 , the electronic device 901 includes a front camera sensor (eg, : Front camera sensor 904, DVS (dynamic vision sensor)) or via a sensor (e.g. touch sensor, digitizer, gesture sensor, roughness sensor, 3D depth sensor, gesture sensor, accelerometer, gyro sensor, geomagnetic sensor, etc.) Based on the recognized user input, some information of the information displayed on the first display 902 may be designated. The user input may be, for example, an input for designating a partial area of the first display 902, and in this case, information displayed in the designated partial area may be designated as the partial information.

According to an exemplary embodiment, the display control module (eg, the display control module 170 ) of the electronic device 901 may transmit, for example, some information specified through the transparent display area 914 or the first display 902 to be transmitted through the transparent display. You can adjust the transparency of some areas 916 of the area. The partial area 916 of the transparent display area may be, for example, an area corresponding to the partial area of the first display designated by a user input (eg, an area designated by the same relative coordinates as the partial area of the first display). .

According to an embodiment, the display control module (eg, the display control module 170 ) of the electronic device 901 may separate the partial area 916 of the transparent display designated through the transparent display area 914 or the first display 902 and the designated partial area, for example. The transparency of the remaining transparent display areas can be adjusted differently. In the partial region 916 of the transparent display area, for example, the visible state of the information of the first display 902 is the first visible state (eg, the information of the first display 902 is not visible, or its contents cannot be distinguished even if it is visible ( illegible) state) to adjust the transparency of some area 916 of the transparent display area, and the remaining transparent display area except for the designated partial area, for example, the visible state of the information of the first display 902 is the second visible state (e.g. : It is possible to adjust the transparency of the remaining transparent display area except for a partial area designated as (when information of the first display 902 is dimly visible).

According to an embodiment, the display control module (eg, the display control module 170 ) of the electronic device 901 may transmit information displayed on the first display 902 through the transparent display area 914 so that the information displayed on the first display 902 is not transmitted through the transparent display area. You can adjust the transparency of the 914.

According to various embodiments, the display control module of the electronic device 901 may change the position of the partial area 916 of the transparent display area corresponding to the specified partial information based on the movement of the specified partial information of the first display. The display control module, for example, adjusts the partial region 916 of the transparent display region to be opaque in response to a user input, and the specified partial information is displayed due to display of other information (eg, messenger input, screen scrolling or screen movement, etc.) The position of the partial area 916 of the transparent display area may be changed based on the moving and displaying of the partial information designated through the first display.

According to one embodiment, the display control module controls, for example, other physical properties (eg, brightness, size, shape, color, saturation, sharpness, contrast, arrangement of liquid crystal molecules, etc.) other than the transparency of some area 916 of the transparent display area. ) can be adjusted. The display control module may, for example, adjust the physical properties of the partial area 916 of the transparent display area to set a viewing angle of image information displayed through the partial area 916 of the transparent display area to be different from other areas. The display control module, for example, adjusts a viewing angle of image information shown through a partial area of the transparent display area, so that information viewed through the partial area can be viewed from the front but not seen from the side 2 At least a partial area of the display 912 may be controlled.

Referring to FIG. 9B , in the electronic device 901 , for example, in a state in which at least a part of the second display 912 (eg, the transparent display area 914 ) covers the first display 902 , the electronic device 901 uses the front camera sensor 904 . Through this, the gesture input may be recognized. The display control module (eg, the display control module 170 ) of the electronic device 901 adjusts the transparency of at least a portion of the transparent display area based on the recognized gesture input to make at least a portion of the transparent display area 914 opaque, for example. The second display may be controlled to change to the display area 918 . The opaque display area 918 may be designated based on, for example, a gesture input (eg, gesture direction (up, down, left, right, front, or back), gesture size, gesture shape, gesture time, or gesture range, etc.). can The display control module may, for example, control at least a part of the information displayed on the first display 902 not to be seen by being obscured by the designated opaque display area 916 . According to an embodiment, the control module may control the first display through at least one of brightness adjustment of the first display 902 corresponding to the opaque display area, pixel control (eg, pixel off), or color change. According to an embodiment, the display control module is configured to control at least one of brightness control, size control, transparency control, shape change, position change, saturation control, sharpness control, contrast control, or arrangement of liquid crystal molecules of the opaque display area 916 . The second display 912 may be controlled through .

10A to 10K are diagrams illustrating examples in which the electronic device 1001 controls a plurality of displays according to a user input, according to various embodiments. The electronic device 1001 (eg, the electronic device 101 ) may include, for example, a plurality of displays including at least a first display 1002 and a second display 1012 . The second display may include, for example, a transparent display area 1014, such that, according to a relative position between the first display 1002 and the second display 1012, at least a portion of the information displayed on the first display 1002 is visible through the transparent display area. can be formed. In the transparent display area, for example, transparency can be adjusted. The electronic device 1001 may additionally include a sensor (eg, a touch sensor, a digitizer, a gesture sensor, a proximity sensor, image sensor, 3D depth sensor, etc.).

Referring to FIG. 10A , in the electronic device 1001, for example, in a state in which at least a portion (eg, a transparent display area) of the second display 1012 covers the first display 1002, at least a portion of the second display 1012 (eg, transparent At least one of a touch input, a gesture input, and a proximity input related to the display area) may be detected. At least one of a touch input, a gesture input, and a proximity input may be performed, for example, by at least one of a part of the user's body (eg, finger 1030 ) or another object (eg, electronic pen 1032 ). According to an embodiment, the electronic device 1001 may display the first display as well as the transparent display area 1014 and the second display 1012 based on a user input (eg, a finger 1030, a gesture, or an electronic pen 1032, etc.) associated with the transparent display area 1014 . 1002 can also be controlled. For example, the electronic device 1001 adjusts a property of the first display 1002 or displays it on the first display 1002 based on a user input (eg, a finger 1030, a gesture, or an electronic pen 1032, etc.) associated with the transparent display area 1014 . Information to be performed, a function or application to be executed on the first display 1002 may be determined.

According to an embodiment, the electronic device 1001, for example, receives at least one of a touch input, a gesture, or a proximity input associated with the first display 1002 in a state in which the first display 1002 is at least partially opened with respect to the second display 1012. can detect At least one of a touch input, a gesture input, and a proximity input may be performed by, for example, at least one of a part of the user's body (eg, a finger) or another object (eg, an electronic pen). According to an embodiment, the electronic device 1001 may control not only the first display 1002 but also at least one of the transparent display area 1014 and the second display 1012 based on a user input related to the first display 1002 . The electronic device 1001 , for example, based on a user input associated with the first display 1002, provides properties (eg, size, shape, brightness, color, saturation, sharpness, contrast, transmittance, transparency, and saturation) of the transparent display area 1014 . , gamma, resolution, contrast ratio, viewing angle, color gamut, color temperature, or gradation linearity), information to be displayed in the transparent display area 1014, functions or applications to be executed in the transparent display area 1014, etc. can be determined.

Referring to FIG. 10B , in the electronic device 1001 , for example, in a state in which at least a portion of the second display 1012 (eg, the transparent display area 1014 ) covers the first display 1002 , at least a part of the second display 1002 (eg, transparent A character may be recognized from a user input (eg, a swipe input, a gesture input, or a handwriting input) associated with the display area). Here, the characters may include, for example, alphabets, numbers, Chinese characters, Korean characters, or symbols. For example, the electronic device 1001 acquires a plurality of positions (eg, coordinates) corresponding to the touch or proximity input by recognizing a continuous touch or proximity input by an external object (eg, a finger 1030 or an electronic pen 1032 ). And, by comparing the shape formed by connecting the obtained positions and the pre-stored characters with each other, it is possible to extract the character with the highest similarity. The electronic device 1001 may, for example, execute a function or an application corresponding to the extracted character through at least one of the first display 1002 and the second display 1012 and the transparent display area 1014 .

According to an embodiment, when a specific character (eg, “C” 1050 is input), the electronic device 1001 may perform a pre-stored application or function mapped to the specific character. , a function mapped to a specific character, and may include, for example, a function of capturing information displayed on the first display 1002 or information displayed on the transparent display area 1014. For example, information displayed on the first display 1002 and All information displayed on the transparent display area 1014 is recognized as an image, and at least one of the captured image of the first display 1002 and the captured image of the transparent display area 1014 is generated, or the captured image of the first display 1002 and the captured image of the transparent display area 1014 are captured. According to an embodiment, one image may be configured by a display display layer (eg, S/W, a graphic processor, or a processor) corresponding to the captured image of the first display 1002. graphic display layer) and a display layer corresponding to the captured image of the transparent display area, respectively, may be stored.

According to some embodiments, additionally or alternatively, at least some information of the information displayed on the first display 1002 (eg, text, image, or video, etc.) is displayed in the transparent display area 1014 that is at least partially overlapped with the first display 1002. It may be captured and stored through a touch, proximity input, or key input.

Referring to FIG. 10C , in the electronic device 1001 , for example, in a state in which at least a portion (eg, a transparent display area) of the second display 1012 covers the first display 1002 , at least a portion of the second display 1012 (eg, transparent A sketch or drawing created by the user may be recognized from the user's input 1032 associated with the display area 1014). According to an embodiment, the electronic device 1001 recognizes the recognized sketch or drawing as a result of tracing information (eg, an image) displayed on the first display 1002 by the user, and maps the recognized sketch or drawing to the information displayed on the first display 1002. can be saved According to an embodiment, the electronic device may generate an image in which the recognized sketch or drawing is synthesized with information displayed on the first display 1002 . The electronic device 1001 may, for example, map the generated image to information displayed on the first display 1002 or store it independently from the information displayed on the first display 1002 . According to an embodiment, one image may be stored to include a display layer corresponding to information displayed on the first display 1002 and a display layer corresponding to a sketch or drawing.

According to an embodiment, the electronic device 1001 (eg, the electronic device 101 ) opens at least a part of the transparent display area 1014 with respect to the first display 1002 due to, for example, movement of the second display 1012 , A sketch or drawing input through the transparent display area 1014 may be displayed through the first display 1002 . The sketch or drawing may be displayed, for example, in addition to the information displayed on the first display 1002 or in place of the information displayed on the first display 1002 .

Referring to FIG. 10D , the electronic device 1001 provides, for example, a user input (eg, an electronic pen 1032 or a touch using a user's hand) sensed in association with at least a part of the second display 1012 (eg, the transparent display area 1014 ). Based on input or proximity input (eg, hovering or gesture), the object displayed on the first display 1002 or the transparent display area 1014 (eg, content such as a text image or video, or an interface such as a window, button, menu, bar, etc.) object) of at least one object 1052 may be selected (eg, clipped). For example, when the first display 1002 is covered by the transparent display area 1014 , the object displayed on the first display 1002 may be clipped through the transparent display area 1014 . When the first display 1002 is at least partially opened with respect to the transparent display area 1014 , an object displayed on the transparent display area 1014 may be clipped through the transparent display area 1014 .

According to various embodiments, the electronic device 1001 transmits the shape or movement of the created (eg, sketched or drawn) or clipped object 1052 through at least one of the first display 1002 and the second display 1012 (corresponding ) may be displayed (eg, changed shape or movement) in conjunction with or independently of other information displayed on at least one display. According to an embodiment, the electronic device 1001 generates and stores a video or motion image (eg, a gif file) in which the shape or movement of the object 1052 is reflected, or displays it through at least one suitable display (eg, the first display 1002 ). can do.

At least one display layer may be used to display a shape or movement of the object 1052 . According to an embodiment, the object 1052 is displayed using at least one display layer provided (eg, rendered) through the first display 1002, and other information related to the object 1052 is displayed on the display 1002. It may be displayed using another display layer provided through (eg, rendered). The two display layers (or image information displayed therein) may be independently controlled (eg, rendered) based on a user input or image characteristics, for example. According to an embodiment, the electronic device 1001 includes , the clipped or created object 1052 may be displayed by adding it to information previously displayed on the screen of the first display 1002 . For example, when the transparent display area 1014 is in a state that covers the first display 1002 and the second display 1012 is moved to at least partially open the first display 1002, or a user input (eg, a gesture, When a swipe, motion, single-sided touch, or double-sided touch) is input, the object displayed on the transparent display area 1014 may be moved and displayed on the first display 1002 .

According to another embodiment, the electronic device 1001 may provide a new image object, for example, a user input, in addition to the object displayed on the first display 1002 or the transparent display area 1014, based on the user's line-type input, for example. An image having a line connecting , as an outline, or a video in which the image is moved according to an additional user input may be generated.

The electronic device 1001 may store the clipped or generated object 1052 in various forms. According to an embodiment, the object 1052 may be synthesized in an image captured by the screen of the first display 1002 and stored. According to an embodiment, the captured image of the object 1052 may be stored as a separate image from the captured image of the screen of the first display 1002 . According to an embodiment, one image may be stored to include a display layer corresponding to the screen of the first display 1002 and another display layer corresponding to the object 1052 .

Referring to FIG. 10E , the electronic device 1001 may be connected to the cover 1010 including the second display 1012 , and for example, the electronic device 1001 and the cover 1010 may be connected to at least a part of the electronic device 1001 or the cover 1010 (eg, the connection part 1018 ). By having an angle detecting sensor 1019 (e.g., angle detecting sensor, roughness sensor, or Hall sensor) for detecting the connection angle between can be

According to an embodiment, the electronic device 1001 may execute a function, application, or security mode corresponding to the opening degree of the cover 1010 based on the degree of opening of the cover 1010 detected through the angle detection sensor 1019 . For example, while the cover 1010 is at least partially opened and an application requiring security (eg, e-mail, personal information, web browsing secure function, Internet banking, or a function to display secure content) is running through the first display 1002 When the cover 1010 is closed, adjust the transparency of the transparent display area so that the corresponding application is not visible, or through the transparent display area, the user interface (eg desktop, application, clock, calendar, schedule, magazine, e-book) , gallery, phone function or messenger function, etc.).

According to an embodiment, the electronic device 1001 may display a visual expression corresponding to the opening degree (eg, an opening degree) based on an opening degree (eg, an angle, an open state, or a ratio) of the cover 1010 detected by the angle detection sensor 1019 . An animation of an opening of a book that has been closed according to , or an effect of increasing or decreasing an activated area of the first display 1010 according to an opening degree) may be displayed through at least one of the first display and the transparent display.

According to various embodiments, the first display 1002 and the second display 1012 may be connected to each other to constitute one flexible display module. According to an embodiment, in a state in which at least a partial region of the flexible display module is bent, the electronic device 1001 detects a degree of bending using a sensor functionally connected to the electronic device 1001, and based on the degree of bending, the flexible display You can control the display of the module. For example, you can adjust the transparency of some bent areas, or display other information in some bent areas so that the display of other areas obscured by some bent areas is not visible through some bent areas. . According to an embodiment, at least one of the curved partial area or the other area to be covered may be additionally or alternatively selected by the user by a double-sided touch of the display.

Referring to FIG. 10F , the electronic device 1001 may display the first display 1002 or the second display 1012 while at least a part of the second display 1012 (eg, the transparent display area 1014 ) covers the first display 1002 , for example. When entering a lock mode that limits at least a part of the display function of information through a user input (eg, a pattern or password etc.) can be received. For example, the electronic device 1001 may compare the user input with pre-stored unlock information, release the lock mode if they match, and activate the information display function through the first display 1002 and the second display 1012. have.

According to an embodiment, the electronic device 1001 receives a user input for releasing the lock mode, for example, while at least a part of the second display 1012 (eg, the transparent display area 1014 ) covers the first display 1002 . You can display a user interface screen for For example, a user interface screen for receiving a pattern as a user input displays a plurality of graphic components 1054 arranged to be spaced apart from each other, thereby guiding the user to input a pattern centering on the displayed graphic components. For example, the electronic device 1001 recognizes a continuous touch or proximity input by an external object (eg, a finger 1030 or an electronic pen 1032 ), and recognizes a plurality of positions (eg, coordinates) corresponding to the touch, gesture, or proximity input. A shape formed by acquiring the points and connecting the acquired locations may be displayed through the user interface screen. The electronic device 1001, for example, adjusts settings (eg, brightness, display color (eg, black), display on/off) of the first display 1002 and at least a part of the second display 1012 (eg, a transparent display) By displaying such a user interface through the area 1014), it is possible to reduce the current consumed for displaying the user interface.

According to some embodiments, the screen lock mode may be released without displaying a separate graphic component for receiving the user input pattern. For example, according to an embodiment, while being touched on at least one of the first display 1002 or the second display 1012 or with at least a portion placed in a proximity position (eg, in the case of hovering), the at least one Based on the detection of a user input moving from one point of the display to another (eg, a finger movement), the screen lock mode for the first display 1002 , the second display 1012 , or the transparent display area 1014 all simultaneously or respectively This may be terminated independently.

According to various embodiments, the electronic device 1001 may provide additional information (eg, clock, notification information, Current consumption for display (image information, text information, weather information, status information of the electronic device, etc.) may be reduced. According to an embodiment, the electronic device 1001 displays, for example, additional information through at least a part of the second display 1012 (eg, the transparent display area 1014 ), and sets the settings (eg, brightness, display) of the first display 1002 . By adjusting the color (eg, black) and on/off of the display, the current consumed for displaying additional information can be reduced.

Referring to FIG. 10G , the electronic device 1001 provides, for example, first information 1062 ( For example, by simultaneously displaying the second information 1064 (eg, the second image) that can be displayed in association with the first image) on the transparent display area 1014, the state in which the first information 1062 and the second information 1064 are displayed together; It may be delivered to the user as a kind of single information 1060 (eg, a third image generated by synthesizing the first image and the second image).

According to an embodiment, the display control module of the electronic device may control the second information 1064 displayed on the transparent display area due to some information corresponding to the transparent display area among the first information 1062 displayed on the first display. If there is a risk of being perceived as interfering with the display, the representation of some information in the first information 1062 is replaced with another representation 1066 (eg, a blank image of white or black color or another image related to the second information 1064); Controlling the display function of the portion corresponding to the second information 1064 of the transparent display area 1014 of the first display 1002 differently from the rest of the first display 1002 (eg, displaying only white or black color, adjusting the viewing angle, displaying with a mirror, or adjust the brightness).

According to an embodiment, the electronic device 1001 transmits at least one of the first information 1062 and the second information 1064 to another external device (eg, the electronic device 104) or the server (eg, the server 106) for communication (eg, wifi, BT). , NFC, GPS, cellular communication, USB, HDMI, RS-232, or POTS). For example, the electronic device 1001 recognizes an NFC tag located in a specific place (eg, a store), and based on tagging information of the recognized NFC tag, at least part of the tagging information or additional information (eg, based on the tagging information) information of the store or information of products sold in the store) can be created or obtained. The electronic device may display the additional information as at least one of the first information 1062 and the second information 1064 on at least one of the first display 1002 and the second display 1012 (eg, the transparent display area 1014 ). For example, when the electronic device 1001 recognizes the NFC tag of a clothing store, a pre-stored full body image for the user of the electronic device 1001 may be displayed on the first display 1002 as the first information 1062 . At the same time, the electronic device 1001 may provide a virtual fitting service by displaying products sold in a clothing store on the transparent display area 1014 , thereby displaying an image similar to that of a user wearing the corresponding product.

Referring to FIG. 10H , the display control module (eg, the display control module 170 ) of the electronic device 1001 displays at least one icon (eg, the first icon 1071 or the second icon 1072 ) through the first display 1002 . can do. Icons may be, for example, widgets or specific content.

According to an embodiment, if at least a portion of the second display 1012 (eg, the transparent display area 1014 ) covers the first display 1002 , so that the transparent display area 1014 is arranged to at least partially overlap the first display, the second display A sensor (eg, a second touch sheet) capable of detecting a touch input or a proximity input associated with 1012 may be activated. Also, a sensor (eg, a first touch sheet) capable of detecting a touch input or a proximity input associated with the first display 1002 may be switched to an inactive state, for example.

According to an embodiment, when an input related to an area in which the first icon 1071 of the first display 1002 is disposed is received, the display control module may control the movement of the position of the first icon 1071 based on the received input. The display control module may configure the first display 1002 and the transparent display area 1014 to be displayed through the transparent display area 1014 by, for example, moving the first icon 1071 from the first display 1002 to the transparent display area 1014 in which an input has occurred. can be controlled The input may be, for example, a long touch input or a double tap input.

According to an embodiment, when at least one icon (eg, the first icon 1071) is displayed through the transparent display area 1014, the display control module is configured to provide an input associated with an area in which the first icon 1071 of the transparent display area 1014 is disposed. When this is received, the first display 1002 and the transparent display area 1014 may be controlled to move and display the first icon 1071 of the transparent display area 1014 to the first display 1002 . The input may be, for example, a long touch input or a double tap input.

According to various embodiments, the display control module may store an icon to be displayed on the first display 1002 and an icon to be displayed on the transparent display area 1014 separately from each other. Also, for example, the display control module may store, for example, information on an icon displayed on the first display 1002 and information on an icon displayed on the transparent display area 1014 in separate locations, and according to the movement of the icon, the position is moved. You can also change the storage location of the icon's information. The display control module is configured to, for example, switch the first display 1002 and/or the transparent display area 1014 from an inactive state (eg, wake mode release, lock screen release, or turn-off) to an active state (turn-on) In this case, by loading an icon stored in a storage location corresponding to the corresponding display (eg, first display 1002 or transparent display area 1014) switched to the active state, the corresponding display (eg, first display 1002 or transparent display area 1014) is loaded ) can be indicated by

According to various embodiments, the display control module may be configured to, for example, an interface object (eg, a first search interface 1073 or a second search interface) that can select a search page displayed through the first display 1001 and/or the transparent display 1014 . 1074 ) through the first display 1002 and/or the transparent display 1014 . The first search interface 1073 may be, for example, an interface object that can select a search page to be displayed through the transparent display area 1014 . The second search interface 1074 may be, for example, an interface object that can select a search page to be displayed through the first display 1002;

According to an embodiment, when receiving an input related to a page search through the second search interface 1074, the display control module may control the first display 1001 to display another page corresponding to the input through the first display 1002. can The page displayed on the first display 1002 may be, for example, a page related to at least one of a preset standby screen of the electronic device 1001 or execution of a specific function. According to an embodiment, the user may search for an object (eg, icon) disposed on another page that is not currently displayed in the first display or transparent display area, using the first search interface 1073 or the second search interface 1074. can

According to an embodiment, the display control module is configured to: an object (eg, icon) displayed through the first display 1002 and an object displayed through the transparent display area 1014 in a state where the first display 1002 and the transparent display area 1014 are at least partially overlapped When (eg, an icon) is shown overlapping each other, the position of one of the two objects is automatically adjusted so that the two objects are clearly visible to the user and the user input for each of the two objects is easily recognized To do this, the first display 1002 and the transparent display area 1014 may be controlled.

Referring to FIG. 10I , the display control module 170 may display a first function screen 1081 corresponding to a specific function through the first display 1002 in a state in which the first display 1002 and the second display 1012 of the electronic device 1001 are unfolded. have. The first function screen 1081 may be, for example, a web page screen received from an accessed server according to access to a specific web site. The display control module 170 may, for example, control the transparent display area 1014 in a transparent state. Alternatively, the display control module 170 may display, for example, another web page received from a server that provided the web page of the first function screen 1081 through the transparent display area 1014 .

According to an embodiment, the display control module 170 performs an operation (eg, a hinge operation of the second display) in which at least a portion (eg, the transparent display area 1014 ) of the second display 1012 of the electronic device 1001 covers the first display 1002 . In response, the transparency of at least a portion 1082 of the transparent display area 1014 may be adjusted to be opaque. This can prevent unintentional exposure of information displayed on the first display 1002 .

According to an embodiment, the display control module 170 performs an operation of opening at least a part (eg, a transparent display area 1014) of the second display 1012 of the electronic device 1001 with respect to the first display 1002 (eg, a hinge operation of the second display) ), a second function screen 1083 corresponding to a specific function may be displayed through the first display 1002 . The second function screen 1083 may be, for example, a web page screen received from a predetermined specific server.

According to an embodiment, the display control module 170 performs an operation (eg, a hinge operation of the second display) in which at least a portion (eg, the transparent display area 1014 ) of the second display 1012 of the electronic device 1001 covers the first display 1002 . In response, the third function screen 1084 corresponding to the specific function may be displayed through the first display 1002 . The third function screen may be, for example, a preset standby screen of the electronic device 1001 . The display control module 170 may control the transparent display area 1014 to be transparent, for example, so that the third function screen 1084 can be seen through the transparent display area 1014 .

According to various embodiments, the electronic device 1001 may include, for example, the type of a specific application or function being executed in the electronic device 1001, information displayed through the first display 1002 and/or the transparent display area 1014 (eg, screen or page), or at least one of an open/closed state of a cover for the main body of the electronic device 1001, to adjust the transparency of the transparent display area 1014, or to adjust the transparency of the first display 1002 and/or It is possible to control to output a screen of a preset specific function or automatically output a web page of a preset specific server to the transparent display area 1014 .

Referring to FIG. 10J , the display control module 170 of the electronic device 1001 may determine a display on which information is to be displayed among a plurality of displays (eg, the display 1002 and the display 1012 ) according to the location of the user. The display control module 170, for example, determines the position or gaze of the user of the display, and displays specified information through a display (eg, display 1012 ) corresponding to the position or gaze of the user among the plurality of displays. can do.

The display control module 170 may display various information through a surface corresponding to the user's position or gaze, among both surfaces (eg, the rear 1015 and the front 1016 ) of the transparent display area 1014 of the display 1012 . The display control module 170, for example, when the rear surface 1015 of the display 1012 is placed to face the user (eg, when the display 1002 is opened to face the user at the same time as the front surface of the display 1002), the electronic device 1001 through the rear surface 1015 The transparent display 1012 may be controlled so that the object 1070 (eg, another user or object) located outside the .

When the front surface 1016 of the transparent display area 1014 is placed to face the user (eg, when the display 1002 is opened to face the user at the same time as the rear surface), the object 1070 located outside the electronic device 1001 through the front surface 1016 (eg: Other users or objects) are see-through, or information 1072 different from the information 1072 displayed through the rear surface 1015 (eg, at least a part of information displayed on the display 1002 or additional information related thereto) is displayed It is possible to control the transparent display 1012 as much as possible. According to one embodiment, the display control module 170 may include one or more sensors 1004 (eg, a front camera sensor, a roughness sensor, or a motion recognition sensor (eg, a 3D depth sensor, a gesture sensor, accelerometer, gyro sensor, or geomagnetic sensor) or near field communication (e.g. Wifi, Wifi-direct, WiGig, BT, BLE, Zigbee, UWB, NFC, RFID, Audio Sync, HBC or VLC) to your location or You can determine the direction of your gaze.

Additionally or alternatively, the display control module 170 may be configured to display information displayed or displayed through at least one display (eg, display 1012 ) among a plurality of displays (eg, display 1002 and display 1012 ) according to the open/closed state of the display. can be adjusted otherwise.

According to various embodiments, the electronic device 1001 may use at least one of the at least one camera sensor 1004 or 1006 to adjust at least one of the type and shape of information displayed on at least one of the front or rear of the display 1014 and the display 1002. have. For example, the display control module 170 of the electronic device 1001 activates at least one of the camera sensor 1004 or 1006 to activate a subject (eg, a specified user's face) within a predetermined direction (eg, a predetermined range that can be photographed by the camera sensor 1004 or 1006). Alternatively, it is possible to check whether a specific user's face exists (eg, face recognition in a captured image or human shape determination). When an image including a subject designated by the camera sensor 1004 is acquired, the display control module 170 may output first information designated on the first surface 1015 of the display 1014 as illustrated. Also, the display control module 170 may output the second information designated on the display 1002 .

According to various embodiments of the present disclosure, when an image including a subject specified by the camera sensor 1006 is acquired, the display control module 170 may output the specified third information on the second surface 1016 of the display 1014 as illustrated. The third information may include at least one of first information and second information. Alternatively, the third information is information adjusted so that the first information and the second information correspond to the second surface 1016 of the display 1014 (eg, information including at least a portion of the first information and the second information, or the first information and the information obtained by reducing the second information). The display control module 170 is configured to display information specified on the first surface of the display 1014 while the third information is output on the second surface 1016 of the display 1014 (eg, a background screen of a specified color or a background screen of a specified transparency, or a specified text or images, etc.). The display control module 170 may turn off the display 1002 or output the fourth information to the display 1002 while the third information is output on the second surface 1016 of the display 1014 .

According to various embodiments, if an image including a subject specified by the camera sensor 1006 is not obtained, the display control module 170 limits the output of the third information or information specified on the second surface 1016 of the display 1014 (eg: A specified color screen, a background screen with a specified transparency, or a specific text) can be output. Alternatively, if an image including a subject designated by the camera sensor 1006 is not obtained, the display control module 170 may control the display 1014 to be turned off.

According to various embodiments, when the camera sensor 1004 and the camera sensor 1006 acquire an image including a designated subject, the display control module 170 outputs the first information to the first surface 1015 of the display 1014, and the display 1002 2 information may be output, and control may be performed to output third information to the second surface 1016 of the display 1014 .

According to various embodiments, when a designated object is detected by the camera sensor 1006 and third information is output to the second surface 1016 of the display 1014, and the designated object is detected by the camera sensor 1004, the display control module 170, It is possible to control to output the first information or the second information to the first surface 1015 or the display 1002 of the display 1014, respectively. In this operation, the display control module 170 may stop outputting the third information on the second surface 1016 of the display 1014 .

According to various embodiments, the display control module 170 may output the third information to the first surface 1015 of the display 1014 . The display control module 170 may output the third information for a specified time and then change it to the second information being displayed through the display 1002.

According to various embodiments, when outputting the third information to the first surface 1015 of 1014 , the display control module 170 changes the displayed direction (eg, from left to right through rotation of the electronic device 1001 or a user input). information arrangement in the direction or change in the arrangement of information in the right-to-left direction).

The above-described display 1014 may be, for example, a transparent display. Accordingly, the display control module 170 adjusts the transparency (or background) of the second surface 1016 while the first information is output on the first surface 1015 in relation to the improvement of visibility, or the third information is output on the second surface 1016 In the meantime, the transparency (or background) of the second surface 1016 can be adjusted.

As described above, the electronic device 1001 according to various embodiments may adjust at least one of the type and form of information displayed on the displays and an output position based on at least one of the camera sensor 1004 and the camera sensor 1006 . According to various embodiments, the electronic device 1001 may control to output various information (eg, information pre-mapped to each person) according to the type of the subject (eg, people classified according to face recognition). According to various embodiments, the electronic device 1001 determines the arrangement state of the electronic device 1001 by using at least one of the above-mentioned various sensors in addition to the camera sensor, and corresponds to the arrangement state, the above-described first information, second information, At least one of outputting, changing, or stopping the output of the third information may be controlled.

Referring to FIG. 10K , the display control module 170 of the electronic device 1001 provides a user with respect to at least one of the position of the display 1012 with respect to the display 1002 or both sides of the transparent display area 1014 of the display 1012 (eg, the rear 1015 and the front 1016). Various information can be displayed depending on the location of

According to one embodiment, when the display 1012 is closed with respect to the display 1002 (eg, when two displays 1002 and 1012 touch each other or are spaced apart within a specified distance (eg, 1 cm or 5 cm)), the display control module 170 is the display 1002 The visible state may be adjusted so that at least a part of the information displayed through the display is visible through the transparent display area 1014 .

According to one embodiment, when the display 1012 is opened with respect to the display 1002 (eg, when the two displays 1002 and 1012 are spaced apart from each other by more than the specified distance (eg, 0.5 cm, 5 cm, or 10 cm)), the display control module 170 may display other information 1072 (eg, text, an image, or information related to information displayed through the display 1002, etc.) through at least a partial area of the transparent display area 1014 . Additionally or alternatively, the display control module 170 is configured to transmit the object 1070 (eg, another user or an external object) located in the periphery (eg, the rear part) of the display 1012 through at least another partial region of the transparent display region 1014 to be viewed. You can adjust the visibility state.

According to an embodiment, the display control module 170 is configured to automatically display the other information 1072 in the partial area, or the object 1070 to the transparent display area, based on an operation of opening the display 1012 to the display 1002. Visibility of the at least another partial area may be adjusted so that it is not transmitted through 1014 .

In the present disclosure, for convenience of description, a specific distance (eg, 0.5 cm, 5 cm, or 10 cm) for determining the closed or open state between the display 1002 and the display 1012 is used, but this is an example and other distance values may be used.

According to an embodiment, the display 1012 may independently see through or display information through the transparent display area 1014 even when the display 1012 is detached from the display 1002 . For example, when the display 1012 is placed to face the user on one side (eg, the front 1016), the object 1070 (eg, the rear part) located in the periphery of the display 1012 through at least a partial area of the transparent display area 1014 ( e.g. other users or external objects) can be viewed. Optionally or additionally, information (eg, text or images, etc.) can be displayed.

11 illustrates an example of using a transparent display area formed in at least a portion (eg, a second display) of a plurality of displays as an input means while the cover of the electronic device 1101 is opened according to various embodiments of the present disclosure. For example, the electronic device 1101 may include a sensor (eg, a touch sensor, a digitizer, a gesture sensor, a proximity sensor, an image sensor, 3D depth sensor, etc.).

Referring to FIG. 11 , the electronic device 1101 (eg, the electronic device 101 ) displays a user input 1150 (eg, single-sided touch input, double-sided) associated with the transparent display area 1114 in a state in which separate information is not displayed on the transparent display area 1114 . In response to a touch input, a hovering input, a swipe input, a gesture input, or a handwriting input), controlling a function or application executed through the first display 1102 (eg, capturing an image displayed on the first display 1102 or on the electronic device 1101 ) execution of a stored application, changing settings of the electronic device 1101), a function using other components of the electronic device 1101 (eg, audio output or camera shooting, etc.), or an external electronic device external to the electronic device 1101 (eg, the electronic device 104 or Functions (eg, TV remote control, remote control, data transmission/reception, text information transmission/reception, voice information transmission/reception, etc.) using the electronic device 105 may be performed.

12 illustrates an example of using a transparent display area formed on at least a portion of a plurality of displays (eg, a second display) as an input means while the cover of the electronic device 1201 is opened, according to various embodiments of the present disclosure. The electronic device 1201 is, for example, a sensor (eg, a touch sensor, a digitizer, a gesture sensor, a proximity) capable of detecting a single-sided touch input, a double-sided touch input, a gesture input, or a proximity input (eg, hovering) associated with the transparent display area 1214 . sensor, image sensor, 3D depth sensor, etc.).

Referring to FIG. 12 , in a state in which the first body part (eg, the cover part) of the electronic device 1201 is at least partially opened, a transparent display area formed in the display (eg, the second display 1212) located in the first body part is input. Information or functions displayed on another display (eg, the first display 1202 ) located on the second body part (eg, the body part) of the electronic device 1201 may be controlled by using it as a means. The electronic device 1201 (eg, the electronic device 101 ) may include, for example, a plurality of displays including at least a first display 1202 and a second display 1212 . The second display 1212 may include, for example, a transparent display area 1214 . The electronic device 1201 may additionally include a sensor (eg, a touch sensor, a digitizer, a gesture sensor, a proximity sensor, an image sensor, or a 3D depth sensor, etc.) capable of detecting a touch input or a proximity input (eg, hovering) associated with the transparent display area 1214 ). may include.

According to some embodiments, the electronic device 1201 may, for example, a virtual input tool (eg, a virtual keyboard 1220 or a game pad) for a function or application (eg, a chatting program 1210 or a game 1230) to be executed through the first display 1202 . 1240) may be displayed through at least a portion of the second display 1212 (eg, the transparent display area 1214).

According to an embodiment, the electronic device 1201 executes, for example, a text input application (eg, a chatting program 1210, a web browser 1260, a message (SMS/MMS) program, etc.) through the first display 1202, and inputs text When a user input (eg, touch, gesture, swipe, hovering, or pen input, etc.) is detected in at least a part of the application, a virtual input tool (eg, virtual keyboard 1220 or text input) for the text input application through the second display 1212 window) can be displayed.

According to some embodiments, the electronic device 1201 displays, for example, a function or application (eg, a web browser 1260) different from a function or application (eg, an image reproducing program 1250) executed on the first display 1202 on the second display. may execute through at least a portion of 1212 (eg, transparent display area 1214 ).

13 is a diagram illustrating an example of providing augmented reality content using a transparent display area in an electronic device according to various embodiments of the present disclosure; The electronic device (eg, the electronic device 101 ) may include, for example, a plurality of displays including at least a first display 1302 and a second display 1312 . The second display 1312 may include, for example, a transparent display area 1314, and depending on a relative position between the first display 1302 and the second display 1312, at least some of the information displayed on the first display 1302 may include the transparent display area 1314. It can be formed to be seen through. In the transparent display area 1314, for example, transparency can be adjusted. The electronic device 1301 may additionally include a sensor capable of recognizing a user's input (eg, a touch sensor associated with at least one of the first display 1302 and the second display 1312), a gesture sensor, a front camera sensor 1304, a rear camera sensor 1306, a digitizer, a dynamic vision sensor (DVS), a proximity sensor, or a 3D depth sensor).

Referring to FIG. 13 , the electronic device 1301 displays, on the transparent display area 1314, second information 1318 related to first information 1316 transmitted through the transparent display area in a state in which the cover of the electronic device 1301 is opened. reality can be realized.

According to an embodiment, the electronic device 1301 may predict the first information 1316, for example, based on the context information 1307 obtained using a sensor functionally connected to the electronic device 1301 (eg, the rear camera sensor 1306). have. According to an embodiment, the electronic device 1301 may predict the first information 1316 by, for example, additionally using the gaze or face recognition information 1305 to the context information 1307 .

According to an embodiment, the second information 1318 is, for example, information predicted based on the predicted first information (eg, the context information 1307 and the gaze or face recognition information 1305 or information predicted based on the context information 1307) etc.) can be obtained. For example, when the electronic device 1301 obtains the predicted first information under the control of the display control module 170, the prediction is made to the server (eg, the server 106 or the external electronic device (the electronic device 104 or the electronic device 106)) The first information is transmitted, and the server (eg, server 106 or an external electronic device (electronic device 104 or electronic device 106) receives the server processing information based on the predicted first information, based on the processed information 2 The information 1318 may be displayed through the transparent display area 1314 .

According to another embodiment, the electronic device obtains, for example, predicted first information, and transmits additional information through a communication module (eg, WiFi, BT, NFC, GPS, or cellular communication) included in the electronic device. obtained and processed based on the first information and the additional information predicted from the processor (eg, the processor 120 ) to display the second information 1318 through the transparent display area 1314 based on the information processed by the processor have.

According to an embodiment, a position where the second information is displayed on the transparent display area may be determined based on the first information. In addition, by additionally using the gaze or face recognition information, the first information may be adjusted to match or approximate a direction that is transmitted through the current transparent display area and is shown to the user.

According to an embodiment, the electronic device may display third information related to the predicted first information through the first display or execute a separate application related to the first information. For example, the electronic device may provide augmented reality navigation information through the transparent display area and, at the same time, provide map navigation information through the first display.

14 is a diagram illustrating an example of changing and displaying a setting of another display (eg, a first display) overlapping a transparent display area among a plurality of displays in an electronic device according to various embodiments of the present disclosure; The electronic device 1401 (eg, the electronic device 101 ) may include, for example, a plurality of displays including at least a first display 1402 and a second display 1412 . The second display 1412 may include, for example, a transparent display area 1414, and depending on the relative position between the first display 1402 and the second display 1412, at least a portion of the information displayed on the first display 1402 may be transmitted through the transparent display area 1414. It can be formed to be visible. In the transparent display area 1414, for example, transparency can be adjusted.

Referring to FIG. 14 , for example, in a state 1450 in which at least a part of the second display 1412 (eg, the transparent display area 1414 ) covers the first display 1402 , information displayed on the first display 1402 is displayed on the transparent display area 1414 . And when the transparency compared to the transparent display is seen through the material ( 1420 ), a difference in brightness, saturation, contrast, luminance, or brightness may occur visually according to the transparency of the transparent display area. For example, when viewed through the transparent display area 1414, when information displayed on the first display is viewed as it is without being transmitted through other materials, or when information displayed on the first display is transmitted through a material having relatively high transparency (eg, It may have relatively low visibility (brightness, saturation, contrast, luminance, or brightness) compared to the case 1416 when viewed through glass, transparent plastic, etc.).

According to an embodiment, when the electronic device 1401 recognizes that at least a portion of the information displayed on the first display 1402 is transmitted through the transparent display area 1414, at least a portion of the area of the first display 1402 corresponding to the transparent display area 1414 The settings of area 1403 (eg, brightness, saturation, contrast, luminance, or brightness) can be adjusted in steps (eg, scale 0-10).

For example, the electronic device may set the luminance of at least a portion of the first display 1402 after the first display 1402 is covered with the second display 1412, the luminance before the first display 1402 is covered with the second display 1412 or the first Compared to the luminance of the rest of the display 1402, it can be adjusted upward.

According to various embodiments, when at least a portion of the second display 1412 (eg, the transparent display area 1414 ) covers the first display 1402 and only the operation of the first display 1402 is separately viewed ( 1460 ), the transparent display area Settings (eg, brightness, saturation, contrast, luminance, or brightness) of the at least partial area 1403 corresponding to 1414 and the at least partial area 1405 corresponding to a material having high transparency may be different. According to an embodiment, at least one setting (eg, brightness, saturation, contrast, luminance, or brightness) of at least a partial area 1403 corresponding to the transparent display area 1414 or at least a partial area 1405 corresponding to a high-transparency material is changed. can

15 is a flowchart illustrating a method of controlling a plurality of displays in an electronic device according to various embodiments of the present disclosure; The electronic device (eg, the electronic device 101) may include, for example, a plurality of displays including at least a first display (eg, the first display 151) and a second display (eg, the second display 152). . The second display includes, for example, a transparent display area (eg, a transparent display area 153 ), wherein, depending on a relative position between the first display and the second display, at least a portion of the information displayed on the first display is the transparent display area It can be formed to be shown through.

Referring to FIG. 15 , in operation 1501 , the electronic device (eg, the electronic device 101 ) may display first information through the first display using, for example, a display control module (eg, the display control module 170 ). have.

In operation 1502, visibility regarding whether or not at least some information of the first information is transmitted through the transparent display area of the second display may be determined.

In operation 1503, when the visible state determined in relation to the transparent display area is the first visible state (eg, the state in which the at least some information is visible), the second information may be additionally displayed through the transparent display area. The additionally displayed second information may be information related to the at least partial information or information not related to the at least one piece of information.

In operation 1504, in addition to operation 1503 or replacing operation 1503, the visible state determined in relation to the transparent display area is the second visible state (eg, the at least some information is not visible or the content cannot be distinguished even though it is visible). (illegible state, or dimly visible, etc.), the setting of at least a partial area corresponding to the transparent display area among the first displays may be changed. According to some embodiments, after operation 1504 is executed, operation 1503 may be additionally executed.

16 is a flowchart illustrating a method of generating a visual effect by using a transparent display area in an electronic device according to various embodiments of the present disclosure; The electronic device (eg, the electronic device 101) may include, for example, a plurality of displays including at least a first display (eg, the first display 151) and a second display (eg, the second display 152). . The second display includes, for example, a transparent display area (eg, 153 ), wherein, depending on the relative position between the first display and the second display, at least a portion of the information displayed on the first display is visible through the transparent display area. It can be formed to be

In operation 1601 , the display control module (eg, the display control module 170 ) of the electronic device (eg, the electronic device 210 ) obtains first information to be displayed on the first display.

In operation 1602, the display control module may generate first image information and second image information for a visual effect of the first information, based on the first information. According to one embodiment, in the process of generating at least one of the first image information or the second image information, shift, smoothing, sharpening, noise removal, histogram transformation, face recognition, high frequency cutoff filtering, At least one of an angle conversion, a size conversion, a saturation conversion, a brightness conversion, and an object finding image processing technique may be applied. According to an embodiment, the first image information may be the same as the first information, and the second image information may be an image generated by applying the image processing to the first information.

According to an embodiment, when the first information is a stereoscopic image including a left-eye image and a right-eye image, the first image information is any one of a left-eye image or a right-eye image, and the second image information is a left-eye image of the first information. Alternatively, it may be the other one of the right eye images.

In operation 1603, the electronic device displays the first image information through any one of the first display or the transparent display area in order to express a visual effect of the first information, and in operation 1604, the electronic device displays the second image information to the first It can be displayed through the other of a display or a transparent display area. According to an embodiment, the first image information and the second image information may be displayed at the same time.

According to an embodiment, when the first image information is any one of a left-eye image and a right-eye image, and the second image information is the other one of the left-eye image or the right-eye image of the first information, the first image information and the second image information may be displayed simultaneously or sequentially by time division.

17 is a flowchart illustrating a method of providing additional information related to information displayed using a transparent display area in an electronic device according to various embodiments of the present disclosure; The electronic device (eg, the electronic device 101) may include, for example, a plurality of displays including at least a first display (eg, the first display 151) and a second display (eg, the second display 152). . The second display includes, for example, a transparent display area (eg, 153 ), wherein, depending on the relative position between the first display and the second display, at least a portion of the information displayed on the first display is visible through the transparent display area. It can be formed to be

In operation 1701, the display control module (eg, the display control module 170) of the electronic device, for example, using a sensor functionally connected to the electronic device, transmits first information (eg: location, time, surrounding environment, health, etc.) related second information such as news, weather, schedule, recommended content, behavior guide, appearance guide, health guide or augmented reality content) may be acquired. According to an embodiment, the display control module may obtain context information related to the user by using a rear camera sensor of the electronic device, and may generate the second information based on the obtained context information.

In operation 1702, the display control module may acquire the user's gaze or face recognition information using, for example, another sensor functionally connected to the electronic device. In operation 1703, for example, the display control module may adjust (or determine) a display position of the second information based on the gaze or face recognition information obtained in operation 1703 .

In operation 1704, the electronic device may display second information through the transparent display area. For example, the electronic device may omit the processes of operations 1702 to 1703 and display the second information acquired in operation 1701 through the transparent display area as it is.

The operations performed by the method illustrated in FIGS. 15 to 17 may be processed in a sequential, parallel, iterative, or heuristic manner, or may be executed in an order different from that illustrated in the drawings, and some operations may be It may be omitted or other operations may be added.

According to various embodiments of the present disclosure, a method of operating an electronic device may include displaying first information through a first display functionally connected to the electronic device; and when at least a portion of the first information is viewed through a transparent display area of a second display connected to the electronic device so as to be able to change the position of the first display, it is associated with the at least some information through the transparent display area to additionally display the second information.

According to various embodiments, the additional display operation includes the size, shape, brightness, color, saturation, sharpness, contrast, transmittance, transparency, saturation, gamma, resolution, contrast ratio, viewing angle, and color gamut of the transparent display area. and dynamically changing at least one of , color temperature, and grayscale linearity.

According to various embodiments, the operation of additionally displaying may include an operation of generating a visual effect by using the second information so that the at least some information is viewed three-dimensionally.

According to various embodiments, the additionally displaying may include: generating the second information based on the first information; displaying the first portion through the first display so that the first portion of the second information is transmitted through a transparent display area; and simultaneously displaying the first part and displaying the second part of the second information through the transparent display area.

According to various embodiments, the visual effect may include a depth effect image of the at least some information.

According to various embodiments, the generating of the visual effect includes shifting, smoothing, sharpening, noise removal, histogram transformation, face recognition, high frequency cutoff filtering, angle transformation, size transformation, and saturation transformation of the image of the first information. , applying image processing of at least one of brightness conversion and object finding.

According to various embodiments, the first information includes a stereoscopic image including a left-eye image and a right-eye image, and the generating of the second information includes displaying the left-eye image in the first display area and the transparent display area. operation to display through any one; and displaying the right eye image through the other one of the first display and the transparent display area.

According to various embodiments, the first information includes any one of a left-eye image and a right-eye image of at least one object, and the second information includes the other one of the left-eye image and the right-eye image. can do.

According to various embodiments, the left-eye image and the right-eye image may be time-divided and alternately performed.

According to various embodiments, the additionally displaying may include: recognizing a face or a gaze of a user of the electronic device; and at least one transparency, luminance, brightness or reflectivity of the first display or the transparent display region, or the at least some information in the transparent display, such that the transparent display region functions as a mirror, based at least on the face or gaze Alternatively, it may include an operation of adjusting a display position of the second information.

According to various embodiments, the additionally displaying may include: obtaining context information associated with a user of the electronic device; and generating an augmented reality effect associated with the at least partial information as the second information based on the context information.

According to various embodiments, the additionally displaying may include: generating avatar content corresponding to the user of the electronic device; and displaying the avatar content using the transparent display area as at least a part of the second information.

According to various embodiments, the additionally displaying may include: designating some information of the first information based on a user input on at least one of the first display and the second display; and adjusting the transparency of at least a partial area of the transparent display area so that the partial information is not shown through the transparent display area.

According to various embodiments, the additionally displaying may include: designating a partial area of the transparent display area based on a user input associated with the second display; and adjusting the transparency of the partial region so that at least a part of the first information is not shown through the partial region.

According to various embodiments, the additionally displaying may include executing a function or application of the electronic device or changing a setting of the electronic device in response to a user input associated with at least one of an upper surface or a lower surface of the transparent display area. It may include an action to

According to various embodiments, the additionally displaying may include displaying one or more of a first captured image corresponding to the at least part of the first information and a second captured image associated with the second information as at least one image. It can include the action of saving to a file.

According to various embodiments, the operation of additionally displaying may include an operation of storing at least one of at least a portion of the at least some information, at least a portion of the second information, or a combination thereof.

According to various embodiments, the storing may include a method of storing based on a user input sensed through the transparent display area.

According to various embodiments, the additionally displaying may include a user for authenticating a user of the electronic device through the second display when a lock limiting at least some functions of the electronic device is set. displaying the interface; authenticating the user based on a user input associated with the user interface; and releasing the lock based on the authentication.

According to various embodiments, the additionally displaying may include changing the expression corresponding to the at least part of the first information in response to the display of the second information, or displaying it in the transparent display area of the first display. The operation may include controlling the corresponding partial area differently from other areas of the first display.

According to various embodiments, the additionally displaying may include changing the at least some information in response to the display of the second information, or displaying a partial area of the first display corresponding to the transparent display area of the first display. It may include an operation of controlling differently from other areas of the display.

According to various embodiments, when it is determined that the first information is not displayed through the transparent display area, recognizing a user input associated with the transparent display area; and executing a function or application of the electronic device through the first display based on the user input.

According to various embodiments, the additionally displaying may be performed according to an open/closed state of a cover of the main body of the electronic device, or a user input associated with at least one of the first display and the second display. based on the size, shape, brightness, color, saturation, sharpness, transmittance, transparency, contrast, saturation, gamma, resolution, contrast ratio, viewing angle, color gamut, color temperature of at least one of the first display or the second display, Alternatively, the operation may include changing at least one of grayscale linearity.

According to various embodiments, the additionally displaying may include displaying, as the second information, a virtual input tool for a function or application to be executed through the first display.

, According to various embodiments, the additionally displaying may include, as the second information, generating an image corresponding to a user input related to the transparent display area; and displaying the image through the first display.

According to various embodiments, the displaying of the image may include displaying the image simultaneously with the at least some information or other information displayed on the first display.

According to various embodiments, the simultaneous display of the image may include displaying the image as a first display layer and displaying the at least some information or corresponding information among the other information as a second display layer.

According to various embodiments, the displaying operation may dynamically change and display at least one of a motion, a shape, or a content of the image.

According to various embodiments, the additionally displaying may include, through at least one of the first display and the second display, a visual representation corresponding to the open/closed state of the cover with respect to the main body of the electronic device. It may include an action to display.

According to various embodiments of the present disclosure, a method of operating an electronic device may include displaying first information through a first display functionally connected to the electronic device; and when at least a part of the first information is shown through a transparent display area of a second display functionally connected to the electronic device so as to be able to change the position of the first display, it is displayed in the transparent display area of the first display. It may include an operation of automatically changing the settings of the corresponding at least some areas.

According to various embodiments, the changing operation may include changing at least one of brightness, saturation, contrast, luminance, and brightness of the at least partial region.

According to various embodiments of the present disclosure, a method of displaying an electronic device may include: a first display formed on at least a portion of a body of the electronic device; and a second display formed on at least a portion of a top surface of a cover functionally connected to the main body and including a transparent display area, wherein the transparent display is performed using a sensor functionally connected to the electronic device. obtaining second information related to the first information transmitted through the display area; and displaying the second information through the transparent display area.

According to various embodiments, the acquiring of the second information may include: acquiring context information related to a user of the electronic device using the sensor; and generating the second information based on the context information.

According to various embodiments of the present disclosure, the displaying of the second information may include: acquiring information about a user's gaze or face recognition of the electronic device using another sensor functionally connected to the electronic device; and adjusting a display position of the second information based on the gaze or face recognition information.

According to various embodiments, the second information may include augmented reality content related to the first information.

18 is a block diagram 1800 illustrating an electronic device 1801 according to various embodiments of the present disclosure. The electronic device 1801 may constitute, for example, all or a part of the electronic device 101 illustrated in FIG. 1 . Referring to FIG. 18 , the electronic device 1801 includes at least one application processor (AP) 1810, a communication module 1820, a subscriber identification module (SIM) card 1824, a memory 1830, a sensor module 1840, an input device 1850, a display 1860, It may include an interface 1870, an audio module 1880, a camera module 1891, a power management module 1895, a battery 1896, an indicator 1897, and a motor 1898.

The AP 1810 may control a plurality of hardware or software components connected to the AP 1810 by driving an operating system or an application program, and may perform various data processing and operations including multimedia data. The AP 1810 may be implemented as, for example, a system on chip (SoC). According to an embodiment, the AP 1810 may further include a graphic processing unit (GPU) (not shown).

The communication module 1820 (eg, the communication interface 160) transmits and receives data in communication between the electronic device 1801 (eg, the electronic device 101) and other electronic devices (eg, the electronic device 104 or the server 106) connected through a network. can be done According to an embodiment, the communication module 1820 may include a cellular module 1821, a Wifi module 1823, a BT module 1825, a GPS module 1827, an NFC module 1828, and a radio frequency (RF) module 1829.

The cellular module 1821 may provide a voice call, a video call, a text service, or an Internet service through a communication network (eg, LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro, or GSM, etc.). Also, the cellular module 1821 may perform identification and authentication of an electronic device in a communication network using, for example, a subscriber identification module (eg, SIM card 1824). According to an embodiment, the cellular module 1821 may perform at least some of the functions that the AP 1810 may provide. For example, the cellular module 1821 may perform at least a part of a multimedia control function.

According to an embodiment, the cellular module 1821 may include a communication processor (CP). Also, the cellular module 1821 may be implemented as, for example, an SoC. In FIG. 8 , components such as the cellular module 1821 (eg, communication processor), the memory 1830, or the power management module 1895 are illustrated as separate components from the AP 1810, but according to an embodiment, the AP 1810 may be implemented to include at least some of the above-described components (eg, the cellular module 1821).

According to an embodiment, the AP 1810 or the cellular module 1821 (eg, a communication processor) loads and processes a command or data received from at least one of a non-volatile memory or other components connected to each of the volatile memory. can do. Also, the AP 1810 or the cellular module 1821 may store data received from at least one of the other components or generated by at least one of the other components in a non-volatile memory.

Each of the Wifi module 1823, the BT module 1825, the GPS module 1827, or the NFC module 1828 may include, for example, a processor for processing data transmitted and received through a corresponding module. In FIG. 8 , the cellular module 1821, the Wifi module 1823, the BT module 1825, the GPS module 1827, or the NFC module 1828 are respectively shown as separate blocks, but according to an embodiment, the cellular module 1821, the Wifi module 1823, the BT module 1825, and the GPS At least some (eg, two or more) of the module 1827 or the NFC module 1828 may be included in one integrated chip (IC) or an IC package. For example, at least some of the processors corresponding to each of the cellular module 1821, the Wifi module 1823, the BT module 1825, the GPS module 1827, or the NFC module 1828 (eg, the communication processor corresponding to the cellular module 1821 and the Wifi module 1823 corresponding to the Wifi processor) can be implemented as one SoC.

The RF module 1829 may transmit/receive data, for example, transmit/receive an RF signal. Although not shown, the RF module 1829 may include, for example, a transceiver, a power amp module (PAM), a frequency filter, or a low noise amplifier (LNA). In addition, the RF module 1829 may further include a component for transmitting and receiving electromagnetic waves in free space in wireless communication, for example, a conductor or a conducting wire. In FIG. 8 , the cellular module 1821, the Wifi module 1823, the BT module 1825, the GPS module 1827, and the NFC module 1828 share one RF module 1829 with each other, but according to an embodiment, the cellular module 1821 and the Wifi module 1823 , at least one of the BT module 1825, the GPS module 1827, and the NFC module 1828 may transmit and receive an RF signal through a separate RF module.

The SIM card 1824 may be a card including a subscriber identification module, and may be inserted into a slot formed at a specific location of the electronic device. The SIM card 1824 may include unique identification information (eg, integrated circuit card identifier (ICCID)) or subscriber information (eg, international mobile subscriber identity (IMSI)).

The memory 1830 (eg, the memory 130 ) may include an internal memory 1832 or an external memory 1834 . The internal memory 1832 is, for example, a volatile memory (eg, dynamic RAM (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.) or non-volatile memory (eg, non-volatile memory). , at least one of OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, NAND flash memory, NOR flash memory, etc.) may include.

According to an embodiment, the internal memory 1832 may be a solid state drive (SSD). The external memory 1834 is a flash drive, for example, CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), or Memory Stick. and the like may be further included. The external memory 1834 may be functionally connected to the electronic device 1801 through various interfaces. According to an embodiment, the electronic device 1801 may further include a storage device (or storage medium) such as a hard drive.

The sensor module 1840 may measure a physical quantity or detect an operating state of the electronic device 1801, and may convert the measured or sensed information into an electrical signal. The sensor module 1840 may include, for example, a gesture sensor 1840A, a gyro sensor 1840B, a barometric pressure sensor 1840C, a magnetic sensor 1840D, an acceleration sensor 1840E, a grip sensor 1840F, a proximity sensor 1840G, and a color sensor 1840H (eg, RGB (red, green, blue) sensor), a biometric sensor 1840I, a temperature/humidity sensor 1840J, an illuminance sensor 1840K, or an ultra violet (UV) sensor 1840M. Additionally or alternatively, the sensor module 1840 is, for example, an olfactory sensor (E-nose sensor, not shown), an electromyography sensor (not shown), an EEG sensor (electroencephalogram sensor, not shown), an ECG sensor ( It may include an electrocardiogram sensor (not shown), an infra red (IR) sensor (not shown), an iris sensor (not shown), or a fingerprint sensor (not shown). The sensor module 1840 may further include a control circuit for controlling at least one or more sensors included therein.

The input device 1850 may include a touch panel 1852, a (digital) pen sensor 1854, a key 1856, or an ultrasonic input device 1858. The touch panel 1852 may recognize a touch input using, for example, at least one of a capacitive type, a pressure sensitive type, an infrared type, and an ultrasonic type. Also, the touch panel 1852 may further include a control circuit. In the case of capacitive, physical contact or proximity recognition is possible. The touch panel 1852 may further include a tactile layer. In this case, the touch panel 1852 may provide a tactile response to the user.

The (digital) pen sensor 1854 may be implemented, for example, using the same or similar method as receiving a user's touch input or a separate recognition sheet. The key 1856 may include, for example, a physical button, an optical key, or a keypad. The ultrasonic input device 1858 is a device capable of confirming data by detecting sound waves from the electronic device 1801 with a microphone (eg, microphone 1888) through an input tool that generates an ultrasonic signal, and wireless recognition is possible. According to an embodiment, the electronic device 1801 may receive a user input from an external device (eg, a computer or a server) connected thereto using the communication module 1820 .

The display 1860 (eg, the display 150) may include a panel 1862, a hologram device 1864, or a projector 1866. The panel 1862 may be, for example, a liquid-crystal display (LCD) or an active-matrix organic light-emitting diode (AM-OLED). The panel 1862 may be implemented, for example, to be flexible, transparent, or wearable. The panel 1862 may be configured as one module with the touch panel 1852. The hologram device 1864 may display a stereoscopic image in the air by using light interference. The projector 1866 may display an image by projecting light onto the screen. The screen may be located inside or outside the electronic device 1801, for example. According to an embodiment, the display 1860 may further include a control circuit for controlling the panel 1862, the hologram device 1864, or the projector 1866.

The interface 1870 may include, for example, a high-definition multimedia interface (HDMI) 1872, a universal serial bus (USB) 1874, an optical interface 1876, or a D-subminiature (D-sub) 1878. The interface 1870 may be included in, for example, the communication interface 160 illustrated in FIG. 1 . Additionally or alternatively, the interface 1870 includes, for example, a mobile high-definition link (MHL) interface, a secure digital (SD) card/multi-media card (MMC) interface, or an infrared data association (IrDA) standard interface. can do.

The audio module 1880 may interactively convert a sound and an electrical signal. At least some components of the audio module 1880 may be included in, for example, the input/output interface 140 illustrated in FIG. 1 . The audio module 1880 may process sound information input or output through, for example, a speaker 1882, a receiver 1884, an earphone 1886, or a microphone 1888.

The camera module 1891 is a device capable of capturing still images and moving images, and according to an embodiment, one or more image sensors (eg, a front sensor or a rear sensor), a lens (not shown), and an image signal processor (ISP, not shown). ) or a flash (not shown) (eg, LED or xenon lamp).

The power management module 1895 may manage power of the electronic device 1801 . Although not shown, the power management module 1895 may include, for example, a power management integrated circuit (PMIC), a charger integrated circuit (IC), or a battery or fuel gauge.

The PMIC may be mounted in, for example, an integrated circuit or an SoC semiconductor. The charging method can be divided into wired and wireless. The charger IC may charge a battery and may prevent inflow of overvoltage or overcurrent from the charger. According to an embodiment, the charging IC may include a charging IC for at least one of a wired charging method and a wireless charging method. As a wireless charging method, for example, there is a magnetic resonance method, a magnetic induction method, or an electromagnetic wave method, and an additional circuit for wireless charging, for example, a circuit such as a coil loop, a resonance circuit or a rectifier may be added. have.

The battery gauge may measure, for example, a remaining amount of the battery 1896, voltage, current, or temperature during charging. The battery 1896 may store or generate electricity, and may supply power to the electronic device 1801 using the stored or generated electricity. The battery 1896 may include, for example, a rechargeable battery or a solar battery.

The indicator 1897 may display a specific state of the electronic device 1801 or a part thereof (eg, the AP 1810), for example, a booting state, a message state, or a charging state. The motor 1898 may convert an electrical signal into mechanical vibration. Although not shown, the electronic device 1801 may include a processing unit (eg, GPU) for supporting mobile TV. The processing device for supporting mobile TV may process media data according to standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or media flow, for example.

Each of the aforementioned components of the electronic device according to the present disclosure may be composed of one or more components, and the name of the corresponding component may vary depending on the type of the electronic device. The electronic device according to the present disclosure may be configured to include at least one of the above-described components, and some components may be omitted or may further include additional other components. In addition, since some of the components of the electronic device according to the present disclosure are combined to form a single entity, the functions of the components prior to being combined may be identically performed.

The term “module” used in the present disclosure may refer to, for example, a unit including one or a combination of two or more of hardware, software, or firmware. The term “module” may be used interchangeably with terms such as, for example, unit, logic, logical block, component, or circuit. A “module” may be a minimum unit or a part of an integrally formed part. A “module” may be a minimum unit or a part of performing one or more functions. A “module” may be implemented mechanically or electronically. For example, a “module” according to the present disclosure is an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs) or programmable logic device (FPGA) that performs certain operations, known or to be developed in the future. logic device).

According to various embodiments, at least a part of an apparatus (eg, modules or functions thereof) or a method (eg, operations) according to the present disclosure may include a computer-readable storage medium in the form of, for example, a programming module. It can be implemented as a command stored in -readable storage media). When the instruction is executed by one or more processors (eg, the processor 210 ), the one or more processors may perform a function corresponding to the instruction. The computer-readable storage medium may be, for example, the memory 120 . At least a part of the programming module may be implemented (eg, executed) by, for example, the processor 110 . At least a part of the programming module may include, for example, a module, a program, a routine, sets of instructions, or a process for performing one or more functions.

The computer-readable recording medium includes a magnetic medium such as a hard disk, a floppy disk, and a magnetic tape, and an optical recording medium such as a CD-ROM (Compact Disc Read Only Memory) and DVD (Digital Versatile Disc). Media), magneto-optical media such as a floptical disk, and program instructions such as read only memory (ROM), random access memory (RAM), flash memory, etc. (e.g. programming a hardware device specially configured to store and perform the module). In addition, the program instructions may include high-level language codes that can be executed by a computer using an interpreter or the like as well as machine language codes such as those generated by a compiler. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present disclosure, and vice versa.

A module or programming module according to the present disclosure may include at least one or more of the above-described components, some may be omitted, or may further include additional other components. Operations performed by a module, programming module, or other component according to the present disclosure may be executed in a sequential, parallel, iterative, or heuristic manner. Also, some operations may be executed in a different order, omitted, or other operations may be added.

In addition, the embodiments of the present disclosure disclosed in the present specification and drawings are merely provided for specific examples to easily explain the technical content of the present disclosure and help the understanding of the present disclosure, and are not intended to limit the scope of the present disclosure. Therefore, the scope of the present disclosure should be construed as including all changes or modifications derived from the technical spirit of the present disclosure in addition to the embodiments disclosed herein as being included in the scope of the present disclosure.

Claims (67)

In an electronic device,
a flexible display formed on at least a portion of the electronic device;
a front cover operatively connected to the electronic device;
a rear cover operatively connected to the electronic device;
a first speaker provided on the front cover;
a second speaker provided on the front cover; and
at least one processor, the at least one processor comprising:
Identifies bending of the flexible display,
identifying a first overlapping area and a second overlapping area overlapping each other among areas of the flexible display by the bending;
set to adjust the transparency of the flexible display so that an object being displayed in the first overlapping area of the flexible display is seen through the second overlapping area of the display,
The at least one processor comprises:
identifying an angle between the front cover and the back cover;
based on the identified angle being within a specified range, activating the first speaker and the second speaker,
The electronic device is configured to control the directionality of sound output through the activated first speaker and the second speaker.
The method of claim 1,
The flexible display is configured to sense at least one of a touch input and a proximity input.
The method of claim 1,
The electronic device further comprising a second display formed on at least a portion of the front cover or the rear cover.
4. The method of claim 3,
At least one of the flexible display and the second display includes at least one transparent display area or at least one mirror display area.
delete delete delete The method of claim 1,
The electronic device of claim 1, further comprising: an energy harvester formed on at least one of another portion of the upper surface of the front cover, at least a portion of a lower surface of the front cover, or at least a portion of a rear surface of the electronic device.
The method of claim 1,
and the first speaker or the second speaker comprises a thin film speaker.
9. The method of claim 8,
wherein the energy harvester is configured to generate power based on at least one of light, temperature, vibration, pressure or the sun.
The method of claim 1,
The electronic device further comprising an input module configured to recognize an input associated with at least a portion of the transparent display area of the flexible display.
delete 12. The method of claim 11,
The input module includes at least one of a touch sensor and a pressure sensor.
The method of claim 1,
Further comprising a display control module set to control the flexible display,
When at least some information of the information displayed in the first overlapping area is shown through the second overlapping area, the display control module is configured to display information different from the at least some information through the second overlapping area additionally or the An electronic device configured to display on behalf of at least some information.
delete 15. The method of claim 14,
The display control module may be configured to include one of power state information of the electronic device, communication state information between the electronic device and an external device for the electronic device, external environment information of the electronic device, or context awareness information associated with a user of the electronic device. an electronic device configured to determine the other information based on at least one.
The electronic device of claim 1 , wherein the front cover is detachably coupled to the electronic device.
The method of claim 1,
and the front cover is connected to the electronic device in at least one structure of a folder, a hinge, a flip, and a slide so that the front cover can be opened and closed with respect to the electronic device.
The method of claim 1,
The electronic device further comprising a solar cell formed integrally with the flexible display. delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete

Images