KR20170051950A - Electronic device and method for controlling display thereof - Google Patents

Abstract

An electronic device is disclosed. The disclosed electronic device includes a plurality of displays, a processor electrically coupled to the plurality of displays, and a memory electrically coupled to the processor, wherein the processor, upon execution, causes the processor to display And middleware for dividing the image data and transmitting the image data to the respective display drivers of the plurality of displays.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to an electronic device,

Various embodiments according to the present disclosure relate to an electronic apparatus having a plurality of displays and a method of controlling the display of the electronic apparatus, and more particularly, to an electronic apparatus and a display control method using a plurality of displays.

Recently, various types of display devices have been used. Such a display device can have two or more displays, and the size of the screen is gradually increasing. Accordingly, it becomes possible for a user to view a screen while selectively using a plurality of displays.

The electronic device may output one piece of content using a plurality of displays, or may display different pieces of content on a plurality of displays.

Conventionally, when an electronic device displays content on a plurality of displays, the display driver processes and displays the content to suit each display. However, when the specification of the display is different, it is troublesome to provide a driver for each display. Further, when updating the system of the electronic device, it may be troublesome to update the display driver.

Also, conventionally, even when only one of the plurality of displays is activated, there is still waste of resources (e.g., buffer, power) by rendering the content by a plurality of display capacities.

In various embodiments of the present invention, a method of saving resources by generating and displaying content using an application and middleware based on the situation of a plurality of displays is presented.

An electronic device in accordance with one embodiment includes a plurality of displays, a processor electrically coupled to the plurality of displays, and a memory electrically coupled to the processor, wherein the processor, upon execution, And may store the middleware for dividing the content data to be displayed in each of the plurality of display devices and transmitting the separated content data to the display drivers of the plurality of displays.

According to an embodiment of the present invention, there is provided a method of controlling a display of an electronic device, the method comprising: dividing content data to be displayed on each of a plurality of displays in a middleware stored in the electronic device; To the display driver, wherein the display driver is operable to transmit the content data to the at least one display

In a non-transitory recording medium storing middleware for executing a method of controlling display of an electronic device according to an embodiment, the middleware may be configured such that, at the time of execution, the processor of the electronic device displays content data to be displayed on each of the plurality of displays And causing the display driver to transmit the divided content data to the display driver of each of the plurality of displays, wherein the display driver transmits the content data to the at least one display to display the content, Temporary recording medium.

According to various embodiments as described above, the electronic device can smoothly display an image on a plurality of displays regardless of specifications of the display driver or the display device.

1 is a diagram for explaining the operation of an electronic device according to various embodiments of the present disclosure.
2 is a block diagram of an electronic device according to various embodiments of the present disclosure;
3 is a block diagram of a program module in accordance with various embodiments of the present disclosure;
4 is a block diagram briefly illustrating the configuration of an electronic device according to various embodiments of the present disclosure;
5 is a schematic block diagram of a program module for controlling a plurality of displays in accordance with various embodiments of the present disclosure;
6 is a schematic flow chart for driving a plurality of displays in accordance with various embodiments of the present disclosure.
FIG. 7 is a diagram of a case where different images are displayed on a plurality of displays according to various embodiments of the present disclosure;
8 is a flow diagram of an operation in which an electronic device according to various embodiments of the present disclosure displays different images on a display.
Figure 9 is a diagram of a state in which an electronic device according to various embodiments of the present disclosure divides an image into a plurality of displays.
10 is a flow diagram of an operation in which an electronic device according to various embodiments of the present disclosure divides an image into a plurality of displays.
Figure 11 is a diagram illustrating an electronic device according to various embodiments of the present disclosure displaying a single image on a plurality of displays while simultaneously displaying different images on each display.
12 is a flow diagram of an operation in which an electronic device according to various embodiments of the present disclosure divides one image into a plurality of displays while simultaneously displaying different images on each display.
13 is a diagram of a method for displaying an image when an electronic device according to various embodiments of the present disclosure displays an image on a plurality of displays and the connection state of the display changes.
14 is a diagram of another method for displaying an image when an electronic device according to various embodiments of the present disclosure displays an image on a plurality of displays and the connection state of the display changes.
15 is a diagram of a situation where the size of an image displayed on a first display and a second display of an electronic device according to various embodiments of the present disclosure is changed.
16 is a view showing one image divided into three images of three displays of an electronic apparatus according to various embodiments of the present disclosure while displaying different images.
17 is a flowchart of an operation in which an electronic device according to various embodiments of the present disclosure divides one image into three displays and displays different images at the same time.

Hereinafter, various embodiments of the present document will be described with reference to the accompanying drawings. It should be understood, however, that this invention is not intended to be limited to the particular embodiments described herein but includes various modifications, equivalents, and / or alternatives of the embodiments of this document . In connection with the description of the drawings, like reference numerals may be used for similar components.

In this document, the expressions "having," " having, "" comprising," or &Quot;, and does not exclude the presence of additional features.

In this document, the expressions "A or B," "at least one of A or / and B," or "one or more of A and / or B," etc. may include all possible combinations of the listed items . For example, "A or B," "at least one of A and B," or "at least one of A or B" includes (1) at least one A, (2) Or (3) at least one A and at least one B all together.

As used herein, the terms "first," "second," "first," or "second," and the like may denote various components, regardless of their order and / or importance, But is used to distinguish it from other components and does not limit the components. For example, the first user equipment and the second user equipment may represent different user equipment, regardless of order or importance. For example, without departing from the scope of the rights described in this document, the first component can be named as the second component, and similarly the second component can also be named as the first component.

(Or functionally or communicatively) coupled with / to "another component (eg, a second component), or a component (eg, a second component) Quot; connected to ", it is to be understood that any such element may be directly connected to the other element or may be connected through another element (e.g., a third element). On the other hand, when it is mentioned that a component (e.g., a first component) is "directly connected" or "directly connected" to another component (e.g., a second component) It can be understood that there is no other component (e.g., a third component) between other components.

As used herein, the phrase " configured to " (or set) to be "configured according to circumstances may include, for example, having the capacity to, To be designed to, "" adapted to, "" made to, "or" capable of ". The term " configured to (or set up) "may not necessarily mean" specifically designed to "in hardware. Instead, in some situations, the expression "configured to" may mean that the device can "do " with other devices or components. For example, a processor configured (or configured) to perform the phrases "A, B, and C" may be implemented by executing one or more software programs stored in a memory device or a dedicated processor (e.g., an embedded processor) , And a generic-purpose processor (e.g., a CPU or an application processor) capable of performing the corresponding operations.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the scope of the other embodiments. The singular expressions may include plural expressions unless the context clearly dictates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art. The general predefined terms used in this document may be interpreted in the same or similar sense as the contextual meanings of the related art and, unless expressly defined in this document, include ideally or excessively formal meanings . In some cases, even the terms defined in this document can not be construed as excluding the embodiments of this document.

In the following, various embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram for explaining an operation of an electronic device 100 according to an embodiment of the present invention.

Referring to Figure 1, an electronic device 100 may be implemented with a variety of devices with displays 110a, 110b. For example, the electronic device 100 may be a cellular phone, a smart phone, a laptop computer, a tablet device, an electronic book device, a device for digital broadcasting, a PDA (personal digital assistant) A multimedia player, navigation, or a wearable device such as a smart watch, smart glasses, or a head-mounted display (HMD). However, the present invention is not limited thereto.

According to various embodiments, the electronic device 100 may implement different contents displayed on the screen, such as an image and a moving picture displayed on the display 110 according to a change in the state of an application being executed in the electronic device 100. [

The application can perform various functions in the electronic device 100 as a program that is embedded in the electronic device 100 or downloaded from the outside of the electronic device 100 and can be executed in the electronic device 100. [ The state change of the application may include an execution of the application, a change in the operation inside the application under execution, and a change in the state of a plurality of displays in which the application is executed.

Referring to Figure 1 (a), the electronic device 100 may include a camera 120. According to various embodiments, the electronic device 100 can capture an image using the camera 120 and display the image on the display 110. According to various embodiments, the electronic device 100 may display content received from an external electronic device on the display 110 using a communication module. 1 (a) is a diagram showing a screen input through the camera 120 or a screen received from an external electronic device on a plurality of displays. One image is divided and displayed on the two displays 110a and 110b.

The electronic device 100 can change the screen configuration as shown in FIG. 1 (b) in response to a user's signal input or the like. Referring to FIG. 1 (b), the first display 110a displays icons 130 for changing the shooting conditions. And an image input through the camera 120 is displayed on the second display 110b. That is, it can be seen that the image displayed on the plurality of displays 110 is changed in accordance with the change in the state of the camera application currently being executed.

In this manner, the electronic device 100 can freely utilize the plurality of displays 110 according to a change in the state of the application, thereby providing a useful screen configuration to the user.

2 is a block diagram of an electronic device 100 in accordance with various embodiments. Electronic device 100 includes one or more processors (e.g., AP) 210, a communications module 220, a subscriber identification module 224, a memory 230, a sensor module 240, an input device 250, An interface 270, an audio module 280, a camera module 291, a power management module 295, a battery 296, an indicator 297, and a motor 298. The processor 290, The processor 210 may be, for example, an operating system or an application program to control a plurality of hardware or software components coupled to the processor 210, and to perform various data processing and operations. ) May be implemented, for example, as a system on chip (SoC). According to one embodiment, the processor 210 may further include a graphics processing unit (GPU) and / or an image signal processor. The cellular module 210 may include at least some of the components shown in Figure 2 (e.g., the cellular module 221) The processor 210 other components: processing by loading the command or data received from at least one (e.g., non-volatile memory) in the volatile memory) and can store the result data into the nonvolatile memory.

The communication module 220 may include, for example, a cellular module 221, a WiFi module 223, a Bluetooth module 225, a GNSS module 227, an NFC module 228 and an RF module 229 have. The cellular module 221 can provide voice calls, video calls, text services, or Internet services, for example, over a communication network. According to one embodiment, the cellular module 221 may utilize a subscriber identity module (e.g., a SIM card) 224 to perform the identification and authentication of the electronic device 100 within the communication network. According to one embodiment, the cellular module 221 may perform at least some of the functions that the processor 210 may provide. According to one embodiment, the cellular module 221 may comprise a communications processor (CP). At least some (e.g., two or more) of the cellular module 221, the WiFi module 223, the Bluetooth module 225, the GNSS module 227, or the NFC module 228, according to some embodiments, (IC) or an IC package. The RF module 229 can, for example, send and receive communication signals (e.g., RF signals). The RF module 229 may include, for example, a transceiver, a power amplifier module (PAM), a frequency filter, a low noise amplifier (LNA), or an antenna. According to another embodiment, at least one of the cellular module 221, the WiFi module 223, the Bluetooth module 225, the GNSS module 227, or the NFC module 228 transmits / receives an RF signal through a separate RF module . The subscriber identification module 224 may include, for example, a card or an embedded SIM containing a subscriber identity module, and may include unique identification information (e.g., ICCID) or subscriber information (e.g., IMSI (international mobile subscriber identity).

The memory 230 may include, for example, an internal memory 232 or an external memory 234. Volatile memory (e.g., a DRAM, an SRAM, or an SDRAM), a non-volatile memory (e.g., an OTPROM, a PROM, an EPROM, an EEPROM, a mask ROM, a flash ROM , A flash memory, a hard drive, or a solid state drive (SSD). The external memory 234 may be a flash drive, for example, a compact flash (CF) ), A Micro-SD, a Mini-SD, an extreme digital (xD), a multi-media card (MMC), or a memory stick, etc. The external memory 234 may communicate with the electronic device 100, Or may be physically connected.

The sensor module 240 may, for example, measure a physical quantity or sense the operating state of the electronic device 100 and convert the measured or sensed information into an electrical signal. The sensor module 240 includes a gesture sensor 240A, a gyro sensor 240B, an air pressure sensor 240C, a magnetic sensor 240D, an acceleration sensor 240E, a grip sensor 240F, A temperature sensor 240G, a UV sensor 240G, a color sensor 240H (e.g., an RGB (red, green, blue) sensor), a living body sensor 240I, And a sensor 240M. Additionally or alternatively, the sensor module 240 may be configured to perform various functions such as, for example, an e-nose sensor, an electromyography (EMG) sensor, an electroencephalograph (EEG) sensor, an electrocardiogram An infrared (IR) sensor, an iris sensor, and / or a fingerprint sensor. The sensor module 240 may further include a control circuit for controlling at least one or more sensors belonging to the sensor module 240. In some embodiments, the electronic device 100 further includes a processor configured to control the sensor module 240, either as part of the processor 210 or separately, so that while the processor 210 is in a sleep state, The sensor module 240 can be controlled.

The input device 250 may include, for example, a touch panel 252, a (digital) pen sensor 254, a key 256, or an ultrasonic input device 258. As the touch panel 252, for example, at least one of an electrostatic type, a pressure sensitive type, an infrared type, and an ultrasonic type can be used. Further, the touch panel 252 may further include a control circuit. The touch panel 252 may further include a tactile layer to provide a tactile response to the user. (Digital) pen sensor 254 may be part of, for example, a touch panel or may include a separate recognition sheet. Key 256 may include, for example, a physical button, an optical key, or a keypad. The ultrasonic input device 258 can sense the ultrasonic wave generated by the input tool through the microphone (e.g., the microphone 288) and confirm the data corresponding to the ultrasonic wave detected.

The display 260 may include a panel 262, a hologram device 264, a projector 266, and / or control circuitry for controlling them. The panel 262 may be embodied, for example, flexibly, transparently, or wearably. The panel 262 may comprise a touch panel 252 and one or more modules. The hologram device 264 can display a stereoscopic image in the air using interference of light. The projector 266 can display an image by projecting light onto a screen. The screen may be located, for example, inside or outside the electronic device 100. The interface 270 may include, for example, an HDMI 272, a USB 274, an optical interface 276, or a D-sub (D-subminiature) 278. The interface 270 may, for example, be included in the communication interface 170 shown in FIG. Additionally or alternatively, the interface 270 may include, for example, a mobile high-definition link (MHL) interface, an SD card / multi-media card (MMC) interface, or an infrared data association have.

The electronic device 100 according to one embodiment may include a plurality of displays 260. Various embodiments for changing the image displayed on the plurality of displays 260 depending on the situation of the electronic device 100 or displaying the image on one display 260 will be described later.

The audio module 280 can, for example, convert sound and electrical signals in both directions. At least some of the components of the audio module 280 may be included, for example, in the input / output interface 145 shown in FIG. The audio module 280 may process sound information input or output through, for example, a speaker 282, a receiver 284, an earphone 286, a microphone 288, or the like. The camera module 291 is, for example, a device capable of capturing still images and moving images, and according to one embodiment, one or more image sensors (e.g., a front sensor or a rear sensor), a lens, an image signal processor (ISP) , Or flash (e.g., an LED or xenon lamp, etc.). The power management module 295 can manage the power of the electronic device 100, for example. According to one embodiment, the power management module 295 may include a power management integrated circuit (PMIC), a charging IC, or a battery or fuel gauge. The PMIC may have a wired and / or wireless charging scheme. The wireless charging scheme may include, for example, a magnetic resonance scheme, a magnetic induction scheme, or an electromagnetic wave scheme, and may further include an additional circuit for wireless charging, for example, a coil loop, a resonant circuit, have. The battery gauge can measure, for example, the remaining amount of the battery 296, the voltage during charging, the current, or the temperature. The battery 296 may include, for example, a rechargeable battery and / or a solar cell.

The indicator 297 may indicate a particular state of the electronic device 100 or a portion thereof (e.g., processor 210), such as a boot state, a message state, or a state of charge. The motor 298 can convert the electrical signal to mechanical vibration, and can generate vibration, haptic effects, and the like. Electronic device 100 is, for example, DMB Mobile TV-enabled devices capable of handling media data in accordance with standards such as (digital multimedia broadcasting), DVB (digital video broadcasting), or MediaFLO (mediaFlo ^TM) (for example, : GPU). Each of the components described in this document may be composed of one or more components, and the name of the component may be changed according to the type of the electronic device. In various embodiments, an electronic device (e. G., Electronic device 100) may have some components omitted, further include additional components, or some of the components may be combined into one entity, The functions of the preceding components can be performed in the same manner.

3 is a block diagram of a program module according to various embodiments. According to one embodiment, the program module 310 may include an operating system that controls resources associated with the electronic device 100 and / or various applications running on the operating system. The operating system may include, for example, Android ^TM , iOS ^TM , Windows ^TM , Symbian ^TM , Tizen ^TM , or Bada ^TM .

3, program module 310 may include a kernel 320, middleware 330, API 360, and / or application 370. At least a portion of the program module 310 is preloaded on the electronic device or is downloadable from the external electronic device.

The kernel 320 may include, for example, a system resource manager 321 and / or a device driver 393. The system resource manager 321 can perform control, allocation, or recovery of system resources. According to one embodiment, the system resource manager 321 may include a process manager, a memory manager, or a file system manager. The device driver 323 may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WiFi driver, an audio driver, or an inter-process communication . The middleware 330 may provide various functions through the API 360, for example, to provide functions that are commonly needed by the application 370 or allow the application 370 to use limited system resources within the electronic device. Application 370 as shown in FIG. According to one embodiment, the middleware 330 includes a runtime library 335, an application manager 341, a window manager 342, a multimedia manager 343, a resource manager 344, a power manager 345, a database manager At least one of the package manager 346, the package manager 347, the connectivity manager 348, the notification manager 349, the location manager 350, the graphic manager 351 or the security manager 352 and the display manager 353 . ≪ / RTI >

The runtime library 335 may include, for example, a library module that the compiler uses to add new functionality via a programming language while the application 370 is executing. The runtime library 335 may perform input / output management, memory management, or arithmetic function processing. The application manager 341 can manage the life cycle of the application 370, for example. The window manager 342 can manage GUI resources used in the screen. The multimedia manager 343 can recognize the format required for reproducing the media files and can perform encoding or decoding of the media file using a codec according to the format. The resource manager 344 can manage the source code of the application 370 or the space of the memory. The power manager 345 may, for example, manage the capacity or power of the battery and provide the power information necessary for operation of the electronic device. According to one embodiment, the power manager 345 may interoperate with a basic input / output system (BIOS). The database manager 346 may create, retrieve, or modify the database to be used in the application 370, for example. The package manager 347 can manage installation or update of an application distributed in the form of a package file.

The connectivity manager 348 may, for example, manage the wireless connection. The notification manager 349 may provide the user with an event such as, for example, an arrival message, an appointment, a proximity notification, and the like. The location manager 350 can manage the location information of the electronic device, for example. The graphic manager 351 may, for example, manage the graphical effects to be presented to the user or a user interface associated therewith. Security manager 352 may provide, for example, system security or user authentication. The display manager 353 can confirm, for example, whether the display is activated or inactivated. According to one embodiment, the middleware 330 may include a telephony manager for managing the voice or video call function of the electronic device, or a middleware module capable of forming a combination of the functions of the above-described components . According to one embodiment, the middleware 330 may provide a module specialized for each type of operating system. Middleware 330 may dynamically delete some existing components or add new ones. The API 360 may be provided in a different configuration depending on the operating system, for example, as a set of API programming functions. For example, for Android or iOS, you can provide a single API set for each platform, and for Tizen, you can provide two or more API sets for each platform.

The application 370 may include a home 371, a dialer 372, an SMS / MMS 373, an instant message 374, a browser 375, a camera 376, an alarm 377, Contact 378, voice dial 379, email 380, calendar 381, media player 382, album 383, watch 384, healthcare (e.g., measuring exercise or blood glucose) , Or environmental information (e.g., air pressure, humidity, or temperature information) application. According to one embodiment, the application 370 may include an information exchange application capable of supporting the exchange of information between the electronic device and the external electronic device. The information exchange application may include, for example, a notification relay application for communicating specific information to an external electronic device, or a device management application for managing an external electronic device. For example, the notification delivery application can transmit notification information generated in another application of the electronic device to the external electronic device, or receive notification information from the external electronic device and provide the notification information to the user. The device management application may, for example, control the turn-on / turn-off or brightness (or resolution) of an external electronic device in communication with the electronic device (e.g., the external electronic device itself Control), or install, delete, or update an application running on an external electronic device. According to one embodiment, the application 370 may include an application (e.g., a healthcare application of a mobile medical device) designated according to the attributes of the external electronic device. According to one embodiment, the application 370 may include an application received from an external electronic device. At least some of the program modules 310 may be implemented (e.g., executed) in software, firmware, hardware (e.g., processor 210), or a combination of at least two of the same, Program, routine, instruction set or process.

4 is a block diagram briefly showing a configuration of an electronic device 100 according to an embodiment.

4, electronic device 100 includes a processor 410 (or processor 210 of FIG. 2), a display 420 (or display 260 of FIG. 2) and a sensor module 430 2 < / RTI >

The display 420 may comprise one or more of a plurality of displays. Although two displays 420a and 420b are shown in FIG. 4, the present invention is not limited thereto. The display 420 may provide a display area in which an image or UI is displayed. Display 420 may include a touch screen that senses touch input. The display 420 may display various screen configurations according to an executed application. For example, when the camera application is executed, the display 420 may display the input image. When the image playback application is executed, the display 420 may display images stored in the electronic device 100 or images stored in an external device capable of communicating with the electronic device 100 in various forms.

The sensor module 430 is a component for recognizing various status changes and the like around the electronic device 100 including the electronic device 100. The sensor module 430 can sense a user's touch using a touch sensor. The sensor module 430 may be implemented as a touch pad separately from the display 420 or may be implemented as a touch screen integrated with the display 420. [

The sensor module 430 senses the user's touch and transmits it to the processor 410 to change the state of the running application. The sensor module 430 may also sense various states of the display 420. For example, if the electronic device 100 is implemented with a plurality of displays 420, the sensor module 430 may be configured such that the plurality of displays 420 are all oriented in the same direction, or at least one display 420 You can detect if you are facing another direction.

Processor 410 is a component for controlling the operation of electronic device 100. The processor 410 may control the display 420 to change the status of the application based on various signals received from the sensor module 430 and to indicate the changed status. For example, as shown in FIG. 1, when the display 420 displays an image, when the user inputs a specific signal, the sensor module 430 can sense the input signal of the user. The processor 410 may perform a specified function based on the user input signal received from the sensor module 430. [ That is, as shown in FIG. 1 (b), icons 130 that can change the shooting setting can be displayed.

As such, if a signal is sensed by the sensor module 430 while the display 420 is executing an application, the processor 410 may cause the display 420 to change the image or UI being displayed on the display 420 420). The operation of the electronic device 100 will be described in detail below with reference to various drawings.

FIG. 5 is a schematic block diagram of a program module for controlling a plurality of displays 530. FIG.

6 is a schematic flow chart for driving a plurality of displays 530. FIG.

5 and 6, the overall contents of the electronic device 100 dividing the contents to be displayed on the plurality of displays 530 and displaying them on the plurality of displays 530 will be described.

According to various embodiments, upon request of the first application 501, the display manager 511 may verify the information and status of the display 530 that the current electronic device 100 is using (act 610). The display manager 511 may determine whether the information of the identified display 530, such as the size or resolution of the display 530, the currently-running display 530 is displayed on the first display 531 or the second display 532 Information to the first application 501 (operation 620).

For example, the first application 501 may request information from the display manager 511 about the display 530 in the following cases.

When executing the first application 501, the first application 501 may request information about the display 530 to create an executable image for the display 530.

Also, for example, if the first application 501 being executed is an image playback application, the first application 501 may request information about the display 530 according to various situations of playing the image. Specifically, the first application 501 divides one image into a plurality of displays 530, displays different images on the respective displays 530, and displays one or more image editing icons And may request information on the display 530 to display an image to be reproduced in another display 532. [

Such various reproduction environments can be continuously changed by the user's selection. Thus, the first application 501 can request information about the display 530 to display images in accordance with the changing playback environment.

Also, for example, if the running first application 501 is an application that plays back an image, the display 530 (e.g., the first display 531 or the second display 532) The display 530 which has been turned OFF or OFF may be turned ON again. In this case, the first application 501 may request the display manager 511 for information on the current state of the display 530. [ However, the information requested by the first application 501 to the display manager 511 is not limited thereto.

According to various embodiments, the first application 501 may generate image data in the form of an image layer to be displayed on the display 530 based on information about the received display 530 (operation 630) . The first application 501 may transmit the generated image layers to the graphic manager 513 through the application manager 512 (operation 640).

According to various embodiments, the graphic manager 513 may be configured to provide the image layers generated by the first application 501 to the frame buffers of the display drivers 521 and 522 of the plurality of displays, ) Can be managed as an image layer group. For example, if an image composed of a plurality of image layers is displayed on the first display 531, the graphic manager 513 groups (for example, layer stacks) a plurality of image layers, To the driver 521.

According to various embodiments, the graphic manager 513 may classify image data to be displayed in accordance with the size or current state (e.g., active state, relative connection state) of the plurality of displays 530 and output the image data to the respective display drivers 521 and 522 (Act 650). ≪ / RTI >

Display drivers 521 and 522 may display images on respective displays 531 and 532 using image data stored in the frame buffer of the display driver (act 660).

Hereinafter, various embodiments for displaying an image on a plurality of displays in accordance with an application state change will be described.

Fig. 7 is a diagram showing a case where different contents are displayed on a plurality of displays.

Referring to Fig. 7 (a), for example, a state in which the electronic device 100 executes the camera application is shown. When the camera function is executed, the electronic device 100 can display the image input through the camera module 720 on the display 710. [ The first display 711 may display various setting icons that can be adjusted when capturing an image. And the second display 712 can display an image (live view 760) input through the camera 720 in real time.

The effect applying icon 730 can apply various effects to the photographed image. For example, if the user selects the 'Bright' effect, the camera application can display the saturation, hue, tone and the like of the input image on the second display 712 with an increased weight. If the user selects the 'sketch' effect, the camera application can display the input image on the display 712 as if the edge portion of the subject was drawn with a pencil.

The setting icon 740 may be used to change other setting values of the camera application or to activate a desired camera module when the electronic device 100 has a plurality of camera modules.

The photographing related icon 750 may be displayed on the second display 712 in an overlapping manner with the image input through the camera 720. [ However, the icon 750 associated with the shooting may be separately assigned to the physical key of the electronic device 100 and displayed on the display 710 separately from the input image.

The photographing related icon 750 may include a photographing icon for photographing an input image, a mode icon for switching the photographing mode, a moving picture photographing icon for photographing the moving picture, and the like.

7 (b) is a diagram showing the image displayed on the display 710 in an image layer in FIG. 7 (a).

Referring to FIG. 7 (b), the camera application can create three image layers. The first image layer 770 may display an effect applying icon 730 and a setting icon 740. The second image layer 780 can display an input image by a live view 760. [ The third image layer 790 may display an imaging related icon 750.

According to various embodiments, the graphics manager 513 may divide and group the three image layers according to the state of the display and provide them to the frame buffer of the display driver. Specifically, the graphic manager 513 synthesizes the second image layer 780 and the third image layer 790 to be displayed together on the second display 712 into an image layer stack, As shown in FIG.

8 is a diagram illustrating a process for the electronic device 100 to display an image on the display 730 as shown in FIG.

Referring to FIG. 8, the camera application 810 may generate three image layers having a size of Full HD. According to various embodiments, the camera application 810 may generate an image through an activity. An activity may refer to an activity of generating an image to be displayed on the display 710, as the different operations included in the application.

According to various embodiments, a first image layer 770 may be generated by a first activity 811 of the camera application 810 and a second image layer 770 may be generated by a second activity 812, 3 image layer 790 may be generated. The camera application 810 may transmit the generated image layers to the graphic manager 820. [

According to various embodiments, the graphics manager 820 may separate or merge the data contained in the image layers 770, 780, 790 to display the images on the first display 711 and the second display 712 can do. For example, the first image layer 770 may be made into a first image layer stack 821, the second image layer 780 and the third image layer 790 may be made into a second image layer stack 822, have. The graphic manager 820 generates the generated first and second image layer stacks 821 and 822 as a display first frame buffer 831 and a display second frame buffer 832 respectively and outputs the generated first and second image layer stacks 821 and 822 to the display driver 830 Lt; / RTI > The display driver 830 may display the first display 841 and the second display 842 using the received display frame buffers 831 and 832, respectively.

As described above, in the electronic device 100 according to the embodiment, the graphic manager 820 belonging to the middleware part among the program modules may transmit the image to be displayed on the display 840 in advance to the display driver 830 . That is, when the display driver 830 performs the image separation process, when the electronic device 100 updates the OS, the display driver 830 also updates the OS, System) command to separate images. As described above, by performing the image separation processing at the middleware end belonging to the operating system (OS) of the electronic device 100, the electronic device 100 separates and processes the image regardless of the state of the display driver 830 .

9 is a diagram showing a state in which one screen is divided and displayed on a plurality of displays.

Figure 9 (a) shows the entire image to be reproduced. Referring to FIG. 9B, the electronic device 100 can divide and display an image on the display 920. FIG. In order to divide one image into a plurality of displays 921 and 922, an application generates an entire image, and the graphic manager separates the generated entire image and transmits the separated image to each display driver.

10 is a diagram showing an overall flow of dividing one image into a plurality of displays 1040. FIG.

According to various embodiments, the application 1010 may generate an image to be displayed on the display 1040. For example, application 1010 may be a gallery application that plays back a stored image. The gallery application 1010 may display an image stored on the electronic device 100 or stored on the external electronic device on the display 1040. The gallery application 1010 may generate one image layer 1050 so as to have a capacity twice as large as the Full HD size. The gallery application 1010 may transmit the generated image layer 1050 to the graphic manager 1020. [

According to various embodiments, the graphics manager 1020 may further include a divider 1021 that separates the images. The divider 1021 can separate and separate the data to be displayed on each display from the data possessed by the image layer. That is, a function of separating image layers according to characteristics such as size or resolution of each of the plurality of displays can be performed. For example, the divider 1021 may divide the image layer 1020 to match the size or resolution of the first display 1041 and the second display 1042.

According to various embodiments, the graphics manager 1020 may make the first image layer stack 1021 of data to be displayed on the first display 1041 of the separated data and write the data to be displayed on the second display 1042 to the second An image layer stack 1022 can be formed. The graphic manager 1020 transmits the generated first image layer stack 1021 and the second image layer stack 1022 to the first frame buffer 1031 and the second frame buffer 1032.

According to various embodiments, the display driver displays an image on the first display 1041 using the first frame buffer 1031 and an image on the second display 1042 using the second frame buffer 1032 .

As described above, in the electronic device 100 according to the embodiment, the graphic manager 1020 belonging to the middleware part among the program modules may transmit an image to be displayed on the display 1040 in advance to the display driver 1030 . That is, when the display driver 1030 performs the image separation process, when the electronic device 100 updates the OS, the display driver 1030 also updates the display device 1030, The image is separated and processed according to the instruction of the operation system. As described above, by performing the image separation processing at the middleware end belonging to the operating system (OS) of the electronic device 100, the electronic device 100 separates and processes the image regardless of the state of the display driver 1030 .

11 is a diagram showing one image divided into a plurality of displays 1110 while displaying different images on the respective displays 1111 and 1112. FIG.

11A, the electronic device 100 displays a plurality of thumbnail images 1113 on the first display 1111, and one large image 1114 on the second display 1112. [ And displays an icon 1115 for editing an image over the first display 1111 and the second display 1112. [ The thumbnail images 1113 may be images that have previously been captured and stored in the electronic device 100 and that are displayed in a small size and reduced size. One large image 1114 may be an image selected by the user among the images previously captured and stored in the electronic device 100 and may be an image currently input through the camera of the electronic device 100. [

According to various embodiments, when the electronic device 100 executes the gallery application, an image can be displayed as shown in FIG. 11 (a). Specifically, the plurality of thumbnail images displayed on the first display 1111 may be a state in which the user can select images to be displayed in a small size. One image displayed on the second display 1112 may be an image selected by the user from a plurality of thumbnail images. The image editable icon 1115 may apply various effects to the image displayed on the second display 1112 at the user's option.

11B is a diagram showing the images displayed on the display 1110 separated into an image layer.

Referring to FIG. 11 (b), the first image layer 1120 may include a plurality of thumbnail images. The second image layer 1130 includes an icon 1115 for editing the image and may be displayed on both the first display 1111 and the second display 1112. [ The third image layer 1140 may include one image. Image layers can be created in the Gallery application. The graphics manager may divide and group the three image layers according to the state of the display and provide them to the display frame buffer.

Fig. 12 is a view for explaining a flow for the electronic device 100 to display an image on the display 1110 as shown in Fig.

Referring to FIG. 12, the gallery application 1210 can generate two image layers 1120 and 1140 having a full HD size and one image layer 1130 having a size twice as large as Full HD. The gallery application 1210 may create an image layer through an activity. An activity may refer to an activity of generating an image to be displayed on the display 710, as the different operations included in the application.

According to various embodiments, the gallery application 1210 may generate a first image layer 1120 of full HD size by a first activity 1211. The gallery application 1210 may generate a second image layer 1130 having a size twice as large as Full HD by the second activity 1212. [ The gallery application 1210 may generate the third image layer 1140 of full HD size by the third activity 1211. The gallery application 1210 may transmit the generated image layers to the graphic manager 1220 .

According to various embodiments, the graphics manager 1220 may identify and merge the data contained in the image layers 1120, 1130, and 1140 to display images on the first display 1241 and the second display 1242, respectively . For example, the graphics manager 1220 may further include a divider 1221 for separating images. The divider 1221 may perform a function of separating image layers according to characteristics such as size or resolution of each of the plurality of displays. For example, the divider 1221 may divide the image layers according to the sizes of the first display 1241 and the second display 1242. Specifically, the divider 1221 can separate and separate the data to be displayed on the respective displays 1241 and 1242 from among data possessed by the image layer 1130.

According to various embodiments, the graphics manager 1220 groups the first image layer 1120 and the second-1 image layer 1130-1 separated by the divider 1221 into a first image layer stack 1222 Can be generated. The graphic manager 1220 may generate the second image layer stack 1223 by grouping the second image layer 1130-2 separated by the third image layer 1140 and the divider 1221. [ The graphic manager 1220 may transmit the generated first image layer stack 1222 and the second image layer stack 1223 to the first frame buffer 1231 and the second frame buffer 1232, respectively.

According to various embodiments, the display driver 1230 may display an image on the first display 1241 using the first frame buffer 1231 and may display an image on the second display 1242 using the second frame buffer 1232. [ ). ≪ / RTI >

As described above, in the electronic device 100 according to the embodiment, the graphic manager 1220 belonging to the middleware part among the program modules may transmit the image to be displayed on the display 1240 in advance to the display driver 1230 . That is, when the display driver 1230 performs the image separation process, when the electronic device 100 updates the OS, the display driver 1230 also updates the OS, The image is separated and processed according to the instruction of the operation system. As described above, by performing the image separation process in the middleware stage belonging to the operating system (OS) of the electronic device 100, the electronic device 100 separates and processes the image regardless of the state of the display driver 1230 .

13 is a diagram illustrating a method of displaying an image when the connection state of the display 1310 is changed in a state in which an image is displayed on the plurality of displays 1310. FIG.

The display direction of one display 1311 can be changed by the user's operation in a state in which an image is displayed on the plurality of displays 1310. [ When the user changes the display direction of the first display 1311, the electronic device 100 can recognize the change of direction using the sensor module 430. [ According to various embodiments, the electronic device 100 may recognize that the first display 1311 switches from a first direction to a second direction using a sensor (e.g., a Hall sensor).

For example, the first direction may be the direction in which the display 1310 of the electronic device 100 faces the user. The second direction may be a direction in which the display 1310 of the electronic device 100 does not face the user.

The electronic device 100 can recognize the direction toward the user by using the camera. Specifically, the electronic device 100 may include a camera on a side where the second display 1312 is located. The camera can analyze the input image to find the face of the person, and if the previously stored data exists, the user can recognize the face of the user. Thus, the electronic device 100 may determine whether the display 1310 is facing the user.

The first display 1311 may not need to display an image if the first display 1311 changes in a first direction toward the user and in a second direction that does not face the user. In this case, the power of the first display 1311 can be turned off to reduce power consumption.

According to various embodiments, the electronic device 100 may turn off the power of the first display 1311 when the first display 1311 is changed beyond a threshold in a second direction not facing the user. The threshold value may be an angle preset by the manufacturer. The threshold value may also be set by entering a menu for setting the function of the electronic device 100 by the user.

A method of displaying an image when turning off the power of one display 1311 while displaying an image on the plurality of displays 1310 will be described.

13 (a) shows a state in which an image is displayed on a plurality of displays 1310. FIG. The first display 1311 may display a plurality of thumbnail images. One large image may be displayed on the second display 1312. An icon 1315 for correcting the image may be displayed across the first display 1311 and the second display 1312. [

As shown in FIG. 13 (c), the electronic device 100 can generate an image layer and display it on the display 1310. Specifically, the first display 1311 may display a first image layer 1320 and a second-1 image layer 1330-1, and the second display 1312 may display a second-image layer 1330 -2) and the third image layer 1340 can be displayed. The 2-1 image layer 1330-1 and the 2-2image layer 1330-2 are arranged in such a manner that the second image layer 1330 is aligned with the size or resolution of each of the displays 1311 and 1312, admit. The first image layer 1320 and the third image layer 1340 may have a full HD size. And the second image layer 1330 may have a size twice as large as Full HD.

In this state, as described above, when the user turns the first display 1311 and the electronic device 100 turns off the power of the first display 1311, The device 100 may display an image on the second display 1312 using only the third image layer 1340. [ This process will be described in detail with reference to FIG. 13 (d).

Referring to FIG. 13D, the display manager 1360 can confirm the current state of the display 1310. The sensor module 430 may sense the rotation of the first display 1311 and turn off the power of the first display 1311. The display manager 1360 can confirm that the power of the first display 1311 is turned off. The display manager 1360 can transmit to the graphic manager 1370 that the status of the first display 1311 has changed.

The graphic manager 1370 can recognize that the power of the first display 1311 is turned off and adjust the image layers. For example, the graphics manager 1370 may remove the first image layer 1320 that was displayed on the first display 1311. The graphic manager 1370 may remove the second image layer 1330 that was displayed on the first display 1311 and the second display 1312. [

According to various embodiments, the gallery application 1350 can verify that the power of the first display 1311 is turned off from the display manager 1360. [ In this case, the gallery application 1350 may not generate the first image layer 1320 and the second image layer 1330 that were displayed on the first display 1311. Thus, the gallery application 1350 may generate the first The resource waste for generating the image layer 1320 and the second image layer 1330 can be reduced.

The graphics manager 1370 may continue to transmit the third image layer 1340, which was displayed on the second display 1312, to the second display driver 1381.

According to various embodiments, the graphics manager 1370 may transmit the third image layer 1340 to the frame buffer of the second display driver 1381. [ The second display driver 1381 may display an image on the second display 1312 using a frame buffer.

In the embodiment of FIG. 13, the case where the state of the first display and the state of the second display change from (a) to (b) has been described, but the present invention is not limited thereto. Conversely, have.

14 is a diagram of another method of displaying an image when the connection state of the display 1410 is changed in a state in which an image is displayed on the plurality of displays 1410. FIG.

14 (a) shows an image displayed on a plurality of displays 1410. FIG. 14 (a) has been described in detail with reference to FIG. 13 (a), detailed description thereof will be omitted.

In this state, when the direction change of the first display 1411 is detected by the user, the electronic device 100 can turn off the power of the first display 1411. [ 14B and 14C, the electronic device 100 displays the second image layer 1440 and the second image layer 1440 whose size is changed. An image may be displayed on the second display 1412 using an image layer 1430 ?. This process will be described in detail with reference to FIG. 14 (d).

Referring to FIG. 14D, the display manager 1460 can confirm the current state of the display 1410. The sensor module 430 may sense the rotation of the first display 1411 and turn off the power of the first display 1411. The display manager 1460 can confirm that the power of the first display 1411 is turned off. The display manager 1460 may transmit to the graphics manager 1470 that the status of the first display 1411 has changed.

The graphic manager 1470 can recognize that the first display 1411 is powered off and adjust the image layers. For example, the graphics manager 1470 may remove the first image layer 1420 that was displayed on the first display 1411.

According to various embodiments, the gallery application 1450 may verify that the power of the first display 1411 is turned off from the display manager 1460. In this case, the gallery application 1450 may not generate the first image layer 1420 that was displayed on the first display 1411. Thus, the gallery application 1450 creates the first image layer 1420 Reduce resource waste.

The graphic manager 1470 may change the size of the second image layer 1430 displayed on the first display 1411 and the second display 1412. [ Instead of the second image layer 1430 having a double size of Full HD, the gallery application 1450 may use a second? An image layer 1430? Can be newly generated. The gallery application 1450 includes a third image layer 1440 and a newly created second? May send the image layer 1430? To the graphics manager 1470.

According to various embodiments, the graphics manager 1470 includes a third image layer 1440 and a second? May send the image layer 1430? To the frame buffer of the second display driver 1481. The second display driver 1481 can display an image on the second display 1412 using the frame buffer.

In this manner, the electronic device 100 according to an embodiment can transmit the image to be displayed on the display 1410 in advance to the display driver 1480 by the graphic manager 1470. Also, in the case where one display is not used, the graphic manager 1470 does not delete unnecessary image layers or layer stacks or transmit them to the display driver 1480, thereby preventing waste of generating and transmitting unnecessary data.

In the embodiment of FIG. 14, the case where the state of the first display and the state of the second display change from (a) to (b) has been described. However, the present invention is not limited thereto. have.

The method of changing the size of the second image layer 1330 and displaying it may be various.

Figure 15 illustrates a situation where the size of the image displayed in the first display (e.g., 1311 in Figure 14) and the second display (e.g., 1412 in Figure 14) is changed and displayed in the second display (e.g., 1412 in Figure 14) Fig. According to various embodiments, the electronic device 100 may be configured such that the second image layer 1430, which is twice the size of the full HD created by the gallery application 1450, disappears and the second? And display the appearance of the image layer 1430? In the form of an animation on the second display 1412.

15A, the electronic device 100 can display only the right half of the third image layer 1440 and the second image layer 1430 in the second display (e.g., 1412 in FIG. 14) have.

Referring to FIG. 15B, the electronic device 100 may further display a central portion of the second image layer 1430 on the second display 1412. Referring to FIG. 15 (c), the electronic device 100 may further display a central portion of the second image layer 1430 on the second display 1412.

Referring to FIG. 15D, the electronic device 100 includes a third image layer 1440 on the second display 1412 and a second image layer 1440 newly generated in a full HD size. Image layer 1430 ?. That is, the second image layer 1430 gradually moves to the right side of the second display 1412, Image layer 1430 ?. Using such an animation effect, the electronic device 100 can provide the user with a sense of aesthetics or the pleasure of using the electronic device 100.

16 is a view showing one image divided into three displays 1610 while displaying different images.

16A, the electronic device 100 displays a plurality of thumbnail images on the first display 1611, and the second display 1612 and the third display 1613 display one large image And an icon 1615 for editing an image is divided and displayed as a whole on the display 1610. [

According to various embodiments, when the electronic device 100 executes a gallery application, an image can be displayed as shown in FIG. 16 (a). In particular, the plurality of thumbnail images displayed on the first display 1611 may be a state in which the images that can be selected by the user are displayed in a small size. One image divided into the second display 1612 and the third display 1613 may be an image selected by the user from among a plurality of thumbnail images. The icon 1615 for editing an image can be divided and displayed on the first display 1611, the second display 1612, and the third display 1613. The image editable icon 1615 can apply various effects to the images displayed on the second display 1612 and the third display 1613 by the user's selection.

16B is a diagram showing the images displayed on the display 1610 separated into an image layer.

Referring to FIG. 16B, the first image layer 1620 may include a plurality of thumbnail images. The second image layer 1630 includes one image selected by the user and can be displayed separately on the second display 1612 and the display 3 1613. The third image layer 1640 includes an icon 1615 for editing the image and may be displayed separately on the first display 1611, the second display 1612, and the third display 1613.

17 is a view for explaining a flow for the electronic device 100 to display an image on the display 1610 as shown in Fig.

Referring to FIG. 17, the display manager 1711 can confirm the information and the status of the display 1610 currently used by the electronic device 100. The display manager 1711 may send to the gallery application 1701 information about the identified display 1610, e.g., the size of each of the displays 1610 and what the currently active display 1610 is .

The gallery application 1701 may generate image layers to be displayed on the display 1610 based on the image data to be displayed on the display 1610 based on the information of the received display 1610. [ For example, the gallery application 1701 includes a first image layer 1620 having a full HD size, a second image layer 1630 having a size of twice the full HD size, a third image layer 1630 having a size of three times the full HD size, An image layer 1640 may be generated. The gallery application 1701 can transmit the generated image layers to the graphic manager 1713 through the application manager 1712. [

According to various embodiments, the graphics manager 1713 may adjust the size of the image layers to produce an image for each display 1611, 1612, 1613. For example, the graphic manager 1713 may divide the second image layer 1630 into a 2-1 image layer 1631 and a 2-2 image layer 1632 each having a full HD size.

According to various embodiments, the graphic manager 1713 may convert the third image layer 1640 into a 3-1 image layer 1641 and a 3-2 image layer 1642 each having a full HD size, An image layer 1643, and the like.

According to various embodiments, the graphics manager 1713 may group each of the divided image layers into a layer stack according to the display 1610 to display. For example, the first image layer 1620 and the third image layer 1641 may be grouped into a layer stack 1 (1740). The second-1 image layer 1631 and the third-second image layer 1642 can be grouped into a layer stack 2 (1750). The second-2 image layer 1632 and the third-third image layer 1643 may be grouped into a layer stack 3 (1760).

The graphic manager 1713 sends the generated layer stacks to the frame buffers of the respective display drivers 1731, 1732 and 1733 and the display drivers 1731, 1732 and 1733 transmit the layer stacks stored in the frame buffer The stacks can be used to display an image on each display 1611, 1612, 1613.

As described above, in the electronic device 100 according to the embodiment, the graphic manager 1713 belonging to the middleware module among the program modules may transmit an image to be displayed on the display 1610 in advance and send it to the display driver 1730 . That is, when the display driver 1730 performs image separation processing, if the electronic device 100 updates the OS (Operating System), the display driver 1730 also updates the OS, The image is separated and processed according to the instruction of the operation system. As described above, by performing the image separation processing at the middleware end belonging to the operating system (OS) of the electronic device 100, the electronic device 100 separates the image regardless of the state of the display driver 1730 .

According to various embodiments of the present disclosure, there is provided a computer program product comprising a processor for executing an application in an electronic device, a first display and a second display, a first display driver for controlling the first display and a second display driver for controlling the second display And a memory for storing a display driver and a data management module, wherein the data management module, when executed by the processor, receives from the application content to be displayed in association with the execution of the application, 1 content and a second content, and may transmit the first content to the first display driver and the second content to the second display driver.

According to various embodiments, the first display driver may display the first content using the first display and the second display driver may be configured to display the second content using the second display have.

According to various embodiments, the data management module may be configured to be performed at a different software layer than the application and the first and second display drivers.

According to various embodiments, the data management module may form at least part of the middleware.

According to various embodiments, the content may be configured to be created using the application using attributes determined based on contextual information associated with the electronic device or the content.

According to various embodiments, the context information may include an activation state of the first display and the second display, an interconnect state, an execution state of the application, or a combination thereof.

According to various embodiments of the present disclosure, CLAIMS What is claimed is: 1. An electronic device comprising: a plurality of displays; a processor electrically coupled to the plurality of displays; and a memory electrically coupled to the processor, wherein the processor, upon execution, And middleware for dividing the content data and transmitting the separated content data to the display drivers of the plurality of displays.

According to various embodiments, the middleware may be configured to, at runtime, cause the processor to display the plurality of displays based on at least one of execution of an application, a content playback state change of an executing application, It is possible to distinguish content data to be displayed.

According to various embodiments, the content playback state change of the application may be such that when different contents are displayed on the plurality of displays, when one content is displayed separately, different contents and one content are separated and displayed Or at least one of the following cases.

According to various embodiments, the middleware may be configured such that, at the time of execution, the processor identifies content data to be displayed on each of the plurality of displays, the content data including content layers constituting content layers constituting content to be displayed by the plurality of displays To the display driver of each of the plurality of displays.

According to various embodiments, at least one of the content to be displayed on each of the plurality of displays may be content received from the outside of the electronic device, and at least the other one may be content generated by the electronic device.

According to various embodiments, the change in the interconnect state of the plurality of displays may be achieved when the at least one display changes in a different direction than the other display in a state where the plurality of displays are facing the same direction, Or a case where one display is directed in a different direction from the other display and the plurality of displays are all turned to the same direction.

According to various embodiments, Wherein the middleware is configured such that, in execution, the processor is operable, in a state in which the plurality of displays face in the same direction, at least one display corresponds to a change in a direction different from the remaining display, Does not transmit the display data to the display driver of the display whose direction has changed, and the content data to be displayed on the display whose direction has not changed can be transmitted to the display driver of each display whose direction has not changed.

According to various embodiments, the change in which at least one display changes in a direction different from the remaining display in a state in which the plurality of displays face the same direction occurs when a change occurs when the at least one display moves by more than a predetermined value It can be judged.

According to various embodiments, the middleware may be configured such that, at the time of execution, the processor changes the size of the content data to be displayed on the display whose orientation has not changed among the contents simultaneously displayed on the plurality of displays, It can be transmitted to each display driver.

According to various embodiments of the present disclosure, there is provided a method of controlling a display of an electronic device, the method comprising: identifying content data to be displayed on each of a plurality of displays in a middleware stored in the electronic device; And transmitting the content data to the display driver of each of the plurality of displays, wherein the display driver may transmit the content data to the at least one display to display the content.

According to various embodiments, the operation of dividing the content data to be displayed on each of the plurality of displays may include a case where the application is executed, a case where the content playback state of the application is changed, .

According to various embodiments, in the case where the content reproduction state change of the application displays different contents on the plurality of displays, when one content is separately displayed, different contents and one content are displayed separately Or at least one of the cases.

According to various embodiments, the middleware may divide content data to be displayed on each of the plurality of displays at the time of execution, the content data obtained by grouping image layers constituting content to be displayed by each of the plurality of displays, To the respective display driver of the display.

According to various embodiments, the connection state change of the plurality of displays may be changed when the at least one display changes in a direction different from the remaining display in a state where the plurality of displays face the same direction, or when at least one display is different And a state in which all of the displays are oriented in the same direction in a state of being oriented.

According to various embodiments, when the middleware is in execution, when the at least one display changes in a direction different from the remaining display in a state where the plurality of displays face in the same direction, the middleware does not transmit the content data to be displayed on the changed display And transmitting the content data to be displayed on the display whose orientation is not changed to the display driver.

According to various embodiments, the method may further include changing the size of the content data to be displayed on the display whose orientation is not changed among the contents simultaneously displayed on the plurality of displays, and transmitting the changed content data to the display driver of the display whose orientation has not changed .

According to various embodiments of the present disclosure, there is provided a non-transitory medium having stored thereon middleware for executing a method of controlling display of an electronic device, the middleware being operative to cause a processor of the electronic device to display And causing the display driver to transmit the divided content data to the display driver of each of the plurality of displays, wherein the display driver transmits the content data to the at least one display to display the content A non-temporary recording medium.

As described above, according to various embodiments of the present invention, it is possible to prevent generation of unnecessary data and waste of electric power when the image is divided and displayed in the electronic device 100 having a plurality of displays.

The display control method according to the various embodiments described above may be implemented as a program and provided to a display system.

For example, the graphic manager distinguishes image data to be displayed on a plurality of displays and sends them to at least one display driver, and the display driver displays the transmitted image data on a plurality of displays, A non-transitory computer readable medium may be provided.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

Claims (23)

In an electronic device,
A processor for executing an application;
A first display and a second display;
A first display driver for controlling the first display and a second display driver for controlling the second display; And
A memory for storing a data management module, wherein the data management module, when executed by the processor or another processor,
Receive content from the application or through the application to be displayed in association with the execution of the application,
Divides the content into a first content and a second content, and
And to transmit the first content to the first display driver and the second content to the second display driver. The method according to claim 1,
Wherein the first display driver uses the first display to display
And wherein the second display driver is configured to display the second content using the second display. The method according to claim 1,
The data management module includes:
And to perform at a different software layer than the application and the first and second display drivers. The method according to claim 1 or 3,
The data management module includes:
Middleware or framework. The method according to claim 1,
Wherein the content is set to be created using the application using attributes determined based on contextual information associated with the electronic device or the content. 6. The method of claim 5,
The above-
An activation state of the first display and the second display, an interconnect state, an execution state of the application, or a combination thereof. In an electronic device,
A plurality of displays;
A processor electrically coupled to the plurality of displays; And
And a memory electrically coupled to the processor,
The memory, when executed,
Wherein the processor stores middleware for dividing content data to be displayed on each of the plurality of displays and transmitting the divided content data to a display driver of each of the plurality of displays. 8. The method of claim 7,
The middleware, when executed,
Wherein the processor is configured to distinguish content data to be displayed on the plurality of displays based on at least one of an execution of an application, a change in a content playback state of a running application, and a change in an interconnect state of the plurality of displays. 9. The method of claim 8,
The content playback state change of the application may include:
Wherein at least one of the plurality of displays displays at least one of different contents when the one content is displayed separately from the other contents. 10. The method of claim 9,
Wherein the middleware identifies content data to be displayed on each of the plurality of displays by the processor, the content data obtained by grouping content layers constituting content to be displayed by each of the plurality of displays, To the display driver of the electronic device. 10. The method of claim 9,
Wherein at least one of the contents to be displayed on each of the plurality of displays is content received from the outside of the electronic apparatus and at least one of the contents is generated from the electronic apparatus. 9. The method of claim 8,
Wherein the change of the interconnect state of the plurality of displays comprises:
In a state where the plurality of displays are oriented in the same direction, at least one display changes in a direction different from the remaining display, or when at least one display of the plurality of displays faces a direction different from the remaining display, All of which are in the same direction. 13. The method of claim 12,
Wherein the middleware, when executed,
Wherein at least one display in a state in which the plurality of displays face the same direction corresponds to a change in a direction different from the remaining display,
The content data to be displayed on the display whose orientation has not changed is not transmitted to the display driver of the display whose orientation has changed and the content data to be displayed on the display whose orientation has not changed is transmitted to each display driver of the display whose orientation has not changed Electronic device. 14. The method of claim 13,
Wherein the at least one display changes in a direction different from the remaining display in a state where the plurality of displays face in the same direction determines that a change occurs when the at least one display moves by more than a predetermined value. 14. The method of claim 13,
Wherein the middleware changes the size of content data to be displayed on the display of which the direction is not changed among the contents simultaneously displayed on the plurality of displays by the processor, and transmits the changed content data to the respective display drivers . A method of controlling a display of an electronic device,
Dividing content data to be displayed in each of the plurality of displays in the middleware stored in the electronic device;
Sending the content data from the middleware stored in the electronic device to the display driver of each of the plurality of displays; / RTI >
The display driver sending the content data to the at least one display to display the content. 17. The method of claim 16,
Wherein the operation of dividing the content data to be displayed on each of the plurality of displays comprises:
When the application is executed, when the content playback state of the application is changed, the connection state of the plurality of displays is changed. 18. The method of claim 17,
The content playback state change of the application may include:
Wherein when displaying the different contents on the plurality of displays, separating and displaying one piece of content, separating the different pieces of content and one piece of content and displaying the separated contents simultaneously. 19. The method of claim 18,
The middleware, when executed,
Transmitting content data obtained by grouping image layers constituting content to be displayed by each of the plurality of displays to a display driver of each of the plurality of displays, the content data to be displayed on each of the plurality of displays; ≪ / RTI > 18. The method of claim 17,
The connection state change of the plurality of displays may be changed,
In a state in which the plurality of displays are oriented in the same direction, at least one display changes in a direction different from the remaining display, or in a state in which at least one display faces a different direction from the remaining display, Wherein the at least one of the at least two of the at least two of the at least two of the at least two of the plurality 21. The method of claim 20,
The middleware, when executed,
When the at least one display changes in a direction different from the remaining display in a state in which the plurality of displays face the same direction, the content data to be displayed on the display whose orientation has not changed is not transmitted, To the display driver; ≪ / RTI > 22. The method of claim 21,
Transmitting content data to be displayed on a display whose orientation is unchanged among the plurality of displays simultaneously displayed on the display to the display driver of the display whose size has not been changed by changing the size; ≪ / RTI > A non-transitory recording medium storing middleware for executing a display control method of an electronic device,
Wherein the middleware, when executed, causes the processor of the electronic device to,
Causing content data to be displayed on each of the plurality of displays to be distinguished;
Causing the divided content data to be transmitted to a display driver of each of the plurality of displays; / RTI >
Wherein the display driver transmits the content data to the at least one display to display the content.

Images