US20160350063A1 - Methods for displaying image data in a computer system supporting multiple displays - Google Patents
Methods for displaying image data in a computer system supporting multiple displays Download PDFInfo
- Publication number
- US20160350063A1 US20160350063A1 US15/168,483 US201615168483A US2016350063A1 US 20160350063 A1 US20160350063 A1 US 20160350063A1 US 201615168483 A US201615168483 A US 201615168483A US 2016350063 A1 US2016350063 A1 US 2016350063A1
- Authority
- US
- United States
- Prior art keywords
- display device
- image data
- resolution
- display
- mode
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
- G09G2330/02—Details of power systems and of start or stop of display operation
- G09G2330/021—Power management, e.g. power saving
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2350/00—Solving problems of bandwidth in display systems
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2360/00—Aspects of the architecture of display systems
- G09G2360/08—Power processing, i.e. workload management for processors involved in display operations, such as CPUs or GPUs
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/04—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
- G09G2370/042—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller for monitor identification
Definitions
- the disclosure relates to image processing techniques, and more precisely, to methods and systems for displaying image data in a computer system supporting multiple displays.
- image data to be displayed on the two display devices can be rendered in an extension mode and a mirror mode.
- the extension mode the image data to be displayed are rendered separately for the two display devices.
- the mirror mode the image data to be displayed are rendered for one of the display devices and then scaled to be displayed by the other display device with the same rendering content.
- a computer system may only allow rendering the image data with the extension mode if the two display devices have different rendering content (i.e., different image data to be displayed on the two display devices) or rendering the image data with the mirror mode if the two display devices have the same rendering content.
- the rendering mode for rendering the image data may be fixed and may not be automatically and dynamically changed.
- a method for displaying image data on a first display device of a first electronic device and a second display device of a second electronic device external of the first electronic device includes the steps of: determining whether image data to he displayed on the first and second display devices are the same; when the image data to be displayed on the first and second display devices are the same, estimating a first resource consumption required when the extension mode is selected for displaying the image data and a second resource consumption required when the mirror mode is selected for displaying the image data; and determining to display the image data on the first and second display devices in the extension mode or the mirror mode according to the first and second estimated resource consumption.
- a method for displaying image data in a computer system includes a first display device, a second display device and a rendering module coupled to the first and second display devices.
- the method performed by the rendering module includes the steps of: determining whether image data to be displayed on first and second display devices are the same; and when the image data to be displayed on the first and second display devices are the same, displaying the image data on the first and second display devices in the mirror mode in which the image data are rendered for a selected one of the first and second display devices and are scaled to obtain scaled image data to be mirrored to the other of the first and second display devices, wherein the selected display device is dynamically determined according to one or more display characteristics of the first and second display devices acquired from the first and second display devices.
- an electronic device has a first display device and selectively operates in an extension mode or a mirror mode with an external electronic device having a second display device.
- the electronic device includes a decoder and a determination module.
- the decoder is configured to provide image data to be displayed on the first and second display devices.
- the determination module is configured to determine whether the image data to be displayed on the first and second display devices are the same.
- the determination module is configured to estimate the first resource consumption required when an extension mode is selected for displaying the image data and the second resource consumption required when the mirror mode is selected for displaying the image data and determine to display the image data on the first and second display devices in the extension mode or the mirror mode according to the first and second estimated resource consumption.
- FIG. 1 is a block diagram illustrating the functional units of a display system according to an implementation of the disclosure
- FIG. 2 is a flow chart of a method for displaying image data on a first display device of a first electronic device and a second display device of a second electronic device external of the first electronic device in accordance with another implementation of the disclosure;
- FIG. 3 is a flow chart of a method for determining whether to display the image data on the first and second display devices in the extension mode or the mirror mode according to the first and second estimated resource consumption in accordance with another implementation of the disclosure;
- FIG. 4 is a flow chart of a method for determining which one of the first mode or the second mode will serve as the mirror mode according to the one or more acquired display characteristics of the first and second display device in accordance with another implementation of the disclosure.
- FIG. 5 is a flow chart of a method for displaying image data on a first display device of a first electronic device and a second display device of a second electronic device external of the first electronic device in accordance with another implementation of the disclosure.
- FIG. 1 is a diagram of an electronic device in accordance with an implementation of the disclosure.
- the electronic device 100 can be a mobile device (e.g., a tablet computer, a smartphone, or a wearable computing device) or a laptop computer capable of acquiring images.
- the electronic device 100 can be implemented as multiple chips or a single chip, such as a system on chip (SOC).
- the electronic device 100 comprises a processor 110 , a system bus 120 , a graphics processing unit (GPU) 130 , a memory unit 140 , a display 150 , a decoder 160 , a determination module 170 , a rendering module 180 and a scaling module 190 .
- GPU graphics processing unit
- the processor 110 can be coupled to each other through the system bus 120 .
- the processor 110 may be a central processing unit (CPU) general-purpose processor, a digital signal processor (DSP), or any equivalent circuitry, but the disclosure is not limited thereto.
- the memory unit 140 may include a volatile memory 141 and a non-volatile memory 142 .
- the volatile memory 141 may be a dynamic random access memory (DRAM) or a static random access memory (SRAM), and the non-volatile memory 142 may be a flash memory, a hard disk, a solid-state disk (SSD), etc.
- DRAM dynamic random access memory
- SRAM static random access memory
- SSD solid-state disk
- the program codes of the applications for use on the electronic device 100 can be pre-stored in the non-volatile memory 142 .
- the processor 110 may load program codes of applications from the non-volatile memory 142 to the volatile memory 141 , and execute the program code of the applications.
- the processor 110 may also transmit the graphics data to the GPU 130 , and the GPU 130 may determine the graphics data or image data to be rendered on the display 150 (the details will be described later).
- the volatile memory 141 and the non-volatile memory 142 are illustrated as one memory unit, they can be implemented separately as different memory units. In addition, different numbers of volatile memory 141 and/or non-volatile memory 142 can be also utilized in different implementations.
- the display 150 can be a display circuit or hardware that can be coupled for controlling a display device 152 .
- the display device 152 may include a driving circuit and a display panel and can be disposed internal to or external of the electronic device 100 .
- the decoder 160 , the determination module 170 , the rendering module 180 and the scaling module 190 are each a stand-alone circuit that is external of the display 150 .
- the electronic device 100 can selectively operate in an extension mode or a mirror mode with an external electronic device 200 having a display device 250 .
- the electronic device 100 can be a mobile phone and the external electronic device 200 can be any electronic device supporting image mirroring and/or extension such as a TV, a projector and so on.
- the electronic device 100 and the external electronic device 200 can both be mobile phones, and the disclosure is not limited thereto.
- the extension mode the image data to be displayed are rendered separately for the electronic device 100 and the electronic device 200 .
- the image data to be displayed can be rendered for one of the electronic device 100 and the electronic device 200 and then scaled to be displayed by the other with the same rendering content.
- the image data to be displayed can be rendered for the electronic device 100 and then scaled to be displayed by the electronic device 200 or it can be rendered for the electronic device 200 and then scaled to be displayed by the electronic device 100 .
- the decoder 160 can be configured to provide image data to be displayed on a first display device (e.g., the display device 152 ) and a second display device (e.g., the display device 250 of the electronic device 200 ).
- the determination module 170 can be configured to determine whether the image data to be displayed on the first and second display devices are the same.
- the image data to be displayed on the first display device provided by the decoder 160 can be an image A and the image data to be displayed on the first and second display devices are determined as the same when the image data to be displayed on the second display device provided by the decoder 160 is also the image A.
- the determination module 170 is configured to estimate a first resource consumption required when the extension mode is selected for displaying the image data and a second resource consumption required when the mirror mode is selected for displaying the image data and determine to display the image data on the first and second display devices in the extension mode or the mirror mode according to the first and second estimated resource consumption.
- the rendering module 180 is coupled to the decoder 160 and has circuitry for generating first image data to be displayed on the first display device and/or second image data to be displayed on the second display device according to the image data provided by the decoder 160 .
- the scaling module 190 is coupled to the rendering module 180 and has circuitry for scaling one of the first image data and the second image data to generate scaled image data to be mirrored on the other of the first and second display devices.
- the scaling module 190 may perform an up-scaling operation to scale the image data to generate a larger image or ii may perform a down-scaling operation to scale the image data to generate a smaller image.
- the scaling module 190 can be used in the mirror mode.
- the rendering module 180 can render the image data provided by the decoder 160 to generate a first image data with a resolution of 1920 ⁇ 1080 pixels to be displayed on the first display device and then the scaling module 190 can perform an up-scaling operation to scale the first image data to generate scaled image data with a resolution of 3840 ⁇ 2160 pixels to be mirrored on the second device.
- the rendering module 180 can generate a first image data with a resolution of 3840 ⁇ 2160 pixels to be displayed on the second display device and then the scaling module 190 can perform a down-scaling operation to scale the first image data to generate scaled image data with a resolution of 1920 ⁇ 1080 pixels to be mirrored on the first device.
- the rendering module 180 can further include a first rendering module 182 and a second rendering module 184 .
- the first rendering module 182 can be coupled to the decoder 160 and can have circuitry for generating first image data to be displayed on the first display device according to the image data provided by the decoder 160 .
- the second rendering module 184 can be coupled to the decoder 160 and have circuitry for generating second image data to be displayed on the second display device according to the image data provided by the decoder 160 .
- FIG. 2 is a flow chart of a method for displaying image data on a first display device of a first electronic device and a second display device of a second electronic device external of the first electronic device, in accordance with another implementation of the disclosure.
- the electronic device 100 serving as the first electronic device and the electronic device 200 serving as the second electronic device of FIG. I is utilized here for explanation of the flow chart, which however, is not limited to be applied to the electronic device 100 only. More details about each step can be referred to implementations in connection to FIGS. I and 2 but not limited thereto. Moreover, the steps can be performed in different sequences and/or can be combined or separated in different implementations.
- step S 202 a determination is made whether image data to be displayed on the first and second display devices are the same.
- the step S 202 may be performed by determination module 170 in FIG. 1 .
- the image data to be displayed on the first display device provided by the decoder 160 can be an image A and the image data to be displayed on the first and second display devices are determined as the same when the image data to be displayed on the second display device provided by the decoder 160 is also the image A.
- step S 204 the first resource consumption required when the extension mode is selected for displaying the image data is estimated and the second resource consumption required when the mirror mode is selected for displaying the image data is estimated.
- the step S 204 may be performed by determination module 170 in FIG. 1 , for example.
- each of the first estimated resource consumption and the second estimated resource consumption may comprise estimated bandwidth usage, memory usage, power usage, or a combination thereof.
- step S 206 a determination is made to display the image data on the first and second display devices in the extension mode or the mirror mode according to the first and second estimated resource consumption.
- the step S 206 may be performed by determination module 170 in FIG. 1 , for example.
- FIG. 3 is a flow chart of a method for determining whether to display the image data on the first and second display devices in the extension mode or the mirror mode according to the first and second estimated resource consumption in another implementation of the disclosure. The method may be performed by determination module 170 in FIG. 1 , for example.
- step S 302 a determination is made to determine whether the first estimated resource consumption is lower than the second estimated resource consumption.
- the first estimated resource consumption is lower than the second estimated resource consumption (Yes in step S 302 ), which indicates that displaying the image data with the extension mode consumes less resource than that with the mirror mode
- the first estimated resource consumption is higher than the second estimated resource consumption (No in step S 302 ), which indicates that displaying the image data with the extension mode consumes less resource than that with the mirror mode
- it is determined in step S 306 to display the image data on the first and second display devices in the mirror mode.
- step S 208 a determination is made in step S 208 to display the image data on the first and second display devices in the extension mode in which the image data are separately rendered for the first and second display devices.
- the step S 208 may be performed by determination module 170 in FIG. 1 , for example.
- the determination module 170 may determine a best mode, selected from one of multiple modes, to be the mirror mode. To be more specific, under the mirror mode, the determination module 170 may further determine generate image data for which display device(s) to display, and mirror the images by up/down scaling the generated image data for another/other display devices according to each display's display characteristics.
- the step of estimating the second resource consumption required may further comprise the steps of: determining one of a first mode and a second mode to be the mirror mode, wherein in the first mode the image data is rendered for the first display device and scaled to be mirrored to the second display device and in the second mode the image data is rendered for the second display device and scaled to be mirrored to the first display device; and estimating a third resource consumption required for the first mode or estimating a fourth resource consumption required for the second mode to be the second resource consumption according to the determination result.
- one or more display characteristics of the first and second display devices can further be acquired and the step of determining which one of the first mode or the second mode is to be the mirror mode may further comprise determining which one of the first mode or the second mode is to be the mirror mode according to the one or more acquired display characteristics of the first and second display devices.
- the one or more acquired display characteristics of the first and second display devices comprise one or more of the following predetermined factors of the first and second display devices: resolution, aspect ratio, color profile, frame rate, refresh rate and resource consumption.
- the one or more acquired display characteristics can be the resolution of the first display device and that of the second display device
- the step of determining which one of the first mode or the second mode is to be the mirror mode according to the one or more acquired display characteristics of the first and second display devices may be performed by determining the first mode to be the mirror mode and rendering the image data for the first display device and down-scaling the rendered image data for the second display device when the resolution of the first display device is higher than the resolution of the second display device; and determining the second mode to be the mirror mode and rendering the image data for the second display device and down-scaling the rendered image data for the first display device when the resolution of the first display device is lower than the resolution of the second display device.
- the step of determining which one of the first mode or the second mode is to serve as the mirror mode according to the one or more acquired display characteristics of the first and second display devices may be performed by obtaining the resolution difference between the resolution of the first display device and that of the second display device; determining the first mode to be the mirror mode and rendering the image data for the first display device and down-scaling the rendered image data for the second display device when the resolution of the first display device is higher than the resolution of the second display device by the resolution difference that is greater than a predetermined threshold value; and determining the second mode to be the mirror mode and rendering the image data for the second display device and down-scaling the rendered image data for the first display device when the resolution of the first display-device is lower than the resolution of the second display device by the resolution difference that is greater than the predetermined threshold value,
- the step of determining which one of the first mode or the second mode will serve as the mirror mode according to the one or more acquired display characteristics of the first and second display devices may be performed by obtaining resolution difference between the resolution of the first display device and that of the second display device, determining the first mode to be the mirror mode and rendering the image data for the first display device and down-scaling the rendered image data for the second display device when the resolution of the first display device is higher than the resolution of the second display device by a first resolution difference that is greater than a first predetermined threshold value and the resolution of the second display device is lower than an original resolution of the image data by a second resolution difference that is not lower than a second predetermined threshold value, determining the second mode to be the mirror mode and rendering the image data for the second display device and up-scaling the rendered image data for the second display device when the resolution of the first display device is greater than the resolution of the second display device by the first resolution difference that is greater than the first predetermined threshold value and the resolution of the second display device is lower than the original resolution
- image data to be displayed can be still generated for the display with a higher resolution and a down-scaling for the generated image data is performed or it can be generated for the display with a lower resolution and an up-scaling for the generated image data is performed.
- the image data to be displayed can be generated for the first display device or the second display device regardless which one is higher or lower.
- FIG. 4 is a flow chart of a method for determining which one of the first mode and the second mode will serve as the mirror mode according to the one or more acquired display characteristics of the first and second display device in accordance with another implementation of the disclosure.
- the method may be performed by determination module 170 in FIG. 1 , for example.
- the first display-device and the second display device have the same display content and the resolution of first display device is RA, the resolution of second display device is RB and the resolution of display content is RC.
- TH1>0 and TH2>0 are thresholds.
- the resolution difference between the first display device and the second display device is defined as (RA-RE) or (RB-RA).
- step S 402 it is determined if the resolution difference between the first display device and the second display device is detected to be higher than a predetermined threshold (i.e., (RA-RB)>TH1) (step S 402 ). If the answer of step S 402 is yes, it is further determined whether the resolution of the second display device is lower than an original resolution of the image data by a second resolution difference that is lower than a second predetermined threshold value (i.e., (RC-RB) ⁇ TH2) (step S 404 ). If the answer of step S 404 is yes, i.e. (RC-RB) ⁇ TH2, a determination is made as to serve the second mode as the mirror mode (step S 406 ).
- a predetermined threshold i.e., (RA-RB)>TH1
- step S 402 determines if the resolution difference between the first display device and the second display device is detected to be higher than the predetermined threshold (i.e., (RB-RA)>TH1) (step S 410 ). If the answer of step S 410 is yes, it is further determined whether the resolution of the first display device is lower than an original resolution of the image data by a second resolution difference that is lower than a second predetermined threshold value (i.e., (RC-RA) ⁇ TH2) (step S 412 ). If the answer of step S 412 is yes, i.e.
- step S 408 a determination is made as to serve the first mode as the mirror mode.
- the determination module 170 keeps comparing other display characteristics between the first and second display devices (e.g., (i.e. aspect ratio, color profile, frame rate, refresh rate and resource consumption)) to find a best way of mirror mode.
- the step of determining which of the first mode or the second mode will be the mirror mode may be performed by obtaining the resolution difference between the resolution of each of the first and second display devices.
- the obtained resolution difference is lower than the predetermined threshold value, a determination is made as to which of the first mode or the second mode will serve as the mirror mode. The determination is made by referring to the predetermined factors of the first and second display device.
- the determination module 170 may re-determine to render the image data for the first display device or the second display device when detecting a change in the one or more acquired display characteristics of the first and second display devices. To be more specific, if one of the first and second display devices changes its display characteristics, the determination can be changed correspondingly, and without a personal setting/preference. For example, the determination module 170 may first determine to generate an image for a display A (e.g., the display device 152 ) and then down-scale the image data for a display B (e.g., the display device 250 ) as the resolution of the display A is higher than the resolution of the display B.
- a display A e.g., the display device 152
- a display B e.g., the display device 250
- the determination module 170 can determine to generate an image for the display B and then down-scale the image data for the display A, without a personal setting in advance, to achieve the best display quality for both displays A and B.
- a method for displaying image data in a computer system comprises a first display device (e.g., the display device 152 ), a second display device (e.g., the display device 250 ) and a determination module (e.g., the determination module 170 ) coupled to the first and second display devices.
- a first display device e.g., the display device 152
- a second display device e.g., the display device 250
- a determination module e.g., the determination module 170
- FIG. 5 is a flow chart of a method for displaying image data on a first display device of a first electronic device and a second display device of a second electronic device external of the first electronic device in accordance with another implementation of the disclosure.
- the electronic device 100 serving as the first electronic device and the electronic device 200 serving as the second electronic device of FIG. 1 are utilized here for explanation of the flow chart, which, however, is not limited to be applied to the electronic device 100 only.
- the implementations connected to FIGS. 1 and 5 can be referred to for more details about each step, but the disclosure is not limited thereto. Moreover, the steps can be performed in different sequences and/or can be combined or separated in different implementations.
- step S 502 a determination is made whether image data to be displayed on first and second display devices are the same.
- the image data are to be displayed on the first and second display devices in the mirror mode, in which the image data are rendered for a selected one of the first and second display devices and are scaled to obtain scaled image data to be mirrored to the other of the first and second display devices (step S 504 ).
- the image data can be rendered for the first display device and the image data can then be scaled to obtain scaled image data to be mirrored on the second display device.
- the selected display device can be dynamically determined according to one or more display characteristics of the first and second display devices acquired from the first and second display devices.
- the one or more acquired display characteristics comprise one or more of the following predetermined factors of the first and second display devices: resolution, aspect ratio, color profile, frame rate, refresh rate, and power consumption.
- the acquired display characteristics can be the resolution of the first display device and the resolution of the second display device, and it is further determined to render the image data for the first display device and down-scale the rendered image data for the second display device when the resolution of the first display device is higher than the resolution of the second display device. Conversely, a determination is made to render the image data for the second display device and down-scale the rendered image data for the first display device when the resolution of the first display device is lower than the resolution of the second display device.
- the determination module 170 may obtain the resolution difference between the resolution of the first display device and that of the second display device, determine whether the obtained resolution difference is lower than a predetermined threshold value, and in response to the obtained resolution difference being lower than the predetermined threshold value, determine to render the image data for the first display device and down-scale the rendered image data for the second display device, or determine to render the image data for the second display device and up-scale the rendered image data for the first display device.
- the determination module 170 may further determine the image data to be displayed in the extension mode when the first estimated resource consumption is lower than the second estimated resource consumption, and determine the image data to be displayed in the mirror mode when the first estimated resource consumption is higher than the second estimated resource consumption.
- an electronic device and an associated method for displaying image data on a first display device of the electronic device and a second display device of another electronic device external of the electronic device are provided.
- the determination module of the present disclosure can determine whether image data to be displayed on the first and second display devices are the same. When the image data to be displayed on the first and second display devices are the same, the determination module can estimate resource consumption required when displaying the image data with each of the extension mode and the mirror mode and then determine to display the image data on the first and second display devices in the extension mode or the mirror mode according to the estimated resource consumption.
- the determination for displaying in the extension mode or the mirror mode can be made dynamically and automatically without requiring any personal setting or preference and different display conditions and design requirements can be met, thus achieving better display effects for the display devices and providing more flexible and quick adjustment for rendering the image data to be displayed on multiple display s.
- the implementations of methods that have been described, or certain aspects or portions thereof, may be practiced in logic circuits, or may take the form of program code (i.e., instructions) embodied in tangible media, such as floppy diskettes, CD-ROMS, hard drives, or any other machine-readable storage medium, wherein when the program code is loaded into and executed by a machine, such as a smartphone, a mobile phone, or a similar device, the machine becomes an apparatus for practicing the disclosure.
- the disclosed methods may also be embodied in the form of program code transmitted over some transmission medium, such as electrical wiring or cabling, through fiber optics, or via any other form of transmission, wherein when the program code is received and loaded into and executed by a machine, the machine becomes an apparatus for practicing the disclosure.
- the program code When implemented on a general-purpose processor, the program code combines with the processor to provide a unique apparatus that operates analogously to specific logic circuits.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
Description
- This application claims the benefit of U.S. Provisional Application No. 62/169,014, filed on Jun. 1, 2015, the entirety of which is incorporated by reference herein.
- Field of the Disclosure
- The disclosure relates to image processing techniques, and more precisely, to methods and systems for displaying image data in a computer system supporting multiple displays.
- Description of the Related Art
- Currently, more and more computer systems become capable of supporting multiple displays. For any computer system with at least two display devices, image data to be displayed on the two display devices can be rendered in an extension mode and a mirror mode. In the extension mode, the image data to be displayed are rendered separately for the two display devices. In the mirror mode, the image data to be displayed are rendered for one of the display devices and then scaled to be displayed by the other display device with the same rendering content. Conventionally, a computer system may only allow rendering the image data with the extension mode if the two display devices have different rendering content (i.e., different image data to be displayed on the two display devices) or rendering the image data with the mirror mode if the two display devices have the same rendering content. However, once the determination is made, the rendering mode for rendering the image data may be fixed and may not be automatically and dynamically changed.
- Accordingly, there is demand for methods and systems for displaying image data in a computer system supporting multiple displays to solve the aforementioned problem.
- A detailed description is given in the following implementations with reference to the accompanying drawings.
- In an exemplary implementation, a method for displaying image data on a first display device of a first electronic device and a second display device of a second electronic device external of the first electronic device is provided. The method includes the steps of: determining whether image data to he displayed on the first and second display devices are the same; when the image data to be displayed on the first and second display devices are the same, estimating a first resource consumption required when the extension mode is selected for displaying the image data and a second resource consumption required when the mirror mode is selected for displaying the image data; and determining to display the image data on the first and second display devices in the extension mode or the mirror mode according to the first and second estimated resource consumption.
- In another exemplary implementation, a method for displaying image data in a computer system is provided. The computer system includes a first display device, a second display device and a rendering module coupled to the first and second display devices. The method performed by the rendering module includes the steps of: determining whether image data to be displayed on first and second display devices are the same; and when the image data to be displayed on the first and second display devices are the same, displaying the image data on the first and second display devices in the mirror mode in which the image data are rendered for a selected one of the first and second display devices and are scaled to obtain scaled image data to be mirrored to the other of the first and second display devices, wherein the selected display device is dynamically determined according to one or more display characteristics of the first and second display devices acquired from the first and second display devices.
- In yet another exemplary implementation, an electronic device is provided. The electronic device has a first display device and selectively operates in an extension mode or a mirror mode with an external electronic device having a second display device. The electronic device includes a decoder and a determination module. The decoder is configured to provide image data to be displayed on the first and second display devices. The determination module is configured to determine whether the image data to be displayed on the first and second display devices are the same. When the image data to be displayed on the first and second display devices are the same, the determination module is configured to estimate the first resource consumption required when an extension mode is selected for displaying the image data and the second resource consumption required when the mirror mode is selected for displaying the image data and determine to display the image data on the first and second display devices in the extension mode or the mirror mode according to the first and second estimated resource consumption.
- Other aspects and features of the present disclosure will become apparent to those with ordinary skill in the art upon review of the following descriptions of specific implementations of and the display systems and devices for carrying out the method.
- The disclosure can be more fully understood by reading the subsequent detailed description and examples with reference to the accompanying drawings, wherein:
-
FIG. 1 is a block diagram illustrating the functional units of a display system according to an implementation of the disclosure; -
FIG. 2 is a flow chart of a method for displaying image data on a first display device of a first electronic device and a second display device of a second electronic device external of the first electronic device in accordance with another implementation of the disclosure; -
FIG. 3 is a flow chart of a method for determining whether to display the image data on the first and second display devices in the extension mode or the mirror mode according to the first and second estimated resource consumption in accordance with another implementation of the disclosure; -
FIG. 4 is a flow chart of a method for determining which one of the first mode or the second mode will serve as the mirror mode according to the one or more acquired display characteristics of the first and second display device in accordance with another implementation of the disclosure; and -
FIG. 5 is a flow chart of a method for displaying image data on a first display device of a first electronic device and a second display device of a second electronic device external of the first electronic device in accordance with another implementation of the disclosure. - This description is made for the purpose of illustrating the general principles of the disclosure and should not be taken in a limiting sense. It should be understood that the implementations may be realized in software, hardware, firmware, or any combination thereof.
-
FIG. 1 is a diagram of an electronic device in accordance with an implementation of the disclosure. Theelectronic device 100 can be a mobile device (e.g., a tablet computer, a smartphone, or a wearable computing device) or a laptop computer capable of acquiring images. Theelectronic device 100 can be implemented as multiple chips or a single chip, such as a system on chip (SOC). For example, theelectronic device 100 comprises aprocessor 110, asystem bus 120, a graphics processing unit (GPU) 130, amemory unit 140, adisplay 150, a decoder 160, a determination module 170, arendering module 180 and ascaling module 190. Theprocessor 110, theGPU 130, the decoder 160, the determination module 170, therendering module 180, thescaling module 190 and thememory unit 140 can be coupled to each other through thesystem bus 120. Theprocessor 110 may be a central processing unit (CPU) general-purpose processor, a digital signal processor (DSP), or any equivalent circuitry, but the disclosure is not limited thereto. Thememory unit 140, for example, may include avolatile memory 141 and anon-volatile memory 142. Thevolatile memory 141 may be a dynamic random access memory (DRAM) or a static random access memory (SRAM), and thenon-volatile memory 142 may be a flash memory, a hard disk, a solid-state disk (SSD), etc. For example, the program codes of the applications for use on theelectronic device 100 can be pre-stored in thenon-volatile memory 142. Theprocessor 110 may load program codes of applications from thenon-volatile memory 142 to thevolatile memory 141, and execute the program code of the applications. Theprocessor 110 may also transmit the graphics data to theGPU 130, and theGPU 130 may determine the graphics data or image data to be rendered on the display 150 (the details will be described later). It should be noted that, although thevolatile memory 141 and thenon-volatile memory 142 are illustrated as one memory unit, they can be implemented separately as different memory units. In addition, different numbers ofvolatile memory 141 and/ornon-volatile memory 142 can be also utilized in different implementations. Thedisplay 150 can be a display circuit or hardware that can be coupled for controlling adisplay device 152. Thedisplay device 152 may include a driving circuit and a display panel and can be disposed internal to or external of theelectronic device 100. To be more specific, in an implementation, the decoder 160, the determination module 170, therendering module 180 and thescaling module 190 are each a stand-alone circuit that is external of thedisplay 150. - The
electronic device 100 can selectively operate in an extension mode or a mirror mode with an externalelectronic device 200 having adisplay device 250. For example, in one implementation, theelectronic device 100 can be a mobile phone and the externalelectronic device 200 can be any electronic device supporting image mirroring and/or extension such as a TV, a projector and so on. In another implementation, theelectronic device 100 and the externalelectronic device 200 can both be mobile phones, and the disclosure is not limited thereto. In the extension mode, the image data to be displayed are rendered separately for theelectronic device 100 and theelectronic device 200. In the mirror mode, the image data to be displayed can be rendered for one of theelectronic device 100 and theelectronic device 200 and then scaled to be displayed by the other with the same rendering content. For example, in the mirror mode, the image data to be displayed can be rendered for theelectronic device 100 and then scaled to be displayed by theelectronic device 200 or it can be rendered for theelectronic device 200 and then scaled to be displayed by theelectronic device 100. - The decoder 160 can be configured to provide image data to be displayed on a first display device (e.g., the display device 152) and a second display device (e.g., the
display device 250 of the electronic device 200). The determination module 170 can be configured to determine whether the image data to be displayed on the first and second display devices are the same. For example, the image data to be displayed on the first display device provided by the decoder 160 can be an image A and the image data to be displayed on the first and second display devices are determined as the same when the image data to be displayed on the second display device provided by the decoder 160 is also the image A. When the image data to be displayed on the first and second display devices are the same, the determination module 170 is configured to estimate a first resource consumption required when the extension mode is selected for displaying the image data and a second resource consumption required when the mirror mode is selected for displaying the image data and determine to display the image data on the first and second display devices in the extension mode or the mirror mode according to the first and second estimated resource consumption. - The
rendering module 180 is coupled to the decoder 160 and has circuitry for generating first image data to be displayed on the first display device and/or second image data to be displayed on the second display device according to the image data provided by the decoder 160. Thescaling module 190 is coupled to therendering module 180 and has circuitry for scaling one of the first image data and the second image data to generate scaled image data to be mirrored on the other of the first and second display devices. To be more specific, thescaling module 190 may perform an up-scaling operation to scale the image data to generate a larger image or ii may perform a down-scaling operation to scale the image data to generate a smaller image. Thescaling module 190 can be used in the mirror mode. For example, in one implementation, if the first display device (e.g., a screen of a mobile phone) is of a resolution of 1920×1080 pixels and the second display device (e.g., a screen of a TV) is of a resolution of 3840×2160 pixels, therendering module 180 can render the image data provided by the decoder 160 to generate a first image data with a resolution of 1920×1080 pixels to be displayed on the first display device and then thescaling module 190 can perform an up-scaling operation to scale the first image data to generate scaled image data with a resolution of 3840×2160 pixels to be mirrored on the second device. In another implementation, therendering module 180 can generate a first image data with a resolution of 3840×2160 pixels to be displayed on the second display device and then thescaling module 190 can perform a down-scaling operation to scale the first image data to generate scaled image data with a resolution of 1920×1080 pixels to be mirrored on the first device. - The
rendering module 180 can further include afirst rendering module 182 and asecond rendering module 184. Thefirst rendering module 182 can be coupled to the decoder 160 and can have circuitry for generating first image data to be displayed on the first display device according to the image data provided by the decoder 160. Thesecond rendering module 184 can be coupled to the decoder 160 and have circuitry for generating second image data to be displayed on the second display device according to the image data provided by the decoder 160. -
FIG. 2 is a flow chart of a method for displaying image data on a first display device of a first electronic device and a second display device of a second electronic device external of the first electronic device, in accordance with another implementation of the disclosure. Theelectronic device 100 serving as the first electronic device and theelectronic device 200 serving as the second electronic device of FIG. I is utilized here for explanation of the flow chart, which however, is not limited to be applied to theelectronic device 100 only. More details about each step can be referred to implementations in connection to FIGS. I and 2 but not limited thereto. Moreover, the steps can be performed in different sequences and/or can be combined or separated in different implementations. - In step S202, a determination is made whether image data to be displayed on the first and second display devices are the same. The step S202 may be performed by determination module 170 in
FIG. 1 . For example, the image data to be displayed on the first display device provided by the decoder 160 can be an image A and the image data to be displayed on the first and second display devices are determined as the same when the image data to be displayed on the second display device provided by the decoder 160 is also the image A. - When the image data to be displayed on the first and second display devices are the same (Yes in step S202), in step S204, the first resource consumption required when the extension mode is selected for displaying the image data is estimated and the second resource consumption required when the mirror mode is selected for displaying the image data is estimated. The step S204 may be performed by determination module 170 in
FIG. 1 , for example. In some implementations, each of the first estimated resource consumption and the second estimated resource consumption may comprise estimated bandwidth usage, memory usage, power usage, or a combination thereof. - After the first and second estimated resource consumption are generated, in step S206, a determination is made to display the image data on the first and second display devices in the extension mode or the mirror mode according to the first and second estimated resource consumption. The step S206 may be performed by determination module 170 in
FIG. 1 , for example. -
FIG. 3 is a flow chart of a method for determining whether to display the image data on the first and second display devices in the extension mode or the mirror mode according to the first and second estimated resource consumption in another implementation of the disclosure. The method may be performed by determination module 170 inFIG. 1 , for example. - In step S302, a determination is made to determine whether the first estimated resource consumption is lower than the second estimated resource consumption. When the first estimated resource consumption is lower than the second estimated resource consumption (Yes in step S302), which indicates that displaying the image data with the extension mode consumes less resource than that with the mirror mode, it is determined in step S304 to display the image data on the first and second display devices in the extension mode. When the first estimated resource consumption is higher than the second estimated resource consumption (No in step S302), which indicates that displaying the image data with the extension mode consumes less resource than that with the mirror mode, it is determined in step S306 to display the image data on the first and second display devices in the mirror mode.
- In contrast, when the image data to be displayed on the first and second display devices are not the same (No in step S202), a determination is made in step S208 to display the image data on the first and second display devices in the extension mode in which the image data are separately rendered for the first and second display devices. The step S208 may be performed by determination module 170 in
FIG. 1 , for example. - In some implementations, it is further obtained a system resource usage status required and dynamically switched between the extension mode and the mirror mode to display the image data on the first and second display devices according to the obtained system resource usage status required and the first and second estimated resource consumption by the determination module 170.
- In some implementations, the determination module 170 may determine a best mode, selected from one of multiple modes, to be the mirror mode. To be more specific, under the mirror mode, the determination module 170 may further determine generate image data for which display device(s) to display, and mirror the images by up/down scaling the generated image data for another/other display devices according to each display's display characteristics. For example, in one implementation, when determining to display the image data with the mirror mode, the step of estimating the second resource consumption required may further comprise the steps of: determining one of a first mode and a second mode to be the mirror mode, wherein in the first mode the image data is rendered for the first display device and scaled to be mirrored to the second display device and in the second mode the image data is rendered for the second display device and scaled to be mirrored to the first display device; and estimating a third resource consumption required for the first mode or estimating a fourth resource consumption required for the second mode to be the second resource consumption according to the determination result.
- In some implementations, one or more display characteristics of the first and second display devices can further be acquired and the step of determining which one of the first mode or the second mode is to be the mirror mode may further comprise determining which one of the first mode or the second mode is to be the mirror mode according to the one or more acquired display characteristics of the first and second display devices. For example, the one or more acquired display characteristics of the first and second display devices comprise one or more of the following predetermined factors of the first and second display devices: resolution, aspect ratio, color profile, frame rate, refresh rate and resource consumption.
- In an implementation, the one or more acquired display characteristics can be the resolution of the first display device and that of the second display device, and the step of determining which one of the first mode or the second mode is to be the mirror mode according to the one or more acquired display characteristics of the first and second display devices may be performed by determining the first mode to be the mirror mode and rendering the image data for the first display device and down-scaling the rendered image data for the second display device when the resolution of the first display device is higher than the resolution of the second display device; and determining the second mode to be the mirror mode and rendering the image data for the second display device and down-scaling the rendered image data for the first display device when the resolution of the first display device is lower than the resolution of the second display device.
- In another implementations, the step of determining which one of the first mode or the second mode is to serve as the mirror mode according to the one or more acquired display characteristics of the first and second display devices may be performed by obtaining the resolution difference between the resolution of the first display device and that of the second display device; determining the first mode to be the mirror mode and rendering the image data for the first display device and down-scaling the rendered image data for the second display device when the resolution of the first display device is higher than the resolution of the second display device by the resolution difference that is greater than a predetermined threshold value; and determining the second mode to be the mirror mode and rendering the image data for the second display device and down-scaling the rendered image data for the first display device when the resolution of the first display-device is lower than the resolution of the second display device by the resolution difference that is greater than the predetermined threshold value,
- In some implementations, the step of determining which one of the first mode or the second mode will serve as the mirror mode according to the one or more acquired display characteristics of the first and second display devices may be performed by obtaining resolution difference between the resolution of the first display device and that of the second display device, determining the first mode to be the mirror mode and rendering the image data for the first display device and down-scaling the rendered image data for the second display device when the resolution of the first display device is higher than the resolution of the second display device by a first resolution difference that is greater than a first predetermined threshold value and the resolution of the second display device is lower than an original resolution of the image data by a second resolution difference that is not lower than a second predetermined threshold value, determining the second mode to be the mirror mode and rendering the image data for the second display device and up-scaling the rendered image data for the second display device when the resolution of the first display device is greater than the resolution of the second display device by the first resolution difference that is greater than the first predetermined threshold value and the resolution of the second display device is lower than the original resolution of the image data by the second resolution difference that is lower than the second predetermined threshold value, determining the second mode to be the mirror mode and rendering the image data for the second display device and down-scaling the rendered image data for the first display device when the resolution of the second display device is higher than the resolution of the first display device by the first resolution difference that is greater than the first predetermined threshold value and the resolution of the first display device is lower than the original resolution of the image data by the second resolution difference that is not lower than the second predetermined threshold value; and determining the first mode to be the mirror mode and rendering the image data for the first display device and up-scaling the rendered image data for the second display device when the resolution of the second display device is higher than the resolution of the first display device by the first resolution difference that is greater than the first predetermined threshold value and the resolution of the first display device is lower than the original resolution of the image data by the second resolution difference that is lower than the second predetermined threshold value.
- To be more specific, if the resolution difference between the first display device and the second display device is detected to be lower than a predetermined threshold, image data to be displayed can be still generated for the display with a higher resolution and a down-scaling for the generated image data is performed or it can be generated for the display with a lower resolution and an up-scaling for the generated image data is performed. Alternatively, the image data to be displayed can be generated for the first display device or the second display device regardless which one is higher or lower.
-
FIG. 4 is a flow chart of a method for determining which one of the first mode and the second mode will serve as the mirror mode according to the one or more acquired display characteristics of the first and second display device in accordance with another implementation of the disclosure. The method may be performed by determination module 170 inFIG. 1 , for example. In this implementation, it is assumed that the first display-device and the second display device have the same display content and the resolution of first display device is RA, the resolution of second display device is RB and the resolution of display content is RC. Further, TH1>0 and TH2>0 are thresholds. The resolution difference between the first display device and the second display device is defined as (RA-RE) or (RB-RA). First, it is determined if the resolution difference between the first display device and the second display device is detected to be higher than a predetermined threshold (i.e., (RA-RB)>TH1) (step S402). If the answer of step S402 is yes, it is further determined whether the resolution of the second display device is lower than an original resolution of the image data by a second resolution difference that is lower than a second predetermined threshold value (i.e., (RC-RB)<TH2) (step S404). If the answer of step S404 is yes, i.e. (RC-RB)<TH2, a determination is made as to serve the second mode as the mirror mode (step S406). Thus, the determination module 170 determines that rendering the image data for the second display device is the best way of mirror mode. If the answer of step S404 is no, i.e. (RC-RB)>=TH2, a determination is made as to serve the first mode as the mirror mode (step S408). Thus, the determination module 170 determines that rendering the image data for the first display device is the best way of mirror mode. - Similarly, if the answer of step S402 is no, i.e., (RA-RB)<=TH1), it is determined if the resolution difference between the first display device and the second display device is detected to be higher than the predetermined threshold (i.e., (RB-RA)>TH1) (step S410). If the answer of step S410 is yes, it is further determined whether the resolution of the first display device is lower than an original resolution of the image data by a second resolution difference that is lower than a second predetermined threshold value (i.e., (RC-RA)<TH2) (step S412). If the answer of step S412 is yes, i.e. (RC-RA)<TH2, a determination is made as to serve the first mode as the mirror mode (step S408). Thus, the determination module 170 determines that rendering the image data for the first display-device is the best way of mirror mode. If the answer of step S412 is no, i.e. (RC-RA)>=TH2, a determination is made as to serve the second mode as the mirror mode (step S406). Thus, the determination module 170 determines that rendering the image data for the second display device is the best way of mirror mode.
- If the resolution difference between the first display device and the second display device is detected to be lower than a predetermined threshold (i.e., (RA-RB)<=TH1 and (RB-RA)<=TH1), the determination module 170 keeps comparing other display characteristics between the first and second display devices (e.g., (i.e. aspect ratio, color profile, frame rate, refresh rate and resource consumption)) to find a best way of mirror mode.
- In some implementations, in cases where the acquired display characteristics comprise the resolution of both the first and second display devices and the predetermined factors of the first and second display device (i.e. aspect ratio, color profile, frame rate, refresh rate and resource consumption), then the step of determining which of the first mode or the second mode will be the mirror mode (according to the one or more acquired display characteristics of the first and second display devices) may be performed by obtaining the resolution difference between the resolution of each of the first and second display devices. When the obtained resolution difference is lower than the predetermined threshold value, a determination is made as to which of the first mode or the second mode will serve as the mirror mode. The determination is made by referring to the predetermined factors of the first and second display device.
- In some implementations, the determination module 170 may re-determine to render the image data for the first display device or the second display device when detecting a change in the one or more acquired display characteristics of the first and second display devices. To be more specific, if one of the first and second display devices changes its display characteristics, the determination can be changed correspondingly, and without a personal setting/preference. For example, the determination module 170 may first determine to generate an image for a display A (e.g., the display device 152) and then down-scale the image data for a display B (e.g., the display device 250) as the resolution of the display A is higher than the resolution of the display B. Thereafter, if the display A decreases its resolution to be lower than the display B, or/and the display B increases its resolution to be higher than the display A, the changes can be detected by the determination module 170, and the determination can be changed in time. Accordingly, the determination module 170 can determine to generate an image for the display B and then down-scale the image data for the display A, without a personal setting in advance, to achieve the best display quality for both displays A and B.
- In another implementation, a method for displaying image data in a computer system is provided, wherein the computer system comprises a first display device (e.g., the display device 152), a second display device (e.g., the display device 250) and a determination module (e.g., the determination module 170) coupled to the first and second display devices.
-
FIG. 5 is a flow chart of a method for displaying image data on a first display device of a first electronic device and a second display device of a second electronic device external of the first electronic device in accordance with another implementation of the disclosure. Theelectronic device 100 serving as the first electronic device and theelectronic device 200 serving as the second electronic device ofFIG. 1 are utilized here for explanation of the flow chart, which, however, is not limited to be applied to theelectronic device 100 only. The implementations connected toFIGS. 1 and 5 can be referred to for more details about each step, but the disclosure is not limited thereto. Moreover, the steps can be performed in different sequences and/or can be combined or separated in different implementations. - In step S502, a determination is made whether image data to be displayed on first and second display devices are the same. When the image data to be displayed on the first and second display devices are the same, the image data are to be displayed on the first and second display devices in the mirror mode, in which the image data are rendered for a selected one of the first and second display devices and are scaled to obtain scaled image data to be mirrored to the other of the first and second display devices (step S504). For example, in one implementation, the image data can be rendered for the first display device and the image data can then be scaled to obtain scaled image data to be mirrored on the second display device.
- In step S506, the selected display device can be dynamically determined according to one or more display characteristics of the first and second display devices acquired from the first and second display devices. For example, in some implementations, the one or more acquired display characteristics comprise one or more of the following predetermined factors of the first and second display devices: resolution, aspect ratio, color profile, frame rate, refresh rate, and power consumption.
- In an implementation, the acquired display characteristics can be the resolution of the first display device and the resolution of the second display device, and it is further determined to render the image data for the first display device and down-scale the rendered image data for the second display device when the resolution of the first display device is higher than the resolution of the second display device. Conversely, a determination is made to render the image data for the second display device and down-scale the rendered image data for the first display device when the resolution of the first display device is lower than the resolution of the second display device.
- In some implementations, in cases where the acquired display characteristics comprise the resolution of the first display device and that of the second display device and the resolution of the first display device is higher than the resolution of the second display device, and the determination module 170 may obtain the resolution difference between the resolution of the first display device and that of the second display device, determine whether the obtained resolution difference is lower than a predetermined threshold value, and in response to the obtained resolution difference being lower than the predetermined threshold value, determine to render the image data for the first display device and down-scale the rendered image data for the second display device, or determine to render the image data for the second display device and up-scale the rendered image data for the first display device.
- In some implementations, the determination module 170 may further determine the image data to be displayed in the extension mode when the first estimated resource consumption is lower than the second estimated resource consumption, and determine the image data to be displayed in the mirror mode when the first estimated resource consumption is higher than the second estimated resource consumption.
- In view of the above implementations, an electronic device and an associated method for displaying image data on a first display device of the electronic device and a second display device of another electronic device external of the electronic device are provided. The determination module of the present disclosure can determine whether image data to be displayed on the first and second display devices are the same. When the image data to be displayed on the first and second display devices are the same, the determination module can estimate resource consumption required when displaying the image data with each of the extension mode and the mirror mode and then determine to display the image data on the first and second display devices in the extension mode or the mirror mode according to the estimated resource consumption. Accordingly, the determination for displaying in the extension mode or the mirror mode can be made dynamically and automatically without requiring any personal setting or preference and different display conditions and design requirements can be met, thus achieving better display effects for the display devices and providing more flexible and quick adjustment for rendering the image data to be displayed on multiple display s.
- The implementations of methods that have been described, or certain aspects or portions thereof, may be practiced in logic circuits, or may take the form of program code (i.e., instructions) embodied in tangible media, such as floppy diskettes, CD-ROMS, hard drives, or any other machine-readable storage medium, wherein when the program code is loaded into and executed by a machine, such as a smartphone, a mobile phone, or a similar device, the machine becomes an apparatus for practicing the disclosure. The disclosed methods may also be embodied in the form of program code transmitted over some transmission medium, such as electrical wiring or cabling, through fiber optics, or via any other form of transmission, wherein when the program code is received and loaded into and executed by a machine, the machine becomes an apparatus for practicing the disclosure. When implemented on a general-purpose processor, the program code combines with the processor to provide a unique apparatus that operates analogously to specific logic circuits.
- Use of ordinal terms such as “first” and “second” in the claims to modify a claim element does not by itself connote any priority, precedence, or order of one claim element over another or the temporal order in which acts of a method are performed, but are used merely as labels to distinguish one claim element having a certain name from another element having the same name (but for use of the ordinal term) to distinguish the claim elements.
- While the disclosure has been described by way of example and in terms of preferred implementation, it is to be understood that the disclosure is not limited thereto. On the contrary, it is intended to cover various modifications and similar arrangements (as would be apparent to the skilled in the art). Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/168,483 US10152295B2 (en) | 2015-06-01 | 2016-05-31 | Methods for displaying image data in a computer system supporting multiple displays |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201562169014P | 2015-06-01 | 2015-06-01 | |
US15/168,483 US10152295B2 (en) | 2015-06-01 | 2016-05-31 | Methods for displaying image data in a computer system supporting multiple displays |
Publications (2)
Publication Number | Publication Date |
---|---|
US20160350063A1 true US20160350063A1 (en) | 2016-12-01 |
US10152295B2 US10152295B2 (en) | 2018-12-11 |
Family
ID=57398567
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/168,483 Active 2037-06-14 US10152295B2 (en) | 2015-06-01 | 2016-05-31 | Methods for displaying image data in a computer system supporting multiple displays |
Country Status (1)
Country | Link |
---|---|
US (1) | US10152295B2 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170199715A1 (en) * | 2016-01-11 | 2017-07-13 | Lg Electronics Inc. | Image display apparatus |
CN111736790A (en) * | 2020-07-31 | 2020-10-02 | 开立生物医疗科技(武汉)有限公司 | Multi-screen display method, device and system and host equipment |
US11308263B2 (en) * | 2018-04-03 | 2022-04-19 | Palantir Technologies Inc. | Multi-stage data page rendering |
Citations (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070296643A1 (en) * | 2006-06-27 | 2007-12-27 | Microsoft Corporation | Display extension using terminal clients |
US7523226B2 (en) * | 2005-11-09 | 2009-04-21 | Microsoft Corporation | Controlling an auxiliary display user interface based on usage context |
US20100033403A1 (en) * | 2008-08-08 | 2010-02-11 | MEDL Technology Co., Ltd. | Portable monitor display |
US20120042252A1 (en) * | 2010-08-10 | 2012-02-16 | Microsoft Corporation | Cloning Or Extending A Computer Desktop On A Wireless Display Surface |
US20120176396A1 (en) * | 2011-01-11 | 2012-07-12 | Harper John S | Mirroring graphics content to an external display |
US8407347B2 (en) * | 2004-11-19 | 2013-03-26 | Xiao Qian Zhang | Method of operating multiple input and output devices through a single computer |
US20130086528A1 (en) * | 2011-09-29 | 2013-04-04 | Junghyun Lee | Display device and image displaying method thereof |
US20130155126A1 (en) * | 2010-08-31 | 2013-06-20 | Frederick L. Lathrop | Determination of display device power consumption |
US20130283193A1 (en) * | 2010-12-15 | 2013-10-24 | Timothy Griffin | Multiple user computing method and system for same |
US20130322416A1 (en) * | 2012-05-30 | 2013-12-05 | Samsung Electronics Co. Ltd. | Method and apparatus for providing concurrent service |
US20130328878A1 (en) * | 2012-06-08 | 2013-12-12 | Apple Inc. | System and method for display mirroring |
US20140028726A1 (en) * | 2012-07-30 | 2014-01-30 | Nvidia Corporation | Wireless data transfer based spanning, extending and/or cloning of display data across a plurality of computing devices |
US20140310611A1 (en) * | 2012-02-21 | 2014-10-16 | Blackberry Limited | System and method for displaying a user interface across multiple electronic devices |
US20150113181A1 (en) * | 2013-10-18 | 2015-04-23 | Dell Products, Lp | Seamless Switching of USB Devices Connected to a Monitor Hub |
US20150116362A1 (en) * | 2013-10-29 | 2015-04-30 | Dell Products, Lp | System and Method for Positioning an Application Window Based on Usage Context for Dual Screen Display Device |
US20160117268A1 (en) * | 2013-10-29 | 2016-04-28 | Timothy Griffin | Invention title method and system of connecting and switching grouped input and output devices between computers |
US20160313967A1 (en) * | 2015-04-22 | 2016-10-27 | Wistron Corporation | Method of Interacting Frames between Multiple Electronic Devices and Electronic System Thereof |
-
2016
- 2016-05-31 US US15/168,483 patent/US10152295B2/en active Active
Patent Citations (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8407347B2 (en) * | 2004-11-19 | 2013-03-26 | Xiao Qian Zhang | Method of operating multiple input and output devices through a single computer |
US7523226B2 (en) * | 2005-11-09 | 2009-04-21 | Microsoft Corporation | Controlling an auxiliary display user interface based on usage context |
US20070296643A1 (en) * | 2006-06-27 | 2007-12-27 | Microsoft Corporation | Display extension using terminal clients |
US20100033403A1 (en) * | 2008-08-08 | 2010-02-11 | MEDL Technology Co., Ltd. | Portable monitor display |
US20120042252A1 (en) * | 2010-08-10 | 2012-02-16 | Microsoft Corporation | Cloning Or Extending A Computer Desktop On A Wireless Display Surface |
US20130155126A1 (en) * | 2010-08-31 | 2013-06-20 | Frederick L. Lathrop | Determination of display device power consumption |
US20130283193A1 (en) * | 2010-12-15 | 2013-10-24 | Timothy Griffin | Multiple user computing method and system for same |
US20120176396A1 (en) * | 2011-01-11 | 2012-07-12 | Harper John S | Mirroring graphics content to an external display |
US20130086528A1 (en) * | 2011-09-29 | 2013-04-04 | Junghyun Lee | Display device and image displaying method thereof |
US20140310611A1 (en) * | 2012-02-21 | 2014-10-16 | Blackberry Limited | System and method for displaying a user interface across multiple electronic devices |
US20130322416A1 (en) * | 2012-05-30 | 2013-12-05 | Samsung Electronics Co. Ltd. | Method and apparatus for providing concurrent service |
US20130328878A1 (en) * | 2012-06-08 | 2013-12-12 | Apple Inc. | System and method for display mirroring |
US20140253416A1 (en) * | 2012-06-08 | 2014-09-11 | Apple Inc. | System and method for display mirroring |
US20140028726A1 (en) * | 2012-07-30 | 2014-01-30 | Nvidia Corporation | Wireless data transfer based spanning, extending and/or cloning of display data across a plurality of computing devices |
US20150113181A1 (en) * | 2013-10-18 | 2015-04-23 | Dell Products, Lp | Seamless Switching of USB Devices Connected to a Monitor Hub |
US20150116362A1 (en) * | 2013-10-29 | 2015-04-30 | Dell Products, Lp | System and Method for Positioning an Application Window Based on Usage Context for Dual Screen Display Device |
US20160117268A1 (en) * | 2013-10-29 | 2016-04-28 | Timothy Griffin | Invention title method and system of connecting and switching grouped input and output devices between computers |
US20160313967A1 (en) * | 2015-04-22 | 2016-10-27 | Wistron Corporation | Method of Interacting Frames between Multiple Electronic Devices and Electronic System Thereof |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170199715A1 (en) * | 2016-01-11 | 2017-07-13 | Lg Electronics Inc. | Image display apparatus |
US10606542B2 (en) * | 2016-01-11 | 2020-03-31 | Lg Electronics Inc. | Image display apparatus |
US11308263B2 (en) * | 2018-04-03 | 2022-04-19 | Palantir Technologies Inc. | Multi-stage data page rendering |
CN111736790A (en) * | 2020-07-31 | 2020-10-02 | 开立生物医疗科技(武汉)有限公司 | Multi-screen display method, device and system and host equipment |
Also Published As
Publication number | Publication date |
---|---|
US10152295B2 (en) | 2018-12-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8451279B2 (en) | System, method and computer program product for adjusting a refresh rate of a display | |
US9171350B2 (en) | Adaptive resolution DGPU rendering to provide constant framerate with free IGPU scale up | |
CN110377264B (en) | Layer synthesis method, device, electronic equipment and storage medium | |
US11568782B2 (en) | Method of driving a display panel that includes a first display region having a first resolution and a second display region being adjacent to the first display region and having a second resolution higher than the first resolution | |
US9383851B2 (en) | Method and apparatus for buffering sensor input in a low power system state | |
WO2019041863A1 (en) | Image processing system, image displaying method, display device, and storage medium | |
US8207977B1 (en) | System, method, and computer program product for changing a refresh rate based on an identified hardware aspect of a display system | |
US10152295B2 (en) | Methods for displaying image data in a computer system supporting multiple displays | |
TWI575495B (en) | Dithering for image data to be displayed | |
US8284210B1 (en) | Bandwidth-driven system, method, and computer program product for changing a refresh rate | |
CN106775521B (en) | Screen-off display method and device | |
US10078999B2 (en) | Dynamic bandwidth usage reduction for displays | |
US9805662B2 (en) | Content adaptive backlight power saving technology | |
US9241144B2 (en) | Panorama picture scrolling | |
WO2016145599A1 (en) | Image display method and device | |
KR20160033419A (en) | Image processing apparatus and method of controlling thereof | |
US9355604B2 (en) | Overdriving control method with image compression control and related circuit | |
US20190385565A1 (en) | Dynamic configuration of display features | |
US10489947B2 (en) | Mobile device, application display method, and non-transitory computer readable storage medium | |
CN111179883A (en) | Image display method and device, mobile terminal, computer equipment and storage medium | |
US11594194B2 (en) | Video timing for display systems with variable refresh rates | |
KR101664638B1 (en) | Alpha channel power savings in graphics unit | |
US12008285B2 (en) | Image processing method and display control method | |
CN111949325B (en) | Display method and device and electronic equipment | |
TWI597688B (en) | Layer processing method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MEDIATEK INC., TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHEN, CHUN-HUNG;KO, CHIEN-CHOU;CHEN, CHIUNG-FU;AND OTHERS;SIGNING DATES FROM 20160529 TO 20160531;REEL/FRAME:038830/0645 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: XUESHAN TECHNOLOGIES INC., CANADA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MEDIATEK INC.;REEL/FRAME:056593/0167 Effective date: 20201223 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |