TW202044012A - Method and device for processing display information - Google Patents

Abstract

The present disclosure disclosed a display information processing device and method suitable for a host system, the method comprises: determining whether specification of interfaces of a plurality of extended display devices connected to extension interfaces conforms to the default specification of interfaces of the host system; calling drivers corresponding to a plurality of extended display devices from the host system to drive the plurality of extended display devices with the specification of interfaces conforming to the default specification of interfaces of the host system; obtaining resolution information from the plurality of extended display devices, respectively; determining a common resolution from the resolution information of the plurality of extended display devices; and outputting display information of a main display device to the plurality of extended display devices based on the common resolution. The present disclosure solves the issue of installing drivers, and may also automatically adjust the optimal resolution for display according to the resolution of the connected display devices.

Description

Display message processing device and display message processing method

This application relates to the technical field of display devices, and in particular to a display device that supports the same resolution to display content on multiple display devices.

Traditional onboard display devices or display devices with Universal Serial Bus (USB) interface (hereinafter referred to as USB display devices) have the following disadvantages. First, for self-developed display devices, typical traditional solution providers need to install self-developed drivers on these self-developed display devices to implement related functions. This will increase the insecurity of the system. In addition, if the user is under the guest account, the user will be restricted by operating system permissions. Usually, installing device drivers will require an administrator account and password for installation, or it may be impossible to successfully install the driver due to permission restrictions. If the user's motherboard has enabled the Secure Boot mode, the system will have stricter restrictions on driver installation.

In an application scenario where multiple display devices are used to display the same content, in the existing display device solutions, it is necessary to manually set the copy mode to expand the display content. This will increase the complexity of the operation in some application scenarios.

Whether it is an existing onboard display device or a USB display device, when copying the windows desktop, if the externally copied display does not support the current desktop resolution, the operating system will automatically switch the windows desktop resolution and then set the main desktop The resolution supported at the same time as the copied monitor. This usually causes black borders on both sides of the main desktop resolution after switching, causing problems such as inability to display in full screen.

The embodiment of the present application provides a display message processing method and a display message processing device, so as to solve the problems of the need to install a driver and unsupported resolution when expanding the display.

In order to solve the above problems, this application is implemented through the technical solutions of the following embodiments.

The display message processing method disclosed in the embodiment of the present application is suitable for a host system and includes: determining whether the interface specifications of a plurality of expansion display devices connected to the expansion interface meet the interface specifications preset by the host system; Call the driver corresponding to the plurality of expansion display devices to drive the plurality of expansion display devices whose interface specifications meet the system default; obtain the resolution information from the plurality of expansion display devices respectively; from the plurality of expansion display devices The resolution information determines the common resolution; based on the common resolution, the display information of the main display device is output to the plurality of extended display devices for display.

The display message processing device disclosed in the embodiment of the present application is suitable for a host system and includes: a processor; a main interface, which is in communication with the processor and selectively connected to the main display device; and a plurality of expansion interfaces, respectively The processor is in communication connection; the memory is in communication connection with the processor, wherein the memory stores instructions that can be executed by the processor; when the multiple interface specifications are connected to multiple expansion display devices, the instructions are The processor executes so that the processor can: determine whether the interface specifications of the plurality of expansion display devices connected to the expansion interface meet the default interface specifications of the host system; call the driver corresponding to the plurality of expansion display devices from the host system The program conforms to the plurality of expansion display devices preset by the system by driving interface specifications; obtains the resolution information from the plurality of expansion display devices respectively; determines the common resolution from the resolution information of the plurality of expansion display devices; Based on the resolution, the display information of the main display device is output to the plurality of extended display devices for display.

The technical solution of this application has at least the following technical effects. According to the display message processing method and the display message processing device disclosed in the present application, the technical problem that the driver needs to be installed in the prior art is solved, and the driver-free use of the expanded display device is basically realized, with the technical effects of plug and play and easy operation. Because there is no need to install drivers, there is no need to copy and install any files to the host system's disk directory and modify the system registry options, so the security of the system can be improved. On the other hand, the display message processing method and the display message processing device disclosed in the present application can automatically adjust the optimal resolution for display according to the resolution of the connected display device, thus solving the problem that the resolution is not supported by the prior art.

Other advantages of this application will be explained in more detail in conjunction with the following description and drawings.

The embodiments of the present application will be described below in conjunction with related drawings. In these figures, the same reference numerals represent the same or similar components or method flows.

It must be understood that the words "include", "include" and other words used in this manual are used to indicate the existence of specific technical features, values, method steps, operations, components and/or components, but they do not exclude Add more technical features, values, method steps, job processing, components, components, or any combination of the above.

If the instructions use words such as "first", "second", "third", etc., they are used to modify the components in the request, not to indicate that there is a priority order, an advance relationship, or a component comes first. For another component, or the chronological order of execution of method steps, it is only used to distinguish components with the same name.

It must be understood that when a component is described as being “connected” or “coupled” to another component, it can be directly connected or coupled to other components, and intermediate components may appear. Conversely, when a component is described as being “directly connected” or “directly coupled” to another component, there are no intermediate components. Other terms used to describe the relationship between components can also be interpreted in a similar way, such as "between" versus "directly between", or "adjacent" versus "directly adjacent" and so on.

This application is based on a display device such as a universal serial bus, which can simultaneously realize one-to-many copy of the system desktop without installing any additional user-mode or kernel-mode drivers, which fully improves the security of the system and the ease of use for users Sex.

First, a flowchart of a display message processing method according to an embodiment of the present application will be described. 1, the display message processing method is applied to a display message processing device, and the display message processing device can be a display card or similar device installed in a host system. The hardware composition of the host system or the display information processing device will be described in subsequent embodiments.

The display information processing device is equipped with a main interface and a plurality of expansion interfaces, the main interface is connected with a main display device, and the plurality of expansion interfaces are connected with a plurality of expansion display devices. It is specifically stated here that when it is mentioned that "multiple expansion interfaces are connected with multiple expansion display devices", it may mean that each expansion interface is connected with an expansion display device, or there may be only a few expansion interfaces connected with an expansion display device , It is also possible that there is only one expansion interface connected to an expansion display device.

First, when the host system is connected to the main display device, it will first determine whether the interface specification of the main display device connected to the main interface meets the interface specification preset by the host system (step 100); then, call the corresponding The driver of the main display device conforms to the main display device preset by the system with a drive interface specification (step 110).

When a plurality of expansion interfaces are connected to a plurality of expansion display devices, determine whether the interface specifications of the plurality of expansion display devices connected to the expansion interface meet the default interface specifications of the host system (step 120); then call the corresponding from the host system The driver of the extended display devices conforms to the extended display devices preset by the system by driving interface specifications (step 130).

After the driver is installed, the resolution information is obtained from the extended display devices (step 140), and the common resolution is determined from the resolution information of the extended display devices (step 150). In one embodiment, the common resolution is determined by the intersection of the resolution information of the extended display devices.

Finally, based on the common resolution, the display information of the main display device is output to the extended display devices for display (step 160).

Referring to FIG. 2, it is a flowchart of a display message processing method according to another embodiment of the present application. In step 150, when the common resolution cannot be determined from the resolution information of the extended display devices, the original resolution is obtained from the extended display devices respectively (step 170), and the original resolution is obtained from the extended display devices. The original resolution determines the best resolution (step 180); based on the best resolution, the display information of the main display device is output to the extended display devices for display (step 190). In one embodiment, the optimal resolution is the lowest resolution among the original resolutions of the extended display devices.

According to the display message processing method disclosed in this application, it reports to the operating system of the host system that the connected display device is a compatible device, so winusb.sys can be automatically loaded as a function driver, so the hardware manufacturer does not need to be a display device INF file is provided, which makes the installation process of user driver easier. INF is the English abbreviation of Device INFormation File. It is a file format released by Microsoft for hardware device manufacturers to release its drivers. The INF file contains hardware device information or scripts to control hardware operations. The INF file specifies how the hardware driver should be installed into the system, where the source file is, which folder to install into, how to add information about itself to the registry, and so on.

In addition, the display message processing method disclosed in this application fully considers various use scenarios for copying the same screen. It only needs to execute the display message processing method disclosed in this application to realize the copying of multi-display devices without the need for traditional solutions. Each monitor is copied separately in the display setting panel.

Referring to FIG. 3, it is a schematic diagram of the system architecture of a display message processing apparatus according to an embodiment of the present application, and is described in conjunction with the flow in FIG. Figure 3 shows the application scenario of the expanded display device. The general system architecture includes a host system 210, a display message processing device 220, and multiple display devices, including a main display device 291, extended display devices 292, 293, and 294. The extended display devices 292, 293, and 294 in the figure can simultaneously display the content displayed by the main display device 291. The number of expansion display devices 292, 293, and 294 in the figure is only an exemplary description, and is not used to limit the number that can be expanded in this application. In the application scenario of the prior art, the expansion display device 292, 293, and 294 drivers need to be installed in the host system 210. The technical solution proposed by the present application does not need to install a driver. As long as the expansion display devices 292, 293, and 294 are connected to the display message processing device 220 of the host system 210, the content displayed on the main display device 291 can be automatically and synchronously displayed.

The host system 210 in FIG. 3 may be a personal computer, a laptop computer (Laptop PC), a tablet computer, and so on. If the system architecture design permits, the host system 210 of the present application may also be electronic products such as mobile phones, digital cameras, and digital cameras. The main technical solution of the present application lies in the display message processing device 220, so unnecessary components are omitted in the host system 210.

The display information processing device 220 includes a processor 261 and a storage 262 communicatively connected with the processor, wherein the storage 262 stores instructions that can be executed by the processor 261. Physically, the processor 261 and the storage 262, as well as the main interface and a plurality of expansion interfaces can be connected by a bus or other means.

Specifically, the storage 262 configured in the display information processing device 220 is used to store firmware or software for implementing the technical solutions of the present application. The storage 262, as a non-transitory computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs and modules, such as the program corresponding to the display message processing method in the embodiment of the present application Instructions or modules. The processor 261 executes the data processing of the displayed message by running the non-volatile software program, instruction or module stored in the storage 262, that is, realizes the display message processing method of the above method embodiment. The storage 262 includes non-volatile storage, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device, and may also include a high-speed random access storage.

In addition, the display message processing device 220 is also configured with a main interface 221 and a plurality of expansion interfaces 222, 223, and 224. The number of interfaces in the figure is only an exemplary description, and is not used to limit the number of interfaces that can be configured by the display message processing device 220. The interface may be an interface that complies with the Universal Serial Bus (Universal Serial Bus, USB) specification. Although not shown in the figure, the main display device 291 or the expansion display devices 292, 293, and 294 are also configured with interfaces that conform to the specifications of the main interface 221 and a plurality of expansion interfaces 222, 223, and 224, such as a universal serial bus (Universal Serial Bus, USB) specification interface.

The display message processing device 220 is used to process the messages to be displayed by the host system 210 and output the processed messages to the main display device 291 or the extended display devices 292, 293, and 294 for display.

When the main display device 291 is connected to the main interface 221 of the display message processing device 220, the firmware in the message processing device 220 will first determine whether the main display device 291 meets the system default display interface specifications, and if it is the default display interface According to specifications, the display information processing device 220 will report to the host system 210 and notify the host system 210 that the host display device 291 is a compatible display device. The host system 210 stores a driver program corresponding to the display interface of the main display device 291. After the display message processing device 220 determines that the main display device 291 is a compatible display device, the operating system in the host system 210 will designate the corresponding driver as the driver of the main display device 291. After applying the technical solution of the present application, after connecting the main display device 291, there is no need to install additional drivers. Taking the Windows operating system as an example, and taking the USB specification as an example, when the message processing device 220 determines that the main display device 291 is a USB compatible device, the operating system in the host system 210 will assign the winusb.sys program as the main display device 291 Driver. Therefore, through the technical solution proposed in this application, after the main display device 291 is connected to the host system 210, it can operate directly without installing additional drivers.

Furthermore, the expansion display devices 292, 293, and 294 can be connected to the display information processing device 220 through expansion interfaces 222, 223, and 224, respectively. After connection, the display information processing device 220 will first determine whether the expansion display devices 292, 293, 294 meet the system's default display interface specifications. If it is the default display interface specification, the display information processing device 220 will report to the host system and notify The host system expands the display devices 292, 293, and 294 to be compatible display devices and assigns corresponding drivers. Similarly, taking the Windows operating system as an example, and the USB specification as an example, when the message processing device 220 determines that the expansion display devices 292, 293, and 294 are USB compatible devices, the operating system in the host system will assign the winusb.sys program As a driver for the extended display devices 292, 293, and 294. Therefore, with the technical solution proposed in this application, after the expansion display devices 292, 293, and 294 are connected to the host system 210, they can operate directly without installing additional drivers.

The resolutions of the extended display devices 292, 293, and 294 may be different. Therefore, the display information processing device 220 of the present application can further adjust the resolution of the extended display devices 292, 293, and 294 to solve the problem of adjusting the resolution of the extended display device in the prior art. The problem caused. After the driver configuration is completed, the display information processing device 220 will then adjust the resolution of the extended display devices 292, 293, and 294. Explained with the extended display devices 292, 293, and 294, the extended display devices 292, 293, and 294 need to be copied and displayed with the main desktop of the main display device 291, and the display message processing device 220 will obtain from the extended display devices 292, 293, and 294 respectively Resolution information, this resolution information will be stored in the extended display devices 292, 293, and 294 in the form of a mode list. The resolution information records the resolutions that each extended display device 292, 293, 294 can support. After obtaining the resolution information, the display information processing device 220 obtains a resolution suitable for the extended display devices 292, 293, and 294 from the resolutions of the extended display devices 292, 293, and 294. More specifically, the display information processing device 220 intersects the obtained resolution information to obtain a common resolution. This common resolution can be supported by any extended display device 292, 293, or 294. After obtaining the common resolution, the display information processing device 220 uses the common resolution as a reference to copy the display information of the main display device 291 to the extended display devices 292, 293, and 294 for display.

If the applicable resolution of the extended display devices 292, 293, and 294 cannot be obtained, that is, the common resolution cannot be obtained, the display information processing device 220 then obtains the original resolution (Native Resolution) of the extended display devices 292, 293, and 294. Then set the best original resolution for each extended display device 292, 293, 294. Specifically, the display message processing device 220 can obtain the original resolution from the extended display identification data (EDID, hereinafter referred to as EDID message) of the extended display devices 292, 293, and 294. Furthermore, the display information processing device 220 uses the smallest resolution of the extended display devices 292, 293, and 294 as a reference to zoom and display the desktop image.

For example, when the display information processing device 220 cannot obtain the common resolution, the display information processing device 220 will obtain the original resolution of the extended display devices 292, 293, and 294. For example, the original resolution of the extended display device 292 is 1080p (1920×1080), the original resolution of the extended display device 293 is 2k (2048x1080), and the original resolution of the extended display device 294 is 1280x1024, then the display information processing device 220 will Regarding the lowest original resolution as the best resolution, adjust the resolutions of the extended display devices 292, 293, and 294 to 1280x1024, and based on the 1280x1024 resolution, copy the display information of the main display device 291 to the extended display Devices 292, 293, and 294 are used for display.

The display message processing device disclosed in the present application reports to the operating system of the host system that the connected display device is a compatible device, so it can automatically load winusb.sys as a function driver, so the hardware manufacturer does not need to The display device provides an INF file, which makes the installation process of the user driver easier. In addition, the display information processing device disclosed in this application fully considers various use scenarios for copying the same screen. It only needs to use the display information processing device disclosed in this application to realize the replication of multi-display devices without the need for traditional solutions. Each monitor is copied separately in the display setting panel.

According to the display message processing method and the display message processing device disclosed in the present application, the technical problem that the driver needs to be installed in the prior art is solved, and the driver-free use of the extended display device is basically realized, which has the advantages of plug and play and easy operation. Because there is no need to install drivers, there is no need to copy and install any files to the host system's disk directory and modify the system registry options, so the security of the system can be improved.

On the other hand, the display message processing method and the display message processing device disclosed in the present application can automatically adjust the optimal resolution for display according to the resolution of the connected display device, thus solving the problem that the resolution is not supported by the prior art.

All or part of the steps in the method of the present application can be implemented by a computer program, such as a computer operating system, a specific hardware driver in the computer, or a software program. In addition, it can also be implemented in other types of programs as shown above. Those with ordinary knowledge in the technical field can write the methods of the embodiments of the present application into computer programs, which will not be described for the sake of brevity. The calculator program implemented according to the method of the embodiment of the present application can be stored in a suitable computer readable data carrier, such as DVD, CD-ROM, USB, hard disk, and can also be placed through a network (such as the Internet, or Other appropriate carrier) access to the web server.

Although the above-described components are included in the drawings, it is not ruled out that, without violating the spirit of the invention, more other additional components are used to achieve better technical effects. In addition, although the flowcharts are executed in the specified order, those skilled in the art can modify the order of these steps under the premise of achieving the same effect without violating the spirit of the invention. Therefore, this application does not It is limited to using only the sequence described above. In addition, those skilled in the art can also integrate several steps into one step, or perform more steps sequentially or in parallel in addition to these steps, and this application is not limited thereby.

Although this application uses the above embodiments for description, it should be noted that these descriptions are not intended to limit the application. On the contrary, this application covers modifications and similar arrangements obvious to those skilled in the art. Therefore, the scope of the request must be interpreted in the broadest way to include all obvious modifications and similar settings.

100~190: steps 210: host system 220: display message processing device 221: Main Interface 222: Expansion Interface 223: Expansion Interface 224: Expansion interface 261: processor 262: Storage 291: Main display device 292: Expansion display device 293: Expansion display device 294: Expansion display device

The drawings described here are used to provide a further understanding of the application and constitute a part of the application. The exemplary embodiments and descriptions of the application are used to explain the application and do not constitute an improper limitation of the application. In the schema: FIG. 1 is a flowchart of a display message processing method according to an embodiment of the present application; 2 is a flowchart of a display message processing method according to another embodiment of the present application; FIG. 3 is a schematic diagram of the system architecture of a display message processing device according to an embodiment of the present application.

100~160: steps

Claims (10)

A display message processing method suitable for a host system includes: Determine whether the interface specifications of the plurality of expansion display devices connected to the expansion interface meet the default interface specifications of the host system; Invoke the driver programs corresponding to the extended display devices from the host system to drive the extended display devices whose interface specifications meet the system default; Obtain resolution information from these extended display devices respectively; The resolution information from the extended display devices determines the common resolution; and Based on the common resolution, the display information of the main display device is output to the extended display devices for display. The display message processing method as described in claim 1, further includes: Determine whether the interface specification of the main display device connected to the main interface meets the interface specification preset by the host system; The driver program corresponding to the main display device is called from the host system to drive the main display device whose interface specification conforms to the system default. The display message processing method according to claim 1, wherein the common resolution is determined by the intersection of the resolution messages of the extended display devices. The display message processing method according to claim 3, wherein when the common resolution resolution cannot be determined from the resolution information of the plurality of extended display devices, the method further includes: Obtain the original resolution from the expanded display devices; Determine the best resolution from the original resolution of the extended display devices; and Based on the optimal resolution, the display information of the main display device is output to the extended display devices for display. The display message processing method according to claim 4, wherein the optimal resolution is the lowest resolution among the original resolutions of the extended display devices. A display message processing device suitable for a host system, including: A processor A main interface, communicatively connected with the processor, and selectively connected with a main display device; A plurality of expansion interfaces are respectively connected to the processor for communication; A memory connected to the processor in communication, wherein the memory stores instructions that can be executed by the processor; When a plurality of expansion display devices are connected to the expansion interfaces, the instruction is executed by the processor, so that the processor can: Determine whether the interface specifications of the expansion display devices connected to the expansion interface meet the default interface specifications of the host system; Invoke the driver programs corresponding to the extended display devices from the host system to drive the extended display devices whose interface specifications meet the system default; Obtain resolution information from these extended display devices respectively; The resolution information from the extended display devices determines the common resolution; Based on the common resolution, the display information of the main display device is output to the extended display devices for display. The display message processing device according to claim 6, wherein when the main display device is connected to the main interface, the instruction is executed by the processor, so that the processor can: Determine whether the interface specification of the main display device connected to the main interface meets the interface specification preset by the host system; The driver program corresponding to the main display device is called from the host system to drive the main display device whose interface specification conforms to the system default. The display message processing device according to claim 6, wherein the common resolution is determined by the intersection of the resolution messages of the extended display devices. For example, the display message processing device of claim 6, wherein when the processor cannot determine the common resolution from the resolution information of the extended display devices, the processor further: Obtain the original resolution from the expanded display devices; Determine the best resolution from the original resolution of the extended display devices; Based on the optimal resolution, the display information of the main display device is output to the extended display devices for display. The display message processing device according to claim 9, wherein the optimal resolution is the lowest resolution among the original resolutions of the extended display devices.

Images