CN114995778A - Remote display control system, remote control interface display method and computing equipment - Google Patents
Remote display control system, remote control interface display method and computing equipment Download PDFInfo
- Publication number
- CN114995778A CN114995778A CN202210775616.0A CN202210775616A CN114995778A CN 114995778 A CN114995778 A CN 114995778A CN 202210775616 A CN202210775616 A CN 202210775616A CN 114995778 A CN114995778 A CN 114995778A
- Authority
- CN
- China
- Prior art keywords
- display
- data
- main control
- controlled
- interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
- G06F3/1462—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay with means for detecting differences between the image stored in the host and the images displayed on the remote displays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4092—Image resolution transcoding, e.g. client/server architecture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/0001—Systems modifying transmission characteristics according to link quality, e.g. power backoff
- H04L1/0002—Systems modifying transmission characteristics according to link quality, e.g. power backoff by adapting the transmission rate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/08—Protocols specially adapted for terminal emulation, e.g. Telnet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
Abstract
The invention discloses a remote display control system, a remote control interface display method and a computing device, wherein the system comprises a master control end and a controlled end which are connected in a remote communication manner, wherein: the master control end comprises a master control display card and a master control display connected with the master control display card in a communication mode, and is suitable for acquiring display parameters of the master control display and sending the display parameters to the controlled end; the controlled end comprises a controlled display card and is suitable for creating a display card simulator, display parameters and to-be-processed display data related to a to-be-displayed interface of the controlled end are provided to the display card simulator, so that the display card simulator processes the to-be-processed display data based on the display parameters to generate target display data matched with the main control display, and the target display data are sent to the main control end, so that the main control end displays a control interface matched with the main control display on the main control display based on the target display data. According to the technical scheme of the invention, the control interface can be displayed in the optimal mode at the main control end, and the problem of system breakdown is avoided.
Description
This application is a divisional application of the invention patent application 2022103087393 filed on 28/3/2022.
Technical Field
The invention relates to the technical field of remote control, in particular to a remote display control system, a remote control interface display method and computing equipment.
Background
When the desktop is operated remotely, because the display resolutions of the controlled end and the main control end may be different, if the interface display information of the controlled end is directly displayed on the display of the main control end in a copy form, the problem of unmatched interface display often occurs.
According to conventional remote control software, when the display resolution of the controlled end is higher than that of the main control end, scroll bars are added on the right side and the lower side of the main control end, and a user can check all information on an interface by dragging the scroll bars. When the display resolution of the controlled end is lower than that of the main control end, the interface of the controlled end is displayed in the middle of the screen of the main control end according to conventional remote control software.
According to the existing remote control software, the display resolutions of the master control end and the controlled end must be manually modified to ensure that the display resolutions of the two terminals are uniform, so that the control interface with the best resolution matched with the display interface of the controlled end can be displayed on the screen of the master control end. For example, in order to avoid system crash caused by adjusting the resolution of the controlled end (the resolution adjusting process depends on the system for processing, which inevitably leads to system crash), remote control software such as TeamViewer, sunflower and the like do not allow the user to adjust the resolution at will, which causes the main control end to be unable to display the interface information of the controlled end with the optimal resolution, and moreover, manually adjusting the resolution increases service processing timeliness, which affects user experience. In addition, the screen resolutions of different manufacturers are different, which causes that the master control end and the controlled end cannot achieve the same display resolution, thereby affecting the accuracy of the master control end in positioning the target in the process of performing remote control.
To this end, a remote display control system is required to solve the problems in the prior art.
Disclosure of Invention
To this end, the present invention provides a remote display control system, a remote control interface display method and a computing device to solve or at least alleviate the above-existing problems.
According to an aspect of the present invention, there is provided a remote display control system, comprising a master control end and a slave end connected by remote communication, wherein: the master control end comprises a master control display card and a master control display which is in communication connection with the master control display card and is suitable for acquiring display parameters of the master control display and sending the display parameters to the controlled end; the controlled end comprises a controlled display card and is suitable for creating a display card simulator, display parameters and to-be-processed display data related to a to-be-displayed interface of the controlled end are provided to the display card simulator, so that the display card simulator processes the to-be-processed display data based on the display parameters to generate target display data matched with the main control display, and the target display data are sent to the main control end, so that the main control end displays a control interface matched with the main control display on the main control display based on the target display data.
Optionally, in the remote display control system according to the present invention, the main control terminal is further adapted to: and carrying out graphic calculation and rendering on the target display data through a main control display card to obtain final display data, and controlling the main control display to display the control interface based on the final display data.
Optionally, in the remote display control system according to the present invention, the system further comprises: and the controlled end is in communication connection with one or more main control ends through the data distribution server.
Optionally, in the remote display control system according to the present invention, the target display data includes one or more frames of data, and the controlled end is further adapted to perform the following steps to send the target display data to the master end: sending the current frame data to a data distribution server so as to forward the current frame data to one or more main control terminals through the data distribution server; and responding to the instruction of the data distribution server for sending the next frame data, and sending the next frame data to the data distribution server so as to forward the next frame data to one or more main control terminals through the data distribution server.
Alternatively, in the remote display control system according to the present invention, the data distribution server is adapted to: and after determining that at least one master control end receives the current frame data, sending the instruction for sending the next frame data to the controlled end.
Optionally, in the remote display control system according to the present invention, the graphics card simulator is further adapted to: and processing the display data to be processed based on the display parameters by utilizing an image processing algorithm.
Optionally, in the remote display control system according to the present invention, the slave includes a slave processor; the display card simulator is suitable for intercepting display data to be processed sent to the controlled display card by the controlled processor and display parameters of the main control display.
Optionally, in the remote display control system according to the present invention, the display parameters include: the display resolution and DPI of the display are controlled.
According to one aspect of the present invention, there is provided a remote control interface display method, executed at a controlled end, the controlled end being in remote communication connection with a main control end, the method comprising: receiving display parameters of a main control display sent by a main control end; creating a display card simulator, and providing the display parameters and to-be-processed display data related to a to-be-displayed interface of a controlled end to the display card simulator, so that the display card simulator processes the to-be-processed display data based on the display parameters to generate target display data matched with the main control display; and sending the target display data to the main control end so that the main control end displays a control interface matched with the main control display on the main control display based on the target display data.
According to one aspect of the present invention, there is provided a remote control interface display method, executed at a master control end, the master control end being in remote communication connection with a controlled end, the method comprising: sending display parameters of a main control display to a controlled end so that the controlled end can create a display card simulator, providing the display parameters and display data to be processed related to a to-be-displayed interface of the controlled end to the display card simulator, and processing the display data to be processed through the display card simulator based on the display parameters to generate target display data matched with the main control display; and receiving target display data sent by the controlled end, and displaying a control interface matched with the main control display on the main control display based on the target display data.
According to an aspect of the invention, there is provided a computing device comprising: at least one processor; a memory storing program instructions configured to be executed by the at least one processor, the program instructions including instructions for performing the remote control interface display method as described above.
According to an aspect of the present invention, there is provided a readable storage medium storing program instructions that, when read and executed by a computing device, cause the computing device to perform a remote control interface display method as described above.
According to the technical scheme of the invention, the remote display control system is characterized in that a main control end and a controlled end cooperate to display a control interface at the main control end, wherein the main control end provides display parameters of a main control display to the controlled end, a display card simulator created by the controlled end performs adaptive processing on to-be-processed display data corresponding to the to-be-displayed interface based on the display parameters, and sends processed target display data to the main control end, so that the main control end displays the control interface matched with the display parameters of the main control display on the main control display based on the target display data. Therefore, occupation of the memory space of the main control end is reduced, matching of the resolution ratio of the control interface displayed on the main control end and the main control display can be achieved, the main control end can display the control interface in the best mode, the display effect of the control interface is enhanced, and the problem of system breakdown is avoided.
Furthermore, the controlled end communicates with the main control end through the data distribution server, and based on the publish/subscribe mode of the data distribution server, the data transmission frequency between the controlled end and the main control end can be controlled by dynamically adjusting the transmission frame rate of the display data, so that the fluency of remote control operation on the controlled end at the main control end can be ensured, and the display effect of a control interface can be dynamically adjusted according to a network environment, thereby improving user experience.
The above description is only an overview of the technical solutions of the present invention, and the present invention can be implemented in accordance with the content of the description so as to make the technical means of the present invention more clearly understood, and the above and other objects, features, and advantages of the present invention will be more clearly understood.
Drawings
To the accomplishment of the foregoing and related ends, certain illustrative aspects are described herein in connection with the following description and the annexed drawings, which are indicative of various ways in which the principles disclosed herein may be practiced, and all aspects and equivalents thereof are intended to be within the scope of the claimed subject matter. The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description read in conjunction with the accompanying drawings. Throughout this disclosure, like reference numerals generally refer to like parts or elements.
FIG. 1 shows a schematic diagram of a remote display control system 100 according to one embodiment of the invention;
FIG. 2 shows a schematic diagram of a computing device 200, according to one embodiment of the invention;
FIG. 3 illustrates a flow diagram of a remote control interface display method 300 according to one embodiment of the invention;
FIG. 4 illustrates a flow diagram of a remote control interface display method 400 according to one embodiment of the invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
FIG. 1 shows a schematic diagram of a remote display control system 100 according to one embodiment of the invention.
As shown in fig. 1, the remote display control system 100 includes at least one master terminal 110 and at least one slave terminal 120, where the master terminal 110 and the slave terminal 120 may establish a remote communication connection, so that the master terminal 110 may send a remote control instruction to the slave terminal 120 to implement remote control of the slave terminal 120 at the master terminal 110.
It should be noted that, after the master end 110 establishes the remote communication connection with the controlled end 120, the master end 110 needs to acquire the display data of the controlled end 120 and display the display data on the master end 110. Specifically, a corresponding control interface needs to be displayed on the master control end 110 according to the display interface of the controlled end 120, so that a user can perform an interactive operation on the control interface displayed on the master control end 110 to send a corresponding remote control instruction to the controlled end 120, thereby implementing a remote control operation on the controlled end 120.
In the embodiment of the present invention, as shown in fig. 1, the main control end 110 includes a main control processor 113, a main control display card 115, and a main control display (not shown) communicatively connected to the main control display card. In one embodiment, the main control processor 113 and the main control display card 115 are integrated on the main board of the main control end 110, and communicate through a bus and a board connector. The main control graphics card 115 includes a main control graphics processor, a main control graphics card memory (frame buffer memory), and a main control video controller, which are coupled in sequence. The master video controller may be communicatively coupled to the master display via the monitor connection device.
The controlled end 120 includes a controlled processor 123, a controlled graphics card 125, and a controlled display (not shown) communicatively coupled to the controlled graphics card. In one embodiment, the controlled processor 123 and the controlled graphics card 125 are integrated on the motherboard of the controlled end 120 and communicate through a bus, motherboard connector. The slave graphics card 125 includes a slave graphics processor, a slave graphics card memory (frame buffer memory), and a slave video controller coupled in sequence. The controlled video controller may be communicatively coupled to the controlled display via a monitor connection device.
After the master end 110 establishes the remote communication connection with the controlled end 120, the master end 110 obtains the display parameters of the master display and sends the display parameters to the controlled end 120, so as to instruct the controlled end 120 to perform adaptive processing on the interface of the controlled end 120 according to the display parameters of the master display. Here, the display parameters of the master display include, for example, a display resolution and a DPI of the master display.
After receiving the display parameters of the main control display sent by the main control end 120, the controlled end 120 creates a display card simulator 124, so as to intercept the display data to be processed and the display parameters of the main control display sent by the controlled processor 123 to the controlled display card 125 through the display card simulator 124, and simulate the controlled display card to process the data. Here, the display data to be processed is related to the interface to be displayed of the controlled end 120, and is interactive data that the controlled processor 123 of the controlled end 120 should send to the controlled graphics card 125 (through a bus or a motherboard connector). According to the prior art, the controlled processor 123 may send the data to be displayed (through the bus and the motherboard connector) to the controlled graphic processor of the controlled graphic card 125, process the data to be displayed to be processed through the controlled graphic processor, where the data to be displayed to be processed includes, for example, a display processing instruction, interface data information, and the like, and display the interface to be displayed on the controlled display after processing the data to be displayed through the controlled graphic card of the controlled end 120.
In the embodiment according to the present invention, the controlled end 120 creates a graphics card simulator between the controlled processor 123 and the controlled graphics card 125, and provides the display data to be processed related to the interface to be displayed of the controlled end 120 and the display parameters of the main control display provided by the main control end to the graphics card simulator 124, so that the display data to be processed is processed based on the display parameters of the main control display through the graphics card simulator 124. Specifically, after the display card simulator 124 processes the display data to be processed based on the display parameters of the main control display, the target display data adapted to the main control display may be generated, and the target display data is sent to the main control terminal 110, so that the main control terminal 110 displays the control interface adapted to the display parameters of the main control display on the main control display based on the target display data.
In one implementation, the graphics card simulator 124 may utilize an image processing algorithm to process the display data to be processed based on the display parameters of the master display.
According to the technical scheme of the invention, the main control end and the controlled end cooperate to display the control interface at the main control end. The display card simulator of the controlled end performs adaptive processing on the to-be-processed display data corresponding to the to-be-displayed interface based on the display parameters. Therefore, the occupation of the memory space of the main control end is reduced, the control interface displayed on the main control end can be matched with the resolution of the main control display, the main control end can display the control interface in an optimal mode, and the display effect of the control interface is enhanced. In addition, when the main control end 110 is in remote communication connection with one or more controlled ends 120, the main control end 110 only needs to provide the display parameters of the main control display to each controlled end 120, and the adaptive processing on the display data to be processed is respectively executed by the display card simulator of each controlled end 120, so that the main control end can quickly respond to multiple controlled ends and perform smooth remote control operation on the multiple controlled ends, and the risk of collapse of the main control end and the controlled end system is greatly reduced.
Further, after the main control terminal 110 obtains the target display data from the controlled terminal 120, the main control display card 115 performs graphic calculation and rendering on the target display data to obtain final display data, and controls the main control display to display the control interface based on the final display data.
In one embodiment, a master graphics processor and a master graphics card memory are deployed on the master graphics card 115. The main control graphics processor performs graphics calculation and rendering on the target display data to obtain final display data, and writes the final display data into the main control display card memory. And then, the main control video controller acquires final display data from the main control display card memory, performs digital-to-analog signal conversion on the final display data and provides the converted final display data to the main control display, so that the main control display displays a control interface based on the converted final display data of the digital-to-analog signal.
It can be understood that the controlled display of the controlled end 120 will eventually present a to-be-displayed interface corresponding to the to-be-processed display data. And the main control terminal 110 displays a corresponding control interface on the main control display based on the target display data. In this way, the control interface displayed by the main control terminal 110 is matched with the resolution of the main control display thereof, so that the presentation effect of the control interface and the interactive experience of the user are improved, and the user can conveniently perform accurate remote control operation based on the control interface.
In one embodiment, as shown in fig. 1, the remote display control system 100 further includes a data distribution server 150, and the controlled end 120 and the main control end 110 may be communicatively connected through the data distribution server 150. The data Distribution server 150 is dds (data Distribution service), and adopts a communication mode of a publish/subscribe mode. The slave 120 and the master 110 may forward data via the data distribution server 150.
In one implementation, the controlled end 120 may be communicatively connected with one or more master ends 110 through a data distribution server 150. For example, for an online teaching application scenario, a terminal used by a teacher corresponds to a controlled terminal, and terminals used by a plurality of students correspond to a plurality of master terminals.
The target display data includes one or more frames of data, and when the slave 120 transmits the target display data to the master 110, each time one frame of data is forwarded to the master 110 via the data distribution server 150. Specifically, the slave 120 may further transmit the target display data to the master 110 by performing the following steps: sending the current frame data to the data distribution server 150 so as to forward the current frame data to one or more main control terminals 110 via the data distribution server 150; in response to an instruction of the data distribution server 150 to send the next frame data, the next frame data is sent to the data distribution server so as to forward the next frame data to the one or more masters 110 via the data distribution server.
In one embodiment, the data distribution server 150 sends a "send next frame data" instruction to the slave 120 after determining that at least one master 110 receives the current frame data. Subsequently, the slave 120 transmits the next frame data to the master 110 via the data distribution server 150 in response to the instruction.
It should be noted that, the data distribution server 150, as a data synchronization middleware between the slave end and the master end, can control the data sending frequency between the slave end and the master end by dynamically adjusting the sending frame rate of the display data, so as to ensure the smoothness of remote control operation performed on the slave end at the master end, and facilitate dynamic adjustment of the display effect of the control interface according to the network environment, thereby improving user experience.
According to the communication model of the publish/subscribe scheme adopted by the data distribution server 150, the controlled end 120 as a publisher needs to publish a data transmission request and subscribe to a state of whether to allow transmission of the next frame data.
One or more masters 110 as subscribers need to subscribe to a data acquisition request (subscribe to data published by the masters based on the master ID) and publish a feedback of a data receiving event, so that the data distribution server 150 can determine whether the masters 110 receive frame data according to the feedback of the data receiving event.
The main control terminal 110 stores each frame of data in the main control terminal's memory after receiving the frame of data, then directly receives the next frame of data, and directly covers the original memory data after receiving the next frame of data (the memory data needs to be locked in the process of reading and writing). And for each frame of data received by the main control end, if the frame of data can be processed in time, the frame of data is directly processed and then displayed. If the frame data cannot be processed, the frame data can be discarded firstly, the frequency of refreshing the display by the control interface is reduced, and the display resolution can be further reduced.
In one implementation, the creating of the graphics card simulator by the controlled end 120 specifically includes: OpenGL (Open Graphics Library), which is a cross-language, cross-platform Application Programming Interface (API) for rendering 2D, 3D vector Graphics, is created. The interface is used to render complex three-dimensional scenes from simple graphics bits. The controlled end 120 can obtain display data to be processed (display processing instruction and interface data information) sent from the controlled processor 123 of the controlled end to the controlled graphics card (controlled graphics processor) by calling the OpenGL library, and simulate the controlled graphics card to process the display data to be processed.
In one embodiment, the operating system 112 of the master 110 runs the remote control application 111, the operating system 122 of the slave 120 runs the remote control application 121, and the remote control application 111 and the remote control application 121 can communicate via a remote control server, so that the master 110 and the slave 120 realize remote communication.
According to the remote display control system, the main control end and the controlled end cooperatively process the display of the control interface at the main control end, wherein the main control end provides the display parameters of the main control display to the controlled end, the display card simulator created by the controlled end carries out adaptive processing on the display data to be processed corresponding to the interface to be displayed based on the display parameters, and the processed target display data is sent to the main control end, so that the main control end displays the control interface matched with the display parameters of the main control display at the main control display based on the target display data. Therefore, the occupation of the memory space of the main control end is reduced, the control interface displayed on the main control end can be matched with the resolution of the main control display, the main control end can display the control interface in an optimal mode, the display effect of the control interface is enhanced, and the problem of system breakdown is avoided.
According to an embodiment of the present invention, the controlled end 120 is adapted to perform the remote control interface display method 300 according to the present invention, and the main control end 110 is adapted to perform the remote control interface display method 400 according to the present invention, so that the data to be processed by the controlled end is provided to the main control end after being adaptively processed by the controlled end, so that the main control end can display the control interface in a resolution adapted to the main control display.
According to an embodiment of the present invention, the master 110 and the slave 120 may respectively implement the computing device 200 as shown below.
FIG. 2 shows a schematic diagram of a computing device 200, according to one embodiment of the invention.
As shown in FIG. 2, in a basic configuration 202, a computing device 200 typically includes a system memory 206 and one or more processors 204. A memory bus 208 may be used for communication between the processor 204 and the system memory 206.
Depending on the desired configuration, the processor 204 may be any type of processing, including but not limited to: a microprocessor (UP), a microcontroller (UC), a digital information processor (DSP), or any combination thereof. The processor 204 may include one or more levels of cache, such as a level one cache 210 and a level two cache 212, a processor core 214, and registers 216. Example processor cores 214 may include Arithmetic Logic Units (ALUs), Floating Point Units (FPUs), digital signal processing cores (DSP cores), or any combination thereof. The example memory controller 218 may be used with the processor 204, or in some implementations the memory controller 218 may be an internal part of the processor 204.
Depending on the desired configuration, system memory 206 may be any type of memory, including but not limited to: volatile memory (such as RAM), non-volatile memory (such as ROM, flash memory, etc.), or any combination thereof. System memory 206 may include an operating system 220, one or more applications 222, and program data 224. The application 222 is actually a plurality of program instructions that direct the processor 204 to perform corresponding operations. In some embodiments, application 222 may be arranged to cause processor 204 to operate with program data 224 on an operating system.
Computing device 200 also includes storage 232, storage 232 including removable storage 236 and non-removable storage 238.
Computing device 200 may also include a storage interface bus 234. The storage interface bus 234 enables communication from the storage devices 232 (e.g., removable storage 236 and non-removable storage 238) to the basic configuration 202 via the bus/interface controller 230. Operating system 220, applications 222, and at least a portion of program data 224 may be stored on removable storage 236 and/or non-removable storage 238, and loaded into system memory 206 via storage interface bus 234 and executed by one or more processors 204 when computing device 200 is powered on or applications 222 are to be executed.
Computing device 200 may also include an interface bus 240 that facilitates communication from various interface devices (e.g., output devices 242, peripheral interfaces 244, and communication devices 246) to the basic configuration 202 via the bus/interface controller 230. The example output device 242 includes an image processing unit 248 and an audio processing unit 250. They may be configured to facilitate communication with various external devices, such as a display or speakers, via one or more a/V ports 252. Example peripheral interfaces 244 can include a serial interface controller 254 and a parallel interface controller 256, which can be configured to facilitate communications with external devices such as input devices (e.g., keyboard, mouse, pen, voice input device, touch input device) or other peripherals (e.g., printer, scanner, etc.) via one or more I/O ports 258. An example communication device 246 may include a network controller 260, which may be arranged to facilitate communications with one or more other computing devices 262 over a network communication link via one or more communication ports 264.
The network communication link may be one example of a communication medium. Communication media may typically be embodied by computer readable instructions, data structures, program modules, and may include any information delivery media, such as carrier waves or other transport mechanisms, in a modulated data signal. A "modulated data signal" may be a signal that has one or more of its data set or its changes made in a manner that encodes information in the signal. By way of non-limiting example, communication media may include wired media such as a wired network or private-wired network, and various wireless media such as acoustic, Radio Frequency (RF), microwave, Infrared (IR), or other wireless media. The term computer readable media as used herein may include both storage media and communication media.
In an embodiment in accordance with the invention, computing device 200 is configured to perform remote control interface display method 300 or remote control interface display method 400 in accordance with the invention. The application of the computing device 200 includes a plurality of program instructions for performing the remote control interface display method 300 or the remote control interface display method 400 of the present invention, such that the computing device may perform the remote control interface display method 300 or the remote control interface display method 400 of the present invention.
In an embodiment according to the present invention, the controlled end 120 is configured to perform the remote control interface display method 300 according to the present invention. The controlled end 120 executes the remote control interface display method 300 of the present invention after establishing a remote communication connection with at least one master control end 110.
FIG. 3 illustrates a flow diagram of a remote control interface display method 300 according to one embodiment of the invention. The method 300 is adapted to be performed at the controlled end 120.
As shown in FIG. 3, the method 300 includes steps S310-S330.
In step S310, the display parameters of the main control display sent by the main control terminal 110 are received. Here, the display parameters of the master display include, for example, a display resolution and a DPI of the master display.
Subsequently, in step S320, the graphics card simulator 124 is created, and the display parameters and the to-be-processed display data related to the to-be-displayed interface of the controlled end are provided to the graphics card simulator 124, so that the graphics card simulator processes the to-be-processed display data based on the display parameters to generate the target display data adapted to the master display.
Finally, the target display data is sent to the main control end 110, so that the main control end 110 displays a control interface adapted to the display parameters of the main control display on the main control display based on the target display data.
In an embodiment according to the present invention, the main control terminal 110 is configured to perform the remote control interface display method 400 according to the present invention. The master 110 executes the remote control interface display method 400 of the present invention after establishing a remote communication connection with at least one slave 120.
FIG. 4 illustrates a flow diagram of a remote control interface display method 400 according to one embodiment of the invention. The method 400 is adapted to be performed at the master 110.
As shown in FIG. 4, the method 400 includes steps S410 to S420.
In step S410, the display parameters of the main control display are sent to the controlled end 120, so that the controlled end 120 creates the display card simulator 124, provides the display parameters and the to-be-processed display data related to the to-be-displayed interface of the controlled end to the display card simulator 124, and processes the to-be-processed display data based on the display parameters through the display card simulator 124, so as to generate the target display data adapted to the main control display.
Subsequently, in step S420, the target display data sent by the controlled end 120 is received, and a control interface adapted to the master display is displayed on the master display based on the target display data.
It should be noted that the graphics card simulator 124 created according to the controlled end 120 may intercept the to-be-processed display data sent by the controlled processor 123 to the controlled graphics card 125 and the display parameters of the main control display, and simulate the controlled graphics card to process the data.
After the main control terminal 110 obtains the target display data from the controlled terminal 120, the main control display card 115 performs graphic calculation and rendering on the target display data to obtain final display data, and controls the main control display to display a control interface based on the final display data.
In one embodiment, the controlled end 120 may further transmit the target display data to the master end 110 by performing the following steps: sending the current frame data to the data distribution server 150 so as to forward the current frame data to one or more main control terminals 110 via the data distribution server 150; in response to an instruction of the data distribution server 150 to send the next frame data, the next frame data is sent to the data distribution server so as to forward the next frame data to the one or more masters 110 via the data distribution server.
In one embodiment, the data distribution server 150 sends a "send next frame data" instruction to the slave 120 after determining that at least one master 110 receives the current frame data. Subsequently, the slave 120 transmits the next frame data to the master 110 via the data distribution server 150 in response to the instruction.
It should be noted that, for the specific implementation of the remote control interface display methods 300 and 400, reference may be made to the description of the remote display control system 100 in the foregoing, and the description thereof is omitted here.
According to the remote control interface display method, after receiving the display parameters of the main control display, the controlled end establishes the display card simulator, performs adaptive processing on the display data to be processed corresponding to the interface to be displayed according to the display parameters of the main control display by the display card simulator, and sends the processed target display data to the main control end, so that the main control end displays the control interface matched with the display parameters of the main control display on the main control display based on the target display data. Therefore, the control interface displayed at the main control end can be matched with the resolution of the main control display, so that the main control end can display the control interface in an optimal mode, the display effect of the control interface is enhanced, and the problem of system breakdown is avoided.
The various techniques described herein may be implemented in connection with hardware or software or, alternatively, with a combination of both. Thus, the methods and apparatus of the present invention, or certain aspects or portions thereof, may take the form of program code (i.e., instructions) embodied in tangible media, such as removable hard drives, U.S. disks, floppy disks, CD-ROMs, or any other machine-readable storage medium, wherein, when the program is loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the invention.
In the case of program code execution on programmable computers, the mobile terminal generally includes a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device. Wherein the memory is configured to store program code; the processor is configured to execute the remote control interface display method of the present invention according to instructions in the program code stored in the memory.
By way of example, and not limitation, readable media may comprise readable storage media and communication media. Readable storage media store information such as computer readable instructions, data structures, program modules or other data. Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. Combinations of any of the above are also included within the scope of readable media.
In the description provided herein, algorithms and displays are not inherently related to any particular computer, virtual system, or other apparatus. Various general purpose systems may also be used with examples of this invention. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules or units or components of the devices in the examples disclosed herein may be arranged in a device as described in this embodiment or alternatively may be located in one or more devices different from the devices in this example. The modules in the foregoing examples may be combined into one module or may additionally be divided into multiple sub-modules.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Moreover, those skilled in the art will appreciate that although some embodiments described herein include some features included in other embodiments, not others, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
Furthermore, some of the described embodiments are described herein as a method or combination of method elements that can be performed by a processor of a computer system or by other means of performing the described functions. A processor having the necessary instructions for carrying out the method or method elements thus forms a means for carrying out the method or method elements. Further, the elements of the apparatus embodiments described herein are examples of the following apparatus: the apparatus is used to implement the functions performed by the elements for the purpose of carrying out the invention.
As used herein, unless otherwise specified the use of the ordinal adjectives "first", "second", "third", etc., to describe a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially, in ranking, or in any other manner.
While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this description, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as described herein. Furthermore, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The present invention has been disclosed in an illustrative rather than a restrictive sense with respect to the scope of the invention, as defined in the appended claims.
Claims (12)
1. A remote display control system comprises a master control end and a controlled end which are connected in a remote communication mode, wherein:
the master control end comprises a master control display card and a master control display connected with the master control display card in a communication mode, and is suitable for acquiring display parameters of the master control display and sending the display parameters to the controlled end;
the controlled end comprises a controlled processor, a controlled display card and a controlled display connected with the controlled display card in a communication mode, the controlled end is suitable for creating a display card simulator after receiving the display parameters, the display parameters and display data to be processed related to a display interface to be displayed of the controlled end are provided to the display card simulator, so that the display card simulator processes the display data to be processed based on the display parameters to generate target display data matched with the main control display, and the target display data are sent to the main control end, so that the main control end displays a control interface matched with the main control display based on the target display data; the controlled display card is suitable for displaying an interface to be displayed on the controlled display after the display data to be processed are processed.
2. The system of claim 1, wherein the master is further adapted to:
and carrying out graphic calculation and rendering on the target display data through the main control display card to obtain final display data, and controlling the main control display to display the control interface based on the final display data.
3. The system of claim 1 or 2, wherein the system further comprises:
and the controlled end is in communication connection with one or more main control ends through the data distribution server.
4. The system of claim 3, wherein the target display data comprises one or more frames of data, the slave is further adapted to perform the following steps to transmit the target display data to the master:
sending the current frame data to the data distribution server so as to forward the current frame data to one or more main control terminals through the data distribution server;
and responding to an instruction of the data distribution server for sending next frame data, and sending the next frame data to the data distribution server so as to forward the next frame data to one or more main control terminals through the data distribution server.
5. The system of claim 4, wherein,
the data distribution server is adapted to: and after determining that at least one master control end receives the current frame data, sending the instruction for sending the next frame data to the controlled end.
6. The system of any one of claims 1-5, wherein the graphics card simulator is further adapted to:
and processing the display data to be processed based on the display parameters by utilizing an image processing algorithm.
7. The system of any one of claims 1-6,
the display card simulator is suitable for intercepting display data to be processed sent to the controlled display card by the controlled processor and display parameters of the main control display.
8. The system of any one of claims 1-7,
the display parameters include: the display resolution and the DPI of the master control display.
9. A remote control interface display method is executed at a controlled end, the controlled end is in remote communication connection with a main control end, and the method comprises the following steps:
receiving display parameters of a main control display sent by the main control end;
creating a display card simulator, and providing the display parameters and to-be-processed display data related to the to-be-displayed interface of the controlled end to the display card simulator so that the display card simulator processes the to-be-processed display data based on the display parameters to generate target display data matched with the main control display, and displaying the to-be-displayed interface on the controlled display after processing the to-be-processed display data through the controlled display card; and
and sending the target display data to the main control end so that the main control end can display a control interface matched with the main control display on the main control display based on the target display data.
10. A remote control interface display method is executed at a main control end, the main control end is in remote communication connection with a controlled end, and the method comprises the following steps:
sending display parameters of a main control display to the controlled end so that the controlled end creates a display card simulator after receiving the display parameters, provides the display parameters and display data to be processed related to a display interface to be displayed of the controlled end to the display card simulator, processes the display data to be processed based on the display parameters through the display card simulator so as to generate target display data matched with the main control display, and displays the display interface to be displayed on the controlled display after processing the display data to be processed through the controlled display card; and
and receiving the target display data sent by the controlled end, and displaying a control interface matched with a main control display on the main control display based on the target display data.
11. A computing device, comprising:
at least one processor; and
a memory storing program instructions, wherein the program instructions are configured to be adapted to be executed by the at least one processor, the program instructions comprising instructions for performing the method of claim 9 or 10.
12. A readable storage medium storing program instructions which, when read and executed by a computing device, cause the computing device to perform the method of claim 9 or 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210775616.0A CN114995778A (en) | 2022-03-28 | 2022-03-28 | Remote display control system, remote control interface display method and computing equipment |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210775616.0A CN114995778A (en) | 2022-03-28 | 2022-03-28 | Remote display control system, remote control interface display method and computing equipment |
| CN202210308739.3A CN114489552B (en) | 2022-03-28 | 2022-03-28 | Remote display control system, remote control interface display method and computing equipment |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210308739.3A Division CN114489552B (en) | 2022-03-28 | 2022-03-28 | Remote display control system, remote control interface display method and computing equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114995778A true CN114995778A (en) | 2022-09-02 |
Family
ID=81488948
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210308739.3A Active CN114489552B (en) | 2022-03-28 | 2022-03-28 | Remote display control system, remote control interface display method and computing equipment |
| CN202210775616.0A Pending CN114995778A (en) | 2022-03-28 | 2022-03-28 | Remote display control system, remote control interface display method and computing equipment |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210308739.3A Active CN114489552B (en) | 2022-03-28 | 2022-03-28 | Remote display control system, remote control interface display method and computing equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN114489552B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115859335A (en) * | 2023-02-03 | 2023-03-28 | 合肥科颖医药科技有限公司 | Remote control technology-based remote information data lookup method and system |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101794237B (en) * | 2009-02-02 | 2014-12-31 | 联想(北京)有限公司 | Computer and method for realizing universal display |
| CN101754433A (en) * | 2009-12-24 | 2010-06-23 | 深圳市同洲电子股份有限公司 | Method for displaying file content in mobile terminal and mobile terminal |
| CN102857726A (en) * | 2012-08-17 | 2013-01-02 | 北京君正集成电路股份有限公司 | Remote control method, terminal, opposite terminal and system based on synchronous display |
| CN106383689B (en) * | 2016-09-20 | 2019-11-29 | 青岛海信电器股份有限公司 | Display font scale adjusting method, device and terminal device |
| CN106873932B (en) * | 2017-02-17 | 2020-03-03 | 浙江大学 | Android system server side and remote desktop image redirection method and system |
| CN110389730B (en) * | 2018-04-13 | 2022-05-06 | 杭州海康威视数字技术股份有限公司 | Method and device for large-screen display based on virtual display card and electronic equipment |
| CN109358951B (en) * | 2018-10-29 | 2021-07-02 | 北京京航计算通讯研究所 | SPICE protocol-based display method for intelligently supporting direct connection of display cards and virtual display cards |
| CN109542377A (en) * | 2018-11-16 | 2019-03-29 | 深圳时空数字科技有限公司 | Smart machine, display equipment, storage equipment and screen display interactive control method |
-
2022
- 2022-03-28 CN CN202210308739.3A patent/CN114489552B/en active Active
- 2022-03-28 CN CN202210775616.0A patent/CN114995778A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115859335A (en) * | 2023-02-03 | 2023-03-28 | 合肥科颖医药科技有限公司 | Remote control technology-based remote information data lookup method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114489552A (en) | 2022-05-13 |
| CN114489552B (en) | 2022-08-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1329870C (en) | Block-based rotation of arbitrary-shaped images | |
| CN102047612A (en) | Image-based remote access system | |
| US20180126272A1 (en) | Virtual-reality providing system, virtual-reality providing method, virtual-reality-provision supporting apparatus, virtual-reality providing apparatus, and non-transitory computer-readable recording medium | |
| US20230120253A1 (en) | Method and apparatus for generating virtual character, electronic device and readable storage medium | |
| KR101914478B1 (en) | Image providing system, service apparatus and image providing method thereof | |
| US10402472B2 (en) | Optimized rendering of shared documents on client devices with document raster representations | |
| CN110555900B (en) | Rendering instruction processing method and device, storage medium and electronic equipment | |
| CN114489552B (en) | Remote display control system, remote control interface display method and computing equipment | |
| CN116821040B (en) | Display acceleration method, device and medium based on GPU direct memory access | |
| CN112965771A (en) | Virtual screen construction method, computing device and storage medium | |
| GB2538797B (en) | Managing display data | |
| US8854385B1 (en) | Merging rendering operations for graphics processing unit (GPU) performance | |
| CN112416505A (en) | Remote control system, method and computing equipment | |
| JP2016224942A (en) | System and method for optimizing image view binding | |
| CN111741343B (en) | Video processing method and device and electronic equipment | |
| CN111915714A (en) | Rendering method for virtual scene, client, server and computing equipment | |
| CN110288523B (en) | Image generation method and device | |
| CN109308862B (en) | Signal control method, control device, processing device and signal control equipment | |
| JP2005055573A (en) | High-speed display processor | |
| CN113885758B (en) | Virtual screen generation method, computing device and storage medium | |
| CN113613043A (en) | Screen display and image processing method, embedded device and cloud server | |
| CN115619904A (en) | Image processing method, device and equipment | |
| CN114998504A (en) | Two-dimensional image illumination rendering method, device and system and electronic device | |
| JP7279986B1 (en) | Information processing method, information processing system and information processing program | |
| US11037329B2 (en) | Encoding positional coordinates based on multiple channel color values |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |