CN111355767B - Remote control method, server, client and electronic equipment - Google Patents
Remote control method, server, client and electronic equipment Download PDFInfo
- Publication number
- CN111355767B CN111355767B CN201910142476.1A CN201910142476A CN111355767B CN 111355767 B CN111355767 B CN 111355767B CN 201910142476 A CN201910142476 A CN 201910142476A CN 111355767 B CN111355767 B CN 111355767B
- Authority
- CN
- China
- Prior art keywords
- interface
- control
- client
- data
- interface data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Communication Control (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a remote control method, a server, a client and electronic equipment, wherein the method comprises the following steps: creating at least one control interface, the control interface comprising a client code; according to the client code, determining a client corresponding to the control interface, and determining a data connection channel corresponding to the server and the client; executing control operation on at least one control interface, and determining a control instruction according to the control operation; transmitting the control instruction to a client corresponding to the control interface through a corresponding data connection channel; receiving interface data sent by at least one client; and displaying interface data of the corresponding client on at least one control interface. The invention can realize the remote control of the control terminal and at least one controlled terminal, and can be integrated in an operating system.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a remote control method, a server, a client, and an electronic device.
Background
The electronic whiteboard is an intelligent terminal widely applied to the fields of education and offices, and a plurality of electronic whiteboards which are installed and deployed are sometimes required to be controlled and managed uniformly through remote control. The existing remote control method is to use remote desktop service of a windows system, can realize one-to-one remote control, cannot realize one-to-many remote control, and only supports the windows system; another is to install special remote control software (e.g., teamViewer, VNCViewer software) which is mature in functionality but which requires authorization to use independent of the operating system, adding additional cost.
Disclosure of Invention
In view of the above, the present invention aims to provide a remote control method, a server, a client, and an electronic device, which can realize remote control of at least one client by the server and can be integrated in an operating system.
Based on the above object, the present invention provides a remote control method, applied to a server, the method comprising:
creating at least one control interface, the control interface comprising a client code;
determining a client corresponding to the control interface according to the client code, and determining a data connection channel corresponding to the server and the client;
executing control operation on the at least one control interface, and determining a control instruction according to the control operation;
the control instruction is sent to a client corresponding to the control interface through a corresponding data connection channel;
receiving interface data sent by at least one client;
and displaying interface data of the corresponding client on the at least one control interface.
Optionally, a control data packet is sent to the client corresponding to the control interface, where the control data packet includes the control instruction and the client code.
Optionally, the interface data packet sent by the client is received, the decoded data packet is parsed, the interface data and the client code are obtained, the corresponding control interface is determined according to the client code, and the interface data is displayed on the control interface.
Optionally, the client performs decompression processing on the interface data to generate decompressed interface data, the server receives the interface data sent by the client, processes the decompressed interface data to generate interface data suitable for display of the control interface, and displays the interface data suitable for display of the control interface on the control interface.
Optionally, the method further comprises: receiving a control return sent by at least one client, wherein the control return comprises attribute information of the interface data and a processing method of the interface data, setting the attribute of the control interface according to the attribute information of the interface data, and configuring the processing method of the received interface data according to the processing method of the interface data.
The embodiment of the invention also provides a remote control method which is applied to the client, and comprises the following steps:
Establishing a data connection channel with a server;
receiving a control instruction sent by the server through the data connection channel;
executing corresponding operation according to the control instruction;
intercepting interface data of a current display interface;
and sending interface data to the server through the data connection channel.
Optionally, a control data packet sent by the server is received, and the control data packet is analyzed to obtain the control instruction.
Optionally, an interface data packet is sent to the server, where the interface data packet includes interface data and a client code of the client.
Optionally, the method includes: intercepting the interface data at regular time, carrying out resolution processing on the intercepted interface data, storing the interface data after resolution processing in a first memory area, regularly reading the first memory area, carrying out compression processing on the interface data after resolution processing if the interface data after resolution processing exists in the first memory area, storing the interface data after compression processing in a second memory area, regularly reading the second memory area, and sending the interface data after compression processing to the server if the interface data after compression processing exists in the second memory area.
Optionally, the method further includes sending a control return data packet to the server, where the control return data packet includes attribute information of the interface data and a processing method of the interface data.
The embodiment of the invention also provides a server, which comprises:
the system comprises a creation interface module, a control interface module and a control interface module, wherein the creation interface module is used for creating at least one control interface, and the control interface comprises a client code;
the first network connection module is used for determining a client corresponding to the control interface according to the client code and determining a data connection channel corresponding to the server and the client;
the acquisition instruction module is used for determining a control instruction according to the control operation when the at least one control interface executes the control operation;
the first sending module is used for sending the control instruction to a client corresponding to the control interface through a corresponding data connection channel;
the first receiving module is used for receiving interface data sent by at least one client;
and the display processing module is used for displaying the interface data of the corresponding client on the at least one control interface.
Optionally, the service end is integrated in the operating system as a remote control end service.
Optionally, the first sending module is configured to send a control data packet to a client corresponding to the control interface through a corresponding data connection channel, where the control data packet includes the control instruction and the client code.
Optionally, the first receiving module is configured to receive an interface data packet sent by at least one client, where the interface data packet includes the interface data and the client code, parse the interface data packet, obtain the interface data and the client code, and determine a corresponding control interface according to the client code.
Optionally, the display processing module is configured to process the received interface data, generate interface data suitable for display of the control interface, and display the interface data suitable for display of the control interface on the corresponding control interface.
Optionally, the server further includes:
the first receiving module is used for receiving a control return data packet sent by at least one client, wherein the control return data packet comprises attribute information of the interface data and a processing method of the interface data;
the setting module is used for setting the attribute of the control interface according to the attribute information of the interface data and configuring the processing method of the received interface data according to the processing method of the interface data.
The embodiment of the invention also provides a client, which comprises:
the second network connection module is used for establishing a data connection channel with the server;
the second receiving module is used for receiving the control instruction sent by the server through the data connection channel;
the execution module is used for executing corresponding operations according to the control instruction;
the intercepting module is used for intercepting interface data of the current display interface;
and the second sending module is used for sending the interface data to the server through the data connection channel.
Optionally, the client is integrated in the operating system as a remote controlled end service.
Optionally, the second receiving module is configured to receive, through the data connection channel, a control data packet sent by the server, where the control data packet includes the control instruction and a client code of the client, and parse the control data packet to obtain the control instruction.
Optionally, the second sending module is configured to send an interface data packet to the server through the data connection channel, where the interface data packet includes the interface data and a client code of the client.
Optionally, the client further includes:
the interface data processing module is used for carrying out resolution processing on the intercepted interface data, generating interface data after resolution processing, and carrying out compression processing on the interface data after resolution processing, so as to generate interface data after compression processing;
the first memory area is used for storing the interface data after resolution processing;
the second memory area is used for storing the interface data after the compression processing;
the reading module is used for regularly reading the first memory area, compressing the interface data after resolution processing by the interface data processing module if the interface data after resolution processing exists in the first memory area, regularly reading the second memory area, and transmitting the interface data after compression processing to the server by the second transmitting module if the interface data after compression processing exists in the second memory area.
Optionally, the second sending module is configured to send a control return data packet to the server, where the control return data packet includes attribute information of interface data and a processing method of the interface data.
The embodiment of the invention also provides electronic equipment, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, and is characterized in that the remote control method is realized when the processor executes the program.
From the above, it can be seen that, according to the remote control method, the server, the client and the electronic device provided by the invention, the server creates at least one control interface, each control interface determines the corresponding client through different client codes, the corresponding client can be controlled to execute the corresponding operation by executing the control operation through the control interface, and the interface data can be displayed on the corresponding control interface by receiving the interface data of the client. The invention can realize the remote control of the control terminal and at least one controlled terminal, and the control terminal can respectively and remotely control a plurality of controlled terminals through corresponding control interfaces; in addition, the service end and the client end can be integrated into an operating system as a system service, and the operating system can be a windows system, a linux system and the like.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of a remote control method of a server according to an embodiment of the present invention;
fig. 2 is a flowchart of a remote control method of a client according to an embodiment of the present invention;
FIG. 3 is a schematic flow chart of a remote control method according to an embodiment of the invention;
FIG. 4 is a block diagram of a server according to an embodiment of the present invention;
fig. 5 is a block diagram of a client according to an embodiment of the present invention.
Detailed Description
The present invention will be further described in detail below with reference to specific embodiments and with reference to the accompanying drawings, in order to make the objects, technical solutions and advantages of the present invention more apparent.
It should be noted that, in the embodiments of the present invention, all the expressions "first" and "second" are used to distinguish two entities with the same name but different entities or different parameters, and it is noted that the "first" and "second" are only used for convenience of expression, and should not be construed as limiting the embodiments of the present invention, and the following embodiments are not described one by one.
Fig. 1 is a schematic flow chart of a remote control method of a server according to an embodiment of the present invention. As shown in the figure, the remote control method disclosed by the invention can realize the remote control of the server to at least one client, and is applied to the server, and comprises the following steps:
the method comprises the steps that a server creates at least one control interface, wherein the control interface comprises a client code;
according to the client code, determining a client corresponding to the control interface, and determining a data connection channel corresponding to the server and the client;
executing control operation on at least one control interface, and determining a control instruction according to the control operation;
transmitting the control instruction to a client corresponding to the control interface through a corresponding data connection channel;
receiving interface data sent by at least one client;
and displaying interface data of the corresponding client on at least one control interface.
As shown in fig. 1, the remote control method applied to a server according to an embodiment of the present invention includes:
s10: the method comprises the steps that at least one control interface is established by a server, the control interface comprises client codes, the number of the control interfaces is consistent with that of the clients, and the clients correspond to the control interfaces one by one;
s11: determining a client corresponding to the control interface according to the client code, and determining at least one data connection channel between the server and at least one client;
The server creates a control interface, and remotely controls the client through the control interface. The control interface created by the server has an address identifier, the address identifier comprises a network address of the server and a client code, and the remote control client corresponding to the control interface can be determined according to the client code of the control interface.
The server creates a first control interface with a first address identifier comprising a first client code corresponding to the first client, and the server can remotely control the first client through the first control interface. That is, when the server creates the first control interface, the first control interface includes the first client code, and the first data connection channel between the server and the first client is determined according to the first client code, and when the control operation is executed on the first control interface, the corresponding control instruction may be sent to the first client through the first data connection channel, and the interface data of the first client is sent to the server through the first data connection channel and displayed on the first control interface.
When the server needs to remotely control the clients, the server creates a plurality of control interfaces with the same number as the clients, each control interface has address identifiers, client codes of each address identifier correspond to different clients respectively, and the server can remotely control each client through each control interface. That is, the server creates a plurality of control interfaces, each control interface has different client codes, a data connection channel between the server and each client is determined according to each client code, when control operation is executed on each control interface, a control instruction generated by each control interface is sent to a corresponding client through a corresponding data connection channel between the server and each client, and interface data of each client is sent to the server through a corresponding data connection channel and displayed on the corresponding control interface.
It should be noted that, the server may remotely control the plurality of clients through respective control interfaces, and the server may also simultaneously control the control interfaces through a synchronization control module, so as to realize synchronous remote control of the server on each client.
S12: executing control operation on at least one control interface, and determining a control instruction according to the control operation;
s13: transmitting the control instruction to a client corresponding to the control interface through a corresponding data connection channel;
and executing remote control operation on the client on the control interface, and acquiring an operation event and an operation instruction according to the control operation on the control interface. The control operation comprises mouse operation, keyboard operation, file operation and the like, wherein the mouse operation comprises left key/right key movement, pressing, releasing and the like, and the corresponding mouse control instruction comprises left key/right key movement, pressing, releasing, coordinate values and the like; the keyboard operations include pressing, releasing, etc., the corresponding keyboard control instructions include pressing, releasing, key coding, etc., the file operations include copying, pasting, etc., and the corresponding file control instructions include copying, pasting, file content data, etc.
Executing control operation on the control interface, determining a corresponding operation instruction, sending the operation instruction to a corresponding client through a corresponding data connection channel, receiving the operation instruction by the client, and executing corresponding operation action according to the operation instruction.
In one embodiment, the server establishes a data connection channel with the client based on a TCP communication protocol. The control instruction sent by the server to the client is packaged into a control data packet conforming to the TCP protocol, the control data packet comprises a client code, the client is determined according to the client code, and a data connection channel corresponding to the server and the client is determined; the interface data sent by the client are packaged into an interface data packet conforming to the TCP protocol, the interface data packet comprises a client code, a control interface created by the server is determined according to the client code, and the interface data is displayed on the control interface.
The interface data packet/control data packet conforming to the TCP protocol has the following data format:
| message header | Message type | Client encoding length | Client encoding | Data length | Data content |
The meaning of each field in the data format is:
the message header is used for identifying the data packet as a data packet interacted between the server and the client; the message header field occupies 6 bytes;
Message type, message type of the data packet, the message type includes heartbeat detection, control request, control return, screenshot uploading, etc., different types define different field values; the message type field occupies 1 byte;
the timing interactive information between the server and the client is the data packet of the heartbeat detection to detect the data connection state of the two parties. After the server side executes the control operation, a data packet with the message type of a control request and the data content of a control instruction is sent to the client side.
After the client executes corresponding operation, sending a data packet with the information type of control return and the data content of the intercepted interface data as the size, width and height of the interface data to the server, and carrying out data compression method identification, color setting identification and other attribute information; meanwhile, the client starts to execute screenshot operation, intercepts interface data, performs resolution processing, compression processing and the like on the intercepted interface data, generates processed interface data, and sends a data packet with the message type of screenshot uploading and the data content of the processed interface data to the server.
The server sets each attribute of the control interface according to each attribute information in the data content and sets a corresponding decompression method according to the received message type as a data packet returned by the control. And the server side decompresses the processed interface data according to the data packet uploaded by the screenshot according to the type of the received message, and displays the interface data on the control interface.
The client code length, the client code length field occupies 4 bytes;
and the client code is used for judging whether the data packet is from the server or the client, if so, the source identifier is the client code, and if so, the source identifier is the client code of the controlled terminal.
A data length, a length of data content, a data length field occupying 4 bytes;
the data content, the interactive data of the server and the client, the interactive data is a control instruction if the interactive data is from the server (the data packet sent by the server to the client), and the interactive data is attribute information of interface data or processed interface data if the interactive data is from the client (the data packet sent by the client to the server).
S14: receiving interface data sent by at least one client;
s15: and displaying interface data of the corresponding client on at least one control interface.
The first client side intercepts first interface data of a display interface of the first client side at fixed time and sends the intercepted first interface data to the server side. The first client sends the first interface data to the server through the first data connection channel, the server receives the first interface data, and the first interface data is displayed on the first control interface. For a plurality of clients, each client intercepts interface data of each display interface at fixed time, sends each interface data to a server through a corresponding data connection channel, receives each interface data, and displays each interface data on a corresponding control interface.
Considering that the resolution of the display screen of the client and the resolution of the display screen of the server may be different, the client intercepts interface data at fixed time, and processes the intercepted interface data into interface data which is suitable for the resolution of the display screen of the server according to the resolution of the display screen of the server. Furthermore, in order to improve the data transmission efficiency, the interface data after resolution processing is compressed and then sent to the server. The server receives the interface data, firstly decompresses the interface data, then processes the decompressed interface data into interface data suitable for display of a control interface, and displays the processed interface data on the control interface.
The step S10 further includes: and starting the server. In the embodiment of the invention, the service end and the client end can be integrated into the operating system as one system service (respectively corresponding to the remote control end service and the remote controlled end service), when the remote control function is used, the remote control end service is started at the control terminal, the remote controlled end service is started at the controlled terminal, and after the service is started, the control terminal remotely controls at least one controlled terminal according to the steps S10-S14.
The operating system may be windows, linux operating system, etc., the server of the windows version is integrated into the windows operating system of the control terminal as a remote control terminal service, the client of the windows version is integrated into the windows operating system of the controlled terminal as a remote controlled terminal service, and after the service is started, the remote control of the controlled terminal by the control terminal can be realized. The server of the linux version is used as a remote control end service to be integrated in a linux operating system of the control terminal, the client of the linux version is used as a remote controlled end service to be integrated in the linux operating system of the controlled terminal, and after the service is started, the remote control of the control terminal on the controlled terminal can be realized.
Fig. 2 is a flowchart of a remote control method of a client according to an embodiment of the present invention. As shown in the figure, the remote control method applied to the client according to the embodiment of the invention includes:
s20: establishing a data connection channel with a server;
s21: receiving a control instruction through a data connection channel;
s22: executing corresponding operation according to the control instruction;
the method comprises the steps that a data connection channel is established between a client and a server through network communication, the server creates a control interface comprising a client code, the client code corresponds to the client, the data connection channel between the server and the client is determined according to the client code, when the server executes control operation on the control interface, a generated control instruction is sent to a corresponding client through the data connection channel, the client receives the control instruction, and corresponding operation is executed on a display interface according to the control instruction.
S23: intercepting interface data of a current display interface;
s24: interface data is sent through the data connection channel.
Considering that the resolution of the display screen of the client and the resolution of the display screen of the server may be different, the client intercepts interface data of the current interface at regular time, and performs resolution processing (such as clipping) on the intercepted interface data according to the resolution of the display screen of the server to generate interface data which is suitable for the resolution of the display screen of the server. Further, in order to improve the data transmission efficiency, the interface data subjected to resolution processing is compressed, and the compressed interface data is sent to the server.
The server receives the interface data, firstly decompresses the interface data, then processes the decompressed interface data into interface data suitable for display of a control interface, and then displays the processed interface data on a corresponding control interface.
The step S20 further includes: and starting the client. In the embodiment of the invention, the service end and the client end can be integrated into the operating system as one system service (respectively corresponding to the remote control end service and the remote controlled end service), when the remote control function is used, the remote control end service is started at the control terminal, the remote controlled end service is started at the controlled terminal, and after the service is started, the controlled terminal and the control terminal realize remote control according to the steps S20-S24.
Fig. 3 is a schematic flow chart of a remote control method according to an embodiment of the invention. As shown in the figure, in the remote control method disclosed in the embodiment of the present invention, the server is served as a remote control end in an operating system of the control terminal, and the client is served as a remote controlled end in the operating system of the controlled terminal. The server creates control interfaces, the number of the created control interfaces is consistent with the number of clients to be remotely controlled, address identifiers of the control interfaces respectively comprise client codes of the clients, data connection channels of the server and the clients are determined according to the client codes, and the data connection channels of the server and the clients are opened.
The server side executes control operation on the control interface, determines the control instruction according to the control operation, encapsulates the control instruction into a control data packet conforming to the TCP protocol, wherein the control data packet comprises the control instruction and a client code, sends the control data packet to a client corresponding to the client code through a data connection channel, receives the control data packet by the client, analyzes the control data packet to obtain the control instruction, and executes corresponding operations such as mouse operation, keyboard operation, file operation and the like according to the control instruction.
The client receives the control data packet, sends a control return data packet comprising data contents such as attribute information of the interface data and a processing method to the server, and the server sets the attribute of the control interface and configures the processing method of the interface data according to the received control return data packet. At the same time, the method comprises the steps of,
the client side intercepts interface data of a current display interface at regular time, carries out resolution processing on the intercepted interface data, generates interface data after resolution processing, and stores the interface data after resolution processing in a first memory area; regularly checking whether the first memory area has the interface data after resolution processing, if so, reading out the interface data after resolution processing, compressing the interface data after resolution processing, generating compressed interface data, and storing the compressed interface data in the second memory area; and regularly checking whether the second memory area has compressed interface data, if so, reading the compressed interface data, packaging the compressed interface data into an interface data packet conforming to the TCP protocol, wherein the interface data packet comprises the interface data and client codes, and sending the interface data packet to a server.
The server receives the interface data packet, analyzes the interface data packet, acquires compressed interface data and client codes, decompresses the compressed interface data to generate interface data, draws the interface data to generate interface data suitable for being displayed on a control interface, determines a corresponding control interface according to the client codes, and displays the interface data on the corresponding control interface.
After the remote control of the control terminal and the controlled terminal is completed, the remote control terminal service and the remote controlled terminal service are closed, and the operation is convenient. The remote control terminal service and the remote controlled terminal service occupy small space, are convenient to integrate in a system, have system compatibility, and can realize the remote control function of one control terminal on at least one controlled terminal.
Fig. 4 is a block diagram of a server according to an embodiment of the present invention. As shown in the figure, the server disclosed in the embodiment of the present invention includes:
the system comprises a creation interface module, a control interface module and a control interface module, wherein the creation interface module is used for creating at least one control interface, the control interface comprises client codes, the number of the control interfaces is consistent with that of the clients, and the clients are in one-to-one correspondence with the control interfaces;
the first network connection module is used for determining a client corresponding to the control interface according to the client code and determining a data connection channel corresponding to the server and the client;
The acquisition instruction module is used for determining a control instruction according to the control operation when at least one control interface executes the control operation;
the first sending module is used for sending the control instruction to the client corresponding to the control interface through the corresponding data connection channel;
the first receiving module is used for receiving interface data sent by at least one client;
and the display processing module is used for displaying the interface data of the corresponding client on at least one control interface.
In the embodiment of the invention, the creation interface module of the server creates control interfaces consistent with the number of the clients according to the number of the clients, each control interface comprises an address identifier, the address identifier comprises a server address and a client code, the first network connection module determines the client corresponding to the control interface through the client code, and determines a data connection channel between the server and the client. The server side executes control operation on the control interface, the acquisition instruction module determines a control instruction according to the control operation, the first sending module sends the control instruction to the corresponding client side through a data connection channel between the server side and the client side, and the client side receives the control instruction and executes corresponding operation according to the control instruction. Meanwhile, the client side intercepts interface data of a current display interface at fixed time, the interface data is sent to the server side through the data connection channel, the first receiving module of the server side receives the interface data, and the display processing module displays the interface data on a control interface of the corresponding client side.
In the embodiment of the invention, the interactive data between the server and the client are data packets conforming to the TCP protocol, wherein,
the first sending module is used for packaging the control instruction into a control data packet and sending the control data packet to a client corresponding to the control interface through a corresponding data connection channel;
the first receiving module is used for receiving the interface data packet sent by at least one client, analyzing the interface data packet and obtaining interface data and client codes.
After the control operation is executed on the control interface, the server determines a control instruction, encapsulates the control instruction into a control data packet, wherein the control data packet comprises a client code of the control interface and the control instruction, and sends the control data packet to a client corresponding to the client code. The server receives the interface data packet sent by the client, analyzes the interface data, acquires the client code in the interface data packet, determines the corresponding control interface according to the client code, and displays the interface data on the corresponding control interface.
The display processing module is used for processing the received interface data, generating interface data suitable for controlling the interface display, and displaying the interface data suitable for controlling the interface display on the corresponding control interface.
The display processing module decompresses the received interface data to generate decompressed interface data, processes the decompressed interface data to generate interface data suitable for controlling interface display, and displays the interface data on the control interface.
In the embodiment of the invention, the first network connection module is used for establishing a data connection channel between the client and the server when the server is started, determining the client corresponding to the control interface according to the client code, determining the data connection channel between the server and the client, and opening the data connection channel between the server and the client.
In the embodiment of the present invention, the server further includes:
the first receiving module is used for receiving a control return data packet sent by at least one client, wherein the control return data comprises attribute information of interface data and a processing method of the interface data; the attribute information comprises the size, width, height and the like of the interface data, and the processing method of the interface data comprises a compression method.
The setting module is used for setting the attribute of the control interface according to the attribute information of the interface data, and configuring the processing method of the received interface data according to the processing method of the interface data.
Fig. 5 is a block diagram of a client according to an embodiment of the present invention. As shown in the figure, the client disclosed in the embodiment of the present invention includes:
the second network connection module is used for establishing a data connection channel with the server;
the second receiving module is used for receiving the control instruction sent by the server through the data connection channel;
the execution module is used for executing corresponding operations according to the control instruction;
the intercepting module is used for intercepting interface data of the current display interface;
and the second sending module is used for sending the interface data to the server through the data connection channel.
In the embodiment of the invention, the client establishes a data connection channel with the server through the second network connection module, and when the server executes control operation on the control interface, the second receiving module is utilized to receive the control instruction sent by the server, and the execution module executes corresponding operation on the client according to the received control instruction. Meanwhile, an intercepting module of the client intercepts interface data of a current display interface of the client at fixed time, and the interface data is sent to the server through a second sending module.
In the embodiment of the invention, the interactive data between the server and the client are data packets conforming to the TCP protocol, wherein,
The second receiving module is used for receiving the control data packet sent by the server through the data connection channel, analyzing the control data packet and obtaining a control instruction;
the second sending module is used for packaging the interface data into an interface data packet and sending the interface data packet to the server through the data connection channel.
The client intercepts interface data at regular time, encapsulates the interface data into an interface data packet, wherein the interface data packet comprises a client code and the interface data, and sends the interface data packet to the server. The client receives the control data packet sent by the server, analyzes the control data packet, acquires a control instruction, and executes corresponding operation according to the control instruction.
The client further comprises:
the interface data processing module is used for carrying out resolution processing on the intercepted interface data, generating interface data after resolution processing, and carrying out compression processing on the interface data after resolution processing, so as to generate interface data after compression processing;
the first memory area is used for storing the interface data after resolution processing;
the second memory area is used for storing the interface data after compression processing;
the reading module is used for regularly reading the first memory area, compressing the interface data after resolution processing by the interface data processing module if the first memory area has the interface data after resolution processing, and regularly reading the second memory area, and transmitting the interface data after compression processing to the server by the second transmitting module if the second memory area has the interface data after compression processing.
The second sending module is further configured to send a control return data packet to the server, where the control return data packet includes attribute information of the interface data and a processing method of the interface data.
Based on the above object, the embodiment of the present invention also proposes an embodiment of an apparatus for performing the remote control method. The device comprises:
one or more processors and memory.
The apparatus for performing the remote control method may further include: input means and output means.
The processor, memory, input devices, and output devices may be connected by a bus or other means.
The memory is used as a non-volatile computer readable storage medium for storing non-volatile software programs, non-volatile computer executable programs and modules, such as program instructions/modules corresponding to the remote control method in the embodiments of the present invention. The processor executes various functional applications of the server and data processing by running non-volatile software programs, instructions and modules stored in the memory, i.e. implements the remote control method of the above-described method embodiments.
The memory may include a memory program area and a memory data area, wherein the memory program area may store an operating system, at least one application program required for a function; the storage data area may store data created according to the use of a device performing the remote control method, etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory optionally includes memory remotely located with respect to the processor, the remote memory being connectable to the membership user action monitoring device through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device may receive input numeric or character information and generate key signal inputs related to user settings and function control of the device performing the remote control method. The output means may comprise a display device such as a display screen.
The one or more modules are stored in the memory that, when executed by the one or more processors, perform the remote control method of any of the method embodiments described above. The technical effects of the embodiment of the device for executing the remote control method are the same as or similar to those of any of the previous method embodiments.
The embodiment of the invention also provides a non-transitory computer storage medium, which stores computer executable instructions that can execute the method for processing the list item operation in any of the method embodiments. Embodiments of the non-transitory computer storage medium have technical effects identical or similar to any of the method embodiments described above.
Finally, it should be noted that, as will be appreciated by those skilled in the art, all or part of the procedures in implementing the methods of the embodiments described above may be implemented by a computer program for instructing relevant hardware, where the program may be stored in a computer readable storage medium, and the program may include the procedures of the embodiments of the methods described above when executed. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), or the like. The technical effects of the computer program embodiments are the same as or similar to any of the method embodiments described above.
In addition, typically, the devices, apparatuses and the like described in the present disclosure may be various electronic terminal apparatuses, such as mobile phones, personal Digital Assistants (PDAs), tablet computers (PADs), smart televisions, and the like, and may also be large-sized terminal apparatuses, such as servers, and the like, so the protection scope of the present disclosure should not be limited to a specific type of device, apparatus, and the like. The client described in the present disclosure may be applied to any of the above electronic terminal devices in the form of electronic hardware, computer software, or a combination of both.
Furthermore, the method according to the present disclosure may also be implemented as a computer program executed by a CPU, which may be stored in a computer-readable storage medium. The above-described functions defined in the methods of the present disclosure are performed when the computer program is executed by a CPU.
Furthermore, the above-described method steps and system units may also be implemented using a controller and a computer-readable storage medium storing a computer program for causing the controller to implement the above-described steps or unit functions.
Further, it should be appreciated that the computer-readable storage medium (e.g., memory) described herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. By way of example, and not limitation, nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of example, and not limitation, RAM is available in a variety of forms such as synchronous RAM (DRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), and direct RambusRAM (DRRAM). The storage devices of the disclosed aspects are intended to comprise, without being limited to, these and other suitable types of memory.
The device of the foregoing embodiment is configured to implement the corresponding method in the foregoing embodiment, and has the beneficial effects of the corresponding method embodiment, which is not described herein.
Those of ordinary skill in the art will appreciate that: the discussion of any of the embodiments above is merely exemplary and is not intended to suggest that the scope of the disclosure, including the claims, is limited to these examples; the technical features of the above embodiments or in the different embodiments may also be combined within the idea of the invention, the steps may be implemented in any order and there are many other variations of the different aspects of the invention as described above, which are not provided in detail for the sake of brevity.
Additionally, well-known power/ground connections to Integrated Circuit (IC) chips and other components may or may not be shown within the provided figures, in order to simplify the illustration and discussion, and so as not to obscure the invention. Furthermore, the devices may be shown in block diagram form in order to avoid obscuring the invention, and also in view of the fact that specifics with respect to implementation of such block diagram devices are highly dependent upon the platform within which the present invention is to be implemented (i.e., such specifics should be well within purview of one skilled in the art). Where specific details (e.g., circuits) are set forth in order to describe example embodiments of the invention, it should be apparent to one skilled in the art that the invention can be practiced without, or with variation of, these specific details. Accordingly, the description is to be regarded as illustrative in nature and not as restrictive.
While the invention has been described in conjunction with specific embodiments thereof, many alternatives, modifications, and variations of those embodiments will be apparent to those skilled in the art in light of the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.
The embodiments of the invention are intended to embrace all such alternatives, modifications and variances which fall within the broad scope of the appended claims. Therefore, any omission, modification, equivalent replacement, improvement, etc. of the present invention should be included in the scope of the present invention.
Claims (19)
1. The remote control method is applied to a server and is characterized in that the server is integrated into an operating system as a system service, and the method comprises the following steps:
creating a plurality of control interfaces, wherein the control interfaces comprise client end codes, and the client end codes of the control interfaces are different;
determining a client corresponding to the control interface according to the client code, and determining a data connection channel corresponding to the server and the client;
the server side remotely controls each client side respectively through corresponding control interfaces, or the server side simultaneously controls the control interfaces;
Wherein, control each customer end through each control interface, include:
executing control operation on at least one control interface, and determining a control instruction according to the control operation;
the control instruction is sent to a client corresponding to the control interface through a corresponding data connection channel;
receiving interface data and control returns sent by at least one client; wherein, the control returns attribute information comprising the interface data and a processing method of the interface data;
setting the attribute of a corresponding control interface according to the attribute information, and processing the interface data according to the processing method to obtain interface data suitable for controlling interface display;
and displaying interface data suitable for controlling interface display of the corresponding client on the at least one control interface.
2. The method of claim 1, wherein a control data packet is sent to a client corresponding to the control interface, the control data packet including the control instruction and the client code.
3. The method of claim 1, wherein receiving the interface data packet sent by the client, parsing the interface data packet, obtaining the interface data and the client code, determining the corresponding control interface according to the client code, and displaying the interface data on the control interface.
4. The method of claim 1, wherein the client decompresses the interface data to generate decompressed interface data, and the server receives the interface data sent by the client, processes the decompressed interface data to generate interface data suitable for display of the control interface, and displays the interface data suitable for display of the control interface on the control interface.
5. The remote control method is applied to a client, and is characterized in that the client is integrated into an operating system as a system service, and the method comprises the following steps:
establishing a data connection channel with a server;
receiving a control instruction sent by the server through the data connection channel;
executing corresponding operation according to the control instruction;
intercepting interface data of a current display interface;
interface data and control returns are sent to the server through the data connection channel; wherein, the control returns attribute information comprising the interface data and a processing method of the interface data; and the server side sets the attribute of the control interface according to the attribute information, processes the interface data according to the processing method to obtain interface data suitable for controlling the interface display, and displays the interface data suitable for controlling the interface display.
6. The method of claim 5, wherein a control data packet sent by the server is received, and the control data packet is parsed to obtain the control instruction.
7. The method of claim 5, wherein an interface data packet is sent to the server, the interface data packet including interface data and a client code of the client.
8. The method according to claim 5, comprising: intercepting the interface data at regular time, carrying out resolution processing on the intercepted interface data, storing the interface data after resolution processing in a first memory area, regularly reading the first memory area, carrying out compression processing on the interface data after resolution processing if the interface data after resolution processing exists in the first memory area, storing the interface data after compression processing in a second memory area, regularly reading the second memory area, and sending the interface data after compression processing to the server if the interface data after compression processing exists in the second memory area.
9. A server integrated as a system service in an operating system, the server comprising:
The system comprises a creation interface module, a control interface module and a control interface module, wherein the creation interface module is used for creating a plurality of control interfaces, the control interfaces comprise client end codes, and the client end codes of all the control interfaces are different;
the first network connection module is used for determining a client corresponding to the control interface according to the client code and determining a data connection channel corresponding to the server and the client; the server side remotely controls each client side respectively through corresponding control interfaces, or the server side simultaneously controls the control interfaces;
the control interface comprises an acquisition instruction module, a control instruction processing module and a control instruction processing module, wherein the acquisition instruction module is used for determining a control instruction according to at least one control interface when the control operation is executed;
the first sending module is used for sending the control instruction to a client corresponding to the control interface through a corresponding data connection channel;
the first receiving module is used for receiving interface data and control returns sent by at least one client; wherein, the control returns attribute information comprising the interface data and a processing method of the interface data;
the display processing module is used for setting the attribute of the corresponding control interface according to the attribute information, and processing the interface data according to the processing method to obtain interface data suitable for controlling the interface display; and displaying interface data suitable for controlling interface display of the corresponding client on the at least one control interface.
10. The server of claim 9, wherein the server is integrated into an operating system as a remote control service.
11. The server according to claim 9, wherein,
the first sending module is configured to send a control data packet to a client corresponding to the control interface through a corresponding data connection channel, where the control data packet includes the control instruction and the client code.
12. The server according to claim 9, wherein,
the first receiving module is configured to receive an interface data packet sent by at least one client, where the interface data packet includes the interface data and the client code, parse the interface data packet, obtain the interface data and the client code, and determine a corresponding control interface according to the client code.
13. A client integrated as a system service in an operating system, the client comprising:
the second network connection module is used for establishing a data connection channel with the server;
the second receiving module is used for receiving the control instruction sent by the server through the data connection channel;
The execution module is used for executing corresponding operations according to the control instruction;
the intercepting module is used for intercepting interface data of the current display interface;
the second sending module is used for sending the interface data and the control return to the server through the data connection channel; wherein, the control returns attribute information comprising the interface data and a processing method of the interface data; and the server side sets the attribute of the control interface according to the attribute information, processes the interface data according to the processing method to obtain interface data suitable for controlling the interface display, and displays the interface data suitable for controlling the interface display.
14. The client of claim 13, wherein the client is integrated into an operating system as a remote controlled-end service.
15. The client of claim 13, wherein the client is configured to,
the second receiving module is configured to receive, through the data connection channel, a control data packet sent by the server, where the control data packet includes the control instruction and a client code of the client, and parse the control data packet to obtain the control instruction.
16. The client of claim 13, wherein the client is configured to,
the second sending module is configured to send an interface data packet to the server through the data connection channel, where the interface data packet includes the interface data and a client code of the client.
17. The client of claim 13, further comprising:
the interface data processing module is used for carrying out resolution processing on the intercepted interface data, generating interface data after resolution processing, and carrying out compression processing on the interface data after resolution processing, so as to generate interface data after compression processing;
the first memory area is used for storing the interface data after resolution processing;
the second memory area is used for storing the interface data after the compression processing;
the reading module is used for regularly reading the first memory area, compressing the interface data after resolution processing by the interface data processing module if the interface data after resolution processing exists in the first memory area, regularly reading the second memory area, and transmitting the interface data after compression processing to the server by the second transmitting module if the interface data after compression processing exists in the second memory area.
18. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any one of claims 1 to 4 when the program is executed by the processor.
19. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any one of claims 5 to 8 when the program is executed by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910142476.1A CN111355767B (en) | 2019-02-26 | 2019-02-26 | Remote control method, server, client and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910142476.1A CN111355767B (en) | 2019-02-26 | 2019-02-26 | Remote control method, server, client and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111355767A CN111355767A (en) | 2020-06-30 |
| CN111355767B true CN111355767B (en) | 2023-04-25 |
Family
ID=71196924
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910142476.1A Active CN111355767B (en) | 2019-02-26 | 2019-02-26 | Remote control method, server, client and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111355767B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112604271A (en) * | 2020-12-07 | 2021-04-06 | 杭州雾联科技有限公司 | Cloud game system control method, device, equipment and readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102857726A (en) * | 2012-08-17 | 2013-01-02 | 北京君正集成电路股份有限公司 | Remote control method, terminal, opposite terminal and system based on synchronous display |
| CN104506907A (en) * | 2014-11-25 | 2015-04-08 | 上海众应信息科技有限公司 | A method and a system for interactive operation between a controlling end and multiple remote controlled terminals |
| CN105302412A (en) * | 2015-09-29 | 2016-02-03 | 小米科技有限责任公司 | Method and apparatus for displaying state of smart device |
| CN106033218A (en) * | 2015-03-19 | 2016-10-19 | 佛山市顺德区美的电热电器制造有限公司 | Control system and method of household electrical appliance |
-
2019
- 2019-02-26 CN CN201910142476.1A patent/CN111355767B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102857726A (en) * | 2012-08-17 | 2013-01-02 | 北京君正集成电路股份有限公司 | Remote control method, terminal, opposite terminal and system based on synchronous display |
| CN104506907A (en) * | 2014-11-25 | 2015-04-08 | 上海众应信息科技有限公司 | A method and a system for interactive operation between a controlling end and multiple remote controlled terminals |
| CN106033218A (en) * | 2015-03-19 | 2016-10-19 | 佛山市顺德区美的电热电器制造有限公司 | Control system and method of household electrical appliance |
| CN105302412A (en) * | 2015-09-29 | 2016-02-03 | 小米科技有限责任公司 | Method and apparatus for displaying state of smart device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111355767A (en) | 2020-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108600048B (en) | Interface testing method, device, equipment and computer readable storage medium | |
| CN109766082B (en) | Method and device for application program page jump | |
| EP3013015B1 (en) | Packet compression method and apparatus | |
| CN104412601B (en) | The system and method for accommodating the single KVM clients of a variety of different video compress techniques | |
| CN105005471A (en) | Method, device, server and system for modifying configuration parameters of BIOS | |
| CN109085950B (en) | Multi-screen interaction method and device based on electronic whiteboard and electronic whiteboard | |
| CN109510754B (en) | Online document generation method, device and system and electronic equipment | |
| EP2899956A1 (en) | Terminal pairing method, terminal and system | |
| CN103139609A (en) | Method and device for optimizing remote application video play | |
| CN111352912A (en) | Compressed file processing method, device, storage medium, terminal and server | |
| CN111885516A (en) | Multi-channel access short message configuration method and device, computer equipment and storage medium | |
| CN105159643A (en) | Two-dimensional code-based wireless screen transmission authentication method and system | |
| CN113114706B (en) | Multichannel Ethernet message processing method based on power chip | |
| CN110737711A (en) | Report exporting method and device, computer equipment and storage medium | |
| CN111355767B (en) | Remote control method, server, client and electronic equipment | |
| CN105515887A (en) | Application test method, server and system | |
| CN105376636A (en) | A verification code filling-in method, a verification code filling-in assisting method, an intelligent television set and an intelligent mobile terminal | |
| CN109788251B (en) | Video processing method, device and storage medium | |
| CN115208951A (en) | Request processing method and device, electronic equipment and computer readable storage medium | |
| CN104123244A (en) | USB redirection system and method | |
| CN104202432B (en) | Remote web management system and management method | |
| CN110781139A (en) | Teaching plan resource management system and method and electronic equipment | |
| CN112162718A (en) | Reverse interaction method, device, equipment and storage medium | |
| CN104391576A (en) | Remote input method and device based on wireless Ethernet | |
| CN113467776B (en) | Method and device for accessing equipment, storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |