CN111355767A - Remote control method, server, client and electronic equipment - Google Patents
Remote control method, server, client and electronic equipment Download PDFInfo
- Publication number
- CN111355767A CN111355767A CN201910142476.1A CN201910142476A CN111355767A CN 111355767 A CN111355767 A CN 111355767A CN 201910142476 A CN201910142476 A CN 201910142476A CN 111355767 A CN111355767 A CN 111355767A
- Authority
- CN
- China
- Prior art keywords
- interface
- control
- client
- data
- interface data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Telephonic Communication Services (AREA)
- Communication Control (AREA)
Abstract
The invention discloses a remote control method, a server, a client and electronic equipment, wherein the method comprises the following steps: creating at least one control interface, wherein the control interface comprises a client code; determining a client corresponding to the control interface according to the client code, and determining a data connection channel corresponding to the server and the client; executing control operation on at least one control interface, and determining a control instruction according to the control operation; sending the control instruction to a client corresponding to the control interface through a corresponding data connection channel; receiving interface data sent by at least one client; and displaying the interface data of the corresponding client on at least one control interface. The invention can realize the remote control of the control terminal and at least one controlled terminal and can be integrated in an operating system.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a remote control method, a server, a client, and an electronic device.
Background
An electronic whiteboard is an intelligent terminal widely applied to the fields of education and office, and a plurality of installed and deployed electronic whiteboards need to be controlled and managed in a unified manner through remote control sometimes. One of the existing remote control methods is to utilize a self-contained remote desktop service of a windows system, which can realize one-to-one remote control, cannot realize one-to-many remote control and only supports the windows system; the other is to install dedicated remote control software (such as TeamViewer and VNCViewer software), which is relatively sophisticated but independent of the operating system and requires authorization to use, thus increasing the cost.
Disclosure of Invention
In view of the above, an object of the present invention is to provide a remote control method, a server, a client and an electronic device, which can implement remote control of at least one client by the server and can be integrated in an operating system.
Based on the above purpose, the present invention provides a remote control method, which is applied to a server side, and the method includes:
creating at least one control interface, wherein the control interface comprises a client code;
determining a client corresponding to the control interface according to the client code, and determining a data connection channel corresponding to the server and the client;
executing control operation on the at least one control interface, and determining a control instruction according to the control operation;
sending the control instruction to a client corresponding to the control interface through a corresponding data connection channel;
receiving interface data sent by at least one client;
and displaying the interface data of the corresponding client on the at least one control interface.
Optionally, a control data packet is sent to the client corresponding to the control interface, where the control data packet includes the control instruction and the client code.
Optionally, the interface data packet sent by the client is received, the decoded data packet is analyzed, the interface data and the client code are obtained, the corresponding control interface is determined according to the client code, and the interface data is displayed on the control interface.
Optionally, the client decompresses the interface data to generate decompressed interface data, the server receives the interface data sent by the client, processes the decompressed interface data to generate interface data suitable for being displayed by the control interface, and displays the interface data suitable for being displayed by the control interface on the control interface.
Optionally, the method further includes: receiving a control return sent by at least one client, wherein the control return comprises attribute information of the interface data and a processing method of the interface data, setting the attribute of the control interface according to the attribute information of the interface data, and configuring the received processing method of the interface data according to the processing method of the interface data.
The embodiment of the invention also provides a remote control method which is applied to the client and comprises the following steps:
establishing a data connection channel with a server;
receiving a control instruction sent by the server through the data connection channel;
executing corresponding operation according to the control instruction;
intercepting interface data of a current display interface;
and sending interface data to the server through the data connection channel.
Optionally, the control data packet sent by the server is received, and the control data packet is analyzed to obtain the control instruction.
Optionally, an interface data packet is sent to the server, where the interface data packet includes interface data and a client code of the client.
Optionally, the method includes: the interface data is intercepted regularly, the intercepted interface data is subjected to resolution processing, the interface data after resolution processing is stored in a first memory area, the first memory area is read regularly, if the interface data after resolution processing exists in the first memory area, the interface data after resolution processing is compressed, the interface data after compression processing is stored in a second memory area, the second memory area is read regularly, and if the interface data after compression processing exists in the second memory area, the interface data after compression processing is sent to the server side.
Optionally, the method further includes sending a control return data packet to the server, where the control return data packet includes the attribute information of the interface data and the processing method of the interface data.
An embodiment of the present invention further provides a server, including:
the interface creating module is used for creating at least one control interface, and the control interface comprises client codes;
the first network connection module is used for determining a client corresponding to the control interface according to the client code and determining a data connection channel corresponding to the server and the client;
the instruction acquisition module is used for determining a control instruction according to the control operation when the at least one control interface executes the control operation;
the first sending module is used for sending the control instruction to a client corresponding to the control interface through a corresponding data connection channel;
the first receiving module is used for receiving interface data sent by at least one client;
and the display processing module is used for displaying the interface data of the corresponding client on the at least one control interface.
Optionally, the server is integrated in the operating system as a remote control server.
Optionally, the first sending module is configured to send a control data packet to a client corresponding to the control interface through a corresponding data connection channel, where the control data packet includes the control instruction and the client code.
Optionally, the first receiving module is configured to receive an interface data packet sent by at least one client, where the interface data packet includes the interface data and the client code, analyze the interface data packet, obtain the interface data and the client code, and determine a corresponding control interface according to the client code.
Optionally, the display processing module is configured to process the received interface data, generate interface data suitable for the control interface to display, and display the interface data suitable for the control interface to display on the corresponding control interface.
Optionally, the server further includes:
the first receiving module is used for receiving a control return data packet sent by at least one client, wherein the control return data packet comprises attribute information of the interface data and a processing method of the interface data;
and the setting module is used for setting the attribute of the control interface according to the attribute information of the interface data and configuring the processing method of the received interface data according to the processing method of the interface data.
An embodiment of the present invention further provides a client, including:
the second network connection module is used for establishing a data connection channel with the server;
the second receiving module is used for receiving the control instruction sent by the server through the data connection channel;
the execution module is used for executing corresponding operation according to the control instruction;
the intercepting module is used for intercepting the interface data of the current display interface;
and the second sending module is used for sending the interface data to the server through the data connection channel.
Optionally, the client is integrated in the operating system as a remote controlled end service.
Optionally, the second receiving module is configured to receive, through the data connection channel, a control data packet sent by the server, where the control data packet includes the control instruction and a client code of the client, and the control data packet is analyzed to obtain the control instruction.
Optionally, the second sending module is configured to send an interface data packet to the server through the data connection channel, where the interface data packet includes the interface data and the client code of the client.
Optionally, the client further includes:
the interface data processing module is used for carrying out resolution processing on the intercepted interface data to generate interface data after resolution processing, and carrying out compression processing on the interface data after resolution processing to generate interface data after compression processing;
the first memory area is used for storing the interface data after resolution processing;
the second memory area is used for storing the interface data after the compression processing;
the reading module is used for regularly reading the first memory area, if the interface data processed by the resolution ratio exists in the first memory area, the interface data processing module compresses the interface data processed by the resolution ratio, and regularly reading the second memory area, and if the interface data processed by the compression ratio exists in the second memory area, the second sending module sends the compressed interface data to the server.
Optionally, the second sending module is configured to send a control return data packet to the server, where the control return data packet includes attribute information of the interface data and a processing method of the interface data.
The embodiment of the invention also provides electronic equipment which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, and is characterized in that the processor realizes the remote control method when executing the program.
As can be seen from the above description, in the remote control method, the server, the client and the electronic device provided by the present invention, the server creates at least one control interface, each control interface determines a corresponding client through different client codes, executes a control operation through the control interface, can control the corresponding client to execute the corresponding operation, and can display interface data on the corresponding control interface by receiving the interface data of the client. The invention can realize the remote control of the control terminal and at least one controlled terminal, and the control terminal can respectively remotely control a plurality of controlled terminals through corresponding control interfaces; moreover, the server and the client can be integrated in an operating system as a system service, and the operating system can be a windows system, a linux system and the like.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flow chart of a remote control method of a server according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a remote control method of a client according to an embodiment of the present invention;
FIG. 3 is a flow chart of a remote control method according to an embodiment of the present invention;
FIG. 4 is a block diagram of a server according to an embodiment of the present invention;
fig. 5 is a block diagram of a client according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to specific embodiments and the accompanying drawings.
It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it should be noted that "first" and "second" are merely for convenience of description and should not be construed as limitations of the embodiments of the present invention, and they are not described in any more detail in the following embodiments.
Fig. 1 is a flowchart illustrating a remote control method of a server according to an embodiment of the present invention. As shown in the figure, the remote control method disclosed by the invention can realize the remote control of the server to at least one client, and the remote control method applied to the server comprises the following steps:
the server side creates at least one control interface, and the control interface comprises a client side code;
determining a client corresponding to the control interface according to the client code, and determining a data connection channel corresponding to the server and the client;
executing control operation on at least one control interface, and determining a control instruction according to the control operation;
sending the control instruction to a client corresponding to the control interface through a corresponding data connection channel;
receiving interface data sent by at least one client;
and displaying the interface data of the corresponding client on at least one control interface.
As shown in fig. 1, the remote control method applied to the server according to the embodiment of the present invention includes:
s10: the server side creates at least one control interface, the control interface comprises client side codes, the number of the control interfaces is consistent with that of the client sides, and the client sides correspond to the control interfaces one to one;
s11: determining a client corresponding to the control interface according to the client code, and determining at least one data connection channel between the server and at least one client;
and the server side establishes a control interface, and the client side is remotely controlled through the control interface. The control interface created by the server side is provided with an address identifier, the address identifier comprises a network address of the server side and a client code, and the remote control client corresponding to the control interface can be determined according to the client code of the control interface.
The server creates a first control interface, the first control interface is provided with a first address identifier comprising a first client code, the first client code corresponds to the first client, and the server can remotely control the first client through the first control interface. That is, when the server creates a first control interface, the first control interface includes a first client code, a first data connection channel between the server and the first client is determined according to the first client code, when a control operation is executed on the first control interface, a corresponding control instruction can be sent to the first client through the first data connection channel, and interface data of the first client is sent to the server through the first data connection channel and displayed on the first control interface.
When the server needs to remotely control a plurality of clients respectively, the server creates a plurality of control interfaces with the same number as the clients, each control interface has an address identifier, the client codes of the address identifiers correspond to different clients respectively, and the server can remotely control the clients through the control interfaces. The method comprises the steps that a server side creates a plurality of control interfaces, each control interface is provided with different client codes, a data connection channel between the server side and each client is determined according to each client code, when control operation is executed on each control interface, a control instruction generated by each control interface is sent to the corresponding client through the corresponding data connection channel between the server side and each client, and interface data of each client is sent to the server side through the corresponding data connection channel and displayed on the corresponding control interface.
It should be noted that, the server performs remote control on a plurality of clients through corresponding control interfaces, and the server may also perform simultaneous control on the control interfaces through a synchronous control module, so as to implement synchronous remote control on each client by the server.
S12: executing control operation on at least one control interface, and determining a control instruction according to the control operation;
s13: sending the control instruction to a client corresponding to the control interface through a corresponding data connection channel;
and executing remote control operation on the client on the control interface, and acquiring an operation event and an operation instruction according to the control operation on the control interface. The control operation comprises mouse operation, keyboard operation, file operation and the like, wherein the mouse operation comprises left key/right key movement, pressing, releasing and the like, and the corresponding mouse control instruction comprises left key/right key movement, pressing, releasing, coordinate values and the like; the keyboard operation comprises pressing, releasing and the like, the corresponding keyboard control instruction comprises pressing, releasing, key coding and the like, the file operation comprises copying, pasting and the like, and the corresponding file control instruction comprises copying, pasting, file content data and the like.
And executing control operation on the control interface, determining a corresponding operation instruction, sending the operation instruction to a corresponding client through a corresponding data connection channel, receiving the operation instruction by the client, and executing a corresponding operation action according to the operation instruction.
In one embodiment, the server and the client establish a data connection channel based on a TCP communication protocol. A control instruction sent by a server to a client is packaged into a control data packet conforming to a TCP (transmission control protocol), the control data packet comprises a client code, the client is determined according to the client code, and a data connection channel corresponding to the server and the client is determined; and the interface data sent by the client is packaged into an interface data packet conforming to a TCP (transmission control protocol), the interface data packet comprises a client code, a control interface created by the server is determined according to the client code, and the interface data is displayed on the control interface.
The interface data packet/control data packet conforming to the TCP protocol has the following data format:
| message header | Message type | Client code length | Client side encoding | Data length | Data content |
The meaning of each field in the data format is as follows:
the message header is used for identifying the data packet as a data packet interacted between the server side and the client side; the message header field occupies 6 bytes;
the message type comprises heartbeat detection, control request, control return, screenshot uploading and the like, and different field values are defined in different types; the message type field occupies 1 byte;
the server side and the client side regularly exchange data packets with the message type of heartbeat detection to detect the data connection state of the two sides. And after the server executes the control operation, sending a data packet with the message type of a control request and the data content of a control instruction to the client.
After executing corresponding operation, the client sends a data packet of attribute information such as control return, size and width of intercepted interface data of data content, data compression method identification, color setting identification and the like to the server; meanwhile, the client side starts to execute screenshot operation, interface data are intercepted, resolution processing, compression processing and the like are carried out on the intercepted interface data, processed interface data are generated, and the client side sends a data packet with the message type of screenshot uploading and the data content of the processed interface data to the server.
The server side sets various attributes of a control interface of the server side according to received message types as a data packet returned by the control, and sets a corresponding decompression method according to various attribute information in data contents. And the server side decompresses the processed interface data and displays the interface data on the control interface according to the data packet uploaded by the received message type as the screenshot.
The length of the client code, and the length field of the client code occupy 4 bytes;
and the client code is that the data packet is from a server or a client, if the data packet is from the client, the source identifier is the client code, and if the data packet is from the server, the source identifier is the client code of the controlled end.
The data length, the length of the data content, and the data length field occupies 4 bytes;
the data content is interactive data between the server and the client, if the interactive data comes from the server (a data packet sent by the server to the client), the interactive data is a control instruction, and if the interactive data comes from the client (a data packet sent by the client to the server), the interactive data is attribute information of interface data or processed interface data.
S14: receiving interface data sent by at least one client;
s15: and displaying the interface data of the corresponding client on at least one control interface.
The first client side intercepts first interface data of a display interface of the first client side at regular time, and sends the intercepted first interface data to the server side. The first client sends the first interface data to the server through the first data connection channel, and the server receives the first interface data and displays the first interface data on the first control interface. For a plurality of clients, each client respectively intercepts interface data of each display interface at regular time, each interface data is sent to a server through a corresponding data connection channel, and the server receives each interface data and respectively displays each interface data on a corresponding control interface.
Considering that the resolution ratio of the display screens of the client and the server is possibly different, the client intercepts the interface data at regular time, and processes the intercepted interface data into the interface data adaptive to the resolution ratio of the display screen of the server according to the resolution ratio of the display screen of the server. Furthermore, in order to improve the data transmission efficiency, the interface data processed by the resolution ratio is compressed and then sent to the server. The server receives the interface data, decompresses the interface data, processes the decompressed interface data into interface data suitable for the control interface display, and displays the processed interface data on the control interface.
The step S10 is preceded by: and starting the server. In the embodiment of the present invention, the server and the client may be integrated as a system service (corresponding to the remote control service and the remote controlled service, respectively) in the operating system, when the remote control function is used, the remote control service is started at the control terminal, the remote controlled service is started at the controlled terminal, and after the remote control service is started, the control terminal performs remote control on at least one controlled terminal according to steps S10-S14.
The operating system can be a windows operating system, a linux operating system and the like, a server of a windows version is integrated in the windows operating system of the control terminal as a remote control end service, a client of the windows version is integrated in the windows operating system of the controlled terminal as a remote controlled end service, and after the service is started, the remote control of the control terminal on the controlled terminal can be realized. The linux version server is integrated in a linux operating system of the control terminal as a remote control terminal service, the linux version client is integrated in a linux operating system of the controlled terminal as a remote controlled terminal service, and after the service is started, the control terminal can remotely control the controlled terminal.
Fig. 2 is a flowchart illustrating a remote control method of a client according to an embodiment of the present invention. As shown in the figure, the remote control method applied to the client according to the embodiment of the present invention includes:
s20: establishing a data connection channel with a server;
s21: receiving a control instruction through a data connection channel;
s22: executing corresponding operation according to the control instruction;
the method comprises the steps that a data connection channel is established between a client and a server through network communication, the server establishes a control interface comprising a client code, the client code corresponds to the client, the data connection channel between the server and the client is determined according to the client code, when the server executes control operation on the control interface, a generated control instruction is sent to the corresponding client through the data connection channel, the client receives the control instruction, and corresponding operation is executed on a display interface according to the control instruction.
S23: intercepting interface data of a current display interface;
s24: and sending the interface data through the data connection channel.
Considering the possible difference in resolution between the display screens of the client and the server, the client intercepts the interface data of the current interface at regular time, and performs resolution processing (such as clipping) on the intercepted interface data according to the resolution of the display screen of the server to generate interface data adapted to the resolution of the display screen of the server. Furthermore, in order to improve the data transmission efficiency, the interface data processed by the resolution ratio is compressed, and the compressed interface data is sent to the server.
The server receives the interface data, decompresses the interface data, processes the decompressed interface data into interface data suitable for the control interface display, and displays the processed interface data on the corresponding control interface.
The step S20 is preceded by: and starting the client. In the embodiment of the present invention, the server and the client may be integrated as a system service (corresponding to the remote control service and the remote controlled service, respectively) in the operating system, when the remote control function is used, the remote control service is started at the control terminal, the remote controlled service is started at the controlled terminal, and after the remote control function is started, the controlled terminal implements remote control with the control terminal according to steps S20-S24.
Fig. 3 is a flowchart illustrating a remote control method according to an embodiment of the present invention. As shown in the figure, in the remote control method disclosed in the embodiment of the present invention, the server serves as a remote control end in an operating system of the control terminal, and the client serves as a remote controlled end in an operating system of the controlled terminal. The server side creates control interfaces, the number of the created control interfaces is consistent with the number of the clients to be remotely controlled, the address identification of each control interface respectively comprises a client code of each client, a data connection channel corresponding to the server side and each client is determined according to the client code, and the data connection channel corresponding to the server side and each client is opened.
The server executes control operation on the control interface, determines a control instruction according to the control operation, packages the control instruction into a control data packet conforming to a TCP (transmission control protocol), the control data packet comprises the control instruction and a client code, sends the control data packet to a client corresponding to the client code through a data connection channel, receives the control data packet by the client, analyzes the control data packet to obtain the control instruction, and executes corresponding operation such as mouse operation, keyboard operation, file operation and the like according to the control instruction.
The client receives the control data packet, sends a control return data packet comprising data contents such as attribute information of interface data and a processing method to the server, and the server sets the attribute of the control interface and configures the processing method of the interface data according to the received control return data packet. At the same time, the user can select the desired position,
the client side intercepts interface data of a current display interface of the client side at regular time, carries out resolution processing on the intercepted interface data, generates interface data after resolution processing, and stores the interface data after resolution processing in a first memory area; checking whether the first memory area has the interface data after resolution processing at regular time, if so, reading the interface data after resolution processing, compressing the interface data after resolution processing to generate compressed interface data, and storing the compressed interface data in a second memory area; and checking whether the second memory area has the compressed interface data at regular time, if so, reading the compressed interface data, packaging the compressed interface data into an interface data packet conforming to a TCP (transmission control protocol), wherein the interface data packet comprises the interface data and a client code, and sending the interface data packet to a server.
The server receives the interface data packet, analyzes the interface data packet, acquires compressed interface data and client codes, decompresses the compressed interface data to generate interface data, performs drawing processing on the interface data to generate interface data suitable for being displayed on a control interface, determines a corresponding control interface according to the client codes, and displays the interface data on the corresponding control interface.
After the remote control of the control terminal and the controlled terminal is finished, the remote control end service and the remote controlled end service are closed, and the operation is convenient. The remote control end service and the remote controlled end service occupy small space, are convenient to integrate in a system, have system compatibility and can realize the remote control function of one control terminal to at least one controlled terminal.
Fig. 4 is a block diagram of a server according to an embodiment of the present invention. As shown in the figure, the server disclosed in the embodiment of the present invention includes:
the interface creating module is used for creating at least one control interface, the control interface comprises client codes, the number of the control interfaces is consistent with that of the clients, and the clients correspond to the control interfaces one to one;
the first network connection module is used for determining a client corresponding to the control interface according to the client code and determining a data connection channel corresponding to the server and the client;
the instruction acquisition module is used for determining a control instruction according to the control operation when at least one control interface executes the control operation;
the first sending module is used for sending the control instruction to the client corresponding to the control interface through the corresponding data connection channel;
the first receiving module is used for receiving interface data sent by at least one client;
and the display processing module is used for displaying the interface data of the corresponding client on at least one control interface.
In the embodiment of the invention, an interface creating module of a server creates control interfaces with the same number as that of clients according to the number of the clients, each control interface comprises an address identifier, the address identifier comprises a server address and a client code, and a first network connection module determines the client corresponding to the control interface through the client code and determines a data connection channel between the server and the client. The server executes control operation on the control interface, the instruction acquisition module determines a control instruction according to the control operation, the first sending module sends the control instruction to the corresponding client through a data connection channel between the server and the client, and the client receives the control instruction and executes corresponding operation according to the control instruction. Meanwhile, the client intercepts the interface data of the current display interface of the client at regular time, the interface data is sent to the server through the data connection channel, the first receiving module of the server receives the interface data, and the display processing module displays the interface data on the corresponding control interface of the client.
In the embodiment of the invention, the interactive data of the server and the client is a data packet conforming to a TCP protocol, wherein,
the first sending module is used for packaging the control instruction into a control data packet and sending the control data packet to a client corresponding to the control interface through a corresponding data connection channel;
the first receiving module is used for receiving the interface data packet sent by at least one client, analyzing the interface data packet and acquiring interface data and client codes.
And after the server executes the control operation on the control interface, determining a control instruction, packaging the control instruction into a control data packet, wherein the control data packet comprises a client code and a control instruction of the control interface, and sending the control data packet to a client corresponding to the client code. The server receives the interface data packet sent by the client, analyzes the interface data, acquires the client code in the interface data packet, determines the corresponding control interface according to the client code, and displays the interface data on the corresponding control interface.
The display processing module is used for processing the received interface data, generating interface data suitable for controlling interface display, and displaying the interface data suitable for controlling interface display on the corresponding control interface.
The display processing module decompresses the received interface data to generate decompressed interface data, then processes the decompressed interface data to generate interface data suitable for controlling interface display, and displays the interface data on the control interface.
In the embodiment of the invention, the first network connection module is used for establishing a data connection channel between the client and the server when the server is started, determining the client corresponding to the control interface according to the client code, determining the data connection channel between the server and the client, and opening the data connection channel between the server and the client.
In the embodiment of the present invention, the server further includes:
the first receiving module is used for receiving a control return data packet sent by at least one client, and the control return data comprises attribute information of interface data and a processing method of the interface data; the attribute information comprises the size, width, height and the like of the interface data, and the processing method of the interface data comprises a compression method.
And the setting module is used for setting the attribute of the control interface according to the attribute information of the interface data and configuring the received processing method of the interface data according to the processing method of the interface data.
Fig. 5 is a block diagram of a client according to an embodiment of the present invention. As shown in the figure, the client disclosed in the embodiment of the present invention includes:
the second network connection module is used for establishing a data connection channel with the server;
the second receiving module is used for receiving the control instruction sent by the server through the data connection channel;
the execution module is used for executing corresponding operation according to the control instruction;
the intercepting module is used for intercepting the interface data of the current display interface;
and the second sending module is used for sending the interface data to the server through the data connection channel.
In the embodiment of the invention, the client establishes a data connection channel with the server through the second network connection module, when the server executes control operation on the control interface, the second receiving module is used for receiving the control instruction sent by the server, and the execution module executes corresponding operation on the client according to the received control instruction. Meanwhile, an intercepting module of the client intercepts interface data of a current display interface of the client at regular time, and the interface data is sent to the server through a second sending module.
In the embodiment of the invention, the interactive data of the server and the client is a data packet conforming to a TCP protocol, wherein,
the second receiving module is used for receiving the control data packet sent by the server through the data connection channel, analyzing the control data packet and acquiring a control instruction;
and the second sending module is used for packaging the interface data into an interface data packet and sending the interface data packet to the server through the data connection channel.
The client intercepts the interface data at regular time, packages the interface data into an interface data packet, and sends the interface data packet to the server. The client receives the control data packet sent by the server, analyzes the control data packet, acquires a control instruction, and executes corresponding operation according to the control instruction.
The client further comprises:
the interface data processing module is used for carrying out resolution processing on the intercepted interface data to generate interface data after resolution processing, and carrying out compression processing on the interface data after resolution processing to generate interface data after compression processing;
the first memory area is used for storing the interface data after resolution processing;
the second memory area is used for storing the interface data after the compression processing;
the reading module is used for regularly reading the first memory area, if the first memory area has the interface data after resolution processing, the interface data processing module compresses the interface data after resolution processing, and regularly reads the second memory area, and if the second memory area has the interface data after compression processing, the second sending module sends the interface data after compression processing to the server.
The second sending module is further configured to send a control return data packet to the server, where the control return data packet includes attribute information of the interface data and a processing method of the interface data.
In view of the above object, an embodiment of the present invention further provides an apparatus for executing the remote control method. The device comprises:
one or more processors, and a memory.
The apparatus for performing the remote control method may further include: an input device and an output device.
The processor, memory, input device, and output device may be connected by a bus or other means.
The memory, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as program instructions/modules corresponding to the remote control method in the embodiments of the present invention. The processor executes various functional applications of the server and data processing by running nonvolatile software programs, instructions and modules stored in the memory, that is, the remote control method of the above-described method embodiment is realized.
The memory may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of a device performing the remote control method, and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, the memory optionally includes memory remotely located from the processor, and these remote memories may be connected to the member user behavior monitoring device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device may receive input numeric or character information and generate key signal inputs related to user settings and function control of the device performing the remote control method. The output device may include a display device such as a display screen.
The one or more modules are stored in the memory and, when executed by the one or more processors, perform the remote control method of any of the method embodiments described above. The technical effect of the embodiment of the device for executing the remote control method is the same as or similar to that of any method embodiment.
The embodiment of the invention also provides a non-transitory computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions can execute the processing method of the list item operation in any method embodiment. Embodiments of the non-transitory computer storage medium may be the same or similar in technical effect to any of the method embodiments described above.
Finally, it should be noted that, as will be understood by those skilled in the art, all or part of the processes in the methods of the above embodiments may be implemented by a computer program that can be stored in a computer-readable storage medium and that, when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like. The technical effect of the embodiment of the computer program is the same as or similar to that of any of the method embodiments described above.
Furthermore, the apparatuses, devices, etc. described in the present disclosure may be various electronic terminal devices, such as a mobile phone, a Personal Digital Assistant (PDA), a tablet computer (PAD), a smart television, etc., and may also be large terminal devices, such as a server, etc., and therefore the scope of protection of the present disclosure should not be limited to a specific type of apparatus, device. The client disclosed by the present disclosure may be applied to any one of the above electronic terminal devices in the form of electronic hardware, computer software, or a combination of both.
Furthermore, the method according to the present disclosure may also be implemented as a computer program executed by a CPU, which may be stored in a computer-readable storage medium. The computer program, when executed by the CPU, performs the above-described functions defined in the method of the present disclosure.
Further, the above method steps and system elements may also be implemented using a controller and a computer readable storage medium for storing a computer program for causing the controller to implement the functions of the above steps or elements.
Further, it should be appreciated that the computer-readable storage media (e.g., memory) described herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. By way of example, and not limitation, nonvolatile memory can include Read Only Memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which can act as external cache memory. By way of example and not limitation, RAM is available in a variety of forms such as synchronous RAM (DRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The storage devices of the disclosed aspects are intended to comprise, without being limited to, these and other suitable types of memory.
The apparatus of the foregoing embodiment is used to implement the corresponding method in the foregoing embodiment, and has the beneficial effects of the corresponding method embodiment, which are not described herein again.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, is limited to these examples; within the idea of the invention, also features in the above embodiments or in different embodiments may be combined, steps may be implemented in any order, and there are many other variations of the different aspects of the invention as described above, which are not provided in detail for the sake of brevity.
In addition, well known power/ground connections to Integrated Circuit (IC) chips and other components may or may not be shown within the provided figures for simplicity of illustration and discussion, and so as not to obscure the invention. Furthermore, devices may be shown in block diagram form in order to avoid obscuring the invention, and also in view of the fact that specifics with respect to implementation of such block diagram devices are highly dependent upon the platform within which the present invention is to be implemented (i.e., specifics should be well within purview of one skilled in the art). Where specific details (e.g., circuits) are set forth in order to describe example embodiments of the invention, it should be apparent to one skilled in the art that the invention can be practiced without, or with variation of, these specific details. Accordingly, the description is to be regarded as illustrative instead of restrictive.
While the present invention has been described in conjunction with specific embodiments thereof, many alternatives, modifications, and variations of these embodiments will be apparent to those of ordinary skill in the art in light of the foregoing description. For example, other memory architectures (e.g., dynamic ram (dram)) may use the discussed embodiments.
The embodiments of the invention are intended to embrace all such alternatives, modifications and variances that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, substitutions, improvements and the like that may be made without departing from the spirit and principles of the invention are intended to be included within the scope of the invention.
Claims (24)
1. A remote control method is applied to a server side, and is characterized in that the method comprises the following steps:
creating at least one control interface, wherein the control interface comprises a client code;
determining a client corresponding to the control interface according to the client code, and determining a data connection channel corresponding to the server and the client;
executing control operation on the at least one control interface, and determining a control instruction according to the control operation;
sending the control instruction to a client corresponding to the control interface through a corresponding data connection channel;
receiving interface data sent by at least one client;
and displaying the interface data of the corresponding client on the at least one control interface.
2. The method of claim 1, wherein a control packet is sent to a client corresponding to the control interface, wherein the control packet comprises the control instruction encoded with the client.
3. The method according to claim 1, wherein an interface data packet sent by the client is received, the decoded data packet is analyzed, the interface data and the client code are obtained, the corresponding control interface is determined according to the client code, and the interface data is displayed on the control interface.
4. The method according to claim 1, wherein the client decompresses the interface data to generate decompressed interface data, the server receives the interface data sent by the client, processes the decompressed interface data to generate interface data suitable for the control interface to display, and the interface data suitable for the control interface to display is displayed on the control interface.
5. The method of claim 1, further comprising: receiving a control return sent by at least one client, wherein the control return comprises attribute information of the interface data and a processing method of the interface data, setting the attribute of the control interface according to the attribute information of the interface data, and configuring the received processing method of the interface data according to the processing method of the interface data.
6. A remote control method is applied to a client, and is characterized by comprising the following steps:
establishing a data connection channel with a server;
receiving a control instruction sent by the server through the data connection channel;
executing corresponding operation according to the control instruction;
intercepting interface data of a current display interface;
and sending interface data to the server through the data connection channel.
7. The method according to claim 6, wherein a control data packet sent by the server is received, and the control data packet is parsed to obtain the control command.
8. The method of claim 6, wherein an interface data packet is sent to the server, and the interface data packet comprises interface data and a client code of the client.
9. The method of claim 6, comprising: the interface data is intercepted regularly, the intercepted interface data is subjected to resolution processing, the interface data after resolution processing is stored in a first memory area, the first memory area is read regularly, if the interface data after resolution processing exists in the first memory area, the interface data after resolution processing is compressed, the interface data after compression processing is stored in a second memory area, the second memory area is read regularly, and if the interface data after compression processing exists in the second memory area, the interface data after compression processing is sent to the server side.
10. The method according to claim 6, further comprising sending a control return data packet to the server, wherein the control return data packet includes attribute information of the interface data and a processing method of the interface data.
11. A server, comprising:
the interface creating module is used for creating at least one control interface, and the control interface comprises client codes;
the first network connection module is used for determining a client corresponding to the control interface according to the client code and determining a data connection channel corresponding to the server and the client;
the instruction acquisition module is used for determining a control instruction according to the control operation when the at least one control interface executes the control operation;
the first sending module is used for sending the control instruction to a client corresponding to the control interface through a corresponding data connection channel;
the first receiving module is used for receiving interface data sent by at least one client;
and the display processing module is used for displaying the interface data of the corresponding client on the at least one control interface.
12. The server according to claim 11, wherein the server is integrated as a remote control service in an operating system.
13. The server according to claim 11,
the first sending module is used for sending a control data packet to a client corresponding to the control interface through a corresponding data connection channel, wherein the control data packet comprises the control instruction and the client code.
14. The server according to claim 11,
the first receiving module is used for receiving an interface data packet sent by at least one client, analyzing the interface data packet to obtain the interface data and the client code, and determining a corresponding control interface according to the client code.
15. The server according to claim 11,
the display processing module is used for processing the received interface data, generating interface data suitable for the control interface to display, and displaying the interface data suitable for the control interface to display on the corresponding control interface.
16. The server according to claim 11, further comprising:
the first receiving module is used for receiving a control return data packet sent by at least one client, wherein the control return data packet comprises attribute information of the interface data and a processing method of the interface data;
and the setting module is used for setting the attribute of the control interface according to the attribute information of the interface data and configuring the processing method of the received interface data according to the processing method of the interface data.
17. A client, comprising:
the second network connection module is used for establishing a data connection channel with the server;
the second receiving module is used for receiving the control instruction sent by the server through the data connection channel;
the execution module is used for executing corresponding operation according to the control instruction;
the intercepting module is used for intercepting the interface data of the current display interface;
and the second sending module is used for sending the interface data to the server through the data connection channel.
18. The client of claim 17, wherein the client is integrated into an operating system as a remotely controlled end service.
19. The client of claim 17,
the second receiving module is configured to receive a control data packet sent by the server through the data connection channel, where the control data packet includes the control instruction and a client code of the client, and parse the control data packet to obtain the control instruction.
20. The client of claim 17,
and the second sending module is used for sending an interface data packet to the server through the data connection channel, wherein the interface data packet comprises the interface data and the client code of the client.
21. The client of claim 17, further comprising:
the interface data processing module is used for carrying out resolution processing on the intercepted interface data to generate interface data after resolution processing, and carrying out compression processing on the interface data after resolution processing to generate interface data after compression processing;
the first memory area is used for storing the interface data after resolution processing;
the second memory area is used for storing the interface data after the compression processing;
the reading module is used for regularly reading the first memory area, if the interface data processed by the resolution ratio exists in the first memory area, the interface data processing module compresses the interface data processed by the resolution ratio, and regularly reading the second memory area, and if the interface data processed by the compression ratio exists in the second memory area, the second sending module sends the compressed interface data to the server.
22. The client of claim 17,
and the second sending module is used for sending a control return data packet to the server, wherein the control return data packet comprises attribute information of the interface data and a processing method of the interface data.
23. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 1 to 5 when executing the program.
24. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 6 to 10 when executing the program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910142476.1A CN111355767B (en) | 2019-02-26 | 2019-02-26 | Remote control method, server, client and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910142476.1A CN111355767B (en) | 2019-02-26 | 2019-02-26 | Remote control method, server, client and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111355767A true CN111355767A (en) | 2020-06-30 |
| CN111355767B CN111355767B (en) | 2023-04-25 |
Family
ID=71196924
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910142476.1A Active CN111355767B (en) | 2019-02-26 | 2019-02-26 | Remote control method, server, client and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111355767B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112604271A (en) * | 2020-12-07 | 2021-04-06 | 杭州雾联科技有限公司 | Cloud game system control method, device, equipment and readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102857726A (en) * | 2012-08-17 | 2013-01-02 | 北京君正集成电路股份有限公司 | Remote control method, terminal, opposite terminal and system based on synchronous display |
| CN104506907A (en) * | 2014-11-25 | 2015-04-08 | 上海众应信息科技有限公司 | A method and a system for interactive operation between a controlling end and multiple remote controlled terminals |
| CN105302412A (en) * | 2015-09-29 | 2016-02-03 | 小米科技有限责任公司 | Method and apparatus for displaying state of smart device |
| CN106033218A (en) * | 2015-03-19 | 2016-10-19 | 佛山市顺德区美的电热电器制造有限公司 | Control system and method of household electrical appliance |
-
2019
- 2019-02-26 CN CN201910142476.1A patent/CN111355767B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102857726A (en) * | 2012-08-17 | 2013-01-02 | 北京君正集成电路股份有限公司 | Remote control method, terminal, opposite terminal and system based on synchronous display |
| CN104506907A (en) * | 2014-11-25 | 2015-04-08 | 上海众应信息科技有限公司 | A method and a system for interactive operation between a controlling end and multiple remote controlled terminals |
| CN106033218A (en) * | 2015-03-19 | 2016-10-19 | 佛山市顺德区美的电热电器制造有限公司 | Control system and method of household electrical appliance |
| CN105302412A (en) * | 2015-09-29 | 2016-02-03 | 小米科技有限责任公司 | Method and apparatus for displaying state of smart device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112604271A (en) * | 2020-12-07 | 2021-04-06 | 杭州雾联科技有限公司 | Cloud game system control method, device, equipment and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111355767B (en) | 2023-04-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3013015B1 (en) | Packet compression method and apparatus | |
| CN109085950B (en) | Multi-screen interaction method and device based on electronic whiteboard and electronic whiteboard | |
| US20150289301A1 (en) | Terminal matching method, terminal and system | |
| WO2014206347A1 (en) | Cross-terminal input method, apparatus and system | |
| CN105721462A (en) | Information pushing method and device | |
| EP3131303B1 (en) | Method and device for transmitting data in intelligent terminal to television terminal | |
| CN103139609A (en) | Method and device for optimizing remote application video play | |
| CN112653913A (en) | Screen projection method and device, client device and readable storage medium | |
| CN109922049B (en) | Verification device and method based on block chain | |
| CN105159643A (en) | Two-dimensional code-based wireless screen transmission authentication method and system | |
| CN111062189A (en) | Data analysis method and device and electronic equipment | |
| CN105141567A (en) | Interactive data processing method and system of terminal application and service end and interaction method | |
| CN105207975A (en) | Data transmission method and data transmission system for USB image equipment under VDI architecture | |
| CN112202939A (en) | Method, device and storage medium for compressing and decompressing IP address and transmitting and receiving message | |
| CN110781139A (en) | Teaching plan resource management system and method and electronic equipment | |
| CN104639501B (en) | A kind of method of data stream transmitting, equipment and system | |
| CN111355767B (en) | Remote control method, server, client and electronic equipment | |
| CN106445353A (en) | Display method and device of super-large pictures and electronic equipment | |
| CN108512889B (en) | Application response pushing method based on HTTP and proxy server | |
| CN104202432B (en) | Remote web management system and management method | |
| CN104123244A (en) | USB redirection system and method | |
| CN108132767B (en) | Application window preview method and system | |
| CN115643310B (en) | Method, device and system for compressing data | |
| CN107318129B (en) | Data processing method and device and terminal | |
| CN113467776B (en) | Method and device for accessing equipment, storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |