CN116366625A - IPKVM-based remote automatic control system, method and electronic equipment - Google Patents
IPKVM-based remote automatic control system, method and electronic equipment Download PDFInfo
- Publication number
- CN116366625A CN116366625A CN202310173107.5A CN202310173107A CN116366625A CN 116366625 A CN116366625 A CN 116366625A CN 202310173107 A CN202310173107 A CN 202310173107A CN 116366625 A CN116366625 A CN 116366625A
- Authority
- CN
- China
- Prior art keywords
- key feature
- server
- data
- key
- remote server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 62
- 238000004891 communication Methods 0.000 claims abstract description 19
- 238000013507 mapping Methods 0.000 claims description 19
- 230000002159 abnormal effect Effects 0.000 claims description 16
- 238000012545 processing Methods 0.000 claims description 15
- 238000002955 isolation Methods 0.000 claims description 6
- 238000011156 evaluation Methods 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 4
- 230000008569 process Effects 0.000 description 13
- 230000006870 function Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The application provides a remote automatic control system, a method and electronic equipment based on IP KVM, wherein the system comprises a local client, IP KVM and a server, wherein: the local client is in communication connection with the IP KVM; the IP KVM is in communication connection with the server; the IP KVM is also in communication connection with a plurality of remote servers; the server is used for acquiring first operation data in real time, wherein the first operation data are operation data of the remote server; the server identifies a first key feature contained in the first operational data; the server judges whether the first key feature is the same as the second key feature, wherein the second key feature is a key feature marked in the second operation data of the remote server in advance; if the first key feature is the same as the second key feature, calling a prestored operation instruction aiming at the second key feature; the server converts the operation instruction into a mouse control signal and sends the mouse control signal to a remote server. The remote control method and the remote control device have the effect of improving the remote control efficiency of the remote server.
Description
Technical Field
The application relates to the technical field of remote control, in particular to a remote automatic control system and method based on IP KVM and electronic equipment.
Background
IP KVM, also known as KVM OVER IP, i.e., KVM switch with remote management functionality, is an abbreviation for keyboard, display, mouse (Keyboard, video, mouse) for controlling multiple computers through a set of keyboard, display and mouse. In general, the distance between the analog KVM switch and the controlled computer is generally short because of signal attenuation in the signal transmission process from the computer to the peripheral device. The IP KVM as a digital KVM switch can transmit signals from a remote server to a local client through the internet or a private network, and then compile the signals into video data for display. Meanwhile, the IP KVM can convert the mouse operation instruction of the remote control end into a control signal and transmit the control signal to the remote server, so that the control of the local client to a plurality of remote servers is realized.
Currently, in the traditional KVM industry, for a process of remotely controlling a remote server, a manager needs to continuously view video pictures of an operation interface of the remote server and issue operation instructions for different operation interfaces. During long-term operation, the manager is fatigued to reduce the efficiency of the real-time control of the remote server, and thus, a method is needed to improve the efficiency of the remote control of the remote server.
Disclosure of Invention
The application provides a remote automatic control system, a remote automatic control method and electronic equipment based on IP KVM, which have the effect of improving the remote control efficiency of a remote server.
In a first aspect of the present application, there is provided an IP KVM-based remote automatic control system, the system comprising a local client, an IP KVM, and a server, wherein:
the local client is in communication connection with the IP KVM;
the IP KVM is in communication connection with the server;
the IP KVM is also in communication connection with a plurality of remote servers;
the remote server is configured to send first operation data to the local client in real time through the IP KVM, where the first operation data is operation data of the remote server;
the local client is used for sending the first operation data to the server through the IP KVM;
the server comprises an acquisition module, an identification module, a processing module and an output module, wherein:
the acquisition module is used for acquiring the first operation data in real time;
the identification module is used for identifying first key features contained in the first operation data;
the processing module is used for judging whether the first key feature is the same as the second key feature, wherein the second key feature is a key feature marked in advance from second operation data of a remote server; the method comprises the steps of,
If the first key feature is the same as the second key feature, a prestored operation instruction aiming at the second key feature is called;
the output module is used for converting the operation instruction into a mouse control signal and sending the mouse control signal to the remote server.
By adopting the technical scheme, the local client is in communication connection with a plurality of remote servers through the IP KVM, so that the control of the plurality of remote servers can be realized. In the process that the local client controls the remote server to operate through the IP KVM, the remote server sends first operation data to the local client in real time, and the local client simultaneously sends the first operation data to the server. The server identifies a first key feature of the first operation data, compares the first key feature with a second key feature, and if the first key feature and the second key feature are consistent, the server is indicated to have a prestored operation instruction aiming at the first key feature. The server retrieves the operation instruction corresponding to the pre-stored second key feature, converts the operation instruction into a mouse control signal and sends the mouse control signal to the remote server, and finally the remote server converts the mouse control signal into the operation instruction to execute corresponding operation, so that the automatic control of the server to the remote server is completed. The above operations are automatically completed by the computer, so that the manual operation amount is greatly reduced, and the efficiency of remote control of the remote server is improved.
In a second aspect of the present application, there is provided a remote automatic control method based on IP KVM, the method being applied to a server of the above system, the method comprising:
acquiring the first operation data in real time, wherein the first operation data is the operation data of the remote server;
identifying the first key feature contained in the first operational data;
judging whether the first key feature is the same as the second key feature, wherein the second key feature is a key feature marked in advance from second operation data of the remote server;
if the first key feature is the same as the second key feature, a prestored operation instruction aiming at the second key feature is called;
and converting the operation instruction into a mouse control signal and sending the mouse control signal to the remote server.
By adopting the technical scheme, the server identifies the first key feature of the first operation data, compares the first key feature with the second key feature, and if the first key feature and the second key feature are consistent, the server is indicated to have prestored operation instructions aiming at the first key feature. The server retrieves the operation instruction corresponding to the pre-stored second key feature, converts the operation instruction into a mouse control signal and sends the mouse control signal to the remote server, and finally the remote server converts the mouse control signal into the operation instruction to execute corresponding operation, thereby completing automatic control of the remote server. The above operations are automatically completed by the computer, so that the manual operation amount is greatly reduced, and the efficiency of remote control of the remote server is improved.
Optionally, before the acquiring the first operation data in real time, the method further includes:
acquiring the second operation data and acquiring the marked second key features in the second operation data;
and acquiring the operation instruction and establishing a mapping relation between the operation instruction and the second key feature.
By adopting the technical scheme, the server acquires the second operation data and the marked second key features in the second operation data in advance, and establishes the mapping relation between the operation instruction and the second key features, so that the subsequent server can conveniently send the operation instruction to the remote server according to the key features, and the automatic control of the remote server is completed.
Optionally, after the determining whether the first key feature is the same as the second key feature, the method further includes:
if the first key feature is different from the second key feature, calculating the similarity between the first key feature and a plurality of second key features;
judging whether the numerical value of the similarity exceeds a preset first threshold value or not;
if the values of the similarities do not exceed the first threshold, receiving the operation instruction aiming at the first key feature, which is sent by the local client;
Counting the times of receiving the operation instructions, and calculating whether the times of receiving the operation instructions exceeds a preset second threshold value;
and if the times of receiving the operation instructions exceeds a preset second threshold value, establishing a mapping relation between the first key features and the operation instructions.
By adopting the technical scheme, when the server judges that the first key feature is different from the second key feature, the server indicates that the operation instruction aiming at the first key feature is not prestored. The server calculates that the value of the similarity between the first key feature and the second key feature does not exceed a first threshold value, which indicates that the server also does not pre-store second operation data similar to the first operation data. The server counts the times of the same operation instruction aiming at the first operation data sent by the subsequent local client, and if the times exceed a preset second threshold value, the server indicates that the local client adopts the same operation instruction for the first key feature for a plurality of times. The server establishes a mapping relation between the first key feature and the operation instruction, thereby completing the learning of the operation instruction aiming at the first key feature, and being convenient for a subsequent server to automatically send the corresponding operation instruction when identifying the first key feature.
Optionally, after the determining whether the value of the similarity exceeds the preset first threshold, the method further includes:
if the fact that the numerical values of the plurality of the similarities exceed the first threshold value is judged, sorting the plurality of the similarities according to the numerical values, selecting the first similarity with the largest numerical value, and calling the third key feature corresponding to the first similarity;
invoking a pre-stored operation instruction aiming at the third key feature;
and converting the operation instruction into a mouse control signal and sending the mouse control signal to a remote server.
By adopting the technical scheme, if the server judges that the numerical values of the plurality of similarities exceed the first threshold, the server indicates that a plurality of second key features similar to the first key features exist. The server selects a first similarity with a value higher than other similarities, and invokes a third key feature corresponding to the first similarity and an operation instruction aiming at the third key feature, so that the selection of the operation instruction aiming at the first key feature is completed through fuzzy matching, and further automatic control of the remote server is completed.
Optionally, after the sending the mouse control signal to the remote server, the method further includes:
Acquiring an operation result after the remote server executes the operation instruction;
converting the operation result into a video signal and sending the video signal to a local client;
receiving a judging result aiming at the running result and sent by a local client, and judging whether the judging result is correct or incorrect;
and if the evaluation result is correct, establishing a mapping relation between the first key feature and the operation instruction.
By adopting the technical scheme, after the server finishes selecting the operation instruction aiming at the first key feature through fuzzy matching, the server sends a key mouse control signal to a remote server. After executing the operation instruction, the remote server sends the video signal converted by the operation result to the local client. If the local client judges that the operation instruction is correct, and the operation instruction selected for the first key feature is the correct operation instruction, the server establishes a mapping relation between the first key feature and the operation instruction. After the subsequent server recognizes the first key feature again, the server directly selects a corresponding operation instruction.
Optionally, after the sending the mouse control signal to the remote server, the method further includes:
Detecting whether the data downloaded by the remote server is abnormal or not in real time;
and if the data is detected to have abnormality, the data is sent to an isolation area of the local client, and the data is deleted from the remote server.
By adopting the technical scheme, the server monitors whether the data downloaded by the remote server is abnormal in real time, and takes safety measures for the abnormal data, so that the safety of the remote server data can be protected, and the abnormal data is prevented from affecting the operation of the automatic operation instruction of the server. And the abnormal data is sent to the isolation area of the local client, so that the local client can conveniently know and analyze the abnormal situation later.
Optionally, the types of the first operation data further include:
video data, text data, image data, and code data;
the key features corresponding to the first operation data of the video data type comprise key characters and key pixel combinations;
the key features corresponding to the first operation data of the text data type comprise key characters;
the key features corresponding to the first operational data of the image data type include key pixel combinations;
the key feature corresponding to the first operation data of the code data type includes a key feature code.
By adopting the technical scheme, the server can process various types of operation data and identify key features contained in different types of operation data, so that the application scene of the automatic control method is increased.
In a third aspect of the present application there is provided an electronic device comprising a processor, a memory for storing instructions, a user interface and a network interface, both for communicating to other devices, the processor being for executing the instructions stored in the memory to cause the electronic device to perform a method as claimed in any one of the preceding claims.
In summary, one or more technical solutions provided in the embodiments of the present application at least have the following technical effects or advantages:
1. the local client is in communication connection with a plurality of remote servers through the IP KVM, and can control the plurality of remote servers. In the process that the local client controls the remote server to operate through the IP KVM, the remote server sends first operation data to the local client in real time, and the local client simultaneously sends the first operation data to the server. The server identifies a first key feature of the first operation data, compares the first key feature with a second key feature, and if the first key feature and the second key feature are consistent, the server is indicated to have a prestored operation instruction aiming at the first key feature. The server retrieves the operation instruction corresponding to the pre-stored second key feature, converts the operation instruction into a mouse control signal and sends the mouse control signal to the remote server, and finally the remote server converts the mouse control signal into the operation instruction to execute corresponding operation, so that the automatic control of the server to the remote server is completed. The above operations are automatically completed by the computer, so that the manual operation amount is greatly reduced, and the efficiency of remote control of the remote server is improved.
2. The server can automatically count the times of the same operation instruction for the first operation data sent by the local client under the condition that the operation instruction for the first key feature is not prestored, and if the times exceed a preset threshold value, the local client is indicated to adopt the same operation instruction for the first key feature for a plurality of times. The server establishes a mapping relation between the first key feature and the operation instruction, thereby completing the learning of the operation instruction aiming at the first key feature, and being convenient for a subsequent server to automatically send the corresponding operation instruction when identifying the first key feature.
3. If the server judges that the values of the plurality of similarities exceed the first threshold, the server indicates that a plurality of second key features similar to the first key features exist. The server selects a first similarity with a value higher than other similarities, and invokes a third key feature corresponding to the first similarity and an operation instruction aiming at the third key feature, so that the selection of the operation instruction aiming at the first key feature is completed through fuzzy matching, and further automatic control of the remote server is completed.
Drawings
FIG. 1 is a schematic diagram of a remote automatic control system based on IP KVM according to an embodiment of the present application.
Fig. 2 is a schematic structural diagram of a server according to an embodiment of the present application.
FIG. 3 is a flow chart of a remote automatic control method based on IP KVM according to an embodiment of the present application.
Fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Reference numerals illustrate: 1. a local client; 2. IP KVM; 3. a server; 4. an acquisition module; 5. an identification module; 6. a processing module; 7. an output module; 8. a processor; 9. a communication bus; 10. a user interface; 11. a network interface; 12. a memory.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in the present specification, the technical solutions in the embodiments of the present specification will be clearly and completely described below with reference to the drawings in the embodiments of the present specification, and it is obvious that the described embodiments are only some embodiments of the present application, but not all embodiments.
In the description of embodiments of the present application, words such as "for example" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described herein as "such as" or "for example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "or" for example "is intended to present related concepts in a concrete fashion.
In the description of the embodiments of the present application, the term "plurality" means two or more. For example, a plurality of systems means two or more systems, and a plurality of screen terminals means two or more screen terminals. Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating an indicated technical feature. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.
The embodiment discloses a remote automatic control system based on IP KVM, referring to FIG. 1, the system comprises a local client 1, IP KVM2 and a server 3, wherein:
the local client 1 is communicatively connected to the IP KVM 2. The IP KVM2 is communicatively connected to the server 3. The IP KVM2 is also communicatively coupled to a plurality of remote servers. The remote server is configured to send, in real time, first operation data to the local client 1 through the IP KVM2, where the first operation data is operation data of the remote server. The local client 1 is configured to send the first operation data to the server 3 through the IP KVM 2. Referring to fig. 2, the server 3 includes an acquisition module 4, an identification module 5, a processing module 6, and an output module 7, wherein: and the acquisition module 4 is used for acquiring the first operation data in real time. The identification module 5 identifies a first key feature contained in the first operation data. And the processing module 6 is used for judging whether the first key feature is the same as the second key feature, wherein the second key feature is a key feature marked in advance from the second operation data of the remote server. And if the first key feature is the same as the second key feature, calling a prestored operation instruction aiming at the second key feature. And the output module 7 is used for converting the operation instruction into a mouse control signal and sending the mouse control signal to the remote server.
Specifically, in the conventional "client-KVM-server" architecture, the client is directly connected to a plurality of servers through KVM, and this architecture results in that the client can only receive an instruction input by a user, and send a mouse control signal to the server, so as to complete control of the server. According to the remote control method based on the IP KVM, on the basis of an original framework, the server 3 is connected with the IP KVM2, the remote automatic control method based on the IP KVM is realized through the server 3, and the server 3 can realize automatic control of a remote server, so that the effect of improving the efficiency of remote control of the remote server is achieved. The local client 1 is communicatively connected to an IP KVM2, and the IP KVM2 is communicatively connected to a plurality of remote servers. Meanwhile, the IP KVM2 is communicatively connected to the server 3. The local client 1 is connected with a display, a keyboard and a mouse, video data of a current operation interface are converted into video signals in the operation process of the remote server, the video signals are transmitted to the display of the local client 1 through the IP KVM2 to display the video data, and a user of the local client 1 issues operation instructions according to the content of video pictures through the keyboard and the mouse, and the operation instructions are converted into keyboard and mouse control signals through the IP KVM2 to be transmitted to the remote server, so that control of the remote server is realized. Also, since communication connection is achieved between the remote server and the IP KVM2, between the IP KVM2 and the local client 1, and between the IP KVM2 and the server 3 through the access internet, the mutual transmission of various types of files such as text, image, and video through the internet, and the transmission distance will not be limited.
The embodiment also discloses a remote automatic control method based on IP KVM, referring to FIG. 2, comprising the following steps:
s110, acquiring first operation data in real time, wherein the first operation data is operation data of a remote server.
Specifically, in the process that the local client 1 controls the remote server to operate through the IP KVM2, the remote server sends the first operation data to the local client 1 in real time, and the local client 1 sends the first operation data to the server 3.
S120, identifying a first key feature contained in the first operation data.
Specifically, the first key feature is determined according to the type of the first operation data, for example, the first operation data is the operation data of the video type, and then the first key feature is a key character and key pixel combination.
S130, judging whether the first key feature is identical with a second key feature, wherein the second key feature is a key feature marked in advance from second operation data of a remote server.
Specifically, the server 3 recognizes the first key feature contained in the first operation data, and then the server 3 retrieves a plurality of second operation data pre-stored in the data, and acquires the second key feature of the second operation data marked. The server 3 compares the first key feature with the second key feature to determine whether the first key feature and the second key feature are identical.
S140, if the first key feature is the same as the second key feature, a prestored operation instruction aiming at the second key feature is called.
Specifically, if the server 3 determines that the first key feature is the same as the second key feature, it indicates that the server 3 has prestored an operation instruction for the first key feature. The server 3 invokes the operation instruction corresponding to the pre-stored second key feature.
S150, converting the operation instruction into a mouse control signal and sending the mouse control signal to a remote server.
Specifically, the server 3 converts the operation command into a mouse control signal, and sends the mouse control signal to a remote server. Finally, the remote server converts the mouse control signal into an operation instruction to execute corresponding operation, thereby completing the automatic control of the server 3 to the remote server. The above operations are automatically completed by the computer, so that the manual operation amount is greatly reduced, and the efficiency of remote control of the remote server is improved.
For example, the second operation data is the video data displayed on the display of the pre-stored local client 1 when the remote server performs the temporary file processing. In the second operation data, if a file named as an XXX-expired file, docx exists in the video, the key characters marked in the corresponding second key features are the expired file and the docx. For this second key feature, the corresponding operation instruction is "delete file containing key character expiration file and docx". When the local client 1 remotely controls the remote server to process the file in real time, the remote server sends the video signal of the operation interface of the file processing process to the local client 1 in real time, and meanwhile, the server 3 acquires the video displayed by the display of the remote client, namely, acquires the first operation data. If the server 3 recognizes that a file named "transmission record-expiration file. Docx" exists in a certain video frame, the server 3 automatically transmits an operation instruction of "delete the file" to the remote server.
In one possible implementation manner, before the first operation data is obtained in real time, the method specifically further includes: and acquiring second operation data, and acquiring second marked key features in the second operation data. And acquiring an operation instruction, and establishing a mapping relation between the operation instruction and the second key feature.
Specifically, in order to facilitate the subsequent server 3 to send an operation instruction to the remote server according to the key feature, to complete automatic control of the remote server, it is necessary to obtain the second key feature and an operation instruction corresponding to the second key feature in advance.
For example, in the process that the local client 1 controls the remote server to operate through the IP KVM2, the remote server transmits the video data of the operation interface to the display of the local client 1 through the IP KVM2 for displaying, and the server 3 acquires the video of the display interface in real time. The local client 1 sends a mouse operation signal to the remote server through the IP KVM2, so that the purpose of remotely controlling the operation of the remote server is achieved. In the operation process, the user selects a video frame needing to be added with automation operation through the local client 1, marks key characters on the video frame, and the server 3 automatically sets the key characters as second key features. Subsequently, the operation instruction is recorded, and the local client 1 continuously inputs the operation instruction to be performed to the server 3 until the operation instruction is finished. Then the server 3 automatically establishes a mapping relation between the operation instruction and the second key feature.
In one possible implementation manner, after determining whether the first key feature is the same as the second key feature, the method specifically further includes: if the first key feature is different from the second key feature, calculating the similarity between the first key feature and the plurality of second key features. And judging whether the numerical value of the similarity exceeds a preset first threshold value. And if the values of the similarities do not exceed the first threshold, receiving an operation instruction aiming at the first key feature, which is sent by the local client 1. And calculating the times of receiving the operation instructions, and if the times of receiving the operation instructions exceeds a preset second threshold value, establishing a mapping relation between the first key features and the operation instructions.
Specifically, if the server 3 determines that the second key feature identical to the first key feature does not exist, in the process that the local client 1 controls the remote server to operate through the IP KVM2, the server 3 acquires the first key feature of the first operation data in real time, and performs similarity calculation on the first key feature and the second key feature to acquire the similarity. The calculation of the similarity is a conventional technical means in the related art, and will not be further described herein. The server 3 further determines whether the value of the similarity exceeds a preset first threshold, where the specific value of the first threshold is not specifically limited in this embodiment, and other embodiments may be adjusted according to actual situations.
If the values of the similarities do not exceed the first threshold, that is, the second key features similar to the first key features are not pre-stored, the server 3 receives the operation instruction for the first operation data sent by the local client 1. If the subsequent server 3 identifies the first key feature multiple times, the same operation instruction for the first operation data sent by the local client 1 is acquired multiple times. The server 3 counts the number of times of receiving the operation instruction for the first key feature. If the number of times of receiving the operation instruction is calculated to exceed the preset second threshold, it indicates that the local client 1 sends the same operation instruction for the first key feature for multiple times, where the specific value of the second threshold is not specifically limited in this embodiment, and other embodiments may be adjusted according to the actual situation. The server 3 establishes a mapping relation between the second key feature and the operation instruction, thereby completing learning of the operation instruction for the first operation data. For similarity calculation of the first key feature and the second key feature, the similarity can be calculated according to different types of key features by adopting different algorithms, for example, the key features of the character type can be calculated based on a character matching algorithm.
In one possible implementation manner, after determining whether the value of the similarity exceeds a preset first threshold, the method specifically further includes: and if the values of the plurality of similarities exceed the first threshold value, sorting the plurality of similarities according to the values, selecting the first similarity with the largest value, and calling the third key feature corresponding to the first similarity. And calling a pre-stored operation instruction aiming at the third key characteristic. And converting the operation instruction into a mouse control signal and sending the mouse control signal to a remote server.
Specifically, if the server 3 determines that the values of the plurality of similarities exceed the first threshold, it indicates that there are a plurality of second key features similar to the first key feature. The server 3 performs preferred selection of a first similarity with a higher value than other similarities, and invokes a third key feature corresponding to the first similarity and an operation instruction aiming at the third key feature, so that the selection of the operation instruction aiming at the first key feature is completed through fuzzy matching, and further automatic control of the remote server is completed.
In one possible implementation manner, after sending the mouse control signal to the remote server, the method specifically further includes: and acquiring an operation result after the remote server executes the operation instruction. The operation result is converted into a video signal and transmitted to the local client 1. And receiving a judgment result aiming at the running result and sent by the local client side 1, and judging whether the judgment result is correct or wrong. If the obtained judging result is correct, establishing a mapping relation between the first key feature and the operation instruction.
Specifically, after the server 3 completes the selection of the operation instruction for the first key feature through fuzzy matching, a mouse control signal is sent to the remote server. The server 3 needs to obtain feedback from the local client 1 to determine if the matching result is correct. The remote server sends the operation result to the local client 1 after executing the operation instruction, i.e. sends the video of the operation interface after executing the operation instruction to the local client 1. If the local client 1 judges that the operation instruction is correct, which indicates that the operation instruction selected by the server 3 aiming at the first key feature is the correct operation instruction, the server 3 establishes a mapping relation between the first key feature and the operation instruction, so that the server 3 can directly select the operation instruction corresponding to the first key feature after recognizing that the subsequent remote server reappears the first key feature.
For example: when the remote server performs text input, the first operation data is video data of a current operation interface of the remote server, which is displayed by a display of the local client 1. If the user inputs the text "need to disassemble the current engine" on the remote server through the keyboard of the local client 1, the server 3 recognizes that the first key feature "need to disassemble the current engine", and the server 3 invokes the pre-stored second operation data and the second key feature of the second operation data. When the remote server performs text input, the second operation data is pre-stored video data displayed on the display of the local client 1.
When the server 3 obtains that the database does not store the second key features identical to the first key features in advance, the similarity between the first key features and the plurality of second key features is calculated. If the third key feature with the highest similarity is that the input "the current engine needs to be disassembled", the corresponding operation instruction is that "the next step is included" is input at the back ", and the server 3 converts the operation instruction into a mouse control signal and sends the mouse control signal to the remote server. The remote server inputs "next steps including" after "need to disassemble the current engine", and converts the executed operation result into a video signal to be transmitted to the local client 1. If the user determines that "the following steps are included after" the current engine needs to be disassembled ", the user sends the" correct "judgment result to the server 3 through the local client 1. If the user determines that other contents need to be input after the current engine needs to be disassembled, the judgment result of error is sent to the server 3 through the local client 1. If the server 3 obtains the judging result as "correct", the mapping relation between the first key feature "the current engine needs to be disassembled" and the operation instruction "the following steps are included".
In one possible implementation manner, after sending the mouse control signal to the remote server, the method specifically further includes: and detecting whether the data downloaded by the remote server is abnormal or not in real time. If the data is detected to be abnormal, the data is sent to the isolation area of the local client 1, and the data is deleted from the remote server.
Specifically, in order to prevent the operation of the automation instructions of the server 3 from being affected by the remote server abnormal data, the server 3 monitors in real time whether the data downloaded from the remote server is abnormal. If abnormal data is detected, the server 3 sends the data to the isolation area of the local client 1, and deletes the data from the remote server, so that the local client 1 can conveniently know and analyze the abnormal situation later.
In one possible implementation, the type of the first operation data further includes: video data, text data, image data, and code data.
Specifically, the key features corresponding to the first operation data of the video data type include key characters and key pixel combinations. The key features corresponding to the first operational data of the text data type include key characters. The key features corresponding to the first operational data of the image data type include key pixel combinations. The key features corresponding to the first operational data of the code data type include key feature codes. For the first operation data of the video data type, the extraction and recognition of the corresponding key features are preferably performed by a text detection algorithm. For the first operation data of the text data type, the extraction and recognition of the corresponding key features are preferably performed by an image recognition algorithm. For the first operation data of the code data type, the extraction and identification of the corresponding key features are preferably performed by a character matching algorithm. The technology adopted for extracting and identifying the key features is only a conventional technical means in the related technical field, and will not be further described herein.
In one possible implementation manner, the server 3 is configured to calculate the similarity between the first key feature and the plurality of second key features if it is determined that the first key feature is different from the second key feature;
judging whether the numerical value of the similarity exceeds a preset first threshold value or not;
if the values of the similarities do not exceed the first threshold, receiving an operation instruction aiming at the first key feature, which is sent by the local client 1;
and calculating the times of receiving the operation instructions, and if the times of receiving the operation instructions exceeds a preset second threshold value, establishing a mapping relation between the first key features and the operation instructions.
In one possible implementation manner, the server 3 is configured to sort the multiple similarities according to the value if it is determined that the values of the multiple similarities exceed the first threshold, select the first similarity with the largest value, and call the third key feature corresponding to the first similarity;
calling a pre-stored operation instruction aiming at a third key feature;
and converting the operation instruction into a mouse control signal and sending the mouse control signal to a remote server.
In a possible implementation manner, the server 3 is configured to obtain an operation result after the remote server executes the operation instruction;
Converting the operation result into a video signal and transmitting the video signal to the local client 1;
receiving a judgment result aiming at the running result and sent by the local client side 1, and judging whether the judgment result is correct or wrong;
if the obtained judging result is correct, establishing a mapping relation between the first key feature and the operation instruction.
In a possible implementation, the server 3 is configured to detect in real time whether the data downloaded by the remote server is abnormal;
if the data is detected to be abnormal, the data is sent to the isolation area of the local client 1, and the data is deleted from the remote server.
In one possible implementation, the server 3 is configured to obtain video data, text data, image data, and code data;
the key features corresponding to the first operation data of the video data type comprise key characters and key pixel combinations;
the key features corresponding to the first operation data of the text data type comprise key characters;
the key features corresponding to the first operation data of the image data type comprise key pixel combinations;
the key features corresponding to the first operational data of the code data type include key feature codes.
The present application also provides an electronic device, referring to fig. 4, the electronic device may include: at least one processor 8, at least one communication bus 9, a user interface 10, a network interface 11, at least one memory 12.
Wherein a communication bus 9 is used to enable connection communication between these components.
The user interface 10 may include a Display screen (Display), a Camera (Camera), and the optional user interface 10 may further include a standard wired interface, a wireless interface.
The network interface 11 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface), among others.
Wherein the processor 8 may comprise one or more processing cores. The processor 8 connects the various parts within the overall server 3 using various interfaces and lines, performs various functions of the server 3 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 12, and invoking data stored in the memory 12. Alternatively, the processor 8 may be implemented in hardware in at least one of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), programmable logic array (Programmable Logic Array, PLA). The processor 8 may integrate one or a combination of several of a central processing unit 8 (Central Processing Unit, CPU), an image processor 8 (Graphics Processing Unit, GPU), and a modem, etc. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content required to be displayed by the display screen; the modem is used to handle wireless communications. It will be appreciated that the modem may not be integrated into the processor 8 and may be implemented solely by a single chip.
The Memory 12 may include a random access Memory 12 (Random Access Memory, RAM), or may include a Read-Only Memory 12 (Read-Only Memory). Optionally, the memory 12 includes a non-transitory computer readable medium (non-transitory computer-readable storage medium). Memory 12 may be used to store instructions, programs, code sets, or instruction sets. The memory 12 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described above, etc.; the storage data area may store data or the like involved in the above respective method embodiments. The memory 12 may optionally also be at least one memory device located remotely from the aforementioned processor 8. As shown, the memory 12, which is a computer storage medium, may include an operating system, a network communication module, a user interface 10 module, and an application program of a remote automatic control method based on IP KVM.
In the electronic device shown in the figure, the user interface 10 is mainly used for providing an input interface for a user, and acquiring data input by the user; and the processor 8 may be configured to invoke an application program in the memory 12 that stores an IP KVM-based remote automatic control method, which when executed by the one or more processors 8 causes the electronic device to perform the method as in one or more of the embodiments described above.
It should be noted that, for simplicity of description, the foregoing method embodiments are all expressed as a series of action combinations, but it should be understood by those skilled in the art that the present application is not limited by the order of actions described, as some steps may be performed in other order or simultaneously in accordance with the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required in the present application.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to related descriptions of other embodiments.
In the several embodiments provided herein, it should be understood that the disclosed apparatus may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, such as a division of units, merely a division of logic functions, and there may be additional divisions in actual implementation, such as multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some service interface, device or unit indirect coupling or communication connection, electrical or otherwise.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable memory 12. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in whole or in part in the form of a software product stored in one memory 12, comprising several instructions for causing one computer device (which may be a personal computer, a server 3 or a network device, etc.) to perform all or part of the steps of the methods of the embodiments of the present application. Whereas the aforementioned memory 12 comprises: various media capable of storing program codes, such as a U disk, a mobile hard disk, a magnetic disk or an optical disk.
The foregoing is merely exemplary embodiments of the present disclosure and is not intended to limit the scope of the present disclosure. That is, equivalent changes and modifications are contemplated by the teachings of this disclosure, which fall within the scope of the present disclosure. Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a scope and spirit of the disclosure being indicated by the claims.
Claims (9)
1. A remote automatic control system based on IP KVM, characterized in that the system comprises a local client (1), an IP KVM (2) and a server (3), wherein:
the local client (1) is in communication connection with the IP KVM (2);
the IP KVM (2) is in communication connection with the server (3);
the IP KVM (2) is also in communication connection with a plurality of remote servers;
the remote server is used for sending first operation data to the local client (1) in real time through the IP KVM (2), wherein the first operation data is the operation data of the remote server;
The local client (1) is configured to send the first operation data to the server (3) through the IP KVM (2);
the server (3) comprises an acquisition module (4), an identification module (5), a processing module (6) and an output module (7), wherein:
the acquisition module (4) is used for acquiring first operation data in real time;
the identification module (5) identifies a first key feature contained in the first operation data;
the processing module (6) is configured to determine whether the first key feature is the same as the second key feature, where the second key feature is a key feature marked in advance from second operation data of a remote server; the method comprises the steps of,
if the first key feature is the same as the second key feature, a prestored operation instruction aiming at the second key feature is called;
the output module (7) is used for converting the operation instruction into a mouse control signal and sending the mouse control signal to the remote server.
2. A remote automatic control method based on IP KVM, characterized in that it is applied to a server (3) according to claim 1, said method comprising:
acquiring the first operation data in real time, wherein the first operation data is the operation data of the remote server;
Identifying the first key feature contained in the first operational data;
judging whether the first key feature is the same as the second key feature, wherein the second key feature is a key feature marked in advance from second operation data of the remote server;
if the first key feature is the same as the second key feature, a prestored operation instruction aiming at the second key feature is called;
and converting the operation instruction into a mouse control signal and sending the mouse control signal to the remote server.
3. The remote automatic control method based on IP KVM as recited in claim 2, wherein before the first operation data is obtained in real time, the method further comprises:
acquiring the second operation data and acquiring the marked second key features in the second operation data;
and acquiring the operation instruction and establishing a mapping relation between the operation instruction and the second key feature.
4. The method according to claim 2, wherein after said determining whether the first key feature and the second key feature are the same, the method further comprises:
If the first key feature is different from the second key feature, calculating the similarity of the first key feature and other second key features;
judging whether the numerical values of the similarity exceeds a preset first threshold value or not;
if the values of the similarities do not exceed the first threshold, receiving the operation instruction aiming at the first key feature, which is sent by the local client (1);
counting the times of receiving the operation instructions, and calculating whether the times of receiving the operation instructions exceeds a preset second threshold value;
and if the times of receiving the operation instructions exceeds a preset second threshold value, establishing a mapping relation between the first key features and the operation instructions.
5. The method for remote automatic control based on IP KVM as recited in claim 4, wherein after determining whether the value of the similarity exceeds a preset first threshold, the method further comprises:
if the fact that the numerical values of the plurality of the similarities exceed the first threshold value is judged, sorting the plurality of the similarities according to the numerical values, selecting the first similarity with the largest numerical value, and calling the third key feature corresponding to the first similarity;
Invoking a pre-stored operation instruction aiming at the third key feature;
and converting the operation instruction into a mouse control signal and sending the mouse control signal to a remote server.
6. The method according to claim 5, wherein after the sending the mouse control signal to the remote server, the method further comprises:
acquiring an operation result after the remote server executes the operation instruction;
converting the operation result into a video signal and transmitting the video signal to a local client (1);
receiving a judgment result aiming at the running result and sent by a local client (1), and judging whether the judgment result is correct or wrong;
and if the evaluation result is correct, establishing a mapping relation between the first key feature and the operation instruction.
7. The method according to claim 2, wherein after the sending the mouse control signal to the remote server, the method further comprises:
detecting whether the data downloaded by the remote server is abnormal or not in real time;
and if the data is detected to be abnormal, the data is sent to an isolation area of the local client (1), and the data is deleted from the remote server.
8. The remote automatic control method based on IP KVM as recited in claim 2, wherein the type of the first operation data further comprises:
video data, text data, image data, and code data;
the key features corresponding to the first operation data of the video data type comprise key characters and key pixel combinations;
the key features corresponding to the first operation data of the text data type comprise key characters;
the key features corresponding to the first operational data of the image data type include key pixel combinations;
the key feature corresponding to the first operation data of the code data type includes a key feature code.
9. An electronic device comprising a processor (8), a memory (12), a user interface (10) and a network interface (11), the memory (12) being configured to store instructions, the user interface (10) and the network interface (11) being configured to communicate to other devices, the processor (8) being configured to execute the instructions stored in the memory (12) to cause the electronic device to perform the method of any of claims 2-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310173107.5A CN116366625A (en) | 2023-02-28 | 2023-02-28 | IPKVM-based remote automatic control system, method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310173107.5A CN116366625A (en) | 2023-02-28 | 2023-02-28 | IPKVM-based remote automatic control system, method and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116366625A true CN116366625A (en) | 2023-06-30 |
Family
ID=86932176
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310173107.5A Pending CN116366625A (en) | 2023-02-28 | 2023-02-28 | IPKVM-based remote automatic control system, method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116366625A (en) |
-
2023
- 2023-02-28 CN CN202310173107.5A patent/CN116366625A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107645524B (en) | Message pushing processing method and device | |
| US8239525B2 (en) | Server apparatus and communication system | |
| CN109241897B (en) | Monitoring image processing method and device, gateway equipment and storage medium | |
| US20100046840A1 (en) | Image processing apparatus and image processing method for evaluating a plurality of image recognition processing units | |
| CN112331213A (en) | Intelligent household equipment control method and device, electronic equipment and storage medium | |
| WO2017054307A1 (en) | Recognition method and apparatus for user information | |
| CN105809117A (en) | Information prompt method and user terminal | |
| CN114615346A (en) | Protocol conversion method and device | |
| CN116366625A (en) | IPKVM-based remote automatic control system, method and electronic equipment | |
| CN108063665B (en) | Communication method and terminal device | |
| CN113746837B (en) | Information processing method and apparatus, electronic device, and computer readable medium | |
| US20210064396A1 (en) | Remote operating system | |
| CN115473692A (en) | Service request processing method, device, equipment and medium | |
| CN112165594A (en) | Service handling method and device based on video communication and computer equipment | |
| CN114915774A (en) | Production process detection system and detection method | |
| CN112214103A (en) | Method for connecting wireless control equipment with computer and related device | |
| CN115061590B (en) | KVM (keyboard video mouse) seat system control method based on video identification and KVM seat system | |
| CN110955891A (en) | File detection method, device and system and data processing method | |
| CN117311892B (en) | Remote assistance method, system, electronic device and storage medium | |
| CN113836509B (en) | Information acquisition method, device, electronic equipment and storage medium | |
| CN116347046B (en) | Household monitoring method and system based on visual mobile terminal control | |
| CN113891064A (en) | Device testing method and device, computer device and computer-readable storage medium | |
| CN109686060B (en) | Monitoring method and device for fitness equipment | |
| CN114743240A (en) | Internet of things ultra-low power consumption application communication management method and related equipment | |
| CN111222047A (en) | Picture downloading method, device, server and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |