CN117009188B - Computer system misoperation prevention system and method - Google Patents
Computer system misoperation prevention system and method Download PDFInfo
- Publication number
- CN117009188B CN117009188B CN202311268607.3A CN202311268607A CN117009188B CN 117009188 B CN117009188 B CN 117009188B CN 202311268607 A CN202311268607 A CN 202311268607A CN 117009188 B CN117009188 B CN 117009188B
- Authority
- CN
- China
- Prior art keywords
- man
- machine interaction
- module
- information
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000002265 prevention Effects 0.000 title claims abstract description 103
- 238000000034 method Methods 0.000 title claims abstract description 19
- 230000003993 interaction Effects 0.000 claims abstract description 314
- 230000002093 peripheral effect Effects 0.000 claims abstract description 158
- 238000012544 monitoring process Methods 0.000 claims abstract description 42
- 238000010191 image analysis Methods 0.000 claims abstract description 23
- 238000004458 analytical method Methods 0.000 claims abstract description 6
- 238000000605 extraction Methods 0.000 claims description 12
- 239000000284 extract Substances 0.000 claims description 10
- 238000012790 confirmation Methods 0.000 claims description 4
- 238000004519 manufacturing process Methods 0.000 abstract description 5
- 238000012545 processing Methods 0.000 abstract description 2
- 241000699666 Mus <mouse, genus> Species 0.000 description 33
- 230000006870 function Effects 0.000 description 11
- 230000002452 interceptive effect Effects 0.000 description 5
- 230000007257 malfunction Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000009434 installation Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3438—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment monitoring of user actions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
- G06F9/30003—Arrangements for executing specific machine instructions
- G06F9/30076—Arrangements for executing specific machine instructions to perform miscellaneous control operations, e.g. NOP
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Computer Hardware Design (AREA)
- Input From Keyboards Or The Like (AREA)
Abstract
The invention belongs to the technical field of computer system processing, and particularly relates to a computer system misoperation prevention system and method, wherein the system comprises the following components: the image acquisition module acquires image information on a graphic display of the computer system and sends the image information to the image analysis module; the image analysis module performs recognition analysis on the image information, generates monitoring information and sends the monitoring information to the misoperation prevention judging module; the misoperation prevention judging module receives the key operation information extracted by the information input module, judges the key operation information, generates a man-machine interaction instruction according to a judging result and sends the man-machine interaction instruction to the man-machine interaction peripheral locking module; the man-machine interaction peripheral locking module generates a man-machine interaction operation instruction according to the man-machine interaction instruction and sends the man-machine interaction operation instruction to the man-machine interaction peripheral; the man-machine interaction peripheral is provided with a locking function, and corresponding operation is carried out according to man-machine interaction operation instructions. The invention can effectively control misoperation of the computer system and avoid production influence and economic loss.
Description
Technical Field
The invention belongs to the technical field of computer system processing, and particularly relates to a computer system misoperation prevention system and method.
Background
Microcomputer uses keyboard and mouse to perform man-machine interaction, and is widely used in various industries, in some specific industries, such as: industrial control, finance, software, etc., misoperation to the keyboard and mouse may lead to serious events.
In the field of industrial control, an operator station and an engineer station of a Digital Control System (DCS) both adopt a keyboard and a mouse to perform man-machine interaction, an operation and maintenance personnel clicks and executes equipment start-stop and valve switch operation by using the mouse, and once misoperation occurs, the process system is possibly stopped, and the production of a factory is influenced.
In the financial field, if an error occurs in transferring an input amount, a great economic loss may be caused.
Therefore, it is desirable to develop a system or method capable of effectively controlling the misoperation of a computer system, avoiding the production influence, economic loss and the like.
Disclosure of Invention
The invention aims to provide an anti-misoperation system and method for a computer system, wherein the system is used for identifying the correctness of operation by locking the operation of a man-machine interaction peripheral and carrying out anti-misoperation judgment, so that the possibility of misoperation caused by people is avoided.
The technical scheme for realizing the purpose of the invention comprises the following steps:
a computer system anti-misoperation system, the system comprising: the system comprises an image acquisition module, an image analysis module, an anti-misoperation judging module, a man-machine interaction peripheral locking module, a man-machine interaction peripheral and an information input module;
the image acquisition module acquires image information on a graphic display of the computer system and sends the image information to the image analysis module;
the image analysis module performs recognition analysis on the image information to generate monitoring information, and sends the monitoring information to the misoperation prevention judging module;
the misoperation prevention judging module receives the key operation information extracted by the information input module, judges the key operation information, generates a man-machine interaction instruction according to a judging result, and sends the man-machine interaction instruction to the man-machine interaction peripheral locking module;
the man-machine interaction peripheral locking module generates a man-machine interaction operation instruction according to the man-machine interaction instruction, and sends the man-machine interaction operation instruction to the man-machine interaction peripheral;
the man-machine interaction peripheral is provided with a locking function, and corresponding operation is carried out according to man-machine interaction operation instructions;
the anti-misoperation judging module judges key operation information, generates a man-machine interaction instruction according to a judging result, and sends the man-machine interaction instruction to the man-machine interaction peripheral locking module, wherein the anti-misoperation judging module comprises:
if the key operation information is consistent with the monitoring information, the anti-misoperation judging module generates a man-machine interaction locking instruction, the man-machine interaction locking instruction is sent to the man-machine interaction peripheral locking module, meanwhile anti-misoperation judgment is executed, after the anti-misoperation judgment is passed, the anti-misoperation judging module generates a man-machine interaction locking instruction releasing the man-machine interaction locking instruction, and the man-machine interaction locking instruction releasing the man-machine interaction locking instruction is sent to the man-machine interaction peripheral locking module;
if the key operation information is inconsistent with the monitoring information, the misoperation prevention judging module generates a man-machine interaction executing instruction and sends the man-machine interaction executing instruction to the man-machine interaction peripheral locking module;
the man-machine interaction peripheral locking module generates a man-machine interaction operation instruction according to the man-machine interaction instruction, sends the man-machine interaction operation instruction to the man-machine interaction peripheral, and the man-machine interaction peripheral performs corresponding operation according to the man-machine interaction operation instruction, and comprises the following steps:
if the man-machine interaction peripheral locking module receives the man-machine interaction locking instruction sent by the misoperation prevention judging module, the man-machine interaction peripheral locking module generates a locking key operation instruction and sends the locking key operation instruction to the man-machine interaction peripheral, and the man-machine interaction peripheral locks key operation;
if the man-machine interaction peripheral locking module receives the man-machine interaction unlocking instruction or the man-machine interaction executing instruction sent by the misoperation prevention judging module, the man-machine interaction peripheral locking module generates an executing key operation instruction and sends the executing key operation instruction to the man-machine interaction peripheral, and the man-machine interaction peripheral executes key operation.
Further, the monitoring information includes position information of a key operation window, position information of a key operation area, position information of a mouse, input frame information, and selection frame information.
Further, the information input module comprises a behavior recognition module, a voice recognition module and an instruction extraction module; the behavior recognition module receives the behavior information acquired by the first camera, recognizes the behavior information, extracts behavior recognition information, and sends the behavior recognition information to the misoperation prevention judging module; the voice recognition module receives the voice information collected by the microphone, recognizes the voice information, extracts the voice recognition information, and sends the voice recognition information to the misoperation prevention judging module; the instruction extraction module extracts operation information in the work management system, generates an expected operation instruction, and sends the expected operation instruction to the misoperation prevention judging module.
Further, the locking function of the man-machine interaction peripheral is integrated in a customized keyboard and mouse, or integrated in software interfaces of the keyboard and the mouse.
Further, the man-machine interaction peripheral is specifically a keyboard and a mouse of a computer system.
Further, the man-machine interaction peripheral comprises a USB-HID acquisition interface and a USB-HID instruction output module, the USB-HID acquisition interface is used for acquiring interaction operation information of the man-machine interaction peripheral, the interaction operation information is sent to the man-machine interaction peripheral locking module, the man-machine interaction peripheral locking module generates a man-machine interaction operation instruction according to the man-machine interaction instruction sent by the misoperation prevention judging module, the man-machine interaction operation instruction comprises a locking key operation instruction and an execution key operation instruction, and when the man-machine interaction operation instruction is the execution key operation instruction, the USB-HID instruction output module receives the interaction operation information sent by the USB-HID acquisition interface and sends the interaction operation information to downstream application software.
Further, the image acquisition module comprises a second camera and a computer image acquisition interface, wherein the computer image acquisition interface receives the image information sent by the second camera, converts the image information into computer image information, and sends the computer image information to the image analysis module.
A method of preventing malfunction of a computer system, the method comprising the steps of:
step (1), collecting image information of a computer system;
step (2), identifying and analyzing the image information to generate monitoring information;
step (3), identifying and judging key operation information, and generating a man-machine interaction instruction according to a judging result;
step (4), executing misoperation prevention judgment when the man-machine interaction instruction is a man-machine interaction locking instruction, and judging whether the misoperation prevention judgment is passed or not;
and (5) confirming whether the man-machine interaction peripheral executes key operation or not according to the misoperation prevention judging result.
Further, the monitoring information includes position information of a key operation window, position information of a key operation area, position information of a mouse, input frame information, and selection frame information.
Further, the step (3) specifically comprises: when the key operation information is consistent with the monitoring information, a man-machine interaction locking instruction is generated, and the man-machine interaction peripheral equipment locks the key operation; and when the key operation information is inconsistent with the monitoring information, generating a man-machine interaction execution instruction, and executing the key operation by the man-machine interaction peripheral.
Further, the step (5) includes:
step (5.1), when the misoperation prevention judgment passes, releasing the man-machine interaction locking instruction, and enabling the man-machine interaction peripheral to resume normal execution of key operation;
and (5.2) executing the misoperation prevention judgment when the misoperation prevention judgment is not passed, and continuously locking key operation by the man-machine interaction peripheral equipment.
The beneficial technical effects of the invention are as follows:
1. according to the computer system misoperation prevention system, through misoperation prevention judgment, the risk of misoperation caused by people is reduced, and factory shutdown and property loss caused by misoperation are avoided;
2. the anti-misoperation system of the computer system provided by the invention realizes that the anti-misoperation system is locked only in key operation by arranging the man-machine interaction peripheral with the locking function, so that the normal use of the man-machine interaction peripheral is not influenced;
3. the computer system misoperation prevention system provided by the invention provides the intervention type and non-intervention type misoperation prevention systems according to the system environment, and selects the misoperation prevention judging method according to the requirement, thereby improving the applicability and the expandability of the misoperation prevention method and the system.
Drawings
FIG. 1 is a block diagram of an anti-misoperation system of a computer system provided by the invention;
FIG. 2 is a block diagram of an anti-misoperation system installed in a computer system according to the present invention;
FIG. 3 is a block diagram of an anti-misoperation system installed outside a computer system according to the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples.
As shown in fig. 1, the present invention provides a computer system anti-misoperation system, which includes: the system comprises an image acquisition module 11, an image analysis module 12, an anti-misoperation judging module 13, a man-machine interaction peripheral locking module 14, a man-machine interaction peripheral 15 and an information input module.
The image acquisition module 11, the image analysis module 12, the misoperation prevention judging module 13, the man-machine interaction peripheral locking module 14 and the man-machine interaction peripheral 15 are sequentially connected, and the information input module is connected with the misoperation prevention judging module 13.
The image acquisition module 11 acquires image information on a graphic display of the computer system and sends the image information to the image analysis module 12.
The image analysis module 12 receives the image information sent by the image acquisition module 11, performs recognition analysis on the image information, generates monitoring information, and sends the monitoring information to the misoperation prevention determination module 13. The monitoring information includes position information of a key operation window, position information of a key operation area, position information of a mouse, input frame information, and selection frame information.
The misoperation prevention judging module 13 receives the monitoring information sent by the image analyzing module 12, receives the key operation information extracted by the information input module, judges the key operation information, generates a man-machine interaction instruction according to the judgment result, and sends the man-machine interaction instruction to the man-machine interaction peripheral locking module 14.
If the key operation information is consistent with the monitoring information, the anti-misoperation judging module 13 generates a man-machine interaction locking instruction, sends the man-machine interaction locking instruction to the man-machine interaction peripheral locking module 14, and simultaneously executes anti-misoperation judgment, wherein the anti-misoperation judgment comprises: speech recognition, eye focus recognition, multiple confirmations, etc. When the misoperation prevention judgment is passed, namely the command of the key operation information is consistent with the demand command, the misoperation prevention judgment module 13 generates a command for releasing the man-machine interaction locking, and the command for releasing the man-machine interaction locking is sent to the man-machine interaction peripheral locking module 14.
If the key operation information is inconsistent with the monitoring information, the misoperation prevention judging module 13 generates a man-machine interaction executing instruction and sends the man-machine interaction executing instruction to the man-machine interaction peripheral locking module 14.
The man-machine interaction peripheral locking module 14 receives the man-machine interaction instruction sent by the misoperation prevention judging module 13, generates a man-machine interaction operation instruction according to the man-machine interaction instruction, and sends the man-machine interaction operation instruction to the man-machine interaction peripheral 15;
the man-machine interaction peripheral 15 has a locking function, and performs corresponding operations according to man-machine interaction operation instructions.
If the man-machine interaction peripheral locking module 14 receives the man-machine interaction locking instruction sent by the misoperation prevention judging module 13, the man-machine interaction peripheral locking module 14 generates a locking key operation instruction and sends the locking key operation instruction to the man-machine interaction peripheral 15, and the man-machine interaction peripheral 15 locks key operation; if the man-machine interaction peripheral locking module 14 receives the man-machine interaction locking instruction or the man-machine interaction executing instruction sent by the misoperation prevention judging module 13, the man-machine interaction peripheral locking module 14 generates an executing key operation instruction and sends the executing key operation instruction to the man-machine interaction peripheral 15, and the man-machine interaction peripheral 15 executes the key operation.
The man-machine interaction locking instruction is transmitted to man-machine interaction peripheral equipment through a man-machine interaction peripheral equipment locking module, wherein the man-machine interaction peripheral equipment locking module comprises, but is not limited to, locking of a 'carriage return' key of a keyboard and/or a 'left key' of a mouse;
the man-machine interaction peripheral 15 comprises a keyboard, a mouse, etc. of a computer system, and the locking function can be integrated in the keyboard, the mouse with fixed value or integrated in a software interface of the keyboard and the mouse.
In specific implementation, when the mouse enters the key operation area and/or the input cursor enters the key operation window, the anti-misoperation determination module 13 generates a man-machine interaction locking instruction. When the mouse leaves the key operation area and/or the input cursor leaves the key operation window, generating a command for releasing the man-machine interaction locking by the misoperation prevention judging module 13; the man-machine interaction locking instruction and the man-machine interaction unlocking locking instruction are sent to the man-machine interaction peripheral locking module 14.
The invention provides a misoperation prevention method of a computer system, which comprises the following steps:
step (1), collecting image information of a computer system;
step (2), identifying and analyzing the image information to generate monitoring information, wherein the monitoring information comprises position information of a key operation window, position information of a key operation area, position information of a mouse and input frame information;
step (3), identifying and judging key operation information, and generating a man-machine interaction instruction according to a judging result; when the key operation information is consistent with the monitoring information, a man-machine interaction locking instruction is generated, and the man-machine interaction peripheral equipment locks the key operation; when the key operation information is inconsistent with the monitoring information, generating a man-machine interaction execution instruction, and executing key operation by a man-machine interaction peripheral;
step (4), when the man-machine interaction instruction is a man-machine interaction interlocking stopping instruction, executing misoperation prevention judgment, judging whether the misoperation prevention judgment is passed or not, namely judging whether an instruction of key operation information is consistent with a demand instruction or not;
step (5), confirming whether the man-machine interaction peripheral executes key operation or not according to the misoperation prevention judging result;
step (5.1), when the misoperation prevention judgment is passed, namely the instruction of key operation information is consistent with the demand instruction, the man-machine interaction locking instruction is released, and the man-machine interaction peripheral equipment resumes normal execution of key operation;
and (5.2) when the misoperation prevention judgment is not passed, namely the instruction of the key operation information is inconsistent with the demand instruction, executing the misoperation prevention judgment, and continuously locking the key operation by the man-machine interaction peripheral.
In the implementation, when the input icon is identified to enter the key input box, locking the 'enter' key of the keyboard, and when the mouse is identified to enter the key operation area, locking the 'left key' of the mouse; when the command of the key operation is consistent with the demand command, namely after the misoperation prevention judgment is passed, the locking of the carriage return key of the keyboard and/or the left key of the mouse is released.
Example 1
For a computer system that allows installation of third party software while not allowing connection to a production management system, the present embodiment installs a computer system anti-misoperation system in the computer system to realize an anti-misoperation function. As shown in fig. 2, the anti-misoperation system of the computer system comprises: an image acquisition module 11; an image analysis module 12; an erroneous operation prevention determination module 13; the system comprises a man-machine interaction peripheral locking module 14, a man-machine interaction peripheral 15 and an information input module. The man-machine interaction peripheral 15 comprises a USB-HID (i.e. a man-machine interaction peripheral based on USB, which is a protocol and interface) acquisition interface 151 and a USB-HID instruction output module 152. The information input module includes a behavior recognition module 161, a voice recognition module 162. The USB-HID instruction output module 152 is installed in the computer system in the form of application software.
The image acquisition module 11, the image analysis module 12, the misoperation prevention judging module 13 and the man-machine interaction peripheral locking module 14 are sequentially connected, and the information input module is connected with the misoperation prevention judging module 13.
The image acquisition module 11 is used for acquiring computer image information from the computer and sending the acquired computer image information to the image analysis module 12. The acquired computer image information can be directly sourced from the memory of the computer display card, or can be sourced from the interface of the computer display card and the display.
The image analysis module 12 performs recognition analysis on the computer image information to generate monitoring information, and sends the monitoring information to the misoperation prevention determination module 13. The monitoring information includes position information of a key operation window, position information of a key operation area, position information of a mouse, input frame information, and selection frame information.
The misoperation prevention judging module 13 receives the monitoring information sent by the image analyzing module 12, receives the key operation information extracted by the information input module, judges the key operation information, generates a man-machine interaction instruction according to the judgment result, and sends the man-machine interaction instruction to the man-machine interaction peripheral locking module 14.
The man-machine interaction peripheral locking module 14 receives the man-machine interaction instruction sent by the misoperation prevention judging module 13 and generates a man-machine interaction operation instruction.
If the key operation information is consistent with the monitoring information, the anti-misoperation judging module 13 generates a man-machine interaction locking instruction, sends the man-machine interaction locking instruction to the man-machine interaction peripheral locking module 14, and simultaneously executes anti-misoperation judgment. When the incorrect manipulation preventing judgment is passed, the incorrect manipulation preventing judgment module 13 generates a man-machine interaction locking releasing instruction, and sends the man-machine interaction locking releasing instruction to the man-machine interaction peripheral locking module 14.
If the key operation information is inconsistent with the monitoring information, the misoperation prevention judging module 13 generates a man-machine interaction executing instruction and sends the man-machine interaction executing instruction to the man-machine interaction peripheral locking module 14.
If the man-machine interaction peripheral locking module 14 receives the man-machine interaction locking instruction sent by the misoperation prevention judging module 13, the man-machine interaction peripheral locking module 14 generates a locking key operation instruction; if the man-machine interaction peripheral locking module 14 receives the man-machine interaction unlocking instruction or the man-machine interaction executing instruction sent by the misoperation prevention judging module 13, the man-machine interaction peripheral locking module 14 generates an executing key operation instruction.
In specific implementation, when the mouse enters the key operation area and/or the input cursor enters the key operation window, the anti-misoperation determination module 13 generates a man-machine interaction locking instruction. When the mouse leaves the key operation area and/or the input cursor leaves the key operation window, generating a command for releasing the man-machine interaction locking by the misoperation prevention judging module 13; the man-machine interaction locking instruction and the man-machine interaction unlocking locking instruction are sent to the man-machine interaction peripheral locking module 14.
The information input module comprises a behavior recognition module 161 and a voice recognition module 162; the behavior recognition module 161 has one end connected to the first camera 163 and the other end connected to the erroneous operation prevention determination module 13; the voice recognition module 162 has one end connected to the microphone 164 and the other end connected to the erroneous operation prevention determination module 13.
The first camera 163 is configured to collect behavior information of a current man-machine interaction peripheral operator, and send the behavior information to the behavior recognition module 161. The behavior information includes: operator eye focus and operator finger pointing.
The behavior recognition module 161 receives the behavior information collected by the first camera 163, recognizes the behavior information, extracts behavior recognition information, and transmits the behavior recognition information to the misoperation prevention determination module 13. The behavior identification information includes: operator eye focus position, operator finger orientation and position, number of operators.
The microphone 164 is used for collecting voice information of the current man-machine interaction peripheral operator, and sending the voice information to the voice recognition module 162. The voice information includes an operator spoken instruction.
The voice recognition module 162 recognizes the voice information, extracts the voice recognition information, and transmits the voice recognition information to the erroneous operation prevention determination module 13.
The malfunction prevention judgment module 13 performs malfunction prevention judgment on the behavior recognition information and the voice recognition information based on the extracted behavior recognition information of the behavior recognition module 161 and the voice recognition information extracted by the voice recognition module 162. And generating a man-machine interaction instruction according to the judging result, and sending the man-machine interaction instruction to the man-machine interaction peripheral locking module 14. When the anti-misoperation judging is passed, the anti-misoperation judging module 13 sends out an instruction for releasing the man-machine interaction locking.
Specifically, the anti-misoperation determining module 13 determines whether the operator's eye focus is located in the key operation window and/or the key operation region according to the operator's eye focus position, the operator's finger direction and position, and the number of operators extracted by the behavior identifying module 161; whether the operator finger pointing stays in the key operation window and/or the key operation area; whether confirmation by two or more operators is performed. The misoperation prevention determination module 13 determines the consistency of the spoken instruction with the position of the mouse and/or the input box information according to the operator spoken instruction extracted by the voice recognition module 162.
The human-computer interaction peripheral 15 comprises a USB-HID acquisition interface 151 and a USB-HID instruction output module 152.
The USB-HID acquisition interface 151 is configured to acquire the interactive operation information of the human-computer interaction peripheral 15, and send the interactive operation information to the human-computer interaction peripheral locking module 14. The human-machine interaction peripheral 15 includes a keyboard, a mouse, and the like.
When the man-machine interaction peripheral locking module 14 receives the man-machine interaction locking instruction sent by the misoperation prevention judging module 13, the man-machine interaction peripheral locking module 14 generates a locking key operation instruction, locks interaction operation information sent by the USB-HID acquisition interface 151 and prevents the interaction operation information from being sent to the USB-HID instruction output module 152. The interactive operation information includes: the "enter" key of the keyboard, the "left" key of the mouse.
When the man-machine interaction peripheral locking module 14 receives the man-machine interaction locking instruction or the man-machine interaction executing instruction sent by the misoperation prevention judging module 13, the man-machine interaction peripheral locking module 14 generates an executing key operation instruction, locks the interaction operation information sent by the USB-HID acquisition interface 151, and sends the interaction operation information to the USB-HID instruction output module 152.
The USB-HID command output module 152 receives the interactive operation information sent by the USB-HID acquisition interface 151, and sends the interactive operation information to the downstream application software.
Example 2
For the computer system with extremely high requirements on network security and system stability, which does not allow the installation of third-party software and does not allow the connection of the production management system, the embodiment installs the computer system anti-misoperation system outside the computer system so as to realize the anti-misoperation function. As shown in fig. 3, the anti-misoperation system of the computer system comprises: an image acquisition module 11; an image analysis module 12; an erroneous operation prevention determination module 13; the system comprises a man-machine interaction peripheral locking module 14, a man-machine interaction peripheral 15 and an information input module. The image acquisition module 11 comprises a second camera 111, a computer image acquisition interface 112. The information input modules include a behavior recognition module 161, a speech recognition module 162, and an instruction extraction module 163. The man-machine interaction peripheral 15 is a peripheral with a locking function.
The image analysis module 12, the misoperation prevention judging module 13, the man-machine interaction peripheral locking module 14 and the man-machine interaction peripheral 15 are sequentially connected, and the information input module is connected with the misoperation prevention judging module 13.
One end of the computer image acquisition interface 112 is connected with the second camera 111, and the other end is connected with the image analysis module 12. The second camera 111 is mounted in front of the computer system display, captures image information of the computer system display in real time, and transmits the captured image information to the computer image acquisition interface 112. The computer image acquisition interface 112 receives the image information sent by the second camera 111, converts the image information into computer image information, and sends the computer image information to the image analysis module 12.
The image analysis module 12 performs recognition analysis on the computer image information to generate monitoring information, and sends the monitoring information to the misoperation prevention determination module 13. The monitoring information includes position information of a key operation window, position information of a key operation area, position information of a mouse, input frame information, and selection frame information.
The misoperation prevention judging module 13 receives the monitoring information sent by the image analyzing module 12, receives the key operation information extracted by the information input module, judges the key operation information, generates a man-machine interaction instruction according to the judgment result, and sends the man-machine interaction instruction to the man-machine interaction peripheral locking module 14.
The man-machine interaction peripheral locking module 14 receives the man-machine interaction instruction sent by the misoperation prevention judging module 13 and generates a man-machine interaction operation instruction.
If the key operation information is consistent with the monitoring information, the anti-misoperation judging module 13 generates a man-machine interaction locking instruction, sends the man-machine interaction locking instruction to the man-machine interaction peripheral locking module 14, and simultaneously executes anti-misoperation judgment. When the incorrect manipulation preventing judgment is passed, the incorrect manipulation preventing judgment module 13 generates a man-machine interaction locking releasing instruction, and sends the man-machine interaction locking releasing instruction to the man-machine interaction peripheral locking module 14.
If the key operation information is inconsistent with the monitoring information, the misoperation prevention judging module 13 generates a man-machine interaction executing instruction and sends the man-machine interaction executing instruction to the man-machine interaction peripheral locking module 14.
If the man-machine interaction peripheral locking module 14 receives the man-machine interaction locking instruction sent by the misoperation prevention judging module 13, the man-machine interaction peripheral locking module 14 generates a locking key operation instruction; if the man-machine interaction peripheral locking module 14 receives the man-machine interaction unlocking instruction or the man-machine interaction executing instruction sent by the misoperation prevention judging module 13, the man-machine interaction peripheral locking module 14 generates an executing key operation instruction.
In specific implementation, when the mouse enters the key operation area and/or the input cursor enters the key operation window, the anti-misoperation determination module 13 generates a man-machine interaction locking instruction. When the mouse leaves the key operation area and/or the input cursor leaves the key operation window, generating a command for releasing the man-machine interaction locking by the misoperation prevention judging module 13; the man-machine interaction locking instruction and the man-machine interaction unlocking locking instruction are sent to the man-machine interaction peripheral locking module 14.
The information input module comprises a behavior recognition module 161, a voice recognition module 162 and an instruction extraction module 165; the behavior recognition module 161 has one end connected to the first camera 163 and the other end connected to the erroneous operation prevention determination module 13; one end of the voice recognition module 162 is connected with the microphone 164, and the other end is connected with the misoperation prevention judging module 13; the instruction extraction module 163 has one end connected to the work management system 166 and the other end connected to the erroneous operation prevention determination module 13.
The first camera 163 is configured to collect behavior information of a current man-machine interaction peripheral operator, and send the behavior information to the behavior recognition module 161. The behavior information includes: operator eye focus and operator finger pointing.
The behavior recognition module 161 receives the behavior information collected by the first camera 163, recognizes the behavior information, extracts behavior recognition information, and transmits the behavior recognition information to the misoperation prevention determination module 13. The behavior identification information includes: operator eye focus position, operator finger orientation and position, number of operators.
The microphone 164 is used for collecting voice information of the current man-machine interaction peripheral operator, and sending the voice information to the voice recognition module 162. The voice information includes an operator spoken instruction.
The voice recognition module 162 receives the voice information collected by the microphone 164, recognizes the voice information, extracts the voice recognition information, and sends the voice recognition information to the malfunction prevention judgment module 13.
The work management system 166 is used for making work plans and operation instructions in the management system, generating operation information, and sending the operation information to the instruction extraction module 165. The operation instruction comprises operation information of a key operation window in the computer image in the current work.
The instruction extraction module 165 is configured to extract operation information in the work management system 166, generate an expected operation instruction, and send the expected operation instruction to the anti-misoperation determining module 13.
The behavior recognition module 161, the voice recognition module 162 and the instruction extraction module 165 form 3 kinds of anti-misoperation judging information generation methods, and in the embodiment, the anti-misoperation judging information generation methods can be used in any collocation mode according to requirements, and can also be used independently.
The erroneous operation prevention determination module 13 performs erroneous operation prevention determination on the behavior recognition information, the voice recognition information, and the expected operation instruction generated by the instruction extraction module 165 based on the extracted behavior recognition information of the behavior recognition module 161, the voice recognition information extracted by the voice recognition module 162, and the expected operation instruction. And generating a man-machine interaction instruction according to the judging result, and sending the man-machine interaction instruction to the man-machine interaction peripheral locking module 14. When the anti-misoperation judging is passed, the anti-misoperation judging module 13 sends out an instruction for releasing the man-machine interaction locking.
Specifically, the anti-misoperation determining module 13 determines whether the operator's eye focus is located in the key operation window and/or the key operation region according to the operator's eye focus position, the operator's finger direction and position, and the number of operators extracted by the behavior identifying module 161; whether the operator finger pointing stays in the key operation window and/or the key operation area; whether confirmation by two or more operators is performed. The misoperation prevention determination module 13 determines the consistency of the spoken instruction with the position of the mouse and/or the input box information according to the operator spoken instruction extracted by the voice recognition module 162. The erroneous operation prevention determination module 13 determines the coincidence of the expected operation instruction with the position of the mouse and/or the input frame information and/or the selection frame information, based on the expected operation instruction generated by the instruction extraction module 165.
When the man-machine interaction peripheral locking module 14 receives the man-machine interaction locking instruction sent by the misoperation prevention judging module 13, the man-machine interaction peripheral locking module 14 generates a locking key operation instruction and sends the locking key operation instruction to the man-machine interaction peripheral 15 with the locking function, the man-machine interaction peripheral 15 with the locking function is provided with a locking device, and the man-machine interaction peripheral 15 is in a locking state through the locking device so as to lock the key operation.
When the man-machine interaction peripheral locking module 14 receives the man-machine interaction unlocking locking instruction or the man-machine interaction executing instruction sent by the misoperation prevention judging module 13, the man-machine interaction peripheral locking module 14 generates an executing key operation instruction and sends the executing key operation instruction to the man-machine interaction peripheral 15 with the locking function, the man-machine interaction peripheral 15 releases the locking device, and the man-machine interaction peripheral 15 executes the key operation.
The man-machine interaction peripheral 15 comprises a keyboard and a mouse, and can be specifically a carriage return key of the keyboard and/or a left key of the mouse, and the carriage return key of the keyboard and/or the left key of the mouse are/is in a locking state through a locking device of the man-machine interaction peripheral 15. After releasing the lock of the man-machine interaction peripheral 15, key operations may be performed by the "enter" key of the keyboard and/or the "left" key of the mouse.
The present invention has been described in detail with reference to the drawings and the embodiments, but the present invention is not limited to the embodiments described above, and various changes can be made within the knowledge of those skilled in the art without departing from the spirit of the present invention. The invention may be practiced otherwise than as specifically described.
Claims (11)
1. A computer system anti-misoperation system, characterized in that the system comprises: the system comprises an image acquisition module (11), an image analysis module (12), an anti-misoperation judging module (13), a man-machine interaction peripheral locking module (14), a man-machine interaction peripheral (15) and an information input module;
the image acquisition module (11) acquires image information on a graphic display of the computer system and sends the image information to the image analysis module (12);
the image analysis module (12) performs recognition analysis on the image information to generate monitoring information, and sends the monitoring information to the misoperation prevention judging module (13);
the misoperation prevention judging module (13) receives the key operation information extracted by the information input module, judges the key operation information, generates a man-machine interaction instruction according to a judging result, and sends the man-machine interaction instruction to the man-machine interaction peripheral locking module (14);
the information input module comprises a behavior recognition module (161) and a voice recognition module (162);
the misoperation prevention judging module (13) judges whether the eye focus of the operator is positioned in a key operation window and/or a key operation area according to the eye focus position of the operator, the finger direction and the position of the operator and the number of operators extracted by the behavior identifying module (161); whether the operator finger pointing stays in the key operation window and/or the key operation area; whether confirmation by two or more operators is performed; the misoperation prevention judging module (13) judges the consistency of the dictation instruction and the position of the mouse and/or the information of the input frame according to the dictation instruction of the operator extracted by the voice recognition module (162);
the man-machine interaction peripheral locking module (14) generates a man-machine interaction operation instruction according to the man-machine interaction instruction, and sends the man-machine interaction operation instruction to the man-machine interaction peripheral (15);
the man-machine interaction peripheral (15) has a locking function and performs corresponding operation according to man-machine interaction operation instructions;
the misoperation prevention judging module (13) judges key operation information, generates a man-machine interaction instruction according to a judging result, and sends the man-machine interaction instruction to the man-machine interaction peripheral locking module (14) comprises:
if the key operation information is consistent with the monitoring information, the anti-misoperation judging module (13) generates a man-machine interaction locking instruction, the man-machine interaction locking instruction is sent to the man-machine interaction peripheral locking module (14), meanwhile anti-misoperation judgment is executed, after the anti-misoperation judgment is passed, the anti-misoperation judging module (13) generates a man-machine interaction locking instruction releasing, and the man-machine interaction locking instruction releasing is sent to the man-machine interaction peripheral locking module (14);
if the key operation information is inconsistent with the monitoring information, the misoperation prevention judging module (13) generates a man-machine interaction executing instruction, and the man-machine interaction executing instruction is sent to the man-machine interaction peripheral locking module (14);
the man-machine interaction peripheral locking module (14) generates a man-machine interaction operation instruction according to the man-machine interaction instruction, the man-machine interaction operation instruction is sent to the man-machine interaction peripheral (15), and the man-machine interaction peripheral (15) performs corresponding operations according to the man-machine interaction operation instruction, wherein the operations comprise:
if the man-machine interaction peripheral locking module (14) receives the man-machine interaction locking instruction sent by the misoperation prevention judging module (13), the man-machine interaction peripheral locking module (14) generates a locking key operation instruction and sends the locking key operation instruction to the man-machine interaction peripheral (15), and the man-machine interaction peripheral (15) locks key operation;
if the man-machine interaction peripheral locking module (14) receives the man-machine interaction unlocking instruction or the man-machine interaction executing instruction sent by the misoperation prevention judging module (13), the man-machine interaction peripheral locking module (14) generates an executing key operation instruction and sends the executing key operation instruction to the man-machine interaction peripheral (15), and the man-machine interaction peripheral (15) executes the key operation.
2. The system of claim 1, wherein the monitoring information includes position information of a key operation window, position information of a key operation area, position information of a mouse, input frame information, and selection frame information.
3. The computer system anti-misoperation system according to claim 1, characterized in that the information input module comprises a behavior recognition module (161), a voice recognition module (162) and an instruction extraction module (165); the behavior recognition module (161) receives the behavior information collected by the first camera (163), recognizes the behavior information, extracts behavior recognition information, and sends the behavior recognition information to the misoperation prevention judgment module (13); the voice recognition module (162) receives voice information collected by the microphone (164), recognizes the voice information, extracts voice recognition information, and sends the voice recognition information to the misoperation prevention judging module (13); the instruction extraction module (165) extracts the operation information in the work management system (166), generates an expected operation instruction, and transmits the expected operation instruction to the erroneous operation prevention determination module (13).
4. A computer system anti-misoperation system according to claim 1, characterized in that the locking function of the man-machine interaction peripheral (15) is integrated in a customized keyboard, mouse or in a software interface of the keyboard, mouse.
5. The system according to claim 1, wherein the man-machine interaction peripheral (15) is in particular a keyboard or a mouse of the computer system.
6. The anti-misoperation system of a computer system according to claim 1, wherein the man-machine interaction peripheral (15) comprises a USB-HID acquisition interface (151) and a USB-HID instruction output module (152), the USB-HID acquisition interface (151) is used for acquiring interaction operation information of the man-machine interaction peripheral (15), the interaction operation information is sent to the man-machine interaction peripheral locking module (14), the man-machine interaction peripheral locking module (14) generates man-machine interaction operation instructions according to the man-machine interaction instructions sent by the anti-misoperation judging module (13), the man-machine interaction operation instructions comprise locking key operation instructions and executing key operation instructions, and when the man-machine interaction operation instructions are executing key operation instructions, the USB-HID instruction output module (152) receives the interaction operation information sent by the USB-HID acquisition interface (151) and sends the interaction operation information to downstream application software.
7. The system according to claim 1, wherein the image acquisition module (11) comprises a second camera (111) and a computer image acquisition interface (112), the computer image acquisition interface (112) receives the image information sent by the second camera (111), converts the image information into computer image information, and sends the computer image information to the image analysis module (12).
8. A method for preventing misoperation of a computer system, characterized in that a computer system according to claim 1 is adopted, the method comprises the following steps:
step (1), collecting image information of a computer system;
step (2), identifying and analyzing the image information to generate monitoring information;
step (3), identifying and judging key operation information, and generating a man-machine interaction instruction according to a judging result;
step (4), executing misoperation prevention judgment when the man-machine interaction instruction is a man-machine interaction locking instruction, and judging whether the misoperation prevention judgment is passed or not;
and (5) confirming whether the man-machine interaction peripheral executes key operation or not according to the misoperation prevention judging result.
9. The method for preventing misoperation of a computer system according to claim 8, wherein the monitoring information includes position information of a key operation window, position information of a key operation region, position information of a mouse, input frame information, and selection frame information.
10. The method for preventing misoperation of a computer system according to claim 8, wherein the step (3) is specifically: when the key operation information is consistent with the monitoring information, a man-machine interaction locking instruction is generated, and the man-machine interaction peripheral equipment locks the key operation; and when the key operation information is inconsistent with the monitoring information, generating a man-machine interaction execution instruction, and executing the key operation by the man-machine interaction peripheral.
11. The method for preventing misoperation of a computer system according to claim 8, wherein the step (5) includes:
step (5.1), when the misoperation prevention judgment passes, releasing the man-machine interaction locking instruction, and enabling the man-machine interaction peripheral to resume normal execution of key operation;
and (5.2) executing the misoperation prevention judgment when the misoperation prevention judgment is not passed, and continuously locking key operation by the man-machine interaction peripheral equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311268607.3A CN117009188B (en) | 2023-09-28 | 2023-09-28 | Computer system misoperation prevention system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311268607.3A CN117009188B (en) | 2023-09-28 | 2023-09-28 | Computer system misoperation prevention system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117009188A CN117009188A (en) | 2023-11-07 |
| CN117009188B true CN117009188B (en) | 2024-02-13 |
Family
ID=88571286
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311268607.3A Active CN117009188B (en) | 2023-09-28 | 2023-09-28 | Computer system misoperation prevention system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117009188B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105356619A (en) * | 2015-12-10 | 2016-02-24 | 国网四川省电力公司天府新区供电公司 | Anti-misoperation method for transformer station based image recognition |
| CN105553113A (en) * | 2016-03-03 | 2016-05-04 | 云南电网有限责任公司电力科学研究院 | Intelligent identification based anti-misoperation system and method for robot |
| CN105573586A (en) * | 2015-12-17 | 2016-05-11 | 昆山龙腾光电有限公司 | Method and device for preventing misoperation for terminal equipment |
| CN106887059A (en) * | 2017-01-18 | 2017-06-23 | 华南农业大学 | A kind of intelligent electronic lock system based on face recognition |
| CN108337490A (en) * | 2018-04-26 | 2018-07-27 | 中铁十局集团第二工程有限公司 | A kind of building site monitoring system |
| CN109165634A (en) * | 2018-09-21 | 2019-01-08 | 深圳市九洲电器有限公司 | A kind of intelligent identification Method, apparatus and system |
| CN109687581A (en) * | 2018-12-20 | 2019-04-26 | 国网北京市电力公司 | Method, apparatus, storage medium and the processor of Anti-maloperation for Substation |
| CN110148233A (en) * | 2019-04-19 | 2019-08-20 | 国网上海市电力公司 | It is a kind of for unlocking the system and method for substation's error-proof device |
| CN110253586A (en) * | 2019-07-12 | 2019-09-20 | 珠海优特电力科技股份有限公司 | Electrical anti-error operates device and method |
| CN112084873A (en) * | 2020-08-10 | 2020-12-15 | 国网上海市电力公司 | Five-prevention safety auxiliary method based on face recognition |
| CN114496326A (en) * | 2022-01-14 | 2022-05-13 | 中广核工程有限公司 | Monitoring and identifying method and system for man-machine interaction operation of nuclear power plant |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103376932B (en) * | 2012-04-26 | 2017-08-18 | 富泰华工业（深圳）有限公司 | Anti-misoperation system and method |
-
2023
- 2023-09-28 CN CN202311268607.3A patent/CN117009188B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105356619A (en) * | 2015-12-10 | 2016-02-24 | 国网四川省电力公司天府新区供电公司 | Anti-misoperation method for transformer station based image recognition |
| CN105573586A (en) * | 2015-12-17 | 2016-05-11 | 昆山龙腾光电有限公司 | Method and device for preventing misoperation for terminal equipment |
| CN105553113A (en) * | 2016-03-03 | 2016-05-04 | 云南电网有限责任公司电力科学研究院 | Intelligent identification based anti-misoperation system and method for robot |
| CN106887059A (en) * | 2017-01-18 | 2017-06-23 | 华南农业大学 | A kind of intelligent electronic lock system based on face recognition |
| CN108337490A (en) * | 2018-04-26 | 2018-07-27 | 中铁十局集团第二工程有限公司 | A kind of building site monitoring system |
| CN109165634A (en) * | 2018-09-21 | 2019-01-08 | 深圳市九洲电器有限公司 | A kind of intelligent identification Method, apparatus and system |
| CN109687581A (en) * | 2018-12-20 | 2019-04-26 | 国网北京市电力公司 | Method, apparatus, storage medium and the processor of Anti-maloperation for Substation |
| CN110148233A (en) * | 2019-04-19 | 2019-08-20 | 国网上海市电力公司 | It is a kind of for unlocking the system and method for substation's error-proof device |
| CN110253586A (en) * | 2019-07-12 | 2019-09-20 | 珠海优特电力科技股份有限公司 | Electrical anti-error operates device and method |
| CN112084873A (en) * | 2020-08-10 | 2020-12-15 | 国网上海市电力公司 | Five-prevention safety auxiliary method based on face recognition |
| CN114496326A (en) * | 2022-01-14 | 2022-05-13 | 中广核工程有限公司 | Monitoring and identifying method and system for man-machine interaction operation of nuclear power plant |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117009188A (en) | 2023-11-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108321930B (en) | Sequence control system and method | |
| CN100485558C (en) | Electrical power system safety operation intelligent monitoring device and monitoring method thereof | |
| CN110336375B (en) | Processing method and system for power grid monitoring alarm information | |
| CN101458502A (en) | Electrical power system standardized work intelligent control method and special equipment | |
| CN108053041B (en) | Secondary system abnormity identification and anti-misoperation system and method under multi-association scene of transformer substation | |
| CN111326153A (en) | Power grid intelligent regulation and control auxiliary robot interaction method based on semantic understanding | |
| EP3702913A1 (en) | Input operation processing method and processing device, and computer-readable storage medium | |
| CN111857470B (en) | Unattended control method and device for production equipment and controller | |
| CN103905270A (en) | Smart grid android system safety base line automatic checking system and method | |
| CN214154147U (en) | Intelligent anti-misoperation system for switching operation | |
| CN109802355B (en) | Method and device for preventing misoperation of relay protection soft pressing plate | |
| CN117009188B (en) | Computer system misoperation prevention system and method | |
| CN110348545B (en) | AR intelligent operation ticket method and device based on ERP system | |
| CN110828018A (en) | Compact distributed nuclear power reactor DCS architecture | |
| CN106547236A (en) | A kind of nuclear power plant digitizes the method for designing of accident program elements | |
| CN107301057A (en) | A kind of big data batch processing method and device | |
| CN115439106A (en) | Intelligent financial robot system for fund centralized settlement | |
| CN100367230C (en) | Action control method based on LSM programme | |
| CN211878585U (en) | Man-machine interaction system of dust removing equipment | |
| CN111061239A (en) | Remote programmed operation system for power grid dispatching | |
| CN115934005B (en) | Data storage method and system | |
| Yu et al. | Anti-error technology of secondary system of intelligent substation based on device state recognition and analysis | |
| CN211529625U (en) | Compact distributed nuclear power reactor DCS architecture | |
| CN111984973A (en) | Transformer substation integrated automation system host reinforcement acceptance system and method | |
| CN101299683A (en) | Collocation device and method for off-line data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |