CN112987846B - Anti-cheating keyboard and mouse input monitoring system - Google Patents

Anti-cheating keyboard and mouse input monitoring system Download PDF

Info

Publication number
CN112987846B
CN112987846B CN202110169976.1A CN202110169976A CN112987846B CN 112987846 B CN112987846 B CN 112987846B CN 202110169976 A CN202110169976 A CN 202110169976A CN 112987846 B CN112987846 B CN 112987846B
Authority
CN
China
Prior art keywords
keyboard
mouse
client
server
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110169976.1A
Other languages
Chinese (zh)
Other versions
CN112987846A (en
Inventor
陈祥雨
陈美华
鲍敏
袁超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Southeast University
Original Assignee
Southeast University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Southeast University filed Critical Southeast University
Priority to CN202110169976.1A priority Critical patent/CN112987846B/en
Publication of CN112987846A publication Critical patent/CN112987846A/en
Application granted granted Critical
Publication of CN112987846B publication Critical patent/CN112987846B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/04Generating or distributing clock signals or signals derived directly therefrom
    • G06F1/14Time supervision arrangements, e.g. real time clock
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/04Generating or distributing clock signals or signals derived directly therefrom
    • G06F1/06Clock generators producing several clock signals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/0202Constructional details or processes of manufacture of the input device
    • G06F3/0219Special purpose keyboards
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Debugging And Monitoring (AREA)
  • Alarm Systems (AREA)

Abstract

The invention discloses an anti-cheating keyboard and mouse input monitoring system, and belongs to the field of monitoring systems. An anti-cheating keyboard and mouse input monitoring system, comprising: the system comprises a keyboard, a mouse, a storage module, an information acquisition module and a client, wherein the mouse and the keyboard are connected to the client; the information acquisition module acquires the input operation of the keyboard and the time of the input operation, and the time of the mouse click, the roller operation and the operation; the mouse and the keyboard share a clock module to provide time sequence signals; the operation and operation time storage value acquired by the information acquisition module is transmitted to the server; the client acquires the operation and operation time of all mouse and keyboard input signals connected to the client and uploads the operation and operation time to the server; the server compares the operation and operation time of the keyboard and the mouse respectively acquired by the keyboard and the mouse and the client module, calculates the matching degree of the two parties, sets a matching degree threshold, and displays an alarm when the matching degree is lower than the threshold.

Description

Anti-cheating keyboard and mouse input monitoring system
Technical Field
The invention relates to the field of monitoring systems, in particular to an anti-cheating keyboard and mouse input monitoring system.
Background
Under special circumstances, schools or human institutions need to replace examination room pen tests by adopting remote tests, namely, test takers check test questions through a display of a computer client, and the test takers click answers of the selected questions on the computer client by using a mouse and answer the questions in a form of inputting characters by using a keyboard. The answer is transmitted back to the server of the teacher through the client. The test taker uses the video equipment such as mobile phone to send the real-time video picture of the answer of his own examination to the prison teacher.
This form presents a vulnerability: the test taker can leak the test question content of the client to other staff through the external display or through screen sharing software, other staff can connect other mice and keyboards to the client computer in a wired or wireless mode, and other staff can watch the test questions in the space outside the video picture and answer with the mice and the keyboards. Which is not detected by the examination system and by the prisoner.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides an anti-cheating keyboard and mouse input monitoring system.
The aim of the invention can be achieved by the following technical scheme:
an anti-cheating keyboard and mouse input monitoring system, comprising: the system comprises a keyboard, a mouse, a storage module, an information acquisition module and a client, wherein the mouse and the keyboard are connected to the client;
the information acquisition module acquires the input operation of the keyboard and the time of the input operation, and the time of the mouse click, the roller operation and the operation;
the mouse and the keyboard share a clock module and provide the time sequence signal;
the operation and operation time storage value acquired by the information acquisition module is transmitted to a server; the client acquires the operation and operation time of all mouse and keyboard input signals connected to the client and uploads the operation and operation time to the server;
the server compares the operation and operation time of the keyboard and the mouse respectively acquired by the keyboard and the mouse and the client module, calculates the matching degree of the two parties, sets a matching degree threshold, and displays an alarm when the matching degree is lower than the threshold.
Further, a microphone is arranged on the server, a loudspeaker is arranged on the client, and the microphone is in signal connection with the loudspeaker.
Further, the system also comprises a monitoring module, wherein the monitoring module comprises a plurality of cameras; the pictures collected by the monitoring module at least comprise: a picture of the face of the examinee and the keyboard in the same frame, and a picture of the face of the examinee and the mouse in the same frame; and the monitoring module transmits the pictures to the server in the form of video stream.
Further, the camera is mounted on a movable or angle-adjustable bracket.
Further, the threshold is set to 1%.
Further, the server is capable of storing the video stream.
Further, key color spots are arranged on each key of the keyboard, and whether the keys of the keyboard are displaced or not is judged by detecting the key color spots through the camera group.
The invention has the beneficial effects that:
in the examination process, the operation of the mouse and the keyboard by the test taker and the system time corresponding to the operation can be recorded, and after the test is finished, whether additional key mouse access exists can be judged by comparing the key mouse signals actually input by the computer end, so that the cheating means of accessing the external key mouse can be effectively prevented. The monitoring system can accurately judge the accurate time of the interference of the external key mouse and the specific degree of the interference, and can accurately judge the cheating behavior. In addition, the monitoring system can synchronously monitor the operation picture in the examination process, and further assist in judging whether the cheating situation occurs.
In the examination process, a test taker is appointed to use the mouse component and the keyboard component, the mouse and the keyboard component simulate the mode of human eye on-site observation through image recognition, the moment corresponding to the operations and the operations of the test taker such as keyboard knocking, mouse clicking, mouse wheel rolling and the like is recorded, the camera group of the keyboard component and the mouse component shoots the pictures of the test taker using the keyboard and the mouse, and the mouse operation data and the video pictures are sent to the server in real time. The invigilator views the pictures of the candidate operating the mouse and the keyboard in real time at the server, the server displays the real-time key mouse operating data record of the candidate, and monitors and reminds the matching degree threshold value, and the invigilator can judge whether the cheating behavior of the external key mouse operation exists or not.
The monitoring system has lower execution cost and is more convenient to popularize and use.
Drawings
The invention is further described below with reference to the accompanying drawings.
FIG. 1 is a schematic diagram of a monitoring system of the present application;
FIG. 2 is a schematic block diagram of a server of the monitoring system of the present application;
fig. 3 is a schematic structural diagram of a keyboard of the present application.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, a tamper resistant key mouse input monitoring system, comprising: the system comprises a keyboard, a mouse, a storage module, an information acquisition module and a client, wherein the mouse and the keyboard are connected to the client; the information acquisition module acquires the input operation of the keyboard and the time of the input operation, and the time of the mouse click, the roller operation and the operation; the mouse and the keyboard share a clock module and provide the time sequence signal; the operation and operation time storage value acquired by the information acquisition module is transmitted to a server; the client acquires the operation and operation time of all mouse and keyboard input signals connected to the client and uploads the operation and operation time to the server; the server compares the operation and operation time of the keyboard and the mouse acquired by the keyboard and the mouse and the client module respectively, calculates the matching degree of the two parties, and sets a matching degree threshold, for example, the threshold may be set to be 1%. When the matching degree is lower than the threshold value, the server displays an alarm, so that the aim of rapidly detecting cheating of the external keyboard and mouse is fulfilled.
More specifically, a microphone is arranged on the server, a loudspeaker is arranged on the client, and the microphone is connected with the loudspeaker through a signal, so that a prisoner can call a designated examinee through the server.
In addition, the invention also comprises a monitoring module, wherein the monitoring module comprises a plurality of cameras; the pictures collected by the monitoring module at least comprise: a picture of the face of the examinee and the keyboard in the same frame, and a picture of the face of the examinee and the mouse in the same frame; and the monitoring module transmits the pictures to the server in the form of video stream. Therefore, the prisoner can monitor the operation of the examinee through the video, and ensure that the examinee himself operates the keyboard and the mouse.
Further, the camera is mounted on a movable or angle-adjustable support, and an examinee can adjust the camera to a proper angle according to the position and sitting posture of the examinee, so that the face and the keyboard/mouse can appear on a monitoring picture at the same time.
The invention further discloses a specific embodiment, referring to fig. 2, during the examination, the mouse and the keyboard start to record the operation of the examinee and the time of the operation.
The information acquired by the information acquisition module comprises: the left mouse button is clicked + the moment of the clock module at the moment, the right mouse button is clicked + the moment of the clock module at the moment, the mouse wheel is rolled + the moment of the clock module at the moment and the keys of the keyboard are clicked + the moment of the clock module at the moment.
In the examination process, the test taker first examination client module starts to record all the operations of the mouse and the keyboard connected to the computer, and the recorded contents are consistent with the recorded forms of the mouse component and the keyboard component sent to the test taker, namely: there is a time when the left mouse button is clicked + a time when the right mouse button is clicked + a time when the mouse wheel is scrolled + a time when the keyboard button is tapped.
In the examination process, the server displays a list of examinees who are in examination: examinees a, b, c, etc., each taking part in the remote examination in the same manner as the examinees a.
For example, if the prisoner selects to click "the test taker's nail" on the server, the data comparison display module displays the current test taker's name, i.e. "test taker's nail".
In the examination process, cameras in a keyboard component and a mouse component of the examinee's first are used for shooting videos in real time, and video code streams are transmitted to a server. At the moment, when the invigilator selects and clicks 'examinee' on the server side, the invigilator can see at least 4 video pictures in the monitoring video group module of the server side: the method comprises the steps of performing in-frame video of the hands and the keyboard of the examinee, performing in-frame video of the faces and the keyboard of the examinee, performing in-frame video of the hands and the mouse of the examinee, and performing in-frame video of the faces and the mouse of the examinee; and the prisoner judges whether to operate the key mouse for the examinee's first person by comparing the face and hand actions of the examinee's first in the video and the operation of the on-site keyboard and the mouse.
Meanwhile, for example, as shown in fig. 2, the data uploaded by the data comparison information acquisition module of the server (left area) and the data transmitted by the display examination client module (right area). For example, the examinee first clicks the left mouse button once and the right mouse button once after 10:32:03.2 (10 points 32 parts for 3.2 seconds), and then enters an English word the and a space. All the data monitored by the mouse end and the examination client end at this time are completely consistent, namely the matching degree displayed by the data comparison display module is 100%. Assuming that the matching degree threshold set by the server is 98% (the threshold is necessarily smaller than 1), and the real-time matching degree is larger than the threshold at the moment, so that the value beside the matching degree of the server is displayed as normal; if the client module records the operation record which is not from the keyboard and mouse component, and the matching degree is less than the threshold value at a certain moment, an alarm is displayed beside the matching degree value, so that the prison teacher's examinee is prompted to possibly have cheating actions input by other keyboard and mouse.
In other examples, as shown in fig. 3, a camera group is arranged in front of the keyboard, and the position of the camera group is relatively unchanged from that of the keyboard; one camera shoots the same frame picture of the keyboard, the hands of the user and the faces of the user, and the other camera shoots the key close-up picture of the keyboard; in the use process, the angle and the position of the camera are not adjustable; each key of the keyboard is provided with a key color bar; in the picture, the acquisition module judges and records which key is pressed according to the displacement of each keyboard key color bar or whether the color spot of the detected key is covered.
In the description of the present specification, the descriptions of the terms "one embodiment," "example," "specific example," and the like, mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The foregoing has shown and described the basic principles, principal features and advantages of the invention. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, and that the above embodiments and descriptions are merely illustrative of the principles of the present invention, and various changes and modifications may be made without departing from the spirit and scope of the invention, which is defined in the appended claims.

Claims (7)

1. An anti-cheating keyboard and mouse input monitoring system, comprising: the system comprises a keyboard, a mouse, a storage module, an information acquisition module and a client, wherein the mouse and the keyboard are connected to the client;
the information acquisition module acquires the input operation of the keyboard and the time of the input operation, and the time of the mouse click, the roller operation and the operation;
the mouse and the keyboard share one clock module to provide time sequence signals;
the operation and operation time storage value acquired by the information acquisition module is transmitted to a server; the client acquires the operation and operation time of all mouse and keyboard input signals connected to the client and uploads the operation and operation time to the server;
the server compares the operation and operation time of the keyboard and the mouse respectively acquired by the keyboard and the mouse and the client module, calculates the matching degree of the two parties, sets a matching degree threshold, and displays an alarm when the matching degree is lower than the threshold.
2. The anti-cheating keymouse input monitoring system of claim 1, wherein a microphone is arranged on the server, a loudspeaker is arranged on the client, and the microphone is in signal connection with the loudspeaker.
3. The anti-cheating keymouse input monitoring system of claim 1, further comprising a monitoring module, the monitoring module comprising a plurality of cameras; the pictures collected by the monitoring module at least comprise: a picture of the face of the examinee and the keyboard in the same frame, and a picture of the face of the examinee and the mouse in the same frame; and the monitoring module transmits the pictures to the server in the form of video stream.
4. A tamper resistant keymouse input monitoring system according to claim 3 wherein the camera is mounted on a movable or angle adjustable stand.
5. The anti-cheating keyboard and mouse input monitoring system of claim 1, wherein the threshold is set to 1%.
6. The anti-cheating keymouse input monitoring system of claim 3, wherein said server is capable of storing said video stream.
7. The anti-cheating keyboard and mouse input monitoring system according to claim 1, wherein each key of the keyboard is provided with a key color spot, and whether the key of the keyboard is displaced is judged by detecting the key color spot through a camera group.
CN202110169976.1A 2021-02-05 2021-02-05 Anti-cheating keyboard and mouse input monitoring system Active CN112987846B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110169976.1A CN112987846B (en) 2021-02-05 2021-02-05 Anti-cheating keyboard and mouse input monitoring system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110169976.1A CN112987846B (en) 2021-02-05 2021-02-05 Anti-cheating keyboard and mouse input monitoring system

Publications (2)

Publication Number Publication Date
CN112987846A CN112987846A (en) 2021-06-18
CN112987846B true CN112987846B (en) 2024-02-20

Family

ID=76349076

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110169976.1A Active CN112987846B (en) 2021-02-05 2021-02-05 Anti-cheating keyboard and mouse input monitoring system

Country Status (1)

Country Link
CN (1) CN112987846B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI796909B (en) * 2021-12-29 2023-03-21 美商沃耶特拉海龜灘有限公司 Mouse device with a detection function of non-human mouse events and detection method thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101833619A (en) * 2010-04-29 2010-09-15 西安交通大学 Method for judging identity based on keyboard-mouse crossed certification
CN107247656A (en) * 2017-05-04 2017-10-13 东南大学 A kind of machine, which is passed the examination, records and counts the method and system of examinee's mouse behavior
CN111062027A (en) * 2019-12-25 2020-04-24 北京安天网络安全技术有限公司 Method and device for preventing bad HID equipment from invading, electronic equipment and storage medium
CN111192374A (en) * 2020-01-02 2020-05-22 湖南映客互娱网络信息有限公司 Real-time online monitoring method and system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9286026B2 (en) * 2006-09-08 2016-03-15 Aten International Co., Ltd. System and method for recording and monitoring user interactions with a server

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101833619A (en) * 2010-04-29 2010-09-15 西安交通大学 Method for judging identity based on keyboard-mouse crossed certification
CN107247656A (en) * 2017-05-04 2017-10-13 东南大学 A kind of machine, which is passed the examination, records and counts the method and system of examinee's mouse behavior
CN111062027A (en) * 2019-12-25 2020-04-24 北京安天网络安全技术有限公司 Method and device for preventing bad HID equipment from invading, electronic equipment and storage medium
CN111192374A (en) * 2020-01-02 2020-05-22 湖南映客互娱网络信息有限公司 Real-time online monitoring method and system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
智能化网络考试监控系统开发;刘持标;吴俊;张鸣华;陆永东;陈斌;黄保敬;吴宝发;;网络安全技术与应用(07);全文 *

Also Published As

Publication number Publication date
CN112987846A (en) 2021-06-18

Similar Documents

Publication Publication Date Title
US8600100B2 (en) Method of assessing people's self-presentation and actions to evaluate personality type, behavioral tendencies, credibility, motivations and other insights through facial muscle activity and expressions
Gorissen et al. Methodological triangulation of the students’ use of recorded lectures
US20140240507A1 (en) Online Examination Proctoring System
US20040152060A1 (en) Learning condition judging program and user condition judging system
JP4631014B2 (en) Electronic teaching material learning support device, electronic teaching material learning support system, electronic teaching material learning support method, and electronic learning support program
CN109685007B (en) Eye habit early warning method, user equipment, storage medium and device
CN112987846B (en) Anti-cheating keyboard and mouse input monitoring system
CN115345761A (en) Online examination auxiliary system and online examination monitoring method
WO2023041940A1 (en) Gaze-based behavioural monitoring system
TWI642026B (en) Psychological and behavioral assessment and diagnostic methods and systems
Pise et al. Estimation of learning affects experienced by learners: an approach using relational reasoning and adaptive mapping
US6684027B1 (en) Method and system for recording data for the purposes of performance related skill development
CN113987457A (en) Anti-cheating method and system for examination with computer for students
WO2022064621A1 (en) Video meeting evaluation system and video meeting evaluation server
JP2022074561A (en) Online examination method and online examination system
CN112270264A (en) Multi-party interactive teaching system
JP7289169B1 (en) Information processing device, method, program, and system
TWI796227B (en) Remote exam supervision systems and methods
AU2021107210A4 (en) System, method and virtual reality device for assessing compliance of body movement
Patil et al. Attentiveness monitoring and user record maintenance in virtual classrooms
WO2022113248A1 (en) Video meeting evaluation terminal and video meeting evaluation method
WO2022064620A1 (en) Video meeting evaluation system and video meeting evaluation server
WO2022145039A1 (en) Video meeting evaluation terminal, video meeting evaluation system and video meeting evaluation program
WO2022064617A1 (en) Video meeting evaluation system and video meeting evaluation server
CN221010189U (en) Remote teaching eye movement switching system for network intelligent training room

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant