CN117095456A - Examination behavior detection method and device, electronic equipment and storage medium - Google Patents

Abstract

The application relates to the technical field of computers, in particular to the field of video detection, and provides a detection method and device for examination behaviors, electronic equipment and a storage medium. The method comprises the following steps: in response to an examination starting instruction, acquiring target identity information of a target object in an examination picture shot by first camera equipment; determining first identity information corresponding to target identification information of glasses worn by a target object based on a preset binding relation between the identity information and the identification information, and matching the determined first identity information with the target identity information to obtain a matching result; after the matching result is determined to be in accordance with the examination specification, examination contents are displayed on an examination interface; periodically collecting at least one environmental information, and detecting the environmental information based on examination contents; and determining examination behaviors of the target object based on the detection result. Because the application detects based on the collected environmental information, the examination behavior of the target object is automatically determined, and the detection accuracy is improved.

Description

Examination behavior detection method and device, electronic equipment and storage medium

Technical Field

The application relates to the technical field of computers, in particular to the field of video detection, and provides a detection method and device for examination behaviors, electronic equipment and a storage medium.

Background

At present, thanks to high flexibility and convenience, online teaching and online examination become more and more common, and space limitation can be broken through, and travel time is saved, wherein online teaching often needs to observe learning conditions of students in real time, online examination is more complex, and corresponding examinee behavior detection strategies are needed to ensure the integrity of questions and examination.

In the related technology, aiming at an online examination, the on-line examination is mainly carried out by shooting an examinee through one or more camera devices, the identity of the examinee is checked manually, and the action of the examinee is observed to determine whether the examinee is an honest examination, but the imaging dead angle is easy to exist in the mode, and the artificial observation is carried out, and the observation is carried out only on the action of the examinee, so that the omission is easy to occur, and the efficiency is not high; if a plurality of camera devices are adopted, the requirements on examination environment, equipment quantity and equipment arrangement are higher, so that examination behavior is difficult to detect, and examination fairness is difficult to guarantee.

In summary, how to improve the accuracy of online examination behavior detection is needed to be solved.

Disclosure of Invention

The embodiment of the application provides a detection method, a detection device, electronic equipment and a storage medium for examination behaviors, which are used for improving the accuracy of on-line examination behavior detection.

The test behavior detection method provided by the embodiment of the application comprises the following steps:

in response to an examination starting instruction, acquiring target identity information of a target object in an examination picture shot by first camera equipment;

determining first identity information corresponding to target identification information of glasses worn by the target object based on a preset binding relation between the identity information and the identification information, and matching the determined first identity information with the target identity information to obtain a matching result;

after the matching result is determined to be in accordance with the examination specification, examination contents are displayed on an examination interface;

periodically collecting at least one environmental information, and detecting the environmental information based on examination contents; and determining examination behaviors of the target object based on the detection result.

The device for detecting examination behaviors provided by the embodiment of the application comprises the following components:

an acquisition unit for acquiring target identity information of a target object in an examination picture shot by the first camera device in response to an examination start instruction;

The matching unit is used for determining first identity information corresponding to target identification information of glasses worn by the target object based on a binding relation between preset identity information and the identification information, and matching the determined first identity information with the target identity information to obtain a matching result;

the display unit is used for displaying examination contents on an examination interface after determining that the matching result accords with the examination specification;

the acquisition unit is used for periodically acquiring at least one environmental information and detecting the environmental information based on examination contents; and determining examination behaviors of the target object based on the detection result.

Optionally, the apparatus further includes:

the determining unit is configured to determine, after the obtaining of the target identity information of the target object, that the target identity information is identical to second identity information before determining, based on a preset binding relationship between the identity information and the identification information, the received first identity information corresponding to the target identification information sent by the glasses worn by the target object, where the second identity information is the identity information bound with account information used by the target object to log in the examination interface.

Optionally, the matching unit is further configured to:

and before determining first identity information corresponding to the target identification information of the glasses worn by the target object, acquiring the target identification information of the glasses sent by the first image pickup device, wherein the target identification information sent by the first image pickup device is received from the glasses.

Optionally, the acquiring unit is further configured to:

before the target identity information of the target object is acquired, determining the number of objects in the shooting range as a set number based on an examination picture shot by the first shooting equipment;

the acquisition unit is further configured to:

and if the number of the objects in the shooting range is not the set number, displaying prompt information in the examination interface, and acquiring an examination picture again based on the first camera equipment.

Optionally, the collecting unit is specifically configured to collect environmental information by:

identifying a picture reflected on a lens of glasses worn by the object in examination pictures shot by the first camera equipment to obtain the environment information; or (b)

And identifying the picture shot by the second image pickup equipment on the glasses worn by the object to obtain the environment information.

Optionally, the collecting unit is specifically configured to:

if the obtained environment information comprises interface content displayed on the examination interface, comparing the interface content with the examination content to obtain a first detection result; matching examination room information except the interface content in the environment information with preset characters to obtain a second detection result, wherein the preset characters are set based on the examination content;

and judging the examination behavior of the target object based on the first detection result and the second detection result.

Optionally, the collecting unit is specifically configured to:

if the first detection result is that the interface content is consistent with the examination content in comparison, and the second detection result is that the preset characters are not matched in examination room information except for an examination interface, determining that the examination behaviors of the target object are normal;

and if the first detection result is that the interface content is inconsistent with the examination content in comparison, and/or the second detection result is that the examination room information except the examination interface is matched with the preset character, determining that the examination behavior of the target object is abnormal.

The electronic device provided by the embodiment of the application comprises a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of any examination behavior detection method.

An embodiment of the present application provides a computer readable storage medium including a computer program for causing an electronic device to execute the steps of any one of the above test behavior detection methods when the computer program is run on the electronic device.

Embodiments of the present application provide a computer program product comprising a computer program stored in a computer readable storage medium; when the processor of the electronic device reads the computer program from the computer readable storage medium, the processor executes the computer program, so that the electronic device executes the steps of any one of the examination behavior detection methods.

The application has the following beneficial effects:

the embodiment of the application provides a detection method, a detection device, electronic equipment and a storage medium for examination behaviors, wherein the identity of a target object can be verified based on examination pictures shot by first camera equipment, so that the identity of an examinee is ensured to be consulted, and then the identity of the examinee is further checked based on identification information of glasses; only after the identification information of the glasses is matched with the examinee, the examination content is displayed; environmental information is acquired for many times in the examination period, and examination behaviors of a target object are determined by automatically detecting the environmental information, so that the behaviors of the examinee are judged manually instead of only aiming at the behaviors of the examinee, and the high efficiency of information acquisition and the accuracy of behavior judgment are effectively improved.

Additional features and advantages of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application. The objectives and other advantages of the application will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.

Drawings

The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute a limitation on the application. In the drawings:

fig. 1 is a schematic diagram of an application scenario of a test behavior detection method according to an embodiment of the present application;

fig. 2 is an overall flowchart of a test behavior detection method provided by an embodiment of the present application;

FIG. 3 is a schematic diagram of an environmental information provided in an embodiment of the present application;

FIG. 4 is a schematic diagram of detecting environmental information according to an embodiment of the present application;

FIG. 5 is an overall flowchart of another test behavior detection method according to an embodiment of the present application;

fig. 6 is a schematic diagram of a composition structure of a test behavior detection device according to an embodiment of the present application;

Fig. 7 is a schematic diagram of a hardware composition structure of an electronic device according to an embodiment of the present application;

fig. 8 is a schematic diagram of a hardware composition structure of another electronic device according to an embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the technical solutions of the present application, but not all embodiments. All other embodiments, based on the embodiments described in the present document, which can be obtained by a person skilled in the art without any creative effort, are within the scope of protection of the technical solutions of the present application.

Some of the concepts involved in the embodiments of the present application are described below.

Identity information: the application is characterized by object identity information, which is divided into first identity information and second identity information of target identity information, wherein the target identity information is the identity information of the target object obtained through an examination picture, the first identity information is the identity information bound with the target identity information of glasses worn by the target object, and the second identity information is the identity information bound with account information used by the target object to log in an examination interface.

Environmental information: when the target object is tested, the information of the front scene covers the visual field range of the target object, and the visual field range comprises interface contents of a test interface displayed by the terminal equipment and test room information except the test interface.

The preferred embodiments of the present application will be described below with reference to the accompanying drawings of the specification, it being understood that the preferred embodiments described herein are for illustration and explanation only, and not for limitation of the present application, and embodiments of the present application and features of the embodiments may be combined with each other without conflict.

Fig. 1 is a schematic diagram of an application scenario according to an embodiment of the present application. The application scene graph includes two terminal devices 110, two glasses 130, two image capturing devices 140, and one server 120.

In the embodiment of the present application, the terminal device 110 includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a desktop computer, an electronic book reader, an intelligent home appliance, and the like; the terminal device may be provided with a client related to the examination, where the client may be software (such as a browser, examination software, etc.), or may be a web page, an applet, etc., and the server 120 may be a background server corresponding to the software or the web page, the applet, etc., or a server specifically used for detecting the examination behavior, and the application is not limited in detail. The server 120 may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), basic cloud computing services such as big data and artificial intelligent platforms, and the like; the lenses of the glasses 130 are polarized aspheric lenses, each glasses 130 has a unique identification information, and the identification information can be a device identification code and the like, and the application is not limited in particular; the image pickup apparatus 140 may be a video camera, or the like.

It should be noted that, the method for detecting the examination behavior in the embodiments of the present application may be performed by an electronic device, which may be the terminal device 110 or the server 120, that is, the method may be performed by the terminal device 110 or the server 120 alone or may be performed by both the terminal device 110 and the server 120 together. For example, when the server 120 is an execution subject, taking the object A1 as an example, the terminal device 110 receives and sends an examination start instruction to the server 120, and the server 120 obtains an examination picture shot by the image capturing device 140 after receiving the instruction, and obtains identity information of the object A1 in the picture; based on a preset binding relation between the identity information and the identification information, determining first identity information corresponding to target identification information of the glasses 130 worn by A1, and after determining that the first identity information is consistent with the identity information of A1, sending an instruction to enable the terminal equipment 110 to display examination content; after that, the server periodically collects environmental information through the image pickup device 140 and detects the environmental information based on the examination contents; and determining examination behaviors of the target object based on the detection result.

In an alternative embodiment, the terminal device 110 and the server 120 may communicate through a communication network, and the information may be transmitted between the glasses 130 and the image capturing device 140, for example, the identification information of the glasses may be transmitted, and the image capturing device 140 may send the information to the server 120 through the terminal device 110.

In an alternative embodiment, the communication network is a wired network or a wireless network.

It should be noted that, the number of terminal devices and servers shown in fig. 1 is merely illustrative, and the number of terminal devices and servers is not limited in practice, and is not particularly limited in the embodiment of the present application.

In addition, the embodiment of the application can be applied to various scenes, including but not limited to cloud technology, artificial intelligence, intelligent traffic and other scenes.

The examination behavior detection method provided by the exemplary embodiment of the present application will be described below with reference to the accompanying drawings in conjunction with the application scenario described above, and it should be noted that the application scenario is only shown for the convenience of understanding the spirit and principle of the present application, and the embodiment of the present application is not limited in any way in this respect.

Referring to fig. 2, a flowchart of an implementation of a test behavior detection method provided by an embodiment of the present application is shown, where a specific implementation flow of the method is as follows:

s201: in response to an examination start instruction, target identity information of a target object is acquired in an examination picture shot by the first camera device.

Before the on-line examination formally starts, the server needs to verify the identity of a target object (such as an examinee) and detect the number of people in the examination room so as to ensure that only one examinee exists in the examination room and prevent the situation that the off-site personnel assist in answering questions in the examination process, and an optional implementation manner is that the server determines the number of objects in a shooting range as a set number based on an examination picture shot by a first camera device; if the number of the objects in the shooting range is not the set number, prompt information is displayed in the examination interface, and examination pictures are acquired again based on the first camera equipment.

In the above, the first image capturing device is placed in front of the examinee, and may be an independent camera, a camera, or a camera carried by the terminal device, when the server detects the number of people in the examination room, the server needs to make the first image capturing device have a larger shooting range, if the first image capturing device is an independent camera, the process can be completed by directly adjusting the focal length by the server, if the first image capturing device is a camera carried by the terminal device, the process can be completed by manually adjusting the focal length, the azimuth, and the like by the examinee, so that the shooting range can cover the whole person of the examinee, and the surrounding environment of the examinee. The set number may be 1 person. The examination starting instruction can be triggered by the object after the interaction of the appointed interface, and can also be triggered at fixed time; for example, the designated interface has a "start test" button, and the object triggers a test start instruction after clicking. In addition, the interaction mode is not limited to the form of clicking a button, and can be gestures, dragging and the like; the content of the "start examination" is not limited, and may be "start verification identity", etc., and the present application is not particularly limited.

If only 1 object is detected in the photographed examination picture, the object is determined to be a target object, namely, an examinee, and based on the target object in the examination picture, the target identity information of the target object is obtained, and specific obtaining modes can be face recognition, iris recognition and the like.

If a plurality of objects are detected in the shot examination picture, prompt information is displayed in an examination interface of the terminal equipment to prompt that a plurality of people are detected in the examination room at present, and the examination room is shot again based on the first camera equipment to acquire the examination picture until only one person can be detected in the examination picture. The prompt information may be "please ensure that only one examinee exists in the examination room", "detect that there are multiple persons in the examination room, please leave the examination room by other persons than the examinee", etc., and the present application is not limited in particular.

Taking a specific scene as an example, assuming that a test taker A takes an on-line test, clicking a button for starting identity verification on a designated interface, acquiring a test picture by using first camera equipment, sending the test picture to a server, detecting that only one test taker A exists in a shooting range by the server, determining the test taker A as a target object, and acquiring target identity information of the test taker A.

S202: and determining first identity information corresponding to target identification information of glasses worn by the target object based on a preset binding relation between the identity information and the identification information, and matching the determined first identity information with the target identity information to obtain a matching result.

In the foregoing, before determining the first identity information corresponding to the target identification information of the glasses worn by the target object, the server needs to acquire the target identification information, where the target identification information is also sent by the first image capturing device, and the target identification information sent by the first image capturing device is received from the glasses.

That is, communication between the first image capturing device and the glasses may be achieved by bluetooth or the like, so that the glasses may transmit the target identification information to the first image capturing device, and the first image capturing device may transmit the photographed examination picture and the target identification information of the glasses to the server together. Or the examination picture and the target identification information of the glasses can be sent successively, and the application is not particularly limited.

Before confirming the identity of the examinee based on the binding relation between the preset identity information and the identification information, the identity of the examinee can be checked through the account information used by the target object login examination interface, and then the identity is further checked through the identification information of the glasses, so that the accuracy of the identity checking result is enhanced; the identity of the examinee can be confirmed and checked only by the identification information of the glasses.

The embodiment of checking the account information used may be that after the target identity information of the target object is obtained, the server determines that the target identity information is the same as the second identity information before determining the first identity information corresponding to the target identity information sent by the glasses worn by the target object based on the preset binding relationship between the identity information and the identity information, where the second identity information is the identity information bound with the account information used by the login examination interface of the target object.

For example, in the preset binding relationship, the examinee a binds with the glasses B, or the identification information of the glasses B binds with the identity information of the examinee a, the examinee C binds with the glasses D, the examinee E binds with the glasses F … … the examinee a registers the account number in advance and binds with the identity information of the examinee a, that is, the second identity information, before the examination.

Before an examination, an examinee A logs in the account number and enters an examination interface, at this time, the server confirms that the examinee A logs in the examination interface of the examinee A, or in other words, determines that the examinee needing to be examined is A according to second identity information bound by the account number, and the examination paper of the examination interface belongs to the examinee A; identifying the target object shot by the first camera equipment to obtain target identity information, and confirming that the second identity information is identical to the target identity information, namely confirming that the login person is the examinee A; then, the server determines that the glasses are glasses B according to the target identification information sent by the first image pickup device, and determines that the first identity information corresponding to the target identification information of the glasses B is examinee A according to the binding relation, namely, the user of the glasses B is determined to be examinee A, the examinee photographed by the first image pickup device is actually examinee A, and the glasses are successfully matched with the examinee.

If the online examination can enter the examinee interface without logging in an account, the server can determine and check the identity of the examinee only based on the target identification information of the glasses. For example, the examinee a binds with the glasses B, the examinee logs in the examination interface, the first camera device sends the shot target object and the target identification information of the glasses, the server determines that the glasses are the glasses B, the user of the glasses B should be the examinee a according to the binding relation, the server identifies the shot target object, determines that the target object is the examinee a, the server determines that the examinee needing examination is the examinee a, the examination paper of the examination interface belongs to the examinee a, and determines that the target object, namely the examinee, is the examinee a.

S203: and after the matching result is determined to be in accordance with the examination specification, displaying examination contents on an examination interface.

And after the first identity information is determined to be the same as the target identity information, displaying examination contents on an examination interface.

In the above, the test content may be displayed immediately after the first identity information is determined to be the same as the target identity information, or a unified test start time may be set, after the first identity information is determined to be the same as the target identity information, the test start time is skipped to the waiting interface, and after the preset test start time is reached, the test content is displayed.

Following the assumption in 202, after the glasses are successfully matched with the examinee, the server determines that the target object is the examinee a himself, and sends a corresponding instruction to the terminal device. And the terminal equipment displays the examination content in the examination interface.

S204: periodically collecting at least one environmental information, and detecting the environmental information based on examination contents; and determining examination behaviors of the target object based on the detection result.

In the above, the environmental information is periodically collected according to a preset time period, for example, one time of collection in one minute, etc., or may be set to enter the next collection and detection immediately after the end of the one collection and detection, and the application is not particularly limited; and each acquisition may be performed in two ways:

mode one: and identifying a picture reflected on a lens of glasses worn by the subject in the examination picture shot by the first shooting equipment to obtain environment information.

The glasses provided by the application are polarized aspheric lenses. The general lens can be a resin lens, the weight of the resin lens is light, the refractive index is low, but the polarized aspheric lens adopted by the application has less visual deformation and clearer image, when an examinee wears glasses to carry out on-line examination, the glasses can present images of an on-screen examination interface, and the information of the examination interface can be better kept on the mirror surface; when the examination environment is dark, the imaging is clearer; furthermore, when the surrounding environment is darker, but the screen light is stronger, the screen light can illuminate surrounding objects and then be reflected to the mirror surface by the surrounding objects, so that images of other objects in the examination room are also displayed on the mirror surface except the screen, and the environment information is collected from the lens.

Mode two: and identifying the picture shot by the second image pickup equipment on the glasses worn by the object to obtain the environment information.

In addition to collecting environmental information from the spectacle lenses, the spectacles are attached with a second image pickup device, an examination interface and an examination room environment in the visual field range of an examinee can be shot, and the server can collect the environmental information through pictures shot by the second image pickup device.

The environment information is mainly divided into two parts, one part is acquired based on the content in the examination interface displayed on the screen of the terminal equipment, and the other part is examination room information, which mainly reflects the examination room environment in the visual field range when the examinee faces the examination screen, or the environment information can be divided into information in the screen area and information outside the screen area.

In the above, when the server captures an image by using the first image capturing apparatus and acquires the environmental information, it is necessary to adjust the capturing area, that is, the distance and angle of the image. For example, the server controls the first image pickup device to perform angle adjustment, distance scaling and center point calibration of the image, so that the lens is positioned at a position 2/5 of the position above the center point of the photographed image, the lens area occupies 5% -8% of the photographing area, and collection is started after calibration is successful. If the second camera device is used for shooting, the shooting area needs to be adjusted to be suitable, and the complete examination interface and the examination room environment in the visual field range of the examinee can be acquired.

Then, if the collected test interface is normal, the server compares interface content displayed on the test interface with test content in the environment information to obtain a first detection result; and matching examination room information except interface content in the environment information with preset characters to obtain a second detection result, and finally judging examination behaviors of the target object based on the first detection result and the second detection.

An alternative way of determination is: if the first detection result is that the interface content is consistent with the examination content, and the second detection result is that the examination room information except the examination interface is not matched with the preset character, determining that the examination behavior of the target object is normal; if the first detection result is that the interface content is inconsistent with the examination content in comparison, and/or the second detection result is that the examination room information except the examination interface is matched with the preset character, determining that the examination behavior of the target object is abnormal.

In the above, the examinee may have a neck discomfort condition during the examination, and may have a short-lived requirement for turning his head around, and at this time, the acquired examination interface may be incomplete when environmental information is acquired, so the server may continuously acquire multiple frames of examination pictures based on the first image capturing device or the second image capturing device when environmental information is acquired each time; and selecting at least one frame to collect environment information, wherein the selection mode can be random frames, appointed frames and the like, if a complete examination interface cannot be collected, a frame is replaced for collecting, and if all frames cannot detect the complete examination interface, abnormal examination behaviors of a target object are determined. Or presetting a percentage threshold, and if the percentage of the examination interface part reflected by the screen information of all the frames acquired at the time to the whole examination interface is smaller than the preset percentage threshold, determining that the examination behavior of the target object is abnormal.

When a complete examination interface can be detected, as shown in fig. 3, an environmental information schematic diagram provided in the embodiment of the present application is shown, and for the interface content displayed on the examination interface in the environmental information, the server compares the interface content with the examination content, that is, the examination paper of the present examination, for example, extracts characters and images in the interface content, and compares the characters and images with test questions in the examination paper. A similarity threshold value can be preset, and if the similarity between the interface content and the examination content reaches the similarity threshold value, the content displayed by the examination interface is truly the examination paper of the examination, and the comparison is passed; if the similarity between the interface content and the examination content does not reach the similarity threshold, the examination behavior of the target object is abnormal, and the cheating condition exists.

Further, the similarity threshold may be set to be multiple, for example, a first similarity threshold and a second similarity threshold are set, where the first similarity threshold is smaller than the second similarity threshold, and if the similarity between the interface content and the examination content reaches the second similarity threshold, the comparison is passed; if the similarity of the interface content and the examination content does not reach the second similarity threshold value but reaches the first similarity threshold value, reminding an examinee of abnormality in the examination area; if the similarity between the interface content and the examination content does not reach the first similarity threshold, the examination behavior of the target object is abnormal, and the cheating condition exists.

For the environment information, the examination room information except the examination interface can adopt the modes of optical character recognition (Optical Character Recognition, OCR) character detection, preset template detection and the like to detect and score the association degree of characters, english, numbers and the like and examination contents which appear in the examination room environment except the examination interface, and also can preset an association threshold value, if the association of the characters and the examination contents of the examination is not detected, or the score of the association degree is insufficient, the examination room information indicates that the behavior of the examinee is normal; if the score of the association degree of the character and the examination content of the examination reaches the association threshold value, the abnormal examination behavior of the target object is indicated, and the cheating condition exists.

When the server detects abnormal examination behaviors of the target object or detects abnormal examination behaviors of the target object based on interface content or examination room information, the server stops collecting and detecting the current examination picture to obtain the current shot examination picture as evidence, and marks the examination room information of the target object and the evidence as serious events to report.

The related personnel can further check according to the evidence uploaded by the server to confirm whether the test taker has dishonest test behaviors, and if so, the test taker can immediately stop the test; or allowing the examinee to continue the examination but marking the examinee correspondingly to indicate that dishonest examination behaviors exist in the examination process, and continuously collecting the next environmental information by the server; if related personnel consider that the report is a server misjudgment, the serious event mark is canceled, and the server enters the next environmental information acquisition.

In addition, the examinee may have the requirements of rubbing eyes, wiping lenses and the like, so the application can also provide a short pause button, which can stop the examination paper display and the acquisition of environmental information, but the first camera equipment can detect the behavior and action of the target object, namely the examinee. In the acquisition process of the environmental information, the server can detect the face of the examinee through the first camera equipment in real time, so that the examination process is always completed by the examinee, and the situation that the camera equipment is shielded in the examination process can be prevented. Further, the first image capturing device may also adjust its own viewing angle along with the angle change of the target object in the examination process.

Along the assumption in S203, after the test taker a starts the test answer, the server controls the first image capturing device or the second image capturing device to adjust the shooting picture, and after the adjustment is completed, the server starts to periodically collect the environmental information and detect through the first image capturing device or the second image capturing device on the glasses; as shown in fig. 4, which is a schematic diagram for detecting environmental information provided by the embodiment of the present application, it is assumed that the picture in fig. 4 is captured by the server through the second image capturing device, and the interface content displayed by the examination interface is compared with the examination paper of the present examination by a single choice question server of the physical examination, so as to confirm that the interface content is consistent with the examination paper; for examination room information outside an examination interface, the server adopts character detection, three words of draft paper can be detected on draft paper placed in a desktop, rubber can be detected on rubber, english textbooks can be detected in textbooks, the relevance between the English textbooks and the physical examination of the examination room is very low, and the score of the relevance degree cannot reach a relevance threshold value, so that the examinee acts normally. The server enters the next environmental information acquisition and detection until the examination is finished.

Based on the above process, as shown in fig. 5, an overall flowchart of another test behavior detection method provided by the embodiment of the present application is that, after receiving a test start instruction, a server specifically executes the following steps:

step 501: examination pictures are shot based on the first camera device.

Step 502: the number of objects is determined in the test frame, if there are only 1 person in the test frame, step 503 is executed, otherwise step 504 is executed.

Step 503: the object is confirmed as a target object and target identity information thereof is acquired.

Step 504: and sending a corresponding instruction to the terminal equipment so that the terminal equipment displays the prompt information.

Step 505: target identification information of glasses worn by a target object and first identity information corresponding to the target identification information are obtained.

Step 506: determining whether the first identity information matches the target identity information, if so, executing step 507, otherwise executing step 508.

Step 507: and sending a corresponding instruction to the terminal equipment, so that the terminal equipment displays the examination content on an examination interface.

Step 508: the examination request is denied.

If the matching is incorrect, the examination is not allowed, and the server can also send a corresponding instruction to the terminal equipment, so that the terminal equipment sends a prompt to the examinee, and prompts that the identity check is wrong and the matching needs to be carried out again.

Step 509: the image capturing apparatus adjusts a capturing screen and acquires environmental information in the capturing screen.

The image capturing apparatus may be a first image capturing apparatus or a second image capturing apparatus, or may acquire images captured by the first image capturing apparatus and the second image capturing apparatus at the same time, and integrate the contents of the two images to acquire the environmental information.

Step 510: comparing interface contents displayed on an examination interface in the environment information with examination contents to obtain a first detection result; and matching the examination room information except the interface content in the environment information with the preset characters to obtain a second detection result.

Step 511: based on the first detection result and the second detection, it is determined whether the target object has a cheating behavior, if so, step 512 is executed, otherwise, step 509 is returned.

Step 512: and acquiring the current shot examination picture and reporting the examinee information of the target object.

In the foregoing, after step 512, the server may directly end the current examination of the target object, or may choose to record the current event but not end the examination, and continue the acquisition and detection of the next environmental information.

In the related art, whether cheating conditions exist in an on-line examination environment is mainly that whether an object is an examinee or not is mainly detected through a camera device, an examination interface is detected through a network, and the examinee is prevented from cutting a screen, but in the examination environment with hidden angles, if books, small copies and the like exist, the examination environment is difficult to observe, and even other people assist in the side; in addition, there may be an object that blocks the image capturing apparatus with a video recorded in advance, and after blocking the image capturing apparatus, the examinee refers to the data and even the tilmicosin cannot be found. The on-line examination mode of multi-machine-position auxiliary shooting cannot avoid the cheating problem caused by pre-recording video and shielding before a camera, a relatively large examination room environment is needed for the multi-machine-position, high requirements are placed on the number and arrangement of equipment, and the multi-machine-position is still actually relevant personnel (such as teachers) for monitoring through the camera equipment, the important point is to observe the action of the examinee, in this case, omission is easy to generate, and in some subtle small copies and the like, the cheating problem is difficult to see in the video.

The application directly obtains the environment information on the lens of the examinee, or obtains the examination picture through the second shooting equipment on the glasses to collect the environment information, checks the interface content in the environment information in real time, namely whether the examinee has problems or not, and simultaneously detects whether other people exist in the sight range of the examinee, other data and the like in real time by using the environment information, thereby well covering hidden corners which cannot be detected in the prior art, avoiding the problems of books and small copies in the examination environment with hidden angles and the problem of video shielding; on the other hand, the application does not need to install a plurality of camera equipment, has low requirements on the environment of the examination room, and can effectively improve the high efficiency and the data accuracy of data acquisition through the visual angle adjustment of the area where the lens is positioned.

The application focuses on detecting the environment instead of the actions of examinees, reduces the difficulty of on-line examination cheating identification, saves labor and has higher detection accuracy.

Based on the same inventive concept, the embodiment of the application also provides a detection device for examination behaviors. As shown in fig. 6, which is a schematic structural diagram of a test behavior detection device, may include:

an obtaining unit 601, configured to obtain target identity information of a target object in an examination picture shot by a first image capturing device in response to an examination start instruction;

A matching unit 602, configured to determine first identity information corresponding to target identification information of glasses worn by a target object based on a binding relationship between preset identity information and the identification information, and match the determined first identity information with the target identity information to obtain a matching result;

the display unit 603 is configured to display test contents on a test interface after determining that the matching result meets the test specification;

the acquisition unit 604 is configured to periodically acquire at least one environmental information, and detect the environmental information based on examination content; and determining examination behaviors of the target object based on the detection result.

Optionally, the apparatus further comprises:

the determining unit 605 is configured to determine, after obtaining target identity information of the target object, that the target identity information is identical to second identity information, based on a binding relationship between preset identity information and identification information, before determining first identity information corresponding to the target identification information sent by glasses worn by the target object, where the second identity information is identity information bound to account information used by the target object logging examination interface.

Optionally, the matching unit 602 is further configured to:

before first identity information corresponding to the target identity information of the glasses worn by the target object is determined, the target identity information of the glasses sent by the first image capturing device is obtained, and the target identity information sent by the first image capturing device is received from the glasses.

Optionally, the obtaining unit 601 is further configured to:

before acquiring target identity information of a target object, determining the number of objects in a shooting range as a set number based on examination pictures shot by first shooting equipment;

the acquisition unit 601 is further configured to:

if the number of the objects in the shooting range is not the set number, prompt information is displayed in the examination interface, and examination pictures are acquired again based on the first camera equipment.

Optionally, the collecting unit 604 is specifically configured to collect the environmental information by:

identifying a picture reflected on a lens of glasses worn by an object in examination pictures shot by the first camera equipment to obtain environment information; or (b)

And identifying the picture shot by the second image pickup equipment on the glasses worn by the object to obtain the environment information.

Optionally, the collecting unit 604 is specifically configured to:

if the obtained environment information comprises interface content displayed on the examination interface, comparing the interface content with the examination content to obtain a first detection result; matching examination room information except interface content in the environment information with preset characters to obtain a second detection result, wherein the preset characters are set based on examination content;

And judging the examination behavior of the target object based on the first detection result and the second detection result.

Optionally, the collecting unit 604 is specifically configured to:

if the first detection result is that the interface content is consistent with the examination content, and the second detection result is that the examination room information except the examination interface is not matched with the preset character, determining that the examination behavior of the target object is normal;

if the first detection result is that the interface content is inconsistent with the examination content in comparison, and/or the second detection result is that the examination room information except the examination interface is matched with the preset character, determining that the examination behavior of the target object is abnormal.

Having described the method and apparatus for detecting examination behavior according to an exemplary embodiment of the present application, next, an electronic device according to another exemplary embodiment of the present application will be described.

Those skilled in the art will appreciate that the various aspects of the application may be implemented as a system, method, or program product. Accordingly, aspects of the application may be embodied in the following forms, namely: an entirely hardware embodiment, an entirely software embodiment (including firmware, micro-code, etc.) or an embodiment combining hardware and software aspects may be referred to herein as a "circuit," module "or" system.

The embodiment of the application also provides electronic equipment based on the same conception as the embodiment of the method. In one embodiment, the electronic device may be a server, such as server 120 shown in FIG. 1. In this embodiment, the electronic device may be configured as shown in fig. 7, including a memory 701, a communication module 703, and one or more processors 702.

Memory 701 for storing a computer program for execution by processor 702. The memory 701 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, a program required for running an instant communication function, and the like; the storage data area can store various instant messaging information, operation instruction sets and the like.

The memory 701 may be a volatile memory (RAM), such as a random-access memory (RAM); the memory 701 may also be a nonvolatile memory (non-volatile memory), such as a read-only memory (rom), a flash memory (flash memory), a hard disk (HDD) or a Solid State Drive (SSD); or memory 701 is any other medium that can be used to carry or store a desired computer program in the form of instructions or data structures and that can be accessed by a computer, but is not limited to such. Memory 701 may be a combination of the above.

The processor 702 may include one or more central processing units (central processing unit, CPU) or digital processing units, or the like. And a processor 702 for implementing the test behavior detection method when the computer program stored in the memory 701 is called.

The communication module 703 is used for communicating with a terminal device and other servers.

The specific connection medium between the memory 701, the communication module 703 and the processor 702 is not limited in the embodiment of the present application. The embodiment of the present application is shown in fig. 7, where the memory 701 and the processor 702 are connected by a bus 704, where the bus 704 is shown in bold in fig. 7, and the connection between other components is merely illustrative, and not limiting. The bus 704 may be divided into an address bus, a data bus, a control bus, and the like. For ease of description, only one thick line is depicted in fig. 7, but only one bus or one type of bus is not depicted.

The memory 701 stores a computer storage medium, in which computer executable instructions are stored, for implementing the test behavior detection method according to the embodiment of the present application. The processor 702 is configured to perform the test behavior detection method described above, as shown in fig. 2.

In another embodiment, the electronic device may also be other electronic devices, such as terminal device 110 shown in fig. 1. In this embodiment, the structure of the electronic device may include, as shown in fig. 8: communication component 810, memory 820, display unit 830, camera 840, sensor 850, audio circuit 860, bluetooth module 870, processor 880, and the like.

The communication component 810 is for communicating with a server. In some embodiments, a circuit wireless fidelity (Wireless Fidelity, wiFi) module may be included, where the WiFi module belongs to a short-range wireless transmission technology, and the electronic device may help the user to send and receive information through the WiFi module.

Memory 820 may be used to store software programs and data. The processor 880 performs various functions of the terminal device 110 and data processing by executing software programs or data stored in the memory 820. Memory 820 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Memory 820 stores an operating system that enables terminal device 110 to operate. The memory 820 may store an operating system and various application programs, and may also store a computer program for executing the test behavior detection method according to the embodiment of the present application.

The display unit 830 may also be used to display information input by a user or information provided to the user and a graphical user interface (graphical user interface, GUI) of various menus of the terminal device 110. In particular, the display unit 830 may include a display 832 disposed on a front surface of the terminal device 110. The display 832 may be configured in the form of a liquid crystal display, light emitting diodes, or the like.

The display unit 830 may also be used to receive input numeric or character information, generate signal inputs related to user settings and function controls of the terminal device 110, and in particular, the display unit 830 may include a touch screen 831 disposed on the front surface of the terminal device 110, and may collect touch operations on or near the user, such as clicking buttons, dragging scroll boxes, and the like.

The touch screen 831 may cover the display screen 832, or the touch screen 831 may be integrated with the display screen 832 to implement input and output functions of the terminal device 110, and after integration, the touch screen may be abbreviated as touch screen. The display unit 830 may display an application program and a corresponding operation procedure in the present application.

The camera 840 may be used to capture still images and a user may post images captured by the camera 840 through an application. The camera 840 may be one or more. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive elements convert the optical signals to electrical signals, which are then transferred to a processor 880 for conversion to digital image signals.

The terminal device may further comprise at least one sensor 850, such as an acceleration sensor 851, a distance sensor 852, a fingerprint sensor 853, a temperature sensor 854. The terminal device may also be configured with other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, light sensors, motion sensors, and the like.

Audio circuitry 860, speaker 861, microphone 862 may provide an audio interface between a user and terminal device 110. The audio circuit 860 may transmit the received electrical signal converted from audio data to the speaker 861, and the electrical signal is converted into a sound signal by the speaker 861 and output. The terminal device 110 may also be configured with a volume button for adjusting the volume of the sound signal. On the other hand, microphone 862 converts the collected sound signals into electrical signals, which are received by audio circuit 860 and converted into audio data, which are output to communication component 810 for transmission to, for example, another terminal device 110, or to memory 820 for further processing.

The bluetooth module 870 is used for exchanging information with other bluetooth devices having a bluetooth module through a bluetooth protocol. For example, the terminal device may establish a bluetooth connection with a wearable electronic device (e.g., a smart watch) that also has a bluetooth module through the bluetooth module 870, thereby performing data interaction.

The processor 880 is a control center of the terminal device, connects various parts of the entire terminal using various interfaces and lines, and performs various functions of the terminal device and processes data by running or executing software programs stored in the memory 820 and calling data stored in the memory 820. In some embodiments, processor 880 may include one or more processing units; the processor 880 may also integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., and a baseband processor that primarily handles wireless communications. It will be appreciated that the baseband processor described above may not be integrated into the processor 880. The processor 880 of the present application may run an operating system, an application program, a user interface display, a touch response, and a test behavior detection method according to the embodiments of the present application. In addition, the processor 880 is coupled to the display unit 830.

In some possible embodiments, aspects of the test behavior detection method provided by the present application may also be implemented in the form of a program product, which includes a computer program for causing an electronic device to perform the steps in the test behavior detection method according to the various exemplary embodiments of the present application described above when the program product is run on the electronic device, for example, the electronic device may perform the steps as shown in fig. 2.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the spirit or scope of the application. Thus, it is intended that the present application also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims (10)

1. A method for detecting examination behavior, the method comprising:

in response to an examination starting instruction, acquiring target identity information of a target object in an examination picture shot by first camera equipment;

determining first identity information corresponding to target identification information of glasses worn by the target object based on a preset binding relation between the identity information and the identification information, and matching the determined first identity information with the target identity information to obtain a matching result;

After the matching result is determined to be in accordance with the examination specification, examination contents are displayed on an examination interface;

periodically collecting at least one environmental information, and detecting the environmental information based on examination contents; and determining examination behaviors of the target object based on the detection result.

2. The method of claim 1, wherein after the obtaining the target identity information of the target object, before determining the received first identity information corresponding to the target identity information sent by the glasses worn by the target object based on the preset binding relationship between the identity information and the identity information, the method further comprises:

and determining that the target identity information is the same as second identity information, wherein the second identity information is the identity information bound with account information used by the target object to log in the examination interface.

3. The method of claim 1, further comprising, prior to said determining the first identity information corresponding to the target identification information of the glasses worn by the target subject:

and acquiring target identification information of the glasses, which is sent by the first image pickup device, wherein the target identification information is received from the glasses.

4. The method of claim 1, wherein prior to the obtaining the target identity information of the target object, the method further comprises:

determining the number of objects in the shooting range as a set number based on the examination picture shot by the first camera equipment;

the method further comprises the steps of:

and if the number of the objects in the shooting range is not the set number, displaying prompt information in the examination interface, and acquiring an examination picture again based on the first camera equipment.

5. The method of claim 1, wherein the environmental information is collected by:

identifying a picture reflected on a lens of glasses worn by the object in examination pictures shot by the first camera equipment to obtain the environment information; or (b)

And identifying the picture shot by the second image pickup equipment on the glasses worn by the object to obtain the environment information.

6. The method of claim 1, wherein the environmental information is detected based on examination content; determining examination behaviors of the target object based on the detection result comprises the following steps:

if the obtained environment information comprises interface content displayed on the examination interface, comparing the interface content with the examination content to obtain a first detection result; matching examination room information except the interface content in the environment information with preset characters to obtain a second detection result, wherein the preset characters are set based on the examination content;

And judging the examination behavior of the target object based on the first detection result and the second detection result.

7. The method of claim 6, wherein the determining the test behavior of the target object based on the first detection result and the second detection comprises:

if the first detection result is that the interface content is consistent with the examination content in comparison, and the second detection result is that the preset characters are not matched in examination room information except for an examination interface, determining that the examination behaviors of the target object are normal;

and if the first detection result is that the interface content is inconsistent with the examination content in comparison, and/or the second detection result is that the examination room information except the examination interface is matched with the preset character, determining that the examination behavior of the target object is abnormal.

8. A test behavior detection device, comprising:

an acquisition unit for acquiring target identity information of a target object in an examination picture shot by the first camera device in response to an examination start instruction;

the matching unit is used for determining first identity information corresponding to target identification information of glasses worn by the target object based on a binding relation between preset identity information and the identification information, and matching the determined first identity information with the target identity information to obtain a matching result;

The display unit is used for displaying examination contents on an examination interface after determining that the matching result accords with the examination specification;

the acquisition unit is used for periodically acquiring at least one environmental information and detecting the environmental information based on examination contents; and determining examination behaviors of the target object based on the detection result.

9. An electronic device comprising a processor and a memory, wherein the memory stores a computer program which, when executed by the processor, causes the processor to perform the steps of the method of any of claims 1 to 7.

10. A computer readable storage medium, characterized in that it comprises a computer program for causing an electronic device to perform the steps of the method according to any one of claims 1-7 when said computer program is run on the electronic device.