CN113395472A

CN113395472A - Video-based scoring method and device, electronic equipment and storage medium

Info

Publication number: CN113395472A
Application number: CN202010171869.8A
Authority: CN
Inventors: 吕瑞
Original assignee: Hangzhou Hikvision Digital Technology Co Ltd
Current assignee: Hangzhou Hikvision Digital Technology Co Ltd
Priority date: 2020-03-12
Filing date: 2020-03-12
Publication date: 2021-09-14

Abstract

The embodiment of the invention provides a video-based scoring method and device, electronic equipment and a storage medium. The method comprises the following steps: determining a video frame corresponding to each scoring point included in a target experiment from an operation video of a person to be scored for operating the target experiment; the video frame corresponding to any scoring point is used for judging the score of the scoring point and accords with the preset condition corresponding to the scoring point; for each scoring point, determining the score of the scoring point based on the attitude information of the target object in the video frame corresponding to the scoring point; wherein, the target object is: the object which is used for judging whether the operation corresponding to the scoring point is correct or not is arranged in each object related to the scoring point; and calculating the scoring result of the person to be scored about the target experiment based on the scores of the scoring points. Compared with the prior art, the method provided by the embodiment of the invention can greatly reduce the workload of teachers in scoring the experimental operation of students.

Description

Video-based scoring method and device, electronic equipment and storage medium

Technical Field

The present invention relates to the field of image processing technologies, and in particular, to a video-based scoring method and apparatus, an electronic device, and a storage medium.

Background

The experimental operation is an important means for helping students to master knowledge content. For example: the lever principle is the key and difficult point of students in physical mechanics learning, and in the teaching process of the lever principle, a teacher can demonstrate the operation of a lever balance experiment.

In addition, in order to help students to better understand and remember the learned knowledge content, teachers require the students to independently complete experimental operations and evaluate the experimental operation normative of the students through grading the experimental operation conditions of the students.

Currently, the method for scoring the experimental operation condition of the student by the teacher is as follows: when the student performs the experiment, the teacher observes the experiment operation process of the student beside and scores the experiment operation process based on the observed contents. Obviously, this scoring method requires the teacher to participate in the experimental procedure of each student, thereby making the workload of the teacher large.

Therefore, for experiments such as lever balance, in which the scoring is affected by the horizontal balance state of the experimental object, how to reduce the workload of the teacher in scoring the experimental operation of the student is a problem to be solved urgently.

Disclosure of Invention

The embodiment of the invention aims to provide a video-based scoring method, a video-based scoring device, electronic equipment and a storage medium, so as to reduce the workload of teachers in scoring experimental operations of students. The specific technical scheme is as follows:

in a first aspect, an embodiment of the present invention provides a video-based scoring method, where the method includes:

determining a video frame corresponding to each scoring point included in a target experiment from an operation video of a person to be scored for operating the target experiment; the video frame corresponding to any scoring point is used for judging the score of the scoring point and accords with the predetermined condition corresponding to the scoring point, and the predetermined condition comprises the following steps: each object related to the scoring point exists, the position relation of each object is the position relation adjusted by the person to be scored, and the position relation of each object is the position relation corresponding to the scoring point;

for each scoring point, determining the score of the scoring point based on the attitude information of the target object in the video frame corresponding to the scoring point; wherein the target object is: the object which is used for judging whether the operation corresponding to the scoring point is correct or not is arranged in each object related to the scoring point;

and calculating the scoring result of the person to be scored about the target experiment based on the scores of the scoring points.

Optionally, in a specific implementation manner, the target experiment is: a lever balance test, the scoring points comprising: a first score point, a second score point, a third score point, and a fourth score point;

wherein the first scoring point comprises: the center point of the lever is mounted on the scoring point on the supporting rod;

the second scoring point comprises: a scoring point for adjusting a balance nut of the lever to horizontally balance the lever;

the third scoring point comprises: one or more of horizontally balancing the lever using a weight, horizontally balancing the lever using a spring load cell, and horizontally balancing the lever using a weight and a spring load cell;

the fourth score point is: in the operation process corresponding to the third scoring point, the scoring point of the balance nut cannot be adjusted;

the target objects in the video frames corresponding to the first score point, the second score point, the third score point and the fourth score point comprise: the lever.

Optionally, in a specific implementation manner, when the third score point includes: a point of scoring at which the lever is horizontally balanced using a spring load cell, and/or, a point of scoring at which the lever is horizontally balanced using a weight and a spring load cell, the point of scoring further comprising: a fifth scoring point;

wherein the fifth score point is: a point of zero adjustment of the spring load cell;

the target object in the video frame corresponding to the fifth scoring point comprises: the spring load cell.

Optionally, in a specific implementation manner, the video frames corresponding to the first score, the second score, the third score and the fifth score are different video frames; and the video frames corresponding to the third scoring point and the fourth scoring point are the same video frames.

Optionally, in a specific implementation manner, the step of determining, from an operation video of a person to be scored operating a target experiment, a video frame corresponding to each scoring point included in the target experiment includes:

according to the playing sequence of the operation video, starting from the N frame of the preset operation video, detecting whether the lever and a lever shaft have a superposed area or not frame by frame, and whether the lever is not connected with the weight and the spring dynamometer or not;

and after each frame is detected, selecting the video frame corresponding to the first score point according to the detection result.

Optionally, in a specific implementation manner, the step of selecting, according to a detection result, a video frame corresponding to the first score point after detecting each frame includes:

after each frame is detected, if the detection result is yes, the frame is taken as a video frame corresponding to the first score point;

alternatively, the first and second electrodes may be,

after each frame is detected, if the detection result is yes, whether the area where the lever and the lever shaft coincide is not changed is judged, if yes, 1 is added to a first numerical value, otherwise, the first numerical value is cleared, and after 1 is added to the first numerical value, whether the first numerical value reaches a first preset number is judged, if yes, the judgment result is that the area where the lever and the lever shaft coincide is not changed, and the continuous first preset number of frames of video frames serve as the video frames corresponding to the first evaluation point.

according to the second scoring point, according to the playing sequence of the operation video, starting from a video frame corresponding to the first scoring point, detecting whether the lever is not connected with the weight and the spring dynamometer or not frame by frame, and whether the hand of the person to be scored is in contact with a balance nut of the lever or not;

after each frame is detected, if the detection result is yes, whether the lever is not connected with the weight and the spring dynamometer in the next frame or not is continuously detected, and whether the hand of the person to be evaluated is in contact with a balance nut of the lever or not is detected until a target video frame is detected; wherein the target video frame is: the detection result is a video frame that the lever is not connected with the weight and the spring dynamometer, and the hand of the person to be evaluated is not in contact with a balance nut of the lever;

detecting, frame by frame, from the target video frame, whether the lever is not connected with the weight and the spring dynamometer, and whether the hand of the person to be evaluated is not in contact with a balance nut of the lever;

after each frame is detected, if the detection result is yes, adding 1 to the second numerical value, if the detection result is that the lever is not connected with the weight and the spring dynamometer, and the hand of the person to be evaluated is in contact with a balance nut of the lever, clearing the second numerical value and returning to the step of continuously detecting whether the lever is not connected with the weight and the spring dynamometer in the next frame, and whether the hand of the person to be evaluated is in contact with the balance nut of the lever, and, after adding 1 to the second numerical value, judging whether the second numerical value reaches a second preset number or not, if so, the determined detection result is that the lever is not connected with the weight and the spring dynamometer, and the hand of the person to be evaluated is not in contact with the balance nut of the lever, and the continuous video frames of the second preset number of frames are used as the video frames corresponding to the second evaluation point.

Optionally, in a specific implementation manner, the video frame corresponding to the third scoring point includes a first video frame, where the first video frame is: a video frame for a scoring point that horizontally balances the lever using the weight;

the step of determining the video frame corresponding to each scoring point included in the target experiment from the operation video of the person to be scored operating the target experiment comprises the following steps:

according to the third scoring point, according to the playing sequence of the operation video, starting from the video frame corresponding to the second scoring point, detecting whether weights connected with the lever exist on two sides of the center point of the lever frame by frame;

after each frame is detected, if the detection result is yes, determining a first number of weights connected with the lever in the frame and a first connecting position of the lever, and judging whether a previous frame corresponding to the first number and the first connecting position is unchanged, if so, adding 1 to a third numerical value, otherwise, resetting the third numerical value, and after adding 1 to the third numerical value, judging whether the third numerical value reaches a third preset number, if so, determining that the determined detection result is that the previous frame corresponding to the first number and the first connecting position is unchanged, and taking continuous frames of the third preset number as the first video frames;

and determining the first video frame as the video frame corresponding to the fourth scoring point.

Optionally, in a specific implementation manner, the video frame corresponding to the third scoring point includes a predetermined video frame, and the predetermined video frame is a second video frame or a third video frame; wherein the second video frame is: a video frame of a point of scoring for horizontally balancing the lever using the weight and the spring load cell; the third video frame is: a video frame of a point of scoring for balancing the lever horizontally using the spring load cell;

according to the fifth scoring point, according to the playing sequence of the operation video, starting from the video frame corresponding to the second scoring point, detecting whether a spring dynamometer which is not connected with the lever and has a hand-held part in contact with the hand of the person to be scored exists or not frame by frame;

after each frame is detected, if the detection result is yes, determining the distance between a sliding sheet of the spring dynamometer and a zero scale mark of the spring dynamometer, and judging whether the distance is not changed corresponding to the previous frame, if so, adding 1 to a fourth numerical value, otherwise, resetting the fourth numerical value, and after adding 1 to the fourth numerical value, judging whether the fourth numerical value reaches a fourth preset number, if so, taking the determined detection result that the distance is not changed corresponding to the previous frame, and taking the continuous video frames of the fourth preset number as the video frames corresponding to the fifth evaluation point;

according to the playing sequence of the operation video, starting from the video frame corresponding to the fifth score point, detecting whether two sides of the center point of the lever meet a preset condition frame by frame; wherein, when the predetermined video frame is the second video frame, the predetermined condition is: there is a weight and a spring load cell connected to the lever only on one side of a center point of the lever, and when the predetermined video frame is the third video frame, the predetermined condition is: spring force meters connected with the levers are arranged on two sides of the center point of each lever;

after each frame is detected, if the detection result is yes, determining a preset index corresponding to the preset condition in the frame; judging whether the previous frame corresponding to the preset index is unchanged, if so, adding 1 to a fifth numerical value, otherwise, resetting the fifth numerical value, and after adding 1 to the fifth numerical value, judging whether the fifth numerical value reaches a fifth preset number, if so, judging that the previous frame corresponding to the preset index is unchanged and the continuous video frames of the fifth preset number are taken as the preset video frames; wherein, when the predetermined video frame is the second video frame, the predetermined index is: the second quantity of the hung weights, the second connecting position of the hung weights and the lever, and the connecting position of the hooked spring dynamometer and the lever; when the predetermined video frame is the third video frame, the predetermined condition is: the hooked spring dynamometer is respectively connected with the connecting positions of the levers;

and determining the preset video frame as the video frame corresponding to the fourth scoring point.

Optionally, in a specific implementation manner, the step of determining, for each score point, a score of the score point based on the posture information of the target object in the video frame corresponding to the score point includes:

aiming at a first score point, determining a central area where a central point of a lever is located in a video frame corresponding to the first score point;

when the central region coincides with the coincidence region, determining the score of the scoring point as: the grade corresponding to the correct operation of the grade point;

wherein the overlapping area is: the area where the lever coincides with the lever axis.

aiming at the second score point, determining an included angle between a connecting line between lever identification information positioned at two sides of the center point of the lever and a first preset calibration object in a video frame corresponding to the second score point; wherein, the first preset calibration object is: an object for calibrating whether the lever is horizontally balanced;

when the included angle is within a first preset included angle range, determining that the score of the scoring point is as follows: the score corresponding to the correct operation of the score point.

and aiming at the fifth scoring point, judging whether the distance between a slide sheet of the spring dynamometer and a zero scale line of the spring dynamometer is smaller than a preset distance, and if so, determining that the scoring of the scoring point is as follows: the score corresponding to the correct operation of the score point.

aiming at the third score point, determining an included angle between a connecting line between lever identification information positioned at two sides of the center point of the lever and a second preset calibration object in a video frame corresponding to the third score point; wherein, the second preset calibration object is: an object for calibrating whether the lever is horizontally balanced;

when the included angle is within a second preset included angle range, determining that the score of the scoring point is as follows: the score corresponding to the correct operation of the score point.

for the fourth scoring point, when the contact between the hand of the person to be scored and the balance nut of the lever is identified and obtained in the video frame corresponding to the fourth scoring point, determining the scoring of the scoring point as follows: the scoring corresponding to the error operation of the scoring point.

In a second aspect, an embodiment of the present invention provides a video-based scoring apparatus, including:

the video frame acquisition module is used for determining a video frame corresponding to each scoring point included in a target experiment from an operation video of the person to be scored operating the target experiment; the video frame corresponding to any scoring point is used for judging the score of the scoring point and accords with the predetermined condition corresponding to the scoring point, and the predetermined condition comprises the following steps: each object related to the scoring point exists, the position relation of each object is the position relation adjusted by the person to be scored, and the position relation of each object is the position relation corresponding to the scoring point;

the score determining module is used for determining the score of each score point based on the attitude information of the target object in the video frame corresponding to the score point; wherein the target object is: the object which is used for judging whether the operation corresponding to the scoring point is correct or not is arranged in each object related to the scoring point;

and the scoring result calculating module is used for calculating the scoring result of the person to be scored about the target experiment based on the scoring of each scoring point.

Optionally, in a specific implementation manner, the video frame acquiring module includes:

the scoring point detection submodule is used for detecting whether a superposed area exists between the lever and the lever shaft or not frame by frame from the Nth frame of the preset operation video according to the playing sequence of the operation video, and whether the lever is not connected with the weight and the spring dynamometer or not;

and the score point determining submodule is used for selecting the video frame corresponding to the first score point according to the detection result.

Optionally, in a specific implementation manner, the score point determining submodule is specifically configured to:

alternatively, the first and second electrodes may be,

Optionally, in a specific implementation manner, the video frame acquiring module is specifically configured to:

the video frame acquisition module is specifically configured to:

Optionally, in a specific implementation manner, the score determining module is specifically configured to:

In a third aspect, an embodiment of the present invention provides an electronic device, which is characterized by including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete mutual communication through the communication bus;

a memory for storing a computer program;

a processor, configured to implement the steps of any one of the video-based scoring methods provided by the first aspect when executing a program stored in the memory.

In a fourth aspect, the present invention provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of any one of the video-based scoring methods provided in the first aspect.

As can be seen from the above, by applying the scheme provided by the embodiment of the present invention, when a teacher scores experimental operation conditions of students, the teacher does not need to observe experimental operation processes of the students beside the students and scores the experimental operation processes based on the observed contents, but can obtain operation videos of the student operation target experiments through the image acquisition device, and further, the electronic device automatically obtains the scoring results of the students about the target experiments based on the operation videos. Thus, the workload of the teacher in scoring the experimental operation of the student can be greatly reduced.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic flow chart of a video-based scoring method according to an embodiment of the present invention;

fig. 2 is a schematic flowchart of a specific implementation manner of S101 in fig. 1;

fig. 3 is a schematic flowchart of another specific implementation manner of S101 in fig. 1;

fig. 4 is a schematic flowchart of another specific implementation manner of S101 in fig. 1;

fig. 5 is a schematic flowchart of another specific implementation manner of S101 in fig. 1;

FIG. 6 is a schematic diagram of a lever balancing experiment;

figure 7 is a schematic view of the spring load cell 10 of figure 6;

fig. 8 is a schematic structural diagram of a video-based scoring apparatus according to an embodiment of the present invention;

fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Currently, the method for scoring the experimental operation condition of the student by the teacher is as follows: when the student performs the experiment, the teacher observes the experiment operation process of the student beside and scores the experiment operation process based on the observed contents. Obviously, this scoring method requires the teacher to participate in the experimental procedure of each student, thereby making the workload of the teacher large. Therefore, for experiments such as lever balance, in which the scoring is affected by the horizontal balance state of the experimental object, how to reduce the workload of the teacher in scoring the experimental operation of the student is a problem to be solved urgently.

In order to solve the above technical problem, an embodiment of the present invention provides a video-based scoring method.

The method comprises the following steps:

determining a video frame corresponding to each scoring point included in a target experiment from an operation video of a person to be scored for operating the target experiment;

the video frame corresponding to any scoring point is used for judging the score of the scoring point and accords with the predetermined condition corresponding to the scoring point, and the predetermined condition comprises the following steps: each object related to the scoring point exists, the position relation of each object is the position relation adjusted by the person to be scored, and the position relation of each object is the position relation corresponding to the scoring point;

for each scoring point, determining the score of the scoring point based on the attitude information of the target object in the video frame corresponding to the scoring point;

wherein the target object is: the object which is used for judging whether the operation corresponding to the scoring point is correct or not is arranged in each object related to the scoring point;

It should be noted that the video-based scoring method provided in the embodiment of the present invention may be applied to any electronic device, for example, a tablet computer, a notebook computer, a desktop computer, a mobile phone, and the like, and the method is not limited specifically herein, and is hereinafter referred to as an electronic device for short.

It can be understood that, the embodiment of the present invention provides a video-based scoring method, and therefore, before performing the specific steps of the method, the electronic device needs to first obtain an operation video of an operation target experiment of a person to be scored, that is, when the person to be scored operates the operation target experiment, the operation process of the target experiment needs to be recorded.

It should be noted that the operation video may be obtained by recording the process of operating the target experiment by the person to be scored in various ways, and the embodiment of the present invention is not particularly limited.

For example, it is reasonable to install a camera on each laboratory bench, the camera can record the operation of the person on the target experiment when the person to be evaluated operates the target experiment on the laboratory bench, and obtain an operation record, and the camera can transmit the operation record to an electronic device in communication connection with the camera, and can also store the operation record in a local storage space.

Obviously, the electronic device may also obtain the operation video in various ways, and the embodiment of the present invention is not limited in particular.

For example, the electronic device may establish a communication connection with a camera in a laboratory, so that after the camera takes the operation videos, the operation videos may be sent to the electronic device, and then the electronic device stores the operation videos in its own storage space. Therefore, when a person to be evaluated is evaluated, the electronic equipment can directly call the operation video corresponding to the person.

For another example, cameras in a laboratory store the shot operation videos in a local storage space, and the cameras establish communication connection with the electronic device. Therefore, when a person to be scored is scored, the electronic device can send a video acquisition request to the device, and further receive an operation video sent by the device in response to the video acquisition request. The video acquisition request may include information such as an identifier of a person to be evaluated, an identifier of a target experiment, and the like, so that the device storing the operation video may determine the operation video required by the electronic device from the stored operation video based on the information, and send the operation video to the electronic device.

For another example, a camera in a laboratory stores a shot operation video in its own memory card, so that when a person to be scored is scored, the memory card of the camera can be taken out and installed in the electronic device, and thus, the electronic device can obtain the operation video of the person by reading the memory card.

Based on the above description, after obtaining the operation video of the operation target experiment of the person to be scored, the electronic device may perform the experiment operation on the person to be scored based on the operation video, that is, execute the video-based scoring method provided by the embodiment of the present invention.

In addition, in the embodiment of the invention, when the electronic equipment establishes communication connection with the camera in the laboratory, the camera can send the shot operation video to the electronic equipment in real time in the shooting process of the operation video. Therefore, the electronic equipment can execute the video-based scoring method provided by the embodiment of the invention in real time when receiving the operation video, so that the process of the operator to be scored operating the target experiment is scored in real time, and further, when the operator to be scored operates the target experiment, the scoring result of the operator to be scored operating the target experiment can be immediately obtained.

A video-based scoring method according to an embodiment of the present invention is described below.

Fig. 1 is a schematic flowchart of a video-based scoring method according to an embodiment of the present invention. As shown in fig. 1, the method may include the steps of:

s101: determining a video frame corresponding to each scoring point included in a target experiment from an operation video of a person to be scored for operating the target experiment;

the video frame corresponding to any scoring point is used for judging the score of the scoring point and accords with the predetermined condition corresponding to the scoring point, and the predetermined condition comprises the following steps: each object related to the scoring point exists, the position relation of each object is the position relation adjusted by the personnel to be scored, and the position relation of each object is the position relation corresponding to the scoring point;

wherein, each object is one or more experimental devices used in the target experiment.

It should be noted that, during the experiment operation, several important links may be included, and these links determine whether the experiment can obtain an accurate experiment result. When the student can correctly complete the links and obtain the correct experiment result, the student can be explained to accurately master the knowledge content corresponding to the experiment, otherwise, the student does not master the knowledge content corresponding to the experiment, or errors exist in the mastered knowledge content.

Therefore, the knowledge content mastering conditions of the students can be determined by evaluating the performances of the students aiming at the links in the experimental operation process. Therefore, important links in the experiment can be used as the evaluation points of the experiment. These links may be operations in accordance with predetermined rules, correct setting of the positional relationship of the experimental device, zero setting before the experimental device is used, and the like.

It can be understood that, in the operation video of the target experiment operated by the person to be scored, the content reflected by the multiple frames of video frames may not be the content corresponding to the scoring point of the target experiment. For example, the content shot in the first few minutes of the operation video is the content corresponding to the score of the target experiment when the student is reading the experimental notice, and obviously, the content is not the content corresponding to the score of the target experiment, so the electronic device needs to determine the video frame corresponding to the score included in the target experiment in the operation video, and then execute the subsequent steps based on the determined video frame to score the operation of the person to be scored on the target experiment.

In this way, after the electronic device obtains the operation video of the operation target experiment of the person to be evaluated, the step S101 may be executed, and the video frame corresponding to each scoring point included in the target experiment is determined from the operation video of the operation target experiment of the person to be evaluated.

Specifically, for each frame of video in the operation video, the electronic device may determine whether the frame of video meets a predetermined condition corresponding to any scoring point, and when the determination result is yes, the frame of video may be used as a video frame corresponding to the scoring point, and further, the video frame may be used to determine the score of the scoring point. Wherein, the predetermined condition may be: each object related to the scoring point exists on the video frame, the position relationship of each object is the position relationship adjusted by the person to be scored, and meanwhile, the position relationship of each object is the position relationship corresponding to the scoring point.

The specific process of judging whether the video frame corresponds to any scoring point can be understood as follows: in the process of playing the operation video, for each frame of image, the electronic device can judge whether an object corresponding to any scoring point exists in the frame of image through a preset model or algorithm, and further judge whether the person to be scored has adjusted each object. And when the object corresponding to any scoring point is judged to exist and the position relationship of each object is adjusted by the person to be scored, the electronic equipment can further judge whether the position relationship of the objects is the position relationship corresponding to the scoring point.

It can be understood that, if the position relationship of the objects in the video frame is not the position relationship that is adjusted by the person to be scored, the position relationship of the objects in the video frame after the video frame may change, and thus the objects cannot be used as the position relationship corresponding to the scoring point.

In many cases, the scoring points of the target experiment appear in order of the experiment, that is, the scoring points of the target experiment may be determined in order. Specifically, in step S101, the electronic device may first determine a video frame corresponding to a first score point based on a predetermined condition of the first score point, then determine a video frame corresponding to a second score point based on a predetermined condition of the second score point, and so on until determining a video frame corresponding to a last score point.

According to knowledge content corresponding to the target experiment and the operation specification of the target experiment, the scoring points can be different according to different target experiments, and the preset conditions corresponding to the scoring points can also be different. Therefore, the mode of determining the video frame corresponding to each scoring point included in the target experiment from the operation video of the person to be scored operating the target experiment may be different, and the embodiment of the present invention is not particularly limited thereto.

S102: for each scoring point, determining the score of the scoring point based on the attitude information of the target object in the video frame corresponding to the scoring point;

wherein, the target object is: the object which is used for judging whether the operation corresponding to the scoring point is correct or not is arranged in each object related to the scoring point;

for an experiment that the scores such as lever balance are affected by the horizontal balance state of an experimental object, for each score point, a target object for judging whether the operation corresponding to the score point is correct exists in each object related to the score point, that is, for each score point, whether the operation of a person to be scored on the score point is correct is determined based on the posture information of the target object corresponding to the score point.

Therefore, after the step S101 is executed, after the video frame corresponding to each scoring point included in the target experiment is determined, for each scoring point, the pose information of the target object in the video frame corresponding to the scoring point may be acquired, and further, the scoring of the scoring may be determined based on the pose information of the target object in the video frame corresponding to the scoring point.

S103: and calculating the scoring result of the person to be scored about the target experiment based on the scores of the scoring points.

After the above step S203 is completed, and the score of each scoring point is obtained, the electronic device may calculate the scoring result of the person to be scored about the target experiment based on the scores.

Based on the above description of step S101, the score obtained by the person to be scored at each scoring point may indicate the grasp of the knowledge content corresponding to the scoring point by the person, and therefore, the scoring result of the person about the target experiment may be determined according to the score obtained by the person at each scoring point. Therefore, the condition of the personnel operating the target experiment can be reflected through the grading result, and further, the mastering condition of the personnel on the knowledge content corresponding to the target experiment is reflected.

Obviously, when determining the scoring result of the student, the weights of each scoring point may be the same, or it is reasonable to set different weights for each scoring point according to the difficulty level of the knowledge content corresponding to each scoring point.

In this way, when the electronic device executes the step S103, the obtained scores of the respective score points may be directly summed, and the obtained sum is used as the scoring result of the person to be scored regarding the target experiment; or calculating the sum of the products of each scoring point and the weight according to the weight of each scoring point, and taking the sum of the products as the scoring result of the person to be scored about the target experiment; this is all reasonable.

Based on the above description of the video-based scoring method provided by the embodiment of the present invention, the method may be applied to any experiment in which the score is affected by the horizontal balance state of the test object, that is, it is reasonable that the target experiment may be any experiment in which the score is affected by the horizontal balance state of the test object, for example, a lever balance experiment, a stress balance experiment, and the like. Of course, the target experiment may also be other experiments related to the horizontal equilibrium state of the experimental object, and the embodiment of the present invention is not particularly limited.

For clarity, the above steps are illustrated in the following description with reference to specific embodiments.

Alternatively, in a specific implementation, the target experiment may be a lever balance experiment.

Wherein, to the balanced experiment of lever, its experiment equipment can include that both ends are provided with the lever of adjustable balance nut respectively, are used for the bracing piece and the weight of carry lever, and the purpose of this experiment is: after the central point of the lever is mounted on the supporting rod and the lever is in a balanced state by adjusting balance nuts at two ends of the lever, weights are respectively mounted on two sides of the central point of the lever to keep the lever balanced, so that the lever principle can be understood and mastered.

In addition, can also include the spring dynamometer among the experimental device, like this, alright with through in the same one side carry weight of lever central point to vertical upwards pull up with the spring dynamometer that the lever is connected make the lever keep balance, perhaps, make the lever keep balance through the spring dynamometer that respectively vertical upwards pull up with the lever connection in the both sides of lever central point, thereby, can utilize the spring dynamometer to understand and master lever principle.

Wherein the spring force gauge needs to be zeroed first before it is used. The zero setting of the spring force gauge is as follows: the vertical spring dynamometer of lifting, through the spring of adjustment spring dynamometer, make spring dynamometer's pointer and spring dynamometer's zero scale mark coincidence, perhaps, the distance between the two is less than preset distance to, guarantee spring dynamometer's measurement accuracy.

Specifically, as shown in fig. 6, in a lever balancing experiment, the experimental device may include: the device comprises a lever base 1, a support rod 2, a lever shaft 3, a lever 5, a weight 7 and a spring dynamometer 10;

the support rod 2 is arranged on the base 1, the base 1 is arranged on the experiment table 0, and in the experiment process, the central point of the lever 5 can be rotatably hung on the lever shaft 3 arranged on the support rod 2, for example, the central point of the lever 5 can be connected with the lever shaft 3 in a hinge mode and the like; two ends of the lever 5 are respectively provided with an adjustable balance nut 6, two sides of a central point are respectively provided with a first label 4, and the first labels 4 can be used as lever identification information so that the electronic equipment can detect the lever 5 in a video frame of an operation video; a second label 8 is arranged on the weight 7, and the second label 8 can be used as weight identification information, so that the electronic equipment can detect the weight 7 in a video frame of an operation video; the spring force gauge 10 is provided with a third label 9, which third label 9 can be used as gauge identification information so that the electronic device can detect the spring force gauge 10 in the video frame of the operation video.

Further, as shown in fig. 7, the front view of the spring load cell 10 in fig. 6 is shown, which includes a zero scale key point 11 of the spring load cell 10, a zero scale key point 12 of the spring load cell 10, and a slide 13 of the spring load cell 10. When the electronic device detects the zero scale key point 11 and the zero scale key point 12 of the spring dynamometer 10 in a video frame of an operation video, a connecting line between the detected zero scale key point 11 and the detected zero scale key point 12 can be used as a zero scale line for detecting the spring dynamometer 10.

Then during the lever balancing experiment, the correct experimental operation process is: mounting the central point of the lever 5 on the lever shaft 3; adjusting the balance nut 6 to enable the lever 5 to be in a balance state, wherein the balance state can be determined through a horizontal included angle between a connecting line between the two first marks 4 and a lever shaft;

the weights 7 are respectively mounted on two sides of the central point of the lever 5, so that the lever 5 keeps a balanced state, wherein the number of the weights 7 respectively mounted on the two sides of the central point of the lever 5 and the distance from the central point of the lever 5 can be the same or different, and in the process, the balance nut 6 cannot be adjusted again.

Zeroing the spring dynamometer 10, taking down the weight 7 currently mounted on the lever 5, mounting the weight 7 on one side of the central point of the lever 5, hooking a hook of the spring dynamometer 10 at one position of the side of the central point of the lever 5, and vertically pulling up the spring dynamometer 10 to keep the lever 5 in a balanced state, wherein in the process, the balance nut 6 cannot be adjusted again;

the weight 7 and the hooked spring dynamometer 10 which are currently hung on the lever 5 are taken down, two spring dynamometers 10 are respectively zeroed, hooks of the two spring dynamometers 10 are respectively hooked at certain positions on two sides of the central point of the lever 5, the two spring dynamometers 10 are vertically pulled upwards, and the lever 5 is kept in a balanced state, wherein the distances from the positions of the hooks of the two spring dynamometers 10 on two sides of the central point of the lever 5 to the central point of the lever 5 can be different or the same, and in the process, the balance nut 6 cannot be adjusted again.

Through the explanation on the correct experimental operation process of the lever balance experiment, the lever center point can be determined to be mounted on the lever shaft in the lever balance experiment; adjusting a balance nut of the lever to balance the lever; using a weight and/or spring load cell to balance the lever horizontally; zeroing the spring force gauge prior to use of the spring force gauge; in the process of using weights and/or a spring dynamometer to enable the lever to be horizontally balanced, the balance nut cannot be adjusted again, and the balance nut is an important link of a lever balance experiment.

Based on this, when the target experiment is a lever balance experiment, the target experiment may include four scores, namely, a first score, a second score, a third score and a fourth score.

Wherein the first scoring point comprises: the center point of the lever is mounted on the scoring point on the supporting rod; that is, the correct operation for the first scoring point is: the person to be evaluated mounts the center point of the lever on the support rod.

The second scoring point includes: a scoring point for adjusting a balance nut of the lever to enable the lever to be horizontally balanced; that is, the second score corresponds to the correct operation: the balance nut of the adjusting lever makes the lever balance horizontally.

The third scoring point includes: one or more of a point of evaluation of horizontally balancing the lever using a weight, horizontally balancing the lever using a spring force gauge, and horizontally balancing the lever using the weight and the spring force gauge; that is, the correct operation for the third scoring point is: the method includes at least one of horizontally balancing the lever using a weight, horizontally balancing the lever using a spring load cell, and horizontally balancing the lever using the weight and the spring load cell.

Optionally, in an embodiment, for the third score point, when the third score point includes: the point of scoring at which the lever is balanced horizontally using the spring load cell, and/or the point of scoring at which the lever is balanced horizontally using the weight and the spring load cell, that is, when the third point of scoring corresponds to correct operation: the target experiment may further include a fifth score point when the lever is horizontally balanced using the spring load cell and the lever is horizontally balanced using at least one of a weight and a spring load cell.

Wherein the fifth score point is: the point of scoring at which the spring load cell is zeroed, that is, the correct operation for the fifth point of scoring, is: the lever is balanced horizontally using a spring load cell, and the spring load cell is zeroed before the lever is balanced horizontally using a weight and spring load cell.

Obviously, the target objects in the video frames corresponding to the fifth scoring point include: a spring load cell.

In addition, since the spring load cell needs to be zeroed before the spring load cell is used, in this embodiment, it is necessary to determine the video frame corresponding to the fifth scoring point, and then determine the scoring point included in the third scoring point, at which the lever is horizontally balanced by the spring load cell, and/or the video frame corresponding to the scoring point, at which the lever is horizontally balanced by the weight and the spring load cell. That is, in the playing order of the operation video, the video frame corresponding to the fifth scoring point precedes the scoring point corresponding to the scoring point for which the lever is horizontally balanced using the spring load cell, and/or the video frame corresponding to the scoring point for which the lever is horizontally balanced using the weight and the spring load cell.

The fourth score point was: in the operation process corresponding to the third scoring point, the scoring point of the balance nut cannot be adjusted; that is, the correct operation for the fourth scoring point is: and correspondingly, in the operation process of the personnel to be scored, which is corresponding to the third scoring point, the balance nut cannot be adjusted, and the balance nut is adjusted to be an error operation corresponding to the fourth scoring point.

Further, the target objects in the video frames corresponding to the first score point, the second score point, the third score point and the fourth score point all include: a lever.

According to the introduction of the lever balance experiment, the operation corresponding to the second scoring point is performed after the operation corresponding to the first scoring point is completed; the operation corresponding to the third scoring point is performed after the operations corresponding to the first scoring point and the second scoring point are completed, or the operation corresponding to the third scoring point is performed after the operations corresponding to the first scoring point, the second scoring point and the fifth scoring point are completed; the operation corresponding to the fifth scoring point is performed after the operation corresponding to the first scoring point and the second scoring point is completed; and the operation corresponding to the fourth scoring point is performed in the process of executing the operation corresponding to the third scoring point. And when the operations corresponding to the third scoring point, the fourth scoring point and the fifth scoring point are performed, the results of the operations corresponding to the first scoring point and the second scoring point are not changed.

Based on this, optionally, in a specific implementation manner, when the target experiment is a lever balance experiment and the score point of the target experiment includes a fifth score point, the video frames corresponding to the first score point, the second score point, the third score point and the fifth score point are different video frames; and the video frames corresponding to the third scoring point and the fourth scoring point are the same video frames.

Optionally, in another specific implementation manner, when the target experiment is a lever balance experiment and the score of the target experiment does not include the fifth score, the video frames corresponding to the first score, the second score and the third score are different video frames; and the video frames corresponding to the third scoring point and the fourth scoring point are the same video frames.

Next, when the target experiment is a lever balance experiment, step S101 in the video-based scoring method according to the embodiment of the present invention is specifically described.

When the target experiment is a lever balance experiment, except for the operation corresponding to the fourth scoring point, the operations corresponding to other scoring points are sequentially performed, and the video frames corresponding to other scoring points are different video frames, so that the electronic device can sequentially determine the video frames corresponding to the scoring points in the operation video according to the operation sequence of other scoring points, and determine the video frame corresponding to the third scoring point as the video frame corresponding to the fourth scoring point after determining the video frame corresponding to the third scoring point.

Specifically, the method comprises the following steps:

for the first score point, as shown in fig. 2, the step S101 may include steps S201 to S202:

s201: detecting whether a superposed area exists between a lever and a lever shaft or not frame by frame from the Nth frame of a preset operation video according to the playing sequence of the operation video, and whether the lever is not connected with a weight and a spring dynamometer or not;

s202: and after each frame is detected, selecting the video frame corresponding to the first score point according to the detection result.

For the lever balance experiment, the lever and the supporting rod provided with the lever shaft for mounting the lever are necessary experimental equipment in the experimental process, and in the experimental process, the lever needs to be firstly mounted on the lever shaft, and the lever at the moment is not connected with a weight and a spring dynamometer.

Therefore, after the operation video is acquired, the electronic equipment can detect whether the lever and the lever shaft are overlapped or not and whether the lever is not connected with the weight and the spring dynamometer or not frame by frame from the N frame of the preset operation video according to the playing sequence of the operation video.

Wherein, N may be 1, that is, whether there is a region where the lever and the lever shaft overlap is detected from a first frame of the operation video, and whether the lever is not connected with the weight and the spring dynamometer; n may be other predetermined values, for example, 5, 10, etc., and the embodiment of the present invention is not particularly limited.

It can be understood that when the person to be evaluated starts the lever balance test, the person may not immediately enter the test operation link but take the test equipment and read the test instruction. Then, the content shot in the operation video within a period of time after the start of playing may not be the content of the experimental operation link. Therefore, in order to save the scoring time and improve the scoring efficiency, the electronic device may start the detection from the predetermined nth frame according to the playing sequence of the operation video instead of the first frame.

Any algorithm or model for detecting whether the lever and the lever shaft are overlapped or not and whether the weight and the spring dynamometer are not connected with the lever or not can be built in the electronic equipment, so that the electronic equipment can execute the step S201.

Optionally, in a specific implementation manner, a manner of detecting whether there is a region where the lever and the lever shaft overlap is: and detecting an image area where the lever is located and an image area where the lever shaft is located in the video frame, and judging whether the detected image area where the lever is located and the detected image area where the lever shaft is located have an overlapping area. Further, if present, it can be determined whether there is an area of overlap of the lever and the lever axis.

Therefore, after each frame is detected, the electronic equipment can select the video frame corresponding to the first score point from the detected video frames starting from the Nth frame of the operation video according to the detection result.

Optionally, in a specific implementation manner, the step S202 may include:

for the first scoring point, the correct operation corresponding to the scoring point is as follows: the person to be evaluated has the center point of the lever mounted on the support bar, i.e. the lever needs to be mounted on the lever shaft first, and the lever at this time is not connected with the weight and the spring dynamometer. Therefore, in step S202, in the process of detecting frame by frame from the nth frame of the predetermined operation video according to the playing sequence of the operation video, the electronic device may determine the frame as the video frame corresponding to the first score point when detecting that there is an overlapping region between the lever and the lever shaft and the lever is not connected to the weight and the spring.

Optionally, in another specific implementation manner, the step S202 may include:

after each frame is detected, if the detection results are yes, whether the area where the lever and the lever shaft are overlapped does not change is judged, if yes, 1 is added to the first numerical value, otherwise, the first numerical value is cleared, and after 1 is added to the first numerical value, whether the first numerical value reaches a first preset number is judged, if yes, the determined detection results are yes, and continuous video frames of the first preset number are used as the video frames corresponding to the first evaluation point.

It can be understood that, when the person to be evaluated mounts the lever on the lever shaft, after one mounting is completed, the position of the lever mounted on the lever shaft may be adjusted again, so that, in the process of determining the video frame corresponding to the first evaluation point, it is necessary to determine whether the person to be evaluated is adjusting the position of the lever mounted on the lever shaft or has already adjusted the position of the lever mounted on the lever shaft, that is, when the video frame corresponding to the first evaluation point is determined, it is necessary to determine whether the position of the lever mounted on the lever shaft is not changed, that is, it is necessary to determine whether the area where the lever and the lever shaft coincide is not changed.

Correspondingly, the operations of the person to be scored are reflected in the video frame of the operation video, namely: if the overlapped area of the lever and the lever shaft in the continuous multi-frame video frames is changed, the person to be evaluated can be considered to adjust the position where the lever is mounted on the lever shaft, and if the overlapped area of the lever and the lever shaft in the continuous multi-frame video frames is not changed, the person to be evaluated can be considered to adjust the position where the lever is mounted on the lever shaft. Therefore, when the overlapped area of the lever and the lever shaft in the video frame is detected, and the weight and the spring are not connected with the lever for dynamometry, whether the overlapped area of the lever and the lever shaft in the frame is unchanged relative to the previous frame can be further judged.

In this way, when it is detected that whether the area where the lever coincides with the lever axis in the video frame has not changed with respect to the previous frame, 1 may be added to the first value, that is, the area where the lever coincides with the lever axis is counted with respect to the video frame where the previous frame has not changed.

Furthermore, the electronic device can determine whether the first value reaches a first preset number, that is, whether a region where the lever and the lever axis coincide in consecutive video frames of the first preset number does not change relative to a previous frame.

If the situation is met, the situation is indicated that the area, overlapped by the lever and the lever shaft, of the video frames with the first preset number of continuous frames does not change relative to the previous frame, namely the position of the lever mounted on the lever shaft is adjusted by the person to be evaluated. Therefore, the electronic device can use the video frames with the continuous first preset number of frames as the video frames corresponding to the first score point, that is, the area where the lever is overlapped with the lever axis is not changed relative to the previous frame, and the video frames with the continuous first preset number of frames as the video frames corresponding to the first score point.

If the frame number does not reach the preset frame number, the fact that the overlapped area of the lever and the lever shaft in the video frames of the first preset number does not change relative to the previous frame does not exist, and the video frames of the next frame need to be continuously detected and judged.

The first preset number may be set according to the specific situation of the practical application, and may be, for example, 5, 10, or 8.

Correspondingly, when the area where the lever and the lever shaft coincide in the frame is judged to be changed relative to the previous frame, it can be shown that the person to be scored is adjusting the position where the lever is mounted on the lever shaft, and then the first numerical value can be cleared, that is, the area where the lever and the lever shaft coincide is counted again relative to the video frame where the previous frame does not change. And determining the video frames corresponding to the first scoring points until the first numerical value reaches a first preset number.

The electronic device may determine whether a region where the lever and the lever axis coincide with each other in a video frame of the operation video changes with respect to a previous frame in various ways, which is not specifically limited in the embodiment of the present invention.

Any algorithm or model for judging whether the area where the lever coincides with the lever axis changes relative to the previous frame or not can be built in the electronic device, so that the electronic device can execute the specific implementation mode.

For example, optionally, for a video frame, after detecting that there is an area where the lever and the lever axis overlap in the video frame, the electronic device may determine a position of the area where the lever and the lever axis overlap in the video frame, and then, the electronic device may determine whether the position is the same as a position of the area where the lever and the lever axis overlap in a previous video frame, so as to determine whether the area where the lever and the lever axis overlap changes with respect to the previous frame. If the position is the same as the position of the overlapped area of the lever and the lever shaft in the previous video frame, the overlapped area of the lever and the lever shaft is not changed relative to the previous frame.

For the second score point, as shown in fig. 3, the step S101 may include steps S301 to S304:

s301: according to the playing sequence of the operation video, starting from the video frame corresponding to the first scoring point, detecting whether the lever is not connected with the weight and the spring dynamometer or not frame by frame, and whether the hand of the person to be scored is in contact with the balance nut of the lever or not;

s302: after each frame is detected, if the detection result is yes, whether the lever in the next frame is not connected with the weight and the spring dynamometer or not is continuously detected, and whether the hand of the person to be evaluated is in contact with a balance nut of the lever or not is detected until a target video frame is detected;

wherein, the target video frame is: the detection result is a video frame that the lever is not connected with the weight and the spring dynamometer, and the hand of the person to be evaluated is not in contact with the balance nut of the lever;

s303: detecting whether the lever is not connected with the weight and the spring dynamometer or not frame by frame from a target video frame, and whether the hand of a person to be evaluated is not in contact with a balance nut of the lever or not;

s304: and after each frame is detected, if the detection result is yes, adding 1 to the second numerical value, if the detection result is that the lever is not connected with the weight and the spring dynamometer, the hand of the person to be evaluated is in contact with the balance nut of the lever, resetting the second numerical value, returning to the step of continuously detecting whether the lever is not connected with the weight and the spring dynamometer in the next frame and whether the hand of the person to be evaluated is in contact with the balance nut of the lever, judging whether the second numerical value reaches a second preset number or not after the second numerical value is added with 1, if the second numerical value reaches the second preset number, taking the determined detection result as that the lever is not connected with the weight and the spring dynamometer and the hand of the person to be evaluated is not in contact with the balance nut of the lever, and taking continuous second preset number of frames as video frames corresponding to the second evaluation point.

In the lever balance experiment, after the central point of the lever is mounted on the lever shaft, the lever may not be in a horizontal balance state at the moment, so that the personnel to be evaluated can adjust the lever to the horizontal balance state through manually adjusting a balance nut of the lever for the accuracy of a subsequent experiment result.

It will be appreciated that the person to be rated can adjust the balance nut a number of times during the adjustment of the lever to the horizontal balance. That is to say, the personnel of waiting to appraise can carry out at least once the rotation to the balance nut earlier, then stop the rotation, and the hand leaves the balance nut, observes whether the lever has reached horizontal balance state, if yes, accomplishes balance nut and adjusts, otherwise, will carry out at least once again to the balance nut, then stop the rotation again, and the hand leaves the balance nut, observes whether the lever has reached horizontal balance state.

Thus, the person to be evaluated can adjust the lever to a horizontal balance state after repeatedly performing the above process at least once.

Based on this, according to the above description of the first score point and the second score point, the operation corresponding to the second score point appears after the operation corresponding to the first score point. Therefore, after the video frame corresponding to the first scoring point is determined, the electronic equipment can detect whether the lever is not connected with the weight and the spring dynamometer or not frame by frame from the video frame corresponding to the first scoring point according to the playing sequence of the operation video, and whether the hand of the person to be scored is in contact with the balance nut of the lever or not.

Obviously, in step S301, when the lever is not connected to the weight and the spring dynamometer and the hand of the person to be evaluated is in contact with the balance nut of the lever as a result of the detection of a certain video frame, it indicates that the person to be evaluated is manually adjusting the balance nut in the video frame. And then, the electronic equipment can continuously detect whether the lever is not connected with the weight and the spring dynamometer in the next video frame of the video frame and whether the hand of the person to be evaluated is in contact with the balance nut of the lever until the target video frame is detected.

Wherein, the target video frame is: the detection result is a video frame that the lever is not connected with the weight and the spring dynamometer, and the hand of the person to be evaluated is not in contact with the balance nut of the lever. That is, when the target video frame is detected, it indicates that the person to be scored stops manually adjusting the balance nut at this time, leaves the balance nut with the hand, and is observing whether the lever has reached the horizontal balance state, and further indicates that the lever may have been adjusted to the horizontal balance state at this time.

However, if the person to be evaluated does not observe that the lever still reaches the horizontal balance state when the target video frame is detected, the person to be evaluated manually adjusts the balance nut again, and the interval between the time corresponding to the target video frame and the time when the person to be evaluated manually adjusts the balance nut again is small, that is, the target video frame is smaller in number than the video frame before the video frame when the lever is detected again that the weight and the spring dynamometer are not connected and the hand of the person to be evaluated is in contact with the balance nut of the lever.

Correspondingly, when the subsequent operation steps are not started after the user to be evaluated finishes the operation of manually adjusting the balance nut to enable the lever to reach the horizontal balance state, the lever is not connected with the weight and the spring dynamometer, and the hand of the person to be evaluated is not in contact with the balance nut of the lever. The interval between the time when the user to be evaluated finishes the operation of manually adjusting the balance nut to enable the lever to reach the horizontal balance state and the time when the operation of the subsequent step is started is larger, that is, a video frame that a large number of continuous detection results are obtained when the weight and the spring dynamometer are not connected with the lever and the hand of the person to be evaluated is not in contact with the balance nut of the lever can be detected.

Therefore, in order to ensure that the video frame corresponding to the determined second score point is the video frame corresponding to the operation that the user to be evaluated completes the manual adjustment of the balance nut to enable the lever to reach the horizontal balance state, after the target video frame is checked, whether the weight and the spring dynamometer are not connected with the lever or not is detected frame by frame from the target video frame, and whether the hand of the person to be evaluated is not in contact with the balance nut of the lever or not is detected.

In this way, after each frame after the target video frame is detected, if the detection results are yes, namely the lever is not connected with the weight and the spring dynamometer, and the hand of the person to be evaluated is not in contact with the balance nut of the lever, 1 is added to the second numerical value, namely the video frames, in which the lever is not connected with the weight and the spring dynamometer, and the hand of the person to be evaluated is not in contact with the balance nut of the lever, are counted.

Correspondingly, if the detection result is that the lever is not connected with the weight and the spring dynamometer, and the hand of the person to be evaluated is in contact with the balance nut of the lever, namely, the person to be evaluated does not complete the operation of manually adjusting the balance nut to enable the lever to reach the horizontal balance state, and the balance nut is adjusted again. At this time, the electronic device may clear the second numerical value and return to the step of continuously detecting whether the lever is not connected with the weight and the spring dynamometer and whether the hand of the person to be evaluated is in contact with the balance nut of the lever in the next frame, thereby detecting a new target video frame.

Furthermore, when the detection result is that the lever is not connected with the weight and the spring dynamometer, the hand of the person to be evaluated is not in contact with the balance nut of the lever, and 1 is added to the second numerical value, the electronic equipment can further judge whether the second numerical value reaches a second preset number.

If the judgment result is reached, the situation that the weights and the spring dynamometer are not connected with the lever in the second preset number of frames of video frames continuously exists, and the hand of the person to be evaluated is not in contact with the balance nut of the lever is shown, namely, the person to be evaluated finishes the operation of manually adjusting the balance nut to enable the lever to reach the horizontal balance state.

Therefore, when the second numerical value reaches the second preset number, the electronic equipment can enable the determined detection result to be that the lever is not connected with the weight and the spring dynamometer, the hand of the person to be evaluated is not in contact with the balance nut of the lever, and continuous video frames of the second preset number are used as the video frames corresponding to the second evaluation point.

The second preset number may be set according to the specific situation of the practical application, and may be, for example, 5, 10, or 8, which is all reasonable.

Correspondingly, if the video frames are not reached, the situation that the weights and the spring dynamometer are not connected with the levers in the second preset number of continuous video frames does not exist, and the hands of the person to be evaluated are not in contact with the balance nuts of the levers is shown, the situation that the person to be evaluated cannot be determined to finish the operation of manually adjusting the balance nuts to enable the levers to reach the horizontal balance state is shown, and the next video frame needs to be continuously detected and judged.

Any algorithm or model for detecting whether the lever is not connected with the weight and the spring dynamometer and whether the hand of the person to be evaluated is in contact with the balance nut of the lever or not and any algorithm or model for detecting whether the lever is not connected with the weight and the spring dynamometer and whether the hand of the person to be evaluated is not in contact with the balance nut of the lever or not can be built in the electronic equipment, so that the electronic equipment can perform the steps S301 to S304.

For the third video frame, the third score point may include, according to the above description of the third score point: one or more of a point of scoring for horizontally balancing the lever using a weight, horizontally balancing the lever using a spring load cell, and horizontally balancing the lever using a weight and a spring load cell.

Based on this, optionally, in a specific implementation manner, the video frame corresponding to the third scoring point may include: at least one type of video frame of the first video frame, the second video frame and the third video frame;

wherein the first video frame is: video frames for scoring points for horizontally balancing the lever using weights;

the second video frame is: video frames for a point of scoring for horizontal balancing of the lever using a weight and spring load cell;

the third video frame is: video frames for a point of scoring using a spring load cell to balance the lever horizontally.

Obviously, when the third scoring point only includes a scoring point for horizontally balancing the lever by using the weight, a scoring point for horizontally balancing the lever by using the weight and the spring load cell, or a scoring point for horizontally balancing the lever by using the spring load cell, the video frame corresponding to the third scoring point only includes the first video frame, the second video frame, or the third video frame;

when the third scoring point comprises a scoring point for horizontally balancing the lever by using a weight and a scoring point for horizontally balancing the lever by using the weight and the spring dynamometer, the video frame corresponding to the third scoring point comprises a first video frame and a second video frame;

when the third scoring point comprises a scoring point for horizontally balancing the lever by using a weight and a scoring point for horizontally balancing the lever by using a spring dynamometer, the video frame corresponding to the third scoring point comprises a first video frame and a third video frame;

when the third scoring point comprises a scoring point for horizontally balancing the lever by using the weight and the spring dynamometer and a scoring point for horizontally balancing the lever by using the spring dynamometer, the video frame corresponding to the third scoring point comprises a second video frame and a third video frame;

when the third scoring point includes a scoring point at which the lever is horizontally balanced by the weight, a scoring point at which the lever is horizontally balanced by the weight and the spring load cell, and a scoring point at which the lever is horizontally balanced by the spring load cell, the video frames corresponding to the third scoring point include the first video frame, the second video frame, and the third video frame.

It should be noted that, when the third scoring point includes two or three scoring points, the operation sequence of the operations corresponding to the two or three scoring points is not limited in the embodiment of the present invention, that is, the determination sequence of determining the video frames corresponding to the two or three scoring points is arbitrary.

Specifically, for the third score point, optionally, in a specific implementation manner, the video frame corresponding to the third score point includes a first video frame, where the first video frame is a video frame of a score point for horizontally balancing a lever by using a weight, as shown in fig. 4, the step S101 may include the steps of:

s401: aiming at the third scoring point, detecting whether weights connected with the lever exist on two sides of the center point of the lever frame by frame from the video frame corresponding to the second scoring point according to the playing sequence of the operation video;

s402: after each frame is detected, if the detection result is yes, determining the first number of weights connected with the lever in the frame and the first connecting position of the lever, judging whether the first number and the first connecting position correspond to the previous frame and are not changed, if so, adding 1 to the third numerical value, otherwise, resetting the third numerical value, and after adding 1 to the third numerical value, judging whether the third numerical value reaches a third preset number, if so, judging that the first number and the first connecting position correspond to the previous frame and are not changed, and taking continuous third preset number frames as the first video frames;

s403: and determining the first video frame as the video frame corresponding to the fourth scoring point.

In this particular implementation, the third scoring point includes a scoring point that uses weights to horizontally balance the lever. Further, according to the above description of the second score point and the third score point, the operation of horizontally balancing the lever using the weight may occur after the operation corresponding to the second score point. And, correct operation of the scoring point using the weight to level balance the lever is: weights are respectively mounted on two sides of the central point of the lever, so that the lever is horizontally balanced.

Therefore, after the video frames corresponding to the second scoring point are determined, the electronic equipment can detect whether weights connected with the lever exist on two sides of the central point of the lever frame by frame from the video frames corresponding to the second scoring point according to the playing sequence of the operation video.

It can be understood that, in order to ensure that the weights mounted on the two sides of the central point of the lever can enable the lever to be horizontally balanced, the number of the mounted weights and the connection positions of the mounted weights and the lever can be adjusted by a person to be evaluated in the process of mounting the weights. Therefore, in the process of determining the video frame corresponding to the third score point, it is necessary to determine whether the person to be scored is adjusting the number of the weights mounted and the connection position of the mounted weights and the lever, or has already adjusted the number of the mounted weights and the connection position of the mounted weights and the lever.

Correspondingly, the operations of the person to be scored are reflected in the video frame of the operation video, namely: if the number of the weights mounted in the continuous multi-frame video frames and the connection position of the mounted weights and the lever are changed, the person to be evaluated can be considered to adjust the number of the mounted weights and the connection position of the mounted weights and the lever, and if the number of the weights mounted in the continuous multi-frame video frames and the connection position of the mounted weights and the lever are not changed, the person to be evaluated can be considered to have adjusted the number of the mounted weights and the connection position of the mounted weights and the lever.

Based on this, when detecting that weights connected to the lever are present on both sides of the center point of the lever in a video frame, the electronic device can determine the first number of weights connected to the lever and the first connection position to the lever in the frame, i.e., at which position on both sides of the lever several weights are mounted. Thus, it is possible to further judge whether or not the number of the weights mounted in the frame and the connection position of the mounted weights and the lever are unchanged from the previous frame.

In this way, when it is determined that the number of the weights mounted in the frame and the connection position of the mounted weights and the lever have not changed with respect to the previous frame, it is possible to add 1 to the third value, that is, to count the number of the mounted weights and the connection position of the mounted weights and the lever with respect to the video frame in which the previous frame has not changed.

Furthermore, the electronic device can determine whether the third value reaches a third preset number, that is, whether the number of the weights mounted in consecutive frames of the third preset number is present, and whether the connection position of the mounted weights and the lever is unchanged relative to the previous frame.

If the number of the weights is equal to or less than the preset number, the number of the weights mounted in the third preset number of frames of the video frames is determined to be the number of the weights mounted in the third preset number of frames of the video frames, and the connection position of the mounted weights and the lever is not changed relative to the previous frame. In this way, the electronic device can determine that the first number of video frames and the last frame corresponding to the first connection position are unchanged and the continuous third preset number of video frames are the first video frame.

If the number of the weights is not reached, the number of the weights mounted in the continuous third preset number of frames of video frames does not exist, and the connection position of the mounted weights and the lever does not change relative to the previous frame, so that the next frame of video frame needs to be detected and judged.

The third preset number may be set according to the specific situation of the practical application, and may be, for example, 5, 10, or 8, which is all reasonable.

Correspondingly, when the number of the weights mounted in the frame and the connection position of the mounted weights and the lever are changed relative to the previous frame, it can be stated that the person to be scored is adjusting the number of the mounted weights and the connection position of the mounted weights and the lever. Then the third value can be cleared, i.e. the number of the weights mounted and the connection position of the mounted weights and the lever are counted again with respect to the video frame in which the previous frame has not changed. Thus, the first video frame is determined until the third value reaches the third predetermined number.

Further, after determining the first video frame, since the fourth score is: in the operation process corresponding to the third scoring point, the scoring point of the balance nut cannot be adjusted, so that the determined first video frame can be determined as the video frame corresponding to the fourth scoring point.

Any algorithm or model for detecting whether weights connected with the lever exist on two sides of the center point of the lever or not and any algorithm or model for determining the first number of the weights connected with the lever in the frame and the first connecting position of the lever and judging whether the previous frame does not change or not corresponding to the first number and the first connecting position can be built in the electronic device, so that the electronic device can execute the steps S401-S402.

Wherein, optionally, electronic equipment can be through the lever identification information of detecting the lever and the weight identification information of weight to and, the position relation of lever identification information and weight identification information, confirm the hookup location of the weight of carrying and lever, and through the quantity of detection weight identification information, confirm the quantity of the weight of carrying.

Optionally, in another specific implementation manner, the video frame corresponding to the third scoring point includes a second video frame or a third video frame; wherein the second video frame is a video frame about a point of scoring at which the lever is horizontally balanced using a weight and spring load cell; a third video frame is a video frame about a point of scoring at which the lever is horizontally balanced using a spring load cell; as shown in fig. 5, the step S101 may include the following steps:

s501: aiming at the fifth scoring point, detecting whether a spring dynamometer exists, which is not connected with the lever and has a hand-held part in contact with the hand of the person to be scored, frame by frame from the video frame corresponding to the second scoring point according to the playing sequence of the operation video;

s502: after each frame is detected, if the detection result is yes, determining the distance between a slide sheet of the spring dynamometer and a zero scale mark of the spring dynamometer, judging whether the distance corresponds to the previous frame and is not changed, if so, adding 1 to a fourth numerical value, otherwise, resetting the fourth numerical value, judging whether the fourth numerical value reaches a fourth preset number after adding 1 to the fourth numerical value, if so, taking the determined detection result that the distance corresponds to the previous frame and is not changed, and taking continuous video frames of the fourth preset number as video frames corresponding to a fifth evaluation point;

in this embodiment, the video frame corresponding to the third scoring point may include a predetermined video frame, and the predetermined video frame may be a second video frame or a third video frame, so that the third scoring point may include a scoring point for horizontally balancing the lever by using the weight and the spring load cell, or a scoring point for horizontally balancing the lever by using the spring load cell.

Further, according to the above description of the second score point and the third score point, the operation of horizontally balancing the lever using the weight and the spring load cell, or the operation of horizontally balancing the lever using the spring load cell may occur after the operation corresponding to the second score point.

Furthermore, since both of the above operations use a spring load cell, the spring load cell needs to be first zeroed before it is used according to the specifications of the spring load cell. Based on this, in this specific implementation, before determining the video frame corresponding to the third scoring point, it is necessary to first determine a fifth video frame.

Wherein, at the in-process to the zero setting of spring dynamometer, treat that the appraisal personnel can hold the handheld part of spring dynamometer with the finger, lift the spring dynamometer with vertical state is unsettled, and, the spring dynamometer below is used for the couple that links with other article and does not carry any article.

Therefore, after the video frames corresponding to the second scoring point are determined, the electronic equipment can detect whether the handheld part is in contact with the hand of the person to be scored and the spring dynamometer which is not connected with the lever frame by frame from the video frames corresponding to the second scoring point according to the playing sequence of the operation video.

It will be appreciated that during the process of zero setting when the person to be assessed is lifting the spring dynamometer, the slide of the spring dynamometer may move up and down and gradually come to a standstill due to its own weight or manual adjustment of the person to be assessed. Therefore, in the process of determining the video frame corresponding to the fifth score point, it is necessary to determine whether the slide of the spring force gauge has reached the stationary state.

Correspondingly, the up-and-down movement of the slide sheet of the spring dynamometer is reflected in the video frame of the operation video, namely: if the distance between the slide sheet of the spring dynamometer in continuous multi-frame video frames and the zero scale line of the spring dynamometer is not changed, the slide sheet of the spring dynamometer is considered to be in a static state; if the distance between the slide of the spring force gauge and the zero scale line of the spring force gauge varies over successive frames of the video frame, it can be assumed that the slide of the spring force gauge has not reached a standstill.

Based on the above, when the spring dynamometer which is not connected with the lever and has the hand-held part in contact with the hand of the person to be scored is detected in the video frame, the electronic equipment can determine the distance between the slide sheet of the spring dynamometer and the zero scale line of the spring dynamometer and judge whether the distance corresponds to the previous frame and is not changed.

In this way, when it is determined that the distance does not change for the previous frame, 1 may be added to the fourth value, that is, a video frame in which the distance between the slide of the spring force gauge and the zero scale line of the spring force gauge does not change is counted.

Furthermore, the electronic device may determine whether the fourth value reaches a fourth predetermined number, that is, whether there is no change in a distance between a sliding piece of the spring dynamometer and a zero scale line of the spring dynamometer in consecutive frames of the fourth predetermined number.

If the frame number of the video frames reaches the preset number, the fact that the distance between the sliding sheet of the spring dynamometer and the zero scale line of the spring dynamometer is unchanged in the video frames with the fourth preset number of continuous frames is indicated, namely the sliding sheet of the spring dynamometer stops moving up and down to reach a standing state. In this way, the electronic device may use the video frames with the distance corresponding to the previous frame not changed and the consecutive fourth preset number of frames as the video frames corresponding to the fifth score point.

If the frame number does not reach the preset frame number, the video frames of the fourth preset number do not exist, the distance between the slide sheet of the spring dynamometer and the zero scale line of the spring dynamometer is not changed, and the next video frame needs to be detected and judged.

The fourth preset number may be set according to the specific situation of the practical application, and may be, for example, 5, 10, or 8.

Correspondingly, when the distance is judged to be changed corresponding to the previous frame, the situation that the slide sheet of the spring dynamometer still moves downwards and does not reach the standing state can be shown. Then the fourth value can be cleared, i.e. the video frames in which the distance between the slide of the spring force gauge and the zero graduation mark of the spring force gauge has not changed are counted again. And thus, determining the video frame corresponding to the fifth scoring point until the fourth numerical value reaches a fourth preset number.

S503: detecting whether two sides of the center point of the lever meet a preset condition frame by frame from a video frame corresponding to the fifth score point according to the playing sequence of the operation video;

when the predetermined video frame is the second video frame, the predetermined condition is as follows: and a weight and a spring dynamometer connected with the lever are only arranged on one side of the center point of the lever, and when the preset video frame is a third video frame, the preset conditions are as follows: spring force meters connected with the levers are arranged on two sides of the central point of each lever;

s504: after each frame is detected, if the detection result is yes, determining a second number of the designated objects corresponding to the preset condition in the frame and a second connecting position of the designated objects and the lever, and judging whether the last frame corresponding to the second number and the second connecting position is not changed, if so, adding 1 to a fifth numerical value, otherwise, resetting the fifth numerical value, and after adding 1 to the fifth numerical value, judging whether the fifth numerical value reaches a fifth preset number, if so, judging that the last frame corresponding to the second number and the second connecting position is not changed, and taking continuous frames of the fifth preset number as preset video frames;

when the predetermined video frame is the second video frame, the predetermined index is as follows: the second quantity of the hung weights, the second connecting position of the hung weights and the lever, and the connecting position of the hooked spring dynamometer and the lever; when the predetermined video frame is the third video frame, the predetermined condition is: the hooked spring dynamometer is respectively connected with the connecting positions of the levers;

s505: and determining the preset video frame as the video frame corresponding to the fourth scoring point.

After the spring load cell is zeroed, the person to be evaluated can perform the operation of horizontally balancing the lever using the weight and the spring load cell, or horizontally balancing the lever using the spring load cell. Therefore, in this specific implementation, in the operation video recording, the determined predetermined video frame is located after the video frame corresponding to the fifth scoring point.

Wherein the correct operation of the scoring point using the weight and spring load cell to balance the lever horizontally is: hanging weights on one side of the central point of the lever, hooking a hook of the spring dynamometer at a certain position on the side of the lever, and vertically and upwards pulling the spring dynamometer so as to horizontally balance the lever;

the correct operation of the scoring point for the operation of balancing the lever horizontally using the spring load cell is: the hooks of the two spring force meters are respectively hooked at certain positions on two sides of the central point of the lever, and the two spring force meters are vertically pulled upwards to enable the lever to be horizontally balanced.

Therefore, after the video frame corresponding to the fifth scoring point is determined, the electronic equipment can detect whether the two sides of the central point of the lever meet the preset conditions frame by frame from the video frame corresponding to the fifth scoring point according to the playing sequence of the operation video.

When the predetermined video frame is the second video frame, the predetermined condition is as follows: a weight and a spring dynamometer which are connected with the lever are only arranged on one side of the central point of the lever;

when the predetermined video frame is the third video frame, the predetermined condition is: spring load cells connected with the lever are arranged on two sides of the central point of the lever.

It can be understood that no matter whether use weight and spring dynamometer to make lever horizontal balance, still only use spring dynamometer to make lever horizontal balance, in order to guarantee the horizontal balance of lever, the personnel of waiting to appraise can adjust the quantity of the weight of carrying, the weight of carrying and the hookup position of lever at the in-process of carrying the weight or colluding the spring dynamometer to and the hookup position of the spring dynamometer and the lever of linking up that collude. Therefore, in the process of determining the predetermined video frame, it is necessary to judge whether the person to be evaluated is adjusting the number of the weights mounted, the connection position of the mounted weights and the lever, and the coupling position of the coupled spring dynamometer and the lever, or has already adjusted the number of the weights mounted, the connection position of the mounted weights and the lever, and the coupling position of the coupled spring dynamometer and the lever.

Correspondingly, the operations of the person to be scored are reflected in the video frame of the operation video, namely:

when the predetermined video frame is a second video frame, if the number of the weights mounted in the continuous multi-frame video frame and the connecting position with the lever, and the connecting position of the hooked spring dynamometer and the lever are changed, the person to be evaluated can be considered to be adjusting the number of the weights mounted and the connecting position with the lever, and the connecting position of the hooked spring dynamometer and the lever; if the number of the weights mounted and the connection position with the lever in the continuous multi-frame video frames and the connection position of the hooked spring dynamometer and the lever do not change, it can be considered that the person to be evaluated has adjusted the number of the weights mounted and the connection position with the lever, and the connection position of the hooked spring dynamometer and the lever.

When the preset video frame is a third video frame, if the connection positions of the hooked spring dynamometer in the continuous multi-frame video frames and the lever respectively change, the person to be evaluated is considered to adjust the connection positions of the hooked spring dynamometer and the lever respectively; if the connection positions of the spring load cells hooked in the continuous multi-frame video frames and the lever respectively do not change, the person to be evaluated can be considered to have adjusted the connection positions of the hooked spring load cells and the lever respectively.

Based on the method, when two sides of the center point of the lever in the video frame are detected to meet the preset conditions, the preset indexes corresponding to the preset conditions in the frame can be determined.

When the predetermined video frame is the second video frame, the predetermined index is as follows: the second quantity of the hung weights, the second connecting position of the hung weights and the lever, and the connecting position of the hooked spring dynamometer and the lever;

when the predetermined video frame is the third video frame, the predetermined condition is: the hooked spring dynamometer is respectively connected with the connecting positions of the levers;

further, after determining the predetermined index corresponding to the preset condition in the frame, it is possible to determine whether the predetermined index has not changed from the previous frame, that is, whether the person to be evaluated has completed the adjustment of the number of the weights to be mounted and the connection position with the lever, and the connection position of the hooked spring force gauge with the lever.

In this way, when it is determined that the predetermined index corresponding to the preset condition in the frame has not changed from the previous frame, 1 may be added to the fifth value, that is, the video frames in which the predetermined index has not changed from the previous frame are counted.

Furthermore, the electronic device may determine whether the fifth value reaches a fifth predetermined number, that is, whether there is a predetermined index corresponding to the video frames of the fifth predetermined number that has not changed from the previous frame.

If the preset indexes are reached, the situation that the corresponding preset indexes in the video frames of the fifth preset number of frames are unchanged relative to the previous frame is shown, namely, the number of the weights which are hung and the connecting position of the weights and the connecting position of the hooked spring dynamometer and the lever are adjusted by the person to be evaluated. In this way, the electronic device may use the fifth predetermined number of consecutive video frames as the predetermined video frames, where the determination result is that the predetermined index corresponds to the previous frame and has not changed.

If the number of the video frames is not reached, it is indicated that the corresponding predetermined index in the continuous fifth preset number of video frames does not change relative to the previous frame, and the next frame of video frames needs to be detected and judged.

The fifth preset number may be set according to the specific situation of the practical application, and may be, for example, 5, 10, or 8.

Correspondingly, when the corresponding preset index in the video frame is judged to be changed relative to the previous frame, the situation that the person to be scored adjusts the number of the weights mounted and the connecting position of the weights and the lever and the connecting position of the hooked spring dynamometer and the lever can be indicated. Then, the fifth value may be cleared, that is, the video frames in which the corresponding predetermined index in the video frames has not changed from the previous frame are counted again. Thus, the predetermined video frame is determined until the fifth value reaches the fifth predetermined number.

Further, after determining the predetermined video frame, since the fourth score is: in the operation process corresponding to the third scoring point, the scoring point of the balance nut cannot be adjusted, and the predetermined video frame is the first video frame or the second video frame in the video frames corresponding to the third scoring point, so that the determined predetermined video frame can be determined as the video frame corresponding to the fourth scoring point.

Any algorithm or model for detecting whether a spring dynamometer which is not connected with the lever and is used for detecting whether the handheld part is in contact with the hand of the person to be scored or not, any algorithm or model for determining the distance between a sliding sheet of the spring dynamometer and a zero scale line of the spring dynamometer and judging whether the distance corresponds to the previous frame does not change, any algorithm or model for detecting whether two sides of the center point of the lever meet a preset condition or not and any algorithm or model for determining a preset index in the frame corresponding to the preset condition and judging whether the previous frame corresponds to the preset index does not change or not can be built in the electronic equipment, so that the electronic equipment can execute the steps S501-S504.

Optionally, the electronic device may determine a connection position of the mounted weight and the lever by detecting lever identification information of the lever and weight identification information of the weight, and a positional relationship between the lever identification information and the weight identification information; determining the number of the mounted weights by detecting the number of the weight identification information; the connecting position of the hooked spring dynamometer and the lever is determined by detecting the lever identification information of the lever and the dynamometer identification information of the spring dynamometer and the position relation of the lever identification information and the dynamometer identification information.

In addition, optionally, one or more of the first video frame, the second video frame and the third video frame may be included in the video frame corresponding to the third scoring point.

When the video frame corresponding to the third scoring point only includes any one of the first video frame, the second video frame, and the third video frame, the third scoring point may determine the video frames corresponding to the third scoring point and the fourth scoring point, or determine the video frames corresponding to the third scoring point, the fourth scoring point, and the fifth scoring point by using the steps in the embodiment shown in fig. 4 or fig. 5.

When the video frames corresponding to the third scoring point include a plurality of first video frames, second video frames, and third video frames, the order in which the person to be scored performs the operation corresponding to the included video frames may be arbitrary.

Specifically, the method comprises the following steps:

case 1: when the video frame corresponding to the third scoring point includes the first video frame and the second video frame, and the person to be scored performs the operation corresponding to the first video frame first and then performs the operation corresponding to the second video frame, the electronic device may perform the steps in the embodiment shown in fig. 4 after determining the video frame corresponding to the second scoring point, and then perform the steps in the embodiment shown in fig. 5, and in the step S501, the video frame corresponding to the first video frame is started according to the playing sequence of the operation video.

Case 2: when the video frame corresponding to the third scoring point includes the first video frame and the second video frame, and the person to be scored performs the operation corresponding to the second video frame first and then performs the operation corresponding to the first video frame, the electronic device may perform the steps in the embodiment shown in fig. 5 after determining the video frame corresponding to the second scoring point, and then perform the steps in the embodiment shown in fig. 4, and in the step S401, the video frame corresponding to the second video frame is started according to the playing sequence of the operation video.

Case 3: when the video frame corresponding to the third scoring point includes the first video frame and the third video frame, and the person to be scored performs the operation corresponding to the first video frame first and then performs the operation corresponding to the third video frame, the electronic device may perform the steps in the embodiment shown in fig. 4 after determining the video frame corresponding to the second scoring point, and then perform the steps in the embodiment shown in fig. 5, and in the step S501, the video frame corresponding to the first video frame is started according to the playing sequence of the operation video.

Case 4: when the video frame corresponding to the third scoring point includes the first video frame and the third video frame, and the person to be scored performs the operation corresponding to the third video frame first and then performs the operation corresponding to the first video frame, the electronic device may perform the steps in the embodiment shown in fig. 5 after determining the video frame corresponding to the second scoring point, and then perform the steps in the embodiment shown in fig. 4, and in the step S501, the video frame corresponding to the third video frame is started according to the playing sequence of the operation video.

Case 5: when the video frame corresponding to the third scoring point includes the second video frame and the third video frame, and the person to be scored performs the operation corresponding to the second video frame first and then performs the operation corresponding to the third video frame, the electronic device may perform the steps in the embodiment shown in fig. 5 after determining the video frame corresponding to the second scoring point, and further perform the steps in the embodiment shown in fig. 5 again, and when performing the step S501 again, the video frame corresponding to the second video frame is started according to the playing sequence of the operation video.

Case 6: when the video frame corresponding to the third scoring point includes the second video frame and the third video frame, and the person to be scored performs the operation corresponding to the third video frame first and then performs the operation corresponding to the second video frame, the electronic device may perform the steps in the embodiment shown in fig. 5 after determining the video frame corresponding to the second scoring point, and further perform the steps in the embodiment shown in fig. 5 again, and when performing the step S501 again, the video frame corresponding to the third video frame is started according to the playing sequence of the operation video.

Case 7: when the video frame corresponding to the third scoring point includes the first video frame, the second video frame and the third video frame, and the person to be scored performs the operation corresponding to the first video frame, then performs the operation corresponding to the second video frame, and finally performs the operation corresponding to the third video frame, the electronic device may perform the steps in the embodiment shown in fig. 4 after determining the video frame corresponding to the second scoring point; further, the steps in the embodiment shown in fig. 5 are executed, wherein, when the step S501 is executed, the video frame corresponding to the first video frame is started according to the playing order of the operation video; next, the steps in the embodiment shown in fig. 5 are executed again, and when step S501 is executed again, the video frames corresponding to the second video frame are started in the playback order of the operation video recording.

Case 8: when the video frame corresponding to the third scoring point includes the first video frame, the second video frame and the third video frame, and the person to be scored performs the operation corresponding to the first video frame first, then performs the operation corresponding to the third video frame, and finally performs the operation corresponding to the second video frame, the electronic device may perform the steps in the embodiment shown in fig. 4 after determining the video frame corresponding to the second scoring point; further, the steps in the embodiment shown in fig. 5 are executed, wherein, when the step S501 is executed, the video frame corresponding to the first video frame is started according to the playing order of the operation video; next, the steps in the embodiment shown in fig. 5 are executed again, and when step S501 is executed again, the video frames corresponding to the third video frame are started in the playback order of the operation video recording.

Case 9: when the video frame corresponding to the third scoring point includes the first video frame, the second video frame and the third video frame, and the person to be scored performs the operation corresponding to the second video frame first, then performs the operation corresponding to the first video frame, and finally performs the operation corresponding to the third video frame, the electronic device may perform the steps in the embodiment shown in fig. 5 after determining the video frame corresponding to the second scoring point; further, the steps in the embodiment shown in fig. 4 are executed, wherein, when the step S401 is executed, the video frame corresponding to the second video frame is started according to the playing sequence of the operation video; next, the steps in the embodiment shown in fig. 5 are executed again, and when step S501 is executed again, the video frames corresponding to the first video frame are started in the playback order of the operation video recording.

Case 10: when the video frame corresponding to the third scoring point includes the first video frame, the second video frame and the third video frame, and the person to be scored performs the operation corresponding to the second video frame first, then performs the operation corresponding to the third video frame, and finally performs the operation corresponding to the first video frame, the electronic device may perform the steps in the embodiment shown in fig. 5 after determining the video frame corresponding to the second scoring point; further, the steps in the embodiment shown in fig. 5 are executed again, wherein when the step S501 is executed again, the video frames corresponding to the second video frame are started according to the playing sequence of the operation video; next, the steps in the embodiment shown in fig. 4 are executed, and when step S401 is executed, the video frame corresponding to the third video frame is started in the playing order of the operation video recording.

Case 11: when the video frame corresponding to the third scoring point includes the first video frame, the second video frame and the third video frame, and the person to be scored performs the operation corresponding to the third video frame first, then performs the operation corresponding to the first video frame, and finally performs the operation corresponding to the second video frame, the electronic device may perform the steps in the embodiment shown in fig. 5 after determining the video frame corresponding to the second scoring point; further, the steps in the embodiment shown in fig. 4 are executed, wherein, when the step S401 is executed, the video frame corresponding to the third video frame is started according to the playing sequence of the operation video; next, the steps in the embodiment shown in fig. 5 are executed again, and when step S501 is executed again, the video frames corresponding to the first video frame are started in the playback order of the operation video recording.

Case 12: when the video frame corresponding to the third scoring point includes the first video frame, the second video frame and the third video frame, and the person to be scored performs the operation corresponding to the third video frame first, then performs the operation corresponding to the second video frame, and finally performs the operation corresponding to the first video frame, the electronic device may perform the steps in the embodiment shown in fig. 5 after determining the video frame corresponding to the second scoring point; further, the steps in the embodiment shown in fig. 5 are executed again, wherein when the step S501 is executed again, the video frames corresponding to the third video frame are started according to the playing sequence of the operation video; next, the steps in the embodiment shown in fig. 4 are executed, and when step S501 is executed, the video frame corresponding to the second video frame is started in the playing order of the operation video recording.

It should be noted that, in the above cases 1 to 11, video frames corresponding to a plurality of fourth scoring points may be determined, and in the above steps 5 to 12, video frames corresponding to a plurality of fifth scoring points may be determined, for which, the electronic device may obtain scores corresponding to the plurality of fourth scoring points and scores corresponding to the plurality of fifth scoring points, and further, when the scoring result of the person to be scored about the target experiment is obtained in the step S103, the scoring result may be determined based on the obtained scores corresponding to the plurality of fourth scoring points and the scores corresponding to the plurality of fifth scoring points. The embodiment of the present invention is not particularly limited.

For example, the average value of the scores corresponding to the plurality of fourth scoring points and the average value of the scores corresponding to the plurality of fifth scoring points may be obtained, so that the scoring result of the person to be scored about the target experiment is determined based on the two average values.

According to the above description of the video-based scoring method provided by the embodiment of the present invention, after the electronic device performs step S201, and determines the video frame corresponding to each scoring point included in the target experiment, the electronic device may continue to perform step S202, and determine, for each scoring point, the score of the scoring point based on the pose information of the target object in the video frame corresponding to the scoring point.

Next, the step S102 is specifically described by taking the target experiment as the lever balance experiment as an example.

The electronic device may continue to execute step S102 after determining the video frame corresponding to the score point for each score point, and determine the score of the score point; after determining the video frames corresponding to all the scoring points included in the target experiment, the step S102 may be executed for the video frame corresponding to each scoring point, so as to determine the score of each scoring point. This is all reasonable.

Hereinafter, specific ways of executing step S102 on the electronic device are described with respect to the first score, the second score, the third score, the fourth score and the fifth score included in the lever balance test, respectively.

For the first score point, a specific implementation manner of the step S102 may include:

determining a central area where a central point of the lever is located in a video frame corresponding to the first score point; when the central region coincides with the coincidence region, the score of the scoring point is determined as: the grade corresponding to the correct operation of the grade point;

wherein, the overlapping area is: the area where the lever coincides with the lever axis.

According to the introduction of each score point included in the lever balance test, the first score point is the score point of the central point of the lever mounted on the support rod. Furthermore, because the overlapping area exists between the lever and the lever shaft in the video frame corresponding to the first scoring point, the electronic device can firstly determine the central area where the central point of the lever is located in the video frame corresponding to the first scoring point, and then judge whether the central area is overlapped with the overlapping area where the lever is overlapped with the lever shaft.

Obviously, when the central area where the central point of the lever is located coincides with the above-mentioned coinciding area, it can be said that the central point of the lever shaft is mounted on the lever shaft, and further, the central point of the lever is mounted on the support rod. Therefore, it can be determined that the operation corresponding to the first scoring point performed by the person to be scored is correct, and thus, the score of the first scoring point can be determined as: and scoring corresponding to the correct operation of the first scoring point.

Correspondingly, the center area where the center point of the lever is located is not overlapped with the overlapping area, so that the score of the first score point can be determined as follows: and scoring corresponding to the error operation of the first scoring point.

The score corresponding to the correct operation of the first score point can be 1 score or other set scores; the score corresponding to the error operation of the first score point may be 0 score, or may be other set scores. This is all reasonable.

Optionally, the electronic device may detect the lever identification information located on the two sides of the lever, and further, a central point of a connection line of the two pieces of lever identification information is used as the central point of the lever, so that an area where the central point of the lever is located is further determined.

For the second score point, a specific implementation manner of the step S102 may include:

determining an included angle between a connecting line between the lever identification information positioned at two sides of the center point of the lever and a first preset calibration object in the video frame corresponding to the second score point; when the included angle is within a first preset included angle range, determining that the score of the scoring point is as follows: the score corresponding to the correct operation of the score point.

The first preset calibration object is as follows: and the object is used for calibrating whether the lever is horizontally balanced.

According to the above description of the respective scores included in the lever balance test, the second score is: and adjusting a grading point of the balance nut of the lever to enable the lever to be horizontally balanced. Furthermore, in the video frame corresponding to the second scoring point, the lever is not connected with the weight and the spring dynamometer, and the hand of the person to be scored is not in contact with the balance nut of the lever. Therefore, the electronic device needs to determine whether the lever is in a balanced state in the video frame corresponding to the second scoring point, that is, whether the person to be scored adjusts the lever to the balanced state by adjusting the balance nut.

Specifically, the method comprises the following steps: the electronic equipment can firstly detect lever identification information respectively positioned at two sides of the central point of the lever, and further determine an included angle between a connecting line between the two pieces of lever identification information and a preset first preset calibration object for calibrating whether the lever is horizontally balanced; and further judging whether the included angle is within the range of the first preset included angle or not, and determining the grade of the second grading point according to the judgment result.

When the included angle is within the range of the first preset included angle, the lever approaching horizontal balance state can be determined, so that the operation corresponding to the second scoring point executed by the personnel to be scored is determined to be correct, and further, the scoring of the second scoring point is determined to be: and the score corresponding to the correct operation of the second score point.

Correspondingly, when the included angle is out of the first preset included angle range, the score of the second score point can be determined as follows: and the scores corresponding to the error operations of the second scoring point.

The score corresponding to the correct operation of the second score point can be 1 score or other set scores; the score corresponding to the error operation of the second score point may be 0 score, or may be other set scores. This is all reasonable.

The first preset calibration object can be a lever shaft, and the included angle is a horizontal included angle between a connecting line between lever identification information positioned at two sides of the central point of the lever and the lever shaft; the included angle is a vertical included angle between a connecting line between the lever identification information positioned at two sides of the central point of the lever and the supporting rod; the included angle may also be a horizontal included angle between a connecting line between the lever identification information located on both sides of the center point of the lever and the horizontal axis in a space coordinate system corresponding to the camera for shooting the operation video.

Furthermore, when the included angle is a horizontal included angle, the closer the included angle is to zero, the closer the lever is to a horizontal balance state; when the included angle is a vertical included angle, the closer the included angle is to 90 degrees, the closer the lever is to a horizontal balanced state.

Therefore, different first preset included angle ranges can be determined according to different first preset calibration objects. For example, when the first preset calibration object is a lever axis or a horizontal axis in a spatial coordinate system corresponding to a camera for shooting the operation video, the first preset included angle range may be [0 degree, 3 degrees ]; when the first preset calibration object is the support shaft, the first preset included angle range may be [87 degrees, 90 degrees ].

Optionally, in the lever balance experiment shown in fig. 6, the electronic device may detect upper left vertexes of the first identifiers 4 respectively located at two sides of the lever, and further determine a horizontal included angle between a continuation between the two upper left vertexes and the lever axis, so as to determine whether the horizontal included angle is located within a first preset included angle range [0 degree, 3 degrees ], if so, determine that the score of the second score is 1, otherwise, determine that the score of the second score is 0.

For the fifth score point, a specific implementation manner of the step S102 may include:

and aiming at a fifth scoring point, judging whether the distance between a slide sheet of the spring dynamometer and a zero scale line of the spring dynamometer is smaller than a preset distance, and if so, determining that the scoring of the scoring point is as follows: the score corresponding to the correct operation of the score point.

According to the introduction of each score point that the above-mentioned balanced experiment of lever includes, the fifth score point is the score point of zeroing to the spring dynamometer, and then, because in the video frame that the fifth score point corresponds, there is handheld part and the personnel's that wait to grade hand to contact, and the spring dynamometer that does not link to each other with the lever, consequently, electronic equipment just need judge whether the distance between the gleitbretter of spring dynamometer and the zero scale mark of spring dynamometer is less than preset distance. I.e. whether the person to be assessed has zeroed the spring dynamometer.

Specifically, the method comprises the following steps: the electronic device may first detect two zero-scale key points of the spring dynamometer, and then determine a distance between a connection line between the two zero-scale key points and a slip sheet of the spring dynamometer, then determine whether the distance is smaller than a preset distance, and determine a score of the third score point according to a determination result.

Obviously, the closer the distance is to zero, the closer the zero graduation lines of the slide of the spring force gauge and the spring force gauge coincide. Like this, when above-mentioned distance is less than preset distance, can confirm that the gleitbretter of spring dynamometer and the zero scale mark of spring dynamometer are close to the coincidence to, confirm the operation that the point is corresponded to the fifth mark of waiting to grade people's namo is correct, and then, confirm that the mark of fifth mark is: and scoring corresponding to the correct operation of the fifth scoring point.

Accordingly, when the distance is not less than the preset distance, the score of the fifth score point may be determined as: and scoring corresponding to the error operation of the fifth scoring point.

The score corresponding to the correct operation of the fifth score point can be 1 score or other set scores; the score corresponding to the error operation of the second score point may be 0 score, or may be other set scores. This is all reasonable.

For the third score point, a specific implementation manner of the step S102 may include:

determining an included angle between a connecting line between the lever identification information positioned at the two sides of the center point of the lever and a second preset calibration object in the video frame corresponding to the third score point; when the included angle is within a second preset included angle range, determining that the score of the scoring point is as follows: the grade corresponding to the correct operation of the grade point;

wherein, the second preset calibration object is: and the object is used for calibrating whether the lever is horizontally balanced.

According to the above description of the respective scoring points included in the lever balance test, the third scoring point includes: one or more of a point of scoring for horizontally balancing the lever using a weight, horizontally balancing the lever using a spring load cell, and horizontally balancing the lever using a weight and a spring load cell. Furthermore, the video frames corresponding to the third scoring point may include one or more of the first video frame, the second video frame, and the third video frame. Whether weights connected with the lever exist on two sides of the center point of the lever in the first video frame or not is judged; a weight and a spring dynamometer which are connected with the lever are only arranged on one side of the central point of the lever in the second video frame; and spring load cells connected with the levers are arranged on two sides of the center point of the lever in the third video frame, so that whether the lever is in a balanced state or not in the video frame corresponding to the third scoring point needs to be judged by the electronic equipment, namely whether a person to be scored adjusts the lever to the balanced state through mounting weights and/or hooking the spring load cells or not.

Specifically, the method comprises the following steps: the electronic equipment can firstly detect lever identification information respectively positioned at two sides of the central point of the lever, and further determine an included angle between a connecting line between the two pieces of lever identification information and a preset second preset calibration object for calibrating whether the lever is horizontally balanced or not; and further judging whether the included angle is within a second preset included angle range, and determining the grade of the third grade point according to the judgment result.

When the included angle is within the second preset included angle range, the lever approaching horizontal balance state can be determined, so that the operation corresponding to the third scoring point executed by the personnel to be scored is determined to be correct, and further, the scoring of the third scoring point is determined to be: and scoring corresponding to correct operation of the third scoring point.

Correspondingly, when the included angle is out of the second preset included angle range, the grade of the third score point is determined as follows: and the score corresponding to the error operation of the third scoring point.

The score corresponding to the correct operation of the third score point can be 1 score or other set scores; the score corresponding to the error operation of the third score point may be 0 score, or may be another set score. This is all reasonable.

The second preset calibration object can be a lever shaft, and the included angle is a horizontal included angle between a connecting line between the lever identification information positioned at two sides of the central point of the lever and the lever shaft; the included angle is a vertical included angle between a connecting line between the lever identification information positioned at two sides of the central point of the lever and the supporting rod; the included angle may also be a horizontal included angle between a connecting line between the lever identification information located on both sides of the center point of the lever and the horizontal axis in a space coordinate system corresponding to the camera for shooting the operation video.

Therefore, different second preset included angle ranges can be determined according to different second preset calibration objects. For example, when the second preset calibration object is a lever axis or a horizontal axis in a spatial coordinate system corresponding to a camera for shooting the operation video, the second preset included angle range may be [0 degree, 3 degrees ]; when the second preset calibration object is the support shaft, the second preset included angle range may be [87 degrees, 90 degrees ].

Optionally, in the lever balance experiment shown in fig. 2, the electronic device may detect upper left vertexes of the first identifiers 4 respectively located at two sides of the lever, and further determine a horizontal included angle between a continuation between the two upper left vertexes and the lever axis, so as to determine whether the horizontal included angle is located within a second preset included angle range [0 degree, 3 degrees ], if so, determine that the score of the third score is 1, otherwise, determine that the score of the third score is 0.

The second preset calibration object and the first preset calibration object may be the same or different, and thus, the second preset included angle range and the first preset included angle range may be the same or different.

For the fourth score point, a specific implementation manner of the step S102 may include:

when the contact between the hand of the person to be scored and the balance nut of the lever is identified and obtained in the video frame corresponding to the fourth scoring point, the scoring of the scoring point is determined as follows: the scoring corresponding to the error operation of the scoring point.

According to the above descriptions of the respective scores included in the lever balance test, the fourth score is: in the operation process corresponding to the third scoring point, the scoring point of the balance nut cannot be adjusted. Further, since the third score point includes: one or more of a point of scoring for horizontally balancing the lever using a weight, horizontally balancing the lever using a spring load cell, and horizontally balancing the lever using a weight and a spring load cell. Furthermore, the video frames corresponding to the third scoring point may include one or more of the first video frame, the second video frame, and the third video frame. Whether weights connected with the lever exist on two sides of the center point of the lever in the first video frame or not; a weight and a spring dynamometer which are connected with the lever are only arranged on one side of the central point of the lever in the second video frame; and spring force meters connected with the levers are arranged on two sides of the center point of the lever in the third video frame, so that the electronic equipment needs to detect whether the hands of the personnel to be evaluated are in contact with the balance nuts of the lever in the video frame corresponding to the third scoring point.

Wherein, when the detection discernment obtains waiting to grade personnel's hand and the balanced nut contact of lever, can confirm that the user of waiting to discern has adjusted balanced nut at the corresponding operation in-process of third score to, confirm that the operation that the fourth score point that the personnel of waiting to grade executed corresponds is wrong, and then, confirm that the grade of fourth score point does: the scoring corresponding to the error operation of the scoring point.

Correspondingly, when the hand of the person to be scored is detected and identified to be not contacted with the balance nut of the lever, the score of the fourth scoring point can be determined as follows: the score corresponding to the correct operation of the score point.

The score corresponding to the correct operation of the fourth score point can be 0 score or other set scores; the score corresponding to the error operation of the fourth score point may be-1 score, or may be other set scores. This is all reasonable.

Corresponding to the scoring method based on the video provided by the embodiment of the invention, the embodiment of the invention also provides a scoring device based on the video.

Fig. 8 is a video-based scoring apparatus according to an embodiment of the present invention. As shown in fig. 8, the apparatus includes:

the video frame acquisition module 810 is configured to determine a video frame corresponding to each scoring point included in a target experiment from an operation video of a person to be scored operating the target experiment; the video frame corresponding to any scoring point is used for judging the score of the scoring point and accords with the predetermined condition corresponding to the scoring point, and the predetermined condition comprises the following steps: each object related to the scoring point exists, the position relation of each object is the position relation adjusted by the person to be scored, and the position relation of each object is the position relation corresponding to the scoring point;

a score determining module 820, configured to determine, for each score point, a score of the score point based on the posture information of the target object in the video frame corresponding to the score point; wherein the target object is: the object which is used for judging whether the operation corresponding to the scoring point is correct or not is arranged in each object related to the scoring point;

and the scoring result calculating module 830 is configured to calculate a scoring result of the person to be scored about the target experiment based on the scores of the respective scoring points.

Optionally, in a specific implementation manner, the video frame obtaining module 810 includes:

alternatively, the first and second electrodes may be,

Optionally, in a specific implementation manner, the video frame obtaining module 810 is specifically configured to:

the video frame obtaining module 810 is specifically configured to:

Optionally, in a specific implementation manner, the score determining module 820 is specifically configured to:

Corresponding to the video-based scoring method provided by the embodiment of the present invention, an electronic device is further provided by the embodiment of the present invention, as shown in fig. 9, and includes a processor 901, a communication interface 902, a memory 903, and a communication bus 904, where the processor 901, the communication interface 902, and the memory 903 complete mutual communication through the communication bus 904,

a memory 903 for storing computer programs;

the processor 901 is configured to implement the steps of any video-based scoring method provided in the above embodiments of the present invention when executing the program stored in the memory 903.

The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the electronic equipment and other equipment.

The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.

In response to the video-based scoring method provided in the foregoing embodiments of the present invention, an embodiment of the present invention further provides a computer-readable storage medium, and when being executed by a processor, the computer program implements the steps of any of the video-based scoring methods provided in the foregoing embodiments of the present invention.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the apparatus embodiment, the electronic device embodiment and the computer-readable storage medium embodiment, since they are substantially similar to the method embodiment, the description is relatively simple, and the relevant points can be referred to the partial description of the method embodiment.

The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims

1. A video-based scoring method, the method comprising:

2. The method of claim 1, wherein the target experiment is: a lever balance test, the scoring points comprising: a first score point, a second score point, a third score point, and a fourth score point;

3. The method of claim 2, wherein when the third scoring point comprises: a point of scoring at which the lever is horizontally balanced using a spring load cell, and/or, a point of scoring at which the lever is horizontally balanced using a weight and a spring load cell, the point of scoring further comprising: a fifth scoring point;

4. The method according to claim 2, wherein the step of determining the video frame corresponding to each scoring point included in the target experiment from the operation video of the person to be scored operating the target experiment comprises:

5. The method according to claim 4, wherein the step of selecting the video frame corresponding to the first score point according to the detection result after detecting each frame comprises:

alternatively, the first and second electrodes may be,

6. The method according to claim 2, wherein the step of determining the video frame corresponding to each scoring point included in the target experiment from the operation video of the person to be scored operating the target experiment comprises:

7. The method according to claim 2, wherein the video frames corresponding to the third scoring point include a first video frame, wherein the first video frame is: a video frame for a scoring point that horizontally balances the lever using the weight;

8. The method according to claim 2, wherein the video frames corresponding to the third scoring point include a predetermined video frame, and the predetermined video frame is a second video frame or a third video frame; wherein the second video frame is: a video frame of a point of scoring for horizontally balancing the lever using the weight and the spring load cell; the third video frame is: a video frame of a point of scoring for balancing the lever horizontally using the spring load cell;

9. The method of claim 2, wherein the step of determining, for each score point, a score of the score point based on the pose information of the target object in the video frame corresponding to the score point comprises:

10. The method of claim 2, wherein the step of determining, for each score point, a score of the score point based on the pose information of the target object in the video frame corresponding to the score point comprises:

11. The method of claim 3, wherein the step of determining, for each score point, a score of the score point based on the pose information of the target object in the video frame corresponding to the score point comprises:

12. The method according to claim 10 or 11, wherein the step of determining, for each score point, a score of the score point based on the pose information of the target object in the video frame corresponding to the score point comprises:

13. The method of claim 12, wherein the step of determining, for each score point, a score of the score point based on the pose information of the target object in the video frame corresponding to the score point comprises:

14. A video-based scoring apparatus, the apparatus comprising:

15. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;

a memory for storing a computer program;

a processor for implementing the method steps of any of claims 1-13 when executing a program stored in the memory.

16. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of claims 1 to 13.