WO2021018232A1 - Adaptive evaluation method and apparatus, storage medium, and electronic device - Google Patents
Adaptive evaluation method and apparatus, storage medium, and electronic device Download PDFInfo
- Publication number
- WO2021018232A1 WO2021018232A1 PCT/CN2020/105743 CN2020105743W WO2021018232A1 WO 2021018232 A1 WO2021018232 A1 WO 2021018232A1 CN 2020105743 W CN2020105743 W CN 2020105743W WO 2021018232 A1 WO2021018232 A1 WO 2021018232A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- difficulty
- student
- question
- test question
- test
- Prior art date
Links
- 238000011156 evaluation Methods 0.000 title claims abstract description 53
- 230000003044 adaptive effect Effects 0.000 title claims abstract description 22
- 238000012360 testing method Methods 0.000 claims abstract description 264
- 238000000034 method Methods 0.000 claims abstract description 36
- 238000004364 calculation method Methods 0.000 claims description 19
- 230000015654 memory Effects 0.000 claims description 18
- 238000003062 neural network model Methods 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 5
- 230000033764 rhythmic process Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 238000004891 communication Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 238000013527 convolutional neural network Methods 0.000 description 3
- 230000001944 accentuation Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000013210 evaluation model Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000013100 final test Methods 0.000 description 1
- 230000007787 long-term memory Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 230000006403 short-term memory Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/55—Push-based network services
Definitions
- This application relates to the field of computer technology, in particular to an adaptive evaluation method, device, storage medium and electronic equipment.
- the so-called online teaching means that students and teachers can use their own terminals to realize remote video teaching through the Internet.
- individualized customization can be made by evaluating students' test scores.
- the current assessment method is to select fixed questions in the question bank and push them to students, and conduct assessments based on the correct rate of students' answers. Because this evaluation method uses fixed questions, it is impossible to push more suitable test questions based on the actual situation of the students, which leads to the inability to accurately conduct personalized tests for each student.
- the embodiments of the present application provide an adaptive evaluation method, device, storage medium, and electronic equipment, which can push appropriate test questions according to the actual situation of students, and can accurately perform personalized tests for each student.
- the technical solution is as follows:
- an embodiment of the present application provides an adaptive evaluation method, the method includes:
- the evaluation result of the student is determined.
- an adaptive evaluation device including:
- the first answer obtaining module is configured to push at least one first difficulty test question in the question bank to the student based on the student's corresponding teaching level, and obtain the student's first answer information for the at least one first difficulty test question;
- the first correct rate calculation module is configured to extract the first characteristic information of the first answer information, and calculate the first correct rate of the first answer information based on the first characteristic information;
- a target test question push module configured to push at least one target difficulty test question to the student based on the first correctness rate
- the second answer obtaining module is used to obtain the second answer information of the student for the at least one target difficulty test question
- a second correct rate calculation module configured to extract second feature information of the second answer information, and calculate a second correct rate of the second answer information based on the second feature information
- the evaluation result determination module is configured to determine the evaluation result of the student based on the second correctness rate.
- an embodiment of the present application provides a computer storage medium storing a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the above method steps.
- an embodiment of the present application provides an electronic device, which may include: a processor and a memory; wherein the memory stores a computer program, and the computer program is adapted to be loaded by the processor and execute the above method steps .
- At least one first difficulty test question in the question bank is pushed to the student based on the student's teaching level, and at least one first difficulty test question is pushed to the student according to the first correct rate of the first difficulty test question
- the evaluation result is determined by the second answer information of the target difficulty test question.
- FIG. 1 is a schematic flowchart of an adaptive evaluation method provided by an embodiment of the present application
- FIG. 2 is a schematic flowchart of a performance evaluation method provided by an embodiment of the present application.
- FIG. 3 is a schematic diagram of an example of a question bank provided by an embodiment of the present application.
- FIG. 4 is a schematic diagram of an example of an exam question push page provided by an embodiment of the present application.
- FIG. 5 is a schematic structural diagram of a performance evaluation device provided by an embodiment of the present application.
- Fig. 6 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
- the adaptive evaluation device in the embodiment of the present application may be a user terminal, and the user terminal includes, but is not limited to: a personal computer, a tablet computer, a handheld device, a vehicle-mounted device, a wearable device, a computing device, or a device connected to a wireless modem Other processing equipment, etc.
- user terminals can be called different names, such as: user equipment, access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication Device, user agent or user device, cellular phone, cordless phone, personal digital assistant (PDA), terminal equipment in 5G network or future evolution network, etc.
- PDA personal digital assistant
- FIG. 1 is a schematic flowchart of an adaptive evaluation method provided by an embodiment of this application.
- the adaptive evaluation method of the embodiment of the present application may include the following steps:
- S101 Push at least one first difficulty test question in the question bank to the student based on the teaching level corresponding to the student, and obtain first answer information of the student for the at least one first difficulty test question;
- the question bank includes test questions of different difficulty levels, and each difficulty level can include multiple test questions. And, each difficulty level corresponds to the student's teaching level one to one.
- the question bank includes 5 difficulty levels: A, B, C, D, and E, and the corresponding test questions are S1, S2, S3, S4, and S5. And S1, S2, S3, S4, S5 respectively include multiple test questions.
- students’ teaching levels include 5 levels 1, 2, 3, 4, and 5, which correspond to A, B, C, D, and E in the question bank respectively.
- the teaching level can be determined based on factors such as the age of the student and the length of class. Different age ranges and different length of class correspond to different teaching levels.
- the user’s teaching level can be uniquely determined by the user’s age range and class duration. Among them, 1-5, the larger the value, the higher the teaching level. If a student’s age is 25 and the length of class is 20 months, the corresponding teaching level is level 3.
- the student’s teaching level is determined according to factors such as the student’s age and class duration, and then the difficulty level of the test question corresponding to the teaching level is searched. After the difficulty level is determined, the question corresponding to the difficulty level is randomly followed A preset number of test questions (first difficulty test questions) are pushed to the student, and the student answers these first difficulty test questions. After the answers are completed, the corresponding answer information (first answer information) is obtained.
- the teaching level of a certain student X is level 3
- the corresponding difficulty level is C. Therefore, select at least one (such as 3) test questions in S3 and push it to X, and obtain X's answer information for these 3 test questions.
- S102 Extract first feature information of the first answer information, and calculate a first correct rate of the first answer information based on the first feature information;
- the first feature information is related to the content of the first answer information.
- the first answer information may be voice information, text information, or picture information.
- the first feature information may include rhythm features, accent features, prosodic features, clarity, and so on.
- the rhythm feature refers to the pause position and pause duration between words or syllables and syllables when the user pronounces.
- Stress refers to the accentuation of pronunciation due to scene changes, which refers to which word should be emphasized in a whole sentence, or which syllable should be emphasized in a word.
- Prosodic features refer to the expression of circumflex and frustration of pronunciation, which can include the rhythm of each word, the rhythm of each sentence, the rhythm of each paragraph, and so on.
- Clarity means that the pronunciation of each character or word should be round and round, and there is no unclear or unclear ending sound.
- the first feature information may include letter composition, word order, etc.
- the constituent letters refer to which letters a word is composed of, and the order of these letters.
- the word order is the sequence of words that express a sentence (a meaning).
- the first feature information of the first answer information is extracted, and the first feature information is compared with the feature information of the correct answer information one by one, so as to obtain the first correct rate of the student for the first difficulty test question.
- the first feature information of the first answer information is extracted, and the first feature information and the feature information of the correct answer information are subjected to vector operations, such as cosine similarity, distance similarity calculation, etc., to obtain the student The first correct rate for the first difficulty test.
- the order of high and low can be understood as that the difficulty level of the first grade difficulty test is greater than the difficulty level of the target difficulty test. If the difficulty level of the test question corresponding to the target difficulty test is C, the difficulty level of the first grade difficulty test is D or E.
- the first correct rate is less than the first threshold, it indicates that these test questions have a certain degree of difficulty for the student, and at least one test question with a lower difficulty level in the question bank is taken as the Target difficulty test questions and push them to the students.
- the first correct rate is greater than or equal to the first threshold and less than the second threshold, it indicates that these questions are of moderate difficulty for the student.
- the At least one other test question of the same difficulty level as the first difficulty test question in the question bank is used as the target difficulty test question, and is pushed to the student.
- the first threshold is less than the second threshold.
- the first correct rate is greater than or equal to the second threshold, it indicates that these several test questions are relatively easy for the student, and the higher difficulty level in the question bank is selected according to the order of the difficulty level of the test questions in the question bank. At least one test question is used as the target difficulty test question and pushed to the student.
- the high-difficulty test questions or the low-difficulty test questions can include at least one.
- the number of high-difficulty test questions or low-difficulty test questions can be determined according to the correct rate of the students for the first-difficulty test questions, or a fixed number of higher one Test questions or lower one difficulty test questions.
- the number of next difficulty test questions is 3
- the number of next difficulty test questions is 4
- the number of next difficulty test questions is 5 One.
- S104 Acquire second answer information of the student for the at least one target difficulty test question.
- the second answer information written by the user for the target difficulty can be collected through a voice collection device or a touch screen device.
- the second answer information and the first answer information may be the same type of answer information.
- the first answer information is a voice answer
- the second answer information is also a voice answer, which is a test for the same type of exam.
- the calculation method of the second correctness rate may be the same as the calculation method of the first correctness rate. For details, refer to S102, which will not be repeated here.
- the first correctness rate and/or the second correctness rate can also be calculated based on the trained neural network model.
- the neural network model can perform feature extraction and calculation to obtain the final calculation result.
- S106 Determine an evaluation result of the student based on the second correctness rate.
- the second correct rate threshold may be 70%, 75%, 80%, 85%, 90%, etc.
- the statistics of student evaluation results can be calculated based on pre-trained neural network models, such as Convolutional Neural Networks (CNN, or Deep Convolutional Neural Networks, DCNN), Deconvolutional Networks , DN), also known as inverse graphics networks (IGN), recurrent neural networks (RNN), long/short term memory (LSTM), etc. That is, the second accuracy rate, difficulty level, teaching level and other information are used as the input of the model, and the corresponding evaluation result can be obtained.
- the evaluation result can be the number of test scores, the test rating, etc.
- At least one first difficulty test question in the question bank is pushed to the student based on the student's teaching level, and at least one first difficulty test question is pushed to the student according to the first correct rate of the first difficulty test question
- the evaluation result is determined by the second answer information of the target difficulty test question.
- FIG. 2 is a schematic flowchart of an adaptive evaluation method provided by an embodiment of this application.
- the adaptive evaluation method is applied to the user terminal as an example.
- the adaptive evaluation method may include the following steps:
- S201 Acquire the teaching level of the student, and determine the difficulty level of the test question corresponding to the teaching level based on the corresponding relationship between the teaching level and the difficulty level of the test questions in the question bank;
- the teaching level can be determined based on factors such as the age of the student and the length of class. Different age ranges and different class duration correspond to different class levels.
- the teaching level can be divided into 1, 2, 3, 4, 5, etc. The higher the value, the higher the corresponding level.
- the question bank includes test questions of different difficulty levels, and each difficulty level can include multiple test questions. Moreover, each difficulty level corresponds to the student's teaching level one-to-one. After the student's teaching level is determined, the corresponding first difficulty level can be determined.
- S202 Obtain at least one first difficulty test question corresponding to the test question difficulty level in the question bank, and push the at least one first difficulty test question to the student;
- FIG. 3 is a schematic diagram of the question bank, which includes multiple sub-question banks such as S1, S2, S3, S4, and S5.
- the corresponding difficulty levels of each sub-question bank are A, B, C, D, E, and A ⁇ B ⁇ C ⁇ D ⁇ E.
- test questions There are multiple test questions in each sub-question bank. If the determined difficulty level of the test question is C, at least one test question is randomly obtained in S3 and pushed to the student.
- the method of obtaining test questions in the sub-question bank may be to randomly select a fixed number of test questions, or to randomly select a predetermined percentage based on the number of test questions in the sub-question bank.
- the push method may be that the system randomly selects test questions according to preset rules, and then displays them on the display interface of the user terminal.
- the display method can be to display multiple questions on the same page, or to display only one question on the current display page, and jump to display the next question after the user has finished answering the question.
- FIG. 4 a schematic diagram of a test question push display effect is displayed, in which the current difficulty level test question number "current test question includes 5 questions", the content of the test question, and a button control to jump to the next question are displayed.
- S203 Acquire first answer information of the student for the at least one first difficulty test question
- the user terminal After the student finishes answering the above-mentioned pushed test questions and confirms (for example, clicking the "confirm” button on the display interface), the user terminal reads the student's first answer information.
- the student's answer information for the 5 questions obtained by the user terminal is A, A, B, B, and C respectively.
- the examination question requires a student to perform a voice assessment (for example, reading each word or sentence to determine whether the pronunciation is accurate)
- the pronunciation information of the student is adopted by the voice collection device, and the pronunciation information is used as the first answer information.
- the first feature information is related to the content of the first answer information.
- the first answer information may be voice information, text information, or picture information.
- the first feature information may include rhythm features, accent features, prosodic features, clarity, and so on.
- the rhythm feature refers to the pause position and pause duration between words or syllables and syllables when the user pronounces.
- Stress refers to the accentuation of pronunciation due to scene changes, which refers to which word should be emphasized in a whole sentence, or which syllable should be emphasized in a word.
- Prosodic features refer to the expression of circumflex and frustration of pronunciation, which can include the rhythm of each word, the rhythm of each sentence, the rhythm of each paragraph, and so on.
- Clarity means that the pronunciation of each character or word should be round and round, and there is no unclear or unclear ending sound.
- the correlation refers to similarity or distance.
- a feasible implementation is to extract the first feature information of the first answer information, and compare the first feature information with the first reference feature information of the correct answer information one by one to obtain the similarity between the two, and compare the Similarity is used as the first correct rate to describe the first difficulty test questions. The higher the similarity, the higher the first correct rate.
- Another feasible implementation method is to calculate the correlation between the two to calculate the distance between the two, and obtain the first correct rate according to the distance, for example, the reciprocal of the calculated distance is used as the first correct rate, The greater the calculated distance, the lower the first correct rate, or the first correct rate is calculated by performing the cosine similarity of the feature vector, and so on.
- the first answer information needs to be aligned with the first reference feature information and then compared one by one.
- the rhythm can be expressed by the pause duration. If the pause is 0.4 seconds, the rhythm of the word is 0.4. If 1 represents accent and 0 represents non-stress, the accent feature of the corresponding voice segment of the sentence in the user's speech can be expressed as a vector (1,0,0,0). Prosody and clarity can also be expressed by vector coding. Then express each feature information in the form of row vector or column vector for each word in a predetermined order, so as to obtain the matrix corresponding to each sentence, and then align and compare each corresponding matrix.
- the correlation between the two can be calculated sentence by sentence, and then the first correct rate is obtained sentence by sentence, and finally the final first correct rate is obtained according to the weight.
- the first correct rate threshold is a correct rate preset for the target difficulty level, and may be a reasonable value obtained by empirical statistics. It is also possible to set the same correct rate for test questions of various difficulty levels, that is, for test questions of different difficulty levels such as A, B, C, D, and E, the correct rate thresholds are all the same.
- the first correct rate is less than the first threshold, it indicates that these test questions have a certain degree of difficulty for the student, and at least one test question with a lower difficulty level in the question bank is taken as the Target difficulty test questions and push them to the students.
- the B-level test questions should be searched and pushed to the student, that is, the test questions in the S2 question bank should be searched and pushed.
- the push ends at this time.
- the first correct rate is greater than or equal to the first threshold and less than the second threshold, it indicates that these questions are of moderate difficulty for the student.
- the At least one other test question of the same difficulty level as the first difficulty test question in the question bank is used as the target difficulty test question, and is pushed to the student.
- the first threshold is less than the second threshold.
- the C-level test questions should be searched for and pushed to the student, that is, continue to search for test questions in the S3 question bank for push.
- the first correct rate is greater than or equal to the second threshold, it indicates that these several test questions are relatively easy for the student, and the higher difficulty level in the question bank is selected according to the order of the difficulty level of the test questions in the question bank. At least one test question is used as the target difficulty test question and pushed to the student.
- the D-level test questions should be searched and pushed to the student, that is, the test questions in the S4 question bank should be searched and pushed.
- S208 Acquire second answer information of the student for the at least one target difficulty test question
- the method for obtaining the second answer information can be the same as the method for obtaining the first answer information. For details, see S203, which is not repeated here.
- the calculation method of the second correctness rate may be the same as the calculation method of the first correctness rate. For details, refer to S204, which will not be repeated here.
- a feasible evaluation method is to obtain the answer correct rate corresponding to the answer information, determine the pronunciation level corresponding to the answer correct rate, and use the pronunciation level as the test result of the student.
- the correct rate of the student for grade C is 85% (greater than the first correct rate threshold), and the correct rate for grade D is 70% (less than the second correct rate threshold), using a preset algorithm to calculate the total correct rate (if 80%), and then according to the corresponding relationship between the correct rate and the test score (as shown in Table 4), the final test score of the student can be determined.
- Correct rate Test score Greater than or equal to 95% A+ Greater than or equal to 90 and less than 95% A Greater than or equal to 85% and less than 90% A- Greater than or equal to 80% and less than 85% B+ Greater than or equal to 70% and less than 80% B Less than 70% B-
- Another evaluation method may be to use the second correctness rate as the input of the pre-trained evaluation model to obtain the evaluation result. For details, see S106, which will not be repeated here.
- the second correctness rate is greater than or equal to the third correctness rate threshold, it indicates that the student can easily answer the test questions of the target difficulty level, and then the student can continue to push higher difficulty levels in the above manner
- the test questions are pushed directly to the test questions of the highest difficulty level in the question bank or when the correct rate of the answer information of a certain difficulty test question is less than the preset correct rate threshold, the push is ended.
- At least one first difficulty test question in the question bank is pushed to the student based on the student's teaching level, and at least one first difficulty test question is pushed to the student according to the first correct rate of the first difficulty test question
- the evaluation result is determined by the second answer information of the target difficulty test question.
- FIG. 5 shows a schematic structural diagram of an adaptive evaluation device provided by an exemplary embodiment of the present application.
- the adaptive evaluation device can be implemented as all or a part of the user terminal through software, hardware or a combination of the two.
- the device 1 includes a first answer obtaining module 10, a first correct rate calculation module 20, a target test question pushing module 30, a second answer obtaining module 40, a second correct rate calculation module 50, and a test result determination module 60.
- the first answer obtaining module 10 is configured to push at least one first difficulty test question in the question bank to the student based on the student's corresponding teaching level, and obtain the student's first answer information for the at least one first difficulty test question;
- the first correct rate calculation module 20 is configured to extract first feature information of the first answer information, and calculate the first correct rate of the first answer information based on the first feature information;
- the target test question pushing module 30 is configured to push at least one target difficulty test question to the student based on the first correctness rate
- the second answer obtaining module 40 is configured to obtain second answer information of the student for the at least one target difficulty test question
- the second correctness rate calculation module 50 is configured to extract second characteristic information of the second answer information, and calculate a second correctness rate of the second answer information based on the second characteristic information;
- the evaluation result determination module 60 is configured to determine the evaluation result of the student based on the second correctness rate.
- the target test question pushing module 30 is specifically used for:
- At least one test question with a lower difficulty level in the question bank is taken as the target difficulty test question according to the order of the difficulty level of the test questions in the question bank, and is pushed to the student;
- the first correct rate when the first correct rate is greater than or equal to the first threshold and less than the second threshold, use at least one other test question in the question bank with the same difficulty level as the first difficulty test question as the target difficulty Test questions and push them to said students; and/or
- At least one test question with a higher difficulty level in the question bank is taken as the target difficulty test question according to the order of the difficulty level of the test questions in the question bank, and is pushed To the student.
- the first correct rate and/or the second correct rate are calculated based on the trained neural network model.
- the first correct rate calculation module 20 is specifically configured to:
- the second correctness rate calculation module 50 is specifically configured to: calculate the second correctness rate based on the correlation between the second feature information and second reference feature information, where the second reference information is the target difficulty The characteristic information of the reference answer of the test question.
- the first answer obtaining module 10 is specifically used for:
- the evaluation result includes student pronunciation level information.
- the adaptive evaluation device provided in the above embodiment executes the adaptive evaluation method
- only the division of the above-mentioned functional modules is used as an example for illustration.
- the above-mentioned functions can be allocated to different functions according to needs.
- Module completion means dividing the internal structure of the device into different functional modules to complete all or part of the functions described above.
- the self-adaptive evaluation device provided in the above-mentioned embodiment and the self-adaptive evaluation method embodiment belong to the same concept, and the implementation process is detailed in the method embodiment, which will not be repeated here.
- At least one first difficulty test question in the question bank is pushed to the student based on the student's teaching level, and at least one first difficulty test question is pushed to the student according to the first correct rate of the first difficulty test question
- the evaluation result is determined by the second answer information of the target difficulty test question.
- the embodiments of the present application also provide a computer storage medium.
- the computer storage medium may store a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method steps of the embodiments shown in FIGS. 1 to 4 above.
- For the specific execution process refer to the specific description of the embodiment shown in FIG. 1 to FIG. 4, which is not repeated here.
- the electronic device 1000 may include: at least one processor 1001, at least one network interface 1004, a user interface 1003, a memory 1005, and at least one communication bus 1002.
- the communication bus 1002 is used to implement connection and communication between these components.
- the user interface 1003 may include a display screen (Display) and a camera (Camera), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.
- Display display screen
- Camera Camera
- the optional user interface 1003 may also include a standard wired interface and a wireless interface.
- the network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).
- the processor 1001 may include one or more processing cores.
- the processor 1001 uses various excuses and lines to connect various parts of the entire electronic device 1000, and executes by running or executing instructions, programs, code sets, or instruction sets stored in the memory 1005, and calling data stored in the memory 1005.
- Various functions and processing data of the electronic device 1000 may adopt at least one of digital signal processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA).
- DSP Digital Signal Processing
- FPGA Field-Programmable Gate Array
- PLA Programmable Logic Array
- the processor 1001 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), a modem, and the like.
- the CPU mainly processes the operating system, user interface, and application programs; the GPU is used to render and draw the content that the display needs to display; the modem is used to process wireless communication. It is understandable that the above-mentioned modem may not be integrated into the processor 1001, but may be implemented by a chip alone.
- the memory 1005 may include random access memory (RAM) or read-only memory (Read-Only Memory).
- the memory 1005 includes a non-transitory computer-readable storage medium.
- the memory 1005 may be used to store instructions, programs, codes, code sets or instruction sets.
- the memory 1005 may include a storage program area and a storage data area, where the storage program area may store instructions for implementing the operating system and instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), Instructions used to implement the foregoing method embodiments, etc.; the storage data area can store the data involved in the foregoing method embodiments.
- the memory 1005 may also be at least one storage device located far away from the foregoing processor 1001.
- the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an adaptive evaluation application program.
- the user interface 1003 is mainly used to provide an input interface for the user to obtain data input by the user; and the processor 1001 may be used to call an adaptive evaluation application program stored in the memory 1005, and Specifically perform the following operations:
- the evaluation result of the student is determined.
- the processor 1001 when the processor 1001 pushes at least one target difficulty test question to the student based on the first correctness rate, the processor 1001 specifically performs the following operations:
- At least one test question with a lower difficulty level in the question bank is taken as the target difficulty test question according to the order of the difficulty level of the test questions in the question bank, and is pushed to the student;
- the first correct rate when the first correct rate is greater than or equal to the first threshold and less than the second threshold, use at least one other test question in the question bank with the same difficulty level as the first difficulty test question as the target difficulty Test questions and push them to said students; and/or
- At least one test question with a higher difficulty level in the question bank is taken as the target difficulty test question according to the order of the difficulty level of the test questions in the question bank, and is pushed To the student.
- the processor 1001 further performs the following operations:
- the first correct rate and/or the second correct rate are calculated based on the trained neural network model.
- the processor 1001 specifically performs the following operations when performing the calculation of the first correctness rate:
- the processor 1001 specifically performs the following operations when performing calculation of the second correctness rate:
- the second correctness rate is calculated based on the correlation between the second feature information and the second reference feature information, where the second reference information is feature information of a reference answer of a target difficulty test question.
- the processor 1001 when the processor 1001 pushes at least one first difficulty test question in the question bank to the student based on the teaching level corresponding to the student, the processor 1001 specifically performs the following operations:
- the evaluation result includes the pronunciation level information of the student.
- At least one first difficulty test question in the question bank is pushed to the student based on the student's teaching level, and at least one first difficulty test question is pushed to the student according to the first correct rate of the first difficulty test question
- the evaluation result is determined by the second answer information of the target difficulty test question.
- the program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments.
- the storage medium can be a magnetic disk, an optical disc, a read-only storage memory or a random storage memory, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Human Resources & Organizations (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- Economics (AREA)
- Educational Technology (AREA)
- Marketing (AREA)
- Entrepreneurship & Innovation (AREA)
- Development Economics (AREA)
- General Business, Economics & Management (AREA)
- Primary Health Care (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Game Theory and Decision Science (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Electrically Operated Instructional Devices (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
正确率Correct rate | 推送个数Push number |
80%-85%80%-85% | 33 |
85%-90%85%-90% | 44 |
90%-100%90%-100% | 55 |
正确率Correct rate | 考试成绩Test score |
大于或者等于95%Greater than or equal to 95% | A+A+ |
大于或者等于90,且小于95%Greater than or equal to 90 and less than 95% | AA |
大于或者等于85%,且小于90%Greater than or equal to 85% and less than 90% | A-A- |
大于或者等于80%,且小于85%Greater than or equal to 80% and less than 85% | B+B+ |
大于或者等于70%,且小于80%Greater than or equal to 70% and less than 80% | BB |
小于70%Less than 70% | B-B- |
Claims (10)
- 一种自适应测评方法,其特征在于,所述方法包括:An adaptive evaluation method, characterized in that the method includes:基于学生所对应的教学等级向所述学生推送题库中的至少一个第一难度试题,获取所述学生针对所述至少一个第一难度试题的第一答案信息;Push at least one first difficulty test question in the question bank to the student based on the teaching level corresponding to the student, and obtain the student's first answer information for the at least one first difficulty test question;提取所述第一答案信息的第一特征信息,基于所述第一特征信息,计算所述第一答案信息的第一正确率;Extracting first characteristic information of the first answer information, and calculating a first correct rate of the first answer information based on the first characteristic information;基于所述第一正确率,向所述学生推送至少一个目标难度试题;Push at least one target difficulty test question to the student based on the first correctness rate;获取所述学生针对所述至少一个目标难度试题的第二答案信息;Acquiring second answer information of the student for the at least one target difficulty test question;提取所述第二答案信息的第二特征信息,基于所述第二特征信息,计算所述第二答案信息的第二正确率;Extracting second characteristic information of the second answer information, and calculating a second correctness rate of the second answer information based on the second characteristic information;基于所述第二正确率,确定所述学生的测评结果。Based on the second correctness rate, the evaluation result of the student is determined.
- 根据权利要求1所述的方法,其特征在于,基于所述第一正确率,向所述学生推送至少一个目标难度试题,包括:The method according to claim 1, wherein pushing at least one target difficulty test question to the student based on the first correctness rate comprises:当所述第一正确率小于第一阈值时,根据所述题库中考题难度等级的高低顺序将所述题库中低一级难度等级的至少一个试题作为所述目标难度试题,并推送给所述学生;When the first correct rate is less than the first threshold, at least one test question with a lower difficulty level in the question bank is taken as the target difficulty test question according to the order of the difficulty level of the test questions in the question bank, and is pushed to the student;和/或当所述第一正确率大于等于所述第一阈值且小于第二阈值时,将所述题库中与所述第一难度试题的难度等级相同的其他至少一个试题作为所述目标难度试题,并推送给所述学生;和/或And/or when the first correct rate is greater than or equal to the first threshold and less than the second threshold, use at least one other test question in the question bank with the same difficulty level as the first difficulty test question as the target difficulty Test questions and push them to said students; and/or当所述第一正确率大于或者等于所述第二阈值时,根据所述题库中考题难度等级的高低顺序将所述题库中高一级难度等级的至少一个试题作为所述目标难度试题,并推送给所述学生。When the first correct rate is greater than or equal to the second threshold, at least one test question with a higher difficulty level in the question bank is taken as the target difficulty test question according to the order of the difficulty level of the test questions in the question bank, and is pushed To the student.
- 根据权利要求1所述的方法,其特征在于,基于训练好的神经网络模型计算所述第一正确率和/或第二正确率。The method according to claim 1, wherein the first correctness rate and/or the second correctness rate are calculated based on a trained neural network model.
- 根据权利要求3所述的方法,其特征在于,所述计算所述第一正确率,包括:The method according to claim 3, wherein said calculating said first correct rate comprises:基于所述第一特征信息与第一参考特征信息的相关性,计算所述第一正确率,其中,所述第一参考信息为第一难度试题的参考答案的特征信息;和/或Calculate the first correct rate based on the correlation between the first feature information and the first reference feature information, where the first reference information is feature information of the reference answer of the first difficulty test question; and/or所述计算所述第二正确率,包括:基于所述第二特征信息与第二参考特征信息的相关性,计算所述第二正确率,其中,所述第二参考信息为目标难度试题的参考答案的特征信息。The calculating the second correctness rate includes: calculating the second correctness rate based on the correlation between the second characteristic information and the second reference characteristic information, wherein the second reference information is the value of the target difficulty test question Refer to the characteristic information of the answer.
- 根据权利要求1所述的方法,其特征在于,所述基于学生所对应的教学等级向所述学生推送题库中的至少一个第一难度考题,包括:The method according to claim 1, wherein the pushing at least one first difficulty test question in the question bank to the student based on the teaching level corresponding to the student comprises:获取学生的所述教学等级,基于所述教学等级与题库中试题难度等级的对应关系,确定所述教学等级对应的试题难度等级;Acquiring the teaching level of the student, and determining the difficulty level of the test question corresponding to the teaching level based on the corresponding relationship between the teaching level and the difficulty level of the test questions in the question bank;在题库中获取所述试题难度等级对应的至少一个第一难度考题,将所述至少一个第一难度考题推送至所述学生。Acquire at least one first difficulty test question corresponding to the test question difficulty level from the question bank, and push the at least one first difficulty test question to the student.
- 根据权利要求1所述的方法,其特征在于,所述测评结果包括学生的发音等级信息。The method according to claim 1, wherein the evaluation result includes student pronunciation level information.
- 一种自适应测评装置,其特征在于,所述装置包括:An adaptive evaluation device, characterized in that the device includes:第一答案获取模块,用于基于学生所对应的教学等级向所述学生推送题库中的至少一个第一难度试题,获取所述学生针对所述至少一个第一难度试题的第一答案信息;The first answer obtaining module is configured to push at least one first difficulty test question in the question bank to the student based on the student's corresponding teaching level, and obtain the student's first answer information for the at least one first difficulty test question;第一正确率计算模块,用于提取所述第一答案信息的第一特征信息,基于所述第一特征信息,计算所述第一答案信息的第一正确率;The first correct rate calculation module is configured to extract the first characteristic information of the first answer information, and calculate the first correct rate of the first answer information based on the first characteristic information;目标试题推送模块,用于基于所述第一正确率,向所述学生推送至少一个目标难度试题;A target test question push module, configured to push at least one target difficulty test question to the student based on the first correctness rate;第二答案获取模块,用于获取所述学生针对所述至少一个目标难度试题的第二答案信息;The second answer obtaining module is used to obtain the second answer information of the student for the at least one target difficulty test question;第二正确率计算模块,用于提取所述第二答案信息的第二特征信息,基于所述第二特征信息,计算所述第二答案信息的第二正确率;A second correct rate calculation module, configured to extract second feature information of the second answer information, and calculate a second correct rate of the second answer information based on the second feature information;测评结果确定模块,用于基于所述第二正确率,确定所述学生的测评结果。The evaluation result determination module is configured to determine the evaluation result of the student based on the second correctness rate.
- 根据权利要求7所述的装置,其特征在于,所述目标试题推送模块,具体用于:The device according to claim 7, wherein the target test question pushing module is specifically used for:当所述第一正确率小于第一阈值时,根据所述题库中考题难度等级的高低顺序将所述题库中低一级难度等级的至少一个试题作为所述目标难度试题,并推送给所述学生;When the first correct rate is less than the first threshold, at least one test question with a lower difficulty level in the question bank is taken as the target difficulty test question according to the order of the difficulty level of the test questions in the question bank, and is pushed to the student;和/或当所述第一正确率大于等于所述第一阈值且小于第二阈值时,将所述题库中与所述第一难度试题的难度等级相同的其他至少一个试题作为所述目标难度试题,并推送给所述学生;和/或And/or when the first correct rate is greater than or equal to the first threshold and less than the second threshold, use at least one other test question in the question bank with the same difficulty level as the first difficulty test question as the target difficulty Test questions and push them to said students; and/or当所述第一正确率大于或者等于所述第二阈值时,根据所述题库中考题难度等级的高低顺序将所述题库中高一级难度等级的至少一个试题作为所述目标难度试题,并推送给所述学生。When the first correct rate is greater than or equal to the second threshold, at least one test question with a higher difficulty level in the question bank is taken as the target difficulty test question according to the order of the difficulty level of the test questions in the question bank, and is pushed To the student.
- 一种计算机存储介质,其特征在于,所述计算机存储介质存储有多条指令,所述指令适于由处理器加载并执行如权利要求1~6任意一项的方法步骤。A computer storage medium, wherein the computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method steps according to any one of claims 1 to 6.
- 一种电子设备,其特征在于,包括:处理器和存储器;其中,所述存储器存储有计算机程序,所述计算机程序适于由所述处理器加载并执行如权利要求1~6任意一项的方法步骤。An electronic device, comprising: a processor and a memory; wherein the memory stores a computer program, and the computer program is adapted to be loaded by the processor and executed as claimed in any one of claims 1 to 6 Method steps.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910686867.XA CN110489454A (en) | 2019-07-29 | 2019-07-29 | A kind of adaptive assessment method, device, storage medium and electronic equipment |
CN201910686867.X | 2019-07-29 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021018232A1 true WO2021018232A1 (en) | 2021-02-04 |
Family
ID=68548717
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/105743 WO2021018232A1 (en) | 2019-07-29 | 2020-07-30 | Adaptive evaluation method and apparatus, storage medium, and electronic device |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN110489454A (en) |
WO (1) | WO2021018232A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113220847A (en) * | 2021-06-01 | 2021-08-06 | 平安科技(深圳)有限公司 | Knowledge mastering degree evaluation method and device based on neural network and related equipment |
CN114913729A (en) * | 2021-02-09 | 2022-08-16 | 广州视源电子科技股份有限公司 | Question selection method and device, computer equipment and storage medium |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110489454A (en) * | 2019-07-29 | 2019-11-22 | 北京大米科技有限公司 | A kind of adaptive assessment method, device, storage medium and electronic equipment |
CN110956870A (en) * | 2019-11-25 | 2020-04-03 | 中北大学 | Solfeggio teaching method and device |
CN111861816B (en) * | 2020-06-19 | 2024-01-16 | 北京国音红杉树教育科技有限公司 | Method and equipment for calculating word memory strength in language inter-translation learning |
CN111861819B (en) * | 2020-06-19 | 2024-03-12 | 北京国音红杉树教育科技有限公司 | Method for evaluating memory level of user in intelligent silently writing and electronic device |
CN111861815B (en) * | 2020-06-19 | 2024-02-02 | 北京国音红杉树教育科技有限公司 | Method and device for evaluating memory level of user in word listening learning |
CN111861814B (en) * | 2020-06-19 | 2024-01-16 | 北京国音红杉树教育科技有限公司 | Method and system for evaluating memory level in alphabetic language dictation learning |
CN111782952A (en) * | 2020-06-30 | 2020-10-16 | 联想(北京)有限公司 | Information processing method and information processing device |
CN111914176B (en) * | 2020-08-07 | 2023-10-27 | 腾讯科技(深圳)有限公司 | Question recommendation method and device |
CN113936514A (en) * | 2021-08-25 | 2022-01-14 | 国网浙江省电力有限公司培训中心 | Experimental real standard system of high voltage circuit breaker |
CN114429269A (en) * | 2021-12-16 | 2022-05-03 | 北京津发科技股份有限公司 | Human factor work efficiency evaluation method, system and device |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160300564A1 (en) * | 2013-12-20 | 2016-10-13 | Kabushiki Kaisha Toshiba | Text-to-speech device, text-to-speech method, and computer program product |
CN108255962A (en) * | 2017-12-22 | 2018-07-06 | 东软集团股份有限公司 | Knowledge Relation method, apparatus, storage medium and electronic equipment |
CN109389493A (en) * | 2018-09-29 | 2019-02-26 | 平安科技(深圳)有限公司 | Customized test question mesh input method, system and equipment based on speech recognition |
CN109741734A (en) * | 2019-03-08 | 2019-05-10 | 北京猎户星空科技有限公司 | A kind of speech evaluating method, device and readable medium |
CN110489454A (en) * | 2019-07-29 | 2019-11-22 | 北京大米科技有限公司 | A kind of adaptive assessment method, device, storage medium and electronic equipment |
-
2019
- 2019-07-29 CN CN201910686867.XA patent/CN110489454A/en active Pending
-
2020
- 2020-07-30 WO PCT/CN2020/105743 patent/WO2021018232A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160300564A1 (en) * | 2013-12-20 | 2016-10-13 | Kabushiki Kaisha Toshiba | Text-to-speech device, text-to-speech method, and computer program product |
CN108255962A (en) * | 2017-12-22 | 2018-07-06 | 东软集团股份有限公司 | Knowledge Relation method, apparatus, storage medium and electronic equipment |
CN109389493A (en) * | 2018-09-29 | 2019-02-26 | 平安科技(深圳)有限公司 | Customized test question mesh input method, system and equipment based on speech recognition |
CN109741734A (en) * | 2019-03-08 | 2019-05-10 | 北京猎户星空科技有限公司 | A kind of speech evaluating method, device and readable medium |
CN110489454A (en) * | 2019-07-29 | 2019-11-22 | 北京大米科技有限公司 | A kind of adaptive assessment method, device, storage medium and electronic equipment |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114913729A (en) * | 2021-02-09 | 2022-08-16 | 广州视源电子科技股份有限公司 | Question selection method and device, computer equipment and storage medium |
CN113220847A (en) * | 2021-06-01 | 2021-08-06 | 平安科技(深圳)有限公司 | Knowledge mastering degree evaluation method and device based on neural network and related equipment |
Also Published As
Publication number | Publication date |
---|---|
CN110489454A (en) | 2019-11-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021018232A1 (en) | Adaptive evaluation method and apparatus, storage medium, and electronic device | |
CN112487139B (en) | Text-based automatic question setting method and device and computer equipment | |
CN110491218A (en) | A kind of online teaching exchange method, device, storage medium and electronic equipment | |
CN109816265B (en) | Knowledge characteristic mastery degree evaluation method, question recommendation method and electronic equipment | |
CN112307742A (en) | Session type human-computer interaction spoken language evaluation method, device and storage medium | |
CN110009537B (en) | Information processing method, device, equipment and storage medium | |
CN111107442B (en) | Method and device for acquiring audio and video files, server and storage medium | |
CN113377200B (en) | Interactive training method and device based on VR technology and storage medium | |
Ma et al. | The effects of using a self-developed mobile app on vocabulary learning and retention among EFL learners | |
CN111597305B (en) | Entity marking method, entity marking device, computer equipment and storage medium | |
CN115630860A (en) | Teaching quality evaluation method, device, equipment and storage medium | |
KR102550839B1 (en) | Electronic apparatus for utilizing avatar matched to user's problem-solving ability, and learning management method | |
US20120323556A1 (en) | System and method for using pinyin and a dynamic memory state for modifying a hanyu vocabulary test | |
KR20070006742A (en) | Language teaching method | |
KR101160414B1 (en) | Study system and method for foreign language | |
US9547995B1 (en) | Dynamic instructional course | |
JP2020038371A (en) | Computer program, pronunciation learning support method and pronunciation learning support device | |
KR102423740B1 (en) | Method for operating lecture platform and apparatus for the same | |
CN115132353A (en) | Method, device and equipment for generating psychological question automatic response model | |
CN111859971A (en) | Method, apparatus, device and medium for processing information | |
CN114333776B (en) | Auxiliary method and device for spoken language teaching, computer equipment and storage medium | |
KR102577643B1 (en) | Online one to one korean lecture platform system and operating server included in the same | |
CN117153197B (en) | Speech emotion recognition method, apparatus, and computer-readable storage medium | |
KR102645783B1 (en) | System for providing korean education service for foreigner | |
KR102594629B1 (en) | Apparatus for including speaking scoring artificial intelligence model to evaluate responses of answer to evaluation question |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20848277 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20848277 Country of ref document: EP Kind code of ref document: A1 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20848277 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 11.08.2022) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20848277 Country of ref document: EP Kind code of ref document: A1 |