CN113450066A - Method, device and storage medium for automatically passing examination and verification of test questions - Google Patents
Method, device and storage medium for automatically passing examination and verification of test questions Download PDFInfo
- Publication number
- CN113450066A CN113450066A CN202110595407.3A CN202110595407A CN113450066A CN 113450066 A CN113450066 A CN 113450066A CN 202110595407 A CN202110595407 A CN 202110595407A CN 113450066 A CN113450066 A CN 113450066A
- Authority
- CN
- China
- Prior art keywords
- examination
- test
- automatically
- questions
- project
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 395
- 238000012795 verification Methods 0.000 title claims abstract description 145
- 238000000034 method Methods 0.000 title claims abstract description 76
- 238000004519 manufacturing process Methods 0.000 claims abstract description 122
- 238000012550 audit Methods 0.000 claims abstract description 107
- 239000000284 extract Substances 0.000 claims abstract description 31
- 238000012216 screening Methods 0.000 claims description 43
- 230000008569 process Effects 0.000 claims description 28
- 238000012552 review Methods 0.000 claims description 28
- 238000011160 research Methods 0.000 claims description 22
- 239000000463 material Substances 0.000 claims description 9
- 238000009739 binding Methods 0.000 claims description 6
- 239000000203 mixture Substances 0.000 claims description 4
- 238000010276 construction Methods 0.000 abstract 1
- 230000006978 adaptation Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Strategic Management (AREA)
- Human Resources & Organizations (AREA)
- Tourism & Hospitality (AREA)
- Entrepreneurship & Innovation (AREA)
- Theoretical Computer Science (AREA)
- Marketing (AREA)
- Educational Technology (AREA)
- Educational Administration (AREA)
- Economics (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Quality & Reliability (AREA)
- Operations Research (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Electrically Operated Instructional Devices (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention relates to the technical field of online education, and discloses a method, a device and a storage medium for automatically passing examination questions, wherein the method for automatically passing examination and verification of the examination questions comprises the following steps: creating a project, and configuring an auditing link which can automatically pass; configuring an audit robot for creating a project and setting audit authority; the examination robot automatically extracts the test questions from the test question production pool of the test question production process according to the examination authority, and automatically examines and passes the examination and verification links configured in the establishment project aiming at the extracted test questions. According to the invention, the configuration of the auditing link in the test question production flow can be realized through creating the project, the automatically-passing auditing link is configured according to the characteristics of the production test questions and requirements, and the repeated and meaningless workload of manual auditing is reduced; by configuring the auditing robot for the construction project, the auditing robot can automatically extract the questions and automatically pass the auditing link, and the auditing of the test question production flow is completed by mutually combining manual auditing, so that the auditing efficiency is greatly improved.
Description
Technical Field
The invention relates to the technical field of online education, in particular to a method and a device for automatically passing examination and verification of test questions and a storage medium.
Background
On-line education can share high-quality education resources through an internet platform, great convenience is brought to users, and education cost is reduced. Shooting and searching questions, a popular online education mode, a user can shoot and upload test questions through intelligent equipment (such as a mobile phone), the cloud server can analyze, extract, search a test question database and other processes according to the uploaded test question pictures to obtain related test question searching results, and the related test question searching results are returned to the user, so that the user can understand and master difficult and complicated test questions greatly.
The matching degree of the search results of photographing and searching questions is often limited by a test question database, and the test questions in the existing test question database are generally produced through a series of production processes. The existing examination and examination process comprises examination and verification links of recording, operation, teaching and research and drawing, wherein the examination and verification link of recording and arrangement mainly aims at examination and verification of converting a teaching material picture into a structured text, the examination and verification link of operation mainly examines whether an examination question format meets requirements, the examination and verification link of teaching and research mainly examines knowledge points of examination questions, the examination and verification link of drawing mainly examines whether the drawing meets requirements, and the examination and verification process that one examination question needs to be manually examined and verified in the production process can be put into an examination question bank. Although the quality of the test questions in the test question bank is ensured by the production process of the test questions which is manually checked, the manual check cannot be distinguished for some special checking conditions, and the check is still required to be carried out according to the specified check process, so that the repeated check is caused, the workload of the check is increased, the efficiency of the examination question check is influenced, and the production of the test questions is not facilitated.
Specifically, for example, secondary examination is performed on some test questions in the existing test question library, the reason for the secondary examination may be due to the change of a certain knowledge point or the change of a certain label, and for the test questions subjected to the secondary examination, since the test questions already pass through the production process, if the test questions needing the secondary examination are put into the production process again, the examination of the test questions subjected to the secondary examination is performed step by step according to the existing examination program of the production process, which inevitably results in repeated examination, increases the workload of examination, affects the efficiency of examination and examination of the test questions, and is not favorable for secondary production of the test questions.
Therefore, the invention aims to solve the problem that how to automatically pass some auditing processes aiming at the test question production processes of some special conditions, more pay attention to the auditing of key processes, avoid repeated auditing and improve the auditing efficiency.
In view of the above, the present invention is particularly proposed.
Disclosure of Invention
In order to solve the problems, the invention aims to customize an automatic passing auditing link, customize an auditing robot and customize a test question releasing range, thereby greatly improving the overall efficiency of examination question auditing, and the specific technical scheme is as follows:
the invention provides a method for automatically passing examination and verification of test questions, which comprises the following steps:
creating a project, and configuring an auditing link which can automatically pass;
configuring an audit robot for creating a project and setting audit authority;
the examination robot automatically extracts the test questions from the test question production pool of the test question production process according to the examination authority, and automatically examines and passes the examination and verification links configured in the establishment project aiming at the extracted test questions.
As an optional embodiment of the present invention, the test question production process includes a plurality of review links, and the creating a project, configuring a review link that can automatically pass includes:
configuring at least one auditing link in the test question production process as an auditing link capable of automatically passing;
optionally, the test question production process includes a record and arrangement, and/or an operation, and/or a teaching and research, and/or a drawing verification link, wherein the record and arrangement verification link mainly aims at verifying that a teaching material picture is converted into a structured text, the operation verification link mainly verifies whether the format of the test questions meets the requirement, the teaching and research verification link mainly verifies the knowledge points of the test questions, and the drawing verification link mainly verifies whether the drawing meets the requirement; and at least one of the creation project configuration record, operation, teaching and research and drawing is an auditing link capable of passing through automatically.
As an optional embodiment of the present invention, the configuring an audit robot of the creation project, wherein the setting of the audit authority includes:
configuring an audit robot account for creating a project, and setting the grade, and/or subject, and/or role, and/or subject difficulty of audit questions of the audit robot account.
As an optional embodiment of the present invention, the method for automatically auditing the examination questions by the auditing robot includes the following steps:
setting subject screening conditions to screen subjects from a subject library, and binding the subjects into a subject item packet of the created item;
putting the test question item packet into a test question production pool of a test question production flow;
the examination robot automatically extracts the test question item packet from the test question production pool according to the examination authority, and automatically examines and verifies the test questions in the extracted test question item packet through an examination and verification link configured in the created items.
As an optional embodiment of the present invention, the setting of the topic screening condition includes:
setting screening conditions of test question attributes: the grade, and/or subject type, and/or year, and/or province, and/or difficulty, and/or source, and/or ability of the test question;
and/or setting the screening conditions of the test question production attributes: examination time of the test questions, and/or history labels, and/or items, and/or production priority protection;
and/or setting the screening conditions of the on-line attributes of the test questions: the on-line time of the test questions and/or the answering times.
As an optional embodiment of the present invention, a project ID is generated in the project creating process, and the configured review robot and the screened test question project package are both bound to the project ID of the created project.
As an optional implementation manner of the present invention, the creating project further includes configuring an audit tag, where the audit tag marks key audit content of the test question;
optionally, the audit tag includes a composition of the test question, and/or content, and/or a tag, and/or a drawing.
As an optional implementation manner of the invention, the examination questions that the auditing robot automatically audits pass are transferred to the next auditing ring section, and the key auditing and checking are performed on the contents corresponding to the examination questions according to the auditing label.
The invention also provides a device for automatically passing examination and verification of test questions, which comprises:
the project creating module is used for creating projects and configuring auditing links capable of passing automatically;
the audit robot configuration module is used for configuring the audit robot of the created project and setting the audit authority;
the examination robot automatically extracts the test questions from the test question production pool of the test question production process according to the examination authority, and automatically examines and passes the examination and verification links configured in the establishment project aiming at the extracted test questions.
The invention also provides a storage medium which stores a computer executable program, and when the computer executable program is executed, the method for automatically passing the examination question is realized.
Compared with the prior art, the invention has the beneficial effects that:
according to the method for automatically passing examination and verification of the test questions, the configuration of the examination and verification links in the test question production flow can be realized through creating the project, the examination and verification links can be configured according to the characteristics of the test questions to be produced and the requirements, the links which do not need to be repeatedly verified are configured to be automatically passed through examination and verification, the repeated or meaningless workload of manual examination and verification is reduced, and the manual examination and verification focuses on the examination and verification of key links; the audit robot is configured for the establishment project, the audit robot automatically extracts the questions and automatically passes through the audit link, the audit link and the manual audit link are combined with each other to finish the audit of the test question production flow, the audit efficiency is greatly improved due to the configuration of the audit robot, and the test question production flow is accelerated.
Description of the drawings:
FIG. 1 is a first flow chart of a method for automatically passing examination and examination questions according to the present invention;
FIG. 2 is a block diagram of a flow chart of a method for automatically passing examination and examination of test questions according to the present invention;
FIG. 3 is a block flow diagram of an embodiment of a method for automatically passing review of test questions according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings. It is to be understood that the embodiments described are only a few embodiments of the present invention, and not all embodiments.
Thus, the following detailed description of the embodiments of the invention is not intended to limit the scope of the invention as claimed, but is merely representative of some embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the embodiments of the present invention and the features and technical solutions thereof may be combined with each other without conflict.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
In the description of the present invention, it should be noted that the terms "upper", "lower", and the like refer to orientations or positional relationships based on those shown in the drawings, or orientations or positional relationships that are conventionally arranged when the products of the present invention are used, or orientations or positional relationships that are conventionally understood by those skilled in the art, and such terms are used for convenience of description and simplification of the description, and do not refer to or imply that the devices or elements referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and the like are used merely to distinguish one description from another, and are not to be construed as indicating or implying relative importance.
Referring to fig. 1, the present embodiment provides a method for automatically passing examination questions, including:
creating a project, and configuring an auditing link which can automatically pass;
configuring an audit robot for creating a project and setting audit authority;
the examination robot automatically extracts the test questions from the test question production pool of the test question production process according to the examination authority, and automatically examines and passes the examination and verification links configured in the establishment project aiming at the extracted test questions.
The method for automatically passing examination questions in the embodiment comprises the following steps:
firstly, some links which do not need to be checked manually in the test question production flow are configured to automatically pass the checking through the creation project, so that the checking links of the test question production flow can be configured according to the specific conditions of the test questions before the test questions are put into production.
For example, if the examination and verification is performed for the second time of production of the test questions in the test question library, the examination and verification links can be configured according to the requirements of the examination and verification for the second time of production, and the links (such as formats and the like) which do not need to be repeatedly examined and verified are configured to automatically pass.
For another example, if the test questions are captured by the known resource library, because the format, the type, the rules and the like of the test questions in the known resource library are clearly known, the process of automatically passing the examination and verification can be selected according to the requirements, the workload of manual examination and verification is reduced, and the efficiency of examination and verification of the test questions is improved.
And secondly, configuring an auditing robot for the creating project, wherein the auditing robot extracts auditing test questions and executes an automatic auditing link.
Specifically, in the existing manual examination, an artificial account with a certain examination right is configured for an examiner, the examiner logs in the artificial account corresponding to each examination right to screen and extract the test questions in the test question pool of the production process, and performs manual examination on the extracted test questions, and the artificial account issues the test questions with verification that the examination passes or the examination fails, so that the test questions are transferred to the next process.
Therefore, on the basis that the operation mechanism and the circulation mode of the existing manual review are not changed, the review robot is configured for the created project, the review robot can specifically adopt automatic review account numbers configured for the created project, the automatic review account numbers are configured by a system, after test questions corresponding to the created project are put into a production process, the test questions of the created project can be automatically identified and automatically extracted, and the test questions automatically pass through a corresponding review link and flow to the next review process according to the existing circulation mode. And in the link which is not configured to automatically pass the verification, the manual account with the corresponding authority is extracted and manually verified, and verification issuance of 'verification passed' or 'verification failed' is given.
In addition, the auditing authority of the auditing robot needs to be set in the embodiment, the authority of the auditing robot for extracting the test questions is determined by the setting of the auditing authority, and the auditing authority can be set according to specific requirements, so that the test questions can be extracted more pertinently, and the automatic auditing is passed.
For example, when a secondary audit needs to be performed on a certain knowledge point in the "teaching and research" link of the "first-grade math test question", other audit links except for the "teaching and research" in the project can be set as links that automatically pass the audit, and the audit authority is set as "first-grade and math" for the audit robot configured for the created project. After the test questions are put into the production process, the auditing robot automatically extracts the 'one-grade mathematics' test questions according to the auditing authority, and directly transfers to the 'teaching and research' auditing process through the 'recording and arranging', 'operating' and 'drawing' auditing processes, wherein the 'teaching and research' auditing is extracted by the manual account with the corresponding auditing authority and is subjected to manual auditing and checking.
In summary, according to the method for automatically passing examination and verification of test questions, configuration of an examination and verification link in a test question production flow can be achieved through creating projects, the examination and verification link can be configured according to the characteristics of the test questions to be produced and requirements, the link which does not need to be repeatedly examined and verified is configured to be automatically passed and verified, repeated or meaningless workload of manual examination and verification is reduced, and manual examination and verification are more focused on examination and verification of key links; the audit robot is configured for the establishment project, the audit robot automatically extracts the questions and automatically passes through the audit link, the audit link and the manual audit link are combined with each other to finish the audit of the test question production flow, the audit efficiency is greatly improved due to the configuration of the audit robot, and the test question production flow is accelerated.
Further, according to the method for automatically passing examination and verification of test questions of the embodiment, the test question production process includes a plurality of examination and verification links, and the step of creating a project and configuring the examination and verification links which can automatically pass includes: and configuring at least one auditing link in the test question production process as an auditing link capable of automatically passing.
Specifically, the test question production process comprises N auditing links, at least one of the auditing links can be configured as an automatic-passing auditing link during project creation, at most N automatic-passing auditing links are configured, and when the N automatic-passing auditing links are configured, the test questions are directly produced without auditing in the production process and are suitable for the condition of merging a plurality of test question banks.
Optionally, the test question production process includes a record and arrangement, and/or an operation, and/or a teaching and research, and/or a drawing verification link, wherein the record and arrangement verification link mainly aims at verifying that a teaching material picture is converted into a structured text, the operation verification link mainly verifies whether the format of the test questions meets the requirement, the teaching and research verification link mainly verifies the knowledge points of the test questions, and the drawing verification link mainly verifies whether the drawing meets the requirement; and at least one of the creation project configuration record, operation, teaching and research and drawing is an auditing link capable of passing through automatically.
As an optional implementation manner of this embodiment, the configuring an audit robot of the creation project includes:
configuring an audit robot account for creating a project, and setting the grade, and/or subject, and/or role, and/or subject difficulty of audit questions of the audit robot account.
The grades of the test questions comprise primary grade, secondary grade, … …, junior-middle grade, … …, senior-middle grade and … …, the subjects of the test questions comprise mathematics, Chinese, English and … …, the roles of the test questions comprise test questions, calendar-year-truth questions, answer detailed test questions and … …, and the difficulty of the test questions comprises low difficulty, medium difficulty, middle difficulty and … …. According to the method for automatically passing examination and verification of the test questions, after the examination and verification authority is set for the examination and verification robot, the examination and verification robot can extract the test questions to conduct examination and verification according to the set examination and verification authority, and the examination and verification authority of the examination and verification robot is set to be manually configured through the configured high-level account.
Referring to fig. 2, as an optional implementation manner of this embodiment, in the method for automatically passing examination and review test questions of this embodiment, the examination and review robot automatically extracts test questions from a test question production pool of a test question production process according to an examination right, and before an examination link configured in a creation project is automatically passed for the extracted test questions, the method further includes:
setting subject screening conditions to screen subjects from a subject library, and binding the subjects into a subject item packet of the created item;
putting the test question item packet into a test question production pool of a test question production flow;
the examination robot automatically extracts the test question item packet from the test question production pool according to the examination authority, and automatically examines and verifies the test questions in the extracted test question item packet through an examination and verification link configured in the created items.
The method for automatically passing examination and verification of the test questions is suitable for the situation that the examination and verification needs to be carried out on the existing test questions in the test question bank after secondary production and re-examination, and when the test questions in the existing test question bank need to be changed due to some reasons, the test questions need to be screened out for secondary production and the knowledge points needing to be changed are examined and verified; or when the labels of some test questions are wrong or inaccurate, the test questions need to be screened out and then printed again.
For example, due to the adaptation of the existing teaching materials, the knowledge points originally belonging to a certain grade are adjusted to another grade, and at this time, the test questions originally belonging to a certain grade in the test question library are screened and re-modified to adapt to the adaptation of the teaching materials, thereby ensuring the accuracy of the knowledge points and ensuring the comprehensiveness of the searched test questions.
For the above-mentioned situation of the re-commissioning of the test questions in the existing test question bank, since the test questions already existing in the test question bank are necessarily checked through the test question production process, and meet the format and content requirements of the test question production, the secondary check of the test questions should be targeted, and if the manual check mode in the conventional test question production process is adopted, a large amount of repeated check work is inevitably generated, and meaningless manual check work is generated, which wastes manpower resources. The method for automatically passing examination and verification of the test questions can well solve the problems, the links which do not need examination and verification in the test questions needing secondary production are configured to automatically pass through the establishment project, and the examination and verification robots configured to establish the project automatically extract the test questions and automatically pass through the corresponding examination and verification links.
In addition, in order to perform secondary examination on the test questions in the existing test question library more efficiently, the method for automatically passing examination and verification of the test questions in the embodiment screens the questions from the test question library by setting the question screening conditions, binds the questions into the test question item packet of the created project, automatically performs a series of operations of screening, packaging, binding and re-commissioning of the test questions through a writing program, and simultaneously combines the created project and the configuration of the examination robot, so that the test questions can be automatically extracted and automatically examined by the examination robot after being re-commissioned, the examination and verification efficiency is greatly improved, the whole process is more automatic and intelligent, only a key link in charge of manual examination and verification is needed, the working intensity of manual examination and verification is reduced, the manual examination and verification is more concentrated on the link needing examination and verification, and the re-commissioned test questions can be ensured to pass examination and verification as soon as possible.
Further, in the method for automatically passing examination and review of test questions of the embodiment, the setting of the question screening condition includes:
setting screening conditions of test question attributes: the grade, and/or subject type, and/or year, and/or province, and/or difficulty, and/or source, and/or ability of the test question;
and/or setting the screening conditions of the test question production attributes: examination time of the test questions, and/or history labels, and/or items, and/or production priority protection;
and/or setting the screening conditions of the on-line attributes of the test questions: the on-line time of the test questions and/or the answering times.
The test question screening conditions of the embodiment not only comprise the screening conditions of the test question attributes, but also comprise the test question production attribute screening conditions and the test question on-line attribute screening conditions, and the test questions in the test question library can be screened in a targeted manner according to specific screening requirements.
The source of the test question in the test question attribute screening condition of the embodiment refers to which book or which question maker (user ID) the test question comes from; the ability of the test questions refers to the ability of the test questions to investigate the student, such as logical thinking ability, application ability of formulas, reading comprehension ability and the like.
The item of the test question in the test question production attribute screening condition of the embodiment refers to which topic or block the test question belongs, and the production priority of the test question refers to the priority of the test question production process, and is a general priority or a high priority.
According to the method for automatically passing examination and examination of the test questions, the project ID is generated in the project creating process, and the configured examination robot and the screened test question project package are bound with the project ID of the created project. Therefore, in the production process of the test questions, the examination robot can more pertinently extract the test question item packet corresponding to the item ID, analyze the test question item packet to obtain the test questions, automatically pass the examination and check of the analyzed test questions, and quicken the process of the test question re-production.
As an optional implementation manner of this embodiment, the creating item further includes configuring an audit tag, where the audit tag marks key audit content of the test question. In the process of creating the project, the embodiment is provided with not only an automatic passing auditing link but also an auditing label, after the test questions are delivered again, the auditing robot automatically passes through the auditing link of the test questions, the test questions are circulated to manual auditing, the manual auditing can be performed with pertinence in the auditing link of the test questions according to the auditing label configured in the project creating, and the auditing efficiency is greatly improved.
It should be noted that each audit link of the test questions generally includes a plurality of nodes to be audited, so that the audit link configured in the creation project and automatically passing through can automatically pass through the audit link, but the manual audit also includes a plurality of nodes according to the specific audit content in the audit link, and the key point of the audit can be directly located through the audit tag, thereby further reducing the workload of the manual audit and greatly improving the efficiency of the manual audit.
Optionally, the audit tag includes a composition of the test question, and/or content, and/or a tag, and/or a drawing.
According to the method for automatically passing examination and verification of the test questions, the examination and verification robot automatically passes the examination and verification of the test questions and conducts key examination and verification on the corresponding content of the test questions according to the examination and verification label.
In the method for automatically passing examination and verification of the test questions, each link of the test question production process can be extracted by different examination robots respectively, and the conditions for extracting the test questions by the examination robots are the set permission.
In the method for automatically passing examination questions through examination, the examination questions of the examination robot are examined, the basic information and the strong examination information of the questions are verified, if the examination questions are qualified, the examination questions pass, otherwise, the examination questions are ignored. And the auditing robot analyzes whether the extracted test questions contain the project ID or not according to the extracted test questions, acquires an auditing link which is configured by the project ID and can automatically pass if the project ID is analyzed, and provides an auditing result which automatically passes aiming at the corresponding link of the test questions according to the configuration of the project ID.
Therefore, in the conventional manual examination and test question checking process, each link needs manual examination, and in fact some test questions do not need to be checked in some links, so that the examination and test question checking process still needs manual examination, and wastes time and labor. The method for automatically passing examination questions can customize an examination link which automatically passes, customize an examination robot, customize a test question releasing range, and greatly improve the overall examination efficiency of the test questions.
This embodiment also provides a device that examination questions pass through examination and examination automatically, includes:
the project creating module is used for creating projects and configuring auditing links capable of passing automatically;
the audit robot configuration module is used for configuring the audit robot of the created project and setting the audit authority;
the examination robot automatically extracts the test questions from the test question production pool of the test question production process according to the examination authority, and automatically examines and passes the examination and verification links configured in the establishment project aiming at the extracted test questions.
The device for automatically passing examination and verification of test questions in the embodiment comprises:
firstly, the project creating module configures some links which do not need to be manually checked in the test question production flow to be automatically checked through creating the project, so that the project creating module can configure the checking links of the test question production flow according to the specific conditions of the test questions before the project creating module puts the test questions into production.
For example, if the examination and verification of the test questions are performed for the second time of production of the test question library, the project creation module can configure examination and verification links according to the requirements of the examination and verification of the second time of production, and configure links (such as formats and the like) which do not need to be repeatedly examined and verified to be automatically passed, so that when the test questions are subjected to the second time of production, the test questions automatically pass through some examination and verification links during examination and verification, and directly flow to links which need to be mainly examined and verified, repeated examination and verification of the test questions are avoided, and the efficiency of examination and production of the test questions is improved.
For another example, if the test questions are captured by the known resource library, because the format, the type, the rules and the like of the test questions in the known resource library are clearly known, the project creation module can select an automatic auditing link according to the requirements for the commissioning of the part of the test questions, so that the workload of manual auditing is reduced, and the efficiency of auditing and commissioning of the test questions is improved.
And secondly, configuring the audit robot for the establishment project by an audit robot configuration module, wherein the audit robot extracts audit test questions and executes an automatic audit passing link.
Specifically, in the existing manual examination, an artificial account with a certain examination right is configured for an examiner, the examiner logs in the artificial account corresponding to each examination right to screen and extract the test questions in the test question pool of the production process, and performs manual examination on the extracted test questions, and the artificial account issues the test questions with verification that the examination passes or the examination fails, so that the test questions are transferred to the next process.
Therefore, on the basis that the operation mechanism and the circulation mode of the existing manual review are not changed, the review robot is configured for the created project, the review robot can specifically adopt automatic review account numbers configured for the created project, the automatic review account numbers are configured by a system, after test questions corresponding to the created project are put into a production process, the test questions of the created project can be automatically identified and automatically extracted, and the test questions automatically pass through a corresponding review link and flow to the next review process according to the existing circulation mode. And in the link which is not configured to automatically pass the verification, the manual account with the corresponding authority is extracted and manually verified, and verification issuance of 'verification passed' or 'verification failed' is given.
In addition, the auditing authority of the auditing robot needs to be set in the embodiment, the authority of the auditing robot for extracting the test questions is determined by the setting of the auditing authority, and the auditing authority can be set according to specific requirements, so that the test questions can be extracted more pertinently, and the automatic auditing is passed.
For example, when a secondary audit needs to be performed on a certain knowledge point in the "teaching and research" link of the "first-grade math test question", other audit links except for the "teaching and research" in the project can be set as links that automatically pass the audit, and the audit authority is set as "first-grade and math" for the audit robot configured for the created project. After the test questions are put into the production process, the auditing robot automatically extracts the 'one-grade mathematics' test questions according to the auditing authority, and directly transfers to the 'teaching and research' auditing process through the 'recording and arranging', 'operating' and 'drawing' auditing processes, wherein the 'teaching and research' auditing is extracted by the manual account with the corresponding auditing authority and is subjected to manual auditing and checking.
In summary, according to the device for automatically passing examination and verification of test questions, the project creation module can configure the examination and verification link in the test question production flow through creating the project, can configure the examination and verification link according to the characteristics of the test questions to be produced and the requirements, and configure the link which does not need to be repeatedly examined and verified as the automatic passing examination and verification, so that the repeated or meaningless workload of manual examination and verification is reduced, and manual examination and verification are more focused on examination and verification of key links; the audit robot configuration module configures the audit robot for the establishment project, the audit robot automatically extracts questions and automatically passes through the audit link, and the audit link is mutually combined with manual audit to finish the audit of the test question production flow, so that the audit efficiency is greatly improved due to the configuration of the audit robot, and the test question production flow is accelerated.
Further, the device for automatically passing examination and verification of test questions of the embodiment, wherein the test question production process includes a plurality of examination and verification links, the project creation module creates projects, and the configuration of the examination and verification links which can automatically pass includes: the project creation module configures at least one auditing link in the test question production process as an auditing link which can be automatically passed.
Specifically, the test question production process comprises N auditing links, at least one of the auditing links can be configured as an automatically-passed auditing link when the project creating module creates the project, and at most N automatically-passed auditing links are configured.
Optionally, the test question production process includes a record and arrangement, and/or an operation, and/or a teaching and research, and/or a drawing verification link, wherein the record and arrangement verification link mainly aims at verifying that a teaching material picture is converted into a structured text, the operation verification link mainly verifies whether the format of the test questions meets the requirement, the teaching and research verification link mainly verifies the knowledge points of the test questions, and the drawing verification link mainly verifies whether the drawing meets the requirement; and at least one of the creation project configuration record, operation, teaching and research and drawing is an auditing link capable of passing through automatically.
As an optional implementation manner of this embodiment, the configuration module of the audit robot configures the audit robot of the creation project, and setting the audit authority includes:
the auditing robot configuration module configures an auditing robot account of a created project, and sets the grade, and/or subject, and/or role, and/or subject difficulty of auditing the test questions by the auditing robot account.
The grades of the test questions comprise primary grade, secondary grade, … …, junior-middle grade, … …, senior-middle grade and … …, the subjects of the test questions comprise mathematics, Chinese, English and … …, the roles of the test questions comprise test questions, calendar-year-truth questions, answer detailed test questions and … …, and the difficulty of the test questions comprises low difficulty, medium difficulty, middle difficulty and … …. According to the method for automatically passing examination and verification of the test questions, after the examination and verification authority is set for the examination and verification robot, the examination and verification robot can extract the test questions to conduct examination and verification according to the set examination and verification authority, and the examination and verification authority of the examination and verification robot is set to be manually configured through the configured high-level account.
As an optional implementation manner of this embodiment, the apparatus for automatically passing examination and verification of test questions of this embodiment further includes a test question screening module, the examination robot automatically extracts test questions from a test question production pool of a test question production process according to an examination authority, and before passing an examination and verification link configured in a creation project for automatic examination and verification of the extracted test questions, the apparatus further includes:
the test question screening module sets a question screening condition to screen questions from a test question library and binds the test question screening condition into a test question project package of the created project;
putting the test question item packet into a test question production pool of a test question production flow;
the examination robot automatically extracts the test question item packet from the test question production pool according to the examination authority, and automatically examines and verifies the test questions in the extracted test question item packet through an examination and verification link configured in the created items.
The device for automatically passing examination and verification of the test questions is suitable for the situation that the examination and verification needs to be carried out on the existing test questions in the test question bank after secondary production and re-examination, and when the test questions in the existing test question bank need to be changed due to some reasons, the test questions need to be screened out for secondary production and the knowledge points needing to be changed are examined and verified; or when the labels of some test questions are wrong or inaccurate, the test questions need to be screened out and then printed again.
For example, due to the adaptation of the existing teaching materials, the knowledge points originally belonging to a certain grade are adjusted to another grade, and at this time, the test questions originally belonging to a certain grade in the test question library are screened and re-modified to adapt to the adaptation of the teaching materials, thereby ensuring the accuracy of the knowledge points and ensuring the comprehensiveness of the searched test questions.
For the above-mentioned situation of the re-commissioning of the test questions in the existing test question bank, since the test questions already existing in the test question bank are necessarily checked through the test question production process, and meet the format and content requirements of the test question production, the secondary check of the test questions should be targeted, and if the manual check mode in the conventional test question production process is adopted, a large amount of repeated check work is inevitably generated, and meaningless manual check work is generated, which wastes manpower resources. The device for automatically passing examination and verification of the test questions can well solve the problems, the project creating module configures links which do not need to be examined and verified in the test questions needing secondary production into automatic passing through creating the projects, and the examination and verification robot configuration module automatically extracts the test questions and automatically passes through corresponding examination and verification links through the examination and verification robots configuring the created projects.
In addition, in order to perform a secondary examination more efficiently for the test questions in the existing test question bank, the device for automatically passing examination and examination of the test questions in the embodiment screens the questions from the test question bank by setting the question screening conditions, and binding the test question item package as the created item, the test question screening module automatically executes the series of operations of screening, packaging, binding and re-producing the test questions through writing programs, meanwhile, by combining the establishment of projects and the configuration of the auditing robots, the test questions can be automatically extracted and audited by the auditing robots after being put into production again, so that the examination question auditing efficiency is greatly improved, the whole process is more automatic and intelligent, and only the link of key auditing needs to be taken charge of manually, so that the working intensity of manual auditing is reduced, the manual auditing is more concentrated in the link needing auditing, and the test questions put into production again can be ensured to pass auditing as soon as possible.
Further, the question screening conditions set by the test question screening module of this embodiment include:
setting screening conditions of test question attributes: the grade, and/or subject type, and/or year, and/or province, and/or difficulty, and/or source, and/or ability of the test question;
and/or setting the screening conditions of the test question production attributes: examination time of the test questions, and/or history labels, and/or items, and/or production priority protection;
and/or setting the screening conditions of the on-line attributes of the test questions: the on-line time of the test questions and/or the answering times.
The test question screening conditions of the embodiment not only comprise the screening conditions of the test question attributes, but also comprise the test question production attribute screening conditions and the test question on-line attribute screening conditions, and the test questions in the test question library can be screened in a targeted manner according to specific screening requirements.
The source of the test question in the test question attribute screening condition of the embodiment refers to which book or which question maker (user ID) the test question comes from; the ability of the test questions refers to the ability of the test questions to investigate the student, such as logical thinking ability, application ability of formulas, reading comprehension ability and the like.
The item of the test question in the test question production attribute screening condition of the embodiment refers to which topic or block the test question belongs, and the production priority of the test question refers to the priority of the test question production process, and is a general priority or a high priority.
In the device for automatically passing examination and examination of test questions of this embodiment, the project creating module generates a project ID in the process of creating a project, and the configured examination robot and the screened test question project package are both bound to the project ID of the created project. Therefore, in the production process of the test questions, the examination robot can more pertinently extract the test question item packet corresponding to the item ID, analyze the test question item packet to obtain the test questions, automatically pass the examination and check of the analyzed test questions, and quicken the process of the test question re-production.
As an optional implementation manner of this embodiment, the creating of the project by the project creating module further includes configuring an audit tag, where the audit tag marks key audit content of the test question. The project creating module of the embodiment is configured with an automatic passing auditing link and an auditing label in the project creating process, after the test questions are delivered again, the auditing robot automatically passes through the auditing link of the test questions, the test questions are circulated to manual auditing, the manual auditing can be performed with more targeted auditing in the auditing link of the test questions according to the auditing label configured in the project creating process, and the auditing efficiency is greatly improved.
It should be noted that each audit link of the test questions generally includes a plurality of nodes to be audited, so that the audit link configured in the creation project and automatically passing through can automatically pass through the audit link, but the manual audit also includes a plurality of nodes according to the specific audit content in the audit link, and the key point of the audit can be directly located through the audit tag, thereby further reducing the workload of the manual audit and greatly improving the efficiency of the manual audit.
Optionally, the audit tag includes a composition of the test question, and/or content, and/or a tag, and/or a drawing.
According to the device for automatically passing examination and verification of the test questions, the examination questions which are automatically passed through examination and verification by the examination and verification robot are transferred to the next examination and verification ring section, and key examination and verification are performed on the corresponding contents of the test questions according to the examination and verification labels.
The automatic device that passes through examination and check of examination questions of this embodiment, every link of examination questions production flow can be respectively by the examination robot extraction examination questions of difference, and the condition of examination robot extraction examination questions is the authority that its set up.
The device for automatically passing examination questions of the embodiment checks the examination questions of the robot, checks the basic information and the strong examination information of the questions, passes the check if the check is qualified, and ignores the check if the check is not qualified. And the auditing robot analyzes whether the extracted test questions contain the project ID or not according to the extracted test questions, acquires an auditing link which is configured by the project ID and can automatically pass if the project ID is analyzed, and provides an auditing result which automatically passes aiming at the corresponding link of the test questions according to the configuration of the project ID.
The embodiment also provides a storage medium, which stores a computer executable program, and when the computer executable program is executed, the method for automatically passing the examination question is realized.
The storage medium of this embodiment may comprise a propagated data signal with readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
The embodiment also provides an electronic device, which includes a processor and a memory, where the memory is used to store a computer executable program, and when the computer program is executed by the processor, the processor executes the method for automatically passing the examination question.
The electronic device is in the form of a general purpose computing device. The processor can be one or more and can work together. The invention also does not exclude that distributed processing is performed, i.e. the processors may be distributed over different physical devices. The electronic device of the present invention is not limited to a single entity, and may be a sum of a plurality of entity devices.
The memory stores a computer executable program, typically machine readable code. The computer readable program may be executed by the processor to enable an electronic device to perform the method of the invention, or at least some of the steps of the method.
The memory may include volatile memory, such as Random Access Memory (RAM) and/or cache memory, and may also be non-volatile memory, such as read-only memory (ROM).
It should be understood that elements or components not shown in the above examples may also be included in the electronic device of the present invention. For example, some electronic devices further include a display unit such as a display screen, and some electronic devices further include a human-computer interaction element such as a button, a keyboard, and the like. Electronic devices are considered to be covered by the present invention as long as the electronic devices are capable of executing a computer-readable program in a memory to implement the method of the present invention or at least a part of the steps of the method. From the above description of the embodiments, those skilled in the art will readily appreciate that the present invention can be implemented by hardware capable of executing a specific computer program, such as the system of the present invention, and electronic processing units, servers, clients, mobile phones, control units, processors, etc. included in the system. The invention may also be implemented by computer software for performing the method of the invention, e.g. control software executed by a microprocessor, an electronic control unit, a client, a server, etc. It should be noted that the computer software for executing the method of the present invention is not limited to be executed by one or a specific hardware entity, and can also be realized in a distributed manner by non-specific hardware. For computer software, the software product may be stored in a computer readable storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or may be distributed over a network, as long as it enables the electronic device to perform the method according to the present invention.
The above embodiments are only used for illustrating the invention and not for limiting the technical solutions described in the invention, and although the present invention has been described in detail in the present specification with reference to the above embodiments, the present invention is not limited to the above embodiments, and therefore, any modification or equivalent replacement of the present invention is made; all such modifications and variations are intended to be included herein within the scope of this disclosure and the appended claims.
Claims (10)
1. A method for automatically passing examination and check of test questions is characterized by comprising the following steps:
creating a project, and configuring an auditing link which can automatically pass;
configuring an audit robot for creating a project and setting audit authority;
the examination robot automatically extracts the test questions from the test question production pool of the test question production process according to the examination authority, and automatically examines and passes the examination and verification links configured in the establishment project aiming at the extracted test questions.
2. The method of claim 1, wherein the test question production process includes a plurality of review links, and the creating a project and configuring the review links that can be automatically passed includes:
configuring at least one auditing link in the test question production process as an auditing link capable of automatically passing;
optionally, the test question production process includes a record and arrangement, and/or an operation, and/or a teaching and research, and/or a drawing verification link, wherein the record and arrangement verification link mainly aims at verifying that a teaching material picture is converted into a structured text, the operation verification link mainly verifies whether the format of the test questions meets the requirement, the teaching and research verification link mainly verifies the knowledge points of the test questions, and the drawing verification link mainly verifies whether the drawing meets the requirement; and at least one of the creation project configuration record, operation, teaching and research and drawing is an auditing link capable of passing through automatically.
3. The method of claim 1, wherein the configuration of the auditing robot for creating the project, and the setting of the auditing authority includes:
configuring an audit robot account for creating a project, and setting the grade, and/or subject, and/or role, and/or subject difficulty of audit questions of the audit robot account.
4. The method for automatically passing examination and review of test questions according to claim 1, wherein the review robot automatically extracts test questions from a test question production pool of the test question production process according to the review authority, and before automatically reviewing the extracted test questions through a review link configured in the creation project, the method further comprises:
setting subject screening conditions to screen subjects from a subject library, and binding the subjects into a subject item packet of the created item;
putting the test question item packet into a test question production pool of a test question production flow;
the examination robot automatically extracts the test question item packet from the test question production pool according to the examination authority, and automatically examines and verifies the test questions in the extracted test question item packet through an examination and verification link configured in the created items.
5. The method of claim 4, wherein the setting of the subject screening condition includes:
setting screening conditions of test question attributes: the grade, and/or subject type, and/or year, and/or province, and/or difficulty, and/or source, and/or ability of the test question;
and/or setting the screening conditions of the test question production attributes: examination time of the test questions, and/or history labels, and/or items, and/or production priority protection;
and/or setting the screening conditions of the on-line attributes of the test questions: the on-line time of the test questions and/or the answering times.
6. The method for automatically passing examination and examination of any one of claims 1 to 5, wherein a project ID is generated during the project creating process, and the configured examination robot and the screened test question project package are bound with the project ID of the created project.
7. The method for automatically passing examination and examination of any one of claims 1-6, wherein the creating of the project further comprises configuring an examination label, wherein the examination label marks the key examination content of the examination question;
optionally, the audit tag includes a composition of the test question, and/or content, and/or a tag, and/or a drawing.
8. The method for automatically passing examination questions according to claim 7, wherein the examination questions automatically passed by the examination robot are transferred to the next examination and review section, and the key examination and verification are performed on the corresponding contents of the examination questions according to the examination label.
9. An apparatus for automatically passing examination and verification of test questions, comprising:
the project creating module is used for creating projects and configuring auditing links capable of passing automatically;
the audit robot configuration module is used for configuring the audit robot of the created project and setting the audit authority;
the examination robot automatically extracts the test questions from the test question production pool of the test question production process according to the examination authority, and automatically examines and passes the examination and verification links configured in the establishment project aiming at the extracted test questions.
10. A storage medium having stored thereon a computer-executable program which, when executed, implements a method of automatically passing an audit of test questions according to any of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110595407.3A CN113450066A (en) | 2021-05-28 | 2021-05-28 | Method, device and storage medium for automatically passing examination and verification of test questions |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110595407.3A CN113450066A (en) | 2021-05-28 | 2021-05-28 | Method, device and storage medium for automatically passing examination and verification of test questions |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113450066A true CN113450066A (en) | 2021-09-28 |
Family
ID=77810351
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110595407.3A Pending CN113450066A (en) | 2021-05-28 | 2021-05-28 | Method, device and storage medium for automatically passing examination and verification of test questions |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113450066A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107918655A (en) * | 2017-11-16 | 2018-04-17 | 重庆三峡学院 | A kind of test paper generation management control system and control method |
| CN109446522A (en) * | 2018-10-22 | 2019-03-08 | 东莞市七宝树教育科技有限公司 | A kind of examination question automatic classification system and method |
| CN110472221A (en) * | 2019-08-22 | 2019-11-19 | 上海乂学教育科技有限公司 | Dynamic Test edit methods and its system |
-
2021
- 2021-05-28 CN CN202110595407.3A patent/CN113450066A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107918655A (en) * | 2017-11-16 | 2018-04-17 | 重庆三峡学院 | A kind of test paper generation management control system and control method |
| CN109446522A (en) * | 2018-10-22 | 2019-03-08 | 东莞市七宝树教育科技有限公司 | A kind of examination question automatic classification system and method |
| CN110472221A (en) * | 2019-08-22 | 2019-11-19 | 上海乂学教育科技有限公司 | Dynamic Test edit methods and its system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10810365B2 (en) | Workflow system and method for creating, distributing and publishing content | |
| US10318593B2 (en) | Extracting searchable information from a digitized document | |
| AU2017296412B2 (en) | System and method for automatically understanding lines of compliance forms through natural language patterns | |
| US10678516B2 (en) | Chatbot builder user interface | |
| CN102880601A (en) | Machine translation feedback | |
| CN115099204A (en) | Information collection management method and device | |
| CN115048506A (en) | Test question generation system, method and device based on knowledge graph and storage medium | |
| CN110889069A (en) | Resource access platform based on web online learning | |
| Karnalim et al. | Layered similarity detection for programming plagiarism and collusion on weekly assessments | |
| White et al. | A task-oriented evaluation metric for machine translation. | |
| CN111626022B (en) | Online education question generation method and device, electronic equipment and storage medium | |
| CN112598547A (en) | Education topic generation method and device based on automatic production line and electronic equipment | |
| CN113450066A (en) | Method, device and storage medium for automatically passing examination and verification of test questions | |
| Whitelock et al. | Addressing the challenges of assessment and feedback in higher education: a collaborative effort across three UK universities | |
| CN111966749B (en) | Data processing method and device, electronic equipment and storage medium | |
| Samuel et al. | Towards an Ontology Network for the Reproducibility of Scientific Studies. | |
| Queirós et al. | Orchestration of e-learning services for automatic evaluation of programming exercises | |
| US11507728B2 (en) | Click to document | |
| Ynion | Using ai in automated ui localization testing of a mobile app | |
| CN114238567A (en) | Course resource information processing method | |
| Zhuang | A PHP Framework-Based Web-Based Instruction Platform. | |
| CN117454023A (en) | Content display method, content display device, electronic equipment and computer storage medium | |
| KR101295025B1 (en) | Distributed Scoring System. | |
| CN114625629A (en) | Interface testing method, terminal and device | |
| Woodson et al. | Visual Displays of School Shooting Data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20230612 Address after: 6001, 6th Floor, No.1 Kaifeng Road, Shangdi Information Industry Base, Haidian District, Beijing, 100085 Applicant after: Beijing Baige Feichi Technology Co.,Ltd. Address before: 100085 4002, 4th floor, No.1 Kaifa Road, Shangdi Information Industry base, Haidian District, Beijing Applicant before: ZUOYEBANG EDUCATION TECHNOLOGY (BEIJING) CO.,LTD. |