CN110246228B - Chemical experiment evaluation system and method based on virtual reality technology - Google Patents
Chemical experiment evaluation system and method based on virtual reality technology Download PDFInfo
- Publication number
- CN110246228B CN110246228B CN201910463331.1A CN201910463331A CN110246228B CN 110246228 B CN110246228 B CN 110246228B CN 201910463331 A CN201910463331 A CN 201910463331A CN 110246228 B CN110246228 B CN 110246228B
- Authority
- CN
- China
- Prior art keywords
- experiment
- experimental
- analysis
- text data
- virtual reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/35—Clustering; Classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/36—Creation of semantic tools, e.g. ontology or thesauri
- G06F16/367—Ontology
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2411—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Databases & Information Systems (AREA)
- Artificial Intelligence (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Animal Behavior & Ethology (AREA)
- Computational Linguistics (AREA)
- Computer Graphics (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Multimedia (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a chemical experiment evaluation system based on a virtual reality technology and a method thereof, and relates to the virtual reality technology. The system comprises an experiment teaching outline text analysis server (10), a virtual reality analysis server (20), a behavior intelligent analysis server (30) and an experiment data analysis server (40); the connection relation is as follows: the experimental teaching outline text analysis server (10), the virtual reality analysis server (20) and the behavior intelligent analysis server (30) are respectively connected with the experimental data analysis server (40). The method comprises the following steps: (1) respectively carrying out experiment teaching outline text analysis, virtual reality analysis and behavior intelligent analysis; (2) and (5) analyzing experimental data. The invention has stable performance, is easy for distributed deployment and processes multi-path data in parallel; the method has strong universality and is suitable for virtual reality equipment and video acquisition equipment of each manufacturer; the portability is strong, and the expansibility is flexible; and the chemical experiment is intelligently evaluated, and the teaching quality of the chemical experiment is promoted to be improved.
Description
Technical Field
The invention relates to a virtual reality technology, in particular to a chemical experiment evaluation system and method based on the virtual reality technology.
Background
The virtual reality technology is a computer simulation system capable of creating and experiencing a virtual world, which utilizes a computer to generate a simulation environment, and is a system simulation of multi-source information fusion, interactive three-dimensional dynamic views and entity behaviors to immerse a user in the environment.
Chemical experiment teaching is an important component of chemical professional experiment teaching of colleges and universities, most of chemical experiments of colleges and universities at present generally require teachers to guide students to manually operate experimental instruments and experimental medicines on site, and due to the limited number of teachers in an experiment class, the experimental teaching method cannot timely indicate that each student is irregular in operation, cannot timely solve problems encountered by each student in the experiment, and cannot perform integral evaluation on the experiment of each student according to the operation steps and the operation specifications of the chemical experiment teaching outline. The virtual reality technology is applied to change the traditional chemical experiment operation mode and the guidance mode, and the chemical experiment evaluation method is innovated, so that the method has practicability and operability.
The existing virtual reality technology is mainly applied to chemical experiment teaching: the virtual experiment scene is designed by applying relevant modeling software according to the requirements of teaching outline, the virtual experiment scene is transplanted into virtual reality equipment, the interaction between the virtual reality equipment and the virtual reality scene is realized through a virtual reality system, and the commonly used virtual equipment mainly comprises virtual reality glasses, a virtual reality helmet, a handle, a rocker, data gloves and the like. The virtual reality system can record the whole process of operating the system in the virtual reality scene, convert the whole process into data output and take the output data as the basis of the teacher for evaluating the chemical experiment of the student.
Experiment requirements in the teaching outline of chemical experiments have clear requirements on operation steps and operation action specifications of experiments, the operation steps of the chemical experiments are mainly considered in the existing virtual reality system, and the operation action specifications in the chemical experiments and the behavior specifications of students in the experiments are not effectively identified and evaluated. Meanwhile, chemical experiments are a process of learning in manual practice, and students often need field guidance and timely answer to problems in the experimental process so as to help the students to better develop experiments.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provide a chemical experiment evaluation system and method based on a virtual reality technology.
The purpose of the invention is realized by the following steps:
the method comprises the steps of adopting a text data analysis technology, a virtual reality technology, a knowledge map technology and an intelligent behavior recognition technology, converting experiment steps and experiment requirements, virtual experiment data and experiment behavior data in an experiment teaching outline into related text data, matching, comparing and analyzing the semantics of the experiment steps and experiment requirement text data information, the virtual experiment text data information and the experiment operation behavior recognition text data information by using the data analysis technology to calculate a chemical experiment score, effectively and objectively evaluating a chemical experiment process by using the intelligent technology, and promoting the improvement of the teaching quality of the chemical experiment.
1. Chemical experiment evaluation system (evaluation system for short) based on virtual reality technology
The evaluation system comprises an experiment teaching outline text analysis server, a virtual reality analysis server, a behavior intelligent analysis server and an experiment data analysis server;
the connection relation is as follows: and the experimental teaching outline text analysis server, the virtual reality analysis server and the behavior intelligent analysis server are respectively connected with the experimental data analysis server.
2. Chemical experiment evaluation method (evaluation method for short) based on virtual reality technology
The evaluation method comprises the following steps:
(1) respectively carrying out experimental teaching outline text analysis, virtual reality analysis and intelligent behavior analysis, and dividing 3 paths to carry out:
route 1: text analysis of experiment teaching outline
A. Inputting experimental teaching outline text data;
B. extracting experimental steps and experimental requirement text data
Extracting text data of experimental steps and experimental requirements by adopting a text semantic extraction and analysis method;
C. generating experimental steps and experimental requirement text data;
route 2: virtual reality analysis
a. Virtual reality equipment
Accessing virtual reality equipment to perform a chemical experiment;
b. virtual experimental data extraction
Extracting data of a student chemical experiment process through virtual reality equipment;
c. generating virtual experiment text data;
way 3: behavioral intelligent analysis
I, video acquisition equipment
Collecting video data through a camera above each experiment working table in a laboratory;
ii, intelligent identification of student experiment operation behaviors
Extracting and identifying the experiment operation behaviors of students in the video by applying an intelligent behavior identification algorithm;
iii, generating experiment operation behavior recognition text data;
(2) and (3) analyzing experimental data:
I. way 1, 2, and 3 are summarized: experimental text data analysis and calculation of experimental scores
Combining virtual experiment text data information and experiment operation behavior identification text data information by using a data analysis technology, matching, comparing and analyzing the combined text data information with the semantics of the experiment step and experiment required text data information, solving similar and repeated text data, generating analysis text data, and taking the percentage of the analysis text data in the experiment step and the experiment required text data multiplied by 100 as a chemical experiment score;
II. And outputting the experimental score.
The invention has the following advantages and positive effects:
(1) the performance is stable, the distributed deployment is easy, and the multi-path data is processed in parallel;
(2) the method has strong universality and is suitable for virtual reality equipment and video acquisition equipment of each manufacturer;
(3) the portability is strong, and the expansibility is flexible;
(4) and the chemical experiment is intelligently evaluated, and the teaching quality of the chemical experiment is promoted to be improved.
Drawings
FIG. 1 is a block diagram showing the construction of the evaluation system,
in the figure:
10-an analysis server for text of the outline of experimental teaching,
11-1 st experiment teaching outline text analysis unit,
12-2 nd experiment teaching outline text analysis unit … …
1N-an Nth experiment teaching outline text analysis unit, wherein N is a natural number, and N is more than or equal to 1 and less than or equal to 100;
20-the virtual reality analysis server,
21-the 1 st virtual reality analyzing unit,
22 nd 2 nd virtual reality analysis unit … …
2N-Nth virtual reality analysis unit, wherein N is a natural number, and N is more than or equal to 1 and less than or equal to 100;
30-a behavior intelligent analysis server for analyzing the behavior,
31-the 1 st behavior intelligent analysis unit,
32-2 nd behavior intelligent analysis unit … …
3N-Nth behavior intelligent analysis unit, wherein N is a natural number, and N is more than or equal to 1 and less than or equal to 100;
40-the server for analyzing the experimental data,
41-1 st experimental data analysis unit,
42-2 nd experimental data analysis unit … …
4N-Nth experimental data analysis unit, wherein N is a natural number, and N is more than or equal to 1 and less than or equal to 100.
FIG. 2 is a step chart of the present evaluation method;
FIG. 3 is a flow chart of experimental tutorial text analysis;
FIG. 4 is a flow chart of building a virtual scene model;
FIG. 5 is a flow chart of building an intelligent question-answering model;
FIG. 6 is a flow chart of virtual reality experimental analysis;
FIG. 7 is a flow chart of a model for establishing a sample of a standard experimental procedure;
FIG. 8 is a flow chart of experimental operational behavior identification;
fig. 9 is a flow chart of intelligent analysis of experimental data.
Detailed Description
The following detailed description is made with reference to the accompanying drawings and examples:
1. evaluation system
1. General of
As shown in fig. 1, the evaluation system includes an experimental teaching outline text analysis server 10, a virtual reality analysis server 20, a behavior intelligent analysis server 30 and an experimental data analysis server 40;
the connection relation is as follows: the experimental teaching outline text analysis server 10, the virtual reality analysis server 20 and the behavior intelligent analysis server 30 are respectively connected with an experimental data analysis server 40.
2. Functional component
1) Experimental teaching outline text analysis server 10
The experimental teaching outline text analysis server 10 is an entity of a chemical experimental teaching outline text data analysis function, and corresponds to one server in physical distribution; the experimental teaching outline text analysis server 10 is composed of a plurality of experimental teaching outline text analysis units, and each experimental teaching outline text analysis unit independently completes one path of analysis of chemical experimental teaching outline text data.
As shown in FIG. 1, the text analysis server 10 of the experimental teaching outline comprises 1 st and 2 … … N text analysis units 11 and 12 … … 1N, wherein N is a natural number, and N is more than or equal to 1 and less than or equal to 100.
The main functions are as follows:
(1) the function of importing the text data of the chemical experiment teaching outline is realized;
(2) realizing the extraction of experimental steps and experimental requirement text data;
(3) the experimental data analysis server 40 is accessed, and the experimental steps and the experimental request text data are collected and analyzed and managed by the experimental data analysis server 40.
2) Virtual reality analysis server 20
The virtual reality analysis server 20 is an entity with the functions of virtual chemical experiment data collection, analysis and intelligent question answering, and corresponds to one server in physical distribution; the virtual reality analysis server 20 is composed of a plurality of virtual reality analysis units, and each virtual reality analysis unit independently completes one path of virtual chemical experiment data collection and analysis.
As shown in FIG. 1, the virtual reality analysis server 20 comprises the 1 st and 2 … … N virtual reality analysis units 21 and 22 … … N, wherein N is a natural number, and N is more than or equal to 1 and less than or equal to 100.
The main functions are as follows:
(1) collecting, storing and analyzing student chemical experiment data;
(2) the intelligent question answering function is realized;
(3) and accessing to the experimental data analysis server 40, and centrally collecting, analyzing and managing the virtual experimental text data by the experimental data analysis server 40.
3) Intelligent analysis of behavior server 30
The behavior intelligent analysis server 30 is an entity with the functions of acquiring and analyzing the behavior video data of the chemical experiment operation, and corresponds to one server in physical distribution; the intelligent behavior analysis server 30 is composed of a plurality of intelligent behavior analysis units, and each intelligent behavior analysis unit independently completes analysis of behavior data of a chemical experiment operation.
As shown in FIG. 1, the behavior intelligent analysis server 30 includes behavior intelligent analysis units 1, 2 … … N31, 32 … … N, where N is a natural number, and N is 1 ≦ N ≦ 100.
The main functions are as follows:
(1) collecting, storing and analyzing video data of chemical experiment operation behaviors;
(2) realizing an intelligent analysis algorithm of chemical experiment operation behaviors;
(3) the experimental data analysis server 40 is accessed, and the behavior recognition text data is collected in a centralized manner by the experimental data analysis server 40 and analyzed and managed.
4) Experimental data analysis Server 40
The experimental data analysis server 40 is a functional entity for experimental data analysis, and corresponds to one server in physical distribution; the experimental data analysis server 40 is composed of a plurality of experimental data analysis units, and each experimental data analysis unit can independently complete an experimental step and analysis of the content of experimental request text data, virtual experimental text data and behavior recognition text data.
As shown in FIG. 1, the experimental data analysis server 40 includes 1 st and 2 nd experimental data analysis units 41 and 42 … … N and … … N and 42 zxft 8978 4N are natural numbers, 1 ≦ N ≦ 100.
The main functions are as follows:
(1) collecting and storing experiment steps, experiment requirement text data, virtual experiment text data and behavior recognition
Classifying text data;
(2) implementing an experimental data analysis algorithm;
(3) and intelligently outputting the chemical experiment score.
3. Principle of operation
1) The experimental teaching outline text analysis server 10 is connected to the experimental data analysis server 40, the experimental teaching outline text analysis server 10 searches and matches keywords such as 'experimental step', 'experimental requirement' and the like by performing keyword extraction and semantic analysis on the content of the input experimental teaching outline text data, extracts the text data of the content of the experimental step and the experimental requirement, generates the text data of the experimental step and the experimental requirement, and sends the text data of the experimental step and the experimental requirement to the experimental data analysis server 40;
2) The virtual reality analysis server 20 is connected to the experiment data analysis server 40, the virtual reality analysis server 20 enables students to perform chemical experiments in virtual scenes through glasses and glove virtual reality equipment, establishes a knowledge graph, achieves an intelligent question-answering function in the virtual chemical experiment process, collects, stores and analyzes virtual chemical experiment data to generate virtual experiment text data, and sends the virtual experiment text data to the experiment data analysis server 40;
3) The behavior intelligent analysis server 30 is connected to the experiment data analysis server 40, the behavior intelligent analysis server 30 collects and stores video information of virtual chemical experiment operation behaviors, analyzes and identifies the virtual chemical experiment operation behaviors in the video to generate behavior identification text data, and sends the behavior identification text data to the experiment data analysis server 40;
4) The experiment data analysis server 40 combines the virtual experiment text data information and the experiment operation behavior recognition text data information, matches, compares and analyzes the combined text data information with the semantics of the experiment step and the experiment required text data information, finds similar and repeated text data, generates analysis text data, and calculates a chemical experiment score by analyzing the percentage of the text data in the experiment step and the experiment required text data.
2. Evaluation method
One) general procedure
As shown in fig. 2, the evaluation method includes the steps of:
(1) respectively carrying out experimental teaching outline text analysis, virtual reality analysis and behavior intelligent analysis, and dividing 3 paths to carry out:
route 1: experimental teaching outline text analysis-210
A. Inputting experimental teaching outline text data-211;
B. extraction of Experimental procedures and Experimental requirement text data-212
Extracting text data of experimental steps and experimental requirements by adopting a text semantic extraction and analysis method;
C. generating experimental steps and experimental requirement text data-213;
route 2: virtual reality analysis-220
a. Virtual reality device-221
Accessing virtual reality equipment to perform a chemical experiment;
b. virtual experiment data extraction-222
Extracting data of a student chemical experiment process through virtual reality equipment;
c. generating virtual experiment text data-223;
route 3: intelligent analysis of behavior-230
I video capture device-231
Collecting video data through a camera above each experiment working table in a laboratory;
ii, intelligent recognition-232 of student experiment operation behavior
Extracting and identifying the experiment operation behaviors of students in the video by applying an intelligent behavior identification algorithm;
iii, generating experiment operation behavior recognition text data-233;
(2) analysis of experimental data-240:
I. way 1, 2, and 3 are summarized: experimental text data analysis and calculation of the Experimental score-241
Combining virtual experiment text data information and experiment operation behavior identification text data information by using a data analysis technology, matching, comparing and analyzing the combined text data information with the semantics of the experiment step and experiment required text data information, solving similar and repeated text data, generating analysis text data, and taking the percentage of the analysis text data in the experiment step and the experiment required text data multiplied by 100 as a chemical experiment score;
II. Output the experimental score-242.
Two) the sub-steps
1. Way 1: text analysis of experiment teaching outline
The method mainly comprises the steps of searching and matching experiment steps and experiment requirement keywords, extracting the specific contents of the experiment steps and the experiment requirements in the experiment teaching outline by using a TextRank (text sorting algorithm) algorithm, and finally generating experiment step and experiment requirement text data.
As shown in fig. 3, the process of text analysis of the experimental teaching outline is as follows:
a. inputting experimental teaching outline text data-301;
b. search matching experiment step, experiment requirement keyword-302
Searching a matching algorithm by using the character string, searching the experiment step and the experiment required vocabulary, and positioning the position of the vocabulary in the experiment teaching outline text;
c. extracting an experiment step and an experiment requirement content text-303 by a TextRank algorithm;
d. experimental procedures and experimental requirements text data was generated-304.
2. Route 2: virtual reality analysis
The virtual reality analysis comprises the steps of establishing a virtual scene model, establishing an intelligent question-answering model and virtual reality experiment analysis.
1) Establishing a virtual scene model
Collecting chemical experiment scenes, experimental equipment and experimental medicine materials, designing a two-dimensional plane graph of the chemical experiment virtual scene by adopting CAD (Computer Aided Design) drawing software, and establishing a three-dimensional model of the chemical experiment virtual scene by applying 3D MAX three-dimensional animation rendering and manufacturing software to Design a three-dimensional model of the chemical experiment virtual scene.
As shown in fig. 4, the process of establishing the virtual scene model is as follows:
a. collecting chemical experiment scene materials-401;
b. CAD design experiment scene plan-402;
c. designing a three-dimensional model-403 of an experimental scene by using a 3D MAX;
d. and establishing a three-dimensional model-404 of the virtual experimental scene.
2) Establishing intelligent question-answering model
Inputting chemical basic knowledge and chemical experimental knowledge, establishing a knowledge graph entity relationship by constructing a triple (entity, relationship and entity) mode, screening knowledge data after establishing the entity and entity relationship, and establishing an intelligent question-answering model by using a neo4j graph database for storing and displaying the knowledge graph.
As shown in fig. 5, the process of establishing the intelligent question-answering model is as follows:
a. inputting basic knowledge and chemical experiment knowledge-501;
b. establishing knowledge entity relationships-502
Establishing a knowledge graph entity relationship in a triple (entity, relationship, entity) construction mode;
c. knowledge graph storage-503
Storing and displaying the knowledge graph by using a neo4j graph database;
d. an intelligent question-answering model is established 504.
3) Virtual reality experimental analysis
The virtual reality device is in butt joint with the virtual reality platform, the virtual scene model and the intelligent question-answering model are transplanted to the virtual reality platform, the virtual scene model and the intelligent question-answering model are fused with the virtual reality platform and the information interaction unit, and the intelligent question-answering unit can answer questions of students and assist the students in experiments in the experiment process. And collecting the data of the student virtual experiment process to generate virtual experiment text data.
As shown in fig. 6, the flow of the virtual reality experiment analysis is as follows:
a. virtual reality equipment-601
The virtual reality platform is accessed to the virtual reality equipment;
b. virtual reality platform Module fusion-602
Transplanting the virtual scene model and the intelligent question-answering model into a virtual reality platform, and fusing the virtual scene model and the intelligent question-answering model with the virtual reality platform and an information interaction unit;
c. extracting virtual experimental data-603;
d. virtual experiment text data is generated-604.
3. Route 3: behavioral intelligent analysis
The intelligent behavior analysis comprises the steps of establishing a standard experiment operation sample model and identifying experiment operation behaviors.
1) Establishing a standard experiment operation sample model
Inputting a standard experiment operation video, extracting standard actions of experiment operation in the video by adopting an IDT (enhanced depth transactions) feature extraction algorithm, and training standard action samples of the experiment operation by applying an SVM (support vector machine) classifier to generate an experiment operation behavior sample model.
Referring to fig. 7, the process of establishing a standard experimental operation sample model is as follows:
a. inputting standard experiment operation video-701;
b. IDT feature extraction-702
Extracting standard action characteristics of experimental operation in the video by adopting an IDT (enhanced depth transactions) characteristic extraction algorithm;
c. SVM classifier-703
Training a standard action characteristic sample of experimental operation by applying an SVM (support vector machine) classifier;
d. establishing an experimental operation behavior sample model-704;
2) Experimental operational behavior recognition
Inputting experimental video data, adopting an IDT (enhanced digital aided transmission) feature extraction algorithm to perform feature extraction on experimental operation behaviors in the video, and applying an SVM (support vector machine) classifier to perform classification and identification on the experimental operation behaviors in the video to generate experimental operation behavior identification text data.
Referring to fig. 8, the flow of the experimental operation behavior recognition is as follows:
a. inputting experimental video data-801;
b. IDT feature extraction-802
Performing feature extraction on experimental operation behaviors in the video by adopting an IDT (enhanced depth transactions) feature extraction algorithm;
c. SVM classifier recognition-803
Classifying and identifying experimental operation behaviors in the video by applying an SVM (support vector machine) classifier;
d. experimental operational behavior recognition textual data is generated-804.
4. Analysis of Experimental data
Combining the virtual experiment text data and the experiment operation behavior recognition text data, adopting LDA (Latent Dirichlet allocation) model algorithm semantics to match, compare and analyze the combined text data and the experiment step and the experiment required text data, solving similar and repeated text data, generating analysis text data, and taking the percentage of the analysis text data in the experiment step and the experiment required text data multiplied by 100 as a chemical experiment score.
As shown in fig. 9, the flow of experimental data analysis is as follows:
a. inputting experiment steps and experiment requirements, virtual experiments and experiment operation behavior identification text data-901;
b. LDA algorithm contrasts and analyzes text data-902
Combining the virtual experiment text data and the experiment operation behavior recognition text data, matching, comparing and analyzing the combined text data and the experiment step and the experiment required text data by adopting LDA (Latent Dirichlet allocation) model semantics, solving similar and repeated text data, and generating analysis text data;
c. calculate the experimental score-903
Taking the percentage of the analysis text data in the experimental steps and the text data required by the experiment multiplied by 100 as the chemical experiment score;
d. output experimental score-904.
Claims (1)
1. A chemical experiment evaluation system based on virtual reality technology,
the experimental teaching outline analysis system comprises an experimental teaching outline text analysis server (10), a virtual reality analysis server (20), a behavior intelligent analysis server (30) and an experimental data analysis server (40);
the connection relation is as follows:
the experimental teaching outline text analysis server (10), the virtual reality analysis server (20) and the behavior intelligent analysis server (30) are respectively connected with the experimental data analysis server (40);
the method is characterized in that:
the chemical experiment evaluation method comprises the following steps:
(1) respectively carrying out experimental teaching outline text analysis, virtual reality analysis and behavior intelligent analysis, and dividing 3 paths to carry out:
route 1: experiment teaching outline text analysis (210)
A. Inputting experimental teaching outline text data (211);
B. extracting experimental steps and experimental requirements text data (212)
Extracting text data of experimental steps and experimental requirements by adopting a text semantic extraction and analysis method;
C. generating experimental steps and experimental requirement text data (213);
route 2: virtual reality analysis (220)
a. Virtual reality equipment (221)
Accessing virtual reality equipment to perform a chemical experiment;
b. virtual experiment data extraction (222)
Extracting data of a student chemical experiment process through virtual reality equipment;
c. generating virtual experiment text data (223);
route 3: behavior intelligent analysis (230)
I, video acquisition equipment (231)
Collecting video data through a camera above each experiment working table in a laboratory;
ii, intelligent identification of student experiment operation behavior (232)
Extracting and identifying the experiment operation behaviors of students in the video by applying an intelligent behavior identification algorithm;
iii, generating experiment operation behavior recognition text data (233);
(2) analysis of Experimental data (240)
I. Way 1, 2, and 3 are summarized: experimental text data analysis and calculation of Experimental scores (241)
Combining virtual experiment text data information and experiment operation behavior identification text data information by using a data analysis technology, matching, comparing and analyzing the combined text data information with the semantics of the experiment step and experiment required text data information, solving similar and repeated text data, generating analysis text data, and taking the percentage of the analysis text data in the experiment step and the experiment required text data multiplied by 100 as a chemical experiment score;
II. Outputting an experimental score (242);
the process of the 1 st path experiment teaching outline text analysis is as follows:
a. inputting experimental teaching outline text data (211);
b. search matching experiment step, experiment requirement key word (302)
Searching a matching algorithm by using the character string, searching the experiment step and the experiment required vocabulary, and positioning the position of the vocabulary in the experiment teaching outline text;
c. the TextRank algorithm extracts an experiment step and an experiment requirement content text (303);
d. generating experimental steps and experimental requirement text data (304);
the 2 nd path of virtual reality analysis comprises the steps of establishing a virtual scene model, establishing an intelligent question-answering model and virtual reality experimental analysis:
1) The process of establishing the virtual scene model is as follows:
a. collecting chemical experiment scene materials (401);
b. CAD design experiment scene plan (402);
c. 3DMAX designing an experimental scene three-dimensional model (403);
d. establishing a three-dimensional model (404) of a virtual experiment scene;
2) The process of establishing the intelligent question-answering model comprises the following steps:
a. inputting basic knowledge of chemistry and experimental knowledge of chemistry (501);
b. establishing knowledge entity relationship (502)
Establishing a knowledge graph entity relationship in a triple construction mode;
the triples comprise entities, relationships and entities;
c. knowledge-graph storage (503)
Storing and displaying the knowledge graph by applying a neo4j graph database;
d. establishing an intelligent question-answering model (504);
3) The flow of the virtual reality experiment analysis is as follows:
a. virtual reality equipment (221)
The virtual reality platform is accessed to the virtual reality equipment;
b. virtual reality platform module fusion (602)
Transplanting the virtual scene model and the intelligent question-answering model into a virtual reality platform, and fusing the virtual scene model and the intelligent question-answering model with the virtual reality platform and an information interaction unit;
virtual experiment data extraction (222);
d. generating virtual experiment text data (223);
the 3 rd path of behavior intelligent analysis comprises the steps of establishing a standard experiment operation sample model and identifying experiment operation behaviors;
1) The procedure for establishing a standard experimental manipulation sample model is as follows:
a. inputting a standard experiment operation video (701);
b. IDT feature extraction (702)
Extracting standard action features of experimental operation in the video by adopting an IDT feature extraction algorithm;
c. SVM classifier (703)
Training a standard action characteristic sample of the experimental operation by using an SVM classifier;
d. establishing an experimental operation behavior sample model (704);
2) The flow of the experimental operation behavior identification is as follows:
a. inputting experimental video data (801);
b. IDT feature extraction (802)
Performing feature extraction on experimental operation behaviors in the video by adopting an IDT feature extraction algorithm;
c. SVM classifier identification (803)
Classifying and identifying experimental operation behaviors in the video by using an SVM classifier;
d. generating experimental operation behavior recognition text data (233);
the experimental data analysis flow is as follows:
a. inputting experiment steps and experiment requirements, virtual experiments and experiment operation behavior identification text data (901);
b. LDA algorithm contrastive analysis text data (902)
Combining the virtual experiment text data and the experiment operation behavior recognition text data, matching, comparing and analyzing the combined text data with the experiment step and the experiment required text data by adopting LDA model algorithm semantics, solving similar and repeated text data, and generating analysis text data;
c. calculating the score of the experiment (903)
Taking the percentage of the analysis text data in the experimental steps and the text data required by the experiment multiplied by 100 as the chemical experiment score;
d. the experimental score is output (242).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910463331.1A CN110246228B (en) | 2019-05-30 | 2019-05-30 | Chemical experiment evaluation system and method based on virtual reality technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910463331.1A CN110246228B (en) | 2019-05-30 | 2019-05-30 | Chemical experiment evaluation system and method based on virtual reality technology |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110246228A CN110246228A (en) | 2019-09-17 |
| CN110246228B true CN110246228B (en) | 2023-03-24 |
Family
ID=67885503
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910463331.1A Active CN110246228B (en) | 2019-05-30 | 2019-05-30 | Chemical experiment evaluation system and method based on virtual reality technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110246228B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111125400B (en) * | 2019-12-27 | 2022-03-15 | 中山大学 | Scene graph spectrum optimization method based on relation constraint under virtual reality and augmented reality scenes |
| CN111369852A (en) * | 2020-03-03 | 2020-07-03 | 山东女子学院 | Gene editing experiment teaching simulation method and system based on virtual reality |
| CN112182900B (en) * | 2020-10-10 | 2023-12-29 | 浙江中路智能装备有限公司 | Reliability virtual experiment teaching system and method |
| CN113989608A (en) * | 2021-12-01 | 2022-01-28 | 西安电子科技大学 | Student experiment classroom behavior identification method based on top vision |
| CN115662233A (en) * | 2022-11-01 | 2023-01-31 | 四川轻化工大学 | Experiment teaching system and method based on semi-physical simulation |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU1326201A (en) * | 1999-07-23 | 2001-02-13 | Libra Digital, Llc | Electronic recording, analysis, editing, and playback of scents |
| CN102508991A (en) * | 2011-09-30 | 2012-06-20 | 北京航空航天大学 | Method of constructing virtual experiment teaching scene based on image material |
| CN105719211A (en) * | 2016-03-11 | 2016-06-29 | 深圳市同立方科技有限公司 | Teaching training evaluation method and system based on virtual reality |
| CN106599418A (en) * | 2016-12-01 | 2017-04-26 | 北京金恒博远冶金技术发展有限公司 | Rolling forward-slip measurement virtual experiment method and system |
| CN108804654A (en) * | 2018-06-07 | 2018-11-13 | 重庆邮电大学 | A kind of collaborative virtual learning environment construction method based on intelligent answer |
| CN108831238A (en) * | 2018-08-07 | 2018-11-16 | 苏州承儒信息科技有限公司 | A kind of educational system control method based on virtual experimental |
| CN109710931A (en) * | 2018-12-21 | 2019-05-03 | 中南民族大学 | A kind of class teaching content evaluation system and its method based on Intellectual Analysis Technology |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050049797A1 (en) * | 2003-08-27 | 2005-03-03 | Srinka Ghosh | Method and system for displacement-vector-based detection of zone misalignment in microarray data |
-
2019
- 2019-05-30 CN CN201910463331.1A patent/CN110246228B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU1326201A (en) * | 1999-07-23 | 2001-02-13 | Libra Digital, Llc | Electronic recording, analysis, editing, and playback of scents |
| CN102508991A (en) * | 2011-09-30 | 2012-06-20 | 北京航空航天大学 | Method of constructing virtual experiment teaching scene based on image material |
| CN105719211A (en) * | 2016-03-11 | 2016-06-29 | 深圳市同立方科技有限公司 | Teaching training evaluation method and system based on virtual reality |
| CN106599418A (en) * | 2016-12-01 | 2017-04-26 | 北京金恒博远冶金技术发展有限公司 | Rolling forward-slip measurement virtual experiment method and system |
| CN108804654A (en) * | 2018-06-07 | 2018-11-13 | 重庆邮电大学 | A kind of collaborative virtual learning environment construction method based on intelligent answer |
| CN108831238A (en) * | 2018-08-07 | 2018-11-16 | 苏州承儒信息科技有限公司 | A kind of educational system control method based on virtual experimental |
| CN109710931A (en) * | 2018-12-21 | 2019-05-03 | 中南民族大学 | A kind of class teaching content evaluation system and its method based on Intellectual Analysis Technology |
Non-Patent Citations (1)
| Title |
|---|
| 基于虚拟现实技术的实验教学CNKI论文分析;王艳华等;《基础医学教育》;20180516(第05期);第84-89页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110246228A (en) | 2019-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110246228B (en) | Chemical experiment evaluation system and method based on virtual reality technology | |
| Bragg et al. | Sign language recognition, generation, and translation: An interdisciplinary perspective | |
| CN110489755A (en) | Document creation method and device | |
| CN115239527B (en) | Teaching behavior analysis system based on knowledge base teaching feature fusion and modeling | |
| CN113886567A (en) | Teaching method and system based on knowledge graph | |
| Nitin et al. | Analyzing educational comments for topics and sentiments: A text analytics approach | |
| KR102442435B1 (en) | An artificial intelligence system capable of collecting interactive picture data for building artificial intelligence data, evaluating art competency, and predicting academic achievement | |
| CN109710931A (en) | A kind of class teaching content evaluation system and its method based on Intellectual Analysis Technology | |
| Bertacchini et al. | A project based learning approach for improving students’ computational thinking skills | |
| Agarwal et al. | Autoeval: A nlp approach for automatic test evaluation system | |
| CN113360598A (en) | Matching method and device based on artificial intelligence, electronic equipment and storage medium | |
| CN118193701A (en) | Knowledge tracking and knowledge graph based personalized intelligent answering method and device | |
| Xie et al. | Virtual reality primary school mathematics teaching system based on GIS data fusion | |
| Joshi et al. | CISLR: Corpus for Indian Sign Language Recognition | |
| CN117765783A (en) | Intelligent interactive training system based on virtual reality technology | |
| CN117473078A (en) | Visual reading system of long literature based on cross-domain named entity recognition | |
| WO2023166747A1 (en) | Training data generation device, training data generation method, and program | |
| Fukuda et al. | Detection of Student Teacher's Intention using Multimodal Features in a Virtual Classroom. | |
| Pan et al. | A multimodal framework for automated teaching quality assessment of one-to-many online instruction videos | |
| Hoque et al. | An interactive system for exploring community question answering forums | |
| Gupta et al. | EDUVI: An Educational-Based Visual Question Answering and Image Captioning System for Enhancing the Knowledge of Primary Level Students | |
| Tseng et al. | Integration of mixed reality in teaching and learning effectiveness: A systematic literature review of the analyses | |
| Lei | Teaching research on automatic evaluation system of Japanese pronunciation based on artificial intelligence | |
| Kaouni et al. | Integrating Artificial Intelligence and Natural Language Processing in E-Learning Platforms: A Review of Opportunities and Limitations | |
| Gupta et al. | Fostering Interdisciplinary Learning for Elementary Students Through Developing Interactive Digital Stories |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |