WO2023097684A1 - Procédé et système de mise en œuvre d'enseignement virtuel en laboratoire fondés sur la simulation 3d, et support et dispositif - Google Patents

Procédé et système de mise en œuvre d'enseignement virtuel en laboratoire fondés sur la simulation 3d, et support et dispositif Download PDF

Info

Publication number
WO2023097684A1
WO2023097684A1 PCT/CN2021/135495 CN2021135495W WO2023097684A1 WO 2023097684 A1 WO2023097684 A1 WO 2023097684A1 CN 2021135495 W CN2021135495 W CN 2021135495W WO 2023097684 A1 WO2023097684 A1 WO 2023097684A1
Authority
WO
WIPO (PCT)
Prior art keywords
laboratory
teaching
information
student
experimental
Prior art date
Application number
PCT/CN2021/135495
Other languages
English (en)
Chinese (zh)
Inventor
冯彧
赵昕
王�华
崔红
吴锐
王涛
李其岭
Original Assignee
华特数字科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华特数字科技有限公司 filed Critical 华特数字科技有限公司
Priority to PCT/CN2021/135495 priority Critical patent/WO2023097684A1/fr
Publication of WO2023097684A1 publication Critical patent/WO2023097684A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass

Definitions

  • the invention belongs to the field of virtual reality simulation, in particular to a method for realizing virtual laboratory teaching based on 3D simulation.
  • the virtual laboratory is the carrier of virtual experiment operation and is a virtual experiment It is an experimental platform that can work collaboratively in a network environment, realize virtual experiments and design, and fully realize resource sharing.
  • the current Internet-based virtual distance teaching industry has great disadvantages, that is, the teaching environment is relatively single, some teaching links that require special equipment cannot be carried out, and students cannot fully understand it just by watching teachers demonstrate, and cannot carry out immersive learning and Experience, teachers and students do not have a more realistic and diverse teaching environment, unable to realize the leap from mastering to application of knowledge, lacking an experimental teaching system and method based on virtual reality technology, and on the premise that students do not carry out practical experiments, There is no specific perception of the specific experimental process, the lack of specific interaction in the experimental process, and the inability to simulate the experimental scene and experimental objects, resulting in low learning efficiency and the disadvantages of reducing students' interest in experimental teaching.
  • the present invention provides a method for implementing virtual laboratory teaching based on 3D simulation, which aims to realize For students' learning tracking, real-time feedback and virtual interaction in the experiment process, monitor the progress of each implementation task.
  • the first aspect of the present invention provides a method for implementing virtual laboratory teaching based on 3D simulation, which is characterized in that it includes:
  • Step (1) Collect and record the experimental items needed in the laboratory teaching, use all the collected experimental items to build an item library, collect all the laboratory student information, and establish an information database.
  • Step (2) Use the camera to collect the student's face image, and display the collected student's face image
  • Step (3) Segment all faces from the displayed student face image, compare the segmented faces with the data in the information database in step (1), and identify the student identity information;
  • Step (4) According to the results of the recognized face image, student identity information and item information in the item library, create the required model and establish a virtual reality laboratory scene system;
  • Step (5) Establish tasks associated with the established virtual reality laboratory scene to realize laboratory teaching, learning and testing.
  • the student's log-in identity is recorded according to the student's identity information, and the recorded student's log-in identity is uploaded to the data processing center for classified storage.
  • students use the stored log-in information to enter the virtual reality laboratory scene, select associated tasks, start the learning mode for experimental learning and laboratory teaching and testing.
  • the laboratory student information includes student information, laboratory courses corresponding to each student, and experimental course tasks corresponding to the students, and the information corresponding to the above students is uploaded to the data processing center, and the data processing center can Communicate with the created virtual reality lab system that can retrieve all lab student information.
  • the virtual reality laboratory performs the experimental teaching task, calls the experimental item model used in the experimental teaching task according to the established model, and transfers the experimental item models according to the experiment itself. Processes are associated to realize the entire process of a certain experimental teaching and complete the virtual reality experimental teaching task.
  • the face data is collected by the camera, and the image of the face is segmented by image segmentation, the key point information with the segmented face area in the image is calculated and extracted, and the face to be segmented is delineated according to the key point information In the edge area, determine the semantic prior layer information corresponding to the face area to be segmented, and input the semantic prior layer information and the face image into the pre-trained network model to obtain the segmentation result;
  • the process of comparing is: comparing the segmented face with the identity information in the student information in the database to determine the identity of the student.
  • the second aspect of the present invention provides a system for realizing virtual laboratory teaching based on 3D simulation, which is characterized in that it includes:
  • the data processing center realizes the storage and processing of all information, which includes PCs to display student information and feedback information;
  • the image face segmentation module realizes the segmentation and extraction of the face from the face image
  • the calculation module realizes the calculation and extraction of the key point information with the segmented face area in the image.
  • a third aspect of the present invention provides a computer readable storage medium.
  • a kind of computer-readable storage medium is stored with computer program on it, is characterized in that, when this program is executed by processor, realizes the step in the described a kind of teaching implementation method based on 3D simulation virtual laboratory.
  • a fourth aspect of the present invention provides a computer device.
  • a computer device comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor implements a virtual laboratory teaching based on 3D simulation when executing the program steps in the method.
  • Fig. 1 is the flow chart that the laboratory teaching method of the present invention realizes
  • each block in a flowchart or a block diagram may represent a module, a program segment, or a part of a code
  • the module, a program segment, or a part of a code may include one or more An executable instruction for a specified logical function.
  • the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block in the flowchart and/or block diagrams, and combinations of blocks in the flowchart and/or block diagrams can be implemented using a dedicated hardware-based system that performs the specified functions or operations , or can be implemented using a combination of dedicated hardware and computer instructions.
  • this embodiment provides a method for implementing virtual laboratory teaching based on 3D simulation.
  • the method is applied to a server for illustration. It can be understood that this method can also be applied to a terminal. It can be applied to a terminal, a server and a system, and is realized through the interaction between the terminal and the server.
  • the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or it can provide cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network servers, cloud communications, intermediate Cloud servers for basic cloud computing services such as software services, domain name services, security service CDN, and big data and artificial intelligence platforms.
  • the terminal may be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, etc., but is not limited thereto.
  • the terminal and the server may be connected directly or indirectly through wired or wireless communication, which is not limited in this application.
  • the method includes the following steps:
  • a method for realizing virtual laboratory teaching based on 3D simulation comprising:
  • Step (1) Collect and record the experimental items needed in the laboratory teaching, use all the collected experimental items to build an item library, collect all the laboratory student information, and establish an information database.
  • Step (2) Use the camera to collect the student's face image, and display the collected student's face image
  • Step (3) Segment all faces from the displayed student face image, compare the segmented faces with the data in the information database in step (1), and identify the student identity information;
  • Step (4) According to the results of the recognized face image, student identity information and item information in the item library, create the required model and establish a virtual reality laboratory scene system;
  • Step (5) Establish tasks associated with the established virtual reality laboratory scene to realize laboratory teaching, learning and testing.
  • Step (1) Collect and record the experimental items needed in the laboratory teaching, use all the collected experimental items to build an item library, collect all the laboratory student information, and establish an information database.
  • the collection of experimental items required in laboratory teaching mainly refers to the items used in a certain simulation experiment project, which may be chemical reagents and various models in physical experiments. Collect and build an item library of all items, which are used to build item models in the virtual reality laboratory, and are used to create the entire laboratory virtual reality scene.
  • collecting all laboratory student information mainly refers to the student information of students who need to log in to study in a certain experimental teaching task, and store it, which can be used for identity verification, tracking student learning process, and learning Manage the students, including the courses of the students' learning experiments, the class time, and the corresponding curriculum, which are used to realize the statistics of the students' class realization and track and monitor the students' learning process.
  • the student's log-in identity is recorded according to the student's identity information, and the recorded student's log-in identity is uploaded to the data processing center for classified storage.
  • This role is to obtain more realistic student information, so as to maximize the mapping of real students' learning in the laboratory, that is, to construct virtual characters and scenes that are closest to students and laboratory tasks in the virtual environment.
  • Step (2) Use the camera to collect the student's face image, and display the collected student's face image
  • Step (3) Segment all faces from the displayed student face image, compare the segmented faces with the data in the information database in step (1), and identify the student identity information;
  • the specific face segmentation and comparison process includes:
  • the face data is collected by the camera, and the image of the face is segmented by image segmentation, the key point information with the segmented face area in the image is calculated and extracted, and the face to be segmented is delineated according to the key point information In the edge area, determine the semantic prior layer information corresponding to the face area to be segmented, and input the semantic prior layer information and the face image into the pre-trained network model to obtain the segmentation result;
  • the process of comparing is: comparing the segmented face with the identity information in the student information in the database to determine the identity of the student.
  • the trained network model obtains the segmentation results corresponding to each segmentation object.
  • the semantic prior layer information representing the edge of the face area to be segmented is also input, and the semantic prior layer information is passed through the semantic prior layer
  • the information can limit the edge of the segmented face area, avoid wrong segmentation, and improve the accuracy of segmentation.
  • Step (4) According to the results of the recognized face image, student identity information and item information in the item library, create the required model and establish a virtual reality laboratory scene system;
  • the virtual reality laboratory scene includes the completed virtual scene, including the items needed for the experiment, the experimental process, and the function of the virtual reality scene module is to select the item model for the experiment in the laboratory virtual item library.
  • the student information Select the characters in the system to construct the scene required by the system.
  • This scene is a complete scene, including laboratories, objects and virtual students.
  • Step (5) Establish tasks associated with the established virtual reality laboratory scene to realize laboratory teaching, learning and testing.
  • the test includes the managers who conduct the test.
  • the managers can use their own real data to map to the virtual reality laboratory scene to use their own real information, or use the roles assigned by the system.
  • Managers connect to the system through virtual reality devices, including virtual reality headsets, bipedal motion controllers and other virtual reality devices, so that testers can control their characters in the virtual reality world and operate freely in the virtual reality scene. And interact with everything in the scene in virtual reality. Then managers can conduct tests according to the experimental plan prepared in advance. There can be many or few managers. Due to the limitation of the virtual reality laboratory scene, managers can choose only the current test personnel in the whole scenario. In the case of many testers, you can choose to add student avatars to the system, and let the system simulate and control other virtual people in the scene, or without the participation of testers, the virtual scene only includes virtual students controlled by the system for immersive experimental experience.
  • students use the stored log-on information to enter the virtual reality laboratory scene, select associated tasks, start the learning mode for experimental learning and laboratory teaching and testing.
  • the laboratory student information includes student information, laboratory courses corresponding to each student, and experimental course tasks corresponding to the students, and the information corresponding to the above students is uploaded to the data processing center, and the data processing center can Communicate with the created virtual reality lab system that can retrieve all lab student information.
  • the virtual reality laboratory performs the experimental teaching task, calls the experimental item model used in the experimental teaching task according to the established model, and transfers the experimental item models according to the flow of the experiment itself. Associated, so as to realize the entire process of a certain experimental teaching, and complete the experimental teaching task of the virtual reality.
  • the task when an error occurs in the task execution selection established by the association, the task will be removed from the task queue without any processing. When the task ends in this cycle and enters the next cycle, it will re-enter the task queue in the scanning phase. To prevent the infinite loop of error tasks, the same task will not enter the task queue when the same error type reaches 3 times, and it will only enter the task queue after the administrator executes and fixes this type of error. During this period, the individual operations on the teacher's monitoring page will not be affected. In order to avoid entering the "fake death" state due to unexpected factors during execution, every time a new script is triggered by a scheduled task, it will first check whether the task being executed has timed out, and the timeout is limited to 10 minutes. If the task times out, it will be executed Resets the task queue operation; if the task has not timed out, the completion check does nothing.
  • This embodiment provides a system for realizing teaching in a virtual laboratory based on 3D simulation, including:
  • the data processing center realizes the storage and processing of all information, which includes PCs to display student information and feedback information;
  • the image face segmentation module realizes the segmentation and extraction of the face from the face image
  • the calculation module realizes the calculation and extraction of the key point information with the segmented face area in the image.
  • Step (1) Collect and record the experimental items needed in the laboratory teaching, use all the collected experimental items to build an item library, collect all the laboratory student information, and establish an information database.
  • Step (2) Use the camera to collect the student's face image, and display the collected student's face image
  • Step (3) Segment all faces from the displayed student face image, compare the segmented faces with the data in the information database in step (1), and identify the student identity information;
  • Step (4) According to the results of the recognized face image, student identity information and item information in the item library, create the required model and establish a virtual reality laboratory scene system;
  • Step (5) Establish tasks associated with the established virtual reality laboratory scene to realize laboratory teaching, learning and testing.
  • This embodiment provides a computer-readable storage medium and a computer device, on which a computer program is stored, which is characterized in that, when the program is executed by a processor, a 3D simulation-based Steps in the implementation of virtual laboratory teaching.
  • a computer device including a memory, a processor, and a computer program stored in the memory and operable on the processor, wherein the processor implements one of the above-mentioned embodiment 1 when executing the program. Based on the 3D simulation virtual laboratory teaching to realize the steps in the method.
  • the beneficial effect of the present invention is that, by using cloud computing technology and virtual reality simulation, system resources are integrated, online testing of students can be easily realized and experimental tracks can be generated, and at the same time, teachers can also evaluate the experimental results in real time, and students can realize the experimental tasks Through immersion learning and experience, teachers and students have a more realistic and diverse teaching environment to realize the leap from mastering knowledge to applying knowledge.
  • the above-mentioned acquisition and preprocessing module, input data set building module, output data set building module, model training module and inversion module correspond to steps S101 to S105 in Embodiment 1, and the above-mentioned modules correspond to the corresponding
  • the examples and application scenarios implemented by the steps are the same, but are not limited to the content disclosed in the first embodiment above.
  • the above-mentioned modules can be executed in a computer system such as a set of computer-executable instructions.
  • the embodiments of the present invention may be provided as methods, systems, or computer program products. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) having computer-usable program code embodied therein.
  • a computer-usable storage media including but not limited to disk storage and optical storage, etc.
  • These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions
  • the device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random AccessMemory, RAM), etc.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

L'invention concerne un procédé et un système de mise en œuvre d'enseignement virtuel en laboratoire fondés sur la simulation 3D. Un système de laboratoire de réalité virtuelle intégré est utilisé ; un système d'expérience virtualisée et un mode de calcul en nuage sont utilisés ; un modèle virtuel de scène est construit en recueillant des articles requis par une tâche d'enseignement expérimentale ; une tâche d'expérience associée est établie dans une scène de laboratoire de réalité virtuelle ; et une simulation de scène est réalisée par une sélection de connexion effectuée par un étudiant, de telle sorte que le suivi et la rétroaction en temps réel de l'apprentissage pour l'étudiant ainsi que l'interaction virtuelle pendant un processus d'expérience sont obtenus, et le processus de chaque tâche de mise en œuvre est surveillé.
PCT/CN2021/135495 2021-12-03 2021-12-03 Procédé et système de mise en œuvre d'enseignement virtuel en laboratoire fondés sur la simulation 3d, et support et dispositif WO2023097684A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/135495 WO2023097684A1 (fr) 2021-12-03 2021-12-03 Procédé et système de mise en œuvre d'enseignement virtuel en laboratoire fondés sur la simulation 3d, et support et dispositif

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/135495 WO2023097684A1 (fr) 2021-12-03 2021-12-03 Procédé et système de mise en œuvre d'enseignement virtuel en laboratoire fondés sur la simulation 3d, et support et dispositif

Publications (1)

Publication Number Publication Date
WO2023097684A1 true WO2023097684A1 (fr) 2023-06-08

Family

ID=86611365

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/135495 WO2023097684A1 (fr) 2021-12-03 2021-12-03 Procédé et système de mise en œuvre d'enseignement virtuel en laboratoire fondés sur la simulation 3d, et support et dispositif

Country Status (1)

Country Link
WO (1) WO2023097684A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117130488A (zh) * 2023-10-24 2023-11-28 江西格如灵科技股份有限公司 基于vr场景的训练考核方法、装置、计算机设备及介质

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101763753A (zh) * 2009-12-29 2010-06-30 广东中大讯通软件科技有限公司 实现面向数字家庭的现代远程互动教育服务的方法及系统
CN102945313A (zh) * 2012-10-18 2013-02-27 北京航空航天大学 一种开放式虚拟实验教学内容构建与展示方法
KR20130057201A (ko) * 2011-11-23 2013-05-31 두산동아 주식회사 복수의 사용자 단말을 이용한 가상 실험 시스템 및 그 방법
CN104517489A (zh) * 2013-09-28 2015-04-15 南京专创知识产权服务有限公司 教学用虚拟实验台
CN105336233A (zh) * 2015-11-24 2016-02-17 华中科技大学 一种虚拟仿真教学应用平台
CN108399809A (zh) * 2018-03-26 2018-08-14 滨州职业学院 虚拟教学系统、云平台管理系统和处理终端管理系统
CN110879945A (zh) * 2018-09-05 2020-03-13 武汉朗立创科技有限公司 基于人工智能和虚拟现实的虚拟现实实验室系统
CN110956562A (zh) * 2019-11-28 2020-04-03 北京国发曼英智能科技有限公司 一种基础医学虚拟仿真综合实验平台

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101763753A (zh) * 2009-12-29 2010-06-30 广东中大讯通软件科技有限公司 实现面向数字家庭的现代远程互动教育服务的方法及系统
KR20130057201A (ko) * 2011-11-23 2013-05-31 두산동아 주식회사 복수의 사용자 단말을 이용한 가상 실험 시스템 및 그 방법
CN102945313A (zh) * 2012-10-18 2013-02-27 北京航空航天大学 一种开放式虚拟实验教学内容构建与展示方法
CN104517489A (zh) * 2013-09-28 2015-04-15 南京专创知识产权服务有限公司 教学用虚拟实验台
CN105336233A (zh) * 2015-11-24 2016-02-17 华中科技大学 一种虚拟仿真教学应用平台
CN108399809A (zh) * 2018-03-26 2018-08-14 滨州职业学院 虚拟教学系统、云平台管理系统和处理终端管理系统
CN110879945A (zh) * 2018-09-05 2020-03-13 武汉朗立创科技有限公司 基于人工智能和虚拟现实的虚拟现实实验室系统
CN110956562A (zh) * 2019-11-28 2020-04-03 北京国发曼英智能科技有限公司 一种基础医学虚拟仿真综合实验平台

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117130488A (zh) * 2023-10-24 2023-11-28 江西格如灵科技股份有限公司 基于vr场景的训练考核方法、装置、计算机设备及介质

Similar Documents

Publication Publication Date Title
Manikandan et al. Intelligent and deep learning approach OT measure E-learning content in online distance education
Bliemel Lessons learned from an inside-out flip in entrepreneurship education
CN106297445A (zh) 一种基于大数据的移动学习系统
CN112396886A (zh) 一种基于5g技术的虚拟现实智慧教学云平台
CN109377802A (zh) 一种自动交互式智能教育系统及方法
Cervera et al. The robot programming network
CN109544028A (zh) 基于用户空间的个性化教学数据分析方法及系统
WO2023097684A1 (fr) Procédé et système de mise en œuvre d'enseignement virtuel en laboratoire fondés sur la simulation 3d, et support et dispositif
Škrinárová et al. Model of education and training strategy for the high performance computing
CN117252734A (zh) 一种基于数字孪生的教学系统及其应用方法
CN114399804A (zh) 一种基于3d模拟虚拟实验室教学实现方法、系统、介质及设备
Yu et al. Virtual experiment method for MOOCs to solve abstract key notes and difficult points
CN110580830A (zh) 以数字可视化虚拟现实技术应用于跨学科学习的教学系统
Yanyan Construction of a Smart Classroom for Image Processing Courses in Colleges and Universities Based on Artificial Intelligence: Taking Fundamentals of Photoshop as an Example
Purawat et al. Biomedical big data training collaborative (BBDTC): an effort to bridge the talent gap in biomedical science and research
Tu et al. Building a learning games network in cloud learning platform based on immigrant education
Velev et al. Challenges of metaverse in education digitalization
Bundovski et al. Micro Assessment SaaS cloud solution
Tanaiutchawoot The Metaverse Design and Evaluation in Product Design and Development
Lin et al. Research on the Teaching Reform of Virtual Simulation Experiment of Tourism Management Major under the Background of Big Data
Sun et al. Data Model Building for Online Teachers' Professional Development
Zhang et al. Design of Hybrid Learning Mode in Higher Vocational Colleges Based on Cloud Platform
Xiong Development of VR Teaching System for Engine Dis-assembly
Xiangyan Application study of modern educational technology under cloud computing platform
Liu The design of college ideological and political teaching system based on online and offline mixed mode

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21966110

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE