CN112509401A - Remote real-practice teaching method and system based on augmented reality projection interaction - Google Patents

Remote real-practice teaching method and system based on augmented reality projection interaction Download PDF

Info

Publication number
CN112509401A
CN112509401A CN202011519952.6A CN202011519952A CN112509401A CN 112509401 A CN112509401 A CN 112509401A CN 202011519952 A CN202011519952 A CN 202011519952A CN 112509401 A CN112509401 A CN 112509401A
Authority
CN
China
Prior art keywords
teacher
remote
practical
student
teaching
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011519952.6A
Other languages
Chinese (zh)
Inventor
查娟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Institute of Mechanical and Electrical Engineering Co Ltd
Original Assignee
Zhejiang Institute of Mechanical and Electrical Engineering Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Institute of Mechanical and Electrical Engineering Co Ltd filed Critical Zhejiang Institute of Mechanical and Electrical Engineering Co Ltd
Priority to CN202011519952.6A priority Critical patent/CN112509401A/en
Publication of CN112509401A publication Critical patent/CN112509401A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/08Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

本发明公开了一种基于增强现实投影交互的远程实操教学方法与系统,该发明使教师可以远程在线地观看学生的实操过程,并随时通过语音和图形交互等方式对学生进行在线指导,学生端通过投影机将实时绘制的指引信息投影至学生的实操区域,使学生可以直观地观测到增强现实的指引内容,更准确高效地理解教师的意图,大大提高远程实操教学的学习效率。本发明提出了一种新的远程实操教学的辅导方式,系统构成简单,易于搭建,师生操作直观高效,为原本难以实现的远程实操教学提供了解决方法。

Figure 202011519952

The invention discloses a remote practical operation teaching method and system based on augmented reality projection interaction. The invention enables teachers to remotely watch students' practical operation process online, and provide online guidance to students through voice and graphic interaction at any time. The student end projects the real-time drawing guidance information to the students' practical area through the projector, so that the students can intuitively observe the guidance content of augmented reality, understand the teacher's intention more accurately and efficiently, and greatly improve the learning efficiency of remote practical teaching. . The invention proposes a new tutoring method for remote practical operation teaching, the system is simple in structure, easy to build, intuitive and efficient in operation by teachers and students, and provides a solution for remote practical operation teaching that was originally difficult to achieve.

Figure 202011519952

Description

Remote real-practice teaching method and system based on augmented reality projection interaction
Technical Field
The invention relates to the technical field of digital teaching, in particular to a remote real-practice teaching method and system based on augmented reality projection interaction.
Background
With the development of the digital era and the influence of uncertain factors such as epidemic situation management and control, a remote teaching mode has become one of important teaching means. The existing remote teaching is mainly carried out in the modes of electronic courseware, video, live broadcast and the like, and the teaching is basically carried out in the mode of taking students as watchers. The teaching of this kind of mode can only observe through the plane display device at present, is difficult to combine together with actual operation, lacks the operation tutor of intuitionistic, is difficult to support the numerous real behaviour teaching of components and parts, operation flow complicacy. The practice courses are important education forms indispensable to professional education, and the improvement of the teaching ability and the learning efficiency of remote practice teaching is of great significance.
Augmented Reality (AR) is a technology for seamlessly fusing virtual information in an actual scene, and can provide immersive teaching guidance for real-practice teaching. The existing AR/VR-based practice teaching is basically customized based on fixed courses and teaching flows, a great deal of effort is needed to make model animations and design interactive processes, and a lot of teachers without relevant animation design experience cannot make AR/VR digital teaching plans at all, so that the system is difficult to effectively popularize and apply. The remote teaching system and the teaching method (202010205746.1) based on the augmented reality technology, which are applied by Ling-Zao et al, adopt AR glasses to simulate classroom teaching and record the learning condition of students. Such glasses-based AR systems cause great inconvenience to students who wear glasses themselves and may cause adverse effects such as dizziness. In summary, the current remote teaching technology cannot support remote practice teaching well due to insufficient immersion, while the current augmented reality teaching mode needs a lot of effort to make teaching plans on one hand, and is not beneficial to wearing and using on the other hand, and the usability is insufficient.
Disclosure of Invention
The invention aims to provide a remote real-practice teaching method and system based on augmented reality projection interaction, and aims to solve the problem that the conventional remote real-practice teaching method is difficult to provide an intuitive, easy-to-use and convenient teaching mode.
In order to achieve the purpose, the technical scheme adopted by the invention is as follows:
in a first aspect, an embodiment of the present invention provides a remote real-practice teaching method based on augmented reality projection interaction, including the following steps:
step (1), erecting a projector and a camera in a student real-operation environment at a student end, and calculating a relative position relation between a projection coordinate system and a camera coordinate system, wherein the method specifically comprises the following substeps:
step (1.1), adjusting the positions of a projector and a camera according to the actual operation environment of students, so that a projection area and a video shooting area are overlapped and cover the actual operation area;
step (1.2), after the position of a projector and a camera are fixed, the projector projects a preset image I to an actual operation area;
step (1.3), acquiring a scene picture containing the projected image I through a camera, and recording the scene picture as an image F;
step (1.4), calculating a transformation relation matrix H between the images I and F to obtain the relative position relation between a projection coordinate system and a camera coordinate system;
step (2), remote communication between the student end and the teacher end is established through the server;
step (3), after the remote communication is established, the pictures of the real exercise area and the voices of the students are sent to the teacher end in real time through the student end;
step (4), after receiving the picture of the real exercise area, the teacher displays the real exercise environment observed by the student terminal, and the teacher directly adds virtualized guidance information in the area of interest in the displayed real exercise environment; the teacher end simultaneously sends the voice and the interactive guidance information of the teacher to the student end in real time;
and (5) after receiving the virtualized guidance information of the teacher, the student converts the position of the guidance information from a camera observation picture coordinate system to a projection picture coordinate system by transforming a relation matrix H, and projects the position to the real operation area by a projector.
Further, still include:
and (6) recording all video, audio and interactive guidance information data transmitted in the remote teaching at the same time when the server end completes the communication between the student end and the teacher end, and storing the video, audio and interactive guidance information data into a database for data playback and teaching evaluation after the course is finished.
Further, still include:
and (7) repeating the steps (3) to (6) to form a closed loop in the remote teaching process until the course is finished or any party is disconnected.
In a second aspect, an embodiment of the present invention provides a remote real-practice teaching system based on augmented reality projection interaction, where the system is configured to execute the remote real-practice teaching method based on augmented reality projection interaction in the first aspect, and the system includes:
a teacher end, the teacher end comprising: the system comprises a display module for displaying the student end actual operation process, an interaction module for teachers to conduct interaction guidance, a first data acquisition module for acquiring the teacher to conduct the interaction guidance process, and a first network communication module for remotely receiving and sending data, wherein the interaction module conducts interaction based on the student end actual operation process provided by the display module, teachers directly conduct interaction in displayed actual operation pictures, and interaction guidance information is provided at any position specified by the teachers;
a student end, the student end comprising: the system comprises a first data acquisition module, a projection display module, a first network communication module and a processing module, wherein the first data acquisition module is used for acquiring the real-time operation process of students, the projection display module is used for projecting the interaction guide information of teachers in an augmented reality mode in a real-time operation environment, the first network communication module is used for remotely receiving and sending data, and the processing module is used for calculating the relative position relation between a projection coordinate system and a camera coordinate system; the processing module enables the guide information of the teacher to be accurately projected to a position appointed by the teacher during interaction, and fusion of virtual information and a real operation environment is formed;
a server side, the server side comprising: the server is used for realizing remote connection and data transmission between the first network communication module and the second network communication module, and the database is used for storing communication data.
Furthermore, the first data acquisition module at least comprises audio acquisition and interactive acquisition, acquires real-time voice and interactive guidance information of a teacher, and sends the real-time voice and interactive guidance information through the first network communication module.
Furthermore, the second data acquisition module at least comprises audio acquisition and video acquisition, acquires real-time voice of students and monitoring video of an actual operation area, and sends the real-time voice and the monitoring video through the second network communication module.
According to the technical scheme, the method has the advantages that a teacher can visually give remote guidance information in a real exercise area of a student, so that a complex multimedia teaching plan design is avoided, the teacher can quickly master a use method and develop teaching, visual, convenient and cheap projection type augmented reality real exercise teaching experience is provided for the student, and the problems of narrow vision field, dizziness, glasses overlapping and the like caused by using an intelligent helmet and other similar devices are avoided while the student quickly understands the guidance of the teacher. The invention is simple, easy to use and visual, and provides a new solution for remote practice teaching.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:
fig. 1 is a schematic structural diagram of a remote real-practice teaching system based on augmented reality projection interaction according to this embodiment;
fig. 2 is a flowchart of a remote real-practice teaching method based on augmented reality projection interaction according to this embodiment;
fig. 3 is a schematic diagram of the spatial relationship between multiple areas of the student end in this embodiment.
Fig. 4 is a schematic view of a projection teaching mode actually observed by the student end in this embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Example 1:
referring to fig. 1, the present embodiment provides a remote real-practice teaching system based on augmented reality projection interaction, which includes:
teacher 001, comprising: the system comprises a display module for displaying the student end actual operation process, an interaction module for teachers to conduct interaction guidance, a first data acquisition module for acquiring the teacher to conduct the interaction guidance process, and a first network communication module for remotely receiving and sending data, wherein the interaction module conducts interaction based on the student end actual operation process provided by the display module, teachers directly conduct interaction in displayed actual operation pictures, and interaction guidance information is provided at any position specified by the teachers;
specifically, the teacher end is composed of a notebook computer, a display screen of the notebook computer is a display module, a keyboard, a mouse and a touch pad of the notebook computer are interaction modules, a computer program and a sound card for recording man-machine interaction operation and teaching voice of the teacher are first data acquisition modules, and a wireless network card is a first network communication module;
a student end 003 comprising: the system comprises a first data acquisition module, a projection display module, a first network communication module and a processing module, wherein the first data acquisition module is used for acquiring the real-time operation process of students, the projection display module is used for projecting the interaction guide information of teachers in an augmented reality mode in a real-time operation environment, the first network communication module is used for remotely receiving and sending data, and the processing module is used for calculating the relative position relation between a projection coordinate system and a camera coordinate system; the processing module enables the guide information of the teacher to be accurately projected to a position appointed by the teacher during interaction, and fusion of virtual information and a real operation environment is formed;
specifically, the student end comprises a projector, a camera, a bracket for fixing the projector and the camera, and a notebook computer. The camera connected with the notebook computer and the video and audio acquisition software in the notebook computer are second data acquisition modules, the projector connected with the notebook computer and the projection control software in the notebook computer are projection display modules, and the wireless network card carried by the notebook computer is a second network communication module; the processor of the notebook computer is used as a processing module.
The server 005 includes: the server is used for realizing remote connection and data transmission between the first network communication module and the second network communication module, and the database is used for storing communication data;
specifically, in this embodiment, the server is directly hung on the teacher end, and the notebook computer of the teacher end also serves as the server, directly communicates with the student end, and stores the communication data in the local database.
Example 2:
referring to fig. 2, the present embodiment provides a remote real-practice teaching method based on augmented reality projection interaction, where the method includes the following steps:
a projection correction step S101, namely erecting a projector and a camera in the student real operation environment at the student end, and calculating the relative position relation between a projection coordinate system and a camera coordinate system, and specifically comprising the following substeps:
1.1 adjusting the positions of the projector 301 and the camera 303 according to the environment of the student in actual operation and fixing the projector 301 and the camera 303 through the bracket 305, so that the projection area 311 and the video shooting area 313 are basically overlapped and cover the real operation area 315, and the space relationship among the projector 301, the camera 303 and the real operation area 315 is shown in fig. 3;
1.2 after fixing the position of the projector and the camera by using a bracket and other equipment, the projector projects a preset image I to an actual operation area, wherein in the example, a picture (marked as the image I) with a official website two-dimensional code of Zhejiang electromechanical occupational technology institute is projected by a notebook computer at a student end;
1.3, acquiring a scene picture containing the two-dimensional code pattern through a camera, namely acquiring an image containing a Zhejiang electromechanical technical institute official website two-dimensional code and recording the image as an image F;
1.4 identifying and extracting three positioning graphs and a correction graph of the two-dimensional code in the image I and the image F by adopting an algorithm of an OpenCV software library, calculating the coordinate positions of the central points of the four frame-shaped graphs in the image I and the image F respectively, determining the clockwise sequence of the four central points by judging the left and right regions of a diagonal line, and then calculating the two groups of point sets by adopting a homography solving method provided by OpenCV to obtain a transformation relation matrix H between the image I and the image F, namely a coordinate system position transformation relation between a projection picture and a camera observation picture. And finally, storing the transformation relation matrix H into a file form for subsequent calling.
The projection correction step is the preprocessing and preparation of the subsequent steps, on one hand, the spatial relation between the devices is fixed, and on the other hand, the spatial synchronization of the monitoring picture and the projection picture is realized, namely, the deviation between the projection area and the shooting area shown in the figure 3 is compensated through calculation, so that the guide information of the teacher can be accurately projected to the corresponding position, and the function of augmented reality is completed.
Therefore, the design of the invention has the advantages that the requirement on the fixed position of the equipment can be reduced, and the camera and the projector do not need to be conjugate and coaxial or have strict relative position and posture, so that the usability of the equipment at the student end is enhanced during deployment, and the equipment can be quickly built without professionals. On the other hand, the invention corrects the parallax by the software compensation mode of the projector self-projection, and does not need to use additional solid markers such as cards, stickers and the like, thereby automating the correction process and being more beneficial to the rapid configuration and use of the system.
And a communication establishing step S103, establishing network communication between the teacher end and the student end through the server, and realizing bidirectional data receiving and sending between the first network communication module and the second network communication module.
Specifically, in this embodiment, the teacher-side computer also serves as a server, and four threads are respectively started at the teacher side and the student side to respectively serve as a video sending service, an audio sending service, a video receiving service, and an audio receiving service. And the audio and video are bound with IP by Socket, and the networking is monitored and completed. Firstly, a teacher end starts a remote IP connection application of audio and video sending service, if the audio and video sending service is normally connected, audio and video acquisition information transmission is started, and if the audio and video sending service cannot be normally connected, the teacher end waits for 3 seconds to continuously try connection until the audio and video sending service is normally connected. If the connection cannot be normally performed, the remote connection operation can be finished by forced quitting. And after the teacher end completes the connection of the audio and video sending service, waiting for the connection application of the student end to the local receiving service. The student end also starts four threads, and the operation steps are consistent with those of the teacher end.
And a data acquisition step S105, acquiring and sending data at the student side. After the remote communication between the student end and the teacher end is established, the student end starts video and voice acquisition and sends the pictures of the real exercise area and the voices of the students to the teacher end in real time.
Specifically, the student side starts video and voice acquisition through software libraries such as OpenCV and pyAudio, and sends real-time audio and video contents to the teacher side.
And an interactive guidance step S107, wherein the teacher displays, interactively guides and transmits. After receiving the real-time operation picture, the teacher end displays the real-time operation environment observed by the student end camera in a 2D or 3D mode through the display module, so that the teacher can directly add virtualized guidance information to the region of interest through the interaction module in the displayed real-time operation environment; and the teacher end simultaneously starts voice acquisition and interactive acquisition and sends the voice and interactive guidance information of the teacher to the student end in real time.
Specifically, after receiving the real-time real operation picture sent by the student, the teacher opens a screen window through the OpenCV software library to display the real operation picture observed by the camera. When the teacher conducts interactive guidance, the teacher directly uses the mouse to draw interactive contents on an observed real operation picture, records the moving track of a mouse cursor through the OpenCV software library, marks track points in red and displays the track points in the real operation picture. In the process of drawing by the teacher, all red track points are independently extracted into an image R, the image is consistent with the observed real operation picture in size, and the image R is sent to the student side. Meanwhile, the teacher can conduct interactive guidance through voice at any time and send the interactive guidance to the student end through the network.
The step design has the advantages that teachers can visually mark observed real operation pictures without designing multimedia materials or animation conversion tools in advance, and therefore usability is greatly improved.
And a projection display step S109, wherein the student side performs projection display. After receiving the virtual guide information of the teacher end, the student end converts the position of the guide information from a camera observation picture coordinate system to a projection picture coordinate system by transforming a relation matrix H, and projects the guide information to an actual operation area through a projector, so that virtual and actual registration of the virtual guide information and a real actual operation environment is realized, the interactive guide information of the teacher is accurately projected to an area of interest originally observed by the teacher, and the remote actual operation teaching based on augmented reality is completed.
Specifically, the student side receives a guide image R and interactive voice sent by the teacher side through the second network communication module, converts the image R based on the camera coordinate system into an image under a projection coordinate system through a perspective transformation function and a transformation relation matrix H of the OpenCV software library while playing the voice, and projects the image R to the real operation area through the projector to realize virtual and real registration of virtual guide information and a real operation environment.
Fig. 4 shows the projection teaching contents actually observed by the student side, the teacher draws a triangle around the device to be operated through the teacher side interface, and draws an X at the position where the device should be placed, so that the student side can intuitively and accurately observe the prompt of the teacher at the same position and improve the teaching efficiency in cooperation with the guidance of voice.
The step design has the advantages that the interactive guide information of the teacher can be accurately projected to the remote interactive position of the teacher in real time through the method, so that students can intuitively and accurately understand the intention of the teacher, the remote real-time practice teaching based on the augmented reality is realized, and the teaching quality and the teaching efficiency are improved.
Server data management step S111. And the server side records all data such as video, audio, interactive guidance information and the like transmitted in the remote teaching while finishing the communication between the student side and the teacher side, and stores the data in a database for data playback and teaching evaluation after the course is finished.
Specifically, in this embodiment, the server is built at the teacher end, and the data management is also completed at the teacher end. And the server side records all data such as video, audio, interactive guidance information and the like transmitted in the remote teaching while finishing the communication between the student side and the teacher side, and stores the data in a database for data playback and teaching evaluation after the course is finished.
And circularly executing the steps. And repeating the steps S105 to S111 to form a closed loop of the remote teaching process until the course is finished or any party is disconnected.
Specifically, the closed loop real-time execution of steps S105 to S111 is repeated, so that the information of the teachers and the students can be exchanged in real time, and the remote lecture is realized. If the course is finished or one party exits the course, the connection is disconnected.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (6)

1.一种基于增强现实投影交互的远程实操教学方法,其特征在于,包括如下步骤:1. a remote practical teaching method based on augmented reality projection interaction, is characterized in that, comprises the steps: 步骤(1),在学生端的学生实操环境中架设投影机和相机,并计算投影坐标系与相机坐标系的相对位置关系,具体包括如下子步骤:Step (1), set up a projector and a camera in the student's practical operation environment on the student side, and calculate the relative positional relationship between the projection coordinate system and the camera coordinate system, which specifically includes the following sub-steps: 步骤(1.1),根据学生实际操作的环境调整投影机和相机的位置,使投影区域和视频拍摄区域重叠并覆盖实操区域;Step (1.1), adjust the position of the projector and camera according to the actual operating environment of the students, so that the projection area and the video shooting area overlap and cover the practical area; 步骤(1.2),在投影机和相机位置固定后,投影机投影预定的图像I至实操区域;Step (1.2), after the position of the projector and the camera is fixed, the projector projects the predetermined image I to the practical area; 步骤(1.3),通过相机采集包含投影后的图像I的场景画面,记作图像F;In step (1.3), the scene image including the projected image I is captured by the camera, and is recorded as image F; 步骤(1.4),计算图像I和F之间的变换关系矩阵H,即得投影坐标系与相机坐标系的相对位置关系;Step (1.4), calculate the transformation relationship matrix H between the images I and F, that is, the relative positional relationship between the projection coordinate system and the camera coordinate system; 步骤(2),通过服务器建立学生端与教师端之间的远程通信;Step (2), establishing long-distance communication between the student terminal and the teacher terminal through the server; 步骤(3),远程通信建立后,通过学生端将实操区域的画面和学生的语音实时发送给教师端;In step (3), after the remote communication is established, the screen of the practical operation area and the voice of the students are sent to the teacher terminal in real time through the student terminal; 步骤(4),教师端收到实操区域的画面后,对学生端相机观测到的实操环境进行显示,教师在显示的实操环境中,直接在感兴趣区域添加虚拟化的指导信息;教师端同时将教师的语音和交互指导信息实时发送给学生端;In step (4), after receiving the picture of the practical operation area, the teacher terminal displays the practical operation environment observed by the camera of the student terminal, and in the displayed practical operation environment, the teacher directly adds virtualized guidance information in the area of interest; The teacher terminal simultaneously sends the teacher's voice and interactive guidance information to the student terminal in real time; 步骤(5),学生端收到教师端的虚拟化指导信息后,通过变换关系矩阵H,将指导信息的位置从相机观测画面坐标系转化至投影画面坐标系,再通过投影机投影至实操区域。In step (5), after receiving the virtualized guidance information from the teacher, the student terminal converts the position of the guidance information from the coordinate system of the camera observation screen to the coordinate system of the projection screen by transforming the relationship matrix H, and then projects it to the practical area through the projector. . 2.根据权利要求1所述的一种基于增强现实投影交互的远程实操教学方法,其特征在于,还包括:2. a kind of remote practical teaching method based on augmented reality projection interaction according to claim 1, is characterized in that, also comprises: 步骤(6),服务器端在完成学生端和教师端通信的同时,记录下所有在本次远程教学中传输的视频、音频、交互指引信息数据,存储至数据库,以供课程结束后的数据回放和教学评价。Step (6), while the server side completes the communication between the student side and the teacher side, it records all the video, audio, and interactive guidance information data transmitted in this distance teaching, and stores it in the database for data playback after the course ends. and teaching evaluation. 3.根据权利要求2所述的一种基于增强现实投影交互的远程实操教学方法,其特征在于,还包括:3. a kind of remote practical teaching method based on augmented reality projection interaction according to claim 2, is characterized in that, also comprises: 步骤(7),重复步骤(3)至(6),形成远程教学过程的闭环,直至课程结束,或任意一方断开连接。Step (7), repeat steps (3) to (6) to form a closed loop of the distance teaching process, until the end of the course, or either party disconnects. 4.一种基于增强现实投影交互的远程实操教学系统,其特征在于,该系统用于执行权利要求1-3任一项所述的一种基于增强现实投影交互的远程实操教学方法,该系统包括:4. A remote practical teaching system based on augmented reality projection interaction, characterized in that, the system is used to execute a remote practical teaching method based on augmented reality projection interaction according to any one of claims 1-3, The system includes: 教师端,所述教师端包括:用于显示学生端实操过程的显示模块、用于教师进行交互指引的交互模块、用于采集教师进行交互指引过程的第一数据采集模块、用于数据远程接收和发送的第一网络通信模块,其中所述交互模块基于所述显示模块所提供的学生端实操过程进行交互,教师直接在显示的实操画面中进行交互,在教师指定的任意位置提供交互指引信息;The teacher's end, the teacher's end includes: a display module for displaying the actual operation process of the student's end, an interaction module for the teacher's interactive guidance, a first data acquisition module for collecting the teacher's interactive guidance process, a data remote The first network communication module for receiving and sending, wherein the interaction module interacts based on the student-side practical operation process provided by the display module, and the teacher directly interacts in the displayed practical operation screen, and provides at any position designated by the teacher. interactive guidance information; 学生端,所述学生端包括:用于采集学生实操过程的第二数据采集模块、用于将教师的交互指引信息以增强现实的方式投影在实操环境中的投影显示模块、用于数据远程接收和发送的第二网络通信模块,用于计算投影坐标系与相机坐标系的相对位置关系的处理模块;其中所述处理模块使教师的指引信息能准确投影至教师交互时所指定的位置,形成虚拟信息和实操环境的融合;The student side, the student side includes: a second data acquisition module for collecting the students' practical operation process, a projection display module for projecting the teacher's interactive guidance information in the practical operation environment in an augmented reality manner, a data acquisition module for data The second network communication module for remote reception and transmission, a processing module for calculating the relative positional relationship between the projection coordinate system and the camera coordinate system; wherein the processing module enables the teacher's guidance information to be accurately projected to the position specified by the teacher during interaction , forming a fusion of virtual information and practical environment; 服务器端,所述服务器端包括:用于实现第一网络通信模块和第二网络通信模块之间远程连接和数据传输的服务器、用于存储通信数据的数据库。The server side includes: a server for realizing remote connection and data transmission between the first network communication module and the second network communication module, and a database for storing communication data. 5.根据权利要求4所述的一种基于增强现实投影交互的远程实操教学系统,其特征在于,所述第一数据采集模块至少包括音频采集和交互采集,采集教师的实时语音和交互指引信息,通过第一网络通信模块发送。5. A kind of remote practical teaching system based on augmented reality projection interaction according to claim 4, is characterized in that, described first data acquisition module comprises at least audio frequency acquisition and interactive acquisition, collects teacher's real-time voice and interactive guidance The information is sent through the first network communication module. 6.根据权利要求4所述的一种基于增强现实投影交互的远程实操教学系统,其特征在于,所述第二数据采集模块至少包括音频采集和视频采集,采集学生的实时语音和实际操作区域的监控视频,通过第二网络通信模块发送。6. a kind of remote practical teaching system based on augmented reality projection interaction according to claim 4, is characterized in that, described second data acquisition module comprises at least audio frequency acquisition and video acquisition, collects the real-time voice and actual operation of students The surveillance video of the area is sent through the second network communication module.
CN202011519952.6A 2020-12-21 2020-12-21 Remote real-practice teaching method and system based on augmented reality projection interaction Pending CN112509401A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011519952.6A CN112509401A (en) 2020-12-21 2020-12-21 Remote real-practice teaching method and system based on augmented reality projection interaction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011519952.6A CN112509401A (en) 2020-12-21 2020-12-21 Remote real-practice teaching method and system based on augmented reality projection interaction

Publications (1)

Publication Number Publication Date
CN112509401A true CN112509401A (en) 2021-03-16

Family

ID=74922906

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011519952.6A Pending CN112509401A (en) 2020-12-21 2020-12-21 Remote real-practice teaching method and system based on augmented reality projection interaction

Country Status (1)

Country Link
CN (1) CN112509401A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113079202A (en) * 2021-03-22 2021-07-06 紫光计算机科技有限公司 Remote education information interaction method and device
CN113207008A (en) * 2021-05-08 2021-08-03 山西晓雯文化艺术发展有限公司 AR-based tele-immersive simulation classroom and control method thereof
CN113223353A (en) * 2021-04-14 2021-08-06 佛山科学技术学院 Remote real-time guiding method based on virtual experiment
IT202200012095A1 (en) * 2022-06-08 2023-12-08 Teorema S R L COMPUTERIZED LEARNING SYSTEM FOR MAKEUP, FASHION AND CINEMATOGRAPHIC
CN119445914A (en) * 2025-01-09 2025-02-14 西安交通大学城市学院 A gymnastics movement remote teaching system control method, system, device and medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103414861A (en) * 2013-08-21 2013-11-27 浙江大学 Method for self-adaptation geometric correction of projector picture
CN104952303A (en) * 2015-07-13 2015-09-30 安庆状元郎电子科技有限公司 Classroom live broadcast system
CN109274981A (en) * 2018-09-27 2019-01-25 深圳点猫科技有限公司 It is a kind of for educating the living broadcast interactive method and device of cloud platform
CN110233841A (en) * 2019-06-11 2019-09-13 上海文景信息科技有限公司 A kind of long-distance education data interaction system and method based on AR holographic glasses
CN110275987A (en) * 2019-05-09 2019-09-24 威比网络科技(上海)有限公司 Intelligent tutoring consultant generation method, system, equipment and storage medium
CN110766574A (en) * 2019-09-09 2020-02-07 北京美院帮网络科技有限公司 Remote teaching system and method
CN110889985A (en) * 2019-12-12 2020-03-17 徐州三诚教育科技有限公司 Remote learning system
CN111292579A (en) * 2020-04-08 2020-06-16 华南农业大学 Remote intelligent light and shadow interactive drawing guiding and learning device and application thereof

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103414861A (en) * 2013-08-21 2013-11-27 浙江大学 Method for self-adaptation geometric correction of projector picture
CN104952303A (en) * 2015-07-13 2015-09-30 安庆状元郎电子科技有限公司 Classroom live broadcast system
CN109274981A (en) * 2018-09-27 2019-01-25 深圳点猫科技有限公司 It is a kind of for educating the living broadcast interactive method and device of cloud platform
CN110275987A (en) * 2019-05-09 2019-09-24 威比网络科技(上海)有限公司 Intelligent tutoring consultant generation method, system, equipment and storage medium
CN110233841A (en) * 2019-06-11 2019-09-13 上海文景信息科技有限公司 A kind of long-distance education data interaction system and method based on AR holographic glasses
CN110766574A (en) * 2019-09-09 2020-02-07 北京美院帮网络科技有限公司 Remote teaching system and method
CN110889985A (en) * 2019-12-12 2020-03-17 徐州三诚教育科技有限公司 Remote learning system
CN111292579A (en) * 2020-04-08 2020-06-16 华南农业大学 Remote intelligent light and shadow interactive drawing guiding and learning device and application thereof

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113079202A (en) * 2021-03-22 2021-07-06 紫光计算机科技有限公司 Remote education information interaction method and device
CN113223353A (en) * 2021-04-14 2021-08-06 佛山科学技术学院 Remote real-time guiding method based on virtual experiment
CN113207008A (en) * 2021-05-08 2021-08-03 山西晓雯文化艺术发展有限公司 AR-based tele-immersive simulation classroom and control method thereof
IT202200012095A1 (en) * 2022-06-08 2023-12-08 Teorema S R L COMPUTERIZED LEARNING SYSTEM FOR MAKEUP, FASHION AND CINEMATOGRAPHIC
CN119445914A (en) * 2025-01-09 2025-02-14 西安交通大学城市学院 A gymnastics movement remote teaching system control method, system, device and medium

Similar Documents

Publication Publication Date Title
CN112509401A (en) Remote real-practice teaching method and system based on augmented reality projection interaction
CN110266992A (en) A kind of long-distance video interactive system and method based on augmented reality
CN110233841B (en) Remote education data interaction system and method based on AR holographic glasses
CN109887096A (en) Education and teaching information processing system and teaching method using virtual reality technology
CN107976811B (en) Virtual reality mixing-based method simulation laboratory simulation method of simulation method
CN105635669B (en) The movement comparison system and method for data and real scene shooting video are captured based on three-dimensional motion
KR101839122B1 (en) A multi-access virtual space provisioning system linked with a multi-user real space location system and a method for providing 3D virtual reality images in a multiple access virtual space
CN111240490A (en) Equipment insulation test training system based on VR virtual immersion and circular screen interaction
CN113011723A (en) Remote equipment maintenance system based on augmented reality
CN112286354A (en) Education and teaching method and system based on virtual reality
CN114402276A (en) Teaching system, viewing terminal, information processing method, and program
CN114267213B (en) Real-time demonstration method, device, equipment and storage medium for practical training
CN108594999A (en) Control method and device for panoramic picture display systems
CN110427107A (en) Virtually with real interactive teaching method and system, server, storage medium
CN111242704A (en) Method and electronic equipment for superposing live character images in real scene
CN110444061B (en) Internet of things teaching machine
CN114973812A (en) An AR-based remote real-time online teaching method and online teaching system
KR101839118B1 (en) A multi-access virtual space provisioning system linked with a multi-user real space location system
CN106060528B (en) Augmented reality method and system based on mobile phone terminal and electronic whiteboard
CN113259544B (en) Remote interactive holographic demonstration system and method
CN116402497B (en) AR-based equipment inspection and maintenance methods and systems
CN113110742A (en) AR multi-person interaction industrial robot teaching system based on SLAM positioning technology
CN110365959A (en) Projecting method, device, system and projection device
CN113315885B (en) Holographic studio and system for remote interaction
CN113507599B (en) Education cloud service platform based on big data analysis

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20210316