CN111325853A - Remote tutoring system and method based on augmented reality glasses - Google Patents
Remote tutoring system and method based on augmented reality glasses Download PDFInfo
- Publication number
- CN111325853A CN111325853A CN202010205824.8A CN202010205824A CN111325853A CN 111325853 A CN111325853 A CN 111325853A CN 202010205824 A CN202010205824 A CN 202010205824A CN 111325853 A CN111325853 A CN 111325853A
- Authority
- CN
- China
- Prior art keywords
- student
- augmented reality
- reality glasses
- teacher
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20048—Transform domain processing
- G06T2207/20061—Hough transform
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20224—Image subtraction
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The invention discloses a remote tutoring system and method based on augmented reality glasses, belonging to the technical field of digital teaching and at least comprising; the teacher end is used for collecting teaching situations of a teacher, receiving and displaying student end data; the student end is used for receiving and displaying teacher end data and collecting student attendance situations; the cloud server is used for realizing data interaction between the teacher end and the student end; the method is characterized in that: the teacher end and the student end both comprise augmented reality glasses; the augmented reality glasses of the student end are used for shooting videos at a first person visual angle and displaying videos and voice information returned from the teacher end; the augmented reality glasses of the teacher end are used for shooting videos at a first person visual angle and then sending the videos and the voice information to the student end, or playing teaching courseware and videos to the student end synchronously, or displaying the videos and the voice information returned from the student end.
Description
Technical Field
The invention belongs to the technical field of digital teaching, and particularly relates to a remote tutoring system and method based on augmented reality glasses.
Background
As is well known, the traditional classroom teaching mode has space limitation and time limitation objectively, that is, students and teachers must arrive at a specific place at a specific time to carry out teaching work, in recent years, along with the rapid development of the internet of things technology, in order to overcome the above defects of the traditional classroom teaching mode, the online teaching system comes up, and at present, the existing online teaching system mainly comprises three parts: the system comprises two information recording parts for acquiring audio and video information of teachers or students and a cloud server for transmitting data. Under the condition of 'stopping a lesson and not stopping a study' during the period of novel coronavirus pneumonia epidemic situation prevention and control and delayed start of study of the department of education, network teaching is used in a large number, and the defects of the existing network teaching system exist in the using process:
in the traditional teaching process of classroom or extraclass tutoring, a teacher usually requires a student to solve problems on a blackboard or on manuscript paper, and whether the understanding of the knowledge points of the student is clear or not is observed so as to develop the targeted teaching. However, the remote education system in the market at present mainly broadcasts or records the video of the teacher giving lessons, and the unidirectional transmission of the teaching video lacks the interaction with the students of the classroom participants, so that it is particularly difficult for the teacher to check the problem solving situation of the students remotely in real time to achieve the purpose of learning the learning degree of the students.
Disclosure of Invention
The invention provides a remote tutoring system and a remote tutoring method based on augmented reality glasses for solving the technical problems in the prior art, and the system and the method can simulate classroom teaching through the augmented reality technology and can realize that students can carry out immersive learning at home. The teacher can carry out real-time interdynamic with the student, improves interactive experience. Meanwhile, the attention of the students is detected in real time by using an eye movement tracking technology, the conditions of attention transfer and the like of the students are found in real time, and effective attention management and control are realized. By mining eye movement data of students in a certain period, the quality evaluation of courses and the psychological and hobby evaluation of the students can be carried out.
A first object of the present invention is to provide an augmented reality glasses-based remote tutoring system, comprising at least;
the teacher end is used for collecting teaching situations of a teacher, receiving and displaying student end data;
the student end is used for receiving and displaying teacher end data and collecting student attendance situations;
the cloud server is used for realizing data interaction between the teacher end and the student end; the method is characterized in that:
the teacher end and the student end both comprise augmented reality glasses;
the augmented reality glasses of the student end are used for shooting videos at a first person visual angle and displaying videos and voice information returned from the teacher end; the augmented reality glasses of the teacher end are used for shooting videos at a first person visual angle and then sending the videos and the voice information to the student end, or playing teaching courseware and videos to the student end synchronously, or displaying the videos and the voice information returned from the student end.
Further, the augmented reality glasses of student end and teacher end all carry on leading camera, and this camera is used for shooing the video at paper hand writing process, discernment student or teacher's gesture and the content variation volume of discerning writing on paper simultaneously.
Furthermore, the teacher end and the student end are provided with a micro loudspeaker and a microphone for voice interaction.
Further, the augmented reality glasses-based remote tutoring system comprises a courseware playing and/or video module, a real-time tutoring and/or a post tutoring module.
Further, the student end comprises a teaching video manual recording module.
Further, remote tutoring system based on augmented reality glasses still includes the image processing module, when carrying out the afterward tutoring, student's augmented reality glasses record student's process of solving problems, and upload to high in the clouds server storage, augmented reality glasses snatch student's video screenshot of solving problems with timing, and utilize digital image processing module discernment student at the content variation volume of writing on paper, once grab picture content and compare with the last picture content of grabbing after when grabbing, when exceeding predetermined percentage, with the next picture capture data and time stamp correlation, upload to high in the clouds server and save, replace the video mode with the picture and save.
Further, the cloud server stores the video shot in a timestamp-based video shot form.
The second purpose of the present invention is to provide a method of a remote teaching system based on the augmented reality technology, which includes the following steps:
s101, establishing a data interaction relationship between a teacher end and a student end through a cloud server;
s102, a teacher end collects teaching data of teaching situations of a teacher and sends the teaching data to a cloud server;
s103, the student side obtains data of real-time tutoring or tutoring afterwards through the cloud server, and then enters a corresponding tutoring course;
when the student selects real-time tutoring, the augmented reality glasses of the teacher end and the student end are synchronously started, and the locally acquired data are sent to the other side; the two parties can read the data of the other party in real time through the augmented reality glasses;
when the student chooses to tutor afterwards, student's augmented reality glasses record student's process of solving problems, and upload to high in the clouds server storage, augmented reality glasses are in order regularly to snatch student's video screenshot of solving problems, and utilize digital image processing module discernment student's content variation volume of writing on paper, compare with the last content of grabbing the picture when the picture content of grabbing of the back, when exceeding preset percentage, associate the last screenshot data with the time stamp, upload to high in the clouds server and save, replace the video mode with the picture and save.
Further, the specific process of the digital image processing module for identifying the content change amount written on the paper by the student comprises the following steps:
s201, capturing a picture at regular time;
s202, preprocessing an image;
s203, calculating the variation of the two adjacent screenshots, comparing the variation with a threshold, returning to the step S201 when the variation does not exceed the threshold, and executing the step S204 when the variation exceeds the threshold;
s204, associating the screenshot with a timestamp;
and S205, sending the data to a cloud server for storage.
Further, the image preprocessing specifically includes:
s2021, identifying the paper contour of the original image; the method specifically comprises the following steps:
marking the paper surface outline in the screenshot by using a differential operator canny algorithm; firstly, smoothing an image by adopting a Gaussian filter, and removing image noise; then, respectively calculating gradient components and gradient directions in the x direction and the y direction by using a sobel operator; then, the places with gradient values not being maximum values are restrained, non-edge pixels are excluded, and only a few thin lines are reserved; finally, connecting the connection points on the graph by using double thresholds;
the sobel operator is used for a discrete difference operator for edge detection, and a certain pixel and a neighborhood thereof in the image are represented as follows:
wherein: i is pixel point f (x, y) and its 3 x 3 neighborhood;
for the derivation in the x and y directions, respectively, the kernel size is 3:
horizontal transformation
Vertical transformation
The gradient magnitude and direction are calculated using the following formulas:
gradient amplitude
Direction angle
S2022, carrying out binarization on the contour image;
s2023, calculating the inclination angle and the position of the contour by Hough transform;
s2024, image rotation and stretching correction.
The invention has the advantages and positive effects that:
the invention can simulate one-to-one or one-to-many extraterrestrial coaching by utilizing the augmented reality glasses, and can realize remote coaching of students at home. The teacher can obtain the visual angle of the students and interact with the students in real time, so that interactive experience is improved; the cloud server can also be used for looking up the stored visual angle images of the students afterwards and analyzing the learning states of the students. The method specifically comprises the following steps:
when the teacher end starts playing courseware or teaching video, the courseware and the teaching video are synchronously played in the student end augmented reality glasses.
The student end is provided with a teaching video manual recording module, and when the student stores and reviews the teaching video synchronized by the teacher end, the teaching video can be recorded manually. When a student clicks to record, in order to record a relatively complete teaching video, the recording module sets the video recording starting point to be one minute ahead, and relatively complete video recording is achieved. The cloud server provides a certain capacity of video storage space for students to store the recorded interesting videos, and the searching and playback are convenient.
When real-time tutoring is carried out, the student end augmented reality glasses shoot the problem solving process of students in real time, and real-time video streams are transmitted to the teacher display end through the cloud management server to carry out real-time interaction; when a plurality of students participate in tutoring, the teacher display terminal can simultaneously display the problem solving videos of the plurality of students, and the teacher can select one-to-one interactive tutoring with the students and also select simultaneous interactive tutoring with the plurality of students.
Drawings
FIG. 1 is a block diagram of the architecture of the preferred embodiment of the present invention;
FIG. 2 is a schematic diagram of the installation position of the front camera in the preferred embodiment of the present invention;
FIG. 3 is a flow chart of identifying variations in the content written by a student on paper in a preferred embodiment of the invention;
fig. 4 is a flow chart of image pre-processing in a preferred embodiment of the present invention.
Detailed Description
In order to further understand the contents, features and effects of the present invention, the following embodiments are illustrated and described in detail with reference to the accompanying drawings:
referring to fig. 1 to 4, the first preferred embodiment: an augmented reality glasses-based remote tutoring system comprising; the system comprises a student part, a teacher part, a network transmission part and a cloud management server part, wherein the network transmission part is used for realizing data interaction between a first data acquisition terminal and a second data acquisition terminal; this student portion includes: the system comprises a first data acquisition terminal for acquiring handwritten videos of students and a first display terminal for receiving and displaying data of a teacher part; the teacher section includes: the second display terminal is used for receiving and displaying student data, and the second data acquisition terminal is used for acquiring a teacher handwritten video; the first data acquisition and display terminal and the second data acquisition and display terminal are augmented reality glasses. By adopting the technical scheme, the invention can simulate one-to-one or one-to-many extraterrestrial coaching by utilizing the augmented reality glasses, and can realize remote coaching of students at home. The teacher can obtain the visual angle of the students and interact with the students in real time, so that interactive experience is improved; the cloud server can also be used for looking up the stored visual angle images of the students afterwards and analyzing the learning states of the students.
Wherein: the augmented reality glasses at the student end are used for shooting videos at a first person visual angle and displaying videos and voice information returned from the teacher end; the augmented reality glasses at the teacher end are used for shooting videos at a first person visual angle and then sending the videos and the voice information to the student end, or playing teaching courseware and videos to the student end synchronously, or displaying the videos and the voice information returned from the student end.
Student's end and teacher end augmented reality glasses carry on leading camera, like fig. 2 to student or teacher's first person's visual angle shoots the video, mainly used shoots the video at paper handwriting process, discerns student or teacher's gesture and the content variation volume of writing on the paper simultaneously.
The platform authority is mainly divided into three major roles of a system administrator, a teacher and a student. The system administrator may perform any platform-dependent privilege processing on the platform. Any user can create a virtual classroom and set a classroom password, the user enters the classroom according to the classroom password, the user defaults to a student role when entering the virtual classroom, and a virtual classroom creator can designate a certain member in the classroom as a teacher role. When the augmented reality glasses of the student end are connected to the platform, the video content presented by the screen is controlled by the teacher in the classroom until the classroom administrator gives up control or the student exits the virtual classroom.
The voice interaction of the teacher end and the student end is realized through a micro loudspeaker and a microphone carried by the augmented reality glasses.
The teacher end system has two functional modules of courseware playing, video playing, real-time tutoring and after tutoring.
When the teacher end starts playing courseware or teaching video, the courseware and the teaching video are synchronously played in the student end augmented reality glasses.
The student end is provided with a teaching video manual recording module, and when the student stores and reviews the teaching video synchronized by the teacher end, the teaching video can be recorded manually. When a student clicks to record, in order to record a relatively complete teaching video, the recording module sets the video recording starting point to be one minute ahead, and relatively complete video recording is achieved. The cloud server provides a certain capacity of video storage space for students to store the recorded interesting videos, and the searching and playback are convenient.
When real-time tutoring is carried out, the student end augmented reality glasses shoot the problem solving process of students in real time, and real-time video streams are transmitted to the teacher display end through the cloud management server to carry out real-time interaction; when a plurality of students participate in tutoring, the teacher display terminal can simultaneously display the problem solving videos of the plurality of students, and the teacher can select one-to-one interactive tutoring with the students and also select simultaneous interactive tutoring with the plurality of students.
When the teacher end adopts intelligent display equipment such as a mobile phone or a tablet computer, the interaction comprises voice interaction and touch handwriting input interaction, the handwriting input interaction comprises images such as marks and characters, and the images are synchronously sent to augmented reality glasses of students through a network for display.
When the teacher end adopts augmented reality glasses equipment, the interaction comprises voice interaction, gesture input interaction and handwriting interaction on paper, and the real-time video of the first person visual angle of the teacher end handwritten on the paper is synchronously sent to the augmented reality glasses of students through the network for display.
When the student end augmented reality glasses are used for giving guidance afterwards, the student end augmented reality glasses record the student problem solving process and upload the student problem solving process to the cloud server for storage, and the student end augmented reality glasses are used for storing in a video screenshot form based on the time stamps for reducing the storage capacity of the cloud server. Augmented reality glasses are in order regularly to snatch student's solution video screenshot to utilize digital image processing algorithm discernment student to write the content variation volume on paper, when the content of once grabbing the picture back compares with the content of once grabbing the picture before, when exceeding preset percentage, associate last screenshot data with the time stamp, upload to high in the clouds server and save, replace video storage mode with the picture and will greatly reduce high in the clouds server memory space.
When the first person refers to the visual angle to record the handwritten content of the student, the paper is usually flatly placed on the desktop, the optical axis of the eyes and the paper surface generally form an angle of 45-90 degrees, the optical axis of the camera is not generally perpendicular to the image, and the perspective deformation of the image in a large-size-near-large-size mode is caused. Moreover, the angle of the video shot by the same student at each moment is changed, which is not beneficial to identifying the variation of the front and back contents. Therefore, when the digital image processing algorithm is used for identifying the content variation written on the paper, firstly, the picture obtained by video screenshot needs to be preprocessed, and then the handwritten content variation is detected.
The preprocessing algorithm mainly comprises paper contour identification, binaryzation, Hough transformation identification straight line and tangential correction of an original image.
Marking the paper surface outline in the screenshot by using a differential operator canny algorithm; firstly, smoothing an image by adopting a Gaussian filter, and removing image noise; secondly, respectively calculating gradient components and gradient directions in the x direction and the y direction by using a sobel operator; thirdly, suppressing the places with gradient values not being maximum values, and eliminating non-edge pixels and only keeping a few thin lines; and finally, connecting the connection points on the graph by using double thresholds.
The sobel operator is a discrete difference operator mainly used for edge detection, and a certain pixel and a neighborhood thereof in an image are represented as follows:
wherein: i is pixel point f (x, y) and its 3 x 3 neighborhood;
for the derivation in the x and y directions, respectively, the kernel size is 3:
horizontal transformation
Vertical transformation
The gradient magnitude and direction are calculated using the following formulas:
gradient amplitude
Direction angle
After the paper surface contour is obtained through the detection of the paper surface, binarization processing is carried out on the paper surface, background interference is removed, and the black and white contour of the paper surface is kept. And then Hough transform is carried out to fit a straight line of the paper profile, and the inclination angle and the position of the profile in the screenshot are calculated.
The hough transform is an algorithm for detecting straight lines, and considering the correspondence between points and lines, a straight line passing through a point (x1, y1) can be expressed as: y1 kx1+ b, where variables and parameters are interchanged, a point (x1, y1) is known, and the cluster of straight lines passing through this point can be expressed as b (-x1) k + y 1. Points on the same straight line have the same slope and intercept, and the straight lines meet at the same point (k, b) on the parameter space, so that the straight lines in the picture are found. The inclination angle of the paper can be obtained by the straight line of the paper contour fitted by Hough transform.
And after preprocessing, obtaining a paper surface binary black-and-white image with consistent paper surface size and inclination angle. The detection algorithm of the handwritten content variation comprises two parts, namely expansion and image subtraction.
The expansion of the image is a convolution operation, and the function is to strengthen and highlight the paper characters and facilitate the subsequent identification of the variation of the front and the rear pictures. The convolution operation is very simple, and for each pixel of the image, a certain neighborhood is taken, and the maximum value is calculated to be used as the pixel value of the pixel position corresponding to a new image.
And finally, calculating the content variation of the student writing on the paper in the two video screenshots before and after digital image subtraction, and associating the next screenshot data with the timestamp, uploading to a cloud server and storing when the next screenshot content is compared with the previous screenshot content by a preset percentage.
The above-mentioned embodiments are only for illustrating the technical ideas and features of the present invention, and the purpose thereof is to enable those skilled in the art to understand the contents of the present invention and to carry out the same, and the present invention shall not be limited to the embodiments, i.e. the equivalent changes or modifications made within the spirit of the present invention shall fall within the scope of the present invention.
Claims (10)
1. An augmented reality glasses based remote tutoring system; at least comprises the following components;
the teacher end is used for collecting teaching situations of a teacher, receiving and displaying student end data;
the student end is used for receiving and displaying teacher end data and collecting student attendance situations;
the cloud server is used for realizing data interaction between the teacher end and the student end; the method is characterized in that:
the teacher end and the student end both comprise augmented reality glasses;
the augmented reality glasses of the student end are used for shooting videos at a first person visual angle and displaying videos and voice information returned from the teacher end; the augmented reality glasses of the teacher end are used for shooting videos at a first person visual angle and then sending the videos and the voice information to the student end, or playing teaching courseware and videos to the student end synchronously, or displaying the videos and the voice information returned from the student end.
2. The augmented reality glasses-based remote tutoring system of claim 1, wherein the augmented reality glasses of the student end and the teacher end are equipped with front cameras, and the cameras are used for shooting video of handwriting process on paper, recognizing gesture of student or teacher and recognizing content variation written on paper.
3. The remote guidance system based on augmented reality glasses according to claim 1, wherein the teacher-end and the student-end augmented reality glasses are equipped with a micro speaker and a microphone for voice interaction.
4. The augmented reality glasses-based remote tutoring system of claim 1, wherein the augmented reality glasses-based remote tutoring system comprises a play courseware and/or video module, a real-time tutoring and/or a post tutoring module.
5. The augmented reality glasses-based remote coaching system of claim 1, wherein the student end comprises an instructional video manual recording module.
6. The remote guidance system based on the augmented reality glasses as claimed in claim 1, further comprising an image processing module, when performing the after-the-fact guidance, the augmented reality glasses at the student end record the student problem solving process and upload the student problem solving process to the cloud server for storage, the augmented reality glasses capture the student problem solving video screenshot at regular time, the digital image processing module is used for identifying the content variation written on paper by the student, when the content of the last captured image is compared with the content of the previous captured image and exceeds a preset percentage, the data of the next captured image is associated with the timestamp and uploaded to the cloud server for storage, and the picture is stored in a video replacing mode.
7. The augmented reality glasses-based remote tutoring system of claim 6, wherein the cloud server stores in the form of time stamp based video shots.
8. A method for augmented reality glasses-based remote tutoring system based on claim 1, characterized by the following steps:
s101, establishing a data interaction relationship between a teacher end and a student end through a cloud server;
s102, a teacher end collects teaching data of teaching situations of a teacher and sends the teaching data to a cloud server;
s103, the student side obtains data of real-time tutoring or tutoring afterwards through the cloud server, and then enters a corresponding tutoring course;
when the student selects real-time tutoring, the augmented reality glasses of the teacher end and the student end are synchronously started, and the locally acquired data are sent to the other side; the two parties can read the data of the other party in real time through the augmented reality glasses;
when the student chooses to tutor afterwards, student's augmented reality glasses record student's process of solving problems, and upload to high in the clouds server storage, augmented reality glasses are in order regularly to snatch student's video screenshot of solving problems, and utilize digital image processing module discernment student's content variation volume of writing on paper, compare with the last content of grabbing the picture when the picture content of grabbing of the back, when exceeding preset percentage, associate the last screenshot data with the time stamp, upload to high in the clouds server and save, replace the video mode with the picture and save.
9. The method of augmented reality glasses-based remote tutoring system according to claim 8, wherein the digital image processing module recognizes the content variation amount written on the paper by the student by the following specific process:
s201, capturing a picture at regular time;
s202, preprocessing an image;
s203, calculating the variation of the two adjacent screenshots, comparing the variation with a threshold, returning to the step S201 when the variation does not exceed the threshold, and executing the step S204 when the variation exceeds the threshold;
s204, associating the screenshot with a timestamp;
and S205, sending the data to a cloud server for storage.
10. The method of an augmented reality glasses-based remote tutoring system of claim 9, wherein the image pre-processing is specifically:
s2021, identifying the paper contour of the original image; the method specifically comprises the following steps:
marking the paper surface outline in the screenshot by using a differential operator canny algorithm; firstly, smoothing an image by adopting a Gaussian filter, and removing image noise; then, respectively calculating gradient components and gradient directions in the x direction and the y direction by using a sobel operator; then, the places with gradient values not being maximum values are restrained, non-edge pixels are excluded, and only a few thin lines are reserved; finally, connecting the connection points on the graph by using double thresholds;
the sobel operator is used for a discrete difference operator for edge detection, and a certain pixel and a neighborhood thereof in the image are represented as follows:
wherein: i is pixel point f (x, y) and its 3 x 3 neighborhood;
for the derivation in the x and y directions, respectively, the kernel size is 3:
horizontal transformation
Vertical transformation
The gradient magnitude and direction are calculated using the following formulas:
gradient amplitude
Direction angle
S2022, carrying out binarization on the contour image;
s2023, calculating the inclination angle and the position of the contour by Hough transform;
s2024, image rotation and stretching correction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010205824.8A CN111325853B (en) | 2020-03-23 | 2020-03-23 | Remote coaching system and method based on augmented reality glasses |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010205824.8A CN111325853B (en) | 2020-03-23 | 2020-03-23 | Remote coaching system and method based on augmented reality glasses |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111325853A true CN111325853A (en) | 2020-06-23 |
| CN111325853B CN111325853B (en) | 2023-04-28 |
Family
ID=71165869
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010205824.8A Active CN111325853B (en) | 2020-03-23 | 2020-03-23 | Remote coaching system and method based on augmented reality glasses |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111325853B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112671875A (en) * | 2020-12-17 | 2021-04-16 | 广州宏途教育网络科技有限公司 | Remote psychological coaching system and method for primary and secondary schools |
| CN113507599A (en) * | 2021-07-08 | 2021-10-15 | 四川纵横六合科技股份有限公司 | Education cloud service platform based on big data analysis |
| CN114283639A (en) * | 2022-01-10 | 2022-04-05 | 立人实业(广东)集团有限公司 | Remote education control system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106228982A (en) * | 2016-07-27 | 2016-12-14 | 华南理工大学 | A kind of interactive learning system based on education services robot and exchange method |
| CN107240317A (en) * | 2017-07-14 | 2017-10-10 | 福建铁工机智能机器人有限公司 | A kind of utilization AR realizes the method and apparatus of long-distance education |
| JP6227816B1 (en) * | 2017-03-27 | 2017-11-08 | 株式会社ドワンゴ | Class system, class method, correspondence class server and correspondence class program |
| CN109102727A (en) * | 2018-09-26 | 2018-12-28 | 宋飞 | A kind of virtual reality teaching equipment |
| CN110233841A (en) * | 2019-06-11 | 2019-09-13 | 上海文景信息科技有限公司 | A kind of long-distance education data interaction system and method based on AR holographic glasses |
| KR102012316B1 (en) * | 2019-02-12 | 2019-10-21 | 주식회사 이에프엠 | After-school class contents provision system based on augmented reality |
-
2020
- 2020-03-23 CN CN202010205824.8A patent/CN111325853B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106228982A (en) * | 2016-07-27 | 2016-12-14 | 华南理工大学 | A kind of interactive learning system based on education services robot and exchange method |
| JP6227816B1 (en) * | 2017-03-27 | 2017-11-08 | 株式会社ドワンゴ | Class system, class method, correspondence class server and correspondence class program |
| CN107240317A (en) * | 2017-07-14 | 2017-10-10 | 福建铁工机智能机器人有限公司 | A kind of utilization AR realizes the method and apparatus of long-distance education |
| CN109102727A (en) * | 2018-09-26 | 2018-12-28 | 宋飞 | A kind of virtual reality teaching equipment |
| KR102012316B1 (en) * | 2019-02-12 | 2019-10-21 | 주식회사 이에프엠 | After-school class contents provision system based on augmented reality |
| CN110233841A (en) * | 2019-06-11 | 2019-09-13 | 上海文景信息科技有限公司 | A kind of long-distance education data interaction system and method based on AR holographic glasses |
Non-Patent Citations (1)
| Title |
|---|
| 马少斌等: "一种基于AR的可视化交互教学平台" * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112671875A (en) * | 2020-12-17 | 2021-04-16 | 广州宏途教育网络科技有限公司 | Remote psychological coaching system and method for primary and secondary schools |
| CN113507599A (en) * | 2021-07-08 | 2021-10-15 | 四川纵横六合科技股份有限公司 | Education cloud service platform based on big data analysis |
| CN113507599B (en) * | 2021-07-08 | 2022-07-08 | 四川纵横六合科技股份有限公司 | Education cloud service platform based on big data analysis |
| CN114283639A (en) * | 2022-01-10 | 2022-04-05 | 立人实业(广东)集团有限公司 | Remote education control system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111325853B (en) | 2023-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110334610B (en) | Multi-dimensional classroom quantification system and method based on computer vision | |
| CN111325853B (en) | Remote coaching system and method based on augmented reality glasses | |
| CN111079113A (en) | Teaching system with artificial intelligent control and use method thereof | |
| CN103905734A (en) | Method and device for intelligent tracking and photographing | |
| CN111242962A (en) | Method, device and equipment for generating remote training video and storage medium | |
| CN109889881B (en) | Teacher classroom teaching data acquisition system | |
| CN112183238B (en) | Remote education attention detection method and system | |
| WO2019019403A1 (en) | Interactive situational teaching system for use in k12 stage | |
| CN111275345B (en) | Classroom informatization evaluation and management system and method based on deep learning | |
| CN112652200A (en) | Man-machine interaction system, man-machine interaction method, server, interaction control device and storage medium | |
| CN110364043A (en) | A kind of paper cloud intellectual education system and application method | |
| CN106982357A (en) | A kind of intelligent camera system based on distribution clouds | |
| CN206557851U (en) | A kind of situation harvester of listening to the teacher of imparting knowledge to students | |
| CN111382633A (en) | Classroom attendance management method, device, terminal and computer readable storage medium | |
| CN203588489U (en) | A situational teaching device | |
| CN110490173B (en) | Intelligent action scoring system based on 3D somatosensory model | |
| CN113989608A (en) | Student experiment classroom behavior identification method based on top vision | |
| US20140118522A1 (en) | Dance learning system using a computer | |
| CN111311995A (en) | Remote teaching system and teaching method based on augmented reality technology | |
| CN116403218B (en) | Online and offline hybrid teaching management system based on remote audio/video interaction | |
| CN202907086U (en) | Campus video system based on Internet of things | |
| CN116226821A (en) | Teaching data center management system | |
| CN112116841A (en) | Personalized remote education system and method based on deep learning | |
| CN111050111A (en) | Online interactive learning communication platform and learning device thereof | |
| CN115937961A (en) | Online learning identification method and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |