CN109754644A - A kind of teaching method and system based on augmented reality - Google Patents
A kind of teaching method and system based on augmented reality Download PDFInfo
- Publication number
- CN109754644A CN109754644A CN201711080115.6A CN201711080115A CN109754644A CN 109754644 A CN109754644 A CN 109754644A CN 201711080115 A CN201711080115 A CN 201711080115A CN 109754644 A CN109754644 A CN 109754644A
- Authority
- CN
- China
- Prior art keywords
- content
- courses
- stage property
- teaching
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 75
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000012545 processing Methods 0.000 claims abstract description 28
- 239000003086 colorant Substances 0.000 claims abstract description 11
- 238000010801 machine learning Methods 0.000 claims description 7
- 230000000877 morphologic effect Effects 0.000 claims description 5
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 230000003993 interaction Effects 0.000 abstract description 8
- 238000005516 engineering process Methods 0.000 description 19
- 238000010586 diagram Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 6
- 230000002708 enhancing effect Effects 0.000 description 6
- 239000000463 material Substances 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000001514 detection method Methods 0.000 description 5
- 238000013528 artificial neural network Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000002452 interceptive effect Effects 0.000 description 4
- 230000003044 adaptive effect Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- -1 piece Substances 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 229910052799 carbon Inorganic materials 0.000 description 2
- 238000007621 cluster analysis Methods 0.000 description 2
- 150000001875 compounds Chemical class 0.000 description 2
- 229910003460 diamond Inorganic materials 0.000 description 2
- 239000010432 diamond Substances 0.000 description 2
- 230000004069 differentiation Effects 0.000 description 2
- 230000009977 dual effect Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000005194 fractionation Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 230000001788 irregular Effects 0.000 description 2
- 239000002184 metal Substances 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 239000002985 plastic film Substances 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000010485 coping Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Abstract
The invention discloses a kind of tutoring systems based on augmented reality, the tutoring system includes one or more cameras, augmented reality device and teaching stage property, wherein, stage property of imparting knowledge to students includes frame and the content of courses area in the frame, and/or the teaching stage property includes the three-dimensional polygon stage property of one or more different colours；One or more cameras are used to acquire the image of the teaching stage property；Augmented reality device connects one or more of cameras by wired or wireless way, carries out augmented reality processing for the image to the collected teaching stage property, identifies the content of courses information in described image, and export the content of courses information.The invention also discloses a kind of augmented reality device and teaching methods.It solves the problem of entity teaching contacts with electronic courseware shortage, can not carry out individualized teaching in the prior art, improves classroom interaction experience.
Description
Technical field
The invention belongs to information technology fields, and in particular, to a kind of teaching method based on augmented reality and be
System.
Background technique
In current teaching process, it is common to use the entities such as books, toy, object visual teaching article, as education is believed
The continuous propulsion of breathization, the electronic equipments such as television set (electronic display), electronic whiteboard, projector, interactive all-in-one machine largely into
Enter classroom, more and more contents of courses start to present in a manner of digitized.
Based on cognitive psychology and the educational numerous studies explanation of nerve, object operation experiences true generation for student
Boundary, understanding and grasp abstract knowledge have great meaning.But electronic courseware belongs to the display form of plane formula, does not include to reality
The contact and use of border object or teaching aid, for example, for kindergarten and primary grades student, from game type, experience type
Classroom environment based on habit, the classroom environment gradually stepped into based on abstract textbook, Concentration education is huge challenge, is added
Their small at ages, attention time of concentration is short, in face of uninteresting planarization, the learning Content of abstract, it is easy to fatigue and walk
Mind, therefore there is also its limitations for the teaching of pure electronic courseware formula.
Current classroom evolves as the indoor instruction environment that traditional teaching aid toy and electronic equipment coexist, although environment compared with
The passing teaching method using chalk, blackboard has many improvement, but can not still solve entity teaching article and electronics class
Lack connection between part content, classroom interaction experience is bad, cannot achieve the collection analysis of classroom data and teaches personalization
It learns and supports the problems such as insufficient.
Summary of the invention
The present invention provides a kind of teaching method and system based on augmented reality, solve entity in the prior art
The problem of teaching contacts with electronic courseware shortage, can not carry out individualized teaching improves classroom interaction experience.
To achieve the goals above, the present invention provides a kind of tutoring system based on augmented reality, the teaching
System includes one or more cameras, augmented reality device and teaching stage property, wherein
The teaching stage property includes frame and the content of courses area in the frame, and/or, the teaching stage property packet
Three-dimensional polygon stage property containing one or more different colours；
One or more of cameras are used to acquire the image of the teaching stage property；
The augmented reality device connects one or more of cameras by wired or wireless way, for acquisition
The image of the teaching stage property arrived carries out augmented reality processing, identifies the content of courses information in described image, and export
The content of courses information.
Optionally, in another embodiment provided by the invention, the tutoring system further includes display device, the display
Device is built-in or independently of the augmented reality device, for showing the content of courses of the output.
Optionally, in another embodiment provided by the invention, the teaching stage property further includes direction signs, the direction
Mark is located in the content area, or is placed on the frame.
Optionally, in another embodiment provided by the invention, the embodiment of the present invention is also provided when the teaching stage property packet
When content of courses area containing frame and in the frame, then the augmented reality device is used to carry out acquired image
Augmented reality processing, identifies the content of courses information in described image, comprising:
The augmented reality device goes out the frame in the teaching stage property image for identification, confirms institute according to the frame
The position in content of courses area is stated, and the content of courses area is identified, identifies the content of courses information in described image.
Optionally, in another embodiment provided by the invention, described in occurring within the scope of the camera collection image
When at least two teaching stage properties, then the augmented reality device goes out the content of courses information in described image for identification, and defeated
The content of courses out, comprising:
The augmented reality device goes out the content of courses information of at least two teaching stage property for identification, and according to institute
That states at least two teaching stage properties puts distance, and the content of courses information is combined, the content of courses after output combination
Information.
The embodiment of the invention also provides a kind of teaching method based on augmented reality, the teaching method includes:
The image of one or more camera acquisition teaching stage properties, the teaching stage property is comprising frame and is located at the frame
Interior content of courses area, and/or, the teaching stage property includes the three-dimensional polygon stage property of one or more different colours；
Augmented reality device carries out augmented reality processing to the image of the collected teaching stage property, identifies the figure
Content of courses information as in, exports the content of courses information.
Optionally, when the teaching stage property includes frame and content of courses area in the frame, then the increasing
Strong real device carries out augmented reality processing to acquired image, identifies the content of courses information in described image, comprising:
It identifies the frame in the teaching stage property image, the position in the content of courses area is confirmed according to the frame,
And the content of courses area is identified, identify the content of courses information in described image.
Optionally, the frame identified in the teaching stage property image, confirms in the teaching according to the frame
Hold the position in area, and the content of courses area identified, identifies the content of courses information in described image, comprising:
Binary conversion treatment, geometrical morphological analysis, clustering processing are carried out to described image, identify the quasi- of the frame
Data are closed, determine the position in content of courses area in the position and the frame of the frame, and identify using machine learning method
Content of courses information in the frame in content of courses area.
Optionally, when the teaching stage property further includes direction signs, then the position and the side of the determination frame
After the position in Kuang Nei content of courses area, further includes:
Identify the direction signs, and according to the bearing mark by the frame and the position in the content of courses area
Become a full member.
Optionally, when occurring at least two teaching stage property within the scope of the camera collection image, then the increasing
Strong real device goes out the content of courses information in described image for identification, and exports the content of courses, comprising:
The augmented reality device goes out the content of courses information of at least two teaching stage property for identification, and according to institute
That states at least two teaching stage properties puts distance, and the content of courses information is combined, the content of courses after output combination
Information.
The method and system of the embodiment of the present invention have the advantage that
In the embodiment of the present invention, by the combination of camera, augmented reality device and teaching stage property, so that the teaching of entity
Stage property can be acquired by camera and be enhanced real device identification, to realize human-computer interaction, can preferably help child
Or pupil carries out the more study of colossus and the recognition methods for interacting, while providing through the embodiment of the present invention, according to direction
Mark, may recognize that the teaching stage property that any angle is put, while can be according to the distance of any two teaching card placement positions, really
The fixed combination for whether carrying out the content of courses, identifies compared to traditional AR, improves discrimination and recognition speed.
Detailed description of the invention
Fig. 1 is that the teaching based on enhancing display technology in the embodiment of the present invention 1 forms architecture diagram；
Fig. 2 a is educational aid frame and content of courses area schematic diagram in the embodiment of the present invention 1；
Fig. 2 b is frame of the educational aid with direction signs and content of courses area schematic diagram in the embodiment of the present invention 1；
Fig. 2 c is another schematic diagram of educational aid frame and content of courses area in the embodiment of the present invention 1；
Fig. 3 is schematic diagram of the tutoring system in practical application scene in the embodiment of the present invention 1；
Fig. 4 is augmented reality apparatus structure schematic diagram in the embodiment of the present invention 2；
Fig. 5 is the teaching method flow chart in the embodiment of the present invention 3 based on AR technology；
Fig. 6 is identification educational aid method flow diagram in the embodiment of the present invention 3.
Specific embodiment
In order to keep the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, to this hair
It is bright to be further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and do not have to
It is of the invention in limiting.In addition, as long as technical characteristic involved in the various embodiments of the present invention described below is each other
Between do not constitute conflict and can be combined with each other.
Embodiment 1
To achieve the above objectives, as shown in Figure 1, the present invention provides a kind of tutoring systems based on augmented reality
100, which includes: one or more cameras 101, augmented reality device 102 and teaching stage property 103, wherein
Stage property 103 of imparting knowledge to students includes frame and the content of courses area in the frame, and/or, the teaching stage property 103
Three-dimensional polygon stage property comprising one or more different colours；
Teaching stage property can be the teaching card of individual phonetic, tone, Chinese character or number, and (teaching card material can be paper
The materials such as piece, plastic sheet, wooden, rubber or sheet metal), it is also possible to the combination teaching card of phonetic, Chinese character and/or number, also
Can be certain teaching aids for being printed on phonetic, tone, Chinese character or number, for example, books, small rod, ruler, set square, religion ruler/teacher's pointer,
The routine teaching aid such as compasses.At present on the market be applied to reality enhancing teaching teaching stage property in, be using have two dimensional code or
Radio frequency identification etc. has some teaching stage properties of specific identification mark, and in the embodiment of the present invention, creatively propose one kind
Completely new teaching stage property, is different from present all teaching stage property on the market, and in the embodiment of the present invention, teaching stage property 103 has
Frame, the frame can be in closed (or semi-enclosed) and have one fixed width, the background color of border color and content of courses area
Difference is obvious, such as border color can be black, and content of courses area background color can be white, alternatively, border color is white,
Content of courses area color is black (as shown in Figure 2 a).Frame is polygon, such as triangle, rectangle, diamond shape and trapezoidal, frame
Or oval, circular.For convenience of explanation, the embodiment of the present invention is by taking quadrangle teaching card as an example, as shown in Figure 2 a, should
Quadrangle can be rectangular or squarish, such as square, rectangle, round rectangle, and frame and content of courses section every
Certain width.Teaching stage property 103 has frame this feature and has following technical effect: can be quick by enhancing display technology
Frame is positioned and identifies, so that reading identifies the content of courses of the teaching area in frame fastly.It is identified with existing augmented reality
Technology is compared, and the scheme of the identification content of courses after frame is first identified in the embodiment of the present invention, ensure that identification teaching stage property 103
Time is shorter, and identification accuracy is higher.Optionally, the content of courses in teaching stage property can be collected from any angle for convenience, it is right
Seem that (such as 6 and 9, u and n), teaching stage property 103 further includes direction signs to ambiguous content, described in some different directions
Direction signs are located in the content area, or are placed on the frame.As shown in Figure 2 b, direction signs can be its thicker
It is middle on one side frame (i.e. Houing while, excess-three side is narrow), be also possible to a point, two rectangle corners, horizontal line etc..If
Frame is circle, then can be in a certain section right above wherein one section of addition direction signs of round frame, such as round frame
Overstriking, or one or more points is added, or certain irregular figures are added.Direction signs have following technical effect: can be quick
The direction of the content of courses is navigated to, to quickly position and identify the information of the content of courses, improves the accuracy rate and speed of identification
Degree.Fig. 2 c is a composition example of teaching stage property 103 in the embodiment of the present invention, and Fig. 2 c is a teaching card, has one in card
The closed frame of round rectangle, frame have certain width (can be divided into interior frame and outer rim), and in frame and teaching
Holding area has certain interval.In addition, the frame meets the thin feature in its thick excess-three side of bottom edge, bottom edge is the direction of the teaching card
Mark.The embodiment of the present invention can quickly position and identify frame, and the rotation angle of the teaching card is identified according to direction signs,
To quickly recognize the content of courses information in frame in content of courses area.
Optionally, in the embodiment of the present invention, teaching stage property 103 includes the three-dimensional polygon road of one or more different colours
Tool, such as seven-piece puzzle stage property in kind, the embodiment of the present invention can be to different colours, different shape (such as equilateral triangle, obtuse angle
Triangle, quadrangle etc.) stage property in kind identified, can not only be accurately positioned the material object stage property in space which specific position
It sets, additionally it is possible to provide rotation angle, if needs such as ajust at indicative information, the convenient interactive teaching and learning with student.
One or more of cameras 101 are used to acquire the image of the teaching stage property 103；
It should be noted that there is no restriction for quantity of the embodiment of the present invention to camera, single camera or multi-cam side
Case.The cost of single camera is low, can be applied to most of scene of imparting knowledge to students, and multi-cam is mountable in different positions,
The range for acquiring image is bigger, and multi-cam (such as dual camera) can survey the depth of field, more preferable for spatial image collection effect.
For convenience of description, the embodiment of the present invention is illustrated using single camera as example.
The augmented reality device 102 connects one or more of cameras 101 by wired or wireless way, is used for
Augmented reality processing is carried out to the image of the collected teaching stage property 103, identifies the content of courses letter in described image
Breath, and export the content of courses information.
It should be noted that augmented reality (Augmented Reality, AR) is also referred to as mixed reality.It passes through
Computer technology, by virtual Information application to real world, true environment and virtual object have been added to same in real time
A picture or space exist simultaneously.AR technology has following characteristics: actual situation combines.It can make computer interface and chart
Double exposure is in real-world object.Two, real-time, interactives.Its single people that can make to conform to the principle of simplicity develops in face of screen exchange oneself being blended in week
In the space and object enclosed.Just because of AR technology has such feature, therefore, AR technology can be applied to teaching field, can be with
It allows child or student's depth to participate in interaction, enhances the interest in classroom.
In the embodiment of the present invention, augmented reality device 102 can be an individual AR processing unit, independently of camera
101 and exist, be attached with camera 101, be also possible to the integrated circuit board for being built-in with camera 101, enhancing is existing
Actual load, which sets 102, can be ARM plate/FPGA plate, can have typical von Neumann structure, such as contain CPU, BUS bus,
RAM, ROM, input/output interface and corresponding circuit structure etc..Optionally, augmented reality device 102 can also be integrated with aobvious
Showing device 104, after augmented reality device 102 is handled acquired image, after being handled by output interface output
Content of courses information to display device 104, display device 104 can show this treated content of courses information.Display device
104 can also independently of the augmented reality device 102 component part as tutoring system 100, optionally, display device
104 can be the display equipment such as TV, PC, mobile terminal, electronic curtain with touch function, user (teacher or
Student) content of courses that shows in display equipment 104 can also be clicked or slide, realization human-computer interaction.
Optionally, when the teaching stage property 103 includes frame and content of courses area in the frame, then described
Augmented reality device 102 is used to carry out augmented reality processing to acquired image, identifies the content of courses in described image
Information, specifically:
The augmented reality device 102 goes out the frame in teaching 103 image of stage property for identification, according to the frame
Confirm the position in the content of courses area, and the content of courses area is identified, identifies in the teaching in described image
Hold information.
More specifically, augmented reality device 102 is used for after the image for receiving the output of camera 101, firstly, using certainly
It adapts to thresholding algorithm and the image that camera 101 acquires is converted into black and white binary image, to highlight the side of teaching stage property 101
Frame.The judgment basis of adaptive thresholding algorithm are as follows:
Wherein
Wherein, v is the gray value of pixel, and N (v) is the pixel set near v, and C is pre-set threshold value, and v ' is represented
Pixel inside field N (v).
Secondly, carrying out two-value contours extract to the result, i.e., the connected region in bianry image is scanned, obtains area
The data such as the lines of outline in domain, the area in region, perimeter.
Again, profile screening is carried out, i.e., fast geometric morphological analysis is carried out to the profile that previous step is extracted, only retains likeness in form
The profile of quadrangle, to reduce the processing time of subsequent step.Specifically, first using the method for local average to contour line
Progress is primary smooth, and the tangent vector of each point on contour line is then calculated using neighbour's calculus of finite differences, finally uses hierarchical clustering side
Method analyzes all tangent vector coordinates, if the significant cluster formed exactly 4, then it is assumed that the profile is similar to four sides
Shape.
Further, four side fractionations are carried out to previous step processing result.Cluster analysis result based on previous step, by 4
It significantly clusters corresponding profile point coordinate to extract in 4 set, corresponds to the fitting data on 4 sides of quadrangle.
Further, least square fitting is carried out to the fitting data of previous step.The data for the four edges that previous step generates
It can carry out straight line fitting respectively to obtain the equation of four edges, it is quasi- to carry out straight line in the present invention using least-squares algorithm
It closes, optimization aim are as follows:
It completes to can determine the specific location of the frame of teaching stage property 101 in the picture after the fitting of four edges.
Further, to adjacent domain image flame detection, since shooting angle is varied, card can generate shape in the picture
Become.The deformation of card can be corrected using frame obtained in the previous step, at this time card content there may also be 0 degree, 90 degree,
180 degree, 270 degree of these four different directions.
Further, direction signs are detected.The embodiment of the present invention is using machine learning method to the side in card
It is detected and is identified to mark, by acquiring the card image of upper thousand sheets difference direction, and is labeled (for example, can be into
5 classifications of row are 0 degree, 90 degree, 180 degree, 270 degree, directionless mark respectively), it is instructed later using deep neural network
Practice, a direction signs classifier can be obtained, direction signs detection can be carried out to result obtained in the previous step and differentiates.The program
The classifier that training obtains can reach 99.6% or more to the recognition accuracy of direction signs.
Further, by mark rotation image.For detecting the card of direction signs, card can be turned by bearing mark
Just.
Further, all directional images are obtained.For not detecting the card of bearing mark, the embodiment of the present invention is straight
The image for delivering a child into 4 different directions is analyzed for subsequent content recognizer.
Further, card content is identified.The present invention identifies card content using machine learning method,
The defined card of a upper thousand sheets is had hundreds in sample database first, to these sample extraction histograms of oriented gradients features
(HOG) after, the training multi-class classifier of SVM；If the sample in database is very more (more than 1,000), depth also can be used directly
Degree neural network is trained.Image obtained in the previous step is differentiated (if front does not detect direction using classifier
Mark, then the image in 4 directions is all differentiated, as long as one of them is effective), after differentiation according to result again with number
It is once compared (checking computations) according to the master sample in library, checking computations are thought successfully to be detected result after.
Finally, output recognition result.If previous step successfully recognizes card, by the classification of card, position, directional information
Output.
Optionally, when there is at least two teaching stage property in the camera 101 acquisition image range, then described
Augmented reality device 102 goes out the content of courses information in described image for identification, and exports the content of courses, specifically:
The augmented reality device 102 goes out the content of courses information of at least two teaching stage property, and root for identification
Distance is put according at least two teaching stage property, the content of courses information is combined, the teaching after output combination
Content information.By taking stage property of imparting knowledge to students is teaching card as an example, when identifying that the content of courses is respectively phonetic " e " and " i ", if identifying
Teaching card be closer (both i.e. location of pixels distance is lower than a preset threshold value), then the directly combination of output " e " and " i "
"ei".And so on, when the content of courses identified is respectively phonetic " e " and four tone of phonetic the first sound therein, and the two
In it is stringent it is upper and lower put, and put distance lower than a pre-set threshold value, then output has the phonetic " ē " of the first tone.
Optionally, tutoring system 100 can also include the input equipments such as microphone, mouse, keyboard, be convenient for subsequent and student
User carries out human-computer interaction.
Fig. 3 provides an example of the tutoring system in practical application of the embodiment of the present invention.It can be seen that, utilize the present invention
The tutoring system that embodiment provides, teacher can carry out diversification and personalized teaching.For example, teacher is in professor's mathematical knowledge
When, it can be set a question by touch screen or keyboard, student can lift digital card with hand to answer, and tutoring system passes through inspection
Survey, the digital card that takes of identification camera it can be seen that student answer, then inspection is compared in the topic by going out with teacher
Whether answer is correct.When learning phonetic, different initial consonants is can be used in student, simple or compound vowel of a Chinese syllable card puts out different groups on the table
It closes, tutoring system is detected by AR device, identifies and navigate to the card that student puts, and is analyzed, if can be combined into
As soon as complete phonetic shows corresponding pinyin combinations on the screen, while can also show one of them corresponding Chinese
Word and picture, and pass through the pronunciation of loudspeaker sending standard.In learning Chinese characters, student can be put different Chinese characters on the table
Different zones place different Chinese character cards, while occurring corresponding with Chinese character image on screen, and with the Chinese character on table
Relative position is consistent.Student can further tell a story according to the image occurred on screen.It can reinforce student to the print of Chinese character
As, while allowing student to give the rein to imagination and constructing different stories.In addition, when showing a figure on electronic curtain, student can be used
Building blocks (such as seven-piece puzzle) are attempted to risk the figure seen on the table, and system analyzes the performance of student by camera, and
Provide prompt；Triumph animation can be played after student completes task as reward.Multiple students can also be supported to spell together,
Frequently who is faster.In addition, the embodiment of the present invention can be used not only for the child for primary grades, it is equally possible that being applied to just
Any one entity such as senior middle school, university teaching scene, can also bring interest and appeal and personalization to need while taking into account quality of instruction
It asks.
The embodiment of the invention provides a kind of tutoring systems based on AR technology, pass through camera, AR device and teaching road
The combination of tool, can 360 degree quickly identification entity teaching stage properties and shown.Meeting the personalized teaching needs of diversification
While, also improve recognition speed and accuracy of identification.In addition, being produced compared to traditional AR identification technology and current AR on the market
Product, the present invention creatively uses exclusive teaching stage property, and depth customizes and optimize associated AR identification technology,
Impart knowledge to students stage property can only with conventional cards form without being additionally embedded in expensive specific identifier object, not only reduce
Cost, it is easier to bring commercial success.
Embodiment 2
As shown in figure 4, the embodiment of the invention provides a kind of AR device 200, including the augmented reality device includes defeated
Incoming interface 201, output interface 202, processor 203 and memory 204, the input interface 201 and one or more cameras
It is connected, for receiving the teaching stage property image of one or more of camera acquisitions；The processor 203 is for collecting
The teaching stage property image carry out augmented reality processing, identify the content of courses information in described image, and pass through institute
It states output interface and exports the content of courses information.
Optionally, AR device 200 can be an individual AR processing unit, exist independently of camera, with camera shooting
Head connection interaction, is also possible to the integrated circuit board for being built-in with camera, augmented reality device can be ARM plate/FPGA
Plate, AR device 200 can also be integrated with display device 205, after AR device 200 is handled acquired image, lead to
Output treated the content of courses information of output interface 202 is crossed to display device 205, after display device 205 can show the processing
Content of courses information.
Optionally, when the teaching stage property includes frame and content of courses area in the frame, then the place
It manages device to be used to carry out augmented reality processing to acquired image, identifies the content of courses information in described image, specifically:
The processor 203 goes out the frame in the teaching stage property image for identification, according to frame confirmation
The position in content of courses area, and the content of courses area is identified, identify the content of courses information in described image.
Specifically, the position in the content of courses area is confirmed according to the frame, and the content of courses area is known
Not, the content of courses information in described image is identified, (the 4th section of page 8 of specification is extremely for details, reference can be made to the description of embodiment 1
The 2nd section of page 10), it is not repeated herein.
Optionally, when occurring at least two teaching stage property within the scope of the camera collection image, then the place
The content of courses information that device 203 goes out for identification in described image is managed, and exports the content of courses, comprising:
The processor 203 goes out the content of courses information of at least two teaching stage property for identification, and according to described
At least two teaching stage properties put distance, and the content of courses information is combined, the content of courses letter after output combination
Breath.By taking stage property of imparting knowledge to students is teaching card as an example, when identifying that the content of courses is respectively phonetic " e " and " i ", if the teaching identified
Card is closer, i.e., the two location of pixels distance is lower than a preset threshold value, then the directly combination " ei " of output " e " and " i ".With
This analogizes, and when the content of courses identified is respectively phonetic " e " and four tone of phonetic the first sound therein, and the two is in stringent
It puts up and down, and puts distance lower than a pre-set threshold value, then output has the phonetic " ē " of the first tone.
In the embodiment of the present invention, AR device carries out augmented reality processing by the image of the collected teaching stage property,
It identifies the content of courses information in described image, and the content of courses information is exported by the output interface.
Embodiment 3
As shown in figure 5, the embodiment of the present invention provides a kind of teaching method based on AR technology, this method is as follows:
S301. the image of one or more camera acquisition teaching stage properties, the teaching stage property is comprising frame and is located at institute
The content of courses area in frame is stated, and/or, the teaching stage property includes the three-dimensional polygon road of one or more different colours
Tool；
Teaching stage property can be the teaching card of individual phonetic, tone, Chinese character or number, and (teaching card material can be paper
The materials such as piece, plastic sheet or sheet metal), it is also possible to the combination teaching card of phonetic, Chinese character and/or number, can also be certain
It is printed on the conventional teaching aids such as the teaching aid of phonetic, tone, Chinese character or number, such as ruler, set square, religion ruler/teacher's pointer, compasses.At present
It is applied in the teaching stage property of reality enhancing teaching on the market, is to have specific knowledge using having two dimensional code or radio frequency identification etc.
The some teaching stage properties not identified, and in the embodiment of the present invention, a kind of completely new teaching stage property is creatively proposed, is different from
All teaching stage property on the market at present, in the embodiment of the present invention, teaching stage property has frame, the frame can in closed and
Has an one fixed width, the background color difference in border color and content of courses area is obvious, such as border color can be black, in teaching
Holding area's background color can be white, alternatively, border color is white, content of courses area color is black (as shown in Figure 2 a).Frame
For polygon, such as triangle, rectangle, diamond shape and trapezoidal, or oval or circular.For convenience of explanation, of the invention
Embodiment is by taking quadrangle teaching card as an example, and as shown in Figure 2 a, which can be rectangular or squarish, such as square, length
Rectangular, round rectangle etc., and frame and content of courses section are every certain width.Teaching stage property has frame this feature and has
Following technical effect: frame can be quickly positioned and identified by enhancing display technology, to read to identify the religion in frame fastly
The content of courses of school district.Religion is identified after first identifying frame compared with existing augmented reality identification technology, in the embodiment of the present invention
The scheme for learning content ensure that the time of identification teaching stage property is shorter, and identification accuracy is higher.It optionally, for convenience can be from any
Angle acquisition to teaching stage property in the content of courses, for some different directions seem ambiguous content (such as 6 and 9, u and
N), teaching stage property further includes direction signs, and the direction signs are located in the content area, or are placed on the frame.Such as
Shown in Fig. 2 b, direction signs can be it is thicker wherein on one side frame (i.e. Houing while, excess-three side is narrow), be also possible to one
Point, two rectangle corners, horizontal line etc. can be in wherein one section of addition directions of round frame if frame is circle
A certain section of overstriking right above mark, such as round frame, or one or more points is added, or certain irregular figures are added.
Direction signs have following technical effect: the direction of the content of courses can be quickly navigated to, to quickly position and identify in teaching
The information of appearance improves the accuracy rate and speed of identification.Fig. 2 c is a composition example of teaching stage property in the embodiment of the present invention,
Fig. 2 c is a teaching card, has the closed frame of a round rectangle in card, frame, which has certain width, (can be divided into inner edge
Frame and outer rim), and there is certain interval in frame and content of courses area.In addition, to meet its thick excess-three side of bottom edge thin for the frame
Feature, bottom edge are the direction signs of the teaching card.The embodiment of the present invention can be positioned quickly and identify frame, and according to direction sign
The rotation angle of the teaching card is identified, to quickly recognize the content of courses information in frame in content of courses area.
Optionally, in the embodiment of the present invention, teaching stage property includes the three-dimensional polygon stage property of one or more different colours,
Such as seven-piece puzzle stage property in kind, the embodiment of the present invention can be to different colours, different shape (such as equilateral triangle, obtuse angle three
Angular, quadrangle etc.) stage property in kind identified, the material object stage property can not only be accurately positioned in specific which the specific position in space
It sets, additionally it is possible to provide rotation angle, if needs such as ajust at indicative information, the convenient interactive teaching and learning with student.
It should be noted that there is no restriction for quantity of the embodiment of the present invention to camera, single camera or multi-cam side
Case.The cost of single camera is low, can be applied to most of scene of imparting knowledge to students, and multi-cam is mountable in different positions,
The range for acquiring image is bigger, and multi-cam (such as dual camera) can survey the depth of field, more preferable for spatial image collection effect.
For convenience of description, the embodiment of the present invention is illustrated using single camera as example.
S302. augmented reality device carries out augmented reality processing to the image of the collected teaching stage property, identifies
Content of courses information in described image exports the content of courses information.
Optionally, when the teaching stage property includes frame and content of courses area in the frame, then the increasing
Strong real device carries out augmented reality processing to acquired image, identifies the content of courses information in described image, specifically
Are as follows:
It identifies the frame in the teaching stage property image, the position in the content of courses area is confirmed according to the frame,
And the content of courses area is identified, identify the content of courses information in described image.
Optionally, above-mentioned steps specifically:
Binary conversion treatment, geometrical morphological analysis, clustering processing are carried out to described image, identify the quasi- of the frame
Data are closed, determine the position in content of courses area in the position and the frame of the frame, and identify using machine learning method
Content of courses information in the frame in content of courses area.
More specifically, above-mentioned steps as shown in fig. 6, specifically:
S3021. image binaryzation.The image that camera acquires is converted into black and white binary map using adaptive thresholding algorithm
Picture, to highlight the frame of teaching stage property.The judgment basis of adaptive thresholding algorithm are as follows:
Wherein
Wherein, v is the gray value of pixel, and N (v) is the pixel set near v, and C is pre-set threshold value, and v ' is represented
Pixel inside field N (v).
S3022. two-value contours extract is carried out to the result, the connected region in bianry image is scanned, area is obtained
The data such as the lines of outline in domain, the area in region, perimeter.
S3023. profile screening is carried out, i.e., fast geometric morphological analysis is carried out to the profile that previous step is extracted, only retains shape
Like the wheel of quadrangle (usage scenario of the embodiment of the present invention includes but is not limited to quadrangle, is only illustrated by taking quadrangle as an example)
Exterior feature, to reduce the processing time of subsequent step.Specifically, once being put down using the method for local average to contour line first
It is sliding, the tangent vector of each point on contour line is then calculated using neighbour's calculus of finite differences, finally using hierarchical clustering method to all
Tangent vector coordinate is analyzed, if the significant cluster formed exactly 4, then it is assumed that the profile is similar to quadrangle.
S3024. four side fractionations are carried out to the processing result of S3023.Cluster analysis result based on previous step, it is aobvious by 4
It writes the corresponding profile point coordinate of cluster to extract in 4 set, corresponds to the fitting data on 4 sides of quadrangle.
S3025. least square fitting is carried out to the fitting data of S3024.The data for the four edges that previous step generates can divide
Not carry out straight line fitting to obtain the equation of four edges, straight line fitting is carried out using least-squares algorithm in the present invention, it is excellent
Change target are as follows:
It completes to can determine the specific location of the frame of teaching stage property 101 in the picture after the fitting of four edges.
S3026. to adjacent domain image flame detection.By taking stage property 101 of imparting knowledge to students is one or more teaching card as an example, due to clapping
It is varied to take the photograph angle, card can generate deformation in the picture.The deformation of card can be carried out using frame obtained in the previous step
Correction, card content there may also be 0 degree, 90 degree, 180 degree, 270 degree of these four different directions at this time.
S3027. direction signs are detected.The embodiment of the present invention is using machine learning method to the direction sign in card
Knowledge is detected and is identified, by acquiring the card image of upper thousand sheets difference direction, and is labeled (for example, 5 can be carried out
Classification is 0 degree, 90 degree, 180 degree, 270 degree, directionless mark respectively), it is trained, can be obtained using deep neural network later
To a direction signs classifier, direction signs detection can be carried out to result obtained in the previous step and is differentiated.The program is trained
To classifier 99.6% or more can reach to the recognition accuracy of direction signs.
S3028a. by mark rotation image.For detecting the card of direction signs, card can be turned by bearing mark
Just.Become a full member will the card go to horizontal position.
S3028b. all directional images are obtained.For not detecting the card of bearing mark, the embodiment of the present invention is direct
The image for generating 4 different directions is analyzed for subsequent content recognizer.
S3029. card content is identified.The present invention identifies card content using machine learning method, first
The defined card of a upper thousand sheets is first had hundreds in sample database, to these sample extraction histograms of oriented gradients features
(HOG) after, the training multi-class classifier of SVM；If the sample in database is very more (more than 1,000), depth also can be used directly
Degree neural network is trained.Image obtained in the previous step is differentiated (if front does not detect direction using classifier
Mark, then the image in 4 directions is all differentiated, as long as one of them is effective), after differentiation according to result again with number
It is once compared (checking computations) according to the master sample in library, checking computations are thought successfully to be detected result after.
S3020. recognition result is exported.If previous step successfully recognizes card, the classification of card, position, direction are believed
Breath output.
Optionally, when the teaching stage property further includes direction signs, then the position and the side of the determination frame
After the position in Kuang Nei content of courses area, further includes:
Identify the direction signs, and according to the bearing mark by the frame and the position in the content of courses area
Become a full member.
Optionally, when occurring at least two teaching stage property within the scope of the camera collection image, then the increasing
Strong real device identifies the content of courses information in described image, and exports the content of courses, specifically:
Identify the content of courses information of at least two teaching stage property, and according at least two teaching stage property
Distance is put, the content of courses information is combined, the content of courses information after output combination.For example, when identifying religion
When content is respectively phonetic " e " and " i ", if the teaching card identified is closer, i.e., the two location of pixels distance is lower than pre-
If a threshold value, then directly output " e " and " i " combination " ei ".And so on, when the content of courses identified is respectively phonetic
" e " and four tone of phonetic the first sound therein, and the two is put in strictly upper and lower, and puts distance lower than pre-set one
Threshold value, then output has the phonetic " ē " of the first tone.
Using teaching method provided by the invention, teacher can carry out diversification and personalized teaching.For example, teacher is teaching
When awarding mathematical knowledge, it can be set a question by touch screen or keyboard, student can lift digital card with hand to answer, and teaching is
System it can be seen that the answer of student, then passes through the topic progress gone out with teacher by detection, the digital card that takes of identification camera
It compares and checks whether answer is correct.When learning phonetic, different initial consonants is can be used in student, simple or compound vowel of a Chinese syllable card is put out on the table
Different combinations, tutoring system is detected by AR device, identifies and navigate to the card that student puts, and is analyzed, if
As soon as complete phonetic can be combined into, corresponding pinyin combinations are shown on the screen, while can also show one of them
Corresponding Chinese character and picture, and pass through the pronunciation of loudspeaker sending standard.In learning Chinese characters, student can be different Chinese characters
It puts different zones on the table and places different Chinese character cards, while occurring image corresponding with Chinese character on screen, and and table
On Chinese character relative position it is consistent.Student can further tell a story according to the image occurred on screen.It can reinforce student couple
The impression of Chinese character, while allowing student to give the rein to imagination and constructing different stories.In addition, being learned when showing a figure on electronic curtain
Life can be attempted to risk the figure seen with building blocks (such as seven-piece puzzle) on the table, and system analyzes the completion of student by camera
Situation, and provide prompt；Triumph animation can be played after student completes task as reward.It can also support multiple students
It spells together, frequently who is faster.
The embodiment of the invention provides a kind of teaching methods based on AR technology, pass through camera, AR device and teaching road
The combination of tool, can 360 degree quickly identification entity teaching stage properties and shown.Meeting the personalized teaching needs of diversification
While, also improve recognition speed and accuracy of identification.In addition, being produced compared to traditional AR identification technology and current AR on the market
Product, the present invention creatively uses exclusive teaching stage property, and depth customizes and optimize associated AR identification technology,
Impart knowledge to students stage property can only with conventional cards form without being additionally embedded in expensive specific identifier object, not only reduce
Cost, it is easier to bring commercial success.
It should be understood that the size of the serial number of each process is not meant to execution sequence in the various embodiments of the application
Successively, the execution sequence of each process should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present application
Constitute any restriction.
Those of ordinary skill in the art may be aware that mould described in conjunction with the examples disclosed in the embodiments of the present disclosure
Block and method and step can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician
Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed
Scope of the present application.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and module, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
The various pieces of this specification are all made of progressive mode and are described, same and similar portion between each embodiment
Dividing may refer to each other, and what each embodiment introduced is and other embodiments difference.Especially for device and it is
For embodiment of uniting, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to method reality
Apply the explanation of example part.
Finally, it should be understood that being not intended to the foregoing is merely the preferred embodiment of technical scheme
Limit the protection scope of the application.Obviously, those skilled in the art can carry out various modification and variations without de- to the application
From scope of the present application.If these modifications and variations of the application belong to the range of the claim of this application and its equivalent technologies
Within, then any modification, equivalent replacement, improvement and so on, should be included within the scope of protection of this application.
Claims (13)
1. a kind of tutoring system based on augmented reality, which is characterized in that the tutoring system is taken the photograph including one or more
As head, augmented reality device and teaching stage property, wherein
The teaching stage property includes frame and the content of courses area in the frame, and/or, the teaching stage property includes one
The three-dimensional polygon stage property of a or multiple and different colors；
One or more of cameras are used to acquire the image of the teaching stage property；
The augmented reality device connects one or more of cameras, the augmented reality dress by wired or wireless way
It sets and carries out augmented reality processing for the image to the collected teaching stage property, identify the content of courses in described image
Information, and export the content of courses information.
2. tutoring system according to claim 1, which is characterized in that the tutoring system further includes display device, described
Display device is built-in or independently of the augmented reality device, for showing the content of courses of the output.
3. tutoring system according to claim 1, which is characterized in that the teaching stage property further includes direction signs, described
Direction signs are located in the content area, or are placed on the frame.
4. tutoring system according to claim 1-3, which is characterized in that when the teaching stage property include frame and
When content of courses area in the frame, then the augmented reality device is used to carry out augmented reality to acquired image
Processing, identifies the content of courses information in described image, comprising:
The augmented reality device goes out the frame in the teaching stage property image for identification, confirms the religion according to the frame
The position of content regions is learned, and the content of courses area is identified, identifies the content of courses information in described image.
5. tutoring system according to claim 1-3, which is characterized in that when the camera collection image range
It is interior occur it is described at least two teaching stage property when, then the augmented reality device for identification go out described image in the content of courses
Information, and export the content of courses, comprising:
The augmented reality device for identification go out it is described at least two teaching stage property content of courses information, and according to it is described extremely
Few two teaching stage properties put distance, the content of courses information are combined, the content of courses after exporting the combination
Information.
6. a kind of augmented reality device, which is characterized in that the augmented reality device includes input interface, output interface, processing
Device and memory, the input interface is connected with one or more cameras, for receiving one or more of cameras
The teaching stage property image of acquisition；The processor is used to carry out at augmented reality the image of the collected teaching stage property
Reason identifies the content of courses information in described image, and exports the content of courses information by the output interface.
7. augmented reality device according to claim 6, which is characterized in that when the teaching stage property includes frame and is located at
When content of courses area in the frame, then the processor is used to carry out acquired image augmented reality processing, identification
Content of courses information in described image out, comprising:
The processor goes out the frame in the teaching stage property image for identification, confirms the content of courses according to the frame
The position in area, and the content of courses area is identified, identify the content of courses information in described image.
8. augmented reality device according to claim 6 or 7, which is characterized in that when the camera collection image range
It is interior occur it is described at least two teaching stage property when, then the processor for identification go out described image in content of courses information,
And export the content of courses, comprising:
The processor goes out the content of courses information of at least two teaching stage property for identification, and according to described at least two
Teaching stage property puts distance, and the content of courses information is combined, the content of courses information after output combination.
9. a kind of teaching method based on augmented reality, which is characterized in that the teaching method includes:
The image of one or more camera acquisition teaching stage properties, the teaching stage property is comprising frame and in the frame
Content of courses area, and/or, the teaching stage property includes the three-dimensional polygon stage property of one or more different colours；
Augmented reality device carries out augmented reality processing to the image of the collected teaching stage property, identifies in described image
Content of courses information, export the content of courses information.
10. teaching method according to claim 9, which is characterized in that when the teaching stage property comprising frame and is located at institute
When stating the content of courses area in frame, then the augmented reality device carries out augmented reality processing, identification to acquired image
Content of courses information in described image out, comprising:
It identifies the frame in the teaching stage property image, the position in the content of courses area is confirmed according to the frame, and right
The content of courses area is identified, identifies the content of courses information in described image.
11. teaching method according to claim 10, which is characterized in that described to identify in the teaching stage property image
Frame confirms the position in the content of courses area according to the frame, and identifies to the content of courses area, identifies institute
State the content of courses information in image, comprising:
Binary conversion treatment, geometrical morphological analysis, clustering processing are carried out to described image, identify the fitting number of the frame
According to determining the position in content of courses area in the position and the frame of the frame, and identify using machine learning method described
Content of courses information in frame in content of courses area.
12. teaching method according to claim 11, which is characterized in that when the teaching stage property further includes direction signs,
Then in the position of the determination frame and the frame after the position in content of courses area, further includes:
It identifies the direction signs, and turns the position in the frame and the content of courses area according to the bearing mark
Just.
13. according to the described in any item teaching methods of claim 9-12, which is characterized in that when the camera collection image model
Enclose it is interior occur it is described at least two teaching stage property when, then the augmented reality device identify the content of courses in described image believe
Breath, and export the content of courses, comprising:
Identify the content of courses information of at least two teaching stage property, and putting according at least two teaching stage property
The content of courses information is combined by distance, the content of courses information after output combination.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711080115.6A CN109754644A (en) | 2017-11-06 | 2017-11-06 | A kind of teaching method and system based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711080115.6A CN109754644A (en) | 2017-11-06 | 2017-11-06 | A kind of teaching method and system based on augmented reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109754644A true CN109754644A (en) | 2019-05-14 |
Family
ID=66399727
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711080115.6A Pending CN109754644A (en) | 2017-11-06 | 2017-11-06 | A kind of teaching method and system based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109754644A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110379232A (en) * | 2019-07-30 | 2019-10-25 | 赵良华 | The methods of exhibiting imparted knowledge to students based on augmented reality and the multi-person interactive of artificial intelligence |
| CN111477060A (en) * | 2020-05-29 | 2020-07-31 | 安徽新视野科教文化股份有限公司 | AR augmented reality technology-based earthquake real scene simulation method and system |
| CN112068709A (en) * | 2020-11-12 | 2020-12-11 | 广州志胜游艺设备有限公司 | AR display interactive learning method based on books for children |
| TWI815782B (en) * | 2022-11-27 | 2023-09-11 | 互動細胞股份有限公司 | Method for recognizing object assemblies in augmented reality images |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101923791A (en) * | 2010-05-31 | 2010-12-22 | 华中师范大学 | Method for learning Chinese by combining reality enhancing technique and plane reading material |
| CN102411854A (en) * | 2011-09-01 | 2012-04-11 | 苏州梦想人软件科技有限公司 | Classroom teaching mixing technology application system based on enhanced reality and method thereof |
| CN102509484A (en) * | 2011-10-13 | 2012-06-20 | 苏州梦想人软件科技有限公司 | Learning system based on augmented reality technology and learning method thereof |
| CN103366610A (en) * | 2013-07-03 | 2013-10-23 | 熊剑明 | Augmented-reality-based three-dimensional interactive learning system and method |
| CN106097794A (en) * | 2016-07-25 | 2016-11-09 | 焦点科技股份有限公司 | The Chinese phonetic alphabet based on augmented reality combination is recognized reading learning system and recognizes reading method |
| CN106570483A (en) * | 2016-11-07 | 2017-04-19 | 厦门市妖猫网络有限公司 | Image positioning method and system |
-
2017
- 2017-11-06 CN CN201711080115.6A patent/CN109754644A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101923791A (en) * | 2010-05-31 | 2010-12-22 | 华中师范大学 | Method for learning Chinese by combining reality enhancing technique and plane reading material |
| CN102411854A (en) * | 2011-09-01 | 2012-04-11 | 苏州梦想人软件科技有限公司 | Classroom teaching mixing technology application system based on enhanced reality and method thereof |
| CN102509484A (en) * | 2011-10-13 | 2012-06-20 | 苏州梦想人软件科技有限公司 | Learning system based on augmented reality technology and learning method thereof |
| CN103366610A (en) * | 2013-07-03 | 2013-10-23 | 熊剑明 | Augmented-reality-based three-dimensional interactive learning system and method |
| CN106097794A (en) * | 2016-07-25 | 2016-11-09 | 焦点科技股份有限公司 | The Chinese phonetic alphabet based on augmented reality combination is recognized reading learning system and recognizes reading method |
| CN106570483A (en) * | 2016-11-07 | 2017-04-19 | 厦门市妖猫网络有限公司 | Image positioning method and system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110379232A (en) * | 2019-07-30 | 2019-10-25 | 赵良华 | The methods of exhibiting imparted knowledge to students based on augmented reality and the multi-person interactive of artificial intelligence |
| CN110379232B (en) * | 2019-07-30 | 2021-05-14 | 大连澜创科技有限公司 | Display method for multi-person interactive teaching based on augmented reality and artificial intelligence |
| CN111477060A (en) * | 2020-05-29 | 2020-07-31 | 安徽新视野科教文化股份有限公司 | AR augmented reality technology-based earthquake real scene simulation method and system |
| CN112068709A (en) * | 2020-11-12 | 2020-12-11 | 广州志胜游艺设备有限公司 | AR display interactive learning method based on books for children |
| TWI815782B (en) * | 2022-11-27 | 2023-09-11 | 互動細胞股份有限公司 | Method for recognizing object assemblies in augmented reality images |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8358320B2 (en) | Interactive transcription system and method | |
| Kennedy | Drawing & the blind: Pictures to touch | |
| CN106128212B (en) | Learning calligraphy system and method based on augmented reality | |
| US6215901B1 (en) | Pen based computer handwriting instruction | |
| CN111881310B (en) | Chinese character hard-stroke writing intelligent guidance and scoring method and guidance scoring system | |
| CN109754644A (en) | A kind of teaching method and system based on augmented reality | |
| CN108399821A (en) | A kind of electronic intelligence auxiliary writing training and analysis and evaluation system | |
| Brennan | Caricature generator | |
| CN109614849A (en) | Remote teaching method, apparatus, equipment and storage medium based on bio-identification | |
| CN106409063A (en) | Robot painting teaching method and device and robot | |
| CN105931506A (en) | Children painting system and display method thereof based on augmented reality | |
| KR101079925B1 (en) | An augmented reality situational training system by recognition of markers and hands of trainee | |
| Cummmings et al. | I don't believe my eyes! geometric sketch recognition for a computer art tutorial | |
| CN105989366A (en) | Inclination angle correcting method of text image, page layout analysis method of text image, vision assistant device and vision assistant system | |
| CN104166499A (en) | Handwriting practice system and practice handwriting automatic detecting and evaluating method | |
| CN109902541A (en) | A kind of method and system of image recognition | |
| US20200098279A1 (en) | Interactive arabic alphabet blocks | |
| KR20100058843A (en) | Method and system for teaching hangeul using augmented reality | |
| KR101700317B1 (en) | System, method and computer readable recording medium for managing an education using a smart pen based on a dot code | |
| CN208208121U (en) | A kind of terminal, end fitting and augmented reality display system | |
| CN106846972A (en) | Graphic plotting training method and device | |
| Thiengtham et al. | Improve template matching method in mobile augmented reality for thai alphabet learning | |
| CN112836542A (en) | Method, system and computer readable medium for practicing calligraphy based on dot matrix code | |
| Agrawal et al. | A Tutor for the hearing impaired (developed using Automatic Gesture Recognition) | |
| CN110781734B (en) | Child cognitive game system based on paper-pen interaction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |