CN112068709A - AR display interactive learning method based on books for children - Google Patents
AR display interactive learning method based on books for children Download PDFInfo
- Publication number
- CN112068709A CN112068709A CN202011260019.1A CN202011260019A CN112068709A CN 112068709 A CN112068709 A CN 112068709A CN 202011260019 A CN202011260019 A CN 202011260019A CN 112068709 A CN112068709 A CN 112068709A
- Authority
- CN
- China
- Prior art keywords
- module
- projection
- display
- human body
- children
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Abstract
The invention relates to the technical field of AR, and discloses an AR display interactive learning method based on books for children; the AR display interactive learning method based on the book for the children comprises the following steps: s1: establishing a human body model; s2: connecting the transferring equipment; s3: acquiring book contents; s4: acquiring a real scene; s5: AR combined projection; s6: specifying an action interaction; s7: the method and the device have the advantages that the 3D simulation human body model, the specified interaction action and the specified interaction voice are established, so that the children can interactively control the current AR projection display content according to the set specified interaction action or the specified interaction voice while AR projection display is carried out, scene interaction sense is increased, learning interest is improved, learning can be better guided, learning efficiency is improved, and the target unlocking reward method not only increases learning interest, but also improves concentration degree and learning enthusiasm during learning.
Description
Technical Field
The invention belongs to the technical field of AR, and particularly relates to an AR display interactive learning method based on books for children.
Background
AR is generally understood as a technique for superimposing virtual information and a display world, and Augmented Reality (AR) is a technique for calculating the position and angle of a camera image in real time and adding a corresponding image, and was first proposed in 1990. The method comprises new technologies and new means such as multimedia, three-dimensional modeling, real-time video display and control, multi-sensor fusion, real-time tracking and registration, scene fusion and the like, and superimposes virtual objects generated by a computer or non-geometric information about real objects on scenes of the real world, so that the real world is enhanced.
A children's book refers to a publication that disseminates information knowledge to the age stage of young children. Including printed publications such as books and periodicals, and also including electronic publications such as visible, audible and touch publications, general juvenile publications are classified by age: young children 0-3 years old: middle-aged children 3-6 years old: young children 6-9 years old: young children 9-14 years old.
With the continuous development of the AR technology, the applied industry range is wider, the combination of the AR technology and the children book is also one content of the application attempt, compared with the traditional reading, the children book which can be displayed in a scene by combining the AR technology can arouse the interest of children, but the existing children book combined with the AR technology is only simple scene display and simple voice interaction generally, has poor interaction with the scenes of the children, is difficult to continuously attract the interest of the children when being used for a long time, and limits the use of the children book combined with the AR technology; therefore, improvements are now needed in view of the current situation.
Disclosure of Invention
In view of the above situation, in order to overcome the defects of the prior art, the invention provides an AR display interactive learning method based on a child book, which effectively solves the problems that with the continuous development of the AR technology, the application industry range is wider, the combination of the AR technology and the child book is also one content of the application attempt of the AR technology, compared with the traditional reading, the child book capable of carrying out scene display by combining the AR technology can arouse the interest of children, but the existing child book combined with the AR technology is generally only simple scene display and simple voice interaction, has poor scene interaction with children, is difficult to continuously attract the interest of children when being used for a long time, and the use of the child book combined with the AR technology is limited.
In order to achieve the purpose, the invention provides the following technical scheme: an AR display interactive learning method based on books for children comprises the following steps:
s1: human body model establishment: establishing a 3D simulation human body model of the child to be learned at the mobile terminal, and storing the model to the AR terminal;
s2: moving and throwing equipment connection: the mobile terminal is wirelessly connected with the projection equipment, and appointed interaction actions or appointed interaction voices are set in the mobile terminal and stored in the AR terminal;
s3: acquiring book contents: scanning page information required to be learned by the book of the child by using the mobile terminal, and transmitting the information to the AR terminal;
s4: acquiring a real scene: acquiring a current real object scene, a current real object position, a current human body posture and a current human body position by using projection equipment:
s5: AR combined projection: the AR terminal combines the AR content corresponding to the book content acquired in the step S3 with the real scene and the human body acquired in the step S4, the human body adopts the 3D simulated human body model established in the step S1, the model and the current posture and position of the human body acquired in the step S4 are correspondingly simulated, the model and the current posture and position of the human body are projected on the end surface of the AR display screen for display, and the corresponding voice content is played while the display is carried out;
s6: specifying an action interaction: when the AR projection is displayed, the child can interactively control the current AR projection display content according to the designated interactive action or the designated interactive voice set in the step S2, when the control is performed, the projection equipment acquires the designated interactive action or the designated interactive voice in real time and transmits the acquired designated interactive action or the designated interactive voice to the AR terminal, the AR terminal converts the current AR projection display content according to the designated interactive action or the designated interactive voice by combining the setting in the step S2, and when the child acts, the 3D simulation human body model in the AR projection display also performs synchronous action;
s7: and (3) learning result feedback: after the AR projection display learning is finished, the AR projection extracts corresponding test questions 5-8 in a learning library of the AR terminal according to the current learning content, tests the children in real time through the AR projection, and displays corresponding reward puzzles according to test results:
the method comprises the following steps: when the answer accuracy of the test questions is between 90% and 100%, showing 3 pieces of puzzles;
secondly, the step of: when the answer accuracy of the test questions is between 75% and 90%, displaying 2 puzzles;
③: when the answer accuracy of the test questions is between 0% and 75%, showing 1 jigsaw puzzle;
and after the book contents are completely studied, the rewarding jigsaw can be completely unlocked when the answer accuracy of the test questions is between 90% and 100% on average, and after the unit study, the study progress and the result are stored in the AR terminal in real time.
Preferably, in step S2, the mobile terminal includes one or a combination of several of a mobile phone, a notebook, a PAD smart terminal, a tablet pc, and a wearable device such as smart glasses, a smart watch, or a smart bracelet, the projection device includes a camera unit, a projection unit, and a processing center unit, and the wireless connection mode between the mobile terminal and the projection device includes one or a combination of several of a 5G module, a 4G module, a bluetooth module, a WiFi module, a LORA module, a Z-Wave module, a GSM module, a CDMA module, and a TD-SCDMA module.
Preferably, in the step S3, the book content obtaining manner includes one or two combinations of two-dimensional code scanning and book picture scanning including AR color.
Preferably, in step S4, the current real object scene, position, and current posture and position of the human body are obtained by one or two combinations of hardware positioning and visual positioning, the hardware positioning includes one or more combinations of GPS positioning, ultrasonic positioning, magnetic field tracker, optical positioning, inertial positioning, and spiral measurement device, the visual positioning includes an image obtaining module, a relative position and direction calibration module, and an image processing module, and the image obtaining module, the relative position and direction calibration module, and the image processing module are electrically connected in two ways.
Preferably, in the steps S1-S6, the AR terminal includes an AR scene library, a data control processing center, a sound image sensing module, and a data storage module, and the AR scene library, the data control processing center, the sound image sensing module, and the data storage module are electrically connected in a bidirectional manner.
Preferably, in step S5, the AR display end includes one or a combination of a handheld display, a conventional liquid crystal display, a head-mounted display and a projection display.
Compared with the prior art, the invention has the beneficial effects that: according to the invention, by establishing a 3D simulated human body model, a specified interactive action and a specified interactive voice, when the AR projection is displayed, children can interactively control the current AR projection display content according to the set specified interactive action or specified interactive voice, when the control is carried out, the projection equipment acquires the specified interactive action or specified interactive voice in real time and transmits the specified interactive action or specified interactive voice to the AR terminal, the AR terminal converts the current AR projection display content according to the specified interactive action or specified interactive voice, and when the children act, the 3D simulated human body model in the AR projection display also carries out synchronous action, and the AR content corresponding to the acquired book content is combined with the acquired real scene and human body through the AR terminal and is projected on the surface of the AR display screen for display, and the corresponding voice content is played while being displayed, so that the scene interaction sense of the children is increased, the learning interest of the children is improved, the children can be better guided to learn, teaching through lively activities is realized, and the learning efficiency of the children is improved;
the invention sets a learning result feedback mechanism, after AR projection display learning is finished, the AR projection extracts 5-8 corresponding test questions from a learning library of an AR terminal according to the current learning content, tests children in real time through the AR projection, and displays corresponding reward jigsaw puzzle according to the test result: the method comprises the following steps: when the answer accuracy of the test questions is between 90% and 100%, showing 3 pieces of puzzles; secondly, the step of: when the answer accuracy of the test questions is between 75% and 90%, displaying 2 puzzles; ③: when the answer accuracy of the test questions is between 0% and 75%, showing 1 jigsaw puzzle; the reward picture arragement is after the books content is all studied, and when the test question answer correct rate is between 90% -100% on average, can all unblock, after the unit study, study progress and result are stored in AR terminal department in real time, through target formula unblock reward method, both increased children's interest in study, the concentration degree and the enthusiasm of study when also having improved children's study, compare traditional reward method, it is more novel interesting.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention.
In the drawings:
FIG. 1 is a flow chart of the present invention;
FIG. 2 is a diagram of a visual alignment framework of the present invention;
fig. 3 is a diagram of the framework of the AR terminal according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments; all other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, the present invention provides an AR display interactive learning method based on a book for children, which includes the following steps:
s1: human body model establishment: establishing a 3D simulation human body model of the child to be learned at the mobile terminal, and storing the model to the AR terminal;
s2: moving and throwing equipment connection: the mobile terminal is wirelessly connected with the projection equipment, and appointed interaction actions or appointed interaction voices are set in the mobile terminal and stored in the AR terminal;
s3: acquiring book contents: scanning page information required to be learned by the book of the child by using the mobile terminal, and transmitting the information to the AR terminal;
s4: acquiring a real scene: acquiring a current real object scene, a current real object position, a current human body posture and a current human body position by using projection equipment:
s5: AR combined projection: the AR terminal combines the AR content corresponding to the book content acquired in the step S3 with the real scene and the human body acquired in the step S4, the human body adopts the 3D simulated human body model established in the step S1, the model and the current posture and position of the human body acquired in the step S4 are correspondingly simulated, the model and the current posture and position of the human body are projected on the surface of an AR display end to be displayed, and the corresponding voice content is played while being displayed;
s6: specifying an action interaction: when the AR projection is displayed, the child can interactively control the current AR projection display content according to the designated interactive action or the designated interactive voice set in the step S2, when the control is performed, the projection equipment acquires the designated interactive action or the designated interactive voice in real time and transmits the acquired designated interactive action or the designated interactive voice to the AR terminal, the AR terminal converts the current AR projection display content according to the designated interactive action or the designated interactive voice by combining the setting in the step S2, and when the child acts, the 3D simulation human body model in the AR projection display also performs synchronous action;
s7: and (3) learning result feedback: after the AR projection display learning is finished, the AR projection extracts corresponding test questions 5-8 in a learning library of the AR terminal according to the current learning content, tests the children in real time through the AR projection, and displays corresponding reward puzzles according to test results:
the method comprises the following steps: when the answer accuracy of the test questions is between 90% and 100%, showing 3 pieces of puzzles;
secondly, the step of: when the answer accuracy of the test questions is between 75% and 90%, displaying 2 puzzles;
③: when the answer accuracy of the test questions is between 0% and 75%, showing 1 jigsaw puzzle;
and after the book contents are completely studied, the rewarding jigsaw can be completely unlocked when the answer accuracy of the test questions is between 90% and 100% on average, and after the unit study, the study progress and the result are stored in the AR terminal in real time.
In step S2, the mobile terminal includes one or more combinations of a mobile phone, a notebook, a PAD smart terminal, a tablet pc, and a wearable device such as smart glasses, a smart watch, or a smart bracelet, the projection device includes a camera unit, a projection unit, and a processing center unit, and the wireless connection mode between the mobile terminal and the projection device includes one or more combinations of a 5G module, a 4G module, a bluetooth module, a WiFi module, a LORA module, a Z-Wave module, a GSM module, a CDMA module, and a TD-SCDMA module.
In step S3, the book content acquisition mode includes one or two combination of two-dimensional code scanning and book picture scanning including AR color.
In step S4, the current real object scene, position, and current posture and position of the human body are obtained by one or two combinations of hardware positioning and visual positioning, the hardware positioning includes one or a combination of several of GPS positioning, ultrasonic positioning, magnetic field tracker, optical positioning, inertial positioning, and spiral measurement device, the visual positioning includes an image obtaining module, a relative position and direction calibration module, and an image processing module, and the image obtaining module, the relative position and direction calibration module, and the image processing module are electrically connected in two directions.
In steps S1-S6, the AR terminal includes an AR scene library, a data control processing center, a sound image sensing module, and a data storage module, and the AR scene library, the data control processing center, the sound image sensing module, and the data storage module are electrically connected in both directions.
In step S5, the AR display terminal includes one or more of a handheld display, a conventional liquid crystal display, a head-mounted display, and a projection display.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (6)
1. The utility model provides a children book-based AR show interactive learning method which is characterized in that: the method comprises the following steps:
s1: human body model establishment: establishing a 3D simulation human body model of the child to be learned at the mobile terminal, and storing the model to the AR terminal;
s2: moving and throwing equipment connection: the mobile terminal is wirelessly connected with the projection equipment, and appointed interaction actions or appointed interaction voices are set in the mobile terminal and stored in the AR terminal;
s3: acquiring book contents: scanning page information required to be learned by the book of the child by using the mobile terminal, and transmitting the information to the AR terminal;
s4: acquiring a real scene: acquiring a current real object scene, a current real object position, a current human body posture and a current human body position by using projection equipment:
s5: AR combined projection: the AR terminal combines the AR content corresponding to the book content acquired in the step S3 with the real scene and the human body acquired in the step S4, the human body adopts the 3D simulated human body model established in the step S1, the model and the current posture and position of the human body acquired in the step S4 are correspondingly simulated, the model and the current posture and position of the human body are projected on the surface of an AR display end to be displayed, and the corresponding voice content is played while being displayed;
s6: specifying an action interaction: when the AR projection is displayed, the child can interactively control the current AR projection display content according to the designated interactive action or the designated interactive voice set in the step S2, when the control is performed, the projection equipment acquires the designated interactive action or the designated interactive voice in real time and transmits the acquired designated interactive action or the designated interactive voice to the AR terminal, the AR terminal converts the current AR projection display content according to the designated interactive action or the designated interactive voice by combining the setting in the step S2, and when the child acts, the 3D simulation human body model in the AR projection display also performs synchronous action;
s7: and (3) learning result feedback: after the AR projection display learning is finished, the AR projection extracts corresponding test questions 5-8 in a learning library of the AR terminal according to the current learning content, tests the children in real time through the AR projection, and displays corresponding reward puzzles according to test results:
the method comprises the following steps: when the answer accuracy of the test questions is between 90% and 100%, showing 3 pieces of puzzles;
secondly, the step of: when the answer accuracy of the test questions is between 75% and 90%, displaying 2 puzzles;
③: when the answer accuracy of the test questions is between 0% and 75%, showing 1 jigsaw puzzle;
and after the book contents are completely studied, the rewarding jigsaw can be completely unlocked when the answer accuracy of the test questions is between 90% and 100% on average, and after the unit study, the study progress and the result are stored in the AR terminal in real time.
2. The AR display interactive learning method based on children's books as claimed in claim 1, wherein: in step S2, the mobile terminal includes one or a combination of several of a mobile phone, a notebook, a PAD smart terminal, a tablet pc, and a wearable device such as smart glasses, a smart watch, or a smart bracelet, the projection device includes a camera unit, a projection unit, and a processing center unit, and the wireless connection mode between the mobile terminal and the projection device includes one or a combination of several of a 5G module, a 4G module, a bluetooth module, a WiFi module, a LORA module, a Z-Wave module, a GSM module, a CDMA module, and a TD-SCDMA module.
3. The AR display interactive learning method based on children's books as claimed in claim 1, wherein: in step S3, the book content obtaining mode includes one or two combinations of two-dimensional code scanning and book picture scanning including AR color.
4. The AR display interactive learning method based on children's books as claimed in claim 1, wherein: in step S4, the current real object scene, position, and current posture and position of the human body are obtained by one or two combinations of hardware positioning and visual positioning, the hardware positioning includes one or more combinations of GPS positioning, ultrasonic positioning, magnetic field tracker, optical positioning, inertial positioning, and spiral measurement instrument, the visual positioning includes an image obtaining module, a relative position and direction calibration module, and an image processing module, and the image obtaining module, the relative position and direction calibration module, and the image processing module are electrically connected in two ways.
5. The AR display interactive learning method based on children's books as claimed in claim 1, wherein: in the steps S1-S6, the AR terminal includes an AR scene library, a data control processing center, a sound image sensing module, and a data storage module, and the AR scene library, the data control processing center, the sound image sensing module, and the data storage module are electrically connected in a bidirectional manner.
6. The AR display interactive learning method based on children's books as claimed in claim 1, wherein: in step S5, the AR display end includes one or a combination of several of a handheld display, a conventional liquid crystal display, a head-mounted display, and a projection display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011260019.1A CN112068709A (en) | 2020-11-12 | 2020-11-12 | AR display interactive learning method based on books for children |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011260019.1A CN112068709A (en) | 2020-11-12 | 2020-11-12 | AR display interactive learning method based on books for children |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112068709A true CN112068709A (en) | 2020-12-11 |
Family
ID=73655030
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011260019.1A Pending CN112068709A (en) | 2020-11-12 | 2020-11-12 | AR display interactive learning method based on books for children |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112068709A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106683501A (en) * | 2016-12-23 | 2017-05-17 | 武汉市马里欧网络有限公司 | AR children scene play projection teaching method and system |
| CN108492633A (en) * | 2018-03-26 | 2018-09-04 | 山东英才学院 | A method of realizing children's complementary education using AR |
| CN109754644A (en) * | 2017-11-06 | 2019-05-14 | 彼乐智慧科技（北京）有限公司 | A kind of teaching method and system based on augmented reality |
| CN110471530A (en) * | 2019-08-12 | 2019-11-19 | 苏州悠优互娱文化传媒有限公司 | It is a kind of based on children's book equipped AR interactive learning method, apparatus, medium |
-
2020
- 2020-11-12 CN CN202011260019.1A patent/CN112068709A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106683501A (en) * | 2016-12-23 | 2017-05-17 | 武汉市马里欧网络有限公司 | AR children scene play projection teaching method and system |
| CN109754644A (en) * | 2017-11-06 | 2019-05-14 | 彼乐智慧科技（北京）有限公司 | A kind of teaching method and system based on augmented reality |
| CN108492633A (en) * | 2018-03-26 | 2018-09-04 | 山东英才学院 | A method of realizing children's complementary education using AR |
| CN110471530A (en) * | 2019-08-12 | 2019-11-19 | 苏州悠优互娱文化传媒有限公司 | It is a kind of based on children's book equipped AR interactive learning method, apparatus, medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Craig | Understanding augmented reality: Concepts and applications | |
| Cheng et al. | Construction of interactive teaching system for course of mechanical drawing based on mobile augmented reality technology | |
| CN109976519B (en) | Interactive display device based on augmented reality and interactive display method thereof | |
| CN111729283B (en) | Training system and method based on mixed reality technology | |
| CN110688005A (en) | Mixed reality teaching environment, teacher and teaching aid interaction system and interaction method | |
| CN109144247A (en) | The method of video interactive and based on can interactive video motion assistant system | |
| Indrawan et al. | Markerless Augmented Reality Utilizing Gyroscope to Demonstrate the Position of Dewata Nawa Sanga. | |
| CN106780680A (en) | Three-dimensional animation generation method, terminal and system based on augmented reality | |
| CN111028597B (en) | Mixed reality foreign language scene, environment and teaching aid teaching system and method thereof | |
| CN109035906A (en) | One kind reading aloud Training Methodology based on the visual Chinese of mixed reality | |
| CN112068709A (en) | AR display interactive learning method based on books for children | |
| CN111840999A (en) | Game education method based on three-dimensional object graph recognition | |
| CN112037090A (en) | Knowledge education system based on VR technology and 6DOF posture tracking | |
| Chen et al. | Research on augmented reality system for childhood education reading | |
| CN117826976A (en) | XR-based multi-person collaboration method and system | |
| Yadav et al. | Augmented Reality and its Science | |
| Zhou et al. | Design research and practice of augmented reality textbook | |
| Nováková et al. | Benefits of Interactive Augmented Reality in Education | |
| Zulfiqar et al. | Augmented Reality and Its Applications in Education: A Systematic Survey | |
| CN112419508B (en) | Method for realizing mixed reality based on large-scale space accurate positioning | |
| CN211264542U (en) | Teaching support system based on high-speed communication technology | |
| Ghimire | Augmented Reality in Historical Museum: A case study at Fjell Fortress | |
| Reddy et al. | Augmented reality (AR) in education-A New Prospect | |
| Chouhan et al. | AI-Enabled Augmented Reality-Based Shared Collaborative Experience | |
| Yang et al. | Virtual reconstruction of visually conveyed images under multimedia intelligent sensor network node layout |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201211 |