CN109035906B - Chinese reading training method based on mixed reality visualization - Google Patents
Chinese reading training method based on mixed reality visualization Download PDFInfo
- Publication number
- CN109035906B CN109035906B CN201810799595.XA CN201810799595A CN109035906B CN 109035906 B CN109035906 B CN 109035906B CN 201810799595 A CN201810799595 A CN 201810799595A CN 109035906 B CN109035906 B CN 109035906B
- Authority
- CN
- China
- Prior art keywords
- mixed reality
- scene
- dimensional
- user
- reading
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
Abstract
The invention provides a Chinese reading training method based on mixed reality visualization, which comprises the following steps: the mixed reality client scans the entity environment and uploads the entity environment information to the mixed reality server; a user requests a three-dimensional scene from a mixed reality server through a mixed reality client; the mixed reality server determines a spatial position which can be used for displaying a three-dimensional visual scene; the mixed reality server inquires and acquires a three-dimensional scene requested by a user, and the mixed reality server calculates and analyzes the three-dimensional scene requested by the user to generate a three-dimensional visual scene; the mixed reality client displays the three-dimensional visual scene at a spatial position which can be used for displaying the three-dimensional visual scene. By using intelligent voice guidance and combining with mixed reality equipment to track the head position and the viewpoint of a user and combining with the scenes of Chinese texts, the virtual text scene display in a physical classroom is completed, and Chinese reading is effectively guided.
Description
Technical Field
The invention relates to the field of mixed reality visualization application, in particular to a mixed reality visualization Chinese reading training method and a Chinese reading training system.
Background
In the traditional Chinese reading education, the students are difficult to vividly read due to the fact that the expression of a plurality of text scenes is abstract. The current teaching method for Chinese reading is mainly to use a plane display method, including plane printing, ppt, micro-lesson and other modes to read the scenes of texts and guide reading. The method has the disadvantages that three-dimensional space scenes of texts cannot be displayed, scenes of the texts cannot be reproduced through immersive three-dimensional scene visualization, and targeted guidance cannot be provided for different users. Therefore, a set of intelligent guidance system capable of using mixed reality equipment can be combined with three-dimensional information visualization, abstract text scenes can be vividly displayed in an entity space in a three-dimensional dynamic visualization mode, and the Chinese reading training effect of a user is effectively improved through intelligent guidance.
Disclosure of Invention
In order to solve the problems, the invention provides a Chinese reading training method based on mixed reality visualization, which comprises the following steps:
s10: starting a mixed reality system;
s20: the mixed reality client scans the entity environment and uploads the entity environment information to the mixed reality server;
s30: a user requests a three-dimensional scene from a mixed reality server through a mixed reality client;
s40: the mixed reality server calculates and analyzes entity environment information and determines a spatial position which can be used for displaying a three-dimensional visual scene;
s50: the mixed reality server inquires and acquires a three-dimensional scene requested by a user, and the mixed reality server calculates and analyzes the three-dimensional scene requested by the user to generate a three-dimensional visual scene;
s60: the method comprises the steps that a three-dimensional visual scene is displayed in a space position which can be used for displaying the three-dimensional visual scene by a mixed reality client;
s70: and the user reads aloud through the three-dimensional visual scene observed by the mixed reality client.
Preferably, the scanning of the physical environment in S20 includes locating the position of the user and scanning the surroundings of the user.
Preferably, the three-dimensional visualization scene in S50 is a three-dimensional visualization scene with a reading guidance scheme and an interaction scheme.
The Chinese reading training method based on mixed reality visualization provided by the invention can be realized by using mixed reality equipment, and comprises the following steps: showing a virtual lesson scene in a classroom; the user can observe the holographic three-dimensional image and interact with the holographic three-dimensional image; the reading guidance can be intelligently customized according to the actual environment information and the personal condition of the user. By using intelligent voice guidance and combining with mixed reality equipment to track the head position and the viewpoint of a user and combining with the scenes of Chinese texts, the virtual text scene display in a physical classroom is completed, and Chinese reading is effectively guided.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
FIG. 1 is a flow chart of a Chinese reading training method based on mixed reality visualization provided by the present invention;
fig. 2 is a block diagram of a mixed reality visualization-based chinese reading training method provided by the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention provides a Chinese reading training method based on mixed reality visualization, which comprises the following steps:
s10: starting a mixed reality system; a mixed reality system, such as microsoft hol o lens ens, google glasses, etc., can complete three-dimensional scanning of the surrounding environment, and simultaneously can capture the position information of the user and display a holographic image; the user can watch media such as three-dimensional animation, panoramic video and the like through the mixed reality equipment;
s20: the mixed reality client scans the entity environment and uploads the entity environment information to the mixed reality server; scanning the physical environment comprises positioning the position of the user and scanning the surrounding environment of the user;
s30: a user requests a three-dimensional scene from a mixed reality server through a mixed reality client;
s40: the mixed reality server calculates and analyzes entity environment information and determines a spatial position which can be used for displaying a three-dimensional visual scene;
s50: the mixed reality server inquires and acquires a three-dimensional scene requested by a user, and the mixed reality server calculates and analyzes the three-dimensional scene requested by the user to generate a three-dimensional visual scene; the three-dimensional visual scene is a three-dimensional visual scene with a reading guidance scheme and an interaction scheme
S60: the method comprises the steps that a three-dimensional visual scene is displayed in a space position which can be used for displaying the three-dimensional visual scene by a mixed reality client;
s70: and the user reads aloud through the three-dimensional visual scene observed by the mixed reality client.
Example (b): and (4) mixed reality reading teaching of frog poetry.
The 7 th lesson is registered in the primary school Chinese grade of the teaching version (the 2016 department of education examined and approved);
and (3) actual scene: a teaching space with a length and width greater than 3m x 3 m;
wearing equipment: a mixed reality helmet system;
the use process comprises the following steps:
spatial layout: the student wears the mixed reality helmet client and starts the mixed reality helmet client program. The position of a student at the client of the mixed reality helmet and the scene information around the scanned student. Arranging the horizontal space distance of the three-dimensional scene content in a polar coordinate mode according to preset text scene data, namely the setting of a long shot, a middle shot and a short shot; arranging the height placement of the three-dimensional scene content in a high, medium and low arrangement; the angle system of the object from the polar coordinate center is automatically finished according to the principle that the object is uniformly distributed in the space. Specifically, the frog in the text scene needs to be set at a horizontal position of (0, 0 °), with a height of 0; tadpoles are arranged at the positions (1, 45 degrees) and have the height of 0; the bubble is arranged at (2, 90 position) and the height is-1; the lotus leaves are arranged at the position of (3, 135 degrees) and the height is 1; the length and height units are meters.
Speakable explanation interacting with the user:
after the spatial layout is completed, the demonstration reading is started to be played. If there are speaking points related to the objects in the spatially distributed three-dimensional visualization scene in the exemplary speaking, the speaking points are marked at corresponding positions of the objects in the related three-dimensional visualization scene in a text box prompting manner at corresponding time points of the exemplary speaking. The content of the prompt is mainly used to explain how the correct reading should be arranged according to the spatial relationship (e.g., distance, size, etc.) of the corresponding object in the lesson (e.g., volume, tone, rhythm, etc.). In addition, during the playing process of the demonstration reading, the user can listen to the reading explanation of the corresponding text content by moving to the corresponding scene three-dimensional object position. For example, if the user moves to the position of the bubble in the three-dimensional visual scene, in addition to the reading demonstration, the user can speak the bubble in the pond as a small sentence in the text related to the original text, and explain how to combine the spatial position and the characteristics of the bubble to adjust the language and the rhythm of the reading.
The Chinese reading training method based on mixed reality visualization provided by the invention can be realized by using mixed reality equipment, and comprises the following steps: showing a virtual lesson scene in a classroom; the user can observe the holographic three-dimensional image and interact with the holographic three-dimensional image; the reading guidance can be intelligently customized according to the actual environment information and the personal condition of the user. By using intelligent voice guidance and combining with mixed reality equipment to track the head position and the viewpoint of a user and combining with the scenes of Chinese texts, the virtual text scene display in a physical classroom is completed, and Chinese reading is effectively guided.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (1)
1. A Chinese reading training method based on mixed reality visualization is characterized by comprising the following steps:
s10: starting a mixed reality system;
s20: the mixed reality client scans the entity environment and uploads the entity environment information to the mixed reality server; scanning the physical environment comprises positioning the position of the user and scanning the surrounding environment of the user;
s30: a user requests a three-dimensional scene from a mixed reality server through a mixed reality client;
s40: the mixed reality server calculates and analyzes entity environment information and determines a spatial position which can be used for displaying a three-dimensional visual scene;
s50: the mixed reality server inquires and acquires a three-dimensional scene requested by a user, and the mixed reality server calculates and analyzes the three-dimensional scene requested by the user to generate a three-dimensional visual scene; the three-dimensional visualization scene is a three-dimensional visualization scene with a reading guidance scheme and an interaction scheme,
the reading guidance scheme and the interaction scheme comprise demonstration reading, wherein the demonstration reading carries out annotation prompting in the corresponding three-dimensional visualization scene, and the annotation prompting comprises prompting of reading volume, tone, intonation or rhythm speed according to the corresponding object space relation in the text;
s60: the method comprises the steps that a three-dimensional visual scene is displayed in a space position which can be used for displaying the three-dimensional visual scene by a mixed reality client;
s70: and the user reads aloud through the three-dimensional visual scene observed by the mixed reality client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810799595.XA CN109035906B (en) | 2018-07-19 | 2018-07-19 | Chinese reading training method based on mixed reality visualization |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810799595.XA CN109035906B (en) | 2018-07-19 | 2018-07-19 | Chinese reading training method based on mixed reality visualization |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109035906A CN109035906A (en) | 2018-12-18 |
| CN109035906B true CN109035906B (en) | 2021-08-24 |
Family
ID=64643562
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810799595.XA Active CN109035906B (en) | 2018-07-19 | 2018-07-19 | Chinese reading training method based on mixed reality visualization |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109035906B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110009952A (en) * | 2019-04-12 | 2019-07-12 | 上海乂学教育科技有限公司 | Adaptive learning mobile terminal and learning method based on augmented reality |
| CN110610626A (en) * | 2019-10-15 | 2019-12-24 | 上海乂学教育科技有限公司 | Online mixed reality teaching system |
| CN111445314A (en) * | 2020-02-19 | 2020-07-24 | 上海萃钛智能科技有限公司 | Visual communication system and visual communication method for mixed reality shopping environment |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8144148B2 (en) * | 2007-02-08 | 2012-03-27 | Edge 3 Technologies Llc | Method and system for vision-based interaction in a virtual environment |
| CN102110379A (en) * | 2011-02-22 | 2011-06-29 | 黄振强 | Multimedia reading matter giving readers enhanced feeling of reality |
| CN104732826A (en) * | 2015-03-27 | 2015-06-24 | 宋晓宇 | Augmented reality (AR) interactive teaching material and teaching resource cloud platform |
| CN106408480A (en) * | 2016-11-25 | 2017-02-15 | 山东孔子文化产业发展有限公司 | Sinology three-dimensional interactive learning system and method based on augmented reality and speech recognition |
| CN106781786A (en) * | 2017-01-10 | 2017-05-31 | 东北师大理想软件股份有限公司 | A kind of three-dimensional bookstore tutoring system and method based on augmented reality |
| CN106933357A (en) * | 2017-02-23 | 2017-07-07 | 任刚 | A kind of holographic advertisement play system and method based on wearable mixed reality equipment |
-
2018
- 2018-07-19 CN CN201810799595.XA patent/CN109035906B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN109035906A (en) | 2018-12-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11145100B2 (en) | Method and system for implementing three-dimensional facial modeling and visual speech synthesis | |
| Rogerson-Revell | Computer-assisted pronunciation training (CAPT): Current issues and future directions | |
| Dalim et al. | TeachAR: An interactive augmented reality tool for teaching basic English to non-native children | |
| CN109035906B (en) | Chinese reading training method based on mixed reality visualization | |
| Hikmah | Media for language teaching and learning in digital era | |
| US20110053123A1 (en) | Method for teaching language pronunciation and spelling | |
| Ebert et al. | Ogma: A virtual reality language acquisition system | |
| CN109448467A (en) | A kind of virtual image teacher teaching program request interaction systems | |
| Mahayuddin et al. | Implementing augmented reality (AR) on phonics-based literacy among children with autism | |
| US11887499B2 (en) | Virtual-scene-based language-learning system and device thereof | |
| Teófilo et al. | Exploring virtual reality to enable deaf or hard of hearing accessibility in live theaters: A case study | |
| JP2021006977A (en) | Content control system, content control method, and content control program | |
| Salmon et al. | Augmented reality potential and hype: towards an evaluative framework | |
| Mangiron | Audiovisual translation and multimedia and game localisation | |
| Smith et al. | HCI for the Deaf community: Developing human-like avatars for sign language synthesis | |
| Melchor-Couto et al. | Immersive virtual reality: exploring possibilities for virtual exchange | |
| Bastanfard et al. | A novel multimedia educational speech therapy system for hearing impaired children | |
| Sivakumar | Google glass in education | |
| Adamo-Villani et al. | A study of the effects of teaching avatars on students' learning of surveying mathematics | |
| Paoletti | The body in online teaching: presence or absence of gaze and gestures | |
| Zhong et al. | Developing an online VR tool for participatory evaluation of animal vocal behaviours | |
| Wik et al. | Can visualization of internal articulators support speech perception? | |
| JP6849228B2 (en) | Classroom system | |
| Zhou et al. | Evaluation of a multimodal 3-D pronunciation tutor for learning Mandarin as a second language: An eye-tracking study | |
| JP2021009351A (en) | Content control system, content control method, and content control program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210721 Address after: No. 600, Ligong Road, Jimei District, Xiamen City, Fujian Province 361000 Applicant after: XIAMEN University OF TECHNOLOGY Address before: 361010 room 705, No. 20, Dongming Road, Siming District, Xiamen City, Fujian Province Applicant before: Li Jianxun |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230602 Address after: Unit 501, 5th Floor, Building 5, Aviation Business Plaza, No. 228 Gaoqi South Fifth Road, Xiamen Area, China (Fujian) Pilot Free Trade Zone, Xiamen City, Fujian Province, 361000 Patentee after: Xiamen Qiwushe Research Education Technology Co.,Ltd. Address before: No. 600, Ligong Road, Jimei District, Xiamen City, Fujian Province 361000 Patentee before: XIAMEN University OF TECHNOLOGY |
|
| TR01 | Transfer of patent right |