The methods of exhibiting imparted knowledge to students based on augmented reality and the multi-person interactive of artificial intelligence
Technical field
The present invention relates to interactive teaching technical fields, and in particular to a kind of more people based on augmented reality and artificial intelligence are mutual
The methods of exhibiting of dynamic teaching.
Background technique
Existing interactive teaching device includes: that CAI software, point in computer/tablet computer or smart mobile phone are read in the market
Machine, talking pen, e-book etc..But there is own shortcomings and defect for these above-mentioned existing interactive teaching devices:
1) interactive teaching device interest is insufficient, it is difficult to learner be attracted to be actively engaged in.
2) courseware content in interactive teaching device can not timely update, also can not be according to the study situation of every learner
It is made to measure.
3) instructional system design is complicated, cumbersome, higher using threshold.
4) do not say that more advanced artificial intelligence and augmented reality are applied in teaching.
5) it is not carried out the Real-time Feedback of multi-person interactive study and study situation.
Science and technology is constantly progressive along with the epoch, and the media such as picture, text, video play the role of in interactive teaching process
It is increasing, a large amount of above-mentioned medium data can be all touched in daily life and study from three years old child to cycle of sixty years old man.
However there is stating, unintelligible, content update is slow, cannot be customized and be learned according to study schedule in the technique of expression for traditional medium
The drawbacks such as content are practised, learning efficiency can not be allowed to maximize, so that learner, instructor and overseer have to pay additional essence
Power continues remedial instruction process.
Augmented reality (Augmented Reality abbreviation AR) is gradually studied and applies in recent years.It passes through computer
Virtual information is applied to real world by device, and real world and virtual information are added to the method shown on device in real time
It is very suitable to be applied in teaching.Both the information that virtual information and real world are presented is merged into display using AR technology, allow
It realizes message complementary sense, emphasize, user is promoted to expand the experience on sense organ, promote the quality for receiving information.
In addition, although teacher has used the advanced means such as AR technology to impart knowledge to students, realizes and more effectively lecture knowledge, but
Targeted guidance problem of the teacher in face of several students when is not can solve still.Student is in learning process, because a
Necessarily there is progress difference in body learning ability difference, knowledge point degree not parity problem is grasped, as a knowledge point student
After having grasped, if situations such as teacher continues to teach the knowledge point, and student necessarily will appear attention transfer.Or teacher
When being individually for a certain name student and targetedly imparting knowledge to students, other students also will appear situations such as attention laxes.And teacher
Also it is difficult to teach students in accordance with their aptitude, efficiently, quickly grasps the study schedule and ' Current Knowledge Regarding of each student.
With the development of artificial intelligence (Artificial Intelligence abbreviation AI), there can be reasoning, know
Knowledge, planning, study, exchange, perception, movement and ability of operation object etc..But the energy how to have possessed above-mentioned AI technology
Power is applied in teaching, and is combined with AR technology, and technological gap is still had.
Summary of the invention
Aiming at the shortcomings of the prior art and blank, the present invention provides a kind of more people based on augmented reality and artificial intelligence
The methods of exhibiting and system of interactive teaching, it is more lively, interesting both to have may be implemented the content of courses, has feeling of immersion experience, may be used also
To realize the real-time interactive of the polygonal color and multiple terminals such as teacher, student, supervision, and can also be according to the study feelings of every student
Condition greatly promotes the interest of student's study by system adjust automatically learning Content and teaching method, improves subjective initiative and
Practise effect, meanwhile, also allow the roles such as teacher, supervision more easily and effectively to complete work, enhance between student, between teacher, supervise
Interaction effect between pipe.
In order to achieve the above object, the technical scheme is that being taught based on augmented reality and the multi-person interactive of artificial intelligence
Methods of exhibiting comprising S1 main system, S1 database, C1 control system, K1 subsystem, F1 auxiliary system;
Step 1:C1 control system issues instruction to S1 main system, and S1 main system control S1 database output data mould group arrives
K1 subsystem;
K on step 2:K1 subsystemiDevice, wherein i=1,2 ..., n, receive above-mentioned data mould group, by the data
Mould group is presented to KiDisplay unit and/or KiOn audio output unit, pass through KiInteraction control unit carries out interactive learning;
Step 3:K1 subsystem is by KiThe real time data presented on device is assigned to corresponding F by F1 auxiliary systemiDevice
On, wherein i=1,2 ..., n;And by FiArithmetic element and FiDisplay unit carries out real-time display;
K on step 4:K subsystemiDevice, wherein i=1,2 ..., n, through the AI engine output data in S1 main system
To S1 database, and the total data in S1 database in data with existing mould group is combined, is carried out by the AI engine in S1 main system
Data processing forms KiThe corresponding self-defining data mould group of device, and being stored into S1 database, wherein self-defining data mould group
Including achievement data;
Step 5:S1 main system obtains self-defining data mould group by S1 database, and into K1 subsystem, F1 auxiliary system
Corresponding KiDevice, FiDevice exports achievement data;
Step 6:C1 control system issues instruction to S1 main system, and S1 main system controls the output of S1 database and passes through AI engine
Self-defining data mould group after data processing is to K1 subsystem;
Repeat step 2-6.
It should be noted that i=1 in the application, 2 ..., n;Wherein n takes the natural number greater than 0, above-mentioned customized number
It further include the customized teaching notes data exported by AI engine, customized problem data, customized according to including achievement data in mould group
Some other self-defining data such as language data, customized enquirement data, customized answer data.Achievement data is divided into topic
Mesh number evidence and customized achievement data.Achievement data is exported without AI engine, and customized achievement data is drawn by AI
Hold up the data of processing output.
Based on above-mentioned technical solution, K1 subsystem is by KiThe real time data presented on device is assigned to by F1 auxiliary system
Corresponding FiOn device, regulator can be realized, can obtain its corresponding student's in real time including third parties such as parent, teachers
Study condition.
It in addition, the data mould group obtained is being constantly updated for individual i-th of student, and is oneself according to it
Body updates the study situation of last data mould group, the personalized of progress, constantly forms new self-defining data mould group, in this way
Teaching more there is specific aim, teaching efficiency is more preferable.
Secondly, realizing the real-time interactive of polygonal color and multiple terminals, several students can simultaneously learn data mould group.
Preferably, the data mould group includes basic data mould group, can recognize image mould group, problem data mould group, teaching notes
It is one or more in data mould group and user data component.
Preferably, the basic data mould group includes text data, script data, three-dimensional modeling data, audio data, sound
Happy data, voice data, animation data, video data and/or special effects data;It can recognize that image mould group includes that can recognize picture number
According to and/or customized recognizable image data;Problem data mould group includes problem data and/or customized problem data;Teaching notes
Data mould group includes model answer data, teaching notes data and/or customized teaching notes data;User data component includes achievement number
According to, user information data, customized answer data and/or customized enquirement data.
Further, AI engine carries out data processing and specifically includes data reasoning, knowledge summary, planning in the step 4
Data, learning data, data exchange, sensing capability, mobile data and operation data.
It should be noted that above-mentioned data processing method, for the method that can be completed using general knowledge known in this field.
Further, AI engine obtains K in the step 4iDevice, wherein i=1,2 ..., n are combined after the data of output
By the data in recognizable image mould group already present in S1 database, including the v in each recognizable imagei(i=1,
2 ..., n), yi(i=1,2 ..., n), wi(i=1,2 ..., n) key point data;Via other in AI engine combination S1 database
Data mould group carries out data training, obtains completely new customized recognizable image;
AI engine obtains KiIt combines after the data of device output by teaching notes data mould group already present in S1 database
Data, including the m in each section lesson datai(i=1,2 ..., n), ji(i=1,2 ..., n), Ii(i=1,2 ..., n), ki
(i=1,2 ..., n) key point data carries out data training via data mould groups other in AI engine combination S1 database, obtains
New customized teaching notes data;
AI engine obtains KiIt combines after the data of device output by problem data mould group already present in S1 database
Data, including the n in each problem datai(i=1,2 ..., n), nai(i=1,2 ..., n), qi(i=1,2 ..., n),
qai(i=1,2 ..., n), pi(i=1,2 ..., n) key point data, via other data moulds in AI engine combination S1 database
Group carries out data training, obtains new customized problem data;
AI engine obtains KiIt combines after the data of device output by basic data mould group already present in S1 database
Data, including in each three-dimensional modeling data a1, a2, a3 ..., anCrucial point data;B1 in each video data,
b2、b3、…、bnCrucial point data;C1, c2, c3 in each animation data ..., cnCrucial point data;Each special efficacy number
D1, d2, d3 in ..., dnCrucial point data;E1, e2, e3 in each music data ..., enCrucial point data;It is each
F1, f2, f3 in a script data ..., fnCrucial point data;G1, g2, g3 in each audio data ..., gnKey point
Data;H1, h2, h3 in each text data ..., hnCrucial point data;I1, i2 in each voice data,
i3、…、inCrucial point data;Data training is carried out via data mould groups other in AI engine combination S1 database, is obtained completely new
Basic data mould group;
AI engine obtains KiIt combines after the data of device output by data mould group already present in S1 database, including topic
Data mould group, user data component, basic data mould group, can recognize that image mould group carries out data training at teaching notes data mould group, obtain
To achievement data.
Further, the specific method of the step 1 is that C1 control system passes through the C1 controller and/or C1 on C1 device
Audio output unit issues instruction by C1 communication unit and C1 arithmetic element, by output data mould group in S1 database to K1
System and S1 main system.
Further, the specific method of the step 2 is the K on K1 subsystemiDevice uses KiCommunication unit receives data
Mould group and by KiArithmetic element, KiD engine unit, KiAR engine unit combination KiCamera, KiActual environment is by data mould group
It is presented to KiDisplay unit and KiOn audio output unit, pass through KiInteraction control unit completes interactive learning.
Further, the specific method of the step 3 is K1 subsystem by KiThe real time data presented on device is auxiliary by F1
Auxiliary system is assigned to corresponding FiOn device and by FiArithmetic element and FiDisplay unit carries out real-time display.
Further, the specific method of the step 4 is the K on K1 subsystemiDevice passes through KiInteractive controlling output data
Or via KiAudio output unit passes through the speech recognition engine output data on S1 device and combines existing in S1 database
Problem data mould group, teaching notes data mould group, user data component, basic data mould group, can recognize image mould group in whole numbers
According to by the AI engine progress data processing in S1 main system, the data processing includes data reasoning, knowledge summary, planning number
According to, learning data, data exchange, sensing capability, mobile data and/or operation data;Form KiDevice is corresponding customized to be answered
Case data, achievement data, customized recognizable image, customized problem data;And it is stored into S1 database.
It should be noted that the KiDevice is i-th of student terminal;FiDevice is that the corresponding regulator of i-th of student is whole
End.Wherein student terminal can be mobile phone or the end PC of student, and regulator's terminal can be made by the parent of the student
Mobile phone or the end PC also or are teacher's terminals.
Part term is explained in the present invention:
S1 main system: S1 main system is the nervous centralis of this patent, is responsible for each system of parallel connection S1, C1, K1, F1 and subsystem
System, device and sub-device and S1 database.
S1 database: S1 database is the knowledge element of this system, by basic data, can recognize image, topic, teaching notes,
Several data mould groups such as user are constituted, and new by lasting output device on S1, C1, K1, F1 device and engine output
Data pass through artificial intelligence in turn and persistently construct the more effective data mould group of input.
S1 device: S1 device is responsible for exchange and perception in the present system, draws comprising the speech recognition in S1 system, S1 device
It holds up, AI engine, storage unit, arithmetic element, communication unit, audio output unit, real unit, can recognize image etc., be used for
The input and output identification such as the integrated of C1, S1, K1, F1 system, synthetic operation and artificial intelligence, speech recognition.
K1 subsystem: K1 subsystem acts on study.By K1 subsystem responsible and each system of S1, C1, K1, F1 and subsystem
K under system, device and sub-device and K1 subsystemiSubsystem (KiDevice) it is in parallel, the student in every system is exclusive using its
KiSubsystem (KiDevice) learnt.
KiDevice: KiDevice is by KiCommunication unit, KiD engine unit, KiAudio input unit, KiAudio output unit,
KiAR engine unit, KiCamera, KiThe units such as interaction control unit composition, for carrying and running K1 subsystem.
C1 control system: C1 control system is responsible for the fortune of S1, C1, K1, F1 each system and subsystem, device and sub-device
Row control, and control can be modified to the learning outcome of AI engine.
C1 device: by C1 controller, C1 display unit, C1 audio input unit, C1 audio output unit, C1 communication unit
The units such as member, C1 arithmetic element are constituted, for running C1 control system.
F1 auxiliary system: F1 auxiliary system is supervised under C1 control system authorization has one-one relationship in K1 subsystem
KiThe learning outcome presented on device.
F1 device: F1 device is made of units such as display unit, arithmetic element, communication units, for carrying and running F1
Auxiliary system.
Data mould group: being to constitute in S1 database in initial stage preset several mould groups, comprising: problem data mould group,
Teaching notes data mould group, user data mould group, basic data mould group and recognizable image mould group are constituted.After system start-up, pass through
The each system of S1, C1, K1, F1 and subsystem, device and sub-device pass through AI engine or C1 control system input self-defining data
Afterwards, data mould group is voluntarily learnt and is expanded.
Self-defining data: it is by customized problem data, customized teaching notes data, customized enquirement data, customized answers
Several self-defining datas such as case data, customized recognizable image data are constituted, and above-mentioned data can be the input of C1 control system,
It is also possible to be automatically entered by each system of S1, C1, K1, F1 and subsystem by AI engine.
Actual environment: being different from reality environment, refers to the environment of real world.
Beneficial effects of the present invention: the real-time interactive of the polygonal colors and multiple terminals such as teacher, student, supervision is realized, and also
It can be according to the study situation of every student by system adjust automatically learning Content and teaching method.
Detailed description of the invention
Fig. 1 is flow chart of the method for the present invention;
Fig. 2 is data mould group of the present invention and AI engine interaction diagrams;
Fig. 3 is the device of the invention connection relationship diagram.
Specific embodiment
The present invention will be described in further detail in the following with reference to the drawings and specific embodiments.The present embodiment is with skill of the present invention
Implemented premised on art scheme, the detailed implementation method and specific operation process are given.
As shown in Figures 1 and 3, the methods of exhibiting imparted knowledge to students based on augmented reality and the multi-person interactive of artificial intelligence comprising
S1 main system, S1 database, C1 control system, K1 subsystem, F1 auxiliary system;
Step 1:C1 control system issues instruction to S1 main system, and S1 main system control S1 database output data mould group arrives
K1 subsystem;
K on step 2:K1 subsystemiDevice, wherein i=1,2 ..., n, receive above-mentioned data mould group, by the data
Mould group is presented to KiDisplay unit and/or KiOn audio output unit, pass through KiInteraction control unit carries out interactive learning;
Step 3:K1 subsystem is by KiThe real time data presented on device is assigned to corresponding F by F1 auxiliary systemiDevice
On, wherein i=1,2 ..., n;And by FiArithmetic element and FiDisplay unit carries out real-time display;
K on step 4:K subsystemiDevice, wherein i=1,2 ..., n, through the AI engine output data in S1 main system
To S1 database, and the total data in S1 database in data with existing mould group is combined, is carried out by the AI engine in S1 main system
Data processing forms KiThe corresponding self-defining data mould group of device, and being stored into S1 database, wherein self-defining data mould group
Including achievement data;
Step 5:S1 main system obtains self-defining data mould group by S1 database, and into K1 subsystem, F1 auxiliary system
Corresponding KiDevice, FiDevice exports achievement data;
Step 6:C1 control system issues instruction to S1 main system, and S1 main system controls the output of S1 database and passes through AI engine
Self-defining data mould group after data processing is to K1 subsystem;
Repeat step 2-6.
Preferably, the data mould group includes basic data mould group, can recognize image mould group, problem data mould group, teaching notes
It is one or more in data mould group and user data component.
Preferably, the basic data mould group includes text data, script data, three-dimensional modeling data, audio data, sound
Happy data, voice data, animation data, video data and/or special effects data;It can recognize that image mould group includes that can recognize picture number
According to and/or customized recognizable image data;Problem data mould group includes problem data and/or customized problem data;Teaching notes
Data mould group includes model answer data, teaching notes data and/or customized teaching notes data;User data component includes achievement number
According to, user information data, customized answer data and/or customized enquirement data.
Further, AI engine carries out data processing and specifically includes data reasoning, knowledge summary, planning in the step 4
Data, learning data, data exchange, sensing capability, mobile data and operation data.
As shown in Fig. 2, further, AI engine obtains K in the step 4iDevice, wherein i=1,2 ..., n, output
It combines after data by the data in recognizable image mould group already present in S1 database, including in each recognizable image
vi(i=1,2 ..., n), yi(i=1,2 ..., n), wi(i=1,2 ..., n) key point data;Via AI engine combination S1 data
Other data mould groups carry out data training in library, obtain completely new customized recognizable image;
AI engine obtains KiIt combines after the data of device output by teaching notes data mould group already present in S1 database
Data, including the m in each section lesson datai(i=1,2 ..., n), ji(i=1,2 ..., n), Ii(i=1,2 ..., n), ki
(i=1,2 ..., n) key point data carries out data training via data mould groups other in AI engine combination S1 database, obtains
New customized teaching notes data;
AI engine obtains KiIt combines after the data of device output by problem data mould group already present in S1 database
Data, including the n in each problem datai(i=1,2 ..., n), nai(i=1,2 ..., n), qi(i=1,2 ..., n),
qai(i=1,2 ..., n), pi(i=1,2 ..., n) key point data, via other data moulds in AI engine combination S1 database
Group carries out data training, obtains new customized problem data;
AI engine obtains KiIt combines after the data of device output by basic data mould group already present in S1 database
Data, including in each three-dimensional modeling data a1, a2, a3 ..., anCrucial point data;B1 in each video data,
b2、b3、…、bnCrucial point data;C1, c2, c3 in each animation data ..., cnCrucial point data;Each special efficacy number
D1, d2, d3 in ..., dnCrucial point data;E1, e2, e3 in each music data ..., enCrucial point data;It is each
F1, f2, f3 in a script data ..., fnCrucial point data;G1, g2, g3 in each audio data ..., gnKey point
Data;H1, h2, h3 in each text data ..., hnCrucial point data;I1, i2 in each voice data,
i3、…、inCrucial point data;Data training is carried out via data mould groups other in AI engine combination S1 database, is obtained completely new
Basic data mould group;
AI engine obtains KiIt combines after the data of device output by data mould group already present in S1 database, including topic
Data mould group, user data component, basic data mould group, can recognize that image mould group carries out data training at teaching notes data mould group, obtain
To achievement data.
Further, the specific method of the step 1 is that C1 control system passes through the C1 controller and/or C1 on C1 device
Audio output unit issues instruction by C1 communication unit and C1 arithmetic element, by output data mould group in S1 database to K1
System and S1 main system.
Further, the specific method of the step 2 is the K on K1 subsystemiDevice uses KiCommunication unit receives data
Mould group and by KiArithmetic element, KiD engine unit, KiAR engine unit combination KiCamera, KiActual environment is by data mould group
It is presented to KiDisplay unit and KiOn audio output unit, pass through KiInteraction control unit completes interactive learning.
Further, the specific method of the step 3 is K1 subsystem by KiThe real time data presented on device is auxiliary by F1
Auxiliary system is assigned to corresponding FiOn device and by FiArithmetic element and FiDisplay unit carries out real-time display.
Further, the specific method of the step 4 is the K on K1 subsystemiPass through K interactive controlling output data or warp
Speech recognition engine output data on S1 device is passed through by K audio output unit and combines existing topic number in S1 database
According to the total data in mould group, teaching notes data mould group, user data component, basic data mould group, recognizable image mould group by S1
AI engine in main system carries out data processing, and the data processing includes data reasoning, knowledge summary, layout data, study
Data, data exchange, sensing capability, mobile data and/or operation data;The corresponding customized answer data of formation Ki device,
Achievement data, customized recognizable image, customized problem data;And it is stored into S1 database.
Further explanation to embodiment, the S1 main system are the nervous centralis of this patent, be responsible for parallel connection S1, C1, K1,
The each system of F1 and subsystem, device and sub-device and S1 database;The S1 database is the knowledge element of this system, by
Basic data can recognize that several data mould groups such as image, topic, teaching notes, user are constituted, and pass through C1, S1, K1, F1 device
On lasting output device and engine export new data and then pass through artificial intelligence and persistently construct and input more effective data mould
Group;The S1 device is responsible for exchange and perception in the present system, draws comprising speech recognition engine, the AI in S1 system, S1 device
Hold up, storage unit, arithmetic element, communication unit, audio output unit, real unit, can recognize image etc., for C1, S1,
The input and output identification such as the integrated of K1, F1 system, synthetic operation and artificial intelligence, speech recognition;The K1 subsystem acts on
Study, by under K1 subsystem responsible and each system of C1, S1, K1, F1 and subsystem, device and sub-device and K1 subsystem
KiSubsystem is in parallel, and the student in every system is learnt using its exclusive Ki subsystem;The KiDevice is by KiCommunication unit
Member, Ki d engine unit, Ki audio input unit, Ki audio output unit, KiAR engine unit, KiCamera, KiInteraction control
The units such as unit processed composition, for carrying and running KiSubsystem;
The C1 control system is responsible for the operation control of each system of C1, S1, K1, F1 and subsystem, device and sub-device,
And control can be modified to the learning outcome of AI engine;The C1 device is by C1 controller, C1 display unit, C1 audio input
The units such as unit, C1 audio output unit, C1 communication unit, C1 arithmetic element are constituted, for running C1 control system;The F1
Auxiliary system supervises the K in K1 subsystem with one-one relationship under C1 control system authorizationiThe study knot presented on device
Fruit;The F1 device is made of units such as display unit, arithmetic element, communication units, for carrying and running F1 auxiliary system;
The data mould group is to constitute in S1 database in initial stage preset several mould groups, comprising: problem data mould group, teaching notes number
It is constituted according to mould group, user data mould group, basic data mould group and recognizable image mould group.After system start-up, by C1, S1,
After each system of K1, F1 and subsystem, device and sub-device input self-defining data by AI engine or C1 control system, data
Mould group is voluntarily learnt and is expanded;The self-defining data is by customized problem data, customized teaching notes data, customized
Several self-defining datas of data, customized answer data, customized recognizable image data etc. are putd question to constitute, above-mentioned data can be with
It is the input of C control system, is also possible to be automatically entered by each system of C1, S1, K1, F1 and subsystem by AI engine.
Specifically, S1 database includes: problem data mould group, teaching notes data mould group, user data component, basic data
Mould group and recognizable image mould group are constituted.Wherein problem data mould group includes: problem data, customized problem data;Teaching notes number
It include: model answer data, teaching notes data, customized teaching notes data according to mould group;User data component includes: achievement data, uses
Family information data, customized answer data, customized enquirement data;Basic data mould group include: text data, script data,
Three-dimensional modeling data, audio data, music data, voice data, animation data, video data, special effects data;It can recognize image
Mould group includes: recognizable image data, customized recognizable image data.S1 device includes: speech recognition engine, S1 storage list
Member, S1 arithmetic element, S1 communication unit, AI engine, S1 audio output unit, S1 display unit and recognizable image.C1 device
It include: C1 controller, C1 display unit, C1 audio input unit, C1 audio output unit, C1 communication unit, C1 arithmetic element.
It is understood that KiDevice indicates the terminal that i-th of student uses, and whole system includes several K devices, often
A K device all includes: K communication unit, K d engine unit, K AR engine unit, K display unit, K camera, K communication list
Member, K audio input unit, K audio output unit, K arithmetic element, K interactive unit and K actual environment.Likewise, FiDevice
It indicates corresponding i-th of regulator terminal of i-th of student, includes several F devices in system, each F device includes: F aobvious
Show unit, F arithmetic element, F communication unit.
The above description of the embodiments is intended to facilitate ordinary skill in the art to understand and use the invention.
Person skilled in the art obviously easily can make various modifications to these embodiments, and described herein general
Principle is applied in other embodiments without having to go through creative labor.Therefore, the present invention is not limited to the above embodiments, ability
Field technique personnel announcement according to the present invention, improvement and modification made without departing from the scope of the present invention all should be of the invention
Within protection scope.