CN108428375A - A kind of teaching auxiliary and equipment based on augmented reality - Google Patents
A kind of teaching auxiliary and equipment based on augmented reality Download PDFInfo
- Publication number
- CN108428375A CN108428375A CN201710078954.8A CN201710078954A CN108428375A CN 108428375 A CN108428375 A CN 108428375A CN 201710078954 A CN201710078954 A CN 201710078954A CN 108428375 A CN108428375 A CN 108428375A
- Authority
- CN
- China
- Prior art keywords
- image
- light
- augmented reality
- virtual image
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
Abstract
Embodiment of the present invention discloses a kind of teaching auxiliary based on augmented reality, including：Send out the first light for including virtual image；Obtain the second light of the real scene image comprising teaching scene；Second light of first light comprising virtual image and the real scene image comprising teaching scene is synthesized.It is different from the prior art, a kind of being combined the real scene image for scene of imparting knowledge to students with virtual image based on the teaching auxiliary of augmented reality of present embodiment offer, virtual image can provide information alert for user, and auxiliary user carries out tutor auxiliary platform, user experience is good, easy to use.
Description
Technical field
Embodiment of the present invention is related to augmented reality field, auxiliary more particularly to a kind of teaching based on augmented reality
Aid method and equipment.
Background technology
Currently, television set when teaching course, is widely used in each educational institution, projecting apparatus etc. plays multimedia
Material, such as video, audio etc..The use of Multi-media Material, the process for effectively making teaching vividly, are remembered convenient for student
Recall, improves educational effect.
In the implementation of the present invention, inventor has found that at least there are the following problems in the related technology：
1) digital information is presented not intuitive enough.Since the presentation of digital information relies primarily on two-dimensional display screen or throwing
Shadow can only be seen in the case where much education scene needs to show threedimensional model from two dimensional surface formula from one or several angles
It examines, not enough intuitively.
2) region that multimedia messages are shown is generally smaller, can not give student feeling on the spot in person.Moreover, if whole
A classroom only has a small amount of screen, since screen is typically placed at classroom front end, for the student to sit in the back row, it may occur that see
Not the case where not knowing screen.
3) general only teacher can control the broadcasting of the multimedia messages, and student can only passively follow, less flexibly.
Invention content
Embodiment of the present invention is mainly solving the technical problems that provide a kind of teaching auxiliary based on augmented reality
And equipment, there is telepresenc, content intuitive display and display area is big, operation is flexible.
In order to solve the above technical problems, embodiment of the present invention provides a kind of teaching auxiliary based on augmented reality,
Including：Send out the first light for including virtual image；Obtain the second light of the real scene image comprising teaching scene；By the packet
Second light of the first light and the real scene image comprising teaching scene containing virtual image is synthesized.
It is different from the prior art, a kind of teaching auxiliary based on augmented reality that present embodiment provides will impart knowledge to students field
The real scene image of scape is combined with virtual image, and virtual image can provide information alert for user, and auxiliary user teaches
Auxiliary is learned, user experience is good, easy to use.
Description of the drawings
One or more embodiments are illustrated by the picture in corresponding attached drawing, these exemplary theorys
The bright restriction not constituted to embodiment, the element with same reference numbers label is expressed as similar element in attached drawing, removes
Non- to have special statement, composition does not limit the figure in attached drawing.
Fig. 1 a are a kind of structural schematic diagrams for tutor auxiliary platform equipment based on augmented reality that the embodiment of the present invention one provides；
Fig. 1 b are that the schematic diagram when wearing on frame is arranged in Clairvoyant type light-guide device shown in Fig. 1 a；
Fig. 1 c are the first relational graphs between the side view angle of display module shown in Fig. 1 a and display brightness；
Fig. 1 d are the second relational graphs between the side view angle of display module shown in Fig. 1 a and display brightness；
Fig. 1 e are the third relational graphs between the side view angle of display module shown in Fig. 1 a and display brightness；
Display module and user face when Fig. 2 a are the tutor auxiliary platform equipment based on augmented reality shown in wearing Fig. 1 a
Position relationship schematic diagram；
Fig. 2 b are the schematic diagrames for rotating display module shown in Fig. 1 a；
Fig. 3 is the image-forming principle schematic diagram of the tutor auxiliary platform equipment based on augmented reality shown in Fig. 1 a；
Signal when Fig. 4 is the tutor auxiliary platform equipment setting diopter correction eyeglass based on augmented reality shown in Fig. 1 a
Figure；
Fig. 5 be tutor auxiliary platform equipment diagonal line field of view shown in Fig. 1 a based on augmented reality and head frame most
Schematic diagram of the distal end to the distance relation of user's head front end；
Schematic diagram when Fig. 6 is the tutor auxiliary platform equipment connection external equipment work based on augmented reality shown in Fig. 1 a；
Fig. 7 is a kind of structural schematic diagram of tutor auxiliary platform equipment based on augmented reality provided by Embodiment 2 of the present invention；
Fig. 8 is the schematic diagram when tutor auxiliary platform equipment connection external equipment shown in Fig. 7 based on augmented reality works；
Fig. 9 is the another signal when tutor auxiliary platform equipment connection external equipment shown in Fig. 7 based on augmented reality works
Figure；
Figure 10 is the schematic diagram when tutor auxiliary platform equipment shown in Fig. 7 based on augmented reality works；
Figure 11 is first aobvious in a kind of teaching auxiliary based on augmented reality that third embodiment of the invention provides
Show the schematic diagram of pattern；
Figure 12 is second aobvious in a kind of teaching auxiliary based on augmented reality that third embodiment of the invention provides
Show the schematic diagram of pattern；
Figure 13 is a kind of the first application of teaching auxiliary based on augmented reality that third embodiment of the invention provides
Instance graph；
Figure 14 is second answering in a kind of teaching auxiliary based on augmented reality that third embodiment of the invention provides
With the schematic diagram of example；
Figure 15 is that a kind of teaching auxiliary based on augmented reality that third embodiment of the invention provides remotely is shown
Schematic diagram when showing；
Figure 16 be third embodiment of the invention provide a kind of teaching auxiliary based on augmented reality learn it is auxiliary
Schematic diagram when helping；
Figure 17 be third embodiment of the invention provide a kind of teaching auxiliary based on augmented reality test it is auxiliary
Schematic diagram when helping；
Figure 18 is that a kind of teaching auxiliary progress eyeball based on augmented reality that third embodiment of the invention provides chases after
Schematic diagram when track is shown.
Specific implementation mode
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that described herein, specific examples are only used to explain the present invention, not
For limiting the present invention.
In addition, as long as technical characteristic involved in the various embodiments of the present invention described below is each other not
Conflict is constituted to can be combined with each other.
Embodiment one
A refering to fig. 1, a kind of tutor auxiliary platform equipment based on augmented reality provided in an embodiment of the present invention are described based on increasing
The total weight of the tutor auxiliary platform equipment of strong reality is less than 350 grams comprising：It is saturating to wear the display module 12, two of frame 11, two
Depending on type light-guide device 13.Wherein, Clairvoyant type light-guide device 13 be a kind of fractional transmission, part reflection optics synthesizer.
The display module 12 and perspective figures light-guide device 13 are all arranged on wearing frame 11, and holder 11 is by display module
12 and perspective figures light-guide device 13 be fixed.Display module 12 is arranged in the upside of perspective figures light-guide device 13, display module
12 light sent out can reflect after perspective figures light-guide device 13.Optionally, the display module 13 may be additionally located at
The side of the Clairvoyant type light-guide device 13.
The tutor auxiliary platform equipment based on augmented reality further includes：Mainboard 17, mainboard 17 are arranged on wearing frame 11,
And between two display modules 12.Processor is provided on the mainboard 17, the processor is for handling virtual image letter
Number and by virtual image presentation of information on display module 12.
In the embodiment of the present invention, head of the frame 11 for being worn on user is worn, each Clairvoyant type light-guide device 13 has
There are a concave surface, the eyes of concave surface towards user to be arranged.Via a Clairvoyant type light-guide device 13 concave reflection the first light into
The left eye of access customer, and via another Clairvoyant type light-guide device 13 concave reflection another first light into the right side of access customer
Eye, to form the vision of 3D virtual scenes in the brains of user.Wherein, the first light is emitted by display module 12, and
First light includes the virtual image information of left eye and right eye.
B refering to fig. 1, two Clairvoyant type light-guide devices 13 are arranged on wearing frame 11, are separately embedded into and wear
On frame 11.Optionally, two areas for corresponding to user's right and left eyes can be set on the raw material for making Clairvoyant type light-guide device
Domain, the shape size in the region are identical as the above-mentioned shape size of each Clairvoyant type light-guide device 13 when being independently arranged；
There are two the regions for corresponding to user's right and left eyes for setting on the Clairvoyant type light-guide device that final effect is one piece big.It is appreciated that
To process two and the Clairvoyant type light-guide device 13 when being independently arranged on the raw material of one piece big of Clairvoyant type light-guide device
The identical region of shape size, i.e. two Clairvoyant type light-guide devices 13 are integrally formed.It is described to be provided with corresponding to user or so
The Clairvoyant type light-guide device in Vitrea eye domain, which is embedded into, to be worn on frame 11.
It should be noted that display module 12 is removably mounted to wear on frame 11, for example, display module be mobile phone,
The intelligent display terminals such as tablet computer；Worn on frame alternatively, display module is fixedly installed in, for example, display module with wear
Frame Integrated design.
Two display modules 12 can be installed by wearing on frame 11, the left eye and right eye of user are respectively correspondingly arranged one
Display module 12 a, for example, display module 12, for emitting the first light for including left eye virtual image information, another is aobvious
Show module 12 for emitting another first light for including right eye virtual image information.Two display modules 12 can respectively one by one
It is correspondingly located at the top of two Clairvoyant type light-guide devices 13, when the tutor auxiliary platform equipment based on augmented reality is worn on user's
When head, two display modules 12 are located at the top of the left eye and right eye of user correspondingly respectively；Display module 12 also may be used
With positioned at the side of Clairvoyant type light-guide device, i.e. two Clairvoyant type light-guide devices are located between two display modules, when based on increasing
When the tutor auxiliary platform equipment of strong reality is worn on the head of user, two display modules are located at the left side of user correspondingly respectively
The side of eye and right eye.
Single display module 12 can also be installed by wearing on frame 11, there are two viewing areas on the single display module 12
Domain, a display area is for emitting the first light for including left eye virtual image information, another display area is for emitting
Include another first light of right eye virtual image information.
C refering to fig. 1, the lateral shaft in figure identify side view angle, and longitudinal axis indicates display brightness.Display module 12 is LCD
When, the brightness of display module 12 is changed with the angle of observer.For common LCD, when display brightness is 50%
Side viewing angle θ it is generally all bigger.
When LCD is applied to for augmented reality display system, then small side viewing angle, such display are relatively specific for
The brightness of module 12 is just concentrated in the angular regions close to center.Because augmented reality display system is mainly used close to center
Angular regions, in this case project to the first light in user's eye and the brightness of the second light can be relatively high.D refering to fig. 1,
Brightness applied to the first light sent out of the LCD in augmented reality display system and the second light is when display brightness is 50%
Side viewing angle θ it is generally all smaller.Also, applied to the first light sent out of the LCD in augmented reality display system and
The distribution of the brightness of second light is symmetrical about 0 degree of side view angle, and side view angle is less than 60 degree.It is that user perspective hangs down
Directly when display module 12, the display brightness of the brightness of the first light and the second light that display module 12 is sent out is maximum, is used
When family visual angle is offset to both sides, display brightness is gradually reduced, when side view angle is less than 60 degree, display brightness 0.
Optionally, e refering to fig. 1, the first light sent out and the second light of the LCD applied to augmented reality display system
Luminance Distribution can be not in relation to that 0 degree of side view angle is symmetrical, and side view angle when display brightness is most bright is not 0 degree.
Display module includes but not limited to LCD (Liquid Crystal Display, liquid crystal display), OLED
(Organic Light-Emitting Diode, Organic Light Emitting Diode), LCOS (Liquid Crystal On Silicon,
Liquid crystal on silicon) etc. types display.
Refering to Fig. 2 a, two display modules 12 are located at the top of two Clairvoyant type light-guide devices 13 correspondingly respectively,
In user's wearing when the tutor auxiliary platform equipment based on augmented reality, display module 12 and the horizontal frontal plane of user's head form one
The angle of angle a, the angle a are 0 degree to 180 degree, preferably obtuse angle.Meanwhile the projection of display module 12 in the horizontal plane
It is vertical with horizontal frontal plane.
Refering to Fig. 2 b, in some instances, the position of perspective figures light-guide device 13 can be around a certain with horizontal plane
Shaft rotates by a certain angle b, and the angle of the angle b is 0 degree to 180 degree, preferably 0 degree to 90 degree.Meanwhile corresponding left eye and
The Clairvoyant type light-guide device 13 of right eye can adjust spacing by wearing the mechanical structure on frame 11, to adapt to different user
Interpupillary distance, comfort level and image quality when ensureing to use.Most long distance between the edge of described two Clairvoyant type light-guide devices 13
It is saturating to being arranged corresponding to right eye from the left hand edge for less than 150 millimeters, that is, corresponding to the Clairvoyant type light-guide device 13 of left eye setting
Distance depending on the right hand edge of type light-guide device 13 is less than 150 millimeters.Correspondingly, being connected by mechanical structure between display module 12
It connects, the distance between described display module 12 can also be adjusted, or by adjusting display content on display module 12
Position reach same effect.
The frame structure that frame 11 can be the spectacle for hanging over user ear and nose bridge is worn, is provided with
Nose support 111 and temple 112, the head of user is fixed on by nose support 111 and temple 112, and the temple 112 is foldable knot
Structure, wherein nose support 111 correspondence are fixed on the bridge of the nose of user, and the correspondence of temple 112 is fixed on the ear of user.Further,
It can also be connected by elastic band between leg of spectacles 112, elastic band tightens leg of spectacles when wearing, helps frame consolidating on head
It is fixed.
Optionally, nose support 111 and temple 112 are telescopic mechanism, can adjust separately the height and temple 112 of nose support 111
Collapsing length.Equally, nose support 111 and temple 112 can also be detachable structure, can be to nose support 111 or temple after dismounting
112 are replaced.
Optionally, it wears frame 11 and may include nose support and stretching elastic ring, be fixed on by nose support and stretching elastic ring and use account
Portion；Or user's head is only fixed on by the stretching elastic ring including stretching elastic ring.Optionally, wearing frame 11 can also
It is the helmet-type frame structure for being worn on the user crown and nose bridge.In the embodiment of the present invention, due to wearing frame 11
Main function is head for being worn on user and for light, electrical components such as display module 12, Clairvoyant type light-guide devices 13
Support is provided, it includes but not limited to aforesaid way to wear frame, under the premise of having above-mentioned main function, people in the art
Member can make several deformations according to the needs of practical application to wearing frame.
Refering to Fig. 3, display module 12 emits the first light 121 for including left eye virtual image information, via a Clairvoyant type
Left eye 14 of the first light 121 that the concave surface 131 of light-guide device 13 is reflected into access customer；Similarly, display module transmitting includes the right side
Eye virtual image information another first light, via another Clairvoyant type light-guide device concave reflection another first light into
The right eye of access customer, to form the visual experience of 3D virtual scenes in the brain of user, in addition, different from Google glass
In such a way that one piece of small display screen is directly set before the right eye in user, cause visual zone smaller, the embodiment of the present invention
In, the first light that more display module transmittings are reflected by two Clairvoyant type light-guide devices respectively enters the eyes of user,
Visual zone is larger.
In embodiments of the present invention, each when the function of the tutor auxiliary platform equipment realization augmented reality based on augmented reality
The convex surface that Clairvoyant type light-guide device 13 is also disposed opposite to each other with one with concave surface；Via the convex surface and concave surface of Clairvoyant type light-guide device 13
The second light comprising external image information of transmission mixes 3D virtual scenes and real scene into the eyes of access customer to be formed
Vision.Referring again to Fig. 1 a, a Clairvoyant type light-guide device 13 also has the convex surface 132 being disposed opposite to each other with concave surface 131, via saturating
The second light 151 comprising external image information transmitted depending on the convex surface 132 of type light-guide device 13 and concave surface 131 is into access customer
Left eye 14, similarly, another Clairvoyant type light-guide device also have the convex surface being disposed opposite to each other with its concave surface, via the guide-lighting member of the Clairvoyant type
The second light comprising external image information of the convex surface of part and concave surface transmission is into the right eye of access customer, and user is it can be seen that the external world
Real scene, to formed mixing 3D virtual scenes and real scene visual experience.
Refering to Fig. 4, optionally, a diopter correction eyeglass 16, institute are set between human eye and Clairvoyant type light-guide device 13
Diopter correction eyeglass 16 is stated perpendicular to horizontal plane to be arranged.Optionally, plane where the diopter correction eyeglass also can be with water
Plane is at 30 degree to 90 degree of angle.Optionally, the diopter correction eyeglass of the different number of degrees can be arbitrarily set.Display module 12 is sent out
The first light 121 for including left eye virtual image information is penetrated, the first light reflected via the concave surface 131 of Clairvoyant type light-guide device 13
Line 121 and the second light for including external image information transmitted via the convex surface 132 of Clairvoyant type light-guide device 13 and concave surface 131
Line 151 first passes through correction of refractive errors eyeglass 16 into before the left eye 14 of access customer.The correction of refractive errors eyeglass 16 is concavees lens, is made
By thereon the first light 121 and the second light 151 diverging, make the first light 121 and the second light 151 in left eye 14
On retrofocus.Equally, the correction of refractive errors eyeglass 16 can also be convex lens, make by thereon the first light 121 and
Second light 151 converges, and makes the focus Forward of the first light 121 and the second light 151 on left eye 14.
Similarly, display module transmitting includes another first light of right eye virtual image information, is led via another Clairvoyant type
Another first light of the concave reflection of optical element and via what the convex surface of the Clairvoyant type light-guide device and concave surface transmitted include
Second light of external image information also first passes through a diopter correction eyeglass into before the right eye of access customer.
It is top with the eyeball of user after the tutor auxiliary platform equipment based on augmented reality is worn in user's head refering to Fig. 5
Point, the both sides of the edge of the eyeball of user to the virtual display area for the virtual image seen by the Clairvoyant type light-guide device 13
Constitute diagonal line field of view.The distalmost end of head frame, can be as needed to being c at a distance from the contact position of head front end
Adjust the distance length of the c.The angular dimension of the diagonal line field of view and the distalmost end of the head frame 11 to
The distance of head front end contact position is inversely proportional.Preferably, under the premise of ensureing that diagonal line field of view is more than 55 degree, head
The distalmost end of portion's frame at a distance from the contact position of head front end be less than 80mm.
Refering to Fig. 6, two display modules 12 pass through in cable connection to mainboard 17.
Video interface, power interface, communication chip and memory are additionally provided on mainboard 17.
The video interface receives vision signal for connecting computer, mobile phone or other equipment.The wherein described video connects
Mouthful can be：Hdmi, display port, thunderbolt or usb type-c, micro usb, MHL (Mobile High-
Definition Link) etc. interfaces.
The processor, for handling data, wherein being mainly used for decoding video signal transmission and being shown in display module
On 12.
The power interface is used for external power supply or battery powered.The power interface includes USB interface or other connect
Mouthful.
The communication chip, for carrying out data interaction with extraneous by communication protocol, specifically by WiFi, WCDMA,
The communication protocols such as TD-LTE connect internet, then by internet obtain data or with other teaching based on augmented reality it is auxiliary
Equipment is helped to connect；Or directly it is connected with other tutor auxiliary platform equipment based on augmented reality by communication protocol.
The memory is mainly used for storing the display data shown in display module 12 for storing data.
When the tutor auxiliary platform equipment based on augmented reality only include it is as described above wear frame 11, two display modules 12,
When two Clairvoyant type light-guide devices 13 and mainboard 17, all 3D virtual scenes render, the image of corresponding eyes generate with
It is carried out in the connected external equipment of tutor auxiliary platform equipment based on augmented reality.The external equipment includes：Computer, mobile phone,
Tablet computer etc..Specifically, the tutor auxiliary platform equipment based on augmented reality receives the video letter of external equipment by video interface
Number, it is shown on display module 12 after decoding.Meanwhile it being set with the interaction of user by the way that computer, mobile phone, tablet computer etc. are external
Standby upper application software carries out, and can be based on enhancing with described by using mouse-keyboard, touch tablet or the button on external equipment
The tutor auxiliary platform equipment of reality interacts.Dummy object can be incident upon user by the tutor auxiliary platform equipment based on augmented reality
A certain fixed position in the visual field.User needs by soft in the equipment that is connected with the tutor auxiliary platform equipment based on augmented reality
Part is adjusted the operations such as the size of projection screen, position.
A kind of tutor auxiliary platform equipment based on augmented reality provided in an embodiment of the present invention passes through the guide-lighting member of two Clairvoyant types
The concave surface of part more reflects into the first light comprising left eye virtual image information and right eye virtual image information respectively
The eyes of access customer, to form the visual experience of 3D virtual scenes in the brain of user, visual zone is larger.
Embodiment two
Refering to Fig. 7, on the basis of a kind of tutor auxiliary platform equipment based on augmented reality provided in embodiment one, setting
Multiple sensors perceived to surrounding enviroment.
A kind of tutor auxiliary platform equipment based on augmented reality provided in this embodiment, the teaching based on augmented reality are auxiliary
The total weight of equipment is helped to be less than 350 grams comprising：Wear frame 21, two display modules, 22, two Clairvoyant type light-guide devices 23 and
Mainboard 24.
The display module 22, perspective figures light-guide device 23 and mainboard 24 are all arranged on wearing frame 21, wear frame
21 display module 22, perspective figures light-guide device 23 and mainboard 24 are fixed.The setting of display module 22 is in the guide-lighting member of perspective figures
The upside of part 23, the light that display module 22 is sent out can reflect after perspective figures light-guide device 23.Mainboard 24, mainboard
24 between two display modules 22, processor are provided on the mainboard 24, the processor is for handling virtual image letter
Number and by virtual image presentation of information on display module 22.
It wears described in frame 21, two display modules, 22, two Clairvoyant type light-guide devices 23, mainboard 24 and embodiment one
Wear frame 11, two display modules, 12, two Clairvoyant type light-guide devices 13, the concrete function of mainboard 17, structure and position relationship
It is identical, herein without repeating.
Equally, a diopter correction eyeglass, the diopter correction are set between human eye and Clairvoyant type light-guide device 23
Eyeglass is arranged perpendicular to horizontal plane.Optionally, the diopter correction eyeglass of the different number of degrees can be arbitrarily set.
Monocular cam 211, binocular/more mesh camera 212, eyeball tracking camera are additionally provided on head frame 21
213, gyroscope 214, accelerometer 215, magnetometer 216, depth of field sensor 217, ambient light sensor 218 and/or apart from biography
Sensor 219.
Monocular cam 211, binocular/more mesh camera 212, eyeball tracking camera 213, gyroscope 214, accelerometer
215, magnetometer 216, depth of field sensor 217, ambient light sensor 218 and/or range sensor 219 are all connected electrically in mainboard 24
On.
Specifically, the monocular cam 211 is colored monocular cam, is positioned over the front of head frame 21.User
When wearing the tutor auxiliary platform equipment based on augmented reality, monocular cam 211 towards the other side relative to user face,
It can be taken pictures using the camera.Further, it can also be detected with computer vision technique to using the camera
The known label in position in environment, helps the tutor auxiliary platform equipment based on augmented reality to be positioned.
The monocular cam 211 can also be high-resolution camera, for taking pictures or shooting video；Shooting institute
The video of acquisition can also be superimposed dummy object seen in user by software, and reproduction user passes through the teaching based on augmented reality
The content that ancillary equipment is seen.
The binocular/more mesh camera 212 can be monochromatic or colour camera, and 21 front of frame is being worn in setting
Or side, and positioned at side, both sides or the surrounding of monocular cam 211.Further, the binocular/more mesh camera 212
Infrared fileter can be carried.Using binocular camera, can further be obtained on image on the basis of obtaining ambient image
Depth of view information.Using more mesh cameras, then the visual angle of camera can be further expanded, obtain more ambient images and the depth of field
Information.The ambient image and range information that double/more mesh cameras 212 capture can be used for:(1) with gyroscope 214, accelerometer
215, the data of magnetometer 216 blend, and calculate the posture of the tutor auxiliary platform equipment based on augmented reality.(2) user hand is captured
Gesture, palmmprint etc. are used for human-computer interaction.
Optionally, each mesh in above-mentioned monocular cam or binocular/more mesh camera can be RGB cameras, list
One kind in color camera or infrared camera.
The eyeball tracking camera 213 is arranged in the side of Clairvoyant type light-guide device 23, and user wears described based on increasing
When the tutor auxiliary platform equipment of strong reality, eyeball tracking camera 213 is towards the side relative to user face.The eyeball tracking
For tracking human eye focus, the privileged site in the virtual article or virtual screen watched attentively to human eye chases after camera 213
Track and specially treated.For example, showing the specifying information etc. of this object automatically beside the object that human eye is watched attentively.In addition to human eye
The region watched attentively can show high-definition virtual article image, and then only show low definition image i.e. to other regions
Can, the calculation amount of image rendering can be effectively reduced in this way, without influencing user experience.
Gyroscope 214, accelerometer 215, magnetometer 216 are arranged between two display modules 22.It can be by merging top
The data of spiral shell instrument 214, accelerometer 215 and magnetometer 216 obtain relative attitude between user's head and system initial position.This
The data that the initial data of sensors can be further with binocular/more mesh camera 212 a bit are merged, and are obtained existing based on enhancing
Position and posture of the real tutor auxiliary platform equipment in fixed environment.
The depth of field sensor 217 is arranged in the front for wearing frame 21, can directly obtain the depth of view information in environment.
Compared with double/more mesh cameras 212, depth of field sensor can obtain more acurrate, the higher depth of field data of resolution ratio.Similar,
It can be with using these data：(1) data with gyroscope 214, accelerometer 215, magnetometer 216 blend, and calculate based on increasing
The posture of the tutor auxiliary platform equipment of strong reality.(2) use and the human-computer interactions such as user gesture, palmmprint are captured.(3) it detects around user
The three-dimensional information of object.
The ambient light sensor 218 is arranged on wearing frame 21, can monitor the power of ambient light in real time.It is based on
The tutor auxiliary platform equipment of augmented reality adjusts the brightness of display module 22 according to the variation of ambient light in real time, to ensure display effect
Consistency of the fruit under varying environment light.
The range sensor 219 is arranged in the position that the tutor auxiliary platform equipment based on augmented reality is contacted with user's face
It sets, for detecting whether the tutor auxiliary platform equipment based on augmented reality is worn on user's head.If user has taken based on enhancing
The tutor auxiliary platform equipment of reality can then be economized on electricity by closing the modes such as display module 22, processor.
Optionally, the tutor auxiliary platform equipment based on augmented reality further includes：Infrared/near infrared light LED is described red
Outside/near infrared light LED is connected electrically on mainboard 24, and the infrared/near infrared light LED is used to carry for binocular/more mesh camera 212
For light source.Specifically, infrared/the near-infrared LED sends out infrared ray, is reached in infrared ray and pass through binocular/more mesh camera 212
When the object of acquisition, the object goes back infrared reflection, and the photosensitive element on binocular/more mesh camera 212 receives reflection
Infrared ray back is simultaneously converted into electric signal, is then carrying out imaging.
For the tutor auxiliary platform equipment based on augmented reality when carrying out human-computer interaction, the operation that can be carried out includes as follows：
(1) display screen can be incident upon a certain fixation in the user visual field by the tutor auxiliary platform equipment based on augmented reality
Position.User can be adjusted the size of projection screen, position by the sensor in the tutor auxiliary platform equipment based on augmented reality
The operations such as set.
(2) gesture, personal recognition can be carried out by various kinds of sensors, is used for human-computer interaction.
(3) intention that user can be judged by eyeball tracking, in virtual article observed by human eye or virtual screen
Privileged site carries out respective handling.
(4) entity or touch button, rocking bar etc. can also be increased on holder, be used for human-computer interaction.
(5) can be furnished with remote controler, have button, rocking bar, Trackpad etc. on remote controler, by wired or wireless mode with
Tutor auxiliary platform equipment based on augmented reality is connected, as human-computer interaction interface.
(6) earphone jack, earplug or loudspeaker can be integrated by increasing audio decoder and power amplifier chip on mainboard
Etc. occurrence of equipment and microphone, allow user interacted using voice and the tutor auxiliary platform equipment based on augmented reality.
Refering to Fig. 8, video interface and processor are provided on mainboard.
When the tutor auxiliary platform equipment based on augmented reality includes wearing frame 21, two display modules 22, two as described above
When a Clairvoyant type light-guide device 23, mainboard 24 and multiple sensors as described above, all 3D virtual scenes render, are corresponding
The processing for the data that the image of eyes generates and multiple sensors obtain can be set with the tutor auxiliary platform based on augmented reality
It is carried out in standby connected external equipment.The external equipment includes：Computer, mobile phone, tablet computer etc..
Specifically, the tutor auxiliary platform equipment based on augmented reality receives the vision signal of external equipment by video interface,
It is shown on display module 23 after decoding.External equipment receives multiple sensors in the tutor auxiliary platform equipment based on augmented reality
The data of acquisition are adjusted the image that eyes are shown according to data after being handled, the figure shown on display module 23
It is embodied as on.Processor in tutor auxiliary platform equipment based on augmented reality is only used for supporting the transmission of vision signal and show
Show and the transmission of sensing data.
Refering to Fig. 9, it is provided with the stronger processor of operational capability on mainboard, part or all of computer vision algorithms make is existed
It is completed in tutor auxiliary platform equipment based on augmented reality.
Specifically, the tutor auxiliary platform equipment based on augmented reality receives the vision signal of external equipment by video interface,
It is shown on display module 23 after decoding.External equipment receives the operative sensor in the tutor auxiliary platform equipment based on augmented reality
The data of acquisition are adjusted the image that eyes are shown according to sensing data after being handled, and are shown on display module 23
It is embodied on the image shown.The data that remaining sensor obtains then are handled in the tutor auxiliary platform equipment based on augmented reality.
For example, monocular cam 211, binocular/more mesh camera 212, gyroscope 214, accelerometer 215, magnetometer 216 and the depth of field pass
The data that sensor 217 obtains are handled in the tutor auxiliary platform equipment based on augmented reality.Eyeball tracking camera 213, ambient light
The data that sensor 218 and range sensor 219 obtain are handled in external equipment.Tutor auxiliary platform equipment based on augmented reality
On processor be used to support the transmission of vision signal and display, the processing of operative sensor data and remaining sensing data
Transmission.
Refering to fig. 10, high performance processor and image processor are provided on mainboard, in the religion based on augmented reality
It learns and completes all operations in ancillary equipment.In such a mode, augmented reality is shown without connecting external equipment, can be used as one
A independent system operation.
Specifically, after the tutor auxiliary platform equipment based on augmented reality is handled the data that sensor obtains, to eyes
The image of display is adjusted, and is shown on display module 23 after rendering.Place in tutor auxiliary platform equipment based on augmented reality
Manage decoding process and display and the processing of sensing data of the device for vision signal.
The tutor auxiliary platform equipment based on augmented reality described in embodiment one and embodiment two realizes augmented reality
In practical application, the reflectivity for the first light that the concave surface in order to increase Clairvoyant type light-guide device emits display module, for example,
The concave surface of Clairvoyant type light-guide device is coated with reflectance coating, preferably, being coated with the reflection of the concave surface of the Clairvoyant type light-guide device of reflectance coating
Rate is 20%-80%.For another example, if the first light is linearly polarized light, in order to increase Clairvoyant type light-guide device concave surface reflectivity,
The concave surface of Clairvoyant type light-guide device is coated with reflection of polarization film, the polarization direction of the polarization direction of reflection of polarization film and the first light it
Between angle be more than 70 ° and be less than or equal to 90 °, such as：The polarization direction of reflection of polarization film and the polarization direction of the first light are hung down
Directly, the reflectivity for being 100% is realized almost, in addition, since the second light comprising external image information is non-polarized light, if thoroughly
Concave surface depending on type light-guide device is coated with reflection of polarization film, when the second light is via the reflection of polarization film, there is the of intimate 50%
For two light into the eyes of access customer, user remains able to see extraneous real scene.In order to preferably allow comprising external image
For second light of information into the eyes of access customer, the convex surface of Clairvoyant type light-guide device is coated with anti-reflection film.
In the practical application of the tutor auxiliary platform equipment based on augmented reality described in embodiment one and embodiment two, it is
Realize that the controllable adjustment of the reflectivity for first light that the concave surface of Clairvoyant type light-guide device emits display module, Clairvoyant type are led
The concave surface of optical element is equipped with pressure-sensitive reflectance coating, by changing voltage swing of the load on pressure-sensitive reflectance coating, can adjust pressure-sensitive
The reflectivity of reflectance coating is between 0 to 100%, when the reflectivity of pressure-sensitive reflectance coating is 100%, the religion based on augmented reality
Learn the function that virtual reality may be implemented in ancillary equipment.
In order to realize another surface of Clairvoyant type light-guide device being disposed opposite to each other with concave surface to comprising external image information
The controllable adjustment of the light transmittance of second light, another surface of Clairvoyant type light-guide device being disposed opposite to each other with concave surface is equipped with pressure-sensitive
Black-film can adjust the height of pressure-sensitive black-film light transmittance by changing voltage swing of the load on pressure-sensitive black-film.
A kind of tutor auxiliary platform equipment based on augmented reality provided in an embodiment of the present invention passes through the guide-lighting member of two Clairvoyant types
The concave surface of part more reflects the first light comprising left eye virtual image information and comprising right eye virtual image information respectively
Into the eyes of access customer, to form the visual experience of 3D virtual scenes in the brain of user, visual zone is larger.Exist simultaneously
Multiple sensors are arranged in tutor auxiliary platform equipment based on augmented reality can be by perception after sensor perceives the environment on periphery
As a result it is embodied in the image shown in display module so that telepresenc is by more preferable, and user experience is more preferably.
Embodiment three
The present embodiment provides a kind of teaching auxiliaries based on augmented reality, including：
Send out the first light for including virtual image；
Obtain the second light of the real scene image comprising teaching scene；
Second light of first light comprising virtual image and the real scene image comprising teaching scene is closed
At.
The real scene image of the teaching scene of the acquisition includes, obtain in scene of imparting knowledge to students real-time any real-world object or
The second light reflected in scene.Exemplary, the real scene image of the acquisition includes：Teach indoor student, desk and chair,
The image or other scenes, object that the objects such as schooling apparatus show after light reflects are presented into after crossing light reflection
Image out.
The acquisition virtual image includes：Obtain the image that display module 12 is shown after processor is handled.Show
Example, the virtual image includes：In 3D models or other images.The 3D models include：Virtual keyboard, virtual mouse
Mark, virtual paper pen or virtual experiment stage property etc..
Two display modules 12 send out warp of first light in conjunction with acquisition of the display data comprising above-mentioned virtual image
The first light for including teaching scene image information of Clairvoyant type light-guide device 13 is crossed, two kinds of light pass through based on augmented reality
It is merged in eyes of user after the synthesis of Clairvoyant type light-guide device 13 in tutor auxiliary platform equipment, at the human brain of user
The content of the display data of virtual image can be presented on user at the moment by reason in the form of three-dimensional.It can be understood as institute
State the classroom realistic picture that the display data of virtual image is incident upon in the user visual field by the tutor auxiliary platform equipment based on augmented reality
As in.
Include when being shown after the scape real scene image of the teaching scene got is synthesized with the virtual image
First display pattern and the second display pattern；First display pattern is that virtual image will produce generation relatively with real scene image
The display pattern of displacement；Second display pattern is virtual image and the relatively-stationary display pattern of real scene image.Specifically,
Refering to fig. 11, virtual 3d model etc. show position of the content in the coordinate system FH of the tutor auxiliary platform equipment based on augmented reality and
Posture is fixed.When user head rotates, the tutor auxiliary platform equipment based on augmented reality is in real space
Position and posture change, i.e. the relative position and posture of FH and FI change, and the display data of projection is in real space
Position and posture in coordinate system FI can also change correspondingly.This display pattern is known as " the first display pattern ".Processor is by institute
State the first light comprising virtual image and the real scene image comprising teaching scene the second light synthesized after it is aobvious with first
Show that pattern is shown.
The tutor auxiliary platform equipment based on augmented reality described in embodiment two in application, monocular cam can be passed through
211, with the known label in position in computer vision technique detection environment, help the teaching based on augmented reality auxiliary
It helps equipment to be positioned, the depth of view information in environment is obtained by depth of field sensor 217.Alternatively, the teaching based on augmented reality
Ancillary equipment can also further be obtained by using binocular/more mesh camera 212 on the basis of obtaining ambient image
The depth of view information on image taken.Then, the tutor auxiliary platform equipment based on augmented reality is by by monocular cam 211, the depth of field
The data that sensor 217 or binocular/more mesh camera 212 obtain are handled, and processor utilizes computer vision technique pair
Ambient enviroment carries out 3D modeling, identifies different objects in true environment in real time and determines their positions and posture in space.
In this way, the tutor auxiliary platform equipment based on augmented reality, which can be analyzed, show which space user nearby has can preferably project void
Quasi- 3D models and other display contents.In addition, the tutor auxiliary platform equipment based on augmented reality can also by gyroscope 214,
Data combination monocular cam 211, depth of field sensor 217 or binocular/more mesh that accelerometer 215, magnetometer 216 obtain are taken the photograph
The image and depth of field data obtained as first 212 calculates position of the tutor auxiliary platform equipment in real space based on augmented reality
And posture, i.e. coordinate system FHWith FIRelative position and angular relationship T.Due to being thrown in the tutor auxiliary platform equipment based on augmented reality
The display data for the virtual image penetrated, such as virtual display, virtual product, in coordinate system FHIn position and posture it is known that
Projection digital content can be obtained in real space (F by TI) in position and angle.Opposite, if wishing, projecting content goes out
Present real space (FI) some position and angle, then can by relationship T, calculate projection content based on augmented reality
Tutor auxiliary platform device coordinate system FHIn position and posture, by virtual screen etc. projection content be positioned over this.
In this way, refering to fig. 12, the tutor auxiliary platform equipment based on augmented reality may be implemented " the second display pattern ".Work as use
It, can be by adjusting the position and appearance that projection content is shown in the tutor auxiliary platform equipment based on augmented reality when person's head rotation
State allows user to feel and thinks that dummy object is true by projection content " fixation " in real space.
Tutor auxiliary platform equipment based on augmented reality use gyroscope, accelerometer and magnetometer, obtain user's head with
" third display pattern " may be implemented under this display pattern in relative angle between local environment, dummy object and environment
Between relative angle fix, but relative position can move.
For example, when user's head rotation, the relative angle of the virtual image of projection in real space does not change
Become, when user moves, the relative position of the dummy keyboard and screen of projection in real space changes, and being followed by makes
User moves.
In conclusion the first display pattern, the second display pattern and third display pattern and true environment and use
Relationship between person head is as shown in the table：
| With environment relative position | With environment relative angle | With head relative position | With head relative angle | |
| First display pattern | It is not fixed | It is not fixed | It is fixed | It is fixed |
| Second display pattern | It is fixed | It is fixed | It is not fixed | It is not fixed |
| Third display pattern | It is not fixed | It is fixed | It is fixed | It is not fixed |
It should be noted that " the first display pattern ", " the second display pattern " or " third display pattern " can be directed to not
Same virtual image is used in mixed way, and can be determined by user can also to be independently arranged by system software.
" first display pattern ", " the second display pattern " or " the third mode " passes through the two dimension that is arranged in real scene image
Code or other aid marks manually set are realized.
Specifically, it scans and knows by monocular cam 211, depth of field sensor 217 or binocular/more mesh camera 212
The Quick Response Code not being arranged in real scene image, the Quick Response Code include to open the first display pattern, open the second display pattern
Information or the information for opening third display pattern.After the information in identifying Quick Response Code, corresponded to the information of the Quick Response Code
Display pattern shown.Such as, it is to open the information of the first display pattern to scan the information in Quick Response Code, then aobvious with first
Show that pattern is shown；Information in the Quick Response Code for another example scanned is to open the second display pattern or third display pattern
Information is then shown with the second display pattern or the third mode.
Similarly, it can scan and know by monocular cam 211, depth of field sensor 217 or binocular/more mesh camera 212
The handmarking not being arranged in real scene image, the handmarking include to open the first display pattern or open second to show
The information of pattern.Such as, identify that the information in handmarking is to open the information of the first display pattern, then with the first display pattern
It is shown；Information in the handmarking for another example identified is to open the information of the second display pattern the third mode, then with the
Two display patterns or the third mode are shown.
The handmarking on two dimensional surface being arranged in Quick Response Code or other real scene images can be also used for auxiliary with second
The tutor auxiliary platform equipment based on augmented reality when display pattern is shown is positioned：It is sensed according to monocular cam 211, the depth of field
The shape and size of the device 217 either Quick Response Code or handmarking of binocular/more mesh camera 212 takes, with the Quick Response Code
Or actual size of the handmarking on two dimensional surface is compared with shape, extrapolates opposite between label and camera
Position and angle.Due to marking position in the environment to fix, then the tutor auxiliary platform based on augmented reality can be thus calculated
The relative position and angular relationship T of equipment and environment, to realize the second display pattern.
Further, virtual image can be manipulated.Tutor auxiliary platform equipment based on augmented reality can be taken the photograph by monocular
As the movement of first 211, depth of field sensor 217 or the gesture of binocular/tracking user of more mesh camera 212, analyze user's
It is intended to, realization operates the content virtually shown.
It is exemplary, it is tracked by using monocular cam 211, depth of field sensor 217 or binocular/more mesh camera 212
The position of the finger of user executes the corresponding operational order of finger click action after recognizing the click action of finger.
It is exemplary, it is identified by using monocular cam 211, depth of field sensor 217 or binocular/more mesh camera 212
To the grasping movement of the gesture of user, then the corresponding instruction of grasping movement is executed, drag operation is carried out to virtual 3d model etc..
It is exemplary, it is identified by using monocular cam 211, depth of field sensor 217 or binocular/more mesh camera 212
To the gesture motion zoomed in or out, then execute the corresponding instruction of the gesture motion zoomed in or out, to virtual 3d model etc. into
Row scaling.
Specifically, refering to fig. 13, on the basis of traditional teaching way, teacher wear described in embodiment one or two based on
The display module 12 of the tutor auxiliary platform equipment of augmented reality, the tutor auxiliary platform equipment based on augmented reality is sent out comprising virtual 3D moulds
First light of type.It is guide-lighting by Clairvoyant type in conjunction with acquisition that two display modules 12 send out the light comprising virtual 3d model
The light of the image information comprising dais of element 13, two kinds of light are by saturating in the tutor auxiliary platform equipment based on augmented reality
Depending on being merged in teacher's eyes after the synthesis of type light-guide device 13, handled by the human brain of teacher, it can be by virtual image with three
The form of dimension is presented on teacher at the moment.The tutor auxiliary platform equipment based on augmented reality be can be understood as by virtual 3d model
It is incident upon on the dais in the teacher visual field.
Then, virtual image is carried out in several students wear the different tutor auxiliary platform equipment based on augmented reality same
Step display.The virtual 3d model for the tutor auxiliary platform equipment projection based on augmented reality that each student wears passes through communication chip
Connect other augmented reality tutor auxiliary platform equipment and by virtual 3d model, size, posture and position, synchronous driving to each
Or it is shown in the display module 12 in the tutor auxiliary platform equipment based on augmented reality of specified student's wearing.By synchronous student
The size, posture and position of dummy object can be controlled and adjusted, and the base that synchronous driving is worn to other students
In the tutor auxiliary platform equipment of augmented reality.
Simultaneous display is applicable in the first display pattern and the second display pattern.In the first display pattern, void is synchronized
Quasi- object is position within the vision in user.If synchronizing display in the second display pattern, virtual graph is synchronized
As the position in real space.And users exist together in a classroom, virtual image appears at sky for owner
Between middle same position, the case where when the experience of collaborative work very close can face an actual products, effect is true to nature.
Optionally, a certain tutor auxiliary platform equipment based on augmented reality can be assigned to administration authority, is appointed by the equipment is specified
One stylobate is possessed of control power limit in the tutor auxiliary platform equipment of augmented reality, controls the virtual 3d model of projection, for example, always
The equipment that teacher wears has administration authority, and the equipment for specifying a certain student to wear by teacher's control device controls.Specify certain
One student to the operation of virtual 3d model also will in other equipment simultaneous display.
Refering to fig. 14, optionally, in the tutor auxiliary platform equipment based on augmented reality that each student or teacher wear
The virtual 3d model shown in display module 12 can project oneself without simultaneous display, all users in face of oneself
Then virtual 3d model be free to control its rotation and other display modes.All wherein a user needs certainly
When oneself 3D model displays are to all users in classroom the inside, some position in classroom can be projected it onto.
Above-mentioned, in teaching auxiliary, academics and students, can be with relatively more natural it can be seen that people at one's side
Mode is exchanged.It is necessary in the case of, student and teacher can walk about in classroom, there will not be and fall down or hit
To the danger of thing.
Optionally, a kind of teaching auxiliary based on augmented reality further includes：Obtain long-range teaching scene
The virtual image shown in real scene image and/or the long-range tutor auxiliary platform equipment based on augmented reality, with local realistic picture
As and/or the local tutor auxiliary platform equipment based on augmented reality in shown in virtual image synthesis after shown.Refering to figure
15, classroom one and classroom two are respectively in different places.A, for B in classroom one, C carries out remote teaching in classroom two.A, B can be with
It is right by the depth of field sensor 217 on the camera being arranged in classroom one and the tutor auxiliary platform equipment based on augmented reality
Environment residing for oneself carries out real-time three-dimensional modeling, and 3-dimensional image is connected network by communication chip and is sent in real time
In the tutor auxiliary platform equipment based on augmented reality of C, it is incident upon C after processor is handled at the moment, is incident upon the three-dimensional shadows of C at the moment
Virtual image shown in the tutor auxiliary platform equipment based on augmented reality worn as the image and/or A, B in classroom where A, B
The virtual image shown in the tutor auxiliary platform equipment based on augmented reality worn with the image and/or C in classroom where C is through processing
Scene after device synthesis.Equally, C can by the 3-dimensional image of oneself by transmission of network to teach that indoor A, B wear based on
In the tutor auxiliary platform equipment of augmented reality, A, B are incident upon after processor is handled at the moment.If the religion based on augmented reality of C
It learns ancillary equipment and uses the second display pattern, ambient enviroment is modeled, then can be by A, the virtual image of B, which is fixed on, to be said
On empty chair before platform.Likewise, A and B teaches indoor empty chair where the three-dimensional image of C can also be fixed on to A and B
On.It in this way, for all persons of attending class, can all think that all persons of attending class are had a meeting in the same classroom, greatly be promoted and faced
Field sense.
Equally, the participant of long-distance education can come from multiple places, can also remotely be taught in a similar manner
It learns.
Refering to fig. 16, user wears the tutor auxiliary platform equipment based on augmented reality, and tutor auxiliary platform equipment is in user face
Preceding projection virtual image, auxiliary user carry out autonomous learning.Tutor auxiliary platform equipment projects virtual 3d model in face of user,
Virtual display can also be projected.Virtual display can be used for browsing webpage, show other data, can improve student
Practise efficiency.Because user can see external environment simultaneously, the tutor auxiliary platform equipment based on augmented reality connects mouse
After mark and keyboard, mouse and keyboard still can be used normally, and allow user's input information in a manner of most familiar of, for example make pen
Note, prepare lessons etc..User can also select to record information with traditional paper pen.
Refering to fig. 17, user wears the tutor auxiliary platform equipment based on augmented reality, and tutor auxiliary platform equipment is in user face
Preceding projection virtual image, auxiliary user independently test.Do experiment be improve manipulative ability it is necessary by way of.But
Some experiments, such as chemical experiment, have certain risk, need specific place and rules and regulations that could carry out safely.
Many experiments are also required to expend a large amount of consumptive material, expensive.Using the tutor auxiliary platform equipment based on augmented reality, user can
To carry out virtual experiment.Tutor auxiliary platform equipment based on augmented reality projects the experimental apparatus of virtual 3D in face of user,
It is used in combination monocular cam 211, depth of field sensor 217 or binocular/more mesh camera 212 to capture the gesture of user to experimental apparatus
It is operated, allows user that can carry out experiment true to nature inside common environment.Requirement to experimental situation is low, without consumption
Take true experiment consumptive material.
Meanwhile on the side of virtual 3D experimental apparatus, the tutor auxiliary platform equipment based on augmented reality may also display experiment
Data, step such as play at the information, can also show experiment guide, help user to enhance memory, improve learning efficiency.Meanwhile it using
Person can also suspend experiment therewith, with the mouse-keyboard online inquiry money being connect with the tutor auxiliary platform equipment based on augmented reality
Material, is taken notes with paper pen.
Optionally, refering to fig. 18, the focus of the eyes of user can be also tracked by eyeball tracking camera 213, to making
Privileged site in virtual article or virtual screen that user's eye focus is watched attentively is tracked and specially treated, for example,
The regional area of the concentrated observation of user's eyes, the specifying information etc. of automatic display annotation and observed object.These are additional
Display equally can be synchronized selectively with other users.
It is different from the prior art, a kind of teaching auxiliary based on augmented reality that present embodiment provides will impart knowledge to students field
The real scene image of scape is combined with virtual image, and virtual image can provide information alert for user, and auxiliary user teaches
It learns, user experience is good, easy to use.
Mode the above is only the implementation of the present invention is not intended to limit the scope of the invention, every to utilize this
Equivalent structure or equivalent flow shift made by description of the invention and accompanying drawing content, it is relevant to be applied directly or indirectly in other
Technical field is included within the scope of the present invention.
Claims (18)
1. a kind of teaching auxiliary based on augmented reality, which is characterized in that including：
Send out the first light for including virtual image；
Obtain the second light of the real scene image comprising teaching scene；
Second light of first light comprising virtual image and the real scene image comprising teaching scene is synthesized.
2. according to the method described in claim 1, it is characterized in that, the real scene image of the acquisition includes：Classroom, religion are indoor
Student, desk and chair, schooling apparatus；The virtual image includes：3D models, virtual keyboard, virtual mouse, virtual study
Apparatus or virtual experiment stage property.
3. method according to claim 1 or 2, which is characterized in that by the real scene image of the teaching scene got
Include the first display pattern, the second display pattern or third display pattern after being synthesized with the virtual image；First display
The all unfixed display pattern of relative angle and relative position of the pattern between virtual image and real scene image；Described second
The all fixed display pattern of relative angle and relative position of the display pattern between virtual image and real scene image；Described
Relative angle of three patterns between virtual image and real scene image is fixed, the unfixed display pattern of relative position.
4. according to the method described in claim 3, it is characterized in that, first display pattern, the second display pattern or third
Display pattern is realized by the Quick Response Code being arranged in real scene image or other aid marks manually set.
5. method according to claim 1 or 2, which is characterized in that the method further includes：The teaching field got
Scape real scene image is shown in after being synthesized with the virtual image in multiple tutor auxiliary platform equipment based on augmented reality, each to be based on
The tutor auxiliary platform equipment of augmented reality communicates to connect, by virtual image in the different tutor auxiliary platform equipment based on augmented reality
Synchronize display.
6. method according to claim 1 or 2, which is characterized in that the method further includes：The movement of gesture is tracked, it is right
Virtual image is operated.
7. method according to claim 1 or 2, which is characterized in that long-range real scene image and/or virtual image are obtained,
It is shown after being synthesized with the local real scene image and/or virtual image of acquisition.
8. method according to claim 1 or 2, which is characterized in that the method further includes：Eyes of user is watched attentively
The privileged site of virtual image is tracked and particular procedure.
9. a kind of tutor auxiliary platform equipment based on augmented reality, including：
Display module, for showing virtual image and sending out the first light comprising virtual image；
Clairvoyant type light-guide device, the second light for obtaining the real scene image comprising teaching scene；Clairvoyant type light-guide device is also
For the second light of first light comprising virtual image and the real scene image comprising teaching scene to be synthesized.
10. equipment according to claim 9, which is characterized in that Clairvoyant type light-guide device obtain real scene image include：Religion
Room, the indoor student of religion, desk and chair, schooling apparatus；The virtual image that display module is shown includes：It is 3D models, virtual
Keyboard, virtual mouse, virtual schooling apparatus or virtual experiment stage property.
11. equipment according to claim 9 or 10, which is characterized in that the equipment further includes processor, gyroscope, adds
Speedometer, magnetometer, monocular cam, depth of field sensor or binocular/more mesh camera, the processor are used for the packet
Second light of the first light containing virtual image and the real scene image comprising teaching scene synthesized after with the first display mould
Formula is shown；Either processor combination gyroscope, accelerometer, magnetometer, monocular cam, depth of field sensor or double
It is shown with the second display pattern after the data of mesh/more mesh camera；Or processor combination gyroscope, accelerometer or magnetic
After the data of field meter, shown with third display pattern；First display pattern is between virtual image and real scene image
Relative angle and all unfixed display pattern of relative position；Second display pattern is virtual image and real scene image
Between all fixed display pattern of relative angle and relative position；The third mode is between virtual image and real scene image
Relative angle fix, the unfixed display pattern of relative position.
12. equipment according to claim 11, which is characterized in that first display pattern passes through with the second display pattern
The Quick Response Code being arranged in real scene image or other aid marks manually set are realized.
13. equipment according to claim 11, which is characterized in that in the monocular cam or binocular/more mesh camera
Each mesh can be one kind in RGB cameras, monochromatic camera or infrared camera.
14. equipment according to claim 9 or 10, which is characterized in that the equipment further includes：Communication chip, for
Other tutor auxiliary platform equipment based on augmented reality are communicatively coupled；Processor sends out the virtual image by communication chip
It send to other in the tutor auxiliary platform equipment based on augmented reality, virtual image is set in other tutor auxiliary platforms based on augmented reality
Display is synchronized in standby.
15. equipment according to claim 9 or 10, which is characterized in that the monocular cam, depth of field sensor or double
Mesh/more mesh camera is additionally operable to the movement of tracking gesture, and identifies gesture motion.
16. equipment according to claim 9 or 10, which is characterized in that communication chip is additionally operable to obtain long-range teaching field
The real scene image and/or virtual image of scape, processor by obtain long-range teaching scene real scene image and/or virtual image and
It is shown after the local real scene image and/or virtual image synthesis of acquisition.
17. equipment according to claim 9 or 10, which is characterized in that the equipment further includes eyeball tracking camera, is used
It is tracked and particular procedure in the privileged site for the virtual image watched attentively to eyes of user.
18. equipment according to claim 9 or 10, which is characterized in that the tutor auxiliary platform equipment based on augmented reality
When being connected with external equipment, can enhancing be based on now with described by using mouse-keyboard, touch tablet or the button on external equipment
Real tutor auxiliary platform equipment interacts.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710078954.8A CN108428375A (en) | 2017-02-14 | 2017-02-14 | A kind of teaching auxiliary and equipment based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710078954.8A CN108428375A (en) | 2017-02-14 | 2017-02-14 | A kind of teaching auxiliary and equipment based on augmented reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108428375A true CN108428375A (en) | 2018-08-21 |
Family
ID=63155016
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710078954.8A Pending CN108428375A (en) | 2017-02-14 | 2017-02-14 | A kind of teaching auxiliary and equipment based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108428375A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109545003A (en) * | 2018-12-24 | 2019-03-29 | 北京卡路里信息技术有限公司 | A kind of display methods, device, terminal device and storage medium |
| CN109879252A (en) * | 2019-04-03 | 2019-06-14 | 济南大学 | Material object interaction suite for preparing chlorine and use method thereof |
| CN110310523A (en) * | 2019-05-28 | 2019-10-08 | 云南东方飞行培训有限公司 | Teaching method, system electronic device and storage medium based on mixed reality |
| CN110379232A (en) * | 2019-07-30 | 2019-10-25 | 赵良华 | The methods of exhibiting imparted knowledge to students based on augmented reality and the multi-person interactive of artificial intelligence |
| CN111081108A (en) * | 2019-12-26 | 2020-04-28 | 中国航空工业集团公司西安飞机设计研究所 | Disassembly and assembly training method and device based on augmented reality technology |
| CN113126770A (en) * | 2021-04-30 | 2021-07-16 | 塔普翊海（上海）智能科技有限公司 | Interactive three-dimensional scenery system based on augmented reality |
| CN113873266A (en) * | 2020-06-30 | 2021-12-31 | 中移(成都)信息通信科技有限公司 | Barrage display method, user terminal, server, device and storage medium |
| WO2022068609A1 (en) * | 2020-09-30 | 2022-04-07 | 北京字跳网络技术有限公司 | Image processing method and apparatus, and electronic device, and computer readable medium |
| CN114327060A (en) * | 2021-12-24 | 2022-04-12 | 华中师范大学 | Working method of virtual teaching system based on AI assistant |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101894488A (en) * | 2009-07-15 | 2010-11-24 | 上海市电力公司超高压输变电公司 | Distributed three-dimensional simulation training system for regional power system transformer station |
| CN102945637A (en) * | 2012-11-29 | 2013-02-27 | 河海大学 | Augmented reality based embedded teaching model and method |
| US20150086953A1 (en) * | 2013-07-25 | 2015-03-26 | Alexander Johansson | Skill building system and method of use |
| CN105431763A (en) * | 2013-06-24 | 2016-03-23 | 微软技术许可有限责任公司 | Tracking head movement when wearing mobile device |
| CN105468142A (en) * | 2015-11-16 | 2016-04-06 | 上海璟世数字科技有限公司 | Interaction method and system based on augmented reality technique, and terminal |
| CN105866955A (en) * | 2016-06-16 | 2016-08-17 | 深圳市世尊科技有限公司 | Smart glasses |
-
2017
- 2017-02-14 CN CN201710078954.8A patent/CN108428375A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101894488A (en) * | 2009-07-15 | 2010-11-24 | 上海市电力公司超高压输变电公司 | Distributed three-dimensional simulation training system for regional power system transformer station |
| CN102945637A (en) * | 2012-11-29 | 2013-02-27 | 河海大学 | Augmented reality based embedded teaching model and method |
| CN105431763A (en) * | 2013-06-24 | 2016-03-23 | 微软技术许可有限责任公司 | Tracking head movement when wearing mobile device |
| US20150086953A1 (en) * | 2013-07-25 | 2015-03-26 | Alexander Johansson | Skill building system and method of use |
| CN105468142A (en) * | 2015-11-16 | 2016-04-06 | 上海璟世数字科技有限公司 | Interaction method and system based on augmented reality technique, and terminal |
| CN105866955A (en) * | 2016-06-16 | 2016-08-17 | 深圳市世尊科技有限公司 | Smart glasses |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109545003B (en) * | 2018-12-24 | 2022-05-03 | 北京卡路里信息技术有限公司 | Display method, display device, terminal equipment and storage medium |
| CN109545003A (en) * | 2018-12-24 | 2019-03-29 | 北京卡路里信息技术有限公司 | A kind of display methods, device, terminal device and storage medium |
| CN109879252A (en) * | 2019-04-03 | 2019-06-14 | 济南大学 | Material object interaction suite for preparing chlorine and use method thereof |
| CN109879252B (en) * | 2019-04-03 | 2022-05-13 | 济南大学 | Material object interaction kit for preparing chlorine and using method thereof |
| CN110310523A (en) * | 2019-05-28 | 2019-10-08 | 云南东方飞行培训有限公司 | Teaching method, system electronic device and storage medium based on mixed reality |
| CN110379232A (en) * | 2019-07-30 | 2019-10-25 | 赵良华 | The methods of exhibiting imparted knowledge to students based on augmented reality and the multi-person interactive of artificial intelligence |
| CN110379232B (en) * | 2019-07-30 | 2021-05-14 | 大连澜创科技有限公司 | Display method for multi-person interactive teaching based on augmented reality and artificial intelligence |
| CN111081108A (en) * | 2019-12-26 | 2020-04-28 | 中国航空工业集团公司西安飞机设计研究所 | Disassembly and assembly training method and device based on augmented reality technology |
| CN113873266A (en) * | 2020-06-30 | 2021-12-31 | 中移(成都)信息通信科技有限公司 | Barrage display method, user terminal, server, device and storage medium |
| WO2022068609A1 (en) * | 2020-09-30 | 2022-04-07 | 北京字跳网络技术有限公司 | Image processing method and apparatus, and electronic device, and computer readable medium |
| CN113126770A (en) * | 2021-04-30 | 2021-07-16 | 塔普翊海（上海）智能科技有限公司 | Interactive three-dimensional scenery system based on augmented reality |
| CN114327060A (en) * | 2021-12-24 | 2022-04-12 | 华中师范大学 | Working method of virtual teaching system based on AI assistant |
| CN114327060B (en) * | 2021-12-24 | 2023-01-31 | 华中师范大学 | Working method of virtual teaching system based on AI assistant |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7316360B2 (en) | Systems and methods for augmented reality | |
| CN108428375A (en) | A kind of teaching auxiliary and equipment based on augmented reality | |
| US10691934B2 (en) | Real-time visual feedback for user positioning with respect to a camera and a display | |
| CN104871084B (en) | Self adaptation projector | |
| CN206497255U (en) | Augmented reality shows system | |
| TWI486631B (en) | Head mounted display and control method thereof | |
| CN104865701B (en) | Head-mounted display device | |
| KR20070047736A (en) | Horizontal perspective display | |
| WO2018149267A1 (en) | Display method and device based on augmented reality | |
| CN108446011A (en) | A kind of medical householder method and equipment based on augmented reality | |
| CN107810634A (en) | Display for three-dimensional augmented reality | |
| CN108421252A (en) | A kind of game implementation method and AR equipment based on AR equipment | |
| CN108427193A (en) | Augmented reality display system | |
| CN103777915A (en) | Immersed type interaction system | |
| WO2018149266A1 (en) | Information processing method and device based on augmented reality | |
| CN108696740A (en) | A kind of live broadcasting method and equipment based on augmented reality | |
| Luo et al. | Development of a three-dimensional multimode visual immersive system with applications in telepresence | |
| JP6479835B2 (en) | I / O device, I / O program, and I / O method | |
| CN114846434A (en) | Non-uniform stereoscopic rendering | |
| Lin | Lightweight and Sufficient Two Viewpoint Connections for Augmented Reality | |
| JP6479836B2 (en) | I / O device, I / O program, and I / O method | |
| WO2024054433A2 (en) | Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments | |
| CN111768659A (en) | Zoom system based on AR interactive teaching equipment | |
| TW202027499A (en) | Calibration method for eye-tracking application | |
| Ausmeier | Mixed Reality Simulators |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20191218 Address after: Room a-b102-1229, 198 Qidi Road, Xiaoshan Economic and Technological Development Zone, Xiaoshan District, Hangzhou City, Zhejiang Province Applicant after: Hangzhou rongmeng Intelligent Technology Co.,Ltd. Address before: 518000 Guangdong city of Shenzhen province Qianhai Shenzhen Hong Kong cooperation zone before Bay Road No. 1 building 201 room A (located in Shenzhen Qianhai business secretary Co. Ltd.) Applicant before: SHENZHEN DREAMWORLD SMART TECHNOLOGY Co.,Ltd. |
|
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180821 |