CN106254848B - A kind of learning method and terminal based on augmented reality - Google Patents

A kind of learning method and terminal based on augmented reality Download PDF

Info

Publication number
CN106254848B
CN106254848B CN201610619423.0A CN201610619423A CN106254848B CN 106254848 B CN106254848 B CN 106254848B CN 201610619423 A CN201610619423 A CN 201610619423A CN 106254848 B CN106254848 B CN 106254848B
Authority
CN
China
Prior art keywords
augmented reality
information
scenery
terminal
image
Prior art date
Application number
CN201610619423.0A
Other languages
Chinese (zh)
Other versions
CN106254848A (en
Inventor
田永胜
尚飞
Original Assignee
宇龙计算机通信科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 宇龙计算机通信科技(深圳)有限公司 filed Critical 宇龙计算机通信科技(深圳)有限公司
Priority to CN201610619423.0A priority Critical patent/CN106254848B/en
Publication of CN106254848A publication Critical patent/CN106254848A/en
Application granted granted Critical
Publication of CN106254848B publication Critical patent/CN106254848B/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/7867Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/156Mixing image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers

Abstract

The embodiment of the invention discloses a kind of learning method and terminal based on augmented reality are applied to mobile communication technology field.The method comprise the steps that the scenery in starting camera scanning reality scene, obtains the image and three-dimensional feature of the scenery;Determine target mode of learning, wherein the target mode of learning be and the matched mode of learning of target user's ages;Request instruction, the matched augmented reality data model of three-dimensional feature of request and the target mode of learning and the scenery are sent to augmented reality server;Receive that the augmented reality server finds out with the matched augmented reality data model of the request instruction;The image of the augmented reality data model and the scenery is synthesized, and the information after synthesis is shown on the display screen of terminal.Implement the embodiment of the present invention, the interest of study can be improved, transfer the subjective enthusiasm of learner.

Description

A kind of learning method and terminal based on augmented reality

Technical field

The present invention relates to mobile communication technology field more particularly to a kind of learning methods and terminal based on augmented reality.

Background technique

Currently, parent is using oneself existing knowledge, children's book or to pass through mostly when carrying out knowledge education to child Network scans for, and carries out early education to child.But since the existing knowledge of parent might not be correct, using net The mode of network search also not necessarily can accurately show that this object is exactly the answer that child wants to know, and use children's book Mode again it is more inflexible, stiff, attention children can not be attracted.Therefore, not only had using above-mentioned traditional educational pattern There is lower interest, and is difficult to transfer the subjective enthusiasm of children.

Summary of the invention

The embodiment of the invention provides a kind of learning method and terminal based on augmented reality, by augmented reality data and very Real contextual data, which carries out synthesis display, can be improved the interest of study, transfer the subjective enthusiasm of learner.

First aspect of the embodiment of the present invention discloses a kind of learning method based on augmented reality, comprising:

Start the scenery in camera scanning reality scene, obtains the image and three-dimensional feature of the scenery;

Determine target mode of learning, wherein the target mode of learning be and the matched study of target user's ages Mode;

Request instruction is sent to augmented reality server, request and the target mode of learning and the scenery The matched augmented reality data model of three-dimensional feature;

Receive that the augmented reality server finds out with the matched augmented reality data mould of the request instruction Type;

The image of the augmented reality data model and the scenery is synthesized, and by the information after synthesis in terminal Display screen on shown.

As an alternative embodiment, described carry out the image of the augmented reality data model and the scenery Synthesis, and before the information after synthesis is shown on the display screen of terminal, the method also includes:

Obtain the location of object information in the image of the scenery;

The image by the augmented reality data model and the scenery synthesizes, and the information after synthesis is existed It is shown on the display screen of terminal, comprising:

The augmented reality data model, and the figure with the scenery are placed according to the location of object information As being synthesized, the information after synthesis is shown on the display screen of terminal.

As an alternative embodiment, described carry out the image of the augmented reality data model and the scenery Synthesis, and after the information after synthesis is shown on the display screen of terminal, the method also includes:

Downloading and the matched scene plot of the augmented reality data model from the augmented reality server;

Into the scene plot, to be interacted with the target user.

As an alternative embodiment, the method also includes:

Detect whether to receive the correction instruction of extraneous input, wherein the correction instruction include error message and with The matched correct information of error message;

If receiving the correction instruction of extraneous input, the correction instruction is sent to the augmented reality server, with It backs up the augmented reality server according to the correction instruction, and obtains the correct information, and to the end End sends the correct information;

The correct information that the augmented reality server is sent is received, the enhancing is updated according to the correct information Real data model.

As an alternative embodiment, the method also includes:

Detect whether the location of object information in the image of the scenery changes;

If the location of object information changes in the image of the scenery, after object variation Location information place the augmented reality data model, the display picture on display screen to update the terminal.

Second aspect of the embodiment of the present invention discloses a kind of terminal, comprising:

Camera unit obtains the image and three-dimensional of the scenery for starting the scenery in camera scanning reality scene Feature;

Determination unit, for determining target mode of learning, wherein the target mode of learning be and target user's age level Secondary matched mode of learning;

First transmission unit, for sending request instruction to augmented reality server, request and the target learn The matched augmented reality data model of the three-dimensional feature of mode and the scenery;

First receiving unit, for receiving that the augmented reality server finds out and the matched institute of the request instruction State augmented reality data model;

Display unit is synthesized, for the image of the augmented reality data model and the scenery to be synthesized, and will Information after synthesis is shown on the display screen of terminal.

As an alternative embodiment, the terminal further include:

Acquiring unit, the location of object information in the image for obtaining the scenery, and drive the synthesis Display unit spatial positional information according to locating for the object places the augmented reality data model, and with the scenery Image synthesized, the information after synthesis is shown on the display screen of terminal.

As an alternative embodiment, the terminal further include:

Download unit, for the downloading from the augmented reality server and the matched field of augmented reality data model Scape plot;

Interactive unit, for entering the scene plot, to be interacted with the target user.

As an alternative embodiment, the terminal further include:

First detection unit, for detecting whether receiving the correction instruction of extraneous input, wherein the correction instruction packet Include error message and with the matched correct information of the error message;

Second transmission unit, for when receiving the correction instruction of extraneous input, Xiang Suoshu augmented reality server to be sent out The correction instruction is sent, so that the augmented reality server is backed up according to the correction instruction, and is obtained described correct Information, and the correct information is sent to the terminal;

Second receiving unit, the correct information sent for receiving the augmented reality server;

First updating unit, for updating the augmented reality data model according to the correct information.

As an alternative embodiment, the terminal further include:

Second detection unit, whether the location of object information becomes in the image for detecting the scenery Change;

Second updating unit, for when the location of object information changes in the image of the scenery, root According to the location information placement augmented reality data model after object variation, on the display screen to update the terminal Display picture.

As can be seen from the above technical solutions, the embodiment of the present invention, which has the advantage that, scans real field by camera Scenery in scape obtains the image and three-dimensional feature of scenery;The determining and matched target mode of learning of target user's ages; The three-dimensional feature of request instruction, request and above-mentioned target mode of learning and above-mentioned scenery is sent to augmented reality server Matched augmented reality data model;And receive that augmented reality server finds out it is existing with the matched enhancing of above-mentioned request instruction Real data model;The image of the augmented reality data model and scenery is synthesized, and by the information after synthesis in terminal It is shown on display screen.Implement the embodiment of the present invention, augmented reality data and real scene data are carried out synthesis display can To improve the interest of study, the subjective enthusiasm of learner is transferred.

Detailed description of the invention

To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly introduced, it should be apparent that, drawings in the following description are only some embodiments of the invention, for this For the those of ordinary skill in field, without any creative labor, it can also be obtained according to these attached drawings His attached drawing.

Fig. 1 is a kind of flow diagram of learning method based on augmented reality disclosed by the embodiments of the present invention;

Fig. 2 is the flow diagram of another learning method based on augmented reality disclosed by the embodiments of the present invention;

Fig. 3 is a kind of structural schematic diagram of terminal disclosed by the embodiments of the present invention;

Fig. 4 is the structural schematic diagram of another terminal disclosed by the embodiments of the present invention;

Fig. 5 is the entity structure schematic diagram of another terminal disclosed by the embodiments of the present invention;

Fig. 6 is a kind of system structure diagram of learning method based on augmented reality disclosed by the embodiments of the present invention.

Specific embodiment

To make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction with attached drawing to the present invention make into It is described in detail to one step, it is clear that the described embodiments are only some of the embodiments of the present invention, rather than whole implementation Example.Based on the embodiments of the present invention, obtained by those of ordinary skill in the art without making creative efforts All other embodiment, shall fall within the protection scope of the present invention.

Description and claims of this specification and term " first " in above-mentioned attached drawing, " second " and " third " are to use In distinguishing different objects, not for description particular order.In addition, term " includes " and their any deformations, it is intended that It covers and non-exclusive includes.Such as it contains the process, method, system, product or equipment of a series of steps or units and does not limit Due to listed step or unit, but optionally further comprising the step of not listing or unit, or optionally further comprising it is right In the intrinsic other step or units of these process, methods, product or equipment.

Augmented reality (Augmented Reality, AR) is a kind of by real world information and virtual world information " seamless " integrated new technology, is the entity information that script is difficult to experience in the certain time spatial dimension of real world (visual information, sound, taste, tactile etc.) is superimposed after analog simulation again by science and technology such as computers, by virtual information It is applied to real world, is perceived by human sensory, thus reach the sensory experience of exceeding reality, abbreviation AR technology.It is one Kind completely new human-computer interaction technology can simulate true live landscape using a kind of such technology, it be with interactivity and It is contemplated that the computer advanced man-machine interface of essential characteristic.In the environment of augmented reality, user can be true around seeing While real environment, it is seen that the enhancement information that computer generates.The information of this enhancing can be in true environment and true The dummy object of environmental coexistence is also possible to certain information about existing real-world object.

The embodiment of the invention provides a kind of learning method and terminal based on augmented reality, by augmented reality data and very Real contextual data, which carries out synthesis display, can be improved the interest of study, transfer learner subjective enthusiasm and family it is mutual Dynamic property of participation.

In the embodiment of the present invention, terminal includes operation Android operation system, iOS operating system, Windows operation system The terminal of system or other operating systems, such as mobile phone, removable computer, tablet computer, desktop computer, personal digital assistant The terminals such as (Personal Digital Assistant, PDA), smartwatch, Intelligent bracelet, the embodiment of the present invention is subsequent not to be made It repeats.

Referring to Fig. 1, Fig. 1 is a kind of process signal of learning method based on augmented reality disclosed by the embodiments of the present invention Figure.Wherein, the learning method of augmented reality shown in FIG. 1 may comprise steps of:

101: the scenery in starting camera scanning reality scene obtains the image and three-dimensional feature of scenery;

In the embodiment of the present invention, when using augmented reality, it is necessary first to start the camera in terminal to reality Scenery in scene is scanned, and obtains the image of scenery, then can carry out necessary processing operation to the image of the scenery, Unwanted data are rejected as far as possible, may include that the operations such as image grayscale processing, binaryzation, feature extraction and contours extract obtain It finds a view the three-dimensional feature of object.

102: determining target mode of learning, wherein above-mentioned target mode of learning is matched with target user's ages Mode of learning;

In the embodiment of the present invention, a variety of modes of learning can be prestored in terminal, such as be suitble to the mode of studying medicine of child, be suitble to The mode of learning of pupil is suitble to the mode of learning of junior school student, is suitble to the mode of learning of high school student, is suitble to the study mould of university student Formula is suitble to the mode of learning etc. of the elderly, and user can select the mode of learning for being suitble to target user's ages in the terminal, Such as be suitble to the mode of learning of child to can be with the form of picture, animation etc. and replace text, it is suitble to the study mould of the elderly Formula can be shown etc. with bigger font.

103: sending request instruction, request and above-mentioned target mode of learning and above-mentioned scape to augmented reality server The matched augmented reality data model of the three-dimensional feature of object;

In the embodiment of the present invention, the image and three-dimensional feature of the scenery in reality scene are obtained by step 101, passes through step After rapid 102 have determined target mode of learning, can to augmented reality server request and above-mentioned target mode of learning with And the matched augmented reality data model of three-dimensional feature of above-mentioned scenery.

Wherein, augmented reality server judges augmented reality server after the request instruction for receiving terminal transmission In default feature database in whether there is and the matched default feature of the three-dimensional feature of above-mentioned scenery, and if it exists, then obtain and should The default corresponding preset augmented reality data model for meeting above-mentioned target mode of learning of feature, specifically, default feature with Preset augmented reality data model is one-to-one relationship, and a default feature is corresponding with suitable all ages and classes level User augmented reality data model, augmented reality server by the feature in the three-dimensional feature of scenery and default feature database into Row compares, and judges to whether there is and the matched default feature of the three-dimensional feature of scenery in default feature database.

Optionally, if in augmented reality server there is no with the matched default feature of the three-dimensional feature of scenery, by increasing Strong reality server is unsuccessfully prompted to terminal transmission, and prompting user, upload request instructs again.

104: receive that above-mentioned augmented reality server finds out with the matched above-mentioned augmented reality number of above-mentioned request instruction According to model;

In the embodiment of the present invention, augmented reality server is found out and the matched augmented reality data mould of above-mentioned request instruction After type, the augmented reality data model matched is sent to terminal.

Wherein, the augmented reality data model in augmented reality server can be preset completion by server quotient.

105: the image of above-mentioned augmented reality data model and above-mentioned scenery being synthesized, and the information after synthesis is existed It is shown on the display screen of terminal.

It, will after terminal receives the augmented reality data model of augmented reality server transmission in the embodiment of the present invention The scene image in reality scene that the augmented reality data model is scanned with camera is synthesized, by augmented reality data mould Type projects in true scene, and the information after synthesis is shown on the display screen of terminal.Wherein, the mode of display can To include superposition display mode, rendering display mode etc..

In the method depicted in fig. 1, the scenery in reality scene is scanned by camera, obtains the image and three of scenery Dimensional feature;The determining and matched target mode of learning of target user's ages;Request instruction is sent to augmented reality server, The matched augmented reality data model of three-dimensional feature of request and above-mentioned target mode of learning and above-mentioned scenery;And it receives Augmented reality server find out with the matched augmented reality data model of above-mentioned request instruction;By the augmented reality data mould The image of type and scenery is synthesized, and the information after synthesis is shown on the display screen of terminal.It is real to implement the present invention Example is applied, augmented reality data and real scene data, which are carried out synthesis display, can be improved the interest of study, transfer learner Subjective enthusiasm.

Further, referring to Fig. 2, Fig. 2 is another study side based on augmented reality disclosed by the embodiments of the present invention The flow diagram of method.Wherein, the learning method of augmented reality shown in Fig. 2 may comprise steps of:

201: the scenery in starting camera scanning reality scene obtains the image and three-dimensional feature of scenery;

202: determining target mode of learning, wherein above-mentioned target mode of learning is matched with target user's ages Mode of learning;

203: sending request instruction, request and above-mentioned target mode of learning and above-mentioned scape to augmented reality server The matched augmented reality data model of the three-dimensional feature of object;

204: receive that above-mentioned augmented reality server finds out with the matched above-mentioned augmented reality number of above-mentioned request instruction According to model;

205: obtaining the location of object information in the image of above-mentioned scenery;

206: above-mentioned augmented reality data model, and the figure with scenery are placed according to the location of above-mentioned object information As being synthesized, the information after synthesis is shown on the display screen of terminal;

It is alternatively possible to carry out the profile diagram that image procossing extracts object to the image of scenery, may thereby determine that Object information the location of in scene image, and then can be according to above-mentioned location information by above-mentioned augmented reality data mould Type is placed in correct position, avoids augmented reality data model and target object location from mismatching and generate deviation, influences user Usage experience.

207: downloading and the matched scene plot of above-mentioned augmented reality data model from augmented reality server;

208: entering the scene plot, interacted with target user;

In the embodiment of the present invention, the scene image in augmented reality data model and real scene is subjected to synthesis display It afterwards, can downloading and the matched scene play of above-mentioned augmented reality data model from augmented reality server under the trigger of the user Feelings are interacted with entering the scene plot with user, may include that the form of dialogue, animation, music etc. is interacted, example Online knowledge question, such as " this is clover, you know that it there are several leaves " can be such as carried out, is answered after user's observation " three pieces ", terminal receive the voice messaging of user, and after speech processes extraction characteristic information, determine that answer is correct, then " good clever, it is right to answer " is answered, it, can be by way of voice or video to this if user clicks interested object Object makes detailed introduction, transfers the learning initiative of user.

209: detecting whether to receive the correction instruction of extraneous input, wherein above-mentioned correction instruction include error message with And with the matched correct information of the wrong data;

In the embodiment of the present invention, if user can pass through boundary there are error message in the augmented reality data model of load Feedback button in face inputs correction instruction, can also input correction instruction by voice, or click directly on the module of mistake Correction instruction etc. is inputted, which kind of mode is specifically used, the embodiment of the present invention does not make uniqueness restriction.

210: if receiving the correction instruction of extraneous input, above-mentioned correction instruction is sent to augmented reality server, with It backs up augmented reality server according to above-mentioned correction instruction, and obtains above-mentioned correct information, and sending to terminal should Correct information;

211: receiving the correct information that augmented reality server is sent, above-mentioned augmented reality number is updated according to the correct information According to model;

After terminal receives the correction instruction of extraneous input, the correction instruction is sent to augmented reality server, wherein entangle Mistake instruction in carry error message and with the matched correct information of the error message, meanwhile, augmented reality server receive To after correction instruction, above-mentioned correction instruction is backed up, similar situation is avoided to occur again, and correct data model is sent out Terminal is given, so that terminal updates the error section in above-mentioned augmented reality data model according to the correct data model.

212: detecting whether the location of object information in the image of scenery changes;

213: if the location of object information changes in the image of scenery, the position after being changed according to object Confidence breath places above-mentioned augmented reality data model, with the display picture on the display screen of more new terminal.

In the embodiment of the present invention, the location information of object in the picture may result in due to shake of user etc. Variation is sent, the display picture on display screen can be updated by obtaining the new location information of object in the picture at this time.

As an alternative embodiment, scene can be obtained through the above steps if photographed changes Augmented reality data model after variation realizes that scene is synchronous with augmented reality data model.

As an alternative embodiment, after obtaining augmented reality data model, it can also be to the augmented reality Data model is stored, to realize augmented reality experience of the terminal under off-line state.

It can be seen from the description of above-described embodiment in practical applications, the embodiment of the present invention can be completed following completely Enhancing content information shows: it is possible, firstly, to (for example, spending, be moved by the camera of terminal in kind using augmented reality Object etc.) picture sampling acquisition three-dimensional feature information is carried out, and the study mould of suitable target user's ages is determined in terminal Formula (for example, picture, animation form etc.), then the three-dimensional feature information for the scenery that is taken is automatically uploaded to augmented reality by terminal Server.Then, knowledge can be compared with the characteristic information in system features library in obtained three-dimensional feature information by server (it is not related to image recognition algorithm), if successful match, the three-dimensional feature pair with the scenery can be found in systems The augmented reality data model of the mode of learning for the suitable target user's ages answered simultaneously returns to terminal, and terminal is receiving After augmented reality data model, synthesis is carried out on the display screen of terminal with the scene image shot in reality scene and is shown. Finally, being interacted by the speech interface in terminal with user.

Referring to Fig. 3, Fig. 3 is a kind of structural schematic diagram of terminal disclosed by the embodiments of the present invention, as shown in figure 3, the end End may include:

Camera unit 301, for starting the scenery in camera scanning reality scene, image and the three-dimensional for obtaining scenery are special Sign;

Determination unit 302, for determining target mode of learning, wherein above-mentioned target mode of learning is and target user year The mode of learning of age multilevel matching;

First transmission unit 303, for sending request instruction, request and above-mentioned determining list to augmented reality server The matched augmented reality of three-dimensional feature for the scenery that the target mode of learning and above-mentioned camera unit 301 that member 302 determines obtain Data model;

First receiving unit 304 is sent out for receive that augmented reality server finds out with above-mentioned first transmission unit 303 The matched augmented reality data model of the request instruction sent;

Synthesize display unit 305, for by the received augmented reality data model of above-mentioned first receiving unit 304 with it is above-mentioned The image for the scenery that camera unit 301 obtains is synthesized, and the information after synthesis is shown on the display screen of terminal.

Referring to Figure 4 together, Fig. 4 is the structural schematic diagram of another terminal disclosed by the embodiments of the present invention.Wherein, Fig. 4 Shown in terminal be that terminal as shown in Figure 3 optimizes, compared with terminal shown in Fig. 3, above-mentioned terminal further include:

Acquiring unit 306, the location of object information in the image for obtaining scenery, and drive above-mentioned synthesis aobvious Show that unit 305 is placed according to the location of above-mentioned object information by the received augmented reality of above-mentioned first receiving unit 304 Data model, and the image of the scenery obtained with above-mentioned camera unit 301 is synthesized, by the information after synthesis in the aobvious of terminal It is shown in display screen.

It wherein, can be to avoid augmented reality data model and the unmatched situation of reality scene by acquiring unit 306.

Optionally, in terminal shown in Fig. 4, which can also include:

Download unit 307, for the downloading from augmented reality server and the above-mentioned matched field of augmented reality data model Scape plot;

Interactive unit 308, for entering above-mentioned scene plot, to be interacted with target user.

Wherein, the purpose interacted with target user may be implemented by download unit 307 and interactive unit 308, Enhance the interest of study.

Optionally, in terminal shown in Fig. 4, which can also include:

First detection unit 309, for detecting whether receiving the correction instruction of extraneous input, wherein above-mentioned error correction refers to Enable include error message and with the matched correct information of the error message;

Second transmission unit 310, for being to receive entangling for extraneous input in above-mentioned 309 testing result of first detection unit When mistake instruction, the correction instruction is sent to augmented reality server, so that augmented reality server is carried out according to the correction instruction Backup, and above-mentioned correct information is obtained, and send the correct information to terminal;

Second receiving unit 311, for receiving the true according to above-mentioned second transmission unit 310 of augmented reality server transmission Fixed correct information;

First with new unit 312, and the correct information for being sent according to above-mentioned second receiving unit 311 updates augmented reality Data model.

Wherein, pass through first detection unit 309, the second transmission unit 310, the second receiving unit 311 and with new unit 312 can be in the augmented reality data model of load there are carrying out error correction when error message, while server is to error message It is backed up, avoids next sounding similar situation.

Optionally, in terminal shown in Fig. 4, which can also include:

Whether second detection unit 313 occurs for the location of object in the image for detecting scenery information Variation;

Second updating unit 314, for when the location of object information changes in the image of scenery, according to Location information after object variation places above-mentioned augmented reality data model, with the display picture on the display screen of more new terminal Face.

Wherein, it can be changed in the position of object by second detection unit 313 and the second updating unit 314 When, the display picture on real-time update terminal display screen.

Referring to Fig. 5, Fig. 5 is the structural schematic diagram of another terminal disclosed by the embodiments of the present invention, as shown in figure 5, should Terminal may include:

Input unit 501, processor unit 502, output unit 503, storage unit 504, communication unit 505, camera The components such as 506 and power supply 507.These components are communicated by one or more bus 508.Those skilled in the art can be with Understand, the structure of terminal shown in fig. 5 does not constitute a limitation of the invention simultaneously, it is also possible to either bus topology Hub-and-spoke configuration can also include component more more or fewer than structure shown in fig. 5, perhaps combine certain components or difference Component layout.In embodiments of the present invention, terminal shown in fig. 5 includes but is not limited to mobile phone, removable computer, plate The various terminals such as computer, personal digital assistant (Personal Digital Assistant, PDA).

Input unit 501 is for realizing the interaction of user and terminal and/or information input into terminal.Of the invention specific In embodiment, input unit 501 can be touch panel, and touch panel is also referred to as touch screen or touch screen, collect user Touch or close operational motion on it.For example user uses any suitable objects or attachment such as finger, stylus in touch-control Operational motion on panel or close to touch panel position, and corresponding attachment device is driven according to preset formula.It can Choosing, touch panel may include both touch detecting apparatus and touch controller.Wherein, touch detecting apparatus detects user Touch operation, and the touch operation that will test is converted to electric signal, and sends electric signal to touch controller;It touches Controller receives electric signal from touch detecting apparatus, and is converted into contact coordinate, then gives processor unit 502.Touching The order and execution that processor unit 502 is sent can also be received by touching controller.Furthermore, it is possible to using resistance-type, condenser type, red The multiple types such as outside line (Infrared) and surface acoustic wave realize touch panel.

Processor unit 502 is the control centre of terminal, utilizes each portion of various interfaces and the entire terminal of connection Point, by running or execute the program code being stored in storage unit 504 and/or module, and call that be stored in storage single Data in member 504, to execute the various functions and/or processing data of terminal.Processor unit 502 can be by integrated circuit (Integrated Circuit, abbreviation IC) composition, such as the IC that can be encapsulated by single are formed, can also be by more of connection The encapsulation IC of identical function or different function and form.For example, processor unit 502 can only include central processing unit (Central ProcessingUnit, abbreviation CPU) is also possible to CPU, digital signal processor (digital signal Processor, abbreviation DSP), in graphics processor (Graphic Processing Unit, abbreviation GPU) and communication unit Control the combination of chip (such as baseband chip).In embodiments of the present invention, CPU can be single operation core, also can wrap Include multioperation core.

Output unit 503 can include but is not limited to image output unit, sound output and sense of touch output unit.Image is defeated Unit is used for output character, picture and/or video out.Image output unit may include display panel, for example, by using liquid crystal display Device (Liquid Crystal Display, LCD), Organic Light Emitting Diode (Organic Light-Emitting Diode, OLED), the forms such as Field Emission Display (field emission display, abbreviation FED) are come the display panel that configures.Or Image output unit may include reflected displaying device, such as electrophoresis-type (electrophoretic) display, or dry using light Relate to the display of modulation tech (Interferometric Modulation of Light).Image output unit may include Individual monitor or various sizes of multiple displays.In a specific embodiment of the invention, above-mentioned input unit 501 is adopted The touch panel used also can be simultaneously as the display panel of output unit 503.Although input unit 501 and output are single in Fig. 5 Member 503 is the function that outputs and inputs of realizing terminal as two independent components, but in some embodiments it is possible to will Touch panel and display panel are integrated and that realizes terminal output and input function.

Storage unit 504 can be used for storing program code and module, and processor unit 502 is stored in storage by operation The program code and module of unit 504, thereby executing the various function application and realization data processing of terminal.Storage unit 504 mainly include program storage area and data storage area, wherein program storage area can storage program area, at least one function Required program code;Data storage area, which can be stored, uses created data (such as audio data, phone directory according to terminal Deng) etc..In the specific embodiment of the invention, storage unit 504 may include volatile memory, such as non-volatile dynamic Random access memory (Nonvolatile RandomAccess Memory, abbreviation NVRAM), phase change random access memory (Phase Change RAM, abbreviation PRAM), magnetic-resistance random access memory (Magetoresistive RAM, abbreviation MRAM) Deng can also include nonvolatile memory, a for example, at least disk memory, electronics can erase can plan read-only storage Device (Electrically Erasable ProgrammableRead-OnlyMemory, abbreviation EEPROM), flush memory device, example Such as anti-or flash memory (NOR flash memory) or anti-and flash memory (NAND flash memory).Nonvolatile storage storage Operating system performed by processor unit 502 and program code.Processor unit 502 is from nonvolatile storage load operating journey Sequence and data are stored in mass storage to memory and by digital content.Operating system includes for controlling and managing routine System task, such as memory management, storage equipment control, power management etc., and help to communicate between various software and hardwares Various assemblies and/or driver.In embodiments of the present invention, operating system can be Google company android system, The iOS system of Apple company exploitation or Windows operating system etc. or Vxworks of Microsoft Corporation exploitation this The embedded OS of class.

Communication unit 505 makes terminal be connected to remote server by communication channel for establishing communication channel, and from remote Journey server downloads of media data.Communication unit 505 may include WLAN (Wireless Local Area Network, abbreviation wireless LAN) module, bluetooth module, wireless near field communication (Near Field Communication, abbreviation NFC), wireless communication modules and the Ethernet, universal serial bus such as base band (Base Band) module (Lightning, Apple is set for iPhone6/6s etc. at present for (Universal Serial Bus, abbreviation USB), lightning interface It is standby) etc. wire communication modules.

Camera 506 is for shooting reality scene.Camera can be divided into digital camera and simulation camera two Major class.The analog video signal of acquisition can be converted into digital signal by digital camera, and then is stored in terminal.Mould The vision signal that quasi- camera captures has to pass through specific capure card and converts analog signals into figure pattern, and adds It is used with just may switch in terminal after compression.Digital camera can directly capture image, and camera is substantially with number at present Based on word camera.Camera generally has the basic functions such as video camera/propagation and still image capture, it is by camera lens After acquiring image, by camera photosensory assembly circuit and control assembly image is carried out being processed and converted to terminal to know Then other digital signal carries out image restoring by terminal.

Power supply 507 is used to be powered to the different components of terminal to maintain its operation.Understand as generality, power supply 507 can be built-in battery, such as common lithium ion battery, nickel-metal hydride battery etc., also include directly to the outer of terminal power supply Connect power supply, such as AC adapter etc..In certain embodiments of the present invention, power supply 507 can also be made more widely to define, It such as can also include power-supply management system, charging system, power failure detection circuit, power adapter or inverter, power supply Positioning indicator (such as light emitting diode), and generate with the electric energy of terminal, manage and be distributed other associated any components.

In terminal device shown in Fig. 5, processor unit 502 can call the program generation stored in storage unit 504 Code, for performing the following operations: starting camera 506 scans the scenery in reality scene, and image and the three-dimensional for obtaining scenery are special Sign;Determine target mode of learning, wherein above-mentioned target mode of learning be and the matched mode of learning of target user's ages; Send request instruction to augmented reality server by communication unit 505, request and above-mentioned target mode of learning and on State the matched augmented reality data model of three-dimensional feature of scenery;Augmented reality server is received by communication unit 505 to search Out with the matched augmented reality data model of above-mentioned request instruction;By the figure of above-mentioned augmented reality data model and above-mentioned scenery As being synthesized, and the information after synthesis is shown on the display screen of terminal.

As another optional embodiment, processor unit 502 calls the program generation stored in storage unit 504 Code, synthesizes by the natural image of above-mentioned augmented reality data model and above-mentioned scenery, and by the information after synthesis at end Before being shown on the display screen at end, it is also used to execute following steps:

Obtain the location of object information in the image of scenery;To according to the location of above-mentioned object information Above-mentioned augmented reality data model is placed, and is synthesized with the image of above-mentioned scenery, by the information after synthesis in the aobvious of terminal It is shown in display screen.

As another optional embodiment, processor unit 502 calls the program generation stored in storage unit 504 Code, synthesizes by the image image of above-mentioned augmented reality data model and above-mentioned scenery, and by the information after synthesis at end After being shown on the display screen at end, it is also used to execute following steps:

Downloading and the matched scene plot of above-mentioned augmented reality data model from augmented reality server;

Into scene plot, to be interacted with target user.

As another optional embodiment, processor unit 502 calls the program generation stored in storage unit 504 Code, is also used to execute following steps:

Detect whether to receive the correction instruction of extraneous input, wherein above-mentioned correction instruction include error message and with The matched correct information of error message;If receiving the correction instruction of extraneous input, pass through communication unit 505 to enhancing Real server sends the correction instruction so that augmented reality server is backed up according to correction instruction, and obtain it is above-mentioned just It firmly believes breath, and sends above-mentioned correct information to terminal;The above-mentioned of augmented reality server transmission is received by communication unit 505 Correct information updates augmented reality data model according to above-mentioned correct information.

As another optional embodiment, processor unit 502 calls the program generation stored in storage unit 504 Code, is also used to execute following steps:

Detect whether the location of object information in the image of above-mentioned scenery changes;If the image of above-mentioned scenery The location of middle object information changes, then it is existing to place above-mentioned enhancing according to the location information after the variation of above-mentioned object Real data model, with the display picture on the display screen of more new terminal.

In the terminal depicted in fig. 5, augmented reality data are carried out synthesis display with real scene data can be improved The interest of study transfers the subjective enthusiasm of learner.

Referring to Fig. 6, Fig. 6 is a kind of system structure of learning method based on augmented reality disclosed by the embodiments of the present invention Schematic diagram, as shown in fig. 6, including augmented reality server 601, terminal 602;

Terminal 602 obtains the image and three-dimensional feature of scenery for starting the scenery in camera scanning reality scene; Determine target mode of learning, wherein above-mentioned target mode of learning be and the matched mode of learning of target user's ages;Xiang Zeng Strong reality server 601 sends the three-dimensional feature of request instruction, request and above-mentioned target mode of learning and above-mentioned scenery Matched augmented reality data model;Receive augmented reality server 601 find out with the matched enhancing of above-mentioned request instruction Real data model;Obtain the location of object information in the image of scenery;Believed according to the location of above-mentioned object Breath places above-mentioned augmented reality data model, and is synthesized with the image image of above-mentioned scenery, by the information after synthesis at end It is shown on the display screen at end;Downloading and the matched scene of above-mentioned augmented reality data model are acute from augmented reality server Feelings;Into scene plot, to be interacted with target user;It detects whether to receive the extraneous correction instruction inputted, wherein on State correction instruction include error message and with the matched correct information of the error message;If receiving the error correction of extraneous input Instruction, then to augmented reality server 601 send the correction instruction so that augmented reality server 601 according to correction instruction into Row backup, and above-mentioned correct information is obtained, and send above-mentioned correct information to terminal 602;Augmented reality server 601 is received to send out The above-mentioned correct information sent updates augmented reality data model according to above-mentioned correct information;Detect mesh in the image of above-mentioned scenery Whether the location of mark object information changes;If the location of object information becomes in the image of above-mentioned scenery Change, then above-mentioned augmented reality data model is placed according to the location information after the variation of above-mentioned object, with the display of more new terminal Display picture on screen.

Augmented reality server 601, for receiving the request instruction of the transmission of terminal 602;It searches and above-mentioned request instruction The augmented reality data model matched;Above-mentioned augmented reality data model is sent to terminal 602;Receive the error correction that terminal 602 is sent Instruction;Backed up according to above-mentioned correction instruction, and obtain with the matched correct information of above-mentioned error message, and to terminal 602 Send the correct information.

It is worth noting that, included each unit is only carried out according to function logic in the embodiment of above-mentioned terminal It divides, but is not limited to the above division, as long as corresponding functions can be realized;In addition, the tool of each functional unit Body title is also only for convenience of distinguishing each other, the protection scope being not intended to restrict the invention.

In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment Point, reference can be made to the related descriptions of other embodiments.

In addition, those of ordinary skill in the art will appreciate that realizing all or part of the steps in above-mentioned each method embodiment It is that relevant hardware can be instructed to complete by program, corresponding program can store in a kind of computer readable storage medium In, storage medium mentioned above can be read-only memory, disk or CD etc..

The above is only the preferable specific embodiments of the present invention, but scope of protection of the present invention is not limited thereto, any Those familiar with the art the variation that can readily occur in or replaces in the technical scope that the embodiment of the present invention discloses It changes, should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with the protection model of claim Subject to enclosing.

Claims (6)

1. a kind of learning method based on augmented reality characterized by comprising
Start the scenery in camera scanning reality scene, obtains the image and three-dimensional feature of the scenery;
Determine target mode of learning, wherein the target mode of learning be and the matched mode of learning of target user's ages;
The three-dimensional of request instruction, request and the target mode of learning and the scenery is sent to augmented reality server The augmented reality data model of characteristic matching;
Receive that the augmented reality server finds out with the matched augmented reality data model of the request instruction;
The image of the augmented reality data model and the scenery is synthesized, and by the information after synthesis in the aobvious of terminal It is shown in display screen;
The image by the augmented reality data model and the scenery synthesizes, and by the information after synthesis in terminal Display screen on shown after, which comprises
Downloading and the matched scene plot of the augmented reality data model from the augmented reality server;
Into the scene plot, to be interacted with the target user;
Detect whether to receive the correction instruction of extraneous input, wherein the correction instruction include error message and with it is described The matched correct information of error message;
If receiving the correction instruction of extraneous input, the correction instruction is sent to the augmented reality server, so that institute It states augmented reality server to be backed up according to the correction instruction, and obtains the correct information, and sent out to the terminal Send the correct information;
The correct information that the augmented reality server is sent is received, the augmented reality is updated according to the correct information Data model.
2. method according to claim 1, which is characterized in that described by the augmented reality data model and the scenery Image is synthesized, and before the information after synthesis is shown on the display screen of terminal, the method also includes:
Obtain the location of object information in the image of the scenery;
The image by the augmented reality data model and the scenery synthesizes, and by the information after synthesis in terminal Display screen on shown, comprising:
Place the augmented reality data model according to the location of object information, and with the image of the scenery into Row synthesis, the information after synthesis is shown on the display screen of terminal.
3. method according to claim 1, which is characterized in that the method also includes:
Detect whether the location of object information in the image of the scenery changes;
If the location of object information changes in the image of the scenery, according to the position after object variation Confidence breath places the augmented reality data model, the display picture on display screen to update the terminal.
4. a kind of terminal characterized by comprising
Camera unit obtains the image and three-dimensional feature of the scenery for starting the scenery in camera scanning reality scene;
Determination unit, for determining target mode of learning, wherein the target mode of learning be and target user's ages The mode of learning matched;
First transmission unit, for sending request instruction, request and the target mode of learning to augmented reality server And the matched augmented reality data model of three-dimensional feature of the scenery;
First receiving unit, for receiving that the augmented reality server finds out and the matched increasing of the request instruction Strong real data model;
Display unit is synthesized, for the image of the augmented reality data model and the scenery to be synthesized, and will synthesis Information afterwards is shown on the display screen of terminal;
The terminal includes: download unit, for the downloading from the augmented reality server and the augmented reality data mould The matched scene plot of type;
Interactive unit, for entering the scene plot, to be interacted with the target user;
First detection unit, for detecting whether receiving the correction instruction of extraneous input, wherein the correction instruction includes mistake False information and with the matched correct information of the error message;
Second transmission unit, for when receiving the correction instruction of extraneous input, Xiang Suoshu augmented reality server to send institute Correction instruction is stated, so that the augmented reality server is backed up according to the correction instruction, and obtains the correct information, And the correct information is sent to the terminal;
Second receiving unit, the correct information sent for receiving the augmented reality server;
First updating unit, for updating the augmented reality data model according to the correct information.
5. terminal according to claim 4, which is characterized in that the terminal further include:
Acquiring unit, the location of object information in the image for obtaining the scenery, and the synthesis is driven to show Unit places the augmented reality data model according to the location of object information, and with the image of the scenery into Row synthesis, the information after synthesis is shown on the display screen of terminal.
6. terminal according to claim 4, which is characterized in that the terminal further include:
Second detection unit, whether the location of object information changes in the image for detecting the scenery;
Second updating unit, for when the location of object information changes in the image of the scenery, according to institute Location information after stating object variation places the augmented reality data model, aobvious on the display screen to update the terminal Show picture.
CN201610619423.0A 2016-07-29 2016-07-29 A kind of learning method and terminal based on augmented reality CN106254848B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610619423.0A CN106254848B (en) 2016-07-29 2016-07-29 A kind of learning method and terminal based on augmented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610619423.0A CN106254848B (en) 2016-07-29 2016-07-29 A kind of learning method and terminal based on augmented reality

Publications (2)

Publication Number Publication Date
CN106254848A CN106254848A (en) 2016-12-21
CN106254848B true CN106254848B (en) 2019-06-11

Family

ID=57606882

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610619423.0A CN106254848B (en) 2016-07-29 2016-07-29 A kind of learning method and terminal based on augmented reality

Country Status (1)

Country Link
CN (1) CN106254848B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107251364A (en) 2014-12-23 2017-10-13 波戈技术有限公司 wireless camera system and method
CN106843473B (en) * 2016-12-30 2020-04-10 武汉市马里欧网络有限公司 AR-based children painting system and method
CN107229339A (en) * 2017-06-23 2017-10-03 福建水立方三维数字科技有限公司 A kind of augmented reality whiteboard system
CN109429053A (en) * 2017-06-29 2019-03-05 深圳市掌网科技股份有限公司 A kind of display methods and system of virtual information
CN107638690A (en) * 2017-09-29 2018-01-30 北京金山安全软件有限公司 Implementation method, device, server and the medium of augmented reality
CN107888934A (en) * 2017-11-22 2018-04-06 广东电网有限责任公司教育培训评价中心 A kind of power transformation technical ability live broadcast system based on AR technologies
CN108052277A (en) * 2017-12-14 2018-05-18 深圳市艾德互联网络有限公司 A kind of AR positioning learning methods and device
CN109931923A (en) * 2017-12-15 2019-06-25 阿里巴巴集团控股有限公司 A kind of navigation guide map generalization method and apparatus
CN108763552A (en) * 2018-06-01 2018-11-06 广东小天才科技有限公司 A kind of learning method and private tutor's machine based on private tutor's machine
CN109547941A (en) * 2018-11-26 2019-03-29 浙江传媒学院 Virtual experimental system implementation method based on augmented reality

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2928805B1 (en) * 2008-03-14 2012-06-01 Alcatel Lucent Method for implementing video enriched on mobile terminals
CN103577788A (en) * 2012-07-19 2014-02-12 华为终端有限公司 Augmented reality realizing method and augmented reality realizing device
CN103050025B (en) * 2012-12-20 2015-09-09 广东欧珀移动通信有限公司 A kind of learning method of mobile terminal and learning system thereof
CN103164518A (en) * 2013-03-06 2013-06-19 杭州九树网络科技有限公司 Mobile terminal (MT) augmented reality application system and method
CN104063150A (en) * 2014-06-30 2014-09-24 惠州Tcl移动通信有限公司 Mobile terminal capable of entering corresponding scene modes by means of face recognition and implementation method thereof
CN104239416A (en) * 2014-08-19 2014-12-24 北京奇艺世纪科技有限公司 User identification method and system
CN104575130A (en) * 2014-11-07 2015-04-29 马振轩 Multi-picture combining and recognizing cartoon education application system for augmented reality technology
CN105243142A (en) * 2015-10-10 2016-01-13 安徽尚舟电子科技有限公司 Intelligent information push method based on augmented reality and visual computation

Also Published As

Publication number Publication date
CN106254848A (en) 2016-12-21

Similar Documents

Publication Publication Date Title
US10198864B2 (en) Running object recognizers in a passable world model for augmented or virtual reality
Billinghurst et al. A survey of augmented reality
Santos et al. Augmented reality learning experiences: Survey of prototype design and evaluation
CN105075246B (en) The method that Tele-immersion formula is experienced is provided using mirror metaphor
Krumm Ubiquitous computing fundamentals
EP2933780B1 (en) Reality augmenting method, client device and server
CN103657087B (en) Formula narration environment on the spot in person
CN104170318B (en) Use the communication of interaction incarnation
WO2018077206A1 (en) Augmented reality scene generation method, device, system and equipment
KR102078427B1 (en) Augmented reality with sound and geometric analysis
CN102884537B (en) Method for equipment positioning and communication
CN104508709B (en) Animation is carried out to object using human body
Craig et al. Developing virtual reality applications: Foundations of effective design
Oulasvirta et al. Embodied interaction with a 3D versus 2D mobile map
JP5340709B2 (en) Method, system and computer program for rendering real world objects and interactions in a virtual world
US8965049B2 (en) Function extension device, function extension method, computer-readable recording medium, and integrated circuit
WO2017044398A1 (en) Tactile interaction in virtual environments
US10446145B2 (en) Question and answer processing method and electronic device for supporting the same
EP2355009A2 (en) Terminal and method for providing augmented reality
CN106999781A (en) Interactive learning building blocks
US20140002443A1 (en) Augmented reality interface
CN107533372A (en) The hybird environment of attachment data is shown
CN102695032A (en) Information processing apparatus, information sharing method, program, and terminal device
CN104126295A (en) Mirrored interface navigation of multiple user interfaces
CN107077292A (en) Clip and paste information providing method and device

Legal Events

Date Code Title Description
PB01 Publication
C06 Publication
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
GR01 Patent grant
GR01 Patent grant