CN106060528A - Method and system for enhancing reality based on mobile phone side and electronic whiteboard - Google Patents
Method and system for enhancing reality based on mobile phone side and electronic whiteboard Download PDFInfo
- Publication number
- CN106060528A CN106060528A CN201610635755.8A CN201610635755A CN106060528A CN 106060528 A CN106060528 A CN 106060528A CN 201610635755 A CN201610635755 A CN 201610635755A CN 106060528 A CN106060528 A CN 106060528A
- Authority
- CN
- China
- Prior art keywords
- model
- electronic whiteboard
- mobile phone
- phone terminal
- video camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/293—Generating mixed stereoscopic images; Generating mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/361—Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Processing Or Creating Images (AREA)
- Telephone Function (AREA)
Abstract
The invention provides a method and a system for enhancing a reality based on a mobile phone side and an electronic whiteboard. The method comprises the following steps: a 3D model database is respectively preset at the mobile phone side and the electronic whiteboard side; the mobile phone side obtains a to-be-displayed 3D picture; the mobile phone side obtains a 3D model matched with the picture and an identity of the 3D model from the 3D model databases; the mobile phone side obtains a camera real-time image data; the real-time image data and the identity of the 3D model are sent to the electronic whiteboard side; the electronic whiteboard side obtains the corresponding 3D model from the 3D model databases according to the identity of the 3D model; and the electronic whiteboard side overlaps the obtained 3D model to a camera image to display. By interaction between the mobile phone side and the electronic whiteboard side, the reality enhancement effect at the electronic whiteboard side is realized; and meanwhile, the mobile phone side only needs to send the identity of the 3D model to the electronic whiteboard side, so the data transmission quantity is greatly reduced.
Description
Technical field
The present invention relates to augmented reality, particularly relate to a kind of augmented reality method based on mobile phone terminal and electronic whiteboard
And system.
Background technology
AR technology has been applied to the child markets such as toy at present, but is seldom applied to education sector, and mainly applies
In mobile phone mobile terminal, do not support to use in this hardware systems of electronic whiteboard.
Such as, the Chinese patent of Publication No. CN 105608934A, disclose a kind of AR child's early education children's story stage
Acute system, including model stage and physical equipment；Described physical equipment includes photographic head, identification module, synthesis module, process mould
Block, display device and memorizer；Described photographic head is for capturing the image of described model stage, and described identification module is used for stage
The label information binding of model image and corresponding model stage image；Described synthesis module is used for integrated model stage image and dance
The positional information of platform model image, to memorizer, calls processing module when positional information is correct；Processing module is used for obtaining void
Intend physical model, after analog simulation, true picture is superposed with virtual information, and on display device, show stack result.So
And, the program only achieves the effect at mobile device augmented reality, and the most mutual with electronic whiteboard, it is impossible to be applied to teaching
Field.
Summary of the invention
The technical problem to be solved is: provide a kind of augmented reality method based on mobile phone terminal and electronic whiteboard
And system, it is possible on electronic whiteboard, realize the effect of augmented reality.
In order to solve above-mentioned technical problem, the technical solution used in the present invention is:
A kind of augmented reality method based on mobile phone terminal and electronic whiteboard, including:
3D model database is preset respectively at mobile phone terminal and electronic whiteboard end；
Mobile phone terminal obtains and treats the picture that 3D shows；
Mobile phone terminal obtains the 3D model with described picture match, and the mark of described 3D model from 3D model database
Know；
Mobile phone terminal obtains video camera real time image data；
The mark of described video camera real time image data and described 3D model is sent to electronic whiteboard end；
Electronic whiteboard end obtains the 3D model of correspondence according to the mark of described 3D model from 3D model database；
The 3D model got is superimposed upon on video camera real-time imaging display by electronic whiteboard end.
Another technical scheme that the present invention provides is:
A kind of augmented reality system based on mobile phone terminal and electronic whiteboard, including: mobile phone terminal, electronic whiteboard end and default list
Unit；Described default unit is for presetting 3D model database respectively at mobile phone terminal and electronic whiteboard end；
Described mobile phone terminal includes:
Picture acquisition module, treats, for obtaining, the picture that 3D shows；
Matching module, for obtaining the 3D model with described picture match, and described 3D mould from 3D model database
The mark of type；
Image acquiring module, is used for obtaining video camera real time image data；
Sending module, for sending the mark of described video camera real time image data and described 3D model to electronic whiteboard
End；
Described electronic whiteboard end includes:
3D model acquisition module, for obtaining the 3D mould of correspondence from 3D model database according to the mark of described 3D model
Type；
Display module, for being superimposed upon on video camera real-time imaging display with the 3D model got.
The beneficial effects of the present invention is: obtained by mobile phone terminal and treat the picture that 3D shows, owing to mobile phone terminal is provided with 3D mould
Type data base such that it is able to obtain the 3D model with described picture match and mark thereof from this 3D model database；Mobile phone terminal
Also obtain video camera real time image data；Owing to electronic whiteboard end also is provided with 3D model database, therefore mobile phone terminal have only to by
The mark of this video camera real time image data and 3D model is sent to electronic whiteboard end, and electronic whiteboard end can be from according to this mark
The 3D model database of self finds corresponding 3D model, and then by the video camera real-time imaging received and this corresponding 3D
Model Overlapping display, can realize the effect of augmented reality.The present invention is mutual by mobile phone terminal and electronic whiteboard end, it is achieved
The augmented reality effect of electronic whiteboard end；Further, 3D model database has been preset in electronic whiteboard end this locality, and mobile phone terminal has only to send out
Send the mark of 3D model to electronic whiteboard end, on the one hand considerably reduce volume of transmitted data, on the other hand, even if mobile phone terminal with
The ceased communication of electronic whiteboard end, electronic whiteboard end can also rest in current broadcasting scene.
Accompanying drawing explanation
Fig. 1 is the flow chart of the augmented reality method based on mobile phone terminal and electronic whiteboard of one embodiment of the invention；
Fig. 2 is the structural representation of the augmented reality system based on mobile phone terminal and electronic whiteboard of one embodiment of the invention；
Fig. 3 is the flow chart of the augmented reality method based on mobile phone terminal and electronic whiteboard of the embodiment of the present invention one；
Fig. 4 is the flow chart of the augmented reality method based on mobile phone terminal and electronic whiteboard of the embodiment of the present invention two；
Fig. 5 is the flow chart of the augmented reality method based on mobile phone terminal and electronic whiteboard of the embodiment of the present invention three；
Fig. 6 is the flow chart of the augmented reality method based on mobile phone terminal and electronic whiteboard of the embodiment of the present invention four；
Fig. 7 is the structural representation of the augmented reality system based on mobile phone terminal and electronic whiteboard of the embodiment of the present invention five；
Fig. 8 is the knot of the augmented reality system based on mobile phone terminal and electronic whiteboard being preferable to carry out of the embodiment of the present invention five
Structure schematic diagram.
Label declaration:
1, mobile phone terminal；11, picture acquisition module；12, matching module；13, sending module；14, image acquiring module；15、
First display module；16, the first instruction acquisition module；2, electronic whiteboard end；21,3D model acquisition module；22, display module；
23, control module；24, the second instruction acquisition module；3, unit is preset.
Detailed description of the invention
By describing the technology contents of the present invention in detail, being realized purpose and effect, below in conjunction with embodiment and coordinate attached
Figure is explained.
The design of most critical of the present invention is: mobile phone terminal and electronic whiteboard end preset 3D model database respectively；Mobile phone terminal
Obtain 3D model and the mark of this 3D model treating that picture that 3D shows is corresponding；And video camera real time image data and mark are sent out
Give electronic whiteboard；Electronic whiteboard obtains the 3D model of correspondence according to this mark from 3D model database.
Refer to Fig. 1, the present invention provides:
A kind of augmented reality method based on mobile phone terminal and electronic whiteboard, including:
3D model database is preset respectively at mobile phone terminal and electronic whiteboard end；
Mobile phone terminal obtains and treats the picture that 3D shows；
Mobile phone terminal obtains the 3D model with described picture match, and the mark of described 3D model from 3D model database
Know；
Mobile phone terminal obtains video camera real time image data；
The mark of described video camera real time image data and described 3D model is sent to electronic whiteboard end；
Electronic whiteboard end obtains the 3D model of correspondence according to the mark of described 3D model from 3D model database；
Electronic whiteboard end shows after being superimposed upon on video camera real-time imaging by the 3D model got.
Further, described mobile phone terminal obtains video camera real time image data, farther includes afterwards:
Described 3D model is superimposed upon in video camera real-time imaging display by mobile phone terminal.
Knowable to foregoing description, mobile phone terminal and electronic whiteboard end realize simultaneous display.
Further, the 3D model got is superimposed upon on described video camera image display by described electronic whiteboard end, it
After farther include:
Mobile phone terminal obtains the operational order to described 3D model；
Described operational order is sent to electronic whiteboard end；
Electronic whiteboard end operates accordingly according to the 3D model got described in the control of described operational order.
Knowable to foregoing description, also by the modes such as touch, slip mobile phone terminal, the 3D mould of Synchronization Control electronic whiteboard end
Type carries out rotating, moving.
Further, the 3D model got is superimposed upon on described video camera image display by described electronic whiteboard end, it
After farther include:
Electronic whiteboard end obtains the operational order to described 3D model；
Electronic whiteboard end operates accordingly according to the 3D model got described in the control of described operational order.
Knowable to foregoing description, it is possible to by directly electronic whiteboard end carry out multiple point touching, slide, pull, click etc.
Operation controls to amplify at the 3D model that electronic whiteboard end shows, reduces, rotation etc..
Further, mobile phone terminal obtains the 3D model with described picture match from 3D model database, particularly as follows:
Identify the characteristic information of described picture；
Described characteristic information is compared with the 3D model in the 3D model database of mobile phone terminal, obtains and described appointment
The 3D model of picture match.
Knowable to foregoing description, by the 3D model in the characteristic information of the above-mentioned picture of comparison and 3D model database,
To the 3D model with this picture match.
Refer to Fig. 2, another technical scheme of the present invention is:
A kind of augmented reality system based on mobile phone terminal and electronic whiteboard, including: mobile phone terminal 1, electronic whiteboard end 2 with preset
Unit 3；Described default unit 3 is for presetting 3D model database respectively at mobile phone terminal 1 and electronic whiteboard end 2；
Described mobile phone terminal 1 includes:
Picture acquisition module 11, treats, for obtaining, the picture that 3D shows；
Matching module 12, for obtaining the 3D model with described picture match, and described 3D from 3D model database
The mark of model；
Image acquiring module 14, is used for obtaining video camera real time image data；
Sending module 13, for sending white to electronics by the mark of described video camera real time image data and described 3D model
Plate end；
Described electronic whiteboard end 2 includes:
3D model acquisition module 21, for obtaining the 3D of correspondence from 3D model database according to the mark of described 3D model
Model；
Display module 22, for being superimposed upon on video camera real-time imaging display by the 3D model got.
Knowable to foregoing description, the picture acquisition module 11 of mobile phone terminal 1 gets after the picture that 3D shows, matching module
12 obtain the 3D model with this picture match and mark thereof from the 3D model database of mobile phone terminal, and image acquiring module 14 obtains
The image data of video camera captured in real-time；And by sending module 13, image data and the mark of captured in real-time are sent to electronics
Blank end；Thus the 3D model acquisition module 21 of electronic whiteboard end 2 obtains from the 3D model database of self according to this mark
To corresponding 3D model；And then the 3D model got is superimposed upon on the image of captured in real-time display by display module 22.Invention
The effect of the augmented reality of electronic whiteboard end 2 is realized alternately by mobile phone terminal 1 and electronic whiteboard end 2；And there are transmission data
Measure little advantage.
Further, described mobile phone terminal 1 also includes:
First display module 15, for being superimposed upon on video camera image display by described 3D model.
Knowable to foregoing description, the display module 22 of electronic whiteboard end 2 can be superimposed upon video camera image by just 3D model
Upper display, 3D model is also superimposed upon on video camera image display by the first display module 15 of mobile phone terminal 1, it is achieved mobile phone terminal 1 He
Electronic whiteboard end 2 simultaneous display.
Further, described mobile phone terminal 1 also includes:
First instruction acquisition module 16, for obtaining the operational order to described 3D model；
Described sending module 13 is additionally operable to send to electronic whiteboard end 2 described operational order；
Described electronic whiteboard end 2 also includes:
Control module 23, gets described in controlling according to the operational order of described first instruction acquisition module 16 acquisition
3D model operate accordingly.
Further, described electronic whiteboard end 2 also includes:
Second instruction acquisition module 24, for obtaining the operational order to described 3D model；
Control module 23, for according to the 3D got described in the operational order control of the second instruction acquisition module 24 acquisition
Model operates accordingly.
Knowable to foregoing description, can be obtained mobile phone terminal 3D model by the first instruction acquisition module 16 of mobile phone terminal 1
Operational order, then send this operational order to electronic whiteboard end 2 by sending module 13, it is achieved mobile phone terminal 1 remotely controlled electronically
The 3D model manipulation of blank end 2；Also can be obtained electronic whiteboard end 2 by the second instruction acquisition module 24 of electronic whiteboard end 2
The operational order of 3D model, directly control the 3D model manipulation of electronic whiteboard end 2.
Refer to Fig. 3, embodiments of the invention one are:
A kind of augmented reality method based on mobile phone terminal and electronic whiteboard, including:
3D model database is preset respectively at mobile phone terminal and electronic whiteboard end；
Mobile phone terminal obtains and treats the picture that 3D shows；Show for example, it is desired to picture A is carried out 3D, then scanned by mobile phone terminal
Picture A；
Mobile phone terminal obtains the 3D model with described picture match, and the mark of described 3D model from 3D model database
Know；Concrete, including: identify the characteristic information of described picture；By in the described characteristic information 3D model database with mobile phone terminal
3D model compare, obtain the 3D model mated with described designated pictures；And obtain the mark of this 3D model；Described mark
It can be the ID numbering of 3D model；
Mobile phone terminal obtains video camera real time image data；
Described 3D model is superimposed upon on video camera real-time imaging display by mobile phone terminal；Meanwhile, by real-time for described video camera shadow
As the mark of data and described 3D model sends to electronic whiteboard end；
Electronic whiteboard end obtains the 3D model of correspondence according to the mark of described 3D model from 3D model database；Such as,
Assume that ID is a, then the 3D model selecting ID to be a from 3D model database；
The 3D model that electronic whiteboard end gets is superimposed upon on video camera real-time imaging display；Concrete, during display, electronics
Blank end first renders video camera real-time imaging according to the video camera real time image data received, more real-time at described video camera
The 3D model that on image, superposition gets；As by the above-mentioned 3D mould that ID is a selected from electronic whiteboard end 3D model database
Type is superimposed upon on the video camera real-time imaging rendered；Above-mentioned mobile phone terminal shows in like manner.
Refer to Fig. 4, embodiments of the invention two are:
A kind of augmented reality method based on mobile phone terminal and electronic whiteboard, the difference with above-described embodiment one is:
The 3D model got is superimposed upon on described video camera real-time imaging display by described electronic whiteboard end, laggard one
Step includes:
Mobile phone terminal obtains the operational order to described 3D model；Such as, the screen of slip mobile phone terminal, control the rotation of this 3D model
Turn；
Described operational order is sent to electronic whiteboard end；Such as, white by the control instruction of 3D model is sent to electronics
Plate；
Electronic whiteboard end operates accordingly according to the 3D model got described in the control of described control instruction；Realize
On electronic whiteboard, this 3D model of Synchronization Control rotates.
Refer to Fig. 5, embodiments of the invention three are:
A kind of augmented reality method based on mobile phone terminal and electronic whiteboard, the difference with above-described embodiment is:
The 3D model of acquisition is superimposed upon on described video camera real-time imaging display by described electronic whiteboard end, the most further
Including:
Electronic whiteboard end obtains the operational order to described 3D model；
Electronic whiteboard end operates accordingly according to the 3D model got described in the control of described operational order；Such as,
The screen of slip electronic whiteboard end, controls the 3D model rotation that electronic whiteboard end shows.
In a preferred embodiment, the 3D model that the control electronic whiteboard end of above-described embodiment two and embodiment three shows enters
The mode of row operation can exist simultaneously.
A concrete application scenarios of the present invention be presented herein below:
Assume the anthropometric dummy needing to be shown the picture M of textbook chapters and sections by electronic whiteboard end；First, mobile phone terminal is passed through
Scanned picture M, gets the anthropometric dummy mated with picture M, and this anthropometric dummy from the 3D model database of mobile phone terminal
ID:R；
Mobile phone terminal also can be followed textbook and be moved shooting, the video captured by acquisition；Then anthropometric dummy is superimposed upon
Show on the video of shooting；Meanwhile, the ID:R of this video and above-mentioned anthropometric dummy is also sent to electronic whiteboard end by mobile phone terminal；Electricity
Sub-blank end, according to ID:R, gets the anthropometric dummy of correspondence from the 3D model database of electronic whiteboard end；Electronic whiteboard end
Video stream data and 3D model data be to separate, electronic whiteboard end first renders there is video, then on video playback interface
Superposition 3D model, it is achieved the effect of augmented reality.
If user is by the screen of slip mobile phone terminal, control the anthropometric dummy rotation that mobile phone terminal shows；Then mobile phone terminal is by right
The Spin Control instruction that anthropometric dummy sends is sent to electronic whiteboard end, and electronic whiteboard end controls electronic whiteboard end according to this instruction
The anthropometric dummy of display rotates.Directly can also be slided the screen of electronic whiteboard end, controls the human mould that electronic whiteboard end shows
Type rotates.
When mobile phone terminal exits and when establishing a connection of electronic whiteboard, electronic whiteboard end is optional reside in currently playing
Scene.
Refer to Fig. 6, embodiments of the invention four are:
The system that a kind of augmented reality method based on mobile phone terminal and electronic whiteboard with embodiment one is corresponding, including: mobile phone
End 1, electronic whiteboard end 2 and default unit 3；Described default unit 3 is for presetting 3D respectively at mobile phone terminal 1 and electronic whiteboard end 2
Model database；
Described mobile phone terminal 1 includes:
Picture acquisition module 11, treats, for obtaining, the picture that 3D shows；
Matching module 12, for obtaining the 3D model with described picture match, and described 3D from 3D model database
The mark of model；Described matching module includes: identification module, for identifying the characteristic information of described picture；Comparing module, is used for
Described characteristic information is compared with the 3D model in the 3D model database of mobile phone terminal, obtains mating with described designated pictures
3D model；
Image acquiring module 14, is used for obtaining video camera real time image data；
First display module 15, for being superimposed upon on video camera real-time imaging display by described 3D model；
Sending module 13, for sending white to electronics by the mark of described video camera real time image data and described 3D model
Plate end；
Described electronic whiteboard end 2 includes:
3D model acquisition module 21, for obtaining the 3D of correspondence from 3D model database according to the mark of described 3D model
Model；
Display module 22, for being superimposed upon on the video camera image received display by the described 3D model got.
Refer to Fig. 7, embodiments of the invention five are:
A kind of augmented reality system based on mobile phone terminal and electronic whiteboard, the difference with embodiment four is:
Described mobile phone terminal 1 also includes:
First instruction acquisition module 16, for obtaining the operational order to described 3D model；
Described sending module 13 is additionally operable to send to electronic whiteboard end described operational order；
Control module 23, gets described in controlling according to the operational order of described first instruction acquisition module 16 acquisition
3D model operate accordingly.
In a preferred embodiment, as shown in Figure 8, described electronic whiteboard end 2 also includes: the second instruction acquisition module 24,
For obtaining the operational order to described 3D model；Described control module 23 is for obtaining according to described second instruction acquisition module 24
The 3D model got described in the operational order control taken operates accordingly.
In sum, the augmented reality method and system based on mobile phone terminal and electronic whiteboard that the present invention provides, pass through hands
Machine end and electronic whiteboard end are mutual, it is achieved the augmented reality effect of electronic whiteboard end；And both can control electricity by mobile phone terminal
The 3D model of sub-blank end carries out corresponding operating, can directly be entered by the 3D model of electronic whiteboard end control electronic whiteboard end again
Row corresponding operating.Meanwhile, the mark of video camera image data and 3D model is sent to electronic whiteboard end by mobile phone terminal, it is not necessary to transmission
3D model, greatly reduces volume of transmitted data；Image data and 3D model data are separate, and mobile phone terminal is with electronic whiteboard end eventually
Stop-pass letter does not interferes with the currently displaying of electronic whiteboard end yet.The foregoing is only embodiments of the invention, not thereby limit
The scope of the claims of the present invention, every equivalents utilizing description of the invention and accompanying drawing content to be made, or directly or indirectly transport
It is used in relevant technical field, is the most in like manner included in the scope of patent protection of the present invention.
Claims (10)
1. an augmented reality method based on mobile phone terminal and electronic whiteboard, it is characterised in that including:
3D model database is preset respectively at mobile phone terminal and electronic whiteboard end；
Mobile phone terminal obtains and treats the picture that 3D shows；
Mobile phone terminal obtains the 3D model with described picture match, and the mark of described 3D model from 3D model database；
Mobile phone terminal obtains video camera real time image data；
The mark of described video camera real time image data and described 3D model is sent to electronic whiteboard end；
Electronic whiteboard end obtains the 3D model of correspondence according to the mark of described 3D model from 3D model database；
The 3D model got is superimposed upon on video camera real-time imaging display by electronic whiteboard end.
2. according to the augmented reality method based on mobile phone terminal and electronic whiteboard described in claim 1, it is characterised in that described mobile phone
End obtains video camera real time image data, farther includes afterwards:
Described 3D model is superimposed upon in video camera real-time imaging display by mobile phone terminal.
Augmented reality method based on mobile phone terminal and electronic whiteboard the most according to claim 1, it is characterised in that described electricity
The 3D model got is superimposed upon on described video camera real-time imaging display by sub-blank end, farther includes afterwards:
Mobile phone terminal obtains the operational order to described 3D model；
Described operational order is sent to electronic whiteboard end；
Electronic whiteboard end operates accordingly according to the 3D model got described in the control of described operational order.
Augmented reality method based on mobile phone terminal and electronic whiteboard the most according to claim 1, it is characterised in that described electricity
The 3D model got is superimposed upon on described video camera real-time imaging display by sub-blank end, farther includes afterwards:
Electronic whiteboard end obtains the operational order to described 3D model；
Electronic whiteboard end operates accordingly according to the 3D model got described in the control of described operational order.
Augmented reality method based on mobile phone terminal and electronic whiteboard the most according to claim 1, it is characterised in that mobile phone terminal
The 3D model with described picture match is obtained from 3D model database, particularly as follows:
Identify the characteristic information of described picture；
Described characteristic information is compared with the 3D model in the 3D model database of mobile phone terminal, obtains and described designated pictures
The 3D model of coupling.
6. an augmented reality system based on mobile phone terminal and electronic whiteboard, it is characterised in that including: mobile phone terminal, electronic whiteboard
End and default unit；Described default unit is for presetting 3D model database respectively at mobile phone terminal and electronic whiteboard end；
Described mobile phone terminal includes:
Picture acquisition module, treats, for obtaining, the picture that 3D shows；
Matching module, for obtaining the 3D model with described picture match from 3D model database, and described 3D model
Mark；
Image acquiring module, is used for obtaining video camera real time image data；
Sending module, for sending the mark of described video camera real time image data and described 3D model to electronic whiteboard end；
Described electronic whiteboard end includes:
3D model acquisition module, for obtaining the 3D model of correspondence from 3D model database according to the mark of described 3D model；
Display module, is superimposed upon on video camera real-time imaging display for the 3D model got.
Augmented reality system based on mobile phone terminal and electronic whiteboard the most according to claim 6, it is characterised in that described hands
Machine end also includes:
First display module, for being superimposed upon on video camera image display by described 3D model.
Augmented reality system based on mobile phone terminal and electronic whiteboard the most according to claim 6, it is characterised in that described hands
Machine end also includes:
First instruction acquisition module, for obtaining the operational order to described 3D model；
Described sending module is additionally operable to send to electronic whiteboard end described operational order；
Described electronic whiteboard end also includes:
Control module, for according to the 3D model got described in the operational order control of described first instruction acquisition module acquisition
Operate accordingly.
Augmented reality system based on mobile phone terminal and electronic whiteboard the most according to claim 6, it is characterised in that described electricity
Sub-blank end also includes:
Second instruction acquisition module, for obtaining the operational order to described 3D model；
Control module, for according to the 3D model got described in the operational order control of described second instruction acquisition module acquisition
Operate accordingly.
Augmented reality system based on mobile phone terminal and electronic whiteboard the most according to claim 6, it is characterised in that described
Matching module includes:
Identification module, for identifying the characteristic information of described picture；
Comparing module, for being compared with the 3D model in the 3D model database of mobile phone terminal by described characteristic information, obtains
The 3D model mated with described designated pictures.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610635755.8A CN106060528B (en) | 2016-08-05 | 2016-08-05 | Augmented reality method and system based on mobile phone terminal and electronic whiteboard |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610635755.8A CN106060528B (en) | 2016-08-05 | 2016-08-05 | Augmented reality method and system based on mobile phone terminal and electronic whiteboard |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106060528A true CN106060528A (en) | 2016-10-26 |
| CN106060528B CN106060528B (en) | 2018-08-10 |
Family
ID=57481842
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610635755.8A Active CN106060528B (en) | 2016-08-05 | 2016-08-05 | Augmented reality method and system based on mobile phone terminal and electronic whiteboard |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106060528B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107277429A (en) * | 2017-07-14 | 2017-10-20 | 福建铁工机智能机器人有限公司 | A kind of method that teleconference is carried out using AR |
| WO2018120657A1 (en) * | 2016-12-27 | 2018-07-05 | 华为技术有限公司 | Method and device for sharing virtual reality data |
| CN108600729A (en) * | 2018-03-30 | 2018-09-28 | 盎锐（上海）信息科技有限公司 | Dynamic 3D models generating means and image generating method |
| WO2024037582A1 (en) * | 2022-08-17 | 2024-02-22 | 北京字跳网络技术有限公司 | Image processing method and apparatus |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120127062A1 (en) * | 2010-11-18 | 2012-05-24 | Avi Bar-Zeev | Automatic focus improvement for augmented reality displays |
| CN105491365A (en) * | 2015-11-25 | 2016-04-13 | 罗军 | Image processing method, device and system based on mobile terminal |
| CN105608934A (en) * | 2015-12-21 | 2016-05-25 | 大连新锐天地传媒有限公司 | AR children's story early education stage play system |
| CN205281405U (en) * | 2015-12-02 | 2016-06-01 | 广州经信纬通信息科技有限公司 | Image recognition system based on augmented reality |
-
2016
- 2016-08-05 CN CN201610635755.8A patent/CN106060528B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120127062A1 (en) * | 2010-11-18 | 2012-05-24 | Avi Bar-Zeev | Automatic focus improvement for augmented reality displays |
| CN105491365A (en) * | 2015-11-25 | 2016-04-13 | 罗军 | Image processing method, device and system based on mobile terminal |
| CN205281405U (en) * | 2015-12-02 | 2016-06-01 | 广州经信纬通信息科技有限公司 | Image recognition system based on augmented reality |
| CN105608934A (en) * | 2015-12-21 | 2016-05-25 | 大连新锐天地传媒有限公司 | AR children's story early education stage play system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018120657A1 (en) * | 2016-12-27 | 2018-07-05 | 华为技术有限公司 | Method and device for sharing virtual reality data |
| CN107277429A (en) * | 2017-07-14 | 2017-10-20 | 福建铁工机智能机器人有限公司 | A kind of method that teleconference is carried out using AR |
| CN108600729A (en) * | 2018-03-30 | 2018-09-28 | 盎锐（上海）信息科技有限公司 | Dynamic 3D models generating means and image generating method |
| WO2024037582A1 (en) * | 2022-08-17 | 2024-02-22 | 北京字跳网络技术有限公司 | Image processing method and apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106060528B (en) | 2018-08-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9584766B2 (en) | Integrated interactive space | |
| US8823697B2 (en) | Tabletop, mobile augmented reality system for personalization and cooperation, and interaction method using augmented reality | |
| US20100159430A1 (en) | Educational system and method using virtual reality | |
| US7224851B2 (en) | Method and apparatus for registering modification pattern of transmission image and method and apparatus for reproducing the same | |
| US7830417B2 (en) | System and method for interacting with objects via a camera enhanced mobile device | |
| US20220245859A1 (en) | Data processing method and electronic device | |
| CN106060528A (en) | Method and system for enhancing reality based on mobile phone side and electronic whiteboard | |
| CN106095367B (en) | Multi-screen interaction method and system | |
| US8099460B2 (en) | Information processing device and method, recording medium, and program | |
| CN112135158B (en) | Live broadcasting method based on mixed reality and related equipment | |
| KR101961758B1 (en) | 3-Dimensional Contents Providing System, Method and Computer Readable Recoding Medium | |
| CN111242704B (en) | Method and electronic equipment for superposing live character images in real scene | |
| JP2019179382A (en) | Information processing program, information processing method and information processing system | |
| US8938131B1 (en) | Apparatus and method for registration of flat panel display device and imaging sensor, and electronic device having flat panel display device and imaging sensor which are registered using the method | |
| CN112689151B (en) | Live broadcast method and device, computer equipment and storage medium | |
| CN112675541A (en) | AR information sharing method and device, electronic equipment and storage medium | |
| US20140098138A1 (en) | Method and system for augmented reality based smart classroom environment | |
| CN115268658A (en) | Multi-party remote space delineation marking method based on augmented reality | |
| TWI330099B (en) | ||
| CN111242107B (en) | Method and electronic device for setting virtual object in space | |
| JP7313847B2 (en) | Photography system, photography device, management device and photography method | |
| KR102178894B1 (en) | Education support system and method using mat and Augmented Reality | |
| CN209514619U (en) | Assist fill in a form equipment and system | |
| JP2010278566A (en) | Remote conference system, information processing apparatus and program | |
| KR20190066660A (en) | The system of conference live streaming broadcasting |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |