CN107765894A - A kind of method and device of dummy object in real-time calibration real world - Google Patents
A kind of method and device of dummy object in real-time calibration real world Download PDFInfo
- Publication number
- CN107765894A CN107765894A CN201610678228.5A CN201610678228A CN107765894A CN 107765894 A CN107765894 A CN 107765894A CN 201610678228 A CN201610678228 A CN 201610678228A CN 107765894 A CN107765894 A CN 107765894A
- Authority
- CN
- China
- Prior art keywords
- real
- mobile terminal
- module
- dummy object
- real world
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03542—Light pens for emitting or receiving light
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present invention relates to a kind of method and device of the dummy object in real-time calibration real world.Wherein device includes an interactive device and a mobile terminal, by direction controller, it is seen that optical transmitting set, bluetooth communication, camera, geographical position sensing module, display device, and the component such as associated control modules are formed.Wherein method includes：By a kind of interactive device for being used to carry out location position to dummy object in real world, user is set to demarcate the band of position of real world, and dummy object is associated with the demarcation region.The present invention is by using the method demarcated real world region and associate dummy object, support the augmented reality scene of real-time customization user at one's side, so as to more flexibly be associated and using dummy object in real world, improve the Consumer's Experience of augmented reality and expanded its application.
Description
Technical field
The present invention relates to augmented reality (AR) technical field, more particularly to a kind of reality of dummy object in real world
When demarcate.Allow user according to the information for being presently in actual environment, the real-time edition and attribute of progress augmented reality scene
Customization.
Background technology
Augmented reality（Augmented Reality, abbreviation AR）, it is a kind of calculating video camera image in real time
Position and angle and plus the technology of respective virtual image, the target of this technology be on screen virtual object in real time
It is superimposed upon in real world and carries out interaction.For the angle of user, real world is by preprepared computer model
（Dummy model）Strengthened, this enhancing can include visual information, sound, taste, tactile etc..Triggered by real world
Signal, augmented reality system can make user with interacting communication by the enhanced world of dummy model.
One complete augmented reality system be tightly linked by one group, the hardware component of real-time working and related software
What systematic collaboration was realized.In typical augmented reality system, the scene of real world passes through cut-and-dried computer model
（Dummy model）It is enhanced, need to ensure the synchronization of the visual effect of real world and virtual world in this process, or
Say the uniformity of the coordinate system of real world and virtual world.This uniformity is needed by being identified in real world
The particular location of object and feature judge and update the dummy model to be superimposed.Currently used mode is in advance in reality
One group of image is gathered in the world, and dummy object model corresponding to characteristics of image and association is extracted under off-line state, then is integrated
Into augmented reality system.During use afterwards, when the image capture module of augmented reality system captures and identifies
After some image gathered, it becomes possible to realize with storage and the information handled in advance to be superimposed associated dummy object
Model, to strengthen the real-world scene that user observes.
At present, augmented reality system on the market is all pre-designed augmented reality scene, and user can only passively make
With, it is necessary to be preset in the image of internal system by catching to obtain the experience of augmented reality in real world.General lack of
It is easy-to-use, intuitively, effective augmented reality system customization method, user is difficult its augmented reality at one's side of real-time customizationization
Scene.
The content of the invention
In order to overcome the above-mentioned deficiencies of the prior art, the invention provides the virtual object in a kind of real-time calibration real world
The method and device of body.
Its main technical schemes being related to is：It is used to carry out position mark to dummy object in real world by one kind
Fixed interactive device, user is demarcated with it to real position, and dummy object is associated with the demarcation region；
Real world two field picture is taken in image acquisition units；The region demarcated according to interactive device in image, calculate demarcation region
Relative coordinate in the real world images of seizure；Dummy object is superimposed on the demarcation region specified；Set by interactive device
Put the attribute of dummy object, and adjust its relative position in real world, as up and down and it is front and rear stack order
Adjustment.
The present invention makes dummy object be interacted with real world by using the method for demarcating real region and contour identification
Shi Gengjia is flexibly true, not only support real-time calibration real world object and editor attachment dummy object, also support dummy object with
The front and rear superposition interaction capabilities of real world object, so as to the more flexibly association and using dummy object in real world,
Without the mark and its model in the demarcation designed in advance real world for dummy object.
Its further technical scheme is：In a kind of real-time calibration real world with user mutual and input function
The method and device of dummy object, the system include：
One mobile terminal, for collection and display information, and run the augmented reality application software of correlation；
One interactive device, for marking specific region in the real-time scene that is captured in video image acquisition equipment, there is provided with
The editor of dummy object and interaction.
Further, in above-mentioned mobile terminal, including：
One camera, for catching the real-time scene of real world；
One image characteristics extraction module, for extracting the real-world scene characteristics of image currently captured；
One geographical position sensing module, for obtaining real-time geographical location information；
One display device, for showing the real-world scene that captures, marked region and the increasing after being superimposed with dummy object
Strong reality scene；
One dummy object configuration module, for setting dummy object attribute and incidence relation with marked region；
One bluetooth communication, for receiving the control instruction sent on interactive device；
One memory module, for recording the status attribute information of dummy object and incidence relation with marked region.
Further, in above-mentioned interactive device, including：
Visible light emitter, demarcated for sending visible ray in real world；
Function button, for controlling visible light emitter and providing the interactive function to dummy object on mobile terminals；
Direction controller, for providing the interactive function to dummy object on mobile terminals；
Bluetooth communication, for the control instruction on interactive device to be sent into mobile terminal.
Brief description of the drawings
Fig. 1 is the structure of the interactive device of the dummy object in a kind of real-time calibration real world that the embodiment of the present invention one provides
Schematic diagram.
Fig. 2 is the inside of the interactive device of the dummy object in a kind of real-time calibration real world that the embodiment of the present invention one provides
Cavity body structure schematic diagram.
Fig. 3 is the application method of the device of the dummy object in a kind of real-time calibration real world that the embodiment of the present invention one provides
Schematic diagram.
Fig. 4 is that the another kind of the device of the dummy object in a kind of real-time calibration real world that the embodiment of the present invention two provides makes
Use method schematic diagram.
Embodiment
The embodiment of the present invention is described further below in conjunction with the accompanying drawings.
Embodiment 1
As shown in figure 1, a kind of interactive device 9 based on real-time calibration, including shell body 1.Shell body 1 includes shell on the back 2 and drain pan
3.Shell on the back 2 and drain pan 3 surround a cavity.The front end of shell body 1 is provided with visible light emitter 4.Before the front bottom end of shell body 1 is pressed
After be sequentially set with button 5 and button 6.The front top of shell on the back 2 is provided with direction controller 7.Charge port is left on shell body 1 to open
Mouth 8.Cavity body structure inside shell body is as shown in Fig. 2 position corresponding to the visible light emitter 4 on shell body 1, before cavity
Portion is provided with VISIBLE LIGHT EMISSION module 10.Corresponding to the position of the direction controller 7 on shell body 1, the cavity top side of being provided with
To control module 11.Key control module is installed corresponding to the button 5 on shell body 1 and the position of button 6, cavity front portion
12.Corresponding to the position of the ability on shell body 1, inside cavity is provided with charging module 13.In addition inside cavity is additionally provided with indigo plant
Tooth communication module 14, central processing control module 15 and battery module 16.
The device of the augmented reality of the present embodiment so uses：As shown in figure 3, opening mobile terminal 17, pass through shifting
The camera 18 of dynamic terminal catches the area of visual field 21 that camera shooting visual angle 20 is covered in real world 19, and in display
Caught area of visual field image 23 is presented in 22.Meanwhile by supporting the interactive device 9 of real-time calibration, and its 5 pairs of button can
See that optical transmitting set 4 is controlled, pass through visible point of light indicating area 24, the region quilt in area of visual field 21 in real world 19
Camera 18 presents in the display after catching identification and is noted as demarcating region 25.
Mobile terminal 17 extracts area of visual field figure respectively when obtaining area of visual field image 23 and demarcation region 25 thereon
As 23 characteristic informations and relative position information of the region 25 in area of visual field 21 is demarcated, and is known by geographical position sensing module 26
Geographical location information not residing for the terminal.
Key control is pressed based on real-time calibration interactive device, movement is sent control signals to by bluetooth communication 14
Terminal 17, dummy object interactive interface 27 is recalled on mobile terminal 17, and by button 6 and direction controller with 7 and bluetooth
Communication module 14 sends control information, realizes and void is chosen and adjusted on mobile terminal 17 by the real-time calibration interactive device 9
Intend attribute and posture of the object 28 on demarcation region 25, and it is by mobile terminal 17 that the area of visual field image 23 extracted is special
Reference ceases, and demarcates relative position information of the region 25 in area of visual field 21, and current geographical location information is added to the void
In the attribute for intending object 28.
It should be noted that in the present embodiment, the acquiescence of dummy object 28 is positioned on demarcation region 25, people in the art
Member is it is appreciated that dummy object 28 can also use button 6, or direction controller 7, or combine button 6 and direction controller 7
Placement location, and the attribute such as image that is settable overlapping or replacing covering demarcation region 25 are adjusted, and calculates the phase after adjustment
To positional information.
Button 5 and button 6 on the device can provide control and other combination button functions of visible light emitter 4.This
Art personnel understand that the function of button 5 and the function of button 6 have a variety of embodiments.A kind of simple embodiment
It is：Button 5 is visible light emitter control button, and button 6 is function combination button.Button 5 controls transmitting and the pass of visible ray
Close, button 6 recalls and closed dummy object interactive interface 27, and bonding position controller sets the attribute of dummy object 28.
In addition, in the present embodiment, charge port opening 8 is arranged on the tail position on shell body 1.Those skilled in the art manage
Solution, charge port can also be arranged in shell body other positions.
After user completes the augmented reality customization of area of visual field 21 in real world 19, when user passes through the enhancing
When the mobile terminal 17 of real device observes real-world scene, mobile terminal 17 is caught in real world by camera 18
Image in shooting visual angle region, once identifying that the region was customized, that is, pass through characteristics of image and geographical location information
Wherein calibrated dummy object is found out, with reference to the relative position attribute on dummy object, builds the dummy object current
Real world image on, and shown by the display 22 of mobile terminal 17, to show real world picture and virtual object
Body is superimposed obtained augmented reality picture.It will be appreciated by those skilled in the art that by remote data base, data sharing and network lead to
The dummy object of letter, calibrated real world region and its association can be identified on different multiple mobile terminals and be in
It is existing.
Embodiment 2
On the basis of embodiment 1, further, as shown in figure 4, being designed by backstage algorithm, it is seen that optical transmitting set 4 is served only for light
Mark 29 position corrections.When mobile terminal camera 18 identifies that visible ray is sent out in the real world area of visual field image 23 of seizure
The visible point of light 30 that emitter 4 is launched, then show the mapping cursor 29 of the visible ray in display 22, and switches to direction control
Device 7 processed is controlled to the position that cursor 29 is mapped in display 22.And void is demarcated according to the positional information for mapping cursor 29
Intend object.
Embodiment 3
On the basis of embodiment 1, further, it will be appreciated by those skilled in the art that the battery mould inside interactive device 9 can be passed through
Charging module 13 and charge port opening 8 are replaced using non-charging battery in block 16, to reduce cost and complexity.
Claims (18)
1. a kind of method and device of the dummy object in real-time calibration real world, including：
One interactive device and a mobile terminal；One geospatial location of mark in real-world scene；And carry
Take the characteristic information of the real-world scene and marked region, and the virtual object that real-time customization is associated with the characteristic information
Body.
2. the method as described in claim 1 and device, it is characterised in that the interactive device includes a seal casinghousing.
3. interactive device as claimed in claim 2, it is characterised in that the back of the seal casinghousing is provided with direction controlling
Device;The front end of the seal casinghousing is provided with visible light emitter;The bottom of the seal casinghousing be provided with former and later two by
Key;The seal casinghousing is internally provided with VISIBLE LIGHT EMISSION control module, direction controlling module, key control module,
Battery module, bluetooth communication and central processing control module.
4. the method as described in claim 1 and device, it is characterised in that, the mobile terminal includes a camera, and one
Individual image characteristics extraction module, a geographical position sensing module, a display device, a bluetooth communication, one
Individual dummy object configuration module, a memory module.
5. the interactive device as described in claim 1 or 2 or 3, it is characterised in that, direction controller and its direction controlling module
Sending direction control instruction.
6. the interactive device as described in claim 1 or 2 or 3, it is characterised in that, it is seen that optical transmitting set and its VISIBLE LIGHT EMISSION
Control module sends visible ray in real world.
7. the interactive device as described in claim 1 or 2 or 3, it is characterised in that, button and its key control module transmission can
See that photocontrol instructs, also the transmittable interactive instruction with mobile terminal.
8. the interactive device as described in claim 1 or 2 or 3, it is characterised in that, bluetooth communication will produce on interactive device
Raw control instruction is sent to mobile terminal.
9. the interactive device as described in claim 1 or 2 or 3, it is characterised in that, each mould of central processing control module processing
The data of block and communication.
10. the interactive device as described in claim 1 or 2 or 3, it is characterised in that, battery module is each module in device
Electric power is provided.
11. the mobile terminal as described in claim 1 or 4, it is characterised in that, the field in camera real-time capture real world
Scape, and the visual light imaging information that capture visible light emitter is sent.
12. the mobile terminal as described in claim 1 or 4, it is characterised in that, image characteristics extraction module analysis and extract take the photograph
The real-world scene characteristics of image captured as head.
13. the mobile terminal as described in claim 1 or 4, it is characterised in that, image characteristics extraction module analysis and extract take the photograph
The marked region and feature captured as head.
14. the mobile terminal as described in claim 1 or 4, it is characterised in that, geographical position sensing module obtains current in real time
Residing geographical position coordinates information.
15. the mobile terminal as described in claim 1 or 4, it is characterised in that, display device shows the real world captured
Scene, it is seen that signal region and the augmented reality scene after being superimposed with dummy object.
16. the mobile terminal as described in claim 1 or 4, it is characterised in that, described in bluetooth communication and claim 2
Interactive device on bluetooth communication carry out paired communication.
17. the mobile terminal as described in claim 1 or 4, it is characterised in that, dummy object configuration module is interacted by receiving
Caused control instruction on device, to set dummy object attribute and incidence relation with marked region.
18. the mobile terminal as described in claim 1 or 4, it is characterised in that, memory module is situated between by being locally or remotely stored
Matter, record customized dummy object status attribute information and the incidence relation information with marked region.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610678228.5A CN107765894A (en) | 2016-08-17 | 2016-08-17 | A kind of method and device of dummy object in real-time calibration real world |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610678228.5A CN107765894A (en) | 2016-08-17 | 2016-08-17 | A kind of method and device of dummy object in real-time calibration real world |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107765894A true CN107765894A (en) | 2018-03-06 |
Family
ID=61259637
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610678228.5A Pending CN107765894A (en) | 2016-08-17 | 2016-08-17 | A kind of method and device of dummy object in real-time calibration real world |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107765894A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110618753A (en) * | 2019-08-02 | 2019-12-27 | 常州锦瑟医疗信息科技有限公司 | Indicating equipment and method for mixed reality scene and mixed reality system |
| CN111162840A (en) * | 2020-04-02 | 2020-05-15 | 北京外号信息技术有限公司 | Method and system for setting virtual objects around optical communication device |
| WO2020244576A1 (en) * | 2019-06-05 | 2020-12-10 | 北京外号信息技术有限公司 | Method for superimposing virtual object on the basis of optical communication apparatus, and corresponding electronic device |
-
2016
- 2016-08-17 CN CN201610678228.5A patent/CN107765894A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020244576A1 (en) * | 2019-06-05 | 2020-12-10 | 北京外号信息技术有限公司 | Method for superimposing virtual object on the basis of optical communication apparatus, and corresponding electronic device |
| CN110618753A (en) * | 2019-08-02 | 2019-12-27 | 常州锦瑟医疗信息科技有限公司 | Indicating equipment and method for mixed reality scene and mixed reality system |
| CN111162840A (en) * | 2020-04-02 | 2020-05-15 | 北京外号信息技术有限公司 | Method and system for setting virtual objects around optical communication device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109639970B (en) | Shooting method and terminal equipment | |
| CN107580209B (en) | Photographing imaging method and device of mobile terminal | |
| CN108111754B (en) | Method for determining image acquisition mode and mobile terminal | |
| US20120105447A1 (en) | Augmented reality-based device control apparatus and method using local wireless communication | |
| US20150116502A1 (en) | Apparatus and method for dynamically selecting multiple cameras to track target object | |
| CN108762501B (en) | AR display method, intelligent terminal, AR device and AR system | |
| CN105955043A (en) | Augmented-reality type visible controllable intelligent household control system and method | |
| CN104243962A (en) | Augmented reality head-mounted electronic device and method for generating augmented reality | |
| WO2021237616A1 (en) | Image transmission method, mobile platform, and computer readable storage medium | |
| CN108924412B (en) | Shooting method and terminal equipment | |
| CN107071389A (en) | Take photo by plane method, device and unmanned plane | |
| CN107707825B (en) | A kind of panorama shooting method, mobile terminal and computer readable storage medium | |
| CN108513067B (en) | Shooting control method and mobile terminal | |
| CN106658148B (en) | VR playing method, VR playing device and VR playing system | |
| CN110879979B (en) | Augmented reality system based on mobile terminal | |
| US11842453B2 (en) | Information processing device, information processing method, and program | |
| CN107765894A (en) | A kind of method and device of dummy object in real-time calibration real world | |
| CN103002244B (en) | A kind of method of interactive video call and call terminal | |
| CN107426508A (en) | A kind of method that long-range security inspection is realized using AR | |
| CN110992484A (en) | Method for displaying traffic dynamic video in real scene three-dimensional platform | |
| CN109803110A (en) | A kind of image processing method, terminal device and server | |
| CN107479701B (en) | Virtual reality interaction method, device and system | |
| CN109002059A (en) | A kind of multi-rotor unmanned aerial vehicle object real-time tracking camera system and method | |
| CN108696725A (en) | A kind of camera long-range control method Internet-based and system | |
| CN103139457B (en) | A kind of image obtains control method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180306 |
|
| WD01 | Invention patent application deemed withdrawn after publication |