CN102375972A - Distributive augmented reality platform based on mobile equipment - Google Patents
Distributive augmented reality platform based on mobile equipment Download PDFInfo
- Publication number
- CN102375972A CN102375972A CN201010259788XA CN201010259788A CN102375972A CN 102375972 A CN102375972 A CN 102375972A CN 201010259788X A CN201010259788X A CN 201010259788XA CN 201010259788 A CN201010259788 A CN 201010259788A CN 102375972 A CN102375972 A CN 102375972A
- Authority
- CN
- China
- Prior art keywords
- augmented reality
- server
- application program
- client
- reality platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a distributive augmented reality platform based on mobile equipment. The platform comprises an augmented reality image processing application program; the program is arranged on a mobile device and used for receiving real-time images of a field, and processing and converting the images into the coordinate positions of the images; the augmented reality platform also comprises a client application program on the mobile equipment, and the client application program is used for transmitting data packets comprising the coordinate positions; and the augmented reality platform comprises a server application program on a server at the other end, and the server application program is used for receiving the data packets transmitted by the client application program and identifying a special symbolic identifier from the data packets. An identification result is identity information corresponding to the special symbolic identifier. In addition, the server application program requires measured useful information, such as the position, direction and magnitude of the special symbolic identifier. The server application program transmits the information and display contents corresponding to the information back to the mobile equipment.
Description
Technical field:
The present invention relates to a kind of recognition methods of the special symbol sign in an individual augmented reality applications environment, particularly a kind of distributed augmented reality platform based on movable equipment.
Background technology:
Augmented reality (AR) is the emerging research field that on the basis of virtual reality (VR) technology, grows up in the world in recent years; Augmented reality is comprehensive photoelectronic imaging, merges multi-door subjects such as demonstration, multisensor, computer graphical, Flame Image Process, computer vision, the technology that to be a kind of additional information that produces with computing machine strengthen or expand the scene of real world.The augmented reality technology is in recent years one research focus in the technology such as computer vision, computer graphics, and it brings the user magical user experience through can in real scene, adding virtual 3D figure.Strengthen virtual reality technology and can be applied on the computing machine with camera equipment, or even user's handheld device, like PDA and mobile phone.
Generally speaking, in the augmented reality technology realizes, often need a symbol logo, discern for this symbol logo by the augmented reality technology, and as the basis that shows three-dimension virtual reality.After symbol logo is identified, what the user was seen on real screen will not be the symbol logo in the actual environment, but the three-dimension virtual reality that has been designed in advance.When user and special symbol sign is carried out interaction, in the time of like the position of moving symbol sign and direction, three-dimension virtual reality is shifted one's position and direction too.
But; At present because often computing power is not enough on the movable equipment,, can not make any reaction for recognition result more so can't discern any symbol logo; That is to say, in fact on movable equipment, can't realize any three-dimension virtual reality scene.
Summary of the invention:
Problem for the movable equipment that overcomes aforementioned method; Patent designed scheme of the present invention provides the recognition methods of a kind of augmented reality solution and special symbol sign; Especially, the related scheme of patent of the present invention can be applied to the more limited mobile device of hardware condition, like mobile phone.
On the one hand, the related scheme of patent of the present invention comprises the algorithm that generates special symbol sign recognition mode.The recognition mode that is generated by this method comprises following information:
(1) recognition feature of symbol logo;
(2) position of symbol logo and directional information;
(3) image information of symbol logo;
Another aspect provides a software platform in the present invention, on this software platform, has used the feature recognition algorithms of special symbol sign, and has used the topological structure of client-server.This structure makes the seizure of special symbol sign be placed on the limited client of computing power (on the mobile phone), and the identification of image and return being operated on the server of three-dimension virtual reality.This software platform connects through network interconnection technology through between removable communication apparatus and its server, setting up, and the wireless connections of particularly setting up via the 3g network make the service ability of whole software platform obtain very big must the expansion.
More specifically; Relate to a real-time augmented reality implementation platform that is based upon under the client-server pattern in the present invention, and the invention property ground is applied to this technology on wireless network and the removable communication apparatus (like mobile phone) based on mode identification technology.After movable equipment is confirmed or recognized a symbol logo, will send a signal to master server.And after master server is received signal, can confirm suitable augmented reality content, and content is sent back to removable communication apparatus and demonstration according to the difference of signal.
This specifically distributed augmented reality platform based on movable equipment comprises:
A Flame Image Process and a recognition application that is on the movable equipment, effect are to catch, handle and sign identification;
A client-side program that is on the movable equipment as the maincenter program of client, and carries out communication with server application;
A server application that is on the server is accepted and transfer data packets, the location virtual reality;
A virtual reality storehouse that is on the server;
In the such scheme, said Flame Image Process and recognizer comprise probe algorithm, classification and identification algorithm, image segmentation and the location algorithm of key point.
In the such scheme, be in the client-side program on the movable equipment in the said augmented reality platform, can receive recognition result, and can be connected with server end through the internet, the line data of going forward side by side transmits.
In the such scheme, said server application can be accepted the connection from movable equipment, and reception and deal with data, and in the virtual reality storehouse, locatees content corresponding according to recognition result.
In the such scheme, the classification and identification algorithm of said special identifier adopts the support vector machine technology.
In the such scheme, said image segmentation and location algorithm can be judged the size of special identifier, position and direction, and have client-side program that these information are sent to server program.
The beneficial effect that the present invention possessed comprises: the most computing power that is used for algorithm for pattern recognition is to be provided by master server, and this just has been fit to the relatively low characteristics of configuration of movable equipment.
Description of drawings:
Further specify the present invention below in conjunction with accompanying drawing and embodiment.
Fig. 1 is the main element and the functional module graph of a relation of platform according to the invention.
Fig. 2 is special symbol index identification method figure involved in the present invention.
Embodiment:
For technological means, creation characteristic that the present invention is realized, reach purpose and effect and be easy to understand and understand, below in conjunction with concrete diagram, further set forth the present invention.
Main original paper and functional module in the mobile phone augmented reality implementation platform 10 related among the present invention have been described in Fig. 1.Comprise an image recognition application program 13 in main element in platform 10 and the functional module, be positioned on user's the movable equipment 14.This can move and also comprise a client application 16 on the equipment.Simultaneously, server-side application 18 is positioned at and runs on the remote server 20, and on this server 20, also comprises a virtual reality storehouse 22, the content in the virtual reality storehouse be will be on client's movable equipment 14 content displayed.Through the Internet,, interconnect between main original paper of in the augmented reality implementation platform 10 each and the functional module like the 3G mobile communication network.
The imaging original paper 24 that image recognition application program 13 drives on movable equipment, common this equipment is camera installation.Except image-forming component, on movable equipment, also need be similar to the memory element of calculator memory, be used to deposit image in order to analyzing and discern by image recognition application program 13.Image application program 13 afterwards, sends to client application 16 with coordinate information at analysis image (the special symbol sign perhaps contains the image of symbol logo).The image that obtains not necessarily will be stored on the equipment that can move 14, and only need implement ground this image is shown on the real element of the equipment that can move 14 26.
Client application 16 can be considered to the core hinge of the augmented reality software platform on the movable equipment 14.Client application 16 accepts to come from the coordinate information of picture recognition application program 13; And be sent to server application 18. to these information at server application 18; According to the information that receives; After in virtual reality storehouse 22, navigating to corresponding virtual reality content, this content is transferred back to movable equipment 14. client applications also will handle the virtual reality content that reality is wanted in formation these contents, and with this content reality to the display element of movable equipment.
Server application 18 possibly be positioned on a series of servers, and these servers interconnect through the 3G wireless communication networks.Client application 16 Connection Service device application programs 18, and transmit a Query Information comprise positional information and id information of symbol logo etc.Server program 18 is resolved these information, and inquires about virtual reality storehouse 22 in view of the above.Then content is encrypted and its is returned to client application 16.
In addition, server application 18 can be designed as needs login mode.Through this login mode, client's information such as hobby can collected and follow the tracks of to server, perhaps generates client's behavior form and safeguard all online client application programs.That is to say that server-side application will keep and can carry out session with a plurality of client applications 16 simultaneously.
Three-dimension virtual reality storehouse 22 can be on the different servers with server application 18.In this example, server 20 ends comprise server application 18 and three-dimension virtual reality storehouse 22, but are not limited thereto in the practical application.Be on the master server differently with all the elements, content involved in the present invention comprises the server application 18 and three-dimension virtual reality storehouse 22 that is on different server or a plurality of servers.
Augmented reality content or connection that 22 storages of three-dimension virtual reality storehouse are all.Virtual reality storehouse 22 can receive the query requests from different server application program 18, and returns content corresponding according to positional information in the query requests and identification information.When the virtual reality storehouse receives a query requests; It checks at first whether this request is an available requests; And verify this server application request information of meeting with a response of whether having the right, retrieval and content corresponding thereof then, and provide this content to server application.
If this augmented reality platform can be used, user's movable equipment 14 just must be equipped with the client application 16 of customization in advance.Client application can consign to the user through form of software, and perhaps the user downloads this application program with the form of note, perhaps the user with similar host-host protocol from downloaded.
In Fig. 2, introduced the recognizer of special symbol sign.In the drawings, the standard picture that includes special symbol sign be through the imaging device on user's the movable equipment catch 1.Depend on the different platforms framework, the image that captures can be stored in the user movable equipment or be transferred to server handle with detected image in key point 2.
Carry out the extraction 3 of characteristics of image for detected picture point set in the image.After these characteristics that extract are normalization, be the block of pixels at center with this unique point.For the image of each input, the extraction characteristic of some row is extracted by this method, to describe this image.These extract characteristics after processing procedure in will be as the input vector of classifier algorithm 5.
Special symbol identification image for all carries out aforesaid processing procedure, to carry out feature extraction according to aforementioned feature extraction method 3.These characteristics are as the training data 10 of the training process of classifier algorithm 5.In this article, classifier algorithm adopts SVM (SVM) algorithm of knowing clearly, and has particularly adopted accounting method in the pyramid coupling, but in practical application, has been not limited thereto.
Through classifier algorithm 5, the special symbol identification image of each input is with corresponding specific output result, and these outputs store the standard as identification as unique identification.
The characteristic of the special symbol sign of identification can effectively He fast be effectively separated symbol logo to be identified by the reverse input picture that is mapped as by this method from background image.This method is as image object partitioning algorithm 7 of the present invention.On the basis of effective recognition image symbol logo, carry out dimension for the symbol logo of identification and measure, with the size 8 of the symbol logo that obtains discerning.The positional information of distinguished symbol sign is meant on the dimension based measurement center 11 of all pixels that obtain.
Whether compare the sorter output of the sorter output of the characteristic of aiming symbol sign with a series of distinguished symbol signs that trained, be the symbol logo 12 that we need discern to determine this symbol logo.
As stated, an instance of the present invention can be described to a certain applications based on particular device.But scope involved in the present invention is not limited thereto, and revises the scope of application that all belongs to this patent for the generality of the described method of this instance.
Claims (6)
1. a distributed augmented reality platform based on movable equipment is characterized in that, comprising:
A Flame Image Process and a recognition application that is on the movable equipment, effect are to catch, handle and sign identification;
A client-side program that is on the movable equipment as the maincenter program of client, and carries out communication with server application;
A server application that is on the server is accepted and transfer data packets, the location virtual reality;
A virtual reality storehouse that is on the server.
2. according to the augmented reality platform of claim 1, it is characterized in that said Flame Image Process and recognizer comprise probe algorithm, classification and identification algorithm, image segmentation and the location algorithm of key point.
3. according to the augmented reality platform of claim 1, it is characterized in that, be in the client-side program on the movable equipment in the said augmented reality platform, can receive recognition result, and can be connected with server end through the internet, the line data of going forward side by side transmits.
4. according to the augmented reality platform of claim 1, it is characterized in that said server application can be accepted the connection from movable equipment, and reception and deal with data, and in the virtual reality storehouse, locate content corresponding according to recognition result.
5. according to the augmented reality platform of claim 2, it is characterized in that the classification and identification algorithm of said special identifier adopts the support vector machine technology.
6. according to the augmented reality platform of claim 2, it is characterized in that said image segmentation and location algorithm can be judged the size of special identifier, position and direction, and have client-side program that these information are sent to server program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010259788XA CN102375972A (en) | 2010-08-23 | 2010-08-23 | Distributive augmented reality platform based on mobile equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010259788XA CN102375972A (en) | 2010-08-23 | 2010-08-23 | Distributive augmented reality platform based on mobile equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102375972A true CN102375972A (en) | 2012-03-14 |
Family
ID=45794559
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010259788XA Pending CN102375972A (en) | 2010-08-23 | 2010-08-23 | Distributive augmented reality platform based on mobile equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102375972A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104571527A (en) * | 2015-01-26 | 2015-04-29 | 华东理工大学 | AR (augmented reality) technique-based 3D (three-dimensional) molecule interactive docking system and implementing method |
| CN104794754A (en) * | 2015-05-12 | 2015-07-22 | 成都绿野起点科技有限公司 | Distribution type virtual reality system |
| CN104981850A (en) * | 2013-02-14 | 2015-10-14 | 不锈钢结构维护个人责任有限公司 | Method for the representation of geographically located virtual environments and mobile device |
| CN105103198A (en) * | 2013-04-04 | 2015-11-25 | 索尼公司 | Display control device, display control method and program |
| CN105849719A (en) * | 2013-06-27 | 2016-08-10 | 奥瑞斯玛有限公司 | Augmented reality |
| CN106375378A (en) * | 2016-08-25 | 2017-02-01 | 北京每刻风物科技有限公司 | Application deployment method and system based on local area network client server structure |
| CN106599919A (en) * | 2016-12-13 | 2017-04-26 | 毛荣军 | Fabrication method and display method of augmented reality diamond painting |
| CN108369749A (en) * | 2015-12-02 | 2018-08-03 | 杜瓦娱乐有限公司 | The method that device to being used to form augmented reality environment is controlled |
| CN108564661A (en) * | 2018-01-08 | 2018-09-21 | 佛山市超体软件科技有限公司 | A kind of recording method based on augmented reality scene |
| WO2019240467A1 (en) | 2018-06-12 | 2019-12-19 | Samsung Electronics Co., Ltd. | Electronic device and system for generating object |
-
2010
- 2010-08-23 CN CN201010259788XA patent/CN102375972A/en active Pending
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104981850A (en) * | 2013-02-14 | 2015-10-14 | 不锈钢结构维护个人责任有限公司 | Method for the representation of geographically located virtual environments and mobile device |
| CN105103198A (en) * | 2013-04-04 | 2015-11-25 | 索尼公司 | Display control device, display control method and program |
| CN105849719B (en) * | 2013-06-27 | 2021-09-28 | 惠普发展公司，有限责任合伙企业 | Augmented reality |
| CN105849719A (en) * | 2013-06-27 | 2016-08-10 | 奥瑞斯玛有限公司 | Augmented reality |
| CN104571527B (en) * | 2015-01-26 | 2017-11-07 | 华东理工大学 | A kind of 3D molecules interaction docking system and implementation method based on augmented reality |
| CN104571527A (en) * | 2015-01-26 | 2015-04-29 | 华东理工大学 | AR (augmented reality) technique-based 3D (three-dimensional) molecule interactive docking system and implementing method |
| CN104794754B (en) * | 2015-05-12 | 2018-04-20 | 成都绿野起点科技有限公司 | A kind of Distributed Virtual Reality System |
| CN104794754A (en) * | 2015-05-12 | 2015-07-22 | 成都绿野起点科技有限公司 | Distribution type virtual reality system |
| CN108369749A (en) * | 2015-12-02 | 2018-08-03 | 杜瓦娱乐有限公司 | The method that device to being used to form augmented reality environment is controlled |
| CN108369749B (en) * | 2015-12-02 | 2022-03-29 | 杜瓦娱乐有限公司 | Method for controlling an apparatus for creating an augmented reality environment |
| CN106375378A (en) * | 2016-08-25 | 2017-02-01 | 北京每刻风物科技有限公司 | Application deployment method and system based on local area network client server structure |
| CN106599919A (en) * | 2016-12-13 | 2017-04-26 | 毛荣军 | Fabrication method and display method of augmented reality diamond painting |
| CN106599919B (en) * | 2016-12-13 | 2020-04-28 | 毛荣军 | Manufacturing and displaying method of augmented reality diamond picture |
| CN108564661A (en) * | 2018-01-08 | 2018-09-21 | 佛山市超体软件科技有限公司 | A kind of recording method based on augmented reality scene |
| CN108564661B (en) * | 2018-01-08 | 2022-06-28 | 佛山市超体软件科技有限公司 | Recording method based on augmented reality scene |
| WO2019240467A1 (en) | 2018-06-12 | 2019-12-19 | Samsung Electronics Co., Ltd. | Electronic device and system for generating object |
| EP3776158A4 (en) * | 2018-06-12 | 2021-05-26 | Samsung Electronics Co., Ltd. | Electronic device and system for generating object |
| US11334230B2 (en) | 2018-06-12 | 2022-05-17 | Samsung Electronics Co., Ltd | Electronic device and system for generating 3D object based on 3D related information |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102375972A (en) | Distributive augmented reality platform based on mobile equipment | |
| US11145083B2 (en) | Image-based localization | |
| CN111417028B (en) | Information processing method, information processing device, storage medium and electronic equipment | |
| JP6905061B2 (en) | Augmented reality-based offline dialogue methods and equipment | |
| KR102180327B1 (en) | Incremental visual query processing with holistic feature feedback | |
| CN103458098B (en) | Method and device used for data transmission between mobile terminals and mobile terminals | |
| CN111601115B (en) | Video detection method, related device, equipment and storage medium | |
| CN101281422B (en) | Apparatus and method for generating three-dimensional information based on object as well as using interactive system | |
| KR20120001847A (en) | System and method for searching image | |
| CN105117624A (en) | Recognition system and method of user system based on face recognition | |
| CN104227716B (en) | A kind of cameras people real-time control method based on remote operating | |
| KR20110096500A (en) | Location-based communication method and system | |
| CN106815555A (en) | A kind of augmented reality method and system of distributed scene target identification | |
| WO2019109828A1 (en) | Ar service processing method, device, server, mobile terminal, and storage medium | |
| CN110800314B (en) | Computer system, remote operation notification method, and recording medium | |
| KR101197126B1 (en) | Augmented reality system and method of a printed matter and video | |
| CN103649955A (en) | Image topological coding for visual search | |
| KR101276314B1 (en) | Matching point extraction system using feature point of lsh algorithm and thereof | |
| KR102125314B1 (en) | Method and Apparatus for Providing Product Information by Using Store and Image Information | |
| EP2492791A1 (en) | Augmented reality-based file transfer method and file transfer system thereof | |
| CN104580300B (en) | The method and system of figure and outdoor scene identification based on cloud operation | |
| CN108650217B (en) | Synchronous method, device, storage medium and the electronic device of action state | |
| CN106778449B (en) | Object identification method of dynamic image and interactive film establishment method for automatically capturing target image | |
| Hu et al. | Mobile camera based cross-screen interaction by object matching and tracking | |
| CN112486315A (en) | Multi-person cooperation method based on computer vision |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120314 |