CN108961425A - Method, system, terminal and the server of augmented reality effect - Google Patents

Method, system, terminal and the server of augmented reality effect Download PDF

Info

Publication number
CN108961425A
CN108961425A CN201810817185.3A CN201810817185A CN108961425A CN 108961425 A CN108961425 A CN 108961425A CN 201810817185 A CN201810817185 A CN 201810817185A CN 108961425 A CN108961425 A CN 108961425A
Authority
CN
China
Prior art keywords
data
server
scene
information
augmented reality
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810817185.3A
Other languages
Chinese (zh)
Inventor
高哲远
韩振杰
滑立栋
李梁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201810817185.3A priority Critical patent/CN108961425A/en
Publication of CN108961425A publication Critical patent/CN108961425A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The present invention provides method, system, terminal and the server of a kind of augmented reality effect, wherein described method includes following steps: S1, the position scene based on place, sends geography information and scene information to server;S2, based on the received geography information, the corresponding position data with server storage are index, search contextual data associated there, and received scene information is compared with the contextual data that server stores, and when the two is consistent, execute step S3;S3, server read and send virtual reality effect data associated with the position data of itself storage and contextual data, and the virtual reality effect data based on transmission carries out augmented reality.It is driving the present invention is based on geography information position scene, when the scene that the scene of client shooting and server-side are stored has intersection, carries out augmented reality effect and show, overcoming in the prior art is insufficient brought by driving with specific image.

Description

Method, system, terminal and the server of augmented reality effect
Technical field
The present invention relates to augmented reality field more particularly to a kind of method of augmented reality effect, system, terminal and Server.
Background technique
Based on the augmented reality effect method of geography information position scene drive, be a kind of mobile end equipment meet it is specific The method of augmented reality is shown under geographical and scene condition.Currently, the effect of augmented reality, which is presented, is driven based on certain image Dynamic (such as the image that is captured of camera and under the conditions of the pre-stored image of server-side is matched).However in many cases, It opens augmented reality effect not needing to match specific image, it is only necessary to exist and specific site condition in certain scene It is lower.For example, the situation for the steric requirements that the digitlization of the needs such as museum is presented.Therefore, in view of the above-mentioned problems, it is necessary to mention Further solution out.
Summary of the invention
The present invention is intended to provide a kind of method, system, terminal and the server of augmented reality effect, to overcome the prior art Present in deficiency.
In order to solve the above technical problems, the technical scheme is that
A kind of method of augmented reality effect comprising following steps:
S1, the position scene based on place send geography information and scene information to server;
S2, based on the received geography information, the corresponding position data with server storage are index, are searched associated with it Contextual data, and received scene information is compared with the contextual data that server stores, when the two is consistent, is executed Step S3;
S3, server read and send virtual reality effect associated with the position data of itself storage and contextual data Data, the virtual reality effect data based on transmission carry out augmented reality.
The improvement of method as augmented reality effect of the invention, the geography information include the GPS letter of position Breath, the scene information includes the video data recorded using scene around position as object.
The improvement of method as augmented reality effect of the invention is deposited according to geography information and scene information with server The position data of storage and the similarity of contextual data judge whether to read and send virtual reality effect data.
The improvement of method as augmented reality effect of the invention, the similarity calculate as follows:
(1) in the location database L={ l of server1,l2,...lNIn search and geography information in 20-25m Position data set;
(2) according to scene database S={ V in server1,V2,...VN, the corresponding scene number of calculating position data acquisition system According to normalization histogram;
(3) similarity is calculated according to following formula:
Wherein, hclientThe homogenization histogram of scene information is represented,Represent fromIn in every 10 frame Extract 1 frame.
In order to solve the above technical problems, the technical scheme is that
A kind of system of augmented reality effect comprising:
Transmission unit: the position scene based on place sends geography information and scene information to server;
Comparing unit: geography information based on the received, with server storage corresponding position data be index, search and its Associated contextual data, and received scene information is compared with the contextual data that server stores;
Display unit: the virtual reality effect number associated with position data and contextual data sent according to server According to progress augmented reality.
The improvement of system as augmented reality effect of the invention, the geography information include the GPS letter of position Breath, the scene information includes the video data recorded using scene around position as object.
The improvement of system as augmented reality effect of the invention, the comparing unit are also used to: according to geography information With the similarity of the position data and contextual data of scene information and server storage, judges whether to read and send virtual reality Effect data.
The improvement of system as augmented reality effect of the invention, the similarity calculate as follows:
(1) in the location database L={ l of server1,l2,...lNIn search and geography information in 20-25m Position data set;
(2) according to scene database S={ V in server1,V2,...VN, the corresponding scene number of calculating position data acquisition system According to normalization histogram;
(3) similarity is calculated according to following formula:
Wherein, hclientThe homogenization histogram of scene information is represented,Represent fromIn in every 10 frame Extract 1 frame.
In order to solve the above technical problems, the technical scheme is that
A kind of terminal comprising:
Processor;
For the exectorial memory of storage processor;
Wherein, the processor is configured to:
Position scene based on place sends geography information and scene information to server;
Geography information based on the received, the corresponding position data with server storage are index, are searched associated there Contextual data, and received scene information is compared with the contextual data that server stores;
When the two is consistent, the associated with the position data of storage and contextual data virtual existing of server transmission is received Real effect data, the virtual reality effect data based on transmission carry out augmented reality.
In order to solve the above technical problems, the technical scheme is that
A kind of server comprising:
Processor;
For the exectorial memory of storage processor;
Wherein, the processor is configured to:
Receive the geography information and scene information based on the position scene where it that terminal is sent;
Geography information based on the received is index with the corresponding position data of storage, searches scene number associated there According to, and received scene information is compared with the contextual data of storage;
When the two is consistent, virtual reality effect associated with the position data of storage and contextual data is sent to terminal Data, terminal carry out augmented reality based on the virtual reality effect data of transmission.
Compared with prior art, the beneficial effects of the present invention are: being driving the present invention is based on geography information position scene, when When the scene that the scene and server-side of client shooting are stored has intersection, carries out augmented reality effect and show, overcome existing It is brought insufficient for driving with specific image in technology.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this The some embodiments recorded in invention, for those of ordinary skill in the art, without creative efforts, It is also possible to obtain other drawings based on these drawings.
Fig. 1 is the flow chart of a specific embodiment of the method for augmented reality effect of the invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
Augmented reality (Augmented Reality, abbreviation AR), refers to the position through camera image and angle actuarial And image analysis technology is added, the technology that the virtual world on screen can be combined and be interacted with real-world scene.
The augmented reality of mobile phone terminal at this stage is mainly based upon what specific image model was driven, however, increasing In the related application of strong reality, the presentation of driving augmented reality effect does not need specific image model, opposite only to need one A scene referred to has no specific image model and exists, but have friendship with the scene of server-side in the scene referred to Collection relationship is satisfied with the condition for indicating that current augmented reality effect can be presented.
Therefore, in view of the above-mentioned problems, one embodiment of the invention provides a kind of method of augmented reality effect comprising such as Lower step:
S1, the position scene based on place send geography information and scene information to server.
Wherein, the geography information includes the GPS information of position, and the scene information includes around position Scene is the video data that object is recorded.To which user can send GPS information and the position of its position by its terminal Video data under setting.
S2, based on the received geography information, the corresponding position data with server storage are index, are searched associated with it Contextual data, and received scene information is compared with the contextual data that server stores, when the two is consistent, is executed Step S3.
Wherein, location database L={ l is stored in server1,l2,...lNAnd scene database S={ V1,V2, ...VNAnd virtual reality effect data library K={ k1,k2,...kN}.Location database L={ l1,l2,...lNIn be stored with position Set data, scene database S={ V1,V2,...VNIn be stored with contextual data, virtual reality effect data library K={ k1, k2,...kNIn be stored with virtual reality effect data.The position data is opposite with contextual data and virtual reality effect data It answers.To which r-tree can be used according to above-mentioned corresponding relationship after server receives the geography information sent and scene information It is indexed and corresponding contextual data is inquired with fast and easy.
S3, server read and send virtual reality effect associated with the position data of itself storage and contextual data Data, the virtual reality effect data based on transmission carry out augmented reality.
It wherein, in one embodiment, can be according to the position data of geography information and the storage of scene information and server Reach virtual reality effect unlocking condition when the value of similarity is greater than preset threshold value with the similarity of contextual data, It presents to the corresponding augmented reality effect packet of virtual reality effect data under server end and at the terminal.
Specifically, the similarity calculates as follows:
(1) in the location database L={ l of server1,l2,...lNIn search and geography information in 20-25m Position data set;
(2) according to scene database S={ V in server1,V2,...VN, the corresponding scene number of calculating position data acquisition system According to normalization histogram;
(3) similarity is calculated according to following formula:
Wherein, hclientThe homogenization histogram of scene information is represented,Represent fromIn in every 10 frame Extract 1 frame.
Corresponding with the embodiment of method of above-mentioned augmented reality effect, the present invention also provides a kind of augmented reality effects System comprising:
Transmission unit: the position scene based on place sends geography information and scene information to server.
Wherein, the geography information includes the GPS information of position, and the scene information includes around position Scene is the video data that object is recorded.
Comparing unit: geography information based on the received, with server storage corresponding position data be index, search and its Associated contextual data, and received scene information is compared with the contextual data that server stores.
Wherein, the comparing unit is also used to: according to the position data of geography information and the storage of scene information and server With the similarity of contextual data, judge whether to read and send virtual reality effect data.
Display unit: the virtual reality effect number associated with position data and contextual data sent according to server According to progress augmented reality.
Wherein, the similarity calculates as follows:
(1) in the location database L={ l of server1,l2,...lNIn search and geography information in 20-25m Position data set;
(2) according to scene database S={ V in server1,V2,...VN, the corresponding scene number of calculating position data acquisition system According to normalization histogram;
(3) similarity is calculated according to following formula:
Wherein, hclientThe homogenization histogram of scene information is represented,Represent fromIn in every 10 frame Extract 1 frame.
Based on the bright design of identical invention, the present invention also provides a kind of terminals comprising:
Processor;
For the exectorial memory of storage processor;
Wherein, the processor is configured to:
Position scene based on place sends geography information and scene information to server;
Geography information based on the received, the corresponding position data with server storage are index, are searched associated there Contextual data, and received scene information is compared with the contextual data that server stores;
When the two is consistent, the associated with the position data of storage and contextual data virtual existing of server transmission is received Real effect data, the virtual reality effect data based on transmission carry out augmented reality.
Based on the bright design of identical invention, the present invention also provides a kind of servers comprising:
Processor;
For the exectorial memory of storage processor;
Wherein, the processor is configured to:
Receive the geography information and scene information based on the position scene where it that terminal is sent;
Geography information based on the received is index with the corresponding position data of storage, searches scene number associated there According to, and received scene information is compared with the contextual data of storage;
When the two is consistent, virtual reality effect associated with the position data of storage and contextual data is sent to terminal Data, terminal carry out augmented reality based on the virtual reality effect data of transmission.
In conclusion being driving the present invention is based on geography information position scene, when the scene and server-side of client shooting It when the scene stored has intersection, carries out augmented reality effect and shows, overcome in the prior art with specific image for driving institute Bring is insufficient.
It is obvious to a person skilled in the art that invention is not limited to the details of the above exemplary embodiments, Er Qie In the case where without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matter From the point of view of which point, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the present invention is by appended power Benefit requires rather than above description limits, it is intended that all by what is fallen within the meaning and scope of the equivalent elements of the claims Variation is included within the present invention.Any reference signs in the claims should not be construed as limiting the involved claims.
In addition, it should be understood that although this specification is described in terms of embodiments, but not each embodiment is only wrapped Containing an independent technical solution, this description of the specification is merely for the sake of clarity, and those skilled in the art should It considers the specification as a whole, the technical solutions in the various embodiments may also be suitably combined, forms those skilled in the art The other embodiments being understood that.

Claims (10)

1. a kind of method of augmented reality effect, which is characterized in that described method includes following steps:
S1, the position scene based on place send geography information and scene information to server;
S2, based on the received geography information, the corresponding position data with server storage are index, search field associated there Scape data, and received scene information is compared with the contextual data that server stores, when the two is consistent, execute step S3;
S3, server read and send virtual reality effect number associated with the position data of itself storage and contextual data According to the virtual reality effect data based on transmission carries out augmented reality.
2. the method for augmented reality effect according to claim 1, which is characterized in that the geography information includes that institute is in place The GPS information set, the scene information include the video data recorded using scene around position as object.
3. the method for augmented reality effect according to claim 1, which is characterized in that according to geography information and scene information With the position data of server storage and the similarity of contextual data, judge whether to read and send virtual reality effect data.
4. the method for augmented reality effect according to claim 3, which is characterized in that the similarity is as follows It calculates:
(1) in the location database L={ l of server1,l2,...lNIn search and position of the geography information in 20-25m Data acquisition system;
(2) according to scene database S={ V in server1,V2,...VN, the corresponding contextual data of calculating position data acquisition system Normalization histogram;
(3) similarity is calculated according to following formula:
Wherein, hclientThe homogenization histogram of scene information is represented,Represent fromIn extract in every 10 frame 1 frame.
5. a kind of system of augmented reality effect, which is characterized in that the described method includes:
Transmission unit: the position scene based on place sends geography information and scene information to server;
Comparing unit: geography information based on the received, the corresponding position data with server storage are index, are searched associated therewith The contextual data of connection, and received scene information is compared with the contextual data that server stores;
Display unit: the virtual reality effect data associated with position data and contextual data sent according to server, into Row augmented reality.
6. the system of augmented reality effect according to claim 5, which is characterized in that the geography information includes that institute is in place The GPS information set, the scene information include the video data recorded using scene around position as object.
7. the system of augmented reality effect according to claim 5, which is characterized in that the comparing unit is also used to: root According to the similarity of the position data and contextual data of geography information and the storage of scene information and server, judge whether to read concurrent Send virtual reality effect data.
8. the system of augmented reality effect according to claim 7, which is characterized in that the similarity is as follows It calculates:
(1) in the location database L={ l of server1,l2,...lNIn search and position of the geography information in 20-25m Data acquisition system;
(2) according to scene database S={ V in server1,V2,...VN, the corresponding contextual data of calculating position data acquisition system Normalization histogram;
(3) similarity is calculated according to following formula:
Wherein, hclientThe homogenization histogram of scene information is represented,Represent fromIn extract in every 10 frame 1 frame.
9. a kind of terminal characterized by comprising
Processor;
For the exectorial memory of storage processor;
Wherein, the processor is configured to:
Position scene based on place sends geography information and scene information to server;
Geography information based on the received, the corresponding position data with server storage are index, search scene associated there Data, and received scene information is compared with the contextual data that server stores;
When the two is consistent, virtual reality associated with the position data of the storage and contextual data effect that server is sent is received Fruit data, the virtual reality effect data based on transmission carry out augmented reality.
10. a kind of server characterized by comprising
Processor;
For the exectorial memory of storage processor;
Wherein, the processor is configured to:
Receive the geography information and scene information based on the position scene where it that terminal is sent;
Geography information based on the received is index with the corresponding position data of storage, searches contextual data associated there, and Received scene information is compared with the contextual data of storage;
When the two is consistent, virtual reality effect number associated with the position data of storage and contextual data is sent to terminal According to terminal carries out augmented reality based on the virtual reality effect data of transmission.
CN201810817185.3A 2018-07-24 2018-07-24 Method, system, terminal and the server of augmented reality effect Pending CN108961425A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810817185.3A CN108961425A (en) 2018-07-24 2018-07-24 Method, system, terminal and the server of augmented reality effect

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810817185.3A CN108961425A (en) 2018-07-24 2018-07-24 Method, system, terminal and the server of augmented reality effect

Publications (1)

Publication Number Publication Date
CN108961425A true CN108961425A (en) 2018-12-07

Family

ID=64463562

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810817185.3A Pending CN108961425A (en) 2018-07-24 2018-07-24 Method, system, terminal and the server of augmented reality effect

Country Status (1)

Country Link
CN (1) CN108961425A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103002410A (en) * 2012-11-21 2013-03-27 北京百度网讯科技有限公司 Augmented reality method and system for mobile terminals and mobile terminals
CN103424113A (en) * 2013-08-01 2013-12-04 毛蔚青 Indoor positioning and navigating method of mobile terminal based on image recognition technology
CN103530377A (en) * 2013-10-16 2014-01-22 北京理工大学 Scene information searching method based on binary feature codes
CN104794219A (en) * 2015-04-28 2015-07-22 杭州电子科技大学 Scene retrieval method based on geographical position information
KR20160112898A (en) * 2015-03-20 2016-09-28 한국과학기술원 Method and apparatus for providing dynamic service based augmented reality
CN107833280A (en) * 2017-11-09 2018-03-23 交通运输部天津水运工程科学研究所 A kind of outdoor moving augmented reality method being combined based on geographic grid with image recognition
US20180114065A1 (en) * 2016-10-26 2018-04-26 Alibaba Group Holding Limited User location determination based on augmented reality

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103002410A (en) * 2012-11-21 2013-03-27 北京百度网讯科技有限公司 Augmented reality method and system for mobile terminals and mobile terminals
CN103424113A (en) * 2013-08-01 2013-12-04 毛蔚青 Indoor positioning and navigating method of mobile terminal based on image recognition technology
CN103530377A (en) * 2013-10-16 2014-01-22 北京理工大学 Scene information searching method based on binary feature codes
KR20160112898A (en) * 2015-03-20 2016-09-28 한국과학기술원 Method and apparatus for providing dynamic service based augmented reality
CN104794219A (en) * 2015-04-28 2015-07-22 杭州电子科技大学 Scene retrieval method based on geographical position information
US20180114065A1 (en) * 2016-10-26 2018-04-26 Alibaba Group Holding Limited User location determination based on augmented reality
CN107833280A (en) * 2017-11-09 2018-03-23 交通运输部天津水运工程科学研究所 A kind of outdoor moving augmented reality method being combined based on geographic grid with image recognition

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
毕金强等: "一种基于SURF与地理格网模型的增强现实方法", 《计算机与现代化》 *

Similar Documents

Publication Publication Date Title
CN110602554B (en) Cover image determining method, device and equipment
US9710946B2 (en) Method and apparatus for displaying point of interest
JP5582548B2 (en) Display method of virtual information in real environment image
US9280804B2 (en) Rotation of an image based on image content to correct image orientation
KR101259957B1 (en) System and method for providing supplementary information using image matching
US20120044263A1 (en) Terminal device and method for augmented reality
CN106683195B (en) AR scene rendering method based on indoor positioning
US9832614B2 (en) Method, server and terminal for information interaction
CN111325798B (en) Camera model correction method, device, AR implementation equipment and readable storage medium
KR20150075532A (en) Apparatus and Method of Providing AR
CN106407439A (en) Method and system used for generating and marking track in photo or/and video set
CN104484814A (en) Advertising method and system based on video map
CN111970557A (en) Image display method, image display device, electronic device, and storage medium
TW201814553A (en) Method and system for remote management of location-based space object
CN112702643B (en) Barrage information display method and device and mobile terminal
CN108419112A (en) Streaming media video categorization, search method and device based on observing and controlling flight path information
CN109034214B (en) Method and apparatus for generating a mark
KR101173358B1 (en) Apparatus and method of guiding woodland path based on qr code
CN114283349A (en) Data processing method and device, computer equipment and storage medium
CN107544660B (en) Information processing method and electronic equipment
CN108961425A (en) Method, system, terminal and the server of augmented reality effect
CN109842791B (en) Image processing method and device
US20150379040A1 (en) Generating automated tours of geographic-location related features
US20140289019A1 (en) Information system to obtain an exposition rating of a geographical area
CN114666657B (en) Video editing method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20181207