CN105933500A - Mobile terminal, remote server, and communication method and system based on augmented reality - Google Patents
Mobile terminal, remote server, and communication method and system based on augmented reality Download PDFInfo
- Publication number
- CN105933500A CN105933500A CN201510400473.5A CN201510400473A CN105933500A CN 105933500 A CN105933500 A CN 105933500A CN 201510400473 A CN201510400473 A CN 201510400473A CN 105933500 A CN105933500 A CN 105933500A
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- virtual enhancing
- enhancing object
- communication
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention provides a mobile terminal, a remote server, and a communication method and system based on augmented reality. The method includes that an instruction for requesting interaction communication is sent to the remote server on the mobile terminal, and includes the geographic position information of the mobile terminal; a virtually augmented object sent by the remote server and the communication content of the virtually augmented object are received, the virtually augmented object is selected from predetermined virtually augmented objects by the remote server based on the geographic position information of the mobile terminal and the geographic information of the predetermined virtually augmented objects, the virtually augmented object represents an entity object; and on the mobile terminal, the interactive communication with the user of the mobile terminal is carried out by means of the communication content of the virtually augmented object by taking the virtually augmented object as a medium. According to the invention, the marketing manner based on augmented reality can be widely used in offline small and medium-sized businesses, and meanwhile, the complexity for identifying the augmented object is reduced, and the participation and experience of users are improved.
Description
Technical field
The present invention relates to technical field of data transmission, particularly to a kind of mobile terminal, remote server, based on enhancing
The means of communication of reality and system.
Background technology
Augmented reality (Augmented Reality, referred to as AR) is on the real world that people touch, attached
Add virtual information, the information of real world is strengthened or expands.By dummy object, the scene of computer generation
Or system prompt information superposition is in real scene, it is achieved user and environment directly carry out natural interaction.
Experiencing poor, to participate in interactive difficulty problem for solving traditional marketing mode, in recent years, augmented reality is got over
Carry out the most uses in goods marketing.But, in existing mode, marketing based on augmented reality is generally concentrated at
Advertisement and exhibition field, owing to using augmented reality cost high, medium and small trade company is used alone cost greatly, causes base
Widely used problem in medium and small trade company under the marketing of augmented reality is difficult to online.
Summary of the invention
Embodiments provide a kind of means of communication based on augmented reality, in order to marketing based on augmented reality
It is widely used in medium and small trade company under mode is online, reduces the participation identifying the complexity strengthening object, improving user simultaneously
Degree and experience property.The method includes: on mobile terminals, sends request to remote server and interacts the finger of communication
Order, described instruction includes the geographical location information of described mobile terminal；Receive the virtual increasing that described remote server sends
Strong object, and the Content of Communication of described virtual enhancing object, described virtual enhancing is to liking described remote server root
According to geographical location information and the geography information of pre-customized virtual enhancing object of described mobile terminal, from pre-customized virtual increasing
Electing in strong object, described virtual enhancing object represents entity object；On the mobile terminal, with described void
Intending strengthening object is medium, utilizes the described Content of Communication of virtual enhancing object and the user of mobile terminal to carry out interactive logical
News.
In one embodiment, the geographical location information of described mobile terminal includes: the location information of described mobile terminal
Photographic head orientation information with described mobile terminal.
In one embodiment, before sending, to remote server, the instruction that request interacts communication, also include:
Obtain the location information of described mobile terminal；Utilize gravity sensor and acceleration induction device to obtain described mobile terminal to exist
Vertically direction vector during state, and according to the photographic head of mobile terminal described in direction Vector operation towards orientation
Angle.
In one embodiment, the Content of Communication of described virtual enhancing object includes: interactive instruction and with described mutual finger
The response message that order is corresponding；With described virtual enhancing object as medium, utilize the Content of Communication of described virtual enhancing object
Interactive communication is carried out with the user of mobile terminal, including: identify the instruction of user；Friendship at described virtual enhancing object
Instruction is found mutually the interactive instruction of instructions match with user；With described virtual enhancing object as medium, utilize and look for
To response message corresponding to interactive instruction respond the instruction of user.
In one embodiment, the described Content of Communication of virtual enhancing object and the user of mobile terminal is being utilized to carry out mutually
Before dynamic communication, also include: the virtual enhancing object received is resolved；Virtual enhancing object after resolving
Display is on the screen of described mobile terminal.
The embodiment of the present invention additionally provides a kind of means of communication based on augmented reality, in order to battalion based on augmented reality
It is widely used in medium and small trade company under pin mode is online, reduces the ginseng identifying the complexity strengthening object, improving user simultaneously
With degree and experience property.The method includes: the request receiving mobile terminal transmission interacts the instruction of communication, described finger
Order includes the geographical location information of described mobile terminal；Geographical location information according to described mobile terminal and each pre-customized
The geography information of virtual enhancing object, a selected virtual enhancing object, institute from pre-customized virtual enhancing object
State virtual enhancing object and represent entity object；By selected virtual enhancing object and the communication of described virtual enhancing object
Content, is sent to described mobile terminal, and wherein, on the mobile terminal, described virtual enhancing object is mutual
Medium, utilizes the described Content of Communication of virtual enhancing object and the user of mobile terminal to carry out interactive communication.
In one embodiment, the geographical location information of described mobile terminal includes: the location information of described mobile terminal
Photographic head orientation information with described mobile terminal；Geographical location information according to described mobile terminal and each pre-customized
The geography information of virtual enhancing object, a selected virtual enhancing object from pre-customized virtual enhancing object, including:
Location information according to described mobile terminal and the geography information of each pre-customized virtual enhancing object, calculate described movement
Distance value between terminal and each pre-customized virtual enhancing object；Location information according to described mobile terminal, each pre-
The geography information of the virtual enhancing object of customization and the photographic head orientation information of described mobile terminal, calculate each pre-customized
Virtual enhancing object and described mobile terminal photographic head towards between angular separation；For each pre-customized virtual
Strengthen object, calculate the product of distance value corresponding to this pre-customized virtual enhancing object and the sine value of angular separation；
Determine that pre-customized virtual enhancing object corresponding to the minima of product is described virtual enhancing object.
In one embodiment, before the request receiving mobile terminal transmission interacts the instruction of communication, also include:
The instruction customizing each pre-customized virtual enhancing object, each pre-customized virtual enhancing is received by Web page mode
Object and each Content of Communication one_to_one corresponding.
In one embodiment, each pre-customized virtual enhancing object and trade company's one_to_one corresponding, each pre-customized virtual increasing
The geography information of strong object is consistent with the geography information of corresponding trade company, the Content of Communication of each pre-customized virtual enhancing object
Marketing message including corresponding trade company.
The embodiment of the present invention additionally provides a kind of mobile terminal, in order to during marketing mode based on augmented reality descends online
It is widely used in little trade company, reduces simultaneously and identify the complexity of enhancing object, the participation improving user and experience property.
This mobile terminal includes: the first sending module, interacts the instruction of communication for sending request to remote server,
Described instruction includes the geographical location information of described mobile terminal；First receiver module, is used for receiving described remote service
The virtual enhancing object that device sends, and the Content of Communication of described virtual enhancing object, described virtual enhancing is to liking institute
State remote server according to the geographical location information of described mobile terminal and the geography information of pre-customized virtual enhancing object,
Electing from pre-customized virtual enhancing object, described virtual enhancing object represents entity object；Interactive module, uses
In with described virtual enhancing object as medium, utilize the Content of Communication of described virtual enhancing object and the user of mobile terminal
Carry out interactive communication.
In one embodiment, the geographical location information of described mobile terminal includes: the location information of described mobile terminal
Photographic head orientation information with described mobile terminal；Described mobile terminal, also includes: global position system GPS mould
Block, for, before sending, to remote server, the instruction that request interacts communication, obtaining determining of described mobile terminal
Position information；Computing module, for before sending, to remote server, the instruction that request interacts communication, utilizes weight
Power induction apparatus and acceleration induction device obtain the described mobile terminal direction vector when vertical state, and according to the direction
The photographic head of mobile terminal described in Vector operation towards azimuth.
In one embodiment, the Content of Communication of described virtual enhancing object includes: interactive instruction and with described mutual finger
The response message that order is corresponding；Described interactive module, including: recognition unit, for identifying the instruction of user；Coupling is single
Unit, for finding the interactive instruction of the instructions match with user in the interactive instruction of described virtual enhancing object；Alternately
Unit, for described virtual enhancing object as medium, utilizes the response message corresponding with the interactive instruction found to ring
Answer the instruction of user.
In one embodiment, also include: parsing module, at the Content of Communication utilizing described virtual enhancing object
Before carrying out interactive communication with the user of mobile terminal, the virtual enhancing object received is resolved；Display module,
Virtual enhancing object after showing parsing.
The embodiment of the present invention additionally provides a kind of remote server, in order under marketing mode based on augmented reality is online
It is widely used in medium and small trade company, reduces simultaneously and identify the complexity of enhancing object, the participation improving user and experience property.
This remote server includes: the second receiver module, and the request sent for receiving mobile terminal interacts the finger of communication
Order, described instruction includes the geographical location information of described mobile terminal；Matching module, for according to described mobile terminal
Geographical location information and the geography information of each pre-customized virtual enhancing object, from pre-customized virtual enhancing object
A selected virtual enhancing object, described virtual enhancing object represents entity object；Second sending module, for selecting
Fixed virtual enhancing object and the Content of Communication of described virtual enhancing object, be sent to described mobile terminal, wherein,
On the mobile terminal, described virtual enhancing object is mutual medium, utilizes the communication of described virtual enhancing object
Content carries out interactive communication with the user of mobile terminal.
In one embodiment, the geographical location information of described mobile terminal includes: the location information of described mobile terminal
Photographic head orientation information with described mobile terminal；Described matching module, including: metrics calculation unit, for basis
The location information of described mobile terminal and the geography information of each pre-customized virtual enhancing object, calculate described mobile terminal
And the distance value between each pre-customized virtual enhancing object；Angle calculation unit, for according to described mobile terminal
The photographic head of location information, the geography information of each pre-customized virtual enhancing object and described mobile terminal is towards letter
Breath, calculate the photographic head of each pre-customized virtual enhancing object and described mobile terminal towards between angular separation；Take advantage of
Product unit, for for each pre-customized virtual enhancing object, calculate this pre-customized virtual enhancing object corresponding away from
The product of the sine value of distance values and angular separation；Determine unit, determine corresponding pre-customized virtual of the minima of product
Strengthening object is described virtual enhancing object.
In one embodiment, also include: customized module, for interacting in the request receiving mobile terminal transmission
Before the instruction of communication, received the instruction customizing each pre-customized virtual enhancing object by Web page mode, respectively
Pre-customized virtual enhancing object and each Content of Communication one_to_one corresponding.
The embodiment of the present invention additionally provides a kind of communication system based on augmented reality, in order to battalion based on augmented reality
It is widely used in medium and small trade company under pin mode is online, reduces the ginseng identifying the complexity strengthening object, improving user simultaneously
With degree and experience property.This system includes: any of the above-described kind of mobile terminal and any of the above-described kind of remote server.
In embodiments of the present invention, determined the virtual enhancing object mated with mobile terminal by geography information, and then
On mobile terminals, with virtual enhancing object as medium, utilize Content of Communication and the mobile terminal of virtual enhancing object
User carries out interactive communication, and such as, this virtual enhancing object can represent trade company, the Content of Communication of virtual enhancing object
Can be the goods marketing information of trade company, be realized by the interactive communication between virtual enhancing object and mobile phone users
The goods marketing of trade company, is interacted communication by being then based on mobile terminal with user, it is thereby achieved that and line
Under effective combination of business activities under the geographical position of medium and small trade company and line, also allow for marketing mode based on augmented reality
It is widely used in medium and small trade company under Xian；Identified and determine, by then passing through geography information, mate with mobile terminal virtual
Strengthen object, it is to avoid the image processing techniques identification reference mark such as feature detection, edge detection, optical imagery,
Thus reduce and identify the complexity strengthening object；Simultaneously because directly carried out mutually with user by virtual enhancing object
Dynamic communication, thus improve participation and the experience property of user.
Accompanying drawing explanation
Accompanying drawing described herein is used for providing a further understanding of the present invention, constitutes the part of the application, not
Constitute limitation of the invention.In the accompanying drawings:
Fig. 1 is the flow chart of a kind of based on augmented reality the means of communication that the embodiment of the present invention provides；
Fig. 2 is the flow chart of the another kind means of communication based on augmented reality that the embodiment of the present invention provides；
Fig. 3 is a kind of calculating between mobile terminal and each pre-customized virtual enhancing object of embodiment of the present invention offer
Distance and the schematic diagram of angle；
Fig. 4 is the structured flowchart of a kind of based on augmented reality the communication system that the embodiment of the present invention provides.
Detailed description of the invention
For making the object, technical solutions and advantages of the present invention clearer, below in conjunction with embodiment and accompanying drawing,
The present invention is described in further details.Here, the exemplary embodiment of the present invention and explanation thereof are used for explaining this
Bright, but not as a limitation of the invention.
In prior art, owing to marketing based on augmented reality is generally concentrated at advertisement and exhibition field, use and strengthen now
Real technical costs is high, and it is big that medium and small trade company is used alone cost so that is unfavorable for that marketing mode based on augmented reality is online
Under be widely used in medium and small trade company.Present inventor finds, mobile terminal device typically have certain operational capability,
The various sensors such as photographic head, accelerometer gyroscope and global positioning system (Global Positioning System,
Referred to as GPS) module etc., it is integrated with the various correlation techniques that augmented reality system needs, it is therefore proposed that will be mobile
Terminal as the exploitation application platform of AR technology, identifies based on geography information and determines mate with mobile terminal virtual
Strengthening object, and then interact communication by virtual enhancing object with user, trade company can be by virtual enhancing object
And the interactive correspondence between user realizes goods marketing so that marketing mode based on augmented reality be not confined to advertisement
With exhibition field, it is widely used in medium and small trade company under being conducive to marketing mode based on augmented reality online.
In embodiments of the present invention, it is provided that a kind of means of communication based on augmented reality, the method can be by application
The form of program (Application, referred to as APP) operates on mobile terminal (such as, mobile phone etc.), such as figure
Shown in 1, the method includes:
Step 101: on mobile terminals, sends request to remote server and interacts the instruction of communication, described finger
Order includes the geographical location information of described mobile terminal；
Step 102: receive the virtual enhancing object that described remote server sends, and described virtual enhancing object
Content of Communication, described virtual enhancing to as if described remote server according to the geographical location information of described mobile terminal and
The geography information of pre-customized virtual enhancing object, elects, described virtual enhancing from pre-customized virtual enhancing object
Object represents entity object；
Step 103: on the mobile terminal, with described virtual enhancing object as medium, utilizes described virtual enhancing
The Content of Communication of object and the user of mobile terminal carry out interactive communication.
Flow process as shown in Figure 1 understands, and in embodiments of the present invention, is determined and mobile terminal by geography information
The virtual enhancing object joined, and then on mobile terminals, with virtual enhancing object as medium, utilize virtual enhancing object
The user of Content of Communication and mobile terminal carry out interactive communication, such as, this virtual enhancing object can represent trade company,
The Content of Communication of virtual enhancing object can be the goods marketing information of trade company, by virtual enhancing object and mobile terminal
Interactive communication between user realizes the goods marketing of trade company, is interacted communication by being then based on mobile terminal with user
, it is thereby achieved that effective combination of business activities under the geographical position of medium and small trade company and line with under line, also allow for
It is widely used in medium and small trade company under marketing mode based on augmented reality is online；Identified really by then passing through geography information
The fixed virtual enhancing object mated with mobile terminal, it is to avoid the image processing techniques such as feature detection, edge detection knowledge
Other reference mark, optical imagery, thus reduce and identify the complexity strengthening object；Simultaneously because by virtual enhancing
Object directly to carry out interactive communication with user, thus improves participation and the experience property of user.
When being embodied as, the geographical location information of above-mentioned mobile terminal may include that the location information of described mobile terminal
With the photographic head orientation information of described mobile terminal, concrete, determine match with described mobile terminal to identify
Virtual enhancing object, in the present embodiment, before sending, to remote server, the instruction that request interacts communication,
Also include: obtain the location information of described mobile terminal；Such as, collected by the GPS module of described mobile terminal
The location information of mobile terminal, this location information is the location letter of the current location that user's this mobile terminal hand-held is arrived
Breath.Gravity sensor and acceleration induction device is utilized to obtain the described mobile terminal direction vector when vertical state, and
Photographic head according to mobile terminal described in direction Vector operation towards azimuth；Such as, when the mobile terminal of user
Open photographic head and of short duration static time, the gravity sensor of mobile terminal and acceleration induction device obtain this mobile terminal and exist
Vertically direction vector during state, and according to the photographic head of the direction this mobile terminal of Vector operation towards azimuth,
And then by photographic head towards azimuth be sent to remote server, in order to remote server is according to the location of mobile terminal
Information and photographic head towards azimuth identify the virtual enhancing object matched with mobile terminal.
When being embodied as, after receiving the virtual enhancing object that remote server sends, it is possible to carry out virtual enhancing right
As the interactive correspondence with user, concrete, the Content of Communication of described virtual enhancing object includes: interactive instruction and with
The response message that described interactive instruction is corresponding；With described virtual enhancing object as medium, utilize described virtual enhancing object
The user of Content of Communication and mobile terminal carry out interactive communication, including: identify the instruction of user；In described virtual increasing
The interactive instruction of strong object is found the interactive instruction of instructions match with user；With described virtual enhancing object as matchmaker
It is situated between, utilizes the response message corresponding with the interactive instruction found to respond the instruction of user.Such as, interactive instruction is permissible
Being the instruction of the form such as voice or gesture, the response message corresponding with interactive instruction can be sound, word or picture etc.
The information of form, when mutual with user, first, identifies voice or the gesture instruction of user, then by the finger of user
The interactive instruction supported with this virtual enhancing object of order is mated, and by corresponding to the interactive instruction that the match is successful
Response content by virtual enhancing object representation out, to respond the instruction of user, it is achieved mutual.
When being embodied as, interactive logical utilizing the described Content of Communication of virtual enhancing object and the user of mobile terminal to carry out
Before news, also include: the virtual enhancing object received is resolved；Virtual enhancing object after resolving shows
On the screen of described mobile terminal.Such as, after receiving the virtual enhancing object that remote server sends, to reception
To virtual enhancing object process, this virtual enhancing object is probably 3D model, resolves 3D model,
Relevant information explanation to the virtual enhancing object after resolving and virtual enhancing object renders, and by right for virtual enhancing
As being shown on the screen of mobile terminal, in order to interact communication with user.
Mutual in order to realize between the most virtual enhancing object and user, in the present embodiment, also provide for
A kind of means of communication based on augmented reality, the method may operate on remote server, as in figure 2 it is shown, should
Method includes:
Step 201: the request receiving mobile terminal transmission interacts the instruction of communication, and described instruction includes described shifting
The geographical location information of dynamic terminal；
Step 202: according to geographical location information and the geography of each pre-customized virtual enhancing object of described mobile terminal
Information, a selected virtual enhancing object from pre-customized virtual enhancing object, described virtual enhancing object represents real
Body object；
Step 203: by described virtual enhancing object and the Content of Communication of described virtual enhancing object, is sent to described
Mobile terminal, wherein, on the mobile terminal, described virtual enhancing object is mutual medium, utilizes described void
The user of the Content of Communication and mobile terminal of intending enhancing object carries out interactive communication.
Flow process as shown in Figure 2 understands, in the present embodiment, it is achieved that come from pre-customized by geographical location information
In virtual enhancing object, a selected virtual enhancing object, and by this selected virtual enhancing object and this virtual enhancing
The Content of Communication of object is sent to mobile terminal, in order to carry out on mobile terminals between virtual enhancing object and user
Interactive correspondence.
In order to realize a selected virtual enhancing object mated with mobile terminal from pre-customized virtual enhancing object,
In the present embodiment, the geographical location information of described mobile terminal may include that described mobile terminal location information and
The photographic head orientation information of described mobile terminal；Concrete, according to the geographical location information of described mobile terminal and each pre-
The geography information of the virtual enhancing object of customization, from pre-customized virtual enhancing object, a selected virtual enhancing is right
As, including:
First, according to location information and the geography information of each pre-customized virtual enhancing object of described mobile terminal, meter
Calculate the distance value between described mobile terminal and each pre-customized virtual enhancing object；Such as, as it is shown on figure 3, A point
Being the location positioning of mobile terminal, AB is the photographic head direction of mobile terminal, and C is the virtual enhancing that certain is pre-customized
The position of object is it is known that the location positioning of mobile terminal and the position of certain pre-customized virtual enhancing object can calculate
Go out distance L between mobile terminal and the virtual enhancing object that certain is pre-customized, can be with the value of rough calculation L, it is assumed that
The gps coordinate value of A and C is respectively (α 1, β 1) and (α 2, β 2), and earth radius is R, then
L=R arccos [cos β 1cos β 2cos (α 1-α 2)+sin β 1sin β 2].
Secondly, according to the location information of described mobile terminal, the geography information of each pre-customized virtual enhancing object and
The photographic head orientation information of described mobile terminal, calculates taking the photograph of each pre-customized virtual enhancing object and described mobile terminal
As head towards between angular separation；Such as, as it is shown on figure 3, certain pre-customized virtual enhancing object is whole with mobile
End photographic head towards between angular separation be the difference at the azimuth of AB and AC in θ, i.e. figure.
Again, for each pre-customized virtual enhancing object, the distance that this pre-customized virtual enhancing object is corresponding is calculated
The product of the sine value of value and angular separation；Such as, based on shown in Fig. 3, certain pre-customized virtual enhancing object pair
The product of the sine value of the distance value L answered and angular separation θ is L*sin θ.
Finally, determine that pre-customized virtual enhancing object corresponding to the minima of product is selected virtual enhancing object.
I.e. determine that pre-customized virtual enhancing object corresponding to the minima of L*sin θ is selected virtual enhancing object, pass through
This selected virtual enhancing object interacts communication with user on mobile terminals.L*sin θ minima represents virtual
Strengthen object positional distance screen center's point in mobile terminal screen minimum, it is seen then that remote server selects one
Virtual enhancing object interacts communication on mobile terminals with user, thus avoids because showing multiple virtual enhancing objects
And the interface confusion caused.
Mutual in order to realize between virtual enhancing object and user, in the present embodiment, send receiving mobile terminal
Request interact communication instruction before, also include: receive customization by Web page mode each pre-customized
The instruction of virtual enhancing object, each pre-customized virtual enhancing object and each Content of Communication one_to_one corresponding.Such as, user
Remote server customization 3D cartoon figure or the virtual enhancing object of 2D can be signed in by web mode, and fixed
Interactive instruction that adopted and each virtual enhancing object is corresponding and the form of response and content.Customizing virtual strengthens for the convenience of the user
Object, remote server may be provided for the template of some virtual enhancing objects and selects for user.
When being embodied as, in order to the above-mentioned means of communication based on augmented reality are applied in goods marketing, each in customization
During pre-customized virtual enhancing object, can be by each pre-customized virtual enhancing object and entity trade company one a pair
Should, i.e. one pre-customized virtual enhancing object represents an entity trade company, the ground of each pre-customized virtual enhancing object
Reason information can be consistent with the geography information of corresponding trade company, and it is right that the Content of Communication of each pre-customized virtual enhancing object includes
Answer the marketing message of trade company, for example, it is possible to include the marketing message such as reward voucher, menu, in order on mobile terminals,
Mutual by between virtual enhancing object and user, it is achieved virtual enhancing object represents trade company and user is mutual, guides
User completes reward voucher and gets, goods browse, place an order or select the service such as seat, is beneficial to trade company and carries out on line or under line
Marketing service, and on-line off-line collaborative marketing service.
In the present embodiment, additionally provide a kind of communication system based on augmented reality, as shown in Figure 4, be somebody's turn to do based on increasing
The communication system of strong reality, including: mobile terminal 401 and remote server 402, concrete, mobile terminal 401
With remote server 402 by following steps realization communication based on augmented reality:
Step 1: the first sending module 4011 of mobile terminal 401 sends request to remote server and interacts logical
The instruction of news, described instruction includes the geographical location information of described mobile terminal；
Step 2: the second receiver module 4021 of remote server 402 receives the request of mobile terminal transmission and hands over
The instruction of communication mutually；
Step 3: the matching module 4022 of remote server 402 according to the geographical location information of described mobile terminal and
The geography information of each pre-customized virtual enhancing object, a selected virtual enhancing from pre-customized virtual enhancing object
Object；
Step 4: the second sending module 4023 of remote server 402 is by described virtual enhancing object and described void
Intend strengthening the Content of Communication of object, be sent to described mobile terminal so that on the mobile terminal, described virtual increasing
Strong object is mutual medium, utilizes the described Content of Communication of virtual enhancing object and the user of mobile terminal to carry out interaction
Communication；
Step 5: the first receiver module 4012 of mobile terminal 401 receives the virtual increasing that described remote server sends
Strong object, and the Content of Communication of described virtual enhancing object；
Step 6: the interactive module 4013 of mobile terminal 401, with described virtual enhancing object as medium, utilizes described
The Content of Communication of virtual enhancing object and the user of mobile terminal carry out interactive communication.
When being embodied as, in order to obtain the geographical location information of mobile terminal, in the present embodiment, described mobile terminal
Geographical location information include: the location information of described mobile terminal and the photographic head orientation information of described mobile terminal；
Described mobile terminal 401, also includes: GPS module, for interacting communication to remote server transmission request
Instruction before, obtain the location information of described mobile terminal；Computing module, for asking to remote server transmission
Before asking the instruction interacting communication, gravity sensor and acceleration induction device is utilized to obtain described mobile terminal perpendicular
Direction vector during straight state, and according to the photographic head of mobile terminal described in direction Vector operation towards azimuth.
When being embodied as, mutual in order to realize between virtual enhancing object and user, in the present embodiment, described void
The Content of Communication intending strengthening object corresponding includes: interactive instruction and the response message corresponding with described interactive instruction；Described
Interactive module, including: recognition unit, for identifying the instruction of user；Matching unit, in described virtual enhancing
The interactive instruction of object is found the interactive instruction of instructions match with user；Interactive unit, for described virtual increasing
Strong object is medium, utilizes the response message corresponding with the interactive instruction found to respond the instruction of user.
When being embodied as, above-mentioned mobile terminal 401 also includes: parsing module, for utilizing described virtual enhancing right
Before the Content of Communication of elephant and the user of mobile terminal carry out interactive communication, the virtual enhancing object received is solved
Analysis；Display module, the virtual enhancing object after showing parsing.
The virtual enhancing object mated with mobile terminal is determined in order to identify, and then by this virtual enhancing object and use
Family interacts, and in the present embodiment, the geographical location information of described mobile terminal includes: determining of described mobile terminal
Position information and the photographic head orientation information of described mobile terminal；The matching module of remote server 402, including: distance
Computing unit, for the location information according to described mobile terminal and the geographical letter of each pre-customized virtual enhancing object
Breath, calculates the distance value between described mobile terminal and each pre-customized virtual enhancing object；Angle calculation unit, uses
In the location information according to described mobile terminal, the geography information of each pre-customized virtual enhancing object and described movement
The photographic head orientation information of terminal, calculate the photographic head of each pre-customized virtual enhancing object and described mobile terminal towards
Between angular separation；Product unit, for for each pre-customized virtual enhancing object, calculates this pre-customized void
Intend the product strengthening distance value corresponding to object with the sine value of angular separation；Determine unit, determine the minima of product
Corresponding pre-customized virtual enhancing object is described virtual enhancing object.
When being embodied as, user can strengthen object, in the present embodiment, remote server 402 with customizing virtual
Also include: customized module, before interact the instruction of communication in the request receiving mobile terminal transmission, pass through
Web page mode receives the instruction customizing each pre-customized virtual enhancing object, each pre-customized virtual enhancing object with
Each Content of Communication one_to_one corresponding.Such as, during customizing each pre-customized virtual enhancing object, user can be led to
Cross web mode and sign in remote server customization 3D cartoon figure or the virtual enhancing object of 2D, can be by each pre-
The virtual enhancing object of customization and trade company's one_to_one corresponding, i.e. one virtual enhancing object represents a trade company, each pre-customized
The geography information of virtual enhancing object can be consistent with the geography information of corresponding trade company, with each pre-customized virtual enhancing
The Content of Communication that object is corresponding includes the marketing message of corresponding trade company, for example, it is possible to include that reward voucher, menu etc. are marketed
Information, in order on mobile terminals, mutual by between virtual enhancing object and user, it is achieved virtual enhancing object
Represent trade company and user mutual, guide user to complete reward voucher and get, goods browse, place an order or select the services such as seat.
In embodiments of the present invention, determined the virtual enhancing object mated with mobile terminal by geography information, and then
On mobile terminals, with virtual enhancing object as medium, utilize Content of Communication and the mobile terminal of virtual enhancing object
User carries out interactive communication, and such as, this virtual enhancing object can represent trade company, the Content of Communication of virtual enhancing object
Can be the goods marketing information of trade company, be realized by the interactive communication between virtual enhancing object and mobile phone users
The goods marketing of trade company, is interacted communication by being then based on mobile terminal with user, it is thereby achieved that and line
Under effective combination of business activities under the geographical position of medium and small trade company and line, also allow for marketing mode based on augmented reality
It is widely used in medium and small trade company under Xian；Identified and determine, by then passing through geography information, mate with mobile terminal virtual
Strengthen object, it is to avoid the image processing techniques identification reference mark such as feature detection, edge detection, optical imagery,
Thus reduce and identify the complexity strengthening object；Simultaneously because directly carried out mutually with user by virtual enhancing object
Dynamic communication, thus improve participation and the experience property of user.
Obviously, those skilled in the art should be understood that each module of the above-mentioned embodiment of the present invention or each step are permissible
Realizing with general calculating device, they can concentrate on single calculating device, or is distributed in multiple calculating
On the network that device is formed, alternatively, they can realize with calculating the executable program code of device, thus,
Can be stored in storing in device and be performed by calculating device, and in some cases, can be to be different from
The step shown or described by order execution herein, or they are fabricated to respectively each integrated circuit modules, or
Multiple modules in them or step are fabricated to single integrated circuit module and realize by person.So, the embodiment of the present invention
It is not restricted to any specific hardware and software combine.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for the skill of this area
For art personnel, the embodiment of the present invention can have various modifications and variations.All within the spirit and principles in the present invention,
Any modification, equivalent substitution and improvement etc. made, should be included within the scope of the present invention.
Claims (17)
1. means of communication based on augmented reality, it is characterised in that including:
On mobile terminals, sending request to remote server and interact the instruction of communication, described instruction includes described
The geographical location information of mobile terminal；
Receive the virtual enhancing object that described remote server sends, and the Content of Communication of described virtual enhancing object,
Described virtual enhancing to as if described remote server according to the geographical location information of described mobile terminal and pre-customized void
Intending strengthening the geography information of object, elect from pre-customized virtual enhancing object, described virtual enhancing object represents
Entity object；
On the mobile terminal, with described virtual enhancing object as medium, utilize the communication of described virtual enhancing object
Content carries out interactive communication with the user of mobile terminal.
2. the method for claim 1, it is characterised in that the geographical location information of described mobile terminal includes:
The location information of described mobile terminal and the photographic head orientation information of described mobile terminal.
3. method as claimed in claim 2, it is characterised in that interact sending request to remote server
Before the instruction of communication, also include:
Obtain the location information of described mobile terminal；
Gravity sensor and acceleration induction device is utilized to obtain the described mobile terminal direction vector when vertical state, and
Photographic head according to mobile terminal described in direction Vector operation towards azimuth.
4. method as claimed any one in claims 1 to 3, it is characterised in that described virtual enhancing object
Content of Communication includes: interactive instruction and the response message corresponding with described interactive instruction；
With described virtual enhancing object as medium, utilize the Content of Communication of described virtual enhancing object and the use of mobile terminal
Family carries out interactive communication, including:
Identify the instruction of user；
The interactive instruction of instructions match with user is found in the interactive instruction of described virtual enhancing object；
With described virtual enhancing object as medium, utilize the response message corresponding with the interactive instruction found to respond user
Instruction.
5. method as claimed any one in claims 1 to 3, it is characterised in that utilizing described virtual enhancing
Before the Content of Communication of object and the user of mobile terminal carry out interactive communication, also include:
The virtual enhancing object received is resolved；
Virtual enhancing object after resolving shows on the screen of described mobile terminal.
6. means of communication based on augmented reality, it is characterised in that including:
The request receiving mobile terminal transmission interacts the instruction of communication, and described instruction includes the ground of described mobile terminal
Reason positional information；
Geographical location information according to described mobile terminal and the geography information of each pre-customized virtual enhancing object, from advance
A selected virtual enhancing object in the virtual enhancing object of customization, described virtual enhancing object represents entity object；
By described virtual enhancing object and the Content of Communication of described virtual enhancing object, it is sent to described mobile terminal,
Wherein, on the mobile terminal, described virtual enhancing object is mutual medium, utilizes described virtual enhancing object
The user of Content of Communication and mobile terminal carry out interactive communication.
7. method as claimed in claim 6, it is characterised in that the geographical location information of described mobile terminal includes:
The location information of described mobile terminal and the photographic head orientation information of described mobile terminal；
Geographical location information according to described mobile terminal and the geography information of each pre-customized virtual enhancing object, from advance
A selected virtual enhancing object in the virtual enhancing object of customization, including:
Location information according to described mobile terminal and the geography information of each pre-customized virtual enhancing object, calculate described
Distance value between mobile terminal and each pre-customized virtual enhancing object；
Location information, the geography information of each pre-customized virtual enhancing object and described shifting according to described mobile terminal
The photographic head orientation information of dynamic terminal, calculates the photographic head court of each pre-customized virtual enhancing object and described mobile terminal
Angular separation between to；
For each pre-customized virtual enhancing object, calculate distance value corresponding to this pre-customized virtual enhancing object and side
Product to the sine value of angle；
Determine that pre-customized virtual enhancing object corresponding to the minima of product is described virtual enhancing object.
Method the most as claimed in claims 6 or 7, it is characterised in that enter in the request receiving mobile terminal transmission
Before the instruction of row interactive correspondence, also include:
The instruction customizing each pre-customized virtual enhancing object is received by Web page mode, each pre-customized virtual
Strengthen object and each Content of Communication one_to_one corresponding.
Method the most as claimed in claims 6 or 7, it is characterised in that each pre-customized virtual enhancing object and business
Family one_to_one corresponding, the geography information of each pre-customized virtual enhancing object is consistent with the geography information of corresponding trade company, each pre-
The Content of Communication of the virtual enhancing object of customization includes the marketing message of corresponding trade company.
10. a mobile terminal, it is characterised in that including:
First sending module, interacts the instruction of communication for sending request to remote server, and described instruction includes
The geographical location information of described mobile terminal；
First receiver module, for receiving the virtual enhancing object that described remote server sends, and described virtual increasing
The Content of Communication of strong object, described virtual enhancing is to liking the described remote server geographical position according to described mobile terminal
Confidence breath and the geography information of pre-customized virtual enhancing object, elect from pre-customized virtual enhancing object, described
Virtual enhancing object represents entity object；
Interactive module, for described virtual enhancing object as medium, utilizes the Content of Communication of described virtual enhancing object
Interactive communication is carried out with the user of mobile terminal.
11. mobile terminals as claimed in claim 10, it is characterised in that the geographical position letter of described mobile terminal
Breath includes: the location information of described mobile terminal and the photographic head orientation information of described mobile terminal；
Described mobile terminal, also includes:
Global position system GPS module, for remote server send request interact communication instruction it
Before, obtain the location information of described mobile terminal；
Computing module, for, before sending, to remote server, the instruction that request interacts communication, utilizing gravity-feed tank
Device and acceleration induction device is answered to obtain the described mobile terminal direction vector when vertical state, and according to direction vector
Calculate the photographic head of described mobile terminal towards azimuth.
12. mobile terminals as described in claim 10 or 11, it is characterised in that leading to of described virtual enhancing object
Letter content includes: interactive instruction and the response message corresponding with described interactive instruction；Described interactive module, including:
Recognition unit, for identifying the instruction of user；
Matching unit, for finding the mutual of instructions match with user in the interactive instruction of described virtual enhancing object
Instruction；
Interactive unit, for described virtual enhancing object as medium, utilizes the response corresponding with the interactive instruction found
Information responds the instruction of user.
13. mobile terminals as described in claim 10 or 11, it is characterised in that also include:
Parsing module, for utilizing the described Content of Communication of virtual enhancing object and the user of mobile terminal to carry out interaction
Before communication, the virtual enhancing object received is resolved；
Display module, the virtual enhancing object after showing parsing.
14. 1 kinds of remote servers, it is characterised in that including:
Second receiver module, the request sent for receiving mobile terminal interacts the instruction of communication, described instruction bag
Include the geographical location information of described mobile terminal；
Matching module, for according to the geographical location information of described mobile terminal and each pre-customized virtual enhancing object
Geography information, a selected virtual enhancing object, described virtual enhancing object generation from pre-customized virtual enhancing object
Table entity object；
Second sending module, is used for selected virtual enhancing object and the Content of Communication of described virtual enhancing object,
Being sent to described mobile terminal, wherein, on the mobile terminal, described virtual enhancing object is mutual medium,
The described Content of Communication of virtual enhancing object and the user of mobile terminal is utilized to carry out interactive communication.
15. remote servers as claimed in claim 14, it is characterised in that the geographical position of described mobile terminal
Information includes: the location information of described mobile terminal and the photographic head orientation information of described mobile terminal；
Described matching module, including:
Metrics calculation unit, for according to the location information of described mobile terminal and each pre-customized virtual enhancing object
Geography information, calculates the distance value between described mobile terminal and each pre-customized virtual enhancing object；
Angle calculation unit, for according to the location information of described mobile terminal, each pre-customized virtual enhancing object
The photographic head orientation information of geography information and described mobile terminal, calculates each pre-customized virtual enhancing object with described
The photographic head of mobile terminal towards between angular separation；
Product unit, for for each pre-customized virtual enhancing object, calculates this pre-customized virtual enhancing object pair
The product of the sine value of the distance value answered and angular separation；
Determine unit, determine that pre-customized virtual enhancing object corresponding to the minima of product is that described virtual enhancing is right
As.
16. remote servers as described in claims 14 or 15, it is characterised in that also include:
Customized module, before interact the instruction of communication in the request receiving mobile terminal transmission, passes through Web
Page mode receives the instruction customizing each pre-customized virtual enhancing object, and each pre-customized virtual enhancing object is logical with each
Letter content one_to_one corresponding.
17. 1 kinds of communication systems based on augmented reality, it is characterised in that including:
Mobile terminal according to any one of claim 10 to 13；
Remote server according to any one of claim 14 to 16.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510400473.5A CN105933500A (en) | 2015-07-09 | 2015-07-09 | Mobile terminal, remote server, and communication method and system based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510400473.5A CN105933500A (en) | 2015-07-09 | 2015-07-09 | Mobile terminal, remote server, and communication method and system based on augmented reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105933500A true CN105933500A (en) | 2016-09-07 |
Family
ID=56839873
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510400473.5A Pending CN105933500A (en) | 2015-07-09 | 2015-07-09 | Mobile terminal, remote server, and communication method and system based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105933500A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107644335A (en) * | 2017-09-18 | 2018-01-30 | 维沃移动通信有限公司 | A kind of method of payment, mobile terminal and server |
| CN108665294A (en) * | 2017-03-30 | 2018-10-16 | 阿里巴巴集团控股有限公司 | Virtual resource object processing method, device and computer system |
| CN108712360A (en) * | 2017-04-12 | 2018-10-26 | 朱恩辛 | A kind of transboundary interactive friend-making system and its method |
| CN111724484A (en) * | 2020-06-10 | 2020-09-29 | 深圳市金研微科技有限公司 | Augmented reality information interaction system and interaction method |
| CN112055034A (en) * | 2019-06-05 | 2020-12-08 | 北京外号信息技术有限公司 | Interaction method and system based on optical communication device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103164518A (en) * | 2013-03-06 | 2013-06-19 | 杭州九树网络科技有限公司 | Mobile terminal (MT) augmented reality application system and method |
| CN103826201A (en) * | 2014-02-13 | 2014-05-28 | 夷希数码科技(上海)有限公司 | Geographical position-based virtual interaction method and system thereof |
| CN104166929A (en) * | 2014-08-06 | 2014-11-26 | 北京行云时空科技有限公司 | Information pushing system and method based on space-time scenes |
-
2015
- 2015-07-09 CN CN201510400473.5A patent/CN105933500A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103164518A (en) * | 2013-03-06 | 2013-06-19 | 杭州九树网络科技有限公司 | Mobile terminal (MT) augmented reality application system and method |
| CN103826201A (en) * | 2014-02-13 | 2014-05-28 | 夷希数码科技(上海)有限公司 | Geographical position-based virtual interaction method and system thereof |
| CN104166929A (en) * | 2014-08-06 | 2014-11-26 | 北京行云时空科技有限公司 | Information pushing system and method based on space-time scenes |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108665294A (en) * | 2017-03-30 | 2018-10-16 | 阿里巴巴集团控股有限公司 | Virtual resource object processing method, device and computer system |
| CN108712360A (en) * | 2017-04-12 | 2018-10-26 | 朱恩辛 | A kind of transboundary interactive friend-making system and its method |
| CN107644335A (en) * | 2017-09-18 | 2018-01-30 | 维沃移动通信有限公司 | A kind of method of payment, mobile terminal and server |
| CN112055034A (en) * | 2019-06-05 | 2020-12-08 | 北京外号信息技术有限公司 | Interaction method and system based on optical communication device |
| CN111724484A (en) * | 2020-06-10 | 2020-09-29 | 深圳市金研微科技有限公司 | Augmented reality information interaction system and interaction method |
| CN111724484B (en) * | 2020-06-10 | 2021-02-09 | 深圳市金研微科技有限公司 | Augmented reality information interaction system and interaction method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103297544B (en) | Instant messaging application method based on augmented reality | |
| Bigham et al. | VizWiz:: LocateIt-enabling blind people to locate objects in their environment | |
| CN105933500A (en) | Mobile terminal, remote server, and communication method and system based on augmented reality | |
| US8531514B2 (en) | Image providing system and image providing method | |
| CN102194007B (en) | System and method for acquiring mobile augmented reality information | |
| CN102754060B (en) | Method and apparatus for determining information for display | |
| JP6296056B2 (en) | Image processing apparatus, image processing method, and program | |
| US20110148922A1 (en) | Apparatus and method for mixed reality content operation based on indoor and outdoor context awareness | |
| CN102142081B (en) | Image processing device, image processing method, and program | |
| US20090300122A1 (en) | Augmented reality collaborative messaging system | |
| US20100017728A1 (en) | Apparatus and method of interworking between virtual reality services | |
| CN104537550A (en) | Internet autonomous advertising method based on augmented reality IP map | |
| WO2013055980A1 (en) | Method, system, and computer program product for obtaining images to enhance imagery coverage | |
| KR20120023882A (en) | Method and apparatus for authorizing use of augmented reality information | |
| CN103826201A (en) | Geographical position-based virtual interaction method and system thereof | |
| KR20140143777A (en) | Method of communication and of information in augmented reality | |
| JP2012068481A (en) | Augmented reality expression system and method | |
| WO2011084720A2 (en) | A method and system for an augmented reality information engine and product monetization therefrom | |
| US11568615B2 (en) | Collaborative on-demand experiences | |
| US20210018991A1 (en) | Universal Pointing and Interacting Device | |
| CN111242704A (en) | Method and electronic equipment for superposing live character images in real scene | |
| KR102074370B1 (en) | Method for providing augmented reality contents | |
| KR20180003017A (en) | System and method for mission conduction based on location | |
| CN108171801A (en) | A kind of method, apparatus and terminal device for realizing augmented reality | |
| KR20150077607A (en) | Dinosaur Heritage Experience Service System Using Augmented Reality and Method therefor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160907 |
|
| RJ01 | Rejection of invention patent application after publication |