CN103002410B - Augmented reality method and system for mobile terminals and mobile terminals - Google Patents
Augmented reality method and system for mobile terminals and mobile terminals Download PDFInfo
- Publication number
- CN103002410B CN103002410B CN201210475883.2A CN201210475883A CN103002410B CN 103002410 B CN103002410 B CN 103002410B CN 201210475883 A CN201210475883 A CN 201210475883A CN 103002410 B CN103002410 B CN 103002410B
- Authority
- CN
- China
- Prior art keywords
- information
- mobile terminal
- social
- server
- reality scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The invention provides an augmented reality method and a system for mobile terminals and the mobile terminals. The method includes the flowing steps: a server receives and stores social hot spot information sent by a first mobile terminal; a second mobile terminal obtains reality scene information and sends the reality scene information to the server; the server receives the reality scene information, searches social hot spot information related to the reality scene information according to the reality scene information, and returns the social hot spot information to the second mobile terminal; the second mobile terminal receives the social hot spot information returned by the server and overlays the social hot spot information and the reality scene information through augmented reality to acquire augmented reality information; and the second mobile terminal displays the augmented reality information. According to the method, images and text information are overlaid with reality scenes, content of social hot spot information is displayed from a panorama view, so that the social hot spot information acquired by users is more real, and user experience is good.
Description
Technical field
The present invention relates to network communication technology field, particularly a kind of augmented reality method for mobile terminal, system and mobile terminal.
Background technology
User often can share interested information on network, and things that is nice, joyful, that make laughs can be uploaded onto the server by mobile terminal and to be shared with other people by user.At present, the information that network is shared can only show user by Word message and image, cannot connect, lack presence, poor user experience with real world.
Summary of the invention
Object of the present invention is intended at least solve one of above-mentioned technological deficiency.
For this reason, the present invention's first object is to propose a kind of augmented reality method for mobile terminal, and the method represents the content of social hot information from panorama visual angle, and the social hot information that user is obtained has more presence, and Consumer's Experience is good.
The present invention's second object is to propose a kind of augmented reality system for mobile terminal.
The present invention's the 3rd object is to propose a kind of mobile terminal.
For achieving the above object, the augmented reality method for mobile terminal of embodiment according to a first aspect of the present invention comprises the following steps: server receives and stores the social hot information that the first mobile terminal sends, and wherein said social hot information comprises and primary importance information and first image information corresponding with described primary importance information and Word message; Second acquisition for mobile terminal reality scene information, and described reality scene information is sent to described server, wherein said reality scene information comprises the second image information and second place information; Described server receives described reality scene information, and the social hot information relevant to described reality scene information according to described reality scene information searching, and described social hot information is back to described second mobile terminal; Described second mobile terminal receives the described social hot information that described server returns, and by augmented reality by described social hot information and described reality scene information superposition to obtain augmented reality information; And described second mobile terminal shows described augmented reality information.
According to the augmented reality method for mobile terminal of the embodiment of the present invention, mobile phone users is in the process sharing social hot information, by augmented reality image and Word message and reality scene superimposed, the content of social hot information is represented from panorama visual angle, the social hot information that user is obtained has more presence, and Consumer's Experience is good.
For achieving the above object, the augmented reality system for mobile terminal of embodiment according to a second aspect of the present invention comprises: the first mobile terminal, for social hot information is sent to server, wherein said social hot information comprises and primary importance information and first image information corresponding with described primary importance information and Word message; Server, for receiving and storing described social hot information; Second mobile terminal, for obtaining reality scene information, and described reality scene information is sent to described server, wherein said reality scene information comprises the second image information and second place information, described server is further used for receiving described reality scene information, and the social hot information relevant to described reality scene information according to described reality scene information searching, and described social hot information is back to described second mobile terminal; Described second mobile terminal is further used for receiving the described social hot information that described server returns, and by augmented reality by described social hot information and described reality scene information superposition to obtain augmented reality information, and show described augmented reality information.
According to the augmented reality system for mobile terminal of the embodiment of the present invention, mobile phone users is in the process sharing social hot information, by augmented reality image and Word message and reality scene superimposed, the content of social hot information is represented from panorama visual angle, the social hot information that user is obtained has more presence, and Consumer's Experience is good.
For achieving the above object, the mobile terminal of embodiment according to a third aspect of the present invention comprises: acquisition module, for gathering the image information of reality scene; Locating module, for locating the positional information of described reality scene; Social focus identification module, for described reality scene information is sent to server, and receive the social hot information that described server returns, wherein said reality scene information comprises described image information and described positional information; Augmented reality module, for by described social hot information and described reality scene information superposition to obtain augmented reality information; And display module, for showing described augmented reality information.
According to the mobile terminal of the embodiment of the present invention, mobile phone users is in the process sharing social hot information, by augmented reality module by image and Word message and reality scene superimposed, the content of social hot information is represented from panorama visual angle, the social hot information that user is obtained has more presence, and Consumer's Experience is good.
The aspect that the present invention adds and advantage will part provide in the following description, and part will become obvious from the following description, or be recognized by practice of the present invention.
Accompanying drawing explanation
The present invention above-mentioned and/or additional aspect and advantage will become obvious and easy understand from the following description of the accompanying drawings of embodiments, wherein:
Fig. 1 is according to an embodiment of the invention for the process flow diagram of the contact searching method of mobile terminal;
Fig. 2 is the process flow diagram of the contact searching method for mobile terminal according to another embodiment of the present invention;
Fig. 3 is in accordance with another embodiment of the present invention for the process flow diagram of the contact searching method of mobile terminal;
Fig. 4 is the process flow diagram of the contact searching method for mobile terminal according to another embodiment of the present invention;
Fig. 5 is according to an embodiment of the invention for the structured flowchart of the contact name searching system of mobile terminal;
Fig. 6 is the structured flowchart of mobile terminal according to an embodiment of the invention;
Fig. 7 is the structured flowchart of the mobile terminal according to another embodiment of the present invention.
Embodiment
Be described below in detail embodiments of the invention, the example of described embodiment is shown in the drawings, and wherein same or similar label represents same or similar element or has element that is identical or similar functions from start to finish.Being exemplary below by the embodiment be described with reference to the drawings, only for explaining the present invention, and can not limitation of the present invention being interpreted as.On the contrary, embodiments of the invention comprise fall into attached claims spirit and intension within the scope of all changes, amendment and equivalent.
In describing the invention, it is to be appreciated that term " first ", " second " etc. are only for describing object, and instruction or hint relative importance can not be interpreted as.In describing the invention, it should be noted that, unless otherwise clearly defined and limited, term " is connected ", " connection " should be interpreted broadly, such as, can be fixedly connected with, also can be removably connect, or connect integratedly; Can be mechanical connection, also can be electrical connection; Can be directly be connected, also indirectly can be connected by intermediary.For the ordinary skill in the art, concrete condition above-mentioned term concrete meaning in the present invention can be understood.In addition, in describing the invention, except as otherwise noted, the implication of " multiple " is two or more.
Describe and can be understood in process flow diagram or in this any process otherwise described or method, represent and comprise one or more for realizing the module of the code of the executable instruction of the step of specific logical function or process, fragment or part, and the scope of the preferred embodiment of the present invention comprises other realization, wherein can not according to order that is shown or that discuss, comprise according to involved function by the mode while of basic or by contrary order, carry out n-back test, this should understand by embodiments of the invention person of ordinary skill in the field.
Below with reference to the accompanying drawings the augmented reality method for mobile terminal according to the embodiment of the present invention, system and mobile terminal are described.
A kind of augmented reality method for mobile terminal, comprise the following steps: server receives and stores the social hot information that the first mobile terminal sends, and wherein social hot information comprises and primary importance information and first image information corresponding with primary importance information and Word message; Second acquisition for mobile terminal reality scene information, and reality scene information is sent to server, wherein reality scene information comprises the second image information and second place information; Server receives reality scene information, and the social hot information relevant to reality scene information according to reality scene information searching, and social hot information is back to the second mobile terminal; The social hot information that second mobile terminal reception server returns, and by augmented reality by social hot information and reality scene information superposition to obtain augmented reality information; And the second mobile terminal display augmented reality information.
Fig. 1 is according to an embodiment of the invention for the process flow diagram of the augmented reality method of mobile terminal.
As shown in Figure 1, comprise the steps according to the augmented reality method for mobile terminal of the embodiment of the present invention.
Step S101, server receives and stores the social hot information that the first mobile terminal sends, and wherein social hot information comprises primary importance information and first image information corresponding with primary importance information and Word message.
In one embodiment of the invention, user can be taken pictures to interested things by the camera on the first mobile terminal, and the photo of shooting is commented on, then using photo as image information, comment uploads onto the server as Word message, the geographic position at GPS (GPS) the meeting consumer positioning place that the first mobile terminal is built-in simultaneously, user can it can be used as the positional information of image information and Word message to upload onto the server, server will store the social hot information comprising primary importance information and first image information corresponding with primary importance information and Word message.
Such as, when user A uses after the meal in first dining room, if think that the Braised Dongpo Pork Hock with Brown Sauce in this dining room is eaten very well, the photo of Braised Dongpo Pork Hock with Brown Sauce just can be taken with mobile phone, and comparison film carries out commenting on " Braised Dongpo Pork Hock with Brown Sauce is eaten very well ", then the photo of Braised Dongpo Pork Hock with Brown Sauce and comment thereof are uploaded onto the server, GPS (GPS) simultaneously in mobile phone can navigate to the geographic position in dining room, user A place, and geographic position is uploaded onto the server, server will store the social hot information about Braised Dongpo Pork Hock with Brown Sauce in first dining room, server also may receive and store the social hot information of other vegetables in the first dining room that other users upload.
Step S102, the second acquisition for mobile terminal reality scene information, and reality scene information is sent to server, wherein reality scene information comprises the second image information and second place information.
In one embodiment of the invention, user can open the camera of the second mobile terminal, to be taken pictures by it or camera function obtains the image of user place reality scene as image information, the geographic position at GPS (GPS) the meeting consumer positioning place simultaneously in the second mobile terminal, and it can be used as positional information, the reality scene information comprising image information and positional information can be sent to server by user.
Such as, after user B enters first dining room, GPS (GPS) in the mobile phone of user B will navigate to the geographic position at user B place, when user B opens the image in camera acquisition dining room, the reality scene information in the first dining room comprising the image in geographic position and dining room can be sent to server by mobile phone automatically.
Step S103, server receives reality scene information, and the social hot information relevant to reality scene information according to reality scene information searching.
Particularly, after server receives reality scene information, the social hot information comprising same position information will be searched according to the positional information in reality scene information, or search the social hot information comprising close image information according to image information.
Such as, after the reality scene information in the first dining room that the mobile phone receiving user B when server sends, the social hot information comprising the social hot information of the vegetable uploaded about Braised Dongpo Pork Hock with Brown Sauce or other users in geographic position, first dining room that will find that user A mobile phone uploads.
Step S104, the social hot information relevant to reality scene information found is back to the second mobile terminal by server.
Step S105, the social hot information that the second mobile terminal reception server returns, and by augmented reality by social hot information and reality scene information superposition to obtain augmented reality information.
In one embodiment of the invention, second mobile terminal can by augmented reality module by social hot information and reality scene information superposition, obtain augmented reality information, augmented reality information can, from panorama visual angle presenting images, allow user have sense on the spot in person.
Step S106, the second mobile terminal display augmented reality information.
Such as, when user B mobile phone by about Braised Dongpo Pork Hock with Brown Sauce or other vegetables picture and comment and dining room imaging importing after, by the augmented reality information displaying after superposition on Mobile phone screen, user just can see, and dining table puts goluptious Braised Dongpo Pork Hock with Brown Sauce or other vegetables.
According to the augmented reality method for mobile terminal of the embodiment of the present invention, mobile phone users is in the process sharing social hot information, by augmented reality image and Word message and reality scene superimposed, the content of social hot information is represented from panorama visual angle, the social hot information that user is obtained has more presence, and Consumer's Experience is good.
Fig. 2 is the process flow diagram of the augmented reality method for mobile terminal according to another embodiment of the present invention.
As shown in Figure 2, comprise the steps according to the augmented reality method for mobile terminal of the embodiment of the present invention.
Step S201, server receives and stores the social hot information that the first mobile terminal sends, and wherein social hot information comprises primary importance information and first image information corresponding with primary importance information and Word message.
In one embodiment of the invention, user can be taken pictures to interested things by the camera on the first mobile terminal, and the photo of shooting is commented on, then using photo as image information, comment uploads onto the server as Word message, the geographic position at GPS (GPS) the meeting consumer positioning place that the first mobile terminal is built-in simultaneously, user can it can be used as the positional information of image information and Word message to upload onto the server, server will store the social hot information comprising primary importance information and first image information corresponding with primary importance information and Word message.
Such as, when user A uses after the meal in first dining room, if think that the Braised Dongpo Pork Hock with Brown Sauce in this dining room is eaten very well, the photo of Braised Dongpo Pork Hock with Brown Sauce just can be taken with mobile phone, and comparison film carries out commenting on " Braised Dongpo Pork Hock with Brown Sauce is eaten very well ", then the photo of Braised Dongpo Pork Hock with Brown Sauce and comment thereof are uploaded onto the server, GPS (GPS) simultaneously in mobile phone can navigate to the geographic position in dining room, user A place, and geographic position is uploaded onto the server, server will store the social hot information about Braised Dongpo Pork Hock with Brown Sauce in first dining room, server also may receive the social hot information of other vegetables in the first dining room that other users upload.
Step S202, the second acquisition for mobile terminal reality scene information, and reality scene information is sent to server, wherein reality scene information comprises the second image information and second place information.
In one embodiment of the invention, user can open the camera of the second mobile terminal, to be taken pictures by it or camera function obtains the image of user place reality scene as image information, the geographic position at GPS (GPS) the meeting consumer positioning place simultaneously in the second mobile terminal, and it can be used as positional information, the reality scene information comprising image information and positional information can be sent to server by user.
Such as, after user B enters first dining room, GPS (GPS) in the mobile phone of user B will navigate to the geographic position at user B place, when user B opens the image in camera acquisition dining room, the reality scene information in the first dining room comprising the image in geographic position and dining room can be sent to server by mobile phone automatically.
Step S203, server receives reality scene information, and the social hot information relevant to reality scene information according to reality scene information searching.
Particularly, after server receives reality scene information, the social hot information comprising same position information will be searched according to the positional information in reality scene information, or search the social hot information comprising close image information according to image information.
Such as, after the reality scene information in the first dining room that the mobile phone receiving user B when server sends, the social hot information whether having user to upload to comprise geographic position, first dining room will be searched.
Step S204, if server does not find the social hot information relevant to reality scene information, then sets up new social hot information according to reality scene information, searches for other users in future.
Particularly, the positional information that can upload according to the second mobile terminal of server and image information set up the social hot information about the second mobile phone users geographic location.
In one embodiment of the invention, server can also continue other image informations that reception second mobile terminal sends.Such as, if do not find the social hot information comprising second dining room geographical location information after the reality scene information in the second dining room that the mobile phone that server receives user C sends, then server can continue the dining evaluation and the image that receive the transmission of user C mobile phone, and the social hot information set up accordingly about second dining room, just can by the social hot information of whois lookup to second dining room when other users come second dining room.
Step S205, if the social hot information relevant to reality scene information that whois lookup arrives, is then back to the second mobile terminal by social hot information.
Step S206, the social hot information that the second mobile terminal reception server returns, and by augmented reality by social hot information and reality scene information superposition to obtain augmented reality information.
In one embodiment of the invention, second mobile terminal can by augmented reality module by social hot information and reality scene information superposition, obtain augmented reality information, augmented reality information can, from panorama visual angle presenting images, allow user have sense on the spot in person.
Step S207, the second mobile terminal display augmented reality information.
Such as, when user B mobile phone by about Braised Dongpo Pork Hock with Brown Sauce or other vegetables picture and comment and dining room imaging importing after, by the augmented reality information displaying after superposition on Mobile phone screen, user just can see, and dining table puts goluptious Braised Dongpo Pork Hock with Brown Sauce or other vegetables.
According to the augmented reality method for mobile terminal of the embodiment of the present invention, when server fails to find the social hot information relevant to the reality scene information that user submits to, the reality scene information can submitted to according to user sets up new social hot information, to enrich constantly social hot information on server, facilitate user to search, improve Consumer's Experience.
Fig. 3 is in accordance with another embodiment of the present invention for the process flow diagram of the augmented reality method of mobile terminal.
As shown in Figure 3, comprise the steps according to the augmented reality method for mobile terminal of the embodiment of the present invention.
Step S301, server receives and preserves the social graph of the first mobile terminal, and wherein social graph comprises the information with the user-dependent social connections people of the first mobile terminal.
Particularly, the name, Termination ID etc. that can comprise social connections people with the information of the user-dependent social connections people of the first mobile terminal can the information of unique identification social connections people identity and the relations etc. of contact person and user.
Step S302, social hot information is sent to server by the first mobile terminal, and arranges the take over party of social hot information, and wherein social hot information comprises primary importance information and first image information corresponding with primary importance information and Word message.
Particularly, by intended receiver name, Termination ID or take over party can be set with the relation of user.
Such as, user D is in the place of often dating with girlfriend, mobile phone screen is drawn a rose or utilizes the rose picture stored in mobile phone, and write " giving you bunch of roses flower ", specify only has his girlfriend to check simultaneously, and the take over party of the social hot information that the social hot information and user D that comprise the positional information of user D, the image information of rose and Word message will arrange by mobile phone is sent to server.
Step S303, the second acquisition for mobile terminal reality scene information, and reality scene information is sent to server, wherein reality scene information comprises the second image information and second place information.
In one embodiment of the invention, user can open the camera of the second mobile terminal, to be taken pictures by it or camera function obtains the image of user place reality scene as image information, the geographic position at GPS (GPS) the meeting consumer positioning place simultaneously in the second mobile terminal, and it can be used as positional information, the reality scene information comprising image information and positional information can be sent to server by user.
Such as, when the girlfriend E of user D comes dating site, GPS (GPS) in mobile phone will navigate to the geographic position at her place, when opening camera, the reality scene information in the geographic position and dating site that comprise her place can be sent to server by mobile phone automatically.
Step S304, server receives the reality scene information that the second mobile terminal sends, and finds the social hot information relevant to reality scene information.
Step S305, server judges that whether the information of the second mobile terminal is consistent with the information of social hot information take over party.
Particularly, the information of the second mobile terminal comprises the ID, address name etc. of the second mobile terminal, server also receives the information of the second mobile terminal while receiving reality scene information, and judge the second mobile terminal ID, the mobile terminal ID of address name and social hot information take over party and name whether consistent.
Such as, when the reality scene information that the girlfriend E that server receives user D sends, the social hot information that the user D relevant to dating site sends will be found, and judge the name of the name of user E and mobile terminal ID and social hot information take over party and mobile terminal ID whether consistent.
Step S306, if inconsistent, then server does not send social hot information.
Step S307, if unanimously, then social hot information is sent to the second mobile terminal by server.
Step S308, the social hot information that the second mobile terminal reception server returns, and by augmented reality by social hot information and reality scene information superposition to obtain augmented reality information.
In one embodiment of the invention, second mobile terminal can by augmented reality module by social hot information and reality scene information superposition, obtain augmented reality information, augmented reality information can, from panorama visual angle presenting images, allow user have sense on the spot in person.
Step S309, the second mobile terminal display augmented reality information.
Such as, when the mobile phone of the girlfriend E of user D is by after the picture of the rose received and " give you bunch of roses flower " and the imaging importing of dating site, will by the augmented reality information displaying after superposition on Mobile phone screen, user E just can see the bright-coloured rose that boyfriend send.
According to the augmented reality method for mobile terminal of the embodiment of the present invention; user can arrange take over party when uploading social hot information; make other people cannot check social hot information, the privacy of protection user social contact hot information, improves Consumer's Experience further.
Fig. 4 is the process flow diagram of the augmented reality method for mobile terminal according to another embodiment of the present invention.
As shown in Figure 4, comprise the steps according to the augmented reality method for mobile terminal of the embodiment of the present invention.
Step S401, server receives and stores the social hot information that the first mobile terminal sends, and wherein social hot information comprises primary importance information and first image information corresponding with primary importance information and Word message.
In one embodiment of the invention, user can be taken pictures to interested things by the camera on the first mobile terminal, and the photo of shooting is commented on, then using photo as image information, comment uploads onto the server as Word message, the geographic position at GPS (GPS) the meeting consumer positioning place that the first mobile terminal is built-in simultaneously, user can it can be used as the positional information of image information and Word message to upload onto the server, server will store the social hot information comprising primary importance information and first image information corresponding with primary importance information and Word message.
Such as, when user A uses after the meal in first dining room, if think that the Braised Dongpo Pork Hock with Brown Sauce in this dining room is eaten very well, the photo of Braised Dongpo Pork Hock with Brown Sauce just can be taken with mobile phone, and comparison film carries out commenting on " Braised Dongpo Pork Hock with Brown Sauce is eaten very well ", then the photo of Braised Dongpo Pork Hock with Brown Sauce and comment thereof are uploaded onto the server, GPS (GPS) simultaneously in mobile phone can navigate to the geographic position in dining room, user A place, and geographic position is uploaded onto the server, server will store the social hot information about Braised Dongpo Pork Hock with Brown Sauce in first dining room, server also may receive the social hot information of other vegetables in the first dining room that other users upload.
Step S402, the second acquisition for mobile terminal reality scene information, and reality scene information is sent to server, wherein reality scene information comprises the second image information and second place information.
In one embodiment of the invention, user can open the camera of the second mobile terminal, to be taken pictures by it or camera function obtains the image of user place reality scene as image information, the geographic position at GPS (GPS) the meeting consumer positioning place simultaneously in the second mobile terminal, and it can be used as positional information, the reality scene information comprising image information and positional information can be sent to server by user.
Such as, after user B enters first dining room, GPS (GPS) in the mobile phone of user B will navigate to the geographic position at user B place, when user B opens the image in camera acquisition dining room, the reality scene information in the first dining room comprising the image in geographic position and dining room can be sent to server by mobile phone automatically.
Step S403, server receives reality scene information, and the social hot information relevant to reality scene information according to reality scene information searching.
Particularly, after server receives reality scene information, the social hot information comprising same position information will be searched according to the positional information in reality scene information, or search the social hot information comprising close image information according to image information.
Such as, after the reality scene information in the first dining room that the mobile phone receiving user B when server sends, the social hot information comprising the vegetable uploaded about Braised Dongpo Pork Hock with Brown Sauce or other users in geographic position, first dining room that will find that user A mobile phone uploads.
Step S404, the social hot information relevant to reality scene information found is back to the second mobile terminal by server.
Step S405, the social hot information that the second mobile terminal reception server returns, and by augmented reality by social hot information and reality scene information superposition to obtain augmented reality information.
In one embodiment of the invention, second mobile terminal can by augmented reality module by social hot information and reality scene information superposition, obtain augmented reality information, augmented reality information can, from panorama visual angle presenting images, allow user have sense on the spot in person.
Step S406, the second mobile terminal display augmented reality information.
Such as, when user B mobile phone by about Braised Dongpo Pork Hock with Brown Sauce or other vegetables picture and comment and dining room imaging importing after, by the augmented reality information displaying after superposition on Mobile phone screen, user just can see, and dining table puts goluptious Braised Dongpo Pork Hock with Brown Sauce or other vegetables.
Step S407, the second mobile terminal receives user to the operation of augmented reality information, wherein operates to comprise and checks, comments on, replys and collect.
Particularly, when user checks the augmented reality information that the second mobile terminal shows, oneself interested content can be selected to check, and can carry out commenting on, reply and collecting.Such as, user B can select oneself interested vegetable to check, and comments on vegetable used and reply after dining, if sensation pretty good also can be collected recommend other people.
According to the augmented reality method for mobile terminal of the embodiment of the present invention, user can select to check interested social hot information, and can comment on it, reply and the operation such as collection, enrich the content of social hot information, thus more there is presence by the information after augmented reality.
In order to realize above-mentioned example, the present invention also proposes a kind of augmented reality system for mobile terminal.
A kind of augmented reality system for mobile terminal, comprise: the first mobile terminal, for social hot information is sent to server, wherein social hot information comprises primary importance information and first image information corresponding with primary importance information and Word message; Server, for receiving and storing social hot information; Second mobile terminal, for obtaining reality scene information, and reality scene information is sent to server, wherein reality scene information comprises the second image information and second place information, server is further used for receiving reality scene information, and the social hot information relevant to reality scene information according to reality scene information searching, and social hot information is back to the second mobile terminal; Second mobile terminal is further used for the social hot information that reception server returns, and by augmented reality by social hot information and reality scene information superposition to obtain augmented reality information, and display augmented reality information.
Fig. 5 is according to an embodiment of the invention for the structured flowchart of the augmented reality system of mobile terminal.
As shown in Figure 5, comprise according to the augmented reality system for mobile terminal of the embodiment of the present invention: the first mobile terminal 100, server 200 and the second mobile terminal 300.
Particularly, the first mobile terminal 100 is for being sent to server 200 by social hot information, and wherein social hot information comprises primary importance information and first image information corresponding with primary importance information and Word message.
In one embodiment of the invention, user can be taken pictures to interested things by the camera on the first mobile terminal 100, and the photo of shooting is commented on, then using photo as image information, comment on and upload onto the server as Word message, the geographic position at GPS (GPS) the meeting consumer positioning place that the first mobile terminal 100 is built-in simultaneously, user can it can be used as the positional information of image information and Word message to upload onto the server 200.
Such as, when user A uses after the meal in first dining room, if think that the Braised Dongpo Pork Hock with Brown Sauce in this dining room is eaten very well, the photo of Braised Dongpo Pork Hock with Brown Sauce just can be taken with mobile phone, and comparison film carries out commenting on " Braised Dongpo Pork Hock with Brown Sauce is eaten very well ", then the photo of Braised Dongpo Pork Hock with Brown Sauce and comment thereof are uploaded onto the server, the GPS (GPS) simultaneously in mobile phone can navigate to the geographic position in dining room, user A place, and is uploaded onto the server in geographic position.
Server 200 is for receiving and storing social hot information.
Reality scene information for obtaining reality scene information, and is sent to server 200 by the second mobile terminal 300, and wherein reality scene information comprises the second image information and second place information.
In one embodiment of the invention, user can open the camera of the second mobile terminal 300, to be taken pictures by it or camera function obtains the image of user place reality scene as image information, the geographic position at GPS (GPS) the meeting consumer positioning place simultaneously in the second mobile terminal 300, and it can be used as positional information, the reality scene information comprising image information and positional information can be sent to server 200 by user.
Such as, after user B enters first dining room, GPS (GPS) in the mobile phone of user B will navigate to the geographic position at user B place, when user B opens the image in camera acquisition dining room, the reality scene information in the first dining room comprising the image in geographic position and dining room can be sent to server by mobile phone automatically.
Server 200 is further used for receiving reality scene information, and the social hot information relevant to reality scene information according to reality scene information searching, if do not find the social hot information relevant to reality scene information, then set up new social hot information according to reality scene information, search for other users in future, if find the social hot information relevant to reality scene information, then social hot information is back to the second mobile terminal 300.
More specifically, after server 200 receives reality scene information, the social hot information comprising same position information will be searched according to the positional information in reality scene information, or search the social hot information comprising close image information according to image information.If do not found, the positional information that server can be uploaded according to the second mobile terminal and image information set up the social hot information about the second mobile phone users geographic location.If found, then social hot information is back to the second mobile terminal.
Such as, the social hot information comprising second dining room geographical location information is not found after server receives the reality scene information in the second dining room of the mobile phone transmission of user C, then server can continue the dining evaluation and the image that receive the transmission of user C mobile phone, and the social hot information set up accordingly about second dining room, just can by the social hot information of whois lookup to second dining room when other users come second dining room.After server receives the reality scene information in the first dining room of the mobile phone transmission of user B, the social hot information about Braised Dongpo Pork Hock with Brown Sauce comprising geographic position, first dining room that user A mobile phone is uploaded will be found, and return it to the mobile phone of user B.
Second mobile terminal 300 is further used for the social hot information that reception server 200 returns, and by augmented reality by social hot information and reality scene information superposition to obtain augmented reality information, and display augmented reality information, and receive the operation of user to augmented reality information, wherein operate to comprise and check, comment on, reply and collect.
In one embodiment of the invention, second mobile terminal can by augmented reality module by social hot information and reality scene information superposition, obtain augmented reality information, augmented reality information can, from panorama visual angle presenting images, allow user have sense on the spot in person.When user checks the augmented reality information that the second mobile terminal shows, oneself interested content can be selected to check, and can carry out commenting on, reply and collecting.
Such as, when user B mobile phone by about Braised Dongpo Pork Hock with Brown Sauce picture and comment and dining room imaging importing after, by the augmented reality information displaying after superposition on Mobile phone screen, user just can see, and dining table puts goluptious Braised Dongpo Pork Hock with Brown Sauce, user B also can comment on Braised Dongpo Pork Hock with Brown Sauce and reply, if sensation pretty good also can be collected recommend other people.
According to the augmented reality system for mobile terminal of the embodiment of the present invention, mobile phone users is in the process sharing social hot information, by augmented reality image and Word message and reality scene superimposed, the content of social hot information is represented from panorama visual angle, the social hot information that user is obtained has more presence, and Consumer's Experience is good.
In one embodiment of the invention, first mobile terminal can also be used for the take over party arranging social focus message, particularly, first mobile terminal can pass through intended receiver name, Termination ID or take over party is set with the relation of user, server is also for receiving and preserving the social graph of the first mobile terminal, and find the social hot information relevant to reality scene information, and when the information of judgement second mobile terminal is consistent with the information of social hot information take over party, social hot information is sent to the second terminal, ensure that social hot information only has acceptance can check just now, improve the privacy of social hot information.
Wherein, social graph comprises the information with the user-dependent social connections people of the first mobile terminal, and the name, Termination ID etc. that can comprise social connections people with the information of the user-dependent social connections people of the first mobile terminal can the information of unique identification social connections people identity and the relations etc. of contact person and user; The information of the second mobile terminal comprises the ID, address name etc. of the second mobile terminal, and server also receives the information of the second mobile terminal while receiving reality scene information.
Such as, user D is in the place of often dating with girlfriend, mobile phone screen is drawn a rose or utilizes the rose picture stored in mobile phone, and write " giving you bunch of roses flower ", specify only has his girlfriend to check simultaneously, mobile phone will will comprise the positional information of user D, the take over party of the social hot information of the image information of rose and the social hot information of Word message and user D setting is sent to server, during the reality scene information that the girlfriend E that server receives user D sends, the social hot information that the user D relevant to dating site sends will be found, and when the name and mobile terminal ID that judge the name of user E and mobile terminal ID and social hot information take over party are consistent, social hot information is sent on the mobile phone of user E.
In order to realize above-described embodiment, the invention allows for a kind of mobile terminal.
A kind of mobile terminal, comprising: acquisition module, for gathering the image information of reality scene; Locating module, for locating the positional information of reality scene; Social focus identification module, for reality scene information is sent to server, and the social hot information that reception server returns, wherein reality scene information comprises image information and positional information; Augmented reality module, for by social hot information and reality scene information superposition to obtain augmented reality information; And display module, for showing augmented reality information.
Fig. 6 is the structured flowchart of mobile terminal according to an embodiment of the invention.
As shown in Figure 6, comprise according to the mobile terminal of the embodiment of the present invention: acquisition module 301, locating module 302, social focus identification module 303, augmented reality module 304 and display module 305.
Particularly, acquisition module 301 is for gathering the image information of reality scene.
In one embodiment of the invention, acquisition module 301 can be camera, is taken pictures or camera function obtains the image of user place reality scene as image information by it.
Locating module 302 is for locating the positional information of reality scene.
In one embodiment of the invention, locating module 302, can the geographic position at consumer positioning place containing GPS (GPS), as the positional information of mobile terminal.
Social focus identification module 303 is for being sent to server by reality scene information, and the social hot information that reception server returns, wherein reality scene information comprises image information and positional information.
Augmented reality module 304 for by social hot information and reality scene information superposition to obtain augmented reality information.
In one embodiment of the invention, second mobile terminal can by augmented reality module 304 by social hot information and reality scene information superposition, obtain augmented reality information, augmented reality information can, from panorama visual angle presenting images, allow user have sense on the spot in person.
Display module 305 is for showing augmented reality information.
According to the mobile terminal of the embodiment of the present invention, mobile phone users is in the process sharing social hot information, by augmented reality module by image and Word message and reality scene superimposed, the content of social hot information is represented from panorama visual angle, the social hot information that user is obtained has more presence, and Consumer's Experience is good.
Fig. 7 is the structured flowchart of the mobile terminal according to another embodiment of the present invention.
As shown in Figure 7, also comprise on the basis shown in Fig. 6 according to the mobile terminal of the embodiment of the present invention: social focus operational module 306.
Particularly, social focus operational module 306, for receiving the operation of user to augmented reality information, wherein operates to comprise and checks, comments on, replys and collect.More specifically, when user checks the augmented reality information that the second mobile terminal shows, oneself interested content can be selected to check, and can carry out commenting on, reply and collecting.
Such as, user B can select oneself interested vegetable to check, and comments on vegetable used and reply after dining, if sensation pretty good also can be collected recommend other people.
According to the mobile terminal of the embodiment of the present invention, user can select to check interested social hot information by social focus operational module, and can comment on it, reply and the operation such as collection, enrich the content of social hot information, thus more there is presence by the information after augmented reality.
Should be appreciated that in an embodiment of the present invention, mobile terminal can be the hardware device that mobile phone, panel computer, personal digital assistant etc. have Affiliate sessions record.
Although illustrate and describe embodiments of the invention, for the ordinary skill in the art, be appreciated that and can carry out multiple change, amendment, replacement and modification to these embodiments without departing from the principles and spirit of the present invention, scope of the present invention is by claims and equivalency thereof.
Claims (8)
1., for an augmented reality method for mobile terminal, it is characterized in that, comprise the following steps:
Server receives and stores the social hot information that the first mobile terminal sends, and wherein said social hot information comprises primary importance information and first image information corresponding with described primary importance information and Word message;
Server receives and preserves the social graph of the first mobile terminal, and wherein said social graph comprises the information with the user-dependent social connections people of described first mobile terminal;
Described first mobile terminal, when described social hot information is sent to server, arranges the take over party of described social hot information;
Second acquisition for mobile terminal reality scene information, and described reality scene information is sent to described server, wherein said reality scene information comprises the second image information and second place information;
Described server receives described reality scene information, and the social hot information relevant to described reality scene information according to described reality scene information searching;
When after described whois lookup to the described social hot information relevant to the described reality scene information that described second mobile terminal sends, judge that whether the information of described second mobile terminal is consistent with the information of described social hot information take over party;
If consistent, then described social hot information is sent to described second mobile terminal by described server;
Described second mobile terminal receives the described social hot information that described server returns, and by augmented reality by described social hot information and described reality scene information superposition to obtain augmented reality information; And
Described second mobile terminal shows described augmented reality information.
2. the augmented reality method for mobile terminal according to claim 1, is characterized in that, further comprising the steps of:
If described server does not find the social hot information relevant to the described reality scene information that described second mobile terminal sends, then described server sets up new social hot information according to described reality scene information.
3. the augmented reality method for mobile terminal according to claim 1, is characterized in that, further comprising the steps of:
Described second mobile terminal receives user to the operation of described augmented reality information, and wherein said operation comprises checks, comments on, replys and collect.
4., for an augmented reality system for mobile terminal, it is characterized in that, comprising:
First mobile terminal, for social hot information is sent to server, wherein said social hot information comprises primary importance information and first image information corresponding with described primary importance information and Word message;
Server, for receiving and storing described social hot information, wherein, described server is also for receiving and preserving the social graph of described first mobile terminal, and wherein said social graph comprises the information with the user-dependent social connections people of described first mobile terminal;
Second mobile terminal, for obtaining reality scene information, and described reality scene information is sent to described server, wherein said reality scene information comprises the second image information and second place information, described server is further used for receiving described reality scene information, and the social hot information relevant to described reality scene information according to described reality scene information searching;
Described first mobile terminal is also for when being sent to server by described social hot information, the take over party of described social hot information is set, described server is further after finding the described social hot information relevant to the described reality scene information that described second mobile terminal sends, judge that whether the information of described second mobile terminal is consistent with the information of described social hot information take over party, and when consistent, described social hot information is sent to described second mobile terminal;
Described second mobile terminal is further used for receiving the described social hot information that described server returns, and by augmented reality by described social hot information and described reality scene information superposition to obtain augmented reality information, and show described augmented reality information.
5. the augmented reality system for mobile terminal according to claim 4, is characterized in that,
Described server also for when not finding the social hot information relevant to the described reality scene information that described second mobile terminal sends, sets up new social hot information according to described reality scene information.
6. the augmented reality system for mobile terminal according to claim 4, is characterized in that, described second mobile terminal is also for receiving the operation of user to described augmented reality information, and wherein said operation comprises checks, comments on, replys and collect.
7. a mobile terminal, is characterized in that, comprising:
Acquisition module, for gathering the image information of reality scene;
Locating module, for locating the positional information of described reality scene;
Social focus identification module, for reality scene information is sent to server, and receive the social hot information that described server returns, wherein said reality scene information comprises described image information and described positional information, wherein, described server receives and stores the social hot information that other mobile terminal sends, and wherein said social hot information comprises primary importance information and first image information corresponding with described primary importance information and Word message, described server also receives and preserves the social graph of other mobile terminal, wherein said social graph comprises the information with the user-dependent social connections people of other mobile terminal described, other mobile terminal described is when being sent to server by described social hot information, the take over party of described social hot information is set, when after described whois lookup to the described social hot information relevant to the described reality scene information that described social focus identification module sends, judge that whether the information of described mobile terminal is consistent with the information of described social hot information take over party, if consistent, then described social hot information is sent to described social focus identification module by described server,
Augmented reality module, for by described social hot information and described reality scene information superposition to obtain augmented reality information; And
Display module, for showing described augmented reality information.
8. mobile terminal according to claim 7, is characterized in that, described mobile terminal also comprises:
Social focus operational module, for receiving the operation of user to described augmented reality information, wherein said operation comprises checks, comments on, replys and collects.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210475883.2A CN103002410B (en) | 2012-11-21 | 2012-11-21 | Augmented reality method and system for mobile terminals and mobile terminals |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210475883.2A CN103002410B (en) | 2012-11-21 | 2012-11-21 | Augmented reality method and system for mobile terminals and mobile terminals |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103002410A CN103002410A (en) | 2013-03-27 |
| CN103002410B true CN103002410B (en) | 2015-04-08 |
Family
ID=47930453
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210475883.2A Active CN103002410B (en) | 2012-11-21 | 2012-11-21 | Augmented reality method and system for mobile terminals and mobile terminals |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103002410B (en) |
Families Citing this family (30)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103945274A (en) * | 2013-04-19 | 2014-07-23 | 达腾科公司 | Method and equipment for providing interactive augmented reality information corresponding to television programs |
| US9910887B2 (en) | 2013-04-25 | 2018-03-06 | Facebook, Inc. | Variable search query vertical access |
| CN103220433B (en) * | 2013-05-13 | 2015-09-09 | 百度在线网络技术（北京）有限公司 | The unlock method of mobile terminal, system, mobile terminal and server |
| CN104348704B (en) * | 2013-08-02 | 2019-06-28 | 腾讯科技（深圳）有限公司 | A kind of methods, devices and systems showing streetscape microblogging |
| CN103412953A (en) * | 2013-08-30 | 2013-11-27 | 苏州跨界软件科技有限公司 | Social contact method on the basis of augmented reality |
| CN103679204A (en) * | 2013-12-23 | 2014-03-26 | 上海安琪艾可网络科技有限公司 | Image identification and creation application system and method based on intelligent mobile device platform |
| CN105323252A (en) * | 2015-11-16 | 2016-02-10 | 上海璟世数字科技有限公司 | Method and system for realizing interaction based on augmented reality technology and terminal |
| CN105468142A (en) * | 2015-11-16 | 2016-04-06 | 上海璟世数字科技有限公司 | Interaction method and system based on augmented reality technique, and terminal |
| CN106982240B (en) * | 2016-01-18 | 2021-01-15 | 腾讯科技（北京）有限公司 | Information display method and device |
| CN105657294A (en) * | 2016-03-09 | 2016-06-08 | 北京奇虎科技有限公司 | Method and device for presenting virtual special effect on mobile terminal |
| CN105824412A (en) * | 2016-03-09 | 2016-08-03 | 北京奇虎科技有限公司 | Method and device for presenting customized virtual special effects on mobile terminal |
| CN105786432A (en) * | 2016-03-18 | 2016-07-20 | 北京奇虎科技有限公司 | Method and device for displaying virtual image on mobile terminal |
| CN106372260A (en) * | 2016-10-25 | 2017-02-01 | 广州卓能信息科技有限公司 | Method, device and system for information exchange |
| CN106648322A (en) * | 2016-12-21 | 2017-05-10 | 广州市动景计算机科技有限公司 | Method of triggering interactive operation with virtual object and device and system |
| CN106980690A (en) * | 2017-03-31 | 2017-07-25 | 联想(北京)有限公司 | A kind of data processing method and electronic equipment |
| CN107247510A (en) * | 2017-04-27 | 2017-10-13 | 成都理想境界科技有限公司 | A kind of social contact method based on augmented reality, terminal, server and system |
| CN108932088B (en) * | 2017-05-22 | 2020-07-14 | 洪荣昭 | Virtual object collection method and portable electronic device |
| CN107817897A (en) * | 2017-10-30 | 2018-03-20 | 努比亚技术有限公司 | A kind of information intelligent display methods and mobile terminal |
| CN109840526A (en) * | 2017-11-27 | 2019-06-04 | 中国移动国际有限公司 | A kind of object-based social contact method and device |
| CN108182228A (en) * | 2017-12-27 | 2018-06-19 | 北京奇虎科技有限公司 | User social contact method, device and the computing device realized using augmented reality |
| CN108388637A (en) * | 2018-02-26 | 2018-08-10 | 腾讯科技（深圳）有限公司 | A kind of method, apparatus and relevant device for providing augmented reality service |
| CN109005285A (en) * | 2018-07-04 | 2018-12-14 | 百度在线网络技术（北京）有限公司 | augmented reality processing method, terminal device and storage medium |
| CN108961425A (en) * | 2018-07-24 | 2018-12-07 | 高哲远 | Method, system, terminal and the server of augmented reality effect |
| CN109358744A (en) * | 2018-08-30 | 2019-02-19 | Oppo广东移动通信有限公司 | Information sharing method, device, storage medium and wearable device |
| CN110413719A (en) * | 2019-07-25 | 2019-11-05 | Oppo广东移动通信有限公司 | Information processing method and device, equipment, storage medium |
| CN110531847B (en) * | 2019-07-26 | 2020-07-14 | 中国人民解放军军事科学院国防科技创新研究院 | Social contact method and system based on augmented reality |
| CN110677537B (en) * | 2019-09-29 | 2021-05-11 | 维沃移动通信有限公司 | Note information display method, note information sending method and electronic equipment |
| CN110928413A (en) * | 2019-11-22 | 2020-03-27 | 北京新势界科技有限公司 | Method and device for establishing AR information point through terminal |
| CN110996119A (en) * | 2019-11-29 | 2020-04-10 | 北京新势界科技有限公司 | AR communication method and device for intelligent recall information |
| CN113973235A (en) * | 2020-07-22 | 2022-01-25 | 上海哔哩哔哩科技有限公司 | Interactive information display method and device and computer equipment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102194007A (en) * | 2011-05-31 | 2011-09-21 | 中国电信股份有限公司 | System and method for acquiring mobile augmented reality information |
| CN102694826A (en) * | 2011-03-22 | 2012-09-26 | 百度在线网络技术（北京）有限公司 | Device and method for obtaining shared object related to real scene |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20100124947A (en) * | 2009-05-20 | 2010-11-30 | 삼성에스디에스 주식회사 | Ar contents providing system and method providing a portable terminal real-time regional information by using augmented reality technology |
-
2012
- 2012-11-21 CN CN201210475883.2A patent/CN103002410B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102694826A (en) * | 2011-03-22 | 2012-09-26 | 百度在线网络技术（北京）有限公司 | Device and method for obtaining shared object related to real scene |
| CN102194007A (en) * | 2011-05-31 | 2011-09-21 | 中国电信股份有限公司 | System and method for acquiring mobile augmented reality information |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103002410A (en) | 2013-03-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103002410B (en) | Augmented reality method and system for mobile terminals and mobile terminals | |
| US11048941B2 (en) | Imaging device and information acquisition system in which an acquired image and associated information are held on a display | |
| US11665122B2 (en) | Geolocation-based data sharing system | |
| US8743144B2 (en) | Mobile terminal, server device, community generation system, display control method, and program | |
| US9883349B2 (en) | Method and device for displaying information which links to related information provided by user's friends at user's location | |
| CN100550754C (en) | Context enriched communication system and method | |
| US20140298382A1 (en) | Server and method for transmitting augmented reality object | |
| CN104966225A (en) | Housing rental method and system based on mobile terminal and 3D panoramic image browsing | |
| US20090310028A1 (en) | System for Controlling a Group of Picture Frames | |
| JP2008058917A (en) | Map information display system with image | |
| US10360246B2 (en) | Method, system, and apparatus for searching and displaying user generated content | |
| GB2484384A (en) | Recording captured moving image with augmented reality information | |
| CN102354284A (en) | Method and system for setting corresponding geographic information in instant messaging | |
| KR20150079723A (en) | Co-relating visual content with geo-location data | |
| WO2015154383A1 (en) | Photographing method and photographing terminal | |
| KR101120737B1 (en) | A method for social video service using mobile terminal | |
| TWI442339B (en) | Method, system and computer program product for synchronizing spot information | |
| KR20160012269A (en) | Method and apparatus for providing ranking service of multimedia in a social network service system | |
| JP2015018421A (en) | Terminal device, contribution information transmission method, contribution information transmission program, and contribution information sharing system | |
| Suh et al. | Context-aware mobile ar system for personalization, selective sharing, and interaction of contents in ubiquitous computing environments | |
| US11436666B1 (en) | Augmented reality menu | |
| CN104079697A (en) | Contact avatar setting method and mobile terminal | |
| US20150088867A1 (en) | System and Method for Enabling Communication Between Users | |
| KR101612263B1 (en) | system and method for providing location based instance message | |
| WO2014187154A1 (en) | A method, system, and apparatus for searching and displaying user generated content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20130327 Assignee: Beijing Intellectual Property Management Co.,Ltd. Assignor: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd. Contract record no.: X2023110000099 Denomination of invention: Augmented reality methods, systems, and mobile terminals for mobile devices Granted publication date: 20150408 License type: Common License Record date: 20230822 |