CN108114471A - AR method for processing business, device, server and mobile terminal - Google Patents

AR method for processing business, device, server and mobile terminal Download PDF

Info

Publication number
CN108114471A
CN108114471A CN201711261596.0A CN201711261596A CN108114471A CN 108114471 A CN108114471 A CN 108114471A CN 201711261596 A CN201711261596 A CN 201711261596A CN 108114471 A CN108114471 A CN 108114471A
Authority
CN
China
Prior art keywords
mobile terminal
business
data
location information
virtual objects
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201711261596.0A
Other languages
Chinese (zh)
Other versions
CN108114471B (en
Inventor
王晓振
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba China Co Ltd
Original Assignee
Guangzhou Dongjing Computer Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Dongjing Computer Technology Co Ltd filed Critical Guangzhou Dongjing Computer Technology Co Ltd
Priority to CN201711261596.0A priority Critical patent/CN108114471B/en
Publication of CN108114471A publication Critical patent/CN108114471A/en
Priority to PCT/CN2018/117486 priority patent/WO2019109828A1/en
Application granted granted Critical
Publication of CN108114471B publication Critical patent/CN108114471B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • A63F13/65—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition
    • A63F13/655—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition by importing photos, e.g. of the player
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/69—Involving elements of the real world in the game world, e.g. measurement in live races, real video
    • A63F2300/695—Imported photos, e.g. of the player

Abstract

An embodiment of the present invention provides a kind of AR method for processing business, device, server and mobile terminal, wherein, a kind of AR method for processing business includes：Receive the geographical location information of mobile terminal, however, it is determined that the AR business location informations to match with the geographical location information are locally stored, then send image capture instruction to the mobile terminal；Receive the image data that the mobile terminal is returned according to described image acquisition instructions；If the described image data image data corresponding with the AR business location information returned matches, AR business datums are sent to the mobile terminal.By the embodiment of the present invention, geographical location, AR business scenarios image and AR business associations are got up so that AR technologies can be efficiently applied in the game class application related with position, promote user experience.

Description

AR method for processing business, device, server and mobile terminal
Technical field
The present embodiments relate to field of computer technology more particularly to a kind of AR method for processing business, device, servers And mobile terminal.
Background technology
AR (Augmented Reality, augmented reality) technology is a kind of by real world information and virtual world information " seamless " integrated new technology, in the certain time spatial dimension of real world be difficult script the information experienced (e.g., Visual information, acoustic information etc.), it is added in real information after analog simulation, real environment and virtual object are real-time Ground has been added to same picture or space exists simultaneously.
With the development of AR technologies, AR technologies are applied to just to become a kind of trend in various application scenarios.It is answered all In, game class application occupies wherein significant proportion, therefore, how by pair being handled with the relevant data of AR technologies, So that AR technologies can be efficiently applied in some game class applications, for example, in the game class application related with position, to carry Rise the game experiencing of user, just a research hotspot as the application of AR technologies.
The content of the invention
In view of this, the embodiment of the present invention provides a kind of AR method for processing business, device, server and mobile terminal, with It realizes by pair being handled with the relevant data of AR technologies so that AR technologies can be efficiently applied to the game related with position In class application.
It is according to embodiments of the present invention in a first aspect, provide a kind of AR method for processing business, including：Receive mobile terminal Geographical location information, however, it is determined that the AR business location informations to match with the geographical location information are locally stored, then to The mobile terminal sends image capture instruction；Receive the picture number that the mobile terminal is returned according to described image acquisition instructions According to；If the described image data image data corresponding with the AR business location information returned matches, to the movement Terminal sends AR business datums.
Second aspect according to embodiments of the present invention provides another AR method for processing business, including：It obtains mobile whole The geographical location information is sent to server by the geographical location information at end；It receives the server and is confirming the geography The image capture instruction sent after location information；Image data is gathered according to described image acquisition instructions, by described image data It is sent to the server；Receive the AR business datums that the server is sent after described image data are confirmed；According to described AR business datums carry out AR service displays.
The third aspect according to embodiments of the present invention provides a kind of AR business processing devices, including：First receives mould Block, for receiving the geographical location information of mobile terminal, however, it is determined that be locally stored what is matched with the geographical location information AR business location informations then send image capture instruction to the mobile terminal；Second receiving module, for receiving the movement The image data that terminal is returned according to described image acquisition instructions；First sending module, if the described image data for return Image data corresponding with the AR business location information matches, then sends AR business datums to the mobile terminal.
Fourth aspect according to embodiments of the present invention provides another AR business processing devices, including：First obtains mould The geographical location information for obtaining the geographical location information of mobile terminal, is sent to server by block；3rd receives mould Block, for receiving the image capture instruction that the server is sent after the geographical location information is confirmed；Second sending module, For gathering image data according to described image acquisition instructions, described image data sending is given to the server；4th receives Module, for receiving the AR business datums that the server is sent after described image data are confirmed；Display module, for basis The AR business datums carry out AR service displays.
5th aspect according to embodiments of the present invention, provides a kind of server, including：Processor, memory, communication connect Mouth and communication bus, the processor, the memory and the communication interface are completed each other by the communication bus Communication；For the memory for storing an at least executable instruction, the executable instruction makes the processor perform such as first The corresponding operation of AR method for processing business described in aspect.
5th aspect according to embodiments of the present invention, provides a kind of mobile terminal, including：Processor, memory, communication Interface and communication bus, the processor, the memory and the communication interface are completed mutual by the communication bus Communication；For the memory for storing an at least executable instruction, the executable instruction makes the processor perform such as the The corresponding operation of AR method for processing business described in two aspects.
By above technical scheme as it can be seen that when realizing AR business, it is necessary to geographical location information and image data are combined, Wherein, image data should be the image of the position indicated by geographical location information, such as the image on office foreground, the image The realization scene of AR business can be described.If the geographical location indicated by geographical location information is not belonging to that setting AR business can be carried out Position, if alternatively, although the geographical location indicated by geographical location information does not belong to the position that can carry out setting AR business, but not There are the realization scenes (without matched image data) of the AR business, can not realize corresponding AR business.As it can be seen that pass through this Inventive embodiments get up geographical location, AR business scenarios image and AR business associations so that AR technologies can be efficiently applied to In the game class application related with position, user experience is promoted.
Description of the drawings
It in order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments described in inventive embodiments for those of ordinary skill in the art, can also be obtained according to these attached drawings Obtain other attached drawings.
Fig. 1 is the step flow chart according to a kind of AR method for processing business of the embodiment of the present invention one；
Fig. 2 is the step flow chart according to a kind of AR method for processing business of the embodiment of the present invention two；
Fig. 3 is the step flow chart according to a kind of AR method for processing business of the embodiment of the present invention three；
Fig. 4 is the step flow chart according to a kind of AR method for processing business of the embodiment of the present invention four；
Fig. 5 is the step flow chart according to a kind of AR method for processing business of the embodiment of the present invention five；
Fig. 6 is the structure diagram according to a kind of AR business processing devices of the embodiment of the present invention six；
Fig. 7 is the structure diagram according to a kind of AR business processing devices of the embodiment of the present invention seven；
Fig. 8 is the structure diagram according to a kind of server of the embodiment of the present invention eight；
Fig. 9 is the structure diagram according to a kind of mobile terminal of the embodiment of the present invention nine.
Specific embodiment
In order to which those skilled in the art is made to more fully understand the technical solution in the embodiment of the present invention, below in conjunction with the present invention The technical solution in the embodiment of the present invention is clearly and completely described in attached drawing in embodiment, it is clear that described reality It is only part of the embodiment of the embodiment of the present invention to apply example, instead of all the embodiments.Based on the implementation in the embodiment of the present invention Example, those of ordinary skill in the art's all other embodiments obtained should all belong to the scope that the embodiment of the present invention is protected.
Embodiment specific implementation is further illustrated the present invention with reference to attached drawing of the embodiment of the present invention.
Embodiment one
Reference Fig. 1 shows a kind of step flow chart of according to embodiments of the present invention one AR method for processing business.
The present embodiment illustrates AR method for processing business provided in an embodiment of the present invention from the angle of server, this reality The AR method for processing business for applying example comprises the following steps：
Step S102：Receive the geographical location information of mobile terminal, however, it is determined that be locally stored and believed with the geographical location The matched AR business location information of manner of breathing then sends image capture instruction to mobile terminal.
In the present embodiment, if mobile terminal thinks triggering AR business, it is necessary to first report geographical location information to server, pass through Whether geographical location information, server may determine that mobile terminal currently in the usage scenario position of AR business.Believe in geographical location The precision of breath is higher, and effect is better.More preferably, the precision of geographical location information is can be controlled within 10 meters, more preferably, can be controlled System is within 3 meters.
Wherein, AR business can be any suitable industry for showing AR effects and/or being interacted with AR virtual objects Business.
The AR business location informations to match with geographical location information of server local storage can be and geographical location The identical information of information, such as latitude and longitude coordinates or according to the more specific location information of geographical location information generation, e.g., XX Company foreground (in such cases, server when receiving the geographical location information of mobile terminal, it is necessary to which the geographical location is believed Breath corresponding conversion is corresponding specific location) etc..
If server judges that mobile terminal is currently located at the usage scenario position of AR business, it can send and scheme to mobile terminal As acquisition instructions, to indicate the image of mobile terminal acquisition current location, subsequent scenario comparison is carried out.
Step S104：Receive the image data that mobile terminal is returned according to image capture instruction.
Mobile terminal can control the camera in mobile terminal to carry out current position after image capture instruction is received Image Acquisition, and the image data of acquisition is uploaded to server.Server receives the image data that mobile terminal uploads, into Row subsequent use scene contrast judgement.
Step S106：If the image data image data corresponding with AR business location informations returned matches, to shifting Dynamic terminal sends AR business datums.
In server in addition to AR business location informations are stored with, image corresponding with AR service digit confidence manners of breathing is also stored with Data, the image data for AR business usage scenario image data, can include one or more (two and two with On) image data of the image of usage scenario.In addition, also it is stored with to handle the logical code of AR business in server, with It realizes to functions such as the receptions, processing and transmission of information and data.
If the geographical location information and image data that are sent according to mobile terminal, determine the current geographical location of mobile terminal Match with usage scenario with AR business, then send AR business datums to mobile terminal.Wherein, AR business datums are included but not It is limited to：AR virtual objects, AR virtual items, the operable data for AR virtual objects.
Through this embodiment, when realizing AR business, it is necessary to geographical location information and image data are combined, wherein, Image data should be the image of the position indicated by geographical location information, such as the image on office foreground, which can be with The realization scene of AR business is described.If the geographical location indicated by geographical location information is not belonging to carry out the position of setting AR business It puts, if alternatively, although the geographical location indicated by geographical location information belongs to the position that can carry out setting AR business, but is not present The realization scene (without matched image data) of the AR business, can not realize corresponding AR business.As it can be seen that pass through this implementation Example, geographical location, AR business scenarios image and AR business associations is got up so that AR technologies can be efficiently applied to have with position In the game class application of pass, user experience is promoted.
Embodiment two
Reference Fig. 2 shows a kind of step flow chart of according to embodiments of the present invention two AR method for processing business.
The present embodiment still from the angle of server, illustrates AR method for processing business provided in an embodiment of the present invention.
The AR method for processing business of the present embodiment comprises the following steps：
Step S202：Server receives the geographical location information of mobile terminal, however, it is determined that has been locally stored and the geography The AR business location informations that location information matches then send image capture instruction to mobile terminal.
Server local is stored with the data carried out needed for AR business, includes but not limited to：AR business location information and AR The corresponding image data of business location information, AR business datums, user information, AR business progress msgs, etc..
It should be noted that when mobile terminal user uses AR business for the first time, above-mentioned data, such feelings may be not present Under condition, user can be prompted to be configured the AR business, position and the usage scenario of the AR business are set by mobile terminal Image simultaneously preserves the information set and data upload server.Wherein, usage scenario image is suggested from different perspectives Multiple are gathered, the form of video flowing can also be used, to provide more flexible acquisition to the user when subsequently carrying out image comparison Angle.
In this step, server is after the geographical location information of mobile terminal is received, by the geographical location information and this The AR business location informations of ground storage are compared, to judge whether mobile terminal present position is AR business position, if For AR business position, then image capture instruction is sent to mobile terminal, instruction mobile terminal carries out the usage scenario of AR business Image Acquisition；If not AR business position, then prompt message is returned to mobile terminal, to prompt mistake to the user of mobile terminal Or prompting is configured AR business.In another feasible pattern, if not AR business position, i.e. server determine locally not When being stored with the AR business location informations to match with the geographical location information, then looked into from the AR business location informations of storage It looks for and the immediate AR business location information of the geographical location information；Include immediate AR service digits to mobile terminal transmission The prompt message of confidence breath.It is because while that the current location residing for mobile terminal does not have AR business, when being possible to a spacing There is AR business from the range of, mobile terminal may be selected to participate.Therefore, the corresponding of the AR business can be sent to mobile terminal Location information instructs the user of mobile terminal that the position is gone to participate in AR business.Optionally, it may call upon and lead in mobile terminal side Boat application, according to the current geographic position information of mobile terminal and immediate AR business location information, for the mobile terminal User navigates.
Step S204：Server receives the image data that mobile terminal is returned according to image capture instruction.
Mobile terminal gathers the image of present position according to image capture instruction and uploads corresponding image data, server Receive the image data that mobile terminal uploads.
Step S206：Server judges the image data of mobile terminal return and be locally stored and AR service digit confidences Cease whether corresponding image data matches；If matching, performs step S208；If mismatching, step S214 is performed.
Server local is stored with the image data of the usage scenario of AR business, i.e., figure corresponding with AR business location informations As data, by the comparison of the image data returned with mobile terminal, you can judge whether mobile mobile terminal is currently in AR In the usage scenario of business.
In a kind of feasible pattern, server carries out iamge description processing to the image data that mobile terminal returns, and obtains The text description of described image data.The image data corresponding with AR business location informations of server local storage is also to have deposited The text description of the image data of storage, i.e. iamge description.Server compares the figure of text description and storage that mobile terminal returns As whether description matches.By carrying out iamge description processing to image data, servers' data storage burden is alleviated, is also carried The high comparison efficiency of image data.
Iamge description process includes：After being split to image, several regions are divided the image into, including different characteristic Object and background, wherein may include some shapes, such as the region of rectangle, circle, curve and arbitrary shape；Segmentation is completed Afterwards, these regions with different characteristic are represented with data, symbol, formal language, generates the text description of the image.Its In, the description of image-region, which can be divided into, is described relation, the structure between region description in itself and region, including right The various forms of descriptions such as line, curve, region, geometric properties.In the embodiment of the present invention, those skilled in the art, which may be employed, to be appointed The image anticipated represented by the image data that appropriate image description model and algorithm return to mobile terminal is carried out at iamge description Reason, the embodiment of the present invention are not restricted this.
Step S208：If server judges the image data image data phase corresponding with AR business location informations returned Match somebody with somebody, then send AR business datums to mobile terminal.
Wherein, AR business datums include：AR service feature data, the AR service features data include it is following at least it One：AR virtual objects, AR virtual items, the operable data for AR virtual objects.AR virtual objects can be arbitrary appropriate , the two dimensional image and/or special efficacy that can be shown in the terminal, 3-D view and/or special efficacy or video etc., Such as three-dimensional plant or virtual animal；AR virtual items can be any suitable, AR virtual objects can be operated Stage property, e.g., for water to virtual plant virtual kettle, for virtual plant carry out shovel soil virtual scoop, be used for Virtual insecticide of deinsectization, etc. is carried out to virtual plant；For AR virtual objects operable data with to AR virtual objects The operation of progress is related with current state, and the upper limit of e.g., in one day watering to virtual plant is five times, then with watering when initial daily Corresponding operable data is 5, and when there is user to water 1 time for virtual plant, then the operable data is updated to 4, etc..Pass through AR virtual objects, AR virtual items and the operable data for AR virtual objects can be realized in AR business, user with it is empty Intend effective interaction of object and the state update of virtual objects with the functions such as checking.
But not limited to this, AR service features data can also set other fit by those skilled in the art according to actual demand When characteristic；Also, in addition to above-mentioned AR service features data, AR business datums can also include but not limited to：AR business Progress data, AR service-user data, etc..
Mobile terminal after corresponding AR business datums are received, can based on the image that image capture device gathers in real time, Carry out rendering and showing for AR virtual objects.Certainly, AR virtual items, which can also synchronize, renders and shows, also, can root The operations such as corresponding information alert are carried out according to the operable data for AR virtual objects.
Step S210：Server receive mobile terminal by the AR virtual items in AR business datums to AR virtual objects into Capable operation updates the operable data of AR virtual objects according to the operation.
After mobile terminal has carried out corresponding AR service displays according to AR business datums, the user of mobile terminal can lead to AR virtual items are crossed to operate AR virtual objects, and by operation information Real-time Feedback to server.Server is receiving After these operation informations, by the operable data according to these operation update AR virtual objects.It optionally, can also be according to update Operable data update AR virtual objects and/or AR virtual tools afterwards, and it is virtually right to the updated AR of mobile terminal transmission As and/or AR virtual tools, so that mobile terminal is updated.
It should be noted that for social gaming class application, there are multiple users to be participated in together by respective mobile terminal In one application, these users simultaneously or non-concurrently can grasp same AR virtual objects by respective mobile terminal Make, such as watered simultaneously using virtual kettle to identical virtual plant；Alternatively, pass through its mobile terminal in a user While having carried out watering to virtual plant using virtual kettle, another user uses virtual scoop pair by its mobile terminal Identical virtual plant has carried out shovel soil operation, these operation informations will all be reported to server, and server is operated according to these The state of information real-time update virtual plant simultaneously feeds back to multiple mobile terminals.
That is, when mobile terminal includes multiple, server receives at least one mobile terminal in multiple mobile terminals At least one operation carried out by AR virtual items to AR virtual objects updates corresponding AR void according at least one of this operation Intend the operable data of object.Optionally, AR virtual objects and/or AR virtual items can also be updated simultaneously.
Step S212：To mobile terminal, return to step S210 is continued to execute the updated operable data of server sync.
As previously mentioned, for some mobile terminal, server can be according to the operation information that the mobile terminal uploads more It is new to be directed to the operable data of AR virtual objects, and then updated operable data is synchronized to mobile terminal.But except this it Outside, AR virtual objects and/or AR virtual items can also be updated, in such cases, the operable data after synchronized update arrives While mobile terminal, AR virtual objects that can also be after synchronized update and/or updated AR virtual items to mobile terminal.
And when mobile terminal includes multiple, operable data of the meeting after synchronized update to the same of multiple mobile terminals When, also the AR virtual objects after synchronized update and/or updated AR virtual items to multiple mobile terminals.Multiple mobile terminals Show the operation that AR virtual objects are carried out operation information and, the user information of the corresponding mobile terminal of the operation.Example Such as, user XX for XX plant waterings once, user YY applies fertilizer once, etc. for XX plants.
Hereby it is achieved that the synchronism between the AR business that more people participate in.
Step S214：If server judges the image data image corresponding with AR business location informations that mobile terminal returns Data mismatch, then image data corresponding with AR business location informations are sent to mobile terminal, prompting mobile terminal according to The described image data of transmission carry out Image Acquisition.
When the image data that mobile terminal returns and the image data of server local storage mismatch, it may be possible to move The angle of user's captured image of dynamic terminal is incorrect, therefore, can the image data that stored in server be sent to movement Terminal, after being referred to for mobile terminal user, from correct angle shot.It is for reference by sending image data, it can improve User carries out the accuracy of Image Acquisition using mobile terminal, promotes user experience.
But those skilled in the art are it should be apparent that in actual use, if server judges what mobile terminal returned Image data image data corresponding with AR business location informations mismatches, and can also carry out other proper treatments, such as prompts wrong By mistake etc..
Through this embodiment, when realizing AR business, it is necessary to geographical location information and image data are combined, wherein, Image data should be the image of the position indicated by geographical location information, such as the image on office foreground, which can be with The realization scene of AR business is described.If the geographical location indicated by geographical location information is not belonging to carry out the position of setting AR business It puts, if alternatively, although the geographical location indicated by geographical location information belongs to the position that can carry out setting AR business, but is not present The realization scene (without matched image data) of the AR business, can not realize corresponding AR business.As it can be seen that pass through this implementation Example, geographical location, AR business scenarios image and AR business associations is got up so that AR technologies can be efficiently applied to have with position In the game class application of pass, user experience is promoted.
Embodiment three
Reference Fig. 3 shows a kind of step flow chart of according to embodiments of the present invention three AR method for processing business.
The present embodiment illustrates AR method for processing business provided in an embodiment of the present invention from the angle of mobile terminal.
The AR method for processing business of the present embodiment comprises the following steps：
Step S302：The geographical location information of mobile terminal is obtained, the geographical location information is sent to server.
Mobile terminal when wanting triggering AR business, it is necessary to the geographical location information of itself first is sent to server, with Judge whether mobile terminal is currently in the usage scenario of AR business for server.The precision of geographical location information is higher, effect Fruit is better.
Step S304：Receive the image capture instruction that server is sent after the geographical location information is confirmed.
Be stored in server with the relevant information of AR business, include but not limited to：AR business location information and AR business The corresponding image data of location information, AR business datums, user information, AR business progress msgs, etc..
Server is receiving the geographical location information of mobile terminal transmission, and determines the geographical location information and server After the AR service digits of middle storage put information match, image capture instruction will be sent to mobile terminal.
User for the mobile terminal for using AR business for the first time, can be by mobile terminal to the usage scenario of AR business Position and image be configured, and by the information or data sending of the position set and image to server preserve.Service The message judgement that device can be sent according to mobile terminal is the message for the message or application type for setting type, and then determines follow-up Operation.Such as, the message if setting type then preserves the corresponding information or data of mobile terminal upload；If disappearing for application type Breath, then perform the scheme described in the present embodiment.
Step S306：Image data is gathered according to image capture instruction, the image data of acquisition is sent to server.
Mobile terminal controls the image capture device such as camera pair in mobile terminal after image capture instruction is received The scene for being presently in position is shot, and the image of shooting is uploaded to server, and making for AR business is carried out for server With the identification and judgement of scene.
Step S308：Receive the AR business datums that server is sent after image data is confirmed.
If geographical location information and image data are confirmed by server, position and field that mobile terminal is presently in are represented The corresponding AR business of Jing Junyu matches, and then sends AR business datums to mobile terminal, so that mobile terminal is based on this map As the image that collecting device gathers in real time, rendering, show and interacting for AR business datums is carried out.
Wherein, the AR business datums that mobile terminal is received from server include but are not limited to：AR service feature data, it is described AR service features data include at least one of：AR virtual objects, AR virtual items, grasping for the AR virtual objects Make data.But not limited to this, AR service features data can also set other fit by those skilled in the art according to actual demand When characteristic；Also, in addition to above-mentioned AR service features data, AR business datums can also include but not limited to：AR business Progress data, AR service-user data, etc..
Step S310：AR service displays are carried out according to AR business datums.
After AR business datums are received, mobile terminal on the basis of the realtime graphic of acquisition, will render and draw phase The AR business datums answered such as AR virtual objects and AR virtual items, and are shown.
Through this embodiment, when realizing AR business, it is necessary to geographical location information and image data are combined, wherein, Image data should be the image of the position indicated by geographical location information, such as the image on office foreground, which can be with The realization scene of AR business is described.If the geographical location indicated by geographical location information is not belonging to carry out the position of setting AR business It puts, if alternatively, although the geographical location indicated by geographical location information belongs to the position that can carry out setting AR business, but is not present The realization scene (without matched image data) of the AR business, can not realize corresponding AR business.As it can be seen that pass through this implementation Example, geographical location, AR business scenarios image and AR business associations is got up so that AR technologies can be efficiently applied to have with position In the game class application of pass, user experience is promoted.
Example IV
Reference Fig. 4 shows a kind of step flow chart of according to embodiments of the present invention four AR method for processing business.
The present embodiment still from the angle of mobile terminal, is said AR method for processing business provided in an embodiment of the present invention It is bright.
The AR method for processing business of the present embodiment comprises the following steps：
Step S402：Mobile terminal receives the triggering command of AR business.
Wherein, the triggering command of triggering generation, also may be used when which can be the AR application startups in mobile terminal To be the triggering command generated when the AR business options in conventional application are triggered, other appropriate ways triggering generations are can also be Instruction, the embodiment of the present invention is not restricted the triggering mode and generating mode and concrete form of triggering command.
Step S404：Mobile terminal obtains the geographical location information of mobile terminal itself, by described according to triggering command Reason location information is sent to server.
In the present embodiment, the precision of geographical location information of mobile terminal is set within 10 meters, it more preferably, can be 3 Within rice.
Step S406：Mobile terminal receives the Image Acquisition that server is sent after the geographical location information is confirmed and refers to Order.
Optionally, server if it is determined that there is no mobile terminal send geographical location information when, can also be from storage It is searched and the immediate AR business location information of the geographical location information in AR business location informations；And it is sent to mobile terminal Include the prompt message of immediate AR business location information, with the user for instructing mobile terminal the position is gone to participate in AR business. In such cases, mobile terminal can call navigation application, according to the current geographic position information of mobile terminal and immediate AR business location informations, navigate for the user of the mobile terminal.Certainly, server is if it is determined that there is no mobile terminal transmissions Geographical location information when, error message can also be prompted or prompt the information that is configured to AR business of user, etc..
Step S408：Mobile terminal gathers image data according to image capture instruction, and the image data of acquisition is sent to Server.
Step S410：Mobile terminal receives the AR business datums that server is sent after described image data are confirmed.
Wherein, AR business datums include：AR service feature data, the AR service features data include it is following at least it One：AR virtual objects, AR virtual items, the operable data for AR virtual objects.
Step S412：Mobile terminal carries out AR service displays according to AR business datums.
For example, after the AR business datums of server transmission are received, rendered on the image that is gathered in real time in mobile terminal With drafting AR virtual objects and AR virtual items, etc..
Step S414：What mobile terminal reception server was sent after being updated to AR business datums updates the data, according to It updates the data the local AR business datums of update and carries out AR service displays.
It on the one hand, can be empty to AR using AR virtual items according to the operable data for current mobile terminal Intend object to be operated, and the operation information of the operation is sent to server；And then server is received according to the operation Information the operable data stored in server is updated after data, according to updated data carry out AR business exhibitions Show.
Optionally, server can also update AR virtual objects and/or the virtual roads of AR according to updated operable data Tool.Based on this, mobile terminal is being received outside updated operable data, can also receive updated AR virtual objects And/or AR virtual items, carry out AR service displays according to updated data.
On the other hand, for the situation of multiple mobile terminals, it is possible to which there is no empty to AR by the user of current mobile terminal Intend object to be operated, but the user of other mobile terminals operated or, the user of current mobile terminal and other Mobile terminal with being operated per family to AR virtual objects.But the AR industry no matter what kind of situation it is, participated in for multi-user Business, which needs to send to multiple mobile terminals, to be updated the data to update AR business datums and update AR service displays accordingly.It is based on This, current mobile terminal can receive updating the data for server transmission, and described update the data can only include updated grasp Make data, it can also be in addition to including updated operable data, after further including updated AR virtual objects and/or update AR virtual items, it is described update the data by server according to multiple mobile terminals including current mobile terminal use AR The operation information that virtual item operates AR virtual objects generates；AR service displays are carried out according to described update the data.
In addition, each mobile terminal can show participate in the AR business multiple mobile terminals to AR virtual objects into The operation information of capable operation and, the user information of the corresponding mobile terminal of the operation.Such as, user A applies fertilizer to XX plants Once, user B to XX plant waterings once, user C to XX plant waterings once, etc..
Hereby it is achieved that the update and displaying of the AR business of multi-user's reference.
Through this embodiment, when realizing AR business, it is necessary to geographical location information and image data are combined, wherein, Image data should be the image of the position indicated by geographical location information, such as the image on office foreground, which can be with The realization scene of AR business is described.If the geographical location indicated by geographical location information is not belonging to carry out the position of setting AR business It puts, if alternatively, although the geographical location indicated by geographical location information belongs to the position that can carry out setting AR business, but is not present The realization scene (without matched image data) of the AR business, can not realize corresponding AR business.As it can be seen that pass through this implementation Example, geographical location, AR business scenarios image and AR business associations is got up so that AR technologies can be efficiently applied to have with position In the game class application of pass, user experience is promoted.
Embodiment five
Reference Fig. 5 shows a kind of step flow chart of according to embodiments of the present invention five AR method for processing business.
The angle that the present embodiment is interacted from mobile terminal and server is right to cultivate the AR of virtual plant game as example AR method for processing business provided in an embodiment of the present invention illustrates.
The AR method for processing business of the present embodiment comprises the following steps：
Step S502：The AR game of mobile terminal A setting cultivation virtual plants uses position and usage scenario, and will be right The geographical location information and scene image data upload server answered.
Mobile terminal A is started by corresponding account or played into AR, for the first time using AR game such as cultivation virtual plant AR game when, do not preserved in server with the AR play relevant any data, it is necessary to mobile terminal set after upload To server.
For example, after mobile terminal A starts, its GPS data is sent to server, the image then sent according to server is adopted Collection instruction starts camera, sends camera video and flows to server.
Step S504：Server receives and preserves the geographical location information and image data of mobile terminal A uploads, generates AR The initialization data of game is simultaneously sent to mobile terminal A.
For example, server after the GPS data of mobile terminal A is received, first looks at and whether is stored with the GPS data, In the case of use for the first time, there is no the GPS data in server, preserve the GPS data and send image to mobile terminal A Acquisition instructions instruction mobile terminal A uploads image data；After waiting standby communication terminals A uploaded videos streams, by the data of the video flowing It is associated with GPS data foundation；After server obtains enough image datas from video flowing, by image data and GPS data It is corresponding to preserve, and the initialization data of the AR game of cultivation virtual plant is generated, and the initialization data is sent to movement eventually Hold A.Optionally, the image data of preservation can be original image, alternatively, the characteristic information of image, alternatively, the text of image is retouched It states.
Typically, since the image in video flowing is the entrance for generating AR game, therefore, it is necessary to pass through image Obtain the data of the usage scenario of enough AR game.For example, doing AR game entries using company foreground, then company foreground is needed Continuous image from left to right, the user convenient for participating in AR game can when shooting the image on company foreground from different perspectives Properly enter game.The initialization data of AR game includes at least AR virtual objects and AR virtual items, for example, the present embodiment The initialization data of the AR game of middle cultivation virtual plant can include：The initial 3D models of plant image and interaction are set The kettle such as to water.
In addition, if the GPS data of the transmission of mobile terminal A is not present in server, server can also be according to storage The GPS data of GPS data and mobile terminal A searches the position closest with the current location of mobile terminal A, according to the position The GPS data put sends prompt message, the position of AR game of the prompting mobile terminal A away from its nearest neighbours, to refer to mobile terminal A It leads user and participates in AR game.
In addition, the corresponding AR game datas of each GPS data are will also maintain in server, wherein, AR game datas Including user id, AR game progress, AR game characteristic data etc..AR game characteristics data can be AR game virtuals object, void Intend stage property, AR game operable datas, for example, how many pest, plant need how many nutrient, plant to need above virtual plant How much water, etc..
Step S506：Mobile terminal A receives the initialization data of AR game, and AR game circle is shown according to initialization data Face.
After the AR game of cultivation virtual plant receives the initialization data of server return in mobile terminal A, it can be based on The image of camera current shooting, initialization data is plotted on image, to show AR interfaces for user.
After the completion of the initialization procedure of AR game, multiple mobile terminals subsequently including mobile terminal A can be direct The AR for entering cultivation virtual plant by the image data of GPS data and usage scenario plays.
Step S508：Mobile terminal B triggering AR game, obtains the geographical location information of mobile terminal B and is sent to service Device.
For example, mobile terminal B sends GPS data to server.
It should be noted that the present embodiment is by taking mobile terminal B as an example, in the case of illustrating multiple mobile terminals, before implementation State the process that other mobile terminals outside the mobile terminal A of initialization carry out AR game, those skilled in the art it will be clear that It is that in actual use, the arbitrary mobile terminal for participating in AR game including mobile terminal A and B can refer to mobile whole The operation of B is held to carry out the AR game operations of the present embodiment.
Step S510：Server receives the geographical location information of mobile terminal B, and the geographical location with being stored in server Information is matched, if successful match, performs step S512；If it fails to match, prompt message is sent to mobile terminal B, Prompt mistake.
Step S512：Server sends image capture instruction to mobile terminal B.
After server receives the GPS data of mobile terminal B, check whether the GPS data exists in the server, if depositing , then when checking whether the GPS data corresponds to the image data of GPS data with the presence of corresponding image data, to mobile terminal B sends image capture instruction, instruction mobile terminal B acquisition images, and standby communication terminals B is waited to send the image of acquisition, such as gathers Video flowing in image.
Step S514：Mobile terminal B gathers the image of position according to image capture instruction, and is sent to server.
For example, after mobile terminal B receives image capture instruction, start camera, send camera video and flow to service Device.
Step S516：Server receives the image data for the image that mobile terminal B is sent, and with stored in server with The corresponding image data of geographical location information is matched, if successful match, performs step S518；If it fails to match, to Mobile terminal B sends prompt message, and the user of prompting mobile terminal B is with the presence or absence of AR game usage scenarios.
After the standby communication terminals such as server B passes video flowing back, by the image data in video flowing and the image data of storage It is compared.
If compare the operation for successfully carrying out subsequent step S518；If comparison failure sends scene to mobile terminal B Prompting.For example, company foreground is game entry, the user of mobile terminal B shoots server not identification after company foreground Out, but the GPS data of mobile terminal B is matched, then the user of server meeting prompting mobile terminal B more recently claps It takes the photograph, or the user for several frame pictures will be extracted in the image data on the company foreground preserved in server being sent to mobile terminal B, The user of prompting mobile terminal B can be according to the angle shot company foreground in image data.
Step S518：Server sends AR game datas to mobile terminal B.
If the image data of the image data and storage in video flowing compares successfully, game number in the server will be stored According to returning to mobile terminal B.
Step S520：Mobile terminal B shows AR interfaces according to AR game datas.
After mobile terminal B waiting for server is passed back to game data, interface is showed for user according to game data.
The interface that AR interfaces combine for AR virtual objects and reality scene, wherein, AR virtual objects come from server The AR game datas of transmission, camera of the reality scene from mobile terminal B are found a view.
Step S522：Mobile terminal B receives the AR game operations that are carried out by AR interfaces of user, and by the letter of operation Breath is sent to server.
Step S524：Server updates AR game datas according to the information of the operation, and is sent to mobile terminal A and B.
Step S526：Mobile terminal A and B receive updated AR game datas, and update interface.
AR virtual objects are responded according to the operation of the user of mobile terminal B, and mobile terminal B receives the operation of user, If the operation is effective operation of AR game, then the corresponding information of the operation is uploaded onto the server, server receives phase After the information answered, update AR game datas and mobile terminal A, mobile terminal A are also sent to while mobile terminal B is returned to It, can be according to the respective AR game datas of updated data update after receiving updated data with B.
For example, in the AR game of the cultivation virtual plant of the present embodiment, user clicks on kettle icon and virtual plant is carried out Watering；AR game receives the information that kettle icon is clicked, and corresponding event after the kettle icon is clicked on is sent to server, Such as " water "；Server receives " water " event, if the corresponding virtual plant water shortage of AR game at this time is 5, point is struck waters After pot image, then virtual plant water shortage is 4；Server sends water shortage as 4 corresponding virtual plants to mobile terminal A and B 3d models；AR game receives the message of 3d models variation, obtains the data of new 3d models, is plotted in mobile terminal A respectively In the interface of B.
If also other users participate in AR game, updated AR game datas can be sent to while connect by server The multiple mobile terminals entered.
Through this embodiment, the AR game of an office kind plant is constructed.It is used first by a user mobile whole End uploads the position data of AR game, and starts camera and scan the corresponding specific position of the position data, such as public Foreground is taken charge of, to initialize entire AR game.Then, other users using respective mobile terminal uploading position data and start Camera scans the position such as company foreground again can enter AR game.Meanwhile AR game has what more people cooperateed with jointly Characteristic and sociability can effectively meet the social needs of user, promote user experience.
It should be noted that AR business processings scheme provided in an embodiment of the present invention may be not only suitable for game class applied field Scape is equally applicable to other AR business scenarios related with geographical location information.
Embodiment six
Reference Fig. 6 shows a kind of structure diagram of according to embodiments of the present invention six AR business processing devices.
The AR business processing devices of the present embodiment can be arranged in server, which includes：First Receiving module 602, for receiving the geographical location information of mobile terminal, however, it is determined that be locally stored and the geographical location information The AR business location informations to match then send image capture instruction to mobile terminal；Second receiving module 604, for receiving The image data that mobile terminal is returned according to image capture instruction；First sending module 606, if for return image data with The corresponding image data of AR business location informations matches, then sends AR business datums to mobile terminal.
Optionally, the first sending module 606 is used to carry out iamge description processing to the image data that mobile terminal returns, and obtains The text of described image data is taken to describe；Match if the text describes iamge description corresponding with AR business location informations, Then AR business datums are sent to mobile terminal.
Optionally, AR business datums include：AR service feature data, AR service features data include at least one of： AR virtual objects, AR virtual items, the operable data for the AR virtual objects.
Optionally, the AR business processing devices of the present embodiment further include：First update module 608, for being sent first Module 606 to mobile terminal send AR business datums after, receive mobile terminal by AR virtual items to AR virtual objects into Capable operation updates the operable data of AR virtual objects according to the operation；Synchronization module 610, after synchronized update Operable data is to mobile terminal.
Optionally, the first update module 608 be additionally operable to according to updated operable data update AR virtual objects and/or AR virtual items；While synchronization module 610 is additionally operable to the operable data after synchronized update to mobile terminal, synchronized update Rear AR virtual objects and/or updated AR virtual items are to mobile terminal.
Optionally, mobile terminal includes multiple；First update module 608 is used to receive at least one in multiple mobile terminals At least one operation that a mobile terminal carries out AR virtual objects by AR virtual items, according at least one of described operation more The operable data of new corresponding AR virtual objects；Synchronization module 610 is for the operable data after synchronized update to multiple While mobile terminal, AR virtual objects and/or updated AR virtual items after synchronized update to multiple mobile terminals.
Optionally, if the first sending module 606 is additionally operable to the image data of mobile terminal return and AR business location informations Corresponding image data mismatches, then image data corresponding with AR business location informations is sent to mobile terminal, prompts to move Dynamic terminal carries out Image Acquisition according to the image data of transmission.
Optionally, the first sending module 606 is additionally operable to if it is determined that local be not stored with and the geographical location information phase The AR business location informations matched somebody with somebody then are searched and the immediate AR of the geographical location information from the AR business location informations of storage Business location information；Include the prompt message of immediate AR business location information to mobile terminal transmission.
The AR business processing devices of the present embodiment are used to implement corresponding server end in aforesaid plurality of embodiment of the method AR method for processing business, and the advantageous effect with corresponding embodiment of the method, details are not described herein.
Embodiment seven
Reference Fig. 7 shows a kind of structure diagram of according to embodiments of the present invention seven AR business processing devices.
The AR business processing devices of the present embodiment can be arranged in any suitable mobile terminal, AR business processings dress Put including：For obtaining the geographical location information of mobile terminal, the geographical location information is sent for first acquisition module 702 To server；3rd receiving module 704, for receiving the Image Acquisition that server is sent after the geographical location information is confirmed Instruction；Second sending module 706, for gathering image data according to image capture instruction, by described image data sending to clothes Business device；4th receiving module 708, for receiving the AR business datums that server is sent after described image data are confirmed；Displaying Module 710, for carrying out AR service displays according to AR business datums.
Optionally, AR business datums include：AR service feature data, AR service features data include at least one of： AR virtual objects, AR virtual items, the operable data for the AR virtual objects.
Optionally, the AR business processing devices of the present embodiment further include：3rd sending module 712, in display module It is virtual to AR using AR virtual items according to the operable data after 710 carry out AR service displays according to AR business datums Object is operated, and the operation information of the operation is sent to server.
Optionally, the AR data processing equipments of the present embodiment further include：5th receiving module 714, for being sent the 3rd After the operation information of the operation is sent to server by module 712, updating the data for server transmission is received, wherein, institute It states and updates the data in addition to including updated operable data, further include updated AR virtual objects and/or updated AR virtual items, described update the data use AR void by server according to multiple mobile terminals including current mobile terminal Intend the operation information that stage property operates AR virtual objects to generate；Second update module 716, for being updated the data according to Carry out AR service displays.
Optionally, display module 710 is additionally operable to show that multiple mobile terminals carry out AR virtual objects on mobile terminals Operation operation information and, the user information of the corresponding mobile terminal of the operation.
The AR business processing devices of the present embodiment are used to implement corresponding mobile terminal in aforesaid plurality of embodiment of the method AR method for processing business, and the advantageous effect with corresponding embodiment of the method, details are not described herein.
Embodiment eight
With reference to Fig. 8, a kind of structure diagram of according to embodiments of the present invention eight server is shown, it is of the invention specific real Example is applied not limit the specific implementation of server.
As shown in figure 8, the server can include：Processor (processor) 802, communication interface (Communications Interface) 804, memory (memory) 806 and communication bus 808.
Wherein：
Processor 802, communication interface 804 and memory 806 complete mutual communication by communication bus 808.
Communication interface 804, for communicating with other servers or mobile terminal.
Processor 802, for performing program 810, the AR method for processing business that can specifically perform above-mentioned server side is real Apply the correlation step in example.
Specifically, program 810 can include program code, which includes computer-managed instruction.
Processor 802 may be central processor CPU or specific integrated circuit ASIC (Application Specific Integrated Circuit) or be arranged to implement the embodiment of the present invention one or more integrate electricity Road.The one or more processors that mobile terminal includes can be same type of processor, such as one or more CPU；Also may be used To be different types of processor, such as one or more CPU and one or more ASIC.
Memory 806, for storing program 810.Memory 806 may include high-speed RAM memory, it is also possible to further include Nonvolatile memory (non-volatile memory), for example, at least a magnetic disk storage.
Program 810 specifically can be used for so that processor 802 performs following operation：Receive the geographical location letter of mobile terminal Breath, however, it is determined that the AR business location informations to match with the geographical location information are locally stored, then are sent to mobile terminal Image capture instruction；Receive the image data that mobile terminal is returned according to described image acquisition instructions；If the image data returned Image data corresponding with AR business location informations matches, then sends AR business datums to mobile terminal.
In a kind of optional embodiment, if program 810 is additionally operable to so that processor 802 is in described image data and AR The corresponding image data of business location information matches, then when sending AR business datums to mobile terminal, to described image data Iamge description processing is carried out, obtains the text description of described image data；If the text description and AR business location informations pair The iamge description answered matches, then sends AR business datums to mobile terminal.
In a kind of optional embodiment, AR business datums include：AR service feature data, AR service feature data packets Include at least one of：AR virtual objects, AR virtual items, the operable data for the AR virtual objects.
In a kind of optional embodiment, program 810 is additionally operable to so that processor 802, which receives mobile terminal, passes through AR void Intend the operation that stage property carries out AR virtual objects, the operable data of AR virtual objects is updated according to the operation；Synchronized update Operable data afterwards is to mobile terminal.
In a kind of optional embodiment, program 810 is additionally operable to so that processor 802 is according to updated operable number According to update AR virtual objects and/or AR virtual items；While operable data after synchronized update is to the mobile terminal, AR virtual objects and/or updated AR virtual items after synchronized update are to the mobile terminal.
In a kind of optional embodiment, mobile terminal includes multiple；Program 810 is additionally operable to so that processor 802 exists The operation that mobile terminal carries out AR virtual objects by AR virtual items is received, AR virtual objects are updated according to the operation During operable data, receive at least one mobile terminal in multiple mobile terminals by AR virtual items to AR virtual objects into At least one capable operation updates the operable data of corresponding AR virtual objects according at least one operation；Program 810 is also used While causing operable data of the processor 802 after synchronized update to the multiple mobile terminal, after synchronized update AR virtual objects and/or updated AR virtual items are to the multiple mobile terminal.
In a kind of optional embodiment, if program 810 be additionally operable to so that processor 802 return image data with The corresponding image data of AR business location informations mismatches, then image data corresponding with AR business location informations is sent to shifting Dynamic terminal, prompting mobile terminal carry out Image Acquisition according to the image data of transmission.
In a kind of optional embodiment, program 810 is additionally operable to so that processor 802 is not if it is determined that local be stored with The AR business location informations to match with the geographical location information, then from the AR business location informations of storage search with it is described The immediate AR business location information of geographical location information；Include immediate AR business location information to mobile terminal transmission Prompt message.
The specific implementation of each step may refer in the AR method for processing business embodiments of above-mentioned server side in program 810 Corresponding steps and unit in corresponding description, this will not be repeated here.It is apparent to those skilled in the art that it is What is described is convenienct and succinct, and the equipment of foregoing description and the specific work process of module may be referred in preceding method embodiment Corresponding process description, details are not described herein.
Through this embodiment, when realizing AR business, it is necessary to geographical location information and image data are combined, wherein, Image data should be the image of the position indicated by geographical location information, such as the image on office foreground, which can be with The realization scene of AR business is described.If the geographical location indicated by geographical location information is not belonging to carry out the position of setting AR business It puts, if alternatively, although the geographical location indicated by geographical location information belongs to the position that can carry out setting AR business, but is not present The realization scene (without matched image data) of the AR business, can not realize corresponding AR business.As it can be seen that pass through the present invention Embodiment gets up geographical location, AR business scenarios image and AR business associations so that AR technologies can be efficiently applied to and position It is equipped in the game class application of pass, promotes user experience.
Embodiment nine
With reference to Fig. 9, a kind of structure diagram of according to embodiments of the present invention nine mobile terminal is shown, the present invention is specifically Embodiment does not limit the specific implementation of mobile terminal.
As shown in figure 9, the mobile terminal can include：Processor (processor) 902, communication interface (Communications Interface) 904, memory (memory) 906 and communication bus 908.
Wherein：
Processor 902, communication interface 904 and memory 906 complete mutual communication by communication bus 908.
Communication interface 904, for communicating with other mobile terminals or server.
Processor 902 for performing program 910, can specifically perform the AR method for processing business of above-mentioned mobile terminal side Correlation step in embodiment.
Specifically, program 910 can include program code, which includes computer-managed instruction.
Processor 902 may be central processor CPU or specific integrated circuit ASIC (Application Specific Integrated Circuit) or be arranged to implement the embodiment of the present invention one or more integrate electricity Road.The one or more processors that mobile terminal includes can be same type of processor, such as one or more CPU；Also may be used To be different types of processor, such as one or more CPU and one or more ASIC.
Memory 906, for storing program 910.Memory 906 may include high-speed RAM memory, it is also possible to further include Nonvolatile memory (non-volatile memory), for example, at least a magnetic disk storage.
Program 910 specifically can be used for so that processor 902 performs following operation：Obtain the geographical location letter of mobile terminal Breath, server is sent to by the geographical location information；Receive the figure that server is sent after the geographical location information is confirmed As acquisition instructions；Image data is gathered according to image capture instruction, by described image data sending to server；Receive server The AR business datums sent after described image data are confirmed；AR service displays are carried out according to AR business datums.
In a kind of optional embodiment, AR business datums include：AR service feature data, AR service feature data packets Include at least one of：AR virtual objects, AR virtual items, the operable data for the AR virtual objects.
In a kind of optional embodiment, program 910 is additionally operable to so that processor 902 is carried out according to AR business datums After AR service displays, according to the operable data, AR virtual objects are operated using AR virtual items, and by described in The operation information of operation is sent to server.
In a kind of optional embodiment, program 910 is additionally operable to so that processor 902 is carried out according to AR business datums After AR service displays, receive server send update the data, wherein, it is described update the data except include it is updated operable Outside data, updated AR virtual objects and/or updated AR virtual items are further included, it is described to update the data by server The behaviour that AR virtual objects are operated using AR virtual items according to multiple mobile terminals including current mobile terminal Make information generation；AR service displays are carried out according to described update the data.
In a kind of optional embodiment, program 910 be additionally operable to so that processor 902 show on mobile terminals it is multiple The operation information for the operation that mobile terminal carries out AR virtual objects and, user's letter of the corresponding mobile terminal of the operation Breath.
The specific implementation of each step may refer to the AR method for processing business embodiments of above-mentioned mobile terminal side in program 910 In corresponding steps and unit in corresponding description, this will not be repeated here.It is apparent to those skilled in the art that For convenience and simplicity of description, the specific work process of the equipment of foregoing description and module may be referred to preceding method embodiment In corresponding process description, details are not described herein.
Through this embodiment, when realizing AR business, it is necessary to geographical location information and image data are combined, wherein, Image data should be the image of the position indicated by geographical location information, such as the image on office foreground, which can be with The realization scene of AR business is described.If the geographical location indicated by geographical location information is not belonging to carry out the position of setting AR business It puts, if alternatively, although the geographical location indicated by geographical location information belongs to the position that can carry out setting AR business, but is not present The realization scene (without matched image data) of the AR business, can not realize corresponding AR business.As it can be seen that pass through the present invention Embodiment gets up geographical location, AR business scenarios image and AR business associations so that AR technologies can be efficiently applied to and position It is equipped in the game class application of pass, promotes user experience.
It may be noted that according to the needs of implementation, all parts/step described in the embodiment of the present invention can be split as more The part operation of two or more components/steps or components/steps can be also combined into new component/step by multi-part/step Suddenly, to realize the purpose of the embodiment of the present invention.
It is above-mentioned to realize or be implemented as in hardware, firmware according to the method for the embodiment of the present invention to be storable in note Software or computer code in recording medium (such as CD ROM, RAM, floppy disk, hard disk or magneto-optic disk) are implemented through net The original storage that network is downloaded is in long-range recording medium or nonvolatile machine readable media and will be stored in local recording medium In computer code, can be stored in using all-purpose computer, application specific processor or can compile so as to method described here Such software processing in journey or the recording medium of specialized hardware (such as ASIC or FPGA).It is appreciated that computer, processing Device, microprocessor controller or programmable hardware include can storing or receive software or computer code storage assembly (for example, RAM, ROM, flash memory etc.), when the software or computer code are by computer, processor or hardware access and when performing, realize Two-dimensional code data processing method described here.In addition, when all-purpose computer access is used to implement the two-dimentional yardage being shown in which According to processing method code when, all-purpose computer is converted to perform at the two-dimensional code data being shown in which by the execution of code The special purpose computer of reason method.
Those of ordinary skill in the art may realize that each exemplary lists described with reference to the embodiments described herein Member and method and step can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is performed with hardware or software mode, specific application and design constraint depending on technical solution.Professional technician Described function can be realized using distinct methods to each specific application, but this realization is it is not considered that exceed The scope of the embodiment of the present invention.
Embodiment of above is merely to illustrate the embodiment of the present invention, and is not the limitation to the embodiment of the present invention, related skill The those of ordinary skill in art field in the case where not departing from the spirit and scope of the embodiment of the present invention, can also make various Variation and modification, therefore all equivalent technical solutions fall within the scope of the embodiment of the present invention, the patent of the embodiment of the present invention Protection domain should be defined by the claims.

Claims (28)

1. a kind of augmented reality AR method for processing business, including：
Receive the geographical location information of mobile terminal, however, it is determined that the AR industry to match with the geographical location information is locally stored Business location information, then send image capture instruction to the mobile terminal；
Receive the image data that the mobile terminal is returned according to described image acquisition instructions；
If the described image data image data corresponding with the AR business location information returned matches, to the movement Terminal sends AR business datums.
2. according to the method described in claim 1, wherein, if described image data figure corresponding with the AR business location information As data match, then AR business datums are sent to the mobile terminal, including：
Iamge description processing is carried out to described image data, obtains the text description of described image data；
Match if the text describes iamge description corresponding with the AR business location information, sent out to the mobile terminal Send AR business datums.
3. method according to claim 1 or 2, wherein, the AR business datums include：AR service feature data, it is described AR service features data include at least one of：AR virtual objects, AR virtual items, grasping for the AR virtual objects Make data.
4. according to the method described in claim 3, wherein, after AR business datums are sent to the mobile terminal, the side Method further includes：
The operation that the mobile terminal carries out the AR virtual objects by the AR virtual items is received, according to the operation Update the operable data of the AR virtual objects；
Operable data after synchronized update is to the mobile terminal.
5. according to the method described in claim 4, wherein, the method further includes：
The AR virtual objects and/or AR virtual items are updated according to updated operable data；
While operable data after synchronized update is to the mobile terminal, AR virtual objects after synchronized update and/or Updated AR virtual items are to the mobile terminal.
6. according to the method described in claim 5, wherein, the mobile terminal includes multiple；
The operation for receiving the mobile terminal and the AR virtual objects being carried out by the AR virtual items, according to described Operation updates the operable data of the AR virtual objects, including：Receive at least one mobile terminal in multiple mobile terminals At least one operation carried out by the AR virtual items to the AR virtual objects, updates according at least one of described operation The operable data of the corresponding AR virtual objects；
While the operable data after synchronized update is to the mobile terminal, the AR virtual objects after synchronized update And/or updated AR virtual items are to the mobile terminal, including：Operable data after synchronized update is to the multiple While mobile terminal, the AR virtual objects and/or updated AR virtual items after synchronized update are whole to the multiple movement End.
7. according to the method described in claim 1, wherein, the method further includes：
If the described image data returned image data corresponding with the AR business location information mismatches, will be with the AR The corresponding image data of business location information is sent to the mobile terminal, prompts the figure of the mobile terminal according to transmission As data carry out Image Acquisition.
8. according to the method described in claim 1, wherein, the method further includes：
If it is determined that local be not stored with the AR business location informations to match with the geographical location information, then from the AR industry of storage It is engaged in searching and the immediate AR business location information of the geographical location information in location information；
Include the prompt message of the immediate AR business location information to mobile terminal transmission.
9. a kind of augmented reality AR method for processing business, including：
The geographical location information of mobile terminal is obtained, the geographical location information is sent to server；
Receive the image capture instruction that the server is sent after the geographical location information is confirmed；
Image data is gathered according to described image acquisition instructions, gives described image data sending to the server；
Receive the AR business datums that the server is sent after described image data are confirmed；
AR service displays are carried out according to the AR business datums.
10. according to the method described in claim 9, wherein, the AR business datums include：AR service feature data, the AR Service feature data include at least one of：AR virtual objects, AR virtual items, for the operable of the AR virtual objects Data.
11. according to the method described in claim 10, wherein, it is described according to the AR business datums carry out AR service displays it Afterwards, the method further includes：
According to the operable data, the AR virtual objects are operated using the AR virtual items, and by the behaviour The operation information of work is sent to the server.
12. according to the method described in claim 10, wherein, the service is sent in the operation information by the operation After device, the method further includes：
Receive that the server sends updates the data, wherein, it is described update the data except include updated operable data it Outside, updated AR virtual objects and/or updated AR virtual items are further included, it is described to update the data by the server root The AR virtual objects are grasped using the AR virtual items according to multiple mobile terminals including the mobile terminal The operation information generation of work；
AR service displays are carried out according to described update the data.
13. according to the method for claim 12, wherein, the method further includes：
The operation for the operation that the multiple mobile terminal carries out the AR virtual objects is shown on the mobile terminal Information and, the user information of the corresponding mobile terminal of the operation.
14. a kind of augmented reality AR business processing devices, including：
First receiving module, for receiving the geographical location information of mobile terminal, however, it is determined that be locally stored and the geographical position The matched AR business location information of confidence manner of breathing then sends image capture instruction to the mobile terminal；
Second receiving module, for receiving the image data that the mobile terminal is returned according to described image acquisition instructions；
First sending module, if the described image data image data phase corresponding with the AR business location information for return Matching then sends AR business datums to the mobile terminal.
15. device according to claim 14, wherein, first sending module, for being carried out to described image data Iamge description is handled, and obtains the text description of described image data；If the text description and the AR business location information pair The iamge description answered matches, then sends AR business datums to the mobile terminal.
16. the device according to claims 14 or 15, wherein, the AR business datums include：AR service feature data, institute Stating AR service features data includes at least one of：AR virtual objects, AR virtual items, for the AR virtual objects can Operation data.
17. device according to claim 16, wherein, described device further includes：
First update module, for after the mobile terminal sends AR business datums, being received in first sending module The operation that the mobile terminal carries out the AR virtual objects by the AR virtual items, according to the operation update The operable data of AR virtual objects；
Synchronization module, for the operable data after synchronized update to the mobile terminal.
18. device according to claim 17, wherein,
First update module is additionally operable to update the AR virtual objects according to updated operable data and/or AR is empty Intend stage property；
The synchronization module, while being additionally operable to the operable data after synchronized update to the mobile terminal, synchronized update Rear AR virtual objects and/or updated AR virtual items are to the mobile terminal.
19. device according to claim 18, wherein, the mobile terminal includes multiple；
First update module passes through the virtual roads of the AR for receiving at least one mobile terminal in multiple mobile terminals Has at least one operation carried out to the AR virtual objects, it is virtual to update the corresponding AR according at least one of described operation The operable data of object；
The synchronization module, while for the operable data after synchronized update to the multiple mobile terminal, it is synchronous more AR virtual objects and/or updated AR virtual items after new are to the multiple mobile terminal.
20. device according to claim 14, wherein, first sending module, if being additionally operable to the described image returned Data image data corresponding with the AR business location information mismatches, then will figure corresponding with the AR business location information Picture data sending prompts the mobile terminal to carry out Image Acquisition according to the described image data of transmission to the mobile terminal.
21. device according to claim 14, wherein, first sending module is additionally operable to if it is determined that local do not store There are the AR business location informations to match with the geographical location information, then lookup and institute from the AR business location informations of storage State the immediate AR business location information of geographical location information；Include the immediate AR business to mobile terminal transmission The prompt message of location information.
22. a kind of augmented reality AR business processing devices, including：
The geographical location information for obtaining the geographical location information of mobile terminal, is sent to service by the first acquisition module Device；
3rd receiving module refers to for receiving the Image Acquisition that the server is sent after the geographical location information is confirmed Order；
Second sending module, for gathering image data according to described image acquisition instructions, by described image data sending to institute State server；
4th receiving module, for receiving the AR business datums that the server is sent after described image data are confirmed；
Display module, for carrying out AR service displays according to the AR business datums.
23. device according to claim 22, wherein, the AR business datums include：AR service feature data, the AR Service feature data include at least one of：AR virtual objects, AR virtual items, for the operable of the AR virtual objects Data.
24. device according to claim 23, wherein, described device further includes：
3rd sending module, after carrying out AR service displays according to the AR business datums in the display module, according to The operable data operates the AR virtual objects using the AR virtual items, and by the operation of the operation Information is sent to the server.
25. device according to claim 23, wherein, described device further includes：
5th receiving module, for the 3rd sending module by the operation information of the operation be sent to the server it Afterwards, receive that the server sends updates the data, wherein, it is described update the data except include updated operable data it Outside, updated AR virtual objects and/or updated AR virtual items are further included, it is described to update the data by the server root The AR virtual objects are grasped using the AR virtual items according to multiple mobile terminals including the mobile terminal The operation information generation of work；
Second update module carries out AR service displays for being updated the data according to.
26. device according to claim 25, wherein, the display module is additionally operable to show on the mobile terminal The operation information for the operation that the multiple mobile terminal carries out the AR virtual objects and, it is described operation it is corresponding The user information of mobile terminal.
27. a kind of server, including：Processor, memory, communication interface and communication bus, the processor, the memory Mutual communication is completed by the communication bus with the communication interface；
For the memory for storing an at least executable instruction, the executable instruction makes the processor perform right such as will Ask the corresponding operation of 1-8 any one of them AR method for processing business.
28. a kind of mobile terminal, including：Processor, memory, communication interface and communication bus, the processor, the storage Device and the communication interface complete mutual communication by the communication bus；
For the memory for storing an at least executable instruction, the executable instruction makes the processor perform right such as will Ask the corresponding operation of 9-13 any one of them AR method for processing business.
CN201711261596.0A 2017-12-04 2017-12-04 AR service processing method and device, server and mobile terminal Active CN108114471B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201711261596.0A CN108114471B (en) 2017-12-04 2017-12-04 AR service processing method and device, server and mobile terminal
PCT/CN2018/117486 WO2019109828A1 (en) 2017-12-04 2018-11-26 Ar service processing method, device, server, mobile terminal, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711261596.0A CN108114471B (en) 2017-12-04 2017-12-04 AR service processing method and device, server and mobile terminal

Publications (2)

Publication Number Publication Date
CN108114471A true CN108114471A (en) 2018-06-05
CN108114471B CN108114471B (en) 2020-05-22

Family

ID=62228892

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711261596.0A Active CN108114471B (en) 2017-12-04 2017-12-04 AR service processing method and device, server and mobile terminal

Country Status (2)

Country Link
CN (1) CN108114471B (en)
WO (1) WO2019109828A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108905199A (en) * 2018-07-24 2018-11-30 合肥爱玩动漫有限公司 A kind of game skill acquisition and game skill upgrade method based on AR
CN109003317A (en) * 2018-07-04 2018-12-14 百度在线网络技术（北京）有限公司 Virtual information processing method, device, equipment and storage medium
WO2019109828A1 (en) * 2017-12-04 2019-06-13 广州市动景计算机科技有限公司 Ar service processing method, device, server, mobile terminal, and storage medium
CN111953849A (en) * 2020-08-28 2020-11-17 深圳市慧鲤科技有限公司 Method and device for displaying message board, electronic equipment and storage medium
CN112422680A (en) * 2020-11-18 2021-02-26 中国联合网络通信集团有限公司 Communication method and device
CN112639682A (en) * 2018-08-24 2021-04-09 脸谱公司 Multi-device mapping and collaboration in augmented reality environments
CN113398577A (en) * 2021-05-13 2021-09-17 杭州易现先进科技有限公司 Multi-person AR interaction method and system for offline space

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102891915A (en) * 2011-07-18 2013-01-23 上海盛畅网络科技有限公司 Actual and virtual interactive entertainment system and method for mobile terminal
US20130303285A1 (en) * 2012-05-11 2013-11-14 Sony Computer Entertainment Europe Limited Apparatus and method for augmented reality
US20150231503A1 (en) * 2013-09-23 2015-08-20 Empire Technology Development Llc Location graph adapted video games
CN106582016A (en) * 2016-12-05 2017-04-26 湖南简成信息技术有限公司 Augmented reality-based motion game control method and control apparatus
CN106730814A (en) * 2016-11-22 2017-05-31 深圳维京人网络科技有限公司 Marine fishing class game based on AR and face recognition technology

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108114471B (en) * 2017-12-04 2020-05-22 广州市动景计算机科技有限公司 AR service processing method and device, server and mobile terminal

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102891915A (en) * 2011-07-18 2013-01-23 上海盛畅网络科技有限公司 Actual and virtual interactive entertainment system and method for mobile terminal
US20130303285A1 (en) * 2012-05-11 2013-11-14 Sony Computer Entertainment Europe Limited Apparatus and method for augmented reality
US20150231503A1 (en) * 2013-09-23 2015-08-20 Empire Technology Development Llc Location graph adapted video games
CN106730814A (en) * 2016-11-22 2017-05-31 深圳维京人网络科技有限公司 Marine fishing class game based on AR and face recognition technology
CN106582016A (en) * 2016-12-05 2017-04-26 湖南简成信息技术有限公司 Augmented reality-based motion game control method and control apparatus

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019109828A1 (en) * 2017-12-04 2019-06-13 广州市动景计算机科技有限公司 Ar service processing method, device, server, mobile terminal, and storage medium
CN109003317A (en) * 2018-07-04 2018-12-14 百度在线网络技术（北京）有限公司 Virtual information processing method, device, equipment and storage medium
CN108905199A (en) * 2018-07-24 2018-11-30 合肥爱玩动漫有限公司 A kind of game skill acquisition and game skill upgrade method based on AR
CN112639682A (en) * 2018-08-24 2021-04-09 脸谱公司 Multi-device mapping and collaboration in augmented reality environments
CN111953849A (en) * 2020-08-28 2020-11-17 深圳市慧鲤科技有限公司 Method and device for displaying message board, electronic equipment and storage medium
CN112422680A (en) * 2020-11-18 2021-02-26 中国联合网络通信集团有限公司 Communication method and device
CN113398577A (en) * 2021-05-13 2021-09-17 杭州易现先进科技有限公司 Multi-person AR interaction method and system for offline space
CN113398577B (en) * 2021-05-13 2024-04-09 杭州易现先进科技有限公司 Multi-person AR interaction method and system for offline space

Also Published As

Publication number Publication date
CN108114471B (en) 2020-05-22
WO2019109828A1 (en) 2019-06-13

Similar Documents

Publication Publication Date Title
CN108114471A (en) AR method for processing business, device, server and mobile terminal
CN107481190B (en) A kind of image processing method and device
CN108550190A (en) Augmented reality data processing method, device, computer equipment and storage medium
US8994752B2 (en) Image processing device, image processing method, and program
CN104750931A (en) Intelligent device control arrangement system applied to interior design
CN110537210A (en) Augmented reality display system, program and method
CN106157354B (en) A kind of three-dimensional scenic switching method and system
CN109887003A (en) A kind of method and apparatus initialized for carrying out three-dimensional tracking
CN103477365B (en) Information processor, server unit and information processing method
CN111744202A (en) Method and device for loading virtual game, storage medium and electronic device
CN108525305A (en) Image processing method, device, storage medium and electronic equipment
CN106611441B (en) The treating method and apparatus of three-dimensional map
CN110377574B (en) Picture collaborative processing method and device, storage medium and electronic device
CN108109161A (en) Video data real-time processing method and device based on adaptive threshold fuzziness
CN112085854B (en) Cloud information synchronous display system and method
CN102810109B (en) The storage method and device of augmented reality view
US20230120293A1 (en) Method and apparatus for visualization of public welfare activities
CN103002019A (en) Browser and method for sending webpage game message for browser
CN112308977A (en) Video processing method, video processing apparatus, and storage medium
CN108134945A (en) AR method for processing business, device and terminal
CN110349504A (en) A kind of museum guiding system based on AR
CN110298925A (en) A kind of augmented reality image processing method, calculates equipment and storage medium at device
CN109298776B (en) Augmented reality interaction system, method and device
WO2021093703A1 (en) Interaction method and system based on optical communication apparatus
CN108959311A (en) A kind of social activity scene configuration method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20200526

Address after: 310051 room 508, floor 5, building 4, No. 699, Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province

Patentee after: Alibaba (China) Co.,Ltd.

Address before: 510627 Guangdong city of Guangzhou province Whampoa Tianhe District Road No. 163 Xiping Yun Lu Yun Ping B radio square 14 storey tower

Patentee before: GUANGZHOU UCWEB COMPUTER TECHNOLOGY Co.,Ltd.