CN106022873A - Self-service dish-ordering system based on augmented reality - Google Patents
Self-service dish-ordering system based on augmented reality Download PDFInfo
- Publication number
- CN106022873A CN106022873A CN201610326870.7A CN201610326870A CN106022873A CN 106022873 A CN106022873 A CN 106022873A CN 201610326870 A CN201610326870 A CN 201610326870A CN 106022873 A CN106022873 A CN 106022873A
- Authority
- CN
- China
- Prior art keywords
- module
- user
- interface
- vegetable
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0633—Lists, e.g. purchase orders, compilation or processing
- G06Q30/0635—Processing of requisition or of purchase orders
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0641—Shopping interfaces
Abstract
The invention provides a self-service dish-ordering system based on augmented reality, and the system comprises a mobile client and a background system. The mobile client and the background system are respectively divided into a system supporting layer, a service processing layer and a user interaction layer. The mobile client provides a visual interface through carrying out the real-time superposing of virtual dish information and a real world image and displaying the superposed image to a user. The system supporting layers are mainly responsible for the recognition and tracking of an identification, and have functions of resource file management, file management, database and network communication. The service processing layers mainly achieve the functions of dish information superposed display, user logging-in, comment scoring, order management, mobile payment and dish information management according to a dish-ordering flow. The user interaction layers are interactive interfaces for software and the user, and carry out the call of interfaces, provided by the service processing layers according to the operation of the user, to make a response. The system can provide a decision-making reference for the user through employing multimedia and social information, and enables the dish-ordering process to be more convenient, quick, interesting and friendly.
Description
Technical field
The present invention relates to the use of Vuforia SDK augmented reality and realize Self-service order system, more specifically
Say this kind of system include mark identify, virtual information represent and alternately, user order, mobile payment etc., belong to
In field of human-computer interaction.
Background technology
The Vuforia SDK for building augmented reality that Qualcomm (high pass) issues, in 2015
October is purchased by U.S. parameters technology company (PTC).This SDK can open based on Unity developing instrument
Send out, its pattern recognition, identify that the technical specification such as tracking, image quality in industry maintains the leading position, for
The enforcement of the present invention provides powerful support.
Unity3D be by Uinty Technologies develop for build such as 3 D video game, build
Build the multi-platform comprehensive development of games instrument of the type interaction contents such as visualization, realtime three dimensional animation, at present
It is widely used in the exploitation of game design, virtual reality, augmented reality.
Meal ordering system majority on existing market is towards businessman, and user is then by reading simple papery dish
After single information orders food decision-making, service man helps user place an order and carry out by PDA, mobile device or PC
Order management；This experience is the most friendly, it is impossible to provide the user real-time, useful information.
In the design of existing augmented reality meal ordering system, Hohai University's computer and the Guo of Information Institute
Little one-tenth has delivered paper " design based on augmented reality electronic ordering system and realization ".This paper proposes to make
The basic effect of augmented reality is simulated with SVM classifier and coordinate system transformation, but, the application will use height
Logical Vuforia SDK realizes the function of augmented reality, and uses Unity3D to develop, in realization side
In formula different and more stable, discrimination is higher, content creation is more excellent, Consumer's Experience is more preferable.
Summary of the invention
It is an object of the invention to the shortcoming overcoming prior art with not enough, it is provided that a kind of based on augmented reality
Self-service order system.
The purpose of the present invention is achieved through the following technical solutions:
A kind of Mobile self-service meal ordering system based on augmented reality engine, this Mobile self-service meal ordering system includes moving
Dynamic client and background system, it is provided that menu identification function based on augmented reality, dish information show function
Order function and mobile payment function with user,
Described mobile client includes that the first system supporting layer, the first Business treatment and first user are mutual
Layer；Described background system includes second system supporting layer, the second Business treatment and second user's alternation of bed；
Described mobile client uses augmented reality, is obtained the image of the menu of plane media by photographic head,
Mark on menu in image is mated, and virtual information is true in real time by calculating mark place
The coordinate in the world, is superimposed upon virtual information in real world on the position identifying place so that user feels
This virtual information necessary being in real world.
Further, described the first system supporting layer includes identifying identification module, document management module, data
Storehouse, network communication module, the Business treatment for mobile client provides interface accessing, wherein, described mark
Know identification module mark in plane of scanning motion medium menu, and defeated for result with the vegetable representated by mark
Go out；Described document management module is used for processing local file resource；Described data base is used for access structure number
According to；Described network communication module carries out initiating network request, the network operation of download remote resource.
Further, described second system supporting layer includes identifying transmission module, resource on transmission module, picture
Files passe module, third party cloud storage service access module, data base, document management module, network lead to
Letter module, the Business treatment for background system provides interface accessing；Wherein, in described mark at transmission module
Reason businessman submits mark to, and interacts with VWS service, obtains identification characteristics result；Described picture
Upload resume module businessman or the picture of user's submission and return to the address of picture；Described resource file uploads mould
Block processes the resource file that businessman submits to the address returning resource file；The storage service of described third party cloud is visited
Ask that local file and data are stored on third party cloud storage platform and carry out the file on platform by module
Management；Described data base is used for access structure data；Described document management module processes local file resource；
Described network communication module carries out network request response, initiation network request, uploads or download remote resource
Network operation.
Further, described first Business treatment include dish information processing module, mobile payment module,
Ordering Module, comment grading module, user log in and subscriber information module, for the use of mobile client
Family alternation of bed provides interface accessing, and the mobile terminal with second user's alternation of bed of described background system is asked simultaneously
The module of response part interacts；Wherein, described dish information processing module supports from described the first system
The mark identification module of layer obtains dish information, obtains the related resource literary composition of vegetable to described background system
Part, carries out coordinate calculating and is superimposed upon on photographic head image；Described mobile payment module provides optional main flow
Payment platform pay to user；Described Ordering Module mainly realize shopping basket, place an order, order
Status poll and the sequence information correlation function of order history record inquiry；Described comment grading module provides and comments
The inquiry of opinion scoring, interpolation function；Described user logs in and subscriber information module is stepped on according to username and password
Recording system or fast register, can check user profile after login.
Further, described second system supporting layer includes identifying matching module, login process module, vegetable
Message processing module, Ordering Module, payment processes module, comment scoring processing module, after described
Second user's alternation of bed of platform system provides interface accessing.Wherein, described mark matching module is to identify identification
Metadata is input, carries out characteristic matching, and returns matching result；Described login process resume module
Businessman and the login of user, registration operation are, and the inquiry of user profile and amendment operation；Described vegetable is believed
Breath processing module processes the inquiry of dish information, adds, revises operation；Under described Ordering Module processes
List, acknowledgement of orders, order refusal, order inquiries operation；The movement of described payment processes resume module user
Pay request, and make requests on to respective pay channel, return evidence for payment；Described comment scoring processes mould
Block process comment inquiry, add, revise, deletion action.
Further, described first user alternation of bed provides the user interface mutual with user, including vegetable exhibition
Current bound face, mobile payment interface, order details interface, shopping basket interface, comment scoring interface, Yong Hudeng
Record and user profile interface, above-mentioned interface is user interface, the operation of response user, and calls movement
The corresponding interface of the Business treatment of client processes the operation of user.
Further, described second user's alternation of bed provides mobile terminal request response page and businessman backstage respectively
The page, wherein,
Described mobile terminal request response page includes that user's logging request processing module, mark matching request process
Module, dish information request processing module, order request processing module, payment request processing module, comment
Scoring request processing module, above-mentioned request processing module provides for described mobile client and accesses described backstage system
The interface of system, returns corresponding data according to the request of described mobile client；
Described businessman background page includes businessman's Login Register interface, the main interface of background system, dish information pipe
Reason interface, order management interface, comment scoring administration interface, payment processes interface, above-mentioned interface is businessman
Background system operation interface, it is provided that carry out corresponding service process to businessman operator, and call described backstage
The corresponding interface of second Business treatment of system processes.
Further, described mobile client is scanned by the mark identification module of described the first system supporting layer
The picture in menu in plane media or mark, processed mould by the dish information of described first Business treatment
Block
Obtain the related resource file of vegetable to described background system, carry out coordinate calculating and be superimposed upon photographic head image
On, represent interface finally by the vegetable of described first user alternation of bed and open up in real time on the basis of actual picture
Show vegetable essential information, vegetable model, vegetable multimedia descriptions and comment score information, wherein, described dish
Product multimedia descriptions includes video, 3D model, audio frequency.
Further, described vegetable represents and comprises following sub-interface in interface: vegetable image and vegetable model,
Image interface after video resource superposition, vegetable essential information interface, vegetable quantity subtract one button, vegetable number
Amount adds a button, vegetable quantity, comments on scoring interface, shopping basket exhalation button, lower button, wherein,
Described image interface, comment scoring interface, vegetable essential information interface vegetable quantity information all in accordance with currently
Identify that vegetable carries out real-time information display.
Further, described Mobile self-service meal ordering system supports that user repeatedly places an order during having dinner, and
After dining, carry out one-time payment, support that third-party platform pays simultaneously, wherein, described third party
Platform includes that wechat pays and/or Alipay.
The present invention has such advantages as relative to prior art and effect: provide friendly user interface and good
Good Consumer's Experience, increases user and orders enjoyment.It addition, mutual, bottom and service logic are separated, fall
Weak coupling, improves the stability of system, possesses good autgmentability and adaptability.
Accompanying drawing explanation
Fig. 1 is the composition schematic diagram of the Self-service order system that the present invention proposes；
Fig. 2 is the system assumption diagram of the Self-service order system that the present invention proposes；
Fig. 3 is the system assumption diagram of the mobile client of the Self-service order system that the present invention proposes；
Fig. 4 is the system assumption diagram of the background system of the Self-service order system that the present invention proposes；
Fig. 5 is that the vegetable of the mobile client of the Self-service order system that the present invention proposes represents interface sketch；
Fig. 6 is the operating process schematic diagram of the Self-service order system that the present invention proposes.
Detailed description of the invention
For making the purpose of the present invention, technical scheme and advantage clearer, clear and definite, develop simultaneously referring to the drawings
The present invention is described in more detail for embodiment.Should be appreciated that specific embodiment described herein is only used
To explain the present invention, it is not intended to limit the present invention.
Embodiment
The present invention provides a kind of user oriented Self-service order system based on augmented reality, and this system includes moving
Dynamic client (in Fig. 1 3) and background system (the 5 of Fig. 1), the mobile client of this system can be transported
Row is at the Mobile operating system platform of main flow, on Android and iOS.Whole system, including mobile visitor
Family end and background system, all will use three-layer architecture realization, as shown in Figure 2.
Wherein, mobile client (in Fig. 1 3) uses and has arrived augmented reality, and it passes through photographic head
The image of the menu (in Fig. 1 1) in acquisition plane media, uses augmented reality on menu
Mark (in Fig. 1 2) identifies and follows the trail of, and calculates the coordinate of the real world residing for identifying in real time and by dish
Product virtual information and resource are superimposed upon in image, and these information are as deposited in real world to make user feel
?.So, user just can obtain vegetable details and comment score information intuitively, orders food.Dining
After, user can select mobile payment or order of having paid in cash voluntarily, follow-up continues vegetable point
Comment.Businessman can be added or revise dish information and resource file, management order by the backstage of system, be returned
Reexamine opinion, collect money, check operation situation etc..
Mobile client in the present invention uses three-layer architecture to realize above-mentioned purpose.Three-decker is respectively
For system support layer, Business treatment and user's alternation of bed, as shown in Figure 3:
System support layer is the key component of whole mobile client, it is provided that most basic service access capability,
A layer directly interacted with Vuforia SDK, additionally, also include document management module, data base,
Network communication module, all functions on upper strata are all based on this layer.It mainly be responsible for scanning papery menu,
Identify vegetable ID (in servicing with Vuforia VWS, mark management background data base is compared), obtain dish
Product information and resource file, offer caching resource ability, offer network accessibility.The module of this layer connects
Its last layer Business treatment of confession is called.
Business treatment mainly carries out being packaged service logic of ordering, it is provided that interface is for its last layer
Family alternation of bed calls, and the simultaneously user's alternation of bed network service with background system carries out data exchange:
1) user logs in and user profile is checked: according to username and password login system or fast note
Volume, can check user profile after login.
2) dish information is shown: from the mark identification module of system support layer, obtain dish information, backward
Platform system obtains the related resource file (such as food model, video, music etc.) of vegetable, carries out coordinate meter
Calculate and be superimposed upon on photographic head image.
3) order processing: include this module mainly realize shopping basket, place an order, order status inquiries and order
The sequence information correlation functions such as historical record inquiry, after the vegetable of needs and quantity are put into shopping basket by user,
Submitting order to, this module will be verified, incoming background system realizes placing an order, and return order status for "
Submit to ".After businessman backstage confirms, order status is changed into " having confirmed that " by system.When user has paid
Bi Hou, order status is changed into " completing " by system.User can be looked into by order history record query function
Ask History Order information, comment on further, now will call comment module, order shape after comment
State changes " commenting on " into.
4) mobile payment: user may select the payment platform of main flow and pays, as Alipay, wechat are propped up
Pay.
5) user comment scoring: to completed order, the per pass vegetable in order can be carried out by user
Comment, including comment and scoring, incoming backstage is completed comment by comment data.
User's alternation of bed can respond the action of user, specifically includes user and logs in and user profile interface, dish
Product represent interface (such as Fig. 4), order details interface, shopping basket interface, mobile payment interface, comment scoring
Interface.User's alternation of bed is by calling the correlation module of Business treatment, thus responds user operation.
Background system in the present invention is divided into three layers: system support layer, Business Logic, user's alternation of bed,
As shown in Figure 5.
System support layer is the most basic a layer of background system, it provides most basic service access capability,
As identify upload process, picture upload process, resource file upload process, third party cloud storage service access,
Document management module, data base, network service etc..Wherein mark upload process module accepts in businessman
The mark passed, this mark is uploaded to Vuforia cloud service, and Vuforia cloud service is returned by this module
Mark ID, XML and DAT file storage is in data base and file system.Resource file upload process mould
The resource files such as the model relevant with vegetable that user is uploaded by block, video, music are stored in server and
In the service of tripartite's cloud storage.Third party cloud storage service access module provides access third party cloud storage service
The ability of (such as seven Ns, LeanCloud etc.), thus realize shunting user's request, effectively alleviate
Server load, improves server responding ability.Module in this layer provides interface to be its last layer business
Process layer calls.
Business of ordering mainly is provided and supports by Business treatment:
1) mark matching treatment: process and identify identification and matching from mobile client, it is provided that two kinds of match party
Formula: one is practical VWS service；Two be by corresponding for the respective identification XML returned from Vuforia service and
DAT file returns to mobile client and is identified coupling.
2) user and businessman log in, register: provide mobile terminal user and the registering and logging function of businessman.
3) submit order processing to: process the order submitted to from mobile terminal, verify according to sequence information
And it being distributed to corresponding businessman, storage sequence information is to server simultaneously.
4) dish information processes: provide dish information and resource file (model, video, music for businessman
Deng) add, revise, inquire about, the function such as deletion and provide the user dish information query function.
5) businessman's order management: confirm an order for businessman's offer, inquire about order, amendment order, delete and order
The order management functions such as list.Provide the user order inquiries function.
6) comment scoring processes: the acceptable comment from user and businessman is marked, and carries out verifying and form
Process and store.Scoring inquiry can be commented on according to vegetable ID, ID, Merchant ID etc. accordingly and read
Take.
7) payment processes: process mobile payment or pay in cash.
User's alternation of bed is mainly by calling the interface that Business treatment provides, to response from mobile client
The request of end and the page request on businessman backstage.Wherein, the request to mobile client responds and includes user
Login response request responds, mark matching request responds, dish information asks response, order request responds,
Pay request response, comment scoring request response.Businessman's background page include businessman's Login Register interface, after
The main interface of platform system, dish information administration interface, order management interface, comment scoring interface, payment processes
Interface.
One, the detailed description of the invention of mobile client:
(1) realization of system support layer:
Mark identification module:
In Unity, import Vuforia SDK, Hierarchy adds ARCamera, ImageTarget
With CloudRecognition object.A C# script component, this script is added in ImageTarget
Realize the OnTrackerableStateChanged callback method of ITrackableHandler, if being identified as
Merit, then call OnTrackingFound method and dish information processing module, otherwise call
OnTrackingLost method.Add to Cloud Recognition object and realize
The C# script component of ICloudEventHandler interface, realizes corresponding recognition cycle function pair in script
Mark is identified and follows the trail of: in OnInitilized method, one Object Tracker of instantiation uses
In detection identification situation；In OnStateChanged, it is judged that whether be in identification state at present, if
It is then to call the OnTrackingLost method of ImageTarget；In OnNewSearchResult,
By the identification information recognized and background system comparison and obtain vegetable and describe information, including resource type, url
Deng.
Document management module, network communication module then utilize the WWW object of Unity carry out file storage,
Network resource request etc. operate.
(2) realization of Business treatment:
Dish information processing module: the vegetable that this module relies on by mark identification module is incoming describes information.Root
Describe information according to vegetable, determine the type of resource file, if model, then according to the scaling of model
Zoom in and out, then its positional information is converted into the coordinate system of Target, be placed on above Target, add
Add interaction scripts (EventSystem using Unity5.0 interacts case distribution) thus realize void
The superposition of plan information.
Ordering Module comprise place an order, order history inquiry, the function such as sequence information inquiry.When placing an order,
Module is by the ID of the vegetable in Token, shopping basket and the incoming backstage of quantity, and backstage generates according to these information
Order, waits that businessman confirms.Order history inquiry then obtains order list and paging information from backstage, by it
It is illustrated in a list interface.Sequence information inquiry then according to order number from backstage obtain order details
And be illustrated in interface.
Mobile payment module: this module by the SDK of payment platform (such as Alipay) with Native Plugins
Form access Unity3D, utilize the message system of Unity3D to carry out message transmission.
Scoring comment module: according to the order number completing order of user, each vegetable can be carried out one
Secondary evaluation, clicks on after submitting to, and backstage will preserve according to user profile, vegetable ID, comment content, scoring etc..
(3) realization of user's alternation of bed:
User's alternation of bed includes that user logs in and represents interface (such as Fig. 2), order with user profile interface, vegetable
Details interface, shopping basket interface, mobile payment interface, comment scoring interface.
Mainly introduce the design that vegetable represents interface (such as Fig. 2), core be a photographic head image and
The View of the overlapping display in real time of virtual information, this virtual information is generated by dish information processing module, by
The rendering engine of Unity3D carries out real-time rendering.When mark identifies that engine recognizes new result, this is empty
Plan information will be updated according to result.Vegetable represents interface and also includes vegetable essential information interface, comment
Scoring interface and bottom menu bar.Wherein, vegetable essential information interface contain the title of vegetable, price,
Taste, language description etc.；Comment scoring interface then shows the average mark of this vegetable, all comments and corresponding
Scoring, show by list；Bottom menu bar includes shopping cart exhalation button and lower button, wherein does shopping
The total amount of vegetable in car exhalation button display icon and shopping cart.
Two, the detailed description of the invention of background system:
(1) realization of system support layer
In system support layer, mark upload process module first accepts from the mark in the list of businessman's submission also
Storage is to server, then by identification transmission to Vuforia cloud service, mark ID that cloud service is returned,
XML file and DAT file store server, and to update vegetable state be " can use " state.Described mark
Knowledge can be the obvious figure of feature such as vegetable photo, businessman Logo.Third party cloud storage service access mould
Block first accepts the information that businessman uploads, and then obtains Token from cloud storage services, by Token, AppID,
Key, information are submitted in cloud storage in the lump, and after submission, cloud storage SDK can call the local readjustment realized
Function, cloud storage object ID and the URL of return are stored in server by this call back function.Resource file
Upload process module then judges whether to be stored in home server according to file type, if video, audio frequency
Deng multimedia file, then third party cloud storage service access module is used to be uploaded to third party cloud storage
On, and its URL is saved on home server, this implementation can utilize third party cloud to store
Distributed storage, is effectively improved response speed.
(2) realization of Business treatment
Mark matching treatment resume module identifies identification and matching from the augmented reality of mobile client, it is provided that two
Plant matching way: one is practical VWS service, and in this fashion, mobile client directly accesses VWS,
Mark ID of return is committed to background system, and background system will identify ID this module incoming, and this module is looked into
Ask data base, mobile client will be returned to this mark vegetable relevant information of matching of ID；Two be by
Respective identification corresponding from Vuforia cloud service return XML and DAT file return to mobile client,
Mobile terminal loads both of these documents, and starts identification and matching, after having mated, asks dish according to mark ID
Product information.
Login process module is recorded after changing according to the username and password of user and businessman in data base
Record is mated, and the match is successful then logins successfully.This module can process user and merchant registration, according to it
Role is different, distributes different rights.
To Third-party payment platform validation whether payment processes module then process the payment from user and ask and
Pay successfully, if it succeeds, order completes.If user pays in cash, then after user pays,
Businessman confirms to pay successfully, pays success message and will be pushed to user.
(3) realization of user's alternation of bed
User's alternation of bed is divided into two parts, and a part is in response to the request from mobile client, another portion
Divide the page request being in response to from businessman backstage.
Request to mobile client responds:
1) user's login response request response: the login process module calling Business treatment is verified,
The result is returned mobile client.
2) mark matching request response: call the mark matching treatment module of Business treatment, return is believed
Breath returns mobile client.
3) dish information request response: call the dish information processing module of Business treatment, according to vegetable
ID inquires about, and return information is returned mobile client.
4) order request response: if submitting order request to, then by incoming for shopping basket information order processing
Module is verified, and return information is returned mobile client.If order inquiries, then according to relevant
Querying condition calls Ordering Module and processes, and return information is returned mobile client.
5) request response is paid: call the payment processes module of Business treatment, selected by user
Payment platform processes, and payment result is returned mobile client.
6) comment scoring request response: if submitting comment scoring to, then will comment on the incoming industry of score information
Business processes layer comment scoring processing module and processes, and just result returns mobile client.If
For inquiry, then according to querying condition, score information will be commented on accordingly and return.
Businessman's background page:
1) businessman's Login Register interface: this interface requirements businessman provide corresponding information, including Merchant name,
Password, businessman Logo, contact method, address, business license etc..
2) the main interface of background system: this main interface provides the link accessing other background page, including business
Family's information interface, dish information administration interface, order management interface, comment scoring interface, payment processes circle
Face etc..
3) dish information administration interface: the interface provides the interpolation of dish information, inquire about, revise, delete
Except waiting operation.
4) order management interface: the interface provides Confirmation of Orders, inquire about, revise, the operation such as deletion.
5) comment scoring interface: the interface provides and browse, inquire about, reply the operation such as comment.
6) payment processes interface.: the interface provides the means of payment and select and pay successfully the operations such as confirmation.
Finally, being described below user operation logic: first, user opens client software, enters
Menu represents interface, the picture being directed in menu by photographic head or mark, and now interface can show corresponding vegetable
Information and comment, user may browse through information and decides whether to add shopping basket to according to the demand of oneself.When
User clicks on after having chosen vegetable and places an order, and system will submit order to, and businessman carries out acknowledgement of orders and makes vegetable.
During user has dinner, user can continue repeatedly to place an order by step before, until being no longer necessary to.
All orders of end user's one-time payment this time dining, if using mobile payment, then will pay
Completing transaction on platform, if selecting to pay in cash, then being changed into completing by order status by businessman.This be
Whole operating process, schematic diagram is as shown in Figure 6
In sum, a kind of Self-service order system based on augmented reality disclosed in the present embodiment includes mobile visitor
Family end and background system, be respectively adopted hierarchical design, is divided into system support layer, Business treatment and user
Alternation of bed, mobile client by carrying out real-time superposition by virtual dish information with real world image, and incites somebody to action
It is presented to user, it is provided that one user interface intuitively, and wherein system support layer is mainly responsible for the knowledge of mark
Not with follow the trail of, the function such as resource file management, file management, data base and network service, Business treatment
Main Basis order flow process achieve dish information superposition displaying, user log in, comment scoring, order management,
The functions such as mobile payment, dish information management, user's alternation of bed is then the interactive interface of software and user, root
The interface provided according to the operation calls Business treatment of user responds.This system can utilize multimedia and
Social information provides the user decision references, makes the process of ordering more convenient, quick, interesting, friendly.Separately
Outward, after this system has carried out hierarchical design, autgmentability and strong adaptability, follow-up carry out Function Extension.
Above-described embodiment is the present invention preferably embodiment, but embodiments of the present invention are not by above-mentioned reality
Execute the restriction of example, the change made under other any spirit without departing from the present invention and principle, modification,
Substitute, combine, simplify, all should be the substitute mode of equivalence, within being included in protection scope of the present invention.
Claims (10)
1. a Mobile self-service meal ordering system based on augmented reality engine, this Mobile self-service meal ordering system bag
Include mobile client and background system, it is provided that menu identification function based on augmented reality, dish information are shown
Function and user order function and mobile payment function, it is characterised in that
Described mobile client includes that the first system supporting layer, the first Business treatment and first user are mutual
Layer；Described background system includes second system supporting layer, the second Business treatment and second user's alternation of bed；
Described mobile client uses augmented reality, is obtained the image of the menu of plane media by photographic head,
Mark on menu in image is mated, and virtual information is true in real time by calculating mark place
The coordinate in the world, is superimposed upon virtual information in real world on the position identifying place so that user feels
This virtual information necessary being in real world.
A kind of Mobile self-service meal ordering system based on augmented reality engine the most according to claim 1,
It is characterized in that, described the first system supporting layer include identify identification module, document management module, data base,
Network communication module, the Business treatment for mobile client provides interface accessing, and wherein, described mark is known
Other module mark in plane of scanning motion medium menu, and export with the vegetable representated by mark for result；
Described document management module is used for processing local file resource；Described data base is used for access structure data；
Described network communication module carries out initiating network request, the network operation of download remote resource.
A kind of Mobile self-service meal ordering system based on augmented reality engine the most according to claim 1,
It is characterized in that, described second system supporting layer includes identifying transmission module on transmission module, picture, resource literary composition
Transmission module, third party cloud storage service access module, data base, document management module, network service on part
Module, the Business treatment for background system provides interface accessing；Wherein, described mark uploads resume module
Businessman submits mark to, and interacts with VWS service, obtains identification characteristics result；On described picture
Transmission module processes businessman or the picture of user's submission and returns to the address of picture；Transmission module on described resource file
Process the resource file that businessman submits to the address returning resource file；Described third party cloud storage service access
Local file and data are stored on third party cloud storage platform and manage the file on platform by module
Reason；Described data base is used for access structure data；Described document management module processes local file resource；
Described network communication module carries out network request response, initiation network request, uploads or download remote resource
Network operation.
A kind of Mobile self-service meal ordering system based on augmented reality engine the most according to claim 1,
It is characterized in that, described first Business treatment includes dish information processing module, mobile payment module, orders
Single processing module, comment grading module, user log in and subscriber information module, for the user of mobile client
Alternation of bed provides interface accessing, and the mobile terminal request with second user's alternation of bed of described background system simultaneously rings
Should module partly interact；Wherein, described dish information processing module is from described the first system supporting layer
Mark identification module in obtain dish information, to described background system obtain vegetable related resource file,
Carry out coordinate calculating and be superimposed upon on photographic head image；Described mobile payment module provides propping up of optional main flow
Pay platform to pay to user；Described Ordering Module mainly realize shopping basket, place an order, order status
Inquiry and the sequence information correlation function of order history record inquiry；Described comment grading module provides comment to comment
Point inquiry, add function；Described user logs in and subscriber information module logs in system according to username and password
Unite or fast register, user profile after login, can be checked.
A kind of Mobile self-service meal ordering system based on augmented reality engine the most according to claim 1,
It is characterized in that,
Described second system supporting layer includes identifying matching module, login process module, dish information process mould
Block, Ordering Module, payment processes module, comment scoring processing module, for the of described background system
Two user's alternations of bed provide interface accessing.Wherein, described mark matching module identifies metadata with mark
For input, carry out characteristic matching, and return matching result；Described login process resume module businessman and user
Login, registration operation, and the inquiry of user profile and amendment operation；Described dish information processing module
Process the inquiry of dish information, add, revise operation；The process of described Ordering Module places an order, order is true
Recognize, order refusal, order inquiries operate；The mobile payment request of described payment processes resume module user,
And make requests on to respective pay channel, return evidence for payment；Described comment scoring processing module processes comment
Inquiry, add, revise, deletion action.
A kind of Mobile self-service meal ordering system based on augmented reality engine the most according to claim 1,
It is characterized in that,
Described first user alternation of bed provides the user interface mutual with user, represents interface, shifting including vegetable
Dynamic payment interface, order details interface, shopping basket interface, comment scoring interface, user log in and user's letter
Breath interface, above-mentioned interface is user interface, the operation of response user, and calls the industry of mobile client
Business processes the operation of the corresponding interface process user of layer.
A kind of Mobile self-service meal ordering system based on augmented reality engine the most according to claim 1,
It is characterized in that,
Described second user's alternation of bed provides mobile terminal request response page and businessman's background page respectively, its
In,
Described mobile terminal request response page includes that user's logging request processing module, mark matching request process
Module, dish information request processing module, order request processing module, payment request processing module, comment
Scoring request processing module, above-mentioned request processing module provides for described mobile client and accesses described backstage system
The interface of system, returns corresponding data according to the request of described mobile client；
Described businessman background page includes businessman's Login Register interface, the main interface of background system, dish information pipe
Reason interface, order management interface, comment scoring administration interface, payment processes interface, above-mentioned interface is businessman
Background system operation interface, it is provided that carry out corresponding service process to businessman operator, and call described backstage
The corresponding interface of second Business treatment of system processes.
A kind of Mobile self-service meal ordering system based on augmented reality engine the most according to claim 1,
It is characterized in that, described mobile client scans flat by the mark identification module of described the first system supporting layer
The picture in menu on the medium of face or mark, by the dish information processing module of described first Business treatment
Obtain the related resource file of vegetable to described background system, carry out coordinate calculating and be superimposed upon photographic head image
On, represent interface finally by the vegetable of described first user alternation of bed and open up in real time on the basis of actual picture
Show vegetable essential information, vegetable model, vegetable multimedia descriptions and comment score information, wherein, described dish
Product multimedia descriptions includes video, 3D model, audio frequency.
A kind of Mobile self-service meal ordering system based on augmented reality engine the most according to claim 1,
It is characterized in that,
Described vegetable represents and comprises following sub-interface in interface: vegetable image and vegetable model, video resource are folded
Image interface after adding, vegetable essential information interface, vegetable quantity subtract one button, vegetable quantity add a button,
Vegetable quantity, comment scoring interface, shopping basket exhalation button, lower button, wherein, described image interface,
All in accordance with current, comment scoring interface, the vegetable quantity information at vegetable essential information interface identify that vegetable carries out reality
Time information show.
A kind of Mobile self-service meal ordering system based on augmented reality engine the most according to claim 1,
It is characterized in that,
Described Mobile self-service meal ordering system supports that user repeatedly places an order during having dinner, and complete in dining
After carry out one-time payment, support that third-party platform pays simultaneously, wherein, described third-party platform includes micro-
Letter pays and/or Alipay.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610326870.7A CN106022873B (en) | 2016-05-17 | 2016-05-17 | Self-service ordering system based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610326870.7A CN106022873B (en) | 2016-05-17 | 2016-05-17 | Self-service ordering system based on augmented reality |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106022873A true CN106022873A (en) | 2016-10-12 |
| CN106022873B CN106022873B (en) | 2020-01-17 |
Family
ID=57098214
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610326870.7A Active CN106022873B (en) | 2016-05-17 | 2016-05-17 | Self-service ordering system based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106022873B (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106485609A (en) * | 2016-11-07 | 2017-03-08 | 宇龙计算机通信科技(深圳)有限公司 | Point folk prescription method based on augmented reality, system and equipment |
| CN106598256A (en) * | 2016-12-23 | 2017-04-26 | 携程旅游网络技术（上海）有限公司 | AR-based APP client end and application method |
| CN106779939A (en) * | 2016-12-12 | 2017-05-31 | 合肥华耀广告传媒有限公司 | A kind of intelligent meal ordering system based on virtual reality |
| CN106910116A (en) * | 2017-02-22 | 2017-06-30 | 孟祥宝 | A kind of scene-type food and drink is made a reservation formula order dishes system and method |
| CN106934733A (en) * | 2017-02-17 | 2017-07-07 | 安徽金猫数字科技有限公司 | A kind of voice ordering system |
| CN106981000A (en) * | 2016-10-13 | 2017-07-25 | 阿里巴巴集团控股有限公司 | Interaction, method of ordering and system under many people's lines based on augmented reality |
| CN108053338A (en) * | 2017-12-07 | 2018-05-18 | 无锡雅座在线科技股份有限公司 | Method of ordering, device and system |
| CN108063936A (en) * | 2017-12-29 | 2018-05-22 | 光锐恒宇（北京）科技有限公司 | Implementation method, device and the computer readable storage medium of augmented reality AR |
| CN109191252A (en) * | 2018-08-31 | 2019-01-11 | 浙江口碑网络技术有限公司 | Vegetable recommended method and device based on augmented reality |
| CN109348132A (en) * | 2018-11-20 | 2019-02-15 | 北京小浪花科技有限公司 | Panorama shooting method and device |
| CN109448132A (en) * | 2018-10-25 | 2019-03-08 | 北京小米移动软件有限公司 | Display control method and device, electronic equipment, computer readable storage medium |
| CN109785091A (en) * | 2018-12-10 | 2019-05-21 | 大象慧云信息技术有限公司 | A kind of invoice management method and system based on AR technology |
| CN110427102A (en) * | 2019-07-09 | 2019-11-08 | 河北经贸大学 | A kind of mixed reality realization system |
| CN110825214A (en) * | 2018-08-08 | 2020-02-21 | 海南博树创造科技有限公司 | AR intelligent dish ordering system |
| CN111103978A (en) * | 2019-12-11 | 2020-05-05 | 上海纪烨物联网科技有限公司 | AI characteristic tablecloth display method and system based on dynamic scene game table |
| CN111161037A (en) * | 2019-12-31 | 2020-05-15 | 维沃移动通信有限公司 | Information processing method and electronic equipment |
| WO2020150944A1 (en) * | 2019-01-24 | 2020-07-30 | 福建联迪商用设备有限公司 | Service processing method and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080025314A1 (en) * | 2006-07-31 | 2008-01-31 | Lg Electronics Inc. | Method of processing control information in a mobile communication system |
| CN103440603A (en) * | 2013-08-30 | 2013-12-11 | 苏州跨界软件科技有限公司 | Order system based on augmented reality |
| CN104008513A (en) * | 2014-06-24 | 2014-08-27 | 河海大学常州校区 | Campus self-service food ordering system and dining position distributing method |
| CN104299175A (en) * | 2014-09-26 | 2015-01-21 | 徐东 | Mobile phone intelligent ordering system |
-
2016
- 2016-05-17 CN CN201610326870.7A patent/CN106022873B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080025314A1 (en) * | 2006-07-31 | 2008-01-31 | Lg Electronics Inc. | Method of processing control information in a mobile communication system |
| CN103440603A (en) * | 2013-08-30 | 2013-12-11 | 苏州跨界软件科技有限公司 | Order system based on augmented reality |
| CN104008513A (en) * | 2014-06-24 | 2014-08-27 | 河海大学常州校区 | Campus self-service food ordering system and dining position distributing method |
| CN104299175A (en) * | 2014-09-26 | 2015-01-21 | 徐东 | Mobile phone intelligent ordering system |
Non-Patent Citations (2)
| Title |
|---|
| 褚伟龙等: "移动增强现实框架系统", 《计算机应用》 * |
| 邵兴旦: "易用型增强现实系统开发工具的设计与应用", 《万方数据》 * |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10789475B2 (en) | 2016-10-13 | 2020-09-29 | Alibaba Group Holding Limited | Offline-service multi-user interaction based on augmented reality |
| JP2020504852A (en) * | 2016-10-13 | 2020-02-13 | アリババ・グループ・ホールディング・リミテッドＡｌｉｂａｂａ Ｇｒｏｕｐ Ｈｏｌｄｉｎｇ Ｌｉｍｉｔｅｄ | Offline service multi-user interaction based on augmented reality |
| CN106981000A (en) * | 2016-10-13 | 2017-07-25 | 阿里巴巴集团控股有限公司 | Interaction, method of ordering and system under many people's lines based on augmented reality |
| CN106981000B (en) * | 2016-10-13 | 2020-06-09 | 阿里巴巴集团控股有限公司 | Multi-person offline interaction and ordering method and system based on augmented reality |
| CN106485609A (en) * | 2016-11-07 | 2017-03-08 | 宇龙计算机通信科技(深圳)有限公司 | Point folk prescription method based on augmented reality, system and equipment |
| CN106779939A (en) * | 2016-12-12 | 2017-05-31 | 合肥华耀广告传媒有限公司 | A kind of intelligent meal ordering system based on virtual reality |
| CN106598256A (en) * | 2016-12-23 | 2017-04-26 | 携程旅游网络技术（上海）有限公司 | AR-based APP client end and application method |
| CN106934733A (en) * | 2017-02-17 | 2017-07-07 | 安徽金猫数字科技有限公司 | A kind of voice ordering system |
| CN106910116A (en) * | 2017-02-22 | 2017-06-30 | 孟祥宝 | A kind of scene-type food and drink is made a reservation formula order dishes system and method |
| CN108053338A (en) * | 2017-12-07 | 2018-05-18 | 无锡雅座在线科技股份有限公司 | Method of ordering, device and system |
| CN108063936A (en) * | 2017-12-29 | 2018-05-22 | 光锐恒宇（北京）科技有限公司 | Implementation method, device and the computer readable storage medium of augmented reality AR |
| CN110825214A (en) * | 2018-08-08 | 2020-02-21 | 海南博树创造科技有限公司 | AR intelligent dish ordering system |
| CN109191252A (en) * | 2018-08-31 | 2019-01-11 | 浙江口碑网络技术有限公司 | Vegetable recommended method and device based on augmented reality |
| CN109448132A (en) * | 2018-10-25 | 2019-03-08 | 北京小米移动软件有限公司 | Display control method and device, electronic equipment, computer readable storage medium |
| CN109348132A (en) * | 2018-11-20 | 2019-02-15 | 北京小浪花科技有限公司 | Panorama shooting method and device |
| CN109785091A (en) * | 2018-12-10 | 2019-05-21 | 大象慧云信息技术有限公司 | A kind of invoice management method and system based on AR technology |
| WO2020150944A1 (en) * | 2019-01-24 | 2020-07-30 | 福建联迪商用设备有限公司 | Service processing method and system |
| CN110427102A (en) * | 2019-07-09 | 2019-11-08 | 河北经贸大学 | A kind of mixed reality realization system |
| CN111103978A (en) * | 2019-12-11 | 2020-05-05 | 上海纪烨物联网科技有限公司 | AI characteristic tablecloth display method and system based on dynamic scene game table |
| CN111161037A (en) * | 2019-12-31 | 2020-05-15 | 维沃移动通信有限公司 | Information processing method and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106022873B (en) | 2020-01-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106022873A (en) | Self-service dish-ordering system based on augmented reality | |
| US20210279695A1 (en) | Systems and methods for item acquisition by selection of a virtual object placed in a digital environment | |
| US5895454A (en) | Integrated interface for vendor/product oriented internet websites | |
| US10481758B2 (en) | Location based augmented reality system for exchange of items based on location sensing and methods and devices related thereto | |
| KR102115104B1 (en) | Information processing network system based on issuance of integrated code, method and sensing access device | |
| US7013290B2 (en) | Personalized interactive digital catalog profiling | |
| CN111523922B (en) | Information pushing method, system, computer device and cloud server system | |
| US20130283194A1 (en) | Systems and methods for managing content using virtual cards | |
| US9804941B1 (en) | System and method for using data tags to track and manage tasks to provide object-to-object services | |
| KR101745600B1 (en) | System, method and computer readable recording medium for confirming a purchase using a user terminal | |
| CN103996132A (en) | Wedding celebration information service system based on mobile internet | |
| US9626690B2 (en) | System and method for using data tags to manage tasks and rewards in providing object-to-object services | |
| WO2007137465A1 (en) | A method and system thereof for online managing virtual wealth in network game | |
| CN103440593A (en) | Shopping method based on cloud television | |
| CN109859415B (en) | Library system and method thereof | |
| CN105704014A (en) | Method for integrating shopping and social contact, system being integrated with shopping and social contact, and shopping network assembly | |
| CN106779848A (en) | The software of terminal shop commodity distribution on a kind of ecommerce line | |
| JPH11353373A (en) | Electronic wallet device | |
| JP6592573B1 (en) | Information processing method, information display method, program, terminal, server | |
| CN104318448A (en) | Recording method and device based on two-dimension code scanning | |
| CN110264312A (en) | Method and apparatus for merchandise news push | |
| CN109978566A (en) | A kind of end based on generated code is traced to the source information acquisition system and method | |
| US20220245615A1 (en) | Mobile point-of-sale and social marketplace | |
| KR102260176B1 (en) | System for providing incentive according to advertisement result of content and method thereof | |
| CN112132663A (en) | Resource object transfer control method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |