It is a kind of to urge dish method, system, electronic equipment and storage medium automatically
Technical field
The present invention relates to image identification technical fields, more particularly to one kind to urge dish method, system, electronic equipment automatically and deposit
Storage media.
Background technique
When restaurant number of meals is more, it is possible that omitting the case where serving.Such case is met, user is not knowing
May be waited in the case where feelings most of the day, when user felt too slow really just and can have been said with waiter there are also dish not on.It is this
Situation influences the dining experience of user very much, most probably will lead to the loss of client.
Summary of the invention
For overcome the deficiencies in the prior art, dish method, energy are urged automatically one of the objects of the present invention is to provide a kind of
Realization judges automatically whether vegetable has been gone up together, can urge dish automatically when vegetable is not upper neat, urge dish in person without user, improve user
Dining experience.
The second object of the present invention be to provide it is a kind of urge dish method automatically, be able to achieve judge automatically vegetable whether on
Together, dish can be urged automatically when vegetable is not upper neat, urge dish in person without user, improve the dining experience of user.
The third object of the present invention be to provide it is a kind of urge ordering system automatically, be able to achieve judge automatically vegetable whether on
Together, dish can be urged automatically when vegetable is not upper neat, urge dish in person without user, improve the dining experience of user.
The fourth object of the present invention is to provide a kind of electronic equipment, is able to achieve and judges automatically whether vegetable has been gone up together,
Dish can be urged automatically when vegetable is not upper neat, urges dish in person without user, improve the dining experience of user.
The fifth object of the present invention is to provide a kind of computer readable storage medium, the program operation in the storage medium
When can realize and judge automatically whether vegetable has been gone up together, dish can be urged automatically when vegetable is upper neat, urge dish in person without user, improved
The dining of user is experienced.
An object of the present invention adopts the following technical scheme that realization:
It is a kind of to urge dish method automatically, comprising the following steps:
Ordering dishes menu and lower single time for current dining table is obtained, the dish time is urged according to lower single time determination;
When the dish time is urged in arrival, desktop photo is obtained, the photo is pre-processed, vegetable identification model pair is passed through
Pretreated photo is identified to obtain all titles for having gone up vegetable;
It will identify that resulting all titles for having gone up vegetable are compared with menu of ordering dishes, judge whether vegetable has been gone up together;
If it is not, then obtain the title of all not upper vegetables and generate not upper vegetable list, it will the not upper vegetable list hair
It send to background terminal and corresponding vegetable is made in time with kitchen after reminding, the upper vegetable list is labeled with dining table number;
If so, terminating to urge dish process.
Further, further comprising the steps of:
When receiving that user issued when urging dish signal, desktop photo is obtained, the photo is pre-processed, is passed through
Vegetable identification model identifies pretreated photo to obtain all titles for having gone up vegetable;
It will identify that resulting all titles for having gone up vegetable are compared with menu of ordering dishes, determined according to comparison result all
The title of not upper vegetable simultaneously generates not upper vegetable list, the upper vegetable list is sent to background terminal with kitchen after reminding and
When make corresponding vegetable, the upper vegetable list is labeled with dining table number.
Further, further comprising the steps of: to receive and do not go up vegetable list pair with described transmitted by the background terminal
The feedback information answered, and the feedback information is fed back into user, wherein the feedback information is in the not upper vegetable list
The production progress of each vegetable.
The second object of the present invention adopts the following technical scheme that realization:
It is a kind of to urge dish method automatically, comprising the following steps:
Ordering dishes menu and lower single time for current dining table is obtained, the dish time is urged according to lower single time determination;
According to prefixed time interval, timing acquisition desktop photo pre-processes the photo, identifies mould by vegetable
Type identifies pretreated photo to obtain all titles for having gone up vegetable;
The corresponding vegetable of the menu of ordering dishes is labeled as on according to the title of the vegetable identified;
When the dish time is urged in arrival, whether the vegetable inquired in menu of ordering dishes is marked as on;
If it is not, then being arranged according to the not upper vegetable list of the title of not labeled all vegetables generation and by the not upper vegetable
Table is sent to background terminal and makes corresponding vegetable in time with kitchen after reminding, and the upper vegetable list is labeled with dining table number;
If so, terminating to urge dish process.
Further, further comprising the steps of:
When receiving that user issued when urging dish signal, desktop photo is obtained, the photo is pre-processed, is passed through
Vegetable identification model identifies pretreated photo to obtain all titles for having gone up vegetable;
It will identify that resulting all titles for having gone up vegetable are compared with menu of ordering dishes, determined according to comparison result all
The title of not upper vegetable simultaneously generates not upper vegetable list, the upper vegetable list is sent to background terminal with kitchen after reminding and
When make corresponding vegetable, the upper vegetable list is labeled with dining table number.
Further, further comprising the steps of: to receive and do not go up vegetable list pair with described transmitted by the background terminal
The feedback information answered, and the feedback information is fed back into user, wherein the feedback information is in the not upper vegetable list
The production progress of each vegetable.
The third object of the present invention adopts the following technical scheme that realization:
It is a kind of to urge ordering system automatically, comprising: camera and control unit, described control unit are connect with the camera,
Described control unit can be communicated with formula order dishes system to obtain order dishes menu and lower single time;Described control unit includes place
Device and memory are managed, is stored with executable computer program in the memory, the processor can be read in the memory
Computer program urge dish method automatically as described above to realize.
It further, further include urging dish button, it is described that dish button is urged to connect with described control unit, it is described that dish button is urged to use
Dish signal is urged in issuing for user.
The fourth object of the present invention adopts the following technical scheme that realization:
A kind of electronic equipment, including processor and memory are stored with executable computer program in the memory, institute
Stating processor can be read the computer program in the memory to realize and urge dish method automatically as described above.
The fifth object of the present invention adopts the following technical scheme that realization:
A kind of computer readable storage medium, the computer-readable recording medium storage have executable computer program,
The computer program can be realized when running urges dish method automatically as described above.
Compared with prior art, the beneficial effects of the present invention are:
This method determines the vegetable on by way of image recognition, then by by the vegetable on and menu of ordering dishes
It is compared, judges whether vegetable has been gone up together, and then determine a need for carrying out urging dish;It realizes and whether to judge automatically vegetable
It is upper neat, dish can be urged automatically when vegetable is not upper neat, urges dish in person without user, improve the dining experience of user.
Detailed description of the invention
Fig. 1 is a kind of flow diagram of embodiment one for urging dish method automatically provided by the invention;
Fig. 2 is a kind of flow diagram of embodiment two for urging dish method automatically provided by the invention.
Specific embodiment
In the following, being described further in conjunction with attached drawing and specific embodiment to the present invention, it should be noted that not
Under the premise of conflicting, new implementation can be formed between various embodiments described below or between each technical characteristic in any combination
Example.
Embodiment one
Referring to Fig. 1, a kind of urge dish method automatically, comprising the following steps:
S11, ordering dishes menu and lower single time for current dining table is obtained, the dish time is urged according to lower single time determination;
S12, when the dish time is urged in arrival, obtain desktop photo, the photo is pre-processed, mould is identified by vegetable
Type identifies pretreated photo to obtain all titles for having gone up vegetable;
S13, will identify that resulting all titles for having gone up vegetable are compared with menu of ordering dishes, judge vegetable whether on
Together;
S14, if it is not, then obtain the title of all not upper vegetables and generate not upper vegetable lists, will the not upper vegetable column
Table is sent to background terminal and makes corresponding vegetable in time with kitchen after reminding, and the upper vegetable list is labeled with dining table number;
S15, if so, terminate urge dish process.
This method determines the vegetable on by way of image recognition, then by by the vegetable on and menu of ordering dishes
It is compared, judges whether vegetable has been gone up together, and then determine a need for carrying out urging dish;It realizes and whether to judge automatically vegetable
It is upper neat, dish can be urged automatically when vegetable is not upper neat, urges dish in person without user, improve the dining experience of user.
It urges the dish time to may be set to the half an hour after to place an order or one hour, of courses, the type in dining room is different, thereon
The dish time can also differ more.Therefore, urge the dish time can generally serving the time and determine according to dining room.
Vegetable identification model is constructed using convolutional neural networks, trains the vegetable by a large amount of vegetable picture
Identification model can identify vegetable and its title all on desktop from the photo of desktop.It can be by dining table
It puts different vegetables take pictures obtaining a large amount of vegetable picture, each vegetable in picture is marked out to come respectively,
Each vegetable is a classification, forms training sample, pre-processes to training sample, then using these training samples to volume
Product neural network model is trained, and saves as vegetable identification model after model convergence.By vegetable identification after training
Model can identify all vegetables in photo, to obtain having gone up vegetable inventory.
As a preferred embodiment, described obtain ordering dishes menu and lower single time for current dining table specifically:
The order placement information for receiving formula order dishes system obtains ordering dishes for current dining table according to the order placement information and menu and places an order
Time.
Many restaurants are equipped with wechat meal ordering system at present, and user can be ordered by wechat, are into ordering by barcode scanning
After system, the vegetable for wanting to eat is chosen, after clicking determining place an order, the order placement information of the dining table is sent to by meal ordering system automatically
Automatically the control unit of ordering system is urged, order placement information includes dining table number, vegetable inventory and lower single time;Control unit can basis
Order placement information obtains vegetable inventory (menu of ordering dishes) and lower single time, to urge the dish time according to lower single time determination.
In addition, for some restaurants for being not provided with wechat and ordering, user by papery menu choose the vegetable for wanting to eat it
Afterwards, waiter can be raw by the input of the vegetable inventory selected by user ordering system (being also equivalent to meal ordering system) to generate bill
The control unit of ordering system is urged automatically at that can be sent to bill after bill, bill can include dining table number, vegetable inventory and account
Single to generate time (namely lower single time), control unit can obtain vegetable inventory (menu of ordering dishes) and be placed an order according to bill
Time, to urge the dish time according to lower single time determination.
As a preferred embodiment, further comprising the steps of:
When receiving that user issued when urging dish signal, desktop photo is obtained, the photo is pre-processed, is passed through
Vegetable identification model identifies pretreated photo to obtain all titles for having gone up vegetable;
It will identify that resulting all titles for having gone up vegetable are compared with menu of ordering dishes, determined according to comparison result all
The title of not upper vegetable simultaneously generates not upper vegetable list, the upper vegetable list is sent to background terminal with kitchen after reminding and
When make corresponding vegetable, the upper vegetable list is labeled with dining table number.
Removing is urged outside the mode of dish automatically, can also be added and be urged dish manually, user can carry out urging dish by urging dish button.With
Family, which is pressed, urges dish button, and dish signal is urged in generation, this is urged dish signal to be transmitted to and urges in the control unit of ordering system automatically, control unit
It receives after urging dish signal, then the photo of control camera shooting desktop pre-processes photo, identifies mould by vegetable
Type carries out image recognition to pretreated photo, obtains the title of vegetable all on desktop, and vegetable inventory has been gone up in formation, so
Vegetable inventory will have been gone up afterwards to compare with menu of ordering dishes, has judged whether the two is consistent, if inconsistent, finds out the vegetable column on not
Vegetable list on not is sent to background terminal with kitchen after reminding and makes corresponding vegetable as early as possible by table, avoid user wait so long and
Influence the dining experience of user.
In addition, when more people have a meal at the restaurant, it will usually have more vegetable, dining table may fail to lay down, it usually needs
Empty service plate is constantly cleaned up into the above new vegetable during having a meal.Cleaning for empty service plate, first is that back and forth by waiter
The dining situation on dining table is checked in patrol, and whether dining table on have empty service plate, to be cleared up accordingly, but this mode if checking
Waiter is needed to go on patrol back and forth, when not having sky service plate, the patrol of waiter is not played a role, and is not reached and is made full use of people
The purpose of power resource;Second is that take empty service plate away when waiter serves, but this mode is there are a defect, when not had on dining table
When having vacant position, waiter needs to hold new vegetable on hand, and not vacant hand serves new vegetable to take out empty service plate, at this time
User is needed to assist.
Therefore, can also be trained to the vegetable identification model can recognize that sky service plate, realize the basis for urging dish automatically
On, determine go up vegetable inventory when, empty service plate is identified by the way, if information can be transmitted if recognizing there is empty service plate
To service terminal to inform that waiter comes to tidy up service plate, achieve the purpose that handle empty service plate in time, as much as possible guarantee dining table
The upper vacancy with for putting new vegetable.When recognizing all vegetables and having gone up neat, then can not have to retransmit tidy up empty meal
The information of disk is to service terminal, because no longer needing new vegetable, has blank panel also not influence.But, it is serviced to reduce
The information for tidying up sky service plate also can be transmitted, in this way, which waiter can constantly tidy up meal in the workload that member finally tidies up
Blank panel on table reduces and tidies up workload when end user is left.
By matching a service terminal to each waiter, and each waiter distributes and services different regions, meal
Have on the service terminal for then being sent information to when empty service plate and being responsible for servicing the employee of the dining table on table.Service terminal receives
Prompt tone can be issued after information, to remind waiter to check information, waiter goes to dining table position by the dining table number in information
It goes to clear up empty service plate.
Service terminal can be realized in a variety of manners.For example, service terminal described in the present invention may include all
Such as mobile phone, palm PC, personal digital assistant (Personal Digital Assistant, PDA), portable media player
The mobile terminals such as (Portable Media Player, PMP), wearable device.Monolithic on the market can be used in control unit
Machine, some common controllers etc., can directly be bought to relevant manufactures.
As a preferred embodiment, further comprising the steps of: receive transmitted by the background terminal with it is described
The not upper corresponding feedback information of vegetable list, and the feedback information is fed back into user, wherein the feedback information is described
The production progress of each vegetable in not upper vegetable list.In general, user is during waiting is served, if not upper for a long time
The mood of dish, user may be relatively more eager or irritated, and sometimes, user may relatively worry the time, but not know again
Whether vegetable has made, bad to decide whether to continue waiting for.At this point, the production progress of vegetable is informed into user, if
Just in the production process, then the psychology of user can obtain some effects pacified, if not making yet, user is at this time
It then may choose whether also to want these vegetables.For the mode to user feedback, it can be one loudspeaker of setting on dining table, lead to
The form for crossing voice broadcasting informs user, and a display can also be arranged on dining table, shows feedback letter to user by display
Breath.
Embodiment two
Referring to Fig. 2, a kind of urge dish method automatically, comprising the following steps:
S21, ordering dishes menu and lower single time for current dining table is obtained, the dish time is urged according to lower single time determination;
S22, according to prefixed time interval, timing acquisition desktop photo pre-processes the photo, is known by vegetable
Other model identifies pretreated photo to obtain all titles for having gone up vegetable;
S23, the corresponding vegetable of the menu of ordering dishes is labeled as on according to the title of the vegetable identified;
S24, when the dish time is urged in arrival, whether the inquiry vegetable in menu of ordering dishes is marked as on;
S25, vegetable list is not gone up and is not served described if it is not, then being generated according to the title of not labeled all vegetables
Product list is sent to background terminal and makes corresponding vegetable in time with kitchen after reminding, and the upper vegetable list is labeled with dining table
Number;
S26, if so, terminate urge dish process.
This method determines the vegetable on by way of image recognition, then in menu of ordering dishes that the vegetable on is equal
On, whether when to the dish time is urged, can directly inquire has not labeled vegetable to can determine in menu of ordering dishes
Which vegetable not on, corresponding dish is made as early as possible with kitchen after reminding so that not labeled vegetable list is sent to background terminal
Product;It realizes and judges automatically whether vegetable has been gone up together, dish can be urged automatically when vegetable is not upper neat, dish is urged in person without user, mention
The dining of high user is experienced.
As a preferred embodiment, described obtain ordering dishes menu and lower single time for current dining table specifically:
The order placement information for receiving formula order dishes system obtains ordering dishes for current dining table according to the order placement information and menu and places an order
Time.
Many restaurants are equipped with wechat meal ordering system at present, and user can be ordered by wechat, are into ordering by barcode scanning
After system, the vegetable for wanting to eat is chosen, after clicking determining place an order, the order placement information of the dining table is sent to by meal ordering system automatically
Automatically the control unit of ordering system is urged, order placement information includes dining table number, vegetable inventory and lower single time;Control unit can basis
Order placement information obtains vegetable inventory (menu of ordering dishes) and lower single time, to urge the dish time according to lower single time determination.
In addition, for some restaurants for being not provided with wechat and ordering, user by papery menu choose the vegetable for wanting to eat it
Afterwards, waiter can be raw by the input of the vegetable inventory selected by user ordering system (being also equivalent to meal ordering system) to generate bill
The control unit of ordering system is urged automatically at that can be sent to bill after bill, bill can include dining table number, vegetable inventory and account
Single to generate time (namely lower single time), control unit can obtain vegetable inventory (menu of ordering dishes) and be placed an order according to bill
Time, to urge the dish time according to lower single time determination.
As a preferred embodiment, further comprising the steps of:
When receiving that user issued when urging dish signal, desktop photo is obtained, the photo is pre-processed, is passed through
Vegetable identification model identifies pretreated photo to obtain all titles for having gone up vegetable;
It will identify that resulting all titles for having gone up vegetable are compared with menu of ordering dishes, determined according to comparison result all
The title of not upper vegetable simultaneously generates not upper vegetable list, the upper vegetable list is sent to background terminal with kitchen after reminding and
When make corresponding vegetable, the upper vegetable list is labeled with dining table number.
Removing is urged outside the mode of dish automatically, can also be added and be urged dish manually, user can carry out urging dish by urging dish button.With
Family, which is pressed, urges dish button, and dish signal is urged in generation, this is urged dish signal to be transmitted to and urges in the control unit of ordering system automatically, control unit
It receives after urging dish signal, then the photo of control camera shooting desktop pre-processes photo, identifies mould by vegetable
Type carries out image recognition to pretreated photo, obtains the title of vegetable all on desktop, and vegetable inventory has been gone up in formation, so
Vegetable inventory will have been gone up afterwards to compare with menu of ordering dishes, has judged whether the two is consistent, if inconsistent, finds out the vegetable column on not
Vegetable list on not is sent to background terminal with kitchen after reminding and makes corresponding vegetable as early as possible by table, avoid user wait so long and
Influence the dining experience of user.
In addition, when more people have a meal at the restaurant, it will usually have more vegetable, dining table may fail to lay down, it usually needs
Empty service plate is constantly cleaned up into the above new vegetable during having a meal.Cleaning for empty service plate, first is that back and forth by waiter
The dining situation on dining table is checked in patrol, and whether dining table on have empty service plate, to be cleared up accordingly, but this mode if checking
Waiter is needed to go on patrol back and forth, when not having sky service plate, the patrol of waiter is not played a role, and is not reached and is made full use of people
The purpose of power resource;Second is that take empty service plate away when waiter serves, but this mode is there are a defect, when not had on dining table
When having vacant position, waiter needs to hold new vegetable on hand, and not vacant hand serves new vegetable to take out empty service plate, at this time
User is needed to assist.
Therefore, can also be trained to the vegetable identification model can recognize that sky service plate, realize the basis for urging dish automatically
On, determine go up vegetable inventory when, empty service plate is identified by the way, if information can be transmitted if recognizing there is empty service plate
To service terminal to inform that waiter comes to tidy up service plate, achieve the purpose that handle empty service plate in time, as much as possible guarantee dining table
The upper vacancy with for putting new vegetable.When recognizing all vegetables and having gone up neat, then can not have to retransmit tidy up empty meal
The information of disk is to service terminal, because no longer needing new vegetable, has blank panel also not influence.But, it is serviced to reduce
The information for tidying up sky service plate also can be transmitted, in this way, which waiter can constantly tidy up meal in the workload that member finally tidies up
Blank panel on table reduces and tidies up workload when end user is left.
As a preferred embodiment, further comprising the steps of: receive transmitted by the background terminal with it is described
The not upper corresponding feedback information of vegetable list, and the feedback information is fed back into user, wherein the feedback information is described
The production progress of each vegetable in not upper vegetable list.In general, user is during waiting is served, if not upper for a long time
The mood of dish, user may be relatively more eager or irritated, and sometimes, user may relatively worry the time, but not know again
Whether vegetable has made, bad to decide whether to continue waiting for.At this point, the production progress of vegetable is informed into user, if
Just in the production process, then the psychology of user can obtain some effects pacified, if not making yet, user is at this time
It then may choose whether also to want these vegetables.For the mode to user feedback, it can be one loudspeaker of setting on dining table, lead to
The form for crossing voice broadcasting informs user, and a display can also be arranged on dining table, shows feedback letter to user by display
Breath.
Ordering system is urged automatically the present invention also provides a kind of, comprising: camera and control unit, described control unit and institute
Camera connection is stated, described control unit can be communicated with formula order dishes system to obtain order dishes menu and lower single time;It is described
Control unit includes processor and memory, and executable computer program is stored in the memory, and the processor is readable
The computer program in the memory is taken to realize and urge dish method automatically as described above.
The system determines the vegetable on by way of image recognition, then by by the vegetable on and menu of ordering dishes
It is compared, judges whether vegetable has been gone up together, and then determine a need for carrying out urging dish;It realizes and whether to judge automatically vegetable
It is upper neat, dish can be urged automatically when vegetable is not upper neat, urges dish in person without user, improve the dining experience of user.
As a preferred embodiment, further include urging dish button, it is described that dish button is urged to connect with described control unit,
It is described that dish button is urged to urge dish signal for issuing for user.Removing is urged outside the mode of dish automatically, can also be added and be urged dish, user manually
It can carry out urging dish by urging dish button.User, which presses, urges dish button, and dish signal is urged in generation, this is urged dish signal to be transmitted to and urges automatically
In the control unit of ordering system, control unit receives urge dish signal after, control camera shooting desktop photo, then compare
Piece is pre-processed, and is carried out image recognition to pretreated photo by vegetable identification model, is obtained dish all on desktop
The title of product, formation have gone up vegetable inventory, then will go up vegetable inventory and compared with menu of ordering dishes, and judge whether the two is consistent,
If inconsistent, the vegetable list on not is found out, the vegetable list on not is sent to background terminal and is made as early as possible with kitchen after reminding
Make corresponding vegetable, the dining for avoiding user from waiting so long and influencing user is experienced.
In addition, this urges ordering system to may also include service terminal automatically, which, which is trained to, be can recognize that
Empty service plate, realize automatically urge dish on the basis of, determine go up vegetable inventory when, by the way identification sky service plate, if recognizing
With empty service plate, service terminal can be sent information to inform that waiter comes to tidy up service plate, it is empty to reach processing in time
The purpose of service plate has the vacancy for putting new vegetable as much as possible on guarantee dining table.
By matching a service terminal to each waiter, and each waiter distributes and services different regions, meal
Have on the service terminal for then being sent information to when empty service plate and being responsible for servicing the employee of the dining table on table.Service terminal receives
Prompt tone can be issued after information, to remind waiter to check information, waiter goes to dining table position by the dining table number in information
It goes to clear up empty service plate.
Service terminal can be realized in a variety of manners.For example, service terminal described in the present invention may include all
Such as mobile phone, palm PC, personal digital assistant (Personal Digital Assistant, PDA), portable media player
The mobile terminals such as (Portable Media Player, PMP), wearable device.Monolithic on the market can be used in control unit
Machine, some common controllers etc., can directly be bought to relevant manufactures.
The present invention also provides a kind of electronic equipment, including processor and memory, being stored in the memory can be held
The computer program in the memory can be read to realize and urge dish automatically as described above in row computer program, the processor
Method.
In addition, the present invention also provides a kind of computer readable storage medium, the computer-readable recording medium storage
There is executable computer program, the computer program can be realized when running urges dish method automatically as described above.
The above embodiment is only the preferred embodiment of the present invention, and the scope of protection of the present invention is not limited thereto,
The variation and replacement for any unsubstantiality that those skilled in the art is done on the basis of the present invention belong to institute of the present invention
Claimed range.