CN112233307A - Canteen consumption supervision system based on face recognition - Google Patents
Canteen consumption supervision system based on face recognition Download PDFInfo
- Publication number
- CN112233307A CN112233307A CN202010860027.3A CN202010860027A CN112233307A CN 112233307 A CN112233307 A CN 112233307A CN 202010860027 A CN202010860027 A CN 202010860027A CN 112233307 A CN112233307 A CN 112233307A
- Authority
- CN
- China
- Prior art keywords
- module
- canteen
- user
- information
- account
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007726 management method Methods 0.000 claims abstract description 48
- 238000004891 communication Methods 0.000 claims abstract description 35
- 238000004659 sterilization and disinfection Methods 0.000 claims abstract description 29
- 235000012054 meals Nutrition 0.000 claims abstract description 28
- LFQSCWFLJHTTHZ-UHFFFAOYSA-N Ethanol Chemical compound CCO LFQSCWFLJHTTHZ-UHFFFAOYSA-N 0.000 claims abstract description 13
- 230000036760 body temperature Effects 0.000 claims abstract description 13
- 230000003993 interaction Effects 0.000 claims abstract description 13
- 238000009529 body temperature measurement Methods 0.000 claims abstract description 8
- 230000006698 induction Effects 0.000 claims abstract description 8
- 230000001815 facial effect Effects 0.000 claims description 21
- 235000013305 food Nutrition 0.000 claims description 21
- 238000012795 verification Methods 0.000 claims description 18
- 230000005540 biological transmission Effects 0.000 claims description 11
- 238000002360 preparation method Methods 0.000 claims description 9
- GOLXNESZZPUPJE-UHFFFAOYSA-N spiromesifen Chemical compound CC1=CC(C)=CC(C)=C1C(C(O1)=O)=C(OC(=O)CC(C)(C)C)C11CCCC1 GOLXNESZZPUPJE-UHFFFAOYSA-N 0.000 claims description 6
- 239000007921 spray Substances 0.000 claims description 3
- 238000000034 method Methods 0.000 abstract description 8
- 230000000249 desinfective effect Effects 0.000 abstract description 2
- 235000021186 dishes Nutrition 0.000 description 6
- 235000021158 dinner Nutrition 0.000 description 5
- 230000000739 chaotic effect Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 235000012046 side dish Nutrition 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001502 supplementing effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C11/00—Arrangements, systems or apparatus for checking, e.g. the occurrence of a condition, not provided for elsewhere
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C9/00—Individual registration on entry or exit
- G07C9/20—Individual registration on entry or exit involving the use of a pass
- G07C9/22—Individual registration on entry or exit involving the use of a pass in combination with an identity check of the pass holder
- G07C9/25—Individual registration on entry or exit involving the use of a pass in combination with an identity check of the pass holder using biometric data, e.g. fingerprints, iris scans or voice recognition
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C9/00—Individual registration on entry or exit
- G07C9/20—Individual registration on entry or exit involving the use of a pass
- G07C9/27—Individual registration on entry or exit involving the use of a pass with central registration
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
- G07G1/00—Cash registers
- G07G1/12—Cash registers electronically operated
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C11/00—Arrangements, systems or apparatus for checking, e.g. the occurrence of a condition, not provided for elsewhere
- G07C2011/04—Arrangements, systems or apparatus for checking, e.g. the occurrence of a condition, not provided for elsewhere related to queuing systems
Abstract
A canteen consumption supervision system based on face recognition comprises mobile terminals and canteen terminals, wherein the mobile terminals are used by users, the canteen terminals are arranged in a canteen, each mobile terminal comprises a camera module, an I/O (input/output) module, a mobile network module, a payment module, an NFC (near field communication) communication module and a personal data calling module, and the personal data calling module comprises personal health code information and personal face recognition data; the canteen terminal comprises a queuing generation module, a human-computer interaction module, a menu management module, a voice module, an account management module, a wireless network module, a meal delivery module, a face recognition module, an infrared temperature measurement module, a disinfection device infrared induction switch and a disinfection device control module, wherein the face recognition module, the infrared temperature measurement module, the disinfection device infrared induction switch and the disinfection device control module are arranged at an outlet and an inlet of the canteen; the two-dimensional code is arranged at the entrance of the canteen and used for information association. The method solves the problems of detecting whether a user wears a mask or not, scanning health codes for authentication, measuring body temperature, disinfecting alcohol, selecting dishes in a canteen, paying, waiting and the like.
Description
Technical Field
The invention relates to the technical field of canteen consumption management, in particular to a canteen consumption supervision system based on face recognition.
Background
The dining room is a non-profit place which is arranged in enterprises and public institutions such as institutions, schools, factories and mines and the like and is used for supplying dinners, students and the like to eat inside the dining room. The current dining room mostly adopts the window to line up and order dishes, uses the meal card to pay, uses cash to add the mode operation of money, but because the time of leaving work or leaving school is comparatively concentrated, lead to when the rush hour, the dining room people are full of troubles, all need to line up at each step of choosing dishes, paying, waiting for side dish and adding money, efficiency is very low, the average time of having dinner is longer, lead to the order confusion easily, the mutual crowded condition of personnel, and because the dining room order confusion, still lead to the problem of not settling accounts or repeated settling accounts easily. The user all lacks orderly management at the whole process of consuming in dining room, experiences and feels very poor, and the consumption supervision in dining room can not only optimize in the step of payment, but should optimize each node in whole consumption process, consequently, urgently need one kind can solve the chaotic condition of user management when the dining room consumes, improves whole consumption process, promotes the experience of having dinner and feels.
In addition, the user needs to wear a mask, scan health codes for authentication, measure the body temperature and sterilize alcohol when entering a dining room, and the whole process needs to be completed by the cooperation of workers and supervision, so that the method is very troublesome.
Disclosure of Invention
In order to solve the above technical problems, an object of the present invention is to provide a canteen consumption monitoring system based on face recognition.
The technical problem to be solved by the invention is as follows:
(1) how to solve the problem that the steps of detecting whether wearing a mask, scanning health codes, authenticating, measuring body temperature, disinfecting alcohol and the like in a canteen are very troublesome because workers are matched and supervised;
(2) the problem of poor user experience caused by chaos and crowdedness in the consuming processes of selecting, paying, waiting for dish matching, recharging and the like in a dining room is solved;
(3) how to optimize the processes of payment, recharging and the like in consumption and improve the stability and convenience of payment;
the purpose of the invention can be realized by the following technical scheme:
a canteen consumption supervision system based on face recognition comprises mobile terminals and canteen terminals, wherein the mobile terminals are used by users, the canteen terminals are arranged in a canteen, each mobile terminal comprises a camera module, an I/O (input/output) module, a mobile network module, a payment module, an NFC (near field communication) communication module and a personal data calling module, and the personal data calling module comprises personal health code information and personal face recognition data; the dining room terminal comprises a queuing generation module, a human-computer interaction module, a menu management module, a voice module, an account management module, a wireless network module, a meal delivery module, a face recognition module, an infrared temperature measurement module, a disinfection device infrared induction switch and a disinfection device control module which are arranged at the outlet and the inlet of the dining room, and an NFC communication module arranged at each dining seat; the system comprises a canteen terminal, a canteen entrance, a user, a personal data calling module and a canteen terminal, wherein the canteen entrance is provided with a two-dimensional code used for information association, the user registers the two-dimensional code used for information association through scanning, information in the personal data calling module is interconnected with the canteen terminal, and personal health code information and personal face recognition data of the consumer are acquired through the canteen terminal.
The camera module is used for collecting facial images, identification menus and identification two-dimensional codes of a user, and the I/O module comprises an input unit and a display unit and is used for browsing information and inputting information; the mobile network module is used for accessing a network to realize data transmission with the canteen terminal, the payment module is used for charging into an account, and the NFC communication module in the mobile terminal is used for realizing near field communication with the NFC communication module at the dining seat;
the man-machine interaction module is used for collecting dish names input by canteen workers and corresponding unit price, supply amount, picture information and character information; the menu management module is used for receiving the information collected by the man-machine interaction module, generating a menu according to the collected information and updating the menu in real time; the face recognition module is used for collecting face images of people entering and leaving the canteen, and comparing the face images according to standard face information uploaded by a user to realize the recognition of the entrance and exit of the user; the account management module is used for storing account data of a user and uploaded facial images, and the wireless network module is used for accessing the canteen terminal to the Internet to realize data transmission with the mobile terminal; the queue generating module is used for receiving orders transmitted by the NFC communication modules at all dining seats and generating a meal matching table, and the meal delivery module is used for receiving the meal matching table, completing meal matching according to the meal matching table, reminding service staff to deliver meals and displaying position information of users.
The canteen terminal comprises the following steps:
step one, a canteen worker inputs a canteen preset seat number, a current-day dish name and corresponding unit price, supply amount, picture information and character information through a man-machine interaction module, and then transmits acquired data to a menu management module, wherein the menu management module generates a current-day menu according to the dish name, and the menu comprises the dish name, the unit price, the surplus, a batching list and a real object picture;
secondly, the consumer and the staff register by scanning the two-dimensional code for information association, simultaneously realize the interconnection of the information in the personal data calling module and a canteen terminal, and acquire the personal health code information, the personal face recognition data and the related information of the mobile phone number of the consumer through the canteen terminal; the account management module establishes a new account and associates the face image with the account after receiving the registration information and the face image sent by the mobile terminal through the wireless network module, and stores the face images of all users as standard face information;
thirdly, when the user passes through the entrance of the canteen, a face recognition module arranged at the entrance collects a face image, then standard face information is called to be compared with the face image, if the standard face information is not successfully matched with the collected face image, the voice prompt module prompts the user to be forbidden to enter, and prompts the user to enter for re-verification after the registration is finished; meanwhile, the face recognition module recognizes whether the person who enters the device carries a mask or not, and if the voice prompt module does not carry a prompt to forbid the user to enter the device, the face recognition module prompts the user to carry the mask to enter the device for re-verification after the registration is finished; meanwhile, the mobile terminal and the canteen terminal interactively acquire a personal health code in the mobile terminal to verify the personal health, if the personal health code is green, the verification is passed, otherwise, the voice prompt module prompts the user to forbid the user to enter; meanwhile, the infrared temperature measurement module measures and verifies the body temperature of the user, the body temperature verification is passed when the body temperature of the user is a normal value, and otherwise, the verification is not passed, the voice prompt module prompts the user to be forbidden to enter; if and only if the facial information of the entrant is successfully matched with the collected facial image, the entrant has a mask, the temperature of the entrant is normal, and the health code of the entrant is green, the voice module prompts that the entrant can enter, otherwise, the voice module prompts that the entrant is forbidden to enter and prompts the user to use alcohol for disinfection;
step four, allowing the entering user to place hands below the disinfection device, sensing a signal generated to the canteen terminal by the infrared induction switch of the disinfection device, and controlling the disinfection device control module to finally control the alcohol disinfection device to spray and drip alcohol to the hands of the user to realize disinfection by the canteen terminal;
step five, if the user enters and marks the corresponding account as not placing an order, the dining room terminal records that the number of people in the dining room is increased by one to obtain the total number of people;
step six, after the user enters the dining room, the account management module sends a push message containing account balance, the number of people in the dining room and the number of allelic people to the mobile terminal of the user through the wireless network module; if the total number of people is larger than the preset seat number of the dining room, calculating a difference value T between the total number of people and the preset seat number of the dining room, and simultaneously sending out an allelic reminding message to prompt a user that T people are allelic;
step seven, the queue generation module numbers the NFC communication modules at all dining seats, the seat numbers are the same as the numbers, after the NFC communication modules at the dining seats are matched with the NFC communication modules of the mobile terminal, the corresponding account marks are changed into unpaid, orders containing dish names, weight, seat numbers and user information are respectively transmitted to the queue generation module, the menu management module and the account management module, after the account management module receives the orders, the unit price of dishes is called, the consumption amount is calculated, the consumption amount is deducted from the account balance, payment is completed, the corresponding account marks are changed into paid, after the menu management module receives the orders, the real-time menu is updated according to the dish names and the weight in the orders, meanwhile, the queue generation module obtains the time information when the orders are received, obtains the time labels, and associates the time labels with the orders to form a catering table, the food preparation table is sent to the food delivery module, the food delivery module sequentially prepares food according to the food preparation table, and after the food preparation is finished, the food delivery is carried out according to the seat number in the order;
and step eight, when the user passes through the canteen outlet, the face recognition module at the outlet collects a face image, then standard face information is called to be compared with the face image to obtain matched account information, the total number of people is reduced by one, a corresponding account mark is obtained, if the account mark is unpaid, the user is prompted to use other modes for payment, and if the account mark is unpaid or paid, the user is released.
Further, during payment, if the price of the order is smaller than the account balance, the payment is directly completed, if the price of the order is larger than the account balance, the user is prompted to recharge through the payment module, the payment is continuously completed after the recharging is successful, and if the recharging is failed, the user selects other payment modes.
Further, in the step, when the account management module sends the push message, if the account balance is less than 1 yuan, a recharge reminding message is sent, and meanwhile, the menu management module obtains the residual amount of all dishes, screens out the dish names with the residual amount greater than 0.5kg, and pushes the dish names to the mobile terminal as a real-time menu.
Further, the operation steps of the mobile terminal are as follows:
s1, a user searches for an applet through the mobile terminal or scans a two-dimensional code for information association to register an account number, a camera module is used for shooting a facial image of the user, and the facial image is uploaded to a canteen terminal through a mobile network module, so that the mobile terminal, a user account and the facial image are associated with one another;
s2, after entering the canteen, the user receives push information sent by the canteen terminal through the mobile network module, wherein the push information comprises account balance, a real-time menu, the number of people in the canteen and the number of people who are waiting for the number of people;
and S3, after finding the seat, the user checks the menu through the I/O module, determines the name and the quantity of the purchased dish, generates an order, and contacts and pairs the mobile terminal and the NFC communication module to complete order transmission and order payment and wait for meal delivery.
The invention has the beneficial effects that:
(1) face identification, whether take gauze mask verification, body temperature detection and verification, health sign verification, alcohol disinfection automatic control are all intelligent, effectively realize epidemic situation prevention and control and dining room management.
(2) The NFC communication module is used for realizing stable and quick transmission of orders and payment data, so that the condition of network congestion during peak period payment by using a mobile network can be avoided, and the payment efficiency is improved. Meanwhile, due to the characteristics of NFC, the seat number corresponding to the order can be determined, the convenience degree of data encryption and use is better than that of a wireless network, and the payment efficiency can be further improved.
(3) Through the production module of lining up, all NFC communication module in the dining room terminal are bound with the seat number, in the transmission order, transmit user's positional information, make things convenient for the meal delivery, simultaneously with the catering table of production send to the meal delivery module, can realize the digitization of lining up, the trouble of lining up at each window has been removed from, can not form the long team, cooperate other modules, the dish selection has been realized, pay, wait for the dish distribution and in supplementing with money this series of steps, the user only need can accomplish through mobile terminal on the seat, time saving and labor saving, and then the dining room is queued up the order poor, the crowded circumstances such as peak period personnel, user's experience has been promoted.
(4) Through face identification technical control personnel entering, avoid non-personnel of having dinner to get into the dining room at will, the rethread uses digital menu, realizes that multi-user orders simultaneously, shortens the time of ordering, combines to improve payment efficiency, shortens average time of having dinner, improves the receptivity in dining room, can further shorten the time of lining up, solves the chaotic problem of order of the rush hour because of lining up and leading to.
Drawings
The invention will be further described with reference to the accompanying drawings.
FIG. 1 is a system block diagram of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, the embodiment provides a canteen consumption monitoring system based on face recognition, which includes a mobile terminal and a canteen terminal, wherein the mobile terminal is configured and used by users, the canteen terminal is arranged in a canteen, the mobile terminal includes a camera module, an I/O module, a mobile network module, a payment module, an NFC communication module, and a personal data calling module, and the personal data calling module includes personal health code information and personal face recognition data; the dining room terminal comprises a queuing generation module, a human-computer interaction module, a menu management module, a voice module, an account management module, a wireless network module, a meal delivery module, a face recognition module, an infrared temperature measurement module, a disinfection device infrared induction switch and a disinfection device control module which are arranged at the outlet and the inlet of the dining room, and an NFC communication module arranged at each dining seat; the system comprises a canteen terminal, a canteen entrance, a user, a personal data calling module and a canteen terminal, wherein the canteen entrance is provided with a two-dimensional code used for information association, the user registers the two-dimensional code used for information association through scanning, information in the personal data calling module is interconnected with the canteen terminal, and personal health code information and personal face recognition data of the consumer are acquired through the canteen terminal.
The camera module is used for collecting facial images, identification menus and identification two-dimensional codes of a user, and the I/O module comprises an input unit and a display unit and is used for browsing information and inputting information; the mobile network module is used for accessing a network to realize data transmission with the canteen terminal, the payment module is used for charging into an account, and the NFC communication module in the mobile terminal is used for realizing near field communication with the NFC communication module at the dining seat;
the man-machine interaction module is used for collecting dish names input by canteen workers and corresponding unit price, supply amount, picture information and character information; the menu management module is used for receiving the information collected by the man-machine interaction module, generating a menu according to the collected information and updating the menu in real time; the face recognition module is used for collecting face images of people entering and leaving the canteen, and comparing the face images according to standard face information uploaded by a user to realize the recognition of the entrance and exit of the user; the account management module is used for storing account data of a user and uploaded facial images, and the wireless network module is used for accessing the canteen terminal to the Internet to realize data transmission with the mobile terminal; the queuing generation module is used for receiving orders transmitted by the NFC communication modules at all dining seats and generating a meal matching table, and the meal delivery module is used for receiving the meal matching table, reminding service personnel to deliver meals and displaying position information of a user after meal matching is completed according to the meal matching table;
the implementation steps of the canteen terminal are as follows:
step one, a canteen worker inputs a canteen preset seat number, a current-day dish name and corresponding unit price, supply amount, picture information and character information through a man-machine interaction module, and then transmits acquired data to a menu management module, wherein the menu management module generates a current-day menu according to the dish name, and the menu comprises the dish name, the unit price, the surplus, a batching list and a real object picture;
secondly, the consumer and the staff register by scanning the two-dimensional code for information association, simultaneously realize the interconnection of the information in the personal data calling module and a canteen terminal, and acquire the personal health code information, the personal face recognition data and the related information of the mobile phone number of the consumer through the canteen terminal; the account management module establishes a new account and associates the face image with the account after receiving the registration information and the face image sent by the mobile terminal through the wireless network module, and stores the face images of all users as standard face information;
thirdly, when the user passes through the entrance of the canteen, a face recognition module arranged at the entrance collects a face image, then standard face information is called to be compared with the face image, if the standard face information is not successfully matched with the collected face image, the voice prompt module prompts the user to be forbidden to enter, and prompts the user to enter for re-verification after the registration is finished; meanwhile, the face recognition module recognizes whether the person who enters the device carries a mask or not, and if the voice prompt module does not carry a prompt to forbid the user to enter the device, the face recognition module prompts the user to carry the mask to enter the device for re-verification after the registration is finished; meanwhile, the mobile terminal and the canteen terminal interactively acquire a personal health code in the mobile terminal to verify the personal health, if the personal health code is green, the verification is passed, otherwise, the voice prompt module prompts the user to forbid the user to enter; meanwhile, the infrared temperature measurement module measures and verifies the body temperature of the user, the body temperature verification is passed when the body temperature of the user is a normal value, and otherwise, the verification is not passed, the voice prompt module prompts the user to be forbidden to enter; if and only if the facial information of the entrant is successfully matched with the collected facial image, the entrant has a mask, the temperature of the entrant is normal, and the health code of the entrant is green, the voice module prompts that the entrant can enter, otherwise, the voice module prompts that the entrant is forbidden to enter and prompts the user to use alcohol for disinfection;
step four, allowing the entering user to place hands below the disinfection device, sensing a signal generated to the canteen terminal by the infrared induction switch of the disinfection device, and controlling the disinfection device control module to finally control the alcohol disinfection device to spray and drip alcohol to the hands of the user to realize disinfection by the canteen terminal;
step five, if the user enters and marks the corresponding account as not placing an order, the dining room terminal records that the number of people in the dining room is increased by one to obtain the total number of people;
step six, after the user enters the dining room, the account management module sends a push message containing account balance, the number of people in the dining room and the number of allelic people to the mobile terminal of the user through the wireless network module; if the total number of people is larger than the preset seat number of the dining room, calculating a difference value T between the total number of people and the preset seat number of the dining room, and simultaneously sending out an allelic reminding message to prompt a user that T people are allelic;
step seven, the queue generation module numbers the NFC communication modules at all dining seats, the seat numbers are the same as the numbers, after the NFC communication modules at the dining seats are matched with the NFC communication modules of the mobile terminal, the corresponding account marks are changed into unpaid, orders containing dish names, weight, seat numbers and user information are respectively transmitted to the queue generation module, the menu management module and the account management module, after the account management module receives the orders, the unit price of dishes is called, the consumption amount is calculated, the consumption amount is deducted from the account balance, payment is completed, the corresponding account marks are changed into paid, after the menu management module receives the orders, the real-time menu is updated according to the dish names and the weight in the orders, meanwhile, the queue generation module obtains the time information when the orders are received, obtains the time labels, and associates the time labels with the orders to form a catering table, the food preparation table is sent to the food delivery module, the food delivery module sequentially prepares food according to the food preparation table, and after the food preparation is finished, the food delivery is carried out according to the seat number in the order;
and step eight, when the user passes through the canteen outlet, the face recognition module at the outlet collects a face image, then standard face information is called to be compared with the face image to obtain matched account information, the total number of people is reduced by one, a corresponding account mark is obtained, if the account mark is unpaid, the user is prompted to use other modes for payment, and if the account mark is unpaid or paid, the user is released.
During payment, if the price of the order is less than the account balance, the payment is directly finished, the user operation is not needed, the background finishes the payment by himself, if the price of the order is more than the account balance, the user is prompted to recharge through the payment module, the payment is continuously finished after the recharging is successful, and if the recharging is failed, the user selects other payment modes, such as bank cards, cash, debt accounts and the like. The payment mode is various, can deal with emergency.
When the account management module sends the push message, if the account balance is less than 1 yuan, a recharge reminding message is sent, meanwhile, the menu management module obtains the residual amount of all dishes, screens out the dish names with the residual amount being more than 0.5kg, and pushes the dish names to the mobile terminal as a real-time menu.
The operation steps of the mobile terminal are as follows:
s1, the user registers an account number through the mobile terminal, the camera module shoots a facial image of the user, and the facial image is uploaded to the canteen terminal through the mobile network module, so that the mobile terminal, the user account and the facial image are associated with each other;
s2, after entering the canteen, the user receives push information sent by the canteen terminal through the mobile network module, wherein the push information comprises account balance, a real-time menu, the number of people in the canteen and the number of people who are waiting for the number of people;
and S3, after finding the seat, the user checks the menu through the I/O module, determines the name and the quantity of the purchased dish, generates an order, and contacts and pairs the mobile terminal and the NFC communication module to complete order transmission and order payment and wait for meal delivery.
The foregoing is merely exemplary and illustrative of the present invention and various modifications, additions and substitutions may be made by those skilled in the art to the specific embodiments described without departing from the scope of the invention as defined in the following claims.
Claims (5)
1. The utility model provides a dining room consumption supervisory systems based on face identification which characterized in that: the system comprises mobile terminals and a canteen terminal, wherein the mobile terminals are used by users, the canteen terminal is arranged in a canteen, the mobile terminals comprise a camera module, an I/O module, a mobile network module, a payment module, an NFC communication module and a personal data calling module, and the personal data calling module comprises personal health code information and personal face identification data; the dining room terminal comprises a queuing generation module, a human-computer interaction module, a menu management module, a voice module, an account management module, a wireless network module, a meal delivery module, a face recognition module, an infrared temperature measurement module, a disinfection device infrared induction switch and a disinfection device control module which are arranged at the outlet and the inlet of the dining room, and an NFC communication module arranged at each dining seat; the system comprises a canteen terminal, a canteen data calling module, a canteen entrance, a canteen terminal and a consumer personal health code information acquisition module, wherein the canteen entrance is provided with a two-dimensional code for information association;
the camera module is used for collecting facial images, identification menus and identification two-dimensional codes of a user, and the I/O module comprises an input unit and a display unit and is used for browsing information and inputting information; the mobile network module is used for accessing a network to realize data transmission with the canteen terminal, the payment module is used for charging into an account, and the NFC communication module in the mobile terminal is used for realizing near field communication with the NFC communication module at the dining seat;
the man-machine interaction module is used for collecting dish names input by canteen workers and corresponding unit price, supply amount, picture information and character information; the menu management module is used for receiving the information collected by the man-machine interaction module, generating a menu according to the collected information and updating the menu in real time; the face recognition module is used for collecting face images of people entering and leaving the canteen, and comparing the face images according to standard face information uploaded by a user to realize the recognition of the entrance and exit of the user; the account management module is used for storing account data of a user and uploaded facial images, and the wireless network module is used for accessing the canteen terminal to the Internet to realize data transmission with the mobile terminal; the queue generating module is used for receiving orders transmitted by the NFC communication modules at all dining seats and generating a meal matching table, and the meal delivery module is used for receiving the meal matching table, completing meal matching according to the meal matching table, reminding service staff to deliver meals and displaying position information of users.
2. The canteen consumption supervision system based on face recognition according to claim 1, wherein: the canteen terminal comprises the following steps:
step one, a canteen worker inputs a canteen preset seat number, a current-day dish name and corresponding unit price, supply amount, picture information and character information through a man-machine interaction module, and then transmits acquired data to a menu management module, wherein the menu management module generates a current-day menu according to the dish name, and the menu comprises the dish name, the unit price, the surplus, a batching list and a real object picture;
secondly, the consumer and the staff register by scanning the two-dimensional code for information association, simultaneously realize the interconnection of the information in the personal data calling module and a canteen terminal, and acquire the personal health code information, the personal face recognition data and the related information of the mobile phone number of the consumer through the canteen terminal; the account management module establishes a new account and associates the face image with the account after receiving the registration information and the face image sent by the mobile terminal through the wireless network module, and stores the face images of all users as standard face information;
thirdly, when the user passes through the entrance of the canteen, a face recognition module arranged at the entrance collects a face image, then standard face information is called to be compared with the face image, if the standard face information is not successfully matched with the collected face image, the voice prompt module prompts the user to be forbidden to enter, and prompts the user to enter for re-verification after the registration is finished; meanwhile, the face recognition module recognizes whether the person who enters the device carries a mask or not, and if the voice prompt module does not carry a prompt to forbid the user to enter the device, the face recognition module prompts the user to carry the mask to enter the device for re-verification after the registration is finished; meanwhile, the mobile terminal and the canteen terminal interactively acquire a personal health code in the mobile terminal to verify the personal health, if the personal health code is green, the verification is passed, otherwise, the voice prompt module prompts the user to forbid the user to enter; meanwhile, the infrared temperature measurement module measures and verifies the body temperature of the user, the body temperature verification is passed when the body temperature of the user is a normal value, and otherwise, the verification is not passed, the voice prompt module prompts the user to be forbidden to enter; if and only if the facial information of the entrant is successfully matched with the collected facial image, the entrant has a mask, the temperature of the entrant is normal, and the health code of the entrant is green, the voice module prompts that the entrant can enter, otherwise, the voice module prompts that the entrant is forbidden to enter and prompts the user to use alcohol for disinfection;
step four, allowing the entering user to place hands below the disinfection device, sensing a signal generated to the canteen terminal by the infrared induction switch of the disinfection device, and controlling the disinfection device control module to finally control the alcohol disinfection device to spray and drip alcohol to the hands of the user to realize disinfection by the canteen terminal;
step five, if the user enters and marks the corresponding account as not placing an order, the dining room terminal records that the number of people in the dining room is increased by one to obtain the total number of people;
step six, after the user enters the dining room, the account management module sends a push message containing account balance, the number of people in the dining room and the number of allelic people to the mobile terminal of the user through the wireless network module; if the total number of people is larger than the preset seat number of the dining room, calculating a difference value T between the total number of people and the preset seat number of the dining room, and simultaneously sending out an allelic reminding message to prompt a user that T people are allelic;
step seven, the queue generation module numbers the NFC communication modules at all dining seats, the seat numbers are the same as the numbers, after the NFC communication modules at the dining seats are matched with the NFC communication modules of the mobile terminal, the corresponding account marks are changed into unpaid, orders containing dish names, weight, seat numbers and user information are respectively transmitted to the queue generation module, the menu management module and the account management module, after the account management module receives the orders, the unit price of dishes is called, the consumption amount is calculated, the consumption amount is deducted from the account balance, payment is completed, the corresponding account marks are changed into paid, after the menu management module receives the orders, the real-time menu is updated according to the dish names and the weight in the orders, meanwhile, the queue generation module obtains the time information when the orders are received, obtains the time labels, and associates the time labels with the orders to form a catering table, the food preparation table is sent to the food delivery module, the food delivery module sequentially prepares food according to the food preparation table, and after the food preparation is finished, the food delivery is carried out according to the seat number in the order;
and step eight, when the user passes through the canteen outlet, the face recognition module at the outlet collects a face image, then standard face information is called to be compared with the face image to obtain matched account information, the total number of people is reduced by one, a corresponding account mark is obtained, if the account mark is unpaid, the user is prompted to use other modes for payment, and if the account mark is unpaid or paid, the user is released.
3. The canteen consumption supervision system based on face recognition according to claim 1, wherein: and during payment, if the price of the order is less than the account balance, directly completing the payment, if the price of the order is more than the account balance, prompting the user to recharge through the payment module, continuously completing the payment after successful recharging, and if the recharging fails, selecting other payment modes by the user.
4. The canteen consumption supervision system based on face recognition according to claim 1, wherein: in the step, when the account management module sends the push message, if the account balance is less than 1 yuan, a recharge reminding message is sent, meanwhile, the menu management module obtains the residual amount of all dishes, screens out the dish names with the residual amount of more than 0.5kg, and pushes the dish names as a real-time menu to the mobile terminal.
5. The canteen consumption supervision system based on face recognition according to claim 1, wherein: the operation steps of the mobile terminal are as follows:
s1, a user searches for an applet through the mobile terminal or scans a two-dimensional code for information association to register an account number, a camera module is used for shooting a facial image of the user, and the facial image is uploaded to a canteen terminal through a mobile network module, so that the mobile terminal, a user account and the facial image are associated with one another;
s2, after entering the canteen, the user receives push information sent by the canteen terminal through the mobile network module, wherein the push information comprises account balance, a real-time menu, the number of people in the canteen and the number of people who are waiting for the number of people;
and S3, after finding the seat, the user checks the menu through the I/O module, determines the name and the quantity of the purchased dish, generates an order, and contacts and pairs the mobile terminal and the NFC communication module to complete order transmission and order payment and wait for meal delivery.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010860027.3A CN112233307A (en) | 2020-08-24 | 2020-08-24 | Canteen consumption supervision system based on face recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010860027.3A CN112233307A (en) | 2020-08-24 | 2020-08-24 | Canteen consumption supervision system based on face recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112233307A true CN112233307A (en) | 2021-01-15 |
Family
ID=74117208
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010860027.3A Pending CN112233307A (en) | 2020-08-24 | 2020-08-24 | Canteen consumption supervision system based on face recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112233307A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113362519A (en) * | 2021-06-03 | 2021-09-07 | 日立楼宇技术（广州）有限公司 | Queuing data processing method, system, device and storage medium |
| CN113469044A (en) * | 2021-06-30 | 2021-10-01 | 上海歆广数据科技有限公司 | Dining recording system and method |
| CN113888788A (en) * | 2021-09-18 | 2022-01-04 | 上海电气集团数字科技有限公司 | Modular intelligent gate |
| CN114241645A (en) * | 2021-12-16 | 2022-03-25 | 中国电信集团系统集成有限责任公司 | Barrier-free traffic information verification method and device |
-
2020
- 2020-08-24 CN CN202010860027.3A patent/CN112233307A/en active Pending
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113362519A (en) * | 2021-06-03 | 2021-09-07 | 日立楼宇技术（广州）有限公司 | Queuing data processing method, system, device and storage medium |
| CN113469044A (en) * | 2021-06-30 | 2021-10-01 | 上海歆广数据科技有限公司 | Dining recording system and method |
| CN113469044B (en) * | 2021-06-30 | 2022-07-01 | 上海歆广数据科技有限公司 | Dining recording system and method |
| CN113888788A (en) * | 2021-09-18 | 2022-01-04 | 上海电气集团数字科技有限公司 | Modular intelligent gate |
| CN114241645A (en) * | 2021-12-16 | 2022-03-25 | 中国电信集团系统集成有限责任公司 | Barrier-free traffic information verification method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112233307A (en) | Canteen consumption supervision system based on face recognition | |
| CN109961378A (en) | A kind of Eatery Consumption supervisory systems based on recognition of face | |
| CN103714630B (en) | A kind of self-service receive-transmit system of medicated clothing and self-service receiving/transmission method thereof | |
| CN103455960A (en) | Doctor-seeing system based on smart phone terminal and doctor-seeing method thereof | |
| JP2010238118A (en) | Ordering system | |
| CN104915795A (en) | Hotel self-help check-in management system and hotel self-help check-in management method | |
| CN106373063A (en) | Automatic triage treatment control method based on interactive communication and system | |
| CN101515379A (en) | Double-track registration and medical consultation service system | |
| CN110675135A (en) | Multi-person common payment method, device, medium and electronic equipment | |
| CN111027953A (en) | Restaurant ordering and payment method and system | |
| US20210225499A1 (en) | Information processing device and program | |
| CN106682750A (en) | Hotel room number coding method and sales platform management system | |
| WO2015006810A1 (en) | A residential management system | |
| CN104951812A (en) | Food safety information back-tracing supervision device based on RFID | |
| CN110084930A (en) | It is a kind of based on the nurse station of HIS ward supervisory systems | |
| CN109410027A (en) | A kind of financial information processing method, intelligent terminal and medium based on feature identification | |
| KR101858363B1 (en) | Prepayment study space rental system | |
| CN110390581A (en) | The method and device of business processing, system, storage medium, electronic device | |
| CN111784438A (en) | Precious lease and receive silver ordering system charges | |
| CN113838245A (en) | Self-service ordering system for customers of unmanned restaurant and using method | |
| KR20090109451A (en) | Wireless customer calling device | |
| CN208092847U (en) | A kind of new type vending machine system | |
| KR20140128684A (en) | System and method for reservation of amusement park utilization | |
| US20210192531A1 (en) | Method for automatically associating a user of an application with an order made at a retail location | |
| CN213582413U (en) | Dining room automatic charging dining system based on face recognition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20210115 |