CN112949747A - Dish detection method, related equipment, system and storage medium - Google Patents

Dish detection method, related equipment, system and storage medium Download PDF

Info

Publication number
CN112949747A
CN112949747A CN202110314506.XA CN202110314506A CN112949747A CN 112949747 A CN112949747 A CN 112949747A CN 202110314506 A CN202110314506 A CN 202110314506A CN 112949747 A CN112949747 A CN 112949747A
Authority
CN
China
Prior art keywords
dish
detected
image
target
ordered
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110314506.XA
Other languages
Chinese (zh)
Inventor
陈小田
杨在
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Tech Best Iot Technology Co ltd
Original Assignee
Shenzhen Tech Best Iot Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Tech Best Iot Technology Co ltd filed Critical Shenzhen Tech Best Iot Technology Co ltd
Priority to CN202110314506.XA priority Critical patent/CN112949747A/en
Publication of CN112949747A publication Critical patent/CN112949747A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G06K17/0022—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device
    • G06K17/0025—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device the arrangement consisting of a wireless interrogation device in combination with a device for optically marking the record carrier
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/12—Hotels or restaurants
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Cash Registers Or Receiving Machines (AREA)

Abstract

The application discloses a dish detection method, device, system and storage medium, wherein the method comprises the following steps: acquiring a dining area image of a target dining table; detecting whether the dining area image contains dishes to be detected or not; if yes, extracting an image of the dish to be detected in the dining area image; acquiring a clicked menu corresponding to the target dining table from a restaurant server; identifying the dish image to be detected, and determining whether the dish to be detected belongs to the ordered menu; and if the dish to be detected does not belong to the ordered menu, sending prompt information to the restaurant server, wherein the prompt information is used for indicating the dish taken by the user of the target dining table.

Description

Dish detection method, related equipment, system and storage medium
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method, a related device, a system, and a storage medium for detecting dishes.
Background
The existing restaurant ordering mode is that ordering is performed manually or through a terminal, ordered dishes are provided for a user, some customers can bring dishes when the restaurant has meals, and particularly when the user eats hot pots and soup pots, some customers only buy pot bottoms and dip materials, the food materials are brought by themselves, certain troubles are caused to the restaurant, and even food safety disputes can be caused. Therefore, some restaurants have the need to decline the dishes carried by themselves, but the conditions of the dishes carried by the customers are difficult to detect, confirm and supervise.
Disclosure of Invention
In view of the above, it is necessary to provide a dish detecting method, device, system and storage medium capable of detecting whether a user carries dishes.
In a first aspect, a method for detecting dishes is provided, which is applied to a detection device, and the method includes:
acquiring a dining area image of a target dining table;
detecting whether the dining area image contains dishes to be detected or not;
if yes, extracting an image of the dish to be detected in the dining area image;
acquiring a clicked menu corresponding to the target dining table from a restaurant server;
identifying the dish image to be detected, and determining whether the dish to be detected belongs to the ordered menu;
and if the dish to be detected does not belong to the ordered menu, sending prompt information to the restaurant server, wherein the prompt information is used for indicating the dish taken by the user of the target dining table.
In one embodiment, the detection device comprises an angle-adjustable camera and an engagement unit, wherein the engagement unit is used for fixing the detection device on a hot pot body;
the obtaining of the dining area image of the target dining table comprises:
and acquiring the regional image in the hot pot corresponding to the target dining table through the angle-adjustable camera.
In one embodiment, the acquiring the dining area image of the target dining table includes:
and under the condition of receiving a detection instruction from the restaurant service side, acquiring a dining area image of the target dining table, wherein the detection instruction is triggered by the restaurant service side when receiving a menu which is ordered and corresponds to the target dining table from a client.
In one embodiment, in a case that the meal area image includes a dish to be detected, the dish detection method further includes:
sending a ordering information query request for the target dining table to the restaurant server;
receiving feedback information of the restaurant service end to the query request, wherein the feedback information indicates that the target dining table has not been ordered;
and sending the prompt message to the restaurant server.
In one embodiment, the identifying the dish image to be tested and determining whether the dish to be tested belongs to the dishes in the ordered menu includes:
acquiring a dish image in the ordered menu from a preset database;
comparing the dish image to be detected with the dish image in the ordered menu to obtain the similarity between the dish to be detected and the dish in the ordered menu;
if the similarity between the dish to be tested and the dishes in any ordered menu is not smaller than a preset similarity threshold value, determining that the dish to be tested belongs to the dishes in the ordered menu;
and if the similarity between the dish to be tested and the dishes in the ordered menus is smaller than the preset similarity threshold value, determining that the dish to be tested does not belong to the dishes in the ordered menus.
In a second aspect, there is provided a dish detection system, comprising: the system comprises a user side, a detection device and a restaurant server side;
the user side is used for generating a ordered menu of a target dining table according to ordering operation of a user and sending the ordered menu to the restaurant server side;
the restaurant service end is used for receiving the ordered menu sent by the user end and displaying the dish information and the target table identification in the ordered menu;
the detection device is used for:
acquiring a dining area image of a target dining table, detecting whether the dining area image contains dishes to be tested, if so, extracting the dish image to be tested in the dining area image, receiving an ordered menu corresponding to the target dining table from a restaurant server, identifying the dish image to be tested, and determining whether the dishes to be tested belong to the ordered menu;
and the detection device is also used for sending prompt information to the restaurant server if the dish to be detected does not belong to the ordered menu, wherein the prompt information is used for indicating the dish taken by the user of the target dining table.
Optionally, the detection device includes an angle-adjustable camera and a connection unit, and the connection unit is used for fixing the detection device on the hot pot body.
In a third aspect, a detection apparatus is provided, which includes:
the dining table comprises a first acquisition unit, a second acquisition unit and a display unit, wherein the first acquisition unit is used for acquiring a dining area image of a target dining table;
the detection unit is used for detecting whether the dining area image contains dishes to be detected or not;
the extraction unit is used for extracting the dish image to be detected in the dining area image if the dining area image contains the dish to be detected;
the second acquisition unit is used for acquiring the ordered menu corresponding to the target dining table;
the identification unit is used for identifying the dish image to be detected and determining whether the dish to be detected belongs to the ordered menu;
and the notification unit is used for sending prompt information to a restaurant server if the dish to be tested does not belong to the ordered menu, wherein the prompt information is used for indicating the dish taken by the user of the target dining table.
In a fourth aspect, an electronic device is provided, comprising a memory and a processor, the memory storing a computer program that, when executed by the processor, causes the processor to perform the steps as in the first aspect and any one of its possible implementations.
In a fifth aspect, there is provided a computer storage medium storing one or more instructions adapted to be loaded by a processor and to perform the steps of the first aspect and any possible implementation thereof.
According to the dish detection method in the embodiment of the application, the dining area image of the target dining table can be obtained; detecting whether the dining area image contains dishes to be detected or not; if yes, extracting an image of the dish to be detected in the dining area image; acquiring a clicked menu corresponding to the target dining table; identifying the dish image to be detected, and determining whether the dish to be detected belongs to the ordered menu; and if the dish to be detected does not belong to the ordered menu, sending prompt information to a restaurant server, wherein the prompt information is used for indicating the dish taken by the user of the target dining table, so that the restaurant can timely and accurately monitor the dish taken by the user and remind the user.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Wherein:
fig. 1 is a schematic flowchart of a dish detection method according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a dish detection system according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a dish detecting device according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, in one embodiment, a dish detecting method is provided, which can be applied to a detecting device. The method comprises the following steps:
101. and acquiring a dining area image of the target dining table.
The detection device in the embodiment of the present application may be an electronic device, and in a specific implementation, the electronic device may be a terminal, which may also be referred to as a terminal device.
In the embodiment of the application, the detection device can be installed in a dining area of a user of a restaurant to detect dishes. The detection device can communicate with a restaurant server, and the restaurant party can control the detection device through the restaurant server.
Above-mentioned target dining table represents the dining table that current detection device corresponds, and detection device's mounted position can be higher than the dining table surface, is convenient for gather regional image of having a dinner. The dining area image collected by the detection device can be adjusted by adjusting the position or orientation of the camera of the detection device, and the area where dishes on the table are placed is generally required to be included, which is not limited here.
Each table can be set to correspond to one detection device, and the table identification corresponds to the detection device identification, so that the corresponding relation can be stored at the restaurant service end, and the conditions of the tables can be distinguished and inquired.
In an alternative embodiment, the detecting device comprises an angle-adjustable camera and an engaging unit, wherein the engaging unit is used for fixing the detecting device on a hot pot body;
the above-mentioned regional image of having a dinner that obtains the target dining table includes:
and acquiring the regional image in the hot pot corresponding to the target dining table through the angle-adjustable camera.
The detection device can comprise an angle-adjustable camera, and the dining area images with different and more angles can be obtained by adjusting the angle. Above-mentioned linking unit can be buckle structure or adsorption structure to the installation is fixed on the chafing dish pot body, and this application embodiment does not do the restriction to detection device's concrete structure.
This detection device is applicable to the chafing dish shop, and the detection device who carries on the chafing dish pot body can gather the regional image in the chafing dish that the target dining table corresponds, carries out follow-up vegetable and detects the flow to judge whether the user takes the vegetable outward.
Optionally, the step 101 includes:
and under the condition of receiving a detection instruction from the restaurant service end, acquiring a dining area image of the target table, wherein the detection instruction is triggered by the restaurant service end when receiving a menu ordered corresponding to the target table from a client.
The client can be a terminal device of a user, such as a mobile phone, the user can order the dishes on the line by scanning a two-dimensional code and the like, the ordered menu is generated after the ordering is determined and is sent to the restaurant server to be displayed, the ordered menu sent to the restaurant server carries an identifier of a target dining table for ordering, and the restaurant prepares and serves the dishes for the user of the target dining table according to the ordered menu.
The detection device may periodically collect the dining area image, or trigger a detection instruction to the detection device when the restaurant server receives a menu ordered corresponding to the target dining table from the client, and the detection device then responds to the detection instruction to execute step 101.
102. And detecting whether the dish to be detected is contained in the dining area image.
Specifically, after the dining area image of the target dining table is acquired, the dining area image can be detected to determine whether the target dining table contains dishes to be detected. The dish to be tested may be any type of dish available in a restaurant, such as vegetables, meat, pasta, and the like, and optionally, may also be a beverage with a package, and the application is not limited thereto.
In an optional implementation manner, if the dish to be measured is a food that is put into the hot pot for the area image in the hot pot, or a dish that is photographed near the hot pot during the process of picking up and putting down a dish by the user, for example, the image collected when the user puts a dish of duck blood into the hot pot includes duck blood, and the duck blood is the dish to be measured.
The detection device can detect the dining area image according to a preset image detection algorithm so as to determine whether the dining area image contains dishes to be detected. In one embodiment, the method can be implemented by a pre-trained dish detection network model, and the dish detection network model can be obtained by training a large number of different dish sample images with labels, wherein the labels of the dish sample images can mark the dish area and the background area in the dish sample images. The trained dish detection network model can identify a dish area from the input meal area image, and can execute step 103 to extract a corresponding dish image to be detected.
If the meal area image includes dishes to be measured, step 103 may be executed. If the meal area image does not contain the dishes to be measured, step 103 may not be executed, and step 101 and step 102 may be repeatedly executed.
103. And extracting the dish image to be detected in the dining area image.
Under the condition that the meal area image contains the dish to be detected, the identified dish area, namely the dish image to be detected, can be extracted, and then the feature identification is performed, that is, step 104 can be executed.
In an optional implementation manner, in a case that the meal area image includes a dish to be measured, the method further includes:
sending a ordering information query request for the target dining table to the restaurant service end;
receiving feedback information of the query request from the restaurant service end, wherein the feedback information indicates that the target table is not ordered;
and sending prompt information to the restaurant server.
Specifically, if the dining area image includes dishes to be tested, the detection device may first send an order information query request for the target table to the restaurant server to request to query the ordered menu of the table. Specifically, the ordering information query request magnetically carries the identifier of the target table and the identifier of the detection device, the restaurant service end can query the ordering condition of the target table through the identifier of the target table, and if an ordered menu exists, the restaurant service end can feed back to the detection device, that is, the detection device can execute step 104; if the target table is not ordered and the restaurant service end does not check the ordered menu of the target table, the restaurant service end sends feedback information to the detection device to indicate that the target table is not ordered, and the detection device can send prompt information to the restaurant service end to indicate that the user of the target table takes dishes. Optionally, a prompt message may be output to prompt the user of the target table to do not take dishes.
104. And acquiring the ordered menu corresponding to the target dining table from the restaurant service end.
105. And identifying the dish image to be detected, and determining whether the dish to be detected belongs to the ordered dishes in the menu.
Specifically, after the user places an order, the detection device obtains the ordered menu corresponding to the target dining table, and then the detection device can further identify the image of the dish to be detected, determine whether the dish to be detected belongs to the dish in the ordered menu, and judge whether the user has the dish.
In an alternative embodiment, the step 105 includes:
acquiring a dish image in the ordered menu from a preset database;
comparing the dish image to be detected with the dish image in the ordered menu to obtain the similarity between the dish to be detected and the dish in the ordered menu;
if the similarity between the dish to be tested and the dishes in any ordered menu is not smaller than a preset similarity threshold value, determining that the dish to be tested belongs to the dishes in the ordered menu;
and if the similarity between the dish to be tested and the dishes in the ordered menus is smaller than the preset similarity threshold, determining that the dish to be tested does not belong to the dishes in the ordered menus.
The detection device can be stored with a preset database, the preset database comprises a plurality of dish images, different dish images can be distinguished through dish identifiers, such as dish numbers and/or dish names, under the condition that a menu is ordered, the corresponding dish image can be found according to the dish identifier in the ordered menu, then the dish image to be detected is compared with the dish image in the ordered menu, the similarity between the dish to be detected and the dish in the ordered menu is obtained, and when the number of the dish images in the ordered menu is multiple, the dish images can be compared one by one. The image comparison can be executed according to a preset image processing algorithm or a preset model, and specifically, the similarity between the dish image to be detected and the preset dish image can be judged by performing feature extraction and recognition on the dish image to be detected. In an optional implementation manner, the trained dish classification processing model may be established to identify an image of a dish to be tested, and determine whether the image of the dish is a dish in a ordered menu, which is not limited in this application.
Optionally, there may be a plurality of dishes to be tested in the same dining area image, the detection device may extract a plurality of corresponding dishes to be tested for identification when processing, and perform the same steps on each dish image to be tested, so as to determine whether the dish to be tested corresponding to each dish image to be tested belongs to the dish in the ordered menu, which is not described herein again.
The detection device may store a preset similarity threshold, which may be set as needed, for example, 70%. And if the similarity between the dish to be tested and any dish in the ordered menu (referred to as a target dish) is not smaller than the preset similarity threshold, determining that the dish to be tested is the target dish in the ordered dish. If the similarity between the dish to be tested and the dishes in each ordered menu is smaller than the preset similarity threshold, it is determined that the dish to be tested does not belong to the dishes in the ordered menus, and step 106 may be executed.
106. And if the dish to be detected does not belong to the dish in the ordered menu, sending prompt information to the restaurant server, wherein the prompt information is used for indicating the dish taken by the user of the target dining table.
Specifically, the detection device may repeatedly perform the above steps 101 to 105. If the fact that the dishes to be detected at the target dining table do not belong to the dishes in the ordered menu is identified, the prompt information can be sent to the restaurant server to indicate that the user of the target dining table carries the dishes. If it is not detected that the dish does not belong to the ordered menu, step 106 may not be executed.
Optionally, the prompt information sent to the restaurant service end may include an identifier of the target table and corresponding dishes (images) that do not belong to the ordered menu, and the record is made at the restaurant service end, so that the waiter can remind the customer not to take the dishes outside. In some possible scenes, the detection device identifies wrongly, misjudgment may occur, the user does not carry dishes, and the record of the restaurant server side can be corrected after the user confirms the dishes on site by a waiter.
According to the dish detection method in the embodiment of the application, the dining area image of the target dining table can be obtained; detecting whether the dining area image contains dishes to be detected or not; if so, extracting an image of the dish to be detected in the dining area image; acquiring a clicked menu corresponding to the target dining table; identifying the dish image to be detected, and determining whether the dish to be detected belongs to the ordered dishes in the menu; if the dish to be detected does not belong to the ordered menu, sending prompt information to a restaurant server, wherein the prompt information is used for indicating the dish taken by the user of the target dining table, and compared with the situation that whether the dish taken by the user is inspected by restaurant staff, the prompt information is beneficial to timely and accurately monitoring the dish taken by the user by the restaurant, reminding the user, and being difficult to perceive and not influencing the dining of the user; the dishes can be circulated, the dining standard can be guaranteed more effectively, and dining disputes are reduced.
Based on the description of the embodiment of the dish detecting method, the embodiment of the present application further discloses a dish detecting system, as shown in fig. 2, the dish detecting system 200 includes: a user terminal 10, a restaurant service terminal 20 and a detection device 30;
the user terminal 10 is configured to generate an ordered menu of a target table according to an ordering operation of a user, and send the ordered menu to the restaurant server 20;
the restaurant server 20 is configured to receive the ordered menu sent by the user terminal 10, and display the dish information and the target table identifier in the ordered menu;
the detection device 30 is configured to:
acquiring a dining area image of a target dining table, detecting whether a to-be-detected dish is contained in the dining area image, if so, extracting the to-be-detected dish image in the dining area image, receiving an ordered menu corresponding to the target dining table from a restaurant server, identifying the to-be-detected dish image, and determining whether the to-be-detected dish belongs to the ordered menu;
the detecting device 30 is further configured to send a prompt message to the restaurant server 20 if the dish to be detected does not belong to the dish in the ordered menu, where the prompt message is used to indicate that the user of the target table has the dish.
Optionally, the detecting device 30 includes an angle-adjustable camera 31 and an engaging unit 32, and the engaging unit 32 is used for fixing the detecting device on the chafing dish body.
The user terminal 10 may be a mobile terminal of a user, such as a mobile phone or a tablet computer, and may perform online ordering, generate an ordered menu, and send the ordered menu to the restaurant service terminal. The detecting device 30 may perform part or all of the steps of the method in the embodiment shown in fig. 1, which is not described herein again.
The embodiment of the present application further discloses a detection device, which can refer to a schematic structural diagram of the detection device shown in fig. 3, and as shown in fig. 3, the detection device 300 corresponds to the detection device 30 in the dish detection system. The detection apparatus 300 may include:
a first obtaining unit 310, configured to obtain a dining area image of a target dining table;
the detecting unit 320 is configured to detect whether the dining area image contains dishes to be detected;
an extracting unit 330, configured to extract an image of the dish to be detected in the dining area image if the dining area image includes the dish to be detected;
a second obtaining unit 340, configured to obtain a clicked menu corresponding to the target dining table;
an identifying unit 350, configured to identify the dish image to be detected, and determine whether the dish to be detected belongs to a dish in the ordered menu;
and the notifying unit 360 is configured to send prompt information to a restaurant server if the dish to be tested does not belong to the ordered dish in the menu, where the prompt information is used to indicate that the user of the target dining table has the dish.
The detection apparatus 300 may perform part or all of the steps of the method in the embodiment shown in fig. 1, which is not described herein again.
It should be noted that the dish detecting method, the related apparatus, the system and the storage medium are all included in a general inventive concept, and the contents in the embodiments of the dish detecting method, the related apparatus, the system and the storage medium are applicable to each other.
Based on the description of the method embodiment and the device embodiment, the embodiment of the application further provides an electronic device. Referring to fig. 4, the electronic device 400 includes at least a processor 401, an input device 402, an output device 403, and a computer storage medium 404. The processor 401, input device 402, output device 403, and computer storage medium 404 within the electronic device may be connected by a bus or other means.
A computer storage medium 404 may be stored in the memory of the electronic device, said computer storage medium 404 being adapted to store a computer program comprising program instructions, said processor 401 being adapted to execute said program instructions stored by said computer storage medium 404. The processor 401 (or CPU) is a computing core and a control core of the electronic device, and is adapted to implement one or more instructions, and in particular, is adapted to load and execute the one or more instructions so as to implement a corresponding method flow or a corresponding function; in one embodiment, the processor 401 described above in the embodiments of the present application may be configured to perform a series of processes, including any steps of the method in the embodiment shown in fig. 1, and the like.
An embodiment of the present application further provides a computer storage medium (Memory), which is a Memory device in an electronic device and is used to store programs and data. It is understood that the computer storage medium herein may include both a built-in storage medium in the electronic device and, of course, an extended storage medium supported by the electronic device. Computer storage media provide storage space that stores an operating system for an electronic device. Also stored in this memory space are one or more instructions, which may be one or more computer programs (including program code), suitable for loading and execution by processor 401. The computer storage medium may be a high-speed RAM memory, or may be a non-volatile memory (non-volatile memory), such as at least one disk memory; and optionally at least one computer storage medium located remotely from the processor.
In one embodiment, one or more instructions stored in a computer storage medium may be loaded and executed by processor 401 to perform the corresponding steps in the above embodiments; in particular implementations, one or more instructions in the computer storage medium may be loaded by processor 401 and executed to perform any step of the method in fig. 1, which is not described herein again.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the division of the module is only one logical division, and other divisions may be possible in actual implementation, for example, a plurality of modules or components may be combined or integrated into another system, or some features may be omitted, or not performed. The shown or discussed mutual coupling, direct coupling or communication connection may be an indirect coupling or communication connection of devices or modules through some interfaces, and may be in an electrical, mechanical or other form.
Modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical modules, may be located in one place, or may be distributed on a plurality of network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The procedures or functions according to the embodiments of the present application are wholly or partially generated when the computer program instructions are loaded and executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on or transmitted over a computer-readable storage medium. The computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)), or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that includes one or more of the available media. The usable medium may be a read-only memory (ROM), or a Random Access Memory (RAM), or a magnetic medium, such as a floppy disk, a hard disk, a magnetic tape, a magnetic disk, or an optical medium, such as a Digital Versatile Disk (DVD), or a semiconductor medium, such as a Solid State Disk (SSD).

Claims (10)

1. A dish detection method is applied to a detection device, and comprises the following steps:
acquiring a dining area image of a target dining table;
detecting whether the dining area image contains dishes to be detected or not;
if yes, extracting an image of the dish to be detected in the dining area image;
acquiring a clicked menu corresponding to the target dining table from a restaurant server;
identifying the dish image to be detected, and determining whether the dish to be detected belongs to the ordered menu;
and if the dish to be detected does not belong to the ordered menu, sending prompt information to the restaurant server, wherein the prompt information is used for indicating the dish taken by the user of the target dining table.
2. The dish detecting method according to claim 1, wherein the detecting device comprises an angle-adjustable camera and an engaging unit, and the engaging unit is used for fixing the detecting device on a hot pot body;
the obtaining of the dining area image of the target dining table comprises:
and acquiring the regional image in the hot pot corresponding to the target dining table through the angle-adjustable camera.
3. The dish detection method of claim 1, wherein the obtaining of the image of the dining area of the target table comprises:
and under the condition of receiving a detection instruction from the restaurant service side, acquiring a dining area image of the target dining table, wherein the detection instruction is triggered by the restaurant service side when receiving a menu which is ordered and corresponds to the target dining table from a client.
4. The dish detection method according to claim 1 or 2, wherein in a case where the dish to be detected is included in the meal area image, the dish detection method further comprises:
sending a ordering information query request for the target dining table to the restaurant server;
receiving feedback information of the restaurant service end to the query request, wherein the feedback information indicates that the target dining table has not been ordered;
and sending the prompt message to the restaurant server.
5. The dish detection method of claim 4, wherein the identifying the dish image to be detected and determining whether the dish to be detected belongs to the dish in the ordered menu comprises:
acquiring a dish image in the ordered menu from a preset database;
comparing the dish image to be detected with the dish image in the ordered menu to obtain the similarity between the dish to be detected and the dish in the ordered menu;
if the similarity between the dish to be tested and the dishes in any ordered menu is not smaller than a preset similarity threshold value, determining that the dish to be tested belongs to the dishes in the ordered menu;
and if the similarity between the dish to be tested and the dishes in the ordered menus is smaller than the preset similarity threshold value, determining that the dish to be tested does not belong to the dishes in the ordered menus.
6. A dish detection system, comprising: the system comprises a user side, a detection device and a restaurant server side;
the user side is used for generating a ordered menu of a target dining table according to ordering operation of a user and sending the ordered menu to the restaurant server side;
the restaurant service end is used for receiving the ordered menu sent by the user end and displaying the dish information and the target table identification in the ordered menu;
the detection device is used for:
acquiring a dining area image of a target dining table, detecting whether the dining area image contains dishes to be tested, if so, extracting the dish image to be tested in the dining area image, receiving an ordered menu corresponding to the target dining table from a restaurant server, identifying the dish image to be tested, and determining whether the dishes to be tested belong to the ordered menu;
and the detection device is also used for sending prompt information to the restaurant server if the dish to be detected does not belong to the ordered menu, wherein the prompt information is used for indicating the dish taken by the user of the target dining table.
7. The dish detecting system according to claim 6, wherein the detecting device comprises an angle-adjustable camera and an engaging unit for fixing the detecting device to the body of the hot pot.
8. A detection device, comprising:
the dining table comprises a first acquisition unit, a second acquisition unit and a display unit, wherein the first acquisition unit is used for acquiring a dining area image of a target dining table;
the detection unit is used for detecting whether the dining area image contains dishes to be detected or not;
the extraction unit is used for extracting the dish image to be detected in the dining area image if the dining area image contains the dish to be detected;
the second acquisition unit is used for acquiring the ordered menu corresponding to the target dining table;
the identification unit is used for identifying the dish image to be detected and determining whether the dish to be detected belongs to the ordered menu;
and the notification unit is used for sending prompt information to a restaurant server if the dish to be tested does not belong to the ordered menu, wherein the prompt information is used for indicating the dish taken by the user of the target dining table.
9. An electronic device comprising a memory and a processor, wherein the memory stores a computer program that, when executed by the processor, causes the processor to perform the steps of the method of any of claims 1 to 5.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, causes the processor to carry out the steps of the method according to any one of claims 1 to 5.
CN202110314506.XA 2021-03-24 2021-03-24 Dish detection method, related equipment, system and storage medium Pending CN112949747A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110314506.XA CN112949747A (en) 2021-03-24 2021-03-24 Dish detection method, related equipment, system and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110314506.XA CN112949747A (en) 2021-03-24 2021-03-24 Dish detection method, related equipment, system and storage medium

Publications (1)

Publication Number Publication Date
CN112949747A true CN112949747A (en) 2021-06-11

Family

ID=76228151

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110314506.XA Pending CN112949747A (en) 2021-03-24 2021-03-24 Dish detection method, related equipment, system and storage medium

Country Status (1)

Country Link
CN (1) CN112949747A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114973237A (en) * 2022-06-07 2022-08-30 慧之安信息技术股份有限公司 Optical disk rate detection method based on image recognition

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110349053A (en) * 2019-06-13 2019-10-18 深圳市科拜斯物联网科技有限公司 Intelligent restaurant system and dish information methods of exhibiting

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110349053A (en) * 2019-06-13 2019-10-18 深圳市科拜斯物联网科技有限公司 Intelligent restaurant system and dish information methods of exhibiting

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114973237A (en) * 2022-06-07 2022-08-30 慧之安信息技术股份有限公司 Optical disk rate detection method based on image recognition
CN114973237B (en) * 2022-06-07 2023-01-10 慧之安信息技术股份有限公司 Optical disk rate detection method based on image recognition

Similar Documents

Publication Publication Date Title
CN108549851B (en) Method and device for identifying goods in intelligent container and intelligent container
US10441112B1 (en) Food preparation system and method using a scale that allows and stores modifications to recipes based on a measured change to one of its ingredients
CN105931005B (en) Automatic warehousing system
WO2019129248A1 (en) Intelligent refrigerator and information reminder method based on intelligent refrigerator
CA3040843A1 (en) An automatic in-store registration system
WO2019222246A1 (en) Systems and methods for automated storage and retrieval
CN107025613A (en) A kind of automatic method of ordering and terminal
CN111079478B (en) Unmanned goods shelf monitoring method and device, electronic equipment and system
CN103903360A (en) Detecting method, server and system for objects in self-service equipment
CN111191523A (en) Information display method and device, storage medium and electronic device
CN112949747A (en) Dish detection method, related equipment, system and storage medium
CN111798290A (en) Order processing method and device, storage medium and electronic device
CN111523348B (en) Information generation method and device and equipment for man-machine interaction
CN109074861B (en) Food monitoring system
US9524409B1 (en) Food storage container tag system and method
CN111783499A (en) Checkout reminding method and device
US20180285708A1 (en) Intelligent Fixture System
CN109615034B (en) Information tracing method and device for reusable catering tool
CN110533380A (en) A kind of fresh check system and its checking method
US20180181940A1 (en) Pos terminal device, information processing device, information processing system, image recognition method, and image recognition program
US20240029017A1 (en) Information processing device, information processing method, and recording medium
CN112183914B (en) Evaluation method and device for dish items
CN111680625A (en) Method and device for recycling tableware, storage medium and electronic device
US20230252407A1 (en) Systems and methods of defining and identifying product display areas on product display shelves
CN110706430A (en) Automatic calling method, device and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210611