WO2020233585A1 - Food settlement method and device, and computer-readable storage medium - Google Patents

Food settlement method and device, and computer-readable storage medium Download PDF

Info

Publication number
WO2020233585A1
WO2020233585A1 PCT/CN2020/091204 CN2020091204W WO2020233585A1 WO 2020233585 A1 WO2020233585 A1 WO 2020233585A1 CN 2020091204 W CN2020091204 W CN 2020091204W WO 2020233585 A1 WO2020233585 A1 WO 2020233585A1
Authority
WO
WIPO (PCT)
Prior art keywords
food
weight
image
dish
price
Prior art date
Application number
PCT/CN2020/091204
Other languages
French (fr)
Chinese (zh)
Inventor
朱雁锋
霍紫健
刘威云
吴志勇
Original Assignee
深圳市恒天伟焱科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市恒天伟焱科技有限公司 filed Critical 深圳市恒天伟焱科技有限公司
Publication of WO2020233585A1 publication Critical patent/WO2020233585A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/08Payment architectures
    • G06Q20/20Point-of-sale [POS] network systems
    • G06Q20/208Input by product or record sensing, e.g. weighing or scanner processing

Definitions

  • This application relates to the technical field of food settlement, and in particular to a food settlement method, device and computer-readable storage medium.
  • the cashier needs to scan the graphic code on the food to know the price of the food, or the cashier recognizes the food to calculate the price, and the labor cost of food settlement is higher.
  • the main purpose of this application is to provide a food settlement method, device, and computer-readable storage medium, aiming to solve the problem of high labor costs in food settlement.
  • the present application provides a food settlement method
  • the food settlement method should be set as a food settlement device
  • the food settlement device includes an image acquisition module and a weight sensor
  • the food settlement method includes the following step:
  • the price of the food is determined according to the type of the food and the weight of the food, and the price is output.
  • the step of determining the price of the food according to the type of the food and the weight of the food includes:
  • the price of the food is determined according to the unit price of the food and the weight of the food.
  • the method further includes:
  • the step of determining the price of the food according to the unit price of the food and the weight of the food is performed.
  • the method further includes:
  • the price is determined according to the corrected weight and the unit price of the food.
  • the step of determining the weight of the food dish includes:
  • the weight of the food dish is determined according to the matched pre-stored image.
  • the step of determining the food dish includes:
  • identification information of the food dish in the food dish image includes at least one of the food dish number, the shape of the food dish, the color of the food dish, the pattern of the food dish, and the material of the food dish;
  • the weight of the food dish is determined according to the identification information.
  • step of outputting the price it further includes:
  • the user’s food settlement method is determined according to the user information, wherein the food settlement method includes QR code payment, bank card payment, meal card payment, facial recognition payment, eye recognition payment, fingerprint recognition payment, and WeChat payment And at least one of Alipay payment;
  • the method further includes:
  • the food is settled according to the target food settlement method and the price.
  • the present application also provides a food settlement device, the food settlement device including an image acquisition module, a weight sensor, a processor, a memory, and a food settlement program stored in the memory and running on the processor When the food settlement program is executed by the processor, each step of the food settlement method described above is realized.
  • the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a food settlement program, and when the food settlement program is executed by a processor, each of the food settlement methods described above is implemented. step.
  • the food settlement method, device and computer-readable storage medium provided in the present application.
  • the food settlement device acquires the image corresponding to the food to be purchased collected by the image collection module and the weight of the food collected by the weight sensor, and then determines the type of food according to the image, thereby The price of the food is determined according to the type of food and the weight of the food, and finally the price is output, so that the user pays for the food according to the output price; because the food settlement device can determine the price of the food through the image of the food and the weight of the food, and There is no need to manually calculate the price of food, saving the labor cost of food settlement.
  • FIG. 1 is a schematic diagram of the hardware structure of a food settlement device according to an embodiment of the application
  • FIG. 3 is a detailed flowchart of step S30 in FIG. 2;
  • FIG. 4 is a schematic flowchart of a second embodiment of the food settlement method according to the application.
  • the main solution of the embodiment of the present application is: acquiring the image corresponding to the food to be purchased collected by the image acquisition module, and acquiring the weight of the food collected by the weight sensor; determining the type of the food according to the image; The type of the food and the weight of the food determine the price of the food, and output the price.
  • the food settlement device can determine the price of the food through the image of the food and the weight of the food, there is no need to manually calculate the price of the food, which saves the labor cost of food settlement.
  • the food settlement device may be as shown in FIG. 1.
  • the food settlement device includes: an image acquisition module 101, a weight sensor 102, a processor 103, such as a CPU, a memory 104, and a communication bus 105.
  • the communication bus 105 is configured to realize connection and communication between these components.
  • the memory 104 may be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a magnetic disk memory. As shown in FIG. 1, the memory 104 as a computer storage medium may include a food settlement program; and the processor 103 may be configured to call the food settlement and delivery program stored in the memory 104 and perform the following operations:
  • the processor 103 may be configured to call a food settlement program stored in the memory 104 and perform the following operations:
  • the weight of the food dish is determined according to the matched pre-stored image.
  • the processor 103 may be configured to call a food settlement program stored in the memory 104 and perform the following operations:
  • identification information of the food dish in the food dish image includes at least one of the food dish number, the shape of the food dish, the color of the food dish, the pattern of the food dish, and the material of the food dish;
  • the weight of the food dish is determined according to the identification information.
  • the processor 103 may be configured to call a food settlement program stored in the memory 104 and perform the following operations:
  • the user’s food settlement method is determined according to the user information, wherein the food settlement method includes QR code payment, bank card payment, meal card payment, facial recognition payment, eye recognition payment, fingerprint recognition payment, and WeChat payment And at least one of Alipay payment;
  • the processor 103 may be configured to call a food settlement program stored in the memory 104 and perform the following operations:
  • the food is settled according to the target food settlement method and the price.
  • the food settlement device acquires the image corresponding to the food to be purchased collected by the image collection module and the weight of the food collected by the weight sensor, and then determines the type of food based on the image, thereby determining the type of food and the weight of the food The price of the food, and finally output the price, so that the user pays for the food according to the output price; because the food settlement device can determine the price of the food through the image of the food and the weight of the food, without manually calculating the price of the food, saving food Settled labor costs.
  • Fig. 2 is a first embodiment of the food settlement method of the application.
  • the food settlement method includes the following steps:
  • Step S10 acquiring an image corresponding to the food to be purchased collected by the image collection module, and acquiring the weight of the food collected by the weight sensor;
  • the food settlement device is also provided with a weight sensor, which is placed under the tray of the food settlement device, and the food to be purchased selected by the user can be placed on the tray, and the image acquisition module is arranged relative to the tray to facilitate the collection of food images.
  • the food settlement device can determine the type of food according to the image.
  • a corresponding food dish is used for each dish.
  • the food dish can be a ceramic bowl, a stainless steel bowl, etc., which can be loaded with meals. Different dishes can be set differently. The pattern, different patterns, and different shapes of the dishes can be set. Of course, the food dishes can also be numbered. A numbered food dish contains the corresponding dishes or rice. After the user selects the meal, the identity of the food dish can be represented The pattern, shape or number of the food is placed relative to the image collection module of the food settlement device (the food settlement device prompts the user to place food). After the food settlement device collects the image of the food, it can obtain the food dish’s image in the collected image Pattern, pattern, shape or number, so as to determine the type of food according to the pattern, pattern, shape or number of the food dish;
  • various food images are stored in the food settlement device, and the stored food images are pre-stored images.
  • the pre-stored image whose difference value matches the collected food image can be stored in each pre-stored image.
  • the pre-stored image that matches the image corresponding to the food is the target corresponding to the food.
  • the food settlement device can determine the pre-stored image that matches the image corresponding to the food in various ways.
  • the food settlement device is equipped with a similarity calculation program.
  • the food settlement device calculates the first similarity between the collected image and each pre-stored image through the similarity calculation program, and the food settlement device determines the largest first similarity If the maximum similarity is greater than the preset threshold, the pre-stored image corresponding to the maximum similarity is used as the target pre-stored image corresponding to the food.
  • the preset threshold can be any suitable value, for example, 95%.
  • Each pre-stored image has associated information, and the associated information contains the type of food in the pre-stored image. Therefore, the food settlement device can determine the type of food according to the target pre-stored image.
  • the food settlement device may be provided with multiple image acquisition modules, for example, three image acquisition modules may be provided, and each image acquisition module has a different food acquisition angle.
  • each image acquisition module simultaneously collects images of the food, and the food does not move during the collection process.
  • Each image acquisition module has a corresponding image acquisition angle.
  • the food settlement device spatially splices each image according to the image acquisition angle to construct a three-dimensional image corresponding to the food, that is, a three-dimensional image of the food.
  • the food settlement device calculates the three-dimensional image The second degree of similarity with the pre-stored image (the pre-stored image is also a three-dimensional image, that is, the dimension of the pre-stored image is the same as the dimension of the image corresponding to the food), and then determine whether the largest second similarity is greater than the preset threshold, if it is greater than If the threshold is preset, the pre-stored image corresponding to the largest second degree of similarity is used as the target pre-stored image corresponding to the food, so that the type of food is determined according to the target pre-stored image.
  • Step S30 Determine the price of the food according to the type of the food and the weight of the food, and output the price
  • the price of the food can be calculated according to the type of food and the weight of the food. Specifically, please refer to FIG. 3, that is, in step S30, the type of food and the weight of the food are determined.
  • the steps of food price include:
  • Step S31 determining the unit price of the food according to the type of the food
  • Step S32 determining the price of the food according to the unit price of the food and the weight of the food;
  • the food settlement device sets a unit price for each type of food. After the type of food is determined, the unit price of the food to be purchased can be determined according to the type of food. The food settlement device can then calculate the unit price and the weight of the food Get the price of food.
  • the food settlement device can output multiple payment methods, for example, QR code payment, bank card payment, meal card payment, face recognition payment, eye recognition payment, fingerprint recognition payment, NFC payment (near field communication payment) , WeChat payment, Alipay payment, etc., users can choose the payment method to pay for the price to complete the food settlement.
  • payment methods such as meal card payment, facial recognition payment, eye recognition payment, fingerprint recognition payment and other payment methods require users to pay Member registration.
  • the food settlement device will save the user's image, meal card number, phone number, fingerprints entered, and food balance.
  • the food settlement device can obtain the user information of the user when outputting the price of the food.
  • the food settlement device can determine the user through the image acquisition module, and then obtain the user information of the user, thereby determining the food settlement method the user can choose according to the user information .
  • Food settlement methods include the above-mentioned QR code payment, bank card payment, meal card payment, face recognition payment, eye recognition payment, fingerprint recognition payment, NFC payment (near field communication payment), WeChat payment, Alipay payment, food
  • the settlement device then outputs the user’s food settlement method. For example, if the user has activated fingerprint payment, meal card payment, and facial recognition payment, the food settlement device can output fingerprint payment, meal card payment, and facial recognition payment.
  • Payment method for the user to choose after the user performs the selection operation, that is, the food settlement device detects the operation based on the selection of the food settlement method, the target food settlement method can be determined according to the operation, and the target food settlement method can be determined according to the target food The settlement method and the price of the food are used to settle the food.
  • the food settlement device collects the user’s face to identify the user, and then deduct the purchase from the balance in the user account
  • the price of food if the target food settlement method is WeChat payment, the food settlement device will send the food price to the WeChat payment server, so that the WeChat payment server will send the payment request to the user terminal, so that the user can pay for the food based on the user terminal , Thereby completing the food payment.
  • the food settlement device when the food settlement device does not recognize the user, it can output regular food settlement methods such as WeChat payment and Alipay payment.
  • the food settlement device acquires the image corresponding to the food to be purchased collected by the image collection module and the weight of the food collected by the weight sensor, and then determines the type of food based on the image, thereby determining the type of food according to the type of food and the weight of the food.
  • the weight is used to determine the price of the food, and finally the price is output, so that the user pays for the food according to the output price; because the food settlement device can determine the price of the food through the image of the food and the weight of the food, without manually calculating the price of the food, Save the labor cost of food settlement.
  • Figure 4 is a second embodiment of the food settlement method of this application. Based on the first embodiment, after the step S31, it further includes:
  • Step S40 judging whether the food is placed in a pan according to the image
  • Step S50 when the food is not placed in the food dish, execute the step of determining the price of the food according to the unit price of the food and the weight of the food, and output the price;
  • Step S60 when the food is placed in the food dish, determine the weight of the food dish
  • Step S70 Correct the weight of the food according to the weight of the food dish to obtain the corrected weight
  • Step S80 Determine the price according to the corrected weight and the unit price of the food, and output the price.

Landscapes

  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Cash Registers Or Receiving Machines (AREA)

Abstract

The present application discloses a food settlement method, the food settlement method is applied to a food settlement device, the food settlement device comprises an image acquisition module and a weight sensor, the weight sensor is configured to acquire the weight of food, and the food settlement method comprises the following steps: acquiring an image, acquired by the image acquisition module, corresponding to food to be purchased, and acquiring the weight of the food acquired by the weight sensor; determining the type of the food according to the image; and determining the price of the food according to the type of the food and the weight of the food, and outputting the price. The present application further discloses a food settlement device and a computer-readable storage medium.

Description

食物的结算方法、装置和计算机可读存储介质Food settlement method, device and computer readable storage medium
相关申请Related application
本申请要求2019年05月21日申请的,申请号为201910428316.3,名称为“食物的结算方法、装置和计算机可读存储介质”的中国专利申请的优先权,在此将其全文引入作为参考。This application claims the priority of the Chinese patent application filed on May 21, 2019, with the application number 201910428316.3, titled "Food Settlement Method, Apparatus, and Computer-readable Storage Medium", the full text of which is incorporated herein by reference.
技术领域Technical field
本申请涉及食物结算技术领域,尤其涉及一种食物的结算方法、装置和计算机可读存储介质。This application relates to the technical field of food settlement, and in particular to a food settlement method, device and computer-readable storage medium.
背景技术Background technique
随着人们生活节奏的加快,人们动手做饭的时间越来越少,基本都是在外购买食物解决三餐问题。As the pace of people's lives accelerates, people have less and less time to cook, basically buying food out to solve the problem of three meals.
人们在购买食物后,需要收银员扫描食物上图形码得知食物价格,或者,由收银人识别食物计算价格,食物结算的人工成本较高。After people buy food, the cashier needs to scan the graphic code on the food to know the price of the food, or the cashier recognizes the food to calculate the price, and the labor cost of food settlement is higher.
发明概述Summary of the invention
技术问题technical problem
问题的解决方案The solution to the problem
技术解决方案Technical solutions
本申请的主要目的在于提供一种食物的结算方法、装置和计算机可读存储介质,旨在解决食物结算的人工成本较高的问题。The main purpose of this application is to provide a food settlement method, device, and computer-readable storage medium, aiming to solve the problem of high labor costs in food settlement.
为实现上述目的,本申请提供的一种食物的结算方法,所述食物的结算方法应设置为食物结算装置,所述食物结算装置包括图像采集模块以及重量传感器,所述食物的结算方法包括以下步骤:In order to achieve the above objective, the present application provides a food settlement method, the food settlement method should be set as a food settlement device, the food settlement device includes an image acquisition module and a weight sensor, and the food settlement method includes the following step:
获取所述图像采集模块采集的待购买的食物对应的图像,并获取所述重量传感器采集的食物的重量;Acquiring an image corresponding to the food to be purchased collected by the image collection module, and acquiring the weight of the food collected by the weight sensor;
根据所述图像确定所述食物的类型;Determining the type of the food according to the image;
根据所述食物的类型以及所述食物的重量确定所述食物的价格,并输出所述价 格。The price of the food is determined according to the type of the food and the weight of the food, and the price is output.
在一实施例中,所述根据所述食物的类型以及所述食物的重量确定所述食物的价格的步骤包括:In an embodiment, the step of determining the price of the food according to the type of the food and the weight of the food includes:
根据所述食物的类型确定所述食物的单价;Determining the unit price of the food according to the type of the food;
根据所述食物的单价以及所述食物的重量确定所述食物的价格。The price of the food is determined according to the unit price of the food and the weight of the food.
在一实施例中,所述根据所述食物的类型以及所述食物的重量确定所述食物的价格的步骤之后,还包括:In an embodiment, after the step of determining the price of the food according to the type of the food and the weight of the food, the method further includes:
根据所述图像判断所述食物是否放置于食皿;Judging whether the food is placed in a food dish according to the image;
在所述食物未放置于食皿时,执行所述根据所述食物的单价以及所述食物的重量确定所述食物的价格的步骤。When the food is not placed in the food dish, the step of determining the price of the food according to the unit price of the food and the weight of the food is performed.
在一实施例中,所述根据所述图像判断所述食物是否放置于食皿的步骤之后,还包括:In an embodiment, after the step of judging whether the food is placed in a food dish according to the image, the method further includes:
在所述食物放置于所述食皿时,确定所述食皿的重量;When the food is placed in the food dish, determining the weight of the food dish;
根据所述食皿的重量对所述食物的重量进行修正,以得到修正重量;Correcting the weight of the food according to the weight of the food dish to obtain the corrected weight;
根据所述修正重量以及所述食物的单价确定所述价格。The price is determined according to the corrected weight and the unit price of the food.
在一实施例中,所述确定所述食皿的重量的步骤包括:In an embodiment, the step of determining the weight of the food dish includes:
在所述图像中获取食皿图像;Obtaining a food dish image in the image;
确定与所述食皿图像匹配的预存图像;Determining a pre-stored image matching the image of the food dish;
根据匹配的所述预存图像确定所述食皿的重量。The weight of the food dish is determined according to the matched pre-stored image.
在一实施例中,所述确定所述食皿的步骤包括:In an embodiment, the step of determining the food dish includes:
在所述图像中获取食皿图像;Obtaining a food dish image in the image;
在所述食皿图像中所述食皿的获取标识信息,其中,所述标识信息包括食皿编号、食皿造型、食皿颜色、食皿图案以及食皿材质中的至少一个;Obtaining identification information of the food dish in the food dish image, wherein the identification information includes at least one of the food dish number, the shape of the food dish, the color of the food dish, the pattern of the food dish, and the material of the food dish;
根据所述标识信息确定所述食皿的重量。The weight of the food dish is determined according to the identification information.
在一实施例中,所述输出所述价格的步骤之后,还包括:In an embodiment, after the step of outputting the price, it further includes:
获取所述用户对应的用户信息;Obtaining user information corresponding to the user;
根据所述用户信息确定所述用户的食物结算方式,其中,所述食物结算方式包括二维码支付、银行卡支付、餐卡支付、脸部识别支付、眼睛识别支付、指纹 识别支付、微信支付以及支付宝支付中的至少一种;The user’s food settlement method is determined according to the user information, wherein the food settlement method includes QR code payment, bank card payment, meal card payment, facial recognition payment, eye recognition payment, fingerprint recognition payment, and WeChat payment And at least one of Alipay payment;
输出所述食物结算方式。Output the food settlement method.
在一实施例中,所述输出所述食物结算方式的步骤之后,还包括:In an embodiment, after the step of outputting the food settlement method, the method further includes:
在接收到基于所述食物结算方式的选择完成的操作时,根据所述操作确定目标食物结算方式;When receiving an operation based on the selection of the food settlement method, determine the target food settlement method according to the operation;
根据所述目标食物结算方式以及所述价格对所述食物进行结算。The food is settled according to the target food settlement method and the price.
为实现上述目的,本申请还提供一种食物结算装置,所述食物结算装置包括图像采集模块、重量传感器、处理器、存储器以及存储在所述存储器并可在所述处理器运行的食物结算程序,所述食物结算程序被处理器执行时实现如上所述的食物的结算方法的各个步骤。To achieve the above objective, the present application also provides a food settlement device, the food settlement device including an image acquisition module, a weight sensor, a processor, a memory, and a food settlement program stored in the memory and running on the processor When the food settlement program is executed by the processor, each step of the food settlement method described above is realized.
为实现上述目的,本申请还提供一种计算机可读存储介质,所述计算机可读存储介质存储有食物结算程序,所述食物结算程序被处理器执行时实现如上所述的食物结算方法的各个步骤。In order to achieve the above objective, the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a food settlement program, and when the food settlement program is executed by a processor, each of the food settlement methods described above is implemented. step.
本申请提供的食物的结算方法、装置和计算机可读存储介质,食物结算装置获取图像采集模块采集的待购买食物对应的图像以及重量传感器采集的食物的重量,再根据图像确定食物的类型,从而根据食物的类型以及食物的重量来确定食物的价格,最后输出该价格,使得用户根据输出的价格对食物进行支付;因食物结算装置通过食物的图像以及食物的重量即可确定食物的价格,而无需人工计算食物的价格,节省了食物结算的人工成本。The food settlement method, device and computer-readable storage medium provided in the present application. The food settlement device acquires the image corresponding to the food to be purchased collected by the image collection module and the weight of the food collected by the weight sensor, and then determines the type of food according to the image, thereby The price of the food is determined according to the type of food and the weight of the food, and finally the price is output, so that the user pays for the food according to the output price; because the food settlement device can determine the price of the food through the image of the food and the weight of the food, and There is no need to manually calculate the price of food, saving the labor cost of food settlement.
发明的有益效果The beneficial effects of the invention
对附图的简要说明Brief description of the drawings
附图说明Description of the drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍。In order to more clearly describe the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art.
图1为本申请实施例涉及的食物结算装置的硬件结构示意图;FIG. 1 is a schematic diagram of the hardware structure of a food settlement device according to an embodiment of the application;
图2为本申请食物结算方法的第一实施例的流程示意图;2 is a schematic flowchart of the first embodiment of the food settlement method according to the application;
图3为图2中步骤S30的细化流程示意图;FIG. 3 is a detailed flowchart of step S30 in FIG. 2;
图4为本申请食物结算方法的第二实施例的流程示意图。FIG. 4 is a schematic flowchart of a second embodiment of the food settlement method according to the application.
本申请目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization, functional characteristics, and advantages of the purpose of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.
发明实施例Invention embodiment
本发明的实施方式Embodiments of the invention
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请的一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of this application.
本申请实施例的主要解决方案是:获取所述图像采集模块采集的待购买的食物对应的图像,并获取所述重量传感器采集的食物的重量;根据所述图像确定所述食物的类型;根据所述食物的类型以及所述食物的重量确定所述食物的价格,并输出所述价格。The main solution of the embodiment of the present application is: acquiring the image corresponding to the food to be purchased collected by the image acquisition module, and acquiring the weight of the food collected by the weight sensor; determining the type of the food according to the image; The type of the food and the weight of the food determine the price of the food, and output the price.
由于食物结算装置通过食物的图像以及食物的重量即可确定食物的价格,而无需人工计算食物的价格,节省了食物结算的人工成本。Since the food settlement device can determine the price of the food through the image of the food and the weight of the food, there is no need to manually calculate the price of the food, which saves the labor cost of food settlement.
作为一种实现方案,食物结算装置可以如图1所示。As an implementation scheme, the food settlement device may be as shown in FIG. 1.
进一步的,参照图1,食物结算装置包括:图像采集模块101、重量传感器102、处理器103,例如CPU,存储器104,通信总线105。其中,通信总线105设置为实现这些组件之间的连接通信。Further, referring to FIG. 1, the food settlement device includes: an image acquisition module 101, a weight sensor 102, a processor 103, such as a CPU, a memory 104, and a communication bus 105. Among them, the communication bus 105 is configured to realize connection and communication between these components.
存储器104可以是高速RAM存储器,也可以是稳定的存储器(non-volatilememory),例如磁盘存储器。如图1所示,作为一种计算机存储介质的存储器104中可以包括食物结算程序;而处理器103可以设置为调用存储器104中存储的食物结算送程序,并执行以下操作:The memory 104 may be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a magnetic disk memory. As shown in FIG. 1, the memory 104 as a computer storage medium may include a food settlement program; and the processor 103 may be configured to call the food settlement and delivery program stored in the memory 104 and perform the following operations:
获取所述图像采集模块采集的待购买的食物对应的图像,并获取所述重量传感器采集的食物的重量;Acquiring an image corresponding to the food to be purchased collected by the image collection module, and acquiring the weight of the food collected by the weight sensor;
根据所述图像确定所述食物的类型;Determining the type of the food according to the image;
根据所述食物的类型以及所述食物的重量确定所述食物的价格,并输出所述价格。The price of the food is determined according to the type of the food and the weight of the food, and the price is output.
在一实施例中,处理器103可以设置为调用存储器104中存储的食物结算程序,并执行以下操作:In an embodiment, the processor 103 may be configured to call a food settlement program stored in the memory 104 and perform the following operations:
根据所述食物的类型确定所述食物的单价;Determining the unit price of the food according to the type of the food;
根据所述食物的单价以及所述食物的重量确定所述食物的价格。The price of the food is determined according to the unit price of the food and the weight of the food.
在一实施例中,处理器103可以设置为调用存储器104中存储的食物结算程序,并执行以下操作:In an embodiment, the processor 103 may be configured to call a food settlement program stored in the memory 104 and perform the following operations:
根据所述图像判断所述食物是否放置于食皿;Judging whether the food is placed in a food dish according to the image;
在所述食物未放置于食皿时,执行所述根据所述食物的单价以及所述食物的重量确定所述食物的价格的步骤。When the food is not placed in the food dish, the step of determining the price of the food according to the unit price of the food and the weight of the food is performed.
在一实施例中,处理器103可以设置为调用存储器104中存储的食物结算程序,并执行以下操作:In an embodiment, the processor 103 may be configured to call a food settlement program stored in the memory 104 and perform the following operations:
在所述食物放置于所述食皿时,确定所述食皿的重量;When the food is placed in the food dish, determining the weight of the food dish;
根据所述食皿的重量对所述食物的重量进行修正,以得到修正重量;Correcting the weight of the food according to the weight of the food dish to obtain the corrected weight;
根据所述修正重量以及所述食物的单价确定所述价格。The price is determined according to the corrected weight and the unit price of the food.
在一实施例中,处理器103可以设置为调用存储器104中存储的食物结算程序,并执行以下操作:In an embodiment, the processor 103 may be configured to call a food settlement program stored in the memory 104 and perform the following operations:
在所述图像中获取食皿图像;Obtaining a food dish image in the image;
确定与所述食皿图像匹配的预存图像;Determining a pre-stored image matching the image of the food dish;
根据匹配的所述预存图像确定所述食皿的重量。The weight of the food dish is determined according to the matched pre-stored image.
在一实施例中,处理器103可以设置为调用存储器104中存储的食物结算程序,并执行以下操作:In an embodiment, the processor 103 may be configured to call a food settlement program stored in the memory 104 and perform the following operations:
在所述图像中获取食皿图像;Obtaining a food dish image in the image;
在所述食皿图像中所述食皿的获取标识信息,其中,所述标识信息包括食皿编号、食皿造型、食皿颜色、食皿图案以及食皿材质中的至少一个;Obtaining identification information of the food dish in the food dish image, wherein the identification information includes at least one of the food dish number, the shape of the food dish, the color of the food dish, the pattern of the food dish, and the material of the food dish;
根据所述标识信息确定所述食皿的重量。The weight of the food dish is determined according to the identification information.
在一实施例中,处理器103可以设置为调用存储器104中存储的食物结算程序,并执行以下操作:In an embodiment, the processor 103 may be configured to call a food settlement program stored in the memory 104 and perform the following operations:
获取所述用户对应的用户信息;Obtaining user information corresponding to the user;
根据所述用户信息确定所述用户的食物结算方式,其中,所述食物结算方式包括二维码支付、银行卡支付、餐卡支付、脸部识别支付、眼睛识别支付、指纹 识别支付、微信支付以及支付宝支付中的至少一种;The user’s food settlement method is determined according to the user information, wherein the food settlement method includes QR code payment, bank card payment, meal card payment, facial recognition payment, eye recognition payment, fingerprint recognition payment, and WeChat payment And at least one of Alipay payment;
输出所述食物结算方式。Output the food settlement method.
在一实施例中,处理器103可以设置为调用存储器104中存储的食物结算程序,并执行以下操作:In an embodiment, the processor 103 may be configured to call a food settlement program stored in the memory 104 and perform the following operations:
在接收到基于所述食物结算方式的选择完成的操作时,根据所述操作确定目标食物结算方式;When receiving an operation based on the selection of the food settlement method, determine the target food settlement method according to the operation;
根据所述目标食物结算方式以及所述价格对所述食物进行结算。The food is settled according to the target food settlement method and the price.
本实施例根据上述方案,食物结算装置获取图像采集模块采集的待购买食物对应的图像以及重量传感器采集的食物的重量,再根据图像确定食物的类型,从而根据食物的类型以及食物的重量来确定食物的价格,最后输出该价格,使得用户根据输出的价格对食物进行支付;因食物结算装置通过食物的图像以及食物的重量即可确定食物的价格,而无需人工计算食物的价格,节省了食物结算的人工成本。In this embodiment, according to the above solution, the food settlement device acquires the image corresponding to the food to be purchased collected by the image collection module and the weight of the food collected by the weight sensor, and then determines the type of food based on the image, thereby determining the type of food and the weight of the food The price of the food, and finally output the price, so that the user pays for the food according to the output price; because the food settlement device can determine the price of the food through the image of the food and the weight of the food, without manually calculating the price of the food, saving food Settled labor costs.
基于上述食物结算装置的硬件构架,提出本申请食物结算方法的实施例。Based on the hardware architecture of the aforementioned food settlement device, an embodiment of the food settlement method of the present application is proposed.
参照图2,图2为本申请食物结算方法的第一实施例,所述食物结算方法包括以下步骤:Referring to Fig. 2, Fig. 2 is a first embodiment of the food settlement method of the application. The food settlement method includes the following steps:
步骤S10,获取所述图像采集模块采集的待购买的食物对应的图像,并获取所述重量传感器采集的食物的重量;Step S10, acquiring an image corresponding to the food to be purchased collected by the image collection module, and acquiring the weight of the food collected by the weight sensor;
在本申请中执行主体为食物结算装置,食物结算装置设有图像采集模块,图像采集模块可以是摄像头,也可以是相机,用户在购买食物后,可将食物放置在食物结算装置的托盘上,使得食物结算装置控制图像采集模块对食物进行采集,以得到食物对应的图像。食物可以是餐厅内的饭菜,也可以是商场内按照重量贩卖的食品。In this application, the executive body is a food settlement device, and the food settlement device is equipped with an image acquisition module. The image acquisition module can be a camera or a camera. After purchasing food, the user can place the food on the tray of the food settlement device. The food settlement device controls the image collection module to collect food to obtain images corresponding to the food. The food can be the food in the restaurant, or the food sold by weight in the mall.
此外,食物结算装置还设有重量传感器,重量传感器放置于食物结算装置的托盘下,托盘上可放置用户选定的待购买的食物,且图像采集模块相对托盘设置,以便于采集食物图像。In addition, the food settlement device is also provided with a weight sensor, which is placed under the tray of the food settlement device, and the food to be purchased selected by the user can be placed on the tray, and the image acquisition module is arranged relative to the tray to facilitate the collection of food images.
步骤S20,根据所述图像确定所述食物的类型;Step S20, determining the type of the food according to the image;
食物结算装置可根据图像来确定食物的类型。在一实施例中,在食物为饭菜时 ,对每一种菜采用对应的食皿进行盛放,食皿可以是陶瓷碗、不锈钢碗等可装载饭菜的食皿,食皿的不同可以设置不同的花纹、不同图案、不同的造型进行设置,当然,还可对食皿进行编号,一种编号的食皿盛放对应的菜或者饭,在用户选定饭菜后,可将表征食皿的身份的花纹、造型或者编号相对食物的结算装置的图像采集模块放置(食物的结算装置对用户进行食物放置提示),食物的结算装置采集该食物的图像后,可在采集的图像中获取食皿的花纹、图案、造型或者编号,从而根据食皿的花纹、图案、造型或者编号来确定食物的类型;The food settlement device can determine the type of food according to the image. In one embodiment, when the food is a meal, a corresponding food dish is used for each dish. The food dish can be a ceramic bowl, a stainless steel bowl, etc., which can be loaded with meals. Different dishes can be set differently. The pattern, different patterns, and different shapes of the dishes can be set. Of course, the food dishes can also be numbered. A numbered food dish contains the corresponding dishes or rice. After the user selects the meal, the identity of the food dish can be represented The pattern, shape or number of the food is placed relative to the image collection module of the food settlement device (the food settlement device prompts the user to place food). After the food settlement device collects the image of the food, it can obtain the food dish’s image in the collected image Pattern, pattern, shape or number, so as to determine the type of food according to the pattern, pattern, shape or number of the food dish;
在另一实施例中,食物的结算装置中存储有各种食物图像,存储的食物图像即为预存图像。在食物的结算装置获得食物对应的图像后,即可以在存储的各个预存图像中差值与采集的食物图像相匹配的预存图像,与食物对应的图像相匹配的预存图像即为食物对应的目标预存图像。食物的结算装置判断与食物对应的图像相匹配的预存图像可有多种方式。In another embodiment, various food images are stored in the food settlement device, and the stored food images are pre-stored images. After the food settlement device obtains the image corresponding to the food, the pre-stored image whose difference value matches the collected food image can be stored in each pre-stored image. The pre-stored image that matches the image corresponding to the food is the target corresponding to the food. Pre-stored images. The food settlement device can determine the pre-stored image that matches the image corresponding to the food in various ways.
方式一:食物的结算装置设有相似度计算程序,食物的结算装置通过相似度计算程序计算采集的图像与各个预存图像之间的第一相似度,食物的结算装置再确定最大的第一相似度,若是最大的相似度大于预设阈值时,则将最大相似度对应的预存图像作为食物对应的目标预存图像,预设阈值可为任意合适的数值,例如,95%。每一个预存图像具有关联的信息,关联的信息中含有预存图像中食物的类型,因此,食物结算装置可以根据目标预存图像确定食物的类型。Method 1: The food settlement device is equipped with a similarity calculation program. The food settlement device calculates the first similarity between the collected image and each pre-stored image through the similarity calculation program, and the food settlement device determines the largest first similarity If the maximum similarity is greater than the preset threshold, the pre-stored image corresponding to the maximum similarity is used as the target pre-stored image corresponding to the food. The preset threshold can be any suitable value, for example, 95%. Each pre-stored image has associated information, and the associated information contains the type of food in the pre-stored image. Therefore, the food settlement device can determine the type of food according to the target pre-stored image.
方式二:食物的结算装置可设有多个图像采集模块,例如,可以设置三个图像采集模块,各个图像采集模块对食物的采集角度不同。用户在将食物放置在食物的结算装置上时,各个图像采集模块同时对食物进行图像采集,采集过程中,食物不移动。各个图像采集模块具有对应的图像采集角度,食物的结算装置根据图像采集角度对各个图像进行空间拼接,从而构建成食物对应的三维图像,也即食物的立体图,然后,食物的结算装置计算三维图像与预存图像(预存图像也是三维图像,也即预存图像的维度与食物对应的图像的维度相同)之间的第二相似度,再确定最大的第二相似度是否与大于预设阈值,若是大于预设阈值,则将最大第二相似度对应的预存图像作为食物对应的目标预存图像,由 此根据目标预存图像确定食物的类型。需要说明的是,食物的结算装置设置的不同角度的图像采集模块越多,构建的食物的三维图像越接近食物的实际立体图,可以理解的是,食物的结算装置设置的不同角度的图像采集模块越多,食物的结算装置识别的食物更为准确。Method 2: The food settlement device may be provided with multiple image acquisition modules, for example, three image acquisition modules may be provided, and each image acquisition module has a different food acquisition angle. When the user places the food on the food settlement device, each image acquisition module simultaneously collects images of the food, and the food does not move during the collection process. Each image acquisition module has a corresponding image acquisition angle. The food settlement device spatially splices each image according to the image acquisition angle to construct a three-dimensional image corresponding to the food, that is, a three-dimensional image of the food. Then, the food settlement device calculates the three-dimensional image The second degree of similarity with the pre-stored image (the pre-stored image is also a three-dimensional image, that is, the dimension of the pre-stored image is the same as the dimension of the image corresponding to the food), and then determine whether the largest second similarity is greater than the preset threshold, if it is greater than If the threshold is preset, the pre-stored image corresponding to the largest second degree of similarity is used as the target pre-stored image corresponding to the food, so that the type of food is determined according to the target pre-stored image. It should be noted that the more image collection modules of different angles set by the food settlement device, the closer the constructed three-dimensional image of the food is to the actual three-dimensional image of the food. It is understandable that the image collection modules of different angles set by the food settlement device The more food, the more accurate the food recognized by the food settlement device.
步骤S30,根据所述食物的类型以及所述食物的重量确定所述食物的价格,并输出所述价格;Step S30: Determine the price of the food according to the type of the food and the weight of the food, and output the price;
在确定食物的类型后,即可根据食物的类型以及食物的重量来计算食物的价格,具体的,请参照图3,即步骤S30中根据所述食物的类型以及所述食物的重量确定所述食物的价格的步骤包括:After the type of food is determined, the price of the food can be calculated according to the type of food and the weight of the food. Specifically, please refer to FIG. 3, that is, in step S30, the type of food and the weight of the food are determined. The steps of food price include:
步骤S31,根据所述食物的类型确定所述食物的单价;Step S31, determining the unit price of the food according to the type of the food;
步骤S32,根据所述食物的单价以及所述食物的重量确定所述食物的价格;Step S32, determining the price of the food according to the unit price of the food and the weight of the food;
食物结算装置对每一种类型的食物设置有单价,在确定食物的类型后,即可以根据食物的类型确定待购买的食物的单价,食物结算装置再通过食物的单价以及食物的重量即可计算得到食物的价格。The food settlement device sets a unit price for each type of food. After the type of food is determined, the unit price of the food to be purchased can be determined according to the type of food. The food settlement device can then calculate the unit price and the weight of the food Get the price of food.
在确定食物的价格后,即可输出该价格,以供用户进行食物结算。进一步地,食物的结算装置可以输出多种支付方式,例如,二维码支付、银行卡支付、餐卡支付、脸部识别支付、眼睛识别支付、指纹识别支付、NFC支付(近场通信支付)、微信支付、支付宝支付等,用户可以选择支付方式进行价格的支付以完成食物的结算,需要说明的是,餐卡支付、脸部识别支付、眼睛识别支付、指纹识别支付等支付方式需要用户进行会员注册,用户在注册会员时,食物的结算装置会将用户的图像、餐卡编号、电话号码、录入的指纹以及食物余额进行保存。After the price of the food is determined, the price can be output for the user to settle the food. Further, the food settlement device can output multiple payment methods, for example, QR code payment, bank card payment, meal card payment, face recognition payment, eye recognition payment, fingerprint recognition payment, NFC payment (near field communication payment) , WeChat payment, Alipay payment, etc., users can choose the payment method to pay for the price to complete the food settlement. It should be noted that payment methods such as meal card payment, facial recognition payment, eye recognition payment, fingerprint recognition payment and other payment methods require users to pay Member registration. When a user registers a member, the food settlement device will save the user's image, meal card number, phone number, fingerprints entered, and food balance.
食物的结算装置在输出食物的价格时,可获取用户的用户信息,食物的结算装置可以通过图像采集模块来确定用户,进而获取用户的用户信息,从而根据用户信息确定用户可以选择的食物结算方式,食物结算方式包括上述中的二维码支付、银行卡支付、餐卡支付、脸部识别支付、眼睛识别支付、指纹识别支付、NFC支付(近场通信支付)、微信支付、支付宝支付,食物的结算装置再输出用户的食物结算方式,例如,用户开通了指纹支付、餐卡支付以及脸部识别支 付,那么,食物的结算装置可输出指纹支付、餐卡支付、脸部识别支付等三种支付方式,以供用户进行选择;用户在进行选择操作后,也即食物的结算装置在检测到基于食物结算方式的选择完成的操作,即可根据操作来确定目标食物结算方式,从而根据目标食物结算方式以及食物的价格对食物进行结算,例如,目标食物结算方式为脸部识别结算,那么食物的结算装置采集用户的脸部,从而识别出用户,再从用户账号中的余额中扣除购买的食物的价格,若目标食物结算方式为微信支付,那么食物的结算装置会将食物价格发生至微信支付服务器,进而使得微信支付服务器将支付请求发送至用户终端,使得用户基于用户终端对食物进行支付,从而完成食物的支付。The food settlement device can obtain the user information of the user when outputting the price of the food. The food settlement device can determine the user through the image acquisition module, and then obtain the user information of the user, thereby determining the food settlement method the user can choose according to the user information , Food settlement methods include the above-mentioned QR code payment, bank card payment, meal card payment, face recognition payment, eye recognition payment, fingerprint recognition payment, NFC payment (near field communication payment), WeChat payment, Alipay payment, food The settlement device then outputs the user’s food settlement method. For example, if the user has activated fingerprint payment, meal card payment, and facial recognition payment, the food settlement device can output fingerprint payment, meal card payment, and facial recognition payment. Payment method for the user to choose; after the user performs the selection operation, that is, the food settlement device detects the operation based on the selection of the food settlement method, the target food settlement method can be determined according to the operation, and the target food settlement method can be determined according to the target food The settlement method and the price of the food are used to settle the food. For example, if the target food settlement method is facial recognition settlement, the food settlement device collects the user’s face to identify the user, and then deduct the purchase from the balance in the user account The price of food, if the target food settlement method is WeChat payment, the food settlement device will send the food price to the WeChat payment server, so that the WeChat payment server will send the payment request to the user terminal, so that the user can pay for the food based on the user terminal , Thereby completing the food payment.
此外,在当食物结算装置未识别出用户,可以输出微信支付、支付宝支付等常规食物结算方式。In addition, when the food settlement device does not recognize the user, it can output regular food settlement methods such as WeChat payment and Alipay payment.
在本实施例提供的技术方案中,食物结算装置获取图像采集模块采集的待购买食物对应的图像以及重量传感器采集的食物的重量,再根据图像确定食物的类型,从而根据食物的类型以及食物的重量来确定食物的价格,最后输出该价格,使得用户根据输出的价格对食物进行支付;因食物结算装置通过食物的图像以及食物的重量即可确定食物的价格,而无需人工计算食物的价格,节省了食物结算的人工成本。In the technical solution provided in this embodiment, the food settlement device acquires the image corresponding to the food to be purchased collected by the image collection module and the weight of the food collected by the weight sensor, and then determines the type of food based on the image, thereby determining the type of food according to the type of food and the weight of the food. The weight is used to determine the price of the food, and finally the price is output, so that the user pays for the food according to the output price; because the food settlement device can determine the price of the food through the image of the food and the weight of the food, without manually calculating the price of the food, Save the labor cost of food settlement.
参照图4,图4为本申请食物的结算方法的第二实施例,基于第一实施例,所述步骤S31之后,还包括:Referring to Figure 4, Figure 4 is a second embodiment of the food settlement method of this application. Based on the first embodiment, after the step S31, it further includes:
步骤S40,根据所述图像判断所述食物是否放置于食皿;Step S40, judging whether the food is placed in a pan according to the image;
步骤S50,在所述食物未放置于食皿时,执行所述根据所述食物的单价以及所述食物的重量确定所述食物的价格的步骤,并输出所述价格;Step S50, when the food is not placed in the food dish, execute the step of determining the price of the food according to the unit price of the food and the weight of the food, and output the price;
步骤S60,在所述食物放置于所述食皿时,确定所述食皿的重量;Step S60, when the food is placed in the food dish, determine the weight of the food dish;
步骤S70,根据所述食皿的重量对所述食物的重量进行修正,以得到修正重量;Step S70: Correct the weight of the food according to the weight of the food dish to obtain the corrected weight;
步骤S80,根据所述修正重量以及所述食物的单价确定所述价格,并输出所述价格。Step S80: Determine the price according to the corrected weight and the unit price of the food, and output the price.
一些食物在食用时需要采用食皿盛装,例如饭菜,而一些食物无需食皿盛装即 可食用,例如,瓜子、花生等,可以理解的是,若是食物放置在食皿中,而食皿具有一定的重量,食物结算装置如果直接按照重量传感器获得重量,必然会造成计算食物价格大于实际的食物价格。Some foods need to be filled with food dishes when eating, such as meals, and some foods can be eaten without the need for food containers, such as melon seeds, peanuts, etc. It is understandable that if the food is placed in the food dish, the food dish has a certain If the food settlement device obtains the weight directly according to the weight sensor, it will inevitably cause the calculated food price to be greater than the actual food price.
在食物结算装置获得食物的图像后,食物结算装置根据图像来判断食物是否放置在食皿中,食皿是由卖家提供,食物结算装置存储有食皿的图像,若食物结算装置在图像中识别出有食皿,则可判定食物放置在食皿中,而食物结算装置存储有食皿的重量,食物结算装置可以获取食皿的重量,进而根据重量传感器食物的重量减去食皿的重量得到食物的实际重量,实际重量也即修正重量,最后根据食物单价以及修正重量计算得到食物的价格;而在当食物结算装置未识别出有食皿时,则可判定食物并未放置在食皿中,食物结算装置直接根据食物的单价以及重量传感器采集食物的重量来计算食物的价格。After the food settlement device obtains the image of the food, the food settlement device judges whether the food is placed in the food dish based on the image. The food settlement device is provided by the seller. The food settlement device stores the image of the food dish. If the food settlement device recognizes the food in the image If there is a pan, it can be determined that the food is placed in the pan, and the food clearing device stores the weight of the pan, and the food clearing device can obtain the weight of the pan, and then subtract the weight of the pan from the weight of the food on the weight sensor. The actual weight of the food, the actual weight is also the corrected weight, and finally the price of the food is calculated based on the unit price of the food and the corrected weight; and when the food settlement device does not recognize that there is a pan, it can be determined that the food is not placed in the pan , The food settlement device directly calculates the price of the food according to the unit price of the food and the weight of the food collected by the weight sensor.
食物结算装置确定食皿的重量有多种方式,具体的,食物结算装置存储有食皿的标识信息,标识信息表征食皿的类型,标识信息包括食皿编号、食皿造型、食皿颜色、食皿图案以及食皿材质中的至少一种,食物结算装置可在采集的图像中获取食皿图像,进而从食皿图像中获取食皿的标识信息,食物结算装置可以根据标识信息确定食皿的类型,食物结算装置存储有每一种食皿的重量,因此,在确定食皿的类型后,即可根据食皿的类型确定食皿的重量。There are many ways for the food settlement device to determine the weight of the food dish. Specifically, the food settlement device stores the identification information of the food dish. The identification information represents the type of the food dish. The identification information includes the food dish number, the shape of the food dish, the color of the food dish, At least one of the pattern of the food dish and the material of the food dish. The food settlement device can obtain the image of the food dish from the collected image, and then obtain the identification information of the food dish from the image of the food dish. The food settlement device can determine the food dish according to the identification information. The food clearing device stores the weight of each food dish. Therefore, after determining the type of the food dish, the weight of the food dish can be determined according to the type of the food dish.
另外,食物结算装置可预存多种类型的食皿的图像,预存的食皿的图像即为预存图像,食物结算装置在得到食物对应的图像后,在图像中获取食皿图像,进而计算食皿图像与各个预存图像之间的相似度,再确定最大相似度对应的预存图像,若最大相似度大于预设阈值,那么最大相似度对应的预存图像中的食皿即为待购买食物盛装的食皿,也即该预存图像为食皿图像匹配的预存图像,每一张预存图像关联有对应的重量,因此,食物结算装置可根据匹配的预存图像确定食皿的重量。In addition, the food settlement device can pre-store images of various types of food dishes, and the images of the pre-stored food dishes are the pre-stored images. After the food settlement device obtains the image corresponding to the food, it obtains the image of the food dish from the image, and then calculates the food dish The similarity between the image and each pre-stored image is determined, and then the pre-stored image corresponding to the maximum similarity is determined. If the maximum similarity is greater than the preset threshold, the food dish in the pre-stored image corresponding to the maximum similarity is the food to be purchased. The dish, that is, the pre-stored image is a pre-stored image matched by the image of the food dish, and each pre-stored image is associated with a corresponding weight. Therefore, the food settlement device can determine the weight of the food dish according to the matched pre-stored image.
在本实施例提供的技术方案中,食物结算装置根据图像判断食物放置在食皿内,若食物未放置在食皿内,则直接根据食物的单价以及食物的重量确定食物的价格,若食物放置在食皿内,则需对食物的重量进行修正,再根据修正后的重量以使食物的单价得到食物的价格,避免食物结算装置出现食物价格计算不准 确情况,食物结算装置的智能化程度高。In the technical solution provided in this embodiment, the food settlement device judges that the food is placed in the food pan according to the image. If the food is not placed in the food pan, the price of the food is directly determined according to the unit price of the food and the weight of the food. In the food dish, the weight of the food needs to be corrected, and then the price of the food is obtained according to the corrected weight so that the unit price of the food is used to avoid inaccurate food price calculations in the food settlement device. The food settlement device is highly intelligent .
本申请还提供一种食物结算装置,所述食物结算装置包括图像采集模块、重量传感器、处理器、存储器以及存储在所述存储器并可在所述处理器运行的食物结算程序,所述食物结算程序被处理器执行时实现如上实施例所述的食物的结算方法的各个步骤。The present application also provides a food settlement device. The food settlement device includes an image acquisition module, a weight sensor, a processor, a memory, and a food settlement program stored in the memory and running on the processor. When the program is executed by the processor, each step of the food settlement method described in the above embodiment is realized.
本申请还提供一种计算机可读存储介质,所述计算机可读存储介质存储有食物结算程序,所述食物结算程序被处理器执行时实现如上实施例所述的食物结算方法的各个步骤。The present application also provides a computer-readable storage medium that stores a food settlement program, and when the food settlement program is executed by a processor, each step of the food settlement method described in the above embodiment is implemented.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the foregoing embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个......”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that in this article, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, It also includes other elements not explicitly listed, or elements inherent to the process, method, article, or device. Without more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article, or device that includes the element.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本申请各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better.的实施方式。 Based on this understanding, the technical solution of this application essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above. , Magnetic disk, optical disk), including several instructions to make a terminal device (can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the method described in each embodiment of the present application.
以上仅为本申请的可选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above are only optional embodiments of this application, and do not limit the scope of this application. Any equivalent structure or equivalent process transformation made by using the description and drawings of this application, or directly or indirectly applied to other related technologies In the same way, all fields are included in the scope of patent protection of this application.

Claims (20)

  1. 一种食物的结算方法,其中,所述食物的结算方法应设置为食物结算装置,所述食物结算装置包括图像采集模块以及重量传感器,所述重量传感器设置为采集食物的重量,所述食物的结算方法包括以下步骤:A food settlement method, wherein the food settlement method should be set as a food settlement device, the food settlement device includes an image acquisition module and a weight sensor, the weight sensor is set to collect the weight of the food, the weight of the food The settlement method includes the following steps:
    获取所述图像采集模块采集的待购买的食物对应的图像,并获取所述重量传感器采集的食物的重量;Acquiring an image corresponding to the food to be purchased collected by the image collection module, and acquiring the weight of the food collected by the weight sensor;
    根据所述图像确定所述食物的类型;Determining the type of the food according to the image;
    根据所述食物的类型以及所述食物的重量确定所述食物的价格,并输出所述价格。The price of the food is determined according to the type of the food and the weight of the food, and the price is output.
  2. 如权利要求1所述的食物的结算方法,其中,所述根据所述食物的类型以及所述食物的重量确定所述食物的价格的步骤包括:The food settlement method according to claim 1, wherein the step of determining the price of the food according to the type of the food and the weight of the food comprises:
    根据所述食物的类型确定所述食物的单价;Determining the unit price of the food according to the type of the food;
    根据所述食物的单价以及所述食物的重量确定所述食物的价格。The price of the food is determined according to the unit price of the food and the weight of the food.
  3. 如权利要求2所述的食物的结算方法,其中,所述根据所述食物的类型以及所述食物的重量确定所述食物的价格的步骤之后,还包括:The food settlement method according to claim 2, wherein after the step of determining the price of the food according to the type of the food and the weight of the food, the method further comprises:
    根据所述图像判断所述食物是否放置于食皿;Judging whether the food is placed in a food dish according to the image;
    在所述食物未放置于食皿,执行所述根据所述食物的单价以及所述食物的重量确定所述食物的价格的步骤。When the food is not placed in the food dish, the step of determining the price of the food according to the unit price of the food and the weight of the food is performed.
  4. 如权利要求3所述的食物的结算方法,其中,所述根据所述图像判断所述食物是否放置于食皿的步骤之后,还包括:The food settlement method according to claim 3, wherein after the step of judging whether the food is placed in a food dish according to the image, the method further comprises:
    在所述食物放置于所述食皿,确定所述食皿的重量;After the food is placed in the food pan, determine the weight of the food pan;
    根据所述食皿的重量对所述食物的重量进行修正,以得到修正重量;Correcting the weight of the food according to the weight of the food dish to obtain the corrected weight;
    根据所述修正重量以及所述食物的单价确定所述价格,并输出所述价格。The price is determined according to the corrected weight and the unit price of the food, and the price is output.
  5. 如权利要求4所述的食物的结算方法,其中,所述确定所述食皿的 重量的步骤包括:The food settlement method according to claim 4, wherein the step of determining the weight of the food pan comprises:
    在所述图像中获取食皿图像;Obtaining a food dish image in the image;
    确定与所述食皿图像匹配的预存图像;Determining a pre-stored image matching the image of the food dish;
    根据匹配的所述预存图像确定所述食皿的重量。The weight of the food dish is determined according to the matched pre-stored image.
  6. 如权利要求4所述的食物的结算方法,其中,所述确定所述食皿的步骤包括:The food settlement method according to claim 4, wherein the step of determining the food dish comprises:
    在所述图像中获取食皿图像;Obtaining a food dish image in the image;
    在所述食皿图像中所述食皿的获取标识信息,其中,所述标识信息包括食皿编号、食皿造型、食皿颜色、食皿图案以及食皿材质中的至少一个;Obtaining identification information of the food dish in the food dish image, wherein the identification information includes at least one of the food dish number, the shape of the food dish, the color of the food dish, the pattern of the food dish, and the material of the food dish;
    根据所述标识信息确定所述食皿的重量。The weight of the food dish is determined according to the identification information.
  7. 如权利要求1所述的食物的结算方法,其中,所述输出所述价格的步骤之后,还包括:The food settlement method according to claim 1, wherein after the step of outputting the price, it further comprises:
    获取所述用户对应的用户信息;Obtaining user information corresponding to the user;
    根据所述用户信息确定所述用户的食物结算方式,其中,所述食物结算方式包括二维码支付、银行卡支付、餐卡支付、脸部识别支付、眼睛识别支付、指纹识别支付、微信支付以及支付宝支付中的至少一种;The user’s food settlement method is determined according to the user information, wherein the food settlement method includes QR code payment, bank card payment, meal card payment, facial recognition payment, eye recognition payment, fingerprint recognition payment, and WeChat payment And at least one of Alipay payment;
    输出所述食物结算方式。Output the food settlement method.
  8. 如权利要求7所述的食物的结算方法,其中,所述输出所述食物结算方式的步骤之后,还包括:8. The food settlement method according to claim 7, wherein after the step of outputting the food settlement method, the method further comprises:
    在接收到基于所述食物结算方式的选择完成的操作,根据所述操作确定目标食物结算方式;After receiving an operation completed based on the selection of the food settlement method, determine a target food settlement method according to the operation;
    根据所述目标食物结算方式以及所述价格对所述食物进行结算。The food is settled according to the target food settlement method and the price.
  9. 如权利要求1所述的食物的结算方法,其中,所述根据所述图像确定所述食物的类型的步骤包括:The food settlement method according to claim 1, wherein the step of determining the type of the food according to the image comprises:
    确定所述图像与各个预存图像之间的第一相似度;Determine the first degree of similarity between the image and each pre-stored image;
    在确定最大的第一相似度大于预设阈值,根据最大的第一相似度 对应的预存图像确定所述食物的类型。When it is determined that the largest first similarity degree is greater than the preset threshold, the type of the food is determined according to the stored image corresponding to the largest first similarity degree.
  10. 如权利要求1所述的食物的结算方法,其中,所述根据所述图像确定所述食物的类型的步骤包括:The food settlement method according to claim 1, wherein the step of determining the type of the food according to the image comprises:
    确定所述图像与各个预存图像之间的第二相似度,所述图像以及各个所述预存图像为三维图像;Determining a second degree of similarity between the image and each pre-stored image, the image and each of the pre-stored images are three-dimensional images;
    在确定最大的第二相似度大于预设阈值,根据最大的第二相似度对应的预存图像确定所述食物的类型。After determining that the largest second degree of similarity is greater than the preset threshold, the type of the food is determined according to the stored image corresponding to the largest second degree of similarity.
  11. 一种食物结算装置,其中,所述食物结算装置包括图像采集模块、重量传感器、处理器、存储器以及存储在所述存储器并可在所述处理器运行的食物结算程序,所述食物结算程序被处理器执行时实现如下步骤:A food settlement device, wherein the food settlement device includes an image acquisition module, a weight sensor, a processor, a memory, and a food settlement program stored in the memory and running on the processor, the food settlement program being The processor implements the following steps when executing:
    获取所述图像采集模块采集的待购买的食物对应的图像,并获取所述重量传感器采集的食物的重量;Acquiring an image corresponding to the food to be purchased collected by the image collection module, and acquiring the weight of the food collected by the weight sensor;
    根据所述图像确定所述食物的类型;Determining the type of the food according to the image;
    根据所述食物的类型以及所述食物的重量确定所述食物的价格,并输出所述价格。The price of the food is determined according to the type of the food and the weight of the food, and the price is output.
  12. 如权利要求11所述的食物结算装置,其中,所述食物结算程序被处理器执行时实现如下步骤:The food settlement device according to claim 11, wherein the following steps are implemented when the food settlement program is executed by the processor:
    根据所述食物的类型确定所述食物的单价;Determining the unit price of the food according to the type of the food;
    根据所述食物的单价以及所述食物的重量确定所述食物的价格。The price of the food is determined according to the unit price of the food and the weight of the food.
  13. 如权利要求12所述的食物结算装置,其中,所述食物结算程序被处理器执行时实现如下步骤:The food settlement device according to claim 12, wherein the following steps are implemented when the food settlement program is executed by the processor:
    根据所述图像判断所述食物是否放置于食皿;Judging whether the food is placed in a food dish according to the image;
    在所述食物未放置于食皿时,执行所述根据所述食物的单价以及所述食物的重量确定所述食物的价格的步骤。When the food is not placed in the food dish, the step of determining the price of the food according to the unit price of the food and the weight of the food is performed.
  14. 如权利要求13所述的食物结算装置,其中,所述食物结算程序被处理器执行时实现如下步骤:The food settlement device according to claim 13, wherein the following steps are implemented when the food settlement program is executed by the processor:
    在所述食物放置于所述食皿,确定所述食皿的重量;After the food is placed in the food pan, determine the weight of the food pan;
    根据所述食皿的重量对所述食物的重量进行修正,以得到修正重量;Correcting the weight of the food according to the weight of the food dish to obtain the corrected weight;
    根据所述修正重量以及所述食物的单价确定所述价格,并输出所述价格。The price is determined according to the corrected weight and the unit price of the food, and the price is output.
  15. 如权利要求14所述的食物结算装置,其中,所述食物结算程序被处理器执行时实现如下步骤:The food settlement device according to claim 14, wherein the following steps are implemented when the food settlement program is executed by the processor:
    在所述图像中获取食皿图像;Obtaining a food dish image in the image;
    确定与所述食皿图像匹配的预存图像;Determining a pre-stored image matching the image of the food dish;
    根据匹配的所述预存图像确定所述食皿的重量。The weight of the food dish is determined according to the matched pre-stored image.
  16. 如权利要求14所述的食物结算装置,其中,所述食物结算程序被处理器执行时实现如下步骤:The food settlement device according to claim 14, wherein the following steps are implemented when the food settlement program is executed by the processor:
    在所述图像中获取食皿图像;Obtaining a food dish image in the image;
    在所述食皿图像中所述食皿的获取标识信息,其中,所述标识信息包括食皿编号、食皿造型、食皿颜色、食皿图案以及食皿材质中的至少一个;Obtaining identification information of the food dish in the food dish image, wherein the identification information includes at least one of the food dish number, the shape of the food dish, the color of the food dish, the pattern of the food dish, and the material of the food dish;
    根据所述标识信息确定所述食皿的重量。The weight of the food dish is determined according to the identification information.
  17. 一种计算机可读存储介质,其中,所述计算机可读存储介质存储有食物结算程序,所述食物结算程序被处理器执行时实现如下步骤:A computer-readable storage medium, wherein the computer-readable storage medium stores a food settlement program, and when the food settlement program is executed by a processor, the following steps are implemented:
    获取所述图像采集模块采集的待购买的食物对应的图像,并获取所述重量传感器采集的食物的重量;Acquiring an image corresponding to the food to be purchased collected by the image collection module, and acquiring the weight of the food collected by the weight sensor;
    根据所述图像确定所述食物的类型;Determining the type of the food according to the image;
    根据所述食物的类型以及所述食物的重量确定所述食物的价格,并输出所述价格。The price of the food is determined according to the type of the food and the weight of the food, and the price is output.
  18. 如权利要求17所述的计算机可读存储介质,其中,所述食物结算程序被处理器执行时实现如下步骤:17. The computer-readable storage medium of claim 17, wherein the food settlement program is executed by the processor to implement the following steps:
    根据所述食物的类型确定所述食物的单价;Determining the unit price of the food according to the type of the food;
    根据所述食物的单价以及所述食物的重量确定所述食物的价格。The price of the food is determined according to the unit price of the food and the weight of the food.
  19. 如权利要求18所述的计算机可读存储介质,其中,所述食物结算程序被处理器执行时实现如下步骤:18. The computer-readable storage medium of claim 18, wherein the food settlement program is executed by the processor to implement the following steps:
    根据所述图像判断所述食物是否放置于食皿;Judging whether the food is placed in a food dish according to the image;
    在所述食物未放置于食皿,执行所述根据所述食物的单价以及所述食物的重量确定所述食物的价格的步骤。When the food is not placed in the food dish, the step of determining the price of the food according to the unit price of the food and the weight of the food is performed.
  20. 如权利要求19所述的计算机可读存储介质,其中,所述食物结算程序被处理器执行时实现如下步骤:18. The computer-readable storage medium of claim 19, wherein the food settlement program is executed by the processor to implement the following steps:
    在所述食物放置于所述食皿,确定所述食皿的重量;After the food is placed in the food pan, determine the weight of the food pan;
    根据所述食皿的重量对所述食物的重量进行修正,以得到修正重量;Correcting the weight of the food according to the weight of the food dish to obtain the corrected weight;
    根据所述修正重量以及所述食物的单价确定所述价格,并输出所述价格。The price is determined according to the corrected weight and the unit price of the food, and the price is output.
PCT/CN2020/091204 2019-05-21 2020-05-20 Food settlement method and device, and computer-readable storage medium WO2020233585A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910428316.3A CN110264176A (en) 2019-05-21 2019-05-21 Settlement method, device and the computer readable storage medium of food
CN201910428316.3 2019-05-21

Publications (1)

Publication Number Publication Date
WO2020233585A1 true WO2020233585A1 (en) 2020-11-26

Family

ID=67915051

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/091204 WO2020233585A1 (en) 2019-05-21 2020-05-20 Food settlement method and device, and computer-readable storage medium

Country Status (2)

Country Link
CN (1) CN110264176A (en)
WO (1) WO2020233585A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110264176A (en) * 2019-05-21 2019-09-20 深圳市梵高控股有限公司 Settlement method, device and the computer readable storage medium of food

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107563745A (en) * 2017-09-19 2018-01-09 成都猫道科技有限公司 Fruits and vegetables class commodity self-service is weighed and accounting device, system and application method
CN107730321A (en) * 2017-11-02 2018-02-23 杨冠群 A kind of identification pricing system based on canteen characteristics of image
US10134022B1 (en) * 2018-06-07 2018-11-20 Capital One Services, Llc Transaction terminals for automated billing
CN108877109A (en) * 2018-05-25 2018-11-23 合肥民众亿兴软件开发有限公司 A kind of supermarket's guard against theft in market automatic identification weighing settlement method and system
CN109118200A (en) * 2018-07-26 2019-01-01 上海凯景信息技术有限公司 A kind of commodity identification and cash register system based on image recognition
CN110264176A (en) * 2019-05-21 2019-09-20 深圳市梵高控股有限公司 Settlement method, device and the computer readable storage medium of food

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109389753A (en) * 2017-08-08 2019-02-26 刘凑华 Bulk commodity self-help selling system
US20190066239A1 (en) * 2017-08-23 2019-02-28 Prince Castle LLC System and method of kitchen communication
US10223683B1 (en) * 2017-12-05 2019-03-05 Saverio Dalia Versatile transaction scanner for use in a food and beverage venue
CN207510869U (en) * 2017-12-06 2018-06-19 北京创跃网络科技有限公司 A kind of bulk commodity self-identifying weighing device with packing frame
CN108764884A (en) * 2018-05-25 2018-11-06 合肥康之恒机械科技有限公司 A kind of supermarket's guard against theft in market automatic identification is weighed clearing management-control method and system
CN108805548A (en) * 2018-05-25 2018-11-13 合肥市大卓电力有限责任公司 A kind of energy saving automatic identification of bulk product is weighed clearing management-control method and system
CN108806132A (en) * 2018-05-25 2018-11-13 合肥达户电线电缆科技有限公司 A kind of energy saving automatic identification of bulk product is weighed settlement method and system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107563745A (en) * 2017-09-19 2018-01-09 成都猫道科技有限公司 Fruits and vegetables class commodity self-service is weighed and accounting device, system and application method
CN107730321A (en) * 2017-11-02 2018-02-23 杨冠群 A kind of identification pricing system based on canteen characteristics of image
CN108877109A (en) * 2018-05-25 2018-11-23 合肥民众亿兴软件开发有限公司 A kind of supermarket's guard against theft in market automatic identification weighing settlement method and system
US10134022B1 (en) * 2018-06-07 2018-11-20 Capital One Services, Llc Transaction terminals for automated billing
CN109118200A (en) * 2018-07-26 2019-01-01 上海凯景信息技术有限公司 A kind of commodity identification and cash register system based on image recognition
CN110264176A (en) * 2019-05-21 2019-09-20 深圳市梵高控股有限公司 Settlement method, device and the computer readable storage medium of food

Also Published As

Publication number Publication date
CN110264176A (en) 2019-09-20

Similar Documents

Publication Publication Date Title
US11449869B2 (en) Method and system for facilitating payment based on facial recognition
CN107194699B (en) Payment system, method and device based on biological characteristics and readable storage medium
US10699275B2 (en) Systems and methods for use in authorizing transactions to accounts
US20210365979A1 (en) Providing Hands-Free Data for Interactions
US20180211283A1 (en) Passive Patron Identification Systems And Methods
WO2021000577A1 (en) Method and apparatus for face-swiping payment
US20200334682A1 (en) Face payment device, face payment method, face payment system, and machine-readable storage medium
US20180114240A1 (en) Method, server, and storage medium for processing order
US20210182598A1 (en) Image processing apparatus, server device, and method thereof
US11134798B1 (en) Vision-based frictionless self-checkouts for small baskets
WO2020233582A1 (en) Food settlement method and apparatus, and computer-readable storage medium
US20220215421A1 (en) Ordering method and system supporting coupon verification integration
US20220067698A1 (en) Wireless payment systems, devices and methods for electronic payment
CN110569794B (en) Article information storage method and device and computer readable storage medium
WO2020233585A1 (en) Food settlement method and device, and computer-readable storage medium
US9646295B1 (en) Handsfree point-of-sale
CN108389053B (en) Payment method, payment device, electronic equipment and readable storage medium
CN111144864A (en) Catering settlement method, catering settlement device and storage medium
EP3062272A1 (en) Method and apparatus for accumulating membership points
CN109784971B (en) Method, device and system for processing member consumption information
KR101200605B1 (en) System and method for providing partial payment using near field communication
US11379806B2 (en) Virtual reality transaction integration
WO2020156326A1 (en) Processing method and system for queuing up for pre-ordering food
CN109840515B (en) Face posture adjusting method and device and terminal
US20140214599A1 (en) Completing A Purchase Transaction At Various Locations

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20810453

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20810453

Country of ref document: EP

Kind code of ref document: A1