WO2019127255A1 - Cloud-based self-service shopping method and system, electronic device, and program product - Google Patents

Cloud-based self-service shopping method and system, electronic device, and program product Download PDF

Info

Publication number
WO2019127255A1
WO2019127255A1 PCT/CN2017/119526 CN2017119526W WO2019127255A1 WO 2019127255 A1 WO2019127255 A1 WO 2019127255A1 CN 2017119526 W CN2017119526 W CN 2017119526W WO 2019127255 A1 WO2019127255 A1 WO 2019127255A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
face
user
account
face information
Prior art date
Application number
PCT/CN2017/119526
Other languages
French (fr)
Chinese (zh)
Inventor
刘兆祥
廉士国
李少华
Original Assignee
深圳前海达闼云端智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳前海达闼云端智能科技有限公司 filed Critical 深圳前海达闼云端智能科技有限公司
Priority to PCT/CN2017/119526 priority Critical patent/WO2019127255A1/en
Priority to CN201780002673.2A priority patent/CN108235771A/en
Publication of WO2019127255A1 publication Critical patent/WO2019127255A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/08Payment architectures
    • G06Q20/20Point-of-sale [POS] network systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G06K17/0022Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/38Payment protocols; Details thereof
    • G06Q20/40Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
    • G06Q20/401Transaction verification
    • G06Q20/4014Identity check for transactions
    • G06Q20/40145Biometric identity checks

Abstract

Provided are a cloud-based self-service shopping method and system, an electronic device, and a program product, wherein the method obtains the account information of a first user; the first face information of the first user is collected; the tag information of the product purchased by a second user is collected; the second face information of the second user is collected; when the first face information matching the second face information is presented, the shopping amount is deducted according to the tag information and the matching first face information. Based on the cloud technology, the first face information of the first user is collected by obtaining the account information of the first user, the tag information of the product purchased by the second user is collected, and the second face information of the second user is collected. When the first face information matching the second face information is presented, the purchase amount is deducted according to the tag information and the matching first face information, thereby realizing unmanned self-service shopping.

Description

基于云端的自助购物方法和系统、电子设备、程序产品Cloud-based self-service shopping method and system, electronic device, program product 技术领域Technical field
本申请涉及计算机技术领域,特别涉及一种基于云端的自助购物方法和系统、电子设备、程序产品。The present application relates to the field of computer technologies, and in particular, to a cloud-based self-service shopping method and system, an electronic device, and a program product.
背景技术Background technique
日常生活中,超市设置的结账通道不超过10个,而一个超市在同一时间的消费者有可能达到数百人,甚至数千人。尤其是在周末或者节假日,消费者在超市中选好商品后需要排很长的队,超市招聘收银员对商品条码进行一个一个扫描,结账效率低,消费者在排队过程中浪费时间,甚至有些消费者因避免排队而放弃了购物,这对超市是一种无形的损失,影响了超市的销售量。In daily life, supermarkets set up no more than 10 checkout channels, and a supermarket at the same time consumers may reach hundreds or even thousands. Especially on weekends or holidays, consumers need to queue a long queue after selecting good products in the supermarket. The supermarket recruits the cashier to scan the barcodes one by one. The checkout efficiency is low, consumers waste time in the queuing process, and even some consumption. Those who gave up shopping because they avoided queuing were an intangible loss to the supermarket, which affected the sales volume of the supermarket.
为此,很多大型超市尽量开设更多的结账通道,但是一方面,需要招聘更多的收银员,另一方面,受到超市场地的限制,结账通道不能无限地增设,这两方面同时都会增加超市的运营成本。To this end, many large supermarkets try to open more checkout channels, but on the one hand, they need to recruit more cashiers. On the other hand, they are restricted by supermarkets. The checkout channel cannot be added indefinitely. Operating costs.
发明内容Summary of the invention
本申请实施例提供了一种基于云端的自助购物方法和系统、电子设备、程序产品,主要用于自助购物。The embodiment of the present application provides a cloud-based self-service shopping method and system, an electronic device, and a program product, which are mainly used for self-service shopping.
第一方面,本申请实施例提供了一种基于云端的自助购物方法,所述方法,包括:In a first aspect, the embodiment of the present application provides a cloud-based self-service shopping method, where the method includes:
获取第一用户的账户信息;Obtaining account information of the first user;
采集所述第一用户的第一人脸信息;Collecting first face information of the first user;
采集第二用户所购商品的标签信息;Collecting tag information of the products purchased by the second user;
采集所述第二用户的第二人脸信息;Collecting second face information of the second user;
当存在与所述第二人脸信息匹配的第一人脸信息时,根据所述标签信息和匹配的第一人脸信息扣取购物金额。When there is first face information matching the second face information, the shopping amount is deducted according to the tag information and the matched first face information.
第二方面,本申请实施例提供了一种电子设备,所述电子设备包括:In a second aspect, an embodiment of the present application provides an electronic device, where the electronic device includes:
存储器,一个或多个处理器;存储器与处理器通过通信总线相连;处理器被配置为执行存储器中的指令;所述存储介质中存储有用于执行第一方面所述方法中各个步骤的指令。A memory, one or more processors; a memory coupled to the processor via a communication bus; a processor configured to execute instructions in the memory; the storage medium storing instructions for performing the various steps of the method of the first aspect.
第三方面,本申请实施例提供了一种与包括显示器的电子设备结合使用的计算机程序产品,所述计算机程序产品包括计算机可读的存储介质和内嵌于其中的计算机程序机制,所述计算机程序机制包括用于执行上述第一方面所述方法中各个步骤的指令。In a third aspect, an embodiment of the present application provides a computer program product for use in conjunction with an electronic device including a display, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer The program mechanism includes instructions for performing the various steps in the method of the first aspect described above.
第四方面,本申请实施例提供了一种自助购物系统,所述系统,包括:第一人脸采集设备,第二人脸采集设备,账户获取设备,电子标签采集设备,数据存储单元,数据处理单元;In a fourth aspect, the embodiment of the present application provides a self-service shopping system, where the system includes: a first face collection device, a second face collection device, an account acquisition device, an electronic tag collection device, a data storage unit, and data. Processing unit
所述第一人脸采集设备,用于获取第一用户的第一人脸图像;The first face collecting device is configured to acquire a first face image of the first user;
所述第二人脸采集设备,用于获取第二用户的第二人脸图像;The second face collecting device is configured to acquire a second face image of the second user;
所述账户获取设备,用于获取账户标识;The account obtaining device is configured to obtain an account identifier;
所述电子标签采集设备,用于采集所述第二用户所购商品的标签信息;The electronic label collecting device is configured to collect label information of the goods purchased by the second user;
所述数据存储单元,用于存储账户信息、第一人脸信息以及账户信息和第一人脸信息之间的第一关联关系;The data storage unit is configured to store account information, first face information, and a first association relationship between the account information and the first face information;
所述数据存储单元,还用于电子标签、商品的价格以及各电子标签及对应商品的价格之间的第二关联关系;The data storage unit is further configured to use a second association relationship between the price of the electronic label, the commodity, and the price of each electronic label and the corresponding commodity;
所述数据处理单元,用于执行上述第一方面所述方法中各个步骤的指令。The data processing unit is configured to execute the instructions of each step in the method of the first aspect described above.
有益效果如下:The benefits are as follows:
本申请,获取第一用户的账户信息,采集第一用户的第一人脸信息, 采集第二用户所购商品的标签信息,采集第二用户的第二人脸信息,当存在与第二人脸信息匹配的第一人脸信息时,根据标签信息和匹配的第一人脸信息扣取购物金额,实现了无人化的自助购物。The application obtains the account information of the first user, collects the first face information of the first user, collects the tag information of the product purchased by the second user, and collects the second face information of the second user, when the presence and the second person exist. When the face information matches the first face information, the purchase amount is deducted according to the tag information and the matched first face information, thereby realizing unmanned self-service shopping.
附图说明DRAWINGS
下面将参照附图描述本申请的具体实施例,其中:Specific embodiments of the present application will be described below with reference to the accompanying drawings, in which:
图1为本申请实施例中的一种无人商铺结构示意图;1 is a schematic structural diagram of an unmanned shop in the embodiment of the present application;
图2为本申请实施例中的一种基于云端的自助购物方法流程示意图;2 is a schematic flowchart of a cloud-based self-service shopping method according to an embodiment of the present application;
图3为本申请实施例中的另一种基于云端的自助购物方法流程示意图;FIG. 3 is a schematic flowchart of another cloud-based self-service shopping method according to an embodiment of the present application;
图4为本申请实施例中的一种电子设备的结构示意图。FIG. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
具体实施方式Detailed ways
为了使本申请的技术方案及优点更加清楚明白,以下结合附图对本申请的示例性实施例进行进一步详细的说明,显然,所描述的实施例仅是本申请的一部分实施例,而不是所有实施例的穷举。并且在不冲突的情况下,本申请中的实施例及实施例中的特征可以互相结合。The exemplary embodiments of the present application are further described in detail below with reference to the accompanying drawings, in which the embodiments described are only a part of the embodiments of the present application, but not all embodiments. An exhaustive example. And in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.
目前,很多大型超市通过尽量开设更多的结账通道的方式应对同一时间的众多消费者。该方式一方面,需要招聘更多的收银员,另一方面,收到超市场地的限制,结账通道不能无限地增设,这两方面同时都会增加超市的运营成本。At present, many large supermarkets respond to many consumers at the same time by trying to open more checkout channels. On the one hand, this method requires the recruitment of more cashiers. On the other hand, the restrictions on the supermarket venue are received, and the checkout channel cannot be added indefinitely. Both of these aspects will increase the operating cost of the supermarket.
基于此,本申请实施例提供了一种基于云端的自助购物方法,获取第一用户的账户信息,采集第一用户的第一人脸信息,采集第二用户所购商品的标签信息,采集第二用户的第二人脸信息,当存在与第二人脸信息匹配的第一人脸信息时,根据标签信息和匹配的第一人脸信息扣取购物金额,实现了无人化的自助购物。Based on this, the embodiment of the present application provides a cloud-based self-service shopping method, which acquires account information of a first user, collects first face information of the first user, and collects tag information of the product purchased by the second user, and collects the first The second face information of the two users, when there is the first face information matching the second face information, deducting the shopping amount according to the tag information and the matched first face information, thereby realizing unmanned self-service shopping .
本实施例提供的基于云端的自助购物方法可以运行于自助购物系统中,该自助购物系统被应用于无人商铺中。The cloud-based self-service shopping method provided by this embodiment can be run in a self-service shopping system, which is applied to an unmanned shop.
其中,该无人商铺至少包括:入口(1.1),商品选购区域(1.2)Among them, the unmanned shop includes at least: entrance (1.1), commodity purchase area (1.2)
和出口(1.3)。And exports (1.3).
该自助购物系统至少包括:第一人脸采集设备(2.1),第二人脸采集设备(2.2),账户获取设备(2.3),电子标签采集设备(2.4),数据存储单元(2.5),数据处理单元(2.6)。The self-service shopping system includes at least: a first face collection device (2.1), a second face collection device (2.2), an account acquisition device (2.3), an electronic tag collection device (2.4), a data storage unit (2.5), and data. Processing unit (2.6).
1、第一人脸采集设备(2.1)1, the first face collection device (2.1)
第一人脸采集设备(2.1),用于获取用户的人脸图像。The first face collecting device (2.1) is configured to acquire a face image of the user.
第一人脸采集设备(2.1)至少有1台,均位于入口(1.1)处。At least one of the first face collection devices (2.1) is located at the entrance (1.1).
位于入口(1.1)处的第一人脸采集设备(2.1)用于在用户进入该无人商铺时获取其人脸图像。在获取人脸图像后将该人脸图像作为该用户的唯一标识,关联其对应的账户信息,如银行卡号等。The first face collection device (2.1) located at the entrance (1.1) is used to acquire a face image of the user when the user enters the unattended shop. After obtaining the face image, the face image is used as the unique identifier of the user, and the corresponding account information, such as the bank card number, is associated.
第一人脸采集设备(2.1)可以为摄像头。The first face acquisition device (2.1) can be a camera.
2、第二人脸采集设备(2.2)2. Second face collection device (2.2)
第二人脸采集设备(2.2),也用于获取人脸图像。The second face collection device (2.2) is also used to acquire a face image.
第二人脸采集设备(2.2)也至少有1台,但与第一人脸采集设备(2.1)不同,第二人脸采集设备(2.2)位于出口(1.3)处。There is also at least one second face collection device (2.2), but unlike the first face collection device (2.1), the second face collection device (2.2) is located at the exit (1.3).
位于出口(1.3)处的第二人脸采集设备(2.2)用于在用户选购商品后结账时获取其人脸图像。在获取人脸图像后将该人脸图像与第一人脸采集设备(2.1)获取的人脸图像进行比对,确定用户的结算账户,以自动支付购物金额。The second face collection device (2.2) located at the exit (1.3) is used to obtain a face image of the user after the user purchases the item. After acquiring the face image, the face image is compared with the face image acquired by the first face collection device (2.1), and the settlement account of the user is determined to automatically pay the purchase amount.
第二人脸采集设备(2.2)可以为摄像头。The second face acquisition device (2.2) can be a camera.
3、账户获取设备(2.3)3. Account acquisition equipment (2.3)
账户获取设备(2.3),用于获取账户标识。The account acquisition device (2.3) is used to obtain an account identifier.
账户获取设备(2.3)可以为1个,也可以为多个。至少1个账户获取设备(2.3)位于入口(1.1)处。The account acquisition device (2.3) may be one or more. At least one account acquisition device (2.3) is located at the entrance (1.1).
入口(1.1)处的账户获取设备(2.3)在用户进入无人商铺时获取其账户标识,在获取到账户标识后,会将其与第一人脸采集设备(2.1)得到的人脸图像进行关联,以便在结账时根据人脸图像找到对应的账户标识,进而自动支付购物金额。The account obtaining device (2.3) at the entrance (1.1) obtains the account identifier when the user enters the unattended shop, and after obtaining the account identifier, performs the face image obtained by the first face collecting device (2.1). Correlate, so that the corresponding account identifier is found according to the face image at the time of checkout, and the purchase amount is automatically paid.
当账户获取设备(2.3)有多个时,可以在出口(1.3)处安装一个账户获取设备(2.3),出口(1.3)处的账户获取设备(2.3)可以在用户人脸匹配不成功时,方便用户手动支付购物金额。When there are multiple account acquisition devices (2.3), an account acquisition device (2.3) can be installed at the exit (1.3), and the account acquisition device (2.3) at the exit (1.3) can be used when the user face matching is unsuccessful. It is convenient for users to manually pay the purchase amount.
账户获取设备(2.3)可以为账户刷卡装置,除此之外,账户获取设备(2.3)也可以为扫码装置。账户获取设备(2.3)还可以同时为账户刷卡装置和扫码装置。The account obtaining device (2.3) may be an account swiping device, and in addition, the account obtaining device (2.3) may also be a scanning device. The account acquisition device (2.3) can also be an account swiping device and a scanning device at the same time.
4、电子标签采集设备(2.4)4. Electronic tag collection equipment (2.4)
电子标签采集设备(2.4),用于采集用户所购商品的标签信息。The electronic label collecting device (2.4) is used for collecting label information of the products purchased by the user.
电子标签采集设备(2.4)可以为1个或者多个,至少1个电子标签采集设备(2.4)位于出口(1.3)处。The electronic tag collection device (2.4) may be one or more, and at least one electronic tag collection device (2.4) is located at the exit (1.3).
在无人商铺中每一个商品均对应一个唯一的标签,在用户结账时出口(1.3)处的电子标签采集设备(2.4)可以自动采集用户挑选商品的标签,以根据该标签确定用户挑选的商品以及对应的价钱,计算购物金额。In the unmanned shop, each item corresponds to a unique label. At the time of user checkout, the electronic label collection device (2.4) at the exit (1.3) can automatically collect the label of the user's selected item, and determine the item selected by the user according to the label. And the corresponding price, calculate the purchase amount.
电子标签采集设备(2.4)为射频读取器RFID reader。The electronic tag collection device (2.4) is a radio frequency reader RFID reader.
5、数据存储单元(2.5)5, data storage unit (2.5)
数据存储单元(2.5),用于存储入口(1.1)处的账户获取设备(2.3)采集的账户信息、入口(1.1)处的第一人脸采集设备(2.1)采集的人脸信息以及账户信息和人脸信息之间的关联关系。a data storage unit (2.5) for storing account information collected by the account acquisition device (2.3) at the entry (1.1), face information collected by the first face collection device (2.1) at the entry (1.1), and account information The relationship between the information and the face information.
数据存储单元(2.5),还用于存储电子标签、商品的价格以及各电子标 签及对应商品的价格之间的关联关系。The data storage unit (2.5) is also used to store the relationship between the electronic tag, the price of the product, and the price of each electronic tag and the corresponding item.
数据存储单元(2.5)可以为数据库。The data storage unit (2.5) can be a database.
6、数据处理单元(2.6)6, data processing unit (2.6)
数据处理单元(2.6),用于执行本申请提供的基于云端的自助购物方法,以实现自助购物功能。The data processing unit (2.6) is configured to execute the cloud-based self-service shopping method provided by the present application to implement a self-service shopping function.
数据处理单元(2.6)和数据存储单元(2.5)可以位于同一台实体设备中,如服务器。The data processing unit (2.6) and the data storage unit (2.5) may be located in the same physical device, such as a server.
图1展示了上述无人商铺的一种实现结构。其中,整个系统包括摄像头、账户刷卡/扫码装置,RFID读取器、数据处理单元以及数据存储单元。刷卡/扫码装置、摄像头以及RFID reader均可布置在商店的出入通道口。数据处理单元通过刷卡/扫码装置、摄像头以及RFID reader获取用户的账号信息、人脸信息以及商品信息,并进行账户与人脸的关联和存储、人脸识别、账号匹配、价格统计、扣款、删除人脸账号等操作。Figure 1 shows an implementation structure of the above unmanned shop. The entire system includes a camera, an account swipe/scan code device, an RFID reader, a data processing unit, and a data storage unit. The swipe/scan code device, camera and RFID reader can be placed at the entrance and exit of the store. The data processing unit acquires the user's account information, face information, and product information through the swipe/scan code device, the camera, and the RFID reader, and associates and stores the account with the face, face recognition, account matching, price statistics, and debit Delete the face account and other operations.
在进行自助购物之前,会将无人商铺中每一个商品均对应一个唯一的标签,如将商品选购区域(1.2)中的每一个商品贴上一个独有的RFID标签。该RFID标签作为商品的唯一标签,可以为RFID标签关联商品名称,商品价格,商品产地等商品信息,进而通过该RFID标签确定商品名称,商品价格,商品产地等商品信息。Before self-service shopping, each item in the unmanned shop will be assigned a unique label, such as a unique RFID tag attached to each item in the item purchase area (1.2). The RFID tag is a unique tag of the product, and the RFID tag can be associated with the product name such as the product name, the product price, and the product origin, and the product information such as the product name, the product price, and the product origin can be determined by the RFID tag.
将电子标签、商品的价格等商品信息以及各电子标签及对应商品的价格等商品信息之间的第二关联关系存储在数据存储单元(2.5)中。The second association relationship between the product information such as the price of the electronic tag and the product, and the product information such as the price of each electronic tag and the corresponding product is stored in the data storage unit (2.5).
数据处理单元(2.6)所执行的本申请提供的基于云端的自助购物方法的流程如图2所示。The flow of the cloud-based self-service shopping method provided by the data processing unit (2.6) is as shown in FIG. 2 .
201,获取第一用户的账户信息。201. Acquire account information of the first user.
其中,第一用户为从入口(1.1)进入的用户。Among them, the first user is a user who enters from the entrance (1.1).
在本步骤执行之前,可以先获取第一用户的账户授权。在执行本步骤 时,获取账户标识,根据账户标识获取第一用户的账户信息。Before the execution of this step, the account authorization of the first user may be obtained first. When performing this step, the account identifier is obtained, and the account information of the first user is obtained according to the account identifier.
其中,账户标识是根据账户授权生成的。账户信息可以为银行账户,也可以为,电子货币等。Among them, the account identifier is generated according to the account authorization. The account information can be a bank account or an electronic money.
例如,在本步骤执行之前先通过用户手机内部专用的APP预先进行银行账户授权绑定,在用户进门时,执行本步骤,获取银行账户。For example, before the execution of this step, the bank account authorization binding is performed in advance through the APP dedicated to the user's mobile phone. When the user enters the door, this step is performed to obtain the bank account.
如APP时实时动态生成二维码,通过二维码扫描就获得用户的账户信息。If the APP dynamically generates a QR code in real time, the user's account information is obtained by scanning the QR code.
202,采集第一用户的第一人脸信息。202: Collect first face information of the first user.
在执行步骤201之后,可以自动执行步骤202。除此之外,还可以触发执行步骤202。触发条件为:确认成功获取第一用户的账户信息;或者,监测到人脸信息采集的第一条件被触发。After performing step 201, step 202 can be performed automatically. In addition to this, step 202 can also be triggered. The triggering condition is: confirming that the account information of the first user is successfully obtained; or, the first condition that the face information collection is detected is triggered.
其中,第一条件包括但不限于:确认成功获取第一用户的账户信息,并且,在入口(1.1)处展示的人脸信息采集按钮被用户点击。The first condition includes, but is not limited to, confirming that the account information of the first user is successfully acquired, and the face information collection button displayed at the portal (1.1) is clicked by the user.
即步骤201被成功执行后触发执行步骤202。或者,步骤201被成功执行,并且,在入口(1.1)处展示的人脸信息采集按钮被用户点击之后触发执行步骤202。That is, after step 201 is successfully executed, step 202 is triggered. Alternatively, step 201 is successfully performed, and step 202 is triggered after the face information collection button displayed at the portal (1.1) is clicked by the user.
例如,在获取账号时将摄像头布置在入口合适的位置直接在无需用户配合的情况下采集人脸信息,一旦扫码成功则立刻触发人脸图像的采集;也可以在账号获取成功后,由用户通过手动触发人脸信息采集。For example, when the account is acquired, the camera is arranged at the appropriate position of the portal to directly collect the face information without the cooperation of the user. Once the scan code is successful, the face image is immediately triggered; or after the account is successfully obtained, the user can also obtain the account. Manually trigger face information collection.
步骤202在执行时,可以获取第一用户的第一人脸图像,将第一人脸图像确定为第一人脸信息;或者,获取第一用户的第一人脸图像,对第一人脸图像进行人脸检测,从检测的第一人脸图像中提取第一人脸特征信息,将第一人脸特征信息确定为第一人脸信息。When the step 202 is performed, the first face image of the first user may be obtained, and the first face image is determined as the first face information; or the first face image of the first user is acquired, and the first face is obtained. The image is subjected to face detection, and the first face feature information is extracted from the detected first face image, and the first face feature information is determined as the first face information.
例如,在采集第一人脸信息时,可以直接获取原始的人脸图像信息,也可以是经过二次提取的人脸信息,如先进行对图像进行人脸检测,然后 基于检测的人脸图像提取人脸特征。For example, when the first face information is collected, the original face image information may be directly obtained, or may be a second extracted face information, such as performing face detection on the image first, and then based on the detected face image. Extract face features.
在采集到第一用户的第一人脸信息之后,会将账户信息和第一人脸信息进行关联,并将账户信息、第一人脸信息以及账户信息和第一人脸信息之间的第一关联关系存储在数据存储单元(2.5)中,以方便该用户选购完成后自动结账。After collecting the first face information of the first user, the account information and the first face information are associated, and the account information, the first face information, and the first information between the account information and the first face information are An association relationship is stored in the data storage unit (2.5) to facilitate automatic checkout after the user completes the purchase.
例如,根据获取账号的时间和获取人脸信息的时间将二者进行关联,并将关联的信息进行存储。For example, the two are associated according to the time when the account is acquired and the time when the face information is acquired, and the associated information is stored.
在对不同用户执行步骤201和步骤202后,数据存储单元(2.5)除存储有所有商品的电子标签、商品的价格等商品信息以及各电子标签及对应商品的价格等商品信息之间的第二关联关系之外,还会存储进入无人商铺的所有用户的人脸信息,所有用户的账户信息以及所有用户的人脸信息与账户信息之间的第一关联关系。After performing steps 201 and 202 on different users, the data storage unit (2.5) stores, in addition to the electronic tags storing all the products, the price information of the products, and the like, and the second information between the electronic tags and the price of the corresponding products. In addition to the association relationship, the face information of all users entering the unattended shop, the account information of all users, and the first relationship between the face information of all users and the account information are also stored.
步骤202执行之后,各用户均在无人商铺的商品选购区域(1.2)自行选购。当任一用户选购完毕,欲结账时,执行下述步骤203至步骤205。After the execution of step 202, each user purchases himself in the merchandise purchase area (1.2) of the unmanned shop. When any user purchases and wants to checkout, the following steps 203 to 205 are performed.
203,采集第二用户所购商品的标签信息。203. Collect tag information of the product purchased by the second user.
其中,第二用户为欲结账,且结账后从出口(1.3)出去的用户。The second user is a user who wants to check out and exits from the exit (1.3) after checkout.
由于在进行自助购物之前,已经将无人商铺中每一个商品均对应一个唯一的标签,并将电子标签、商品的价格等商品信息以及各电子标签及对应商品的价格等商品信息之间的第二关联关系存储在数据存储单元(2.5)中,因此本步骤的实现方案为:出口(1.3)处的电子标签采集设备(2.4)读取第二用户所购商品的电子标签。Before the self-service shopping, each item in the unmanned shop has been assigned a unique label, and the product information such as the price of the electronic label and the product, and the price of each electronic label and the corresponding product are the same. The second association relationship is stored in the data storage unit (2.5). Therefore, the implementation of this step is: the electronic tag collection device (2.4) at the exit (1.3) reads the electronic tag of the product purchased by the second user.
并在采集第二用户所购商品的标签信息之后,根据电子标签以及第二关联关系,确定第二用户所购商品的价格,将价格确定为购物金额。And after collecting the tag information of the product purchased by the second user, determining the price of the product purchased by the second user according to the electronic tag and the second association relationship, and determining the price as the shopping amount.
若第二用户所购商品有多个,将所购多个商品的价格之和确定为购物金额。If there are multiple items purchased by the second user, the sum of the prices of the purchased plurality of items is determined as the purchase amount.
例如,用于出门时布置在出口通道的RFID reader自动读取一定距离内的RFID的标签信息,获取商品的ID信息,然后查询数据库,统计用户购买商品的价格。For example, the RFID reader disposed in the exit channel for exiting the door automatically reads the RFID tag information within a certain distance, acquires the ID information of the product, and then queries the database to count the price of the user's purchased product.
204,采集第二用户的第二人脸信息。204: Collect second face information of the second user.
在执行步骤203之后,可以自动执行步骤204。除此之外,还可以触发执行步骤204。触发条件为:确认成功采集到至少一个标签信息;或者,监测到人脸信息采集的第二条件被触发。After performing step 203, step 204 can be performed automatically. In addition to this, step 204 can also be triggered. The trigger condition is: confirm that the at least one tag information is successfully collected; or the second condition that the face information is detected is triggered.
其中,第二条件包括但不限于:在出口(1.3)处展示的人脸信息采集按钮被用户点击。Wherein, the second condition includes but is not limited to: the face information collection button displayed at the exit (1.3) is clicked by the user.
即在步骤203中出口(1.3)处的电子标签采集设备(2.4)成功读取到一个第二用户所购商品的电子标签。或者,监测到在出口(1.3)处展示的人脸信息采集按钮被用户点击。That is, in step 203, the electronic tag collection device (2.4) at the exit (1.3) successfully reads an electronic tag of a product purchased by the second user. Alternatively, it is monitored that the face information collection button displayed at the exit (1.3) is clicked by the user.
例如,在执行步骤202的同时摄像头自动采集人脸图像,也可以由RFID reader来触发人脸图像的采集,比如RFID reader识别到商品后,立即触发人脸图像的采集。For example, when the step 202 is performed, the camera automatically collects the face image, and the RFID reader can also trigger the collection of the face image. For example, after the RFID reader recognizes the product, the face image is immediately triggered.
在采集人脸图像之后,还会对该图像进行人脸识别。具体的,获取第二用户的第二人脸图像,将第二人脸图像确定为第二人脸信息;或者,获取第二用户的第二人脸图像,对第二人脸图像进行人脸检测,从检测的第二人脸图像中提取第二人脸特征信息,将第二人脸特征信息确定为第二人脸信息。After the face image is acquired, the image is also subjected to face recognition. Specifically, acquiring a second face image of the second user, determining the second face image as the second face information; or acquiring the second face image of the second user, and performing the face on the second face image The detecting, extracting the second face feature information from the detected second face image, and determining the second face feature information as the second face information.
例如,采集到人脸图像后,进行人脸检测和特征提取。For example, after the face image is acquired, face detection and feature extraction are performed.
执行步骤204之后,还会将数据存储单元(2.5)中存储的每一个第一人脸信息与步骤204采集的第二人脸信息进行匹配,计算每一个第一人脸信息与该第二人脸信息之间的相似度,如果存在一个第一人脸信息与第二人脸信息的相似度大于预设阈值,则确定存在与第二人脸信息匹配的第一 人脸信息,该与第二人脸信息的相似度大于预设阈值的第一人脸信息即为匹配的第一人脸信息。After performing step 204, each first face information stored in the data storage unit (2.5) is also matched with the second face information collected in step 204, and each first face information and the second person are calculated. The similarity between the face information, if there is a similarity between the first face information and the second face information is greater than a preset threshold, determining that there is first face information matching the second face information, the The first face information whose similarity of the two face information is greater than the preset threshold is the matched first face information.
例如,将第二人脸信息与数据库中的第一人脸信息进行相似性比对(如果库中的人脸信息为人脸的原始图像信息,则需要先进行特征提取),相似性可以通过欧氏距离或者余弦距离进行度量,找到最相似的人脸后判断相似度是否超过设定的阈值,如果超过,则匹配成功。For example, the second face information is compared with the first face information in the database for similarity (if the face information in the library is the original image information of the face, the feature extraction is required first), and the similarity can pass through the European The distance or the cosine distance is measured. After finding the most similar face, it is judged whether the similarity exceeds the set threshold. If it is exceeded, the matching is successful.
当不存在与第二人脸信息匹配的第一人脸信息时,则匹配失败,此时可以向该第二用户发送信息不匹配消息,以使第二用户根据消息触发人脸信息采集的第二条件,或者,以使第二用户根据消息手动支付购物金额。When there is no first face information matching the second face information, the matching fails. At this time, the information mismatch message may be sent to the second user, so that the second user may trigger the face information collection according to the message. The second condition, or, is such that the second user manually pays for the purchase amount based on the message.
例如,当匹配失败时,可提醒用户重新刷脸,或者手动支付。For example, when the match fails, the user can be reminded to re-paint the face, or pay by hand.
205,当存在与第二人脸信息匹配的第一人脸信息时,根据标签信息和匹配的第一人脸信息扣取购物金额。205. When there is first face information that matches the second face information, the shopping amount is deducted according to the tag information and the matched first face information.
由于步骤202之后,数据存储单元(2.5)会存储进入无人商铺的所有用户的人脸信息,所有用户的账户信息以及所有用户的人脸信息与账户信息之间的第一关联关系,因此,步骤205会根据匹配的第一人脸信息及第一关联关系,确定匹配的第一人脸信息对应的账户信息,根据对应的账户信息扣取购物金额。After step 202, the data storage unit (2.5) stores the face information of all users entering the unattended shop, the account information of all users, and the first relationship between the face information of all users and the account information, therefore, Step 205: Determine, according to the matched first face information and the first association relationship, account information corresponding to the matched first face information, and deduct the purchase amount according to the corresponding account information.
另外,数据存储单元(2.5)中存储的信息越多,数据存储单元(2.5)运行越慢,因此在扣取购物金额之后,还会删除匹配的第一人脸信息,匹配的第一人脸信息对应的账户信息、第匹配的第一人脸信息与对应的账户信息之间的关联关系。In addition, the more information stored in the data storage unit (2.5), the slower the data storage unit (2.5) runs, so after the purchase amount is deducted, the matching first face information is also deleted, and the matching first face is deleted. The relationship between the account information corresponding to the information, the first matching face information and the corresponding account information.
例如,根据人脸信息匹配用户的账号信息,并进行扣款,最后将人脸信息和账户信息从数据库中删除。For example, the user's account information is matched according to the face information, and the deduction is performed, and finally the face information and the account information are deleted from the database.
执行至此,完成本申请所提供的基于云端的自助购物方法,实现用户的自助购物。To this end, the cloud-based self-service shopping method provided by the present application is completed, and the self-service shopping of the user is realized.
参见图3,对本实施例提供的基于云端的自助购物方法流程再次说明。Referring to FIG. 3, the flow of the cloud-based self-service shopping method provided in this embodiment is again described.
若用户进入无人商铺,在其进门时通过手机扫码/刷卡获取用户授权的付款账号,通过摄像头捕捉人脸信息,系统后台关联用户账号和人脸信息并存储到数据库,数据库还存储有所有商品的ID和价格信息。所有商品贴有RFID标签。用户出门时,RFID读卡器获取用户商品上ID信息,摄像头获取人脸信息,通过人脸识别获取用户对应的付款账号,同时根据商品ID统计商品价格;然后进行扣款,扣款成功后,删除系统后台中的人脸信息和账号信息,有利于保证用户信息安全,并且保证人脸识别的响应速度和用户体验。If the user enters the unmanned shop, when the user enters the door, the user searches for the payment account authorized by the mobile phone, and captures the face information through the camera. The system associates the user account and face information with the database and stores it in the database. The database also stores all the information. Product ID and price information. All items are tagged with RFID. When the user goes out, the RFID card reader obtains the ID information on the user's product, the camera obtains the face information, obtains the payment account corresponding to the user through face recognition, and simultaneously counts the product price according to the product ID; then, the deduction is performed, and after the deduction is successful, Deleting the face information and account information in the background of the system is beneficial to ensure the security of the user information and ensure the response speed and user experience of the face recognition.
有益效果:Beneficial effects:
本申请实施例,获取第一用户的账户信息,采集第一用户的第一人脸信息,采集第二用户所购商品的标签信息,采集第二用户的第二人脸信息,当存在与第二人脸信息匹配的第一人脸信息时,根据标签信息和匹配的第一人脸信息扣取购物金额,实现了无人化的自助购物。In the embodiment of the present application, the account information of the first user is acquired, the first face information of the first user is collected, the tag information of the product purchased by the second user is collected, and the second face information of the second user is collected, when the presence and the When the first face information of the two face information matches, the purchase amount is deducted according to the tag information and the matched first face information, thereby realizing unmanned self-service shopping.
基于同一构思,本申请实施例还提供了一种电子设备,参见图4,电子设备包括:Based on the same concept, the embodiment of the present application further provides an electronic device. Referring to FIG. 4, the electronic device includes:
存储器401,一个或多个处理器402;以及收发组件403,存储器、处理器以及收发组件403通过通信总线(本申请实施例中是以通信总线为I/O总线进行的说明)相连;所述存储介质中存储有用于执行下述各个步骤的指令:a memory 401, one or more processors 402; and a transceiver component 403, the memory, the processor, and the transceiver component 403 are connected by a communication bus (in the embodiment of the present application, the communication bus is an I/O bus); The storage medium stores instructions for performing the following steps:
获取第一用户的账户信息;Obtaining account information of the first user;
采集第一用户的第一人脸信息;Collecting first face information of the first user;
采集第二用户所购商品的标签信息;Collecting tag information of the products purchased by the second user;
采集第二用户的第二人脸信息;Collecting second face information of the second user;
当存在与第二人脸信息匹配的第一人脸信息时,根据标签信息和匹配 的第一人脸信息扣取购物金额。When there is the first face information matching the second face information, the shopping amount is deducted according to the tag information and the matched first face information.
可选地,获取第一用户的账户信息之前,还包括:Optionally, before acquiring the account information of the first user, the method further includes:
获取第一用户的账户授权。Obtain the account authorization of the first user.
可选地,获取第一用户的账户信息,包括:Optionally, obtaining account information of the first user, including:
获取账户标识,账户标识是根据账户授权生成的;Obtain an account identifier, and the account identifier is generated according to an account authorization;
根据账户标识获取第一用户的账户信息。Obtaining the account information of the first user according to the account identifier.
可选地,采集第一用户的第一人脸信息之前,还包括:Optionally, before collecting the first face information of the first user, the method further includes:
确认成功获取第一用户的账户信息;或者,Confirm that the first user's account information is successfully obtained; or,
监测到人脸信息采集的第一条件被触发。The first condition for monitoring the face information collection is triggered.
可选地,采集第一用户的第一人脸信息,包括:Optionally, collecting the first face information of the first user, including:
获取第一用户的第一人脸图像,将第一人脸图像确定为第一人脸信息;或者,Obtaining a first face image of the first user, and determining the first face image as the first face information; or
获取第一用户的第一人脸图像,对第一人脸图像进行人脸检测,从检测的第一人脸图像中提取第一人脸特征信息,将第一人脸特征信息确定为第一人脸信息。Obtaining a first face image of the first user, performing face detection on the first face image, extracting first face feature information from the detected first face image, and determining the first face feature information as the first Face information.
可选地,采集第一用户的第一人脸信息之后,还包括:Optionally, after collecting the first face information of the first user, the method further includes:
关联账户信息和第一人脸信息;Linking account information and first face information;
存储账户信息、第一人脸信息以及账户信息和第一人脸信息之间的第一关联关系。The first relationship between the account information, the first face information, and the account information and the first face information is stored.
可选地,每件商品均设置电子标签;Optionally, an electronic tag is placed for each item;
采集第二用户所购商品的标签信息之前,还包括:Before collecting the tag information of the goods purchased by the second user, the method further includes:
关联各电子标签及对应商品的价格;Associate the price of each electronic label and corresponding product;
存储电子标签、商品的价格以及各电子标签及对应商品的价格之间的第二关联关系。The second association between the price of the electronic tag, the item, and the price of each electronic tag and the corresponding item is stored.
可选地,采集第二用户所购商品的标签信息,包括:Optionally, collecting tag information of the product purchased by the second user, including:
读取第二用户所购商品的电子标签;Reading an electronic tag of a product purchased by a second user;
采集第二用户所购商品的标签信息之后,还包括:After collecting the tag information of the product purchased by the second user, the method further includes:
根据电子标签以及第二关联关系,确定第二用户所购商品的价格,将价格确定为购物金额。The price of the item purchased by the second user is determined according to the electronic tag and the second association relationship, and the price is determined as the purchase amount.
可选地,采集第二用户的第二人脸信息之前,还包括:Optionally, before collecting the second face information of the second user, the method further includes:
确认成功采集到至少一个标签信息;或者,Confirm that at least one tag information is successfully collected; or,
监测到人脸信息采集的第二条件被触发。The second condition for monitoring the face information collection is triggered.
可选地,采集第二用户的第二人脸信息,包括:Optionally, collecting second face information of the second user, including:
获取第二用户的第二人脸图像,将第二人脸图像确定为第二人脸信息;或者,Obtaining a second face image of the second user, and determining the second face image as the second face information; or
获取第二用户的第二人脸图像,对第二人脸图像进行人脸检测,从检测的第二人脸图像中提取第二人脸特征信息,将第二人脸特征信息确定为第二人脸信息。Obtaining a second face image of the second user, performing face detection on the second face image, extracting second face feature information from the detected second face image, and determining the second face feature information as the second Face information.
可选地,匹配的第一人脸信息与第二人脸信息的相似度大于预设阈值。Optionally, the similarity between the matched first face information and the second face information is greater than a preset threshold.
可选地,根据标签信息和匹配的第一人脸信息扣取购物金额之前,还包括:Optionally, before deducting the purchase amount according to the label information and the matched first face information, the method further includes:
当不存在与第二人脸信息匹配的第一人脸信息时,发送信息不匹配消息,以使第二用户根据消息触发人脸信息采集的第二条件,或者,以使第二用户根据消息手动支付购物金额。When there is no first face information matching the second face information, the information does not match the message, so that the second user triggers the second condition of the face information collection according to the message, or so that the second user according to the message Manually pay for the purchase amount.
可选地,根据标签信息和匹配的第一人脸信息扣取购物金额,包括:Optionally, the shopping amount is deducted according to the tag information and the matched first face information, including:
根据匹配的第一人脸信息及第一关联关系,确定匹配的第一人脸信息对应的账户信息;Determining account information corresponding to the matched first face information according to the matched first face information and the first association relationship;
根据对应的账户信息扣取购物金额。The purchase amount is deducted according to the corresponding account information.
可选地,根据标签信息和匹配的第一人脸信息扣取购物金额之后,还包括:Optionally, after deducting the purchase amount according to the label information and the matched first face information, the method further includes:
删除匹配的第一人脸信息,匹配的第一人脸信息对应的账户信息、第匹配的第一人脸信息与对应的账户信息之间的关联关系。The matching first face information, the matching account information corresponding to the first face information, the first matching face information and the corresponding account information are deleted.
不难理解的是,在具体实施时,就为了实现本申请的基本目的而言,上述的并不必然的需要包含上述的收发组件403。It is not difficult to understand that, in the specific implementation, in order to achieve the basic purpose of the present application, the above-mentioned transceiver component 403 is not necessarily required.
有益效果:Beneficial effects:
本申请实施例,获取第一用户的账户信息,采集第一用户的第一人脸信息,采集第二用户所购商品的标签信息,采集第二用户的第二人脸信息,当存在与第二人脸信息匹配的第一人脸信息时,根据标签信息和匹配的第一人脸信息扣取购物金额,实现了无人化的自助购物。In the embodiment of the present application, the account information of the first user is acquired, the first face information of the first user is collected, the tag information of the product purchased by the second user is collected, and the second face information of the second user is collected, when the presence and the When the first face information of the two face information matches, the purchase amount is deducted according to the tag information and the matched first face information, thereby realizing unmanned self-service shopping.
再一方面,本申请实施例还提供了一种与包括显示器的电子设备结合使用的计算机程序产品,所述计算机程序产品包括计算机可读的存储介质和内嵌于其中的计算机程序机制,所述计算机程序机制包括用于执行下述各个步骤的指令:In still another aspect, an embodiment of the present application further provides a computer program product for use in conjunction with an electronic device including a display, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, The computer program mechanism includes instructions for performing the various steps described below:
获取第一用户的账户信息;Obtaining account information of the first user;
采集第一用户的第一人脸信息;Collecting first face information of the first user;
采集第二用户所购商品的标签信息;Collecting tag information of the products purchased by the second user;
采集第二用户的第二人脸信息;Collecting second face information of the second user;
当存在与第二人脸信息匹配的第一人脸信息时,根据标签信息和匹配的第一人脸信息扣取购物金额。When there is the first face information matching the second face information, the shopping amount is deducted according to the tag information and the matched first face information.
可选地,获取第一用户的账户信息之前,还包括:Optionally, before acquiring the account information of the first user, the method further includes:
获取第一用户的账户授权。Obtain the account authorization of the first user.
可选地,获取第一用户的账户信息,包括:Optionally, obtaining account information of the first user, including:
获取账户标识,账户标识是根据账户授权生成的;Obtain an account identifier, and the account identifier is generated according to an account authorization;
根据账户标识获取第一用户的账户信息。Obtaining the account information of the first user according to the account identifier.
可选地,采集第一用户的第一人脸信息之前,还包括:Optionally, before collecting the first face information of the first user, the method further includes:
确认成功获取第一用户的账户信息;或者,Confirm that the first user's account information is successfully obtained; or,
监测到人脸信息采集的第一条件被触发。The first condition for monitoring the face information collection is triggered.
可选地,采集第一用户的第一人脸信息,包括:Optionally, collecting the first face information of the first user, including:
获取第一用户的第一人脸图像,将第一人脸图像确定为第一人脸信息;或者,Obtaining a first face image of the first user, and determining the first face image as the first face information; or
获取第一用户的第一人脸图像,对第一人脸图像进行人脸检测,从检测的第一人脸图像中提取第一人脸特征信息,将第一人脸特征信息确定为第一人脸信息。Obtaining a first face image of the first user, performing face detection on the first face image, extracting first face feature information from the detected first face image, and determining the first face feature information as the first Face information.
可选地,采集第一用户的第一人脸信息之后,还包括:Optionally, after collecting the first face information of the first user, the method further includes:
关联账户信息和第一人脸信息;Linking account information and first face information;
存储账户信息、第一人脸信息以及账户信息和第一人脸信息之间的第一关联关系。The first relationship between the account information, the first face information, and the account information and the first face information is stored.
可选地,每件商品均设置电子标签;Optionally, an electronic tag is placed for each item;
采集第二用户所购商品的标签信息之前,还包括:Before collecting the tag information of the goods purchased by the second user, the method further includes:
关联各电子标签及对应商品的价格;Associate the price of each electronic label and corresponding product;
存储电子标签、商品的价格以及各电子标签及对应商品的价格之间的第二关联关系。The second association between the price of the electronic tag, the item, and the price of each electronic tag and the corresponding item is stored.
可选地,采集第二用户所购商品的标签信息,包括:Optionally, collecting tag information of the product purchased by the second user, including:
读取第二用户所购商品的电子标签;Reading an electronic tag of a product purchased by a second user;
采集第二用户所购商品的标签信息之后,还包括:After collecting the tag information of the product purchased by the second user, the method further includes:
根据电子标签以及第二关联关系,确定第二用户所购商品的价格,将价格确定为购物金额。The price of the item purchased by the second user is determined according to the electronic tag and the second association relationship, and the price is determined as the purchase amount.
可选地,采集第二用户的第二人脸信息之前,还包括:Optionally, before collecting the second face information of the second user, the method further includes:
确认成功采集到至少一个标签信息;或者,Confirm that at least one tag information is successfully collected; or,
监测到人脸信息采集的第二条件被触发。The second condition for monitoring the face information collection is triggered.
可选地,采集第二用户的第二人脸信息,包括:Optionally, collecting second face information of the second user, including:
获取第二用户的第二人脸图像,将第二人脸图像确定为第二人脸信息;或者,Obtaining a second face image of the second user, and determining the second face image as the second face information; or
获取第二用户的第二人脸图像,对第二人脸图像进行人脸检测,从检测的第二人脸图像中提取第二人脸特征信息,将第二人脸特征信息确定为第二人脸信息。Obtaining a second face image of the second user, performing face detection on the second face image, extracting second face feature information from the detected second face image, and determining the second face feature information as the second Face information.
可选地,匹配的第一人脸信息与第二人脸信息的相似度大于预设阈值。Optionally, the similarity between the matched first face information and the second face information is greater than a preset threshold.
可选地,根据标签信息和匹配的第一人脸信息扣取购物金额之前,还包括:Optionally, before deducting the purchase amount according to the label information and the matched first face information, the method further includes:
当不存在与第二人脸信息匹配的第一人脸信息时,发送信息不匹配消息,以使第二用户根据消息触发人脸信息采集的第二条件,或者,以使第二用户根据消息手动支付购物金额。When there is no first face information matching the second face information, the information does not match the message, so that the second user triggers the second condition of the face information collection according to the message, or so that the second user according to the message Manually pay for the purchase amount.
可选地,根据标签信息和匹配的第一人脸信息扣取购物金额,包括:Optionally, the shopping amount is deducted according to the tag information and the matched first face information, including:
根据匹配的第一人脸信息及第一关联关系,确定匹配的第一人脸信息对应的账户信息;Determining account information corresponding to the matched first face information according to the matched first face information and the first association relationship;
根据对应的账户信息扣取购物金额。The purchase amount is deducted according to the corresponding account information.
可选地,根据标签信息和匹配的第一人脸信息扣取购物金额之后,还包括:Optionally, after deducting the purchase amount according to the label information and the matched first face information, the method further includes:
删除匹配的第一人脸信息,匹配的第一人脸信息对应的账户信息、第匹配的第一人脸信息与对应的账户信息之间的关联关系。The matching first face information, the matching account information corresponding to the first face information, the first matching face information and the corresponding account information are deleted.
有益效果:Beneficial effects:
本申请实施例,获取第一用户的账户信息,采集第一用户的第一人脸信息,采集第二用户所购商品的标签信息,采集第二用户的第二人脸信息,当存在与第二人脸信息匹配的第一人脸信息时,根据标签信息和匹配的第一人脸信息扣取购物金额,实现了无人化的自助购物。In the embodiment of the present application, the account information of the first user is acquired, the first face information of the first user is collected, the tag information of the product purchased by the second user is collected, and the second face information of the second user is collected, when the presence and the When the first face information of the two face information matches, the purchase amount is deducted according to the tag information and the matched first face information, thereby realizing unmanned self-service shopping.
本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art will appreciate that embodiments of the present application can be provided as a method, system, or computer program product. Thus, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment in combination of software and hardware. Moreover, the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
尽管已描述了本申请的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例作出另外的变更和修改。所以,所 附权利要求意欲解释为包括优选实施例以及落入本申请范围的所有变更和修改。While the preferred embodiment of the present application has been described, it will be apparent that those skilled in the art can make further changes and modifications to the embodiments. Therefore, it is intended that the appended claims be interpreted as

Claims (18)

  1. 一种基于云端的自助购物方法,其特征在于,所述方法,包括:A cloud-based self-service shopping method, characterized in that the method comprises:
    获取第一用户的账户信息;Obtaining account information of the first user;
    采集所述第一用户的第一人脸信息;Collecting first face information of the first user;
    采集第二用户所购商品的标签信息;Collecting tag information of the products purchased by the second user;
    采集所述第二用户的第二人脸信息;Collecting second face information of the second user;
    当存在与所述第二人脸信息匹配的第一人脸信息时,根据所述标签信息和匹配的第一人脸信息扣取购物金额。When there is first face information matching the second face information, the shopping amount is deducted according to the tag information and the matched first face information.
  2. 根据权利要求1所述的方法,其特征在于,所述获取第一用户的账户信息之前,还包括:The method according to claim 1, wherein before the obtaining the account information of the first user, the method further comprises:
    获取第一用户的账户授权。Obtain the account authorization of the first user.
  3. 根据权利要求2所述的方法,其特征在于,所述获取第一用户的账户信息,包括:The method according to claim 2, wherein the obtaining the account information of the first user comprises:
    获取账户标识,所述账户标识是根据所述账户授权生成的;Obtaining an account identifier, the account identifier being generated according to the account authorization;
    根据所述账户标识获取第一用户的账户信息。Obtaining account information of the first user according to the account identifier.
  4. 根据权利要求1所述的方法,其特征在于,所述采集所述第一用户的第一人脸信息之前,还包括:The method according to claim 1, wherein before the collecting the first face information of the first user, the method further comprises:
    确认成功获取第一用户的账户信息;或者,Confirm that the first user's account information is successfully obtained; or,
    监测到人脸信息采集的第一条件被触发。The first condition for monitoring the face information collection is triggered.
  5. 根据权利要求1所述的方法,其特征在于,所述采集所述第一用户的第一人脸信息,包括:The method according to claim 1, wherein the collecting the first face information of the first user comprises:
    获取所述第一用户的第一人脸图像,将所述第一人脸图像确定为所述第一人脸信息;或者,Obtaining a first face image of the first user, and determining the first face image as the first face information; or
    获取所述第一用户的第一人脸图像,对所述第一人脸图像进行人脸检测,从检测的第一人脸图像中提取第一人脸特征信息,将所述第一人脸特 征信息确定为所述第一人脸信息。Obtaining a first face image of the first user, performing face detection on the first face image, extracting first face feature information from the detected first face image, and using the first face The feature information is determined as the first face information.
  6. 根据权利要求1所述的方法,其特征在于,所述采集所述第一用户的第一人脸信息之后,还包括:The method according to claim 1, wherein after the collecting the first face information of the first user, the method further comprises:
    关联账户信息和第一人脸信息;Linking account information and first face information;
    存储账户信息、第一人脸信息以及账户信息和第一人脸信息之间的第一关联关系。The first relationship between the account information, the first face information, and the account information and the first face information is stored.
  7. 根据权利要求6所述的方法,其特征在于,每件商品均设置电子标签;The method according to claim 6, wherein each article is provided with an electronic tag;
    所述采集第二用户所购商品的标签信息之前,还包括:Before collecting the label information of the product purchased by the second user, the method further includes:
    关联各电子标签及对应商品的价格;Associate the price of each electronic label and corresponding product;
    存储电子标签、商品的价格以及各电子标签及对应商品的价格之间的第二关联关系。The second association between the price of the electronic tag, the item, and the price of each electronic tag and the corresponding item is stored.
  8. 根据权利要求7所述的方法,其特征在于,所述采集第二用户所购商品的标签信息,包括:The method according to claim 7, wherein the collecting tag information of the item purchased by the second user comprises:
    读取所述第二用户所购商品的电子标签;Reading an electronic tag of the product purchased by the second user;
    所述采集第二用户所购商品的标签信息之后,还包括:After the collecting the label information of the product purchased by the second user, the method further includes:
    根据电子标签以及第二关联关系,确定所述第二用户所购商品的价格,将所述价格确定为购物金额。And determining, according to the electronic tag and the second association relationship, a price of the commodity purchased by the second user, and determining the price as the shopping amount.
  9. 根据权利要求8所述的方法,其特征在于,所述采集所述第二用户的第二人脸信息之前,还包括:The method according to claim 8, wherein before the collecting the second face information of the second user, the method further comprises:
    确认成功采集到至少一个标签信息;或者,Confirm that at least one tag information is successfully collected; or,
    监测到人脸信息采集的第二条件被触发。The second condition for monitoring the face information collection is triggered.
  10. 根据权利要求9所述的方法,其特征在于,所述采集所述第二用户的第二人脸信息,包括:The method according to claim 9, wherein the collecting the second face information of the second user comprises:
    获取所述第二用户的第二人脸图像,将所述第二人脸图像确定为所述 第二人脸信息;或者,Obtaining a second face image of the second user, and determining the second face image as the second face information; or
    获取所述第二用户的第二人脸图像,对所述第二人脸图像进行人脸检测,从检测的第二人脸图像中提取第二人脸特征信息,将所述第二人脸特征信息确定为所述第二人脸信息。Acquiring a second face image of the second user, performing face detection on the second face image, extracting second face feature information from the detected second face image, and using the second face The feature information is determined as the second face information.
  11. 根据权利要求1所述的方法,其特征在于,所述匹配的第一人脸信息与所述第二人脸信息的相似度大于预设阈值。The method according to claim 1, wherein the similarity between the matched first face information and the second face information is greater than a preset threshold.
  12. 根据权利要求8所述的方法,其特征在于,所述根据所述标签信息和匹配的第一人脸信息扣取购物金额之前,还包括:The method according to claim 8, wherein before the deducting the shopping amount according to the tag information and the matched first face information, the method further comprises:
    当不存在与所述第二人脸信息匹配的第一人脸信息时,发送信息不匹配消息,以使所述第二用户根据所述消息触发人脸信息采集的第二条件,或者,以使所述第二用户根据所述消息手动支付所述购物金额。When there is no first face information matching the second face information, the information does not match the message, so that the second user triggers the second condition of the face information collection according to the message, or Causing the second user to manually pay the purchase amount based on the message.
  13. 根据权利要求8所述的方法,其特征在于,所述根据所述标签信息和匹配的第一人脸信息扣取购物金额,包括:The method according to claim 8, wherein the deducting the shopping amount according to the tag information and the matched first face information comprises:
    根据所述匹配的第一人脸信息及所述第一关联关系,确定所述匹配的第一人脸信息对应的账户信息;Determining account information corresponding to the matched first face information according to the matched first face information and the first association relationship;
    根据对应的账户信息扣取所述购物金额。The shopping amount is deducted according to the corresponding account information.
  14. 根据权利要求13所述的方法,其特征在于,所述根据所述标签信息和匹配的第一人脸信息扣取购物金额之后,还包括:The method according to claim 13, wherein after the deducting the shopping amount according to the label information and the matched first face information, the method further comprises:
    删除匹配的第一人脸信息,匹配的第一人脸信息对应的账户信息、第匹配的第一人脸信息与对应的账户信息之间的关联关系。The matching first face information, the matching account information corresponding to the first face information, the first matching face information and the corresponding account information are deleted.
  15. 一种电子设备,其特征在于,所述电子设备包括:存储器,一个或多个处理器;存储器与处理器通过通信总线相连;处理器被配置为执行存储器中的指令;所述存储介质中存储有用于执行权利要求1至14任一项所述方法中各个步骤的指令。An electronic device, comprising: a memory, one or more processors; a memory coupled to the processor via a communication bus; the processor configured to execute instructions in the memory; the storage medium storing There are instructions for performing the various steps in the method of any of claims 1 to 14.
  16. 一种与包括显示器的电子设备结合使用的计算机程序产品,所述 计算机程序产品包括计算机可读的存储介质和内嵌于其中的计算机程序机制,所述计算机程序机制包括用于执行权利要求1至14任一所述方法中各个步骤的指令。A computer program product for use in conjunction with an electronic device including a display, the computer program product comprising a computer readable storage medium and a computer program mechanism embodied therein, the computer program mechanism comprising for performing claim 1 14 instructions for each of the steps in any of the methods.
  17. 一种自助购物系统,其特征在于,所述系统,包括:第一人脸采集设备,第二人脸采集设备,账户获取设备,电子标签采集设备,数据存储单元,数据处理单元;A self-service shopping system, comprising: a first face collection device, a second face collection device, an account acquisition device, an electronic tag collection device, a data storage unit, and a data processing unit;
    所述第一人脸采集设备,用于获取第一用户的第一人脸图像;The first face collecting device is configured to acquire a first face image of the first user;
    所述第二人脸采集设备,用于获取第二用户的第二人脸图像;The second face collecting device is configured to acquire a second face image of the second user;
    所述账户获取设备,用于获取账户标识;The account obtaining device is configured to obtain an account identifier;
    所述电子标签采集设备,用于采集所述第二用户所购商品的标签信息;The electronic label collecting device is configured to collect label information of the goods purchased by the second user;
    所述数据存储单元,用于存储账户信息、第一人脸信息以及账户信息和第一人脸信息之间的第一关联关系;The data storage unit is configured to store account information, first face information, and a first association relationship between the account information and the first face information;
    所述数据存储单元,还用于存储电子标签、商品的价格以及各电子标签及对应商品的价格之间的第二关联关系;The data storage unit is further configured to store an electronic tag, a price of the commodity, and a second relationship between the price of each electronic tag and the corresponding commodity;
    所述数据处理单元,用于执行权利要求1至14任一项所述方法中各个步骤的指令。The data processing unit is operative to execute the instructions of the various steps of the method of any one of claims 1 to 14.
  18. 根据权利要求17所述的系统,其特征在于,所述人脸采集设备为摄像头;The system according to claim 17, wherein the face collecting device is a camera;
    所述账户获取设备为账户刷卡装置,或者,所述账户获取设备为扫码装置,或者,所述账户获取设备为账户刷卡装置和扫码装置;The account obtaining device is an account card swiping device, or the account obtaining device is a scan code device, or the account obtaining device is an account card swiping device and a scan code device;
    所述电子标签采集设备为射频读取器RFID reader。The electronic tag collection device is a radio frequency reader RFID reader.
PCT/CN2017/119526 2017-12-28 2017-12-28 Cloud-based self-service shopping method and system, electronic device, and program product WO2019127255A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2017/119526 WO2019127255A1 (en) 2017-12-28 2017-12-28 Cloud-based self-service shopping method and system, electronic device, and program product
CN201780002673.2A CN108235771A (en) 2017-12-28 2017-12-28 Self-help shopping method and system, electronic equipment, program product based on high in the clouds

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/119526 WO2019127255A1 (en) 2017-12-28 2017-12-28 Cloud-based self-service shopping method and system, electronic device, and program product

Publications (1)

Publication Number Publication Date
WO2019127255A1 true WO2019127255A1 (en) 2019-07-04

Family

ID=62645430

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/119526 WO2019127255A1 (en) 2017-12-28 2017-12-28 Cloud-based self-service shopping method and system, electronic device, and program product

Country Status (2)

Country Link
CN (1) CN108235771A (en)
WO (1) WO2019127255A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111160141A (en) * 2019-12-13 2020-05-15 上海秒针网络科技有限公司 Prompt message processing method and device, storage medium and electronic device
CN111240938A (en) * 2020-01-10 2020-06-05 深圳市五联云科技有限公司 Data congestion processing method and device based on face-brushing payment
CN113095836A (en) * 2021-04-22 2021-07-09 北京市商汤科技开发有限公司 Self-service shopping method and device, electronic equipment and storage medium
CN113627930A (en) * 2021-07-08 2021-11-09 支付宝(杭州)信息技术有限公司 Electronic ticket verification method and device, electronic equipment and storage medium

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109102331A (en) * 2018-08-03 2018-12-28 北京旷视科技有限公司 Goods information processing method, server, system, electronic equipment and storage medium
CN110838013A (en) * 2018-08-16 2020-02-25 北京京东尚科信息技术有限公司 Data processing method, device, system and computer readable medium
CN108830585A (en) * 2018-08-28 2018-11-16 杭州魔点科技有限公司 Unmanned shop payment system, control method and control device based on recognition of face
CN109508990A (en) * 2018-10-10 2019-03-22 阿里巴巴集团控股有限公司 Payment processing method, device and self-checkout equipment
CN109509061A (en) * 2018-10-31 2019-03-22 广州慧睿思通信息科技有限公司 Purchase method, device, system and storage medium based on artificial intelligence
CN110428297A (en) * 2018-11-19 2019-11-08 北京京东尚科信息技术有限公司 Commercial product recommending system, method, electronic equipment, storage medium
CN110033275A (en) * 2019-03-07 2019-07-19 百度在线网络技术(北京)有限公司 User identification authorization method and apparatus
CN110189132A (en) * 2019-04-19 2019-08-30 北京百度网讯科技有限公司 Face payment mechanism, method, system and machine readable storage medium
CN110443637A (en) * 2019-07-16 2019-11-12 浙江大华技术股份有限公司 User's Shopping Behaviors analysis method, device and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0991027A2 (en) * 1998-09-30 2000-04-05 Ncr International Inc. Self-service checkout terminal having a biometric sensing device for verifying identity of a user and associated method
CN106875592A (en) * 2017-02-07 2017-06-20 张金滔 A kind of intelligent shop mode and intelligent shop
CN107194699A (en) * 2017-06-05 2017-09-22 崔俊新 Payment system, method, device and readable storage medium storing program for executing based on biological characteristic
CN107464116A (en) * 2017-07-25 2017-12-12 苏宁云商集团股份有限公司 A kind of order settlement method and system
CN107480994A (en) * 2017-06-23 2017-12-15 阿里巴巴集团控股有限公司 A kind of settlement method, access control method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0991027A2 (en) * 1998-09-30 2000-04-05 Ncr International Inc. Self-service checkout terminal having a biometric sensing device for verifying identity of a user and associated method
CN106875592A (en) * 2017-02-07 2017-06-20 张金滔 A kind of intelligent shop mode and intelligent shop
CN107194699A (en) * 2017-06-05 2017-09-22 崔俊新 Payment system, method, device and readable storage medium storing program for executing based on biological characteristic
CN107480994A (en) * 2017-06-23 2017-12-15 阿里巴巴集团控股有限公司 A kind of settlement method, access control method and device
CN107464116A (en) * 2017-07-25 2017-12-12 苏宁云商集团股份有限公司 A kind of order settlement method and system

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111160141A (en) * 2019-12-13 2020-05-15 上海秒针网络科技有限公司 Prompt message processing method and device, storage medium and electronic device
CN111240938A (en) * 2020-01-10 2020-06-05 深圳市五联云科技有限公司 Data congestion processing method and device based on face-brushing payment
CN113095836A (en) * 2021-04-22 2021-07-09 北京市商汤科技开发有限公司 Self-service shopping method and device, electronic equipment and storage medium
CN113627930A (en) * 2021-07-08 2021-11-09 支付宝(杭州)信息技术有限公司 Electronic ticket verification method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN108235771A (en) 2018-06-29

Similar Documents

Publication Publication Date Title
WO2019127255A1 (en) Cloud-based self-service shopping method and system, electronic device, and program product
EP3525156B1 (en) Order information determining method and apparatus
CN107464116B (en) Order settlement method and system
US20170316271A1 (en) Monitoring device and method
CN110866429A (en) Missed scanning identification method and device, self-service cash register terminal and system
CN107103502A (en) A kind of sequence information determines method and apparatus
CN106355484A (en) Method for purchasing based on terminal equipment and purchasing system thereof
US10963880B2 (en) System and method for realizing identity identification on the basis of radio frequency identification technology
JP7298865B2 (en) Information processing system, customer identification device, information processing method and program
US11861993B2 (en) Information processing system, customer identification apparatus, and information processing method
CN109993593B (en) Virtual shopping cart management method and device
JP2023162229A (en) Monitoring device and program
JP6311590B2 (en) Product processing system and product processing method
US11651416B2 (en) Goods purchase analysis assist system
EP3239912A1 (en) Management device and method
CN107862521A (en) A kind of supermarket shopping payment system and method based on Internet of Things
WO2023144992A1 (en) Store exit management system, store exit management method, and recording medium
US20220164977A1 (en) Information processing device, processing method, and recording medium
US20230245087A1 (en) Meta-world autonomous store
JP2022144490A (en) Store system and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17935837

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 18.11.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17935837

Country of ref document: EP

Kind code of ref document: A1