CN111339929A - Retail system of unmanned supermarket - Google Patents
Retail system of unmanned supermarket Download PDFInfo
- Publication number
- CN111339929A CN111339929A CN202010115039.3A CN202010115039A CN111339929A CN 111339929 A CN111339929 A CN 111339929A CN 202010115039 A CN202010115039 A CN 202010115039A CN 111339929 A CN111339929 A CN 111339929A
- Authority
- CN
- China
- Prior art keywords
- user
- commodity
- information
- weight
- image information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/38—Payment protocols; Details thereof
- G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
- G06Q20/401—Transaction verification
- G06Q20/4014—Identity check for transactions
- G06Q20/40145—Biometric identity checks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
- G07G1/00—Cash registers
- G07G1/12—Cash registers electronically operated
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Multimedia (AREA)
- Accounting & Taxation (AREA)
- Human Computer Interaction (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computer Security & Cryptography (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Cash Registers Or Receiving Machines (AREA)
Abstract
The invention discloses a retail system of an unmanned supermarket, which is used for solving the technical problem of low accuracy of commodity identification in the prior art and comprises the following steps: the system comprises an entrance gate, a video monitoring device, a weight sensor, a precise positioning device and a cloud server; the cloud server is used for generating a corresponding first record according to the received first image information when the first user enters the unmanned supermarket; when a second user purchases a commodity, identifying the second user, the type of the commodity actually purchased by the second user and the corresponding quantity of the commodity according to the received second image information, weight information and information of user operation, and recording the second user, the type of the commodity actually purchased by the second user and the corresponding quantity of the commodity in a first record corresponding to the second user; and when the third user leaves the unmanned supermarket, associating the first image information and the second image information which have the same face information with the third image information, acquiring all commodity types and corresponding commodity quantity selected and purchased by the third user from the corresponding first records, and deducting the corresponding consumption amount from the payment account of the third user.
Description
Technical Field
The invention relates to the field of unmanned supermarkets, in particular to a retail system of an unmanned supermarket.
Background
With the continuous progress of science and technology, unmanned vending machines are widely arranged in markets, hospitals, tourist attractions and the like, and provide convenience for the life of people.
However, when a user purchases a product on the unmanned vending machine, the user often needs to press a button corresponding to the product to select the product, and the vending machine will issue the product selected by the user to the user after paying, so that the vending machine can only sell a single product, which makes the user have a small selectable range.
In the prior art, in order to enable users to have more various choices, an unmanned store is provided, and the users can select commodities in the unmanned store, wherein the unmanned store generally identifies the commodities selected by the users by collecting image information of the commodities and weight change information of a shelf. However, this method cannot identify a smaller product, and thus reduces the accuracy of identifying the product.
In view of this, how to improve the accuracy of identifying the commodity becomes a technical problem to be solved urgently.
Disclosure of Invention
The invention provides a retail system of an unmanned supermarket, which is used for solving the technical problem of low accuracy of commodity identification in the prior art.
In a first aspect, to solve the above technical problem, a technical solution of a retail system of an unmanned supermarket according to an embodiment of the present invention is as follows:
the gate machines are respectively arranged at the entrance and the exit of the unmanned supermarket and are used for acquiring the user information entering and exiting the unmanned supermarket;
the video monitoring equipment comprises an entrance monitoring equipment and an exit monitoring equipment and a commodity monitoring equipment; the entrance monitoring equipment is arranged on an entrance gate and used for acquiring first image information of a first user entering the unmanned supermarket; the commodity monitoring equipment is arranged in the area where the goods shelf is located and used for acquiring second image information of the second user for taking and placing commodities; the exit monitoring equipment is arranged on the exit gate and used for acquiring third image information of a third user about to leave the unmanned supermarket;
the weight sensor is arranged on the goods shelf and used for collecting weight information of the second user after taking and placing the commodities on the goods shelf;
the accurate positioning equipment is arranged in the accommodating area of each type of commodity and used for detecting whether the second user performs user operation on the commodity corresponding to the accurate positioning equipment;
the cloud server is used for generating a first record according to the received first image information when the first user enters the unmanned supermarket; when the second user purchases commodities, identifying the types and the corresponding quantities of the commodities purchased by the second user and the second user from the unmanned supermarket according to the received second image information, the weight information and the information of the user operation, and recording the types and the corresponding quantities of the commodities purchased by the second user from the unmanned supermarket into a first record; and when a third user leaves the unmanned supermarket, associating first image information and second image information which have the same face information with the third image information, acquiring all commodity types and corresponding commodity quantity selected by the third user from the corresponding first records, and deducting corresponding consumption amount from a payment account of the third user.
Optionally, the cloud server is specifically configured to:
identifying the first image information to obtain first face information of the first user, and distributing a temporary code to the first user;
and generating the first record based on the temporary code and the first face information, and storing the first record in a database of the unmanned supermarket.
Optionally, the cloud server is specifically configured to:
aiming at the second image information, the weight information and the commodity type corresponding to the second user which are obtained at the same time, the following operations are executed:
identifying the second image information to obtain second face information of the second user and a first commodity;
obtaining weight change information based on the weight information and original weight information of the goods shelf;
determining a second commodity based on the weight change information and the weight information change amount of each type of commodity on the shelf;
determining a third item based on the item type;
determining the commodity type actually taken and placed by the second user from the first commodity, the second commodity and the third commodity according to the preset weight values corresponding to the commodity monitoring equipment, the weight sensor and the accurate positioning equipment respectively;
calculating the commodity number of the commodity type actually selected by the second user according to the single weight of the commodity type actually picked and placed by the second user and the weight change information;
comparing the second face information with the first face information in each first record to determine a first record corresponding to the second face information;
recording the commodity number of the commodity type actually taken and placed by the second user in one item of the first record corresponding to the second face information; when the weight information is increased, the second user deletes or modifies the corresponding item in the first record for putting back the commodity; and when the weight information is reduced, the second user adds or modifies the corresponding item in the first record for taking the commodity away.
Optionally, the cloud server is configured to:
if at least two commodities in the first commodity, the second commodity and the third commodity are the same, adding preset weight values corresponding to the same commodities, and determining the commodity with the highest weight value after the addition as the commodity type actually taken and placed by the second user;
and if the first commodity, the second commodity and the third commodity are three different commodities, determining the commodity corresponding to the highest preset weight value as the commodity type actually picked and placed by the second user.
Optionally, the cloud server is further configured to:
when the weight information is an increase in the weight information,
if the weight change information is inconsistent with the weight change of the commodity in the goods shelf, determining that the second user misplaces the commodity on the goods shelf;
and sending a prompt message for repositioning the commodity to the second user.
Optionally, the cloud server is further configured to:
if the second user is determined to misplace the goods shelf within the preset time length after the prompt message of repositioning the goods is sent to the second user, the prompt message is sent to the staff;
and when other users come to the goods shelf, sending the information of the goods placement error to the other users.
Optionally, the cloud server is configured to:
identifying the third image information to obtain third face information of the third user;
and comparing the third face information with the first face information and the second face information in the first records in the database to determine the first record corresponding to the third face information.
Optionally, the cloud server is configured to:
when the number of the commodities is zero, determining that the third user does not shop;
controlling the exit gate to open to let the third user leave.
Optionally, the cloud server is configured to:
determining that the third user is shopping when the quantity of the commodity is non-zero;
judging whether a payment account corresponding to the third face information exists in the database or not based on the third face information and the database;
and if the third user does not exist, sending prompt information for binding the payment account to the third user.
Optionally, the cloud server is configured to:
sending a prompt message for deducting the consumption amount to a voice device for voice broadcasting;
or sending the prompt message of the consumption amount to the appointed equipment of the third user.
Through the technical solutions in one or more of the above embodiments of the present invention, the embodiments of the present invention have at least the following technical effects:
in the embodiment provided by the invention, when a first user enters an unmanned supermarket, the cloud server generates a corresponding first record according to received first image information; when a second user purchases a commodity, identifying the type and the corresponding quantity of the commodity which are actually purchased from the unmanned supermarket by the second user and the second user according to the received second image information, weight information and information of user operation, and recording the commodity type and the corresponding quantity of the commodity in a first record corresponding to the second user; and when the third user leaves the unmanned supermarket, the first image information and the second image information which have the same face information with the third image information are associated together, so that the commodity class and the corresponding commodity quantity of the third user selected in the unmanned supermarket and recorded in the first record corresponding to the third user can be comprehensively determined, the consumption amount of the third user is determined according to the commodity class and the corresponding commodity quantity, and the corresponding consumption amount is deducted from the payment account of the third user. When the user purchases the commodity, the identity of the user and the commodity actually purchased by the user are identified according to the second image information, the weight information and the information of the user operation, so that the commodity identification accuracy can be effectively improved.
Drawings
Fig. 1 is a first schematic composition diagram of a retail system of an unmanned supermarket according to an embodiment of the present invention;
fig. 2 is a schematic diagram illustrating a video monitoring apparatus according to an embodiment of the present invention;
fig. 3 is a schematic composition diagram ii of a retail system of an unmanned supermarket according to an embodiment of the present invention;
fig. 4 is a schematic composition diagram three of a retail system of an unmanned supermarket according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a retail system of an unmanned supermarket, and aims to solve the technical problem that the accuracy of commodity identification is low in the prior art.
In order to solve the technical problems, the general idea of the embodiment of the present application is as follows:
there is provided a retail system for an unmanned supermarket, comprising: the gate is arranged at an entrance and an exit of the unmanned supermarket and used for acquiring user information entering and exiting the unmanned supermarket; the video monitoring equipment comprises an entrance monitoring equipment and an exit monitoring equipment and a commodity monitoring equipment; the entrance monitoring equipment is arranged on the entrance gate and used for acquiring first image information of a first user entering the unmanned supermarket; the commodity monitoring equipment is arranged in the area where the goods shelf is located and used for acquiring second image information of the second user for taking and placing commodities; the exit monitoring equipment is arranged on the exit gate and used for acquiring third image information of a third user about to leave the unmanned supermarket; the weight sensor is arranged on the goods shelf and used for acquiring weight information of the second user after taking and placing the goods on the goods shelf; the accurate positioning equipment is arranged in the accommodating area of each type of commodity and used for detecting whether a second user performs user operation on the commodity corresponding to the accurate positioning equipment; the cloud server is used for generating a first record according to the received first image information when the first user enters the unmanned supermarket; when a second user purchases commodities, according to the received second image information, weight information and user operation information, identifying the second user and the commodity types and the corresponding commodity quantity of the second user who purchases from the unmanned supermarket, and recording the commodity types and the corresponding commodity quantity of the second user who purchases from the unmanned supermarket into the first record; and when the third user leaves the unmanned supermarket, the first image information and the second image information which have the same face information with the third image information are associated together, all commodity types and corresponding commodity quantity selected and purchased by the third user are obtained from the corresponding first records, and the corresponding consumption amount is deducted from the payment account of the third user.
According to the scheme, when the first user enters the unmanned supermarket, the cloud server generates a corresponding first record according to the received first image information; when a second user purchases a commodity, identifying the type and the corresponding quantity of the commodity which are actually purchased from the unmanned supermarket by the second user and the second user according to the received second image information, weight information and information of user operation, and recording the commodity type and the corresponding quantity of the commodity in a first record corresponding to the second user; when the third user leaves the unmanned supermarket, the first image information and the second image information which have the same face information with the third image information are associated together, so that the commodity types and the corresponding commodity quantity of the third user selected in the unmanned supermarket and recorded in the first record corresponding to the third user can be comprehensively determined, the consumption amount of the third user is determined according to the commodity types and the corresponding commodity quantity, and the corresponding consumption amount is deducted from the payment account of the third user. When the user purchases the commodity, the identity of the user and the commodity actually purchased by the user are identified according to the second image information, the weight information and the information of the user operation, so that the commodity identification accuracy can be effectively improved.
In order to better understand the technical solutions of the present invention, the following detailed descriptions of the technical solutions of the present invention are provided with the accompanying drawings and the specific embodiments, and it should be understood that the specific features in the embodiments and the examples of the present invention are the detailed descriptions of the technical solutions of the present invention, and are not limitations of the technical solutions of the present invention, and the technical features in the embodiments and the examples of the present invention may be combined with each other without conflict.
Referring to fig. 1 to fig. 2, fig. 1 is a schematic composition diagram of a retail system of an unmanned supermarket according to an embodiment of the present invention, fig. 2 is a schematic composition diagram of a video monitoring device according to an embodiment of the present invention, and an embodiment of the present invention provides a retail system of an unmanned supermarket, where the retail system includes:
the gate comprises an entrance gate 101 and an exit gate 102 which are respectively arranged at an entrance and an exit of the unmanned supermarket and are used for acquiring user information entering and exiting the unmanned supermarket.
And the weight sensor 104 is installed on the shelf and used for acquiring weight information of the second user after taking and placing the commodity on the shelf.
And the accurate positioning equipment 105 is arranged in the accommodating area of each type of commodity and is used for detecting whether a second user performs user operation on the commodity corresponding to the accurate positioning equipment.
The cloud server 106 is used for generating a first record according to the received first image information when the first user enters the unmanned supermarket; when a second user purchases commodities, according to the received second image information, weight information and user operation information, identifying the commodity types and the corresponding commodity quantities purchased by the second user from the unmanned supermarket, and recording the commodity types and the corresponding commodity quantities purchased by the second user from the unmanned supermarket into a first record; and when the third user leaves the unmanned supermarket, the first image information and the second image information which have the same face information with the third image information are associated together, all commodity types and corresponding commodity quantity selected and purchased by the third user are obtained from the corresponding first records, and the corresponding consumption amount is deducted from the payment account of the third user.
In the embodiment provided by the present invention, the communication mode between the devices may adopt any one or a combination of 4G, 5G, wifi and bluetooth.
The fine positioning device 105 may be an infrared price tag, a 3D laser imaging device, or the like, which is capable of performing fine positioning.
For example, the area in which article A is placed may be equipped with an infrared price tag for the pinpoint device 105, and when a user picks an article from the area in which article A is placed, the infrared price tag for the pinpoint device 105 may detect that a user is picking article A.
It should be noted that, in the embodiment provided by the present invention, there may be one or more exit gate 102 and entrance gate 101, respectively, which are not limited herein; the number of the inlet monitoring devices 1031 and the number of the outlet monitoring devices 1032 correspond to the inlet gate 101 and the outlet gate 102, respectively, the number of the commodity monitoring devices 1033 and the number of the weight sensors 104 are multiple, and one shelf corresponds to at least one commodity monitoring device 1033 and one weight sensor 104; the number of the accurate positioning devices 105 is multiple, and only one accurate positioning device 105 corresponds to one commodity. In fig. 1-2, although only one device is shown in the figures, it should not be understood as only one device, but rather as a class, such as all gates installed at the entrance are referred to as entrance gates, all monitoring devices in the unmanned supermarket are referred to as video monitoring devices, all video monitoring devices installed at the entrance gates are referred to as entrance monitoring devices 1031, and so on, which will not be described again.
The cloud server 106 generates a corresponding first record according to the received first image information, and generates the first record in the following manner:
firstly, identifying first image information to obtain first face information of a first user, and distributing a temporary code for the first user; and generating a first record based on the temporary code and the first face information, and storing the first record in a database of the unmanned supermarket.
For example, when the user A, B, C performs an unmanned supermarket, the user A, B, C enters the unmanned supermarket through the entrance gate 101 at the entrance, and when the user passes through the entrance gate 101, the entrance monitoring device 1031 installed on the entrance gate 101 collects the first image information a of the user a, the first image information B of the user B, and the first image information C of the user C, and transmits the first image information a, the first image information B, and the first image information C to the cloud server 106, the cloud server 106 recognizes the first image information a, the first image information B, and the first image information C, obtains the first face information a, the first face information B, and the first face information C, sequentially assigns temporary codes 1, 2, and 3 to the first image information a, the first record B (2, the first face information B), and the first record C (3, the first face information C), and then generates the first record a, the first record B, the first record C, and the second record C, The first record B and the first record C are stored in a database of the unmanned supermarket.
In the embodiment provided by the invention, the user can enter the unmanned supermarket no matter whether the user is registered in the unmanned supermarket or not, the cloud server 106 of the unmanned supermarket establishes a record for the user through the collected first image information of the user entering the unmanned supermarket, and the subsequent user can conveniently and accurately record commodities selected by each user when selecting commodities in the unmanned supermarket.
After a user enters an unmanned supermarket, when the user selects a commodity (in the embodiment of the present invention, the user who has picked up and placed the commodity is referred to as a second user), the commodity monitoring device 1033 installed in the shelf area may acquire second image information of the second user, the weight sensor 104 installed on the shelf may acquire the weight of the second user after picking up and placing the commodity on the shelf, and the accurate positioning device 105 installed in the entrance area where the commodity picked up and placed by the second user is located may send a signal to the cloud server 106, so that the cloud server 106 determines, according to the commodity type corresponding to the accurate positioning device 105, that the second user has performed a user operation on the commodity of the commodity type, where the user operation includes a commodity pickup operation and a commodity replacement operation.
The cloud server 106 identifies the second user and the type of the commodity actually purchased by the second user from the unmanned supermarket and the corresponding quantity of the commodity according to the received second image information, the weight information and the information of the user operation, and specifically may adopt the following mode:
aiming at second image information, weight information and commodity types corresponding to a second user obtained at the same time, the following operations are executed:
and identifying the second image information to obtain second face information of a second user and the first commodity.
Since the second image information is an image of the user for picking and placing the commodity, the second image information is identified, so that the second face information of the second user can be identified, and the commodity which is picked and placed by the second user, namely the second commodity, can be identified.
Before or after the second image information is recognized, the weight change information may be obtained based on the weight information and the original weight information of the shelf.
Since the kind of each commodity on the shelf is determined, the second commodity can be determined based on the weight change information and the amount of change in the weight information of each type of commodity on the shelf.
Since the precise positioning device 105 is installed in the entrance area of each type of goods, when the user takes and places the goods, the server may determine the corresponding type of goods according to the received signal of the precise positioning device 105, and further determine a third goods based on the type of goods.
Since three kinds of commodities can be determined according to the first image information, the weight change information and the commodity type corresponding to the precise positioning device 105, and the accuracy of the three kinds of commodities is different, that is, the accuracy of the commodity determined according to the first image information is highest, and then the precise positioning device 105 is used, and the lowest is the weight change information, the preset weight values are set for the commodities determined according to the three kinds of commodities, for example, the preset weight value of the first commodity is 0.45, the preset weight value of the second commodity is 0.3, and the preset weight value of the third commodity is 0.25. Then, according to the preset weight values corresponding to the commodity monitoring device 1033, the weight sensor 104, and the accurate positioning device 105, the commodity type actually taken and placed by the second user is determined from the first commodity, the second commodity, and the third commodity.
And then, calculating the commodity number of the commodity type actually selected by the second user according to the single piece weight of the commodity type actually taken and placed by the second user and the weight change information.
Comparing the second face information with the first face information in each first record before or after calculating the number of commodities of the commodity type actually selected by the second user, and determining the first record corresponding to the second face information;
recording the commodity quantity of the commodity type actually taken and placed by the second user in one item of the first record corresponding to the second face information; when the weight information is increased, the second user deletes or modifies the corresponding item in the first record for putting back the commodity; and when the weight information is reduced, the second user adds or modifies the corresponding item in the first record for taking the commodity.
For example, suppose there are a user a, a user B, and a user C in an unmanned supermarket, when the user a selects a commodity on the shelf 1, the commodity acquisition device corresponding to the shelf 1 acquires an image of the user a, and sends the acquired second image information a to the cloud server 106, the cloud server 106 identifies the second image information a, and when it is determined that the user a has selected the first commodity a, that is, the cloud server 106 obtains the second face information a and the first commodity a of the second user, and the cloud server 106 obtains the current weight information of the shelf 1 through the weight sensor 104 on the shelf 1, and determines the weight change information according to the original weight information and the current weight information of the shelf 1, and further determines that the second commodity a may be selected by the user a by combining with the weight of the commodity, and the cloud server 106 determines the corresponding relationship between the accurate positioning device 105 and the commodity according to the received signal of the accurate positioning device 105, the method comprises the steps of determining that a third commodity A is possibly selected by a user A, and determining what commodity the user A (namely a second user) actually holds according to preset weight values of the first commodity A, the second commodity A and the third commodity A as the preset weight values of the first commodity A, the second commodity A and the third commodity A are 0.45, 0.3 and 0.25 in sequence, and further determining the number of commodities the user A (assumed to be 2 boxes) according to the commodity the user A actually holds (assumed to be milk) and weight change information.
And comparing the second face information A with each piece of first face information in the database, determining that the second face information A corresponds to the first record A, and recording 2 boxes of milk actually taken by the user A in one item of the first record A. If there is already milk in the first record, the amount of milk is modified directly, and if there is no milk, the amount of milk is increased in the first record and the number of products is recorded as 2.
It should be understood that in the embodiments provided by the present invention, one item in the first record should be understood as an identical item, and should not be understood as a different brand of item in the same item.
When the user returns the commodity to the shelf, the process of selecting the commodity is similar to the process of selecting the commodity for the identification of the commodity and the identification of the user, which is not described herein again, but the difference is that the corresponding commodity is deleted or the number of the corresponding commodity is modified when the commodity is recorded in the first record.
When determining the type of the commodity actually taken and placed by the second user from the first commodity, the second commodity and the third commodity according to the preset weight values corresponding to the commodity monitoring device 1033, the weight sensor 104 and the accurate positioning device 105, the cloud server 106 is implemented in the following manner:
and if at least two commodities in the first commodity, the second commodity and the third commodity are the same, adding preset weight values corresponding to the same commodities, and determining the commodity with the highest weight value after addition as the commodity type actually taken and placed by the second user.
And if the first commodity, the second commodity and the third commodity are three different commodities, determining the commodity corresponding to the highest preset weight value as the commodity type actually taken and placed by the second user.
For example, if the first commodity a, the second commodity a, and the third commodity a are three different commodities, and the preset weight values thereof are 0.45, 0.3, and 0.25 in sequence, the first commodity a corresponding to the maximum preset weight value of 0.45 is determined as the commodity actually taken by the user a.
For another example, assuming that the second article a and the third article a are the same article and different articles from the first article a, the preset weight values of the second article a and the third article a are added to obtain a weight value of 0.3+0.25 ═ 0.55, and a weight value of the first article a is 0.45, and the second article a or the third article a corresponding to the maximum preset weight value of 0.55 may be determined as the article actually taken by the user a.
If the first commodity A cannot be identified, the second commodity A and the third commodity A are different commodities, and the commodity with the maximum preset weight value in the second commodity A and the third commodity A is determined as the commodity actually taken by the user A.
Referring to fig. 3, a schematic diagram of a composition of a retail system of an unmanned supermarket according to an embodiment of the present invention is shown, in which after the cloud server 106 obtains weight change information, when the weight change information is increased, if the weight change information is inconsistent with a weight change of a commodity in a shelf, it is determined that a second user misplaces the commodity on the shelf; the cloud server 106 sends a prompt to the second user to reposition the item. The prompt message may be broadcasted through the voice device 107, or may be displayed through the display device 108 that can be seen by the user, which is not limited specifically.
If the second user is determined to have misplaced the goods on the shelf within the preset time after the cloud server 106 sends the prompt message of repositioning the goods to the second user, the prompt message is sent to the staff.
When other users come to the shelf, the cloud server 106 sends information of the article placement error to the other users.
For example, assuming that the article B should be placed on the shelf 1, after the second user B places the article B on the shelf 2, the cloud server 106 recognizes that the second user B misplaces the article B on the shelf, and sends a prompt message that the article B is misplaced to the second user, and please replace the article B, but the second user B does not replace the article B, that is, the cloud server 106 determines that the second user B does not replace the article B within a preset time period (for example, 3 minutes) through the collected image information, and then sends a prompt message to the staff, so that the staff puts the article B on the correct shelf.
When other users come to the shelf with the commodity B misplaced, the cloud server 106 sends the information that the commodity B is misplaced to the other users, so that the other users know that the price of the commodity B placement position is not the real price of the commodity B, and can also prompt the other users to place the commodity B on the correct shelf.
It should be noted that, since the identification process of returning the article B to the shelf is similar to the identification process of the previously selected article, the detailed description is omitted here.
When the user has purchased the commodity and comes to the exit gate 102, the exit monitoring device 1032 installed on the exit gate 102 collects the third image information, and the cloud server 106 identifies the third image information to obtain third face information of the third user, and compares the third face information with each of the first face information and each of the second face information recorded in the database to determine a first record corresponding to the third face information.
When the number of the commodities in the first record is zero, determining that a third user does not shop; the exit gate 102 is controlled to open to let a third user leave.
When the number of the commodities in the first record is not zero, determining that a third user purchases; judging whether a payment account corresponding to the third face information exists in the database or not based on the third face information and the database; and if not, sending prompt information for binding the payment account to a third user.
Please refer to fig. 4, which is a third schematic view of a composition of a retail system of an unmanned supermarket according to an embodiment of the present invention, after calculating the consumption amount of the third user according to the number and types of all commodities in the first record, deducting the consumption amount from the payment account of the third user, and sending a prompt message of deducting the consumption amount to the voice device 107 for voice broadcasting; or sending a prompt message of the consumption amount to the specified device 109 of the third user.
The designated device 109 may be a mobile device, such as a mobile phone, a tablet computer, a laptop computer, etc., and is not limited herein.
In the embodiment provided by the invention, when a first user enters an unmanned supermarket, the cloud server generates a corresponding first record according to received first image information; when a second user purchases a commodity, identifying the type and the corresponding quantity of the commodity which are actually purchased from the unmanned supermarket by the second user and the second user according to the received second image information, weight information and information of user operation, and recording the commodity type and the corresponding quantity of the commodity in a first record corresponding to the second user; and when the third user leaves the unmanned supermarket, the first image information and the second image information which have the same face information with the third image information are associated together, so that the commodity class and the corresponding commodity quantity of the third user selected in the unmanned supermarket and recorded in the first record corresponding to the third user can be comprehensively determined, the consumption amount of the third user is determined according to the commodity class and the corresponding commodity quantity, and the corresponding consumption amount is deducted from the payment account of the third user. When the user purchases the commodity, the identity of the user and the commodity actually purchased by the user are identified according to the second image information, the weight information and the information of the user operation, so that the commodity identification accuracy can be effectively improved.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. A retail system for an unmanned supermarket, comprising:
the gate is arranged at an entrance and an exit of the unmanned supermarket and used for acquiring user information entering and exiting the unmanned supermarket;
the video monitoring equipment comprises an entrance monitoring equipment and an exit monitoring equipment and a commodity monitoring equipment; the entrance monitoring equipment is arranged on an entrance gate and used for acquiring first image information of a first user entering the unmanned supermarket; the commodity monitoring equipment is arranged in the area where the goods shelf is located and used for acquiring second image information of the second user for taking and placing commodities; the exit monitoring equipment is arranged on the exit gate and used for acquiring third image information of a third user about to leave the unmanned supermarket;
the weight sensor is arranged on the goods shelf and used for collecting weight information of the second user after taking and placing the commodities on the goods shelf;
the accurate positioning equipment is arranged in the accommodating area of each type of commodity and used for detecting whether the second user performs user operation on the commodity corresponding to the accurate positioning equipment;
the cloud server is used for generating a first record according to the received first image information when the first user enters the unmanned supermarket; when the second user purchases commodities, identifying the commodity types and the corresponding commodity quantities purchased by the second user and the second user from the unmanned supermarket according to the received second image information, the weight information and the information of the user operation, and recording the commodity types and the corresponding commodity quantities purchased by the second user from the unmanned supermarket into the first record; and when a third user leaves the unmanned supermarket, associating first image information and second image information which have the same face information with the third image information, acquiring all commodity types and corresponding commodity quantity selected by the third user from the corresponding first records, and deducting corresponding consumption amount from a payment account of the third user.
2. The retail system of claim 1, wherein the cloud server is specifically configured to:
identifying the first image information to obtain first face information of the first user, and distributing a temporary code to the first user;
and generating the first record based on the temporary code and the first face information, and storing the first record in a database of the unmanned supermarket.
3. A retail system according to claim 2, characterised in that the cloud server is specifically configured to:
aiming at the second image information, the weight information and the commodity type corresponding to the second user which are obtained at the same time, the following operations are executed:
identifying the second image information to obtain second face information of the second user and a first commodity;
obtaining weight change information based on the weight information and original weight information of the goods shelf;
determining a second commodity based on the weight change information and the weight information change amount of each type of commodity on the shelf;
determining a third item based on the item type;
determining the commodity type actually taken and placed by the second user from the first commodity, the second commodity and the third commodity according to the preset weight values corresponding to the commodity monitoring equipment, the weight sensor and the accurate positioning equipment respectively;
calculating the commodity number of the commodity type actually selected by the second user according to the single weight of the commodity type actually picked and placed by the second user and the weight change information;
comparing the second face information with the first face information in each first record to determine a first record corresponding to the second face information;
recording the commodity number of the commodity type actually taken and placed by the second user in one item of the first record corresponding to the second face information; when the weight information is increased, the second user deletes or modifies the corresponding item in the first record for putting back the commodity; and when the weight information is reduced, the second user adds or modifies the corresponding item in the first record for taking the commodity away.
4. A retail system according to claim 3, characterised in that the cloud server is operable to:
if at least two commodities in the first commodity, the second commodity and the third commodity are the same, adding preset weight values corresponding to the same commodities, and determining the commodity with the highest weight value after the addition as the commodity type actually taken and placed by the second user;
and if the first commodity, the second commodity and the third commodity are three different commodities, determining the commodity corresponding to the highest preset weight value as the commodity type actually picked and placed by the second user.
5. The retail system of claim 4, wherein the cloud server is further configured to:
when the weight information is an increase in the weight information,
if the weight change information is inconsistent with the weight change of the commodity in the goods shelf, determining that the second user misplaces the commodity on the goods shelf;
and sending a prompt message for repositioning the commodity to the second user.
6. The retail system of claim 5, wherein the cloud server is further configured to:
if the second user is determined to misplace the goods shelf within the preset time length after the prompt message of repositioning the goods is sent to the second user, the prompt message is sent to the staff;
and when other users come to the goods shelf, sending the information of the goods placement error to the other users.
7. The retail system of claim 1, wherein the cloud server is to:
identifying the third image information to obtain third face information of the third user;
and comparing the third face information with the first face information and the second face information in the first records in the database to determine the first record corresponding to the third face information.
8. A retail system according to claim 7, wherein the cloud server is configured to:
when the number of the commodities is zero, determining that the third user does not shop;
controlling the exit gate to open to let the third user leave.
9. A retail system according to claim 7, wherein the cloud server is configured to:
determining that the third user is shopping when the quantity of the commodity is non-zero;
judging whether a payment account corresponding to the third face information exists in the database or not based on the third face information and the database;
and if the third user does not exist, sending prompt information for binding the payment account to the third user.
10. The retail system of claim 1, wherein the cloud server is to:
sending a prompt message for deducting the consumption amount to a voice device for voice broadcasting;
or sending the prompt message of the consumption amount to the appointed equipment of the third user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010115039.3A CN111339929B (en) | 2020-02-25 | 2020-02-25 | Retail system of unmanned supermarket |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010115039.3A CN111339929B (en) | 2020-02-25 | 2020-02-25 | Retail system of unmanned supermarket |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111339929A true CN111339929A (en) | 2020-06-26 |
| CN111339929B CN111339929B (en) | 2023-05-16 |
Family
ID=71185613
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010115039.3A Active CN111339929B (en) | 2020-02-25 | 2020-02-25 | Retail system of unmanned supermarket |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111339929B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113254910A (en) * | 2021-07-07 | 2021-08-13 | 新石器慧通（北京）科技有限公司 | User convenient authentication method and device for unmanned vehicle authentication system |
| CN113744473A (en) * | 2021-08-31 | 2021-12-03 | 智码迅付信息科技有限公司 | Face recognition system and method based on 3D structured light |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108564442A (en) * | 2018-04-11 | 2018-09-21 | 合肥美的智能科技有限公司 | Unmanned retail trade system and its control method, goods selling equipment and Cloud Server |
| CN109147174A (en) * | 2018-09-05 | 2019-01-04 | 深圳正品创想科技有限公司 | A kind of self-service method, server and self-service cabinet |
| KR20190093733A (en) * | 2018-01-10 | 2019-08-12 | 트라이큐빅스 인크. | Items recognition system in unmanned store and the method thereof |
| CN110246284A (en) * | 2018-03-07 | 2019-09-17 | 上海善解人意信息科技有限公司 | Unattended Supermarket shopping system and its control method |
| CN110443637A (en) * | 2019-07-16 | 2019-11-12 | 浙江大华技术股份有限公司 | User's Shopping Behaviors analysis method, device and storage medium |
-
2020
- 2020-02-25 CN CN202010115039.3A patent/CN111339929B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20190093733A (en) * | 2018-01-10 | 2019-08-12 | 트라이큐빅스 인크. | Items recognition system in unmanned store and the method thereof |
| CN110246284A (en) * | 2018-03-07 | 2019-09-17 | 上海善解人意信息科技有限公司 | Unattended Supermarket shopping system and its control method |
| CN108564442A (en) * | 2018-04-11 | 2018-09-21 | 合肥美的智能科技有限公司 | Unmanned retail trade system and its control method, goods selling equipment and Cloud Server |
| CN109147174A (en) * | 2018-09-05 | 2019-01-04 | 深圳正品创想科技有限公司 | A kind of self-service method, server and self-service cabinet |
| CN110443637A (en) * | 2019-07-16 | 2019-11-12 | 浙江大华技术股份有限公司 | User's Shopping Behaviors analysis method, device and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113254910A (en) * | 2021-07-07 | 2021-08-13 | 新石器慧通（北京）科技有限公司 | User convenient authentication method and device for unmanned vehicle authentication system |
| CN113744473A (en) * | 2021-08-31 | 2021-12-03 | 智码迅付信息科技有限公司 | Face recognition system and method based on 3D structured light |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111339929B (en) | 2023-05-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106934692B (en) | Article information processing system, method and device | |
| CN107103503B (en) | Order information determining method and device | |
| WO2019165894A1 (en) | Article identification method, device and system, and storage medium | |
| WO2019165891A1 (en) | Method for identifying product purchased by user, and device and smart shelf system | |
| WO2019165892A1 (en) | Automatic vending method and apparatus, and computer-readable storage medium | |
| CN101160576B (en) | Method and system for measuring retail store display conditions | |
| US11978014B2 (en) | Dynamic termination zone detection system | |
| TW201833843A (en) | Order information determining method and order information determining device | |
| KR20180004738A (en) | Systems and methods for controlling shelf display units and graphically representing information on shelf display units | |
| CN110866429A (en) | Missed scanning identification method and device, self-service cash register terminal and system | |
| US20170046774A1 (en) | Payment assistance device, payment assistance method, and program | |
| US20170357939A1 (en) | Methods and Systems for Monitoring a Retail Shopping Facility | |
| JP2016532932A (en) | Article interaction and movement detection method | |
| CN110895747B (en) | Commodity information identification, display, information association and settlement method and system | |
| CN111339929B (en) | Retail system of unmanned supermarket | |
| JP3837475B2 (en) | Automated shopping system | |
| CN111507792A (en) | Self-service shopping method, computer readable storage medium and system | |
| CN112308020B (en) | Method, device and system for tracking off-cabinet state of nonstandard commodity | |
| JP2024015277A (en) | Information providing device and control program thereof | |
| CN103116838A (en) | System and method of measuring time intervals to deliver a service | |
| US20170213276A1 (en) | System for monitoring articles selected by a shopper in a shop | |
| CN111507702A (en) | Self-service shopping method for unmanned supermarket, computer readable storage medium and system | |
| CN114358881A (en) | Self-service settlement method, device and system | |
| CN112036991A (en) | Intelligent management shopping guide system for shopping mall | |
| TW202009878A (en) | Vending device for suggesting shoppers to purchase from other device when commodity sold out and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |