CN111339929B - Retail system of unmanned supermarket - Google Patents
Retail system of unmanned supermarket Download PDFInfo
- Publication number
- CN111339929B CN111339929B CN202010115039.3A CN202010115039A CN111339929B CN 111339929 B CN111339929 B CN 111339929B CN 202010115039 A CN202010115039 A CN 202010115039A CN 111339929 B CN111339929 B CN 111339929B
- Authority
- CN
- China
- Prior art keywords
- user
- commodity
- information
- weight
- goods
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/38—Payment protocols; Details thereof
- G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
- G06Q20/401—Transaction verification
- G06Q20/4014—Identity check for transactions
- G06Q20/40145—Biometric identity checks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
- G07G1/00—Cash registers
- G07G1/12—Cash registers electronically operated
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Multimedia (AREA)
- Accounting & Taxation (AREA)
- Human Computer Interaction (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computer Security & Cryptography (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Cash Registers Or Receiving Machines (AREA)
Abstract
The invention discloses a retail system of an unmanned supermarket, which is used for solving the technical problem of lower accuracy of identifying commodities in the prior art, and comprises the following steps: the system comprises an entrance gate, video monitoring equipment, a weight sensor, accurate positioning equipment and a cloud server; the cloud server is used for generating a corresponding first record according to the received first image information when the first user enters the unmanned supermarket; when the second user purchases the commodity, the second user and the actually purchased commodity type and the corresponding commodity number are identified according to the received second image information, weight information and user operation information and recorded in a first record corresponding to the second user; when the third user leaves the unmanned supermarket, the first image information and the second image information which have the same face information with the third image information are associated, all commodity types selected and purchased by the third user and the corresponding commodity quantity are obtained from the corresponding first record, and the corresponding consumption amount is deducted from the payment account.
Description
Technical Field
The invention relates to the field of unmanned supermarkets, in particular to a retail system of an unmanned supermarket.
Background
With the continuous progress of technology, the unmanned vending machine is widely arranged in markets, hospitals, tourist attractions and the like, and provides convenience for the life of people.
However, when a user purchases a commodity on the unmanned vending machine, the user often needs to press a button corresponding to the commodity to select the commodity, and the vending machine can only release the commodity selected by the user to the user after payment, so that the vending machine can only sell a single commodity, and the selectable range of the user is smaller.
In the prior art, in order to enable users to have more various choices, unmanned stores are provided, and users can select goods in the unmanned stores, and the unmanned stores usually identify the goods selected by the users by collecting image information of the goods and weight change information of a goods shelf. However, this approach does not identify smaller items, thereby reducing the accuracy of identifying the items.
In view of this, how to improve the accuracy of identifying commodities is a technical problem to be solved.
Disclosure of Invention
The invention provides a retail system of an unmanned supermarket, which is used for solving the technical problem of lower accuracy of identifying commodities in the prior art.
In order to solve the above technical problems, a technical solution of a retail system of an unmanned supermarket provided by the embodiment of the invention is as follows:
the gate is respectively arranged at the entrance and exit of the unmanned supermarket and used for acquiring user information entering and exiting the unmanned supermarket;
the video monitoring equipment comprises access monitoring equipment and commodity monitoring equipment; the entrance monitoring equipment is arranged on the entrance gate and used for collecting first image information of a first user entering the unmanned supermarket; the commodity monitoring equipment is arranged in the area where the goods shelf is located and is used for acquiring second image information of the commodities fetched and placed by a second user; the exit monitoring equipment is arranged on the exit gate and used for collecting third image information of a third user who is about to leave the unmanned supermarket;
the weight sensor is arranged on the goods shelf and used for collecting weight information of the second user after picking and placing goods on the goods shelf;
the accurate positioning device is arranged in the accommodating area of each type of commodity and is used for detecting whether the second user performs user operation on the commodity corresponding to the accurate positioning device;
the cloud server is used for generating a first record according to the received first image information when the first user enters the unmanned supermarket; when the second user purchases goods, identifying the second user and the type of goods purchased by the second user from the unmanned supermarket and the corresponding quantity of goods according to the received second image information, the received weight information and the received user operation information, and recording the type of goods purchased by the second user from the unmanned supermarket and the corresponding quantity of goods into a first record; when a third user leaves the unmanned supermarket, the first image information and the second image information which have the same face information as the third image information are associated together, all commodity types and the corresponding commodity quantity purchased by the third user are obtained from the corresponding first record, and the corresponding consumption amount is deducted from the payment account of the third user.
Optionally, the cloud server is specifically configured to:
identifying the first image information, obtaining first face information of the first user, and distributing temporary codes for the first user;
and generating the first record based on the temporary code and the first face information, and storing the first record in a database of the unmanned supermarket.
Optionally, the cloud server is specifically configured to:
the following operations are executed for the second image information, the weight information and the commodity type corresponding to the second user obtained at the same time:
identifying the second image information to obtain second face information of the second user and first commodities;
acquiring weight change information based on the weight information and the original weight information of the goods shelf;
determining a second commodity based on the weight change information and the weight information change amounts of various types of commodities on the goods shelf;
determining a third commodity based on the commodity type;
determining the type of the commodity actually taken and placed by the second user from the first commodity, the second commodity and the third commodity according to preset weight values corresponding to the commodity monitoring equipment, the weight sensor and the accurate positioning equipment;
calculating the number of the commodities of the commodity type actually selected by the second user according to the single weight of the commodity type actually selected by the second user and the weight change information;
comparing the second face information with the first face information in each first record, and determining the first record corresponding to the second face information;
recording the commodity quantity of the commodity type actually fetched and placed by the second user in one item of a first record corresponding to the second face information; when the weight information is increased, the second user replaces the commodity, and deletes or modifies the corresponding item in the first record; when the weight information is reduced, the second user increases or modifies the corresponding item in the first record for taking the commodity.
Optionally, the cloud server is configured to:
if at least two commodities in the first commodity, the second commodity and the third commodity are the same, carrying out addition operation on preset weight values corresponding to the same commodity, and determining the commodity with the highest weight value after the addition operation as the commodity type actually fetched and placed by the second user;
if the first commodity, the second commodity and the third commodity are three different commodities, determining the commodity corresponding to the highest preset weight value as the commodity type actually fetched and placed by the second user.
Optionally, the cloud server is further configured to:
when the weight information is an increase in the weight,
if the weight change information is inconsistent with the weight change of the goods in the goods shelf, determining that the goods are misplaced by the second user;
and sending prompt information for repositioning the commodity to the second user.
Optionally, the cloud server is further configured to:
if the fact that the goods are misplaced by the second user is determined within the preset time after the prompt information of the goods are replaced is sent to the second user, the prompt information is sent to staff;
and when other users come to the goods shelf, sending information of the goods placement errors to the other users.
Optionally, the cloud server is configured to:
identifying the third image information to obtain third face information of the third user;
and comparing the third face information with the first face information and the second face information in each first record in the database, and determining the first record corresponding to the third face information.
Optionally, the cloud server is configured to:
when the commodity quantity is zero, determining that the third user does not shop;
and controlling the outlet gate to be opened so as to enable the third user to leave.
Optionally, the cloud server is configured to:
determining that the third user is shopping when the number of items is non-zero;
judging whether a payment account corresponding to the third face information exists in the database or not based on the third face information and the database;
if not, the prompt message of binding the payment account is sent to the third user.
Optionally, the cloud server is configured to:
sending prompt information deducting the consumption amount to voice equipment for voice broadcasting;
or sending the prompt information of the consumption amount to the appointed equipment of the third user.
Through the technical scheme in the one or more embodiments of the present invention, the embodiments of the present invention have at least the following technical effects:
in the embodiment provided by the invention, when a first user enters an unmanned supermarket, a cloud server generates a corresponding first record according to received first image information; when the second user purchases the commodity, identifying the type of the commodity and the corresponding number of the commodity actually purchased by the second user from the unmanned supermarket according to the received second image information, weight information and user operation information, and recording the type of the commodity and the corresponding number of the commodity in a first record corresponding to the second user; when the third user leaves the unmanned supermarket, the first image information and the second image information which have the same face information as the third image information are associated together, so that the selected commodities and the corresponding commodity quantity in the unmanned supermarket recorded in the first record corresponding to the third user can be comprehensively determined, the consumption amount of the third user is determined according to the commodity types and the corresponding commodity quantity, and the corresponding consumption amount is deducted from the payment account of the third user. When the user selects the commodity, the identity of the user and the commodity actually selected by the user are identified according to the second image information, the weight information and the information of the user operation, so that the accuracy of identifying the commodity can be effectively improved.
Drawings
Fig. 1 is a schematic diagram of a retail system of an unmanned supermarket according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a video monitoring device according to an embodiment of the present invention;
fig. 3 is a second schematic diagram of the composition of the retail system of the unmanned supermarket according to the embodiment of the invention;
fig. 4 is a schematic diagram III of the composition of a retail system of an unmanned supermarket according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a retail system of an unmanned supermarket, which aims to solve the technical problem of lower accuracy of identifying commodities in the prior art.
The technical scheme in the embodiment of the application aims to solve the technical problems, and the overall thought is as follows:
there is provided a retail system for an unmanned supermarket, comprising: the gate is arranged at an access opening of the unmanned supermarket and used for acquiring user information entering and exiting the unmanned supermarket; the video monitoring equipment comprises access monitoring equipment and commodity monitoring equipment; the entrance monitoring equipment is arranged on the entrance gate and used for collecting first image information of a first user entering the unmanned supermarket; the commodity monitoring equipment is arranged in the area where the goods shelf is located and used for acquiring second image information of goods taken and placed by a second user; the exit monitoring equipment is arranged on the exit gate and used for collecting third image information of a third user who is about to leave the unmanned supermarket; the weight sensor is arranged on the goods shelf and used for collecting weight information of the goods placed on the goods shelf by the second user; the accurate positioning device is arranged in the accommodating area of each type of commodity and is used for detecting whether a second user performs user operation on the commodity corresponding to the accurate positioning device; the cloud server is used for generating a first record according to the received first image information when the first user enters the unmanned supermarket; when a second user purchases goods, identifying the types of the goods purchased from the unmanned supermarket and the corresponding quantity of the goods in the second user and the second use case according to the received second image information, weight information and user operation information, and recording the types of the goods purchased from the unmanned supermarket and the corresponding quantity of the goods in the first record; when the third user leaves the unmanned supermarket, the first image information and the second image information which have the same face information as the third image information are associated together, all commodity types and the corresponding commodity quantity selected and purchased by the third user are obtained from the corresponding first record, and the corresponding consumption amount is deducted from the payment account of the third user.
In the scheme, when the first user enters the unmanned supermarket, the cloud server generates a corresponding first record according to the received first image information; when the second user purchases the commodity, identifying the type of the commodity and the corresponding number of the commodity actually purchased by the second user from the unmanned supermarket according to the received second image information, weight information and user operation information, and recording the type of the commodity and the corresponding number of the commodity in a first record corresponding to the second user; when the third user leaves the unmanned supermarket, the first image information and the second image information which have the same face information as the third image information are associated together, so that the selected commodities and the corresponding commodity quantity in the unmanned supermarket recorded in the first record corresponding to the third user can be comprehensively determined, the consumption amount of the third user is determined according to the commodity types and the corresponding commodity quantity, and the corresponding consumption amount is deducted from the payment account of the third user. When the user selects the commodity, the identity of the user and the commodity actually selected by the user are identified according to the second image information, the weight information and the information of the user operation, so that the accuracy of identifying the commodity can be effectively improved.
In order to better understand the above technical solutions, the following detailed description of the technical solutions of the present invention is made by using the accompanying drawings and specific embodiments, and it should be understood that the specific features of the embodiments and the embodiments of the present invention are detailed descriptions of the technical solutions of the present invention, and not limiting the technical solutions of the present invention, and the technical features of the embodiments and the embodiments of the present invention may be combined with each other without conflict.
Referring to fig. 1-2, fig. 1 is a schematic diagram of a composition of a retail system of an unmanned supermarket according to an embodiment of the present invention, and fig. 2 is a schematic diagram of a composition of video monitoring equipment according to an embodiment of the present invention, where the retail system of an unmanned supermarket includes:
the gate comprises an inlet gate 101 and an outlet gate 102 which are respectively arranged at an inlet and an outlet of the unmanned supermarket and are used for acquiring user information entering and exiting the unmanned supermarket.
And the weight sensor 104 is arranged on the goods shelf and used for collecting weight information of the second user after picking and placing goods on the goods shelf.
And a precise positioning device 105 installed at the accommodation area of each type of goods for detecting whether the second user performs a user operation on the goods corresponding to the precise positioning device.
The cloud server 106 is configured to generate a first record according to the received first image information when the first user enters the unmanned supermarket; when the second user purchases the commodity, identifying the second user and the commodity type and the corresponding commodity number purchased by the second user from the unmanned supermarket according to the received second image information, weight information and user operation information, and recording the commodity type and the corresponding commodity number purchased by the second user from the unmanned supermarket into a first record; when the third user leaves the unmanned supermarket, the first image information and the second image information which have the same face information as the third image information are associated together, all commodity types and the corresponding commodity quantity selected and purchased by the third user are obtained from the corresponding first record, and the corresponding consumption amount is deducted from the payment account of the third user.
In the embodiment provided by the invention, the communication mode among the devices can be any one or combination of 4G,5G, wifi and Bluetooth.
The accurate positioning device 105 may be an infrared price tag, a 3D laser imaging device, etc., which can perform accurate positioning.
For example, an infrared price tag of the accurate positioning device 105 is installed in the area where the commodity a is placed, and when the user takes the commodity from the area where the commodity a is placed, the accurate positioning device 105 can detect that the user is taking the commodity a.
It should be noted that, in the embodiment provided in the present invention, the outlet gate 102 and the inlet gate 101 may be one or several, which are not limited herein; the number of the entrance monitoring devices 1031 and the exit monitoring devices 1032 respectively correspond to the entrance gate 101 and the exit gate 102, the number of the commodity monitoring devices 1033 and the weight sensors 104 are multiple, and one shelf at least corresponds to one commodity monitoring device 1033 and one weight sensor 104; the number of precision positioning devices 105 is plural, and only one precision positioning device 105 corresponds to one commodity. In fig. 1-2, although only one of the above devices is shown in the drawings, it should not be understood that there is only one device, but rather one type, such as that all gates installed at an entrance are called entrance gates, all monitoring devices in an unmanned supermarket are called video monitoring devices, all video monitoring devices installed at an entrance gate are called entrance monitoring devices 1031, and so on, and will not be described again.
The cloud server 106 generates a corresponding first record according to the received first image information, and the first record is generated in the following manner:
firstly, identifying first image information to obtain first face information of a first user, and distributing temporary codes for the first user; and generating a first record based on the temporary code and the first face information, and storing the first record in a database of the unmanned supermarket.
For example, when the user A, B, C performs an unmanned supermarket, the user A, B, C enters the unmanned supermarket through the portal gate 101 at the portal, and when the user passes through the portal gate 101, the portal monitoring device 1031 installed on the portal gate 101 collects the first image information a of the user a, the first image information B of the user B, and the first image information C of the user C, and sends them to the cloud server 106, and the cloud server 106 identifies the first image information a, the first image information B, and the first image information C, obtains the first face information a, the first face information B, and the first face information C, and sequentially allocates the temporary codes 1, 2, and 3 thereto, thereby generating the first record a (1, the first face information a), the first record B (2, the first face information B), and the first record C (3, the first face information C), and then stores the first record a, the first record B, and the first record C in the database of the unmanned supermarket.
In the embodiment provided by the invention, whether the user is registered in the unmanned supermarket or not before, the user can enter the unmanned supermarket, and the cloud server 106 of the unmanned supermarket establishes a record for the user through the acquired first image information of the user entering the unmanned supermarket, so that the follow-up user can conveniently and accurately record the selected commodities of each user when selecting the commodities in the unmanned supermarket.
After the user enters the unmanned supermarket, when the user selects the commodity (the user who takes and puts the commodity is called a second user in the embodiment provided by the invention), the commodity monitoring device 1033 installed in the goods shelf area can acquire second image information of the second user, the weight sensor 104 installed on the goods shelf can acquire the weight of the second user after taking and putting the commodity on the goods shelf, and the accurate positioning device 105 installed in the entrance area where the commodity taken and put by the second user can send a signal to the cloud server 106, so that the cloud server 106 determines that the second user performs user operation on the commodity of the commodity type according to the commodity type corresponding to the accurate positioning device 105, and the user operation includes a commodity taking operation and a commodity putting operation.
The cloud server 106 identifies the second user and the type of the commodity actually purchased from the unmanned supermarket by the second user and the corresponding number of the commodity according to the received second image information, weight information and user operation information, specifically, the following method may be adopted:
the following operations are executed for second image information, weight information and commodity type corresponding to a second user obtained at the same time:
and identifying the second image information to obtain second face information of a second user and the first commodity.
Because the second image information is an image of the commodity taken and placed by the user, by identifying the second image information, the second face information of the second user can be identified, and the second user can be identified as to what commodity is taken and placed, namely the second commodity.
The weight change information may be obtained based on the weight information and the original weight information of the pallet before or after the second image information is identified.
Since the kind of each commodity on the shelf is determined, the second commodity can be determined based on the weight change information, and the amount of change in the weight information of each type of commodity on the shelf.
Because the accurate positioning device 105 is installed in the entrance area of each type of commodity, when the user takes and puts the commodity, the server can determine the corresponding commodity type according to the received signal of the accurate positioning device 105, and then determine the third commodity based on the commodity type.
Since the three types of commodities can be determined by the first image information, the weight change information and the commodity type corresponding to the accurate positioning device 105, and the accuracy of the three types of commodities is different, that is, the accuracy of the commodity determined by the first image information is the highest, the accuracy of the commodity determined by the accurate positioning device 105 is the lowest, and the weight change information is the lowest, preset weight values are set for the commodities determined by the three types of commodities, for example, the preset weight value of the first commodity is 0.45, the preset weight value of the second commodity is 0.3 and the preset weight value of the third commodity is 0.25. Then, the type of the commodity actually taken and put by the second user is determined from the first commodity, the second commodity and the third commodity according to the preset weight values corresponding to the commodity monitoring device 1033, the weight sensor 104 and the accurate positioning device 105.
And then, calculating the number of the commodities of the commodity type actually selected by the second user according to the weight of the single commodity of the commodity type actually selected by the second user and the weight change information.
Before or after calculating the number of the commodities of the commodity type actually selected by the second user, comparing the second face information with the first face information in each first record, and determining the first record corresponding to the second face information;
recording the commodity number of the commodity type actually fetched and placed by the second user in one item of the first record corresponding to the second face information; when the weight information is increased, the second user replaces the commodity, and deletes or modifies the corresponding item in the first record; when the weight information is reduced, the second user increases or modifies the corresponding item in the first record for removing the commodity.
For example, assume that there are a user a, a user B, and a user C in the unmanned supermarket, when the user a selects a commodity on the shelf 1, the commodity collection device corresponding to the shelf 1 performs image collection on the user a, and sends the collected second image information a to the cloud server 106, the cloud server 106 identifies the second image information a, and when determining that the user a selects the first commodity a, that is, the cloud server 106 obtains the second face information a and the first commodity a of the second user, and the cloud server 106 obtains the current weight information of the shelf 1 through the weight sensor 104 on the shelf 1, and determines weight change information according to the original weight information and the current weight information of the shelf 1, so that the user a may select the second commodity a in combination with the commodity weight, and the cloud server 106 determines that the user a may select the third commodity a according to the received signal of the accurate positioning device 105 and the corresponding relation between the accurate positioning device 105 and the commodity, and the cloud server 106 determines that the user a may select the third commodity a because the preset weight values of the first commodity a, the second commodity a, the third commodity a, and the third commodity a may be sequentially taken 0.45, 0.0, 0.25, and 0.25 are the actual commodity a (the actual commodity a is determined according to the actual weight of the user).
And comparing the second face information A with each first face information in the database, determining that the second face information A corresponds to the first record A, and recording 2 boxes of milk actually taken by the user A in one item of the first record A. If there is already a milk item in the first record, the quantity of milk is directly modified, and if there is no milk item, the quantity of milk is increased in the first record, and the commodity quantity is recorded as 2.
It should be appreciated that in the embodiments provided herein, one of the first records should be understood as exactly one item of merchandise, and not as different brands of merchandise in the same category of merchandise.
When the user is to put back the commodity on the shelf, the identification of the commodity and the identification of the user are similar to the process of selecting the commodity, and are not repeated herein, except that when the user records the commodity in the first record, the corresponding commodity is deleted or the number of the corresponding commodity is modified.
The cloud server 106 determines the type of the commodity actually taken and placed by the second user from the first commodity, the second commodity and the third commodity according to preset weight values corresponding to the commodity monitoring device 1033, the weight sensor 104 and the accurate positioning device 105, and the method is implemented as follows:
if at least two commodities in the first commodity, the second commodity and the third commodity are the same, adding the preset weight value corresponding to the same commodity, and determining the commodity with the highest weight value after adding as the commodity type actually fetched and placed by the second user.
If the first commodity, the second commodity and the third commodity are three different commodities, determining the commodity corresponding to the highest preset weight value as the commodity type actually fetched and placed by the second user.
For example, assuming that the first commodity a, the second commodity a and the third commodity a are three different commodities, and their preset weight values are 0.45, 0.3 and 0.25 in sequence, the first commodity a corresponding to the maximum preset weight value 0.45 is determined as the commodity actually taken by the user a.
For another example, assuming that the second commodity a and the third commodity a are the same commodity and are different from the first commodity a, the preset weight values of the second commodity a and the third commodity a are added, the obtained weight value is 0.3+0.25=0.55, and the weight value of the first commodity a is 0.45, so that the second commodity a or the third commodity a corresponding to the maximum preset weight value of 0.55 can be determined as the commodity actually taken by the user a.
If the first commodity A cannot be identified, the second commodity A and the third commodity A are different commodities, and the commodity with the largest preset weight value is determined to be the commodity actually taken by the user A.
Referring to fig. 3, a second schematic diagram of the composition of the retail system of the unmanned supermarket according to the embodiment of the invention is shown, after the cloud server 106 obtains the weight change information, if the weight change information is increased, and if the weight change information is inconsistent with the weight change of the goods in the goods shelf, it is determined that the second user misplaces the goods shelf; the cloud server 106 sends a prompt to the second user to replace the merchandise. The prompt information may be broadcasted through the voice device 107, or may be displayed through the display device 108 that can be seen by the user, which is not limited in detail.
If it is determined that the second user misplaces the goods on the shelf within the preset time period after the cloud server 106 sends the prompt information for repositioning the goods to the second user, the prompt information is sent to the staff.
When other users come to the shelf, the cloud server 106 sends information of the article placement error to the other users.
For example, assuming that the article B should be placed on the shelf 1, after the second user B places the article B on the shelf 2, the cloud server 106 recognizes that the second user B misplaces the article B on the shelf, and sends a notification message to the second user that the article B misplaces the shelf, please replace the article B, but the second user B does not replace the article B, that is, the cloud server 106 determines that the second user B does not replace the article B within a preset period (for example, 3 minutes) through the collected image information, and then sends a notification message to the staff to enable the staff to place the article B on the correct shelf.
When other users arrive at the shelf where the commodity B is misplaced, the cloud server 106 sends information of the misplaced commodity B to the other users, so that the other users know that the price of the commodity B at the placement position is not the true price of the commodity B, and the other users can be prompted to place the commodity B on the correct shelf.
It should be noted that, the identification process of placing the article B back to the shelf is similar to the identification process of selecting the article before, so that the description thereof will not be repeated here.
When the user selects the commodity to arrive at the exit gate 102, the exit monitoring device 1032 installed on the exit gate 102 collects third image information, the cloud server 106 identifies the third image information, obtains third face information of the third user, compares the third face information with each first face information and each second face information recorded in the database, and determines a first record corresponding to the third face information.
When the commodity number in the first record is zero, determining that the third user does not shop; the exit gate 102 is controlled to open to let the third user leave.
Determining that the third user is shopping when the number of goods in the first record is non-zero; judging whether a payment account corresponding to the third face information exists in the database or not based on the third face information and the database; if not, the prompt message of binding the payment account is sent to the third user.
Please refer to fig. 4, which is a third schematic diagram of the composition of the retail system of the unmanned supermarket according to the embodiment of the present invention, after calculating the consumption amount of the third user according to the number of all the commodities and the commodity type in the first record, deducting the consumption amount from the payment account of the third user, and sending the prompt message of deducting the consumption amount to the voice device 107 for voice broadcasting; or, a prompt for the amount of the consumption is sent to the third user's designated device 109.
The pointing device 109 may be a mobile device such as a cell phone, tablet computer, laptop computer, etc., and is not limited herein.
In the embodiment provided by the invention, when a first user enters an unmanned supermarket, a cloud server generates a corresponding first record according to received first image information; when the second user purchases the commodity, identifying the type of the commodity and the corresponding number of the commodity actually purchased by the second user from the unmanned supermarket according to the received second image information, weight information and user operation information, and recording the type of the commodity and the corresponding number of the commodity in a first record corresponding to the second user; when the third user leaves the unmanned supermarket, the first image information and the second image information which have the same face information as the third image information are associated together, so that the selected commodities and the corresponding commodity quantity in the unmanned supermarket recorded in the first record corresponding to the third user can be comprehensively determined, the consumption amount of the third user is determined according to the commodity types and the corresponding commodity quantity, and the corresponding consumption amount is deducted from the payment account of the third user. When the user selects the commodity, the identity of the user and the commodity actually selected by the user are identified according to the second image information, the weight information and the information of the user operation, so that the accuracy of identifying the commodity can be effectively improved.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the invention may take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (9)
1. A retail system for an unmanned supermarket, comprising:
the gate is arranged at an access port of the unmanned supermarket and used for acquiring user information entering and exiting the unmanned supermarket;
the video monitoring equipment comprises access monitoring equipment and commodity monitoring equipment; the entrance monitoring equipment is arranged on the entrance gate and used for collecting first image information of a first user entering the unmanned supermarket; the commodity monitoring equipment is arranged in the area where the goods shelf is located and is used for acquiring second image information of the commodities fetched and placed by a second user; the exit monitoring equipment is arranged on the exit gate and used for collecting third image information of a third user who is about to leave the unmanned supermarket;
the weight sensor is arranged on the goods shelf and used for collecting weight information of the second user after picking and placing goods on the goods shelf;
the accurate positioning device is arranged in the accommodating area of each type of commodity and is used for detecting whether the second user performs user operation on the commodity corresponding to the accurate positioning device;
the cloud server is used for generating a first record according to the received first image information when the first user enters the unmanned supermarket; when the second user purchases goods, identifying the second user and the type of goods purchased by the second user from the unmanned supermarket and the corresponding quantity of goods according to the received second image information, the received weight information and the received user operation information, and recording the type of goods purchased by the second user from the unmanned supermarket and the corresponding quantity of goods in the first record; when a third user leaves the unmanned supermarket, associating first image information and second image information which have the same face information with the third image information together, acquiring all commodity types and corresponding commodity numbers purchased by the third user from the corresponding first records, and deducting corresponding consumption amount from a payment account of the third user;
and identifying a second user and the type of goods purchased by the second user from the unmanned supermarket and the corresponding quantity of goods according to the received second image information, the weight information and the information operated by the user, wherein the method comprises the following steps of: the following operations are executed for the second image information, the weight information and the commodity type corresponding to the second user obtained at the same time: identifying the second image information to obtain second face information of the second user and first commodities; acquiring weight change information based on the weight information and the original weight information of the goods shelf; determining a second commodity based on the weight change information and the weight information change amounts of various types of commodities on the goods shelf; determining a commodity type according to the received signal of the accurate positioning equipment, and determining a third commodity based on the commodity type; determining the type of the commodity actually taken and placed by the second user from the first commodity, the second commodity and the third commodity according to preset weight values corresponding to the commodity monitoring equipment, the weight sensor and the accurate positioning equipment; calculating the number of the commodities of the commodity type actually selected by the second user according to the single weight of the commodity type actually selected by the second user and the weight change information; comparing the second face information with the first face information in each first record, and determining the first record corresponding to the second face information; recording the commodity quantity of the commodity type actually fetched and placed by the second user in one item of a first record corresponding to the second face information; when the weight information is increased, the second user replaces the commodity, and deletes or modifies the corresponding item in the first record; when the weight information is reduced, the second user increases or modifies the corresponding item in the first record for taking the commodity.
2. The retail system of claim 1, wherein the cloud server is specifically configured to:
identifying the first image information, obtaining first face information of the first user, and distributing temporary codes for the first user;
and generating the first record based on the temporary code and the first face information, and storing the first record in a database of the unmanned supermarket.
3. The retail system of claim 1, wherein the cloud server is to:
if at least two commodities in the first commodity, the second commodity and the third commodity are the same, carrying out addition operation on preset weight values corresponding to the same commodity, and determining the commodity with the highest weight value after the addition operation as the commodity type actually fetched and placed by the second user;
if the first commodity, the second commodity and the third commodity are three different commodities, determining the commodity corresponding to the highest preset weight value as the commodity type actually fetched and placed by the second user.
4. The retail system of claim 3, wherein the cloud server is further configured to:
when the weight information is an increase in the weight,
if the weight change information is inconsistent with the weight change of the goods in the goods shelf, determining that the goods are misplaced by the second user;
and sending prompt information for repositioning the commodity to the second user.
5. The retail system of claim 4, wherein the cloud server is further configured to:
if the fact that the goods are misplaced by the second user is determined within the preset time after the prompt information of the goods are replaced is sent to the second user, the prompt information is sent to staff;
and when other users come to the goods shelf, sending information of the goods placement errors to the other users.
6. The retail system of claim 2, wherein the cloud server is to:
identifying the third image information to obtain third face information of the third user;
and comparing the third face information with the first face information and the second face information in each first record in the database, and determining the first record corresponding to the third face information.
7. The retail system of claim 6, wherein the cloud server is to:
when the commodity quantity is zero, determining that the third user does not shop;
and controlling the outlet gate to be opened so as to enable the third user to leave.
8. The retail system of claim 6, wherein the cloud server is to:
determining that the third user is shopping when the number of items is non-zero;
judging whether a payment account corresponding to the third face information exists in the database or not based on the third face information and the database;
if not, the prompt message of binding the payment account is sent to the third user.
9. The retail system of claim 1, wherein the cloud server is to:
sending prompt information deducting the consumption amount to voice equipment for voice broadcasting;
or sending the prompt information of the consumption amount to the appointed equipment of the third user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010115039.3A CN111339929B (en) | 2020-02-25 | 2020-02-25 | Retail system of unmanned supermarket |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010115039.3A CN111339929B (en) | 2020-02-25 | 2020-02-25 | Retail system of unmanned supermarket |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111339929A CN111339929A (en) | 2020-06-26 |
| CN111339929B true CN111339929B (en) | 2023-05-16 |
Family
ID=71185613
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010115039.3A Active CN111339929B (en) | 2020-02-25 | 2020-02-25 | Retail system of unmanned supermarket |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111339929B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113254910B (en) * | 2021-07-07 | 2021-10-26 | 新石器慧通（北京）科技有限公司 | User convenient authentication method and device for unmanned vehicle authentication system |
| CN113744473B (en) * | 2021-08-31 | 2022-08-23 | 智码迅付信息科技有限公司 | Face recognition system and method based on 3D structured light |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108564442A (en) * | 2018-04-11 | 2018-09-21 | 合肥美的智能科技有限公司 | Unmanned retail trade system and its control method, goods selling equipment and Cloud Server |
| CN109147174A (en) * | 2018-09-05 | 2019-01-04 | 深圳正品创想科技有限公司 | A kind of self-service method, server and self-service cabinet |
| KR20190093733A (en) * | 2018-01-10 | 2019-08-12 | 트라이큐빅스 인크. | Items recognition system in unmanned store and the method thereof |
| CN110246284A (en) * | 2018-03-07 | 2019-09-17 | 上海善解人意信息科技有限公司 | Unattended Supermarket shopping system and its control method |
| CN110443637A (en) * | 2019-07-16 | 2019-11-12 | 浙江大华技术股份有限公司 | User's Shopping Behaviors analysis method, device and storage medium |
-
2020
- 2020-02-25 CN CN202010115039.3A patent/CN111339929B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20190093733A (en) * | 2018-01-10 | 2019-08-12 | 트라이큐빅스 인크. | Items recognition system in unmanned store and the method thereof |
| CN110246284A (en) * | 2018-03-07 | 2019-09-17 | 上海善解人意信息科技有限公司 | Unattended Supermarket shopping system and its control method |
| CN108564442A (en) * | 2018-04-11 | 2018-09-21 | 合肥美的智能科技有限公司 | Unmanned retail trade system and its control method, goods selling equipment and Cloud Server |
| CN109147174A (en) * | 2018-09-05 | 2019-01-04 | 深圳正品创想科技有限公司 | A kind of self-service method, server and self-service cabinet |
| CN110443637A (en) * | 2019-07-16 | 2019-11-12 | 浙江大华技术股份有限公司 | User's Shopping Behaviors analysis method, device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111339929A (en) | 2020-06-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11847689B2 (en) | Dynamic customer checkout experience within an automated shopping environment | |
| CN107103503B (en) | Order information determining method and device | |
| CN107103502B (en) | Order information determining method and device | |
| WO2019165892A1 (en) | Automatic vending method and apparatus, and computer-readable storage medium | |
| JP2017208110A (en) | Method for detecting item interaction and movement | |
| CN108780596A (en) | Information processing system | |
| US11373160B2 (en) | Monitoring shopping activities using weight data in a store | |
| CN110866429A (en) | Missed scanning identification method and device, self-service cash register terminal and system | |
| US20190251619A1 (en) | Apparatuses, systems, and methods for in store shopping | |
| US9311668B2 (en) | Determining to audit a customer utilizing analytics | |
| US20170046774A1 (en) | Payment assistance device, payment assistance method, and program | |
| CN111339929B (en) | Retail system of unmanned supermarket | |
| CN112464697A (en) | Vision and gravity sensing based commodity and customer matching method and device | |
| JP2023509844A (en) | Customized retail environment | |
| JP3837475B2 (en) | Automated shopping system | |
| JPWO2019171572A1 (en) | Self-checkout system, purchased product management method and purchased product management program | |
| CN111507792A (en) | Self-service shopping method, computer readable storage medium and system | |
| CN111383405A (en) | Vending processing method, system and device and cash registering processing method and device | |
| US20210287226A1 (en) | System and method for managing intangible shopping transactions in physical retail stores | |
| CN115641548A (en) | Abnormality detection method, apparatus, device and storage medium | |
| CN114358881A (en) | Self-service settlement method, device and system | |
| CN110956761B (en) | Object processing method and system, computer system and computer readable medium | |
| CN112036991A (en) | Intelligent management shopping guide system for shopping mall | |
| CN109410482A (en) | A kind of unmanned convenience store's order generation method and system | |
| TW202009878A (en) | Vending device for suggesting shoppers to purchase from other device when commodity sold out and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |