CN110246284A - Unattended Supermarket shopping system and its control method - Google Patents

Unattended Supermarket shopping system and its control method Download PDF

Info

Publication number
CN110246284A
CN110246284A CN201810188611.1A CN201810188611A CN110246284A CN 110246284 A CN110246284 A CN 110246284A CN 201810188611 A CN201810188611 A CN 201810188611A CN 110246284 A CN110246284 A CN 110246284A
Authority
CN
China
Prior art keywords
commodity
user
module
identification
clearing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810188611.1A
Other languages
Chinese (zh)
Inventor
鄢琴
王熙睿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Savvy Mdt Infotech Ltd
Original Assignee
Shanghai Savvy Mdt Infotech Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Savvy Mdt Infotech Ltd filed Critical Shanghai Savvy Mdt Infotech Ltd
Priority to CN201810188611.1A priority Critical patent/CN110246284A/en
Publication of CN110246284A publication Critical patent/CN110246284A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07GREGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00Cash registers
    • G07G1/12Cash registers electronically operated

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Multimedia (AREA)
  • Control Of Vending Devices And Auxiliary Devices For Vending Devices (AREA)
  • Cash Registers Or Receiving Machines (AREA)

Abstract

Present invention discloses a kind of unattended Supermarket shopping system and its control method, the purchase system includes main control module, user information identification module, commodity monitoring modular, picking recording device, settlement module;Information of the main control module to receive the transmission of system various pieces, and comprehensively control is carried out to system various pieces;Identity information of the user information identification module to identify user;Whether commodity monitoring modular is to real-time monitoring commodity in corresponding position;Picking recording device is to carry out identification to the user for extracting the commodity, and the commodity extracted to the user keep a record after the commodity monitoring module monitors are extracted to commodity;Settlement module is settled accounts to the commodity bought to the picking recording device records user.Unattended Supermarket shopping system proposed by the present invention can obtain user in unattended supermarket in real time and take principle condition, and whens clearing is not necessarily to barcode scanning;Or barcode scanning and the data of monitoring are compared, avoid commodity from disappearing without foundation.

Description

Unattended Supermarket shopping system and its control method
Technical field
The invention belongs to electronic information technical fields, are related to a kind of purchase system more particularly to a kind of unattended supermarket Purchase system;Meanwhile the invention further relates to a kind of control methods of unattended Supermarket shopping system.
Background technique
Supermarket, that is, supermarket, generally refers to the open display of commodity, customer self chooses, is lined up cash register clearing, with operation Shop based on fresh food, various household supplies articles;It is a kind of self-service retailer for choosing, unifying cash register clearing of consumer.
And with the development of science and technology, having recently emerged unattended supermarket.Attendant is engaged due to hardly needing, it can Think that supermarket saves biggish expenditure.
However, existing unattended supermarket cannot can only fundamentally be prevented by the behavior of camera head monitor customer Pilferage behavior.
In view of this, nowadays there is an urgent need to design a kind of new unattended supermarket, it is existing unattended super to overcome Drawbacks described above existing for city.
Summary of the invention
The technical problems to be solved by the present invention are: providing a kind of unattended Supermarket shopping system, use can be obtained in real time Family takes principle condition unattended supermarket, and whens clearing is not necessarily to barcode scanning;Or it can judge the quotient of the commodity that user takes out and purchase Product are checked, and commodity is avoided to disappear without foundation.
In addition, can obtain in real time user the present invention also provides a kind of control method of unattended Supermarket shopping system and exist Unattended supermarket takes principle condition, and whens clearing is not necessarily to barcode scanning;Or can judge user take out commodity and purchase commodity into Row verification, avoids commodity from disappearing without foundation.
In order to solve the above technical problems, the present invention adopts the following technical scheme:
A kind of unattended Supermarket shopping system, the system comprises:
Main control module carries out comprehensive control to receive the information of system various pieces transmission, and to system various pieces System;
Image collection module, to obtain image information;
Face detection module, to judge whether there is facial image in dynamic scene and complex background, and by face Image is separated;
Face tracking module, the facial image detected to track the face detection module;
Face recognition module, the face information to be isolated according to face detection module carry out identification to user, Obtain user information;
Monitoring module to obtain the video image of setting regions, and is stored in setting data storage device;
Commodity display device, to display the commodity of sale;Commodity display device is set in merchandise show;
Merchandise storage device, to store the commodity of sale, merchandise storage device is set in merchandise show;
Commodity monitoring modular, to real-time monitoring commodity whether in corresponding position;
Commodity goods compensator, to store and fill from the commodity after the commodity in the commodity display module are extracted Middle extraction commodity are set, commodity display device is delivered to;
Picking recording device, to after the commodity monitoring module monitors are extracted to commodity, to extracting the commodity User carries out identification;Picking recording device identifies user identity by recognition of face, and the user is extracted Commodity keep a record;
Return of goods device identifies commodity and user, and will to be not desired to the commodity bought after receiving user's picking The commodity of the return of goods are delivered in closed container;After returning goods successfully, picking recording device deletes corresponding goods from record;It moves back Goods device is set in merchandise show;
Commodity settle accounts identification module, successively to identify the commodity of user's purchase in clearing, while identifying commodity The identity of user is identified;Commodity clearing identification module is set in clearing;
Settlement module, the commodity to obtain user's purchase to the commodity identification module are settled accounts;The clearing mould The commodity that root tuber is identified according to the commodity identification module, and calculate total price;
Auditing module, the commodity to the commodity and the picking recording device records of settling accounts settlement module compare It is right, judge whether clearing are consistent, and feed back to main control module;
Each commodity are equipped with corresponding commodity display device;Alternatively, a commodity display device displays several commodity, commodity Weight sensor is set below showing device, and the variation judgement that the commodity monitoring modular passes through weight sensor sensed data is It is no to there are commodity to be removed;
The commodity goods compensator includes the container that replenishes, and the container that replenishes connects merchandise storage device;Replenish the support of container Mechanism is equipped with weight sensor, to incude the weight change for the container that replenishes, to sense fill-ins in the container that replenishes Total weight, due to the weight of every commodity be it is identical, using fill-ins total weight divided by every commodity weight, thus The quantity that replenishes of corresponding goods is calculated;
The merchandise storage device is equipped with commodity storage container, conveyor-belt apparatus, and commodity storage passes on conveyor-belt apparatus Commodity in commodity storage container are sent to the container that replenishes by Work-feeding means;
The purchase system includes supermarket place, and supermarket place includes between user identifies, between merchandise show, between clearing;
First entrance is equipped between user's identification, first entrance is equipped with the first electrically operated gate;First electrically operated gate is equipped with Distance-sensing Device, in user in first entrance, the first electrically operated gate is opened, and user is allowed to enter between user's identification;Image is equipped between user's identification Module is obtained, user's face information is obtained, is identified for face recognition module;
Second entrance is equipped between user's identification between merchandise show, second entrance is equipped with the second electrically operated gate;Recognition of face mould After block obtains subscriber identity information success, the second electrically operated gate is opened, and user can be entered between merchandise show by second entrance;
Between merchandise show between clearing between be equipped with first outlet, first outlet be equipped with third electrically operated gate;Third automatically-controlled door Equipped with request key is left, user presses this and leaves request key after the completion of shopping;Third automatically-controlled door is equipped with image and obtains mould Block, the face information that will acquire feed back to face recognition module, and face recognition module identifies the identity information of user, know Not Cheng Gong after, third electrically operated gate is opened, and user can be entered between clearing by third electrically operated gate;
Second outlet is equipped between clearing, second outlet is equipped with the 4th electrically operated gate, after the completion of user's clearing, the 4th electrically operated gate It opens, allows user to walk out second outlet, leave supermarket.
A kind of unattended Supermarket shopping system, the purchase system include:
Main control module carries out comprehensive control to receive the information of system various pieces transmission, and to system various pieces System;
User information identification module, to identify the identity information of user;
Commodity monitoring modular, to real-time monitoring commodity whether in corresponding position;
Picking recording device, to after the commodity monitoring module monitors are extracted to commodity, to extracting the commodity User carries out identification, and the commodity extracted to the user keep a record;
Settlement module, the commodity to buy to the picking recording device records user are settled accounts;Or pass through quotient Product identification device identifies that each commodity are settled accounts, and the commodity recognized and the commodity of picking recording device records are carried out core It is right.
As a preferred solution of the present invention, the user information identification module includes:
Face detection module, to judge whether there is facial image in dynamic scene and complex background, and by face Image is separated;
Face tracking module, the facial image detected to track the face detection module;
Face recognition module, the face information to be isolated according to face detection module carry out identification to user, Obtain user information.
As a preferred solution of the present invention, the purchase system further include:
Commodity settle accounts identification module, successively to identify the commodity of user's purchase in clearing, while identifying commodity The identity of user is identified;Commodity clearing identification module is set in clearing;
Auditing module, the commodity to the commodity and the picking recording device records of settling accounts settlement module compare It is right, judge whether clearing are consistent, and feed back to main control module.
As a preferred solution of the present invention, the purchase system further include:
Commodity display device, to display the commodity of sale;
Merchandise storage device, to store the commodity of sale.
As a preferred solution of the present invention, the purchase system further include:
Commodity goods compensator, to store and fill from the commodity after the commodity in the commodity display module are extracted Middle extraction commodity are set, commodity display device is delivered to.
As a preferred solution of the present invention, the commodity goods compensator includes the container that replenishes, and the container that replenishes connects quotient Product storage device;Replenish container supporting mechanism be equipped with weight sensor, to incude the weight change for the container that replenishes, to feel The total weight that fill-ins in the container that replenishes should be arrived, due to the weight of every commodity be it is identical, utilize the gross weight of fill-ins The weight divided by every commodity is measured, so that the quantity that replenishes of corresponding goods be calculated;
The merchandise storage device is equipped with commodity storage container, conveyor-belt apparatus, and commodity storage passes on conveyor-belt apparatus Commodity in commodity storage container are sent to the container that replenishes by Work-feeding means.
As a preferred solution of the present invention, the purchase system further include:
Return of goods device identifies commodity and user, and will to be not desired to the commodity bought after receiving user's picking The commodity of the return of goods are delivered in closed container;After returning goods successfully, picking recording device deletes corresponding goods from record;It moves back Goods device is set in merchandise show.
As a preferred solution of the present invention, each commodity are equipped with corresponding commodity display device;Alternatively, a commodity Showing device displays several commodity, weight sensor is arranged below commodity display device, the commodity monitoring modular passes through weight The variation of sensor sensing data judges whether there is commodity and is removed.
As a preferred solution of the present invention, the purchase system includes supermarket place, and supermarket place includes that user knows Between other, merchandise show, between clearing;
First entrance is equipped between user's identification, first entrance is equipped with the first electrically operated gate;First electrically operated gate is equipped with Distance-sensing Device, in user in first entrance, the first electrically operated gate is opened, and user is allowed to enter between user's identification;Image is equipped between user's identification Module is obtained, user's face information is obtained, is identified for face recognition module;
Second entrance is equipped between user's identification between merchandise show, second entrance is equipped with the second electrically operated gate;Recognition of face mould After block obtains subscriber identity information success, the second electrically operated gate is opened, and user can be entered between merchandise show by second entrance;
Between merchandise show between clearing between be equipped with first outlet, first outlet be equipped with third electrically operated gate;Third automatically-controlled door Equipped with request key is left, user presses this and leaves request key after the completion of shopping;Third automatically-controlled door is equipped with image and obtains mould Block, the face information that will acquire feed back to face recognition module, and face recognition module identifies the identity information of user, know Not Cheng Gong after, third electrically operated gate is opened, and user can be entered between clearing by third electrically operated gate;
Second outlet is equipped between clearing, second outlet is equipped with the 4th electrically operated gate, after the completion of user's clearing, the 4th electrically operated gate It opens, allows user to walk out second outlet, leave supermarket.
The beneficial effects of the present invention are: unattended Supermarket shopping system proposed by the present invention and its control method, it can User is obtained in real time and takes principle condition in unattended supermarket, and whens clearing is not necessarily to barcode scanning;Or by barcode scanning and the data of monitoring into Row compares, and commodity is avoided to disappear without foundation.
The present invention can be used for the few unmanned supermarket of crowd, in the more situation of the stream of people, commodity display device Taking mouth can design more narrower, to obtain the face information for taking object customer.Further, it is also possible to increase in commodity Setting barrier mechanism (such as glass cover-plate) at showing device, after customer initiates purchase request, glass cover-plate is dug automatically, by caring for Visitor takes away the commodity of corresponding position.Certainly, user can also initiate to buy how many requests (such as can be gesture), commodity display The commodity that device just transfers out corresponding number come out.
Detailed description of the invention
Fig. 1 is the composition schematic diagram of the unattended Supermarket shopping system of the present invention.
Fig. 2 is the usage scenario schematic diagram of the unattended Supermarket shopping system of the present invention.
Fig. 3 is the schematic diagram of commodity goods compensator in the unattended Supermarket shopping system of the present invention.
Fig. 4 is another schematic diagram of commodity goods compensator in the unattended Supermarket shopping system of the present invention.
Fig. 5 is the another schematic diagram of commodity goods compensator in the unattended Supermarket shopping system of the present invention.
Specific embodiment
The preferred embodiment that the invention will now be described in detail with reference to the accompanying drawings.
Embodiment one
It please refers to Fig.1 to Fig.3, present invention discloses a kind of unattended Supermarket shopping system, the system comprises: master control Module 1, image collection module 2, face detection module 3, face tracking module 4, face recognition module 5, monitoring module 6, commodity Showing device 7, merchandise storage device 8, commodity monitoring modular 9, commodity goods compensator 10, picking recording device 11, return of goods device 12, commodity settle accounts identification module 13, settlement module 14, auditing module 15.
The main control module 1, which is separately connected image collection module 2, face detection module 3, face tracking module 4, face, to be known Other module 5, monitoring module 6, commodity monitoring modular 9, commodity goods compensator 10, picking recording device 11, return of goods device 12, commodity Settle accounts identification module 13, settlement module 14, auditing module 15.
The main control module 1 integrates system various pieces to receive the information of system various pieces transmission Control.
Described image acquisition module 2 is to obtain image information, the face information including customer, in order to the inspection of subsequent face Module 3, face tracking module 4, face recognition module 5 is surveyed to be detected, tracked, identified.
The face detection module 3 to judge whether there is facial image in dynamic scene and complex background, and There is face to separate facial image when occurring.
The facial image that the face tracking module 4 is detected to track the face detection module 3.
The face recognition module 5 carries out identity to user to the face information isolated according to face detection module 3 Identification obtains user information.
Above-mentioned face detection module 3, face tracking module 4, face recognition module 5 are that those skilled in the art can basis What the prior art was realized substantially, and and not this Applicant's Abstract graph core improve, be not described herein.
The monitoring module 6 is stored in setting data storage device to obtain the video image of setting regions;So as to Subsequent transfer is checked.
Commodity 100 of the commodity display device 7 to display sale;Commodity display device is set between merchandise show It is interior.Commodity display device 7 can be miscellaneous cabinet body, be also possible to other forms, as being arranged on desk, even On.Each commodity are equipped with corresponding commodity display device;Alternatively, a commodity display device displays several commodity, commodity display Weight sensor is set below device, and the commodity monitoring modular 9 is judged whether by the variation of weight sensor sensed data There are commodity to be removed.
Commodity of the merchandise storage device 8 to store sale, merchandise storage device are set in merchandise show. The merchandise storage device 8 is equipped with commodity storage container, conveyor-belt apparatus, and commodity storage is on conveyor-belt apparatus, conveyer belt dress It sets and the commodity in commodity storage container is sent to the container that replenishes.
Whether the commodity monitoring modular 9 is to real-time monitoring commodity in corresponding position.Such as, commodity monitoring modular 9 can be with Including position sensor or weight sensor or pressure sensor, position sensor can be infrared sensor, ultrasonic wave passes Sensor etc.;By the way that position sensor or weight sensor or pressure sensor to be set to the setting position of commodity (as being arranged After commodity or lower section, as shown in Figure 2 and Figure 3, position sensor be can be set beside commodity, and pressure sensor may be disposed at Below commodity), whether induction commodity are taken away from the customer (or customer group) that the commodity pass through just.The concept of customer group Corresponding is multiple clients in more people's shopping one people payment, and multiple client forms customer group.
The commodity goods compensator 10 from the commodity to deposit after the commodity in the commodity display module are extracted Commodity are extracted in storage device 8, are delivered to commodity display device 7.The implementation of commodity goods compensator 10 can use a variety of sides Formula such as sees Fig. 3, and a part of of merchandise storage device 8 can be obliquely installed, and commodity goods compensator 10 includes at least one resistance Door 1001 is kept off, each blocking door 1001 is corresponding to place a similar commodity, stops door 1001 to be equipped with electric control mechanism, can control Stop the switch of door 1001;When opening blocking door 1001, commodity 100 are slid due to its gravity to pair of commodity display device 7 Answer position.Fig. 4 is seen, commodity conveyer belt 801 can also be arranged in merchandise storage device 8, can tilt and set to merchandise storage device 8 The part fill-ins set.
The picking recording device 11 to extracting to be somebody's turn to do after the commodity monitoring modular 9 monitors that commodity are extracted The user of commodity carries out identification.The settable image collection module 2 of the commodity display device 7, for shooting commodity of taking The face information of user, (can be real by face detection module 3, face tracking module 4, face recognition module 5 by recognition of face It is existing) user identity is identified, and the commodity extracted to the user keep a record.The purpose of picking recording device 11 is that induction cares for Objective (or customer group) has taken how many commodity, so that the subsequent commodity with the customer (or customer group) payment are checked, prevents Only commodity are lost.
The return of goods device 12 identifies commodity and user to be not desired to the commodity bought after receiving user's picking (commodity identification can settle accounts identification module 13 by setting commodity and identify to commodity, such as scanning recognition;User's identification can lead to Face detection module 3, face tracking module 4, face recognition module 5 is crossed to realize), and the commodity of the return of goods are delivered to closed appearance (to prevent from being taken by people) in device;After returning goods successfully, picking recording device 11 deletes corresponding goods from record;Return of goods device It is set in merchandise show.The purpose that return of goods device 12 is arranged be easy for customer retract be not intended to purchase, taken Commodity, while informing picking recording device 11.
Commodity of the commodity clearing identification module 13 successively to identify user's purchase in clearing, in identification commodity The identity of user is identified simultaneously;Commodity clearing identification module is set in clearing.
The settlement module 14 is settled accounts to the commodity for obtaining user's purchase to the commodity identification module;The knot The commodity that module is identified according to the commodity identification module are calculated, and calculate total price.
The auditing module 15 to the commodity of settling accounts settlement module and the commodity of the picking recording device records into Row compares, and judges whether clearing are consistent, and feeds back to main control module 1.
In the present embodiment, the purchase system includes supermarket place, and supermarket place includes 21, merchandise show between user's identification Between 22, clearing between 23.
21 are equipped with first entrance between user's identification, and first entrance is equipped with the first electrically operated gate 211;First electrically operated gate 211 is equipped with Range sensor, in user in first entrance, the first electrically operated gate 211 is opened, and user is allowed to enter 21 between user's identification;User knows It is equipped with image collection module 2 for other 21, obtains user's face information, user identity is identified for face recognition module 5.
User identification between 21 and merchandise show 22 be equipped with second entrance, second entrance be equipped with the second electrically operated gate 212;Face After identification module 5 obtains subscriber identity information success, the second electrically operated gate 212 is opened, and user can enter commodity by second entrance 22 between sales exhibition.
It is equipped with first outlet between merchandise show between 22 and clearing between 23, first outlet is equipped with third electrically operated gate 231;Third Automatically-controlled door 231 is equipped with and leaves request key, and user presses this and leave request key after the completion of shopping;Third automatically-controlled door 231 is set There is image collection module 2, the face information that will acquire feeds back to face recognition module 5, identity of the face recognition module 5 to user Information is identified, after identifying successfully, third electrically operated gate 231 is opened, and user can be entered between clearing by third electrically operated gate 231 23。
23 are equipped with second outlet between clearing, and second outlet is equipped with the 4th electrically operated gate 232, after the completion of user's clearing, the 4th Electrically operated gate 232 is opened, and is allowed user to walk out second outlet, is left supermarket.
The process for using of present system includes:
Step S1, user enters 21 between user's identification, is identified by identity information, enters between merchandise show after being proved to be successful 22 shopping;
Step S2, user removes the commodity of needs from commodity display device 7, and commodity monitoring modular 9 monitors quotient at this time Product are removed;Face recognition module 5 is identified by the user to commodity periphery, is recognized and is removed by which user;If According to the setting of system, commodity goods compensator 10 needs replenish, replenish, if not reaching the condition of replenishing first not into Row replenishes;Picking recording device 11 records the record that each user removes commodity;
Step S3, it when user needs returning merchandise before payment, is returned goods by return of goods device 12;Return of goods device 12 is equipped with Commodity settle accounts identification module 13, can identify the attribute of user's return of goods commodity;Return of goods device 12 cooperates the identification of face recognition module 5 to move back The attribute of goods user;
Step S4, when user's picking is completed, request key is left by 23 first outlets between clearing by pressing, into knot 23 between calculation;
Step S5,23 between clearing, the commodity of selection are settled accounts identification module 13 by commodity and identified by user;It settles accounts simultaneously Between 23 be equipped with image collection module, can obtain the identity information of each user in 23 between settling accounts;This system can be equipped with multiple knots It in 23 (may be a people, it is also possible to a family to same customer group between each clearing to be worthwhile convenient for system 23 between calculation Front yard or other relationships) in customer settle accounts.Therefore, picking recording device 11 is by each user between clearing 23 Picking record summarizes, and the commodity identified with commodity clearing identification module 13 are compared, and judges whether to match;If matching, the 4th automatically-controlled door of two outlets is opened, if mismatching, issues warning information or prompting message, while providing ill-matched quotient Product, user can voluntarily check.
Embodiment two
The difference between this embodiment and the first embodiment lies in the present embodiment, referring to Fig. 4, the commodity goods compensator 10 Including the container 1002 that replenishes, the container 1002 that replenishes connects merchandise storage device 8;Replenish container 1002 supporting mechanism be equipped with weight Sensor (not shown), to incude the weight change for the container that replenishes, to sense fill-ins in the container 1002 that replenishes Total weight, due to the weight of every commodity be it is identical, using fill-ins total weight divided by every commodity weight, thus The quantity that replenishes of corresponding goods is calculated.At this point, several commodity 100 are set to jointly in a cabinet, setting pressure below cabinet Force snesor can incude the variation of commodity amount.
In order to improve the accuracy that picking recording device 11 identifies the commodity user that takes, shopping rule can be set: same It does shopping cabinet, can only have a user on periphery (to avoid user's first from taking commodity, since user's second also aside thinks It is that user's second has been taken commodity);Or it requires user to take after commodity (can while will to take towards the signal of taking pictures of setting camera The commodity taken are placed on beside face);Or user is required to illustrate (such as by other setting means to the picking recording device 11 of system Press setting key after towards setting camera take pictures, or take commodity when);Or by image processing techniques to (sending out When raw commodity leave setting position) image of each user analyzes, and automatic (or by artificial) judgement is which user takes Commodity.
The merchandise storage device 8 is equipped with commodity storage container, conveyor-belt apparatus 801, and commodity 100 are stored in conveyer belt dress It sets on 801, the commodity in commodity storage container are sent to the container 1002 that replenishes by conveyor-belt apparatus 801.
Embodiment three
A kind of unattended Supermarket shopping system, the purchase system include: main control module, user information identification module, Commodity monitoring modular, picking recording device, settlement module;Main control module is separately connected user information identification module, commodity monitoring Module, picking recording device, settlement module.
Information of the main control module to receive the transmission of system various pieces, and comprehensively control is carried out to system various pieces;
Identity information of the user information identification module to identify user;
Whether commodity monitoring modular is to real-time monitoring commodity in corresponding position;
Picking recording device is to after the commodity monitoring module monitors are extracted to commodity, to the use for extracting the commodity Family carries out identification, and the commodity extracted to the user keep a record;
Settlement module is settled accounts to the commodity bought to the picking recording device records user.
Example IV
A kind of unattended Supermarket shopping system, the purchase system include: main control module, user information identification module, Commodity monitoring modular, picking recording device, settlement module, auditing module;Main control module be separately connected user information identification module, Commodity monitoring modular, picking recording device, settlement module, auditing module.
Information of the main control module to receive the transmission of system various pieces, and comprehensively control is carried out to system various pieces;
Identity information of the user information identification module to identify user;
Whether commodity monitoring modular is to real-time monitoring commodity in corresponding position;
Picking recording device is to after the commodity monitoring module monitors are extracted to commodity, to the use for extracting the commodity Family carries out identification, and the commodity extracted to the user keep a record;
Settlement module is settled accounts by the commodity that article identification device recognizes;
Auditing module is compared to the commodity for settling accounts settlement module with the commodity of the picking recording device records, Judge whether clearing are consistent, and feeds back to main control module.
In conclusion unattended Supermarket shopping system proposed by the present invention and its control method, can obtain user in real time Principle condition is taken in unattended supermarket, and whens clearing is not necessarily to barcode scanning.
The present invention can be used for the few unmanned supermarket of crowd, in the more situation of the stream of people, commodity display device Taking mouth can design more narrower, to obtain the face information for taking object customer.Further, it is also possible to increase in commodity Setting barrier mechanism (such as glass cover-plate) at showing device, after customer initiates purchase request, glass cover-plate is dug automatically, by caring for Visitor takes away the commodity of corresponding position.Certainly, user can also initiate to buy how many requests (such as can be gesture), commodity display The commodity that device just transfers out corresponding number come out.
Description and application of the invention herein are illustrative, is not wishing to limit the scope of the invention to above-described embodiment In.The deformation and change of embodiments disclosed herein are possible, the realities for those skilled in the art The replacement and equivalent various parts for applying example are well known.It should be appreciated by the person skilled in the art that not departing from the present invention Spirit or essential characteristics in the case where, the present invention can in other forms, structure, arrangement, ratio, and with other components, Material and component are realized.Without departing from the scope and spirit of the present invention, can to embodiments disclosed herein into The other deformations of row and change.

Claims (10)

1. a kind of unattended Supermarket shopping system, which is characterized in that the purchase system includes:
Main control module carries out comprehensively control to receive the information of system various pieces transmission, and to system various pieces;
Image collection module, to obtain image information;
Face detection module, to judge whether there is facial image in dynamic scene and complex background, and by facial image It separates;
Face tracking module, the facial image detected to track the face detection module;
Face recognition module, the face information to be isolated according to face detection module carry out identification to user, obtain User information;
Monitoring module to obtain the video image of setting regions, and is stored in setting data storage device;
Commodity display device, to display the commodity of sale;Commodity display device is set in merchandise show;
Merchandise storage device, to store the commodity of sale, merchandise storage device is set in merchandise show;
Commodity monitoring modular, to real-time monitoring commodity whether in corresponding position;
Commodity goods compensator, to after the commodity in the commodity display module are extracted, from the merchandise storage device Commodity are extracted, commodity display device is delivered to;
Picking recording device, to after the commodity monitoring module monitors are extracted to commodity, to the user for extracting the commodity Carry out identification;
Picking recording device identifies user identity by recognition of face, and the commodity extracted to the user keep a record;
Return of goods device identifies commodity and user, and will return goods to be not desired to the commodity bought after receiving user's picking Commodity be delivered in closed container;After returning goods successfully, picking recording device deletes corresponding goods from record;It returns goods and fills It installs and is placed in merchandise show;
Commodity settle accounts identification module, to clearing when successively identify user purchase commodity, while identifying commodity to The identity at family is identified;Commodity clearing identification module is set in clearing;
Settlement module, the commodity to obtain user's purchase to the commodity identification module are settled accounts;The settlement module root According to the commodity that the commodity identification module identifies, and calculate total price;
Auditing module, the commodity to settle accounts settlement module are compared with the commodity of the picking recording device records, sentence Whether disconnected clearing are consistent, and feed back to main control module;
Each commodity are equipped with corresponding commodity display device;Alternatively, a commodity display device displays several commodity, commodity display Weight sensor is set below device, and the commodity monitoring modular is judged whether there is by the variation of weight sensor sensed data Commodity are removed;
The commodity goods compensator includes the container that replenishes, and the container that replenishes connects merchandise storage device;Replenish the supporting mechanism of container Equipped with weight sensor, to incude the weight change for the container that replenishes, to sense the gross weight of fill-ins in the container that replenishes Amount, due to the weight of every commodity be it is identical, using fill-ins total weight divided by every commodity weight, to calculate Obtain the quantity that replenishes of corresponding goods;
The merchandise storage device is equipped with commodity storage container, conveyor-belt apparatus, and commodity storage is on conveyor-belt apparatus, conveyer belt Commodity in commodity storage container are sent to the container that replenishes by device;
The purchase system includes supermarket place, and supermarket place includes between user identifies, between merchandise show, between clearing;
First entrance is equipped between user's identification, first entrance is equipped with the first electrically operated gate;First electrically operated gate is equipped with range sensor, User in first entrance, open by the first electrically operated gate, and user is allowed to enter between user's identification;Image, which is equipped with, between user's identification obtains mould Block obtains user's face information, identifies for face recognition module;
Second entrance is equipped between user's identification between merchandise show, second entrance is equipped with the second electrically operated gate;Face recognition module obtains After taking subscriber identity information success, the second electrically operated gate is opened, and user can be entered between merchandise show by second entrance;
Between merchandise show between clearing between be equipped with first outlet, first outlet be equipped with third electrically operated gate;Third automatically-controlled door is equipped with Request key is left, user presses this and leave request key after the completion of shopping;Third automatically-controlled door is equipped with image collection module, The face information that will acquire feeds back to face recognition module, and face recognition module identifies the identity information of user, identification After success, third electrically operated gate is opened, and user can be entered between clearing by third electrically operated gate;
Second outlet is equipped between clearing, second outlet is equipped with the 4th electrically operated gate, and after the completion of user's clearing, the 4th electrically operated gate is beaten It opens, allows user to walk out second outlet, leave supermarket.
2. a kind of unattended Supermarket shopping system, which is characterized in that the purchase system includes:
Main control module carries out comprehensively control to receive the information of system various pieces transmission, and to system various pieces;
User information identification module, to identify the identity information of user;
Commodity monitoring modular, to real-time monitoring commodity whether in corresponding position;
Picking recording device, to after the commodity monitoring module monitors are extracted to commodity, to the user for extracting the commodity Identification is carried out, and the commodity extracted to the user keep a record;
Settlement module, the commodity to buy to the picking recording device records user are settled accounts;Or known by commodity Other device identifies that each commodity are settled accounts, and the commodity recognized and the commodity of picking recording device records are checked.
3. unattended Supermarket shopping system according to claim 2, it is characterised in that:
The user information identification module includes:
Face detection module, to judge whether there is facial image in dynamic scene and complex background, and by facial image It separates;
Face tracking module, the facial image detected to track the face detection module;
Face recognition module, the face information to be isolated according to face detection module carry out identification to user, obtain User information.
4. unattended Supermarket shopping system according to claim 2, it is characterised in that:
The purchase system further include:
Commodity settle accounts identification module, to clearing when successively identify user purchase commodity, while identifying commodity to The identity at family is identified;Commodity clearing identification module is set in clearing;
Auditing module, the commodity to settle accounts settlement module are compared with the commodity of the picking recording device records, sentence Whether disconnected clearing are consistent, and feed back to main control module.
5. unattended Supermarket shopping system according to claim 2, it is characterised in that:
The purchase system further include:
Commodity display device, to display the commodity of sale;
Merchandise storage device, to store the commodity of sale;
Commodity goods compensator, to after the commodity in the commodity display module are extracted, from the merchandise storage device Commodity are extracted, commodity display device is delivered to.
6. unattended Supermarket shopping system according to claim 5, it is characterised in that:
The commodity goods compensator includes the container that replenishes, and the container that replenishes connects merchandise storage device;Replenish the supporting mechanism of container Equipped with weight sensor, to incude the weight change for the container that replenishes, to sense the gross weight of fill-ins in the container that replenishes Amount, due to the weight of every commodity be it is identical, using fill-ins total weight divided by every commodity weight, to calculate Obtain the quantity that replenishes of corresponding goods;
The merchandise storage device is equipped with commodity storage container, conveyor-belt apparatus, and commodity storage is on conveyor-belt apparatus, conveyer belt Commodity in commodity storage container are sent to the container that replenishes by device.
7. unattended Supermarket shopping system according to claim 2, it is characterised in that:
The purchase system further include:
Return of goods device identifies commodity and user, and will return goods to be not desired to the commodity bought after receiving user's picking Commodity be delivered in closed container;After returning goods successfully, picking recording device deletes corresponding goods from record;It returns goods and fills It installs and is placed in merchandise show.
8. unattended Supermarket shopping system according to claim 2, it is characterised in that:
Each commodity are equipped with corresponding commodity display device;Alternatively, a commodity display device displays several commodity, commodity display Weight sensor is set below device, and the commodity monitoring modular is judged whether there is by the variation of weight sensor sensed data Commodity are removed.
9. unattended Supermarket shopping system according to claim 2, it is characterised in that:
The purchase system includes supermarket place, and supermarket place includes between user identifies, between merchandise show, between clearing;
First entrance is equipped between user's identification, first entrance is equipped with the first electrically operated gate;First electrically operated gate is equipped with range sensor, User in first entrance, open by the first electrically operated gate, and user is allowed to enter between user's identification;Image, which is equipped with, between user's identification obtains mould Block obtains user's face information, identifies for face recognition module;
Second entrance is equipped between user's identification between merchandise show, second entrance is equipped with the second electrically operated gate;Face recognition module obtains After taking subscriber identity information success, the second electrically operated gate is opened, and user can be entered between merchandise show by second entrance;
Between merchandise show between clearing between be equipped with first outlet, first outlet be equipped with third electrically operated gate;Third automatically-controlled door is equipped with Request key is left, user presses this and leave request key after the completion of shopping;Third automatically-controlled door is equipped with image collection module, The face information that will acquire feeds back to face recognition module, and face recognition module identifies the identity information of user, identification After success, third electrically operated gate is opened, and user can be entered between clearing by third electrically operated gate;
Second outlet is equipped between clearing, second outlet is equipped with the 4th electrically operated gate, and after the completion of user's clearing, the 4th electrically operated gate is beaten It opens, allows user to walk out second outlet, leave supermarket.
10. the control method of unattended Supermarket shopping system described in a kind of one of claim 1 to 9, which is characterized in that described Method includes the following steps:
Step S1, by range sensor recognize user enter user identification between after, identified by identity information identification device Corresponding user, does shopping after being proved to be successful between merchandise show;
Step S2, user removes the commodity of needs from commodity display device, and commodity monitoring module monitors to commodity are taken at this time Under;Face recognition module is identified by the user to commodity periphery, is recognized and is removed by which user;If according to system Setting, commodity goods compensator needs replenish, replenish, if not reaching the condition of replenishing first without replenishing;Picking Each user removes the record of commodity under recording device records;
Step S3, it when user needs returning merchandise before payment, is returned goods by return of goods device;Return of goods device is settled accounts equipped with commodity Identification module can identify the attribute of user's return of goods commodity;Return of goods device cooperates the attribute of face recognition module identification return of goods user;
Step S4, when user's picking is completed, request key is left by first outlet between clearing by pressing, between clearing 23;
Step S5, between clearing, the commodity of selection are settled accounts identification module identification by commodity by user;Figure is equipped between settling accounts simultaneously As obtaining module, the identity information of each user between settling accounts can be obtained;The system is equipped between multiple clearing, for convenient for system It is worthwhile, the customer in same customer group is settled accounts in each clearing;Therefore, picking recording device will be settled accounts interior each The picking record of a user summarizes, and is compared with the commodity of commodity clearing identification module identification, judges whether to match;If Match, then the 4th automatically-controlled door of second outlet is opened, if mismatching, issues warning information or prompting message, while providing and being unworthy of The commodity of conjunction, user voluntarily check.
CN201810188611.1A 2018-03-07 2018-03-07 Unattended Supermarket shopping system and its control method Pending CN110246284A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810188611.1A CN110246284A (en) 2018-03-07 2018-03-07 Unattended Supermarket shopping system and its control method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810188611.1A CN110246284A (en) 2018-03-07 2018-03-07 Unattended Supermarket shopping system and its control method

Publications (1)

Publication Number Publication Date
CN110246284A true CN110246284A (en) 2019-09-17

Family

ID=67882158

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810188611.1A Pending CN110246284A (en) 2018-03-07 2018-03-07 Unattended Supermarket shopping system and its control method

Country Status (1)

Country Link
CN (1) CN110246284A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111311304A (en) * 2020-01-17 2020-06-19 西安奥卡云数据科技有限公司 Intelligent unmanned supermarket management system based on videos
CN111339929A (en) * 2020-02-25 2020-06-26 浙江大华技术股份有限公司 Retail system of unmanned supermarket
CN111860221A (en) * 2020-06-30 2020-10-30 深圳市九洲电器有限公司 Container management method and container
CN112365255A (en) * 2020-10-28 2021-02-12 中标慧安信息技术股份有限公司 Non-inductive payment method and system for supermarket
CN113222746A (en) * 2020-02-03 2021-08-06 东芝泰格有限公司 Transaction processing system
CN113298545A (en) * 2020-04-24 2021-08-24 阿里巴巴集团控股有限公司 Electronic device, server and information processing method
CN113781730A (en) * 2021-09-15 2021-12-10 深圳市智享科技发展有限公司 Intelligent supermarket with intelligent monitoring function
CN116471384A (en) * 2023-06-20 2023-07-21 深圳市泽威信息科技有限公司 Control method and control device of unattended store monitoring system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103544776A (en) * 2013-10-25 2014-01-29 上海煦荣信息技术有限公司 Vending system and vending terminals
CN104361693A (en) * 2014-11-19 2015-02-18 肖丹 Intelligent market automatic clearing system and implementation method thereof
WO2017056429A1 (en) * 2015-09-30 2017-04-06 日本電気株式会社 Information processing device, information processing method, and recording medium storing program
CN106710071A (en) * 2016-12-19 2017-05-24 澳柯玛股份有限公司 Vending system with function of radio-frequency chip recognition
CN107067510A (en) * 2017-03-27 2017-08-18 杭州赛狐科技有限公司 A kind of unattended Supermarket shopping system
CN107292366A (en) * 2017-08-04 2017-10-24 湖州靖源信息技术有限公司 A kind of unmanned supermarket system
CN107749023A (en) * 2017-10-30 2018-03-02 周燕红 A kind of unmanned supermarket's automatic management method and device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103544776A (en) * 2013-10-25 2014-01-29 上海煦荣信息技术有限公司 Vending system and vending terminals
CN104361693A (en) * 2014-11-19 2015-02-18 肖丹 Intelligent market automatic clearing system and implementation method thereof
WO2017056429A1 (en) * 2015-09-30 2017-04-06 日本電気株式会社 Information processing device, information processing method, and recording medium storing program
CN106710071A (en) * 2016-12-19 2017-05-24 澳柯玛股份有限公司 Vending system with function of radio-frequency chip recognition
CN107067510A (en) * 2017-03-27 2017-08-18 杭州赛狐科技有限公司 A kind of unattended Supermarket shopping system
CN107292366A (en) * 2017-08-04 2017-10-24 湖州靖源信息技术有限公司 A kind of unmanned supermarket system
CN107749023A (en) * 2017-10-30 2018-03-02 周燕红 A kind of unmanned supermarket's automatic management method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
汤历漫著: "《从创意到创业 大众创业全流程思维•方法与案例》", 31 October 2017, 北京:中国经济出版社 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111311304A (en) * 2020-01-17 2020-06-19 西安奥卡云数据科技有限公司 Intelligent unmanned supermarket management system based on videos
CN113222746A (en) * 2020-02-03 2021-08-06 东芝泰格有限公司 Transaction processing system
CN111339929A (en) * 2020-02-25 2020-06-26 浙江大华技术股份有限公司 Retail system of unmanned supermarket
CN111339929B (en) * 2020-02-25 2023-05-16 浙江大华技术股份有限公司 Retail system of unmanned supermarket
CN113298545A (en) * 2020-04-24 2021-08-24 阿里巴巴集团控股有限公司 Electronic device, server and information processing method
CN111860221A (en) * 2020-06-30 2020-10-30 深圳市九洲电器有限公司 Container management method and container
CN112365255A (en) * 2020-10-28 2021-02-12 中标慧安信息技术股份有限公司 Non-inductive payment method and system for supermarket
CN112365255B (en) * 2020-10-28 2021-08-31 中标慧安信息技术股份有限公司 Non-inductive payment method and system for supermarket
CN113781730A (en) * 2021-09-15 2021-12-10 深圳市智享科技发展有限公司 Intelligent supermarket with intelligent monitoring function
CN116471384A (en) * 2023-06-20 2023-07-21 深圳市泽威信息科技有限公司 Control method and control device of unattended store monitoring system
CN116471384B (en) * 2023-06-20 2023-12-12 深圳市泽威信息科技有限公司 Control method and control device of unattended store monitoring system

Similar Documents

Publication Publication Date Title
CN110246284A (en) Unattended Supermarket shopping system and its control method
CN208188867U (en) One kind is for nobody self-service product identification system
US20200258069A1 (en) Weight monitoring-based sensing system and sensing method
CN109214751B (en) Intelligent inventory management system based on inventory position change
CN106781014B (en) Automatic vending machine and its operation method
CN111415461B (en) Article identification method and system and electronic equipment
US10943128B2 (en) Constructing shopper carts using video surveillance
WO2020047919A1 (en) Self-service vending method, apparatus and system, and server and computer-readable storage medium
WO2019165891A1 (en) Method for identifying product purchased by user, and device and smart shelf system
CN108171879B (en) Automatic vending settlement method and device and unmanned sales counter
CN107123006A (en) A kind of smart shopper system
CN107749114A (en) A kind of intelligent cargo management system, method and Intelligent storage cabinet
CN108230559A (en) Automatic vending device, operation method thereof and automatic vending system
CN107749023A (en) A kind of unmanned supermarket's automatic management method and device
CN108492464A (en) A kind of self-service cabinet and its identification commodity method
CN108198315A (en) A kind of auth method and authentication means
CN107403528A (en) Merchandise sales data processing apparatus and system and control method
CN104794831B (en) Image information processing device and its control method
EP3901841A1 (en) Settlement method, apparatus, and system
CN207895558U (en) A kind of vending machine with dual identification function
CN113554812B (en) Automatic sales counter and control system and control method
CN110689389A (en) Computer vision-based shopping list automatic maintenance method and device, storage medium and terminal
CN208092843U (en) A kind of self-service cabinet
CN110473337A (en) A kind of automatic vending machine based on image collecting device
CN110443946B (en) Vending machine, and method and device for identifying types of articles

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20190917

WD01 Invention patent application deemed withdrawn after publication