CN105915857A - Monitoring system and monitoring method for supermarket shopping cart - Google Patents

Monitoring system and monitoring method for supermarket shopping cart Download PDF

Info

Publication number
CN105915857A
CN105915857A CN201610414195.3A CN201610414195A CN105915857A CN 105915857 A CN105915857 A CN 105915857A CN 201610414195 A CN201610414195 A CN 201610414195A CN 105915857 A CN105915857 A CN 105915857A
Authority
CN
China
Prior art keywords
commodity
barcode scanning
shopping
controller
client
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610414195.3A
Other languages
Chinese (zh)
Inventor
徐步兵
韩静
张瑞琪
王琴
郭恩来
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Yimao Information Technology Co Ltd
Original Assignee
Nanjing Yimao Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Yimao Information Technology Co Ltd filed Critical Nanjing Yimao Information Technology Co Ltd
Priority to CN201610414195.3A priority Critical patent/CN105915857A/en
Publication of CN105915857A publication Critical patent/CN105915857A/en
Priority to PCT/CN2017/083075 priority patent/WO2017215362A1/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

The invention relates to a monitoring system and monitoring method for a supermarket shopping cart. The monitoring system comprises a controller mounted between shopping cart handles, a code scanner, a weighing sensor arranged at the bottom of a basket and a camera positioned at the upper end of the basket and used for monitoring a basket opening; the code scanner is positioned at the lower side of the controller and is opposite to the basket opening of the shopping cart; the code scanner, the weighing sensor and the camera are respectively in communication connection with the controller; the complete shopping process of a customer is divided into six states; in each state, weight change information fed back in real time by the weighing sensor, information of each frame of image, which is acquired by a monitoring device, and commodity information acquired by the code scanner are utilized to different degrees; and by combining a plurality of image analysis algorithms, an anti-theft function of an intelligent shopping cart system in the shopping process is achieved. By carrying out gray scale image statistic characteristic analysis or mode identification on a detected motion target image or a skin color detection image, empty-handed or commodity-held detection in a monitoring region is implemented, and a violation operation of the customer is timely reminded and corrected.

Description

Supermarket shopping car monitoring system and monitoring method thereof
Technical field
The present invention relates to a kind of supermarket shopping car monitoring system and monitoring method thereof, particularly relate to a kind of Supermarket shopping system combined based on graphical analysis and gravity sensitive and monitoring method thereof.
Background technology
Although nowadays net purchase is very convenient, but supermarket shopping is still that the important shopping approach of people and life style, especially in a tier 2 cities or festivals or holidays, the phenomenon paid the bill of queuing up highlights, this makes script shopping way the most efficiently long due to the time waiting in line checkout, the purchase experiences fallen behind reduces the desire for consumer goods of client, but adds the operation cost in supermarket.Therefore, research and development integrate the checkout of self-service barcode scanning and monitor the smart shopper system of pilferage behavior in real time, have wide market prospect and great commercial value.
The most existing a lot of similar research, Wal-Mart first have developed RFID technique in retail business, and have developed Intelligent shopping trolley based on RFID and try out in part Wal-Mart supermarket, Dalian University of Technology subsequently, Shanghai Communications Universitys etc. have studied shopping intelligent terminal based on RFID, this research employs RFID label tag and replaces multi-dimensional bar code, this label not only contains commodity every terms of information, and have good anti-counterfeiting technology, encryption technology and information control, but RFID label tag the most also cannot replace common Quick Response Code for a long time, therefore nowadays only have the extremely indivedual supermarket of Wal-Mart in popularization and application.Central South University, College of Information Science and Engineering, University of Electronic Science and Technology etc. are additionally also had to have studied Intelligent shopping trolley based on embedded system, the program combines the intelligent terminal of common bar code and embedded OS, achieve indoor navigation, bar code scan, management Shopping List, generate the functions such as payment code, but the program is not involved with the anti-theft feature of shopping cart, the most also cannot be widely used.But shopping cart commodity are carried out antitheft according to eas system i.e. EAS system by Liu Bing of Northeast Forestry University et al., utilize the soft label of each commodity, just by EAS system, soft label can be decoded after commodity are settled accounts, thus realize antitheft, this is similar with RFID label tag, needing to make each commodity different soft labels, workload is bigger, it is impossible to be widely used.The anti-theft measure that at present supermarket has is substantially on the electronic gate going out supermarket door, excessively simple including patent CN201520043135.6 and patent CN201510559549.9 the method logical judgment, and can not detect and substitute commodity operation for another surreptitiously in shopping process.
Summary of the invention
It is an object of the invention to: a kind of supermarket shopping car monitoring system and monitoring method thereof are provided, utilize the bar code data collected in shopping process, the image analysis data in weight change data and shopping cart central area in Shopping Basket, it is achieved the function of shopping cart anti-theft.
In order to reach object above, a kind of supermarket shopping car monitoring system that the present invention provides, including the controller being installed between shopping cart handle, code reader, it is placed in the LOAD CELLS bottom bicycle basket and is positioned at the photographic head of bicycle basket upper end monitoring basket mouth, code reader is positioned on the downside of controller, relative with shopping bicycle basket mouth, code reader, LOAD CELLS and photographic head are connected with controller communication respectively.
The preferred version of the present invention is: the resolution meaning 40-50(800*600 of shooting) ten thousand pixels, frame frequency is not less than 25 frames/second.
Preferably, the measurement scope of LOAD CELLS is 0-100 kilogram, and gamut weighing precision is ± 1 gram.
Preferably, code reader is connected with controller by USB interface.
A kind of monitoring method of base supermarket shopping car monitoring system, comprises the steps,
S1, startup controller, code reader, LOAD CELLS and photographic head start to gather data message;
When LOAD CELLS meter weight is constant, then commodity are not put into Shopping Basket or empty-handedly operate by client, if commodity barcode scanning, controller can be pointed out barcode scanning success, be entered step S4, detected whether violation operation;If the non-barcode scanning of commodity, the image information in camera collection Shopping Basket is transferred to controller and carries out image judgement, it is judged that empty-handed or hand-held object;If hand-held object, enter step S2, if empty-handed, ignore this action;
When LOAD CELLS meter heavily increases, representing the non-barcode scanning of commodity or barcode scanning is unsuccessful has been directly placed in Shopping Basket, then can point out and take out barcode scanning again, entering step S6, whether the commodity that detection is taken out are the commodity just now put into;
When LOAD CELLS meter restatement heavily reduces, represent and be complete single purchase process, then the return of goods can be pointed out to ask barcode scanning, and enter step S3, detect whether not meet the violation operation of the return of goods;
S2, this step be in determining hands, have article after;
If LOAD CELLS meter weight is constant, then explanation commodity are introduced into Shopping Basket, and controller prompting barcode scanning, when entering step S4 after barcode scanning success;
If LOAD CELLS meter restatement heavily reduces, then there is the violation operation substituting commodity for another surreptitiously in explanation client, and controller can point out violation operation to walk artificial channel;
If LOAD CELLS meter heavily increases, then explanation client has put into again new commodity in the case of non-barcode scanning, and controller can point out new commodity to take out, and enters step S6, and whether the commodity that detection is taken out meet, in order to avoid substituting commodity for another surreptitiously;
S3, when step S1 detecting, meter heavily reduces signal, now hands is in the region of photographic head detection, and the moving target barycenter position according to detecting judges;
When barycenter is outside Shopping Basket central area, then it is assumed that commodity have been taken out and non-barcode scanning by client, and which commodity not can determine that client takes out is, therefore can point out violation operation, please walk artificial channel;
When barycenter is in Shopping Basket central area, the real-time weight change information of weighing machine can be gathered;If meter weight the most constant, illustrate, at normal return process, to need barcode scanning again, so time determined whether to return goods successfully by the barcode scanning signal fed back;If non-barcode scanning, controller can point out the return of goods to ask barcode scanning;If barcode scanning, weight-matched can be carried out, it is judged that whether the commodity taken out meet the commodity of barcode scanning;If meeting, can point out and please take out and enter step S5, detect the violation operation during taking out;If not meeting, then it is assumed that the commodity that client takes out are incorrect, prompting please walk artificial channel;If meter heavily increases, then carrying out weight-matched, if coupling does not meets, then it is assumed that client has put into other commodity, controller prompting please walk artificial channel;If coupling meets, then carry out image judgement, in case client puts into the commodity of same weight;If meter heavily reduces, then it is assumed that taking out two pieces merchandise return, controller can remind client simultaneously;
S4, when, after the prompting barcode scanning success of step S1, photographic head can detect the centroid position of moving target, if detecting, barycenter is outside Shopping Basket central area, then it is assumed that client is returning goods, therefore can point out its barcode scanning again, complete return process;
The real-time weight change information fed back by weighing machine is divided into three kinds of situations;When meter weight is constant, only need to judge the position of barycenter;
When meter heavily reduces;Then think that the non-barcode scanning of client just takes out commodity, remind client's violation operation, artificial channel need to be walked;
When meter heavily increases, commodity have been placed in shopping cart, now carry out weight-matched.If met, image judges whether the hands of client holds article, if hand-held article, then it is assumed that holding the weight such as two in hands but the object of non-equivalence lattice, the commodity of barcode scanning may be different with the commodity put into, therefore will be considered that and be violation operation and point out artificial channel;If empty-handed, then it is assumed that to buy successfully, can point out and can continue shopping, and return to step S1.If do not met, then can remind and take out new commodity, enter step S6, whether detection has violation operation during taking out;
S5, this step are in return process after weight-matched, and whether detection has violation operation when taking out commodity;
It is regarded as violation operation when meter heavily increases or counts heavily to reduce;
When meter weight is constant, according to the difference bianry image of former frame Yu present frame, if white pixel area is less than just illustrating within the least threshold value that commodity have dropped out monitoring region, the return of goods terminate, and return to step S1, continue shopping;
S6, this step are to detect that in purchasing process weight is not mated, and the commodity that when commodity are taken out in prompting, detection is taken out are the most identical with the commodity put into;
When meter heavily increases, it is believed that not taking out commodity and also continuing to put into new commodity is unconventional shopping operation, can remind client;
When meter heavily reduces, according to the difference bianry image of former frame Yu present frame, if white pixel area less than within the least threshold value just explanation commodity have dropped out monitoring region, after correct commodity are taken out can step S1, continue to do shopping.
Preferably, image judge be by first colour original being carried out gradation conversion after, again it carried out motion detection and determine moving target barycenter, after barycenter is in Shopping Basket Surveillance center region, colour original is carried out Face Detection, motion detection result and Face Detection result are sued for peace and obtains entire motion target image, then entire motion objective result and colour of skin result are subtracted each other and obtain colour of skin moving target;Then pixel number that pixel value in colour of skin moving image is 255 is calculated away as removing colour of skin area, and calculate the comentropy of colour of skin barycenter following entire motion target, if the colour of skin area that goes of continuous multiple frames detection is more than threshold value B more than the comentropy of moving region below threshold value A or colour of skin barycenter, it is regarded as hand-held object in Shopping Basket, otherwise it is considered empty-handed, background need to be updated.
Present invention have the beneficial effect that and the complete shopping process of client is divided into six states, utilize, in each state, the merchandise news that every frame image information that the weight change information of LOAD CELLS Real-time Feedback, supervising device gather, code reader obtain to some extent, realize Intelligent shopping trolley system anti-theft function in shopping process in conjunction with multiple image analysis algorithm;By the movement destination image detected or Face Detection image are carried out gray level image statistics characteristic analysis or pattern recognition, empty-handed or the detection of hand-held commodity in realizing monitoring region, remind and correct the violation operation of client in time, realize the judgement to client's Shopping Behaviors in violation of rules and regulations, and while antitheft stopping loss, realize payment to exempt to queue up, reduce cost of labor, improve purchase experiences.
Accompanying drawing explanation
Fig. 1 is the modular structure schematic diagram of the present invention.
Fig. 2 is the flow chart of the inventive method step one.
Fig. 3 is the flow chart of the inventive method step 2.
Fig. 4 is the flow chart of the inventive method step 3.
Fig. 5 is the flow chart of the inventive method step 4.
Fig. 6 is the flow chart of the inventive method step 5.
Fig. 7 is the flow chart of the inventive method step 6.
Detailed description of the invention
Embodiment one
A kind of supermarket shopping car monitoring system that the present embodiment provides, include the controller being installed between shopping cart handle, code reader as shown in Figure 1, be placed in the LOAD CELLS bottom bicycle basket and be positioned at the photographic head of bicycle basket upper end monitoring basket mouth, code reader is positioned on the downside of controller, relative with shopping bicycle basket mouth, code reader, LOAD CELLS and photographic head are connected with controller communication respectively.
The resolution meaning 40-50(800*600 of shooting) ten thousand pixels, frame frequency is not less than 25 frames/second.
The measurement scope of LOAD CELLS is 0-100 kilogram, and gamut weighing precision is ± 1 gram.
Code reader is connected with controller by USB interface.
A kind of monitoring method of base supermarket shopping car monitoring system, comprises the steps,
S1, startup controller, code reader, LOAD CELLS and photographic head start to gather data message;As in figure 2 it is shown,
When LOAD CELLS meter weight is constant, then commodity are not put into Shopping Basket or empty-handedly operate by client, if commodity barcode scanning, controller can be pointed out barcode scanning success, be entered step S4, detected whether violation operation;If the non-barcode scanning of commodity, the image information in camera collection Shopping Basket is transferred to controller and carries out image judgement, it is judged that empty-handed or hand-held object;If hand-held object, enter step S2, if empty-handed, ignore this action;
When LOAD CELLS meter heavily increases, representing the non-barcode scanning of commodity or barcode scanning is unsuccessful has been directly placed in Shopping Basket, then can point out and take out barcode scanning again, entering step S6, whether the commodity that detection is taken out are the commodity just now put into;
When LOAD CELLS meter restatement heavily reduces, represent and be complete single purchase process, then the return of goods can be pointed out to ask barcode scanning, and enter step S3, detect whether not meet the violation operation of the return of goods;
S2, this step be in determining hands, have article after;As it is shown on figure 3,
If LOAD CELLS meter weight is constant, then explanation commodity are introduced into Shopping Basket, and controller prompting barcode scanning, when entering step S4 after barcode scanning success;
If LOAD CELLS meter restatement heavily reduces, then there is the violation operation substituting commodity for another surreptitiously in explanation client, and controller can point out violation operation to walk artificial channel;
If LOAD CELLS meter heavily increases, then explanation client has put into again new commodity in the case of non-barcode scanning, and controller can point out new commodity to take out, and enters step S6, and whether the commodity that detection is taken out meet, in order to avoid substituting commodity for another surreptitiously;
S3, as shown in Figure 4, when detecting in step S1 that meter heavily reduces signal, now hands is in the region of photographic head detection, and the moving target barycenter position according to detecting judges;
When barycenter is outside Shopping Basket central area, then it is assumed that commodity have been taken out and non-barcode scanning by client, and which commodity not can determine that client takes out is, therefore can point out violation operation, please walk artificial channel;
When barycenter is in Shopping Basket central area, the real-time weight change information of weighing machine can be gathered;If meter weight the most constant, illustrate, at normal return process, to need barcode scanning again, so time determined whether to return goods successfully by the barcode scanning signal fed back;If non-barcode scanning, controller can point out the return of goods to ask barcode scanning;If barcode scanning, weight-matched can be carried out, it is judged that whether the commodity taken out meet the commodity of barcode scanning;If meeting, can point out and please take out and enter step S5, detect the violation operation during taking out;If not meeting, then it is assumed that the commodity that client takes out are incorrect, prompting please walk artificial channel;If meter heavily increases, then carrying out weight-matched, if coupling does not meets, then it is assumed that client has put into other commodity, controller prompting please walk artificial channel;If coupling meets, then carry out image judgement, in case client puts into the commodity of same weight;If meter heavily reduces, then it is assumed that taking out two pieces merchandise return, controller can remind client simultaneously;
S4 is as it is shown in figure 5, after step S1 prompting barcode scanning is successful, photographic head can detect the centroid position of moving target, if detecting, barycenter is outside Shopping Basket central area, then it is assumed that client is returning goods, therefore can point out its barcode scanning again, completes return process;
The real-time weight change information fed back by weighing machine is divided into three kinds of situations;When meter weight is constant, only need to judge the position of barycenter;
When meter heavily reduces;Then think that the non-barcode scanning of client just takes out commodity, remind client's violation operation, artificial channel need to be walked;
When meter heavily increases, commodity have been placed in shopping cart, now carry out weight-matched.If met, image judges whether the hands of client holds article, if hand-held article, then it is assumed that holding the weight such as two in hands but the object of non-equivalence lattice, the commodity of barcode scanning may be different with the commodity put into, therefore will be considered that and be violation operation and point out artificial channel;If empty-handed, then it is assumed that to buy successfully, can point out and can continue shopping, and return to step S1.If do not met, then can remind and take out new commodity, enter step S6, whether detection has violation operation during taking out;
S5, as shown in Figure 6, this step is in return process after weight-matched, and whether detection has violation operation when taking out commodity;
It is regarded as violation operation when meter heavily increases or counts heavily to reduce;
When meter weight is constant, according to the difference bianry image of former frame Yu present frame, if white pixel area is less than just illustrating within the least threshold value that commodity have dropped out monitoring region, the return of goods terminate, and return to step S1, continue shopping;
S6 is as it is shown in fig. 7, this step is to detect that in purchasing process weight is not mated, and the commodity that when commodity are taken out in prompting, detection is taken out are the most identical with the commodity put into;
When meter heavily increases, it is believed that not taking out commodity and also continuing to put into new commodity is unconventional shopping operation, can remind client;
When meter heavily reduces, according to the difference bianry image of former frame Yu present frame, if white pixel area less than within the least threshold value just explanation commodity have dropped out monitoring region, after correct commodity are taken out can step S1, continue to do shopping.
Image judge be by first colour original being carried out gradation conversion after, again it carried out motion detection and determine moving target barycenter, after barycenter is in Shopping Basket Surveillance center region, colour original is carried out Face Detection, motion detection result and Face Detection result are sued for peace and obtains entire motion target image, then entire motion objective result and colour of skin result are subtracted each other and obtain colour of skin moving target;Then pixel number that pixel value in colour of skin moving image is 255 is calculated away as removing colour of skin area, and calculate the comentropy of colour of skin barycenter following entire motion target, if the colour of skin area that goes of continuous multiple frames detection is more than threshold value B more than the comentropy of moving region below threshold value A or colour of skin barycenter, it is regarded as hand-held object in Shopping Basket, otherwise it is considered empty-handed, background need to be updated.
In addition to the implementation, the present invention can also have other embodiments.The technical scheme that all employing equivalents or equivalent transformation are formed, all falls within the protection domain of application claims.

Claims (6)

1. a supermarket shopping car monitoring system, it is characterized in that, including the controller being installed between shopping cart handle, code reader, it is placed in the LOAD CELLS bottom bicycle basket and is positioned at the photographic head of bicycle basket upper end monitoring basket mouth, described code reader is positioned on the downside of described controller, relative with shopping bicycle basket mouth, described code reader, described LOAD CELLS and described photographic head are connected with described controller communication respectively.
A kind of supermarket shopping car monitoring system the most according to claim 1, it is characterised in that the resolution meaning 40-50(800*600 of described shooting) ten thousand pixels, frame frequency is not less than 25 frames/second.
A kind of supermarket shopping car monitoring system the most according to claim 1, it is characterised in that the measurement scope of described LOAD CELLS is 0-100 kilogram, and gamut weighing precision is ± 1 gram.
A kind of supermarket shopping car monitoring system the most according to claim 1, it is characterised in that described code reader is connected with controller by USB interface.
5. a monitoring method based on claim 1-4 supermarket shopping car monitoring system, it is characterised in that comprise the steps,
S1, startup controller, code reader, LOAD CELLS and photographic head start to gather data message;
When LOAD CELLS meter weight is constant, then commodity are not put into Shopping Basket or empty-handedly operate by client, if commodity barcode scanning, controller can be pointed out barcode scanning success, be entered step S4, detected whether violation operation;If the non-barcode scanning of commodity, the image information in camera collection Shopping Basket is transferred to controller and carries out image judgement, it is judged that empty-handed or hand-held object;If hand-held object, enter step S2, if empty-handed, ignore this action;
When LOAD CELLS meter heavily increases, representing the non-barcode scanning of commodity or barcode scanning is unsuccessful has been directly placed in Shopping Basket, then can point out and take out barcode scanning again, entering step S6, whether the commodity that detection is taken out are the commodity just now put into;
When LOAD CELLS meter restatement heavily reduces, represent and be complete single purchase process, then the return of goods can be pointed out to ask barcode scanning, and enter step S3, detect whether not meet the violation operation of the return of goods;
S2, this step be in determining hands, have article after;
If LOAD CELLS meter weight is constant, then explanation commodity are introduced into Shopping Basket, and controller prompting barcode scanning, when entering step S4 after barcode scanning success;
If LOAD CELLS meter restatement heavily reduces, then there is the violation operation substituting commodity for another surreptitiously in explanation client, and controller can point out violation operation to walk artificial channel;
If LOAD CELLS meter heavily increases, then explanation client has put into again new commodity in the case of non-barcode scanning, and controller can point out new commodity to take out, and enters step S6, and whether the commodity that detection is taken out meet, in order to avoid substituting commodity for another surreptitiously;
S3, when step S1 detecting, meter heavily reduces signal, now hands is in the region of photographic head detection, and the moving target barycenter position according to detecting judges;
When barycenter is outside Shopping Basket central area, then it is assumed that commodity have been taken out and non-barcode scanning by client, and which commodity not can determine that client takes out is, therefore can point out violation operation, please walk artificial channel;
When barycenter is in Shopping Basket central area, the real-time weight change information of weighing machine can be gathered;If meter weight the most constant, illustrate, at normal return process, to need barcode scanning again, so time determined whether to return goods successfully by the barcode scanning signal fed back;If non-barcode scanning, controller can point out the return of goods to ask barcode scanning;If barcode scanning, weight-matched can be carried out, it is judged that whether the commodity taken out meet the commodity of barcode scanning;If meeting, can point out and please take out and enter step S5, detect the violation operation during taking out;If not meeting, then it is assumed that the commodity that client takes out are incorrect, prompting please walk artificial channel;If meter heavily increases, then carrying out weight-matched, if coupling does not meets, then it is assumed that client has put into other commodity, controller prompting please walk artificial channel;If coupling meets, then carry out image judgement, in case client puts into the commodity of same weight;If meter heavily reduces, then it is assumed that taking out two pieces merchandise return, controller can remind client simultaneously;
S4, when, after the prompting barcode scanning success of step S1, photographic head can detect the centroid position of moving target, if detecting, barycenter is outside Shopping Basket central area, then it is assumed that client is returning goods, therefore can point out its barcode scanning again, complete return process;
The real-time weight change information fed back by weighing machine is divided into three kinds of situations;When meter weight is constant, only need to judge the position of barycenter;
When meter heavily reduces;Then think that the non-barcode scanning of client just takes out commodity, remind client's violation operation, artificial channel need to be walked;
When meter heavily increases, commodity have been placed in shopping cart, now carry out weight-matched;If met, image judges whether the hands of client holds article, if hand-held article, then it is assumed that holding the weight such as two in hands but the object of non-equivalence lattice, the commodity of barcode scanning may be different with the commodity put into, therefore will be considered that and be violation operation and point out artificial channel;If empty-handed, then it is assumed that to buy successfully, can point out and can continue shopping, and return to step S1;If do not met, then can remind and take out new commodity, enter step S6, whether detection has violation operation during taking out;
S5, this step are in return process after weight-matched, and whether detection has violation operation when taking out commodity;
It is regarded as violation operation when meter heavily increases or counts heavily to reduce;
When meter weight is constant, according to the difference bianry image of former frame Yu present frame, if white pixel area is less than just illustrating within the least threshold value that commodity have dropped out monitoring region, the return of goods terminate, and return to step S1, continue shopping;
S6, this step are to detect that in purchasing process weight is not mated, and the commodity that when commodity are taken out in prompting, detection is taken out are the most identical with the commodity put into;
When meter heavily increases, it is believed that not taking out commodity and also continuing to put into new commodity is unconventional shopping operation, can remind client;
When meter heavily reduces, according to the difference bianry image of former frame Yu present frame, if white pixel area less than within the least threshold value just explanation commodity have dropped out monitoring region, after correct commodity are taken out can step S1, continue to do shopping.
The monitoring method of a kind of supermarket shopping car monitoring system the most according to claim 5, it is characterized in that, described image judge be by first colour original being carried out gradation conversion after, again it carried out motion detection and determine moving target barycenter, after barycenter is in Shopping Basket Surveillance center region, colour original is carried out Face Detection, motion detection result and Face Detection result are sued for peace and obtains entire motion target image, then entire motion objective result and colour of skin result are subtracted each other and obtain colour of skin moving target;Then pixel number that pixel value in colour of skin moving image is 255 is calculated away as removing colour of skin area, and calculate the comentropy of colour of skin barycenter following entire motion target, if the colour of skin area that goes of continuous multiple frames detection is more than threshold value B more than the comentropy of moving region below threshold value A or colour of skin barycenter, it is regarded as hand-held object in Shopping Basket, otherwise it is considered empty-handed, background need to be updated.
CN201610414195.3A 2016-06-13 2016-06-13 Monitoring system and monitoring method for supermarket shopping cart Pending CN105915857A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610414195.3A CN105915857A (en) 2016-06-13 2016-06-13 Monitoring system and monitoring method for supermarket shopping cart
PCT/CN2017/083075 WO2017215362A1 (en) 2016-06-13 2017-05-04 Intelligent shopping system based on supermarket shopping cart and control method therefor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610414195.3A CN105915857A (en) 2016-06-13 2016-06-13 Monitoring system and monitoring method for supermarket shopping cart

Publications (1)

Publication Number Publication Date
CN105915857A true CN105915857A (en) 2016-08-31

Family

ID=56750018

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610414195.3A Pending CN105915857A (en) 2016-06-13 2016-06-13 Monitoring system and monitoring method for supermarket shopping cart

Country Status (1)

Country Link
CN (1) CN105915857A (en)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106672042A (en) * 2016-11-16 2017-05-17 南京亿猫信息技术有限公司 Intelligent shopping cart and shopping and sales return process judging method of shopping cart
CN106709422A (en) * 2016-11-16 2017-05-24 南京亿猫信息技术有限公司 Supermarket shopping cart hand identification method and identification system thereof
WO2017215362A1 (en) * 2016-06-13 2017-12-21 南京亿猫信息技术有限公司 Intelligent shopping system based on supermarket shopping cart and control method therefor
CN107862775A (en) * 2017-11-29 2018-03-30 深圳易伙科技有限责任公司 A kind of supermarket's commodity anti-theft early warning system and method based on artificial intelligence
WO2018126345A1 (en) * 2017-01-04 2018-07-12 西安超嗨网络科技有限公司 Commodity identifying method and system of intelligent shopping cart
CN108335436A (en) * 2017-01-19 2018-07-27 东芝泰格有限公司 Accounting device and control method, terminal device
CN108520520A (en) * 2018-04-12 2018-09-11 包仁妹 Key position bulge degree-measuring system
CN108805003A (en) * 2018-04-12 2018-11-13 包仁妹 Key position bulge degree detecting method
CN109353397A (en) * 2018-09-20 2019-02-19 北京旷视科技有限公司 Merchandise control methods, devices and systems and storage medium and shopping cart
CN109727367A (en) * 2017-10-31 2019-05-07 昆山瑞琪信息科技有限公司 A kind of self-service return of goods method
CN109934569A (en) * 2017-12-25 2019-06-25 图灵通诺(北京)科技有限公司 Settlement method, device and system
CN110532994A (en) * 2019-09-04 2019-12-03 上海眼控科技股份有限公司 Behavioral value method, apparatus, computer equipment and readable storage medium storing program for executing
CN110866429A (en) * 2018-08-28 2020-03-06 阿里巴巴集团控股有限公司 Missed scanning identification method and device, self-service cash register terminal and system
CN110956761A (en) * 2018-09-26 2020-04-03 北京京东尚科信息技术有限公司 Object processing method and system, computer system and computer readable medium
CN111263224A (en) * 2018-11-30 2020-06-09 阿里巴巴集团控股有限公司 Video processing method and device and electronic equipment
CN111311848A (en) * 2020-01-16 2020-06-19 青岛创捷中云科技有限公司 Self-service cash-receiving AI loss prevention system and method
CN111553679A (en) * 2020-04-27 2020-08-18 新石器慧通(北京)科技有限公司 Automatic checkout method of auxiliary shopping cart and auxiliary shopping cart
CN111650839A (en) * 2019-03-04 2020-09-11 青岛海尔洗衣机有限公司 Clothes care agent management system and control method thereof
CN112184205A (en) * 2017-08-25 2021-01-05 创新先进技术有限公司 Method, device and system for detecting whether user steals articles and intelligent equipment
CN112930292A (en) * 2018-09-07 2021-06-08 看门人系统公司 Shopping basket monitoring using computer vision and machine learning
CN113077314A (en) * 2021-04-13 2021-07-06 重庆文理学院 Food supply chain management system based on block chain technology
CN113378802A (en) * 2021-08-12 2021-09-10 北京每日优鲜电子商务有限公司 Alarm information sending method, electronic device and computer readable medium
CN114882370A (en) * 2022-07-07 2022-08-09 西安超嗨网络科技有限公司 Intelligent commodity identification method and device, terminal and storage medium
CN116824705A (en) * 2023-08-24 2023-09-29 南京亿猫信息技术有限公司 Intelligent shopping cart shopping behavior discriminating method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101127141A (en) * 2007-09-30 2008-02-20 西安朔方信息技术有限公司 Supermarket self-help settlement and shopping system and its method
CN101268478A (en) * 2005-03-29 2008-09-17 斯达普力特有限公司 Method and apparatus for detecting suspicious activity using video analysis
CN103236006A (en) * 2013-04-18 2013-08-07 战国新 Novel self-help shopping checkout system and method for supermarkets
CN104778618A (en) * 2015-04-22 2015-07-15 郭小卫 Shopping and storing device
CN104787102A (en) * 2015-04-28 2015-07-22 成坤 Intelligent shopping cart, intelligent shopping system and using method thereof
CN105083354A (en) * 2015-09-07 2015-11-25 张俊 Self-help shopping system, shopping cart and self-help shopping method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101268478A (en) * 2005-03-29 2008-09-17 斯达普力特有限公司 Method and apparatus for detecting suspicious activity using video analysis
CN101127141A (en) * 2007-09-30 2008-02-20 西安朔方信息技术有限公司 Supermarket self-help settlement and shopping system and its method
CN103236006A (en) * 2013-04-18 2013-08-07 战国新 Novel self-help shopping checkout system and method for supermarkets
CN104778618A (en) * 2015-04-22 2015-07-15 郭小卫 Shopping and storing device
CN104787102A (en) * 2015-04-28 2015-07-22 成坤 Intelligent shopping cart, intelligent shopping system and using method thereof
CN105083354A (en) * 2015-09-07 2015-11-25 张俊 Self-help shopping system, shopping cart and self-help shopping method

Cited By (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017215362A1 (en) * 2016-06-13 2017-12-21 南京亿猫信息技术有限公司 Intelligent shopping system based on supermarket shopping cart and control method therefor
CN106709422A (en) * 2016-11-16 2017-05-24 南京亿猫信息技术有限公司 Supermarket shopping cart hand identification method and identification system thereof
CN106672042A (en) * 2016-11-16 2017-05-17 南京亿猫信息技术有限公司 Intelligent shopping cart and shopping and sales return process judging method of shopping cart
CN106672042B (en) * 2016-11-16 2020-04-17 南京亿猫信息技术有限公司 Method for judging shopping and goods returning process of intelligent shopping cart
WO2018126345A1 (en) * 2017-01-04 2018-07-12 西安超嗨网络科技有限公司 Commodity identifying method and system of intelligent shopping cart
CN108335436A (en) * 2017-01-19 2018-07-27 东芝泰格有限公司 Accounting device and control method, terminal device
CN112184205B (en) * 2017-08-25 2024-01-05 创新先进技术有限公司 Method, device and system for detecting whether user steals article or not and intelligent device
CN112184205A (en) * 2017-08-25 2021-01-05 创新先进技术有限公司 Method, device and system for detecting whether user steals articles and intelligent equipment
CN109727367A (en) * 2017-10-31 2019-05-07 昆山瑞琪信息科技有限公司 A kind of self-service return of goods method
CN107862775A (en) * 2017-11-29 2018-03-30 深圳易伙科技有限责任公司 A kind of supermarket's commodity anti-theft early warning system and method based on artificial intelligence
CN109934569A (en) * 2017-12-25 2019-06-25 图灵通诺(北京)科技有限公司 Settlement method, device and system
CN109934569B (en) * 2017-12-25 2024-04-12 图灵通诺(北京)科技有限公司 Settlement method, device and system
CN108520520B (en) * 2018-04-12 2019-01-01 绍兴柯桥东茂织造有限公司 Key position bulge degree-measuring system
CN108520520A (en) * 2018-04-12 2018-09-11 包仁妹 Key position bulge degree-measuring system
CN108805003A (en) * 2018-04-12 2018-11-13 包仁妹 Key position bulge degree detecting method
CN108805003B (en) * 2018-04-12 2019-04-23 新昌县彭诚农业科技有限公司 Key position bulge degree detecting method
CN110866429B (en) * 2018-08-28 2024-03-08 阿里巴巴集团控股有限公司 Missing scanning identification method, device, self-service cashing terminal and system
CN110866429A (en) * 2018-08-28 2020-03-06 阿里巴巴集团控股有限公司 Missed scanning identification method and device, self-service cash register terminal and system
CN112930292A (en) * 2018-09-07 2021-06-08 看门人系统公司 Shopping basket monitoring using computer vision and machine learning
CN109353397A (en) * 2018-09-20 2019-02-19 北京旷视科技有限公司 Merchandise control methods, devices and systems and storage medium and shopping cart
CN110956761A (en) * 2018-09-26 2020-04-03 北京京东尚科信息技术有限公司 Object processing method and system, computer system and computer readable medium
CN111263224A (en) * 2018-11-30 2020-06-09 阿里巴巴集团控股有限公司 Video processing method and device and electronic equipment
CN111263224B (en) * 2018-11-30 2022-07-15 阿里巴巴集团控股有限公司 Video processing method and device and electronic equipment
CN111650839A (en) * 2019-03-04 2020-09-11 青岛海尔洗衣机有限公司 Clothes care agent management system and control method thereof
CN110532994A (en) * 2019-09-04 2019-12-03 上海眼控科技股份有限公司 Behavioral value method, apparatus, computer equipment and readable storage medium storing program for executing
CN111311848A (en) * 2020-01-16 2020-06-19 青岛创捷中云科技有限公司 Self-service cash-receiving AI loss prevention system and method
CN111553679B (en) * 2020-04-27 2023-08-25 新石器慧通(北京)科技有限公司 Automatic checkout method of auxiliary shopping cart and auxiliary shopping cart
CN111553679A (en) * 2020-04-27 2020-08-18 新石器慧通(北京)科技有限公司 Automatic checkout method of auxiliary shopping cart and auxiliary shopping cart
CN113077314A (en) * 2021-04-13 2021-07-06 重庆文理学院 Food supply chain management system based on block chain technology
CN113378802B (en) * 2021-08-12 2021-11-19 北京每日优鲜电子商务有限公司 Alarm information sending method, electronic device and computer readable medium
CN113378802A (en) * 2021-08-12 2021-09-10 北京每日优鲜电子商务有限公司 Alarm information sending method, electronic device and computer readable medium
CN114882370A (en) * 2022-07-07 2022-08-09 西安超嗨网络科技有限公司 Intelligent commodity identification method and device, terminal and storage medium
CN116824705A (en) * 2023-08-24 2023-09-29 南京亿猫信息技术有限公司 Intelligent shopping cart shopping behavior discriminating method
CN116824705B (en) * 2023-08-24 2023-11-10 南京亿猫信息技术有限公司 Intelligent shopping cart shopping behavior discriminating method

Similar Documents

Publication Publication Date Title
CN105915857A (en) Monitoring system and monitoring method for supermarket shopping cart
WO2017215362A1 (en) Intelligent shopping system based on supermarket shopping cart and control method therefor
US8995744B2 (en) Cart inspection for suspicious items
US10242267B2 (en) Systems and methods for false alarm reduction during event detection
CN110866429B (en) Missing scanning identification method, device, self-service cashing terminal and system
WO2017146595A1 (en) System and methods for shopping in a physical store
CN115244560A (en) Anti-shoplifting system and method in self-service checkout
JP7257403B2 (en) Method and system for assisting purchases at a physical point of sale
US10372998B2 (en) Object recognition for bottom of basket detection
CN103679471A (en) Checkout security using video surveillance
AU2019424420B2 (en) System and method for detecting scan irregularities at self-checkout terminals
JP2019505920A (en) Intelligent shopping cart product identification method and system
CN109003403B (en) Shopping cart commodity weighing and pricing method, device and system
JP2004171241A (en) Illegality monitoring system and program
CN204614025U (en) A kind of shopping storing equipment
CN110689389A (en) Computer vision-based shopping list automatic maintenance method and device, storage medium and terminal
CN104778618A (en) Shopping and storing device
US20230005348A1 (en) Fraud detection system and method
US20220414632A1 (en) Operation of a self-check out surface area of a retail store
CN112154488B (en) Information processing apparatus, control method, and program
CN207281820U (en) Intelligent payment system
CN107578229A (en) Intelligent payment system
CN113077314A (en) Food supply chain management system based on block chain technology
CN111524303A (en) Supermarket self-checkout anti-theft system and anti-theft method thereof
Beenish et al. Design and Implementation of Autonomous Trolley with E Billing

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Room 1101, 31 Guangju Road, Jianye District, Nanjing City, Jiangsu Province

Applicant after: Nanjing Yimao Information Technology Co., Ltd.

Address before: 210000 National Leading Talents Pioneering Park, Qinhuai District, Nanjing City, Jiangsu Province, 19 (in Nanjing Design Center)

Applicant before: Nanjing Yimao Information Technology Co., Ltd.

CB02 Change of applicant information
RJ01 Rejection of invention patent application after publication

Application publication date: 20160831

RJ01 Rejection of invention patent application after publication