CN112669026A - Automatic checkout system and implementation method thereof - Google Patents
Automatic checkout system and implementation method thereof Download PDFInfo
- Publication number
- CN112669026A CN112669026A CN201910985172.1A CN201910985172A CN112669026A CN 112669026 A CN112669026 A CN 112669026A CN 201910985172 A CN201910985172 A CN 201910985172A CN 112669026 A CN112669026 A CN 112669026A
- Authority
- CN
- China
- Prior art keywords
- commodity
- information
- merchandise
- goods
- checkout
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Abstract
The present invention provides an automatic account settling system, which is mainly provided with a three-dimensional image recognition device on a commodity conveying platform, wherein the three-dimensional image recognition device forms information connection with a commodity management server, the commodity management server stores several commodity information in advance, the consumer can place the commodity to be settled on a conveying device of the commodity conveying platform, the commodity to be settled is driven by the conveying device in the direction of the three-dimensional image recognition device, when the commodity to be settled is in the shooting range of the three-dimensional image recognition device, the three-dimensional image recognition device can recognize the three-dimensional size and the two-dimensional image characteristics of the commodity to be settled, to form a commodity image information, and further transmit the commodity image information to the commodity management server for comparison and analysis with several commodity information, the commodity information which accords with the commodity image information is obtained through comparison, and the effects of automatic purchase and payment are achieved.
Description
Technical Field
The invention relates to an automatic checkout system and an implementation method thereof, in particular to an automatic checkout system capable of guiding a consumer to automatically finish checkout.
Background
With the development and progress of science and technology, the automation or self-help of various electronic devices to reduce manpower and reduce personnel costs has become a major trend of science and technology development, and the main technology of the existing self-help payment is that a user reads commodity information one by one through a bar code scanner (barcode scanner) or Radio Frequency Identification (RFID) to pay for payment, however, the existing bar code scanner must scan the commodity one by one and align with the barcode to perform payment, which not only prolongs the payment time, but also is liable to cause inconvenience for the user in self-help payment when the barcode scanner cannot correctly read the commodity information due to the failure, and although the wireless RFID system can scan and read various commodity information at one time, in this case, each commodity needs to add a RFID tag, which leads to a great increase in cost, and therefore, it is not easy to implement in the conventional self-service checkout system, and please refer to taiwan patent TWI652634 "self-service checkout method and system thereof", which mainly achieves the purpose of self-service checkout by means of image recognition of goods, but general image recognition mostly uses two-dimensional vision technology to perform goods recognition and automatic checkout, and there is a problem that recognition errors are caused by visual misalignment generated by angles when recognition is performed by using two-dimensional images, so the conventional self-service checkout system is really necessary to be improved.
Disclosure of Invention
In view of the above problems, the applicant of the present invention can develop a method and a system for effectively solving the above problems by studying and analyzing the software and hardware devices of a self-service checkout system according to the experience of a checkout shopping system developed over the years; accordingly, the present application is directed to an automated checkout system and an implementation method thereof, which can automatically identify the type of a commodity and the amount of the purchased commodity to speed up the checkout process of a consumer.
The invention achieves the above-mentioned purpose, the automatic checkout system and its implement method of the invention, it mainly has a three-dimensional image recognition device on a goods conveying platform, and three-dimensional image recognition device and a goods management server form the information link, and the said goods management server stores several goods information in advance, the consumer can place the goods to be settled out on a conveying device of the goods conveying platform, make the goods to be settled out be further driven by the conveying device toward the direction with three-dimensional image recognition device, when the goods to be settled out enter the shooting range of the three-dimensional image recognition device, the three-dimensional image recognition device can recognize the three-dimensional size and two-dimensional image characteristic of the goods to be settled out, so as to form a goods image information, and further transmit the goods image information to the goods management server to compare and analyze with several goods information, the commodity information which accords with the commodity image information is obtained through comparison, so that the consumer can settle accounts through the correct commodity information, and the effects of automatically purchasing commodities and settling accounts are achieved.
In order to make the objective, technical features and effects of the present application clear and understandable to the examination committee, the following description is provided with drawings and please refer to the same.
Drawings
FIG. 1 is a system architecture diagram of the present invention;
FIG. 2 is a schematic diagram of the system of the present invention;
FIG. 3 is a schematic diagram of an embodiment of the present invention;
FIG. 4 is a schematic diagram of the present invention;
FIG. 5 is a flow chart of the steps performed in the present invention;
FIG. 6 is another embodiment (one) of the present invention;
fig. 7 shows another embodiment (two) of the present invention.
Detailed Description
Referring to fig. 1, there is shown a system architecture diagram of the present invention, such as an automated checkout system 10 shown in the figure, which mainly comprises a goods transporting platform 101, a three-dimensional image recognition device 102 and a goods management server 103, wherein the goods transporting platform 101 is provided with a transporting device 1011 (e.g. a conveyer belt), the goods transporting platform 101 may be, for example, an open counter, and a consumer may place a goods to be checked out on the transporting device 1011 of the goods transporting platform 101 to move the goods to be checked out through the transporting device 1011; a three-dimensional image recognition device 102, wherein the three-dimensional image recognition device 102 may be, for example, a Depth Camera (Depth Camera), which may also be referred to as a Stereo Camera (Stereo Camera), or may be, for example, another image recognition device capable of capturing three-dimensional images, the three-dimensional image recognition device 102 is disposed on the goods conveying platform 101, and the illuminated angle of view forms an identification area a on the conveying device 1011, and can capture images of goods to be settled on the conveying device 1011 passing through the identification area a to generate a goods image information B; the commodity management server 103 and the three-dimensional image recognition device 102 form an information connection, and after receiving the commodity image information B, the commodity management server 103 further compares the commodity image information B to obtain a correct sales amount of the commodity to be settled in the commodity image information B for the consumer to complete an automatic settlement process.
Referring to fig. 2, which shows a schematic diagram of a system composition of the present invention, referring to fig. 1, the product management server 103 mainly comprises a database 1031, a product comparison module 1032, a display module 1033 and an accounting module 1034, wherein the database 1031 stores a plurality of product information C in advance, the product information C may include product related information such as product amount, product size, product appearance, product characteristics, product weight information, etc., and the product comparison module 1032 may further perform product comparison analysis with the plurality of product information C in the database 1031 after receiving the product image information B generated by the three-dimensional image recognition device 102, and since the product image information B is three-dimensional image information and includes three-dimensional size and two-dimensional image characteristics of the product, after analysis and comparison, in the plurality of product information C in the database 1031, acquiring commodity information C corresponding to the commodity image information B, wherein the commodity information C can reveal any information of the commodity amount, the commodity size, the commodity appearance, the commodity characteristics and the commodity weight information of the commodity to be settled in the commodity image information B, and the commodity information C corresponding to the commodity image information B, i.e., can be displayed on the display module 1033 in the form of data, image or other information for being looked up, for being looked up by consumers, the display module 1033 is disposed on the goods conveying platform 101, for example, a display screen, and after the consumer consults the payment amount through the display module 1033, the checkout operation can be performed through the checkout module 1034, which can be a physical hardware device, such as a card swipe machine, NFC sensor, etc., and may also support payment mechanisms such as online payment, cash payment, credit card payment, etc.
Referring to fig. 3, which is a schematic diagram (a) of the implementation of the present invention and is combined with fig. 1 to fig. 2, in the commodity transportation platform 101 shown in the present figure, a consumer places a commodity to be checked out D, E to be purchased on a transportation device 1011, and the transportation device 1011 moves a commodity to be checked out D, E to an identification area a, as shown in the present figure, after the commodity to be checked out D enters the identification area a, the three-dimensional image recognition device 102 immediately captures commodity image information B of the commodity to be checked out D, and further compares the commodity image information B with a plurality of commodity information C of a database 1031 to obtain commodity information C corresponding to the commodity to be checked out D; referring to fig. 4, there is shown a schematic diagram (two) of the present invention, which is based on fig. 3, after the to-be-checked commodity E enters the identification area a along with the to-be-checked commodity D, the to-be-checked commodity E can be captured by the three-dimensional image recognition device 102 to generate the commodity image information B, and further compared with the plurality of commodity information C in the database 1031 to obtain the commodity information C corresponding to the to-be-checked commodity E, and after the commodity management server 103 completes the identification of the to-be-checked commodity D, E, the corresponding commodity information C can be displayed on the display module 1033 for the consumer to look up, so that the consumer can check out through the check-out module 1034 to complete the entire automatic check-out shopping process.
Referring to fig. 5, a flow chart of steps performed according to the present invention is shown, and referring to fig. 2, the steps performed according to the present invention are as follows:
(1) step S1 of placing the article to be checked out: the consumer can place the goods to be settled on the conveying device 1011 of the goods conveying platform 101 for conveying movement;
(2) image recognition step S2: through the three-dimensional image recognition device 102 arranged on the commodity conveying platform 101, the three-dimensional size and two-dimensional image characteristics of the commodity to be settled can be recognized, and commodity image information B is generated after the recognition is finished;
(3) product comparison step S3: the product comparison module 1032 of the product management server 103 may further analyze and compare the received product image information B with the plurality of product information C stored in the database 1031 to obtain the product information C corresponding to the product image information B, so that the consumer can perform the subsequent payment process through the product information C;
(4) checkout step S4: the commodity information C conforming to the commodity image information B can be displayed on the display module 1033 for the consumer to look up, and the consumer can further perform the payment operation through the payment module 1034 of the commodity management server 103 to complete the whole automatic payment purchasing process.
Referring to fig. 6, which shows another embodiment (a) of the present invention, referring to fig. 1 and fig. 2 in combination, the present application may further provide a weight detecting device 1012 at the bottom of the conveying device 1011, where the weight detecting device 1012 forms an information connection with the product management server 103, and generates a product weight information W after detecting the weight of the product to be settled, and further transmits the product weight information W together with the product image information B to the product management server 103, so that the product comparison module 1032 can compare and analyze the product weight information with the plurality of product information C in the database 1031 more accurately.
Referring to fig. 7, another embodiment (two) of the present invention is shown, and with reference to fig. 1 and fig. 2, the present invention mainly assists the consumers to complete the automatic checkout shopping process, so that a plurality of goods to be checked out placed by different consumers are placed on the conveying device 1011, and in order to further avoid confusion of the placement of the goods to be checked out placed between the consumers, the present invention can further place a separating member 104, such as the goods to be checked out D, E, F shown in the present figure, between the goods to be checked out D, E and the goods to be checked out F, which belong to two different consumers, so that the separating member 104 can be further placed between the goods to be checked out E and the goods to be checked out F, and thus when the separating member 104 enters the identification area a, the three-dimensional image recognition device 102 can further capture the image generation product image information B of the separating member 104, the database 1031 stores the commodity image information B about the separating element 104 in advance, and may further include a calculation stopping instruction, that is, when the commodity comparison module 1032 compares the commodity image information B of the separating element 104 with the several commodity information C, and the comparison analysis result determines that the article is the separating element 104, the system stops calculating the payment amount continuously, so as to prevent the system from calculating the article to be paid of the following consumer to the body of the last consumer.
From the above, the automatic checkout system and the implementation method thereof of the invention are mainly characterized in that a three-dimensional image recognition device is arranged on a commodity conveying platform, the three-dimensional image recognition device is in information connection with a commodity management server, a plurality of commodity information are stored in the commodity management server in advance, a consumer can place a commodity to be checked out on a conveying device of the commodity conveying platform, the commodity to be checked out is further driven by the conveying device in the direction of the three-dimensional image recognition device, when the commodity to be checked out enters the shooting range of the three-dimensional image recognition device, the three-dimensional image recognition device can recognize the three-dimensional size and the two-dimensional image characteristic of the commodity to be checked out so as to form commodity image information, and further the commodity image information is transmitted to a commodity management server to be compared and analyzed with the plurality of commodity information, the commodity information which accords with the commodity image information is obtained through comparison, so that the consumer can settle accounts through correct commodity information, and the effects of automatically purchasing commodities and settling accounts are achieved; accordingly, the present application can achieve the objective of providing an automatic checkout system and an implementation method thereof, which can automatically identify the commodity type and the purchase amount to accelerate the checkout process of the consumer.
However, the above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present application; all equivalent changes and modifications that can be made by one skilled in the art without departing from the spirit and scope of the present application are to be considered as included within the scope of the present application.
[ notation ] to show
10 automatic checkout system
101 commodity conveying platform 102 three-dimensional image recognition device
1011 conveying device 104 separator
1012 weight detecting device
103 commodity management server
1031 database
1032 commodity comparison module
1033 display module
1034 Payment Module
S1 goods to be settled
S2 image recognition step
S3 commodity comparison step
S4 checkout step
A identification area
B commodity image information
C Commodity information
D Commodity to be settled
E commodity to be settled
F goods to be settled
W commodity weight information
Claims (13)
1. An automated checkout system, comprising:
the commodity conveying platform is provided with a conveying device, and the conveying device is used for placing a commodity to be settled;
the three-dimensional image recognition device is arranged on the commodity conveying platform and used for recognizing the three-dimensional size and the two-dimensional image characteristics of the commodity to be settled, and generating commodity image information after the recognition is finished; and
and the commodity management server is in information connection with the three-dimensional image recognition device and is provided with a database and a commodity comparison module, the database stores a plurality of commodity information, and the commodity comparison module is used for comparing and analyzing the commodity information in the database after receiving the commodity image information so as to obtain the commodity information according with the commodity image information and provide a consumer with an automatic checkout process through the commodity information.
2. The automated checkout system of claim 1, wherein the merchandise information comprises any one of or a combination of a merchandise amount, a merchandise size, a merchandise appearance, a merchandise characteristic, a merchandise weight information.
3. The automated checkout system of claim 1, wherein the merchandise management server has a display module, the merchandise information being displayed on the display module.
4. The automated checkout system of claim 1, wherein the merchandise management server has a checkout module for the consumer to perform checkout operations.
5. The automated checkout system of claim 4, wherein the checkout module supports any one or a combination of payment mechanisms of credit card payment, on-line payment, or cash payment.
6. The automated checkout system of claim 2, wherein a weight detecting device is disposed at a bottom of the transporting device of the goods transporting platform, and the weight detecting device is in communication with the goods management server, the weight detecting device is configured to detect a weight of the goods to be checked out and generate the weight information of the goods, so that the goods comparing module compares and analyzes the weight information of the goods in the database.
7. The automated checkout system of claim 1, wherein a separator is also provided on the conveyor for the three-dimensional image recognition device to generate another merchandise image information for the separator, and the merchandise management server stops calculating the checkout amount if the merchandise comparison module determines that the another merchandise image information is the separator.
8. An implementation method of an automatic checkout system is characterized in that after a commodity to be checked out is placed on a conveying device of a commodity conveying platform for conveying and moving, the following steps are continuously executed:
an image recognition step: the commodity conveying platform is provided with a three-dimensional image recognition device which is used for recognizing the three-dimensional size and the two-dimensional image characteristics of the commodity to be checked out and generating commodity image information after the recognition is finished; and
a commodity comparison step: and a commodity comparison module of a commodity management server receives the commodity image information, and analyzes and compares the commodity image information with a plurality of commodity information stored in a database to obtain the commodity information according with the commodity image information, so that a consumer can perform an automatic checkout process through the commodity information.
9. The method of claim 8, wherein the merchandise information includes any one or a combination of an amount of merchandise, a size of merchandise, an appearance of merchandise, a characteristic of merchandise, weight of merchandise information.
10. The method as claimed in claim 9, wherein when the image recognition step is performed, a weight detecting device at the bottom of the transporting device detects the weight of the goods to be checked out and generates the weight information of the goods, and the goods comparison module further performs comparison and analysis of the weight information of the goods in the database when the goods comparison step is performed.
11. The method as recited in claim 8, wherein the merchandise management server has a display module, and the merchandise information is displayed on the display module for review by the consumer for checkout.
12. The method of claim 8, wherein a checkout step is performed after the merchandise verification step is performed, and wherein a checkout module is provided by the merchandise management server for the consumer to perform checkout operations when the checkout step is performed.
13. The method according to claim 8, wherein the image recognition step is performed by generating another item image information for a separating member disposed between the items to be settled by the three-dimensional image recognition device, and the item comparison step is performed by stopping the item management server from further calculating the settlement amount when the item comparison module determines that the another item image information is the separating member.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910985172.1A CN112669026A (en) | 2019-10-16 | 2019-10-16 | Automatic checkout system and implementation method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910985172.1A CN112669026A (en) | 2019-10-16 | 2019-10-16 | Automatic checkout system and implementation method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112669026A true CN112669026A (en) | 2021-04-16 |
Family
ID=75400405
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910985172.1A Withdrawn CN112669026A (en) | 2019-10-16 | 2019-10-16 | Automatic checkout system and implementation method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112669026A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107730782A (en) * | 2017-10-19 | 2018-02-23 | 安徽小豆网络科技有限公司 | Unmanned convenience store's operation system of the self-service cashier's machine of view-based access control model image recognition |
| CN109214806A (en) * | 2018-11-20 | 2019-01-15 | 北京京东尚科信息技术有限公司 | Self-help settlement method, apparatus and storage medium |
| CN109920180A (en) * | 2019-01-23 | 2019-06-21 | 北京小牛智能科技有限公司 | Antitheft system for supermarket, supermarket self-checkout method and client |
| CN110097714A (en) * | 2018-01-31 | 2019-08-06 | 纬创资通股份有限公司 | Self-service accounts settling method and its system |
-
2019
- 2019-10-16 CN CN201910985172.1A patent/CN112669026A/en not_active Withdrawn
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107730782A (en) * | 2017-10-19 | 2018-02-23 | 安徽小豆网络科技有限公司 | Unmanned convenience store's operation system of the self-service cashier's machine of view-based access control model image recognition |
| CN110097714A (en) * | 2018-01-31 | 2019-08-06 | 纬创资通股份有限公司 | Self-service accounts settling method and its system |
| CN109214806A (en) * | 2018-11-20 | 2019-01-15 | 北京京东尚科信息技术有限公司 | Self-help settlement method, apparatus and storage medium |
| CN109920180A (en) * | 2019-01-23 | 2019-06-21 | 北京小牛智能科技有限公司 | Antitheft system for supermarket, supermarket self-checkout method and client |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113628396B (en) | Inspection device and storage medium | |
| CN107464116B (en) | Order settlement method and system | |
| CN107103503B (en) | Order information determining method and device | |
| CN108629591B (en) | Sales data processing device, control method and terminal equipment | |
| US10430776B2 (en) | System and method for exception handling in self-checkout and automated data capture systems | |
| KR101850315B1 (en) | Apparatus for self-checkout applied to hybrid product recognition | |
| US9412099B1 (en) | Automated item recognition for retail checkout systems | |
| CN109726759B (en) | Unmanned vending method, device, system, electronic equipment and computer readable medium | |
| US9082142B2 (en) | Using a mobile device to assist in exception handling in self-checkout and automated data capture systems | |
| JPWO2017126253A1 (en) | INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND PROGRAM | |
| US10510218B2 (en) | Information processing apparatus, information processing method, and non-transitory storage medium | |
| US10289928B2 (en) | Systems and methods of object identification and database creation | |
| US10383461B2 (en) | System of control and identification of goods in a shop | |
| JP2018124988A (en) | Remote weighing device | |
| CN109003105A (en) | A kind of smart electronics retrospect scale system | |
| EP3767538A1 (en) | Sequential classification for commodity identification | |
| KR101851550B1 (en) | Apparatus for self-checkout applied to hybrid product recognition | |
| CN112669026A (en) | Automatic checkout system and implementation method thereof | |
| US9700159B2 (en) | Non-linear checkout stand | |
| CN110706424A (en) | Self-service unmanned supermarket of intelligence | |
| TWM594212U (en) | Automatic checkout system | |
| TW202117640A (en) | Automatic checkout system and implementation method thereof achieving the effects of automatic purchase and checkout after comparison and analysis with a number of commodity information | |
| KR102525381B1 (en) | System based on user behavior analysis and situational awareness using artificial intelligence | |
| WO2023144992A1 (en) | Store exit management system, store exit management method, and recording medium | |
| CN107622606A (en) | A kind of self-help shopping is paid and checking information processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20210416 |