CN109118200A - A kind of commodity identification and cash register system based on image recognition - Google Patents
A kind of commodity identification and cash register system based on image recognition Download PDFInfo
- Publication number
- CN109118200A CN109118200A CN201810833919.7A CN201810833919A CN109118200A CN 109118200 A CN109118200 A CN 109118200A CN 201810833919 A CN201810833919 A CN 201810833919A CN 109118200 A CN109118200 A CN 109118200A
- Authority
- CN
- China
- Prior art keywords
- commodity
- identification
- module
- cash register
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/08—Payment architectures
- G06Q20/20—Point-of-sale [POS] network systems
- G06Q20/202—Interconnection or interaction of plural electronic cash registers [ECR] or to host computer, e.g. network details, transfer of information from host to ECR or from ECR to ECR
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/08—Payment architectures
- G06Q20/20—Point-of-sale [POS] network systems
- G06Q20/208—Input by product or record sensing, e.g. weighing or scanner processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
Abstract
The present invention relates to a kind of commodity identification and cash register system based on image recognition, the system is by combining image recognition and weight verification to realize accurate commodity identification and cash register, the system can realize semi-self-service cash register or full-automatic cash register, the system includes image capture module, picture recognition module, Weighing module, identify control module, POS terminal, cloud training platform and network module, image capture module, Weighing module is connect with identification control module respectively, cloud training platform is connect with picture recognition module by network module, cloud training platform is equipped with identification model library, POS terminal is equipped with cash register unit and touch screen, under semi-self-service cash register mode, cashier assists customer, cash register is completed using POS terminal, under full-automatic cash register mode, customer can voluntarily complete cash register.Compared with prior art, the present invention combines commodity image identification and commodity weight verification, can further improve the accuracy rate of commodity identification, and has many advantages, such as that recognition speed is fast, is widely used.
Description
Technical field
The present invention relates to commodity cash register technical fields, more particularly, to a kind of commodity identification and cash register based on image recognition
System.
Background technique
Image recognition technology is a key areas of artificial intelligence.It, which refers to, carries out Object identifying to image, with identification
The technology of various types of target.In order to work out the simulation movable computer program of mankind's image recognition, there has been proposed
Image recognition model.With the continuous development of modern computer information technology, this technology of image recognition is extensive using more
With it is universal, progressed into daily life.
Image recognition technology is applied in commodity cash register and is a research hotspot at present, can by image recognition commodity
It realizes when cash register without manually checking, the classification and price of commodity can be obtained.But it is for now, existing according to image recognition
The product identification system of technology is not high to the accuracy of the more serious commodity identification of some superpositions, bigger for differentiation
Commodity identification do not come out, and recognition speed is slower, brings inconvenience for cash register work.In addition, existing goods identification system
The commodity that can be identified of uniting are limited, and type is few, limits its extensive use.
Summary of the invention
It is an object of the present invention to overcome the above-mentioned drawbacks of the prior art and provide one kind to be based on image recognition
Commodity identification and cash register system.
The purpose of the present invention can be achieved through the following technical solutions:
A kind of commodity identification and cash register system based on image recognition, the system is using semi-self-service cash register mode or automatically
Cash register mode, the system include:
Image capture module: for carrying out Image Acquisition to cash register commodity；
Picture recognition module: for carrying out commodity identification to the image of acquisition；
POS terminal: for sending identification instruction, receiving identification information and commodity payment；
Weighing module: for acquiring the weight data of cash register commodity；
Identification control module: for controlling picture recognition module and Weighing module, the identification letter for receiving picture recognition module
It ceases and weight data is analyzed and processed；The identification control module and image capture module, Weighing module wired connection
Or it is wirelessly connected；
Cloud training platform: it is connected to the network with picture recognition module, for providing identification model library for picture recognition module；
Network module: for providing wireless data transmission for whole system；
Customer handheld terminal: for carrying out commodity bill payment under full-automatic cash register mode, the customer handheld is whole
End is equipped with payment module.
Preferably, the cloud training platform to commodity image data gathered in advance, commodity image number data into
Row training obtains identification model and stores to identification model library.
Preferably, the identification control module is equipped with processor and memory, and the memory stores commercial standards
Weight data and commodity price data, the commercial standards weight data are all kinds of commercial standards weight numbers gathered in advance
According to.
Preferably, the image capture module includes first microprocessor, camera, camera regulating device and image
Pretreatment unit, the first microprocessor are connect with identification control module, and the camera and first microprocessor connect
It connects, the image pre-processing unit is connect with camera, and the camera regulating device is connect with camera, and described takes the photograph
As head is equipped with the nanometer anti-fog coating for preventing camera mirror surface from hazing.
Preferably, the Weighing module includes electronic-weighing platform, the second microprocessor and incudes trigger module, described
Electronic-weighing platform is connect with the second microprocessor, and second microprocessor is connect with identification control module, the camera shooting
The center of head and electronic-weighing platform is correspondingly arranged up and down, and the induction trigger module is set on electronic-weighing platform, described
Induction trigger module with identification control module connect.
Preferably, when using semi-self-service cash register mode, the POS terminal include cash register unit and respectively with cash register unit
Touch screen, client display screen and the printing device of connection, the touch screen and identification control module connect；It is received when using full-automatic
When silver-colored mode, the POS terminal includes that cash register unit and the touching display screen connecting respectively with cash register unit, clearing code generate list
Member and printing device, the touching display screen are equipped with clearing key, which connect with clearing code generation unit, institute
The clearing code generation unit stated is connect with printing device.
Preferably, the picture recognition module be set to POS terminal in, and with the wired or wireless connection of image capture module.
Preferably, the picture recognition module and POS terminal cloud are arranged, and with the wired or wireless company of image capture module
It connects.
When using semi-self-service cash register mode, the cash register process of the system specifically includes the following steps:
1) sampling mark carried out to all kinds of commodity in advance, obtain include commodity image, commercial standards weight, commodity price and
The sample data of goods number, cloud training platform are trained commodity image data, commodity image number data, obtain and know
Other model is simultaneously stored to identification model library, and commercial standards weight data and commodity price data are stored to identification control module；
If 2) there is commodity to be placed on electronic-weighing platform, induction trigger module sends trigger signal to identifying control module,
Identify control module control image capture module carry out Image Acquisition, camera shooting commodity image and by commodity image pass through
It is sent to picture recognition module after image pre-processing unit processing, is performed the next step；
3) picture recognition module transfers the identification model in the identification model library of cloud training platform and carries out image recognition, and
The commodity image that will acquire is sent to cloud training platform, and the goods number of identification and picture are sent to knowledge by picture recognition module
Other control module, meanwhile, cloud training platform will identify that successful commodity image is added in corresponding commodity training pattern,
Identification model library constantly carries out mold cycle repetitive exercise, completes the update in identification model library；
4) identification control module determines whether to weigh automatically according to image recognition result, if so, then follow the steps 5),
Otherwise, recognition result is shown on touch screen, executes step 6)；
5) weighing data is sent to identification control module, identification control according to the instruction of identification control module by Weighing module
Molding block is compared practical weighing data with standard weights data, and comparison result is shown on touch screen, executes step
It is rapid 6)；
6) cashier carries out information checking to the data that touch screen is shown, if verification passes through, cashier clicks touching
Control screen generates commodity bill using the cash register unit of POS terminal, and client display screen shows bill information, customer payment bill, printing
Equipment prints payment bill, completes cash register；If verification failure, cashier according to wrong data judge incorrectly reason, and according to
After being adjusted according to error reason, it re-execute the steps 2).
When using full-automatic cash register mode, the cash register process of the system specifically includes the following steps:
1) sampling mark carried out to all kinds of commodity in advance, obtain include commodity image, commercial standards weight, commodity price and
The sample data of goods number, cloud training platform are trained commodity image data, commodity image number data, obtain and know
Other model is simultaneously stored to identification model library, and commercial standards weight data and commodity price data are stored to identification control module；
2) commodity are placed on electronic-weighing platform by customer, and induction trigger module sends trigger signal to identification control mould
Block, identification control module control image capture module carry out Image Acquisition, camera shoot commodity image and by commodity image
It is sent to picture recognition module after handling by image pre-processing unit, performs the next step；
3) picture recognition module transfers the identification model in the identification model library of cloud training platform and carries out image recognition, and
The commodity image that will acquire is sent to cloud training platform, and the goods number of identification and picture are sent to knowledge by picture recognition module
Other control module, meanwhile, cloud training platform will identify that successful commodity image is added in corresponding commodity training pattern,
Identification model library constantly carries out mold cycle repetitive exercise, completes the update in identification model library；
4) identification control module determines whether to weigh automatically according to image recognition result, if so, then follow the steps 5),
Otherwise, recognition result is shown on touch screen, executes step 6) or step 7)；
5) weighing data is sent to identification control module, identification control according to the instruction of identification control module by Weighing module
Molding block is compared practical weighing data with standard weights data, and comparison result is shown on touch screen, under execution
One step；
6) customer carries out information checking according to the data that touching display screen is shown, if verification passes through, clicks touch-control and shows
The clearing key of screen, clearing code generation unit generate payment and settlement code, and customer is completed by customer handheld terminal scanning clearing code
Bill payment, printing device print payment bill, complete cash register；If verification failure, customer judges incorrectly former according to wrong data
Cause, and after being adjusted according to error reason, it re-execute the steps 2).
Compared with prior art, the invention has the following advantages that
(1) present system can be by commodity image information collection, commodity weight information collection, merchandise news training with reality
The identification and cash register of existing extensive stock, are widely used；
(2) present system is equipped with exclusive Weighing module, and commodity image identification and commodity weight verification are combined and
Judge that commodity stack situation or wrong identification situation, can further improve the accuracy rate of image recognition；
(3) present invention marks process standardization and sample training by the sample collection of early period, sample, is greatly improved knowledge
Other efficiency；
(4) picture recognition module of the invention and identification control module can realize wired or wireless connection, can be for not
It is arranged on corresponding position with demand, using flexible, conveniently；
(5) recognition speed of present system is fast, and single picture identification only needs 0.1s, when using semi-self-service cash register mode
When, greatly reduce the time of cashier's typing commodity；
(6) present system is divided into complete self-service cash register and semi-self-service cash register both of which, and identifies control module in triggering
When, can be used manually triggering or two kinds of automatic trigger, can be selected according to the demand in different shops or market installation system and
The classification of equipment, application field is extensive, distinct characteristics；
(7) the camera glass of present system uses unique nanometer anti-fog coating, can solve identification warm-served food class commodity
Caused by camera shooting haze problem, further increase the recognition accuracy of warm-served food and the commodity application range of identification；
(8) image capture module of the invention is equipped with camera regulating device, and camera regulating device can be according to being distributed in
The quantity and size of commodity on electronic-weighing platform carry out height and shooting angle is adjusted, to further increase the standard of image recognition
True property.
Detailed description of the invention
Fig. 1 is a kind of commodity identification and receipts based on image recognition in the embodiment of the present invention 1 under semi-self-service cash register mode
The structural schematic diagram of silver-colored system；
Fig. 2 is the workflow schematic diagram of system in the embodiment of the present invention 1；
Fig. 3 is a kind of commodity identification and receipts based on image recognition in the embodiment of the present invention 2 under full-automatic cash register mode
The structural schematic diagram of silver-colored system；
In Fig. 1 shown in label:
1, camera erecting bed, 2, camera, 3, lifting regulating rod, 4, pedestal, 5, fixed plate, 6, USB connecting line, 7, electricity
Sub- weighing unit, 8, host, 9, touch screen, 10, client display screen, 11, printing device；
In Fig. 3 shown in label:
1, camera erecting bed, 2, camera, 3, lifting regulating rod, 4, pedestal, 5, fixed plate, 6, USB connecting line, 7, electricity
Sub- weighing unit, 8, host, 11, printing device, 12, touching display screen, 13, clearing key.
Specific embodiment
The present invention is described in detail with specific embodiment below in conjunction with the accompanying drawings.
The present invention relates to a kind of commodity identification and cash register system based on image recognition, the system is by combining image recognition
And accurate commodity identification and cash register are completed in weight verification, carry out semi-self-service cash register or full-automatic cash register to commodity.
Embodiment 1
A kind of commodity identification and cash register system based on image recognition, for realizing semi-self-service cash register, including Image Acquisition
Module, picture recognition module, Weighing module, identification control module, POS terminal, cloud training platform and network module.
Cloud training platform carries out sample training according to the mark commodity original acquired early period, and generates identification model, cloud
Training platform is held to be equipped with identification model library, identification model library stores identification model.Cloud training platform passes through with POS terminal
Network module connection.
POS terminal includes host, touch screen 9, printing device 11, client display screen 10, is equipped with cash register unit in host.Cash register
Unit is separately connected with touch screen 9, printing device 11, client display screen 10.Touch screen 9 is connect with identification control module.
Weighing module is set to cash register region, for obtaining the weight data of cash register commodity and sending data to identification control
Module.Weighing module includes electronic-weighing platform, the second microprocessor and induction trigger module, electronic-weighing platform and the second micro process
Device connection, the second microprocessor are connect with identification control module, and induction trigger module is set on electronic-weighing platform, incude trigger mode
Block is connect with identification control module.
Image capture module is set to cash register region, for carrying out image taking to cash register commodity, and image is sent to figure
As identification module.Image capture module includes first microprocessor, camera 2, camera regulating device and image preprocessing list
Member, first microprocessor with identification control module connect, camera 2 is connect with first microprocessor, image pre-processing unit and
Camera connection, camera 2 are set in camera regulating device.Camera 2 is corresponding up and down with the center of electronic-weighing platform
Setting.
It identifies that control module and Weighing module, image capture module use wired or wireless connection, knows for controlling image
Other module and Weighing module receive the identification information of picture recognition module and are analyzed and processed to weight data, identification control
Module is equipped with processor and memory, and memory stores commercial standards weight data and commodity price data, and processor is to image
Identification module, Weighing module control and be compared to practical weighing data with standard weights data.
Picture recognition module can be set to POS terminal in, and with the wired or wireless connection of image capture module, picture recognition module
Can also be arranged with POS terminal cloud, and with the wired or wireless connection of image capture module.The picture recognition module of the present embodiment is set to
In POS terminal, picture recognition module is connect with image capture module wire/wireless, and is connected to the network with cloud training platform, is passed through
The identification model library for transferring cloud training platform identifies the commodity image of image capture module acquisition.
The identification control module of the present embodiment is set in POS terminal, and image capture module, Weighing module are connected by USB respectively
Wiring 6 is connect with identification control module.
As shown in Fig. 2, the position of camera 2 is set to 7 top of electronic-weighing platform, and the position of camera 2 and electronic-weighing
The center on 7 surface of platform is corresponding.Camera regulating device includes fixed plate 5, pedestal 4, lifting regulating rod 3 and camera peace
Fill platform 1.Fixed plate 5 is fixed on cash register region, and pedestal 4 is fixed in fixed plate 5, and lifting regulating rod 3 is fixed on pedestal 4, takes the photograph
As head erecting bed 1 is set to the top of lifting regulating rod 3, the junction of camera erecting bed 1 and lifting regulating rod 3 is equipped with being used for
The rotary shaft of 360 degree of adjusting camera erecting beds 1, camera 2 are fixed on the bottom of camera erecting bed 1, and lifting regulating rod 3 is used
In the height for adjusting camera 2, camera erecting bed 1 is used to adjust the shooting angle of camera 2, can be neatly to electronic-weighing
The commodity of different modes of emplacement are completely shot in platform.Light compensating lamp is additionally provided on camera erecting bed 1, light compensating lamp is fixed on
The lens edge of the two sides of camera 2, camera 2 is equipped with focus adjustment circle.
As shown in Fig. 2, the workflow of present system are as follows:
Step 1: carrying out sampling mark to all kinds of commodity in advance, obtaining includes commodity image, commercial standards weight, commodity
The sample data of price and goods number, cloud training platform are trained commodity image data, commodity image number data,
It obtains identification model and stores to identification model library, commercial standards weight data and commodity price data store to identification and control mould
Block；
Step 2: if there is commodity to be placed on electronic-weighing platform, induction trigger module sends trigger signal to identifying control
Module, identification control module control image capture module carry out Image Acquisition, camera shoot commodity image and by commodity figure
As being sent to picture recognition module after handling by image pre-processing unit, perform the next step；
Step 3: picture recognition module, which transfers the identification model in the identification model library of cloud training platform, carries out image knowledge
Not, and the commodity image that will acquire is sent to cloud training platform, and picture recognition module sends out the goods number of identification and picture
It send to identification control module, meanwhile, cloud training platform will identify that successful commodity image is added to corresponding commodity training
In model, identification model library constantly carries out mold cycle repetitive exercise, completes the update in identification model library；
Step 4: identification control module determines whether to weigh automatically according to image recognition result, if so, executing step
Rapid five, otherwise, recognition result is shown on touch screen, executes step 6；
Step 5: weighing data is sent to identification control module according to the instruction of identification control module by Weighing module, know
Other control module is compared practical weighing data with standard weights data, and comparison result is shown on touch screen, holds
Row step 6；
Step 6: cashier carries out information checking to the data that touch screen is shown, and if verification passes through, cashier's point
Hit touch screen, using POS terminal cash register unit generate commodity bill, client display screen show bill information, customer payment bill,
Printing device prints payment bill, completes cash register；If verification failure, cashier according to wrong data judge incorrectly reason,
And after being adjusted according to error reason, it re-execute the steps two.
If error reason be commodity image in product locations deviate frame out, adjust photographic device head regulating device with
Adjust the shooting angle or height of camera；If error reason is that the commodity image in commodity image is unintelligible, focus
Adjusting ring and light compensating lamp, to adjust the focal length and light filling degree of camera；If error reason is that the gross weight that Weighing module obtains is
Zero, then check whether the connection of electronic-weighing platform and POS terminal is abnormal.
Embodiment 2
A kind of commodity identification and cash register system based on image recognition, the system is without cashier, it can be achieved that customer is complete
Automatic cash register, including image capture module, picture recognition module, Weighing module, identification control module, POS terminal, cloud training are flat
Platform, network module and customer handheld terminal.As shown in figure 3, the POS terminal of the present embodiment system include cash register unit and respectively with receipts
Touching display screen 12, clearing code generation unit and the printing device 11 of silver-colored unit connection, touching display screen 12 are equipped with clearing and press
Key 13, clearing key 13 are connect with clearing code generation unit, and clearing code generation unit is connect with printing device 11.This system its
His structure is same as Example 1.
The workflow of this system are as follows:
Step 1: carrying out sampling mark to all kinds of commodity in advance, obtaining includes commodity image, commercial standards weight, commodity
The sample data of price and goods number, cloud training platform are trained commodity image data, commodity image number data,
It obtains identification model and stores to identification model library, commercial standards weight data and commodity price data store to identification and control mould
Block；
Step 2: commodity are placed on electronic-weighing platform by customer, induction trigger module sends trigger signal to identifying control
Molding block, identification control module control image capture module carry out Image Acquisition, camera shoot commodity image and by commodity
Image is sent to picture recognition module after handling by image pre-processing unit, performs the next step；
Step 3: picture recognition module, which transfers the identification model in the identification model library of cloud training platform, carries out image knowledge
Not, and the commodity image that will acquire is sent to cloud training platform, and picture recognition module sends out the goods number of identification and picture
It send to identification control module, meanwhile, cloud training platform will identify that successful commodity image is added to corresponding commodity training
In model, identification model library constantly carries out mold cycle repetitive exercise, completes the update in identification model library；
Step 4: identification control module determines whether to weigh automatically according to image recognition result, if so, executing step
Rapid five, otherwise, recognition result is shown on touch screen, executes step 6；
Step 5: weighing data is sent to identification control module according to the instruction of identification control module by Weighing module, know
Other control module is compared practical weighing data with standard weights data, and comparison result is shown on touch screen, holds
Row is in next step；
Step 6: customer carries out information checking according to the data that touching display screen is shown, if verification passes through, touch-control is clicked
The clearing key of display screen, clearing code generation unit generate payment and settlement code, and customer passes through customer handheld terminal scanning clearing code
Bill payment is completed, printing device prints payment bill, completes cash register；If verification failure, customer misdeem according to wrong data
Accidentally reason, and after being adjusted according to error reason, it re-execute the steps two.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
The cashier for being familiar with the art in the technical scope disclosed by the present invention, can readily occur in various equivalent modifications or replace
It changes, these modifications or substitutions should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with right
It is required that protection scope subject to.
Claims (10)
1. a kind of commodity identification and cash register system based on image recognition, which is characterized in that the system uses semi-self-service cash register mould
Formula or full-automatic cash register mode, the system include:
Image capture module: for carrying out Image Acquisition to cash register commodity；
Picture recognition module: for carrying out commodity identification to the image of acquisition；
POS terminal: for sending identification instruction, receiving identification information and commodity payment；
Weighing module: for acquiring the weight data of cash register commodity；
Identification control module: for control picture recognition module and Weighing module, receive picture recognition module identification information and
Weight data is analyzed and processed；The identification control module and image capture module, Weighing module wired connection or nothing
Line connection；
Cloud training platform: it is connected to the network with picture recognition module, for providing identification model library for picture recognition module；
Network module: for providing wireless data transmission for whole system；
Customer handheld terminal: for carrying out commodity bill payment under full-automatic cash register mode, the customer handheld terminal is set
There is payment module.
2. a kind of commodity identification and cash register system based on image recognition according to claim 1, which is characterized in that described
Cloud training platform commodity image data gathered in advance, commodity image number data are trained, obtain identification model
And it stores to identification model library.
3. a kind of commodity identification and cash register system based on image recognition according to claim 1, which is characterized in that described
Identification control module be equipped with processor and memory, the described memory storage commercial standards weight data and commodity price number
According to the commercial standards weight data is all kinds of commercial standards weight datas gathered in advance.
4. a kind of commodity identification and cash register system based on image recognition according to claim 1, which is characterized in that described
Image capture module include first microprocessor, camera, camera regulating device and image pre-processing unit, described
One microprocessor is connect with identification control module, and the camera is connect with first microprocessor, the image preprocessing
Unit is connect with camera, and the camera regulating device is connect with camera, and the camera is equipped with for preventing
The nanometer anti-fog coating that camera mirror surface hazes.
5. a kind of commodity identification and cash register system based on image recognition according to claim 4, which is characterized in that described
Weighing module include electronic-weighing platform, the second microprocessor and induction trigger module, the electronic-weighing platform and second micro-
Processor connection, second microprocessor are connect with identification control module, in the camera and electronic-weighing platform
Heart position is correspondingly arranged up and down, and the induction trigger module is set on electronic-weighing platform, the induction trigger module and knowledge
Other control module connection.
6. a kind of commodity identification and cash register system based on image recognition according to claim 1, which is characterized in that when adopting
When with semi-self-service cash register mode, the POS terminal includes cash register unit and the touch screen connecting respectively with cash register unit, Gu Kexian
Display screen and printing device, the touch screen and identification control module connect；When using full-automatic cash register mode, the POS
End includes cash register unit and the touching display screen connecting respectively with cash register unit, settles accounts code generation unit and printing device, described
Touching display screen be equipped with clearing key, which connect with clearing code generation unit, the described clearing code generation list
Member is connect with printing device.
7. a kind of commodity identification and cash register system based on image recognition according to claim 1, which is characterized in that described
Picture recognition module be set to POS terminal in, and with the wired or wireless connection of image capture module.
8. a kind of commodity identification and cash register system based on image recognition according to claim 1, which is characterized in that described
Picture recognition module and POS terminal cloud be arranged, and with the wired or wireless connection of image capture module.
9. a kind of commodity identification and cash register system based on image recognition according to claim 1-8, feature
Be, the cash register process of the system specifically includes the following steps:
1) when using semi-self-service cash register mode, sampling mark is carried out to all kinds of commodity in advance, obtaining includes commodity image, commodity
The sample data of standard weights, commodity price and goods number, cloud training platform number commodity image data, commodity image
Data are trained, and are obtained identification model and are stored to identification model library, commercial standards weight data and commodity price data are deposited
Storage extremely identification control module；
If 2) there is commodity to be placed on electronic-weighing platform, induction trigger module sends trigger signal to control module is identified, identifies
Control module control image capture module carry out Image Acquisition, camera shooting commodity image and by commodity image pass through image
It is sent to picture recognition module after pretreatment unit processing, is performed the next step；
3) picture recognition module transfers the identification model in the identification model library of cloud training platform and carries out image recognition, and will obtain
The commodity image taken is sent to cloud training platform, and the goods number of identification and picture are sent to identification control by picture recognition module
Molding block, meanwhile, cloud training platform will identify that successful commodity image is added in corresponding commodity training pattern, identification
Model library constantly carries out mold cycle repetitive exercise, completes the update in identification model library；
4) identification control module determines whether to weigh automatically according to image recognition result, if so, then follow the steps 5), it is no
Then, recognition result is shown on touch screen, executes step 6)；
5) weighing data is sent to identification control module, identification control mould according to the instruction of identification control module by Weighing module
Block is compared practical weighing data with standard weights data, and comparison result is shown on touch screen, executes step 6)；
6) cashier carries out information checking to the data that touch screen is shown, if verification passes through, cashier clicks touch screen,
Commodity bill is generated using the cash register unit of POS terminal, client display screen shows bill information, customer payment bill, printing device
Payment bill is printed, cash register is completed；If verification failure, cashier judges incorrectly reason according to wrong data, and according to mistake
After accidentally reason is adjusted, it re-execute the steps 2).
10. a kind of commodity identification and cash register system based on image recognition according to claim 1-8, feature
Be, the cash register process of the system specifically includes the following steps:
1) when using full-automatic cash register mode, sampling mark is carried out to all kinds of commodity in advance, obtaining includes commodity image, commodity
The sample data of standard weights, commodity price and goods number, cloud training platform number commodity image data, commodity image
Data are trained, and are obtained identification model and are stored to identification model library, commercial standards weight data and commodity price data are deposited
Storage extremely identification control module；
2) commodity are placed on electronic-weighing platform by customer, and induction trigger module sends trigger signal to control module is identified, are known
Other control module control image capture module carries out Image Acquisition, camera shooting commodity image and by commodity image pass through figure
As being sent to picture recognition module after pretreatment unit processing, perform the next step；
3) picture recognition module transfers the identification model in the identification model library of cloud training platform and carries out image recognition, and will obtain
The commodity image taken is sent to cloud training platform, and the goods number of identification and picture are sent to identification control by picture recognition module
Molding block, meanwhile, cloud training platform will identify that successful commodity image is added in corresponding commodity training pattern, identification
Model library constantly carries out mold cycle repetitive exercise, completes the update in identification model library；
4) identification control module determines whether to weigh automatically according to image recognition result, if so, then follow the steps 5), it is no
Then, recognition result is shown on touch screen, executes step 6) or step 7)；
5) weighing data is sent to identification control module, identification control mould according to the instruction of identification control module by Weighing module
Block is compared practical weighing data with standard weights data, and comparison result is shown on touch screen, performs the next step；
6) customer carries out information checking according to the data that touching display screen is shown, if verification passes through, clicks touching display screen
Key is settled accounts, clearing code generation unit generates payment and settlement code, and customer completes bill by customer handheld terminal scanning clearing code
Payment, printing device print payment bill, complete cash register；If verification failure, customer according to wrong data judge incorrectly reason, and
After being adjusted according to error reason, it re-execute the steps 2).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810833919.7A CN109118200A (en) | 2018-07-26 | 2018-07-26 | A kind of commodity identification and cash register system based on image recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810833919.7A CN109118200A (en) | 2018-07-26 | 2018-07-26 | A kind of commodity identification and cash register system based on image recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109118200A true CN109118200A (en) | 2019-01-01 |
Family
ID=64863726
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810833919.7A Pending CN109118200A (en) | 2018-07-26 | 2018-07-26 | A kind of commodity identification and cash register system based on image recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109118200A (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109712350A (en) * | 2019-01-31 | 2019-05-03 | 浙江云澎科技有限公司 | A kind of self-help settlement machine of intelligent recognition and its recognition methods |
| CN109918517A (en) * | 2019-03-15 | 2019-06-21 | 南京亿猫信息技术有限公司 | A kind of wisdom purchase system |
| CN110335426A (en) * | 2019-05-09 | 2019-10-15 | 杨伟 | Commodity pricing method, intelligent electronic-scale and cash register system |
| CN110874900A (en) * | 2019-12-17 | 2020-03-10 | 韶关市龙飞数码科技有限公司 | AI intelligent identification thing self-induction cashier |
| CN110942295A (en) * | 2019-11-08 | 2020-03-31 | 九洲云联（武汉）科技有限公司 | Intelligent cash register system and cash register method thereof |
| CN111461694A (en) * | 2020-03-17 | 2020-07-28 | 上海大学 | Dish identification and pricing system and method based on multi-level learning model |
| CN111540135A (en) * | 2019-10-31 | 2020-08-14 | 杭州腾纵科技有限公司 | Farmer market cash register system capable of improving caching efficiency |
| CN111814614A (en) * | 2020-06-28 | 2020-10-23 | 袁精侠 | Intelligent object-identifying electronic scale weighing method and system |
| WO2020233585A1 (en) * | 2019-05-21 | 2020-11-26 | 深圳市恒天伟焱科技有限公司 | Food settlement method and device, and computer-readable storage medium |
| CN112270624A (en) * | 2020-10-26 | 2021-01-26 | 链盟智能科技(广州)有限公司 | Artificial intelligence bill discernment generation system based on fast food trade |
| CN112304411A (en) * | 2019-07-31 | 2021-02-02 | 梅特勒-托利多(常州)测量技术有限公司 | Weighing system with object recognition and weighing method |
| WO2021018162A1 (en) * | 2019-07-31 | 2021-02-04 | Mettler-Toledo (Changzhou) Measurement Technology Ltd. | A weighing device and a method of weighing using object recognition |
| CN112466068A (en) * | 2020-11-26 | 2021-03-09 | 融讯伟业（北京）科技有限公司 | Intelligent weighing device and intelligent weighing method based on computer vision technology |
| CN112749811A (en) * | 2020-12-24 | 2021-05-04 | 上海柏珍信息科技有限公司 | Weighing identification system based on non-inductive self-learning AI algorithm |
| CN112967000A (en) * | 2021-03-11 | 2021-06-15 | 中工美(北京)供应链物流管理有限责任公司 | Appearance and weight identification method of silver storage automatic warehousing system |
| US11037124B1 (en) | 2020-02-26 | 2021-06-15 | Viscovery Inc. | Checkout apparatus for barcodeless merchandise |
| CN113269935A (en) * | 2021-07-16 | 2021-08-17 | 融讯伟业（北京）科技有限公司 | Visual weighing method and weighing system based on screen-free weighing device |
| TWI765218B (en) * | 2020-01-21 | 2022-05-21 | 創意引晴股份有限公司 | Checkout apparatus for barcodeless merchandise |
| CN115311791A (en) * | 2022-08-08 | 2022-11-08 | 北京远舢智能科技有限公司 | Image recognition device, method, apparatus and storage medium |
| CN117011984A (en) * | 2023-10-08 | 2023-11-07 | 深圳桑达银络科技有限公司 | AI-based self-service cashing loss prevention method and system |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103106752A (en) * | 2011-09-29 | 2013-05-15 | Ncr公司 | System and method for performing a security check at a checkout terminal |
| CN206117827U (en) * | 2016-09-21 | 2017-04-19 | 宿迁琛博信息科技有限公司 | Many angular adjustment computer camera |
| CN107067510A (en) * | 2017-03-27 | 2017-08-18 | 杭州赛狐科技有限公司 | A kind of unattended Supermarket shopping system |
| CN107169758A (en) * | 2017-04-26 | 2017-09-15 | 创斯达科技集团(中国)有限责任公司 | A kind of intelligent payment system and its method of payment |
| CN107563745A (en) * | 2017-09-19 | 2018-01-09 | 成都猫道科技有限公司 | Fruits and vegetables class commodity self-service is weighed and accounting device, system and application method |
| CN107564180A (en) * | 2017-09-17 | 2018-01-09 | 胡雷刚 | A kind of self-help settlement check method and its system |
| CN107705470A (en) * | 2017-08-17 | 2018-02-16 | 阿里巴巴集团控股有限公司 | Shopping settlement method, smart shopper equipment and intelligent supermarket system |
| CN107748973A (en) * | 2017-09-29 | 2018-03-02 | 时瑞科技（深圳）有限公司 | Product identification system and automatic identification are sold or storage method |
| CN107767590A (en) * | 2016-08-16 | 2018-03-06 | 深圳仪普生科技有限公司 | Automatic identification commercialization bar code electronic scale and Automatic identification method |
| CN107833363A (en) * | 2017-09-28 | 2018-03-23 | 中南大学 | Self-help vending machine automated stock control system and method based on image recognition |
| CN108022094A (en) * | 2017-12-15 | 2018-05-11 | 武汉星巡智能科技有限公司 | Self-service checkout system and method |
| CN108093227A (en) * | 2018-01-26 | 2018-05-29 | 嘉兴贝斯特电子技术有限公司 | A kind of Car license recognition camera with spinfunction |
| CN108091085A (en) * | 2018-01-01 | 2018-05-29 | 王美金 | A kind of artificial intelligence market conveyor type automated payment system and application method |
| CN108132510A (en) * | 2017-12-26 | 2018-06-08 | 肖毅 | A kind of safety monitoring lens apparatus |
-
2018
- 2018-07-26 CN CN201810833919.7A patent/CN109118200A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103106752A (en) * | 2011-09-29 | 2013-05-15 | Ncr公司 | System and method for performing a security check at a checkout terminal |
| CN107767590A (en) * | 2016-08-16 | 2018-03-06 | 深圳仪普生科技有限公司 | Automatic identification commercialization bar code electronic scale and Automatic identification method |
| CN206117827U (en) * | 2016-09-21 | 2017-04-19 | 宿迁琛博信息科技有限公司 | Many angular adjustment computer camera |
| CN107067510A (en) * | 2017-03-27 | 2017-08-18 | 杭州赛狐科技有限公司 | A kind of unattended Supermarket shopping system |
| CN107169758A (en) * | 2017-04-26 | 2017-09-15 | 创斯达科技集团(中国)有限责任公司 | A kind of intelligent payment system and its method of payment |
| CN107705470A (en) * | 2017-08-17 | 2018-02-16 | 阿里巴巴集团控股有限公司 | Shopping settlement method, smart shopper equipment and intelligent supermarket system |
| CN107564180A (en) * | 2017-09-17 | 2018-01-09 | 胡雷刚 | A kind of self-help settlement check method and its system |
| CN107563745A (en) * | 2017-09-19 | 2018-01-09 | 成都猫道科技有限公司 | Fruits and vegetables class commodity self-service is weighed and accounting device, system and application method |
| CN107833363A (en) * | 2017-09-28 | 2018-03-23 | 中南大学 | Self-help vending machine automated stock control system and method based on image recognition |
| CN107748973A (en) * | 2017-09-29 | 2018-03-02 | 时瑞科技（深圳）有限公司 | Product identification system and automatic identification are sold or storage method |
| CN108022094A (en) * | 2017-12-15 | 2018-05-11 | 武汉星巡智能科技有限公司 | Self-service checkout system and method |
| CN108132510A (en) * | 2017-12-26 | 2018-06-08 | 肖毅 | A kind of safety monitoring lens apparatus |
| CN108091085A (en) * | 2018-01-01 | 2018-05-29 | 王美金 | A kind of artificial intelligence market conveyor type automated payment system and application method |
| CN108093227A (en) * | 2018-01-26 | 2018-05-29 | 嘉兴贝斯特电子技术有限公司 | A kind of Car license recognition camera with spinfunction |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109712350A (en) * | 2019-01-31 | 2019-05-03 | 浙江云澎科技有限公司 | A kind of self-help settlement machine of intelligent recognition and its recognition methods |
| CN109918517A (en) * | 2019-03-15 | 2019-06-21 | 南京亿猫信息技术有限公司 | A kind of wisdom purchase system |
| CN110335426A (en) * | 2019-05-09 | 2019-10-15 | 杨伟 | Commodity pricing method, intelligent electronic-scale and cash register system |
| WO2020233585A1 (en) * | 2019-05-21 | 2020-11-26 | 深圳市恒天伟焱科技有限公司 | Food settlement method and device, and computer-readable storage medium |
| WO2021018162A1 (en) * | 2019-07-31 | 2021-02-04 | Mettler-Toledo (Changzhou) Measurement Technology Ltd. | A weighing device and a method of weighing using object recognition |
| WO2021018161A1 (en) * | 2019-07-31 | 2021-02-04 | Mettler-Toledo (Changzhou) Measurement Technology Ltd. | Weighing system and weighing method with object recognition |
| CN112304411A (en) * | 2019-07-31 | 2021-02-02 | 梅特勒-托利多(常州)测量技术有限公司 | Weighing system with object recognition and weighing method |
| CN111540135A (en) * | 2019-10-31 | 2020-08-14 | 杭州腾纵科技有限公司 | Farmer market cash register system capable of improving caching efficiency |
| CN110942295A (en) * | 2019-11-08 | 2020-03-31 | 九洲云联（武汉）科技有限公司 | Intelligent cash register system and cash register method thereof |
| CN110874900A (en) * | 2019-12-17 | 2020-03-10 | 韶关市龙飞数码科技有限公司 | AI intelligent identification thing self-induction cashier |
| TWI765218B (en) * | 2020-01-21 | 2022-05-21 | 創意引晴股份有限公司 | Checkout apparatus for barcodeless merchandise |
| US11037124B1 (en) | 2020-02-26 | 2021-06-15 | Viscovery Inc. | Checkout apparatus for barcodeless merchandise |
| CN111461694A (en) * | 2020-03-17 | 2020-07-28 | 上海大学 | Dish identification and pricing system and method based on multi-level learning model |
| CN111461694B (en) * | 2020-03-17 | 2023-07-18 | 上海大学 | Dish identification and pricing system and method based on multi-level learning model |
| CN111814614A (en) * | 2020-06-28 | 2020-10-23 | 袁精侠 | Intelligent object-identifying electronic scale weighing method and system |
| CN112270624A (en) * | 2020-10-26 | 2021-01-26 | 链盟智能科技(广州)有限公司 | Artificial intelligence bill discernment generation system based on fast food trade |
| WO2022111059A1 (en) * | 2020-11-26 | 2022-06-02 | 融讯伟业（北京）科技有限公司 | Intelligent weighing apparatus based on computer vision technology, and intelligent weighing method |
| CN112466068A (en) * | 2020-11-26 | 2021-03-09 | 融讯伟业（北京）科技有限公司 | Intelligent weighing device and intelligent weighing method based on computer vision technology |
| CN112466068B (en) * | 2020-11-26 | 2021-07-09 | 融讯伟业（北京）科技有限公司 | Intelligent weighing device and intelligent weighing method based on computer vision technology |
| CN114550385A (en) * | 2020-11-26 | 2022-05-27 | 融讯伟业（北京）科技有限公司 | Intelligent weighing device and intelligent weighing method based on computer vision technology |
| CN112749811A (en) * | 2020-12-24 | 2021-05-04 | 上海柏珍信息科技有限公司 | Weighing identification system based on non-inductive self-learning AI algorithm |
| CN112967000A (en) * | 2021-03-11 | 2021-06-15 | 中工美(北京)供应链物流管理有限责任公司 | Appearance and weight identification method of silver storage automatic warehousing system |
| CN113269935A (en) * | 2021-07-16 | 2021-08-17 | 融讯伟业（北京）科技有限公司 | Visual weighing method and weighing system based on screen-free weighing device |
| CN115311791A (en) * | 2022-08-08 | 2022-11-08 | 北京远舢智能科技有限公司 | Image recognition device, method, apparatus and storage medium |
| CN117011984A (en) * | 2023-10-08 | 2023-11-07 | 深圳桑达银络科技有限公司 | AI-based self-service cashing loss prevention method and system |
| CN117011984B (en) * | 2023-10-08 | 2023-12-15 | 深圳桑达银络科技有限公司 | AI-based self-service cashing loss prevention method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109118200A (en) | A kind of commodity identification and cash register system based on image recognition | |
| CN108320404A (en) | Commodity recognition method, device, self-service cashier based on neural network | |
| EP3518149A1 (en) | Feedback loop for image-based recognition | |
| WO2017126254A1 (en) | Information processing device, information processing method, and program | |
| US9454708B2 (en) | Recognition dictionary creation apparatus and method for creating recognition dictionary by the same | |
| CN207965958U (en) | The automatic accounting device in dining room based on image recognition | |
| CN105868756A (en) | Gas meter counter direct reading system and direct reading method by applying digital image recognition technology | |
| JP2010218016A (en) | Registration method for model data for optical recognition processing, and optical sensor | |
| CN103124949A (en) | Input method, input system and input device of vision directing type mouse using monocular camera calibration technique | |
| CN109341427A (en) | A kind of laser gun target system | |
| US20170032349A1 (en) | Information processing apparatus | |
| CN112596606A (en) | Shadowless lamp control system, control method and radar-based gesture control shadowless lamp | |
| US10354242B2 (en) | Scanner gesture recognition | |
| US20220414644A1 (en) | Cashless payment system and information terminal | |
| US20100257063A1 (en) | Information gathering and decoding apparatus and method of use | |
| CN210244529U (en) | Give birth to bright self-service selling device | |
| CN108896552A (en) | Disease automatic checkout system in bridge chamber | |
| CN107742383B (en) | Automatic settlement system and method based on smooth surface imaging | |
| CN114235122A (en) | Weighing settlement method and system of electronic scale based on AI image recognition | |
| JP6841352B2 (en) | Product registration device, control method, and program | |
| CN114757218A (en) | Bar information identification method, device, equipment and medium | |
| JP6484603B2 (en) | Information processing apparatus, system, information processing method, and program | |
| JP2022014793A (en) | Information processing device, information processing method, and program | |
| JP2021056992A (en) | Registration method of back-end commodity of self-checkout system | |
| CN111238364A (en) | Three-dimensional size measuring device for logistics package |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190101 |
|
| RJ01 | Rejection of invention patent application after publication |