TWI621076B - Billing management system - Google Patents

Abstract

A checkout management system comprising: an image capturing component for capturing an object and generating an image data; a database for storing image data of one of the corresponding objects and an identification data; a checkout unit, the checkout The unit performs a collection procedure; and a processor electrically connected to the imaging component, the database, and the checkout unit, and the identification module of the processor identifies the object in the camera data Corresponding to the image data, and outputting the identification data of the corresponding object to the checkout unit according to the image data, thereby improving the checkout management performance.

Description

Checkout management system

The present invention relates to a checkout management system, and more particularly to a checkout management system for checking checkout contents with image recognition results.

Good management contributes to the improvement of profitability, which is well known to every operator. Only by carefully examining the links and discovering the mistakes in time can the business of the business be on the right track and the overall revenue will be booming.

Taking the checkout management of the store as an example, in the case where the checkout area needs to rely on the manpower to perform the checkout operation, the operator usually sets a monitor to shoot the checkout area every move, through the monitor screen, the operator not only Can understand the working status of the employees in the checkout area, and can check the checkout situation of the goods in the checkout area. However, when the checkout operation is performed by manpower, it is always inevitable that the amount of the checkout is misplaced due to the employee's intention. When the operator cannot keep an eye on the monitor screen at any time, he often misses the moment when the checkout error occurs. When the checkout error was discovered afterwards, the remedy that was too late was often in vain. The above-mentioned problem of poor management performance was not because of the lack of an effective checkout management system.

In view of this, 遂 provides a checkout management system to solve the problem of poor checkout management performance caused by the lack of a checkout management system.

It is an object of the present invention to provide a checkout management system that can perform a payment process or check checkout content through image recognition or image analysis, and has the effect of improving checkout management performance.

In order to achieve the foregoing object, the checkout management system of the present invention comprises: an image capturing component for capturing an object and generating an image data; a database for storing image data of one of the corresponding objects and an identification data; a checkout unit, the checkout unit executes a collection procedure; and a processor electrically connected to the camera component, the database, and the checkout unit to receive or read the camera data, the image And the identification data, the identification module of the processor identifies the image data corresponding to the object in the camera data, and outputs the identification data corresponding to the object to the checkout unit according to the image data, The checkout unit executes the payment procedure by using the identification data as a collection reference data; wherein the checkout unit has a checkout judgment module, and the checkout judgment module executes a checkout judgment program, the knot The account determination program generates a checkout data according to the amount actually charged by the payment program, and the processor receives the checkout data, the processor has a judgment module, and the judgment module Performing a determining process to determine whether the content of the checkout data matches the content of the identification data output by the identification module, and if the judgment is consistent, the determining module of the processor outputs a first driving signal, if If the judgment is not consistent, the determining module of the processor outputs a second driving signal; a contact switch controller electrically connected to the processor to receive the first driving signal and the second a driving signal, the contact switch controller respectively actuating different switching elements when receiving the first driving signal and the second driving signal; and a video device electrically connected to the contact switch controller This has the effect of improving the efficiency of checkout management.

The checkout unit further has a sensor for sensing a tag of the object to generate a sensing data, the processor receives the sensing data, and the determining module of the processor executes an auxiliary determining program And determining whether the content of the sensing data matches the content of the identification data output by the identification module, and if the determination is consistent, the determining module of the processor outputs the first driving signal, and if the determination is not consistent, the The judging module of the processor outputs the second driving signal, thereby having the effect of improving the checkout management performance.

The display device is electrically connected to the processor, and the superimposed module of the processor executes an image processing program, and the identification data and the checkout data output by the identification module are superimposed on the display. The camera data is outputted and displayed on the display, and the image data of the checkout data and the checkout data are superimposed and displayed on the display, thereby improving the checkout management performance.

The display device is electrically connected to the processor. The superimposed module of the processor performs an image processing program, superimposes the sensing data on the image data, and superimposes the sensing data. The camera data is output and displayed on the display, thereby improving the performance of the checkout management.

The display device is electrically connected to the processor. The superimposed module of the processor is configured to execute an image processing program, and the identification data, the checkout data and the sensing output by the identification module are The data is superimposed on the camera data, and the camera data superimposed with the identification data, the checkout data and the sensor data is outputted and displayed on the display, thereby having the effect of improving the checkout management performance.

The identification data is a text, a symbol or an image message corresponding to the object, thereby improving the performance of the checkout management.

The checkout information is a text, symbol or image message corresponding to the amount actually charged by the payment process, thereby improving the checkout management performance.

The sensing data is a text, symbol or image message corresponding to the object, thereby improving the performance of the checkout management.

〔this invention〕

1‧‧‧Photographic components

2‧‧‧Database

3‧‧‧Checkout unit

31‧‧‧Checkout Judgment Module

32‧‧‧ sensor

4‧‧‧ processor

41‧‧‧ Identification Module

42‧‧‧Judgement module

43‧‧‧Overlay module

5‧‧‧Contact switch controller

6‧‧‧ display

Figure 1: Block diagram of the checkout management system of the present invention.

The above and other objects, features and advantages of the present invention are made more apparent. It is to be understood that the following detailed description of the preferred embodiments of the invention The term "object" as used throughout the text of the present invention refers to any entity having an entity, such as a physical commodity to be settled.

Referring to FIG. 1 , the checkout management system of the present invention includes an image pickup component 1, a database 2, a checkout unit 3, and a processor 4, and the processor 4 is electrically connected to the image pickup device 1. Database 2 and the checkout unit 3.

The imaging element 1 is used to capture an object and generate an image data. The image pickup device 1 can be a camera or a monitor, and the image pickup device 1 can capture the surface of the object as the image data. In addition, in the embodiment, the image pickup device 1 captures an object and generates an image data. However, the image pickup device 1 can perform a plurality of shooting operations to generate a plurality of image data, or simultaneously in one shooting operation. Take several objects as a camera data, and do not set limits here.

The database 2 is used for storing image data of one of the corresponding objects and an identification data. The database 2 can be any storage module for storing electronic data.

More specifically, when the database 2 is created, a plan view or a six-sided view or a N-side view of the object may be taken by any image capturing device as the image data of the object, and The image data, the user may also establish the corresponding identification data, and the identification data may be a text, symbol or image message corresponding to the object. For example, if the object is a canned beverage, the image data may be a six-sided view of the canned beverage, and the identification information may be the name, price or specification of the canned beverage, etc., so that the identification data can be As a collection reference.

The checkout unit 3 performs a collection procedure. The checkout unit 3 can be any unit with a collection function, and is not limited to whether it is a human operation or an automatic operation, such as a cash register, a credit card machine or a debiting unit having an identity recognition function, and the above unit can also be The cloud unit, wherein the checkout unit 3 is the cash register, the credit card machine or has the identity recognition function The operation mode of the capable deduction unit will be described together with the following description of the operation mode of the processor 4.

The processor 4 is electrically connected to the imaging device 1, the database 2, and the checkout unit 3 to receive or read the image data, the image data and the identification data, and the identification module 41 of the processor 4 Identifying the image data corresponding to the object in the camera data, and outputting the identification material corresponding to the object (for example, the name, price or specification of the canned beverage, etc.) to the checkout unit 3 according to the image data The checkout unit 3 executes the collection procedure with the identification information (for example, the name, price or specification of the canned beverage, etc.) as the receipt reference material. The processor 4 can be a computer or any computing processor as a whole, and can execute a software or a program for performing image processing or data identification. When the image is searched for in the database 2, the identification module 41 preferably determines the image based on the similarity of the image. For example, the identification module 41 can determine the object in the image data and the image. The similarity between the objects in the image data is high, and when the similarity between the object in the image data and the object in the image data is high (for example, when the similarity interval is 0% to 100%, the similarity exceeds 90% It is a high degree of similarity, that is, it is determined that the identification is consistent, and the identification data corresponding to the object is output accordingly (or the identification module 41 can also perform the above data transmission operation when the similarity exceeds 90%, and the similarity exceeds In addition, a similar image recognition method can be applied to this, and the present invention is not limited thereto.

For example, when the image recognition technology is mature, the operator can directly perform the checkout operation through the image pickup device 1, the database 2, the checkout unit 3, and the processor 4, for example, the processor 4 receives the image pickup device. After the camera data is captured, the identification module 41 can search and output the identification data (for example, the name, price or specification of the canned beverage) in the database 2, and the identification data can be As the reference for the collection, the collection reference material is directly used as the basis for collecting the money from the customer (before the payment), and the amount actually charged to the customer (after the payment is received) is determined. For example, when the checkout unit 3 is a cash register, the checkout unit 3 In the process of executing the payment procedure, the device having the cash sensing function can be used to determine the actually collected amount; when the checkout unit 3 is the card swiping machine, the checkout unit 3 can execute the collection procedure. In the process, the amount charged by the device having the remote payment function is determined by the actual registration; or when the checkout unit 3 is the debiting unit having the identity recognition function, the checkout unit 3 can perform the collection. During the process, the debit is performed in the corresponding account according to the result of the identity identification and the actual amount is determined (for example, when the checkout unit 3 recognizes the identity of the customer, the checkout unit 3 can be connected to A financial center in which the account established by the customer is debited). Thereby, the checkout management system of the present invention can directly execute the payment program according to the image data captured by the image pickup device 1, and has the effect of improving the checkout management performance.

Furthermore, when the image recognition technology is not yet mature, the checkout unit 3 and the process 4 can also improve the checkout management performance through different operation modes. The checkout unit 3 and the processor 4 are included in the following. The module and its way of acting.

Referring to FIG. 1 again, the checkout unit 3 has a checkout judging module 31 for executing a checkout judging program, and the checkout judging program is based on the payout program. The amount actually collected generates a checkout profile.

Moreover, the checkout unit 3 can further have a sensor 32 for sensing a tag of the object to generate a sensing material. The sensor 32 can be any sensing device for sensing the identity identification label, and the label of the object can be a barcode, a QR code, a pattern or an identity identification label having a similar function, and the sensing data is a text corresponding to the object. , symbol or image message (for example, when the object is a canned beverage, the sensing material can be the name, price or specification of the canned beverage, etc.), and the sensing data can be stored in the sensor 32. In a data storage area, or stored in an external database, and the external database is available for reading by the sensor 32. The checkout unit 3 having the sensor 32 can be a point of sale (POS), and the point-of-sale analysis system can The data is stored in the internal computer. When the sensor 32 reads the barcode, the system can perform comparison on the internal computer according to the read barcode to retrieve relevant information, and the sales point analysis system can The computer-based or non-computer-based, non-computer-based point-of-sale analysis system has a memory function through a programmable control chip, which is well known to those skilled in the art and will not be described again.

The processor 4 can further receive the checkout data, and the processor 4 can determine the module 42 based on the processor 4, the database 2, and the checkout unit 3. Performing a determining process to determine whether the content of the checkout data matches the content of the identification data output by the identification module 41. If the determination is consistent, the determining module 42 of the processor 4 continues to execute the determining program. And the first driving signal is outputted. If the determination is not consistent, the determining module 42 of the processor 4 outputs a second driving signal.

For example, when the image capturing device 1 captures the canned beverage to generate the image data, the processor 4 can receive the image data, and search the database 2 for the canned beverage in the camera data. The image data (for example, an image or a picture in a plurality of directions of the canned beverage), when the processor 4 has successfully recognized the image data corresponding to the canned beverage in the image data (eg, similarity) More than 90%), the identification data corresponding to the image data (for example, the name, price or specification of the canned beverage, etc.) can be retrieved and output. At this time, the checkout judging module 31 may execute the checkout judging program, and the checkout judging program generates the billing information according to the amount actually charged by the billing program (the billing data may represent the payback program) The processor 4 can receive the checkout data, and the judgment module 42 compares the content of the checkout data with the content of the identification data output by the identification module 41, and Judging that the match (for example, the amount actually charged by the collection procedure is the same as the selling price of the canned beverage) does not match (for example, the amount actually charged by the collection procedure does not correspond to the selling price of the canned beverage) The first driving signal and the second driving signal are output to actuate one of the associated controlled electronic devices to operate in different manners. Taking this photo The image data captured by the component 1 can be used for the image recognition operation by the recognition module 41 of the processor 4, so that the identification module 41 of the processor 4 can further identify the type and price of the object, and pass the determination mode. The group 42 judges whether the amount charged and the selling price of the object match, and has the effect of improving the checkout management performance.

Alternatively, on the basis that the checkout unit 3 further has the sensor 32, when the object is the canned beverage, the canned beverage may have a unique label for identifying the identity, and the sensing material may be The name, price or specification of the canned beverage, etc., when the sensor 32 senses the label of the canned beverage, the sensor information can be searched for and generated according to the label (for example, the name, price or the price of the canned beverage) specification). At this time, the processor 4 can receive the sensing data, and then the determining module 42 executes an auxiliary determining program to determine whether the sensing data matches the content of the identification data output by the identification module 41. Corresponding (for example, the object name, the selling price or the same specification), the determining module 42 of the processor 4 continuously executes the auxiliary determining program, and can output the first driving signal, and when the judgment is not matched (for example, the object name) The price or the specification does not correspond to) outputting the second driving signal to actuate the associated controlled electronic device to operate in different manners. Thereby, the image data captured by the image sensor 1 can be used by the recognition module 41 of the processor 4 to perform image recognition operations, so that the identification module 41 of the processor 4 can further identify the name, price or specification of the object. And determining, by the determining module 42 whether the sensing data matches the name, the selling price or the specification of the object, and has the effect of improving the checkout management performance.

In addition, the checkout management system of the present invention may further include a contact switch controller 5 electrically connected to the processor 4 to receive the first drive signal and the second drive signal. The point switch controller 5 is configured to respectively activate different switching elements when receiving the first driving signal and the second driving signal. The switch controller 5 can include a plurality of switching components and a control unit, and the control unit can respectively activate different switching components when receiving the first driving signal and the second driving signal, and the connecting component Point switch controller 5 Any controlled electronic device can be electrically connected, and the controlled electronic device can be an alarm device, a video device, or an electronic device having a specific function, which is not limited herein.

In more detail, the contact switch controller 5 is further electrically connected to a warning device, and the determining module 42 determines the content of the checkout data and the content of the identification data output by the identification module 41. The judging module 42 (for example, if the amount actually charged by the collection procedure is the same as the selling price of the item) does not match (for example, the amount actually charged by the collection procedure does not correspond to the selling price of the item), the judging module 42 Outputting the first driving signal and the second driving signal respectively to activate the contact switch controller 5, and controlling the warning device to issue different warning messages through the contact switch controller 5; or, when the determining module 42: determining that the content of the sensing data matches the content of the identification data output by the identification module 41 (for example, the object name, the selling price, or the specification are the same) and does not match (for example, the object name, the selling price, or the specification does not correspond) The determining module 42 outputs the first driving signal and the second driving signal respectively to activate the contact switch controller 5, and controls the warning device to issue different warning messages through the contact switch controller 5. Therefore, the determining module 42 can determine whether the collected amount matches the selling price of the object, or determine whether the object photographed by the image capturing device 1 matches the object sensed by the sensor 32, and matches or not When the match is reached, the alert switch controller 5 controls the alerter to issue different warning messages to remind the user to pay attention to the checkout process, thereby helping the user to accurately determine the flow of the article, and has the effect of improving the checkout management performance.

Alternatively, the connection switch controller 5 is electrically connected to a video device as an example, and the determining module 42 determines that the content of the checkout data matches the content of the identification data output by the identification module 41 (for example, The amount actually received by the collection procedure is the same as the selling price of the item. If the amount does not match (for example, the amount actually charged by the collection procedure does not correspond to the selling price of the item), the determining module 42 outputs separately. The first driving signal and the second driving signal actuate the contact switch controller 5, and control the video recording device not to perform a recording process or a video recording program through the contact switch controller 5; or, when the determining module 42 judge the feeling The content of the information corresponds to the content of the identification data output by the identification module 41 (for example, the object name, the selling price or the specification are the same) and does not match (for example, the object name, the selling price or the specification does not correspond), the judgment The module 42 outputs the first driving signal and the second driving signal respectively to activate the contact switch controller 5, and controls the video recording device to perform no video recording process or perform a video recording program through the contact switch controller 5 or The special planning video device is triggered, for example, generating a warning through the cloud, triggering a segment recording function, or recording an event occurrence time point, and the above operation may be a remote operation or a direct operation on the field side. Therefore, the determining module 42 can determine whether the collected amount matches the selling price of the object, or determine whether the object photographed by the image capturing device 1 matches the object sensed by the sensor 32, and matches or not In the case of coincidence, the video switch device is controlled by the contact switch controller 5 not to perform a recording process or to execute a video recording program or to trigger a special planning recording device, so that the video recording device records the image data generated by the image capturing device 1 to Help users to accurately determine the flow of objects, with the effect of improving the efficiency of checkout management. The video recording device can be any video recording unit, such as a Digital Video Recorder (DVR), a Network Video Recorder (NVR), or a video processing chip, and is not limited herein. In addition, the contact switch controller 5 can be electrically connected to a single device in addition to a single device. When the contact switch controller 5 is electrically connected to several devices, the contact switch controller 5, when receiving the first driving signal and the second driving signal, respectively, actuating different ones of the plurality of devices, and the actuation principle may be as described above, and details are not described herein again.

Furthermore, the checkout management system of the present invention may further comprise a display 6, and the processor 4 may further have a stacking module 43. The display module 6 is electrically connected to the processor 4, and the overlay module 43 of the processor 4 executes an image processing program, and the identification data and the checkout data outputted by the identification module 41 are superimposed on the image data. And outputting the image data of the identification data and the checkout data to the display 6.

In more detail, when the identification module 41 has identified the camera data and After outputting the identification data, the overlay module 43 can simultaneously read the camera data, the checkout data and the identification data, and process the identification information of the text, symbol or image message and the checkout data by image processing. Superimposed on the camera data, and outputting and displaying the camera data that has been superimposed on the identification data and the checkout data on the display 6, so that the display device 6 can simultaneously display the camera data, the checkout data, and the identification The identification data generated by the module 41 is recognized by the image processing program. The image processing program can superimpose text or images through a dot matrix or a picture, which is well known to those skilled in the art and will not be described herein. The user can view the image data captured by the image sensor 1 through the display 6, view the amount actually collected by the checkout unit 3, and view the identification data generated by the identification module 41. In order to facilitate the user to directly compare the camera data, the checkout data and the identification data directly to the display 6, the effect of improving the checkout management performance is enhanced.

Alternatively, in the checkout management system of the present invention having the display 6, and the checkout unit 3 has the sensor 32, the superimposing module 43 of the processor 4 transmits the sensing data through an image processing program. The image data is superimposed on the image data, and the image data on which the sensor data is superimposed is outputted and displayed on the display 6.

In more detail, when the sensor 32 senses the label of the object and outputs the sensing data, the overlay module 43 can simultaneously read the camera data and the sensing data, and display the text, symbol or image information. The sensing data is superimposed on the camera data by image processing, and the camera data superimposed with the sensing data is outputted and displayed on the display 6. Therefore, the user can simultaneously view the image data captured by the image sensor 1 through the display 6 and view the sensing data sensed by the sensor 32 to facilitate the user to directly compare the image data to the display 6 . And induction data, with the effect of improving the efficiency of checkout management.

Alternatively, in the checkout management system of the present invention having the display 6, and the checkout unit 3 has the sensor 32, the overlay module 43 of the processor 4 is transmitted through the image processing program, and the recognition module is The identification data output by the group 41, the settlement information And the sensing data is superimposed on the image data, and the image data that has been superimposed on the identification data, the settlement data and the sensing data is outputted and displayed on the display 6.

More specifically, when the identification module 41 has identified the captured data and outputs the identification data, and after the checkout unit 3 outputs the checkout data and the sensing data, the overlay module 43 can simultaneously Or reading the camera data, the identification data, the checkout data and the sensor data at the same time, and superimposing the identification information, the checkout data and the sensory data of the text, symbol or image message in the image processing manner. The image data of the identification data, the settlement data and the sensing data are outputted and displayed on the display 6. Thereby, the user can view the image data captured by the image pickup device 1 through the display 6, and view the amount actually collected by the checkout unit 3, and view the identification generated by the identification module 41. The identification data and the sensing data sensed by the sensor 32 are provided to facilitate the user to directly compare the camera data, the identification data, the checkout data and the sensing data directly to the display 6, and the effect of improving the checkout management performance is improved.

In summary, the checkout management system of the present invention can perform image recognition through the processor 4, and execute the payment program or check the checkout content according to the result of the image recognition, thereby improving the checkout management performance.

While the invention has been described in connection with the preferred embodiments described above, it is not intended to limit the scope of the invention. The technical scope of the invention is protected, and therefore the scope of the invention is defined by the scope of the appended claims.

Claims (8)

A checkout management system comprising: an image capturing component for capturing an object and generating an image data; a database for storing image data of one of the corresponding objects and an identification data; a checkout unit, the checkout The unit performs a collection procedure; a processor electrically connecting the camera element, the database, and the checkout unit to receive or read the camera data, the image data, and the identification data, the process The identification module identifies the image data corresponding to the object in the camera data, and outputs the identification data of the corresponding object to the checkout unit according to the image data, wherein the checkout unit uses the identification data Performing the collection procedure as a collection reference; wherein the checkout unit has a checkout determination module, and the checkout judgment module executes a checkout determination program, and the checkout judgment program is based on the receipt The amount actually collected by the program generates a checkout data, the processor receives the checkout data, the processor has a judgment module, and the judgment module executes a judgment program to determine The content of the checkout data is consistent with the content of the identification data output by the identification module. If the judgment is consistent, the judgment module of the processor outputs a first driving signal, and if the judgment does not match, the processor The determining module outputs a second driving signal; a contact switch controller electrically connected to the processor to receive the first driving signal and the second driving signal, the contact switch control When receiving the first driving signal and the second driving signal, respectively, respectively, actuating different switching elements; and a video recording device electrically connected to the contact switch controller. The billing management system of claim 1, wherein the checkout unit further has a sensor, the sensor is configured to sense a label of the object to generate a sensing data, and the processor receives the sensing data. The determining module of the processor executes an auxiliary determining program to determine whether the content of the sensing data and the content of the identification data output by the identification module are If the judgment is consistent, the determining module of the processor outputs the first driving signal, and if the determination is not consistent, the determining module of the processor outputs the second driving signal. The billing management system of claim 1, further comprising a display electrically connected to the processor, wherein the superimposed module of the processor executes an image processing program, and the identification module is The identification data and the checkout data outputted are superimposed on the image data, and the image data superimposed with the identification data and the checkout data is outputted and displayed on the display. The billing management system of claim 2, further comprising a display electrically connected to the processor, wherein the superimposing module of the processor performs an image processing program to superimpose the sensing data And capturing the image data of the sensor data and displaying the image data on the display. The billing management system of claim 2, further comprising a display electrically connected to the processor, wherein the superimposed module of the processor executes an image processing program, and the identification module is The identification data, the checkout data and the sensing data that are output are superimposed on the image data, and the image data that has been superimposed on the identification data, the checkout data and the sensing data is outputted and displayed on the display. The settlement management system of claim 1, wherein the identification data is a text, symbol or image message corresponding to the object. The settlement management system of claim 1, wherein the settlement information is a text, symbol or image message corresponding to the amount actually charged by the collection procedure. The billing management system of claim 2, wherein the sensing data is a text, symbol or image message corresponding to the object.