CN117133088B - Intelligent cashier system based on mobile terminal - Google Patents

Intelligent cashier system based on mobile terminal Download PDF

Info

Publication number
CN117133088B
CN117133088B CN202311401105.3A CN202311401105A CN117133088B CN 117133088 B CN117133088 B CN 117133088B CN 202311401105 A CN202311401105 A CN 202311401105A CN 117133088 B CN117133088 B CN 117133088B
Authority
CN
China
Prior art keywords
information
unit
commodity
price
identification
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202311401105.3A
Other languages
Chinese (zh)
Other versions
CN117133088A (en
Inventor
李忠文
刘静
巢传辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Aerfeng Technology Co ltd
Original Assignee
Shenzhen Aerfeng Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Aerfeng Technology Co ltd filed Critical Shenzhen Aerfeng Technology Co ltd
Priority to CN202311401105.3A priority Critical patent/CN117133088B/en
Publication of CN117133088A publication Critical patent/CN117133088A/en
Application granted granted Critical
Publication of CN117133088B publication Critical patent/CN117133088B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00—Cash registers
    • G07G1/0036—Checkout procedures
    • G07G1/0045—Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/08—Payment architectures
    • G06Q20/12—Payment architectures specially adapted for electronic shopping systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/08—Payment architectures
    • G06Q20/20—Point-of-sale [POS] network systems
    • G06Q20/201—Price look-up processing, e.g. updating
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/08—Payment architectures
    • G06Q20/20—Point-of-sale [POS] network systems
    • G06Q20/208—Input by product or record sensing, e.g. weighing or scanner processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/08—Payment architectures
    • G06Q20/20—Point-of-sale [POS] network systems
    • G06Q20/209—Specified transaction journal output feature, e.g. printed receipt or voice output
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/30—Payment architectures, schemes or protocols characterised by the use of specific devices or networks
    • G06Q20/32—Payment architectures, schemes or protocols characterised by the use of specific devices or networks using wireless devices
    • G06Q20/326—Payment applications installed on the mobile devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0283—Price estimation or determination
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/04—Billing or invoicing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0633—Lists, e.g. purchase orders, compilation or processing
    • G06Q30/0635—Processing of requisition or of purchase orders
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Shopping interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/96—Management of image or video recognition tasks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00—Cash registers
    • G07G1/01—Details for indicating
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00—Cash registers
    • G07G1/12—Cash registers electronically operated

Abstract

The invention discloses an intelligent cashing system based on a mobile terminal, which relates to the technical field of intelligent cashing, wherein a merchant needs to transmit information of various commodities in a store to a database and an online shopping program, so that queuing waiting and complicated checkout processes in traditional shopping are avoided, and the operation cost of the merchant and the utilization rate of human resources are reduced; the image-text acquisition module can capture entity pictures, labels and bar codes of commodities, so that customers can conveniently present wanted commodities to a list in an online shopping program, and the wanted commodities can be counted in the selection process; the method comprises the steps of extracting features of entity pictures, labels and bar codes shot by customers through an information identification module, matching the extracted data information with commodity information in a background database, acquiring commodity names and prices, presenting the commodity names and prices to a mobile terminal of the customers, and identifying degree indexes through a management moduleAnd presetAnd (5) identifying a threshold Q, comparing and analyzing, and generating a management scheme.

Description

Intelligent cashier system based on mobile terminal
Technical Field
The invention relates to the technical field of intelligent cashing, in particular to an intelligent cashing system based on a mobile terminal.
Background
In the current digital age, consumers find more convenient and efficient shopping modes in various fields. With the rapid development of mobile terminal technology, a mobile terminal-based intelligent cashing system is becoming an innovative field of great interest, and mobile cashing systems refer to software and hardware systems capable of cashing operation on mobile devices, such as smart phones, tablet computers, mobile application programs and the like, so that mobile cashing systems are becoming popular.
With the popularization of smart phones, tablet computers and mobile application programs, modern consumers are used to the convenience of online shopping, wanted commodities can be directly sent to home by a dispatcher without going to a business, but sometimes the sent commodities are different from those shown in online pictures, or the phenomenon that the dispatched commodities are extruded and damaged in the dispatching process can not reach the commodity shape wanted by customers, so that the customers sometimes get to purchase the commodities on site, but in the on-site purchasing process, the phenomenon of queuing and paying for a long time can not be avoided in the peak period of a cash receiving area.
Disclosure of Invention
(one) solving the technical problems
Aiming at the defects of the prior art, the invention provides an intelligent cashing system based on a mobile terminal, which solves the problems in the background art.
(II) technical scheme
In order to achieve the above purpose, the invention is realized by the following technical scheme: an intelligent cashing system based on a mobile terminal comprises a database module, a login and registration module, an image-text acquisition module, an information identification module, an intelligent diagnosis module and a management module;
the database module is used for correspondingly inputting the package information and the price information of the commodities in the store into the background operation system, collecting the package information and the price information into a database and finally distributing the package information and the price information into the online shopping program of the exclusive store;
the login registration module is used for registering and logging in an online shopping program in a store through a mobile terminal used by a customer so as to purchase goods subsequently;
the image-text acquisition module is used for carrying out entity shooting, tag shooting and bar code scanning on the commodity to be purchased, and transmitting a shooting result and a scanning result to the information identification module, wherein the entity shooting mark is a first data set, and the tag shooting and the bar code scanning mark is a second data set;
the information identification module is used for identifying and extracting features of the first data set and the second data set, and rapidly matching the first data set and the second data set with package information and goods price information of goods in the database to determine the names and the prices of the goods, so that the information identification module is obtained: commodity identification unit priceTag identification unit priceAnd bar code identification unit price；
The intelligent diagnosis module is used for displaying and displaying the matched commodity information, analyzing and calculating the shooting result and the code scanning result of the customer, and obtaining: degree of identification indexThe recognition degree indexObtained by the following formula:
，
in the method, in the process of the invention,represented as a commodity identification coefficient,represented as a tag identification coefficient,represented as a loading duration of time,andrespectively expressed as commodity identification coefficientsTag identification coefficientAnd loading durationIs used for the weight value of (a),expressed as correction coefficients;
the commodity identification coefficientThe first data set or the second data set is used for calculation and acquisition;
the tag identification coefficientThe first data set or the second data set is used for calculation and acquisition;
the loading time lengthCalculating and acquiring through the identified first data set or second data set;
the management module is used for counting all commodities purchased by customers and comprehensively calculating the total price of the purchaseAt the same time the system will index the degree of recognitionAnd comparing and analyzing with a preset recognition threshold Q to obtain a management scheme.
Preferably, the database module comprises a packaging unit and a goods price unit;
the packaging unit is used for collecting appearance characteristics of various commodities, including names, brand marks, trademarks, packaging shapes, colors, patterns or positions of pictures and texts, attractive marketing slogans or propaganda languages and bar codes or QR codes of the commodities, and transmitting the appearance characteristics to the database;
the goods price unit is used for collecting price labels, discounts or particularly preferential price information of goods and transmitting the price information to the database.
Preferably, the login and registration module comprises a registration unit and a registration unit;
the registration unit is used for enabling new customers to create shopping accounts of the customers, wherein the shopping accounts comprise user names, login passwords and settings of personalized preferences, the personalized preferences comprise settings of notification preferences, currency, language and prepaid total, and shopping histories and order information of the customers are associated with the accounts of the customers;
the registering unit is used for enabling registered customers to log in the shopping program by using account passwords of the registered customers, and after the registered customers log in, the customers can access the shopping cart at any time.
Preferably, the image-text acquisition module comprises a scanning unit, an entity shooting unit and a label shooting unit;
the scanning unit is used for scanning through the bar code on the commodity outer package by the customer, presenting the commodity to be purchased in the list of the online shopping program, and transmitting the commodity to the information identification module;
the entity shooting unit is used for collecting and recording the commodities which are wanted by customers to shoot in entity, and simultaneously aiming the commodities at the shooting frame, at least two pictures are needed to be shot, and finally the pictures are transmitted to the information identification module;
the tag shooting unit is used for shooting or scanning tags or other identifiers on commodities by customers, and collecting and recording the tags or other identifiers to the information identification module.
Preferably, the information identification module comprises a feature extraction unit and a matching unit;
the feature extraction unit is used for identifying text information, label information and identification bar codes or two-dimensional codes in the images to obtain related data information so as to extract the number of pictures shot by customers, shooting angles, saturation of commodity colors, trademark size, shooting inclination and picture-text size in the pictures from the data information;
the matching unit is used for quickly matching the extracted data information to corresponding commodities in the database and displaying commodity names, prices, weights, models and production dates.
Preferably, the algorithm model training and analysis is performed by a computer system to obtain: commodity identification coefficientAnd tag identification coefficientAnd the commodity identification coefficient is calculatedAnd tag identification coefficientCorrelating, obtaining the recognition degree indexThe commodity identification coefficientObtained by the following formula:
，
in the method, in the process of the invention,expressed as the number of pictures in a picture,represented as a trade mark area and,represented by the relative dimensions of the two,denoted as saturation level,represented as an identification angle (a) and,andrespectively expressed as the number of picturesTrademark areaRelative dimensionsSaturation degreeAnd identifying an angleWeight value of (2);
wherein,，，，，，，represented as correction coefficients.
Preferably, the tag identification coefficientObtained by the following formula:
，
in the method, in the process of the invention,represented by the word size of the word,denoted as the inclination of the surface of the substrate,represented as word sizeIs used for the weight value of (a),expressed as inclinationIs a weight value of (a).
Preferably, the management module includes a totaling unit;
the total unit is used for quickly calculating the price of the commodity which is ready to be purchased and paid by the customer, and comprises the commodity identification unit price acquired by the matching unitLabel(s)Identifying unit priceBar code identification unit priceAnd by identifying the commodity as a unit priceTag identification unit priceAnd bar code identification unit priceCorrelating to obtain the total purchase priceThe purchase total priceObtained by the following formula:
，
customer calculates total purchase price by systemChecking, checking and settling payment at any time, acquiring an electronic shopping receipt list and a check code, and registering and summarizing the received money by a background system.
Preferably, the management module further comprises a threshold comparison unit;
the threshold value comparison unit is used for indexing the recognition degreeComparing and analyzing with a preset recognition threshold Q to obtain a management scheme: if the recognition degree indexAbove the pre-determined levelWhen the recognition threshold Q is set, i.e.>When Q, the related data result obtained for the current image through scanning, entity shooting or tag shooting reaches the preset recognition degree; if the recognition degree indexWhen the recognition threshold Q is lower than the preset recognition threshold Q, namely<At Q, the relevant data obtained for the current image captured by scanning, entity shooting or tag shooting can be matched by a plurality of commodity information in the database, but the matching is too slow or the loading is overtime.
Preferably, the goods checking code is used for a shop staff to quickly find the customers needing ticket checking in the crowd and check all the goods purchased by the customers; the electronic shopping receipt list is used for the customer to check the information of the purchased goods at any time.
(III) beneficial effects
The invention provides an intelligent cashing system based on a mobile terminal. The beneficial effects are as follows:
(1) According to the intelligent cashing system based on the mobile terminal, firstly, a merchant needs to transmit information of various commodities in a store to a database and an online shopping program, so that queuing waiting and a complicated checkout process in traditional shopping are avoided, and the operation cost and the utilization rate of human resources of the merchant are reduced; the image-text acquisition module can capture entity pictures, labels and bar codes of commodities, so that customers can conveniently present wanted commodities to a list in an online shopping program, and the wanted commodities can be counted in the selection process; the method comprises the steps that an information identification module is used for carrying out feature extraction on entity pictures, labels and bar codes shot by customers, so that extracted data information is matched with commodity information in a background database, commodity names and prices are obtained, and the commodity names and the commodity prices are presented to a mobile terminal of the customers; meanwhile, the intelligent diagnosis module divides by calculationAnd (3) obtaining by analysis: degree of identification indexThe shopping process is evaluated, and factors such as commodity identification, label identification and loading time are comprehensively considered, so that the merchant can know the identification intensity of the commodity in the store in the customer shooting process and the experience of the customer shopping process; the recognition degree index is transmitted through the management moduleAnd comparing and analyzing with a preset recognition threshold Q to generate a management scheme.
(2) The intelligent cashing system based on the mobile terminal performs algorithm model training and analysis according to a computer system, obtains corresponding data information, and automatically calculates the purchase total price purchased by a customer through a total unit in a management moduleComprising commodity identification unit priceTag identification unit priceAnd bar code identification unit priceThis reduces the customer's effort to calculate the total price, improving the speed and accuracy of settlement; at the same time, the customer is able to obtain an electronic shopping receipt list and a check code, which provides a convenient shopping record and check flow.
(3) According to the intelligent cash register system based on the mobile terminal, the threshold value comparison unit is used for comparing the threshold value with the identification degree indexProviding feedback and advice to the customer to improve the user experience while also improving the performance of the system, which can be achieved by encouraging the user to take better shots.
Drawings
Fig. 1 is a block flow diagram of an intelligent cashing system based on a mobile terminal.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In the current digital age, consumers find more convenient and efficient shopping modes in various fields. With the rapid development of mobile terminal technology, a mobile terminal-based intelligent cashing system is becoming an innovative field of great interest, and mobile cashing systems refer to software and hardware systems capable of cashing operation on mobile devices, such as smart phones, tablet computers, mobile application programs and the like, so that mobile cashing systems are becoming popular.
With the popularization of smart phones, tablet computers and mobile application programs, modern consumers are used to the convenience of online shopping, wanted commodities can be directly sent to home by a dispatcher without going to a business, but sometimes the sent commodities are different from those shown in online pictures, or the phenomenon that the dispatched commodities are extruded and damaged in the dispatching process can not reach the commodity shape wanted by customers, so that the customers sometimes get to purchase the commodities on site, but in the on-site purchasing process, the phenomenon of queuing and paying for a long time can not be avoided in the peak period of a cash receiving area.
Example 1
Referring to fig. 1, the invention provides an intelligent cashing system based on a mobile terminal, which comprises a database module, a login registration module, an image-text acquisition module, an information identification module, an intelligent diagnosis module and a management module;
the database module is used for correspondingly inputting the package information and the price information of the commodities in the store into the background operation system, collecting the package information and the price information into a database and finally distributing the package information and the price information into the online shopping program of the exclusive store;
the login registration module is used for registering and logging in an online shopping program in a store through a mobile terminal used by a customer so as to purchase goods subsequently;
the image-text acquisition module is used for carrying out entity shooting, tag shooting and bar code scanning on the commodity to be purchased, and transmitting a shooting result and a scanning result to the information identification module, wherein the entity shooting is marked as a first data set, and the tag shooting and the bar code scanning are marked as a second data set;
the information identification module is used for identifying and extracting features of the first data set and the second data set, and rapidly matching the first data set and the second data set with package information and goods price information of goods in the database to determine the names and the prices of the goods, so that the information identification module is obtained: commodity identification unit priceTag identification unit priceAnd bar code identification unit price；
The intelligent diagnosis module is used for displaying and displaying the matched commodity information, analyzing and calculating the shooting result and the code scanning result of the customer, and obtaining: degree of identification indexDegree of identification indexObtained by the following formula:
，
in the method, in the process of the invention,represented as a commodity identification coefficient,represented as a tag identification coefficient,represented as a loading duration of time,andrespectively expressed as commodity identification coefficientsTag identification coefficientAnd loading durationIs used for the weight value of (a),expressed as correction coefficients;
commodity identification coefficientThe first data set or the second data set is used for calculation and acquisition;
tag identification coefficientThe first data set or the second data set is used for calculation and acquisition;
duration of loadingCalculating and acquiring through the identified first data set or second data set;
the management module is used for counting all commodities purchased by the customer and comprehensively calculating the total price of the purchaseAt the same time the system will index the degree of recognitionAnd comparing and analyzing with a preset recognition threshold Q to obtain a management scheme.
In the operation of the system, a customer can easily register and register through the mobile terminal, so that the online shopping program of the store can be accessed at any time, and the merchant needs to transmit information of various commodities in the store to the database and the online shopping program; the image-text acquisition module can capture entity pictures, labels and bar codes of commodities; extracting features of the entity pictures, the labels and the bar codes shot by the customers through an information identification module; meanwhile, the intelligent diagnosis module is obtained through calculation and analysis: degree of identification indexAnd the shopping process is evaluated, and factors such as commodity identification, label identification and loading time are comprehensively considered, so that the merchant can know the identification intensity of the commodity in the store in the customer shooting process and the experience of the customer shopping process.
Example 2
Referring to fig. 1, the following details are: the database module comprises a packaging unit and a goods price unit;
the packaging unit is used for collecting appearance characteristics of various commodities, including names, brand marks, trademarks, packaging shapes, colors, patterns or positions of pictures and texts, attractive marketing slogans or propaganda languages and bar codes or QR codes of the commodities, and transmitting the bar codes or QR codes to the database;
the price unit is used for collecting price label, discount or special preferential price information of the commodity and transmitting the price label, discount or special preferential price information to the database.
The login and registration module comprises a registration unit and a registration unit;
the registration unit is used for enabling new customers to create their own shopping accounts, which comprise user names, login passwords and settings of personalized preferences, which comprise settings of notification preferences, currency, language and prepaid total, by means of user authentication, to ensure that only legitimate users can access and use the application, and to associate the customer's shopping history and order information with their account, enabling them to easily track and manage orders.
The registering unit is used for enabling registered customers to log in the shopping program by using account passwords of the registered customers so as to obtain access rights; after logging in, the customer can access his shopping cart at any time.
In this embodiment, the database module is used for collecting appearance characteristics, identification information and price information of the commodity, which is helpful for carrying out systematic statistics on all the commodities sold in the store, ensuring the integrity and accuracy of the commodity information, and reducing the possibility of commodity confusion or mistakes; and the login registration module is beneficial to establishing and managing customer accounts, providing personalized shopping experience and reducing cashing congestion phenomenon in peak time.
Example 3
Referring to fig. 1, the following details are: the image-text acquisition module comprises a scanning unit, an entity shooting unit and a label shooting unit;
the scanning unit is used for scanning through the bar code on the commodity outer package by the customer, presenting the commodity to be purchased in the list of the online shopping program, and transmitting the commodity to the information identification module;
the entity shooting unit is used for collecting and recording the commodities wanted by the customers to shoot the entities, and simultaneously aiming the commodities at the shooting frame, at least two pictures are needed to be shot, and finally the pictures are transmitted to the information identification module;
the tag shooting unit is used for shooting or scanning tags or other identifiers on the commodities by customers, and collecting and recording the tags or other identifiers to the information identification module.
The information identification module comprises a feature extraction unit and a matching unit;
the feature extraction unit is used for identifying text information, label information and identification bar codes or two-dimensional codes in the images to obtain related data information so as to extract the quantity of pictures shot by customers, shooting angles, saturation of commodity colors, trademark size, shooting inclination and picture-text size in the pictures from the data information;
the matching unit is used for quickly matching the extracted data information to corresponding commodities in the database and displaying commodity names, prices, weights, models and production dates.
In this embodiment, the image acquisition module provides multiple modes to acquire commodity information, including scanning, entity shooting and tag shooting, so that customers are allowed to select the mode most suitable for the customers, and the degree of freedom of shopping is further improved; and the effective data information is extracted through the information identification module, and the extracted data information is quickly matched with corresponding commodities in the database, which means that key information such as commodity names, prices, weights, models, production dates and the like can be quickly displayed in an online shopping program of a customer, and the shopping process is accelerated.
Example 4
Referring to fig. 1, the following details are: algorithm model training and analysis are performed by a computer system to obtain: commodity identification coefficientAnd tag identification coefficientAnd the commodity identification coefficient is calculatedAnd tag identification coefficientCorrelating, obtaining the recognition degree indexCommodity identification coefficientObtained by the following formula:
，
in the method, in the process of the invention,expressed as the number of pictures in a picture,represented as a trade mark area and,represented by the relative dimensions of the two,denoted as saturation level,represented as an identification angle (a) and,andrespectively expressed as the number of picturesTrademark areaRelative dimensionsSaturation degreeAnd identifying an angleWeight value of (2);
wherein,，，，，，，represented as correction coefficients.
Wherein the number of picturesThe number of pictures taken by a customer of a commodity is expressed;
trademark areaA distributed face expressed as a trademark on a commodity in a photographed picture;
relative dimensionsThe display is expressed as the ratio of the commodity size to be displayed in the picture to the whole picture area;
saturation levelThe saturation index of commodity color in the photographed picture;
identifying an angleThe angle of the photographed commodity deviates from the front packaging angle, and the data are obtained through recognition by computer vision software or image processing software.
Tag identification coefficientObtained by the following formula:
，
in the method, in the process of the invention,represented by the word size of the word,denoted as the inclination of the surface of the substrate,represented as word sizeIs used for the weight value of (a),expressed as inclinationIs a weight value of (a).
Wherein, the word sizeThe size of handwriting on commodity packages in the photographed pictures is indicated; inclination degreeThe data are all obtained by identifying through computer vision software or image processing software.
The management module comprises a total unit;
the total unit is used for quickly calculating the price of the commodity which is ready to be purchased and paid by the customer, and comprises the commodity identification unit price collected by the matching unitTag identification unit priceBar code identification unit priceAnd by identifying the commodity as a unit priceTag identification unit priceAnd bar code identification unit priceCorrelating to obtain the total purchase priceTotal purchase priceObtained by the following formula:
，
customer calculates total purchase price by systemChecking, checking and settling payment at any time, acquiring an electronic shopping receipt list and a check code, and registering and summarizing the received money by a background system.
In this embodiment, the algorithm model training and analysis performed by the computer system will obtain: commodity identification coefficientAnd tag identification coefficientAnd automatically calculates the purchase total price purchased by the customer through the total unit in the management moduleComprising commodity identification unit priceTag identification unit priceAnd bar code identification unit priceAt the same time, the customer can obtain the electronic shopping receipt list and the goods checking code, which provides convenient shopping recording and goods checking flow, and the background system can automatically record and summarize the received amount and update the cash registered in real time.
Example 5
Referring to fig. 1, the following details are: the management module also comprises a threshold value comparison unit;
the threshold comparison unit is used for indexing the recognition degreeComparing and analyzing with a preset recognition threshold Q to obtain a management scheme: if the recognition degree indexAbove a predetermined recognition threshold Q, i.e>When Q, the related data result obtained by the current image shot by scanning, entity shooting or tag shooting reaches the preset recognition degree, and the online shopping program automatically sends feedback to the customer at the moment to inform the customer that the image recognition effect is good and encourage the customer to continue using the same shooting mode; if the recognition degree indexWhen the recognition threshold Q is lower than the preset recognition threshold Q, namely<Q, the related data obtained by scanning, entity shooting or tag shooting images can be matched with the information of a plurality of commodities in the database, but the matching is too slow or the loading is overtime, and the online shopping program provides a loading prompt to inform the customer that the system is matching the commoditiesInformation, while presenting them with estimated wait times, increases user patience.
The checking code is used for a shop staff to quickly find out the customers needing ticket checking in the crowd and check all the commodities purchased by the customers at this time; the electronic shopping ticket list is used for the customer to check the information of the purchased commodity at any time.
In this embodiment, the threshold comparison unit is used to compare the recognition degree indexProviding feedback and advice to the customer to improve the user experience while also improving the performance of the system, which can be achieved by encouraging the user to take better shots.
Examples: a medical institution introduces a medical equipment information intelligent management system based on a cloud platform, and the following is an example of the medical institution:
and (3) collecting information of pictures and texts: number of pictures3; trademark area0.2; relative dimensions4.5; saturation level7.6; identifying an angle45 degrees; word size26; inclination degree34 degrees; commodity identification unit price35.6 yuan; tag identification unit price7 yuan; bar code identification unit price70.6 yuan, loading time length4 seconds;
from the above data, the following calculations can be made:
commodity identification coefficient==4.65；
Tag identification coefficient==1.37；
Total purchase price==35.6+7+70.6=113.2；
Degree of identification index==6.52；
If the preset recognition threshold Q is 5, namely>Q, representing that the result of the related data obtained by the current image through scanning, entity shooting or tag shooting reaches the preset valueThe recognition degree, at this time, the online shopping program will automatically send feedback to the customer informing them that the image recognition effect is good, encouraging them to continue using the same shooting mode.
Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made therein without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.

Claims (10)

1. An intelligent cashier system based on a mobile terminal is characterized in that: the system comprises a database module, a login registration module, an image-text acquisition module, an information identification module, an intelligent diagnosis module and a management module;
the database module is used for correspondingly inputting the package information and the price information of the commodities in the store into the background operation system, collecting the package information and the price information into a database and finally distributing the package information and the price information into the online shopping program of the exclusive store;
the login registration module is used for registering and logging in an online shopping program in a store through a mobile terminal used by a customer so as to purchase goods subsequently;
the image-text acquisition module is used for carrying out entity shooting, tag shooting and bar code scanning on the commodity to be purchased, and transmitting a shooting result and a scanning result to the information identification module, wherein the entity shooting mark is a first data set, and the tag shooting and the bar code scanning mark is a second data set;
the information identification module is used for identifying and extracting features of the first data set and the second data set, and rapidly matching the first data set and the second data set with package information and goods price information of goods in the database to determine the names and the prices of the goods, so that the information identification module is obtained: commodity identification unit priceTag identification unit price->And bar code recognition unit price->；
The intelligent diagnosis module is used for displaying and displaying the matched commodity information, analyzing and calculating the shooting result and the code scanning result of the customer, and obtaining: degree of identification indexThe recognition degree index->Obtained by the following formula:
，
in the method, in the process of the invention,expressed as commodity identification coefficient->Expressed as tag identification coefficient, ">Represented as a loading duration of time,and->Respectively expressed as commodity identification coefficient->Tag identification coefficient->And loading duration->Weight value of->Expressed as correction coefficients;
the commodity identification coefficientThe first data set or the second data set is used for calculation and acquisition;
the tag identification coefficientThe first data set or the second data set is used for calculation and acquisition;
the loading time lengthCalculating and acquiring through the identified first data set or second data set;
the management module is used for counting all commodities purchased by customers and comprehensively calculating the total price of the purchaseAt the same time the system will index the degree of recognition +.>And comparing and analyzing with a preset recognition threshold Q to obtain a management scheme.
2. The intelligent cashier system based on the mobile terminal according to claim 1, wherein: the database module comprises a packaging unit and a goods price unit;
the packaging unit is used for collecting appearance characteristics of various commodities, including names, brand marks, trademarks, packaging shapes, colors, patterns or positions of pictures and texts, attractive marketing slogans or propaganda languages and bar codes or QR codes of the commodities, and transmitting the appearance characteristics to the database;
the goods price unit is used for collecting price labels, discounts or particularly preferential price information of goods and transmitting the price information to the database.
3. The intelligent cashier system based on the mobile terminal according to claim 2, wherein: the login and registration module comprises a registration unit and a registration unit;
the registration unit is used for enabling new customers to create shopping accounts of the customers, wherein the shopping accounts comprise user names, login passwords and settings of personalized preferences, the personalized preferences comprise settings of notification preferences, currency, language and prepaid total, and shopping histories and order information of the customers are associated with the accounts of the customers;
the registering unit is used for enabling registered customers to log in the shopping program by using account passwords, and after logging in, the customers can access the shopping cart at any time.
4. A mobile terminal based intelligent cashier system according to claim 3, characterized in that: the image-text acquisition module comprises a scanning unit, an entity shooting unit and a label shooting unit;
the scanning unit is used for scanning through the bar code on the commodity outer package by the customer, presenting the commodity to be purchased in the list of the online shopping program, and transmitting the commodity to the information identification module;
the entity shooting unit is used for collecting and recording the commodities which are wanted by customers to shoot in entity, and simultaneously aiming the commodities at the shooting frame, at least two pictures are needed to be shot, and finally the pictures are transmitted to the information identification module;
the tag shooting unit is used for shooting or scanning tags or other identifiers on commodities by customers, and collecting and recording the tags or other identifiers to the information identification module.
5. The intelligent cashier system based on the mobile terminal as in claim 4, wherein: the information identification module comprises a feature extraction unit and a matching unit;
the feature extraction unit is used for identifying text information, label information and identification bar codes or two-dimensional codes in the images to obtain related data information so as to extract the number of pictures shot by customers, shooting angles, saturation of commodity colors, trademark size, shooting inclination and picture-text size in the pictures from the data information;
the matching unit is used for quickly matching the extracted data information to corresponding commodities in the database and displaying commodity names, prices, weights, models and production dates.
6. The intelligent cashier system based on the mobile terminal as in claim 5, wherein: algorithm model training and analysis are performed by a computer system to obtain: commodity identification coefficientAnd tag identification coefficient->And the commodity identification coefficient is->And tag identification coefficient->In association, the recognition degree index is acquired>The commodity identification coefficientObtained by the following formula:
，
in the method, in the process of the invention,expressed as number of pictures>Expressed as trademark area>Expressed as relative dimensions>Expressed as saturation>Expressed as a recognition angle>And->Respectively expressed as picture number->Trademark areaRelative size->Saturation->And recognition angle +.>Weight value of (2);
wherein,，/>，/>，/>，，/>，/>represented as correction coefficients.
7. The intelligent cashier system based on the mobile terminal as in claim 6, wherein: the tag identification coefficientObtained by the following formula:
，
in the method, in the process of the invention,expressed as word size>Expressed as gradient +.>Expressed as word +.>Weight value of->Expressed as gradient +.>Is a weight value of (a).
8. The intelligent cashier system based on the mobile terminal of claim 7, wherein: the management module comprises a total unit;
the total unit is used for quickly calculating the price of the commodity which is ready to be purchased and paid by the customer, and comprises the commodity identification unit price acquired by the matching unitTag identification unit price->Bar code recognition unit price->And by identifying the commodity by +.>Tag identification unit price->And bar code recognition unit price->Correlating to obtain the total purchase priceThe purchase total price->Obtained by the following formula:
，
customer calculates total purchase price by systemChecking, checking and settling payment at any time, acquiring an electronic shopping receipt list and a check code, and registering and summarizing the received money by a background system.
9. The intelligent cashier system based on the mobile terminal of claim 8, wherein: the management module further comprises a threshold value comparison unit;
the threshold value comparison unit is used for indexing the recognition degreeComparing and analyzing with a preset recognition threshold Q to obtain a management scheme: if the recognition degree index->Above a preset recognition threshold Q, i.e. +.>>When Q, the related data result obtained for the current image through scanning, entity shooting or tag shooting reaches the preset recognition degree; if the recognition degree index->When the identification threshold value Q is lower than the preset identification threshold value Q, namely +.><At Q, the relevant data obtained for the current image captured by scanning, entity shooting or tag shooting can be matched by a plurality of commodity information in the database, but the matching is too slow or the loading is overtime.
10. The mobile terminal-based intelligent cashing system of claim 9, wherein: the checking code is used for a shop staff to quickly find out the customers needing ticket checking in the crowd and check all the commodities purchased by the customers at this time; the electronic shopping receipt list is used for the customer to check the information of the purchased goods at any time.
CN202311401105.3A 2023-10-26 2023-10-26 Intelligent cashier system based on mobile terminal Active CN117133088B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311401105.3A CN117133088B (en) 2023-10-26 2023-10-26 Intelligent cashier system based on mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311401105.3A CN117133088B (en) 2023-10-26 2023-10-26 Intelligent cashier system based on mobile terminal

Publications (2)

Publication Number Publication Date
CN117133088A CN117133088A (en) 2023-11-28
CN117133088B true CN117133088B (en) 2023-12-26

Family

ID=88863196

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311401105.3A Active CN117133088B (en) 2023-10-26 2023-10-26 Intelligent cashier system based on mobile terminal

Country Status (1)

Country Link
CN (1) CN117133088B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109859418A (en) * 2019-01-23 2019-06-07 王强 A kind of shopping settlement method in unmanned market
CN110580785A (en) * 2019-01-18 2019-12-17 深圳市阿尔丰科技有限公司 Cash register system, cash register device and cash register method applied to cash register system
CN113592567A (en) * 2021-09-29 2021-11-02 深圳兆瑞优品科技有限公司 Method and system for online shopping of preferred goods

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110276385A1 (en) * 2010-05-06 2011-11-10 Bank Of America Corporation Mobile Shopping Decision Agent
US9129277B2 (en) * 2011-08-30 2015-09-08 Digimarc Corporation Methods and arrangements for identifying objects
US10223730B2 (en) * 2011-09-23 2019-03-05 Visa International Service Association E-wallet store injection search apparatuses, methods and systems

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110580785A (en) * 2019-01-18 2019-12-17 深圳市阿尔丰科技有限公司 Cash register system, cash register device and cash register method applied to cash register system
CN109859418A (en) * 2019-01-23 2019-06-07 王强 A kind of shopping settlement method in unmanned market
CN113592567A (en) * 2021-09-29 2021-11-02 深圳兆瑞优品科技有限公司 Method and system for online shopping of preferred goods

Also Published As

Publication number Publication date
CN117133088A (en) 2023-11-28

Similar Documents

Publication Publication Date Title
CN209132890U (en) Settle accounts case
RU2727084C1 (en) Device and method for determining order information
CN109214806B (en) Self-service settlement method, device and storage medium
CN108537994A (en) View-based access control model identifies and the intelligent commodity settlement system and method for weight induction technology
CN108140282A (en) Information processing unit, information processing method and the recording medium for storing program
US20150120475A1 (en) Executing an in-store transaction
CN108140209A (en) Information processing unit, information processing method and the recording medium wherein having program stored therein
CN105164707A (en) Facilitating mobile device payments using mobile payment account, mobile barcode and universal digital mobile currency
US20080097862A1 (en) System and method for automated management of purchase in self-service-type sales point
CN109920178B (en) Unmanned supermarket system
CN114119001B (en) Intelligent management and analysis platform for cash collection of commodity sales based on artificial intelligence
CN114169952A (en) Commodity recommendation method, server, shopping cart and shopping system
CN106529997A (en) Precision interactive marketing system and method based on bank self-service device
JP3837475B2 (en) Automated shopping system
CN111325929A (en) Store system and data processing method
TWM570489U (en) Smart store shopping system
EP3180749A1 (en) Tax refund system
CN117133088B (en) Intelligent cashier system based on mobile terminal
TWI760521B (en) Smart store shopping system and purchasing method using thereof
US20170004553A1 (en) Method for presenting individual advertising and price information in a shop
JP2021057085A (en) Tax exemption processing apparatus, tax exemption processing method, and program
CN113516469B (en) Unmanned supermarket vending system and vending method based on deep learning and eye tracking
JP7273939B2 (en) Information processing method and terminal
US11727470B2 (en) Optical scanning for weights and measures
US20230038140A1 (en) Smart fundraising system using kiosk

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant