CN116402500A

CN116402500A - Automatic commodity identification weighing and voice control settlement method, device and equipment

Info

Publication number: CN116402500A
Application number: CN202211688840.2A
Authority: CN
Inventors: 魏涛; 魏莎
Original assignee: Shaanxi Huitao Artificial Intelligence Technology Co ltd
Current assignee: Shaanxi Huitao Artificial Intelligence Technology Co ltd
Priority date: 2022-12-27
Filing date: 2022-12-27
Publication date: 2023-07-07

Abstract

The application relates to an automatic commodity identification weighing and voice control settlement method, device and equipment, and relates to the field of settlement. The method comprises the following steps: acquiring a voice settlement instruction and identifying instruction content in the voice settlement instruction; shooting commodity images of commodities to be settled according to the instruction content, and identifying first commodity information from the commodity images; reading second commodity information of the associated commodity corresponding to the first commodity information from the database; displaying the second commodity information on the screen when the first commodity information and the second commodity information are consistent; when goods to be settled are placed on the plane of the settlement area, acquiring a pressure increase value, releasing a pressure signal according to the pressure increase value, and acquiring the weight of the goods to be settled according to the pressure signal; generating a commodity settlement frame according to the second commodity information and the weight of the commodity to be settled; and acquiring a payment mode selected by the user, and settling according to the commodity settlement frame and the payment mode. The settlement system is used for solving the problem of low settlement efficiency.

Description

Automatic commodity identification weighing and voice control settlement method, device and equipment

Technical Field

The present disclosure relates to the field of settlement, and in particular, to a method, an apparatus, and a device for automatic commodity identification weighing and voice control settlement.

Background

At present, when settlement is carried out, a cashier is usually required to record information one by one for settlement of commodities to be settled, settlement queuing time is long, settlement efficiency is low, the cashier is required to carry out a plurality of manual operations, and when the cashier is unfamiliar with the commodities to be settled, settlement efficiency is lower, customer settlement queuing time is long, and customer settlement experience is affected.

Disclosure of Invention

The application provides an automatic commodity identification weighing and voice control settlement method, device and equipment, which are used for solving the problem of low settlement efficiency.

In a first aspect, an embodiment of the present application provides an automatic merchandise identification weighing and voice control settlement method, including:

acquiring a voice settlement instruction and identifying instruction content in the voice settlement instruction, wherein the voice settlement instruction is used for indicating commodity settlement of commodities to be settled;

shooting a commodity image of the commodity to be settled according to the instruction content in the voice settlement instruction, and identifying first commodity information from the commodity image;

Reading second commodity information of the associated commodity corresponding to the first commodity information from a database;

displaying the second commodity information on a screen when the first commodity information is consistent with the second commodity information;

when goods to be settled are placed on the plane of the settlement area, acquiring a pressure increase value, releasing a pressure signal according to the pressure increase value, and acquiring the weight of the goods to be settled according to the pressure signal;

generating a commodity settlement frame according to the second commodity information and the weight of the commodity to be settled;

and acquiring a payment mode selected by the user, and settling according to the commodity settlement frame and the payment mode.

Optionally, the method further comprises:

acquiring a voice query instruction, identifying instruction content in the voice query instruction, and extracting keywords from the instruction content in the voice query instruction;

obtaining a query result corresponding to the keyword according to the keyword;

and converting the query result into voice information, and performing voice broadcasting on the voice information.

Optionally, before the reading, from the database, the second commodity information of the associated commodity corresponding to the first commodity information, the method further includes:

Collecting second commodity information of the related commodity;

and pre-storing second commodity information of the associated commodity in the database.

Optionally, the collecting the second commodity information of the associated commodity includes:

and after settlement is completed, the first commodity information is used as a training sample, and the second commodity information is generated.

shooting an image of the associated commodity, wherein the image of the associated commodity comprises a commodity identification code;

and acquiring second commodity information of the related commodity according to the commodity identification code.

shooting an image of the associated commodity;

identifying initial commodity information of the associated commodity from the image of the associated commodity;

acquiring editing information of cashier on the initial commodity information in the commodity settlement process;

and after confirming misoperation of cashier is obtained, obtaining second commodity information of the related commodity according to the initial commodity information and the editing information.

Acquiring initial commodity information of the associated commodity in advance;

acquiring editing information of commodity familiarity personnel on the initial commodity information;

and obtaining second commodity information of the associated commodity according to the initial commodity information and the editing information.

In a second aspect, an embodiment of the present application provides an automatic commodity identification weighing and voice control settlement device, including a voice identification module, an acquisition module, an image identification module, a settlement module and a pressure sensor;

the voice recognition module is used for acquiring a voice settlement instruction, recognizing instruction content in the voice settlement instruction and sending the instruction content in the voice settlement instruction to the acquisition module, wherein the voice settlement instruction is used for indicating commodity settlement of commodities to be settled;

the acquisition module is used for receiving instruction content in the voice settlement instruction sent by the voice recognition module, shooting a commodity image of the commodity to be settled according to the instruction content in the voice settlement instruction, controlling the image recognition module to recognize first commodity information from the commodity image, and sending the first commodity information to the settlement module;

The pressure sensor is used for acquiring a pressure increase value when the commodity to be settled is placed on the settlement area plane, releasing a pressure signal according to the pressure increase value, acquiring the weight of the commodity to be settled according to the pressure signal, and sending the weight of the commodity to be settled to the settlement module;

the settlement module is used for receiving the first commodity information sent by the acquisition module, reading second commodity information of the associated commodity corresponding to the first commodity information from a database, displaying the second commodity information on a screen when the first commodity information is consistent with the second commodity information, receiving the weight of the commodity to be settled sent by the pressure sensor, generating a commodity settlement frame according to the second commodity information and the weight of the commodity to be settled, acquiring a payment mode selected by a user, and settling according to the commodity settlement frame and the payment mode.

Optionally, the voice-controlled settlement device further comprises an induction module, an infrared sensor and a printing module; the settlement module is provided with a cashier button;

the sensing module is used for sending an acquisition instruction to the acquisition module when sensing that the commodity to be settled is placed on the settlement area plane;

The pressure sensor is used for sending an acquisition instruction to the acquisition module when the commodity to be settled is placed on the settlement area plane;

the settlement module is further used for sending an acquisition instruction to the acquisition module when the clicked operation of the cashing button is received;

the infrared sensor is used for sending an acquisition instruction to the acquisition module when determining that the commodity to be settled is placed on the settlement area plane according to the sent infrared signal;

the acquisition module is further used for receiving an acquisition instruction sent by the sensing module, the pressure sensor, the settlement module or the infrared sensor, or generating an acquisition instruction when acquiring image information, shooting a commodity image of the commodity to be settled according to the acquisition instruction, controlling the image recognition module to recognize first commodity information from the commodity image, and sending the first commodity information to the settlement module;

the settlement module is also used for generating cashier settlement information and sending the cashier settlement information to the printing module;

the printing module is used for receiving the cashing settlement information sent by the settlement module and printing out the settlement list receipt of the commodity to be settled according to the cashing settlement information.

In a third aspect, an embodiment of the present application provides an electronic device, including: the device comprises a processor, a memory and a communication bus, wherein the processor and the memory are communicated with each other through the communication bus;

the memory is used for storing a computer program;

the processor is configured to execute the program stored in the memory, and implement the voice control settlement method according to the first aspect.

Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages: in this application, through the pronunciation settlement instruction, automatic commodity image of waiting to settle accounts commodity to automatic first commodity information is discerned from commodity image, need not artifical manual input commodity information, has also avoided the cashier to treat the unfamiliar condition of settlement commodity and takes place, moreover, carries out automatic settlement through speech control, and the simple operation can promote settlement efficiency. After the first commodity information is identified from the commodity image, the second commodity information of the associated commodity corresponding to the first commodity information is read from the database instead of directly settling accounts according to the first commodity information, when the first commodity information is consistent with the second commodity information, the second commodity information is displayed on the screen, and the commodity settlement frame is generated according to the second commodity information and the weight of the commodity to be settled, so that the accuracy of the second commodity information for settling accounts can be ensured, the first commodity information is prevented from being inaccurate due to errors in commodity image identification, errors in settlement occur, and the accuracy of settlement is improved. And the first commodity information is not required to be manually confirmed again, so that the calculation efficiency is improved. And when the commodity to be settled is placed on the settlement area plane, a pressure increasing value is obtained, a pressure signal is released according to the pressure increasing value, and the weight of the commodity to be settled is obtained according to the pressure signal, so that the automatic weighing can be realized when the commodity to be settled is placed on the settlement area plane directly, the weight of the commodity to be settled is obtained, the commodity is not required to be weighed and then labeled, and then the commodity label is identified, so that the commodity weight is obtained, the weight of the commodity to be settled can be obtained directly through automatic weighing, and the settlement efficiency is improved. Solves the problem of low calculation efficiency.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

In order to more clearly illustrate the embodiments of the invention or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, and it will be obvious to a person skilled in the art that other drawings can be obtained from these drawings without inventive effort.

FIG. 1 is a schematic flow chart of a method for automatic commodity identification weighing and voice control settlement in an embodiment of the present application;

FIG. 2 is a flow chart of a method for voice query in one embodiment of the present application;

FIG. 3 is a schematic flow chart of a method for collecting commodity information by modification and supplement of cashier in commodity settlement according to an embodiment of the present application;

FIG. 4 is a schematic flow chart of a method for implementing call printing for commodity collection in an embodiment of the present application;

FIG. 5 is a flow chart of a method for overall collection, settlement and payment of goods in one embodiment of the present application;

FIG. 6 is a schematic diagram of an automatic merchandise identification weighing and voice control settlement device according to an embodiment of the present application;

FIG. 7 is a schematic diagram of an automatic merchandise identification weighing and voice-controlled settlement device according to one embodiment of the present application;

fig. 8 is a schematic structural diagram of an electronic device in an embodiment of the present application.

Detailed Description

For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present application based on the embodiments herein.

In the embodiment of the application, a voice control settlement method is provided. As shown in fig. 1, the voice-controlled settlement method mainly includes:

step 101, acquiring a voice settlement instruction and identifying instruction content in the voice settlement instruction, wherein the voice settlement instruction is used for indicating commodity settlement of commodities to be settled.

And 102, shooting a commodity image of the commodity to be settled according to the instruction content in the voice settlement instruction, and identifying first commodity information from the commodity image.

The first commodity information may include information such as a commodity image, a commodity name, detailed parameters of a commodity, a commodity identification code, and the like. The article identification code may include a bar code, a two-dimensional code, a code, an electronic tag, and the like.

And 103, reading second commodity information of the associated commodity corresponding to the first commodity information from the database.

The second commodity information may include information such as a commodity image, a commodity name, detailed parameters of the commodity, a commodity identification code, and the like.

And 104, displaying the second commodity information on the screen when the first commodity information is consistent with the second commodity information.

When the number of the commodities to be settled is at least two, when the first commodity information and the second commodity information of each commodity to be settled are consistent, the second commodity information of each commodity to be settled is uniformly displayed on a screen, and commodity settlement frames are uniformly generated to perform primary settlement.

And 105, acquiring a pressure increase value when the commodity to be settled is placed on the settlement area plane, releasing a pressure signal according to the pressure increase value, and acquiring the weight of the commodity to be settled according to the pressure signal.

In one embodiment, the specific method flow of calculating the commodity weight by the pressure sensor according to the pressurization of the commodity comprises the following steps:

when goods to be settled are placed on the settlement area plane, the pressure sensor is pressurized by the goods to release different pressure signals, and the principle is as follows:

when the commodity placed on the plane of the settlement area is a (apple), the pressure sensor releases the pressure signal b to the fixed position L; wherein b is a scale weight information, for example, b1 is a weight of two, b2 is a weight of two, b3 is a weight of three, b4 is a weight of four, b5 is a weight of five, and thus pushing, the fixed position L is a weight of one jin;

when the fixed position of b is adopted, according to the pressure distance signal which is 2 times adopted and is L, the position of the pressure sensor from b is M; for example, L is one jin and M is two jin; when the object is subjected to different pressures of N (N is 5 jin), the transmitted distance signal of c (c is 10 jin), and the distance signal of f (f is 20 jin), the weight of the object obtained according to the mechanical formula is a2 x L.

According to the principle, the mechanical formula is: a=f2=m L, n =ma, f=n gives m=fl/al+ax2=a2=a2, then assuming that the article weight of a is 2*L the article unit price of a is 1.5 yuan, then 2×lx1.5 is equal to the obtained total article price of a.

And 106, generating a commodity settlement frame according to the second commodity information and the weight of the commodity to be settled.

And 107, acquiring a payment mode selected by the user, and settling according to the commodity settlement frame and the payment mode.

The payment mode selected by the user can be face payment, unionpay, flash payment, weChat, payment bank and other payment modes.

In this application, through the pronunciation settlement instruction, automatic commodity image of waiting to settle accounts commodity to automatic first commodity information is discerned from commodity image, need not artifical manual input commodity information, has also avoided the cashier to treat the unfamiliar condition of settlement commodity and takes place, moreover, carries out automatic settlement through speech control, and the simple operation can promote settlement efficiency. After the first commodity information is identified from the commodity image, the second commodity information of the associated commodity corresponding to the first commodity information is read from the database instead of directly settling accounts according to the first commodity information, when the first commodity information is consistent with the second commodity information, the second commodity information is displayed on the screen, and the commodity settlement frame is generated according to the second commodity information and the weight of the commodity to be settled, so that the accuracy of the second commodity information for settling accounts can be ensured, the first commodity information is prevented from being inaccurate due to errors in commodity image identification, errors in settlement occur, and the accuracy of settlement is improved. And the first commodity information is not required to be manually confirmed again, so that the calculation efficiency is improved. And when the commodity to be settled is placed on the settlement area plane, a pressure increasing value is obtained, a pressure signal is released according to the pressure increasing value, and the weight of the commodity to be settled is obtained according to the pressure signal, so that the automatic weighing can be realized when the commodity to be settled is placed on the settlement area plane directly, the weight of the commodity to be settled is obtained, the commodity is not required to be weighed and then labeled, and then the commodity label is identified, so that the commodity weight is obtained, the weight of the commodity to be settled can be obtained directly through automatic weighing, and the settlement efficiency is improved. Solves the problem of low calculation efficiency.

In a specific embodiment, when the voice recognition wakes up 1, the voice interaction recognition content command 1×sends the settlement module, the acquisition module is controlled to acquire screen interaction information 1=1× (1 a-c2×0.5) =2a of the image of the recognized commodity, the information data is transmitted and compared, the commodity 2a associated with the command acquisition database is consistently extracted and displayed on the display screen, and the generated commodity settlement frame is marked with the 2a once

Settlement;

the settlement module receives the voice command 1X transmission sending information, acquires and identifies the commodity image 2a, and transmits and compares the commodity image with the associated commodity data 2a less than or equal to 1 mill (|a|x2a) =0.5 information in an information database to extract the commodity data;

and displaying the extracted commodity image data information on a display screen, generating settlement information of the commodity to carry out frame annotation, and controlling a settlement transaction unit to select a payment mode to finish settlement transaction information according to the commodity information settlement which is acquired by unified acquisition and identification.

In one embodiment, as shown in fig. 2, the automatic commodity identification weighing and voice control settlement process can also perform voice inquiry, and the voice inquiry method comprises the following steps:

step 201, a voice query instruction is obtained, instruction content in the voice query instruction is identified, and keywords are extracted from the instruction content in the voice query instruction.

The instruction content in the voice query instruction can comprise commodity names, commodity types, commodity parameters, production places, prices, weights, music playing control, video playing control, weather query and the like.

The voice recognition module can acquire the voice query instruction, recognize the instruction content in the voice query instruction and extract the key words from the instruction content in the voice query instruction.

Step 202, obtaining a query result corresponding to the keyword according to the keyword.

The voice recognition module can send the keywords to the acquisition module, the acquisition module is controlled to start the camera to shoot the commodity image of the commodity to be settled, the image recognition module is controlled to recognize the first commodity information from the commodity image, the second commodity information of the related commodity corresponding to the first commodity information is read from the database, when the first commodity information is consistent with the second commodity information, the second commodity information is displayed on the screen, and the query result corresponding to the keywords is extracted from the second commodity information.

And 203, converting the query result into voice information, and performing voice broadcasting on the voice information.

The voice recognition module can convert the query result into voice information and perform voice broadcasting on the voice information.

For example: the instruction content in the voice inquiry instruction is what is called by the inquired commodity, and when the voice inquiry instruction is received by the voice recognition module, the voice inquiry instruction is converted into text content: inquiring what the commodity calls, the segmentation unit segments the instruction content in the voice inquiry instruction into different keyword information of inquiring what the commodity calls, the voice recognition module sends the inquiring what the commodity calls to the server, the server receives the command information, determines the keyword segmentation content, the inquiring what the commodity calls to be the content, scans and recognizes a camera connected with the acquisition module to obtain an inquiring result corresponding to the keyword, or obtains the inquiring result corresponding to the keyword from the database, transmits the inquiring result to the voice recognition module to perform conversion prompt response, converts the inquiring result into voice information, and performs voice broadcasting on the voice information.

Also for example: the instruction content in the voice query instruction is ' help me play Zhou Jielun song and tornado ', when the voice query instruction is received by the voice recognition module, the voice query instruction is converted into text content, the segmentation unit segments the instruction content in the voice query instruction into different keyword information, ' play Zhou Jielun song ' is an instruction, the ' tornado ' is the content to send the instruction, the server accesses a database, if the information can not be found and feeds back, the voice recognition module carries out conversion content reply or carries out notification prompt response, ' do not query find content to be played by you ', ' we find play content information of xxAPP, and now will be how well opened for you to play? ". When the voice recognition module hears that the command reply content is good, the server is requested to access and open the related XX information software to play, if the voice recognition module does not hear the interactive command information, the playing is not executed any more.

Also for example: the command content in the voice query command is' help me query of the weight of the product, the same reason is that the price is shared by the price, the voice recognition module receives the command and converts the command into voice text information, the segmentation unit segments the command into the following keyword content, the query is the command, the product weight is the content, the total price is the content, the command is sent to the server for access, the acquisition module is controlled to start the camera to acquire and recognize, the pressure sensor is used for boosting and releasing the pressure signal, the weight of the commodity is acquired, when the first commodity information and the second commodity information are consistent, the settlement module calculates the price of the acquired product according to the weight of the commodity and the second commodity information, then the data information is transmitted, the voice recognition module receives the information command data and then converts and prompts the response, or the server directly acquires the result displayed in advance according to a database or a screen, and then feeds back the voice recognition module to respond to prompt information.

In addition to the voice recognition module obtaining the voice query instruction to wake up by voice, other devices may wake up the voice recognition module to broadcast in language, including but not limited to the following several implementations:

Mode one

When goods to be settled are placed on the settlement area plane by the pressure sensor, a pressure increase value is obtained, a pressure signal is released according to the pressure increase value, an acquisition instruction is sent to the acquisition module, the acquisition module is controlled to shoot, identify and obtain the information of the goods, and the voice recognition module is controlled to carry out voice interactive broadcasting of the names of the goods.

Mode two

The acquisition module shoots commodity images of commodities to be settled, the image recognition module is controlled to recognize first commodity information from the commodity images, and the image recognition module is controlled to carry out voice direct reference data broadcasting according to the first commodity information.

Mode three

And the settlement module is used for controlling the voice recognition module to carry out succinct cashing voice broadcasting on commodity names, unit prices and weights in the settlement information according to the settlement information of the object acquisition, recognition and weighing.

In a specific embodiment, before reading the second commodity information of the associated commodity corresponding to the first commodity information from the database, the voice control settlement method further includes: collecting second commodity information of the related commodity; second commodity information of the associated commodity is stored in a database in advance.

In one embodiment, collecting second merchandise information for an associated merchandise includes: after settlement is completed, the first commodity information is used as a training sample, and the second commodity information is generated.

The first commodity information which is acquired and identified in each settlement process can be used as a training sample to generate the second commodity information, so that the second commodity information is convenient to directly extract in the next acquisition process.

In a specific embodiment, the method for acquiring and identifying the commodity image comprises the following steps:

acquiring related commodity data information according to the image of the identification commodity shot by the acquisition camera, transmitting a commodity data instruction 1x to acquire a commodity 1x-a related to a cloud database instruction, comparing the information with the data of the extracted commodity and the image information 1x (1 x-a+1/2) =2b which are accurately transmitted, and displaying the display content of the display screen display 2b

The commodity information data acquired by the commodity acquisition data instruction cloud database instruction are compared and identical

Transmitting and displaying, and acquiring at least one commodity image in the identification to acquire commodity content extracted by the 2a instruction;

the method comprises the steps of acquiring relevant information of commodities, acquiring image parameters, wherein the data is a commodity image information data 1x in acquisition and identification, automatically generating a commodity data information image settlement frame 1x-a by displaying the content displayed on a display screen, settling, and taking 1 from a newly made record of the commodities as a training sample to store 0.5 of the training sample in the settlement of the cash register process, storing and training the commodities once, and directly extracting in the next acquisition process.

The first time the identified commodity is collected is used as the training sample for the next time.

In a specific embodiment, the settlement frames of the generated image information 2b are acquired according to the acquisition and identification, namely, all the commodities are acquired and identified, the generated image frames are acquired and displayed with a value of 2b < (1 x2 = 2x-0 mill1.5) > on a screen, and the settlement frames according to the image information are ordered according to the commodity types of different categories;

according to the image information settlement frame 1x-a which is obtained by the command database and is generated by the consistency of the commodities and is obtained and displayed by the unified acquisition and identification of all the commodities, unified cashing can be carried out and a calculation formula 2 is calculated>1×1x-a ² ＝ ² Settlement;

the unified settlement can be completed according to all the commodities, and the commodity classification and storage 1-a can be carried out once ² The commodity type information data file is automatically formed and stored, and the commodity is trained in one settlement and can be used as a direct extraction target for next acquisition and identification.

In one embodiment, collecting second merchandise information for an associated merchandise includes: shooting an image of the related commodity, wherein the image of the related commodity comprises a commodity identification code; and acquiring second commodity information of the related commodity according to the commodity identification code.

The article identification code may include a bar code, a two-dimensional code, a code, an electronic tag, and the like.

And in the process that the collection, identification and cashing of the commodities are to be completed in the plane of the settlement area by default collection mode, the storage of second commodity information of related commodities is completed, meanwhile, commodity images and different commodity information identification pages are established, the second commodity information is automatically acquired according to the commodity identification codes in the commodity images, and the second commodity information is automatically marked, classified and stored on the pages. Therefore, the acquisition work is simplified, the acquisition work time of commodity images is effectively reduced, the complexity of commodity image acquisition, placement and shooting is relieved, the problem that operators are unfamiliar with commodities is avoided, and the occurrence of errors is reduced.

In one embodiment, collecting second merchandise information for an associated merchandise includes: shooting an image of the related commodity; identifying initial commodity information of the associated commodity from the image of the associated commodity; acquiring editing information of cashier on initial commodity information in the commodity settlement process; and after the confirmation of the cashier is obtained, obtaining second commodity information of the related commodity according to the initial commodity information and the editing information.

In consideration of the fact that related commodities (such as vegetables, meats, seafood, rice and flour, beans, grains and the like) are in bulk, the commodity identification codes such as bar codes, two-dimensional codes or codes are not arranged, and the collection of second commodity information of related commodities cannot be directly achieved through scanning the commodity identification codes, initial commodity information of the related commodities which are already identified can be supplemented and modified through cashiers in the commodity settlement process, the second commodity information of the related commodities is obtained, and the second commodity information of the related commodities can be directly obtained from a database in the next settlement process without the need of manually modifying the content of the supplementary information again.

In a specific embodiment, as shown in fig. 3, in the commodity settlement process, the method for collecting commodity information through modification and supplement of cashiers includes:

in step 301, when a commodity is placed on the settlement area plane, a commodity image is captured, key information including the color, shape and data of the commodity is identified from the commodity image, and the key information is displayed on the screen as initial commodity information of the commodity.

All commodities can be collected and identified in a unified mode, and a kind of image information frames are generated on a screen according to the collected commodity image information and are sequentially arranged.

And 302, performing supplementary filling on initial commodity information of the commodity displayed on the screen according to the click confirmation operation of the cashier, clicking a cashier confirmation button, and generating settlement frame information of the commodity image.

When the image information of the commodity of the type in the image frame is supplemented according to the cashier, and when the supplementation of all the commodity type information is finished, the cashier settlement button is confirmed to be touched without error, and the cashier settlement information is completed.

Step 303, judging whether the settlement frame information of the commodity image is wrong, if yes, returning to the step 302, otherwise, executing the step 304.

And step 304, clicking the cashing settlement confirming button again to carry out cashing settlement.

And 305, according to the settlement frame information of the commodity image, the commodity image is automatically stored as a training standard supplement for one time, the commodity is prestored, and the commodity image can be directly taken as a reference object of a current instruction to be extracted when the commodity image is acquired next time.

According to the finished cashing settlement information, all commodities can be trained once, and the commodities are stored once according to the commodity type information, wherein the stored commodity type information is a database which is uniformly classified and stored, is used as a target for collecting and extracting the same commodity next time, is used for collecting, identifying and extracting the next time, does not need to manually modify the content again, and can be used as direct identifying settlement information.

In a specific implementation, for example: the method comprises the steps that a camera is used for collecting, other devices and equipment can be used for collecting and connecting, information of various commodities is stored in a settlement device in advance, when the commodity selection interface displays images and identification information of the commodities, relevant personnel fill in and modify all commodity image identification information through verification, and after the identification information of all commodity images is correct, the commodity image identification information is marked, classified and stored and uploaded to a database of a cloud server; the information to be acquired later is used for training according to the comparison. The acquired information can be commodity images, names and corresponding parameters, or bar codes, two-dimensional codes and codes of commodities, or the combination of the commodity images, the names and the commodity codes; in order to enable related personnel to quickly find corresponding commodity identification classifications, the commodity identification classifications can be displayed on a classification screen according to the types of commodities, and at least one commodity identification information list of the commodities is displayed.

In one embodiment, collecting second merchandise information for an associated merchandise includes: acquiring initial commodity information of related commodities in advance; acquiring editing information of initial commodity information by commodity familiarity personnel; and obtaining second commodity information of the related commodity according to the initial commodity information and the editing information.

All sold commodities can be subjected to database storage by adopting pre-acquisition identification, and automatic identification and extraction can be used as an acquisition target when waiting for the next sale. The device for pre-collecting and identifying can be other devices with camera scanning, but not limited to a device, can be a weighing device, an electronic weighing device with camera scanning, or a cashing and settlement integrated machine, for example, weighing cashing device, a computer, a mobile phone, a flat plate, a camera, a scanner, a scanning gun, a camera scanning device and the like, can be connected according to a collecting and identifying device or terminal device, and can be used for uniformly collecting and identifying commodities.

All commodities required to be sold are scanned according to the connection of equipment, and the display of a screen terminal is performed, wherein the display can be realized by connecting a scanner and a scanning gun through a computer, scanning the commodities and displaying the commodities on a screen; sorting according to the types of commodities, and after unified acquisition, scanning and recognition are completed, manually carrying out supplementary modification confirmation on commodity information such as images, parameters, data and the like; after unified modification is confirmed, commodity files can be generated, the commodity files can be manually stored by one key, a database can be classified according to the stored commodity information files, and the database can be used as a target for next acquisition, training and extraction.

The method can be the most original method, the camera of the mobile phone is used for shooting, the commodity images are arranged, the commodity images are connected with a computer to be arranged into commodity files, the commodity images, commodity names, types, data, colors and parameters are uniformly arranged, and the commodity images, the commodity names, the types, the data, the colors and the parameters are uniformly stored through computer connection equipment, or the software of a login system of the mobile phone computer is used for carrying out one-key import of a system background and storing the system background to a database, and the system background is classified as a target of next extraction training.

The method can also be that when goods are placed in a settlement area, a camera collects images of the photographed products, a color and settlement device calculates size information, and obtains goods picture information of different angles, related goods pages are automatically generated, different familiar product personnel can be arranged in specific implementation, plug wires are connected to a computer, a mobile phone or other electronic equipment (comprising a touch screen) while the equipment synchronizes the goods pages, professional familiar product personnel can directly modify or fill in corresponding goods information, or can also take pictures and collect the mobile phone, the computer, the camera and the like to generate the pages, each time fill in modification is completed, one goods is marked, the next goods collection is selected to continue to fill in specific information marking classification, and once analogize when all the goods are collected, the information classified by marking is uniformly checked, classified and uploaded.

In one embodiment, as shown in fig. 4, the method for implementing call printing by commodity collection includes:

and step 401, the pressure sensor releases a pressure control signal according to the pressurization, and the control acquisition module is connected with the camera to take a photograph of the commodity on the plane of the calculation area.

Step 402, control and start the image recognition module to perform shooting object recognition and acquire commodity information, data and parameters of the object.

And step 403, according to the commodity acquisition and transmission data instruction, invoking a cloud database to extract the commodity image and data parameter of the appointed related commodity, comparing and obtaining the consistency, and displaying the screen.

In step 404, the settlement module controls the display screen to display the commodity content, commodity image information, commodity data and parameters, and generates a settlement frame of commodity image information.

And step 405, the settlement module controls the printing module to print the commodity list according to the settlement unified information of the commodity, and the name, the type and the information data of the commodity are printed out to form a receipt list.

Besides the pressure sensor control acquisition module is connected with the camera, photographing and acquisition can be carried out on the commodity on the plane of the calculation area, and other control modules can also be used for controlling the acquisition module to be connected with the camera, so as to carry out photographing and acquisition on the commodity on the plane of the calculation area. Specific implementations include, but are not limited to, the following list of several ways:

(1) The settlement device is connected with a settlement unit interface related button, when a person to be determined clicks a settlement interface cashing button, the acquisition module can be started to acquire a settlement area plane, if the person to be determined is related to the object to be settled, the person to be determined is photographed, the recognition database is used for calling, and the commodity page is displayed on the display screen interface.

(2) And the pressure signal released by the pressure sensor confirms that articles are placed on the settlement area plane due to different pressurizing calculated amounts, and the acquisition module camera can be started to acquire and identify the articles so as to carry out cloud database retrieval to a display interface.

(3) When the sensing module senses that the settlement area is provided with information for placing articles, the sensing module starts the acquisition module to pick up a picture for photographing and acquiring, and the settlement device is called up on the commodity selection page of the display screen according to the acquired information of the articles.

(4) The voice recognition module is used for recognizing a voice awakening instruction, when the voice recognition module controls the acquisition module to shoot and acquire the acquisition information or controls the article acquisition settlement device to wait for acquisition, the time is often that: waiting for the commodity to be placed for 10 seconds, and automatically performing the next operation to be settled if the commodity information is not placed continuously within the preset time, and displaying an interface to the commodity selection page; or receiving voice or other instruction information, and also controlling the acquisition, returning or continuing to place, wherein the acquisition module continues to acquire commodity information and call and display commodity information on a display interface of the settlement device.

(5) And the infrared sensor is arranged, the commodity with the obstacle is determined to be placed on the plane of the settlement area according to the scanning of the infrared signal sent by the infrared sensor, the acquisition module is controlled to start the camera to acquire the plane of the settlement area, and the data is acquired to the display interface after the information of the commodity is acquired.

When the acquisition module acquires the image acquired by identifying the commodity to be settled, the settlement device displays commodity information on the display interface and selects the page. The method can be executed simultaneously, or after the settlement device receives commodity image information, or the voice module receives a voice command and then synchronously executes the voice command.

According to the above-mentioned calling method, the commodity image in the commodity related information is displayed in the preset settlement annotation frame, and at the same time, the annotation frame is generated according to at least one commodity identification data related to the commodity image, and the calling method assumes that:

for example, the at least one commodity identifier in the database includes A1 commodity, a2 commodity and a3 commodity which are the same commodity image, only one commodity to be settled is determined to be A1.1, the database and the commodity with the image are A1, a2 and a3, but different parameters are a1.1, a2.2 and a3.3, and the target commodity to be extracted is determined to be a1.1 as a settlement frame.

For example, multiple commodities are repeated, five commodity page information of A, B, C, D, E is generated on a settlement screen by the collected commodities, then the five commodities are called and downloaded by a cloud server database, and different commodity information images of multiple identical commodities, namely A1, A2, A3, B1, B2, B3, C1, C2, C3, D1, D2, D3, E1, E2 and E3, are respectively 10%, 20%, 50%, 80% and 100%. The reference data are A1.1, B3.3, C1.1, D2.2 and E3.3 respectively, and the highest matching degree is determined that the data are A1, B3, C1, D2 and E3, and the data are extracted as a settlement frame.

All commodities are required to be automatically stored in the first collection settlement or stored in a data file which is collected, tidied and uploaded to a server according to other equipment terminals and used as a reference object for training and retrieval.

In one embodiment, as shown in fig. 5, the method for integrally collecting, settling and paying the commodity comprises the following steps:

and 501, placing the object in a settlement area, and taking a picture by an acquisition camera to wait for calculation according to a pressure signal to acquire a weighing result.

Step 502, a pressure signal released by the pressure sensor or the sensing module senses the article information and starts the control acquisition module, and commodity weight is calculated according to the pressure signal.

In step 503, the acquisition camera shoots, recognizes and acquires the commodity image information, displays a re-settlement area display screen, selects page labels to be settled, and can automatically store login and upload to the cloud server database.

And 504, acquiring commodity to a screen selection page according to the later settlement, logging in a database by itself according to a command to acquire a commodity image, comparing related and same commodities to acquire correct commodity information parameters, extracting the correct commodity information parameters to a settlement device page area, and framing.

Step 505, judging whether the collected and marked object is consistent with the related task list commodity, if so, executing step 506, otherwise, executing step 503.

In step 506, the selection page generates commodity image information, extracts a correct image list, and the settlement device calculates the unit price total of the commodity according to the weight of the obtained product.

In step 507, the settlement collection screen selects pages for different merchandise list arrangements.

The system can be executed at intervals of a preset time, for example; the next operation step is carried out at intervals of 30 seconds (the specific interval time is determined by implementation, the aspect is not particularly limited), the next commodity is waited for to be placed, if the placement action is not carried out for a long time, the next operation page can not be carried out when the corresponding commodity is not collected by the camera by default under the condition that the weighing commodity is placed.

Step 508, voice interaction, control and settlement are carried out to confirm voice.

If the voice is talking, the voice recognition module device receives the voice instruction information, converts the voice instruction information, sends a command to the server, obtains a desired result, and performs voice interaction, can control or inquire commodity information, or controls the settlement to perform voice confirmation, or returns to continue inquiring or collecting placed articles.

Step 509, determining an image identification information list of the commodity, confirming that the commodity is settled, and waiting for the settlement of the next operation.

And comparing the whole selected page of the screen to be settled with the stored commodity of the database, checking and extracting the commodity, and annotating the commodity to determine unified commodity to be settled.

Step 510, confirming the settlement and selecting the payment mode.

The settlement confirming button is manually clicked or the voice dialogue confirms the settlement according to the voice command, and corresponding payment and settlement modes (such as face payment, unionpay card, weChat, payment bank, digital transaction, cash payment modes and the like) can be selected, so that the whole-course direct voice dialogue control can directly carry out the payment of the completed transaction.

Step 511, after the collection is completed, has a voice prompt: the collection was successful.

Printing a bill of the whole settlement commodity in a print receipt window, and storing commodity and data bill information of the settlement again; the stored commodity list can be used as a comparison result of the next database, and can also be used as check data extraction of commodity sales of merchants.

The cash settlement process and money can be embodied in the software functions of the system, and the functions of the software system are as follows: the method has all the option functions of selling goods, cashing and settling accounts, wallet, equipment connection, technical functions of all the invention, and the like, the sold goods can be embodied in a goods list, for example, when a merchant needs the settled goods as a sale check, the sold date can be checked in the goods list, or checked and printed according to the quarters and the months, and the checked list automatically generates a wps file EXCEL form and is connected with a printer for printing.

Based on the same conception, the embodiment of the present application provides an automatic commodity identification weighing and voice control settlement device, the specific implementation of the device can be referred to the description of the embodiment part of the method, and the repetition is omitted, as shown in fig. 6, the device mainly includes a voice recognition module 601, an acquisition module 602, an image recognition module 603, a settlement module 604 and a pressure sensor 605;

the voice recognition module 601 is configured to obtain a voice settlement instruction, recognize instruction content in the voice settlement instruction, and send the instruction content in the voice settlement instruction to the acquisition module 602, where the voice settlement instruction is used to instruct the commodity to be settled to perform commodity settlement;

The acquisition module 602 is configured to receive instruction content in the voice settlement instruction sent by the voice recognition module 601, shoot a commodity image of a commodity to be settled according to the instruction content in the voice settlement instruction, control the image recognition module 603 to recognize first commodity information from the commodity image, and send the first commodity information to the settlement module 604;

the pressure sensor 605 is configured to obtain a pressure increase value when the commodity to be settled is placed on the settlement area plane, release a pressure signal according to the pressure increase value, obtain the weight of the commodity to be settled according to the pressure signal, and send the weight of the commodity to be settled to the settlement module 604;

the settlement module 604 is configured to receive the first commodity information sent by the acquisition module 602, read the second commodity information of the related commodity corresponding to the first commodity information from the database, display the second commodity information on the screen when the first commodity information is consistent with the second commodity information, receive the weight of the commodity to be settled sent by the pressure sensor 605, generate a commodity settlement frame according to the second commodity information and the weight of the commodity to be settled, obtain a payment mode selected by the user, and perform settlement according to the commodity settlement frame and the payment mode.

The first commodity information comprises commodity images, commodity names, types, data and parameters, and information such as colors, shapes, sizes and data of commodities. The image recognition module can also recognize the bar code and the two-dimensional code containing the commodity to acquire the information of the commodity.

The voice recognition module receives an external voice interaction awakening instruction, converts the voice interaction awakening instruction content information, controls the acquisition settlement device to settle accounts, is connected with the pressure sensor to acquire commodity weight, can control the system device unit, comprises inquiry result information of a server execution instruction, and receives feedback result conversion control terminal to respond to prompt interaction information content.

In one embodiment, as shown in fig. 7, the voice-controlled settlement device further includes an induction module 606, an infrared sensor 607, and a printing module 608; the settlement module 604 is provided with a cashier button;

the sensing module 606 is configured to send an acquisition instruction to the acquisition module 602 when sensing that the settlement area plane is holding the commodity to be settled;

the pressure sensor 605 is configured to send an acquisition instruction to the acquisition module 602 when the commodity to be settled is placed on the settlement area plane;

The settlement module 604 is further configured to send an acquisition instruction to the acquisition module 602 when receiving a clicked operation of the cashier button;

the infrared ray sensor 607 is used for sending an acquisition instruction to the acquisition module 602 when determining that the commodity to be settled is placed on the settlement area plane according to the sent infrared signal;

the acquisition module 602 is further configured to receive an acquisition instruction sent by the sensing module 606, the pressure sensor 605, the settlement module 604, or the infrared sensor 607, or generate an acquisition instruction when image information is acquired, capture a commodity image of a commodity to be settled according to the acquisition instruction, control the image recognition module 603 to recognize first commodity information from the commodity image, and send the first commodity information to the settlement module 604;

the settlement module 604 is further configured to generate cashier settlement information, and send the cashier settlement information to the printing module 608;

the printing module 608 is configured to receive the cashier settlement information sent by the settlement module, and print out a settlement list ticket of the commodity to be settled according to the cashier settlement information.

The settlement area plane is used for collecting, shooting and identifying placed commodities, is located in the shooting range of the whole camera, and is used for placing, weighing and collecting the commodities.

Based on the same concept, the embodiment of the application also provides an electronic device, as shown in fig. 8, where the electronic device mainly includes: a processor 801, a memory 802, and a communication bus 803, wherein the processor 801 and the memory 802 complete communication with each other through the communication bus 803;

a memory 802 for storing a computer program;

the processor 801 is configured to execute a program stored in the memory 802 to implement the voice control settlement method provided in the present application.

In one embodiment, the electronic device further comprises a pressure sensor, an inductive identification module, a settlement module, a wireless Bluetooth module, a voice identification module, a communication interface, and an electronic component.

The processor 801 may be an integrated circuit chip, among other things, and has the processing power for signal and data execution. In implementation, the steps of the method may be implemented by device integrated circuit logic in the processor 801 or instructions in the form of software, where the processor 801 may be a server that may operate an operating system (e.g., windows server (tm), mac OS XTM, unixTM, linuxTM, freeBSDTM) or similar general purpose processor, including a central processor (english Central Processing Unit, abbreviated as CPU), or a network processor (english Network Processor, abbreviated as NP), etc.; the present invention may also be a digital signal processor (Digital SignalProcessing, DSP for short), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC for short), a ready-made programmable gate array (Field-Programmable Gate Array, FPGA for short), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or semiconductor components of each device or an integrated circuit, which may implement or execute the functions, steps, and logic of the disclosed methods in the embodiments of the present invention.

The system comprises a processor, a memory, a pressure sensor, an induction identification module, a settlement module, a wireless Bluetooth module, a voice identification module, a communication interface and an electronic component, which are connected through a communication bus.

The communication interface is an auxiliary device, possibly implemented as a signal receiving connection between the auxiliary device of the network signal processor and the wireless bluetooth module, or implemented as a self-contained network signal connection processing capability of the wireless connection module, and the communication interface is removed, or alternatively implemented as an execution range device of the infrared and ultraviolet sensor, and the processor is used for executing an executable module/e.g. a computer program stored in the memory.

The Memory may include a high-speed random access Memory (RAM, random Access Memory), a non-volatile Memory (non-volatile Memory), and a READ Only Memory (ROM), such as at least one Memory disk, a hard disk, a solid state space, and a solid state disk; the communication connection between the system network elements and at least one other network element is realized through at least one wireless Bluetooth module and a communication interface (which can be wired or wireless), and the gateway connection interfaces such as the Internet, a wide area network, a local area network, a metropolitan area network and the like can be used, and wifi or wired connection is used.

The communication bus may be an ISA bus, a PCI bus, an EISA bus, or the like. Can be divided into address buses, data buses, control buses, etc., interconnect buses, line buses, etc., and for ease of illustration only one thick line is shown in fig. 8, but not only one or a different plurality of buses or one type of bus.

The memory is used for storing programs and data, and after receiving the execution command, the processor executes program instructions, or may be a functional processor integrated by the above different modules (including a settlement module, a voice recognition module, an acquisition module, a settlement module, and other modules), and also has the function of receiving or sending the command, and in combination with the processor, executing the corresponding command, the method executed by the device defined by the disclosed flow and process can be applied to the processor, or the method executed by the processor is realized uniformly.

The processor may be a microprocessor or the processor may be any conventional processor, etc., and the methods and steps disclosed in connection with the present invention may be implemented directly as a hardware decoding processor or as a processor of an integrated circuit device module, or as a combination of hardware and software modules in a decoding processor, and a processor chip, not limited to a processor, where the software modules may be located in a random access memory, a flash memory, or a read-only memory, a programmable, etc., a read-only memory, or a programmable and erasable memory, all of which may be well-known in the art, and the storage medium may be located in a memory, where the processor reads data information codes in the memory, and performs the methods and steps in connection with the hardware.

The processor has signal receiving connection processing capability and is mainly used for executing all programs and data instructions stored in the storage.

A communication bus for connecting the internal structures between the respective devices and the apparatus.

And the pressure sensor is used for pressurizing and releasing the pressure signal to obtain commodity weight and controlling the acquisition module to acquire the commodity.

The sensing and identifying module is used for sensing whether the to-be-settled area has articles to be placed or not, and the sensing and identifying module is also provided with a control acquisition module for acquiring and photographing articles and commodities.

The settlement module is used for executing the article information acquired by the camera of the acquisition module, calculating the price of the commodity according to the weight of the commodity, sending instruction information to log in the acquisition server database, comparing and extracting information data of the commodity of one kind, marking identification and settlement to generate a settlement frame of settlement image information, and selecting a payment function of the settlement unit.

And the wireless Bluetooth module is used for receiving the wireless wifi signal for connection, executing an instruction for processing the signal, receiving network connection, releasing the blue voltage signal, and carrying out matching and receiving connection with external equipment.

The voice recognition module is used for receiving the external voice instruction, recognizing voice information content to convert, processing external noise, keeping tone quality pure, eliminating interactive tone quality information of noisy music, having tone quality sound effect adjusting function, receiving and transmitting voice instruction information, and recognizing and replying interactive response content interactive information to the external execution control terminal instruction.

The communication interface is used for receiving communication signals between the processing equipment devices, is at least one communication interface, and assists the wireless Bluetooth module to realize communication connection between the system network element, including MME, SGW, PDN network element base stations and the like and other network elements.

The memory, which may be one or more storage media, is primarily used for storing program code and related program data information.

The electronic assembly is mainly used for circuit power and voltage saving and performs the circuit connection function and the semiconductor chip of the device.

The device modules provided by the embodiment of the invention are explained, and the device module comprises a commodity image acquisition labeling device, a to-be-settled and voice interaction device, intelligent electronic equipment and a system, and the device module has the same technical characteristics as the commodity image acquisition, identification labeling, settlement and voice interaction functional method provided by the implementation method, so that the same technical problems can be solved, and the same technical effects can be achieved.

The invention discloses a method and a computer program product for acquiring, labeling, classifying and storing commodity images and settling voice recognition, which are provided by an embodiment of the method, wherein the method and the computer program product comprise stored computer programs, nonvolatile program codes executable by a processor and computer readable storage media, and can be singly used for listing a system software or be executed by embedded hardware, the program codes comprise instructions which can be used for executing the technical method in the implementation of the method, and specific implementation can refer to the embodiment of the method and no redundant description is needed.

It should be noted that in this document, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The foregoing is only a specific embodiment of the invention to enable those skilled in the art to understand or practice the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An automatic commodity identification weighing and voice control settlement method is characterized by comprising the following steps:

2. The automated merchandise identification weighing and voice controlled settlement method of claim 1, further comprising:

obtaining a query result corresponding to the keyword according to the keyword;

3. The automated merchandise identification weighing and voice controlled settlement method according to claim 1, wherein prior to reading the second merchandise information of the associated merchandise corresponding to the first merchandise information from the database, the method further comprises:

collecting second commodity information of the related commodity;

4. The automated merchandise identification weighing and voice controlled settlement method of claim 3 wherein said collecting second merchandise information for said associated merchandise comprises:

5. The automated merchandise identification weighing and voice controlled settlement method of claim 3 wherein said collecting second merchandise information for said associated merchandise comprises:

6. The automated merchandise identification weighing and voice controlled settlement method of claim 3 wherein said collecting second merchandise information for said associated merchandise comprises:

shooting an image of the associated commodity;

7. The automated merchandise identification weighing and voice controlled settlement method of claim 3 wherein said collecting second merchandise information for said associated merchandise comprises:

acquiring initial commodity information of the associated commodity in advance;

8. The automatic commodity identification weighing and voice control settlement device is characterized by comprising a voice recognition module, an acquisition module, an image recognition module, a settlement module and a pressure sensor;

9. The automated merchandise identification weighing and voice controlled settlement device of claim 8, further comprising an induction module, an infrared sensor, and a printing module; the settlement module is provided with a cashier button;

10. An electronic device, comprising: the device comprises a processor, a memory and a communication bus, wherein the processor and the memory are communicated with each other through the communication bus;

The memory is used for storing a computer program;

the processor is configured to execute a program stored in the memory to implement the automatic commodity identification weighing and voice control settlement method according to any one of claims 1 to 7.