CN111831673A

CN111831673A - Goods identification system, goods identification method and electronic equipment

Info

Publication number: CN111831673A
Application number: CN202010525545.XA
Authority: CN
Inventors: 马捷昱; 冯立男
Original assignee: Shanghai Chaoyue Moon Technology Co ltd
Current assignee: Shanghai Chaoyue Moon Technology Co ltd
Priority date: 2020-06-10
Filing date: 2020-06-10
Publication date: 2020-10-27
Anticipated expiration: 2040-06-10

Abstract

The invention provides a goods identification system, a goods identification method and electronic equipment. The goods identification method comprises the following steps: database construction, tray parameter acquisition and weight change value judgment. According to the invention, the tray area outline and the tray weight change value of each tray with the weight changed are collected in real time in a mode of installing the pressure blanket on the upper surface of the tray. When goods are taken away from or placed on the tray of the shelf, the types and the number of the taken away or placed goods can be judged in real time, so that the shopping records in the shopping database of the user can be ensured to be consistent with the actual shopping condition of the user.

Description

Goods identification system, goods identification method and electronic equipment

Technical Field

The invention relates to a goods identification technology for retail industry, in particular to a goods identification system, a goods identification method and electronic equipment.

Background

Chinese patent publication No. CN108332829A discloses a goods sensing system and a goods sensing method based on weight monitoring, chinese patent publication No. CN108497839A discloses a goods shelf capable of sensing goods, both of which relate to an intelligent goods shelf for an unmanned convenience store, and a weight sensor is required to monitor the change condition of each kind of goods on the goods shelf in real time and record the kinds and the number of the changed goods. Above scheme all adopts the piano type tray, sets up a plurality of independent trays side by side at every layer, places same kind of goods in each tray, does not influence each other between a plurality of trays of same layer. When taking out goods from goods shelves, the weight sensor can accurately judge the type and the quantity, and the disadvantage is that when a user puts the goods to a wrong position, the computer system can only judge that the goods are put wrongly, but can not determine the type and the quantity of the misplaced goods, because various goods have the same weight, the common events which are very likely to happen are very likely, and the weight values of the goods and the goods types do not correspond one to one.

If the user takes the food on the shelf down and eats the food, and the eaten food is put back to the original tray, the computer system can only identify that the weight of the food is different from that of the original goods on the tray, and can not judge whether the goods belongs to the goods on the tray but eaten or belong to the goods on other trays, and only can make a simple alarm. If the goods are other goods originally positioned on other trays, the goods can be sold for the second time, and workers do not need to make adjustment in a short time; if the eaten goods cannot be sold for the second time, an alarm is given to prompt staff or users to take the goods as soon as possible. Meanwhile, the computer can identify which user puts back the item, but the specific type and quantity of the item are difficult to judge, so that the item cannot be deleted from the electronic shopping cart of the user, and the shopping record in the electronic shopping cart of the user is inconsistent with the real shopping situation.

In addition, the piano type tray structure adopted by the two patents is greatly different from the common shelf tray structure, a mould and a design tray need to be developed again, a large number of weight sensors are installed, and the cost of the piano type shelf is much higher than that of the conventional shelf; moreover, the size of each tray of the piano type goods shelf is fixed and unchangeable, only some goods with the same size as the tray can be placed, and if other goods with different sizes are placed, the trays need to be customized again, so that the use cost of the goods shelf is further increased.

Disclosure of Invention

The invention aims to solve the problems of poor accuracy of returned goods type identification, wrong taking and wrong placing and over-high cost of the goods shelf in the intelligent goods shelf in the prior art.

In order to achieve the above object, the present invention provides a method for identifying goods, comprising the steps of: constructing an article database for storing article information of each article placed on a tray of a shelf, wherein the article information comprises the type, the weight, the position column and the bottom contour of each article; collecting the weight change value of each tray in real time; when the weight change value is a non-zero value, recording tray parameters including the weight change value, a column where the weight is changed and a tray area outline where the weight is changed; judging whether the weight change value is less than 0, if so, judging that goods are taken away from a tray of a shelf, judging the type and the quantity of the taken-away goods according to the tray parameters and the goods information, and storing the type, the quantity and the bottom surface outline of the taken-away goods to a shopping database of a user taking away the goods; if not, judging that goods are placed on the tray of the goods shelf, judging the type and the quantity of the goods placed on the goods shelf according to the tray parameters and the shopping database of the user placing the goods, and deleting the goods information corresponding to the goods from the shopping database of the user placing the goods.

Further, the step of judging the type and the number of the taken goods according to the tray parameters and the goods information specifically comprises the following steps: comparing the serial numbers of the columns with the changed weights with the serial numbers of the columns in which the goods are located in the goods database to obtain the types of the goods which are taken away; and calculating the quotient of the absolute value of the weight change value and the single-item weight of the goods of the type in the goods database, and rounding the quotient to obtain the number of the taken-away goods.

Further, the step of determining the type and number of the goods placed on the shelf includes the steps of: judging whether the weight change value is the same as the weight of one article or the total weight of a plurality of articles in a shopping database of a user placing the article; if yes, M possible results of the types and the number of the goods placed on the goods shelf are obtained; if not, the goods are judged to be foreign matters.

Further, the step of determining the type and number of the goods placed on the shelf includes the steps of: judging whether the outline of the tray area with the changed weight is consistent with the outline of at least one item in a shopping database of a user for placing the item; if yes, N possible results of the types and the number of the goods are obtained; if not, the goods are judged to be foreign matters.

Further, the step of determining the type and number of the goods placed on the shelf includes the steps of: judging whether the weight of the goods is the same as the weight of at least one goods in a shopping database of a user placing the goods; if yes, obtaining M possible results of the types and the quantity of the goods placed on the goods shelf, namely weight comparison results; judging whether the outline of the tray area with the changed weight is consistent with the outline of at least one item in a shopping database of a user for placing the item; if so, acquiring N possible results of the types and the quantity of the goods, namely the contour comparison result; and comparing the weight comparison result with the outline comparison result, wherein if one of the weight comparison result and the outline comparison result is the same as the other one, the result is the type and the number of the goods placed on the shelf.

Further, the goods identification method further comprises the following steps: identifying identity information of each user; generating a shopping database of each user according to the identity information of each user; when the weight change value is less than 0, judging the identity of the user taking away the goods; and when the weight change value is larger than 0, judging the identity of the user for placing the goods.

Further, the step of constructing the goods database specifically comprises the following steps: initializing a goods database, and inputting the column number of each tray to the goods database; inputting the goods information corresponding to each column into the goods database, wherein the goods information comprises the kind and the single weight of the goods corresponding to the column; collecting the bottom surface outline of each kind of goods and storing the bottom surface outline to the goods database; when an article is placed on a tray, the outline of the area where the weight of the tray changes is the outline of the bottom surface of the article.

Further, the goods identification method further comprises the following steps: when the weight change value is less than 0, deleting the information of the goods which are taken away from the goods database; when the weight change value is larger than 0, if the goods placed on the shelf are not foreign matters, the goods type, the single-goods weight, the located column and the bottom contour of each goods placed on the shelf are stored to the goods database as a group of goods information.

Further, the goods identification method further comprises the following steps: searching a column corresponding to the goods from the goods database according to the types of the goods placed on the shelf; judging whether the column corresponding to the type of goods is consistent with the column with the changed weight; if so, judging that the goods are placed in the correct column; if not, the goods are judged to be placed in the wrong column, and an alarm signal is optionally sent out.

Further, the bottom surface profile of the article includes the shape and size of the article bottom surface; and the contour of the tray area with the changed weight comprises the shape and the size of the tray area with the changed weight.

Further, before the step of building the goods database, the method further comprises the following steps: arranging at least one shelf, wherein each shelf comprises a plurality of trays, and each tray is divided into at least one column; arranging a pressure blanket on the upper surface of each tray; and placing at least one article in the at least one tray, wherein the bottom surface of each article is in contact with the top surface of the pressure blanket, and the same article is placed in each column; the pressure blanket is used for acquiring the weight change value of the tray, the column with the weight change and the outline of the tray area with the weight change in real time.

The present invention also provides an electronic device comprising: a memory for storing executable program code; and a processor connected to the memory for executing a computer program corresponding to the executable program code by reading the executable program code to execute the steps of the goods identification method.

The invention also provides a goods identification system which comprises the electronic equipment.

Further, the present invention also provides an article identification system, which further includes: at least one shelf, each shelf including a plurality of trays, each tray being divided into a plurality of columns for holding items; and at least one pressure blanket attached to the upper surface of each tray and connected to an electronic device; the pressure blanket is used for acquiring the weight change value of the tray, the column with the weight change and the outline of the tray area with the weight change in real time.

Further, the pressure blanket comprises a plurality of pressure sensors distributed evenly.

Further, the goods identification system also comprises a separator which is detachably arranged above each tray and is used for separating the tray into a plurality of columns.

The goods identification system, the goods identification method and the electronic equipment have the advantages that the weight and the goods outline of each kind of goods on the tray are obtained and recorded in a mode that the pressure blanket is arranged on the upper surface of the tray, and the tray area outline and the tray weight change value of each tray with the changed weight are collected in real time.

When goods are taken away from the tray of the shelf, the weight change value of the tray is compared with the goods information corresponding to each tray in the goods database, the types and the quantity of the goods taken away from the tray can be judged, and the weight value, the bottom outline and other goods information of the goods taken away are stored in the shopping database of the user taking away the goods. When goods are placed on the tray, the weight change value and the outline of the tray are compared with the weight and the outline of the goods in the shopping database of the user for placing the goods, the type and the quantity of the goods placed back to the tray can be judged, and then the goods information corresponding to the goods in the shopping database of the user is deleted, so that the condition that the shopping records in the shopping database of the user are consistent with the actual shopping condition of the user can be ensured.

The goods shelf used in the invention has a structure similar to that of the existing goods shelf, only a pressure blanket is needed to be arranged on a common goods shelf tray, a piano key type is not needed, the cost of the goods shelf can be effectively reduced, and the column width of each tray is adjustable and can be used for placing goods with different sizes.

Drawings

FIG. 1 is a schematic view of the overall structure of the pallet of the present invention;

FIG. 2 is a schematic view of the construction of the pressure blanket of the present invention;

FIG. 3 is a schematic block diagram of the article identification system of the present invention;

FIG. 4 is a schematic view of the front end structure of the shelf according to the present invention;

FIG. 5 is a schematic view of the rear end structure of the shelf according to the present invention;

FIG. 6 is a flow chart of a method of identifying an item according to the present invention;

FIG. 7 is a flowchart of the goods database construction steps of the present invention;

fig. 8 is a flowchart of the user identity obtaining step according to the present invention.

The various components in the figures are numbered as follows:

1. support, 2, pressure blanket, 10, shelf, 11, tray, 12, spacer,

20. an electronic device, 21, a first carpet face, 22, a second carpet face, 23, a pressure sensor,

30. a camera 41, a first row of holes, 42, a second row of holes, 51 and a first limiting hole,

52. a second limit hole 100, a goods identification system 121, a first bracket 122, a second bracket,

123. third support, 201, memory, 202, processor.

Detailed Description

The preferred embodiments of the present invention will be described in full hereinafter with reference to the accompanying drawings, for the technical content thereof to be more clearly understood. The present invention may be embodied in many different forms of embodiments and its scope is not limited to the embodiments set forth herein.

In the drawings, elements having the same structure are denoted by the same reference numerals, and elements having similar structure or function are denoted by the same reference numerals throughout. Directional phrases used in connection with the present invention, such as, for example, upper, lower, front, rear, left, right, inner, outer, etc., are used in the drawings only and are meant to be illustrative and descriptive of the invention and not to limit the scope of the invention.

When certain components are described as being "on" another component, the components can be directly on the other component; there may also be an intermediate member disposed on the intermediate member and the intermediate member disposed on the other member. When an element is referred to as being "mounted to" or "connected to" another element, they may be directly "mounted to" or "connected to" the other element or indirectly "mounted to" or "connected to" the other element through an intermediate element.

As shown in fig. 1, the present embodiment provides an article recognition system 100 for an unmanned convenience store, comprising a shelf 10 placed in the unmanned convenience store, the shelf 10 comprising at least one support 1 and at least one pressure blanket 2, each shelf 10 comprising a plurality of trays 11, each tray 11 being partitioned into a plurality of columns; a pressure blanket 2 is disposed on the upper surface of each tray 11, i.e. the pressure blanket 2 is attached to the upper surface of each tray 11.

Specifically, as shown in fig. 2, the pressure blanket 2 comprises a first blanket face 21, a second blanket face 22, and a plurality of pressure sensors 23; the first carpet surface 21 is attached to the upper surface of a tray 11; the second carpet face 22 is arranged above the first carpet face 21, and the edge of the second carpet face is connected to the first carpet face 21; a plurality of pressure sensors 23 are evenly distributed in the gap between the second carpet face 22 and the first carpet face 21. The distance between any two adjacent pressure sensors 23 in the pressure blanket 2 is 2-10 mm, preferably 5mm, which can not only detect the real-time weight change of the goods on the tray, but also detect the column position of the weight change, and also detect the outline of the tray area with the weight change, i.e. the outline of the goods taken away or put back.

As shown in fig. 3, the article identification system 100 further includes an electronic device 20, the electronic device 20 being disposed inside or outside the shelf 10, and the pressure blanket 2 being connected to the electronic device 20. At least one article is placed in at least one tray 11, and the same article is placed in each column. The pressure blanket 2 is used to capture the weight of the item or items and its bottom surface profile and also to capture the profile of the tray area where the weight changes. The data of the pressure blanket 2 is transmitted to the electronic device 20, and the electronic device 20 can calculate the reduced weight and also can obtain the column position of the changed weight and the outline of the goods, thereby determining the type and quantity of the goods taken from the shelf tray and the type and quantity of the goods put back to the shelf tray.

To facilitate the division of the columns, the pallet 10 further comprises partitions 12 detachably mounted to the frame 1 for dividing the pallet 11 into at least one column. With the end of the shelf 10 or tray 11 facing the user being the front end and the end away from the user being the rear end, it is preferable that the height of the front end of the partition 12 is lower than the height of the rear end thereof to facilitate the user to take or place goods on the shelf 10 or in the tray 11. The tray 11 is divided into a plurality of columns for placing different products, and the shelf 10 can be installed in a refrigerator or a freezer.

The embodiment can be directly improved on the basis of the existing tray, a piano type is not needed, the cost can be reduced, the width of each column can be adjusted, and the tray is suitable for scenes with different sizes of goods. This embodiment can customize the specification and size of pressure blanket 2 according to the tray size, reforms into intelligent goods shelves with traditional goods shelves, can reduce the manufacturing cost and the maintenance cost of goods shelves.

As shown in fig. 4 and 5, in the present embodiment, the spacer 12 includes a first bracket 121 and/or a second bracket 122 and/or a third bracket 123; the supports are all made of at least one metal rod, so that the cost is low. The first bracket 121 is detachably mounted to the front end of the tray 11; the second bracket 122 is detachably mounted to the rear end of the tray 11; one end of the third bracket 123 is detachably mounted to the front end of the tray 11, and the other end thereof is detachably mounted to the rear end of the tray 11, so as to divide the tray 11 into at least one column. Like this just can easily divide the column through pluggable separator 12, the column width is adjustable moreover, is fit for the different condition of goods size, and the column does not receive the strict restriction of goods size, and goods shelves 10 need not make the piano type, only need on whole tray 11 installation pressure blanket 2 can, can reduce cost.

As shown in fig. 4 and 5, in order to easily divide the columns by the pluggable partition 12, the partition 12 includes a first row of holes 41 penetrating the front end of the tray 11 and a second row of holes 42 penetrating the rear end of the tray 11 in addition to the first, second and

third brackets

121, 122 and 123. The lower end of the first bracket 121 is inserted into the first row of holes 41, the lower end of the second bracket 122 is inserted into the second row of holes 42, the front end of the third bracket 123 is inserted into the first row of holes 41, the rear end of the third bracket is inserted into the second row of holes 42, the front end and the rear end of the third bracket 123 are respectively installed on the first bracket 121 and the second bracket 122 in a pluggable manner, the first row of holes 41 and the second row of holes 42 are used for fixing the third bracket 123, so that the third bracket 123 cannot deflect in the front-rear direction and keeps relatively stable, the tray 11 can be divided into a plurality of columns by at least one third bracket 123, and each column is used for placing the same kind of goods. The user can pull out at least one third support 123 from the original position at any time and insert the third support to another position, so that the width of each column can be adjusted according to actual requirements, and the width of the column corresponds to the size of the goods to be placed.

As shown in fig. 6, based on the article identification system 100 described above, the present embodiment further provides an article identification method, including the following steps S1-S12. Wherein steps S1-S4 are hardware setting steps.

As shown in fig. 3, the electronic device 20 includes a memory 201 and a processor 202; a storage medium is provided in the memory 201 for storing executable program code; the processor 202 runs a computer program corresponding to the executable program code by reading the executable program code to perform steps S5-S12 in an article identification method.

In the present embodiment, the pressure blanket 2 is installed on the entire tray 11, the weight change and the goods profile including the shape and size are obtained, and the profile of the tray area where the weight of each tray 11 is changed is collected in real time, so that the number and the kind of the goods can be accurately identified according to the combination of the gravity scheme and/or the visual scheme.

S1, a shelf setting step of setting at least one shelf 10, each shelf 10 including a plurality of trays 11, each tray 11 being partitioned into at least one column by partitions 12 detachably attached to the trays 11. The embodiment can be directly improved on the basis of the existing tray, a piano type is not needed, the cost can be reduced, the width of the column can be adjusted, and the tray is suitable for a scene that the size of goods is flexible and changeable. The embodiment can customize the specification size of the pressure blanket 2, and the common goods shelf is transformed into the intelligent goods shelf, thereby avoiding the waste of the existing common goods shelf and greatly saving the cost of additionally purchasing the goods shelf.

S2, a pressure blanket setting step, setting a pressure blanket 2 on the upper surface of each tray 11, attached to the upper surface of each tray 11, and connected to the electronic device 20. The pressure blanket 2 is used to obtain the weight of the goods on the pallet and its bottom profile, and also to obtain the profile of the area of the pallet where the weight changes. The bottom surface profile of the article, including the shape and size of the bottom surface of the article. The pressure blanket 2 comprises two blanket faces and a plurality of pressure sensors 23 uniformly distributed between the two blanket faces and arranged in a matrix; wherein, the distance between any two adjacent sensors is 2-10 mm, and the distance between two adjacent pressure sensors 23 is preferably 5 mm. When an article is placed on the pressure blanket 2 of a tray 11, the pressure sensor pressed by the article generates an electrical signal and transmits the electrical signal to the electronic device 20, and the electronic device 20 can calculate the outline of the tray area where the weight change occurs, that is, the outline of the bottom of the article taken away from the tray or placed on the tray, including the shape and size of the bottom of the article, according to the electrical signal transmitted by the pressure blanket 2. The electronic device 20 may also calculate the amount of weight change of the tray, i.e., the weight of items removed from or placed on the tray.

S3, placing at least one article in at least one tray 11, preferably, each column is placed with the same article. The bottom of each goods is in direct contact with the pressure blanket on the upper surface of the tray, and the goods cannot be stacked and placed, so that the bottom outline of each goods can be collected by the electronic equipment.

And S4, a camera setting step, namely, setting at least one camera 30 at the top of the unmanned convenience store and/or the front end of the shelf 10, connecting the camera 30 to the electronic equipment 20, wherein the camera 30 is preferably a three-dimensional camera and can continuously acquire multi-frame three-dimensional images. A part of the cameras are arranged at the top of the convenience store, the visual field of the cameras covers the whole range of the bottom of the convenience store, and the electronic equipment judges the position of each user according to the real-time image of each user in the convenience store. When the weight of a certain tray changes, the electronic equipment judges whether the coordinate sets of the two hands of each user have intersection with the coordinate set of the space above the tray, if so, the identity of the user stretching the hand towards the tray when the weight of the tray changes is obtained, namely, the identity of the user taking goods away from the tray or placing the goods to the tray. And a part of cameras are arranged at the front end of the goods shelf, and the visual field of the cameras covers the space in front of the goods shelf. When the weight of a certain tray changes, the electronic equipment intercepts the image of the space in front of the goods shelf in a time period before or after the time point, namely the real-time image in the process that the user stretches out to take away or put back the goods comprises all or part of the pictures of the goods in the hand of the user, the pictures of the goods are input into the goods identification model by combining the computer vision technology and the machine learning technology, and the type of the goods taken away or put back is further judged.

S5, an item database construction step of constructing an item database for storing a plurality of sets of item information of each item placed on the tray 11 of the shelf 10, the item information including a kind, an individual item weight, a place, and a bottom surface contour of each item. As shown in fig. 7, the step S5 of building the goods database specifically includes the following steps: s51, initializing a goods database, and recording shelf numbers, tray numbers and column numbers of each column on each tray; s52, inputting the goods information corresponding to each column into the goods database, wherein the goods information comprises the goods type corresponding to the column, the single weight of the goods of the type and the price of the goods; s53, at least one article is placed on a tray 11 of a shelf 10, the bottom profile of each kind of article is collected in real time and stored in the article database. Wherein the outline of the bottom surface of the article includes a shape of the bottom surface of the article and a size of the bottom surface of the article.

S6, a tray parameter acquisition step, namely acquiring the weight change value of each tray 11 in real time; and when the weight change value is a non-zero value, recording tray parameters including the weight change value, a column where the weight is changed and the outline of a tray area where the weight is changed. Wherein the profile of the tray area with the changed weight comprises the shape and the size of the tray area with the changed weight.

When a user enters a store, the electronic equipment acquires the identity of each user entering the convenience store according to the two-dimensional code or the identity card of the user, and a shopping database is established for each user according to the identity information of the user. When the weight change value is a non-zero value, the electronic equipment acquires the hand position of each user in real time according to the camera at the high position of the convenience store, and compares the hand position of the user with the positions of the trays, so that the conclusion of which user stretches hands to which tray can be obtained. When a shopping event happens, the weight of a certain column on the tray changes, and a user stretching to the column at the same time is a user taking away or putting back goods, so that the identity of the user taking away or putting back the goods can be judged, and the shopping database of the user can be updated synchronously.

S7, a weight change value judging step, namely judging whether the weight change value X is less than 0, if so, judging that goods are taken away from the tray of the goods shelf, and executing the steps S8-S9; if not, it is determined that there is an article placed on the tray of the shelf, and steps S10-S14 are executed.

S8, a first goods judging step, namely judging that goods are taken away from a certain tray of the shelf, and judging the types, quantity types and quantity of the taken-away goods according to the tray parameters and the goods information, wherein the first goods judging step specifically comprises the following steps: comparing the serial numbers of the columns with the changed weights with the serial number of the column in which each goods is located in the goods database, acquiring the types of the taken goods, and acquiring the single-product weight of the goods of the types from the goods database; and calculating the quotient of the absolute value of the weight change value and the single-item weight of the type of the goods in the goods database, and rounding the quotient to obtain the number of the taken-away goods.

S9, a first updating step of the shopping database, which is to update the shopping database of the user, store the type and quantity of the goods taken away and the bottom profile of the goods taken away to the shopping database of the user taking away the goods, record the change condition of each goods quantity in the goods database, and update the stock quantity of the goods on the goods shelf in the goods database.

S10, a second article determination step of determining that an article is placed on a tray of a shelf and that the weight of the article is the same as the weight variation value.

S11, a weight comparison step, wherein whether the weight change value, namely the weight of the goods, is the same as the weight of one goods or the total weight of a plurality of goods in the shopping database of the user placing the goods is judged, and if not, the goods placed on the shelf are judged to be foreign matters; if so, M possible results of the kinds of the items placed on the shelves are acquired, and the next step S12 is executed.

For example, if the item weight is 50 grams, there is only one 50 gram item in the user's shopping database, M = 1. If the item weighs 200 grams, but there are two 200 grams of items, three 100 grams of items, one for each of the five items, in the shopping database of the user, the item placed on the shelf may be one 200 grams of items (two possibilities), or two 100 grams of items (three possibilities), for a total of five possibilities, M = 5. If the weight of the goods is 185 g, no 185 g goods exist in the shopping database of the user, and M =0, the goods is judged to be foreign matters, such as a mobile phone of the user.

The foreign matter refers to other goods which do not belong to the convenience store, and the goods are not originally placed on the shelf of the convenience store. When the kind of an article is determined as foreign matter, the electronic device may send an alarm signal.

S12, a contour comparison step, namely judging whether the contour of the tray area with the changed weight is consistent with the contour of at least one goods in the shopping database of the user for placing the goods, if so, judging that the contour of the goods placed on the shelf is the same as the contour of the goods, and acquiring N possible results of the types of the goods placed on the shelf; if not, the goods placed on the shelf are judged to be foreign matters if the weight of the goods placed on the shelf is the same as that of one kind of goods in the user shopping database but the outline of the goods is different.

For example, if the outline of the bottom surface of the article placed on the shelf is a square with a side length of 12 cm, the bottom surface of only one article in the shopping database of the user is a square with a side length of 12 cm, and the weight of the article is the same as that of the article placed on the shelf, the article can be considered as the article placed on the shelf. If the bottom surface of the article placed on the shelf is a circle with a diameter of 10 cm, but the bottom surface of four kinds of articles in the shopping database of the user is a circle with a diameter of 10 cm, it can be considered that the article may be one of the four kinds of articles, N = 4. If the outline of the bottom surface of the goods placed on the shelf is a strip shape with the length of 20 cm and the width of 3 cm, but the outline of the bottom surface of the goods is not the same as that of the goods in the shopping database of the user, and N =0, the goods is judged to be foreign matters and possibly articles carried by the user, such as umbrellas.

The sequence of steps S11 and S12 may be changed back and forth, or executed synchronously without mutual influence. In step S11 or S12, when M =0 or N =0, it may be determined that the placed article is a foreign matter.

And S13, a type judging step of the returned goods, when M is greater than 0 and N is greater than 0, the type of the goods can be further determined by combining the possibility results respectively obtained in the steps S11 and S12, and if the weight and the outline of the goods placed on the shelf are the same as those of one or more goods in the user shopping database, the goods placed on the shelf can be inferred to be the goods. For example, it is known that the weight of the article is 200 g in step S11, and the outline of the bottom surface of the article is a circle having a diameter of 10 cm in step S12; if the bottom contour of just one article of the five possibilities of step S11 is a circle having a diameter of 10 cm, or if the weight of just one article of the four possibilities of step S12 is 200 g, the type and number of articles to be placed back can be determined.

In a typical situation, the total number of items purchased by a user in a convenience store is typically less than 10, and occasionally reaches 10 to 20. In the case of a small sample size, the probability that the weight and profile of the goods placed on the shelf are the same as those of one or more goods in the user shopping database is basically the only possibility, and the type and number of the goods placed on the shelf can be determined by performing the above steps S11-13.

If the possible results of the types and the numbers of the goods placed on the shelves are not unique after the step S11-13 is performed, two or more possible results exist, and the differences between the possible results can be further recognized by combining with other goods recognition technologies, so as to accurately determine the types and the numbers of the goods. Other article identification techniques include: the computer vision technology is used for further judging the type of goods by utilizing real-time images of the goods; the RFID technology is that RFID labels are arranged on different goods, and the radio frequency identification technology is used for judging the types of the goods, and the like. And S14, a second database updating step, namely updating the shopping database of the user, and deleting the goods information corresponding to the goods from the shopping database of the user who puts back the goods, so that the actual shopping situation of the user is consistent with the information of the shopping database. And updating the goods database, and if the goods placed on the shelf are not foreign matters, storing the weight of each goods placed on the shelf, the bottom contour, the goods type and the column (namely the column number with the changed weight) as a group of goods information into the goods database.

Searching a column number corresponding to the goods from the goods database according to the type of the goods placed on the shelf, judging whether the column number corresponding to the goods of the type is consistent with the column number with changed weight, if so, judging that the goods are placed on the correct column, and only recording the quantity change condition of the goods in the goods database; if not, the goods are judged to be placed in the wrong column, the information of the misplaced goods is added in the goods information corresponding to the column in the goods database except for the original goods, and the goods type, the single-goods weight, the column and the bottom contour of each goods placed on the shelf are stored into the goods database as a group of goods information. When an article is misplaced to the wrong column, optionally, the electronic device sends an alarm signal.

The steps S1 to S4 are all hardware setting steps, and the steps S5 to S14 are all data processing steps executed by the electronic device 20.

As shown in fig. 8, the article identification method of the present invention further includes a user identification obtaining step for obtaining the identification of the user who takes or places the article, including the following steps S15-S17 performed by the electronic device 20. Steps S15-S16 are performed before the tray parameter collecting step S6, and step S17 is performed after the tray parameter collecting step S6.

And S15, a user identity identification step, namely identifying the identity information of each user. The user uses the mobile phone APP software to complete user registration, register identity information and a bank account for payment, and can use the mobile phone to generate a two-dimensional code to indicate the identity when preparing to enter a store. When a user enters a store, the electronic device acquires the two-dimensional code of the user according to a two-dimensional code reader at a gate at the store door so as to acquire the identity of each user entering the convenience store.

And S16, a shopping database generating step, namely generating a shopping database of each user according to the identity information of each user. The electronic device generates a shopping database for each user scanning into the store, and the shopping database is used for recording shopping information of the user in the convenience store.

In the tray parameter collecting step S6, if the weight variation value of the tray is a non-zero number, the following step S17 is required after step S6.

S17, a user identity judging step, namely judging the identity of the user taking or placing the goods and updating the shopping database. When the weight change value is less than 0, judging the identity of the user taking away the goods; and when the weight change value is larger than 0, judging the identity of the user for placing the goods. When the weight change value is less than 0, in the following step S9, the information of the removed item of the user who removed the item is recorded in the shopping database of the user. When the weight change value is greater than 0, calling a shopping database of a user who placed an item in subsequent steps S11-S12; in the following step S14, the information that the user placed the article is deleted from the shopping database of the user.

The pressure blanket is arranged on the upper surface of the tray of the conventional goods shelf, and the weight, the position, the bottom surface contour and other information of each goods placed on the pressure blanket are acquired in real time by utilizing a pressure sensor matrix in the pressure blanket. When goods are taken away from the shelf tray by a user, storing the weight and the bottom profile information of each taken-away goods into a shopping database of the user in real time; when a user places a certain goods on a shelf tray, the shopping database of the user is called in time, the weight and the bottom profile of the goods are compared with the shopping database of the user, the weight and the bottom profile of the goods are compared, and therefore whether the goods are the goods taken away by the user before or not is judged, and the type and the quantity of the goods are judged. In most cases, the electronic equipment can solve the problem of wrong taking and putting through the method, and even if a user places a commodity in a wrong column, the shopping record of the commodity can be deleted from the shopping database of the user in time, so that the condition that the shopping database of the user is consistent with the real shopping condition is ensured.

The invention has the beneficial effects that the goods identification system, the goods identification method and the electronic equipment are provided, the weight and the bottom surface outline of each goods on the tray are obtained and recorded in a mode of installing the pressure blanket on the upper surface of the tray, and the tray area outline and the weight change value of which the weight changes on each tray are collected in real time. When goods are taken away from a goods shelf tray or put back to the goods shelf tray, the type and the quantity of the goods can be timely and accurately judged, the shopping database of the user is updated in real time, the shopping record of the user in the shopping database is consistent with the real shopping condition, the accurate settlement for each user is ensured, the secondary sale of the misplaced goods is not influenced, and the technical problem that the shopping database is mistaken because the user places the goods in the wrong column position is effectively solved.

The goods shelf used in the invention has a structure similar to that of the existing goods shelf, only a pressure blanket is needed to be arranged on a common tray, and the tray is not needed to be specially made into a piano type structure with completely separated columns, so that the cost of the goods shelf can be effectively reduced; and the column field width of each tray is adjustable, can be used for putting not unidimensional goods, and it is more to be suitable for the scene, for the piano type tray, can effectively reduce operation and administrative cost.

The above description is only of the preferred embodiments of the present invention to make it clear for those skilled in the art how to practice the present invention, and these embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications and enhancements can be made without departing from the principles of the invention, and such modifications and enhancements are intended to be included within the scope of the invention.

Claims

1. A method of identifying an item, comprising the steps of:

constructing an article database for storing article information of each article placed on a tray of a shelf, wherein the article information comprises the type, the weight, the position column and the bottom contour of each article;

collecting the weight change value of each tray in real time; when the weight change value is a non-zero value, recording tray parameters including the weight change value, a column where the weight is changed and a tray area outline where the weight is changed; and

judging whether the weight change value is less than 0, if so, judging that goods are taken away from a tray of a shelf, judging the type and the number of the taken-away goods according to the tray parameters and the goods information, and storing the type, the number and the bottom surface outline of the taken-away goods to a shopping database of a user taking away the goods; if not, judging that goods are placed on the tray of the goods shelf, judging the type and the quantity of the goods placed on the goods shelf according to the tray parameters and the shopping database of the user placing the goods, and deleting the goods information corresponding to the goods from the shopping database of the user placing the goods.

2. The article identification method according to claim 1,

the step of judging the type and the quantity of the taken goods according to the tray parameters and the goods information specifically comprises the following steps:

comparing the serial numbers of the columns with the changed weights with the serial numbers of the columns in which the goods are located in the goods database to obtain the types of the goods which are taken away; and

and calculating the quotient of the absolute value of the weight change value and the single-item weight of the type of the goods in the goods database, and rounding the quotient to obtain the number of the taken-away goods.

3. The article identification method according to claim 1,

the step of judging the type and the quantity of the goods placed on the shelf comprises the following steps:

judging whether the weight change value is the same as the weight of one article or the total weight of a plurality of articles in a shopping database of a user placing the article; if yes, M possible results of the types and the number of the goods placed on the goods shelf are obtained; if not, the goods are judged to be foreign matters.

4. The article identification method according to claim 1,

judging whether the outline of the tray area with the changed weight is consistent with the outline of at least one item in a shopping database of a user for placing the item; if yes, N possible results of the types and the number of the goods are obtained; if not, the goods are judged to be foreign matters.

5. The article identification method according to claim 1,

judging whether the weight of the goods is the same as the weight of at least one goods in a shopping database of a user placing the goods; if yes, obtaining M possible results of the types and the quantity of the goods placed on the goods shelf, namely weight comparison results;

judging whether the outline of the tray area with the changed weight is consistent with the outline of at least one item in a shopping database of a user for placing the item; if so, acquiring N possible results of the types and the quantity of the goods, namely the contour comparison result; and

and comparing the weight comparison result with the outline comparison result, and if one of the weight comparison result and the outline comparison result is the same as the other one, determining the type and the number of the goods placed on the shelf.

6. The article identification method of claim 1, further comprising the steps of:

identifying identity information of each user;

generating a shopping database of each user according to the identity information of each user; and

when the weight change value is less than 0, judging the identity of the user taking away the goods; and when the weight change value is larger than 0, judging the identity of the user for placing the goods.

7. The article identification method according to claim 1,

the method comprises the following steps of:

initializing a goods database, and inputting the column number of each tray to the goods database;

inputting the goods information corresponding to each column into the goods database, wherein the goods information comprises the kind and the single weight of the goods corresponding to the column; and

collecting the bottom surface outline of each kind of goods and storing the bottom surface outline to the goods database; when an article is placed on a tray, the outline of the area where the weight of the tray changes is the outline of the bottom surface of the article.

8. The article identification method of claim 1, further comprising the steps of:

when the weight change value is less than 0, deleting the information of the goods which are taken away from the goods database;

when the weight change value is larger than 0, if the goods placed on the shelf are not foreign matters, the goods type, the single-goods weight, the located column and the bottom contour of each goods placed on the shelf are stored to the goods database as a group of goods information.

9. The article identification method of claim 1, further comprising the steps of:

searching a column corresponding to the goods from the goods database according to the types of the goods placed on the shelf;

judging whether the column corresponding to the goods of the type is consistent with the column with the changed weight;

if so, judging that the goods are placed in the correct column;

if not, the goods are judged to be placed in the wrong column, and an alarm signal is optionally sent out.

10. The article identification method according to claim 1,

the bottom surface profile of the article comprises the shape and size of the bottom surface of the article; and

the profile of the tray area with the changed weight comprises the shape and the size of the tray area with the changed weight.

11. The article identification method according to claim 1,

before the step of building the goods database, the method also comprises the following steps:

arranging at least one shelf, wherein each shelf comprises a plurality of trays, and each tray is divided into at least one column;

arranging a pressure blanket on the upper surface of each tray, and connecting the pressure blanket to an electronic device; and

at least one goods is placed in the at least one tray, and the bottom surface of each goods contacts the top surface of the pressure blanket.

12. An electronic device, comprising:

a memory for storing executable program code; and

a processor connected to the memory for executing a computer program corresponding to the executable program code by reading the executable program code to perform the steps of the item identification method according to any of claims 1-9.

13. An item identification system comprising the electronic device of claim 12.

14. The item identification system of claim 13, comprising:

at least one shelf, each shelf including a plurality of trays, each tray being divided into a plurality of columns for holding items; and

at least one pressure blanket attached to the upper surface of each tray and connected to an electronic device; the pressure blanket is used for acquiring the weight change value of the tray, the column with the weight change and the outline of the tray area with the weight change in real time.

15. The item identification system of claim 14,

the pressure blanket includes a plurality of pressure sensors that are evenly distributed.

16. The item identification system of claim 14, further comprising:

the separator is detachably arranged above each tray and is used for separating the tray into a plurality of columns.