CN113591594A - Weighing processing method and device and electronic equipment - Google Patents

Weighing processing method and device and electronic equipment Download PDF

Info

Publication number
CN113591594A
CN113591594A CN202110765567.8A CN202110765567A CN113591594A CN 113591594 A CN113591594 A CN 113591594A CN 202110765567 A CN202110765567 A CN 202110765567A CN 113591594 A CN113591594 A CN 113591594A
Authority
CN
China
Prior art keywords
visual
material information
commodity
weighing
visual material
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110765567.8A
Other languages
Chinese (zh)
Inventor
冯梦远
沈健
刘佳睿
谭耀辉
王树春
周韫文
张远
刘巍
朱瑜
刘凯
姜军
李�诚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hema China Co Ltd
Original Assignee
Hema China Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hema China Co Ltd filed Critical Hema China Co Ltd
Priority to CN202110765567.8A priority Critical patent/CN113591594A/en
Publication of CN113591594A publication Critical patent/CN113591594A/en
Priority to PCT/CN2022/103618 priority patent/WO2023280098A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/5866Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Library & Information Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Cash Registers Or Receiving Machines (AREA)

Abstract

The embodiment of the application discloses a weighing processing method, a weighing processing device and electronic equipment, wherein the method comprises the following steps: acquiring a visual material information base of the commodity object, wherein the visual material information base comprises first visual material information of a commodity body corresponding to the commodity object and second visual material information of an additional mark; carrying out visual characteristic acquisition on the goods body and the additional mark corresponding to the weighing object; and comparing the collected visual characteristic information with the visual material information in the material information base, and identifying the commodity object of the weighing object. Through this application embodiment, can promote the efficiency of weighing, reduce the reliance of the subjective judgement of weighing operator.

Description

Weighing processing method and device and electronic equipment
Technical Field
The present disclosure relates to the field of intelligent weighing technologies, and in particular, to a weighing processing method and apparatus, and an electronic device.
Background
When the intelligent weighing equipment is used for weighing in an entity shop, the visual characteristic collection can be carried out on the weighing object through the visual detection capability equipped in the equipment, and then the weighing object is matched with the visual characteristics of the commodity object materials stored in the database, so that which specific commodity object in the system corresponds to the current weighing object is identified, the unit price can be determined, and the amount to be paid is calculated according to the weighing result.
It can be seen that, in the above intelligent weighing process, the visual features of the material of the commodity object are used as important bases for identifying the weighing object, for example, the specific material of the commodity object may include a photograph of the commodity object, and the specific visual features may include color features, shape/contour features, texture features, spatial relationship features, and the like. However, in practical applications, commodity objects with similar visual characteristics are often encountered. For example, bananas are also used, but different brands of bananas correspond to different merchandise objects, and accordingly, unit prices are different, however, bananas of different brands may have a high similarity in visual characteristics. In this case, when identifying the heavy objects from the pre-stored material of the commodity objects, there is a problem that it is impossible to specify which commodity object corresponds specifically. In order to solve this problem, the prior art deals with a method of displaying a plurality of commodity objects with similar visual features to a weighing operator for selection. That is, assuming that the weighing object is a banana, but there are two brands of bananas in the system, corresponding to different commodity objects, at which point both commodity objects may be returned to the weighing operator from which they are selected. Obviously, this increases the workload of the weighing operator, and the weighing efficiency is low; moreover, since the weighing operator can only make a judgment by visual observation or by combining his own experience, there may be a case of a wrong judgment, which may result in a loss of the consumer user or the merchant.
Therefore, how to further improve the weighing efficiency and reduce the dependence on subjective judgment of the weighing operator for the condition that a plurality of commodity objects with similar visual characteristics exist becomes a technical problem to be solved by the technical personnel in the field.
Disclosure of Invention
The application provides a weighing processing method and device and electronic equipment, which can improve weighing efficiency and reduce the dependence on subjective judgment of weighing operators.
The application provides the following scheme:
a weighing processing method, characterized by comprising:
acquiring a visual material information base of the commodity object, wherein the visual material information base comprises first visual material information of a commodity body corresponding to the commodity object and second visual material information of an additional mark;
carrying out visual characteristic acquisition on the goods body and the additional mark corresponding to the weighing object;
and comparing the collected visual characteristic information with the visual material information in the material information base, and identifying the commodity object of the weighing object.
Wherein the second visual material information is visual material information independent of the first visual material information.
The first visual material information and the second visual material information corresponding to the same commodity object are recorded into the visual material information base at different time points.
Wherein, the additional mark corresponding to the same commodity object is not fixed;
the method further comprises the following steps:
and after receiving new second visual material information submitted for the specified commodity object, updating the corresponding relation between the specified commodity object and the second visual material information.
The additional marks are used for enhancing the first visual material information, and the plurality of commodity objects similar to the first visual material information correspond to different additional marks so as to distinguish and identify the plurality of commodity objects similar to the first visual material information.
Different additional marks corresponding to the plurality of commodity objects with similar first visual material information have different feature values on the same visual feature dimension;
the goods body and the additional mark that the symmetrical heavy object corresponds carry out visual characteristics and gather, include:
when the visual characteristic information of the additional mark corresponding to the weighing object is acquired, only the visual characteristic acquisition is carried out on the additional mark from the same visual characteristic dimension;
the commodity object identification of the weighing object comprises:
determining a plurality of matched commodity objects by comparing the visual characteristics of the commodity body with the first visual material information in the visual material information base;
and comparing the characteristics of the additional marks acquired from the same visual characteristic dimension with second visual material information corresponding to the plurality of commodity objects, and determining the identification of the target commodity object matched with the weighing object.
Wherein, the different additional marks corresponding to the plurality of commodity objects with similar first visual material information have different colors, shapes or numbers.
Wherein the same additional indicia may be multiplexed between different merchandise objects for which the first visual material information is dissimilar.
The additional mark is used for being attached to or drawn on the goods body, or placed on a goods shelf for stacking the goods body, or laid in a container for bearing a weighing object.
Wherein the performing of the commodity object identification on the weighing object comprises:
comparing the acquired visual characteristics of the goods body corresponding to the weighing object with the first visual material information in the visual material information base to determine a matched goods object;
and if the matched commodity objects are multiple, providing a commodity object identification result according to the second visual material information corresponding to the matched commodity objects.
Wherein, according to the second visual material information corresponding to the matched multiple commodity objects, providing a commodity object identification result, and the method comprises the following steps:
comparing the collected visual features of the additional marks with second visual material information corresponding to the plurality of commodity objects, and determining matched target commodity objects;
or,
and displaying the matched commodity objects, and performing enhanced display on second visual material information corresponding to the commodity objects respectively so that a weighing operator can select the commodity objects according to the second visual material information.
A commodity object material information processing method comprises the following steps:
providing an operation option for submitting additional marking-related visual material for the merchandise object;
after receiving visual materials of additional marks related to a target commodity object through the operation options, storing the visual materials into a commodity object visual material information base so as to determine a commodity object matched with the weighing object in a mode of comparing collected visual characteristic information with visual material information in the visual material information base when the commodity object is identified by the weighing object, wherein the collected visual characteristic information comprises: visual characteristic information of an additional mark associated with the weighing object.
Wherein, still include:
and comparing the similarity of the visual material information of the goods body corresponding to the multiple goods objects under the same category, and if the similarity reaches a target threshold value, providing prompt information for submitting the visual material information related to the additional marks for the multiple goods objects.
A weighing processing device comprising:
the visual material information base acquisition unit is used for acquiring a visual material information base of the commodity object, wherein the visual material information base comprises first visual material information of a commodity body corresponding to the commodity object and second visual material information of an additional mark;
the visual characteristic acquisition unit is used for acquiring visual characteristics of the goods body and the additional mark corresponding to the weighing object;
and the weighing object identification unit is used for comparing the acquired visual characteristic information with the visual material information in the material information base to identify the commodity object of the weighing object.
An apparatus for processing material information of a commodity object, comprising:
an operation option providing unit for providing an operation option for submitting the visual material related to the additional mark for the commodity object;
the visual material receiving unit is used for storing the visual material which is an additional mark related to a target commodity object into a commodity object visual material information base after receiving the visual material through the operation options, so that when a weighing object is identified, the commodity object matched with the weighing object is determined in a mode of comparing the collected visual characteristic information with the visual material information in the visual material information base, wherein the collected visual characteristic information comprises: visual characteristic information of an additional mark associated with the weighing object.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any of the preceding claims.
An electronic device, comprising:
one or more processors; and
a memory associated with the one or more processors for storing program instructions that, when read and executed by the one or more processors, perform the steps of the method of any of the preceding claims.
According to the specific embodiments provided herein, the present application discloses the following technical effects:
through the embodiment of the application, the second visual material information of the additional mark can be added on the basis of the first visual material information of the goods body stored in the visual material information library of the commodity object. Therefore, when the weighing object is visually identified, the visual characteristics of the goods body corresponding to the weighing object and the visual characteristics of the additional mark in two aspects can be collected, and the identification result is provided through the first visual material information and the second visual material information stored in the material library. By the method, the commodity object corresponding to the weighing object can be rapidly and accurately identified, the weighing efficiency is improved, and the dependence on the subjective judgment of a weighing operator can be reduced.
Of course, it is not necessary for any product to achieve all of the above-described advantages at the same time for the practice of the present application.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
FIG. 1 is a schematic diagram of a system architecture provided by an embodiment of the present application;
FIG. 2 is a flow chart of a first method provided by an embodiment of the present application;
FIG. 3 is a flow chart of a second method provided by embodiments of the present application;
FIG. 4 is a schematic diagram of a first apparatus provided by an embodiment of the present application;
FIG. 5 is a schematic diagram of a second apparatus provided by an embodiment of the present application;
fig. 6 is a schematic diagram of an electronic device provided in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments that can be derived from the embodiments given herein by a person of ordinary skill in the art are intended to be within the scope of the present disclosure.
In the process of implementing the present application, the inventor of the present application finds that although some goods objects have similarities in visual materials in specific goods bodies, for example, bananas of different brands have similar fruit shapes, colors, sizes, and the like, some additional identification materials may be associated with specific goods, and some differences may exist in vision among different goods objects. For example, also two different brands of bananas, one of which may be distinguished from the other without a "fruit mark" because of the "fruit mark" (a label or the like affixed to the fruit body for displaying a specific brand identification (e.g., logo, etc.)), and so on. Of course, in addition to the "effect mark", the enhancement of the visual characteristics of the goods body corresponding to different goods objects can be realized by providing additional marks and the like specially used for visual identification for specific goods objects.
Therefore, in the embodiment of the present application, in the visual material library for the commodity object, in addition to the visual material of the goods body corresponding to the specific commodity object, the visual material of the additional identification material associated with the commodity object may be stored. Like this, when the weighing object carries out commodity object discernment, except can gathering the visual characteristic of the goods body that the weighing object corresponds, can also gather the visual characteristic of specific additional identification material. If a plurality of commodity objects with similar visual characteristics of the commodity body exist, the identification and the distinguishing of the similar commodity objects can be realized through the additional identification material.
Of course, in the specific implementation, besides the "fruit mark" as the specific additional mark, there may be other ways, for example, other marks that can be attached (for example, attached or drawn) to the goods body, or other mark materials that can be placed on a "stack head" or other goods shelf for stacking specific goods, or other mark materials that can be laid in a tray or other vessel (a specific weighing object is placed in the vessel and then placed together with the vessel on a weighing device for weighing), and so on. In summary, such additional markings can be picked up by the visual pick-up means of the weighing device along with the goods body and can have a certain degree of distinction in terms of visual characteristics between different goods objects.
It should be noted that the embodiments of the present application relate to the following concepts: the meaning of the several concepts will be first introduced below for the convenience of understanding of the merchandise objects, weighing objects, goods, and goods bodies.
The commodity object mainly refers to the expression of a specific commodity from a data level in a specific information system. For example, a certain merchant issues a commodity to a certain information system, and accordingly, the information system may generate a corresponding commodity object, and may also provide a unique identifier in the system, including a commodity ID, for the commodity object. In addition, in the information system, a specific commodity object may be associated with various attribute information including price, unit price, and the like.
The goods and the goods objects distributed in the information system correspond to specific physical entities in specific physical stores, and such physical entities may be the "goods" described in the embodiments of the present application, for example, the goods object with the ID "1000012" in the information system, and the corresponding goods in the physical stores are "bananas" of a certain brand. The goods are tangible and weighted, and the visual materials related to specific goods objects are collected in modes of photographing the goods and the like.
The article body, i.e. the specific article itself, e.g. the fruit body itself of bananas, etc.
The object of weighing, it is the object of carrying out the weighing to place on weighing equipment, that is to say, it is the goods in the entity shop to actually place on the object of weighing, carries out visual characteristic collection (this application embodiment, specifically including the visual material collection to goods body and additional mark material) to goods through intelligent weighing equipment to compare with the material in the material storehouse, determine corresponding commodity object, realize the commodity object discernment of symmetrical heavy object with this.
From the perspective of system architecture, as shown in fig. 1, the embodiment of the present application may relate to an intelligent weighing device, where the intelligent weighing device may include a hardware portion and a software portion, where the software portion may further be divided into a client and a server, where the client operates in a weighing device terminal, and the server may operate in a cloud server. The specific visual materials can be stored in a material database of the server, the client is used for collecting the visual characteristics of the weighing object and uploading the visual characteristics to the server, the server identifies the corresponding commodity object information and returns the commodity object information to the client, and the client can display the identification result through a display screen associated with the weighing equipment. Of course, in another implementation, the specific material database may also be stored locally on the weighing device, so that the identification of the commodity object may be performed locally on the weighing device.
In this embodiment, the material information stored in the specific material database may include visual materials of the article body, and may also include visual materials of associated additional marks. In particular implementations, the particular visual material may be provided by a merchant (e.g., a store manager in a particular brick and mortar store, etc.), and to this end, a workstation may also be provided for the merchant user to upload and update, edit, etc. the particular visual material.
In addition, in practical application, when commodity object information is specifically provided for a consumer user, richer information can be provided for the consumer user by utilizing the material information stored in the specific material database, so as to help the consumer user to make a selection or purchase decision of a commodity object.
The following describes in detail a specific technical solution provided in an embodiment of the present application.
Example one
First, from the perspective of a weighing device, the embodiment provides a weighing processing method, specifically, an execution subject of the method may be a server or a client shown in fig. 1, and referring to fig. 2, the method may include:
s201: and acquiring a visual material information base of the commodity object, wherein the visual material information base comprises first visual material information of the commodity body corresponding to the commodity object and second visual material information of the related additional mark.
In the prior art, visual material information of an article body corresponding to a commodity object is usually only stored in a material library, and the visual material information includes a picture of the article body uploaded by a merchant and the like. In the embodiment of the present application, in order to further identify or distinguish the commodity objects with similar appearances, visual material information of the additional marks corresponding to the commodity objects may be stored in the material library. Specifically, the visual material information of such additional marks may also be submitted by a merchant, for example, the merchant (e.g., staff in a physical store, etc.) may take a picture of the additional marks related to the specific merchandise objects and enter the picture into the visual material information base.
It should be noted that, since a specific weighing scene usually occurs in a physical store, different merchandise objects sold in different physical stores may be different, or the same merchandise object may correspond to different additional marks, etc., a specific visual material library may be created and maintained in a physical store unit, that is, each physical store may have a respective visual material information library. Of course, in another mode, if there are linked stores, etc., different physical stores may sell the same commodity object in a unified manner, and the same commodity object may use the same additional mark in a unified manner, a plurality of physical stores may share the same visual material information base. Alternatively, there may be a case where the product objects or the added marks are partially identical and partially different from each other between different physical stores, and in this case, the same visual material information base may be shared among a plurality of physical stores, and the applicable physical store range may be determined by associating the corresponding physical store identifier with the different physical store identifier, for example.
In a specific implementation, a workbench can be provided for a merchant user, so that the merchant user can upload, update or edit specific additionally marked visual materials. Specifically, for the first visual material information of the goods body associated with the same commodity object and the second visual material information of the additional mark, the two visual material information can be mutually independent and can be recorded into the visual material information base together, or can be recorded into the visual material information base at different times respectively. For example, the merchant only uploads the first visual material information of the goods bodies corresponding to the goods objects initially, then finds that the goods bodies of some goods objects are similar to each other and are difficult to distinguish, and then uploads the visual material information related to the additional marks for the similar goods objects, and the like. That is, the visual material related to the additional mark may be independent of the visual material of the article body, and the same commodity object may correspond to two pieces of visual material information in the material information base, corresponding to the article body and the additional mark, respectively. The two pieces of visual material information can be used for quickly identifying and distinguishing a plurality of commodity objects similar in appearance of the goods body.
The specific additional marks may be various, for example, as described above, the specific additional marks may include additional marks (e.g., fruit marks, etc.) attached to the goods body, or additional marks (e.g., price tags placed at the top of a stack, etc.) placed on a shelf for stacking the goods, or additional marks laid in a container for carrying a weighing object (e.g., relatively small fruits such as strawberries, although non-standard goods weighed in bulk, but may be packaged in advance in containers such as baskets, pots, etc., the weight of the fruits in each container is different, the price needs to be determined after the specific weighing, the containers may also have some packing paper, etc., and in this case, the packing paper may also become the additional marks in the embodiment of the present application), and so on. In particular, the additionally marked visual materials can be collected by a merchant by taking a picture and the like and submitted to the system.
It should be noted here that, regarding the specific fruit mark, the packing paper in the container, etc., which are usually provided by the brand of the commodity object, the visual feature of the specific mark may be relatively complex, and may even directly include information such as a specific trademark pattern, etc., so that the specific commodity object can be directly identified according to the visual feature of the additional mark. For example, a certain brand of apples may be each apple body stuck with a fruit label, and the fruit label carries a brand pattern of the brand, so that even if the visual characteristics of the apple bodies are not relied on, the corresponding weighed apples can be distinguished through the fruit label, and can be distinguished from other brands of apples, and the like.
However, in practical applications, because the visual features of the additional marks such as fruit marks are relatively complex, the requirements on computing resources are relatively high when feature acquisition and subsequent comparison are performed on the additional marks, and even relatively long computing time is required. In the embodiment of the application, the commodity object is identified in the intelligent weighing scene, the computing resources of the intelligent weighing equipment are possibly limited, and meanwhile, the tolerance of computing time consumption is low, so that if the effect mark is directly used as an additional mark, the weighing efficiency is possibly reduced.
For this reason, in a more preferred embodiment, an additional mark specially used for visual identification during weighing may be provided for the commodity object, such an additional mark may be used to enhance the first visual material information of the article body, and by corresponding different additional marks to a plurality of commodity objects with similar first visual material information, the plurality of commodity objects with similar first visual material information are distinguished and identified. That is, the visual characteristics of the goods body can be used for preliminary screening of the goods objects, and then the visual characteristics of the additional marks are used for further determining the matched goods objects from the preliminary screening result.
In such an implementation, the particular additional indicia may have relatively simple visual characteristics, for example, additional indicia of different colors, different shapes, different numbers may be used for multiple merchandise objects that are relatively confusing in terms of the visual characteristics of the article body. The additional indicia may be in a variety of specific forms, such as a sticker, even a color or pattern drawn with a marker pen, and the like. For example, three kinds of apples exist in a store, which are easily confused in appearance, and in this case, red, green and yellow stickers may be attached to the three kinds of apples as additional marks for the purpose of distinguishing them in weighing. In this way, when weighing, it is possible to distinguish which particular apple is by identifying the colour of the particular additional mark.
That is, multiple merchandise objects with similar first visual material information may correspond to different additional indicia, which may have different feature values in the same visual feature dimension. Such as the colors, shapes, numbers, etc., described above. Like this, when the additional mark of weighing object carries out the feature acquisition, can only follow this same visual characteristic dimension carry on the collection of visual characteristic can, follow-up when carrying out the feature comparison, can utilize first visual material information, a plurality of possible commodity objects are tentatively identified, then, follow this same visual characteristic dimension mode of comparing, compare the feature of additional mark and second visual material information to this determines the commodity object of concrete and current weighing object matching. In this way, the feature acquisition and comparison process can be simplified.
In the manner of commodity object identification of the weighing object by means of a simple additional mark added specifically, since the additional mark is used only for further distinction from a plurality of preliminarily determined commodity objects after comparison based on the visual characteristics of the article body. Thus, multiplexing of the same additional mark between different merchandise objects whose first visual material information is dissimilar can also be achieved. For example, three easily confused apples in a certain store can use stickers of three different colors, red, green and yellow, as additional marks, and when weighing is performed, firstly, the possible three apples are identified through the visual characteristics of the weighing object, and then, the specific apple can be further determined through the color of the additional mark associated with the weighing object. In addition, there are three kinds of bananas in the store, which are easy to confuse, and since the visual features of the banana body are clearly different from those of the apple, the three kinds of bananas can also use stickers of three different colors, namely red, green and yellow, as additional marks, and the like.
In addition, in a specific implementation, the additional mark corresponding to the same commodity object may be non-fixed. For example, in the aforementioned case of using a single color sticker as an additional mark, a certain brand of apple uses a yellow sticker as an additional mark on the first day, may also use a green sticker as an additional mark on the second day, and so on, as long as it is ensured that a plurality of merchandise objects having similar visual characteristics of the article body have different additional marks within the same time period.
That is, the second visual material information of the specific commodity object stored in the visual material information base is the visual material information corresponding to the additional mark currently used by the specific commodity object. When the additional mark of the specific commodity object changes, the specific merchant can update the second visual material information corresponding to the commodity object through the workbench. That is, specifically, after receiving new second visual material information submitted for a specified commodity object, the correspondence between the specified commodity object and the second visual material information may be updated.
It should be noted that, in practical applications, it is not necessary to provide visual materials related to the additional mark for all the commodity objects, but only the commodity objects with similarity on the visual materials of the commodity body can be further identified or distinguished through the visual materials related to the additional mark. Therefore, the visual material information related to the part of the commodity objects can be selectively marked according to specific requirements. In addition, in an optional implementation manner, the server and the like may also calculate the similarity between the visual materials of the goods body associated with different goods objects, and if it is found that some goods objects have similarities on the visual materials of the goods body, and situations such as being indistinguishable or being incorrectly identified may occur, a prompt may be given to the associated merchant user, so as to prompt the merchant user to supplement visual material information related to the additional mark for the goods objects, and the like.
S202: and carrying out visual feature acquisition on the goods body corresponding to the weighing object and the related additional marks.
Because the visual materials of the goods body and the additional marks are stored in the material information base, when the intelligent weighing equipment is used for weighing goods, the goods body corresponding to the weighing object and the related additional marks can be subjected to visual characteristic collection. During concrete implementation, in order to facilitate visual feature acquisition of the goods body and the weighing object, the additional mark can be placed on the weighing platform when the goods body corresponding to the weighing object is placed on the weighing platform of the weighing equipment, so that the additional mark can enter the detection range of the visual detection device of the weighing equipment. Wherein this condition can naturally be satisfied if the specific additional mark is attached to the article body, or laid in a specific container, or the like. If the additional marking is a price tag or the like placed on a shelf such as a "stack head", it is also possible to place such a price tag on the weighing platform in addition to the weighing object when it is placed on the weighing platform, so that its visual characteristics can be detected by the visual detection means of the weighing apparatus. Since many of such price tags and the like exist in the form of "cards" and the like, the weight thereof has a negligible influence on the weight of the weighing object. Of course, if the weight of a particular additional marker itself is large, it may not necessarily be placed on the weighing apparatus's platform, but such additional marker may be held by the weighing operator after the weighing object is placed on the platform, so that its visual characteristics can be acquired, and so on.
Wherein, in the process of carrying out visual characteristic collection, visual characteristic's collection can be carried out from a plurality of dimensions with regard to the visual characteristic of specific goods body. And regarding the visual characteristics of the additional marks, the plurality of commodity objects with similar first visual material information are distinguished by adopting different additional marks, and under the condition that the different additional marks have different characteristic values in the same visual characteristic dimension, the visual characteristics can be acquired only from the same visual characteristic dimension.
During specific implementation, the area of the additional mark is usually smaller and possibly blocked by the goods body, and the like, so that the completeness, the definition and the like of the visual feature acquisition of the additional mark can be judged, and if the additional mark is not required, prompt information can be provided to prompt a weighing operator to adjust the placing position of the goods body or the additional mark and the like, so that the acquired visual feature of the additional mark can meet the requirement.
S203: and comparing the collected visual characteristic information with the visual material information in the material information base, and identifying the commodity object of the weighing object.
Because the visual characteristics of the goods body and the related additional marks are collected, the weighing object can be identified by comparing the collected visual characteristic information with the visual material information in the material information base. That is, it is determined which commodity object in the system specifically corresponds to the current weighing object, so as to determine information such as unit price, product name, and the like, and further generate tag information for settlement, and the like.
Specifically, when the weighing object is identified, two kinds of visual characteristic information can be compared with the visual material at the same time, or in another implementation mode, the collected visual characteristic of the goods body corresponding to the weighing object can be compared with the first visual material information in the visual material information base at first to determine the matched goods object. And if the matched commodity objects are multiple, providing a commodity object identification result according to the second visual material information corresponding to the matched commodity objects. For example, the collected visual features of the additional marks may be compared with the second visual material information corresponding to the plurality of commodity objects, so as to determine a matching target commodity object. That is, the first visual material information may be utilized to perform preliminary commodity object identification, and if a plurality of similar commodity objects are found, the second visual material information may be utilized to further identify or distinguish the target commodity object matching the current weighing object from the plurality of similar commodity objects. In this way, the recognition result ultimately returned to the weighing operator for confirmation may include only the target merchandise object.
Or, in another mode, the preliminarily identified and matched plurality of commodity objects may be displayed, and second visual material information corresponding to each of the plurality of commodity objects is displayed in an enhanced manner (for example, the logo is displayed in an enlarged manner, and the like), so that the weighing operator may select the plurality of commodity objects according to the second visual material information. That is, after the preliminary identification is completed, if a plurality of similar commodity objects are found to exist, further judgment work may be left to the weighing operator. Of course, in order to help the weighing operator to make a judgment, the visual material information related to the specific additional mark may be subjected to enhanced display such as amplification, so that the weighing operator can make a judgment more quickly and accurately according to the information of the enhanced display.
In summary, according to the embodiment of the present application, the second visual material information of the additional mark can be added on the basis of the first visual material information of the merchandise body stored in the visual material information library of the merchandise object. Therefore, when the weighing object is visually identified, the visual characteristics of the goods body corresponding to the weighing object and the visual characteristics of the additional mark in two aspects can be collected, and the identification result is provided through the first visual material information and the second visual material information stored in the material library. By the method, the commodity object corresponding to the weighing object can be rapidly and accurately identified, the weighing efficiency is improved, and the dependence on the subjective judgment of a weighing operator can be reduced.
Example two
The second embodiment provides a method for processing information of material of a commodity object from the perspective of a workbench provided for a merchant user, and referring to fig. 3, the method may include:
s301: providing an operation option for submitting additional marking-related visual material for the merchandise object;
s302: after receiving visual materials of additional marks related to a target commodity object through the operation options, storing the visual materials into a commodity object visual material information base so as to determine a commodity object matched with the weighing object in a mode of comparing collected visual characteristic information with visual material information in the visual material information base when the commodity object is identified by the weighing object, wherein the collected visual characteristic information comprises: visual characteristic information of an additional mark associated with the weighing object.
In specific implementation, the similarity between the first visual materials of the multiple commodity objects associated with the same merchant user can be judged, and if the first visual materials of some commodity objects are found to have higher similarity, the merchant user can be prompted to submit additional mark related visual materials for the commodity objects, and the like.
For the parts of the second embodiment that are not described in detail, reference may be made to the descriptions of the first embodiment, and details are not repeated here.
It should be noted that, in the embodiments of the present application, the user data may be used, and in practical applications, the user-specific personal data may be used in the scheme described herein within the scope permitted by the applicable law, under the condition of meeting the requirements of the applicable law and regulations in the country (for example, the user explicitly agrees, the user is informed, etc.).
Corresponding to the first embodiment, the embodiment of the present application further provides a weighing processing apparatus, referring to fig. 4, the apparatus may include:
a visual material information base obtaining unit 401, configured to obtain a visual material information base for a commodity object, where the visual material information base includes first visual material information of a commodity body corresponding to the commodity object and second visual material information of an additional mark;
the visual feature acquisition unit 402 is used for acquiring visual features of the goods body and the additional mark corresponding to the weighing object;
a weighing object identifying unit 403, configured to perform commodity object identification on the weighing object by comparing the collected visual characteristic information with the visual material information in the material information base.
Wherein the second visual material information is visual material information independent of the first visual material information.
In specific implementation, the first visual material information and the second visual material information corresponding to the same commodity object may be recorded into the visual material information library at different time points.
Wherein, the additional mark corresponding to the same commodity object can be non-fixed; at this time, the apparatus may further include:
and the material updating unit is used for updating the corresponding relation between the specified commodity object and the second visual material information after receiving the new second visual material information submitted for the specified commodity object.
In a specific implementation manner, the additional mark is used to enhance the first visual material information, and multiple commodity objects with similar first visual material information correspond to different additional marks, so as to distinguish and identify the multiple commodity objects with similar first visual material information.
At this time, different additional marks corresponding to the plurality of commodity objects with similar first visual material information may have different feature values in the same visual feature dimension;
the visual feature acquisition unit may be specifically configured to:
when the visual characteristic information of the additional mark corresponding to the weighing object is acquired, only the visual characteristic acquisition is carried out on the additional mark from the same visual characteristic dimension;
the weighing object identification unit may be specifically configured to:
determining a plurality of matched commodity objects by comparing the visual characteristics of the commodity body with the first visual material information in the visual material information base;
and comparing the characteristics of the additional marks acquired from the same visual characteristic dimension with second visual material information corresponding to the plurality of commodity objects, and determining the identification of the target commodity object matched with the weighing object.
Wherein, the different additional marks corresponding to the plurality of commodity objects with similar first visual material information have different colors, shapes or numbers.
The same additional indicia may be multiplexed between different merchandise objects where the first visual material information is dissimilar.
Specifically, the additional mark may be used to be attached to or drawn on the article body, or placed on a shelf for stacking the article body, or laid in a container for carrying a weighing object.
Specifically, the weighing object identification unit may be configured to:
comparing the acquired visual characteristics of the goods body corresponding to the weighing object with the first visual material information in the visual material information base to determine a matched goods object;
and if the matched commodity objects are multiple, providing a commodity object identification result according to the second visual material information corresponding to the matched commodity objects.
More specifically, the weighing object identification unit may be configured to:
and comparing the acquired visual features of the additional marks with the second visual material information corresponding to the plurality of commodity objects, and determining the matched target commodity object.
Alternatively, the weighing object identification unit may be configured to:
and displaying the matched commodity objects, and performing enhanced display on second visual material information corresponding to the commodity objects respectively so that a weighing operator can select the commodity objects according to the second visual material information.
Corresponding to the second embodiment, the embodiment of the present application further provides a device for processing material information of a commodity object, and referring to fig. 5, the device may include:
an operation option providing unit 501 for providing an operation option for submitting the visual material related to the additional mark for the commodity object;
a visual material receiving unit 502, configured to store the visual material of the additional mark related to the target commodity object in a commodity object visual material information base after receiving the visual material of the additional mark related to the target commodity object through the operation option, so as to determine, when identifying a commodity object to a weighing object, a commodity object matched with the weighing object in a manner of comparing the collected visual characteristic information with visual material information in the visual material information base, where the collected visual characteristic information includes: visual characteristic information of an additional mark associated with the weighing object.
In addition, the present application also provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps of the method described in any of the preceding method embodiments.
And an electronic device comprising:
one or more processors; and
a memory associated with the one or more processors for storing program instructions that, when read and executed by the one or more processors, perform the steps of the method of any of the preceding method embodiments.
Fig. 6 illustrates an architecture of an electronic device, which may specifically include a processor 610, a video display adapter 611, a disk drive 612, an input/output interface 613, a network interface 614, and a memory 620. The processor 610, the video display adapter 611, the disk drive 612, the input/output interface 613, the network interface 614, and the memory 620 may be communicatively connected by a communication bus 630.
The processor 610 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits, and is configured to execute related programs to implement the technical solution provided in the present Application.
The Memory 620 may be implemented in the form of a ROM (Read Only Memory), a RAM (Random Access Memory), a static storage device, a dynamic storage device, or the like. The memory 620 may store an operating system 621 for controlling the operation of the electronic device 600, a Basic Input Output System (BIOS) for controlling low-level operations of the electronic device 600. In addition, a web browser 623, a data storage management system 624, a weight handling system 625, and the like may also be stored. The weighing processing system 625 may be an application program that implements the operations of the foregoing steps in this embodiment of the present application. In summary, when the technical solution provided in the present application is implemented by software or firmware, the relevant program codes are stored in the memory 620 and called for execution by the processor 610.
The input/output interface 613 is used for connecting an input/output module to realize information input and output. The i/o module may be configured as a component in a device (not shown) or may be external to the device to provide a corresponding function. The input devices may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output devices may include a display, a speaker, a vibrator, an indicator light, etc.
The network interface 614 is used for connecting a communication module (not shown in the figure) to realize the communication interaction between the device and other devices. The communication module can realize communication in a wired mode (such as USB, network cable and the like) and also can realize communication in a wireless mode (such as mobile network, WIFI, Bluetooth and the like).
Bus 630 includes a path that transfers information between the various components of the device, such as processor 610, video display adapter 611, disk drive 612, input/output interface 613, network interface 614, and memory 620.
It should be noted that although the above devices only show the processor 610, the video display adapter 611, the disk drive 612, the input/output interface 613, the network interface 614, the memory 620, the bus 630, etc., in a specific implementation, the device may also include other components necessary for normal operation. Furthermore, it will be understood by those skilled in the art that the apparatus described above may also include only the components necessary to implement the solution of the present application, and not necessarily all of the components shown in the figures.
From the above description of the embodiments, it is clear to those skilled in the art that the present application can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present application may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments of the present application.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, the system or system embodiments are substantially similar to the method embodiments and therefore are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for related points. The above-described system and system embodiments are only illustrative, wherein the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
The weighing processing method, the weighing processing device and the electronic device provided by the application are introduced in detail, a specific example is applied in the description to explain the principle and the implementation of the application, and the description of the embodiment is only used for helping to understand the method and the core idea of the application; meanwhile, for a person skilled in the art, according to the idea of the present application, the specific embodiments and the application range may be changed. In view of the above, the description should not be taken as limiting the application.

Claims (10)

1. A weighing processing method, characterized by comprising:
acquiring a visual material information base of the commodity object, wherein the visual material information base comprises first visual material information of a commodity body corresponding to the commodity object and second visual material information of an additional mark;
carrying out visual characteristic acquisition on the goods body and the additional mark corresponding to the weighing object;
and comparing the collected visual characteristic information with the visual material information in the material information base, and identifying the commodity object of the weighing object.
2. The method of claim 1,
the additional marks corresponding to the same commodity object are not fixed;
the method further comprises the following steps:
and after receiving new second visual material information submitted for the specified commodity object, updating the corresponding relation between the specified commodity object and the second visual material information.
3. The method of claim 1,
the additional marks are used for enhancing the first visual material information, and the plurality of commodity objects similar to the first visual material information correspond to different additional marks so as to distinguish and identify the plurality of commodity objects similar to the first visual material information.
4. The method of claim 3,
different additional marks corresponding to the plurality of commodity objects with similar first visual material information have different feature values on the same visual feature dimension;
the goods body and the additional mark that the symmetrical heavy object corresponds carry out visual characteristics and gather, include:
when the visual characteristic information of the additional mark corresponding to the weighing object is acquired, only the visual characteristic acquisition is carried out on the additional mark from the same visual characteristic dimension;
the commodity object identification of the weighing object comprises:
determining a plurality of matched commodity objects by comparing the visual characteristics of the commodity body with the first visual material information in the visual material information base;
and comparing the characteristics of the additional marks acquired from the same visual characteristic dimension with second visual material information corresponding to the plurality of commodity objects, and determining the identification of the target commodity object matched with the weighing object.
5. The method of claim 4,
the same additional indicia may be multiplexed between different merchandise objects where the first visual material information is dissimilar.
6. The method according to any one of claims 1 to 5,
the commodity object identification of the weighing object comprises:
comparing the acquired visual characteristics of the goods body corresponding to the weighing object with the first visual material information in the visual material information base to determine a matched goods object;
and if the matched commodity objects are multiple, providing a commodity object identification result according to the second visual material information corresponding to the matched commodity objects.
7. The method of claim 6,
providing a commodity object identification result according to the second visual material information corresponding to the matched plurality of commodity objects, wherein the commodity object identification result comprises the following steps:
comparing the collected visual features of the additional marks with second visual material information corresponding to the plurality of commodity objects, and determining matched target commodity objects;
or,
and displaying the matched commodity objects, and performing enhanced display on second visual material information corresponding to the commodity objects respectively so that a weighing operator can select the commodity objects according to the second visual material information.
8. A commodity object material information processing method is characterized by comprising the following steps:
providing an operation option for submitting additional marking-related visual material for the merchandise object;
after receiving visual materials of additional marks related to a target commodity object through the operation options, storing the visual materials into a commodity object visual material information base so as to determine a commodity object matched with the weighing object in a mode of comparing collected visual characteristic information with visual material information in the visual material information base when the commodity object is identified by the weighing object, wherein the collected visual characteristic information comprises: visual characteristic information of an additional mark associated with the weighing object.
9. A weighing processing apparatus, comprising:
the visual material information base acquisition unit is used for acquiring a visual material information base of the commodity object, wherein the visual material information base comprises first visual material information of a commodity body corresponding to the commodity object and second visual material information of an additional mark;
the visual characteristic acquisition unit is used for acquiring visual characteristics of the goods body and the additional mark corresponding to the weighing object;
and the weighing object identification unit is used for comparing the acquired visual characteristic information with the visual material information in the material information base to identify the commodity object of the weighing object.
10. An apparatus for processing material information of a commodity object, comprising:
an operation option providing unit for providing an operation option for submitting the visual material related to the additional mark for the commodity object;
the visual material receiving unit is used for storing the visual material which is an additional mark related to a target commodity object into a commodity object visual material information base after receiving the visual material through the operation options, so that when a weighing object is identified, the commodity object matched with the weighing object is determined in a mode of comparing the collected visual characteristic information with the visual material information in the visual material information base, wherein the collected visual characteristic information comprises: visual characteristic information of an additional mark associated with the weighing object.
CN202110765567.8A 2021-07-06 2021-07-06 Weighing processing method and device and electronic equipment Pending CN113591594A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110765567.8A CN113591594A (en) 2021-07-06 2021-07-06 Weighing processing method and device and electronic equipment
PCT/CN2022/103618 WO2023280098A1 (en) 2021-07-06 2022-07-04 Weighing processing method and apparatus, and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110765567.8A CN113591594A (en) 2021-07-06 2021-07-06 Weighing processing method and device and electronic equipment

Publications (1)

Publication Number Publication Date
CN113591594A true CN113591594A (en) 2021-11-02

Family

ID=78246012

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110765567.8A Pending CN113591594A (en) 2021-07-06 2021-07-06 Weighing processing method and device and electronic equipment

Country Status (2)

Country Link
CN (1) CN113591594A (en)
WO (1) WO2023280098A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023280098A1 (en) * 2021-07-06 2023-01-12 盒马(中国)有限公司 Weighing processing method and apparatus, and electronic device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105448001A (en) * 2014-09-22 2016-03-30 卡西欧计算机株式会社 Merchandise item registration apparatus
US20190080207A1 (en) * 2017-07-06 2019-03-14 Frenzy Labs, Inc. Deep neural network visual product recognition system
CN110793607A (en) * 2019-09-24 2020-02-14 浙江大华技术股份有限公司 Self-service weighing method, system and computer readable storage medium
CN110942035A (en) * 2019-11-28 2020-03-31 浙江由由科技有限公司 Method, system, device and storage medium for acquiring commodity information
CN110992140A (en) * 2019-11-28 2020-04-10 浙江由由科技有限公司 Matching method and system for recognition model
CN112665698A (en) * 2020-12-15 2021-04-16 重庆电子工程职业学院 Intelligent electronic scale

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9299007B2 (en) * 2014-01-28 2016-03-29 Ncr Corporation Methods and apparatus for item identification using brightness compensation
US10657411B1 (en) * 2014-03-25 2020-05-19 Amazon Technologies, Inc. Item identification
US9818038B2 (en) * 2016-01-06 2017-11-14 Toshiba Tec Kabushiki Kaisha Image recognition apparatus
CN107748973A (en) * 2017-09-29 2018-03-02 时瑞科技(深圳)有限公司 Product identification system and automatic identification are sold or storage method
CN107862814A (en) * 2017-11-01 2018-03-30 北京旷视科技有限公司 Automated Clearing House system and automatic settlement method
CN108416403B (en) * 2018-03-08 2021-05-04 上海扩博智能技术有限公司 Method, system, equipment and storage medium for automatically associating commodity with label
JP7361359B2 (en) * 2019-03-20 2023-10-16 株式会社イシダ Product information inspection system and computer control method
CN113591594A (en) * 2021-07-06 2021-11-02 盒马(中国)有限公司 Weighing processing method and device and electronic equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105448001A (en) * 2014-09-22 2016-03-30 卡西欧计算机株式会社 Merchandise item registration apparatus
US20190080207A1 (en) * 2017-07-06 2019-03-14 Frenzy Labs, Inc. Deep neural network visual product recognition system
CN110793607A (en) * 2019-09-24 2020-02-14 浙江大华技术股份有限公司 Self-service weighing method, system and computer readable storage medium
CN110942035A (en) * 2019-11-28 2020-03-31 浙江由由科技有限公司 Method, system, device and storage medium for acquiring commodity information
CN110992140A (en) * 2019-11-28 2020-04-10 浙江由由科技有限公司 Matching method and system for recognition model
CN112665698A (en) * 2020-12-15 2021-04-16 重庆电子工程职业学院 Intelligent electronic scale

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023280098A1 (en) * 2021-07-06 2023-01-12 盒马(中国)有限公司 Weighing processing method and apparatus, and electronic device

Also Published As

Publication number Publication date
WO2023280098A1 (en) 2023-01-12

Similar Documents

Publication Publication Date Title
JP7125899B2 (en) Article interaction and movement detection method
US11568632B1 (en) Item identification among a variant of items
CN109635132B (en) Automatic warehouse management method, system and terminal equipment
US10163149B1 (en) Providing item pick and place information to a user
US10380546B2 (en) Intelligent display and self-serve experience system and method
US10040628B1 (en) Item replacement assistance
CN108805637B (en) Method and device for automatically associating grids and confirming distribution
US11631048B1 (en) User interface with a representative color
JP2019534219A (en) Identification and tracking of bundled units
CN108345912A (en) Commodity rapid settlement system based on RGBD information and deep learning
US11328250B2 (en) Inventory management server, inventory management system, inventory management program, and inventory management method
JP5753215B2 (en) Image recognition system for inventory management and marketing
US11288539B1 (en) Tiered processing for item identification
US10303187B1 (en) Dynamic inventory management user interface
CN110197416A (en) The method and apparatus for identifying commodity by gravity
CN116823123B (en) Warehouse management method and device based on AR positioning, electronic equipment and medium
CN113935774A (en) Image processing method, image processing device, electronic equipment and computer storage medium
US11748787B2 (en) Analysis method and system for the item on the supermarket shelf
CN110415464A (en) The method and apparatus for identifying commodity by multiple force snesor
JP7381330B2 (en) Information processing system, information processing device, and information processing method
CN113591594A (en) Weighing processing method and device and electronic equipment
CN113624314B (en) Weighing processing method and device and weighing equipment
US20190304587A1 (en) Nutrition performance scorecard and automated shopping list
JP2021054604A (en) Picking system, server, method, program and terminal
CN108133543A (en) Selling apparatus and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40060985

Country of ref document: HK