CN113569745A

CN113569745A - Article identification method, device, system, electronic equipment and storage medium

Info

Publication number: CN113569745A
Application number: CN202110862917.2A
Authority: CN
Inventors: 赵萃; 陈逸伦; 韩旭; 黄唯; 刘恒一
Original assignee: Shanghai Sensetime Intelligent Technology Co Ltd
Current assignee: Shanghai Sensetime Intelligent Technology Co Ltd
Priority date: 2021-07-29
Filing date: 2021-07-29
Publication date: 2021-10-29

Abstract

The present disclosure provides an article identification method, system, apparatus, electronic device and storage medium, the method comprising: controlling an image acquisition device to respectively acquire a first internal image of an entity container at a first moment and a second internal image at a second moment, wherein the second moment is a moment after the first moment; comparing the first internal image with the second internal image to obtain a comparison result; under the condition that the comparison result indicates that the article information included in the first internal image and the article information included in the second internal image are different, respectively identifying the first internal image and the second internal image, and determining a first identification result corresponding to the first internal image and a second identification result corresponding to the second internal image; determining item difference information between the first interior image and the second interior image based on the first recognition result and the second recognition result; and generating feedback information corresponding to the entity container based on the article difference information.

Description

Article identification method, device, system, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of image processing technologies, and in particular, to an article identification method, apparatus, system, electronic device, and storage medium.

Background

With the development of economy, more and more unmanned retail stores, vending machines and the like appear in various places, and convenience is provided for the life of people. Generally, a background service system of an unmanned retail store or a vending machine can control the type of articles displayed on a display screen, a user determines selected article information by operating on the display screen, and the background service system completes the article processing process according to the article information. However, the above-mentioned service processing procedure of the vending machine requires the user to manually input the selected article information, which makes the article processing flow cumbersome.

Disclosure of Invention

In view of the above, the present disclosure provides at least an article identification method, apparatus, system, electronic device and storage medium.

In a first aspect, the present disclosure provides an article identification method, including:

controlling an image acquisition device to respectively acquire a first internal image of an entity container at a first moment and a second internal image at a second moment, wherein the second moment is a moment after the first moment;

comparing the first internal image with the second internal image to obtain a comparison result;

under the condition that the comparison result indicates that the article information included in the first internal image and the second internal image are different, respectively identifying the first internal image and the second internal image, and determining a first identification result corresponding to the first internal image and a second identification result corresponding to the second internal image;

determining item difference information between the first interior image and the second interior image based on the first recognition result and the second recognition result;

and generating feedback information corresponding to the entity container based on the article difference information.

In the method, the control image acquisition equipment is used for respectively acquiring a first internal image of the entity container at a first moment and a second internal image of the entity container at a second moment (the second moment is a moment after the first moment), and the first internal image and the second internal image are compared to obtain a comparison result; when the comparison result indicates that the article information included in the first internal image and the article information included in the second internal image are the same, subsequent image recognition processing is not required, resources consumed by image recognition are reduced, and image processing efficiency is improved.

When the comparison result indicates that the article information included in the first internal image and the article information included in the second internal image are different, the first internal image and the second internal image can be respectively identified, a first identification result corresponding to the first internal image and a second identification result corresponding to the second internal image are determined more accurately, and article difference information between the first internal image and the second internal image can be determined more accurately based on the first identification result and the second identification result; and then based on this article difference information, can generate comparatively accurate feedback information, improved the precision of article discernment and processing.

In a possible embodiment, the generating feedback information corresponding to the physical container based on the item difference information includes:

generating item list information corresponding to the entity container based on the category of at least one target item indicated by the item difference information, the difference quantity of the target item and the set attribute information of each item;

and taking the article list information as feedback information corresponding to the entity container.

Here, by generating the item list information corresponding to the physical container and using the item list information as the feedback information corresponding to the physical container, the item handling condition of the physical container in the time period from the first time to the second time can be determined more accurately and clearly through the item list information.

acquiring input processing information input by a user;

and generating feedback information corresponding to the entity container based on the article difference information and the input processing information.

Here, after the placing operation is performed on the articles in the entity container, the input processing information input by the user can be acquired, the feedback information corresponding to the entity container is generated based on the article difference information and the input processing information, and the placing condition corresponding to the placing operation at this time can be determined through the generated feedback information, for example, whether the article type on the shelf is the same as the article type indicated by the input processing information or not can be determined, the condition of article placing error caused by manually performing the placing operation can be alleviated, and the accuracy of the placing operation is improved.

In one possible embodiment, the generating feedback information corresponding to the physical container based on the item difference information and the input processing information includes:

determining article information of an abnormal article corresponding to article difference information or input processing information under the condition that the article difference information is not matched with the input processing information;

generating abnormal prompt information based on the article information of the abnormal article;

and taking the abnormal prompt information as feedback information corresponding to the entity container.

Here, when it is detected that the article difference information does not match the input processing information, the article information of the abnormal article may be determined, the abnormal prompting information may be generated based on the article information of the abnormal article, and the abnormal prompting information may be used as the feedback information corresponding to the physical container, so that the abnormal article may be corrected based on the abnormal prompting information, and the accuracy of the placing operation may be improved.

In a possible embodiment, after generating the feedback information corresponding to the physical container based on the item difference information, the method further includes:

generating a first processing strategy for the fault error reporting operation based on the first internal image and the second internal image in response to the fault error reporting operation for the feedback information.

Here, a fault reporting operation for the feedback information may be generated in case of an error in the feedback information, a first processing strategy for the fault reporting operation may be generated based on the first internal image and the second internal image in response to the fault reporting operation, and then the feedback information may be processed according to the first processing strategy, which improves accuracy and flexibility of processing of the items in the entity container, so that the container management platform of the entity container can meet processing requirements under different item processing conditions.

In a possible embodiment, the generating a first processing policy for the fault-reporting operation based on the first internal image and the second internal image includes:

judging whether the feedback information has article abnormal information or not based on the first internal image, the second internal image and the feedback information;

if the article abnormal information exists, generating error correction processing information aiming at the abnormal article indicated by the article abnormal information based on the article abnormal information;

and generating a first processing strategy aiming at the fault reporting operation based on the error correction processing information.

Here, it may be determined whether the feedback information includes article abnormality information based on the first internal image, the second internal image, and the feedback information, and if so, error correction processing information for the abnormal article indicated by the article abnormality information may be generated; and generating a first processing strategy aiming at fault reporting operation based on the error correction processing information, so that abnormal articles can be processed according to the first processing strategy, and the flexibility of article processing in the entity container is improved.

In one possible embodiment, the method comprises:

responding to a triggered checking request or controlling the image acquisition equipment to acquire a third internal image of the entity container according to a checking period corresponding to the entity container;

identifying the third internal image, and determining a third identification result corresponding to the third internal image;

determining item information of each item currently stored in the physical container based on the third identification result.

Here, the triggered checking request may be responded, and/or the image acquisition device may be controlled to acquire a third internal image of the entity container according to a checking period corresponding to the entity container, and the article information of each article currently stored in the entity container is determined through the third internal image, so that the automatic checking of the entity container is realized, and the checking efficiency is improved.

In a possible embodiment, the method further comprises:

determining an item quantity for each item stored in each physical container;

generating replenishment request information for a first item of any one of the physical containers if it is determined that the quantity of items of the first item stored in the physical container is less than or equal to a set quantity threshold.

Here, the item quantity of each item stored in the respective physical container may be determined; and under the condition that the quantity of the first articles stored in any one of the entity containers is determined to be less than or equal to the set quantity threshold, the replenishment request information for the first articles of any one of the entity containers is generated, replenishment of the entity containers is completed, and the replenishment efficiency is improved.

The following descriptions of the effects of the apparatus, the electronic device, and the like refer to the description of the above method, and are not repeated here.

In a second aspect, the present disclosure provides an item identification system comprising: the container management platform comprises a container management platform and a container, wherein the container comprises a solid container and an image acquisition device;

the physical container is used for storing at least one article in the set storage area;

the image acquisition equipment is used for acquiring a first internal image and a second internal image corresponding to the storage area of the entity container;

the container management platform is configured to execute the article identification method according to any one of the first aspect based on the acquired first internal image and the acquired second internal image.

In a third aspect, the present disclosure provides an article identification device comprising:

the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for controlling an image acquisition device to respectively acquire a first internal image of an entity container at a first moment and a second internal image at a second moment, and the second moment is a moment after the first moment;

the comparison module is used for comparing the first internal image with the second internal image to obtain a comparison result;

the identification module is used for respectively identifying the first internal image and the second internal image under the condition that the comparison result indicates that the article information included in the first internal image and the second internal image are different, and determining a first identification result corresponding to the first internal image and a second identification result corresponding to the second internal image;

a determination module for determining item difference information between the first interior image and the second interior image based on the first recognition result and the second recognition result;

and the first generating module is used for generating feedback information corresponding to the entity container based on the article difference information.

In a possible implementation manner, the first generating module, when generating the feedback information corresponding to the physical container based on the item difference information, is configured to:

acquiring input processing information input by a user;

In one possible embodiment, the first generating module, when generating the feedback information corresponding to the physical container based on the item difference information and the input processing information, is configured to:

determining article information of an abnormal article corresponding to the article difference information or the input processing information under the condition that the article difference information is not matched with the input processing information;

In a possible embodiment, the apparatus further comprises: a second generation module to:

In a possible implementation, the second generating module, when generating the first processing policy for the fault-reporting operation based on the first internal image and the second internal image, is configured to:

In a possible embodiment, the apparatus further comprises: an inventory module to:

In a possible embodiment, the apparatus further comprises: a replenishment module for:

determining an item quantity for each item stored in each physical container;

In a fourth aspect, the present disclosure provides an electronic device comprising: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating via the bus when the electronic device is running, the machine-readable instructions when executed by the processor performing the steps of the article identification method according to the first aspect or any embodiment.

In a fifth aspect, the present disclosure provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the item identification method according to the first aspect or any one of the embodiments.

In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly described below, and the drawings herein incorporated in and forming a part of the specification illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the technical solutions of the present disclosure. It is appreciated that the following drawings depict only certain embodiments of the disclosure and are therefore not to be considered limiting of its scope, for those skilled in the art will be able to derive additional related drawings therefrom without the benefit of the inventive faculty.

Fig. 1 illustrates a flow chart of an article identification method provided by an embodiment of the present disclosure;

fig. 2 is a schematic flow chart illustrating a process of generating feedback information corresponding to an entity container in an article identification method provided by the embodiment of the disclosure;

fig. 3 shows an architecture diagram of an item identification system provided by an embodiment of the present disclosure;

fig. 4 is a schematic diagram illustrating an architecture of an article identification device provided by an embodiment of the present disclosure;

fig. 5 shows a schematic structural diagram of an electronic device provided in an embodiment of the present disclosure.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, not all of the embodiments. The components of the embodiments of the present disclosure, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure, presented in the figures, is not intended to limit the scope of the claimed disclosure, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the disclosure without making creative efforts, shall fall within the protection scope of the disclosure.

The background service system of the unmanned retail store or the vending machine can control the type of the articles displayed on the display screen, a user determines the information of the selected articles through operation on the display screen, and the background service system finishes the treatment process of the articles according to the information of the articles. However, the above-mentioned service processing procedure of the vending machine requires the user to manually input the selected article information, which makes the article processing flow cumbersome. In order to alleviate the above problem, embodiments of the present disclosure provide an article identification method, apparatus, system, electronic device, and storage medium.

The above-mentioned drawbacks are the results of the inventor after practical and careful study, and therefore, the discovery process of the above-mentioned problems and the solutions proposed by the present disclosure to the above-mentioned problems should be the contribution of the inventor in the process of the present disclosure.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.

For the convenience of understanding the embodiments of the present disclosure, a detailed description will be given of an article identification method disclosed in the embodiments of the present disclosure. An execution subject of the article identification method provided by the embodiment of the present disclosure is generally a computer device with certain computing capability, and the computer device includes: a terminal device, which may be a User Equipment (UE), a mobile device, a User terminal, a terminal, or other processing devices. In some possible implementations, the article identification method may be implemented by a processor invoking computer readable instructions stored in a memory.

Referring to fig. 1, which is a schematic flow chart of an article identification method provided in an embodiment of the present disclosure, an execution subject of the method may be a container management platform on a computer device, and the method includes S101-S105, where:

s101, controlling an image acquisition device to respectively acquire a first internal image of an entity container at a first moment and a second internal image of the entity container at a second moment, wherein the second moment is a moment after the first moment;

s102, comparing the first internal image with the second internal image to obtain a comparison result;

s103, under the condition that the comparison result indicates that the article information included in the first internal image and the article information included in the second internal image are different, respectively identifying the first internal image and the second internal image, and determining a first identification result corresponding to the first internal image and a second identification result corresponding to the second internal image;

s104, determining article difference information between the first internal image and the second internal image based on the first recognition result and the second recognition result;

and S105, generating feedback information corresponding to the entity container based on the article difference information.

The following description will specifically discuss S101 to S105.

For S101:

when the method is implemented, the image acquisition equipment can be arranged at a position where the storage area of the solid container can be shot, so that the image acquisition equipment can shoot a first internal image of the solid container at a first moment and a second internal image of the solid container at a second moment, wherein the second moment is a moment after the first moment. Wherein the image acquisition device may be a camera, for example.

The first time and the second time may be preset times, for example, set as periodic times. The first time and the second time may also be times determined according to certain operations on the entity container, for example, the time when the cabinet door of the entity container is opened is determined as the first time, and at this time, the image acquisition device is controlled to acquire a first internal image corresponding to the entity container; and determining the closing moment of the cabinet door of the entity container as a second moment, and controlling the image acquisition equipment to acquire a second internal image corresponding to the entity container at the moment.

For example, a sensor can be arranged on a cabinet door, and the opening and closing conditions of the cabinet door of the physical container can be detected through the sensor; when the opening of a cabinet door of the solid container is detected through a sensor, controlling an image acquisition device to acquire a first internal image corresponding to the solid container; and controlling the image acquisition equipment to acquire a second internal image corresponding to the entity container at the moment when the sensor detects that the cabinet door of the entity container is closed.

For S102 and S103:

after the first internal image and the second internal image are collected, the first internal image and the second internal image can be compared to obtain a comparison result, for example, whether pixel information of each pixel point in the first internal image and the second internal image is consistent or not can be compared, and if not, the comparison result indicates that the article information included in the first internal image and the second internal image is different. The item information may include a category of the item, a number of items, a location where the item is stored, and the like.

Or, whether the pixel information of each pixel point in the first internal image and the second internal image is consistent or not may be compared, and when the pixel information is inconsistent, whether the difference of the pixel information is greater than the set pixel threshold or not and/or whether the number of the pixel points with inconsistent pixel information is greater than the set number threshold or not may be determined, and if yes, it is determined that the comparison result is that the article information included in the first internal image and the second internal image is different.

When the comparison result indicates that the article information included in the first internal image and the article information included in the second internal image are different, the trained image recognition network can be used for respectively recognizing the first internal image and the second internal image, and determining a first recognition result corresponding to the first internal image and a second recognition result corresponding to the second internal image. The network structure of the image recognition network can be set as required.

For example, the first internal image may be input into an image recognition network, a detection module in the image recognition network detects the first internal image, determines whether the first internal image includes the target object, and if so, a recognition module in the image recognition network recognizes feature data output by the detection module, and determines a first recognition result of the first internal image. For example, the first recognition result may include information on the category of the item, the number of items, the storage location of the item, and the like included in the first internal image. The identification process of the second internal image may refer to the description of the first internal image, and is not described in detail here.

For S104 and S105:

here, based on the first recognition result and the second recognition result, item difference information between the first internal image and the second internal image may be determined. For example, the item difference information may include: the category of the target item for which there is a difference, the number of differences in the target item, and the like. And then, feedback information corresponding to the entity container can be generated based on the article difference information. If the user performs different target operations on the entity container within the time period from the first time to the second time, the different target operations can correspond to different feedback information. For example, the user performs an item transaction operation (or item shopping) on the physical container in the time period), the feedback information may include item list information (or order information); and in the time period, the user performs goods placement operation and the like on the entity container, and the feedback information can comprise placement information, wherein the placement operation can comprise shelving operation and/or shelving operation.

In an alternative embodiment, referring to fig. 2, the generating feedback information corresponding to the physical container based on the item difference information may include:

s201, generating item list information corresponding to the entity container based on the category of at least one target item indicated by the item difference information, the difference quantity of the target item and the set attribute information of each item;

s202, the item list information is used as feedback information corresponding to the entity container.

When the user performs an article transaction operation on the entity container within a time period from the first time to the second time, the article list information corresponding to the entity container may be generated based on the category of the at least one target article and the difference quantity of the target article indicated by the article difference information, and the set attribute information of each article. For example, when the attribute information of the item includes an item unit price, the generated item list information may include a category of the target item, a transaction amount (i.e., a difference amount), an item unit price, a transaction total amount, and the like. See table 1 for inventory information.

Table 1 list of items

Categories of articles	Number of transactions	Article unit price	Amount of transaction
				Target object 1	2 are provided with	3 yuan/piece	6 yuan
Target article two	1 bag	5 yuan per bag	5 Yuan
				Total sum of money			11 Yuan

Further, the inventory information of the articles can be used as the feedback information of the target operation corresponding to the entity container. In implementation, the feedback information may be displayed on a display screen of the physical container, or the feedback information may be sent to a mobile device carried by a user who performs an article transaction operation on the physical container.

Here, by generating the item list information of the target operation (item transaction operation) corresponding to the physical container and using the item list information as the feedback information of the target operation corresponding to the physical container, the item handling situation corresponding to the target operation performed by the physical container in the time period from the first time to the second time can be determined more accurately and clearly through the item list information.

In an optional embodiment, when an article in the entity container is placed in a time period from a first time to a second time, where the placing operation includes an racking operation and/or a racking operation, the generating feedback information corresponding to the entity container based on the article difference information may include: step a1 and step a2, wherein:

step A1, acquiring input processing information input by a user;

step A2, based on the item difference information and the input processing information, generating feedback information corresponding to the physical container.

During implementation, a manager of the entity container can carry out placing operation on the entity container in a time period from the first time to the second time (namely, in a time period when the cabinet door is opened); after the physical container is put, the input processing information corresponding to the putting operation can be input through an intelligent terminal (such as a mobile phone, a notebook computer, a tablet personal computer and the like) carried by the user or input equipment (such as a tablet personal computer arranged on the outer surface of the physical container) arranged on the physical container. For example, when the placing operation includes a shelving operation, the input processing information may include a shelving item type, a shelving item number, a shelving item position, and the like; when the placing operation includes a lowering operation, the input processing information may include the type of articles, the number of articles, the position of articles, and the like of the lowering operation.

After the input processing information corresponding to the placing operation is acquired, feedback information of the target operation corresponding to the entity container can be generated based on the article processing information and the input processing information.

Here, after the placing operation is performed on the articles in the entity container, input processing information for the placing operation input by the user can be acquired, feedback information of the target operation corresponding to the entity container is generated based on the article difference information and the input processing information, and the placing condition corresponding to the placing operation can be determined through the generated feedback information, for example, whether the article category on the shelf is the same as the article category indicated by the input processing information or not can be determined, so that the condition of article placing error caused when the placing operation is manually performed can be alleviated, and the accuracy of the placing operation is improved.

In an alternative embodiment, in step a2, the generating feedback information corresponding to the physical container based on the item difference information and the input processing information may include: step a21 and step a22, wherein:

a step a21 of determining article information of an abnormal article corresponding to the article difference information or the input processing information, when it is detected that the article difference information does not match the input processing information;

step A22, generating abnormal prompt information based on the article information of the abnormal article; and taking the abnormal prompt information as feedback information corresponding to the entity container.

Whether the article difference information is matched with the input processing information or not can be detected, if so, prompt information indicating that the placing operation is correct can be generated, the prompt information is used as feedback information of target operation corresponding to the entity container, and the prompt information can be sent to a manager of the entity container. If not, the article information of the abnormal article corresponding to the placing operation can be determined. The item information of the abnormal item may include a category of the abnormal item, an abnormal number of the abnormal item, and the like.

And generating abnormal prompt information aiming at the entity container based on the article information of the abnormal article. For example, the abnormality indication information may be "the actual number of shelves for item one is smaller than the input number of shelves". Taking the abnormal prompt information as feedback information of target operation corresponding to the entity container; and the prompt information can be sent to the manager of the entity container, so that the manager of the entity container can check the placing operation of the entity container after receiving the abnormal prompt information, and the error of the placing operation, which causes the error of the inventory information of the entity container, is avoided.

In an optional embodiment, after generating the feedback information corresponding to the physical container based on the item difference information, the method further includes: generating a first processing strategy for the fault error reporting operation based on the first internal image and the second internal image in response to the fault error reporting operation for the feedback information.

After receiving the feedback information, the user can determine whether the feedback information is wrong, if so, a fault reporting operation for the feedback information can be triggered, and a first processing strategy for the fault reporting operation is generated based on the first internal image and the second internal image in response to the fault reporting operation for the feedback information. For example, the first processing policy may be to generate processing information for the entity container and send the processing information to a manager of the entity container, so that the entity container can manage the entity container according to the processing information, for example, the manager can perform inventory, re-perform an article racking operation, a rack racking operation, and the like on an article stored in the entity container; or, the first processing strategy may be to generate a processing request and send the processing request to a manager of the entity container, so that the manager processes the fault reporting operation.

In an alternative embodiment, the generating a first processing policy for the fault-reporting operation based on the first internal image and the second internal image may include steps B1 to B3, where:

and step B1, judging whether the feedback information has article abnormal information or not based on the first internal image, the second internal image and the feedback information.

Step B2, if any, generates error correction processing information for the abnormal article indicated by the article abnormality information, based on the article abnormality information.

And step B3, generating a first processing strategy aiming at the fault reporting operation based on the error correction processing information.

For example, when the physical container is processed for article transaction, whether the feedback information has article abnormality information may be determined based on the first internal image, the second internal image and the feedback information in response to a fault reporting operation for the feedback information. For example, intermediate item difference information between the first interior image and the second interior image may be redetermined again from the first interior image and the second interior image; and according to the intermediate article difference information and the feedback information, determining whether there is article abnormal information, for example, determining whether the feedback information is consistent with the article type included in the intermediate article difference information, and whether the quantity of each article is consistent, may further include: and judging whether the unit price of each article in the feedback information is consistent with the unit price of the article stored in advance, whether the transaction amount counted by each article is correct, and the like.

If the article abnormality information exists, error correction processing information for the abnormal article indicated by the article abnormality information may be generated based on the article abnormality information. For example, if the article abnormality information is "the number of article one is counted up to 2", the generated error correction processing information may include: the "updated feedback information", and the transaction amount to be returned (i.e., the transaction amount for 2 items one). Further, a first processing policy for the fault reporting operation may be generated based on the error correction processing information, for example, the first processing policy may be: and the updated feedback information is retransmitted to the user who carries out transaction operation on the entity container, and the transaction amount to be returned can be returned to the transaction account of the user.

Exemplarily, after the placing operation is performed on the physical container, if the feedback information is that the number of the first items on the shelf is inconsistent with the input number, in response to the fault reporting operation for the feedback information, the intermediate item difference information between the first internal image and the second internal image is determined again based on the first internal image and the second internal image; judging whether the difference information of the intermediate article is consistent with the input processing information, if so, determining that the feedback information is wrong, correcting the feedback information, and generating updated feedback information, wherein the updated feedback information can be 'no error' in the racking operation; if the goods are inconsistent, the inconsistent goods types and goods numbers are determined, whether the inconsistent goods types and goods numbers are the same as the feedback information or not can be judged, if so, the feedback information is determined to be correct, the feedback information does not need to be corrected, and a manager can perform racking operation and/or racking operation on the entity container again based on the feedback information; if not, the feedback information is determined to be wrong, and the feedback information can be regenerated based on the inconsistent article types and article quantities.

In an alternative embodiment, the method includes:

step C1, responding to the triggered checking request, or controlling the image acquisition device to acquire a third internal image of the entity container according to the checking period corresponding to the entity container;

step C2, recognizing the third internal image, and determining a third recognition result corresponding to the third internal image;

step C3, based on the third identification result, determining the item information of each item currently stored in the physical container.

In implementation, after the administrator triggers the checking request, the image acquisition device is controlled to acquire the third internal image of the physical container in response to the triggered checking request; or, the image collecting device may be controlled to collect the third internal image of the entity container according to a checking period corresponding to the entity container, where the checking period may be set according to actual requirements, for example, the checking period may be once a week, once a month, and the like, that is, the checking may be performed on the entity container every week, and the checking may be performed on the entity container the first day of a month and the like.

Then, the third internal image may be identified, and a third identification result corresponding to the third internal image is determined, where the third identification result may include: item type, item quantity, item storage location, etc. And further determining the article information of each article currently stored in the entity container based on the third identification result, and completing the automatic checking operation of the entity container.

Here, the triggered checking request may be responded, or the image acquisition device may be controlled to acquire a third internal image of the entity container according to a checking period corresponding to the entity container, and the article information of each article currently stored in the entity container is determined through the third internal image, so that the entity container is automatically checked, and the checking efficiency is improved.

In an alternative embodiment, the method further comprises:

step D1, determining the quantity of each item stored in each physical container;

step D2, in the case that the quantity of the first item stored in any physical container is determined to be less than or equal to the set quantity threshold value, generating replenishment request information for the first item of any physical container.

The quantity of each item in each physical container may be determined for each physical container, resulting in the quantity of each item in each physical container. When the quantity of the first articles in any entity container is smaller than or equal to the set quantity threshold, generating replenishment request information for the first articles in any entity container, so that after receiving the replenishment request information, a manager can perform replenishment processing on the first articles in any entity container; when the quantity of the first articles is larger than the set quantity threshold value, the replenishment processing of the first articles is not needed. The first article can be any article in any physical container.

It will be understood by those skilled in the art that in the method of the present invention, the order of writing the steps does not imply a strict order of execution and any limitations on the implementation, and the specific order of execution of the steps should be determined by their function and possible inherent logic.

Based on the same concept, the embodiment of the present disclosure further provides an article identification system, as shown in fig. 3, which is an architecture schematic diagram of the article identification system provided by the embodiment of the present disclosure, and includes a container management platform 31 and a container 32, where the container 32 includes an entity container 321 and an image acquisition device 322; specifically, the method comprises the following steps:

the physical container 321 is used for storing at least one article in the arranged storage area;

the image collecting device 322 is configured to collect a first internal image and a second internal image corresponding to the storage area of the physical container;

the container management platform 31 is configured to execute the article identification method according to any one of the above embodiments based on the acquired first internal image and the acquired second internal image.

In practice, the image capturing device may be disposed at a position where the storage area of the solid container can be photographed, so that the image capturing device can capture the internal image corresponding to the storage area of the solid container, for example, the internal image may include the first internal image and the second internal image, and may further include a third internal image, and the like.

In another optional embodiment, an image comparison module may be disposed in the entity container, after the image acquisition device acquires the first internal image and the second internal image, the image comparison module may be controlled to compare the first internal image and the second internal image to obtain a comparison result, and when the comparison result indicates that the article information included in the first internal image and the second internal image are different, the first internal image and the second internal image may be sent to the container management platform, an image recognition algorithm disposed on the container management platform is controlled to recognize the first internal image and the second internal image respectively, and a first recognition result corresponding to the first internal image and a second recognition result corresponding to the second internal image are determined; and determining item difference information between the first and second interior images based on the first and second recognition results; and based on the article difference information, generating feedback information corresponding to the entity container, and reducing the data transmission pressure through the processing process.

Based on the same concept, an embodiment of the present disclosure further provides an article identification apparatus, as shown in fig. 4, which is a schematic structural diagram of the article identification apparatus provided in the embodiment of the present disclosure, and includes an acquisition module 401, a comparison module 402, an identification module 403, a determination module 404, and a first generation module 405, specifically:

the acquisition module 401 is configured to control an image acquisition device to respectively acquire a first internal image of an entity container at a first time and a second internal image of the entity container at a second time, where the second time is a time after the first time;

a comparison module 402, configured to compare the first internal image with the second internal image to obtain a comparison result;

an identifying module 403, configured to identify the first internal image and the second internal image respectively and determine a first identification result corresponding to the first internal image and a second identification result corresponding to the second internal image when the comparison result indicates that the item information included in the first internal image and the second internal image are different;

a determining module 404 for determining item difference information between the first internal image and the second internal image based on the first recognition result and the second recognition result;

a first generating module 405, configured to generate feedback information corresponding to the physical container based on the item difference information.

In a possible implementation manner, the first generating module 405, when generating the feedback information corresponding to the physical container based on the item difference information, is configured to:

acquiring input processing information input by a user;

In one possible embodiment, the first generating module 405, when generating the feedback information corresponding to the physical container based on the item difference information and the input processing information, is configured to:

In a possible embodiment, the apparatus further comprises: a second generating module 406, configured to:

In a possible implementation, the second generating module 406, when generating the first processing policy for the fault reporting operation based on the first internal image and the second internal image, is configured to:

In a possible embodiment, the apparatus further comprises: an inventory module 407 for:

In a possible embodiment, the apparatus further comprises: a replenishment module 408 to:

determining an item quantity for each item stored in each physical container;

In some embodiments, the functions of the apparatus provided in the embodiments of the present disclosure or the included templates may be used to execute the method described in the above method embodiments, and specific implementation thereof may refer to the description of the above method embodiments, and for brevity, no further description is provided here.

Based on the same technical concept, the embodiment of the disclosure also provides an electronic device. Referring to fig. 5, a schematic structural diagram of an electronic device provided in the embodiment of the present disclosure includes a processor 501, a memory 502, and a bus 503. The memory 502 is used for storing execution instructions and includes a memory 5021 and an external memory 5022; the memory 5021 is also referred to as an internal memory, and is used for temporarily storing operation data in the processor 501 and data exchanged with an external storage 5022 such as a hard disk, the processor 501 exchanges data with the external storage 5022 through the memory 5021, and when the electronic device 500 operates, the processor 501 communicates with the storage 502 through the bus 503, so that the processor 501 executes the following instructions:

Furthermore, the embodiments of the present disclosure also provide a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to perform the steps of the article identification method in the above method embodiments. The storage medium may be a volatile or non-volatile computer-readable storage medium.

The embodiments of the present disclosure also provide a computer program product, where the computer program product carries a program code, and instructions included in the program code may be used to execute the steps of the article identification method in the foregoing method embodiments, which may be referred to specifically in the foregoing method embodiments, and are not described herein again.

The computer program product may be implemented by hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, apparatus, and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present disclosure. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

The above are only specific embodiments of the present disclosure, but the scope of the present disclosure is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the present disclosure, and shall be covered by the scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.

Claims

1. An article identification method, comprising:

2. The method of claim 1, wherein generating feedback information corresponding to the physical container based on the item difference information comprises:

3. The method of claim 1, wherein generating feedback information corresponding to the physical container based on the item difference information comprises:

acquiring input processing information input by a user;

4. The method of claim 3, wherein generating feedback information corresponding to the physical container based on the item differentiation information and the input processing information comprises:

5. The method according to any one of claims 1 to 4, wherein after generating the feedback information corresponding to the physical container based on the item difference information, the method further comprises:

6. The method of claim 5, wherein generating a first processing policy for the fault reporting operation based on the first internal image and the second internal image comprises:

7. The method according to any one of claims 1 to 6, further comprising:

8. The method of any one of claims 1 to 7, further comprising:

determining an item quantity for each item stored in each physical container;

9. An item identification system, comprising: the container management platform comprises a container management platform and a container, wherein the container comprises a solid container and an image acquisition device;

the container management platform is used for executing the article identification method according to any one of claims 1 to 8 based on the acquired first internal image and the second internal image.

10. An article identification device, comprising:

11. An electronic device, comprising: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating via the bus when the electronic device is operating, the machine-readable instructions when executed by the processor performing the steps of the method of identifying an item of claim 1 to 8.

12. A computer-readable storage medium, having stored thereon a computer program which, when being executed by a processor, carries out the steps of the method of item identification according to any one of claims 1 to 8.