CN111274845B

CN111274845B - Method, device and system for identifying display condition of store shelf and electronic equipment

Info

Publication number: CN111274845B
Application number: CN201811472741.4A
Authority: CN
Inventors: 蒋赵贵
Original assignee: Hangzhou Hikvision Digital Technology Co Ltd
Current assignee: Hangzhou Hikvision Digital Technology Co Ltd
Priority date: 2018-12-04
Filing date: 2018-12-04
Publication date: 2023-09-05
Anticipated expiration: 2038-12-04
Also published as: CN111274845A

Abstract

The embodiment of the invention provides a method, a device, a system and electronic equipment for identifying the display condition of a store shelf, wherein the method comprises the following steps: obtaining a first panoramic image obtained when the image acquisition equipment carries out panoramic shooting on a target goods shelf, wherein the target goods shelf is provided with a plurality of commodity price tags; identifying the position information of each commodity price tag from the first panoramic image; obtaining commodity identifications of commodities corresponding to each commodity price tag; based on the position information of each commodity price tag, the full space condition of the commodity corresponding to each commodity identification is identified from the first panoramic image, so that the display condition of various commodities displayed on the goods shelf is automatically identified.

Description

Method, device and system for identifying display condition of store shelf and electronic equipment

Technical Field

The present invention relates to the field of monitoring technologies, and in particular, to a method, an apparatus, a system, and an electronic device for identifying a display condition of a store shelf.

Background

In stores, different products need to be displayed through shelves to assist consumers in browsing and purchasing products. In order to ensure the normal consumption of consumers, it is important to obtain the display condition of the goods displayed on the shelves in the store, for example: when the goods displayed on the goods shelf are sold, the goods need to be timely replenished.

Conventionally, a display condition of a commodity displayed on a shelf is manually checked, and further, a corresponding operation is performed according to the display condition of the commodity displayed on each shelf manually checked, for example, a full, a half full, an empty, or the like display condition, for example, a replenishment is performed for a commodity whose display condition is empty or half empty.

However, by manually checking the display condition of the goods displayed on the shelves, not only is labor-consuming, but also the manual checking is prone to the condition that the checking is not timely, thereby leading to the condition that the replenishment is not timely.

Disclosure of Invention

The embodiment of the invention aims to provide a method, a device, a system and electronic equipment for identifying the display condition of a store shelf, so as to automatically identify the display condition of various commodities displayed on the shelf. The specific technical scheme is as follows:

in one aspect, an embodiment of the present invention provides a method for identifying a store shelf display, the method including:

obtaining an image obtained when the image acquisition equipment carries out panoramic shooting on a target goods shelf as a first panoramic image, wherein the target goods shelf is provided with a plurality of commodity price tags;

identifying the position information of each commodity price tag from the first panoramic image;

Obtaining commodity identifications of commodities corresponding to each commodity price tag;

and identifying the full space condition of the commodity corresponding to each commodity identifier from the first panoramic image based on the position information of each commodity price tag.

Optionally, the step of identifying each commodity price tag and the position information of each commodity price tag from the first panoramic image includes:

based on a preset price tag identification model, identifying each commodity price tag and the position information of each commodity price tag from the first panoramic image, wherein the preset price tag identification model is as follows: the resulting model is trained in advance based on a plurality of sample images, which are images containing commodity price tags.

Optionally, the step of identifying the empty condition of the commodity corresponding to each commodity identifier from the first panoramic image based on the position information of each commodity price tag includes:

determining a commodity display area corresponding to each commodity price tag from the first panoramic image based on the position information of each commodity price tag;

aiming at the commodity display area corresponding to each commodity price tag, the following operation is carried out to obtain the full space condition of the commodity corresponding to each commodity identification;

Identifying whether a commodity is displayed in a commodity display area corresponding to a target commodity price tag from the first panoramic image, wherein the target commodity price tag is one of the identified commodity price tags;

if the commodity display area corresponding to the commodity price tag is identified to be not displayed with the commodity, determining that the full-empty condition of the commodity corresponding to the commodity identification corresponding to the commodity price tag is empty;

if the commodity is identified to be displayed in the commodity display area corresponding to the commodity price tag, determining the area of the commodity display area corresponding to the commodity price tag;

and determining the full-air condition of the commodity corresponding to the commodity label as the full-air condition of the commodity corresponding to the commodity label according to the commodity label, wherein if the ratio between the area of the commodity display area corresponding to the commodity label and the area of the commodity displayed in the commodity display area corresponding to the commodity label is smaller than a first threshold value, the full-air condition of the commodity corresponding to the commodity label is determined to be half-full, and if the ratio between the area of the commodity display area corresponding to the commodity label and the area of the commodity displayed in the commodity display area corresponding to the commodity label is not smaller than a first threshold value, the full-air condition of the commodity corresponding to the commodity label is determined to be full.

Optionally, the step of determining, based on the location information of each commodity price tag, a commodity display area corresponding to each commodity price tag from the first panoramic image includes:

determining commodity price tags corresponding to each commodity display layer in the target goods shelf from the first panoramic image based on the position information of each commodity price tag;

aiming at the commodity price tag corresponding to each commodity display layer, if the distance between the position of the leftmost commodity price tag corresponding to the commodity display layer and the position of the left edge of the goods shelf is not more than the preset distance, determining the area between every two adjacent commodity price tags as a commodity display area corresponding to the commodity price tag with the left position; the area between the rightmost commodity price tag corresponding to the commodity display layer and the right edge of the goods shelf is determined as the commodity display area corresponding to the rightmost commodity price tag corresponding to the commodity display layer;

if the distance between the position of the leftmost commodity price tag of the commodity display layer and the position of the left edge of the goods shelf exceeds the preset distance, determining the area between every two adjacent commodity price tags as a commodity display area corresponding to the commodity price tag with the right position; and determining the area between the leftmost commodity price tag corresponding to the commodity display layer and the left edge of the goods shelf as the commodity display area corresponding to the leftmost commodity price tag corresponding to the commodity display layer.

Optionally, after the step of identifying the empty condition of the commodity corresponding to each commodity identifier from the first panoramic image based on the position information of each commodity price tag, the method further includes:

and displaying the full space condition of the commodity corresponding to each identified commodity identifier.

Optionally, the commodity price tag comprises a commodity two-dimensional code;

before the step of obtaining the commodity identification of the commodity corresponding to each commodity price tag, the method further comprises the following steps:

obtaining an image obtained by the image acquisition equipment when panoramic shooting is carried out on the target shelf as a second panoramic image;

identifying the position information of each commodity price tag from the second panoramic image;

determining a commodity price tag meeting a preset screening condition from the identified commodity price tags as a current commodity price tag to be acquired, wherein the preset screening condition is as follows: a commodity price tag to be acquired which is not determined to be past;

and controlling the image acquisition equipment to rotate from the current position to a target position based on the position information of the current position of the commodity price tag to be acquired, wherein the target position is: the current commodity price tag to be acquired is positioned at the center position of the acquisition area of the image acquisition equipment, and the current position is: the image acquisition equipment acquires the position of the second panoramic image or the position of the price tag image of the former commodity price tag to be acquired;

The multiplying power of the image acquisition equipment is increased;

acquiring a price tag image acquired by the adjusted image acquisition equipment aiming at the current commodity price tag to be acquired;

identifying a commodity two-dimensional code contained in the current commodity price to be acquired in the price image, obtaining commodity information corresponding to the current commodity price to be acquired, and storing the commodity information, wherein the commodity information contains a commodity identifier of the corresponding commodity;

and restoring the multiplying power of the image acquisition equipment, and returning to execute the step of determining the commodity price which meets the preset screening condition from the identified commodity price as the current commodity price to be acquired.

Optionally, after the step of identifying the empty condition of the commodity corresponding to each commodity price tag from the panoramic image based on the position information of the position of each commodity price tag, the method further includes:

determining whether a commodity identifier with empty full condition of the corresponding commodity exists or not from the full condition of the commodity corresponding to each identified commodity identifier;

if the commodity identification with the empty condition of the corresponding commodity is determined, determining the commodity identification with the empty condition of the corresponding commodity as the commodity identification to be supplemented;

And sending first alarm information based on the to-be-restocked goods identifier, wherein the first alarm information is used for prompting the goods shortage.

Optionally, after the step of obtaining the commodity identifier of the commodity corresponding to each commodity price tag, the method further includes:

based on the commodity identification of the commodity corresponding to each commodity price tag, obtaining pre-stored expected position information required to be placed by each commodity price tag;

matching the position information of each commodity price tag with the expected position information of the commodity price tag;

and if the position information of the commodity price tag is not matched with the expected position information of the commodity price tag, sending second alarm information based on the commodity identification of the commodity corresponding to the commodity price tag, wherein the second alarm information is used for prompting that the position set by the commodity price tag is wrong.

In another aspect, an embodiment of the present invention provides a device for identifying a store shelf display, the device comprising:

the first obtaining module is used for obtaining an image obtained when the image acquisition equipment carries out panoramic shooting on a target goods shelf as a first panoramic image, wherein the target goods shelf is provided with a plurality of commodity price tags;

The first identification module is used for identifying each commodity price tag and the position information of each commodity price tag from the first panoramic image;

the second obtaining module is used for obtaining the commodity identification of the commodity corresponding to each commodity price tag;

and the second identification module is used for identifying the full space condition of the commodity corresponding to each commodity identifier from the first panoramic image based on the position information of each commodity price tag.

Optionally, the first identification module is specifically configured to

Optionally, the second identifying module includes:

the first determining unit is used for determining a commodity display area corresponding to each commodity price tag from the first panoramic image based on the position information of each commodity price tag;

the execution unit is used for executing the following operations aiming at the commodity display area corresponding to each commodity price tag so as to obtain the full-empty condition of the commodity corresponding to each commodity identifier; comprising the following steps:

The identification sub-module is used for identifying whether a commodity is displayed in a commodity display area corresponding to a target commodity price tag from the first panoramic image, wherein the target commodity price tag is one of the commodity price tags;

the first determining submodule is used for determining that the full-empty condition of the commodity corresponding to the commodity identification corresponding to the commodity price tag is empty if the commodity is identified not to be displayed in the commodity display area corresponding to the commodity price tag;

the second determining submodule is used for determining the area of the commodity display area corresponding to the commodity price tag if the commodity is identified to be displayed in the commodity display area corresponding to the commodity price tag;

and a third determining sub-module configured to determine, based on the area of the merchandise display area corresponding to the target merchandise price and the area of merchandise displayed in the merchandise display area corresponding to the target merchandise price, a full-air condition of the merchandise display area corresponding to the target merchandise price as a full-air condition of the merchandise corresponding to the merchandise identification corresponding to the target merchandise price, wherein if the ratio between the area of the merchandise display area corresponding to the target merchandise price and the area of merchandise displayed in the merchandise display area corresponding to the target merchandise price is less than a first threshold, then determining that the full-air condition of the merchandise corresponding to the merchandise identification corresponding to the merchandise price is half-full, and if the ratio between the area of the merchandise display area corresponding to the target merchandise price and the area of merchandise displayed in the merchandise display area corresponding to the target merchandise identification corresponding to the merchandise price is not less than a first threshold, then determining that the full-air condition of the merchandise identification corresponding to the merchandise price is full-air condition.

Optionally, the first determining unit is specifically configured to

Optionally, the apparatus further comprises:

and the display module is used for displaying the full-space condition of the commodities corresponding to each commodity identification after the full-space condition of the commodities corresponding to each commodity identification is identified from the first panoramic image based on the position information of each commodity price tag.

Optionally, the commodity price tag comprises a commodity two-dimensional code;

the apparatus further comprises:

the third obtaining module is used for obtaining an image obtained by the image acquisition equipment when panoramic shooting is carried out on the target goods shelf before the commodity identification of the commodity corresponding to each commodity price tag is obtained, and the image is used as a second panoramic image;

the third identification module is used for identifying each commodity price tag and the position information of each commodity price tag from the second panoramic image;

the first determining module is used for determining the commodity price tag meeting the preset screening condition from the identified commodity price tags and taking the commodity price tag as the current commodity price tag to be acquired, wherein the preset screening condition is as follows: a commodity price tag to be acquired which is not determined to be past;

the control module is used for controlling the image acquisition equipment to rotate from the current position to a target position based on the position information of the current position of the commodity price tag to be acquired, wherein the target position is: the current commodity price tag to be acquired is positioned at the center position of the acquisition area of the image acquisition equipment, and the current position is: the image acquisition equipment acquires the position of the second panoramic image or the position of the price tag image of the former commodity price tag to be acquired;

The enlarging module is used for enlarging the multiplying power of the image acquisition equipment;

a fourth obtaining module, configured to obtain a price tag image collected by the adjusted image collecting device for the current commodity price tag to be collected;

the fourth identification module is used for identifying the commodity two-dimensional code contained in the current commodity price to be acquired in the price image, obtaining commodity information corresponding to the current commodity price to be acquired, and storing the commodity information, wherein the commodity information contains commodity identifications of corresponding commodities;

and the recovery module is used for recovering the multiplying power of the image acquisition equipment and triggering the first determination module.

Optionally, the apparatus further comprises:

the second determining module is used for determining whether the commodity identifier with the empty condition of the corresponding commodity exists or not from the empty condition of the identified commodity corresponding to the commodity identifier after the empty condition of the commodity corresponding to each commodity price is identified from the panoramic image based on the position information of the position of each commodity price;

the third determining module is used for determining the commodity identifier with empty full condition of the corresponding commodity as the commodity identifier to be supplemented if determining that the commodity identifier with empty full condition of the corresponding commodity exists;

And the first sending module is used for sending first alarm information based on the to-be-restocked goods identification, wherein the first alarm information is used for prompting the goods shortage.

Optionally, the apparatus further comprises:

a fifth obtaining module, configured to obtain pre-stored expected location information required to be placed by each commodity price tag based on the commodity identifier of the commodity corresponding to each commodity price tag after the commodity identifier of the commodity corresponding to each commodity price tag is obtained;

the matching module is used for matching the position information of each commodity price tag with the expected position information of the commodity price tag;

and the second sending module is used for sending second alarm information based on the commodity identification of the commodity corresponding to the commodity price if the position information of the commodity price is not matched with the expected position information of the commodity price, wherein the second alarm information is used for prompting that the position set by the commodity price is wrong.

In another aspect, an embodiment of the present invention provides a system for identifying a store shelf display, the system including an image acquisition device and an electronic device;

the image acquisition equipment is used for carrying out panoramic shooting on the target goods shelf;

The electronic equipment is used for obtaining an image obtained by the image acquisition equipment when panoramic shooting is carried out on the target shelf, and the image is used as a first panoramic image; identifying the position information of each commodity price tag from the first panoramic image; obtaining commodity identifications of commodities corresponding to each commodity price tag; and identifying the full space condition of the commodity corresponding to each commodity identification from the first panoramic image based on the position information of each commodity price tag, wherein the target goods shelf is provided with a plurality of commodity price tags.

On the other hand, the embodiment of the invention provides electronic equipment, which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface and the memory are communicated with each other through the communication bus;

a memory for storing a computer program;

and the processor is used for realizing the steps of the method for identifying the display condition of the store shelf provided by the embodiment of the invention when executing the computer program stored in the memory.

In another aspect, an embodiment of the present invention provides a computer readable storage medium, where a computer program is stored, where the computer program when executed by a processor implements the steps of the method for identifying a store shelf display provided in any one of the foregoing embodiments of the present invention.

According to the technical scheme provided by the embodiment of the invention, an image obtained when the image acquisition equipment carries out panoramic shooting on the target goods shelf is obtained and is used as a first panoramic image, wherein the target goods shelf is provided with a plurality of commodity price tags; identifying the position information of each commodity price tag from the first panoramic image; obtaining commodity identifications of commodities corresponding to each commodity price tag; and identifying the full space condition of the commodity corresponding to each commodity identification from the first panoramic image based on the position information of each commodity price tag. Therefore, in the embodiment of the invention, the commodity price tag and the position information of the commodity price tag on the target goods shelf can be automatically identified from the first panoramic image obtained when the target goods shelf is panoramic photographed, so that the commodity identification corresponding to each commodity price tag is obtained, the full space condition of the area corresponding to each commodity price tag is determined from the first panoramic image based on the position information of each commodity price tag, namely the full space condition of the commodity corresponding to each commodity identification is determined, and the display condition of various commodities displayed on the goods shelf is automatically identified. Of course, it is not necessary for any one product or method of practicing the invention to achieve all of the advantages set forth above at the same time.

Drawings

In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a flow chart of a method for identifying a store shelf display according to an embodiment of the present invention;

FIG. 2A is a schematic illustration of a first panoramic image;

FIG. 2B is a schematic diagram of the product display area corresponding to each of the identified product price tags;

fig. 3 is a schematic diagram of a process for identifying a two-dimensional code of a commodity of a price tag according to an embodiment of the present invention;

FIG. 4 is a flowchart of a method for identifying a store shelf display according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a device for identifying a shelf display of a store according to an embodiment of the present invention;

FIG. 6 is a schematic diagram of a system for identifying store shelf display according to an embodiment of the present invention;

Fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

The embodiment of the invention provides a method, a device, a system and electronic equipment for identifying the display condition of a shelf of a store, so as to automatically identify the display condition of various commodities displayed on the shelf.

As shown in fig. 1, the embodiment of the invention provides a method for identifying a store shelf display condition, which may include the following steps:

s101: obtaining an image obtained by the image acquisition equipment when panoramic shooting is carried out on a target shelf, and taking the image as a first panoramic image;

wherein the target goods shelf is provided with a plurality of commodity price tags;

wherein, there is a correspondence between the goods displayed on the target shelf and the goods price tag, for example: each commodity displayed on the target goods shelf corresponds to a commodity price tag;

It can be understood that the method for identifying the display condition of the store shelf provided by the embodiment of the invention can be applied to any type of electronic equipment, and the electronic equipment can be equipment with a calculation processing function such as a computer, a mobile phone, an NVR (Net Video Recorder, a network hard disk recorder) and the like. The NVR has the main functions of receiving, storing and managing the digital video code stream transmitted by the acquisition equipment through a network, thereby realizing the advantage of a distributed architecture brought by networking.

In the embodiment of the invention, the image acquisition equipment can be image acquisition equipment such as a tripod head camera and a dome camera which can rotate. In one implementation, the electronic device may be a mobile robot.

In one implementation, it may be: each image acquisition device performs panoramic shooting on a goods shelf. When the electronic equipment detects that the period of shelf display condition identification arrives or receives a shelf display condition identification instruction, the identification flow of the shelf display condition of the store provided by the embodiment of the invention can be triggered, and an image obtained when the image acquisition equipment carries out panoramic shooting on a target shelf is obtained and is used as a first panoramic image. Wherein the first panoramic image comprises the entire merchandise display surface of the target shelf.

In another implementation, it may be: the image acquisition device can carry out panoramic shooting on any goods shelf in the image acquisition area. When the electronic equipment detects that the period of shelf display condition identification arrives or receives a shelf display condition identification instruction, the image acquisition equipment can be controlled to rotate to a preset point position corresponding to a pre-configured target shelf, so that the image acquisition equipment can acquire an image of the whole commodity display surface including the target shelf at the preset point position corresponding to the target shelf, namely panoramic shooting is carried out on the target shelf. Subsequently, the electronic device obtains an image obtained when the image acquisition device performs panoramic shooting on the target shelf as a first panoramic image.

It will be appreciated that in the above case, the correspondence between each shelf and the preset point position may be preconfigured for the image capturing device, either locally or in a connected storage device. Furthermore, when the electronic device detects that the period of shelf display condition identification arrives or receives a shelf display condition identification instruction, the image acquisition device can be controlled to rotate to a preset point position corresponding to the target shelf based on the preset corresponding relation, so that panoramic shooting of the image acquisition device on the target shelf is obtained. The target goods shelf can be any goods shelf in the image acquisition area of the image acquisition equipment.

In order to ensure that the electronic equipment acquires the ordering of panoramic images for different shelves, the shelf display condition identification instruction can carry shelf identifications, so that the electronic equipment can determine which shelf to carry out panoramic shooting. Or, the periods of shelf display condition recognition of different shelves may be set to be different, that is, there is a correspondence between the period of shelf display condition recognition and the shelf, and the electronic device may determine which shelf to panoramic photograph for based on the period of shelf display condition recognition. Or, the electronic device may prestore a shelf shooting sequence, and when the electronic device detects that a period for identifying a shelf display condition arrives or receives a shelf display condition identification instruction, the identification process of the shelf display condition of the store provided by the embodiment of the present invention is sequentially executed for different shelves based on the shelf shooting sequence, which is all possible.

The period of the shelf display condition identification can be a preset period, and the period of the shelf display condition identification can be set to be shorter because the display condition of the goods in the shelf changes frequently, namely the shelf display condition identification needs to be frequently carried out. For example, the period of shelf display recognition may be set in minutes, such as setting the period of shelf display recognition to 5 minutes.

In one case, the image capture area of the image capture device may be greater than the area occupied by the target shelf. One implementation may pre-store one shelf active area for each preset point location in advance. After a first panoramic image obtained by the image acquisition device when panoramic shooting is carried out on the target goods shelf at the preset point position corresponding to the target goods shelf is obtained, an area image corresponding to the effective area of the goods shelf can be determined from the first panoramic image, and then a subsequent identification process of the goods shelf display condition of the store is executed only on the area image. To a certain extent, the accuracy of the subsequent identification of the electronic equipment can be ensured, and the identification burden of the electronic equipment can be reduced. As shown in fig. 2A, a schematic view of a first panoramic image is shown, where a rectangular frame shown in the figure identifies a shelf effective area, and an area of the first panoramic image framed by the rectangular frame is an area image to be identified.

S102: identifying the position information of each commodity price tag from the first panoramic image;

in one case, the S102 may identify each commodity price and the location information of each commodity price from the area image corresponding to the shelf effective area in the first panoramic image. Wherein the shelf effective area is a pre-configured area corresponding to the target shelf.

It can be understood that the corresponding relationship exists between the effective area of the goods shelf and the preset point position of the image acquisition equipment, and the corresponding relationship exists between the goods shelf and the preset point position of the image acquisition equipment, namely the corresponding relationship exists between the goods shelf and the effective area of the goods shelf.

In one implementation, S102 may include: based on a preset price tag identification model, identifying each commodity price tag and the position information of each commodity price tag from the first panoramic image, wherein the preset price tag identification model is as follows: the resulting model is trained in advance based on a plurality of sample images, which are images containing commodity price tags.

In one implementation manner, the preset price tag identification model may be: based on machine learning algorithms such as convolutional neural networks and deep neural networks, the model obtained through training of the plurality of sample images is used for identifying the commodity price tags contained in the images and the position information of each commodity price tag.

In one case, the training process for obtaining the preset price tag identification model may include the following steps:

the electronic device may first obtain an initial price tag identification model, and obtain a sample image required for training, where the sample image includes a commodity price tag, and may refer to a commodity price tag included in the sample image as a sample commodity price tag. And calibrating each sample image, namely identifying the calibration position information of the sample commodity price tag contained in the sample image, wherein the sample commodity price tag in the sample image can be identified by a rectangular frame so as to identify the calibration position information of the sample commodity price tag. The calibration process can be manual calibration by an operator or calibration by an electronic device through a specific program.

Subsequently, the electronic equipment inputs the sample image into the initial price tag identification model, the initial price tag identification model extracts sample image characteristics of the sample image, classifies the sample image characteristics, outputs predicted position information of a sample commodity price tag in the sample image, and calculates a difference value between the output predicted position information and corresponding calibration position information by using a preset loss function; and when the difference value is larger than a preset value, adjusting parameters of an initial price tag identification model based on the obtained difference value, and further circularly inputting a sample image into the initial price tag identification model until the difference value is smaller than the preset value, and characterizing convergence of the initial price tag identification model, namely finishing training of the initial price tag identification model, so as to obtain the preset price tag identification model. Subsequently, based on the obtained preset price tag identification model, each commodity price tag and the position information of each commodity price tag are identified from the first panoramic image.

S103: obtaining commodity identifications of commodities corresponding to each commodity price tag;

in one implementation, the electronic device may have a local or connected storage device pre-stored with a correspondence between the merchandise display position in the shelf and the merchandise, i.e., a correspondence between the merchandise display position in the shelf and the merchandise identification of the merchandise is recorded. Wherein the merchandise display position in the shelf is a position for displaying merchandise.

It will be appreciated that the correspondence between the merchandise display location in the shelf and the merchandise price may be pre-stored locally on the electronic device or by a connected storage device. For example: the leftmost commodity display position of the first layer of the target shelf corresponds to the commodity price tag 1, namely the commodity price tag 1 is required to be arranged at the arrangement position corresponding to the leftmost commodity display position of the first layer of the target shelf; the intermediate product display position of the first layer shelf of the target shelf corresponds to the product price tag 2, that is, the product price tag 2 needs to be set at the set position corresponding to the intermediate product display position of the first layer shelf of the target shelf.

Correspondingly, after the position information of each commodity price tag is identified from the first panoramic image, the commodity display position corresponding to each commodity price tag can be determined based on the position information of each commodity price tag and the corresponding relation between the commodity display position in the goods shelf and the commodity price tag; and determining the commodity identification of the commodity corresponding to each commodity price based on the commodity display position corresponding to each commodity price and the corresponding relation between the commodity display position in the goods shelf and the commodity identification of the commodity.

It can be understood that there is a correspondence between the merchandise display position in the shelf and the merchandise price tag, and there is a correspondence between the merchandise display position in the shelf and the merchandise identification of the merchandise, and there is a correspondence between the merchandise price tag and the merchandise identification of the merchandise.

In another implementation manner, the electronic device may identify, after identifying each commodity price tag and the position information of each commodity price tag from the first panoramic image, for each commodity price tag, identify, in an area corresponding to the position information of the commodity price tag in the first panoramic image, the commodity identifier of the commodity carried by the commodity price tag, thereby obtaining the commodity identifier of the commodity corresponding to each commodity price tag, so as to distinguish different commodity price tags.

S104: and identifying the full space condition of the commodity corresponding to each commodity identification from the first panoramic image based on the position information of each commodity price tag.

In one implementation manner, the commodity display position corresponding to each commodity price tag, that is, the commodity display position of the commodity corresponding to each commodity identifier, can be determined based on the position information of each commodity price tag, and then the commodity display position of the commodity corresponding to each commodity identifier, so that the full space condition of the commodity at the position is determined from the first panoramic image.

In this case, the commodity display position corresponding to each commodity price is preset, and the area of the commodity display position corresponding to each commodity price is also preset. The process of determining the merchandise display position corresponding to each merchandise price based on the position information of each merchandise price may be: based on the position information of each commodity price tag, determining the commodity display position corresponding to each commodity price tag and the area of the commodity display position corresponding to each commodity price tag from the preset information, further identifying the area occupied by the displayed commodity corresponding to each commodity display position, further determining the full-air condition corresponding to each commodity display position based on the area of the commodity display position corresponding to each commodity price tag and the area occupied by the displayed commodity corresponding to each commodity display position, namely determining the full-air condition of the commodity corresponding to each commodity identification.

Wherein, can also be: the electronic device may identify the number of the displayed goods at each goods display position from the first panoramic image, and further determine the full space condition of each goods display position, that is, determine the full space condition of the goods corresponding to each goods identification, based on the maximum number of the displayed goods at each goods display position and the number of the displayed goods at each goods display position.

In another case, the commodity display position and the area corresponding to each commodity price tag can be determined from the first panoramic image directly based on the position information of each commodity price tag, so that the full space condition of each commodity display position is identified, namely, the full space condition of the commodity corresponding to each commodity identification is determined. Details are described later for the layout case.

According to the embodiment of the invention, the commodity price tag and the position information of the commodity price tag on the target goods shelf can be automatically identified from the first panoramic image obtained when the target goods shelf is panoramic photographed, so that the commodity identification corresponding to each commodity price tag is obtained, the full space condition of the area corresponding to each commodity price tag is determined from the first panoramic image based on the position information of each commodity price tag, namely the full space condition of the commodity corresponding to each commodity identification is determined, and the display condition of various commodities displayed on the goods shelf is automatically identified.

In one implementation manner, the step of identifying, from the first panoramic image, the empty condition of the commodity corresponding to each commodity identifier based on the location information of each commodity price tag may include:

Wherein the merchandise display area is the merchandise display position.

In this case, the electronic device may store, locally or in a connected storage device, a correspondence between each product price and a product display area, and when the position of the product price is determined, the corresponding product display area of the product price is determined.

Target identification is carried out on the commodity display area corresponding to each commodity price tag, namely whether commodities are displayed in the commodity display area corresponding to the target commodity price tag is identified; if the commodity is identified not to be displayed, determining that the full space condition of the commodity corresponding to the commodity identification corresponding to the commodity price tag is empty.

If the commodity is identified to be displayed in the commodity display area corresponding to the commodity price tag, identifying all the commodities displayed in the commodity display area corresponding to the target commodity price tag, and determining the area of the area occupied by the displayed commodities, namely determining the area of the area in which the commodity is displayed in the commodity display area corresponding to the target commodity price tag. Calculating the area of the commodity display area corresponding to the target commodity price tag, wherein the area of the commodity display area displays the commodity, and the ratio of the area of the commodity display area corresponding to the target commodity price tag; if the ratio is smaller than a first threshold value, determining that the full-space condition of the commodity corresponding to the commodity identification corresponding to the commodity price tag is half full. If the ratio is not smaller than the first threshold, determining that the full-empty condition of the commodity corresponding to the commodity identification corresponding to the commodity price tag is full.

The first threshold is a preset value.

The electronic device may use any target recognition algorithm to recognize whether a commodity is displayed in the commodity display area corresponding to the target commodity price tag, and recognize the displayed commodity when the commodity is displayed.

In one implementation manner, the step of determining, based on the location information of each commodity price tag, a commodity display area corresponding to each commodity price tag from the first panoramic image may include:

In this case, the shelf may have a plurality of commodity display layers, each of which may be provided with a plurality of commodity price tags, and the commodity display area corresponding to the commodity price tag may be determined for each commodity price tag of each commodity display layer. If the commodity price tag of the commodity display layer is disposed on the left side, that is, if the distance between the leftmost commodity price tag of the commodity display layer and the position where the left edge of the shelf is located does not exceed the preset distance, the area between every two adjacent commodity price tags can be determined as the commodity display area corresponding to the commodity price tag on the left side, and the area between the rightmost commodity price tag corresponding to the commodity display layer and the right edge of the shelf can be determined as the commodity display area corresponding to the rightmost commodity price tag corresponding to the commodity display layer.

In another case, when the commodity price tag of the commodity display layer is disposed on the right side, that is, when the distance between the leftmost commodity price tag of the commodity display layer and the position where the left edge of the shelf is located exceeds the preset distance, the region between every two adjacent commodity price tags may be determined as the commodity display region corresponding to the commodity price tag on the right side, and the region between the leftmost commodity price tag corresponding to the commodity display layer and the left edge of the shelf may be determined as the commodity display region corresponding to the leftmost commodity price tag corresponding to the commodity display layer. Fig. 2B is a schematic diagram of a product display area corresponding to a product price tag.

The left edge of the shelf may refer to a left frame of a real target shelf, or may refer to a left edge of a shelf effective area corresponding to the target shelf. Similarly, the right edge of the shelf may refer to the right frame of the real target shelf, or may refer to the right edge of the effective shelf area corresponding to the target shelf.

In one implementation manner, in order to enable a user to know the display condition of the goods in the goods shelf in real time, after determining the full-air condition of the goods corresponding to each goods identifier, the full-air condition can be displayed to the user, so that the user can take corresponding measures for the displayed full-air condition, for example: and when a commodity is checked to be empty, timely replenishing the commodity. After the step of identifying the full space condition of the commodity corresponding to each commodity identification from the first panoramic image based on the position information of each commodity price tag, the method may further include:

The full space condition of the goods corresponding to each identified goods identifier can be displayed through an application platform installed on the electronic equipment. It may also be: the electronic equipment sends the full-space condition of the identified commodity corresponding to each commodity identification to the display equipment corresponding to the designated target goods shelf, and the full-space condition of the identified commodity corresponding to each commodity identification is displayed through the display equipment corresponding to the target goods shelf. This is all that is possible.

In one implementation, the commodity price tag comprises a commodity two-dimensional code;

before the step of obtaining the commodity identifier of the commodity corresponding to each commodity price tag, the method may further include: the price tag identification process, namely a process of identifying the two-dimensional code of each commodity contained in each commodity price tag to obtain commodity information in the two-dimensional code of each commodity price tag, wherein the commodity information contains commodity identifications, as shown in fig. 3, the process comprises the following steps:

s301: obtaining a second panoramic image acquired by the image acquisition equipment aiming at the target goods shelf;

s302: identifying the position information of each commodity price tag from the second panoramic image;

The location information of each commodity price tag may be: and the position information of each commodity price tag in the first panoramic image.

S303: determining a commodity price tag meeting a preset screening condition from the identified commodity price tags as a current commodity price tag to be acquired, wherein the preset screening condition is as follows: a commodity price tag to be acquired which is not determined to be past;

s304: controlling the image acquisition equipment to rotate from the current position to the target position based on the position information of the current position of the commodity price tag to be acquired;

wherein, the target position is: the current commodity price tag to be acquired is positioned at the center position of the acquisition area of the image acquisition equipment, and the current position is as follows: the image acquisition equipment acquires the position of the second panoramic image or acquires the position of the price tag image of the former commodity price tag to be acquired;

s305: the multiplying power of the image acquisition equipment is increased;

s306: acquiring a price tag image acquired by the adjusted image acquisition equipment aiming at the current commodity price tag to be acquired;

s307: identifying a commodity two-dimensional code contained in the current commodity price to be acquired in the price tag image, obtaining commodity information corresponding to the current commodity price to be acquired, and storing the commodity information;

Wherein, the commodity information comprises commodity identifications of corresponding commodities;

s308: the magnification of the image capturing apparatus is restored, and the execution returns to S303.

In one implementation, it may be: when detecting that the period of price tag identification arrives or acquiring a price tag identification instruction, the electronic device can control the image acquisition device to rotate to a preset point position corresponding to a pre-configured target shelf, so that the image acquisition device can acquire an image of the whole commodity display surface including the target shelf at the preset point position corresponding to the target shelf, namely panoramic shooting is carried out on the target shelf. Subsequently, the electronic device obtains an image obtained when the image acquisition device performs panoramic shooting on the target shelf as a second panoramic image.

And further identifying the position information of each commodity price tag from the second panoramic image. It can be understood that when the image acquisition device performs panoramic shooting on the target goods shelf, the two-dimensional code of each commodity price in the image which is possibly acquired cannot be well identified, at this time, the shooting angle of the image acquisition device can be adjusted based on the position information of each identified commodity price, and then the shooting multiplying power of the image acquisition device can be adjusted, so that a clear commodity price image can be acquired, and the two-dimensional code of the commodity in the commodity price image can be well identified.

Wherein, can be: and determining the commodity price which meets the preset screening conditions from the identified commodity price as the current commodity price to be acquired, namely determining the commodity price which is not determined to be the current commodity price to be acquired as the current commodity price to be acquired, so as to avoid repeated identification of the commodity price and avoid waste of computing resources of electronic equipment. And further controlling the image acquisition equipment to rotate from the current position to the target position, so that the current commodity price tag to be acquired is positioned at the central position of the acquisition area of the image acquisition equipment, adjusting the multiplying power of the image acquisition equipment, enabling the picture to be clear, obtaining the price tag image acquired by the adjusted image acquisition equipment aiming at the current commodity price tag to be acquired, identifying the commodity two-dimensional code in the price tag image through a two-dimensional code identification algorithm, obtaining commodity information corresponding to the current commodity price tag to be acquired, and storing the commodity information. Then, the magnification of the image capturing apparatus is restored, that is, the magnification before the enlargement is restored.

It can be understood that when the image acquisition device acquires the second panoramic image, the position of the second panoramic image is determined, and the center position of the second panoramic image is determined; and the position of each commodity price tag in the second panoramic image is determined, and the electronic equipment can determine the position of the image acquisition equipment when acquiring the second panoramic image through the center position of the second panoramic image and the position of each commodity price tag in the second panoramic image, and rotate to the relative rotation angle of the target position of each commodity price tag. The electronic equipment can control the image acquisition equipment to rotate the relative rotation angle corresponding to the current commodity price to be acquired from the position where the second panoramic image is acquired, and the current commodity price to be acquired can be rotated to the target position of the current commodity price to be acquired.

Under the condition, after the electronic equipment controls the image acquisition equipment to acquire the price tag image of the current commodity price tag to be acquired, the multiplying power of the image acquisition equipment is required to be recovered, and the image acquisition equipment is required to be controlled to rotate to the position where the second panoramic image is acquired, namely the position of the preset point corresponding to the target goods shelf. So as to control the image acquisition equipment to rotate from the preset point position corresponding to the target goods shelf to the target position of the next current commodity price to be acquired, and acquire the price image of the next current commodity price to be acquired.

It can be understood that the relative rotation angle between the target positions of each two commodity price tags can be determined when the image acquisition device rotates from the position where the second panoramic image is acquired to the target position corresponding to each commodity price tag. The electronic equipment can control the image acquisition equipment to rotate the relative rotation angle between the current commodity price to be acquired and the previous commodity price to be acquired at the target position corresponding to the commodity price to be acquired, and the image acquisition equipment can rotate to the target position of the current commodity price to be acquired.

Under the condition, the electronic equipment controls the image acquisition equipment to directly rotate to the target position of the current commodity price to be acquired from the position where the price image of the commodity price to be acquired is located when the price image of the commodity price to be acquired is acquired after the price image of the commodity price to be acquired is acquired for the previous commodity price to be acquired is acquired, and then the multiplying power of the image acquisition equipment is recovered. Wherein, this former commodity price tag of waiting to gather is: the current commodity price to be collected is preceded by the latest commodity price determined as the current commodity price to be collected.

In this implementation manner, the determining, from the identified commodity price tags, the commodity price tag that meets the preset screening condition, as the current process of the commodity price tag to be collected, may be: and taking the commodity price tag in the second panoramic image as the current commodity price tag to be acquired sequentially from left to right and from top to bottom.

The step of increasing the multiplying power of the image acquisition equipment can be to adjust the multiplying power of the image acquisition equipment to a preset multiplying power value, so that a clear price tag image can be acquired, namely, the commodity two-dimensional code in the price tag image can be effectively identified. Wherein, the preset multiple value can be preset.

The above process of identifying each commodity price tag and the position information of each commodity price tag from the second panoramic image may refer to the process of identifying each commodity price tag and the position information of each commodity price tag from the first panoramic image, which will not be described herein.

In one case, the position of the commodity price tag does not change too frequently, i.e., the relative position between commodity price tags does not change too frequently, the cycle of price tag identification may be set relatively long, for example, the cycle of price tag identification may be set in days, for example, the cycle of price tag identification may be set to 1 day.

In one case, when the period of the price tag identification and the period of the shelf display identification overlap, the first panoramic image and the second panoramic image may be the same panoramic image, and at this time, the price tag identification may be performed first after identifying each commodity price tag and the position information of each commodity price tag, that is, the steps S303 to S308 are performed first until all the commodity two-dimensional codes of the commodity price tag are identified, and then the process of the shelf display identification is performed, that is, S103 and S104 are performed.

In one implementation, as shown in fig. 4, the method may include the steps of:

S401: obtaining an image obtained by the image acquisition equipment when panoramic shooting is carried out on a target shelf, and taking the image as a first panoramic image;

s402: identifying the position information of each commodity price tag from the first panoramic image;

s403: obtaining commodity identifications of commodities corresponding to each commodity price tag;

s404: based on the position information of each commodity price tag, identifying the full space condition of the commodity corresponding to each commodity identification from the first panoramic image;

here, S401 is the same as S101 shown in fig. 1, S402 is the same as S102 shown in fig. 1, S403 is the same as S103 shown in fig. 1, and S404 is the same as S104 shown in fig. 1.

S405: determining whether a commodity identifier with empty full condition of the corresponding commodity exists or not from the full condition of the commodity corresponding to each identified commodity identifier;

s406: if the commodity identification with the empty condition of the corresponding commodity is determined, determining the commodity identification with the empty condition of the corresponding commodity as the commodity identification to be supplemented;

s407: and sending first alarm information based on the commodity identification to be replenished.

The first alarm information is used for prompting the shortage of goods.

In one implementation, after determining the full condition corresponding to each commodity identifier, when determining that there is a commodity identifier corresponding to the full condition that is empty, in order to better prompt a user, the commodity identifier corresponding to the full condition that is empty may be determined first as the commodity identifier to be compensated, and then based on the commodity identifier to be compensated, first alarm information is sent to prompt the user that the commodity corresponding to the commodity identifier is out of stock and needs to be compensated.

In one implementation manner, the commodity identifier corresponding to the full space condition is not full may be used as the commodity identifier to be restocked, and further, based on the commodity identifier to be restocked, the first alarm information is sent to prompt the user that the commodity corresponding to the commodity identifier is out of stock and needs to be restocked. Wherein, the commodity identifier that the corresponding full-empty condition is not full may refer to: and other commodity identifications except the commodity identification corresponding to the full-space condition being full.

In one implementation manner, after the step of obtaining the commodity identifier of the commodity corresponding to each commodity price tag, the method may further include:

Matching the position information of the commodity price tag with the expected position information of the commodity price tag aiming at each commodity price tag;

if the position information of the commodity price tag is not matched with the expected position information of the commodity price tag, sending second alarm information based on the commodity identification of the commodity corresponding to the commodity price tag, wherein the second alarm information is used for prompting that the position set by the commodity price tag is wrong.

It will be appreciated that in order to ensure the ordering of the display positions of the products, an expected display position may be set for each product, i.e. the expected position information for each product price to be placed may be pre-stored. After obtaining the commodity identification of the commodity corresponding to each commodity price tag, the identified expected position information of the commodity price tag required to be placed can be obtained from the prestored expected position information of the commodity required to be placed according to the commodity identification of the commodity corresponding to each commodity price tag. And then, for each commodity price, matching the obtained expected position information of the commodity price to be placed with the corresponding position information of the commodity price identified from the first panoramic image, if the position information of the commodity price is not matched with the expected position information, indicating that the commodity price is misplaced, and at the moment, sending second alarm information based on the commodity identification of the commodity corresponding to the commodity price to prompt the user that the position set by the commodity price is misplaced. So that the user can adjust the display position of the commodity corresponding to the commodity price tag.

In one case, the process of matching, for each commodity price tag, the obtained expected location information of the commodity price tag to be placed with the corresponding location information of the commodity price tag identified from the first panoramic image may be: for each commodity price tag, determining expected position information of the commodity price tag to be placed, determining whether the expected position information of the commodity price tag is characterized by being on the same layer of a target shelf or not according to the corresponding position information of the commodity identified from the first panoramic image, and if the expected position information of the commodity price tag is on the same layer of the target shelf, determining that the expected position information of the commodity price tag to be placed is matched with the corresponding position information of the commodity identified from the first panoramic image; otherwise, the two are not matched.

It may also be: for each commodity price tag, determining expected position information of the commodity price tag to be placed, determining whether the expected position information of the commodity price tag to be placed is characterized by being on the same shelf or not, if so, determining that the expected position information of the commodity price tag to be placed is matched with the corresponding position information of the commodity identified from the first panoramic image; otherwise, the two are not matched.

It may also be: for each commodity price tag, determining expected position information required to be placed by the commodity price tag, and determining whether the corresponding position information of the commodity identified from the first panoramic image is characterized as being on the same side of the same layer of the same shelf, such as the left side, the right side, the middle and the like; if so, determining the expected position information of the commodity price tag to be placed, and matching the expected position information with the corresponding position information of the commodity identified from the first panoramic image; otherwise, the two are not matched.

In one implementation manner, the number of the pre-stored commodity price tags required to be displayed on the target shelf can be obtained based on the identification of the target shelf, and the number of the commodity price tags required to be displayed on the target shelf is judged to be the same as the number of the position information of the commodity price tags identified in the first panoramic image; if the commodity price tags are the same, the condition that the commodity price tags fall off is determined not to exist, and if the number of the commodity price tags required to be displayed on the target goods shelf is larger than the number of the position information of the commodity price tags identified in the first panoramic image, the condition that the commodity price tags fall off is determined to exist.

Corresponding to the above method embodiment, the embodiment of the present invention provides a device for identifying a display condition of a shelf of a store, as shown in fig. 5, where the device includes:

The first obtaining module 510 is configured to obtain an image obtained when the image capturing device performs panoramic shooting on a target shelf, as a first panoramic image, where the target shelf is provided with a plurality of commodity price tags;

a first identifying module 520, configured to identify each commodity price tag and location information of each commodity price tag from the first panoramic image;

a second obtaining module 530, configured to obtain a commodity identifier of a commodity corresponding to each commodity price tag;

the second identifying module 540 is configured to identify, from the first panoramic image, a full space condition of the commodity corresponding to each commodity identifier based on the location information of each commodity price tag.

In one implementation, the first identification module 520 is specifically configured to

In one implementation, the second identifying module 540 includes:

In one implementation, the first determining unit is specifically configured to

In one implementation, the apparatus further comprises:

the apparatus further comprises:

In one implementation, the apparatus further comprises:

Corresponding to the above method embodiment, the present invention further provides a system for identifying a display condition of a shelf of a store, as shown in fig. 6, where the system includes an image capturing device 610 and an electronic device 620;

The image acquisition device 610 is configured to perform panoramic shooting for a target shelf;

the electronic device 620 is configured to obtain an image obtained when the image capturing device 610 performs panoramic shooting on the target shelf as a first panoramic image; identifying the position information of each commodity price tag from the first panoramic image; obtaining commodity identifications of commodities corresponding to each commodity price tag; and identifying the full space condition of the commodity corresponding to each commodity identification from the first panoramic image based on the position information of each commodity price tag, wherein the target goods shelf is provided with a plurality of commodity price tags.

Corresponding to the above-mentioned method embodiments, the present invention further provides an electronic device, as shown in fig. 7, including a processor 710, a communication interface 720, a memory 730, and a communication bus 740, where the processor 710, the communication interface 720, and the memory 730 complete communication with each other through the communication bus 740,

a memory 730 for storing a computer program;

the processor 710 is configured to implement any of the above-described method steps for identifying a store shelf display provided by an embodiment of the present invention when executing a computer program stored on the memory 730.

The communication bus mentioned above for the electronic devices may be a peripheral component interconnect standard (Peripheral Component Interconnect, PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, etc. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.

The communication interface is used for communication between the electronic device and other devices.

The Memory may include random access Memory (Random Access Memory, RAM) or may include Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.

The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but also digital signal processors (Digital Signal Processing, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

Corresponding to the above method embodiment, the embodiment of the present invention further provides a computer readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the method steps for identifying the store shelf display provided by any one of the above embodiments of the present invention are implemented.

It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for system embodiments, since they are substantially similar to method embodiments, the description is relatively simple, as relevant to see a section of the description of method embodiments.

The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims

1. A method of identifying a store shelf display, the method comprising:

based on the position information of each commodity price tag, identifying the full space condition of the commodity corresponding to each commodity identifier from the first panoramic image;

the step of identifying the full-space condition of the commodity corresponding to each commodity identifier from the first panoramic image based on the position information of each commodity price tag comprises the following steps:

2. The method of claim 1, wherein the step of identifying each commodity price and location information for each commodity price from the first panoramic image comprises:

3. The method of claim 1, wherein the step of determining a merchandise display area corresponding to each merchandise price tag from the first panoramic image based on the location information of each merchandise price tag comprises:

4. The method of claim 1, wherein after the step of identifying a full space condition of each commodity corresponding to the commodity identification from the first panoramic image based on the position information of each commodity price tag, the method further comprises:

5. The method of claim 1, wherein the commodity price tag comprises a commodity two-dimensional code;

the multiplying power of the image acquisition equipment is increased;

6. The method according to any one of claims 1 to 5, wherein after the step of identifying the empty condition of the commodity corresponding to each commodity price tag from the panoramic image based on the position information of the position of each commodity price tag, the method further comprises:

7. The method according to any one of claims 1 to 5, further comprising, after the step of obtaining the commodity identification of the commodity corresponding to each commodity price tag:

8. A store shelf display identification device, the device comprising:

the second identification module is used for identifying the full space condition of the commodity corresponding to each commodity identification from the first panoramic image based on the position information of each commodity price tag;

The second identification module includes:

9. The device according to claim 8, wherein the first identification module is in particular for

10. The apparatus according to claim 8, wherein the first determining unit is specifically configured to

11. The apparatus of claim 8, wherein the apparatus further comprises:

12. The apparatus of claim 8, wherein the commodity price tag comprises a commodity two-dimensional code;

the apparatus further comprises:

13. The apparatus according to any one of claims 8-12, wherein the apparatus further comprises:

14. The apparatus according to any one of claims 8-12, wherein the apparatus further comprises:

15. A system for identifying a store shelf display, the system comprising an image acquisition device and an electronic device;

the electronic equipment is used for obtaining an image obtained by the image acquisition equipment when panoramic shooting is carried out on the target shelf, and the image is used as a first panoramic image; identifying the position information of each commodity price tag from the first panoramic image; obtaining commodity identifications of commodities corresponding to each commodity price tag; based on the position information of each commodity price tag, identifying the full space condition of the commodity corresponding to each commodity identifier from the first panoramic image, wherein the target goods shelf is provided with a plurality of commodity price tags; the step of identifying the full-space condition of the commodity corresponding to each commodity identifier from the first panoramic image based on the position information of each commodity price tag comprises the following steps: determining a commodity display area corresponding to each commodity price tag from the first panoramic image based on the position information of each commodity price tag; aiming at the commodity display area corresponding to each commodity price tag, the following operation is carried out to obtain the full space condition of the commodity corresponding to each commodity identification; identifying whether a commodity is displayed in a commodity display area corresponding to a target commodity price tag from the first panoramic image, wherein the target commodity price tag is one of the identified commodity price tags; if the commodity display area corresponding to the commodity price tag is identified to be not displayed with the commodity, determining that the full-empty condition of the commodity corresponding to the commodity identification corresponding to the commodity price tag is empty; if the commodity is identified to be displayed in the commodity display area corresponding to the commodity price tag, determining the area of the commodity display area corresponding to the commodity price tag; and determining the full-air condition of the commodity corresponding to the commodity label as the full-air condition of the commodity corresponding to the commodity label according to the commodity label, wherein if the ratio between the area of the commodity display area corresponding to the commodity label and the area of the commodity displayed in the commodity display area corresponding to the commodity label is smaller than a first threshold value, the full-air condition of the commodity corresponding to the commodity label is determined to be half-full, and if the ratio between the area of the commodity display area corresponding to the commodity label and the area of the commodity displayed in the commodity display area corresponding to the commodity label is not smaller than a first threshold value, the full-air condition of the commodity corresponding to the commodity label is determined to be full.

16. The electronic equipment is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;

a memory for storing a computer program;

a processor for carrying out the method steps of identifying a store shelf display according to any of claims 1-7 when executing a computer program stored on a memory.

17. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored therein a computer program which, when executed by a processor, implements the method steps of identifying a store shelf display of any of claims 1-7.