CN110738085A - shelf out-of-stock checking method, device and equipment and storage medium - Google Patents
shelf out-of-stock checking method, device and equipment and storage medium Download PDFInfo
- Publication number
- CN110738085A CN110738085A CN201810805700.6A CN201810805700A CN110738085A CN 110738085 A CN110738085 A CN 110738085A CN 201810805700 A CN201810805700 A CN 201810805700A CN 110738085 A CN110738085 A CN 110738085A
- Authority
- CN
- China
- Prior art keywords
- goods
- image
- label
- determining
- shelf
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
Abstract
The application discloses goods shelf shortage inspection methods, devices and equipment, and storage media, relates to the field of computers, and through the image of goods shelf images, the position of placing goods on a goods shelf is identified, and then the shortage condition of corresponding goods is determined according to the placing state of the goods in the position of placing the goods, so that the manual inspection of goods in a noodle arrangement mode is reduced, manpower resources are saved, and the inspection efficiency of goods shelf shortage can be improved.
Description
Technical Field
The present disclosure relates generally to the field of computers, and more particularly to a method, an apparatus, a device, and a storage medium for checking out of stock on kinds of shelves.
Background
In the operation of shelf scenes such as supermarkets and the like, the goods on the row surface are often emptied, and if the goods cannot be replenished in time, the business income of the supermarkets is influenced with high possibility.
At present, no special automatic inspection method exists, and the inspection is mainly carried out by means of patrol inspection of supermarket staff. Such a method has a relatively large requirement on the number of staff and the responsibility of the staff.
Therefore, the inspection of the goods arranged on the top of the supermarket consumes manpower resources greatly, and the working efficiency is not high.
Disclosure of Invention
In view of the above-mentioned drawbacks and deficiencies of the prior art, it is desirable to provide shelf out-of-stock inspection methods, devices, and apparatuses, and storage media to improve the efficiency of shelf out-of-stock inspection.
, an embodiment of the invention provides a shelf out-of-stock checking method, including:
acquiring a shelf image, and identifying the content in the image;
determining the position of goods on the goods shelf in the image;
and determining the goods shortage condition of the corresponding goods according to the placing state of the goods in the position for placing the goods.
Step , the determining the position of the goods on the shelf in the image specifically includes:
identifying a cargo tag in the image;
and determining the position of goods placed on the goods shelf in the image according to the goods label position and the preset offset.
Further , the identifying the goods label in the image specifically includes:
and identifying the object which accords with the characteristics of the goods label in the image as the goods label according to the characteristics of the preset goods label.
Further , the method further includes, after identifying the merchandise tag in the image:
determining the goods label as the goods label of the legal goods according to the content of the goods label; and/or
And identifying the content on the goods label and determining accurate commodity information.
In a second aspect, an embodiment of the present invention provides shelf out-of-stock checking devices, including:
the image identification unit is used for acquiring a shelf image and identifying the content in the image;
the position determining unit is used for determining the position of goods placed on the goods shelf in the image;
and the out-of-stock identification unit is used for determining the out-of-stock condition of the corresponding goods according to the placing state of the goods in the position for placing the goods.
, the position determination unit is specifically configured to:
identifying a cargo tag in the image;
and determining the position of goods placed on the goods shelf in the image according to the goods label position and the preset offset.
Further , the identifying the cargo label in the image by the position determining unit specifically includes:
and identifying the object which accords with the characteristics of the goods label in the image as the goods label according to the characteristics of the preset goods label.
Further , the position determination unit is further configured to:
after the goods label in the image is identified, determining that the goods label is a goods label of a legal commodity according to the content of the goods label; and/or
And after the goods label in the image is identified, identifying the content on the goods label and determining accurate commodity information.
In a third aspect, an embodiment of the present invention further provides kinds of devices, including a processor and a memory;
the memory contains instructions executable by the processor to cause the processor to perform a method as described in aspect .
In a fourth aspect, embodiments of the present invention further provide computer-readable storage media having stored thereon a computer program for implementing the method as described in aspect .
The embodiment of the invention provides shelf out-of-stock inspection methods, devices and equipment and a storage medium, wherein the positions of goods placed on a shelf are identified through the images of shelf images, and the out-of-stock conditions of corresponding goods are determined according to the placing states of the goods in the positions of the placed goods, so that the manual inspection of the goods in the arrangement is reduced, the manpower resources are saved, and the inspection efficiency of the out-of-stock of the shelf can be improved.
Drawings
Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:
FIG. 1 is a flowchart of a shelf out-of-stock inspection method according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a shelf out-of-stock inspection device according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of shelf out-of-stock inspection equipment according to an embodiment of the invention.
Detailed Description
The present application is described in further detail in with reference to the drawings and the examples, it being understood that the specific examples are set forth herein for the purpose of illustration only and are not intended to be limiting.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
Referring to fig. 1, a shelf out-of-stock checking method provided by the embodiment of the invention includes:
s101, acquiring a shelf image, and identifying the content in the image;
s102, determining the position of goods placed on a shelf in the image;
and S103, determining the shortage condition of the corresponding goods according to the placing state of the goods in the position for placing the goods.
By the method, the goods shortage condition of the corresponding goods can be determined through the image of the goods shelf image, so that manual goods inspection for arranging the goods is reduced, human resources are saved, and the goods shortage inspection efficiency of the goods shelf can be improved.
The image of the shelf can be a picture or a video captured by the image capture device, or can be frames in the video.
When the goods are determined to be out of stock, the staff can be informed in an alarm mode, a corresponding table can be generated and checked by the staff, and the goods out of stock data can be saved in steps, so that the staff can conveniently adjust the goods which are frequently out of stock in steps.
When the position of placing goods is determined, the position of the goods label can be located through the goods label, the position relation of the placing of the goods and the position relation of the label are regular under the condition of , for example, on a conventional shelf in a supermarket, the goods are placed right above the label in a mode, the goods are hung on the shelf, and the goods are placed right below the label in a mode.
When the position of the placed goods is determined in this way, in step S102, the determining the position of the placed goods on the shelf in the image specifically includes:
identifying a cargo tag in the image;
and determining the position of goods on the goods shelf in the image according to the goods label position and the preset offset.
The offset can be determined according to the source of the image, and after the image is acquired from the image acquisition equipment, the position of goods placed on the goods shelf in the image is determined according to the offset set by the image acquisition equipment.
Due to the particularity of the image acquisition angle of the image acquisition equipment, the specification and the like of the goods shelf in the field of view of the image acquisition equipment, the offset of the goods label position and the goods placing position in the image acquired by each image acquisition equipment is different, so that the offset is set for each image acquisition equipment, and the identification result is more accurate.
When the goods label is identified from the image, the goods label can be identified according to the characteristics of the preset goods label, in the case of , the design of the goods label is similar in the application scene of , for example, the goods label in a supermarket, , which includes a supermarket trademark, a goods name, a goods price, a goods bar code, etc., can be used as the characteristics of the goods label, and when an object meeting the corresponding characteristics exists in the image, the object can be identified as the goods label.
At this time, identifying the goods label in the image specifically includes:
and identifying the object which accords with the characteristics of the goods label in the image as the goods label according to the characteristics of the preset goods label.
After the goods label in the image is identified, the goods label can be determined to be a goods label of a legal commodity according to the content of the goods label; and/or identify the content on the merchandise tag to determine accurate merchandise information.
When the goods label is determined to be the goods label of a legal commodity, steps can be carried out to verify the accuracy of the identified goods label, other objects are prevented from being identified as the goods label, if accurate commodity information is determined, steps can be carried out to accurately judge which goods are out of stock, and after accurate goods shortage warning is carried out, the goods are more favorable for a worker to search goods out of stock.
It should be noted that while the operations of the method of the present invention are depicted in the drawings in a particular order, this is not required or implied that the operations must be performed in this particular order or that all of the illustrated operations must be performed to achieve desirable results.
The embodiment of the present invention further provides shelf out-of-stock inspection devices, as shown in fig. 2, including:
an image recognition unit 201, configured to acquire a shelf image and recognize content in the image;
a position determining unit 202 for determining a position of the goods placed on the shelf in the image;
and the out-of-stock identification unit 203 is used for determining the out-of-stock condition of the corresponding goods according to the placing state of the goods in the position where the goods are placed.
Further , the position determination unit 202 is specifically configured to:
identifying a cargo tag in the image;
and determining the position of goods on the goods shelf in the image according to the goods label position and the preset offset.
Further , the location determination unit 202 identifies the cargo label in the image, which specifically includes:
and identifying the object which accords with the characteristics of the goods label in the image as the goods label according to the characteristics of the preset goods label.
Further , the position determination unit 202 is further configured to:
after the goods label in the image is identified, determining the goods label as a goods label of a legal commodity according to the content of the goods label; and/or
After the goods label in the image is identified, the content on the goods label is identified, and accurate commodity information is determined.
It should be understood that the units or modules described in the apparatus correspond to the individual steps in the method described with reference to fig. 1. Thus, the operations and features described above for the method are equally applicable to the apparatus and the units comprised therein and will not be described in further detail here. The device can be realized in the browser or other security applications of the electronic equipment in advance, and can also be loaded into the browser or other security applications of the electronic equipment in a downloading mode and the like. Corresponding units in the device can cooperate with units in the electronic equipment to realize the solution of the embodiment of the application.
Reference is now made to fig. 3, which illustrates a schematic block diagram of a computer system suitable for implementing a terminal device or server of an embodiment of the present application.
As shown in fig. 3, the computer system includes a Central Processing Unit (CPU)301 that can perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)302 or a program loaded from a storage section 308 into a Random Access Memory (RAM) 303. In the RAM 303, various programs and data necessary for system operation are also stored. The CPU301, ROM 302, and RAM 303 are connected to each other via a bus 304. An input/output (I/O) interface 305 is also connected to bus 304.
The following components are connected to the I/O interface 305: an input portion 306 including a keyboard, a mouse, and the like; an output section 307 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 308 including a hard disk and the like; and a communication section 309 including a network interface card such as a LAN card, a modem, or the like. The communication section 309 performs communication processing via a network such as the internet. A drive 310 is also connected to the I/O interface 305 as needed. A removable medium 311 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 310 as necessary, so that a computer program read out therefrom is mounted into the storage section 308 as necessary.
For example, embodiments of the present disclosure include computer program products comprising a computer program tangibly embodied on a machine-readable medium, the computer program containing program code for performing the method of FIG. 1. in such embodiments, the computer program may be downloaded and installed from a network through the communication section 309, and/or installed from the removable media 311.
It should also be noted that in some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures, for example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved, it being noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, may be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The described units or modules may also be provided in a processor, for example, may be described as processors including an XX unit, a YY unit, and a ZZ unit, wherein the names of the units or modules do not in some cases constitute a limitation on the units or modules themselves, for example, the XX unit may also be described as a "unit for XX".
In another aspect, the present application also provides computer readable storage media, which may be the computer readable storage media contained in the apparatus described in the above embodiments, or the computer readable storage media that exist separately and are not assembled into the apparatus, the computer readable storage media stores or more programs than , and the programs are used by or more than processors to execute the formula input method described in the present application.
The above description is only a preferred embodiment of the application and is illustrative of the principles of the technology employed. It will be appreciated by a person skilled in the art that the scope of the invention as referred to in the present application is not limited to the embodiments with a specific combination of the above-mentioned features, but also covers other embodiments with any combination of the above-mentioned features or their equivalents without departing from the inventive concept. For example, the above features may be replaced with (but not limited to) features having similar functions disclosed in the present application.
Claims (10)
- The method for checking the out-of-stock of the kinds of shelves is characterized by comprising the following steps:acquiring a shelf image, and identifying the content in the image;determining the position of goods on the goods shelf in the image;and determining the goods shortage condition of the corresponding goods according to the placing state of the goods in the position for placing the goods.
- 2. The method of claim 1, wherein determining the location on the shelf in the image at which the item is located comprises:identifying a cargo tag in the image;and determining the position of goods placed on the goods shelf in the image according to the goods label position and the preset offset.
- 3. The method of claim 2, wherein the identifying the cargo tag in the image specifically comprises:and identifying the object which accords with the characteristics of the goods label in the image as the goods label according to the characteristics of the preset goods label.
- 4. The method of claim 2, wherein upon identifying the item tag in the image, further comprising:determining the goods label as the goods label of the legal goods according to the content of the goods label; and/orAnd identifying the content on the goods label and determining accurate commodity information.
- The goods shelf out-of-stock inspection device of kinds, characterized by comprising:the image identification unit is used for acquiring a shelf image and identifying the content in the image;the position determining unit is used for determining the position of goods placed on the goods shelf in the image;and the out-of-stock identification unit is used for determining the out-of-stock condition of the corresponding goods according to the placing state of the goods in the position for placing the goods.
- 6. The apparatus of claim 5, wherein the location determining unit is specifically configured to:identifying a cargo tag in the image;and determining the position of goods placed on the goods shelf in the image according to the goods label position and the preset offset.
- 7. The method of claim 6, wherein the location determining unit identifies the cargo tag in the image, in particular comprising:and identifying the object which accords with the characteristics of the goods label in the image as the goods label according to the characteristics of the preset goods label.
- 8. The method of claim 7, wherein the position determination unit is further to:after the goods label in the image is identified, determining that the goods label is a goods label of a legal commodity according to the content of the goods label; and/orAnd after the goods label in the image is identified, identifying the content on the goods label and determining accurate commodity information.
- 9, device comprising a processor and a memory, wherein:the memory contains instructions executable by the processor to cause the processor to perform the method of any of claims 1-4.
- 10, computer readable storage medium having stored thereon a computer program for implementing the method according to any of claims 1-4 to .
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810805700.6A CN110738085A (en) | 2018-07-20 | 2018-07-20 | shelf out-of-stock checking method, device and equipment and storage medium |
| PCT/CN2019/070342 WO2020015340A1 (en) | 2018-07-20 | 2019-01-04 | Shelf short supply checking method and apparatus, and device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810805700.6A CN110738085A (en) | 2018-07-20 | 2018-07-20 | shelf out-of-stock checking method, device and equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110738085A true CN110738085A (en) | 2020-01-31 |
Family
ID=69163852
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810805700.6A Pending CN110738085A (en) | 2018-07-20 | 2018-07-20 | shelf out-of-stock checking method, device and equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110738085A (en) |
| WO (1) | WO2020015340A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111985302A (en) * | 2020-07-02 | 2020-11-24 | 广东易理铺智能科技有限公司 | Single-chip-based multi-lens shelf detection method |
| CN112258107A (en) * | 2020-10-21 | 2021-01-22 | 旺塔琦智能科技(苏州)有限公司 | LED intelligent material rack management method, system, equipment and storage medium |
| CN113674336A (en) * | 2021-07-27 | 2021-11-19 | 浙江大华技术股份有限公司 | Shelf empty information determining method, computer equipment and storage device |
| CN115511875A (en) * | 2022-10-28 | 2022-12-23 | 上海东普信息科技有限公司 | Cargo accumulation detection method, device, equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102184405A (en) * | 2011-04-19 | 2011-09-14 | 清华大学 | Image acquisition-analysis method |
| CN102930264A (en) * | 2012-09-29 | 2013-02-13 | 李炳华 | System and method for acquiring and analyzing commodity display information based on image identification technology |
| CN103714469A (en) * | 2013-12-31 | 2014-04-09 | 广东兰贝斯信息科技有限公司 | Shopping guide system and method based on goods labels and electronic goods shelves |
| CN105701519A (en) * | 2014-12-10 | 2016-06-22 | 株式会社理光 | Realogram scene analysis of images: superpixel scene analysis |
| CN108269355A (en) * | 2018-02-06 | 2018-07-10 | 合肥美的智能科技有限公司 | Self-service equipment and its management method and device and management system and server |
-
2018
- 2018-07-20 CN CN201810805700.6A patent/CN110738085A/en active Pending
-
2019
- 2019-01-04 WO PCT/CN2019/070342 patent/WO2020015340A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102184405A (en) * | 2011-04-19 | 2011-09-14 | 清华大学 | Image acquisition-analysis method |
| CN102930264A (en) * | 2012-09-29 | 2013-02-13 | 李炳华 | System and method for acquiring and analyzing commodity display information based on image identification technology |
| CN103714469A (en) * | 2013-12-31 | 2014-04-09 | 广东兰贝斯信息科技有限公司 | Shopping guide system and method based on goods labels and electronic goods shelves |
| CN105701519A (en) * | 2014-12-10 | 2016-06-22 | 株式会社理光 | Realogram scene analysis of images: superpixel scene analysis |
| CN108269355A (en) * | 2018-02-06 | 2018-07-10 | 合肥美的智能科技有限公司 | Self-service equipment and its management method and device and management system and server |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111985302A (en) * | 2020-07-02 | 2020-11-24 | 广东易理铺智能科技有限公司 | Single-chip-based multi-lens shelf detection method |
| CN112258107A (en) * | 2020-10-21 | 2021-01-22 | 旺塔琦智能科技(苏州)有限公司 | LED intelligent material rack management method, system, equipment and storage medium |
| CN113674336A (en) * | 2021-07-27 | 2021-11-19 | 浙江大华技术股份有限公司 | Shelf empty information determining method, computer equipment and storage device |
| CN115511875A (en) * | 2022-10-28 | 2022-12-23 | 上海东普信息科技有限公司 | Cargo accumulation detection method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020015340A1 (en) | 2020-01-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110738085A (en) | shelf out-of-stock checking method, device and equipment and storage medium | |
| CN108416403B (en) | Method, system, equipment and storage medium for automatically associating commodity with label | |
| US10460287B2 (en) | Three-dimensional indexing protocol | |
| US10410171B2 (en) | System and method for inventory management | |
| US20140003655A1 (en) | Method, apparatus and system for providing image data to represent inventory | |
| CN112100425B (en) | Label labeling method and device based on artificial intelligence, electronic equipment and medium | |
| CN109829397B (en) | Video annotation method and system based on image clustering and electronic equipment | |
| CN102214343A (en) | Digital point-of-sale analyzer | |
| US9811537B2 (en) | Product identification via image analysis | |
| CN112200067B (en) | Intelligent video event detection method, system, electronic equipment and storage medium | |
| US11861668B2 (en) | Method, device, electronic apparatus and storage medium for generating order | |
| CN112257649A (en) | Article identification method, model training method, device and electronic equipment | |
| CN110516002B (en) | Map-based task display method, device, equipment and storage medium | |
| CN114049575A (en) | Intelligent detection method and system for contraband of security check machine and electronic equipment | |
| CN115359117B (en) | Commodity display position determining method, commodity display position determining device and readable storage medium | |
| CN111753614A (en) | Commodity shelf monitoring method and device | |
| US20210012686A1 (en) | Information Delivery Method and Information Delivery System Capable of Generating a Template for Displaying Information of Products | |
| CN110633740B (en) | Image semantic matching method, terminal and computer readable storage medium | |
| US20160117630A1 (en) | Orphaned package identification | |
| CN114239632B (en) | Wire and bar label identification method, system, electronic equipment and medium | |
| CN113763187B (en) | Method for determining claim result, method and device for sending claim request | |
| US20210073489A1 (en) | Commodity positioning method and apparatus, device and storage medium | |
| US20230064123A1 (en) | Article specification apparatus, article specification method, and non-transitory storage medium | |
| EP2991017A1 (en) | Method and system for dynamically updating information referred to an item and computer programs thereof | |
| CN111783500A (en) | Method and device for detecting position change of electronic price tag |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 314000 podium Building 1 / F, 4 / F, and 7 / F, building 5 / F, Jiaxing photovoltaic technology innovation park, 1288 Kanghe Road, Xiuzhou District, Jiaxing City, Zhejiang Province Applicant after: Hanshuo Technology Co.,Ltd. Address before: 314001 building 33, Zhifu center, Xiuzhou District, Jiaxing City, Zhejiang Province Applicant before: ZHEJIANG HANSHOW TECHNOLOGY Co.,Ltd. |