CN110826359A - Method and device for detecting article display - Google Patents

Method and device for detecting article display Download PDF

Info

Publication number
CN110826359A
CN110826359A CN201810899789.7A CN201810899789A CN110826359A CN 110826359 A CN110826359 A CN 110826359A CN 201810899789 A CN201810899789 A CN 201810899789A CN 110826359 A CN110826359 A CN 110826359A
Authority
CN
China
Prior art keywords
goods
state
articles
article
shelf
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810899789.7A
Other languages
Chinese (zh)
Inventor
马斌
王彪
李星毅
周银华
范歆炜
马力
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Original Assignee
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Century Trading Co Ltd, Beijing Jingdong Shangke Information Technology Co Ltd filed Critical Beijing Jingdong Century Trading Co Ltd
Priority to CN201810899789.7A priority Critical patent/CN110826359A/en
Publication of CN110826359A publication Critical patent/CN110826359A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/35Categorising the entire scene, e.g. birthday party or wedding scene
    • G06V20/36Indoor scenes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/08Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087Inventory or stock management, e.g. order filling, procurement or balancing against orders

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Human Resources & Organizations (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Development Economics (AREA)
  • General Business, Economics & Management (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • Multimedia (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The present disclosure provides an article display detection method and apparatus. The goods display detection device collects shelf images at a preset frequency, processes the collected images to determine the goods positions corresponding to the same kind of goods in the shelf, generates a shelf goods display diagram according to the goods position division and the goods information corresponding to the goods positions, and displays the shelf goods display diagram. According to the goods shelf management method and device, the goods positions of the same kind of goods in the goods shelf are obtained through image processing, so that a user can timely know the display condition of the goods on the goods shelf, and the management efficiency is effectively improved.

Description

Method and device for detecting article display
Technical Field
The present disclosure relates to the field of information processing, and in particular, to a method and an apparatus for detecting article display.
Background
Currently, in a conventional off-line retail store, a tally clerk places items on respective positions of shelves for selection by customers.
Disclosure of Invention
The inventor discovers through research that the commodities are placed in a manual mode, so that the current display condition and the current situation of the commodities cannot be obtained, and whether a tally clerk places the commodities correctly and normatively according to the display requirements and the standards cannot be known, and negative influences are brought to the sales and consumption experiences.
Therefore, the scheme capable of acquiring the commodity display condition in time is provided.
In accordance with an aspect of one or more embodiments of the present disclosure, there is provided an article display detection method including: acquiring shelf images at a predetermined frequency; processing the acquired images to determine the goods positions corresponding to the same kind of goods in the goods shelf; generating a shelf article display diagram according to the goods position division and the article information corresponding to the goods positions; a shelf item planogram is presented.
In some embodiments, processing the acquired image comprises: aiming at each layer of the goods shelf, sequentially identifying each article to obtain article credibility; merging the positions of the same kind of articles for the articles with the article credibility greater than the credibility threshold; and dividing the goods space according to the position area of the same kind of articles.
In some embodiments, the above method further comprises: in each goods space, judging whether neglected articles exist, wherein the neglected articles are articles with article credibility not greater than a credibility threshold; and if the neglected articles exist, setting the state of the articles corresponding to the goods space to be in an irregular state.
In some embodiments, the above method further comprises: judging whether other articles different from the articles corresponding to the goods space exist in each goods space; and if other articles different from the article corresponding to the goods space exist, setting the state of the article corresponding to the goods space as a misplaced state.
In some embodiments, the above method further comprises: in each goods space, judging whether the quantity of the goods corresponding to the goods space is less than a quantity threshold or not; and if the quantity of the articles corresponding to the goods space is smaller than the quantity threshold, setting the state of the articles corresponding to the goods space as the out-of-stock state.
In some embodiments, the above method further comprises: monitoring the duration of the state of the goods corresponding to the goods location; and if the duration time of the state of the goods corresponding to the goods position in the nonstandard state, the misplaced state or the out-of-stock state exceeds the corresponding time threshold, sending related prompt information.
In some embodiments, the above method further comprises: generating an article state list according to the goods position division and the state of the articles corresponding to the goods positions; and presenting a list of the states of the items.
In some embodiments, the above method further comprises: pushing at least one of the shelf item planogram and the item status list to the user terminal.
In accordance with another aspect of one or more embodiments of the present disclosure, there is provided an article display detection apparatus comprising: an image acquisition module configured to acquire shelf images at a predetermined frequency; the goods position dividing module is configured to process the acquired images so as to determine the goods positions corresponding to the same type of goods in the goods shelf; the display diagram generating module is configured to generate a display diagram of the goods on the shelf according to the goods position division and the goods information corresponding to the goods positions; a presentation module configured to present a shelf item planogram.
In some embodiments, the goods space division module is configured to identify each item in turn for each layer of the shelf to obtain item reliability, merge locations of the same item for items with item reliability greater than a reliability threshold, and divide the goods space according to a location area where the same item is located.
In some embodiments, the above apparatus further comprises: and the state management module is configured to judge whether the neglected articles exist in each goods space, wherein the neglected articles are articles of which the article credibility is not greater than the credibility threshold, and if the neglected articles exist, the state of the articles corresponding to the goods space is set to be in an irregular state.
In some embodiments, the status management module is further configured to determine whether there is another article different from the article corresponding to the cargo space in each cargo space, and set the status of the article corresponding to the cargo space to the misplaced status if there is another article different from the article corresponding to the cargo space.
In some embodiments, the status management module is further configured to determine, in each cargo space, whether the quantity of the items corresponding to the cargo space is less than a quantity threshold, and set the status of the items corresponding to the cargo space to the out-of-stock status if the quantity of the items corresponding to the cargo space is less than the quantity threshold.
In some embodiments, the above apparatus further comprises: and the duration management module is configured to monitor the duration of the state of the goods corresponding to the goods location, and send related prompt information if the duration of the state of the goods corresponding to the goods location in the nonstandard state, the misplaced state or the out-of-stock state exceeds a corresponding time threshold.
In some embodiments, the above apparatus further comprises: the detail list generating module is configured to generate an article state detail list according to the goods location division and the state of the articles corresponding to the goods location; the presentation module is further configured to present the item status schedule.
In some embodiments, the above apparatus further comprises: a push module configured to push at least one of a shelf item planogram and an item status list to the user terminal.
According to an aspect of one or more embodiments of the present disclosure, there is provided an item recommendation device including: a memory configured to store instructions; a processor coupled to the memory, the processor configured to perform a method according to any of the embodiments described above based on instructions stored in the memory.
According to another aspect of one or more embodiments of the present disclosure, there is provided a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, which when executed by a processor, implement a method as described above in relation to any one of the embodiments.
Other features of the present disclosure and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.
Drawings
In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and for those skilled in the art, other drawings can be obtained according to the drawings without inventive exercise.
FIG. 1 is an exemplary flow chart of an item display detection method according to one embodiment of the present disclosure;
FIG. 2 is an exemplary flow chart of a cargo space division method according to one embodiment of the present disclosure;
FIG. 3 is a schematic diagram of cargo space division according to an embodiment of the present disclosure;
FIG. 4 is a schematic illustration of a shelf item display diagram according to one embodiment of the present disclosure;
FIG. 5 is a schematic diagram of cargo space division according to another embodiment of the present disclosure;
FIG. 6 is a schematic diagram of cargo space division according to yet another embodiment of the present disclosure;
FIG. 7 is a schematic diagram of cargo space division according to yet another embodiment of the present disclosure;
FIG. 8 is an exemplary block diagram of an article display detection arrangement according to one embodiment of the present disclosure;
FIG. 9 is an exemplary block diagram of an article display detection arrangement according to another embodiment of the present disclosure;
fig. 10 is an exemplary block diagram of an article display detection arrangement according to another embodiment of the present disclosure.
Detailed Description
The technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, and not all of the embodiments. The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.
The relative arrangement of the components and steps, the numerical expressions, and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.
Meanwhile, it should be understood that the sizes of the respective portions shown in the drawings are not drawn in an actual proportional relationship for the convenience of description.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
Fig. 1 is an exemplary flow chart of an item display detection method according to one embodiment of the present disclosure. In some embodiments, the method steps of the present embodiment may be performed by an article display detection apparatus.
At step 101, shelf images are acquired at a predetermined frequency.
In some embodiments, the photographs may be taken every 3 minutes. Considering that the customers are often present in front of the shelf and the articles are blocked, the images are shot one at every 10 seconds every time when shooting is performed, three images are continuously shot, and the image with the best effect (the image with the largest number of articles capable of being identified is regarded as the image with the best effect) is taken as the image shot at this time.
In some embodiments, the captured image is uploaded to a cloud server for storage.
At step 102, the captured images are processed to determine the locations of the same type of item in the shelves.
In some embodiments, the goods space is divided by using the position areas where the same kind of goods are located in each layer of the shelf, so that the goods space is dynamically divided according to the placement of the goods, and the goods space and the goods are dynamically bound.
In step 103, a shelf item planogram is generated based on the goods allocation and the item information corresponding to the goods allocation.
At step 104, a shelf item planogram is presented.
In the above embodiments of the present disclosure, the positions of the same kind of articles in the shelves are obtained through image processing, so that the display conditions of the articles on the shelves can be known in time.
Fig. 2 is an exemplary flowchart of a cargo space division method according to an embodiment of the present disclosure. As shown in fig. 2, the step of processing the acquired image may include the following steps.
At step 201, for each layer of the shelf, each item is identified in turn to obtain item credibility.
In step 202, for the articles with the article credibility greater than the credibility threshold, the positions of the same articles are merged.
In some embodiments, items for which the item's trustworthiness is not greater than the trustworthiness threshold may be ignored.
In the process of transportation and storage, some articles may have deformed appearance and damaged outer packages, so that effective identification cannot be performed through image identification. In this case, items that cannot be identified accurately are omitted so as not to affect the cargo space division.
In step 203, goods space division is performed according to the position areas where the same kind of articles are located.
Fig. 3 is a schematic diagram of cargo space division according to an embodiment of the disclosure.
As shown in fig. 3, 8 items are placed on a certain level of the shelf. And sequentially identifying each article through image processing to obtain the corresponding article credibility. For example, the recognition is performed in a left-to-right order.
If the reliability of the article being beverage a is 0.99, it can be judged that the article is beverage a. If the item is beverage a, the confidence level is 0.85, indicating that the item is different from beverage a in terms of appearance, packaging, and the like.
Through recognition, the first 4 items are found to be the items A, and the last 4 items are found to be the items B, so that the goods space of the layer of the goods shelf can be divided. As shown in FIG. 3, cargo space 1-1 corresponds to item A and cargo space 1-2 corresponds to item B.
The corresponding shelf article display diagram is obtained by dividing the goods positions of each layer of the shelf.
FIG. 4 is a schematic illustration of a shelf item display diagram according to one embodiment of the present disclosure.
As shown in fig. 4, the shelf is divided into three layers. In the first layer, beverage A is placed in the cargo space 1-1, beverage B is placed in the cargo space 1-2, beverage C is placed in the cargo space 2-1, beverage D is placed in the cargo space 2-2, beverage E is placed in the cargo space 2-3, beverage F is placed in the cargo space 3-1, and beverage G is placed in the cargo space 3-2. The goods position is dynamically divided according to the placement of the goods, and the goods position and the goods are dynamically bound, so that a user can know the display condition of the goods on the shelf in real time through the shelf goods display diagram.
In some embodiments, in each cargo space, by determining whether there are items that are ignored, where the items that are ignored are items whose item trustworthiness is not greater than the trustworthiness threshold. And if the neglected articles exist, setting the state of the articles corresponding to the goods space to be in an irregular state.
Fig. 5 is a schematic diagram of cargo space division according to another embodiment of the present disclosure.
As shown in fig. 5, 8 items are placed on a certain level of the shelf. And sequentially identifying each article through image processing to obtain the corresponding article credibility. Through analysis, the 1 st, 2 nd and 4 th articles are article A, and the 5 th to 8 th articles are article B. The item confidence level of item 3, item a, was 0.88. Since the item confidence is less than the threshold of 0.9, the status of the item may be considered as non-normative and the item may be ignored. Therefore, the goods space of the layer of goods shelf can be divided. As shown in FIG. 5, the cargo space 1-1 corresponds to items 1, 2 and 4, and the cargo space 1-2 corresponds to items 5 to 8.
Because the goods which are neglected exist in the goods position 1-1, the state of the goods corresponding to the goods position 1-1 is set to be in an irregular state, namely, the goods which are not in the standard exist in the goods position. The state of the goods corresponding to the goods position 1-2 is set to be a normal state.
In some embodiments, in each cargo space, a determination is made as to whether there are other items that are different from the item corresponding to the cargo space. And if other articles different from the article corresponding to the goods space exist, setting the state of the article corresponding to the goods space as a misplaced state.
Fig. 6 is a schematic diagram of cargo space division according to yet another embodiment of the present disclosure.
As shown in fig. 6, 8 items are placed on a certain level of the shelf. And sequentially identifying each article through image processing to obtain the corresponding article credibility. Through analysis, the 1 st, 2 nd and 4 th articles are article A, the 3 rd article is article M, and the 5 th to 8 th articles are article B. Because the 1 st, 2 nd and 4 th articles are the same articles, the goods positions 1-1 are corresponding to the 1 st to 4 th articles and the goods positions 1-2 are corresponding to the 5 th to 8 th articles through position combination.
Since one article M is mixed in the article a in the cargo space 1-1, the 3 rd article is judged to be in a misplaced state. Since there is a misplaced item in the cargo space 1-1, the status of the cargo space 1-1 corresponding to the item is set to a misplaced status, i.e., indicating that there is a misplaced item in the cargo space. The state of the goods corresponding to the goods position 1-2 is set to be a normal state.
In some embodiments, in each of the cargo spaces, the quantity of the items corresponding to the cargo space is determined by determining whether the quantity of the items is less than a quantity threshold. And if the quantity of the articles corresponding to the goods space is smaller than the quantity threshold, setting the state of the articles corresponding to the goods space as the out-of-stock state.
Fig. 7 is a schematic diagram of cargo space division according to yet another embodiment of the present disclosure.
As shown in fig. 7, 8 items are placed on a certain level of the shelf. And sequentially identifying each article through image processing to obtain the corresponding article credibility. Through analysis, the 1 st and 2 nd articles are article A, and the 3 rd to 8 th articles are article B.
In cargo space 1-1, there are only 2 items of article A. Since the number of the articles a is less than the corresponding threshold (e.g., 3), it is determined that the articles a are in the out-of-stock state. Accordingly, the state of the goods corresponding to the goods position 1-1 is set to be in the out-of-stock state. The state of the goods corresponding to the goods position 1-2 is set to be a normal state.
In some embodiments, the duration of the status of the items corresponding to the cargo space is also monitored. And if the duration time of the state of the goods corresponding to the goods position in the nonstandard state, the misplaced state or the out-of-stock state exceeds the corresponding time threshold, sending related prompt information.
For example, if the out-of-stock state of a certain cargo space lasts for more than 2 hours, a prompt message is sent to the relevant staff.
In some embodiments, an item status list is generated and presented according to the cargo space division and the status of the items corresponding to the cargo space. Thus, the user can know the state of the article in each cargo space, the state duration and other information through the detail sheet. For example, the article status list is shown in table 1.
TABLE 1
As can be seen from Table 1, the cargo spaces 1-1, 2-3 and 3-1 are in the out-of-stock state, the cargo spaces 1-2 and 3-2 are in the misplaced state, the cargo spaces 2-1 and 2-3 are in the out-of-specification state, the cargo spaces 2-3 are in the out-of-stock and out-of-specification states, and the cargo space 2-2 is in the normal state. Table 1 also provides the duration corresponding to each state. Through the detail list, a user can conveniently and quickly know information such as the current article state, the state duration and the like in each goods space, and therefore management efficiency can be improved.
In some embodiments, at least one of a shelf item planogram and an item status list may also be pushed to the user terminal. Therefore, the user can conveniently and timely know the relevant information of the goods position through the mobile terminal or the relevant webpage.
Fig. 8 is an exemplary block diagram of an article display detection arrangement according to one embodiment of the present disclosure. As shown in fig. 8, the article display detecting apparatus includes an image capturing module 81, a cargo space dividing module 82, a planogram generating module 83, and a presenting module 84.
The image acquisition module 81 is configured to acquire shelf images at a predetermined frequency.
In some embodiments, the photographs may be taken every 3 minutes. Considering that the customers are often present in front of the shelf and the articles are blocked, the images are shot one at every 10 seconds every time when shooting is performed, three images are continuously shot, and the image with the best effect (the image with the largest number of articles capable of being identified is regarded as the image with the best effect) is taken as the image shot at this time.
In some embodiments, the captured image is uploaded to a cloud server for storage.
The cargo space division module 82 is configured to process the captured images to determine the cargo space corresponding to the same item in the shelf.
In some embodiments, the goods space is divided by using the position areas where the same kind of goods are located in each layer of the shelf, so that the goods space is dynamically divided according to the placement of the goods, and the goods space and the goods are dynamically bound.
The planogram generating module 83 is configured to generate a planogram of the shelf items based on the division of the cargo space and the item information corresponding to the cargo space.
The presentation module 84 is configured to present a shelf item planogram.
In the above embodiments of the present disclosure, the positions of the same kind of articles in the shelves are obtained through image processing, so that the display conditions of the articles on the shelves can be known in time.
In some embodiments, the cargo space classification module 82 is configured to identify each item in turn for each layer of the shelf to obtain item reliability, merge locations of the same item for items with item reliability greater than a reliability threshold, and perform cargo space classification according to a location area of the same item.
In some embodiments, items for which the item's trustworthiness is not greater than the trustworthiness threshold may be ignored.
Fig. 9 is an exemplary block diagram of an article display detection arrangement according to another embodiment of the present disclosure. In contrast to the embodiment shown in fig. 8, in the embodiment shown in fig. 9, a status management module 85 is further included.
The status management module 85 is configured to determine whether an article to be ignored exists in each cargo space, where the article to be ignored is an article whose article credibility is not greater than the credibility threshold, and if the article to be ignored exists, set the status of the article corresponding to the cargo space to an irregular status.
In some embodiments, the status management module 85 is further configured to determine whether there is another article different from the article corresponding to the cargo space in each cargo space, and set the status of the article corresponding to the cargo space to the misplaced status if there is another article different from the article corresponding to the cargo space.
In some embodiments, the status management module 85 is further configured to determine whether the quantity of the items corresponding to the cargo space is less than a quantity threshold in each cargo space, and set the status of the items corresponding to the cargo space to the out-of-stock status if the quantity of the items corresponding to the cargo space is less than the quantity threshold.
In some embodiments, as shown in FIG. 9, a duration management module 86 is also included. The duration management module 86 is configured to monitor the duration of the state of the article corresponding to the cargo space, and send a relevant prompt message if the duration of the state of the article corresponding to the cargo space in the non-standard state, the misplaced state or the out-of-stock state exceeds a corresponding time threshold.
In some embodiments, as shown in fig. 9, a list generation module 87 is further included. The list generating module 87 is configured to generate an item status list according to the cargo space division and the status of the item corresponding to the cargo space. The presentation module 84 is further configured to present the item status list.
In some embodiments, as shown in FIG. 9, a push module 88 is also included. The push module 88 is configured to push at least one of a shelf item planogram and an item status list to the user terminal.
Fig. 10 is an exemplary block diagram of an article display detection arrangement according to another embodiment of the present disclosure. As shown in fig. 10, the item display detection apparatus includes a memory 1001 and a processor 1002.
The memory 1001 is used for storing instructions, the processor 1002 is coupled to the memory 1001, and the processor 1002 is configured to execute the method according to any one of the embodiments in fig. 1 to fig. 2 based on the instructions stored in the memory.
As shown in fig. 10, the article display detection apparatus further includes a communication interface 1003 for information interaction with other devices. Meanwhile, the device also comprises a bus 1004, and the processor 1002, the communication interface 1003 and the memory 1001 are communicated with each other through the bus 1004.
The memory 1001 may include a high-speed RAM memory, and may further include a non-volatile memory (e.g., at least one disk memory). The memory 1001 may also be a memory array. The storage 1001 may also be partitioned and the blocks may be combined into virtual volumes according to certain rules.
Further, the processor 1002 may be a central processing unit CPU, or may be an application specific integrated circuit ASIC, or one or more integrated circuits configured to implement embodiments of the present disclosure.
The present disclosure also relates to a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and the instructions, when executed by a processor, implement a method according to any one of fig. 1 to 2.
In some embodiments, the functional unit modules described above may be implemented as a general purpose Processor, a Programmable Logic Controller (PLC), a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable Logic device, discrete gate or transistor Logic, discrete hardware components, or any suitable combination thereof for performing the functions described in this disclosure.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The description of the present disclosure has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the disclosure in the form disclosed. Many modifications and variations will be apparent to practitioners skilled in this art. The embodiment was chosen and described in order to best explain the principles of the disclosure and the practical application, and to enable others of ordinary skill in the art to understand the disclosure for various embodiments with various modifications as are suited to the particular use contemplated.

Claims (18)

1. An item display detection method comprising:
acquiring shelf images at a predetermined frequency;
processing the acquired images to determine the goods positions corresponding to the same kind of goods in the goods shelf;
generating a shelf article display diagram according to the goods position division and the article information corresponding to the goods positions;
presenting the shelf item planogram.
2. The method of claim 1, processing the acquired image comprising:
sequentially identifying each article for each layer of the shelf to obtain article credibility;
merging the positions of the same kind of articles for the articles with the article credibility greater than the credibility threshold;
and dividing the goods space according to the position area of the same kind of articles.
3. The method of claim 2, further comprising:
in each goods space, judging whether neglected articles exist, wherein the neglected articles are articles with article credibility not greater than a credibility threshold;
and if the neglected articles exist, setting the state of the articles corresponding to the goods space to be in an irregular state.
4. The method of claim 3, further comprising:
judging whether other articles different from the articles corresponding to the goods space exist in each goods space;
and if other articles different from the article corresponding to the goods space exist, setting the state of the article corresponding to the goods space as a misplaced state.
5. The method of claim 4, further comprising:
in each goods space, judging whether the quantity of the goods corresponding to the goods space is less than a quantity threshold or not;
and if the quantity of the articles corresponding to the goods space is smaller than the quantity threshold, setting the state of the articles corresponding to the goods space as the out-of-stock state.
6. The method of claim 5, further comprising:
monitoring the duration of the state of the goods corresponding to the goods location;
and if the duration time of the state of the goods corresponding to the goods position in the nonstandard state, the misplaced state or the out-of-stock state exceeds the corresponding time threshold, sending related prompt information.
7. The method of claim 6, further comprising:
generating an article state list according to the goods position division and the state of the articles corresponding to the goods positions;
and presenting the item state list.
8. The method of claim 7, further comprising:
and pushing at least one of the shelf item display chart and the item state list to a user terminal.
9. An article display detection device comprising:
an image acquisition module configured to acquire shelf images at a predetermined frequency;
the goods position dividing module is configured to process the acquired images so as to determine the goods positions corresponding to the same type of goods in the goods shelf;
the display diagram generating module is configured to generate a display diagram of the goods on the shelf according to the goods position division and the goods information corresponding to the goods positions;
a presentation module configured to present the shelf item planogram.
10. The apparatus of claim 9, wherein,
the goods space dividing module is configured to sequentially identify each item for each layer of the shelf to obtain item reliability, combine the positions of the same item for the items with the item reliability larger than a reliability threshold, and divide the goods space according to the position areas of the same item.
11. The apparatus of claim 10, further comprising:
and the state management module is configured to judge whether the neglected articles exist in each goods space, wherein the neglected articles are articles of which the article credibility is not greater than the credibility threshold, and if the neglected articles exist, the state of the articles corresponding to the goods space is set to be in an irregular state.
12. The apparatus of claim 11, wherein,
the state management module is also configured to judge whether other articles different from the article corresponding to the goods space exist in each goods space, and if the other articles different from the article corresponding to the goods space exist, the state of the article corresponding to the goods space is set to be in a misplaced state.
13. The apparatus of claim 12, wherein,
the state management module is further configured to judge whether the quantity of the articles corresponding to the goods space is smaller than a quantity threshold in each goods space, and if the quantity of the articles corresponding to the goods space is smaller than the quantity threshold, the state of the articles corresponding to the goods space is set to be in an out-of-stock state.
14. The apparatus of claim 13, further comprising:
and the duration management module is configured to monitor the duration of the state of the goods corresponding to the goods location, and send related prompt information if the duration of the state of the goods corresponding to the goods location in the nonstandard state, the misplaced state or the out-of-stock state exceeds a corresponding time threshold.
15. The apparatus of claim 14, further comprising:
the detail list generating module is configured to generate an article state detail list according to the goods location division and the state of the articles corresponding to the goods location;
the presentation module is further configured to present the item status schedule.
16. The apparatus of claim 15, further comprising:
a push module configured to push at least one of the shelf item planogram and the item status list to a user terminal.
17. An item recommendation device comprising:
a memory configured to store instructions;
a processor coupled to the memory, the processor configured to perform implementing the method of any of claims 1-8 based on instructions stored by the memory.
18. A computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions which, when executed by a processor, implement the method of any one of claims 1-8.
CN201810899789.7A 2018-08-09 2018-08-09 Method and device for detecting article display Pending CN110826359A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810899789.7A CN110826359A (en) 2018-08-09 2018-08-09 Method and device for detecting article display

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810899789.7A CN110826359A (en) 2018-08-09 2018-08-09 Method and device for detecting article display

Publications (1)

Publication Number Publication Date
CN110826359A true CN110826359A (en) 2020-02-21

Family

ID=69540784

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810899789.7A Pending CN110826359A (en) 2018-08-09 2018-08-09 Method and device for detecting article display

Country Status (1)

Country Link
CN (1) CN110826359A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112309031A (en) * 2020-09-17 2021-02-02 北京京东乾石科技有限公司 Unmanned container mixed discharge detection method, device, equipment and readable storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112309031A (en) * 2020-09-17 2021-02-02 北京京东乾石科技有限公司 Unmanned container mixed discharge detection method, device, equipment and readable storage medium
CN112309031B (en) * 2020-09-17 2022-06-07 北京京东乾石科技有限公司 Unmanned container mixed discharge detection method, device, equipment and readable storage medium

Similar Documents

Publication Publication Date Title
US9659272B2 (en) Method and apparatus for managing product placement on store shelf
CN109117824B (en) Commodity management method and device, electronic equipment and storage medium
CN109649916B (en) Intelligent container cargo identification method and device
CN112100425B (en) Label labeling method and device based on artificial intelligence, electronic equipment and medium
CN111832590B (en) Article identification method and system
CN111079478B (en) Unmanned goods shelf monitoring method and device, electronic equipment and system
WO2019129248A1 (en) Intelligent refrigerator and information reminder method based on intelligent refrigerator
CN111382635B (en) Commodity category identification method and device and electronic equipment
CN110930221A (en) Abnormal order processing method, storage medium and computer equipment
CN112307871A (en) Information acquisition method and device, attention detection method, device and system
CN103903360A (en) Detecting method, server and system for objects in self-service equipment
CN110599257A (en) Method and system for calculating total amount of dishes based on image recognition technology
CN110826359A (en) Method and device for detecting article display
WO2021233058A1 (en) Method for monitoring articles on shop shelf, computer and system
US20220101296A1 (en) Article deduction apparatus, article deduction method, and program
CN112364702A (en) Article verification method and device
CN108648036A (en) Commodity recognition method, system and storage medium on a kind of shelf
US11120310B2 (en) Detection method and device thereof
CN111753614A (en) Commodity shelf monitoring method and device
WO2017161034A1 (en) System for verifying physical object absences from assigned regions using video analytics
JP2018151819A (en) Management device, management method and program
CN114926464A (en) Image quality inspection method, image quality inspection device and system in double-recording scene
CN111222377B (en) Commodity information determining method and device and electronic equipment
JP2019192169A (en) Determination device, determination method, and object determination program
US11282089B1 (en) Recalled product detection and notification system and related methods

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination