CN111914587B - Display article detection system and method - Google Patents

Display article detection system and method Download PDF

Info

Publication number
CN111914587B
CN111914587B CN201910374661.3A CN201910374661A CN111914587B CN 111914587 B CN111914587 B CN 111914587B CN 201910374661 A CN201910374661 A CN 201910374661A CN 111914587 B CN111914587 B CN 111914587B
Authority
CN
China
Prior art keywords
price tag
electronic price
target
target electronic
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910374661.3A
Other languages
Chinese (zh)
Other versions
CN111914587A (en
Inventor
蒋赵贵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Priority to CN201910374661.3A priority Critical patent/CN111914587B/en
Publication of CN111914587A publication Critical patent/CN111914587A/en
Application granted granted Critical
Publication of CN111914587B publication Critical patent/CN111914587B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/35—Categorising the entire scene, e.g. birthday party or wedding scene
    • G06V20/36—Indoor scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Multimedia (AREA)
  • Economics (AREA)
  • Development Economics (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The embodiment of the application provides a system and a method for detecting display articles, wherein the system comprises the following steps: a plurality of electronic tags, a tag control unit, a tag capturing unit and a data processing unit. The state of the plurality of electronic price tags is a first preset state. The price tag control unit controls the target electronic price tag to present a second preset state; determining a target price tag capturing unit corresponding to the target electronic price tag; and sending a first opening instruction to the target price tag capturing unit. The target price tag capturing unit captures a target electronic price tag in a second preset state according to the first opening instruction, and determines a first relative position of the target electronic price tag in the target goods shelf area. The data processing unit determines a second relative position of the target electronic price tag; if the first relative position and the second relative position are different, a first alert is generated for the target electronic price tag. By applying the technical scheme provided by the embodiment of the application, the detection cost of the displayed articles can be reduced.

Description

Display article detection system and method
Technical Field
The application relates to the technical field of digital monitoring, in particular to a display article detection system and method.
Background
In order to promote the sales of goods and improve the sales benefits of retailers, digital monitoring technology is gradually applied to places such as retail stores and supermarkets to detect the situation of displaying goods and ensure that the positions of goods are correct and sufficient.
At present, in order to realize the detection of displayed commodities, two-dimensional codes of price tags of the commodities are placed on a goods shelf, and the corresponding relation between the price tags and the commodities is established. The high-magnification ball machine or the mobile robot obtains clear two-dimensional code images containing the two-dimensional codes and sends the two-dimensional code images to the electronic equipment. The electronic device analyzes the two-dimensional code image to obtain commodity information such as commodity names, commodity positions, commodity display quantity and the like. The electronic device compares the merchandise information with pre-stored identification information. The electronic device generates an alarm based on the comparison result. The pre-stored identification information comprises information such as commodity names, commodity positions, commodity display quantity and the like.
In the above-described display commodity detection system, in order to obtain a clear two-dimensional code image and generate an alarm, it is necessary to dispose a high-magnification ball machine or a mobile robot, which makes the detection cost of the display commodity high.
Disclosure of Invention
An object of an embodiment of the present application is to provide a display article detection system and method, so as to reduce the detection cost of display articles. The specific technical scheme is as follows:
In a first aspect, embodiments of the present application provide a display article detection system, the system comprising: an electronic price tag, a price tag control unit, a price tag capturing unit and a data processing unit for a plurality of articles; the state of the plurality of electronic price tags is a first preset state;
The price tag control unit is used for controlling target electronic price tags in the electronic price tags of the plurality of articles to be in a second preset state; determining a target price tag capturing unit corresponding to the target electronic price tag according to the corresponding relation between the prestored electronic price tag and the price tag capturing unit; sending a first opening instruction to the target price tag capturing unit;
the target price tag capturing unit is used for capturing the target electronic price tag in the second preset state according to the first opening instruction, and determining a first relative position of the target electronic price tag in a target shelf area corresponding to the target electronic price tag;
The data processing unit is used for determining a second relative position of the target electronic price tag according to the corresponding relation between the prestored electronic price tag and the relative position; judging whether the first relative position and the second relative position are the same; if not, a first alert is generated for the target electronic price label.
Optionally, the first preset state is a first color; the price tag control unit is specifically used for controlling target electronic price tags in the electronic price tags of the plurality of articles to display a second color; or (b)
The price tag control unit is specifically configured to control a target electronic price tag in the electronic price tags of the plurality of articles to present a blinking state; or (b)
The first preset state is a non-transmitting radio frequency signal state, and the price tag control unit is specifically configured to control a target electronic price tag in the electronic price tags of the plurality of articles to transmit a radio frequency signal.
Optionally, the system further comprises: an image capturing unit and a data analyzing unit;
The price tag control unit is further used for determining a target image capturing unit corresponding to the target electronic price tag according to the corresponding relation between the prestored electronic price tag and the image capturing unit after controlling the target electronic price tag to present the second preset state; sending a second opening instruction to the target image capturing unit;
The target image capturing unit is used for capturing a panoramic image of the target shelf area according to the second opening instruction;
The data analysis unit is used for detecting the panoramic image and determining the full-empty state of the object in the object area corresponding to the target electronic price tag, wherein the object area corresponding to the target electronic price tag is the object space between the target electronic price tag and the electronic price tag adjacent to the target electronic price tag on one side.
Optionally, the data analysis unit is specifically configured to:
determining the ratio of the occupied area of the object in the object area corresponding to the target electronic price tag to the total area of the object area;
if the determined ratio is smaller than the first preset ratio, determining that the full-empty state of the article in the article area is an empty state;
if the determined ratio is greater than or equal to the first preset ratio and the determined ratio is less than or equal to the second preset ratio, determining that the article full-empty state of the article area is a half-full state;
and if the determined ratio is greater than the second preset ratio, determining that the full empty state of the article in the article area is a full state.
Optionally, the data analysis unit is further configured to generate a second alarm for the target electronic price tag when the determined item full empty state of the item area is an empty state.
In a second aspect, embodiments of the present application provide a display article detection method applied to a display article detection system, the display article detection system including: an electronic price tag, a price tag control unit, a price tag capturing unit and a data processing unit for a plurality of articles; the state of the electronic price tags of the plurality of articles is a first preset state; the method comprises the following steps:
the price tag control unit controls target electronic price tags in the electronic price tags of the plurality of articles to present a second preset state; determining a target price tag capturing unit corresponding to the target electronic price tag according to the corresponding relation between the prestored electronic price tag and the price tag capturing unit; sending a first opening instruction to the target price tag capturing unit;
The target price tag capturing unit captures the target electronic price tag in the second preset state according to the first opening instruction, and determines a first relative position of the target electronic price tag in a target shelf area corresponding to the target electronic price tag;
The data processing unit determines a second relative position of the target electronic price tag according to a corresponding relation between the electronic price tag and the relative position stored in advance; judging whether the first relative position and the second relative position are the same; if not, a first alert is generated for the target electronic price label.
Optionally, the step of controlling the target electronic price tag in the electronic price tags of the plurality of objects to present a second preset state includes:
If the first preset state is a first color, controlling target electronic price tags in the electronic price tags of the plurality of articles to display a second color; or (b)
If the first preset state is a non-blinking state, controlling target electronic price tags in the electronic price tags of the plurality of articles to be in a blinking state; or (b)
And if the first preset state is a non-transmission radio frequency signal state, controlling target electronic price tags in the electronic price tags of the plurality of articles to transmit radio frequency signals.
Optionally, the display article detection system further comprises: an image capturing unit and a data analyzing unit; the method further comprises the steps of:
The price tag control unit determines a target image capturing unit corresponding to the target electronic price tag according to the corresponding relation between the prestored electronic price tag and the image capturing unit after controlling the target electronic price tag to present the second preset state; sending a second opening instruction to the target image capturing unit;
the target image capturing unit captures a panoramic image of the target shelf area according to the second opening instruction;
the data analysis unit detects the panoramic image and determines the full-empty state of the object in the object area corresponding to the target electronic price tag, wherein the object area corresponding to the target electronic price tag is the object space between the target electronic price tag and the electronic price tag adjacent to the target electronic price tag on one side.
Optionally, the step of determining the article full-empty state of the article area corresponding to the target electronic price tag includes:
determining the ratio of the occupied area of the object in the object area corresponding to the target electronic price tag to the total area of the object area;
if the determined ratio is smaller than the first preset ratio, determining that the full-empty state of the article in the article area is an empty state;
if the determined ratio is greater than or equal to the first preset ratio and the determined ratio is less than or equal to the second preset ratio, determining that the article full-empty state of the article area is a half-full state;
and if the determined ratio is greater than the second preset ratio, determining that the full empty state of the article in the article area is a full state.
Optionally, the method further comprises:
The data analysis unit generates a second alarm for the target electronic price tag when the determined item full empty state of the item area is an empty state.
According to the display article detection system and method provided by the embodiment of the application, the data processing unit determines the relative position of the electronic price tag according to the preset state, a clear two-dimensional code image is not required to be acquired, a high-magnification ball machine or a mobile robot is not required to be deployed, only a small preset state acquisition device is required to be deployed, and the detection cost of the display article is reduced. Of course, it is not necessary for any one product or method of practicing the application to achieve all of the advantages set forth above at the same time.
Drawings
In order to more clearly illustrate the embodiments of the application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a display article detection system according to an embodiment of the present application;
FIG. 2 is a schematic diagram of another embodiment of a display article detection system according to the present application;
FIG. 3 is a schematic view of a shelf area according to an embodiment of the present application;
FIG. 4 is a schematic view of still another embodiment of a display article detection system according to the present application;
FIG. 5 is a schematic view of another embodiment of a shelf area according to the present application;
Fig. 6 is a schematic flow chart of a method for detecting display objects according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Currently, a two-dimensional code of a price tag for a commodity is placed on a shelf for detecting and displaying the commodity. The two-dimensional code comprises commodity names and price tag information, so that the corresponding relation between the price tag and the commodity is established. In order to obtain a clear two-dimensional code image, a high-magnification ball machine or a mobile robot is deployed. The high-magnification ball machine or the mobile robot obtains clear two-dimensional code images containing the two-dimensional codes and sends the two-dimensional code images to the electronic equipment. The electronic equipment analyzes the two-dimensional code image to obtain commodity information such as commodity names, commodity positions, commodity display quantity and the like, and compares the commodity information with prestored identification information. The pre-stored identification information comprises information such as commodity names, commodity positions, commodity display quantity and the like. The electronic device generates an alarm based on the comparison result. For example, the electronic device generates an alarm by analyzing that the obtained commodity position is different from the commodity position included in the prestored identification information. For another example, the electronic device analyzes that the number of merchandise displays is below a preset number threshold and generates an alert.
In the above-described display commodity inspection system, it is necessary to dispose a high-magnification ball machine or a mobile robot, and the detection cost of the display commodity is high. In order to solve the problem of higher detection cost of displayed commodities, the embodiment of the application provides a display object detection system. In the display article detection system, an electronic price tag control unit, a price tag capturing unit and a data processing unit for a plurality of articles; the state of the electronic price tag is a first preset state.
The price tag control unit controls target electronic price tags in the electronic price tags of the plurality of articles to be in a second preset state, determines a target price tag capturing unit corresponding to the target electronic price tag according to the corresponding relation between the prestored electronic price tags and the price tag capturing unit, and sends a first opening instruction to the target price tag capturing unit.
The target price tag capturing unit captures a target electronic price tag in a second preset state according to the first opening instruction, and determines a first relative position of the target electronic price tag in a target shelf area corresponding to the target electronic price tag.
The data processing unit determines a second relative position of the target electronic price tag according to the corresponding relation between the prestored electronic price tag and the relative position, judges whether the first relative position and the second relative position are the same, and generates a first alarm aiming at the target electronic price tag if the first relative position and the second relative position are different.
According to the technical scheme provided by the embodiment of the application, the data processing unit determines the relative position of the electronic price tag according to the preset state, a clear two-dimensional code image is not required to be acquired, a high-magnification ball machine or a mobile robot is not required to be deployed, only a small preset state acquisition device is required to be deployed, and the detection cost of displayed objects is reduced.
The display article detection system provided by the embodiment of the application is described below by means of a specific embodiment.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a display article detection system according to an embodiment of the present application. The display article detection system includes: electronic tags 101-10n of a plurality of items, a tag control unit 200, a tag capturing unit 300, and a data processing unit 400. The state of the electronic price tag 101-10n is a first preset state, that is, the initial state of the electronic price tag 101-10n is the first preset state.
In the embodiment of the present application, the first preset state may include a first color, and/or a static state. The quiescent states may include a non-blinking state, a non-transmitting radio frequency signal state, and the like. The display article detection system provided by the embodiment of the application can be applied to occasions such as supermarkets, warehouses and the like.
And a price tag control unit 200 for controlling a target electronic price tag among the electronic price tags 101-10n of the plurality of items to assume a second preset state.
In an alternative embodiment, a display item detection system as shown in FIG. 2, the display item detection system may further include a pre-configuration unit 500. The pre-configuration unit 500 may pre-configure the detection plan by the pre-configuration unit 500. The detection plan includes electronic price tags that need to be detected. When detecting the display article, the price tag control unit 200 traverses the electronic price tag included in the detection plan, and each time traverses to one electronic price tag, the traversed electronic price tag can be used as the target electronic price tag. The price tag control unit 200 controls the target electronic price tag to assume a second preset state. And after all the electronic price tags included in the detection plan are traversed, ending the detection of the displayed object.
In an alternative embodiment, the detection plan further includes a detection time. When the detection time is reached, the price tag control unit 200 starts detecting the display article, traversing the electronic price tag included in the detection plan. For example, the detection schedule includes a detection time of 2 pm a day. Every time it reaches 2 pm, the price tag control unit 200 starts to detect the display article, traversing the electronic price tag included in the detection plan.
In an alternative embodiment, the first preset state may be a first color. After the price tag control unit 200 starts detecting the display object, the target electronic price tag can be controlled to present the second color. For example, the first color is white and the second color is red. After the price tag control unit 200 opens the detection of the display article, the control target electronic price tag appears red, that is, the control target electronic price tag changes from white to red. At this time, the target price tag capturing unit may be an image capturing unit that captures an image of the target electronic price tag including the color change. The target price tag capturing unit can distinguish the electronic price tag to be detected at this time through different colors of the electronic price tags.
In another alternative embodiment, the first preset state may be a non-blinking state. After the price tag control unit 200 starts detecting the display object, the target electronic price tag can be controlled to be in a blinking state, that is, the target electronic price tag is controlled to be changed from a non-blinking state to a blinking state. At this time, the target price tag capturing unit may be an image capturing unit that captures an image of the target electronic price tag containing the flicker variation. The target price tag capturing unit can distinguish the electronic price tag which needs to be detected at this time through whether the electronic price tag flashes or not.
In the embodiment of the application, the definition requirement of the image acquired by the price tag capturing unit is not high, and the color and the flicker of the electronic price tag can be analyzed. In other words, in the embodiment of the application, a small preset state acquisition device is deployed, so that the detection cost of the displayed objects is reduced.
In yet another alternative embodiment, the first preset state may be a non-transmitting radio frequency signal state. After the price tag control unit 200 starts to detect the display article, the target electronic price tag can be controlled to transmit a radio frequency signal, that is, the target electronic price tag is controlled to change from a non-transmitting radio frequency signal state to a transmitting radio frequency signal state. At this time, the target price tag capturing unit may be a signal capturing unit, capturing a radio frequency signal sent by the target electronic price tag.
In the embodiment of the application, the price tag capturing unit is a signal capturing unit, and the signal capturing unit is a small device, so that the cost is far lower than that of a high-magnification ball machine or a mobile robot, and the detection cost of displayed objects is reduced.
The price tag control unit 200 is further configured to determine a target price tag capturing unit corresponding to the target electronic price tag according to the pre-stored correspondence between the electronic price tag and the price tag capturing unit 300, and send a first opening instruction to the target price tag capturing unit.
In the embodiment of the application, the electronic price tag and the price tag capturing unit may have a one-to-one relationship, that is, one electronic price tag corresponds to one price tag capturing unit. For example, as shown in the shelf area schematic of fig. 3, the shelf area H includes 13 electronic tags J 1-J13, and the 13 electronic tags J 1-J13 may each correspond to one tag capturing unit. Taking electronic price tag J 1 and electronic price tag J 2 as an example, electronic price tag J 1 corresponds to price tag capturing unit B 1, and electronic price tag J 2 corresponds to price tag capturing unit B 2.
The electronic price tag and the price tag capturing unit may also be in a many-to-one relationship, i.e. a plurality of electronic price tags correspond to the same price tag capturing unit. For example, as shown in the shelf area schematic of fig. 3, 13 electronic price tags J 1-J13 may correspond to the same price tag capturing unit, e.g., 13 electronic price tags J 1-J13 may correspond to price tag capturing unit B 1.
In an alternative embodiment, a display item detection system as shown in FIG. 2, the display item detection system may further include a pre-configuration unit 500. The pre-configuration unit 500 stores in advance the correspondence relationship between the electronic price tag and the price tag capturing unit 300. The price tag control unit 200 determines a target price tag capturing unit corresponding to the target electronic price tag according to the corresponding relation between the prestored electronic price tag and the price tag capturing unit 300, and sends a first opening instruction to the target price tag capturing unit. The first opening instruction is used for instructing the target price tag capturing unit to capture the target electronic price tag.
The target price tag capturing unit is used for capturing the target electronic price tag in the second preset state according to the first opening instruction, and determining the first relative position of the target electronic price tag in the target shelf area corresponding to the target electronic price tag.
After receiving the first opening instruction, the target price tag capturing unit captures a target electronic price tag in a second preset state, and determines a first relative position of the target electronic price tag in a target shelf area.
In one example, the target price tag capturing unit is an image capturing unit. The first preset state is a first color, and the second preset state is a second color. After receiving the first opening instruction, the target price tag capturing unit captures a panoramic image of the target shelf area, identifies an electronic price tag in the panoramic image, determines a target electronic price tag presenting a second color, and determines the relative position of the target electronic price tag in the target shelf area as a first relative position.
The shelf area shown in fig. 3 will be described as an example. The first color is white and the second color is red. The target price tag capturing unit captures a panoramic image Q of the shelf area H, and identifies electronic price tags in the panoramic image Q to obtain 13 electronic price tags. The target price tag capturing unit determines that the electronic price tag appearing red is the electronic price tag J 1, and then the electronic price tag J 1 is the target electronic price tag. The target price tag capturing unit may determine the relative position of the electronic price tag J 1 in the shelf region H as the first row.
The data processing unit 400 is configured to determine a second relative position of the target electronic price tag according to a pre-stored correspondence between the electronic price tag and the relative position, determine whether the first relative position and the second relative position are the same, and if so, generate a first alarm for the target electronic price tag.
The data processing unit 400 determines a second relative position of the target electronic price tag according to the corresponding relation between the prestored electronic price tag and the relative position. The second relative position is the relative position of the specified target electronic price tag, namely the correct position where the target electronic price tag should be placed. The data processing unit 400 determines whether the first relative position and the second relative position are the same. If the first relative position and the second relative position are different, the data processing unit 400 may determine that the actual placement position of the target electronic price tag is incorrect, and generate a first alarm for the target electronic price tag. The first alarm is used for prompting the user that the placement position of the current target electronic price tag is wrong.
In an alternative embodiment, the first alarm may include information such as an identification of the target electronic price tag, a target shelf area, a first relative position, a second relative position, a commodity name corresponding to the target electronic price tag, and the like. To facilitate user handling of the solution.
In the embodiment of the application, the information such as commodity names, shelf areas, relative positions and the like corresponding to the electronic price tags can be stored in advance. For example, the correspondence between the electronic price tag and information such as the commodity name, the shelf area, and the relative position is stored in advance by the pre-arrangement unit 500 shown in fig. 2.
In an alternative embodiment, after the target price tag capturing unit receives the first opening instruction, if the target electronic price tag in the second preset state is not captured, it may be determined that the first relative position of the target electronic price tag in the target shelf area is empty. The data processing unit 400 generates a first alert for the target electronic price label in case it is determined that the first relative position is empty.
After the data processing unit 400 generates the first alarm, the first alarm may be output so that the user may process and solve the problem in time, and promote sales of the article.
According to the display article detection system provided by the embodiment of the application, the data processing unit determines the relative position of the electronic price tag according to the preset state, a clear two-dimensional code image is not required to be acquired, a high-magnification ball machine or a mobile robot is not required to be deployed, only a small preset state acquisition device is required to be deployed, and the detection cost of the display article is reduced.
In an alternative embodiment, if the first relative position and the second relative position are the same, the data processing unit 400 may determine that the actual placement position of the target electronic price tag is correct, and no other processing is performed.
In one embodiment of the present application, referring to the display item detection system shown in fig. 4, the display item detection system may include an image capturing unit 600 and a data analyzing unit 700 in addition to the electronic tags 101-10n, the tag control unit 200, the tag capturing unit 300, and the data processing unit 400 including a plurality of items.
The price tag control unit 200 may be further configured to determine, after the control target electronic price tag presents the second preset state, a target image capturing unit corresponding to the target electronic price tag according to a pre-stored correspondence between the electronic price tag and the image capturing unit 600; and sending a second starting instruction to the target image capturing unit.
In the embodiment of the application, the electronic price tag and the image capturing unit may have a one-to-one relationship, that is, one electronic price tag corresponds to one image capturing unit. For example, as shown in the shelf area schematic diagram of fig. 3, the shelf area H includes 13 electronic tags J 1-J13, and the 13 electronic tags J 1-J13 may each correspond to one image capturing unit. Taking electronic price tag J 1 and electronic price tag J 2 as an example, electronic price tag J 1 corresponds to image capturing unit B 1, and electronic price tag J 2 corresponds to image capturing unit B 2.
The electronic price tag and the image capturing unit may also be in a many-to-one relationship, that is, a plurality of electronic price tags correspond to the same image capturing unit. For example, as shown in the shelf area schematic of fig. 3, 13 electronic price tags J 1-J13 may correspond to the same image capturing unit, e.g., 13 electronic price tags J 1-J13 may correspond to image capturing unit B 1.
In an alternative embodiment, a display item detection system as shown in FIG. 2, the display item detection system may further include a pre-configuration unit 500. The pre-configuration unit 500 stores in advance a correspondence relationship between the electronic price tag and the image capturing unit 600. The price tag control unit 200 determines a target image capturing unit corresponding to the target electronic price tag according to the corresponding relation between the electronic price tag and the image capturing unit 600 stored in advance, and sends a second opening instruction to the target image capturing unit. The second on instruction is for instructing the target image capturing unit to capture a panoramic image.
In one embodiment, the image capture unit 600 and the price tag capture unit 300 may be the same physical device to save the cost of the display item detection system. In another embodiment, the image capturing unit 600 and the price tag capturing unit 300 may be different physical devices. And the display article detection system starts different physical devices according to different requirements of users, so that the computing resources of the equipment are saved.
And the target image capturing unit is used for capturing the panoramic image of the target shelf area according to the second starting instruction.
And after receiving the second opening instruction, the target image capturing unit captures a panoramic image of the target shelf area. As shown in fig. 3.
The data analysis unit 700 is configured to detect the panoramic image, and determine an article full-empty state of an article area corresponding to the target electronic price tag, where the article area corresponding to the target electronic price tag is an article space between the target electronic price tag and an electronic price tag adjacent to the target electronic price tag on one side.
In an embodiment of the present application, the data analysis unit 700 may be an intelligent processing chip. The data analysis unit 700 and the data processing unit 400 may be the same physical device or different physical devices. The embodiment of the present application is not limited thereto. For the article area, as shown in fig. 5, taking the electronic price tag J 1 as an example, the article space K between the electronic price tag J 1 and the electronic price tag J 2 is the article area corresponding to the electronic price tag J 1.
The data analysis unit 700 detects the panoramic image, and determines an item area corresponding to the target electronic price tag in combination with the determined first relative position of the target electronic price tag. For example, the target electronic price tag is electronic price tag J 1. The data analysis unit 700 detects the panoramic image, determines each electronic price tag, and determines the article region K corresponding to the electronic price tag J 1 according to the relative position of the electronic price tag J 1.
After determining the item area corresponding to the target electronic price tag, the data analysis unit 700 identifies the item full state of the item area corresponding to the target electronic price tag.
In an alternative embodiment, the item full empty state may include an empty state and a full state. The data analysis unit 700 determines a ratio of a occupied area of the item in the item area corresponding to the target electronic price tag to a total area of the item area. If the determined ratio is smaller than the preset ratio, the data analysis unit 700 determines that the article full empty state of the article area is the empty state. If the determined ratio is equal to or greater than the preset ratio, the data analysis unit 700 determines that the article full empty state of the article area is the full state.
In another alternative embodiment, the item full empty state may include an empty state, a half full state, and a full state for precise control of the displayed items. The data analysis unit 700 determines a ratio of a occupied area of the item in the item area corresponding to the target electronic price tag to a total area of the item area. If the determined ratio is smaller than the first preset ratio, the data analysis unit 700 determines that the article full empty state of the article area is the empty state. If the determined ratio is greater than or equal to the first preset ratio and the determined ratio is less than or equal to the second preset ratio, the data analysis unit 700 determines that the article full empty state of the article area is a half full state. If the determined ratio is greater than the second preset ratio, the data analysis unit 700 determines that the article full empty state of the article area is the full state.
For example, the first preset ratio is 40% and the second preset ratio is 60%. The total area of the article area is 200 pixels. If the data analysis unit 700 determines that the occupied area of the article in the article area is 60 pixels, 60/200=30%, 30% <40%, then it determines that the article full empty state of the article area is the empty state. If the data analysis unit 700 determines that the occupied area of the article in the article area is 100 pixels, 100/200=50%, 40% <50% <60%, then it determines that the article full empty state of the article area is a half full state. If the data analysis unit 700 determines that the occupied area of the article in the article area is 160 pixels, 160/200=80%, 80% >60%, then it determines that the article full empty state of the article area is the full state.
In an alternative embodiment, the data analysis unit may generate a second alert for the target electronic price tag when the determined item full state of the item area. The second alarm is used to inform the user of the article full state of the article area. In another alternative embodiment, to conserve device computing resources, the data analysis unit generates a second alert for the target electronic price tag when the determined item full empty state of the item area is an empty state.
The second alarm may include an item full state of the item area corresponding to the target electronic price tag. The first alarm and the second alarm may be the same alarm or different alarms. That is, an alarm may include the full condition of the article or the relative position of the electronic price tag.
Corresponding to the embodiment of the display article detection system, the embodiment of the application also provides a display article detection method. Referring to fig. 6, fig. 6 is a schematic flow chart of a method for detecting display objects according to an embodiment of the present application. The display article detection method is applied to a display article detection system, and the display article detection system comprises: an electronic price tag, a price tag control unit, a price tag capturing unit and a data processing unit for a plurality of articles; the state of the electronic price tags of the plurality of articles is a first preset state. The method comprises the following steps.
In step 601, the price tag control unit controls a target electronic price tag in the electronic price tags of the plurality of articles to present a second preset state.
In an alternative embodiment, the step 601 price tag control unit controls a target electronic price tag in the electronic price tags of the plurality of articles to present a second preset state, which may include:
If the first preset state is the first color, controlling target electronic price tags in the electronic price tags of the plurality of articles to display the second color; or (b)
If the first preset state is a non-blinking state, controlling target electronic price tags in the electronic price tags of the plurality of articles to be in a blinking state; or (b)
And if the first preset state is a non-transmission radio frequency signal state, controlling target electronic price tags in the electronic price tags of the plurality of articles to transmit radio frequency signals.
In step 602, the price tag control unit determines a target price tag capturing unit corresponding to the target electronic price tag according to the corresponding relation between the prestored electronic price tag and the price tag capturing unit.
In step 603, the price tag control unit sends a first opening instruction to the target price tag capturing unit.
In step 604, the target electronic price tag capturing unit captures a target electronic price tag in a second preset state according to the first opening instruction, and determines a first relative position of the target electronic price tag in a target shelf area corresponding to the target electronic price tag.
In step 605, the data processing unit determines a second relative position of the target electronic price tag according to the corresponding relationship between the prestored electronic price tag and the relative position.
In step 606, the data processing unit determines whether the first relative position and the second relative position are the same. If not, then step 607 is performed.
In step 607, the data processing unit generates a first alert for the target electronic price tag.
In an alternative embodiment, the display article detection system may further include: an image capturing unit and a data analyzing unit. In this case, the display article detection method may further include:
After the price tag control unit controls the target electronic price tag to be in a second preset state, determining a target image capturing unit corresponding to the target electronic price tag according to the corresponding relation between the prestored electronic price tag and the image capturing unit; and sending a second starting instruction to the target image capturing unit.
And the target image capturing unit captures a panoramic image of the target shelf area according to the second opening instruction.
The panoramic image of the data analysis unit detects, and determines the full-empty state of the object in the object area corresponding to the target electronic price tag, wherein the object area corresponding to the target electronic price tag is the object space between the target electronic price tag and the electronic price tag adjacent to the target electronic price tag on one side.
In an alternative embodiment, the step of determining, by the data analysis unit, an article full-empty state of the article area corresponding to the target electronic price tag may include: determining the ratio of the occupied area of the object in the object area corresponding to the target electronic price tag to the total area of the object area; if the determined ratio is smaller than a first preset ratio, determining that the full-empty state of the article in the article area is an empty state; if the determined ratio is greater than or equal to the first preset ratio and the determined ratio is less than or equal to the second preset ratio, determining that the article full-empty state of the article area is a half-full state; and if the determined ratio is greater than a second preset ratio, determining that the full-empty state of the article in the article area is a full state.
In an alternative embodiment, the display article detecting method may further include: the data analysis unit generates a second alert for the target electronic price tag when the determined item full empty state of the item area is an empty state.
According to the display article detection method provided by the embodiment of the application, the data processing unit determines the relative position of the electronic price tag according to the preset state, a clear two-dimensional code image is not required to be acquired, a high-magnification ball machine or a mobile robot is not required to be deployed, only a small preset state acquisition device is required to be deployed, and the detection cost of the display article is reduced.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for display item detection method embodiments, since they are substantially similar to display item detection system embodiments, the description is relatively simple, with reference to a partial description of display item detection system embodiments.
The foregoing description is only of the preferred embodiments of the present application and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application are included in the protection scope of the present application.

Claims (8)

1. A display article detection system, the system comprising: an electronic price tag, a price tag control unit, a price tag capturing unit and a data processing unit for a plurality of articles; the state of the electronic price tags of the plurality of articles is a first preset state;
The price tag control unit is used for controlling target electronic price tags in the electronic price tags of the plurality of articles to be in a second preset state; determining a target price tag capturing unit corresponding to the target electronic price tag according to the corresponding relation between the prestored electronic price tag and the price tag capturing unit; sending a first opening instruction to the target price tag capturing unit;
The target price tag capturing unit is configured to capture the target electronic price tag in the second preset state according to the first opening instruction, and determine a first relative position of the target electronic price tag in a target shelf area corresponding to the target electronic price tag, where the first relative position is a position where the target electronic price tag is actually placed;
The data processing unit is used for determining a second relative position of the target electronic price tag according to the corresponding relation between the prestored electronic price tag and the relative position, wherein the second relative position is a correct position where the target electronic price tag should be placed; judging whether the first relative position and the second relative position are the same; if the electronic price tag is different, generating a first alarm aiming at the target electronic price tag;
The target price tag capturing unit is further configured to determine that a first relative position of the target electronic price tag in the target shelf area is empty when the target electronic price tag in the second preset state is not captured after the first opening instruction is received;
The data processing unit is further used for generating a first alarm aiming at the target electronic price tag when the first relative position of the target electronic price tag in the target goods shelf area is empty;
The system further comprises: an image capturing unit and a data analyzing unit;
The price tag control unit is further used for determining a target image capturing unit corresponding to the target electronic price tag according to the corresponding relation between the prestored electronic price tag and the image capturing unit after controlling the target electronic price tag to present the second preset state; sending a second opening instruction to the target image capturing unit;
The target image capturing unit is used for capturing a panoramic image of the target shelf area according to the second opening instruction;
The data analysis unit is used for detecting the panoramic image and determining the full-empty state of the object in the object area corresponding to the target electronic price tag, wherein the object area corresponding to the target electronic price tag is the object space between the target electronic price tag and the electronic price tag adjacent to the target electronic price tag on one side.
2. The system of claim 1, wherein the system further comprises a controller configured to control the controller,
The first preset state is a first color; the price tag control unit is specifically used for controlling target electronic price tags in the electronic price tags of the plurality of articles to display a second color; or (b)
The price tag control unit is specifically configured to control a target electronic price tag in the electronic price tags of the plurality of articles to present a blinking state; or (b)
The first preset state is a non-transmitting radio frequency signal state, and the price tag control unit is specifically configured to control a target electronic price tag in the electronic price tags of the plurality of articles to transmit a radio frequency signal.
3. The system according to claim 1, characterized in that the data analysis unit is specifically configured to:
determining the ratio of the occupied area of the object in the object area corresponding to the target electronic price tag to the total area of the object area;
If the determined ratio is smaller than a first preset ratio, determining that the full-empty state of the article in the article area is an empty state;
if the determined ratio is greater than or equal to the first preset ratio and the determined ratio is less than or equal to the second preset ratio, determining that the article full-empty state of the article area is a half-full state;
and if the determined ratio is greater than the second preset ratio, determining that the full empty state of the article in the article area is a full state.
4. A system according to claim 1 or 3, wherein the data analysis unit is further adapted to generate a second alert for the target electronic price tag when the determined item full empty status of the item area is empty.
5. A display article detection method, characterized by being applied to a display article detection system, the display article detection system comprising: an electronic price tag, a price tag control unit, a price tag capturing unit and a data processing unit for a plurality of articles; the state of the electronic price tags of the plurality of articles is a first preset state; the method comprises the following steps:
the price tag control unit controls target electronic price tags in the electronic price tags of the plurality of articles to present a second preset state; determining a target price tag capturing unit corresponding to the target electronic price tag according to the corresponding relation between the prestored electronic price tag and the price tag capturing unit; sending a first opening instruction to the target price tag capturing unit;
The target price tag capturing unit captures the target electronic price tag in the second preset state according to the first opening instruction, and determines a first relative position of the target electronic price tag in a target shelf area corresponding to the target electronic price tag, wherein the first relative position is the position where the target electronic price tag is actually placed;
The data processing unit determines a second relative position of the target electronic price tag according to a corresponding relation between the prestored electronic price tag and the relative position, wherein the second relative position is a correct position where the target electronic price tag should be placed; judging whether the first relative position and the second relative position are the same; if the electronic price tag is different, generating a first alarm aiming at the target electronic price tag;
After receiving the first opening instruction, the target price tag capturing unit determines that a first relative position of the target electronic price tag in the target shelf area is empty when the target electronic price tag in the second preset state is not captured;
The data processing unit generates a first alarm for the target electronic price tag when the first relative position of the target electronic price tag in the target shelf area is empty;
The display article detection system further includes: an image capturing unit and a data analyzing unit; the method further comprises the steps of:
The price tag control unit determines a target image capturing unit corresponding to the target electronic price tag according to the corresponding relation between the prestored electronic price tag and the image capturing unit after controlling the target electronic price tag to present the second preset state; sending a second opening instruction to the target image capturing unit;
the target image capturing unit captures a panoramic image of the target shelf area according to the second opening instruction;
the data analysis unit detects the panoramic image and determines the full-empty state of the object in the object area corresponding to the target electronic price tag, wherein the object area corresponding to the target electronic price tag is the object space between the target electronic price tag and the electronic price tag adjacent to the target electronic price tag on one side.
6. The method of claim 5, wherein the step of controlling the target electronic price label of the electronic price labels of the plurality of items to assume a second preset state comprises:
If the first preset state is a first color, controlling target electronic price tags in the electronic price tags of the plurality of articles to display a second color; or (b)
If the first preset state is a non-blinking state, controlling target electronic price tags in the electronic price tags of the plurality of articles to be in a blinking state; or (b)
And if the first preset state is a non-transmission radio frequency signal state, controlling target electronic price tags in the electronic price tags of the plurality of articles to transmit radio frequency signals.
7. The method of claim 5, wherein the step of determining the item full-empty status of the item area corresponding to the target electronic price tag comprises:
determining the ratio of the occupied area of the object in the object area corresponding to the target electronic price tag to the total area of the object area;
If the determined ratio is smaller than a first preset ratio, determining that the full-empty state of the article in the article area is an empty state;
if the determined ratio is greater than or equal to the first preset ratio and the determined ratio is less than or equal to the second preset ratio, determining that the article full-empty state of the article area is a half-full state;
and if the determined ratio is greater than the second preset ratio, determining that the full empty state of the article in the article area is a full state.
8. The method according to claim 5 or 7, characterized in that the method further comprises:
The data analysis unit generates a second alarm for the target electronic price tag when the determined item full empty state of the item area is an empty state.
CN201910374661.3A 2019-05-07 2019-05-07 Display article detection system and method Active CN111914587B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910374661.3A CN111914587B (en) 2019-05-07 2019-05-07 Display article detection system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910374661.3A CN111914587B (en) 2019-05-07 2019-05-07 Display article detection system and method

Publications (2)

Publication Number Publication Date
CN111914587A CN111914587A (en) 2020-11-10
CN111914587B true CN111914587B (en) 2024-05-07

Family

ID=73242747

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910374661.3A Active CN111914587B (en) 2019-05-07 2019-05-07 Display article detection system and method

Country Status (1)

Country Link
CN (1) CN111914587B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101527015A (en) * 2008-03-07 2009-09-09 东芝泰格有限公司 Article management system and information processing device
WO2013169786A2 (en) * 2012-05-07 2013-11-14 Senitron Corp. Real time electronic article surveillance and management
CN106525021A (en) * 2015-09-14 2017-03-22 中兴通讯股份有限公司 Method, apparatus and system for determining positions, as well as processing center
WO2017128982A1 (en) * 2016-01-27 2017-08-03 西安小光子网络科技有限公司 Optical tag-based information interaction system and method therefor
KR20170101051A (en) * 2016-02-26 2017-09-05 엘지이노텍 주식회사 Electronic apparatus for genarating location information and thereof operation method
CN108549870A (en) * 2018-04-16 2018-09-18 图麟信息科技（深圳）有限公司 A kind of method and device that article display is differentiated
CN108922079A (en) * 2018-06-05 2018-11-30 阿里巴巴集团控股有限公司 A kind of data processing method, article detection method, device
CN109085535A (en) * 2018-06-29 2018-12-25 北京迈格威科技有限公司 The positioning system and method for shelf electronic tag
CN109308434A (en) * 2017-07-27 2019-02-05 浙江汉朔电子科技有限公司 Electronics price tag, server and system

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101527015A (en) * 2008-03-07 2009-09-09 东芝泰格有限公司 Article management system and information processing device
WO2013169786A2 (en) * 2012-05-07 2013-11-14 Senitron Corp. Real time electronic article surveillance and management
CN106525021A (en) * 2015-09-14 2017-03-22 中兴通讯股份有限公司 Method, apparatus and system for determining positions, as well as processing center
WO2017128982A1 (en) * 2016-01-27 2017-08-03 西安小光子网络科技有限公司 Optical tag-based information interaction system and method therefor
KR20170101051A (en) * 2016-02-26 2017-09-05 엘지이노텍 주식회사 Electronic apparatus for genarating location information and thereof operation method
CN109308434A (en) * 2017-07-27 2019-02-05 浙江汉朔电子科技有限公司 Electronics price tag, server and system
CN108549870A (en) * 2018-04-16 2018-09-18 图麟信息科技（深圳）有限公司 A kind of method and device that article display is differentiated
CN108922079A (en) * 2018-06-05 2018-11-30 阿里巴巴集团控股有限公司 A kind of data processing method, article detection method, device
CN109085535A (en) * 2018-06-29 2018-12-25 北京迈格威科技有限公司 The positioning system and method for shelf electronic tag

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
RFID-enabled shelf replenishment with backroom monitoring in retail stores;Cosmin Condea等;Decision Support Systems;20120301;第52卷(第4期);839–849 *
基于颜色和SIFT特征的视频目标检索方法研究;李伟;王蓉;;科学技术与工程;20131018(第29期);全文 *

Also Published As

Publication number Publication date
CN111914587A (en) 2020-11-10

Similar Documents

Publication Publication Date Title
US10296869B2 (en) Determination of a product position along a fixture or positions of objects in images
US9171442B2 (en) Item identification using video recognition to supplement bar code or RFID information
US20140195374A1 (en) Managing inventory in a shopping store
US20180293593A1 (en) Camera based location commissioning of electronic shelf labels
EP2600291A1 (en) Planogram extraction based on image processing
EP3211891A1 (en) Identification and imaging of terminal-proximate event occurrences
CN101061726A (en) System and method for enhanced situation awarness
US11568725B2 (en) System and method for providing and/or collecting information relating to objects
US11392888B2 (en) Electronic price, inventory management and label system
CN115136176A (en) System and method for fast checkout using a portable computer device
CN109191546B (en) Map generation method, information acquisition method, device and system
US20220156794A1 (en) Product management system, product management apparatus, and tool communication apparatus
CN111914587B (en) Display article detection system and method
JP2015032230A (en) Shoplifting prevention system using rfid and monitor camera
CA2731818C (en) Electronic article surveillance deactivator with multiple label detection and method thereof
WO2015092375A1 (en) Security system and method
US20120065880A1 (en) Ground Location of Work Truck
KR101682129B1 (en) Method of managing products using a rfid tag and monitoring product flow
US20120273566A1 (en) Ground Location of Work Truck
EP3832566A1 (en) Associating product types and electronic labels using a camera
CN112395918B (en) Goods shelf identification method, device and system
EP3832527A1 (en) Controlling output of electronic labels from camera
US11972409B2 (en) Retransmission of environmental indications for lost prevention at a checkout terminal
WO2017123093A1 (en) Method and device for detecting an inventory in a storage space
JP2024517140A (en) Inventory control method and system with synchronized shelf systems and sensor activation - Patents.com

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant