CN113033732A - Shelf label and shelf commodity identification method and identification device - Google Patents
Shelf label and shelf commodity identification method and identification device Download PDFInfo
- Publication number
- CN113033732A CN113033732A CN202110325441.9A CN202110325441A CN113033732A CN 113033732 A CN113033732 A CN 113033732A CN 202110325441 A CN202110325441 A CN 202110325441A CN 113033732 A CN113033732 A CN 113033732A
- Authority
- CN
- China
- Prior art keywords
- shelf
- reflector
- projector
- goods
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 238000012805 post-processing Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 abstract description 6
- 206010063385 Intellectualisation Diseases 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 4
- 238000012937 correction Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K17/00—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
- G06K17/0022—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B17/00—Details of cameras or camera bodies; Accessories therefor
- G03B17/48—Details of cameras or camera bodies; Accessories therefor adapted for combination with other photographic or optical apparatus
- G03B17/54—Details of cameras or camera bodies; Accessories therefor adapted for combination with other photographic or optical apparatus with projector
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/14—Details
- G03B21/28—Reflectors in projection beam
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Display Racks (AREA)
Abstract
The invention specifically discloses a method and a device for identifying shelf labels and shelf commodities, wherein the identification method comprises the following steps: s1, installing the reflector, the projector and the camera at corresponding positions of each layer of shelf bracket; s2, controlling the reflector to rotate at a constant angular speed, continuously projecting the projection beam of the projector to a slot area for installing the shelf label by using the reflector, further obtaining a rectangular shelf label picture formed by multi-frame projection pictures in the horizontal direction, and simultaneously collecting the image of the shelf commodity in the reflector in the rotation process of the reflector by using the camera; s3, correcting the acquired rectangular shelf label picture to acquire a rectangular shelf label picture with a normal proportion; and S4, processing the collected images of the goods on the shelf, and identifying the information of the goods on the shelf and the corresponding positions of the goods on the shelf. The invention can automatically and effectively identify the shelf label and the shelf commodity information, and has the characteristics of automation and intellectualization.
Description
Technical Field
The invention relates to the technical field of intelligent retail, in particular to a shelf label and shelf commodity identification method and device.
Background
At present, the mainstream automatic electronic shelf label system displays the content of the shelf label by using a liquid crystal screen or an electronic paper screen, and the label content is issued by matching with a low-power wireless or wired communication technology. However, the readability of the lcd screen is poor in the market environment, and the electronic paper screen is expensive although it has a texture close to that of paper. In fact, both displays are not comparable to real printed paper labels in terms of readability, fineness, expressiveness and cost.
Meanwhile, the electronic shelf label using the low-power wireless communication technology is limited by the battery power, so that the long battery service time needs to be replaced by sacrificing the real-time performance, and a large number of labels can be intensively exhausted after 3-5 years, thereby increasing the workload of manpower. Moreover, the wireless communication technology itself is complex, costly, and whether the communication is successful depends on many complex factors, such as the distance between the antenna and the ground and the ceiling, the presence of wall obstructions, and the presence of interferences. Therefore, high reliability is difficult to achieve in a supermarket, and 3 to fifty thousand tags may be available in a supermarket, and it is not practical to use wired connections for the number of tags, which results in huge installation and maintenance costs.
In view of this, it is an urgent technical problem to be solved by those skilled in the art to design a method and an apparatus for identifying shelf labels and shelf products with high automation degree and high intelligence degree.
Disclosure of Invention
The invention aims to provide a shelf label, a shelf commodity identification method and a shelf commodity identification device with high automation degree and intelligence degree.
In order to solve the technical problem, the invention provides a shelf label and shelf commodity identification method, which comprises the following steps:
s1, rotatably mounting a reflector at the upper central position of each layer of shelf supporting plate, and mounting a projector and a camera at the lower left corner or the lower right corner of each layer of shelf supporting plate in parallel;
s2, controlling the reflector to rotate at a constant angular speed, continuously projecting the projection beam of the projector to a slot area for installing shelf labels by using the reflector, further obtaining a rectangular shelf label picture formed by multi-frame projection pictures in the horizontal direction, and simultaneously collecting shelf commodity images in the reflector during the rotation of the reflector by using the camera;
s3, correcting the rectangular shelf label picture obtained in the step S2 to obtain a rectangular shelf label picture with a normal proportion;
s4, the image of the shelf product collected in step S2 is processed to identify the information of the shelf product and the specific position of the shelf product on the shelf.
Preferably, the refresh rate of the shelf label is not less than 15 frames, the rotating speed of the reflector is not less than 7.5 revolutions per second, and the frame rate of the projector is 120 frames per second.
Preferably, the reflective mirror is a single-sided mirror or a double-sided mirror, and the reflective mirror is rotated at a constant angular speed on the shelf by driving of a dc motor.
Preferably, the specific implementation manner of step S3 includes:
s31, generating a template according to the speed change of the projection beam of the projector;
s32, utilizing the template frames generated in the step S31 to fix the length of the square shelf label picture, so that the image in each frame corresponds to one frame of picture projected by the projector;
and S33, uniformly stretching the images with the changed widths in the template to the normal width so as to obtain a rectangular shelf label picture with the normal proportion.
Preferably, the specific implementation manner of step S4 includes:
s41, comparing the goods shelf images collected by the camera with goods shelf images stored in a database in advance, if the comparison and matching are successful, obtaining the information of the goods shelf according to the database, then entering the step S42, and if the comparison and matching are failed, entering the step S43;
s42, determining the specific position of the goods on the goods shelf supporting plate according to the angle of the current reflector;
and S43, collecting the images of the goods on the shelf again by keeping the position of the camera still, repeating the step S41, and reporting an error when the matching failure times reach three times.
Preferably, the information of the shelf goods in the database comprises goods entries and goods names.
Meanwhile, the invention also provides a device for identifying the shelf label and the shelf commodity, which comprises the following components:
the goods shelf comprises a goods shelf body and a plurality of layers of goods shelf supporting plates fixedly arranged on the goods shelf body, wherein each layer of goods shelf supporting plate is used for placing goods of the goods shelf, and a clamping groove for mounting a goods shelf label is arranged on the outer side of each layer of goods shelf supporting plate;
the projector is respectively arranged at the lower left corner or the lower right corner of each layer of the goods shelf supporting plate;
the reflectors are respectively arranged in the middle of the upper part of each layer of shelf supporting plate and used for distributing light beams projected by the projector to a clamping groove area for mounting shelf labels;
the rotating shaft is used for rotatably mounting the reflector on the goods shelf;
the motor is connected with the rotating shaft and is used for driving the rotating shaft to drive the reflector to rotate at a constant angular speed;
the camera is arranged at the lower left corner or the lower right corner of each layer of the shelf supporting plate in parallel with the projector and is used for collecting images of shelf commodities in the reflector mirror in the rotation process of the reflector;
the processor is connected with the projector, the reflector and the camera and is used for receiving the frame pictures projected by the projector and the goods shelf images collected by the camera and performing post-processing;
and the controller is respectively connected with the projector, the reflector, the camera and the motor and is used for controlling the working states of the projector, the reflector, the camera and the motor.
Preferably, the processor is respectively connected with the projector, the reflector and the camera through cables.
Preferably, the controller is respectively connected with the projector, the reflector, the camera and the motor through cables.
Compared with the prior art, the invention utilizes the rotating reflector to continuously project the projection beam of the projector to the clamping groove area for installing the shelf label to obtain a rectangular shelf label picture formed by multiple frames of pictures, then the correction treatment is carried out on the multiple rectangular shelf label pictures to compensate the picture distortion caused by uneven linear velocity, meanwhile, the camera is utilized to obtain the shelf commodity image in the reflector during the rotation process of the reflector, and the obtained shelf commodity image is compared with the shelf commodity image in the pre-stored database, thereby realizing the automatic identification of the shelf label and the shelf commodity information, and having the characteristics of high automation and intelligent degree. Meanwhile, the recognition device has the characteristics of simple structure and high recognition accuracy.
Drawings
FIG. 1 is a flow chart of a shelf label and shelf product identification method of the present invention,
figure 2 is a schematic view of the structure of the shelf label and shelf product identification means of the present invention,
figure 3 is a schematic diagram of the present invention showing shelf label frame images captured by a mirror and projector,
FIG. 4 is a flowchart of the correction processing for the acquired rectangular shelf label screen in the present invention,
figure 5 is a schematic comparison of a rectangular shelf label frame of the present invention before and after rectification,
figure 6 is a flow chart of the present invention for processing shelf commodity images captured by a camera,
fig. 7 is a schematic diagram of the present invention for capturing images of shelf items via mirrors and cameras.
In the figure: 1. the shelf comprises a shelf body, a shelf supporting plate, a clamping groove, a projector, a reflector, a rotating shaft, a camera, a shelf commodity, a shelf label and a projection picture, wherein the shelf supporting plate is 2, the clamping groove is 3, the projector is 4, the reflector is 5, the rotating shaft is 6, the camera is 7, the shelf commodity is 8, the shelf label is 9, the projection picture is 10, one frame of the shelf label picture is 20, and the projection picture is.
Detailed Description
In order to make the technical solutions of the present invention better understood, the present invention is further described in detail below with reference to the accompanying drawings.
In the description of the present invention, it is to be understood that the terms "upper", "lower", "left", "right", "horizontal", "inner", "outer", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience in describing the present invention and simplifying the description, but do not indicate or imply that the referred device or element must have a specific orientation, be constructed in a specific orientation, and be operated, and thus, should not be construed as limiting the present invention. Taking fig. 2 as an example, the vertical paper surface facing inward is the inner side, the vertical paper surface facing outward is the outer side, the vertical paper surface facing upward is the upper side, the vertical paper surface facing downward is the lower side, the vertical paper surface facing leftward is the left side, and the vertical paper surface facing rightward is the right side, and the "horizontal direction" in the present invention refers to the left-right direction of the vertical paper surface.
In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meaning of the above terms in the present invention can be understood by those of ordinary skill in the art through specific situations.
As shown in fig. 1 to 3, fig. 1 is a flow chart illustrating a method for identifying shelf labels and shelf products; FIG. 2 is a schematic diagram showing the construction of a shelf label and shelf product identification device; in fig. 3, 3a shows a schematic diagram of acquiring one frame of the projected picture 10 in the shelf label picture through the mirror and the projector, and 3b shows a schematic diagram of acquiring another frame of the projected picture 20 in the shelf label picture through the mirror and the projector.
A shelf label and shelf item identification method, the identification method comprising the steps of:
s1, rotatably mounting the reflector 5 at the upper central position of each layer of shelf supporting plate 2, and mounting the projector 4 and the camera 7 at the lower left corner or the lower right corner of each layer of shelf supporting plate 2 in parallel;
s2, controlling the reflector 5 to rotate at a constant angular speed, continuously projecting the projection beam of the projector 4 to the region of the clamping groove 3 for mounting the shelf label 9 by using the reflector 5, further obtaining a rectangular shelf label picture formed by multi-frame projection pictures in the horizontal direction, and simultaneously collecting the images of the shelf commodities 8 in the reflector 5 in the rotating process by using the camera 7;
s3, correcting the rectangular shelf label picture obtained in the step S2 to obtain a rectangular shelf label picture with a normal proportion;
s4, the image of the shelved merchandise collected in step S2 is processed to identify the information of the shelved merchandise 8 and the specific position of the shelved merchandise 8 on the shelf.
In this embodiment, the frame rate of the projector 4 is 120 frames/second, in order to avoid a flicker feeling, the refresh rate of the shelf label 9 is not lower than 15 frames, each time the reflective mirror 5 rotates one circle, the projector 4 projects a light beam to project one frame of image at the same position in the region of the card slot 3 where the shelf label 9 is installed, if the reflective mirror 5 is a double-sided reflective mirror, each circle of the reflective mirror 5 can project two frames of image, so the rotation speed of the reflective mirror 5 is not lower than 7.5 revolutions/second (i.e., 450 revolutions/min), and thus we can obtain the number of images that can be projected in the region of the card slot 3 where the shelf label 9 is installed on each layer of the shelf supporting plate 2 (the frame rate of the projector 4 is divided by the frame rate at the same position in the card slot.
In this embodiment, since the reflective mirror 5 rotates at a constant angular velocity, and the linear velocity of the projection beam of the projector 4 projected to the position of the slot area where the shelf label is installed is non-uniform, the projection image is distorted, so that the shelf label image with a normal ratio can be obtained only by correcting the obtained rectangular shelf label image; and the current rotation angle of the reflective mirror 5 is uniquely corresponding to the position on the shelf body 1, so that the specific position of the collected shelf commodity 8 on the shelf can be obtained according to the current angle of the reflective mirror 4.
In this embodiment, the specific flow of the identification method is as follows: firstly, controlling a reflector 5 to rotate at a constant angular speed, continuously projecting a projection beam of a projector 4 of the reflector 5 to a region of a clamping groove 3 for mounting a shelf label 9 to obtain a frame of picture, further obtaining a rectangular shelf label picture formed by a plurality of frames of projection pictures in the horizontal direction, and then correcting the obtained rectangular shelf label picture; meanwhile, the camera 7 is used for collecting the image of the goods on the shelf 8 in the mirror of the reflector 5 in the rotating process of the reflector 5 and processing the collected goods on the shelf, so that the information of the goods on the shelf 8 and the specific position of the goods on the shelf 8 are identified. The identification method has the characteristics of high automation degree and high intelligent degree, and can quickly and accurately identify and display the shelf labels 9 and the shelf commodities 8.
As shown in fig. 4 and 5, fig. 4 is a flowchart of a correction process performed on the acquired rectangular shelf label screen; in fig. 5, 5a shows a schematic view of an uncorrected rectangular shelf label screen, and 5b shows a schematic view of a corrected rectangular shelf label screen.
The specific implementation manner of step S3 in the identification method includes:
s31, generating a template according to the linear velocity change of the projection beam of the projector 4;
s32, utilizing the template frames generated in the step S31 to fix the length of the square shelf label picture, so that the image in each frame corresponds to one frame of picture projected by the projector;
and S33, uniformly stretching the images with the changed widths in the template to the normal width so as to obtain a rectangular shelf label picture with the normal proportion.
In this embodiment, since the angular velocity of the reflective mirror 5 is constant, the linear velocity of the projection beam of the projector 4 will change continuously, for example, when the projection beam of the projector 4 moves from the edge of the shelf support 2 to the center, the linear velocity will decrease continuously with the movement of the projection beam; if the projection beam of the projector 4 continues to move (i.e. moves from the center of the shelf pallet 2 to the edge), the linear velocity will continuously increase along with the movement of the projection beam; therefore, the rectangular shelf label screen composed of multiple frames obtained in the horizontal direction has a problem of distortion. Firstly, a template is generated according to the linear velocity change condition of a projection light beam of a projector 4, then an obtained rectangular shelf label picture is framed according to the generated template so that an image in each frame corresponds to a frame picture projected by the projector 4, finally, the image with the changed width in the template is uniformly stretched to the normal width, due to the effect of the change of the linear velocity and the change of the width, the stretched picture is shrunk, the rectangular shelf label picture with the normal proportion is further obtained, and the distortion correction of the projection picture is realized.
As shown in fig. 6, fig. 6 shows a flowchart of processing the shelf product image captured by the camera. The specific implementation manner of step S4 in the identification method includes:
s41, comparing the goods shelf image collected by the camera 7 with the goods image pre-stored in the database, if the comparison and matching are successful, obtaining the information of the goods shelf 8 according to the database, then entering step S42, if the comparison and matching are failed, entering step S43;
s42, determining the specific position of the goods on the shelf 8 on the shelf supporting plate 2 according to the angle of the current reflector 5;
and S43, collecting the image of the goods on shelf 8 again by keeping the position of the camera 7 still, repeating the step S41, and reporting an error when the matching failure times reach three times.
In the embodiment, information such as commodity items, commodity names and the like of the goods shelf commodities 8 is obtained by comparing and matching the goods shelf commodity images acquired by the camera 7 with goods shelf commodity images stored in a database in advance, if the comparison and matching fails, the comparison and matching are repeated for three times, and when the comparison and matching for three times fails, the recognition system reports errors and is manually processed by an operator, so that the recognition accuracy is ensured to the maximum extent; and then the specific position of the acquired image of the goods on the shelf 8 on the shelf supporting plate 2 is determined according to the angle of the current reflector 5, so that the automatic identification and display of the goods on the shelf 8 are realized. In other embodiments, the number of times of matching failure may also be set to two or more than three times of other values for error reporting.
As shown in fig. 2, 3 and 7, fig. 7 is a schematic diagram showing the collection of images of the shelf goods by means of a mirror and a camera.
A shelf label and shelf item identification device comprising:
the goods shelf comprises a goods shelf body 1 and a plurality of layers of goods shelf supporting plates 2 fixedly arranged on the goods shelf body 1, wherein the goods shelf supporting plates 2 are used for placing goods shelf commodities 8, and a clamping groove 3 used for mounting a goods shelf label 9 is formed in the outer side of each layer of the goods shelf supporting plate 2;
the projector 4 is respectively arranged at the lower left corner or the lower right corner of each layer of the goods shelf supporting plate 2;
the reflectors 5 are respectively arranged at the upper central position of each layer of shelf supporting plate 2 and used for distributing the projection light beams of the projector 4 to the area of the clamping groove 3 for mounting the shelf labels 9;
the rotating shaft 6 is used for rotatably mounting the reflector 5 on the goods shelf;
the motor is connected with the rotating shaft 6 and used for driving the rotating shaft 6 to drive the reflecting mirror 5 to rotate at a constant angular speed;
the camera 7 is arranged at the lower left corner or the lower right corner of each layer of shelf supporting plate in parallel with the projector and is used for collecting images of shelf commodities in the mirror of the reflector 5 in the rotating process of the reflector 5;
the processor is connected with the projector 4, the reflector 5 and the camera 7 and is used for receiving the frame picture projected by the projector 4 and the goods shelf image collected by the camera 7 and performing post-processing;
and the controller is respectively connected with the projector 4, the reflecting mirror 5, the camera 7 and the motor and is used for controlling the working states of the projector 4, the reflecting mirror 5, the camera 7 and the motor.
Wherein, the processor is respectively connected with the projector 4, the reflector 5 and the camera 7 through cables.
The controller is connected with the projector 4, the reflector 5, the camera 7 and the motor through cables.
In this embodiment, since the mass of the reflective mirror 5 is light, the motor is a common dc motor, and the dc motor is controlled by the controller to drive the rotating shaft 6 to rotate, so as to drive the reflective mirror 5 to rotate at a constant angular velocity, then the projector 4 is controlled to project a light beam, and the reflective mirror 5 is used to continuously spread the projected light beam to the slot 3 region to obtain a frame-by-frame projection picture (as shown in fig. 3, 3a shows a schematic diagram of a frame projection picture 10 in the shelf label picture obtained by the reflective mirror 5 and the projector 4, 3b shows a schematic diagram of another frame projection picture 20 in the shelf label picture obtained by the reflective mirror 5 and the projector 4), and the camera 7 is controlled to collect a shelf commodity image in the mirror of the reflective mirror 5 during the rotation of the reflective mirror 5, and then the collected rectangular shelf label picture composed of multiple frames of pictures and the collected shelf commodity image are transmitted to the processor for processing, thereby completing the automatic identification of the shelf label 9 from the shelf product 8. The system has the characteristics of high automation degree and high intelligent degree.
The above description describes in detail a shelf label, a method and an apparatus for identifying shelf products according to the present invention. The principles and embodiments of the present invention are explained herein using specific examples, which are presented only to assist in understanding the core concepts of the present invention. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present invention.
Claims (9)
1. A method for identifying shelf labels and shelf products, the method comprising the steps of:
s1, rotatably mounting a reflector at the upper central position of each layer of shelf supporting plate, and mounting a projector and a camera at the lower left corner or the lower right corner of each layer of shelf supporting plate in parallel;
s2, controlling the reflector to rotate at a constant angular speed, continuously projecting the projection beam of the projector to a slot area for installing the shelf label by using the reflector, further obtaining a rectangular shelf label picture formed by multi-frame projection pictures in the horizontal direction, and simultaneously collecting shelf commodity images in the reflector during the rotation of the reflector by using the camera;
s3, correcting the rectangular shelf label picture obtained in the step S2 to obtain a rectangular shelf label picture with a normal proportion;
s4, the image of the shelf product collected in step S2 is processed to identify the information of the shelf product and the specific position of the shelf product on the shelf.
2. The shelf label and shelf product identification method as claimed in claim 1 wherein the refresh rate of the shelf label is not less than 15 frames, the rotational speed of the mirror is not less than 7.5 rpm, and the frame rate of the projector is 120 rpm.
3. The shelf label and shelf product identification method as claimed in claim 2, wherein the mirror is a single mirror or a double mirror, and the mirror is rotated at a constant angular velocity on the shelf by driving of a dc motor.
4. The shelf label and shelf product identification method according to claim 3, wherein the specific implementation manner of the step S3 includes:
s31, generating a template according to the speed change of the projection beam of the projector;
s32, utilizing the template frames generated in the step S31 to fix the length of the square shelf label picture, so that the image in each frame corresponds to one frame of picture projected by the projector;
and S33, uniformly stretching the images with the changed widths in the template to the normal width so as to obtain a rectangular shelf label picture with the normal proportion.
5. The shelf label and shelf product identification method according to claim 4, wherein the step S4 is implemented in a specific manner including:
s41, comparing the goods shelf images collected by the camera with goods shelf images stored in a database in advance, if the comparison and matching are successful, obtaining the information of the goods shelf according to the database, then entering the step S42, and if the comparison and matching are failed, entering the step S43;
s42, determining the specific position of the goods on the goods shelf supporting plate according to the angle of the current reflector;
and S43, keeping the position of the camera still, collecting the image of the goods on the shelf again, repeating the step S41, and reporting an error when the matching failure times reach three times.
6. The shelf label and shelf product identification method as claimed in claim 5, wherein the information of the shelf product in the database comprises a product entry and a product name.
7. An apparatus for identifying shelf labels and shelf products, comprising:
the goods shelf comprises a goods shelf body (1) and a plurality of layers of goods shelf supporting plates (2) fixedly arranged on the goods shelf body (1), wherein each layer of goods shelf supporting plate (2) is used for placing goods shelf commodities (8), and a clamping groove (3) for installing goods shelf labels (9) is formed in the outer side of each layer of goods shelf supporting plate (2);
the projectors (4) are respectively arranged at the lower left corner or the lower right corner of each layer of shelf supporting plate (2);
the reflectors (5) are respectively arranged in the middle of the upper part of each layer of shelf supporting plate (2) and used for distributing light beams projected by the projector (4) to the area of the clamping groove (3) for mounting the shelf label (9);
the rotating shaft (6) is used for rotatably mounting the reflector (5) on each layer of goods shelf;
the motor is connected with the rotating shaft (6) and is used for driving the rotating shaft (6) to drive the reflector (5) to rotate at a constant angular speed;
the camera (7) is arranged at the lower left corner or the lower right corner of each layer of the shelf supporting plate (2) in parallel with the projector (4) and is used for collecting images of shelf commodities (8) in the mirror of the reflector (5) in the rotating process of the reflector (5);
the processor is connected with the projector (4), the reflector (5) and the camera (7) and is used for receiving the frame picture projected by the projector (4) and the goods shelf image collected by the camera (7) and performing post-processing;
and the controller is respectively connected with the projector (4), the reflecting mirror (5), the camera (7) and the motor and is used for controlling the working states of the projector (4), the reflecting mirror (5), the camera (7) and the motor.
8. The shelf label identification method according to claim 7, wherein the processor is connected to the projector (4), the reflector (5) and the camera (7) by cables, respectively.
9. The shelf label identification method according to claim 8, wherein the controller is connected to the projector (4), the reflector (5), the camera (7) and the motor through cables.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110325441.9A CN113033732B (en) | 2021-03-26 | Goods shelf label and goods shelf commodity identification method and identification device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110325441.9A CN113033732B (en) | 2021-03-26 | Goods shelf label and goods shelf commodity identification method and identification device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113033732A true CN113033732A (en) | 2021-06-25 |
| CN113033732B CN113033732B (en) | 2024-07-05 |
Family
ID=
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101044946A (en) * | 2006-03-28 | 2007-10-03 | 东芝泰格有限公司 | Display shelf and display shelf system |
| CN101273828A (en) * | 2006-12-21 | 2008-10-01 | 东芝泰格有限公司 | Image display controller for display shelf |
| CN105988271A (en) * | 2015-02-13 | 2016-10-05 | 扬明光学股份有限公司 | Projection device |
| US20180276603A1 (en) * | 2017-03-23 | 2018-09-27 | Walmart Apollo, Llc | System and method for remote controlling of electronic shelf labels |
| CN108830147A (en) * | 2018-05-04 | 2018-11-16 | 广州图匠数据科技有限公司 | A kind of commodity on shelf price recognition methods based on image recognition, device and system |
| JP2019014606A (en) * | 2017-03-17 | 2019-01-31 | トーヨーカネツソリューションズ株式会社 | Movable projector type picking device |
| US20190064309A1 (en) * | 2017-08-29 | 2019-02-28 | Walmart Apollo, Llc | Method for determining position accuracy of a modular shelving |
| CN109756716A (en) * | 2019-01-16 | 2019-05-14 | 宁波联影光电科技有限公司 | A kind of intelligent commodity shelf information shows interactive system and exchange method |
| KR20200145179A (en) * | 2019-06-21 | 2020-12-30 | 주식회사 솔루엠 | Electronic Shelf Label and method for controlling information display of the same |
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101044946A (en) * | 2006-03-28 | 2007-10-03 | 东芝泰格有限公司 | Display shelf and display shelf system |
| CN101273828A (en) * | 2006-12-21 | 2008-10-01 | 东芝泰格有限公司 | Image display controller for display shelf |
| CN105988271A (en) * | 2015-02-13 | 2016-10-05 | 扬明光学股份有限公司 | Projection device |
| JP2019014606A (en) * | 2017-03-17 | 2019-01-31 | トーヨーカネツソリューションズ株式会社 | Movable projector type picking device |
| US20180276603A1 (en) * | 2017-03-23 | 2018-09-27 | Walmart Apollo, Llc | System and method for remote controlling of electronic shelf labels |
| US20190064309A1 (en) * | 2017-08-29 | 2019-02-28 | Walmart Apollo, Llc | Method for determining position accuracy of a modular shelving |
| CN108830147A (en) * | 2018-05-04 | 2018-11-16 | 广州图匠数据科技有限公司 | A kind of commodity on shelf price recognition methods based on image recognition, device and system |
| CN109756716A (en) * | 2019-01-16 | 2019-05-14 | 宁波联影光电科技有限公司 | A kind of intelligent commodity shelf information shows interactive system and exchange method |
| KR20200145179A (en) * | 2019-06-21 | 2020-12-30 | 주식회사 솔루엠 | Electronic Shelf Label and method for controlling information display of the same |
Non-Patent Citations (1)
| Title |
|---|
| 刘照邦;袁明辉;: "基于深度神经网络的货架商品识别方法", 包装工程, no. 01 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112203071B (en) | Projection method, system and storage medium based on horizontal correction of distance sensor | |
| US10755571B1 (en) | Identifying parking location using single camera reverse projection | |
| US6877864B1 (en) | Projector and method of correcting image distortion | |
| CN112584113A (en) | Wide-screen projection method and system based on mapping correction and readable storage medium | |
| US20120176415A1 (en) | Graphical display system with adaptive keystone mechanism and method of operation thereof | |
| WO2007002143A2 (en) | Dual camera calibration technique for video projection systems | |
| CN106327483A (en) | Detection equipment logo attaching method, system and device | |
| TWI245563B (en) | A monitor system for a projection apparatus, projection apparatus, and a monitor program for a projection apparatus, and a monitor method for a projection apparatus | |
| CN104527193A (en) | Image system laminator | |
| US8265340B2 (en) | System and method for displaying a product catalog | |
| CN113033732A (en) | Shelf label and shelf commodity identification method and identification device | |
| CN113033732B (en) | Goods shelf label and goods shelf commodity identification method and identification device | |
| CN112203069B (en) | Wide-screen projection method and system based on camera and readable storage medium | |
| CN112203070B (en) | Projection method and system based on monochromatic light emitter and readable storage medium | |
| CN204287670U (en) | Polaroid visual-alignment device | |
| US20070115397A1 (en) | Projection display with internal calibration bezel for video | |
| WO2021248372A1 (en) | Light spot adjustment method, light spot adjustment apparatus and light spot adjustment system | |
| US20130120428A1 (en) | Mobile Projector with Position Dependent Display | |
| CN201523419U (en) | Shooting device with shooting coverage mark | |
| CN107843604B (en) | Device and method for detecting edge defects of double-layer substrate | |
| CN113665495A (en) | Vehicle-mounted target tracker convenient to install and based on computer vision | |
| WO2022084977A1 (en) | Parallax-tolerant panoramic image generation | |
| KR100715670B1 (en) | Device and method for controlling image distrotion in non planar multi prejector system | |
| US20140028725A1 (en) | Electronic device and method for displaying product catalog | |
| CN112040210B (en) | Wide screen projection system, method, apparatus and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20240509 Address after: 430070 5A / F, future mansion, 378 Wuluo Road, Hongshan District, Wuhan City, Hubei Province Applicant after: Wuhan yizhiniao Technology Co.,Ltd. Country or region after: China Address before: 410000 8th floor, building a, Kaile Weigu, Douling Road, Kaifu District, Changsha City, Hunan Province Applicant before: Hunan Deya Huaxing Technology Research Center Co.,Ltd. Country or region before: China Applicant before: Hunan Deya Huaxing Technology Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20240530 Address after: Room 202, Building 58-4, Yuzhou South Road, Xinpu District, Lianyungang City, Jiangsu Province, 222000 Applicant after: Yang Dong Country or region after: China Address before: 430070 5A / F, future mansion, 378 Wuluo Road, Hongshan District, Wuhan City, Hubei Province Applicant before: Wuhan yizhiniao Technology Co.,Ltd. Country or region before: China |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant |