CN110475046B - Method for positioning detection area in installation stage of vending machine - Google Patents
Method for positioning detection area in installation stage of vending machine Download PDFInfo
- Publication number
- CN110475046B CN110475046B CN201910700023.6A CN201910700023A CN110475046B CN 110475046 B CN110475046 B CN 110475046B CN 201910700023 A CN201910700023 A CN 201910700023A CN 110475046 B CN110475046 B CN 110475046B
- Authority
- CN
- China
- Prior art keywords
- goods
- holder
- cradle head
- marks
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07F—COIN-FREED OR LIKE APPARATUS
- G07F11/00—Coin-freed apparatus for dispensing, or the like, discrete articles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/147—Scene change detection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Abstract
The invention discloses a method for positioning a detection area at the loading stage of a vending machine, wherein a mark for positioning is pasted at the loading stage of the vending machine, a holder area detection is carried out at the bottommost position of a holder and the goods taking position moving to each goods layer, the coordinate value of a mark point on the holder at each position is obtained and stored in a configuration file, and when the goods are discharged and detected, the coordinate values of four mark points of the holder area of the corresponding goods layer are obtained from the configuration file according to the layer number of the goods, so that the further discharge detection is carried out. By the mode, the delivery and pickup detection speed can be increased, and the influence of the external environment on the camera view of the acquisition platform is reduced to the minimum.
Description
Technical Field
The invention relates to the field of vending machines, in particular to a method for positioning a detection area in a vending machine installation stage.
Background
The vending machine is a typical case of a model under a new retail business center line, and relates to modules of selling goods, paying, vending machine information management and the like. The goods outlet process is a key link of the vending machine and comprises the key steps of judging that the cradle head is empty, ascending the cradle head to a specified goods layer, moving the goods channel, discharging the goods channel, judging that the goods are discharged, stopping the goods channel, descending the cradle head, opening the baffle, taking the goods, detecting that the goods are taken, closing the baffle and the like. The existing self-service vending machine detects that goods fall and goods are taken out and are completed by means of infrared correlation gratings on two sides of a goods carrying holder of the vending machine, and the problems that smaller goods, transparent goods and long and thin goods cannot be detected and multiple goods are discharged can be solved.
Utilize the camera to detect and sell quick-witted shipment and get the unable goods that detect of infrared grating such as little object of solution, transparent object that can be fine, provide technological and environmental foundation for detecting many shipments moreover. The positioning of the detection area of the camera is a key step of detecting shipment and goods taking by the camera, the area of the cradle head in the whole camera preview picture needs to be known when each goods layer carries out shipment detection, and the area of the cradle head in the whole camera preview picture and the image of the cradle head at the bottom before the cradle head moves also need to be known when the goods taking detection is carried out at the bottommost part. In order to meet the requirement of positioning the detection area, positioning marks need to be attached to four corners of the holder or some positions of the holder, and the holder area is detected in real time in the delivery and pickup processes, which is feasible, but has the following problems:
1. the positioning mark on the holder exists permanently and is easy to damage, thereby influencing the user experience
If the positioning mark pasted on the holder exists permanently, the attractiveness of the whole vending machine is affected, more seriously, the use times of the vending machine are increased, the delivery times are increased, the label is easy to be stained, the possibility of being considered to be damaged also exists, and the subsequent holder area positioning can be seriously affected.
2. The possibility that the mark point cannot be detected exists in the real-time positioning holder area, which causes the abnormal selling process
The positioning cloud platform region detects each frame of preview picture of the camera, and due to the influences of the quality of the picture of the camera, picture noise, external illumination and the like, the mark point is not detected in each frame, and if the continuous multiframe detection is not carried out, the delivery time exceeds the set delay time, so that the selling process is abnormal.
3. The real-time positioning of the cradle head area causes the extension of the goods delivery and taking process and increases the probability of abnormity
Under ideal conditions, the area range of the pan/tilt head can be detected in each frame or several frames of pictures, but the subsequent operations of image processing, correction and the like of the detection area are also carried out, and the steps of shipment detection and the like in the flow are added, so that the time of shipment detection can be still prolonged, the user experience is poor, and the probability of abnormity is increased.
Disclosure of Invention
The technical problem mainly solved by the invention is to provide a method for positioning the detection area at the mounting stage of the vending machine, wherein the detection area of the camera is positioned at the mounting stage of the vending machine, and the detection areas are respectively positioned at the goods layers with different heights, so that the speed of goods delivery and pickup detection can be improved, and the influence of the external environment on the visual field of the camera of the acquisition platform is reduced to the minimum.
In order to solve the technical problems, the invention adopts a technical scheme that: the method for positioning the detection area in the loading stage of the vending machine comprises the following steps:
the method comprises the following steps that firstly, a camera is installed, and an infrared camera is installed in the middle of the top of a goods layer area of a vending machine;
pasting marks, namely pasting marks at four corners of the holder;
acquiring coordinate values of central points of marks on the cradle head when the cradle head is at a zero position and the delivery height of each layer of goods channel, starting preview by an infrared camera in the loading stage of the vending machine, detecting the coordinates of the central points of the four pasted marks in a video stream previewed in real time when the cradle head is at the zero position and the delivery height of each layer, and recording the coordinates of the central points of the four marks if a rectangular area is acquired; calculating coordinate values of the whole holder area by using a rectangular frame formed by the four central points, the longitudinal and horizontal coordinate values of the central points and the distances from the central points to the four corners of the holder, and storing the coordinate values in a configuration file;
and step four, removing the mark bits, and removing the mark bits pasted on the holder after the holder area at each position is obtained.
Further, infrared camera mounted position needs satisfy the cloud platform and rises to the requirement of different goods layer positions, and whole cloud platform can both be in the field of vision of camera.
Furthermore, the marks in the second step need to be clearly distinguished from objects in the visual field range of the holder and the infrared camera.
Further, the mark is a clip-shaped mark with a black square in the middle.
The invention has the beneficial effects that: the invention can improve the speed of goods delivery and pickup detection and minimize the influence of the external environment on the visual field of the camera of the acquisition platform.
Drawings
Fig. 1 is a flow chart of a method for positioning a detection area during a loading phase of a vending machine according to a preferred embodiment of the present invention.
Detailed Description
The following detailed description of the preferred embodiments of the present invention, taken in conjunction with the accompanying drawings, will make the advantages and features of the invention easier to understand by those skilled in the art, and thus will clearly and clearly define the scope of the invention.
Referring to fig. 1, an embodiment of the present invention includes:
a method for positioning a detection area in a vending machine loading stage comprises the following steps:
the method comprises the following steps that firstly, a camera is installed, an infrared camera is installed in the middle of the top of a goods layer area of a vending machine, and the installation position of the infrared camera meets the requirement that the whole holder can be in the visual field range of the camera when the holder is lifted to different goods layer positions;
pasting marks, namely pasting marks at four corners of the holder, wherein the marks need to be obviously distinguished from the holder and objects in the visual field range of the infrared camera, for example, the marks are square marks with black squares in the middle;
acquiring coordinate values of central points of marks on a cradle head when the cradle head is at a zero position and the delivery height of each layer of goods channel, starting preview by an infrared camera in the loading stage of the vending machine, detecting the coordinates of the central points of the four pasted marks in a video stream previewed in real time when the cradle head is at the zero position and the delivery height of each layer, and recording the coordinates of the central points of the four marks if a rectangular area is acquired and storing the coordinates into a configuration file;
step four, a goods taking detection background picture, wherein when goods taking detection is carried out, whether goods exist on the cradle head is detected when the cradle head moves to the bottommost part, if no goods exist, the goods are taken out by a user, two states of the cradle head at the bottommost part in the shopping process of the user are required to be compared, namely an image of the cradle head at the bottommost part before the goods taking layer is carried out and an image of the cradle head moving to the bottommost part after goods taking is finished are compared to see whether the two states are the same, in order to ensure accuracy, a camera preview picture is required to be shot at the bottommost part before the cradle head takes the goods taking layer, the shooting is carried out according to the area coordinate of the cradle head at the bottommost part obtained in the loading stage, and the shot part is used as the goods taking detection background picture of the goods selling process;
removing the mark bits, and removing the mark bits pasted on the holder after the holder area at each position is obtained;
calculating the whole holder area, namely calculating the whole holder area according to the obtained coordinates of the mark central point on the holder, wherein the pasted mark central point cannot be positioned at the four top points of the holder, so that the length and the width of a rectangular frame formed according to the obtained coordinates of the four central points are proportional to the actual length and the width of the holder to obtain the whole holder area; namely, the coordinate values of the whole holder area are calculated according to the rectangular frame formed by the four central points, the longitudinal and horizontal coordinate values of the central points and the distances from the central points to the four corners of the holder, and the results are stored in a configuration file.
The uppermost layer goods way exception handling, because the uppermost layer goods way is close apart from the camera, can't guarantee that whole cloud platform all is at the field of vision scope of camera, consequently move suitable position under the position of receiving goods of uppermost layer goods way, can satisfy whole cloud platform in the field of vision scope of camera, this just requires the uppermost layer goods way can not put fragile thing.
Some sell quick-witted qianmen for glass panels, can reflect the inside light of selling the machine, with the sign reflection above the cloud platform to glass door on, this can cause the interference to the sign detection, consequently, need open the door under this kind of condition and detect.
The traditional mode of detecting the shipment and taking the goods by adopting the infrared correlation grating on the holder and the mode of adopting the camera to carry out the shipment and taking the goods can effectively solve the detection limitation of the traditional mode on the size of the goods and the number of the goods, the positioning of the detection area of the camera is a key step, under the condition, the positioning scheme of the detection area of the camera can provide important reference for the positioning of the detection area, and meanwhile, the invention can provide a precondition for the object identification in the new retail business. The invention can improve the speed of goods delivery and pickup detection and minimize the influence of the external environment on the camera view of the acquisition platform.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes performed by the present specification and drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (1)
1. A method for positioning a detection area in a vending machine loading stage is characterized by comprising the following steps:
the method comprises the following steps that firstly, a camera is installed, an infrared camera is installed in the middle of the top of a goods layer area of a vending machine, and the installation position of the infrared camera needs to meet the requirement that the whole cradle head can be in the visual field range of the camera when the cradle head is lifted to different goods layer positions;
pasting marks, namely pasting marks at four corners of the holder, wherein the marks need to be obviously different from the holder and objects in the visual field range of the infrared camera, and the marks are square-shaped marks with black squares in the middle;
acquiring coordinate values of central points of marks on the cradle head when the cradle head is at a zero position and the delivery height of each layer of goods channel, starting preview by an infrared camera in the loading stage of the vending machine, detecting the coordinates of the central points of the four pasted marks in a video stream previewed in real time when the cradle head is at the zero position and the delivery height of each layer, and recording the coordinates of the central points of the four marks if a rectangular area is acquired; calculating coordinate values of the whole holder area by using a rectangular frame formed by the four central points, the longitudinal and horizontal coordinate values of the central points and the distances from the central points to the four corners of the holder, and storing the coordinate values in a configuration file;
step four, a goods taking detection background image is obtained, whether goods exist on the cradle head is detected when the cradle head moves to the bottommost part when goods taking detection is carried out, if no goods exist, the goods are taken out by a user, two states of the cradle head at the bottommost part in the shopping process of the user are compared, namely an image of the cradle head at the bottommost part before goods taking layer is compared with an image of the cradle head moving to the bottommost part after goods discharging is finished, and whether the images are the same is judged;
shooting a camera preview picture at the bottommost part of the camera before the cradle head goes to a goods layer, intercepting according to the region coordinate of the cradle head at the bottommost part obtained in the loading stage, and taking the intercepted part as a goods taking detection background picture of the goods selling process;
removing the mark bits, and removing the mark bits pasted on the holder after the holder area at each position is obtained;
calculating the whole holder area, namely calculating the whole holder area according to the acquired coordinates of the mark central point on the holder; and calculating the coordinate value of the whole holder area according to the rectangular frame formed by the four central points, the vertical and horizontal coordinate values of the central points and the distances from the central points to the four corners of the holder, and storing the result in a configuration file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910700023.6A CN110475046B (en) | 2019-07-31 | 2019-07-31 | Method for positioning detection area in installation stage of vending machine |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910700023.6A CN110475046B (en) | 2019-07-31 | 2019-07-31 | Method for positioning detection area in installation stage of vending machine |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110475046A CN110475046A (en) | 2019-11-19 |
| CN110475046B true CN110475046B (en) | 2022-05-17 |
Family
ID=68509929
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910700023.6A Active CN110475046B (en) | 2019-07-31 | 2019-07-31 | Method for positioning detection area in installation stage of vending machine |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110475046B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111832420B (en) * | 2020-06-17 | 2023-08-29 | 达闼机器人股份有限公司 | Article processing method, device, medium and vending machine |
Family Cites Families (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102213586B (en) * | 2010-04-09 | 2013-11-20 | 鸿富锦精密工业（深圳）有限公司 | Bad hole detection device and bad hole detection method |
| DK2538394T3 (en) * | 2011-06-24 | 2022-02-14 | Tomra Systems Asa | Method and apparatus for detecting fraud attempts in return vending machines |
| TW201324440A (en) * | 2011-12-13 | 2013-06-16 | Hwa Hsia Inst Of Technology | Tester-providing vending machine with skin condition detection |
| CN104091325A (en) * | 2014-06-16 | 2014-10-08 | 哈尔滨工业大学 | Image ROI positioning method and device based on dimension invariant feature transformation during automobile instrument panel visual detection |
| CN106203431A (en) * | 2016-07-14 | 2016-12-07 | 国芯科技（北京）有限公司 | A kind of image-recognizing method and device |
| US9972158B2 (en) * | 2016-10-01 | 2018-05-15 | Cantaloupe Systems, Inc. | Method and device of automatically determining a planogram in vending |
| CN106709420B (en) * | 2016-11-21 | 2020-07-10 | 厦门瑞为信息技术有限公司 | Method for monitoring driving behavior of commercial vehicle driver |
| CN107255644B (en) * | 2017-06-07 | 2019-09-10 | 燕山大学 | A kind of localization method of transmission electron microscope detection zone |
| CN107516111A (en) * | 2017-08-23 | 2017-12-26 | 昆山塔米机器人有限公司 | A kind of vending machine short supply detection method and device |
| CN107833361B (en) * | 2017-09-28 | 2020-03-31 | 中南大学 | Vending machine goods falling detection method based on image recognition |
| CN108182417B (en) * | 2017-12-29 | 2020-07-10 | 广东安居宝数码科技股份有限公司 | Shipment detection method and device, computer equipment and vending machine |
| CN208547998U (en) * | 2018-03-31 | 2019-02-26 | 深圳邦马特科技有限公司 | A kind of cargo path drive system and vending machine |
| CN110414542A (en) * | 2018-04-27 | 2019-11-05 | 深圳市祈飞科技有限公司 | A kind of fruit flow-paths inspection method and system for vending machine of squeezing the juice automatically |
| CN108806069A (en) * | 2018-05-23 | 2018-11-13 | 向荣华 | A kind of cargo monitoring method sells equipment and selling system |
| CN109446909B (en) * | 2018-09-27 | 2020-12-29 | 山东省科学院自动化研究所 | Monocular distance measurement auxiliary parking system and method |
| CN109711337B (en) * | 2018-12-26 | 2021-08-31 | 浪潮金融信息技术有限公司 | Method for realizing object existence detection by using background matching |
| CN109712315B (en) * | 2018-12-27 | 2021-04-20 | 浪潮金融信息技术有限公司 | Automatic vending machine cargo falling detection method based on double cameras |
| CN109932369B (en) * | 2019-03-06 | 2021-10-01 | 合肥鑫晟光电科技有限公司 | Method and device for detecting special-shaped display panel |
-
2019
- 2019-07-31 CN CN201910700023.6A patent/CN110475046B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN110475046A (en) | 2019-11-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109712315B (en) | Automatic vending machine cargo falling detection method based on double cameras | |
| WO2021012644A1 (en) | Shelf commodity detection method and system | |
| CN107402216B (en) | Film-coated product detection system and method | |
| US8284988B2 (en) | System and method for dimensioning objects using stereoscopic imaging | |
| US10546198B2 (en) | Method for the computer-aided recognition of a transport container being empty and device for the computer-aided recognition of a transport container being empty | |
| CN109711337B (en) | Method for realizing object existence detection by using background matching | |
| CN110475046B (en) | Method for positioning detection area in installation stage of vending machine | |
| CA2739866A1 (en) | Method and system for item identification | |
| CN110054121A (en) | A kind of intelligent forklift and container pose bias detecting method | |
| RU2310828C2 (en) | Method and device for selecting containers | |
| CN108629659A (en) | The self-service system made an inventory using vision measurement | |
| US7840026B2 (en) | Apparatus and method for detecting objects | |
| US11335018B1 (en) | Volumetric measuring method and apparatus based on time-of-flight depth camera | |
| EP3647234B1 (en) | Projection indication device, parcel sorting system, and projection indication method | |
| CN105067629B (en) | A kind of chromatic circle resistance open defect and resistance value integrated testing method | |
| AU2022261860A1 (en) | Automated pallet profiling | |
| CN112991379B (en) | Unmanned vending method and system based on dynamic vision | |
| JP2000321039A (en) | Apparatus and method for inspecting coating fault | |
| CN116256366A (en) | Chip defect detection method, detection system and storage medium | |
| US20200234453A1 (en) | Projection instruction device, parcel sorting system, and projection instruction method | |
| CN110148166A (en) | Measure system, method, apparatus and the storage medium of dimension of object | |
| CN115713491A (en) | Liquid crystal display panel defect detection method and device and electronic equipment | |
| CN110363905B (en) | Vending machine detection area positioning and goods discharge detection method based on sliding rail | |
| EP3689789A1 (en) | Baggage recognition device, baggage sorting system, and baggage recognition method | |
| CN219880624U (en) | Size screening machine |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information | ||
| CB03 | Change of inventor or designer information |
Inventor after: Hu Yan Inventor after: Suo Chunbao Inventor after: Zhang Jinqing Inventor after: Zhao Yaou Inventor after: Fu Xianrui Inventor before: Hu Yan Inventor before: Suo Chunbao Inventor before: Zhang Jinqing Inventor before: Zhao Yaou Inventor before: Fu Xianrui |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |