CN113610816A - Automatic detection and early warning method and device for transverse filter tip rod and electronic equipment - Google Patents
Automatic detection and early warning method and device for transverse filter tip rod and electronic equipment Download PDFInfo
- Publication number
- CN113610816A CN113610816A CN202110916406.4A CN202110916406A CN113610816A CN 113610816 A CN113610816 A CN 113610816A CN 202110916406 A CN202110916406 A CN 202110916406A CN 113610816 A CN113610816 A CN 113610816A
- Authority
- CN
- China
- Prior art keywords
- image
- abnormal
- images
- filter rod
- characteristic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000001514 detection method Methods 0.000 title claims description 17
- 230000002159 abnormal effect Effects 0.000 claims abstract description 153
- 238000012216 screening Methods 0.000 claims abstract description 19
- 230000015654 memory Effects 0.000 claims description 25
- 230000005540 biological transmission Effects 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 8
- 238000003860 storage Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 abstract description 9
- 239000012141 concentrate Substances 0.000 abstract description 2
- 239000000463 material Substances 0.000 abstract description 2
- 238000012545 processing Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 10
- 238000004891 communication Methods 0.000 description 7
- 235000019504 cigarettes Nutrition 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 5
- 238000004519 manufacturing process Methods 0.000 description 5
- 238000013459 approach Methods 0.000 description 4
- 230000007547 defect Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000012546 transfer Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/001—Industrial image inspection using an image reference approach
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30236—Traffic on road, railway or crossing
Abstract
The invention discloses a method, a device and electronic equipment for automatically detecting and early warning a transverse filter rod, wherein the method comprises the steps of collecting a side transportation image of the filter rod, and extracting characteristic points from the side transportation image of the filter rod; generating a characteristic image based on each characteristic point, comparing each characteristic image with a preset standard image, screening an abnormal image from each characteristic image according to the shape and color of each characteristic image, and determining the abnormal image as a transverse filter rod; marking abnormal images, continuously collecting side transport images of the filter rod, and tracking the abnormal images; and generating warning information based on the abnormal image, and sending the warning information to a preset terminal. The invention realizes the real-time identification of the heterogeneous filter rods and the warning of the staff in the process of conveying the filter rods to the transmitter in batches, assists the staff to find the abnormal filter rods accurately and timely, does not need the staff to concentrate on staring at the conveyor belt for a long time, and saves manpower and material resources.
Description
Technical Field
The application relates to the technical field of automatic cigarette production, in particular to a transverse filter rod automatic detection early warning method and device and electronic equipment.
Background
The filter rod is one of the indispensable parts that are used for being connected with the cigarette on the cigarette, and in the production and processing process of filter rod, a large amount of filter rods can be from unloading the orderly piling up of groove machine and arranging to the transfer rail on, transport to the filter rod transmitter through the transfer rail. During the process of conveying the filter rods on the conveying track, the situation that the individual filter rods are deviated under the action of the other filter rod forces in the conveying process and gradually cross over in the conveying process inevitably exists, and the cross filter rods can be blocked if conveyed to a filter rod transmitter, so that the production efficiency is influenced. Therefore, in order to find and manually remove the transverse filter rod, an operator needs to constantly observe whether the transverse filter rod exists between the baffle and the filter rod, so that the workload of the operator is greatly increased, and the attention of the operator is reduced under long-time and boring observation, so that the transverse filter rod is not timely treated.
Disclosure of Invention
In order to solve the above problems, embodiments of the present application provide an automatic detection and early warning method and apparatus for a transverse filter rod, and an electronic device.
In a first aspect, an embodiment of the present application provides an automatic detection and early warning method for a filter rod, where the method includes:
collecting a filter rod side transportation image, and extracting characteristic points from the filter rod side transportation image;
generating characteristic images based on the characteristic points, comparing the characteristic images with a preset standard image, screening abnormal images from the characteristic images according to the shape and the color of the characteristic images, and determining the abnormal images as a transverse filter rod;
marking the abnormal image, continuously acquiring the side transportation image of the filter rod, and tracking the abnormal image;
and generating warning information based on the abnormal image, and sending the warning information to a preset terminal.
Preferably, the comparing each of the feature images with a preset standard image, and screening an abnormal image from each of the feature images according to the shape and color of each of the feature images includes:
comparing each characteristic image with a preset standard image, and screening from each characteristic image to obtain a first screened image, wherein the difference between the pixel color value of the first screened image and the pixel color value of the standard image is smaller than a first preset difference value;
and screening each first screened image based on the shape of the standard image to obtain an abnormal image, wherein the shape of the abnormal image is not matched with the shape of the standard image and the area of the abnormal image is larger than that of the standard image.
Preferably, the marking the abnormal image, continuously acquiring the filter rod side transportation image, and tracking the abnormal image includes:
marking the abnormal images, constructing a coordinate system based on the filter rod side transportation images, and collecting the filter rod side transportation images once at intervals of preset waiting time;
calculating an estimated transmission speed of the abnormal image based on the coordinate position of the marked abnormal image in the filter rod side transport images of adjacent intervals;
and generating a predicted travelling route of the abnormal image based on the estimated transmission speed and the current coordinate position of the abnormal image.
Preferably, after the generating the predicted travel route of the abnormal image based on the estimated transmission speed and the current coordinate position of the abnormal image, the method further includes:
when judging that the filter rod side transportation image is collected next time based on the predicted travelling route, calculating predicted exceeding coordinate information of the abnormal image if the coordinate position of the abnormal image exceeds the filter rod side transportation image;
and sending the predicted beyond coordinate information to an adjacent camera of the abnormal image advancing direction.
Preferably, the method further comprises:
when the side surface transport image of the filter rod is collected next time and the abnormal image is not detected at the estimated coordinate position of the abnormal image, whether the marked abnormal image exists or not is searched within a preset radius range by taking the estimated coordinate position as a center;
optimizing the projected route of travel based on a current coordinate location of the anomaly image when the anomaly image is present;
stopping tracking the abnormal image when the abnormal image does not exist.
Preferably, the method further comprises:
calculating the similarity proportion of each normal image matched with the standard image and the standard image;
and marking the normal image with the similar proportion lower than the preset proportion as an abnormal image.
In a second aspect, an embodiment of the present application provides an automatic detection and early warning device for a filter rod, the device including:
the acquisition module is used for acquiring a filter rod side transportation image and extracting characteristic points from the filter rod side transportation image;
the comparison module is used for generating characteristic images based on the characteristic points, comparing the characteristic images with a preset standard image, screening abnormal images from the characteristic images according to the shape and the color of the characteristic images and determining the abnormal images as transverse filter rods;
the marking module is used for marking the abnormal images, continuously collecting the side transportation images of the filter rod and tracking the abnormal images;
and the sending module is used for generating warning information based on the abnormal image and sending the warning information to a preset terminal.
In a third aspect, an embodiment of the present application provides an electronic device, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor executes the computer program to implement the steps of the method as provided in the first aspect or any one of the possible implementation manners of the first aspect.
In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method as provided in the first aspect or any one of the possible implementations of the first aspect.
The invention has the beneficial effects that: the filter rod identification device has the advantages that heterogeneous filter rods can be identified in real time and warned to workers in the process of conveying the filter rods to the transmitter in batches, the workers are assisted to accurately and timely find the abnormal filter rods, the workers do not need to concentrate on the conveyor belt for a long time, and manpower and material resources are saved. And this application can also detect out the filter rod that quality defects such as filter rod collapse or necking are difficult for being detected by the manual work in the filter rod of normal transport, prevents that the filter rod of defect from being launched to the rolling machine platform and leading to unqualified cigarette to appear.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a schematic flow chart of an automatic detection and early warning method for a filter rod according to an embodiment of the present disclosure;
fig. 2 is a schematic structural diagram of an automatic detection and early warning device for a filter rod according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
In the following description, the terms "first" and "second" are used for descriptive purposes only and are not intended to indicate or imply relative importance. The following description provides embodiments of the present application, where different embodiments may be substituted or combined, and thus the present application is intended to include all possible combinations of the same and/or different embodiments described. Thus, if one embodiment includes feature A, B, C and another embodiment includes feature B, D, then this application should also be considered to include an embodiment that includes one or more of all other possible combinations of A, B, C, D, even though this embodiment may not be explicitly recited in text below.
The following description provides examples, and does not limit the scope, applicability, or examples set forth in the claims. Changes may be made in the function and arrangement of elements described without departing from the scope of the disclosure. Various examples may omit, substitute, or add various procedures or components as appropriate. For example, the described methods may be performed in an order different than the order described, and various steps may be added, omitted, or combined. Furthermore, features described with respect to some examples may be combined into other examples.
Referring to fig. 1, fig. 1 is a schematic flow chart of an automatic detection and early warning method for a filter rod according to an embodiment of the present application. In an embodiment of the present application, the method includes:
s101, collecting a filter rod side transportation image, and extracting feature points from the filter rod side transportation image.
The execution main body of the application can be a camera.
The filter rod side transportation image can be understood as image data acquired by a camera at the side of a conveying device for conveying the filter rod in the embodiment of the application.
In the embodiment of the present application, it should be noted that the axial direction of the filter rod should be perpendicular to the traveling direction of the conveying device and transverse to the conveying device under normal conditions, and the camera performs image acquisition and processing on the side surface of the conveying device, that is, in the image acquired by the camera under normal conditions, the normal filter rod should only be visible from the end side surface, that is, under normal conditions, the acquired image should be a honeycomb-shaped distribution image as if the chalk box is viewed from above, and the abnormal filter rod should be displayed as a cross bar in the image. In order to detect abnormal transverse filter rods, side transportation images of the filter rods are collected, and each characteristic point is extracted from the side transportation images, so that each object in the images is identified.
S102, generating characteristic images based on the characteristic points, comparing the characteristic images with a preset standard image, screening abnormal images from the characteristic images according to the shape and the color of the characteristic images, and determining the abnormal images as transverse filter rods.
In the embodiment of the application, according to the extracted feature points, adjacent similar feature points can be combined to generate a feature image. Because only the side face of the end part of the filter rod can be shot under the normal condition, namely the images detected by each filter rod under the normal condition are similar, a standard image is preset as a judgment basis, each generated characteristic image is compared with the standard image, the abnormal image can be screened out based on the two characteristics of the shape and the color of the characteristic image, and the abnormal image is determined as the transverse filter rod.
In an implementation manner, the comparing each of the feature images with a preset standard image, and screening abnormal images from each of the feature images according to the shape and color of each of the feature images includes:
comparing each characteristic image with a preset standard image, and screening from each characteristic image to obtain a first screened image, wherein the difference between the pixel color value of the first screened image and the pixel color value of the standard image is smaller than a first preset difference value;
and screening each first screened image based on the shape of the standard image to obtain an abnormal image, wherein the shape of the abnormal image is not matched with the shape of the standard image and the area of the abnormal image is larger than that of the standard image.
In this embodiment, when each feature image is compared with the standard image, the pixel color value of each feature image is first subjected to difference calculation on the pixel color value of the standard image, the color value of the pixel point is changed between 0 and 255, the color approaches to black as the color approaches 0, and the color approaches to white as the color approaches 255. The filter rods are normally white, but because of the large number of filter rods being fed at the same time, the filter rods will be closely attached together, inevitably there will be gaps between the filter rods, which will be black due to shadows created in the image. In order to avoid the following steps of recognizing the black gap as an abnormal image, the color values of the pixel points are screened first, and the characteristic image with the color difference smaller than a first preset difference, namely the color approaching white, is used as a first screened image. At this time, the first screened images should be the images corresponding to the filter rods, and at this time, the shapes of the first screened images are matched with the shapes of the standard images, the shapes of the images corresponding to the normal filter rods should be approximate to a circle, and the abnormal transverse filter rods should be rectangular, so that the first screened images with the shapes not matched and the image areas larger than the standard image areas are determined to be abnormal images.
S103, marking the abnormal image, continuously collecting the side surface transportation image of the filter rod, and tracking the abnormal image.
In the embodiment of the application, since the conveying device is still in operation when the image detection is performed, that is, the position of the transverse filter rod is changed in real time, it is necessary to mark the abnormal image and continuously acquire the side transportation image of the filter rod to track the abnormal image.
In one possible embodiment, step S103 includes:
marking the abnormal images, constructing a coordinate system based on the filter rod side transportation images, and collecting the filter rod side transportation images once at intervals of preset waiting time;
calculating an estimated transmission speed of the abnormal image based on the coordinate position of the marked abnormal image in the filter rod side transport images of adjacent intervals;
and generating a predicted travelling route of the abnormal image based on the estimated transmission speed and the current coordinate position of the abnormal image.
In the embodiment of the application, after the abnormal image is marked, in order to more easily represent the position and the state of the abnormal image, a coordinate system is constructed based on the filter rod side transport image, and the filter rod side transport image is collected again at preset waiting time intervals. Through the continuously collected filter rod side transportation images, the estimated transmission speed of the abnormal image, namely the transverse filter rod can be calculated according to the coordinate position of the marked abnormal image in each image. Based on the estimated transmission speed and the current coordinate position of the abnormal image, the estimated traveling route of the abnormal image can be generated, and subsequent detection, identification and auxiliary judgment are facilitated.
In one possible embodiment, after the generating the predicted travel route of the abnormal image based on the estimated transmission speed and the current coordinate position of the abnormal image, the method further includes:
when judging that the filter rod side transportation image is collected next time based on the predicted travelling route, calculating predicted exceeding coordinate information of the abnormal image if the coordinate position of the abnormal image exceeds the filter rod side transportation image;
and sending the predicted beyond coordinate information to an adjacent camera of the abnormal image advancing direction.
In the embodiment of the present application, it should be noted that the length of the entire conveying device of the filter rod may be long, and images of the entire route are acquired by only one camera, on one hand, the image acquisition may not be complete, and on the other hand, the processing load of steps such as feature extraction may be increased due to excessive image data. A plurality of cameras will be arranged in succession for a longer conveyor section. And because the filter rod always moves along the advancing direction of the conveying device, abnormal filter rod images possibly move out of the boundary of the filter rod side transportation images which can be shot by the camera, when the coordinate position of the abnormal image of the next collected image is judged to exceed the range of the image shot by the camera based on the expected advancing route calculation, the expected exceeding coordinate information of the abnormal image is firstly calculated, namely the amount of the coordinate of the abnormal image which is expected to exceed the image when the image is collected next time is calculated, and the exceeding coordinate information is sent to the adjacent camera in the advancing direction to assist the adjacent camera in identifying and detecting the abnormal image.
And S104, generating warning information based on the abnormal image, and sending the warning information to a preset terminal.
In the embodiment of the application, after the abnormal image is determined to exist, the warning information is generated, and is sent to the mobile phone terminal corresponding to the preset staff, so that the staff is reminded to process the filter rod in the future.
In one embodiment, the method further comprises:
when the side surface transport image of the filter rod is collected next time and the abnormal image is not detected at the estimated coordinate position of the abnormal image, whether the marked abnormal image exists or not is searched within a preset radius range by taking the estimated coordinate position as a center;
optimizing the projected route of travel based on a current coordinate location of the anomaly image when the anomaly image is present;
stopping tracking the abnormal image when the abnormal image does not exist.
In the embodiment of the application, the staff can go to the filter rod which is processed abnormally to prevent blockage after receiving the warning information, so that the abnormal filter rod is taken away possibly, and the abnormal image cannot be detected when the image is collected next time. Therefore, when the abnormal image is not detected at the estimated coordinate position determined based on the estimated traveling route, the marked abnormal image is searched within the preset radius range by taking the estimated coordinate position as the center. If the predicted travel route can be found, it is indicated that an error exists in the previously generated predicted travel route, and the predicted travel route is optimized based on the current coordinate position of the abnormal image. If the abnormal image cannot be found, the abnormal filter rod is taken away by the worker, and the tracking of the abnormal image is stopped.
In one embodiment, the method further comprises:
calculating the similarity proportion of each normal image matched with the standard image and the standard image;
and marking the normal image with the similar proportion lower than the preset proportion as an abnormal image.
The normal image can be understood as an image judged to be normal when the characteristic image is compared with the standard image and screened in the embodiment of the application.
In the embodiment of the application, the filter rod may have quality defects due to phenomena of hot collapse, shrinkage and the like of the filter rod during actual production, and the cigarette finally produced by the filter rod is an unqualified cigarette. Although the filter rod with the defects is still round in the image, the filter rod can be sunken inside the filter rod, so that the similarity of the filter rod and the standard image is not particularly high, and therefore, the normal image with the similarity lower than the preset proportion can be determined as the abnormal image through calculation of the similarity proportion, and the abnormal image can be taken away by workers, so that the yield of the production line is improved.
The automatic detection and early warning device for the filter rod according to the embodiment of the present application will be described in detail with reference to fig. 2. It should be noted that the automatic detection and early warning device for a filter rod shown in fig. 2 is used for executing the method of the embodiment shown in fig. 1 of the present application, and for convenience of description, only the portion related to the embodiment of the present application is shown, and details of the technology are not disclosed, please refer to the embodiment shown in fig. 1 of the present application.
Referring to fig. 2, fig. 2 is a schematic structural diagram of an automatic detection and warning device for a filter rod according to an embodiment of the present disclosure. As shown in fig. 2, the apparatus includes:
the acquisition module 201 is used for acquiring a filter rod side transportation image and extracting feature points from the filter rod side transportation image;
a comparison module 202, configured to generate feature images based on the feature points, compare the feature images with a preset standard image, screen an abnormal image from the feature images according to the shape and color of the feature images, and determine that the abnormal image is a transverse filter rod;
the marking module 203 is used for marking the abnormal images, continuously acquiring the side transportation images of the filter rod and tracking the abnormal images;
and the sending module 204 is configured to generate warning information based on the abnormal image, and send the warning information to a preset terminal.
In one embodiment, the alignment module 202 comprises:
the comparison unit is used for comparing each characteristic image with a preset standard image and screening each characteristic image to obtain a first screened image, wherein the difference between the pixel color value of the first screened image and the pixel color value of the standard image is smaller than a first preset difference value;
and the abnormal image screening unit is used for screening each first screened image based on the shape of the standard image to obtain an abnormal image, wherein the shape of the abnormal image is not matched with the shape of the standard image and the area of the abnormal image is larger than that of the standard image.
In one possible embodiment, the tagging module 203 comprises:
the coordinate system construction unit is used for marking the abnormal images and constructing a coordinate system based on the filter rod side transportation images, and the filter rod side transportation images are collected once every preset waiting time;
an estimated transmission speed calculation unit for calculating an estimated transmission speed of the abnormal image based on the coordinate position of the abnormal image marked in the filter rod side transport image of the adjacent interval;
and the predicted travelling route generating unit is used for generating a predicted travelling route of the abnormal image based on the predicted transmission speed and the current coordinate position of the abnormal image.
In one possible embodiment, the tagging module 203 comprises:
an expected excess coordinate information calculation unit configured to calculate expected excess coordinate information of the abnormal image when it is judged that the coordinate position of the abnormal image will exceed the filter rod side transport image when it is next collected based on the expected travel route;
a coordinate information transmitting unit configured to transmit the predicted excess coordinate information to an adjacent camera of the abnormal image traveling direction.
In one embodiment, the apparatus further comprises:
the searching module is used for searching whether the marked abnormal image exists in a preset radius range by taking the estimated coordinate position as a center when the abnormal image is not detected at the estimated coordinate position of the abnormal image when the side surface transportation image of the filter rod is acquired next time;
an optimization module for optimizing the projected travel route based on a current coordinate location of the abnormal image when the abnormal image exists;
and the stopping module is used for stopping tracking the abnormal image when the abnormal image does not exist.
In one embodiment, the apparatus further comprises:
the matching module is used for calculating the similarity proportion of each normal image matched with the standard image and the standard image;
and the processing module is used for marking the normal image with the similar proportion lower than the preset proportion as an abnormal image.
It is clear to a person skilled in the art that the solution according to the embodiments of the present application can be implemented by means of software and/or hardware. The "unit" and "module" in this specification refer to software and/or hardware that can perform a specific function independently or in cooperation with other components, where the hardware may be, for example, a Field-Programmable Gate Array (FPGA), an Integrated Circuit (IC), or the like.
Each processing unit and/or module in the embodiments of the present application may be implemented by an analog circuit that implements the functions described in the embodiments of the present application, or may be implemented by software that executes the functions described in the embodiments of the present application.
Referring to fig. 3, a schematic structural diagram of an electronic device according to an embodiment of the present application is shown, where the electronic device may be used to implement the method in the embodiment shown in fig. 1. As shown in fig. 3, the electronic device 300 may include: at least one central processor 301, at least one network interface 304, a user interface 303, a memory 305, at least one communication bus 302.
Wherein a communication bus 302 is used to enable the connection communication between these components.
The user interface 303 may include a Display screen (Display) and a Camera (Camera), and the optional user interface 303 may further include a standard wired interface and a wireless interface.
The network interface 304 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface), among others.
The central processor 301 may include one or more processing cores. The central processor 301 connects various parts within the entire electronic device 300 using various interfaces and lines, and performs various functions of the terminal 300 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 305 and calling data stored in the memory 305. Alternatively, the central Processing unit 301 may be implemented in at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The CPU 301 may integrate one or a combination of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content required to be displayed by the display screen; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the cpu 301, but may be implemented by a single chip.
The Memory 305 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory 305 includes a non-transitory computer-readable medium. The memory 305 may be used to store instructions, programs, code sets, or instruction sets. The memory 305 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described above, and the like; the storage data area may store data and the like referred to in the above respective method embodiments. The memory 305 may alternatively be at least one storage device located remotely from the central processor 301. As shown in fig. 3, memory 305, which is a type of computer storage medium, may include an operating system, a network communication module, a user interface module, and program instructions.
In the electronic device 300 shown in fig. 3, the user interface 303 is mainly used for providing an input interface for a user to obtain data input by the user; the central processing unit 301 may be configured to call the automatic filter rod detection and warning application program stored in the memory 305, and specifically perform the following operations:
collecting a filter rod side transportation image, and extracting characteristic points from the filter rod side transportation image;
generating characteristic images based on the characteristic points, comparing the characteristic images with a preset standard image, screening abnormal images from the characteristic images according to the shape and the color of the characteristic images, and determining the abnormal images as a transverse filter rod;
marking the abnormal image, continuously acquiring the side transportation image of the filter rod, and tracking the abnormal image;
and generating warning information based on the abnormal image, and sending the warning information to a preset terminal.
The present application also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the above-described method. The computer-readable storage medium may include, but is not limited to, any type of disk including floppy disks, optical disks, DVD, CD-ROMs, microdrive, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, DRAMs, VRAMs, flash memory devices, magnetic or optical cards, nanosystems (including molecular memory ICs), or any type of media or device suitable for storing instructions and/or data.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some service interfaces, devices or units, and may be an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method described in the embodiments of the present application. And the aforementioned memory comprises: various media capable of storing program codes, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by a program, which is stored in a computer-readable memory, and the memory may include: flash disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The above description is only an exemplary embodiment of the present disclosure, and the scope of the present disclosure should not be limited thereby. That is, all equivalent changes and modifications made in accordance with the teachings of the present disclosure are intended to be included within the scope of the present disclosure. Embodiments of the present disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the disclosure herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
Claims (9)
1. An automatic detection and early warning method for a transverse filter rod is characterized by comprising the following steps:
collecting a filter rod side transportation image, and extracting characteristic points from the filter rod side transportation image;
generating characteristic images based on the characteristic points, comparing the characteristic images with a preset standard image, screening abnormal images from the characteristic images according to the shape and the color of the characteristic images, and determining the abnormal images as a transverse filter rod;
marking the abnormal image, continuously acquiring the side transportation image of the filter rod, and tracking the abnormal image;
and generating warning information based on the abnormal image, and sending the warning information to a preset terminal.
2. The method according to claim 1, wherein the comparing each of the feature images with a preset standard image and the screening abnormal images from each of the feature images according to the shape and color of each of the feature images comprises:
comparing each characteristic image with a preset standard image, and screening from each characteristic image to obtain a first screened image, wherein the difference between the pixel color value of the first screened image and the pixel color value of the standard image is smaller than a first preset difference value;
and screening each first screened image based on the shape of the standard image to obtain an abnormal image, wherein the shape of the abnormal image is not matched with the shape of the standard image and the area of the abnormal image is larger than that of the standard image.
3. The method of claim 1, wherein said marking said anomaly images, continuously acquiring said filter rod side transport images, and tracking said anomaly images comprises:
marking the abnormal images, constructing a coordinate system based on the filter rod side transportation images, and collecting the filter rod side transportation images once at intervals of preset waiting time;
calculating an estimated transmission speed of the abnormal image based on the coordinate position of the marked abnormal image in the filter rod side transport images of adjacent intervals;
and generating a predicted travelling route of the abnormal image based on the estimated transmission speed and the current coordinate position of the abnormal image.
4. The method of claim 3, wherein after generating the projected line of travel of the anomaly image based on the estimated transmission speed and the current coordinate position of the anomaly image, further comprising:
when judging that the filter rod side transportation image is collected next time based on the predicted travelling route, calculating predicted exceeding coordinate information of the abnormal image if the coordinate position of the abnormal image exceeds the filter rod side transportation image;
and sending the predicted beyond coordinate information to an adjacent camera of the abnormal image advancing direction.
5. The method of claim 3, further comprising:
when the side surface transport image of the filter rod is collected next time and the abnormal image is not detected at the estimated coordinate position of the abnormal image, whether the marked abnormal image exists or not is searched within a preset radius range by taking the estimated coordinate position as a center;
optimizing the projected route of travel based on a current coordinate location of the anomaly image when the anomaly image is present;
stopping tracking the abnormal image when the abnormal image does not exist.
6. The method of claim 1, further comprising:
calculating the similarity proportion of each normal image matched with the standard image and the standard image;
and marking the normal image with the similar proportion lower than the preset proportion as an abnormal image.
7. An automatic detection and early warning device for a transverse filter rod, which is characterized by comprising:
the acquisition module is used for acquiring a filter rod side transportation image and extracting characteristic points from the filter rod side transportation image;
the comparison module is used for generating characteristic images based on the characteristic points, comparing the characteristic images with a preset standard image, screening abnormal images from the characteristic images according to the shape and the color of the characteristic images and determining the abnormal images as transverse filter rods;
the marking module is used for marking the abnormal images, continuously collecting the side transportation images of the filter rod and tracking the abnormal images;
and the sending module is used for generating warning information based on the abnormal image and sending the warning information to a preset terminal.
8. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method according to any of claims 1-6 are implemented when the computer program is executed by the processor.
9. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110916406.4A CN113610816A (en) | 2021-08-11 | 2021-08-11 | Automatic detection and early warning method and device for transverse filter tip rod and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110916406.4A CN113610816A (en) | 2021-08-11 | 2021-08-11 | Automatic detection and early warning method and device for transverse filter tip rod and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113610816A true CN113610816A (en) | 2021-11-05 |
Family
ID=78308061
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110916406.4A Pending CN113610816A (en) | 2021-08-11 | 2021-08-11 | Automatic detection and early warning method and device for transverse filter tip rod and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113610816A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003083718A (en) * | 2001-09-14 | 2003-03-19 | Mitsubishi Electric Engineering Co Ltd | Visual inspection system for high-speed moving body |
| US20050216124A1 (en) * | 2004-02-26 | 2005-09-29 | Kabushiki Kaisha Toshiba | Mobile robot for monitoring a subject |
| CN102970517A (en) * | 2012-11-28 | 2013-03-13 | 四川长虹电器股份有限公司 | Holder lens autonomous control method based on abnormal condition identification |
| KR20150022249A (en) * | 2013-08-22 | 2015-03-04 | 김용민 | Appartus and method for detecting defect |
| CN104807829A (en) * | 2015-04-17 | 2015-07-29 | 武汉易视维科技有限公司 | Visual detection system and method for filter |
| CN110309735A (en) * | 2019-06-14 | 2019-10-08 | 平安科技（深圳）有限公司 | Exception detecting method, device, server and storage medium |
| CN111263114A (en) * | 2020-02-14 | 2020-06-09 | 北京百度网讯科技有限公司 | Abnormal event alarm method and device |
| CN112700475A (en) * | 2020-12-31 | 2021-04-23 | 荆门汇易佳信息科技有限公司 | Self-adaptive multi-target video tracking system under different scenes |
| CN112756265A (en) * | 2019-10-21 | 2021-05-07 | 顺丰科技有限公司 | Article sorting abnormity detection method, device industrial control equipment and storage medium |
-
2021
- 2021-08-11 CN CN202110916406.4A patent/CN113610816A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003083718A (en) * | 2001-09-14 | 2003-03-19 | Mitsubishi Electric Engineering Co Ltd | Visual inspection system for high-speed moving body |
| US20050216124A1 (en) * | 2004-02-26 | 2005-09-29 | Kabushiki Kaisha Toshiba | Mobile robot for monitoring a subject |
| CN102970517A (en) * | 2012-11-28 | 2013-03-13 | 四川长虹电器股份有限公司 | Holder lens autonomous control method based on abnormal condition identification |
| KR20150022249A (en) * | 2013-08-22 | 2015-03-04 | 김용민 | Appartus and method for detecting defect |
| CN104807829A (en) * | 2015-04-17 | 2015-07-29 | 武汉易视维科技有限公司 | Visual detection system and method for filter |
| CN110309735A (en) * | 2019-06-14 | 2019-10-08 | 平安科技（深圳）有限公司 | Exception detecting method, device, server and storage medium |
| CN112756265A (en) * | 2019-10-21 | 2021-05-07 | 顺丰科技有限公司 | Article sorting abnormity detection method, device industrial control equipment and storage medium |
| CN111263114A (en) * | 2020-02-14 | 2020-06-09 | 北京百度网讯科技有限公司 | Abnormal event alarm method and device |
| CN112700475A (en) * | 2020-12-31 | 2021-04-23 | 荆门汇易佳信息科技有限公司 | Self-adaptive multi-target video tracking system under different scenes |
Non-Patent Citations (1)
| Title |
|---|
| 廖宇 等: "横滤嘴棒自动剔除和图像识别预警方法", 包装工程, vol. 43, no. 11, pages 212 - 218 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9846823B2 (en) | Traffic lane boundary line extraction apparatus and method of extracting traffic lane boundary line | |
| US20180300874A1 (en) | Crack information editing device, method of editing crack information, and crack information editing program | |
| CN110221145B (en) | Power equipment fault diagnosis method and device and terminal equipment | |
| CN109547748B (en) | Object foot point determining method and device and storage medium | |
| CN113688965B (en) | Automatic storage code scanning detection method and cargo management system | |
| CN113343905B (en) | Method and system for training road abnormity intelligent recognition model and recognizing road abnormity | |
| CN114926415A (en) | Steel rail surface detection method based on PCNN and deep learning | |
| CN113610816A (en) | Automatic detection and early warning method and device for transverse filter tip rod and electronic equipment | |
| CN113065623A (en) | Prefabricated part storage yard management method and device, computer equipment and storage medium thereof | |
| CN113192016A (en) | Method, device and equipment for detecting abnormal deformation of conveyor belt and storage medium | |
| CN112102298A (en) | Image recognition method and device, electronic equipment and storage medium | |
| CN116002480A (en) | Automatic detection method and system for accidental falling of passengers in elevator car | |
| CN115576315A (en) | Abnormity inspection method and device of inspection unit and electronic equipment | |
| CN115880563A (en) | Vehicle body damage detection method, device, electronic device and readable storage medium | |
| CN114120658B (en) | Intelligent inspection robot system for highway and inspection method | |
| CN115438945A (en) | Risk identification method, device, equipment and medium based on power equipment inspection | |
| CN115409839A (en) | Road sound barrier hidden danger identification method and device based on pixel analysis model | |
| CN114494680A (en) | Accumulated water detection method, device, equipment and storage medium | |
| CN115170608A (en) | Material tracking method and device | |
| JP6115584B2 (en) | Program and management device | |
| CN112374081A (en) | Large-scale conveyer belt surface crack detection method and system | |
| CN111179458A (en) | Method and device for routing inspection of rail transit equipment | |
| CN110991286A (en) | Automatic electric shovel bucket defect identification device and method based on convolutional neural network | |
| CN116660273B (en) | Chain piece missing detection method in chain and electronic equipment | |
| CN113536234B (en) | Mining area transportation frequency detection method and device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |