CN111062305B - Method and device for monitoring smoldering during cotton loading, unloading and transporting - Google Patents
Method and device for monitoring smoldering during cotton loading, unloading and transporting Download PDFInfo
- Publication number
- CN111062305B CN111062305B CN201911275098.0A CN201911275098A CN111062305B CN 111062305 B CN111062305 B CN 111062305B CN 201911275098 A CN201911275098 A CN 201911275098A CN 111062305 B CN111062305 B CN 111062305B
- Authority
- CN
- China
- Prior art keywords
- cotton
- smoldering
- bale
- temperature
- cotton bale
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N25/00—Investigating or analyzing materials by the use of thermal means
- G01N25/20—Investigating or analyzing materials by the use of thermal means by investigating the development of heat, i.e. calorimetry, e.g. by measuring specific heat, by measuring thermal conductivity
- G01N25/22—Investigating or analyzing materials by the use of thermal means by investigating the development of heat, i.e. calorimetry, e.g. by measuring specific heat, by measuring thermal conductivity on combustion or catalytic oxidation, e.g. of components of gas mixtures
- G01N25/28—Investigating or analyzing materials by the use of thermal means by investigating the development of heat, i.e. calorimetry, e.g. by measuring specific heat, by measuring thermal conductivity on combustion or catalytic oxidation, e.g. of components of gas mixtures the rise in temperature of the gases resulting from combustion being measured directly
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/25—Fusion techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/94—Hardware or software architectures specially adapted for image or video understanding
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Data Mining & Analysis (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Pathology (AREA)
- Immunology (AREA)
- Evolutionary Computation (AREA)
- Combustion & Propulsion (AREA)
- Software Systems (AREA)
- Multimedia (AREA)
- General Engineering & Computer Science (AREA)
- Artificial Intelligence (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Chemical Kinetics & Catalysis (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Preliminary Treatment Of Fibers (AREA)
Abstract
The disclosure provides a cotton loading and unloading transportation smoldering monitoring method and device. The method comprises the following steps: capturing a color image of the bale during handling and transportation of the bale; obtaining a pre-processing image; obtaining an RGB channel image and an HSV component image to identify a first cotton smoldering candidate region in a cotton bale through BP neural network processing; scanning measurement is carried out on the cotton bale through a temperature sensing array, so that a temperature distribution result of the surface layer of the cotton bale is obtained, and the temperature distribution result of the surface layer of the cotton bale comprises the distribution condition of cotton temperature points in a preset depth range of the surface layer of the cotton bale; determining a second cotton smoldering candidate area in the cotton bale based on the temperature distribution result of the surface layer of the cotton bale; determining a smoldering area in the cotton bale, and obtaining the smoldering depth of each point in the smoldering area; and judging whether the cotton bale is smoldered or not according to the smoldering area in the cotton bale and the smoldering depth of each point in the smoldering area. The technique of this disclosure can judge whether the cotton takes place smoldering to accurately find the smoldering region fast.
Description
Technical Field
The invention relates to the technical field of optical measurement, in particular to a cotton loading and unloading transportation smoldering monitoring method and device.
Background
Cotton is one of the leading crops in the world and can be made into fabrics of various specifications. The annual output of cotton in China is about 500 million tons, the value is about 750 hundred million yuan, the cotton is the second crop next to grains, and more than 2 hundred million farmers directly participate in cotton production in China. China mainly concentrates cotton producing areas in Xinjiang, and cotton processing and spinning mainly concentrates in southern and eastern coastal areas, so that a large amount of cotton needs to be transported from Xinjiang to southern and eastern coastal areas through railway transportation. In the middle of the cotton storage and transportation process, because the cotton is bad conductor, the heat accumulation heat insulating ability is strong, along with the rising of temperature, the heat can't in time distribute, when the inside temperature of cotton rises and reaches the spontaneous combustion point, just can cause the big fire, causes the loss.
The storage smoldering monitoring of present cotton bale still mainly relies on the staff regularly to patrol and examine regularly, and this kind of method time is long, receives the staff moreover and thinks the factor influence often, can not realize the timely effective monitoring of cotton bale smoldering, has brought the potential safety hazard for cotton bale storage and transportation. Scientific researchers utilize the smoldering released gas of cotton, temperature change and the like to provide a corresponding detection method and a corresponding detection device, so that the interference of human factors can be effectively eliminated, and the monitoring efficiency and reliability are improved. The technical scheme in this aspect comprises: the Chinese patent application 'operating method of a handheld carbon dioxide detector' (publication number CN 105137006A) proposes a method for detecting the concentration of carbon monoxide gas contained in a cotton stack to realize the detection of a cotton stack smoldering cotton bale. The invention discloses a cotton picker and a real-time cotton ignition early warning method and system thereof (CN 104464168A), and provides a real-time cotton ignition early warning method of the cotton picker by comparing the concentration of cotton smoldering gas.
However, in the process of loading, unloading and transporting cotton, the existing detection device and method are often interfered by the environment, so that the fast monitoring of cotton bale smoldering is affected, and the main problems are as follows:
the gas composition detected is complex. The gas components released by cotton smoldering are complex, so that gas sensor poisoning is easily caused, and the detection accuracy is influenced; and often a certain amount of gas is released when the cotton enters a burning state, so the monitoring method and device have certain hysteresis. Meanwhile, the environment is severe and the personnel are complex in the cotton loading and unloading process, so that the smoldering point is easily mixed in the cotton.
And detecting the speed and precision requirements. Due to the fact that cotton loading, unloading and transportation are large, technical staff hold a detection instrument for detection and the detection efficiency is low, the speed of a monitoring method is high, and the requirements of high speed and high precision of cotton loading and unloading on line cannot be met simultaneously by a common detection and identification method.
Disclosure of Invention
The following presents a simplified summary of the invention in order to provide a basic understanding of some aspects of the invention. It should be understood that this summary is not an exhaustive overview of the invention. It is not intended to determine the key or critical elements of the present invention, nor is it intended to limit the scope of the present invention. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is discussed later.
In view of the above problems, the present invention provides a method and a device for monitoring smoldering during cotton loading, unloading and transporting.
According to one aspect of the invention, the cotton handling transportation smoldering monitoring method is characterized by comprising the following steps: capturing a color image of a bale during handling and transportation of the bale; preprocessing the color image to obtain a preprocessed image; carrying out RGB channel and HSV component processing on the preprocessed image to obtain an RGB channel image and an HSV component image so as to identify a first cotton smoldering candidate region in the cotton bale by carrying out BP neural network processing on the RGB channel image and the HSV component image; scanning measurement is carried out on the cotton bale through a temperature sensing array, and a temperature distribution result of the surface layer of the cotton bale is obtained, wherein the temperature distribution result of the surface layer of the cotton bale comprises the distribution condition of cotton temperature points in a preset depth range of the surface layer of the cotton bale; determining a second cotton smoldering candidate area in the cotton bale based on the temperature distribution result of the surface layer of the cotton bale; determining a smoldering region in the cotton bale based on a first cotton smoldering candidate region and a second cotton smoldering candidate region in the cotton bale, and obtaining smoldering depths of points in the smoldering region according to a temperature distribution result of a surface layer of the cotton bale; and judging whether the cotton bale is smoldered or not according to the smoldering area in the cotton bale and the smoldering depth of each point in the smoldering area.
Further, the step of identifying a first cotton smoldering candidate region in the bale by performing BP neural network processing on the RGB channel image and HSV component image comprises: determining a first smoldering candidate subregion in the RGB channel image based on a carbon blackening feature in the RGB channel image; determining a second smoldering candidate subregion in the RGB channel image based on a luma darkening feature in the HSV component image; and taking the result obtained by carrying out OR operation on the first smoldering candidate subarea and the second smoldering candidate subarea as a first cotton smoldering candidate area in the cotton bale.
Further, the step of determining a second cotton smoldering candidate region in the bale comprises: acquiring cotton surface measurement temperature points which are greater than or equal to a preset temperature threshold value in the cotton bale surface layer based on the temperature distribution result of the cotton bale surface layer; and fitting the cotton surface measurement temperature points which are greater than or equal to a preset temperature threshold value in the cotton bale surface layer, and taking the region obtained after fitting as a second cotton smoldering candidate region in the cotton bale.
Further, the step of determining smoldering areas in the bale comprises: and taking the result obtained by carrying out OR operation on the first cotton smoldering candidate region and the second cotton smoldering candidate region as a smoldering region in the cotton bale.
According to another aspect of the invention, the invention also provides a cotton loading, unloading and transporting smoldering monitoring device which comprises a loading, unloading and transporting module, a camera module, a temperature measuring module and a central processing module; the loading and unloading transportation module comprises a conveying belt for loading and unloading transportation cotton bales; the camera shooting module comprises a camera support, a camera fixing frame is arranged on the camera support, a color camera is arranged on the camera fixing frame, the camera support is fixedly connected with the conveying belt, the collecting direction of the color camera arranged on the camera fixing frame faces the conveying belt, so that the color camera can capture the color image of the cotton bale during the loading, unloading and transporting of the cotton bale, and the camera shooting module is used for sending the color image of the cotton bale captured by the color camera to the central processing module; the temperature measurement module comprises a portal frame, a temperature sensing array is arranged on the portal frame, and the temperature sensing array is arranged on the portal frame according to the following mode: when the cotton bale is conveyed on the conveying belt and passes through the position right below the portal frame, the temperature sensing array can perform scanning type measurement on the cotton bale to obtain a temperature distribution result of the surface layer of the cotton bale; the temperature distribution result of the surface layer of the cotton bale comprises the distribution condition of cotton temperature points in a preset depth range of the surface layer of the cotton bale; the temperature measurement module is used for sending the temperature distribution result captured by the temperature measurement array to the central processing module.
Further, the camera support is installed on the conveyor belt and in front of the portal frame, so that the cotton bale sequentially passes through the camera module and the temperature measuring module when being conveyed on the conveyor belt, the distance between the camera module and the temperature measuring module is within the range of 20cm-100cm, and preferably, the distance between the camera module and the temperature measuring module is 50cm.
Furthermore, the temperature sensing array is formed by closely arranging temperature measurement optical fiber probes.
Further, the temperature sensing array is perpendicular to the plane of the conveyor belt, and is in a range of 50cm-120cm, preferably 85cm, away from the plane of the conveyor belt.
Further, the color camera is perpendicular to the plane of the conveyor belt and is at a distance of 80-150cm, preferably 100cm, from the plane of the conveyor belt.
Further, the central processing module comprises a preprocessing submodule, a first cotton smoldering candidate region determining submodule, a second cotton smoldering candidate region determining submodule, a smoldering region determining submodule and a smoldering judging submodule; the preprocessing submodule is used for preprocessing the color image to obtain a preprocessed image; the first cotton smoldering candidate region determining submodule is used for carrying out RGB channel and HSV component processing on the preprocessed image to obtain an RGB channel image and an HSV component image so as to identify a first cotton smoldering candidate region in the cotton bale by carrying out BP neural network processing on the RGB channel image and the HSV component image; the second cotton smoldering candidate region determining submodule is used for determining a second cotton smoldering candidate region in the cotton bale based on the temperature distribution result of the surface layer of the cotton bale; the smoldering region determining submodule is used for determining a smoldering region in the cotton bale based on a first cotton smoldering candidate region and a second cotton smoldering candidate region in the cotton bale, and obtaining the smoldering depth of each point in the smoldering region according to the temperature distribution result of the surface layer of the cotton bale; and the smoldering judging submodule is used for judging whether the cotton bale smolders according to the smoldering area in the cotton bale and the smoldering depth of each point in the smoldering area.
The invention takes a picture through the color camera, simply processes the picture, then carries out surface scanning measurement on the temperature distribution condition of the cotton bale through the temperature measurement array, carries out fusion processing on the picture and the temperature distribution condition of the cotton bale, can judge whether the cotton is smoldered, and accurately and quickly finds out the smoldering area. The invention is simple and applicable, has simple operation process, and can carry out measurement in the cotton transportation process, thereby shortening the measurement period and time and improving the measurement efficiency and the measurement accuracy.
Drawings
The invention may be better understood by referring to the following description in conjunction with the accompanying drawings, in which like reference numerals are used throughout the figures to indicate like or similar parts. The accompanying drawings, which are incorporated in and form a part of this specification, illustrate preferred embodiments of the present invention and, together with the detailed description, serve to further explain the principles and advantages of the invention. In the drawings:
FIG. 1 is a flow chart illustrating an exemplary process of a cotton handling transportation smoldering monitoring method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram showing a sub-flow in FIG. 1;
FIG. 3 is a schematic diagram showing the structure of a preferred embodiment of the present invention;
fig. 4 is an algorithmic flow diagram illustrating a preferred embodiment of the present invention.
Skilled artisans appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help improve the understanding of the embodiments of the present invention.
Detailed Description
Embodiments of the present invention are described below with reference to the drawings. It should be noted that the figures and description omit representation and description of components and processes that are not relevant to the present invention and that are known to those of ordinary skill in the art for the sake of clarity.
The embodiment of the invention provides a cotton loading, unloading and transporting smoldering monitoring method, which comprises the following steps: capturing a color image of the bale during handling and transportation of the bale; preprocessing the color image to obtain a preprocessed image; carrying out RGB channel and HSV component processing on the preprocessed image to obtain an RGB channel image and an HSV component image, and identifying a first cotton smoldering candidate area in the cotton bale by carrying out BP neural network processing on the RGB channel image and the HSV component image; scanning measurement is carried out on the cotton bale through a temperature sensing array, and a temperature distribution result of the surface layer of the cotton bale is obtained, wherein the temperature distribution result of the surface layer of the cotton bale comprises the distribution condition of cotton temperature points in a preset depth range of the surface layer of the cotton bale; determining a second cotton smoldering candidate area in the cotton bale based on the temperature distribution result of the surface layer of the cotton bale; determining a smoldering region in the cotton bale based on a first cotton smoldering candidate region and a second cotton smoldering candidate region in the cotton bale, and obtaining smoldering depths of all points in the smoldering region according to a temperature distribution result of a surface layer of the cotton bale; and judging whether the cotton bale is smoldered or not according to the smoldering area in the cotton bale and the smoldering depth of each point in the smoldering area.
FIG. 1 illustrates a flow chart of an exemplary process of the cotton handling smoldering monitoring method described above.
As shown in fig. 1, in step S110, a color image of the bale is captured during handling and transportation of the bale.
Next, in step S120, the color image is preprocessed to obtain a preprocessed image, wherein the preprocessing includes, for example, denoising, enhancement processing, and the like.
Then, in step S130, RGB channel and HSV component processing is performed on the preprocessed image to obtain an RGB channel image and an HSV component image, so as to identify a first cotton smoldering candidate region in the bale by performing BP neural network processing on the RGB channel image and the HSV component image.
In one example, the process of identifying the first cotton smoldering candidate region in the cotton bale by performing the BP neural network process on the RGB channel image and the HSV component image in step S130 may be implemented, for example, by the steps shown in fig. 2.
As shown in fig. 2, in step S210, a first smoldering candidate subregion in the RGB channel image may be determined based on a carbon blackening feature in the RGB channel image.
Then, in step S220, a second smoldering candidate subregion in the RGB channel image may be determined based on the lightness darkening feature in the HSV component image.
Thus, in step S230, the first smoldering candidate subregion and the second smoldering candidate subregion are subjected to an or operation to obtain a result, which is used as the first cotton smoldering candidate region in the bale.
Referring to fig. 1, after step S130 is performed, step S140 is then performed.
In step S140, the cotton bale may be scanned and measured by the temperature sensor array, so as to obtain a temperature distribution result of the surface layer of the cotton bale, where the temperature distribution result of the surface layer of the cotton bale includes a distribution condition of cotton temperature points within a predetermined depth range of the surface layer of the cotton bale. The predetermined depth range is, for example, a depth range of 1mm of the cotton surface.
Next, in step S150, a second cotton smoldering candidate region in the bale is determined based on the temperature distribution result of the surface layer of the bale.
For example, a second cotton smoldering candidate region in the bale may be determined as follows: acquiring cotton surface measurement temperature points which are greater than or equal to a preset temperature threshold value in the cotton bale surface layer based on the temperature distribution result of the cotton bale surface layer; and then, fitting the cotton surface measurement temperature points which are greater than or equal to the preset temperature threshold value in the cotton bale surface layer, and taking the region obtained after fitting as a second cotton smoldering candidate region in the cotton bale.
In step S160, a smoldering region in the bale is determined based on the first cotton smoldering candidate region and the second cotton smoldering candidate region in the bale, and the smoldering depth of each point in the smoldering region is obtained from the temperature distribution result of the surface layer of the bale.
As an example, the smoldering regions in the bale may be obtained by, for example, performing an or operation on the first cotton smoldering candidate region and the second cotton smoldering candidate region.
Finally, in step S170, it is determined whether or not the cotton bale is smoldering based on the smoldering areas in the cotton bale and the smoldering depths of the respective points in the smoldering areas.
The embodiment of the invention also provides a cotton handling transportation smoldering monitoring device which comprises a handling transportation module, a camera module, a temperature measuring module and a central processing module;
the loading and unloading transportation module comprises a conveying belt for loading and unloading transportation cotton bales;
the camera shooting module comprises a camera support 1, a camera fixing frame 2 is arranged on the camera support 1, a color camera 6 is arranged on the camera fixing frame 2, the camera support is fixedly connected with the conveying belt, the collecting direction of the color camera arranged on the camera fixing frame faces the conveying belt, so that the color camera can capture color images of cotton bales during loading, unloading and transporting of the cotton bales, and the camera shooting module is used for sending the color images of the cotton bales captured by the color camera to the central processing module;
the temperature measurement module includes portal frame 3, is equipped with temperature sensing array 4 on portal frame 3, and temperature sensing array 4 installs on portal frame 3 according to following mode: when the cotton bale is conveyed on the conveying belt and passes right below the portal frame 3, the temperature sensing array 4 can perform scanning type measurement on the cotton bale to obtain a temperature distribution result of the surface layer of the cotton bale; wherein the temperature distribution result of the surface layer of the cotton bale comprises the distribution condition of cotton temperature points in a preset depth range of the surface layer of the cotton bale; the temperature measurement module is used for sending the temperature distribution result captured by the temperature measurement array to the central processing module.
As an example, the camera bracket is arranged on the conveyor belt and in front of the portal frame, so that the cotton bale passes through the camera module and the temperature measuring module in sequence when being conveyed on the conveyor belt, the distance between the camera module and the temperature measuring module is within the range of 20cm-100cm, and preferably, the distance between the camera module and the temperature measuring module is 50cm.
As an example, the temperature sensing array is composed of closely arranged thermometric fiber probes.
By way of example, the temperature sensing array is perpendicular to the plane of the conveyor belt and is located at a distance in the range of 50cm to 120cm, preferably 85cm, from the plane of the conveyor belt.
As an example, the color camera is perpendicular to the plane in which the conveyor belt lies, at a distance in the range of 80-150cm, preferably 100cm, from the plane of the conveyor belt.
Further, the central processing module (i.e., the computer 5 in fig. 3) includes a preprocessing sub-module, a first cotton smoldering candidate region determining sub-module, a second cotton smoldering candidate region determining sub-module, a smoldering region determining sub-module, and a smoldering determination sub-module.
The preprocessing submodule is used for preprocessing the color image to obtain a preprocessed image.
The first cotton smoldering candidate region determining submodule is used for carrying out RGB channel and HSV component processing on the preprocessed image to obtain an RGB channel image and an HSV component image, and identifying a first cotton smoldering candidate region in the cotton bale by carrying out BP neural network processing on the RGB channel image and the HSV component image.
The second cotton smoldering candidate region determining submodule is used for determining a second cotton smoldering candidate region in the cotton bale based on the temperature distribution result of the surface layer of the cotton bale.
The smoldering region determining submodule is used for determining a smoldering region in the cotton bale based on a first cotton smoldering candidate region and a second cotton smoldering candidate region in the cotton bale, and obtaining the smoldering depth of each point in the smoldering region according to the temperature distribution result of the surface layer of the cotton bale.
The smoldering judging submodule is used for judging whether the cotton bale smolders according to the smoldering area in the cotton bale and the smoldering depth of each point in the smoldering area.
The modules and the sub-modules can respectively execute the same processing as the corresponding steps and sub-steps of the cotton loading, unloading and transporting smoldering monitoring method in the foregoing to realize similar functions and effects, which are not described again here.
PREFERRED EMBODIMENTS
A preferred embodiment of the present invention is described below in conjunction with fig. 3 and 4.
As shown in fig. 3, the smoldering monitoring device for cotton handling transportation in the preferred embodiment includes a camera support 1, a camera fixing frame 2 on the camera support 1, a color camera 6 mounted on the camera fixing frame 2, a gantry 3, and a temperature measuring array 4 on the gantry 3, wherein the camera support 1 is fixed with the gantry 3, the camera support 1 is mounted in front of the gantry 3, and the color camera 6 and the temperature measuring array 4 (i.e. the temperature sensing array 4 described above) are connected with a computer 5 through a data transmission line and a USB interface.
The color camera is, for example, an OK-AC1310 camera.
The temperature sensing array is formed by closely arranging temperature measurement optical fiber probes, for example.
The temperature sensing array is perpendicular to the plane of the conveyor belt, for example, at a distance of 85cm from the plane of the conveyor belt.
The color camera is perpendicular to the plane in which the conveyor belt lies, for example at a distance of 100cm from the plane of the conveyor belt.
The camera module is in front of the temperature measuring module, and the distance between the camera module and the temperature measuring module is 50cm.
The camera module connects the computer and the color camera together through the data transmission line and the USB interface.
When the cotton bale moves on the conveyor belt, the color camera 6 is arranged on the camera fixing frame 2, the color camera 6 is connected with the computer 5 through the data transmission line and the USB interface, the computer 5 drives the color camera 6 to collect color pictures of the cotton bale, and the collected color pictures I are transmitted to the computer 5 for operation processing.
Referring to fig. 4, image denoising and image enhancement preprocessing are firstly performed on the color image I, and the image I is obtained after the processing 1 For image I 1 RGB processing is carried out to obtain RGB three-channel images, and a cotton smoldering area S is obtained from the RGB three-channel images Color wash For image I 1 Performing HSV processing to obtain HSV three-channel images, and obtaining cotton smoldering areas S from the HSV three-channel images Bright Light (LIGHT) To S Color wash And S Bright Light (LIGHT) Performing OR operation to obtain cotton smoldering area S from color image 1 (corresponding to the first cotton smoldering candidate region above).
The cotton bale continues to move through the portal frame 3, the temperature measuring array 4 formed by closely arranging temperature measuring probes is arranged on the portal frame 3 and is vertical to the plane of the conveyor belt, the temperature distribution condition of the cotton bale can be integrally covered and measured through the temperature measuring array 4, and the measured temperature points are measuredIs greater than an empirical threshold T Threshold(s) (determination of T through multiple experiments) Threshold(s) Fitting the points which are 5 ℃ higher than the ambient temperature to obtain a smoldering zone S 2 (corresponding to the second cotton smoldering candidate region above) and smoldering depth H 0 。
Smoldering area S measured by color camera 6 1 And the temperature measuring array 4 obtains a smoldering area S 2 Performing OR operation to obtain the final cotton smoldering area S 0 Smoldering depth information H 0 Measured by the temperature measuring array 4 and obtained by the smoldering area S 0 And smoldering depth H 0 Whether cotton smoldering happens or not is accurately judged, if the cotton smoldering happens, a smoldering point can be quickly and accurately found, and hidden cotton smoldering hazards are prevented.
In summary, the cotton handling transportation smoldering monitoring device of the preferred embodiment comprises a camera module, a temperature measuring module and a central processing module. The camera shooting module comprises a camera support and a color camera, the temperature measuring module comprises a temperature sensing array (composed of temperature measuring probes) and a small portal frame which are uniformly distributed, and the central processing module comprises a computer and realizes fusion algorithm processing and control of the camera shooting module and the temperature measuring module. In the process of transporting the cotton bale on the conveyor belt, a color camera is triggered by a computer to shoot a color image on the surface of the cotton, the color image is subjected to denoising and enhancing pretreatment, and the processed image is subjected to RGB channel and HSV component processing. The inflammable area of the cotton bale shows the characteristics of carbonization-blackening, brightness-darkening and the like, and the smoldering area S of the cotton is determined by utilizing the RGB three-channel image Color wash Determining a smoldering area S of cotton by using HSV three-channel images Bright Light (LIGHT) ，S Color wash And S Bright Light (LIGHT) The two areas are subjected to OR operation to determine a cotton smoldering area S obtained by image processing 1 (ii) a The temperature sensing array realizes scanning measurement on cotton, can detect the distribution condition of cotton temperature points within the depth range of 1mm of the cotton, and the measured temperature points on the surface of the cotton are greater than an empirical threshold T Threshold(s) Is fitted to obtain a smoldering region S 2 ，S 1 And S 2 Performing OR operation to determine the final cotton smoldering area S 0 The cotton smoldering depth is obtained by fitting a temperature sensing array, and finally the cotton is obtainedWhether the bag has smoldering and the size and the depth of the smoldering area can well eliminate the hidden trouble of smoldering in cotton transportation, and has great economic benefit.
While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this disclosure, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as disclosed herein. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The present invention has been disclosed in an illustrative rather than a restrictive sense with respect to the scope of the invention, as defined in the appended claims.
Claims (10)
1. A cotton handling transportation smoldering monitoring method is characterized by comprising the following steps:
capturing a color image of a bale during handling and transport of the bale;
preprocessing the color image to obtain a preprocessed image;
carrying out RGB channel and HSV component processing on the preprocessed image to obtain an RGB channel image and an HSV component image so as to identify a first cotton smoldering candidate region in the cotton bale by carrying out BP neural network processing on the RGB channel image and the HSV component image;
scanning measurement is carried out on the cotton bale through a temperature sensing array, and a temperature distribution result of the surface layer of the cotton bale is obtained, wherein the temperature distribution result of the surface layer of the cotton bale comprises the distribution condition of cotton temperature points in a preset depth range of the surface layer of the cotton bale;
determining a second cotton smoldering candidate area in the cotton bale based on the temperature distribution result of the surface layer of the cotton bale;
determining a smoldering region in the cotton bale based on a first cotton smoldering candidate region and a second cotton smoldering candidate region in the cotton bale, and obtaining smoldering depths of points in the smoldering region according to a temperature distribution result of a surface layer of the cotton bale; and
and judging whether the cotton bale is smoldered or not according to the smoldering area in the cotton bale and the smoldering depth of each point in the smoldering area.
2. The cotton handling transportation smoldering monitoring method of claim 1, wherein said step of identifying a first cotton smoldering candidate region in said bale by performing BP neural network processing on said RGB lane images and HSV component images comprises:
determining a first smoldering candidate subregion in the RGB channel image based on a carbon blackening feature in the RGB channel image;
determining a second smoldering candidate subregion in the RGB channel image based on a luma darkening feature in the HSV component image; and
and taking the result of the OR operation of the first smoldering candidate subarea and the second smoldering candidate subarea as a first cotton smoldering candidate area in the cotton bale.
3. The cotton handling transportation smoldering monitoring method of claim 1 or 2, wherein the step of determining a second cotton smoldering candidate region in said bale comprises:
acquiring cotton surface measurement temperature points which are greater than or equal to a preset temperature threshold value in the cotton bale surface layer based on the temperature distribution result of the cotton bale surface layer; and
fitting the cotton surface measurement temperature points which are greater than or equal to a preset temperature threshold value in the cotton bale surface layer, and taking the area obtained after fitting as a second cotton smoldering candidate area in the cotton bale.
4. The cotton handling smoldering monitoring method of any of claims 1-3, wherein said step of determining a smoldering zone in said bale comprises:
and taking the result obtained by carrying out OR operation on the first cotton smoldering candidate region and the second cotton smoldering candidate region as a smoldering region in the cotton bale.
5. The monitoring device for the smoldering during cotton loading, unloading and transporting is characterized by comprising a loading, unloading and transporting module, a camera module, a temperature measuring module and a central processing module;
the loading and unloading transportation module comprises a conveying belt for loading and unloading transportation cotton bales;
the camera shooting module comprises a camera support, a camera fixing frame is arranged on the camera support, a color camera is arranged on the camera fixing frame, the camera support is fixedly connected with the conveying belt, the collecting direction of the color camera arranged on the camera fixing frame faces the conveying belt, so that the color camera can capture the color image of the cotton bale during the loading, unloading and transporting of the cotton bale, and the camera shooting module is used for sending the color image of the cotton bale captured by the color camera to the central processing module;
the temperature measurement module comprises a portal frame, a temperature sensing array is arranged on the portal frame, and the temperature sensing array is arranged on the portal frame according to the following mode: when the cotton bale is conveyed on the conveying belt and passes through the position right below the portal frame, the temperature sensing array can perform scanning type measurement on the cotton bale to obtain a temperature distribution result of the surface layer of the cotton bale; the temperature distribution result of the surface layer of the cotton bale comprises the distribution condition of cotton temperature points in a preset depth range of the surface layer of the cotton bale; and the temperature measurement module is used for sending the temperature distribution result captured by the temperature measurement array to the central processing module.
6. The monitoring device for smoldering during cotton handling and transportation according to claim 5, wherein said camera support is mounted on said conveyor belt in front of said gantry frame so that said cotton bale passes through said camera module and said temperature measuring module in sequence while being transported on said conveyor belt, and the distance between said camera module and said temperature measuring module is in the range of 20cm-100cm, preferably, the distance between said camera module and said temperature measuring module is 50cm.
7. The monitoring device for smoldering during cotton handling and transportation according to claim 5 or 6, wherein said temperature sensing array is composed of closely arranged temperature measuring fiber probes.
8. The cotton handling and transportation smoldering monitoring device of any of claims 5-7, wherein: the temperature sensing array is perpendicular to the plane of the conveyor belt, and the distance between the temperature sensing array and the plane of the conveyor belt is 50cm-120cm, and is preferably 85cm.
9. The cotton handling smoldering monitoring device of any of claims 5-8, wherein: the color camera is perpendicular to the plane of the conveyor belt and is at a distance of 80-150cm, preferably 100cm, from the plane of the conveyor belt.
10. The cotton handling transportation smoldering monitoring device of any of claims 5-9, wherein said central processing module comprises a preprocessing sub-module, a first cotton smoldering candidate area determining sub-module, a second cotton smoldering candidate area determining sub-module, a smoldering area determining sub-module, and a smoldering determination sub-module;
the preprocessing submodule is used for preprocessing the color image to obtain a preprocessed image;
the first cotton smoldering candidate region determining submodule is used for carrying out RGB channel and HSV component processing on the preprocessed image to obtain an RGB channel image and an HSV component image so as to identify a first cotton smoldering candidate region in the cotton bale by carrying out BP neural network processing on the RGB channel image and the HSV component image;
the second cotton smoldering candidate region determining submodule is used for determining a second cotton smoldering candidate region in the cotton bale based on the temperature distribution result of the surface layer of the cotton bale;
the smoldering region determining submodule is used for determining a smoldering region in the cotton bale based on a first cotton smoldering candidate region and a second cotton smoldering candidate region in the cotton bale, and obtaining the smoldering depth of each point in the smoldering region according to a temperature distribution result of the surface layer of the cotton bale; and
the smoldering judgment submodule is used for judging whether the cotton bale smolders according to a smoldering area in the cotton bale and smoldering depths of all points in the smoldering area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911275098.0A CN111062305B (en) | 2019-12-12 | 2019-12-12 | Method and device for monitoring smoldering during cotton loading, unloading and transporting |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911275098.0A CN111062305B (en) | 2019-12-12 | 2019-12-12 | Method and device for monitoring smoldering during cotton loading, unloading and transporting |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111062305A CN111062305A (en) | 2020-04-24 |
| CN111062305B true CN111062305B (en) | 2023-02-24 |
Family
ID=70298913
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911275098.0A Active CN111062305B (en) | 2019-12-12 | 2019-12-12 | Method and device for monitoring smoldering during cotton loading, unloading and transporting |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111062305B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101398392A (en) * | 2007-09-26 | 2009-04-01 | 中国科学院自动化研究所 | Cotton impurity high speed real-time detection method based on HSI color space |
| CN109034269A (en) * | 2018-08-22 | 2018-12-18 | 华北水利水电大学 | A kind of bollworm female male imago method of discrimination based on computer vision technique |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8265425B2 (en) * | 2008-05-20 | 2012-09-11 | Honda Motor Co., Ltd. | Rectangular table detection using hybrid RGB and depth camera sensors |
-
2019
- 2019-12-12 CN CN201911275098.0A patent/CN111062305B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101398392A (en) * | 2007-09-26 | 2009-04-01 | 中国科学院自动化研究所 | Cotton impurity high speed real-time detection method based on HSI color space |
| CN109034269A (en) * | 2018-08-22 | 2018-12-18 | 华北水利水电大学 | A kind of bollworm female male imago method of discrimination based on computer vision technique |
Non-Patent Citations (2)
| Title |
|---|
| 基于HSV彩色模型的自然场景下棉花图像分割策略研究;韦皆顶等;《棉花学报》;20080115(第01期);全文 * |
| 基于Lab颜色空间和遗传算法的苦苣菜叶片病斑分割;崔世钢等;《天津职业技术师范大学学报》;20150928(第03期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111062305A (en) | 2020-04-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5068799A (en) | System and method for detecting flaws in continuous web materials | |
| JP3041090B2 (en) | Appearance inspection device | |
| JP5302858B2 (en) | Coated wire inspection device and wire processing machine equipped with the same | |
| JP5031691B2 (en) | Surface flaw inspection device | |
| US6687396B1 (en) | Optical member inspection apparatus, image-processing apparatus, image-processing method, and computer readable medium | |
| EP3534151B1 (en) | Inspection apparatus, inspection system, and inspection method | |
| US20190089301A1 (en) | System and method for solar cell defect detection | |
| JP2008041749A (en) | Device for inspecting image defect | |
| US8233697B2 (en) | Method and device for generating digital still pictures of wafer-shaped elements during a production process | |
| JP2015225003A (en) | Appearance inspection device | |
| CN111062305B (en) | Method and device for monitoring smoldering during cotton loading, unloading and transporting | |
| CN113096111A (en) | Material detection method, system, computer program product and readable storage medium | |
| CN115947066B (en) | Belt tearing detection method, device and system | |
| JPH08168102A (en) | Pantagraph and inspection device thereof | |
| CN111458344A (en) | Mask defect visual detection method, equipment and storage medium | |
| CN104935837B (en) | For optical imagery pointing device and the image processing method of optical video equipment | |
| JP2003156451A (en) | Defect detecting device | |
| JPH0658733A (en) | Inspecting method of nonuniform section of glass bottle | |
| CN113376183A (en) | Glass defect detection method, system and equipment | |
| JP2009047517A (en) | Inspection apparatus | |
| JPH10132754A (en) | Device for inspecting appearance of lead frame | |
| JPH08304295A (en) | Method and apparatus for detecting surface defect | |
| JPH11352073A (en) | Foreign matter inspection method and apparatus thereof | |
| JPH0694660A (en) | Method and device for surface defect inspection | |
| CN209372711U (en) | It is a kind of can online recognition dust and scuffing intelligent detection equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |