CN116664573A - Downhole drill rod number statistics method based on improved YOLOX - Google Patents

Downhole drill rod number statistics method based on improved YOLOX Download PDF

Info

Publication number
CN116664573A
CN116664573A CN202310944258.6A CN202310944258A CN116664573A CN 116664573 A CN116664573 A CN 116664573A CN 202310944258 A CN202310944258 A CN 202310944258A CN 116664573 A CN116664573 A CN 116664573A
Authority
CN
China
Prior art keywords
improved
model
yolox
frame
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202310944258.6A
Other languages
Chinese (zh)
Other versions
CN116664573B (en
Inventor
任大伟
孟令威
王蕊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong University of Science and Technology
Original Assignee
Shandong University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong University of Science and Technology filed Critical Shandong University of Science and Technology
Priority to CN202310944258.6A priority Critical patent/CN116664573B/en
Publication of CN116664573A publication Critical patent/CN116664573A/en
Application granted granted Critical
Publication of CN116664573B publication Critical patent/CN116664573B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/20—Image enhancement or restoration using local operators
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/40—Image enhancement or restoration using histogram techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20024—Filtering details
    • G06T2207/20032—Median filtering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30204—Marker
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30242—Counting objects in image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07—Target detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Computational Linguistics (AREA)
  • Biophysics (AREA)
  • Data Mining & Analysis (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Molecular Biology (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Quality & Reliability (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses an improved YOLOX-based underground drill rod number counting method, which belongs to the field of mining and information technology, and comprises the following steps: reading a monitoring video of underground drilling, and preprocessing an image acquired by frame extraction through frame extraction; introducing a CBAM attention mechanism to improve the model feature extraction capability; using a BiFPN feature pyramid to reduce feature loss; the optimization loss function is CIOU, and the positioning capability of the model prediction frame is improved; performing target detection and tracking by using an improved model trained by the preprocessed image; and eliminating small peaks without the unloading operation by setting a peak threshold value, recording the rest effective peaks, and counting once if one peak exists. The invention improves the counting accuracy and has important significance for automatically counting the number of the drill rods.

Description

Downhole drill rod number statistics method based on improved YOLOX
Technical Field
The invention relates to the field of mining and information technology, in particular to an underground drill rod number counting method based on improved YOLOX.
Background
Rock burst is one of the most serious disasters in deep coal mining in China, and compared with other methods for preventing and controlling rock burst, the method for drilling and releasing pressure has the advantages of simple process, low cost and the like, and is widely applied to coal mining. Because the pressure relief drilling depth is difficult to directly measure, the pressure relief drilling depth is generally calculated indirectly through the number of drill rods. In practical measurement, drill rod specifications are the same in the same drilling operation, so drill rod numbers are generally used for measuring drilling depths. The traditional drill rod counting method is manual counting, the method is low in efficiency, and the insufficient pressure relief drilling depth possibly occurs due to false alarm risks in outsourcing engineering, so that potential safety hazards are brought to coal mine production.
Disclosure of Invention
Aiming at the technical problems in the prior art, the invention provides a downhole drill rod number counting method based on improved YOLOX (You Only Look Once: unified, real-Time Object Detection X, only once: unified Real-time object detection X version), which is reasonable in design, overcomes the defects of the prior art and has a good effect.
In order to achieve the above purpose, the present invention adopts the following technical scheme: a downhole drill pipe quantity statistics method based on improved YOLOX, comprising the steps of: step 1: preprocessing a frame extraction image; reading a monitoring video of underground drilling, performing frame extraction, and preprocessing an image obtained by the frame extraction to obtain an original data set; step 2: improvement of training model; introducing CBAM (Convolutional Block Attention Module, convolution attention module) into the model to improve the model feature extraction capability; using bippn (Bidirectional Feature Pyramid Network, bi-directional feature pyramid network) to reduce feature loss; the optimized loss function is CIOU (Complete)Complete and completeCross ratio), and the positioning capability of the model prediction frame is improved; step 3: target detection and tracking; performing target detection and tracking by using an improved model trained by the preprocessed images, wherein the detection targets are a power head and the front end of a machine body, and drawing a periodic interval change waveform chart of the power head and the front end of the machine body; step 4: wave crest screening and counting; and eliminating small peaks without the unloading operation by setting a peak threshold value, recording the rest effective peaks, and counting once if one peak exists.
Preferably, the step 1 specifically includes the following steps: step 1.1: image denoising; carrying out noise elimination and filtering treatment on the frame extraction image by a median filtering method; step 1.2: enhancing the image; the image after noise cancellation and filtering is enhanced through histogram equalization.
Preferably, the step 2 specifically includes the following steps: step 2.1: an attention introducing mechanism; introducing CBAM into the model, automatically acquiring the importance degree of the feature channel through the CBAM, giving weight, strengthening important features and inhibiting non-important features; step 2.2: introducing a feature pyramid; the feature pyramid realizes the fusion of high-level semantic information and low-level detail information through a bidirectional channel from top to bottom and from bottom to top; step 2.3: optimizing the loss function to be CIOU; the optimal loss function is a CIOU loss function, gradient return is realized through the CIOU loss function, positioning of the prediction frame is facilitated, and the similarity degree of the aspect ratio of the prediction frame and the real frame is reflected.
Preferably, the step 3 specifically includes the following steps: step 3.1: predicting the front ends of the power head and the machine body by using the trained model to obtain prediction frames of the power head and the machine body; step 3.2: calculating the distance between the two prediction frame center points; step 3.3: 20 frames of images are extracted every minute, a pitch waveform is drawn with the calculated pitch, the horizontal axis is time, and the vertical axis is distance between the two.
Preferably, the step 4 specifically includes the following steps: step 4.1: obtaining peak value and time information at a peak according to the information of the waveform diagram; step 4.2: because the butt joint power head and the drill rod are in butt joint, small wave peaks without the operation of unloading the drill rod appear, the wave peak threshold value is set for the small wave peaks to be removed; step 4.3: and counting the wave crests meeting the threshold requirement, and carrying out one-time rod unloading operation at the wave crests at the moment, wherein one drill rod is unloaded in one-time rod unloading operation, so that the wave crest count is the statistical quantity of the drill rods.
The invention has the beneficial technical effects that: (1) The method can weaken the interference caused by underground dimming conditions on identification by the image preprocessing method, and has better universality on more accurate identification of objects under the channel; (2) The recognition accuracy reaches 91.3% by improving the model; the more accurate prediction of the object under the underground complex background can be realized; (3) Small peaks which do not generate rod unloading operation are filtered through setting of the peak threshold value, and statistics of the number of drill rods is achieved through recording of the number of effective peaks.
Drawings
FIG. 1 is a flow chart of the method of the present invention.
Detailed Description
The invention is described in further detail below with reference to the attached drawings and detailed description: a downhole drill rod number counting method based on improved YOLOX, which is shown in fig. 1, and comprises the following steps: step 1: reading a monitoring video of underground drilling, preprocessing an image acquired by frame extraction through frame extraction, and solving the problems of low noise and low contrast in the underground image; the method specifically comprises the following steps: step 1.1: image filtering and denoising; and smoothing the images in the data set through a filter in sequence to generate new images to form a new data set, and inhibiting noise of the target image under the condition of reserving the detail characteristics of the images as much as possible so as to eliminate the problem of image noise caused by excessively high equipment sensitivity setting caused by the underground dimming environment.
Taking out frames of video data in a certain coal mine rod unloading process, preprocessing an image after taking out frames to be used as an original data set, wherein the data set has 4783 pictures in total; carrying out noise elimination treatment on the frame-extracted image by different filtering methods, and selecting a more proper noise elimination method; and respectively adopting median filtering, mean filtering and Gaussian filtering to carry out transverse comparison, and finally selecting the median filtering which can eliminate image noise and has the smallest influence on image definition according to comparison results.
Step 1.2: enhancing the image; because the whole underground environment is dim, the gray level of the image data is concentrated and distributed at a lower level, the contrast of the image is insufficient, and the image is required to be enhanced. The filtered image is enhanced by histogram equalization. The contrast of the key area of the image after the global histogram equalization treatment is insufficient, the gray level of the image after the treatment is still concentrated at a lower level, so that the equalized image is marked by adopting the local histogram equalization, the marking targets are two parts of a power head and the front end of a machine body, and the data set is divided into a training set and a test set according to the proportion of 8:2.
The input picture is firstly converted into an HSI color space, histogram equalization is carried out on the intensity channel, and then the processed result is converted into an RGB color space. The mapping of each pixel from the original gray level to the new gray level is realized, the gray level conversion is realized, and the contrast of the image is improved.
Step 2: model improvement. Three-point improvement is provided for the YOLOX network framework according to the underground environment conditions, so that the model is helped to achieve better feature extraction and fusion, and the model is positioned more accurately. Introducing a CBAM attention mechanism into the model to improve the feature extraction capability of the model; using a BiFPN feature pyramid to reduce feature loss; and the optimization loss function is CIOU, so that the positioning capability of the model prediction frame is improved.
The method specifically comprises the following steps: step 2.1: fusing a attentive mechanism; insufficient underground illumination, poor contrast, and poor positioning and recognition accuracy can be caused by fuzzy boundary between a target object and a background due to impurities, pipelines, equipment and the like. The attention mechanism can automatically acquire the importance degree of the characteristic channel and give weight to strengthen important characteristics and inhibit non-important characteristics. The CBAM attention mechanism is fused in the backbone network (Convolutional Block Attention Module).
First, the feature map is mapped through the channel attention mechanismCompressing in space dimension, global average pooling and maximum pooling of the height and width respectively, and passing through a perceptronModel->The method comprises the steps of carrying out a first treatment on the surface of the Then, the characteristic elements are summed and subjected to inner product operation with the original characteristic diagram through a Sigmoid activation function>Representing the inner product and outputting a characteristic diagram +.>As an input profile for the spatial attention module. The spatial attention mechanism also carries out global average pooling and maximum pooling processes, then carries out convolution operation through a convolution kernel, and carries out inner product operation on the input and output characteristic diagrams after activating functions, wherein the formula is as follows.
（1）；/>（2）。
The channel attention formula and spatial attention mechanism are shown below.
（3）；
（4）；
Wherein, the liquid crystal display device comprises a liquid crystal display device,and->Channel and spatial attention vectors, respectively, +.>Representing an activation function, here a Sigmoid function,/->And->Representing the mean pooling and maximum pooling operations, respectively,/->Representing a convolution operation with a convolution kernel size of 7 x 7.
Step 2.2: introducing a feature pyramid; the feature pyramid realizes the fusion of high-level semantic information and low-level detail information through a bidirectional channel from top to bottom and from bottom to top; the front end of the power head and the front end of the machine body belong to small targets in the recognition task, the space dimension of input data can be reduced when a convolution kernel slides on the input data, the size of a feature map can be reduced, extraction of higher-level features is facilitated, and the loss of feature information of small objects can be caused in the process. The feature pyramid fuses the up-sampling of the deep features with the shallow features to achieve a prediction effect, so that the loss of small target feature information can be reduced. BiFPN (Bidirectional Feature Pyramid Network) fuses the information of different scales through the two-way channels from top to bottom and from bottom to top, sets corresponding weights according to the importance of the feature information, can effectively adjust the contribution degree of the feature information in the feature map, and realizes better feature fusion.
Step 2.3: optimizing a loss function; the original IOU loss function of the YOLO is optimized to be the CIOU loss function.
A dim downhole environment may result in poor positioning of the prediction frame. The loss function can reflect the degree of difference between the predicted frame and the real frame and optimize the positioning of the predicted frame through gradient return. But the different loss functions have different capacities of reflecting the difference between the prediction frame and the real frame, and good loss functions can better reflect the difference condition and realize better echelon return. The positioning of the prediction frame can be more in line with the real frame, and the calculation of the center point distance of the follow-up prediction frame is more accurate.
CIOU（) Is not overlapped or not in the frameAnd when all the parameters are included, gradient return can be realized, positioning of the prediction frame is facilitated, and the similarity degree of the aspect ratio of the prediction frame and the real frame can be reflected through the introduction of the length-width consistency parameters.
（5）；
（6）；
（7）；
（8）；
Wherein, the liquid crystal display device comprises a liquid crystal display device,for the cross ratio of the predicted frame and the real frame area, +.>For prediction frame, ++>Is a true frame->For predicting frame center coordinates, < >>Is the coordinates of the center point of the real frame +.>Representing the square of the distance between the two center points, +.>Representing the square of the diagonal length of the smallest bounding rectangle of the prediction frame and the real frame, < >>Is a parameter for making track-off, < ->Is a parameter used to measure aspect ratio uniformity. The CIOU loss function can better reflect the difference between the prediction frame and the real frame, realize better gradient return, help the prediction frame to realize more accurate positioning, and reduce the influence of the underground dim environment on the prediction positioning.
Step 3: training a model; performing target detection and tracking by using an improved model trained by the preprocessed images, wherein the detection targets are a power head and the front end of a machine body, and drawing a periodic interval change waveform chart of the power head and the front end of the machine body; we run on a computer with Windows10 operating system, geForce RTX 3060, indelphinium, and Pytorch deep learning framework using python3.7 as the programming language. The specific experimental initial parameter settings are shown in table 1.
TABLE 1
。
The invention selects YOLOV4, V5, SSD, YOLOX and improved model for comparison study. mAP and FPS values on the test set are shown in Table 2.
TABLE 2
。
As can be seen from table 2, the YOLOX performance before the improvement is also better than the previous generation version. The SSD algorithm detects at a much higher speed than the rest of the models, but its detection accuracy is also lowest. After the improvement, the mAP of the YOLOX model reaches 91.3%, and is respectively improved by 15.1% and 11.5% compared with V4 and V5, and the FPS value is slightly improved. The mAP value was increased by 4.4% with less FPS value reduction compared to the original model. The improved model ensures the detection speed while greatly improving the detection precision.
And (5) waveform drawing. Training the improved model to realize the power head and the machineThe accurate positioning of the front end of the body can obtain the position of the front end and the front endThe central position of the prediction frame is calculated according to the distance formulaThe formula is as follows:(9) The method comprises the steps of carrying out a first treatment on the surface of the Wherein, the liquid crystal display device comprises a liquid crystal display device,is thatWhen the distance between the power head and the front end of the machine body is equal,，respectively isAnd the central coordinates of the prediction frames at the front ends of the power head and the machine body. The spacing was calculated at 20 frames per minute uniformly to plot the spacing curve.
Step 4: wave crest screening and counting; and eliminating small peaks without the unloading operation by setting a peak threshold value, recording the rest effective peaks, and counting once if one peak exists.
The rod unloading is a process that the power head is close to the drill rod and connected with the drill rod and then drives the drill rod to move until the drill rod is taken out completely and then manually unloaded. Because the shape and other characteristics of the drill rod are not obvious, the drill rod is difficult to capture in an actual detection task, and the difficulty of directly identifying the position of the drill rod is high. Considering that the relative position of the power head and the front end of the machine body has an indirect relation with the unloading operation, the counting of the unloading drill rods can be realized through the change condition of the distance relation between the power head and the front end of the machine body.
A large peak close to 1m of the length of a single drill rod appears in the curve, and one drill rod is removed corresponding to one-time rod removing operation. However, small peaks appear in the same curve, and the intervals of the small peaks do not meet the requirement of taking out all drill rods, so that the rod unloading operation does not occur. In combination with video analysis, the reason is that the position needs to be fine-tuned for docking when the power head is docked with the drill pipe. At this time, the power head is close to the front end of the machine body, and the position of the power head is not changed greatly, so that the height of the small wave peak is far lower than the height of the wave peak when the lever unloading operation occurs. The large peak is removed from a drill rod and should count to 1, and the small peak is not removed from the drill rod and does not count. Therefore, a crest threshold can be set, the crest meeting the threshold requirement is a valid crest and is counted, otherwise, the crest is not counted to remove small crest interference.
Considering factors such as underground image quality and recognition errors, a crest of a drill rod length which is tentatively set to be 0.85 times is an effective crest and recorded, and an effectiveness judgment function of the crest is setThe peak height is recorded as 1 when it exceeds the threshold value, and otherwise as 0.
（10）。
Wherein, the liquid crystal display device comprises a liquid crystal display device,peak representing nth peak, +.>The length of the drill rods was 1m in this experiment for the length of a single drill rod, so the spacing threshold was set at 85cm. When->When the value of (2) is 1, the threshold requirement is met; and when the value is 0, it is not satisfied.
A tripping operation and tripping out of a drill rod occurs at the peak meeting the threshold requirement, and a count is made.
The formula is as follows:(11) The method comprises the steps of carrying out a first treatment on the surface of the Wherein (1)>Representing the set of peaks, +.>Representation->Set of->For peak finding function, the value of the peak can be recorded,/->As a conditional count function, when->And when the function counts once, otherwise, the function does not count, and the final counting result is output as the counting result of the number of the drill rods.
It should be understood that the above description is not intended to limit the invention to the particular embodiments disclosed, but to limit the invention to the particular embodiments disclosed, and that the invention is not limited to the particular embodiments disclosed, but is intended to cover modifications, adaptations, additions and alternatives falling within the spirit and scope of the invention.

Claims (5)

1. The underground drill rod number counting method based on the improved YOLOX is characterized by comprising the following steps of: the method comprises the following steps:
step 1: preprocessing a frame extraction image;
reading a monitoring video of underground drilling, performing frame extraction, and preprocessing an image obtained by the frame extraction to obtain an original data set;
step 2: improvement of training model;
introducing CBAM to the model to improve the feature extraction capability of the model; using BiFPN to reduce feature loss; the optimization loss function is CIOU, and the positioning capability of the model prediction frame is improved;
step 3: target detection and tracking;
performing target detection and tracking by using an improved model trained by the preprocessed images, wherein the detection targets are a power head and the front end of a machine body, and drawing a periodic interval change waveform chart of the power head and the front end of the machine body;
step 4: wave crest screening and counting;
and eliminating small peaks without the unloading operation by setting a peak threshold value, recording the rest effective peaks, and counting once if one peak exists.
2. The improved YOLOX-based downhole drill pipe quantity statistics method of claim 1, wherein: the step 1 specifically comprises the following steps:
step 1.1: image denoising;
carrying out noise elimination and filtering treatment on the frame extraction image by a median filtering method;
step 1.2: enhancing the image;
the image after noise cancellation and filtering is enhanced through histogram equalization.
3. The improved YOLOX-based downhole drill pipe quantity statistics method of claim 1, wherein: the step 2 specifically comprises the following steps:
step 2.1: an attention introducing mechanism;
introducing CBAM into the model, automatically acquiring the importance degree of the feature channel through the CBAM, giving weight, strengthening important features and inhibiting non-important features;
step 2.2: introducing a feature pyramid;
the feature pyramid realizes the fusion of high-level semantic information and low-level detail information through a bidirectional channel from top to bottom and from bottom to top;
step 2.3: optimizing the loss function to be CIOU;
the optimal loss function is a CIOU loss function, gradient return is realized through the CIOU loss function, positioning of the prediction frame is facilitated, and the similarity degree of the aspect ratio of the prediction frame and the real frame is reflected.
4. The improved YOLOX-based downhole drill pipe quantity statistics method of claim 1, wherein: the step 3 specifically comprises the following steps:
step 3.1: predicting the front ends of the power head and the machine body by using the trained model to obtain prediction frames of the power head and the machine body;
step 3.2: calculating the distance between the two prediction frame center points;
step 3.3: 20 frames of images are extracted every minute, a pitch waveform is drawn with the calculated pitch, the horizontal axis is time, and the vertical axis is distance between the two.
5. The improved YOLOX-based downhole drill pipe quantity statistics method of claim 1, wherein: the step 4 specifically comprises the following steps:
step 4.1: obtaining peak value and time information at a peak according to the information of the waveform diagram;
step 4.2: because the butt joint power head and the drill rod are in butt joint, small wave peaks without the operation of unloading the drill rod appear, the wave peak threshold value is set for the small wave peaks to be removed;
step 4.3: and counting the wave crests meeting the threshold requirement, and carrying out one-time rod unloading operation at the wave crests at the moment, wherein one drill rod is unloaded in one-time rod unloading operation, so that the wave crest count is the statistical quantity of the drill rods.
CN202310944258.6A 2023-07-31 2023-07-31 Downhole drill rod number statistics method based on improved YOLOX Active CN116664573B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310944258.6A CN116664573B (en) 2023-07-31 2023-07-31 Downhole drill rod number statistics method based on improved YOLOX

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310944258.6A CN116664573B (en) 2023-07-31 2023-07-31 Downhole drill rod number statistics method based on improved YOLOX

Publications (2)

Publication Number Publication Date
CN116664573A true CN116664573A (en) 2023-08-29
CN116664573B CN116664573B (en) 2024-02-09

Family

ID=87712203

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310944258.6A Active CN116664573B (en) 2023-07-31 2023-07-31 Downhole drill rod number statistics method based on improved YOLOX

Country Status (1)

Country Link
CN (1) CN116664573B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130275100A1 (en) * 2012-04-16 2013-10-17 Canrig Drilling Technology Ltd. Wellsite control employing three-dimensional imaging
CN113033315A (en) * 2021-02-26 2021-06-25 江西理工大学 Rare earth mining high-resolution image identification and positioning method
CN114693739A (en) * 2022-04-11 2022-07-01 中国矿业大学 Downhole drill rod counting method and device based on visual tracking algorithm
CN115131712A (en) * 2022-07-12 2022-09-30 安徽理工大学 Intelligent counting method of drill rods driven by computer vision
CN115909121A (en) * 2022-08-24 2023-04-04 安徽理工大学 Mine underground drill rod counting method, system and equipment based on improved YOLOV5 and Deepsort
CN116051953A (en) * 2022-11-23 2023-05-02 中国铁塔股份有限公司重庆市分公司 Small target detection method based on selectable convolution kernel network and weighted bidirectional feature pyramid

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130275100A1 (en) * 2012-04-16 2013-10-17 Canrig Drilling Technology Ltd. Wellsite control employing three-dimensional imaging
CN113033315A (en) * 2021-02-26 2021-06-25 江西理工大学 Rare earth mining high-resolution image identification and positioning method
CN114693739A (en) * 2022-04-11 2022-07-01 中国矿业大学 Downhole drill rod counting method and device based on visual tracking algorithm
CN115131712A (en) * 2022-07-12 2022-09-30 安徽理工大学 Intelligent counting method of drill rods driven by computer vision
CN115909121A (en) * 2022-08-24 2023-04-04 安徽理工大学 Mine underground drill rod counting method, system and equipment based on improved YOLOV5 and Deepsort
CN116051953A (en) * 2022-11-23 2023-05-02 中国铁塔股份有限公司重庆市分公司 Small target detection method based on selectable convolution kernel network and weighted bidirectional feature pyramid

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
LIHONG DONG等: "Drill Pipe Counting Method Based on Scale Space and Siamese Network", 《ACAI 20: PROCEEDINGS OF THE 2020 3RD INTERNATIONAL CONFERENCE ON ALGORITHMS, COMPUTING AND ARTIFICIAL》 *
吴鑫艺: "基于改进RFB和孪生网络的煤矿钻杆计数方法研究", 《中国优秀硕士学位论文全文数据库 工程科技Ⅰ辑》 *
高瑞;郝乐;刘宝;文静怡;陈宇航;: "基于改进ResNet网络的井下钻杆计数方法", 工矿自动化, no. 10 *

Also Published As

Publication number Publication date
CN116664573B (en) 2024-02-09

Similar Documents

Publication Publication Date Title
CN113469177B (en) Deep learning-based drainage pipeline defect detection method and system
CN111080620B (en) Road disease detection method based on deep learning
CN108564085B (en) Method for automatically reading of pointer type instrument
CN105069778B (en) Based on the industrial products detection method of surface flaw that target signature notable figure builds
CN114926407A (en) Steel surface defect detection system based on deep learning
CN101751603A (en) Online bar section image automatic counting device and method
CN112861912A (en) Deep learning-based method and system for identifying indicator diagram of complex working condition of pumping well
CN113159061B (en) Actual tunnel surrounding rock fragment identification method based on example segmentation
CN113313107B (en) Intelligent detection and identification method for multiple types of diseases on cable surface of cable-stayed bridge
CN114140384A (en) Transverse vibration image recognition algorithm for hoisting steel wire rope based on contour fitting and centroid tracking
CN116664573B (en) Downhole drill rod number statistics method based on improved YOLOX
CN112561885B (en) YOLOv 4-tiny-based gate valve opening detection method
CN112016391B (en) Fishpond identification method, system and medium based on high-resolution satellite remote sensing image
CN110751687A (en) Apple size grading method based on computer vision minimum and maximum circles
CN116452976A (en) Underground coal mine safety detection method
Huang et al. The detection of defects in ceramic cell phone backplane with embedded system
CN109636744A (en) A kind of adapting to image processing method of underground distance gated imaging
CN114596262A (en) Dam monitoring and analyzing method and system based on image recognition technology
Tingjiang et al. Research and application of downhole drilling depth based on computer vision technique
CN110827272B (en) Tire X-ray image defect detection method based on image processing
CN110210447B (en) Method and device for detecting moving target in underground dangerous area
Setiawan et al. Improved Edge Detection Based on Adaptive Gaussian Smoothing in X-Ray Image
CN116958141B (en) Automatic cleaning method and system for low-temperature distillation tank
Craciunescu et al. An original method for spot detection and analysis for large surveys of videos in JET
CN116681697B (en) Cobalt removal measuring method and device for diamond compact and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant