CN113362330A - Pantograph cavel real-time detection method, device, computer equipment and storage medium - Google Patents

Pantograph cavel real-time detection method, device, computer equipment and storage medium Download PDF

Info

Publication number
CN113362330A
CN113362330A CN202110919528.9A CN202110919528A CN113362330A CN 113362330 A CN113362330 A CN 113362330A CN 202110919528 A CN202110919528 A CN 202110919528A CN 113362330 A CN113362330 A CN 113362330A
Authority
CN
China
Prior art keywords
real
image
horn
cavel
frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110919528.9A
Other languages
Chinese (zh)
Other versions
CN113362330B (en
Inventor
熊仕勇
董彬
蒋华强
左超华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changzhou Luhang Railway Transportation Technology Co ltd
Original Assignee
Kunshan High New Track Traffic Intelligent Equipment Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kunshan High New Track Traffic Intelligent Equipment Co ltd filed Critical Kunshan High New Track Traffic Intelligent Equipment Co ltd
Priority to CN202110919528.9A priority Critical patent/CN113362330B/en
Publication of CN113362330A publication Critical patent/CN113362330A/en
Application granted granted Critical
Publication of CN113362330B publication Critical patent/CN113362330B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/13Edge detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/60Analysis of geometric attributes
    • G06T7/62Analysis of geometric attributes of area, perimeter, diameter or volume
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning

Abstract

The invention relates to the technical field of rail transit, and discloses a real-time detection method, a device, computer equipment and a storage medium for a pantograph goat horn, which can firstly identify and position a goat horn region of a pantograph goat horn video acquired from a car roof in real time based on a machine vision target detection method, then carry out binarization processing, opening and closing operation processing and contour fitting extraction on an identified goat horn image to obtain a goat horn geometric contour and a real-time value of a goat horn geometric parameter, and finally judge whether the goat horn is qualified in the current state according to the comparison between the real-time value of the goat horn geometric parameter and a design allowable variation range to realize the real-time detection aim of the pantograph goat horn, can simplify a false alarm detection system, facilitate installation and arrangement, reduce the hardware cost, ensure the accuracy of a detection result, reduce the occurrence of alarm conditions and avoid bringing extra rechecking workload to maintainers, the method is particularly suitable for scenes in urban rail transit tunnels.

Description

Pantograph cavel real-time detection method, device, computer equipment and storage medium
Technical Field
The invention belongs to the technical field of rail transit, and particularly relates to a real-time detection method and device for a pantograph goat horn, computer equipment and a storage medium.
Background
In the power failure and outage accidents of the electrified railway system in China, the pantograph-catenary accidents account for 80 percent of the total accidents. The Pantograph-catenary system (english Pantograph-OCS system) is an electric power system composed of a Pantograph and a catenary, and is used for transmitting electric power on the catenary to a train through the Pantograph so as to provide power for driving of a high-speed train. As an important component of the pantograph, the function of the knuckle (i.e. the curved metal on both sides of the pantograph of the power train, the shape of which is similar to that of a natural knuckle, so the knuckle is commonly referred to as a knuckle in the industry) is mainly to ensure that the pantograph smoothly passes through a contact network line fork, so as to prevent the pantograph from entering the contact network line fork to cause a pantograph accident. Therefore, in order to ensure the driving safety of the train, it is necessary to detect the horn of the pantograph.
At present, the detection of the pantograph goat horn mainly comprises a manual detection mode and an automatic detection mode, wherein the detection of the goat horn on a vehicle is mainly carried out by manually climbing the top of the vehicle, and the method has large workload and is relatively complicated; the latter is mainly based on a laser displacement sensor, namely, the profile of the whole pantograph is obtained through laser measurement, and then the abnormality of the goat's horn is obtained through analysis. Although the automatic detection mode can reduce the workload of manpower, the defects of large equipment, complex installation and higher cost exist; meanwhile, the sensor is easily interfered by vibration, sunlight, train speed and the like, so that the conditions of inaccurate detection, false alarm and the like often occur, and extra rechecking work is brought to maintainers. Especially in urban rail transit tunnels, better detection effect cannot be obtained due to poor illumination effect, abrupt change of brightness at the inner and outer junctions of tunnel openings, complex environments in tunnels and laser signal transmitting and receiving ends of sliding plate carbon powder covering sensors and the like.
Disclosure of Invention
In order to solve the problems of huge equipment, complex installation, higher cost and inaccurate detection of the conventional automatic detection mode of the pantograph sheep horn, the invention aims to provide a real-time detection method, a real-time detection device, computer equipment and a storage medium of the pantograph sheep horn, which can simplify a detection system, facilitate installation and arrangement and reduce hardware cost compared with the conventional automatic detection mode, can simultaneously prevent a detection result from being interfered by an external environment, ensure the accuracy of the detection result, reduce the occurrence of false alarm conditions, avoid bringing extra rechecking workload to maintainers, and are particularly suitable for scenes in urban rail transit tunnels.
In a first aspect, the present invention provides a real-time detection method for a pantograph goat's horn, including:
acquiring a video acquired by a monitoring camera in real time, wherein the monitoring camera is arranged on the roof of the vehicle and enables the camera view to cover the area where the pantograph is located;
carrying out histogram equalization processing on the latest image in the video to obtain a sample image to be detected;
importing the sample image to be tested into a trained target detection model, and identifying the position of the goat's horn of the pantograph in the area of the sample image to be tested;
intercepting a goat horn image from the sample image to be detected according to the position of the area;
carrying out binarization processing on the cavel image to obtain a binarized image;
carrying out opening and closing operation processing on the binary image to obtain a new cavel image;
fitting to obtain a real-time geometric outline of the goat horn according to the new goat horn image;
acquiring a real-time value of a goat horn geometric parameter according to the real-time geometric contour, wherein the goat horn geometric parameter comprises goat horn width, goat horn height and/or goat horn area;
and judging whether the goat horn is qualified in the current state according to the comparison result of the real-time value of the goat horn geometric parameter and the design allowable variation range.
Based on the content of the invention, the method can firstly identify and position the cavel area based on the pantograph cavel video acquired by the machine vision target detection method in real time, then carry out binarization processing, opening and closing operation processing and contour fitting extraction on the cavel image obtained by identification to obtain the cavel geometric contour and the real-time value of the cavel geometric parameter, and finally judge whether the cavel is qualified in the current state according to the comparison between the real-time value of the cavel geometric parameter and the allowable variation range of the design, so as to realize the real-time detection aim of the pantograph cavel. The method reduces the occurrence of false alarm, avoids bringing extra rechecking workload to maintainers, and is particularly suitable for scenes in urban rail transit tunnels. In addition, as the geometrical parameters of the cavel can be accurately measured, compared with the existing automatic detection mode, the detection precision is greatly improved; and the source monitoring video (namely the video) can be directly checked while the detection is carried out, so that the detection result can be conveniently rechecked.
In one possible design, before the introducing the sample image to be tested into the trained target detection model, the method further includes:
acquiring a pantograph monitoring video historically acquired by the monitoring camera in one trip;
respectively carrying out histogram equalization processing on each frame of image in the pantograph monitoring video to obtain a plurality of training sample images;
acquiring horn region labeling data corresponding to each training sample image in the plurality of training sample images one to one;
and importing the training sample image and the cavel region labeling data corresponding to the training sample image into the target detection model for training to obtain the trained target detection model.
In one possible design, importing the training sample image and the cavel region labeling data corresponding to the training sample image into the target detection model for training to obtain the trained target detection model, including:
importing the training sample image and the cavel region labeling data corresponding to the training sample image into a YOLO-v4 target detection model, and executing the following training steps in the YOLO-v4 target detection model:
adjusting the training sample image to have a target size and is divided into
Figure 184212DEST_PATH_IMAGE001
A square image of a grid, wherein,
Figure 144077DEST_PATH_IMAGE002
a natural number not less than 5;
judging whether the target center falls on the target center
Figure 326797DEST_PATH_IMAGE003
In a certain grid of the grids, wherein the target center is a center of a horn area of the pantograph;
if so, the grid is responsible for predicting a plurality of target frames and calculating to obtain the predicted value of each target frame in the target frames on frame parameters, wherein the frame parameters comprise a frame center horizontal coordinate, a frame center vertical coordinate, a frame width, a frame height, a frame type and a confidence coefficient corresponding to the frame type;
and performing iterative optimization of a loss function according to the predicted value and the cavel region labeling data to obtain a detection model which is finished with target training.
In one possible design, performing iterative optimization of a loss function according to the predicted value and the cavel region labeling data to obtain a detection model with completed target training, including:
extracting a real value of a real frame on the frame parameter according to the cavel region labeling data, wherein the real frame comprises a cavel labeling frame in the square image;
calculating the frame position loss value according to the following formula according to the predicted value and the real value
Figure 778638DEST_PATH_IMAGE004
Figure 705006DEST_PATH_IMAGE005
In the formula (I), the compound is shown in the specification,
Figure 394744DEST_PATH_IMAGE006
the frame of the target is represented by a frame,
Figure 13945DEST_PATH_IMAGE007
representing the real border of the frame,
Figure 186038DEST_PATH_IMAGE008
representing the intersection ratio of the target bounding box and the real bounding box,
Figure 384938DEST_PATH_IMAGE009
representing a Euclidean distance between a center of the target bounding box and a center of the real bounding box,
Figure 584975DEST_PATH_IMAGE010
representing a diagonal length of a minimum bounding box that bounds the target bounding box and the real bounding box,
Figure 984863DEST_PATH_IMAGE011
it is indicated that the intermediate quantities are calculated,
Figure 411297DEST_PATH_IMAGE012
representing the real value of the bounding box width among the real values,
Figure 351571DEST_PATH_IMAGE013
representing the real values of the bounding box heights among the real values,
Figure 406115DEST_PATH_IMAGE014
representing a bounding box width prediction value of the prediction values,
Figure 478369DEST_PATH_IMAGE015
representing a bounding box height prediction value of the prediction values,
Figure 251153DEST_PATH_IMAGE016
representing the circumferential ratio;
calculating a frame confidence coefficient loss value according to the predicted value and the true value and the following formula
Figure 198380DEST_PATH_IMAGE017
Figure 107431DEST_PATH_IMAGE018
In the formula (I), the compound is shown in the specification,
Figure 973755DEST_PATH_IMAGE019
which represents a pre-set weight parameter that is,
Figure 843623DEST_PATH_IMAGE020
respectively represent a positive integer, and each represents a positive integer,
Figure 719175DEST_PATH_IMAGE021
representing a total number of bounding boxes of the plurality of target bounding boxes,
Figure 623677DEST_PATH_IMAGE022
is shown with
Figure 565963DEST_PATH_IMAGE024
Corresponding to each grid
Figure 313339DEST_PATH_IMAGE025
Whether the logic value of the cavel is predicted by each target frame or not is judged, if yes, the value is 1, and if not, the value is 0,
Figure 602369DEST_PATH_IMAGE026
represents the first
Figure 486011DEST_PATH_IMAGE027
Each target frame contains the probability score of the goat's horn,
Figure 569505DEST_PATH_IMAGE028
represents the first
Figure 538598DEST_PATH_IMAGE027
Each target frame comprises a probability score predicted value of the goat horn;
calculating a class prediction loss value according to the following formula according to the predicted value and the true value
Figure 365740DEST_PATH_IMAGE029
Figure 103888DEST_PATH_IMAGE030
In the formula (I), the compound is shown in the specification,
Figure 482917DEST_PATH_IMAGE031
respectively represent a positive integer, and each represents a positive integer,
Figure 316137DEST_PATH_IMAGE032
representing a total number of bounding boxes of the plurality of target bounding boxes,
Figure 71604DEST_PATH_IMAGE033
is shown with
Figure 539625DEST_PATH_IMAGE034
Corresponding to each grid
Figure 355135DEST_PATH_IMAGE027
Whether the target frame is responsible for predicting the logic value of the cavel or not is judged, if yes, the value is 1, and if not, the value is 0,
Figure 767661DEST_PATH_IMAGE035
a frame class is represented that is a frame class,
Figure 202185DEST_PATH_IMAGE036
a set of bounding box categories is represented,
Figure 914926DEST_PATH_IMAGE037
is represented by the second
Figure 776703DEST_PATH_IMAGE027
The actual code value of the frame class corresponding to the target frame,
Figure 847165DEST_PATH_IMAGE038
is represented by the second
Figure 944434DEST_PATH_IMAGE027
The frame type corresponding to each target frame is predicted and coded;
losing the frame position value
Figure 246102DEST_PATH_IMAGE039
The frame confidence loss value
Figure 278780DEST_PATH_IMAGE040
And the class prediction loss value
Figure 665899DEST_PATH_IMAGE041
The sum is used as a loss function calculation result so as to carry out iterative optimization of the loss function and obtain the detection model.
In one possible design, the opening and closing operation processing is performed on the binarized image to obtain a new cavel image, and the method includes:
the open operation processing is performed according to the following formula:
Figure 442225DEST_PATH_IMAGE042
in the formula (I), the compound is shown in the specification,
Figure 863979DEST_PATH_IMAGE043
representing a new cavel image obtained after the opening operation processing,
Figure 192192DEST_PATH_IMAGE044
representing the binarized image before the on operation processing,
Figure 941974DEST_PATH_IMAGE045
the structural elements of the on-operation are represented,
Figure 381045DEST_PATH_IMAGE046
it is shown that the etching treatment is performed,
Figure 299716DEST_PATH_IMAGE047
showing the expansion treatment;
and/or performing closed operation processing according to the following formula:
Figure 533251DEST_PATH_IMAGE048
in the formula (I), the compound is shown in the specification,
Figure 160542DEST_PATH_IMAGE049
representing a new cavel image obtained after the closed operation processing,
Figure 278671DEST_PATH_IMAGE050
representing the binarized image before the closed arithmetic operation processing,
Figure 675017DEST_PATH_IMAGE051
the structural elements of the closed-loop operation are represented,
Figure 220399DEST_PATH_IMAGE052
it is shown that the etching treatment is performed,
Figure 803827DEST_PATH_IMAGE053
showing the expansion process.
In one possible design, after determining whether the cavel is qualified in the current state according to the comparison result between the real-time value of the cavel geometric parameter and the design allowable variation range, the method further includes:
and if the cavel is judged to be unqualified in the current state, calculating the difference between the real-time value of the geometrical parameters of the cavel and the boundary value of the design allowable variation range, and outputting warning information containing the difference.
In one possible design, the target detection model employs a Faster R-CNN target detection model, an SSD target detection module, or a YOLO target detection model.
The invention provides a real-time detection device for a pantograph goat horn, which comprises a video acquisition module, a equalization processing module, a goat horn area identification module, a goat horn image interception module, a binarization processing module, an opening and closing operation processing module, a goat horn contour fitting module, a goat horn parameter acquisition module and a goat horn qualification judgment module which are sequentially in communication connection;
the video acquisition module is used for acquiring videos acquired by the monitoring camera in real time, wherein the monitoring camera is installed on the roof of the vehicle and enables the camera view to cover the area where the pantograph is located;
the equalization processing module is used for carrying out histogram equalization processing on the latest image in the video to obtain a sample image to be detected;
the cavel region identification module is used for guiding the sample image to be detected into the trained target detection model and identifying the region position of the cavel of the pantograph in the sample image to be detected;
the goat horn image intercepting module is used for intercepting a goat horn image from the sample image to be detected according to the position of the area;
the binarization processing module is used for carrying out binarization processing on the cavel image to obtain a binarization image;
the switching operation processing module is used for carrying out switching operation processing on the binary image to obtain a new cavel image;
the cavel contour fitting module is used for fitting to obtain a real-time geometric contour of the cavel according to the new cavel image;
the cavel parameter acquiring module is used for acquiring a real-time value of a cavel geometric parameter according to the real-time geometric contour, wherein the cavel geometric parameter comprises cavel width, cavel height and/or cavel area;
and the horn qualification judging module is used for judging whether the horn is qualified in the current state according to the comparison result of the real-time value of the geometric parameters of the horn and the design allowable variation range.
In a third aspect, the present invention provides a computer device, comprising a memory, a processor and a transceiver, which are sequentially connected in communication, wherein the memory is used for storing a computer program, the transceiver is used for transceiving data, and the processor is used for reading the computer program and executing the method according to the first aspect or any one of the possible designs of the first aspect.
In a fourth aspect, the present invention provides a storage medium having stored thereon instructions for carrying out the method according to the first aspect or any one of the possible designs of the first aspect, when the instructions are run on a computer.
In a fifth aspect, the present invention provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method as described above in the first aspect or any one of the possible designs of the first aspect.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flow chart of the real-time detection method for the toe of a pantograph provided by the invention.
Fig. 2 is an exemplary diagram of a video captured by a monitoring camera according to the present invention.
Fig. 3 is an exemplary diagram of a clipped cavel image provided by the present invention.
FIG. 4 is an exemplary graph of a goat's horn profile from a new goat's horn image fitting provided by the present invention.
Fig. 5 is a schematic structural diagram of the real-time detection device for the toe of a pantograph according to the present invention.
Fig. 6 is a schematic structural diagram of a computer device provided by the present invention.
Detailed Description
The invention is further described with reference to the following figures and specific embodiments. It should be noted that the description of the embodiments is provided to help understanding of the present invention, but the present invention is not limited thereto. Specific structural and functional details disclosed herein are merely representative of exemplary embodiments of the invention. This invention may, however, be embodied in many alternate forms and should not be construed as limited to the embodiments set forth herein.
It will be understood that, although the terms first, second, etc. may be used herein to describe various objects, these objects should not be limited by these terms. These terms are only used to distinguish one object from another. For example, a first object may be referred to as a second object, and similarly, a second object may be referred to as a first object, without departing from the scope of example embodiments of the present invention.
It should be understood that, for the term "and/or" as may appear herein, it is merely an associative relationship that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, B exists alone or A and B exist at the same time; for the term "/and" as may appear herein, which describes another associative object relationship, it means that two relationships may exist, e.g., a/and B, may mean: a exists singly or A and B exist simultaneously; in addition, for the character "/" that may appear herein, it generally means that the former and latter associated objects are in an "or" relationship.
As shown in fig. 1 to 4, the real-time detection method for a pantograph claw according to the first aspect of the present embodiment may be, but is not limited to being, executed by a computer device disposed in an interior cabinet of a vehicle and communicatively connected to a roof monitoring camera. The real-time detection method for the pantograph sheep horn can include, but is not limited to, the following steps S1 to S9.
S1, acquiring a video acquired by a monitoring camera in real time, wherein the monitoring camera is installed on the roof of the vehicle and enables the camera view to cover the area where the pantograph is located.
In step S1, since the camera view covers the area where the pantograph is located, a complete pantograph picture can be obtained in the obtained video, as shown in fig. 2. In addition, the computer equipment is in communication connection with the monitoring camera, so that the video can be transmitted in real time after being collected.
And S2, carrying out histogram equalization processing on the latest image in the video to obtain a sample image to be detected.
In step S2, the histogram equalization processing is a conventional Image preprocessing method, which is a method for enhancing Image Contrast (Image Contrast), and the main idea is to change the histogram distribution of one Image into an approximately uniform distribution, so as to enhance the Contrast of the Image.
And S3, importing the sample image to be detected into the trained target detection model, and identifying the area position of the horn of the pantograph in the sample image to be detected.
In the step S3, the target detection model is an existing artificial intelligence recognition model for recognizing objects in the picture and marking the positions of the objects, and specifically, but not limited to, the target detection algorithm proposed in 2015 by using fast R-CNN (fast Regions with conditional Neural Networks, by which he kamin et al, which obtains multiple first target detection models in the ILSVRV and COCO contest in 2015, SSD (Single Shot multiple box Detector, which is one of the currently popular main detection frames proposed by Wei Liu) target detection module or YOLO (youonly lok, which has been recently developed to V4 version, has wide application in the industry, which is based on the principle that firstly, 2 frames are predicted for each 7x7 grid for the input image, and then removing the target window with low possibility according to the threshold, and finally removing the redundant window by using a frame combination mode to obtain a detection result) and the like. Therefore, after the identification training of the target detection model on the goat horn image is completed, the goat horn can be identified in the sample image to be detected, and the goat horn position is marked.
Before the step S3, in order to complete the training of the target detection model, the method further includes, but is not limited to, the following steps S21 to S24.
And S21, acquiring a pantograph monitoring video historically acquired by the monitoring camera in one trip.
In the step S21, since the pantograph monitoring video is historically acquired in one trip, it can be ensured that the cavel images in the subsequent training sample images are non-static, and better meet the real-time detection condition, and the real-time detection accuracy of the target detection model obtained by training is ensured.
And S22, respectively carrying out histogram equalization processing on each frame of image in the pantograph monitoring video to obtain a plurality of training sample images.
And S23, acquiring the horn area labeling data which correspond to the training sample images in the plurality of training sample images one by one.
In the step S23, the cavel region labeling data is obtained by manual labeling.
And S24, importing the training sample image and the cavel region labeling data corresponding to the training sample image into the target detection model for training to obtain the trained target detection model.
In the step S24, the training sample image and the cavel region labeling data corresponding to the training sample image are imported into a YOLO-V4 target detection model (i.e., a V4 version of the YOLO target detection model, which includes an Input layer Input, a BackBone layer back bone, a Neck layer tack, and a Prediction layer Prediction, and finally a target detection result is output by the Prediction layer Prediction, which includes a detection target position and a confidence coefficient, where the detection target position is a coordinate region of a detection target in the whole image, and the confidence coefficient is an accuracy of the detection target), and the following training steps S241 to S244 are performed in the YOLO-V4 target detection model.
S241, adjusting the training sample image to have a target size and be divided into
Figure 991226DEST_PATH_IMAGE054
A square image of a grid, wherein,
Figure 507658DEST_PATH_IMAGE055
a natural number not less than 5 is represented.
In step S241, the adjustment of the image and the division of the mesh are both conventional manners in the YOLO target detection model. In addition to this, the present invention is,
Figure 722476DEST_PATH_IMAGE055
the value of (d) may be, for example, 7.
S242, judging whether the target center falls on the target center
Figure 58780DEST_PATH_IMAGE054
In a certain grid of the grids, wherein the target center is a center of a horn area of the pantograph.
In step S242, the specific determination manner is a conventional manner in the YOLO target detection model.
And S243, if yes, the grid is responsible for predicting a plurality of target frames and calculating the predicted value of each target frame in the target frames on frame parameters, wherein the frame parameters include, but are not limited to, frame center horizontal coordinates, frame center vertical coordinates, frame width, frame height, frame type, confidence degrees corresponding to the frame type and the like.
In the step S243, the prediction of the target frames and the calculation of the predicted values are both conventional in the YOLO target detection model.
And S244, performing iterative optimization of a loss function according to the predicted value and the cavel region labeling data to obtain a detection model which is finished with target training.
In said step S244, the iteration of the loss function is optimized in a conventional manner in the YOLO target detection model. More specifically, the method includes, but is not limited to, the following steps S2441 to S2445.
S2441, extracting a real value of a real frame on the frame parameter according to the cavel region labeling data, wherein the real frame comprises a cavel labeling frame in the square image.
S2442, calculating a frame position loss value according to the predicted value and the true value and the following formula
Figure 518711DEST_PATH_IMAGE039
Figure 889649DEST_PATH_IMAGE056
In the formula (I), the compound is shown in the specification,
Figure 776834DEST_PATH_IMAGE057
the frame of the target is represented by a frame,
Figure 866013DEST_PATH_IMAGE058
representing the real border of the frame,
Figure 864056DEST_PATH_IMAGE059
representing the intersection ratio of the target bounding box and the real bounding box,
Figure 355080DEST_PATH_IMAGE060
representing a Euclidean distance between a center of the target bounding box and a center of the real bounding box,
Figure 926349DEST_PATH_IMAGE061
representing a diagonal length of a minimum bounding box that bounds the target bounding box and the real bounding box,
Figure 237245DEST_PATH_IMAGE062
it is indicated that the intermediate quantities are calculated,
Figure 38979DEST_PATH_IMAGE063
representing the real value of the bounding box width among the real values,
Figure 650089DEST_PATH_IMAGE064
representing the real values of the bounding box heights among the real values,
Figure 613497DEST_PATH_IMAGE065
representing a bounding box width prediction value of the prediction values,
Figure 411688DEST_PATH_IMAGE066
representing a bounding box height prediction value of the prediction values,
Figure 17113DEST_PATH_IMAGE067
indicating the circumferential ratio.
S2443, calculating a frame confidence coefficient loss value according to the predicted value and the true value and the following formula
Figure 217150DEST_PATH_IMAGE068
Figure 115574DEST_PATH_IMAGE069
In the formula (I), the compound is shown in the specification,
Figure 135483DEST_PATH_IMAGE070
which represents a pre-set weight parameter that is,
Figure 669232DEST_PATH_IMAGE031
respectively represent a positive integer, and each represents a positive integer,
Figure 599142DEST_PATH_IMAGE032
representing a total number of bounding boxes of the plurality of target bounding boxes,
Figure 294566DEST_PATH_IMAGE033
is shown with
Figure 942716DEST_PATH_IMAGE071
Corresponding to each grid
Figure 14577DEST_PATH_IMAGE072
Whether the target frame is responsible for predicting the logic value of the cavel or not is judged, if yes, the value is 1, and if not, the value is 0,
Figure 533414DEST_PATH_IMAGE073
represents the first
Figure 665318DEST_PATH_IMAGE072
Each target frame contains the probability score of the goat's horn,
Figure 36650DEST_PATH_IMAGE074
represents the first
Figure 584306DEST_PATH_IMAGE072
Each target frame contains the probability score prediction value of the goat horn.
S2444, calculating a category prediction loss value according to the following formula according to the predicted value and the true value
Figure 347863DEST_PATH_IMAGE075
Figure 260455DEST_PATH_IMAGE076
In the formula (I), the compound is shown in the specification,
Figure 742252DEST_PATH_IMAGE077
respectively represent a positive integer, and each represents a positive integer,
Figure 562440DEST_PATH_IMAGE032
representing a total number of bounding boxes of the plurality of target bounding boxes,
Figure 819984DEST_PATH_IMAGE078
is shown with
Figure 293691DEST_PATH_IMAGE079
Corresponding to each grid
Figure 138150DEST_PATH_IMAGE027
Whether the target frame is responsible for predicting the logic value of the cavel or not is judged, if yes, the value is 1, and if not, the value is 0,
Figure 355505DEST_PATH_IMAGE080
a frame class is represented that is a frame class,
Figure 969020DEST_PATH_IMAGE081
a set of bounding box categories is represented,
Figure 613628DEST_PATH_IMAGE082
is represented by the second
Figure 945383DEST_PATH_IMAGE027
The actual code value of the frame class corresponding to the target frame,
Figure 700850DEST_PATH_IMAGE083
is represented by the second
Figure 201494DEST_PATH_IMAGE027
And the predicted coding value of the frame class corresponding to each target frame.
S2445, calculating the frame position loss value
Figure 751424DEST_PATH_IMAGE039
The frame confidence loss value
Figure 836055DEST_PATH_IMAGE084
And the classPredicting loss value
Figure 270579DEST_PATH_IMAGE085
The sum is used as a loss function calculation result so as to carry out iterative optimization of the loss function and obtain the trained target detection model.
The method for training the target detection model described in the foregoing steps S21-S24 may be executed on the computer device, or may be executed on another computer device, and then the trained target detection model is deployed on the computer device, so as to smoothly execute the step S3.
And S4, intercepting the image of the goat horn from the image of the sample to be detected according to the position of the area.
In step S4, since the cavel is identified in the sample image to be tested by the trained target detection model and the cavel position is marked, the cavel image can be easily obtained by clipping, as shown in fig. 3.
And S5, carrying out binarization processing on the cavel image to obtain a binarization image.
In step S5, the binarization processing is a conventional image preprocessing manner, that is, the gray scale value of the pixel points on the image is set to 0 (black) or 255 (white), specifically, the pixel value smaller than 127 is set to 0, and the pixel value greater than or equal to 127 is set to 255, that is, the whole image exhibits a distinct black-and-white effect.
And S6, carrying out opening and closing operation processing on the binary image to obtain a new cavel image.
In step S6, the open/close operation processing includes, but is not limited to, the following modes (a) and/or (B).
(A) The open operation processing is performed according to the following formula:
Figure 983320DEST_PATH_IMAGE086
in the formula (I), the compound is shown in the specification,
Figure 110676DEST_PATH_IMAGE087
representing a new cavel image obtained after the opening operation processing,
Figure 915558DEST_PATH_IMAGE088
representing the binarized image before the on operation processing,
Figure 12827DEST_PATH_IMAGE089
the structural elements of the on-operation are represented,
Figure 721020DEST_PATH_IMAGE052
it is shown that the etching treatment is performed,
Figure 878332DEST_PATH_IMAGE090
showing the expansion process.
(B) And performing closed operation processing according to the following formula:
Figure 265451DEST_PATH_IMAGE091
in the formula (I), the compound is shown in the specification,
Figure 41777DEST_PATH_IMAGE092
representing a new cavel image obtained after the closed operation processing,
Figure 463531DEST_PATH_IMAGE093
representing the binarized image before the closed arithmetic operation processing,
Figure 932690DEST_PATH_IMAGE094
the structural elements of the closed-loop operation are represented,
Figure 807105DEST_PATH_IMAGE052
it is shown that the etching treatment is performed,
Figure 988120DEST_PATH_IMAGE090
showing the expansion process.
And S7, fitting to obtain a real-time geometric outline of the goat horn according to the new goat horn image.
In step S7, since the cavel image is sequentially subjected to binarization processing and opening and closing operation processing, the cavel contour can be obviously represented in the new cavel image, and the real-time geometric contour of the cavel can be accurately obtained by fitting, as shown in fig. 4.
And S8, acquiring a real-time value of the geometrical parameters of the goat horn according to the real-time geometrical outline, wherein the geometrical parameters of the goat horn include but are not limited to goat horn width, goat horn height and/or goat horn area.
In step S8, as shown in fig. 4, since the real-time geometric profile of the cavel has been obtained, the real-time values of the cavel geometric parameters can be obtained based on conventional geometric knowledge.
And S9, judging whether the goat horn is qualified in the current state according to the comparison result of the real-time value of the geometrical parameter of the goat horn and the design allowable variation range.
In the step S9, the allowable design variation range is the design parameter of the cavel, and if the real-time value is within the allowable design variation range, it may be determined that the cavel is qualified in the current state and meets the design requirement, otherwise, it is determined that the cavel is not qualified in the current state, so as to achieve the purpose of real-time detection of the pantograph cavel. In addition, after judging whether the cavel is qualified in the current state according to the comparison result of the real-time value of the cavel geometric parameter and the design allowable variation range, the method may further include: and if the cavel is judged to be unqualified in the current state, calculating the difference between the real-time value of the geometrical parameters of the cavel and the boundary value of the design allowable variation range, and outputting warning information containing the difference. Therefore, the loss amount of the goat horn can be output, early warning is carried out, bow net accidents are avoided, and the running safety of the train is improved.
Therefore, through the real-time detection scheme of the pantograph sheep horn described in detail in the foregoing steps S1 to S9, the real-time detection scheme of the pantograph sheep horn can be firstly based on the machine vision target detection method to identify and position the sheep horn region of the pantograph sheep horn video acquired in real time from the roof, then the binarization processing, the opening and closing operation processing and the contour fitting extraction are performed on the sheep horn image obtained by identification, so as to obtain the geometrical contour of the pantograph horn and the real-time value of the geometrical parameter of the pantograph horn, and finally the real-time value of the geometrical parameter of the pantograph horn is compared with the allowable variation range of design to judge whether the pantograph horn is qualified in the current state, so as to achieve the real-time detection purpose of the pantograph sheep horn, compared with the existing automatic detection scheme, because only a roof camera and in-vehicle computer equipment are required to be configured, the detection system can be simplified, the installation and the hardware cost can be reduced, and the detection result can be prevented from being interfered by the external environment, the accuracy of the detection result is guaranteed, the occurrence of false alarm is reduced, extra rechecking workload brought to maintainers is avoided, and the method is particularly suitable for scenes in urban rail transit tunnels. In addition, as the geometrical parameters of the cavel can be accurately measured, compared with the existing automatic detection mode, the detection precision is greatly improved; and because the horn missing condition can be output and early-warning can be carried out when disqualification is found, the bow net accident can be avoided, and the running safety of the train is improved; and the source monitoring video (namely the video) can be directly checked while the detection is carried out, so that the detection result can be conveniently rechecked.
As shown in fig. 5, a second aspect of this embodiment provides a virtual device for implementing the real-time detection method of a pantograph goat's horn as possible in any one of the first aspect or the first aspect, including a video acquisition module, an equalization processing module, a goat's horn region identification module, a goat's horn image capture module, a binarization processing module, an on-off operation processing module, a goat's horn contour fitting module, a goat's horn parameter acquisition module, and a goat's horn qualification determination module, which are sequentially connected in a communication manner;
the video acquisition module is used for acquiring videos acquired by the monitoring camera in real time, wherein the monitoring camera is installed on the roof of the vehicle and enables the camera view to cover the area where the pantograph is located;
the equalization processing module is used for carrying out histogram equalization processing on the latest image in the video to obtain a sample image to be detected;
the cavel region identification module is used for guiding the sample image to be detected into the trained target detection model and identifying the region position of the cavel of the pantograph in the sample image to be detected;
the goat horn image intercepting module is used for intercepting a goat horn image from the sample image to be detected according to the position of the area;
the binarization processing module is used for carrying out binarization processing on the cavel image to obtain a binarization image;
the switching operation processing module is used for carrying out switching operation processing on the binary image to obtain a new cavel image;
the cavel contour fitting module is used for fitting to obtain a real-time geometric contour of the cavel according to the new cavel image;
the cavel parameter acquiring module is used for acquiring a real-time value of a cavel geometric parameter according to the real-time geometric contour, wherein the cavel geometric parameter comprises cavel width, cavel height and/or cavel area;
and the horn qualification judging module is used for judging whether the horn is qualified in the current state according to the comparison result of the real-time value of the geometric parameters of the horn and the design allowable variation range.
For the working process, working details and technical effects of the foregoing apparatus provided in the second aspect of this embodiment, reference may be made to the method described in the first aspect or any one of the possible designs of the first aspect, which is not described herein again.
As shown in fig. 6, a third aspect of this embodiment provides a computer device for executing the real-time detection method of a pantograph sheep corner as may be designed in any one of the first aspect or the first aspect, including a memory, a processor and a transceiver, which are sequentially and communicatively connected, where the memory is used for storing a computer program, the transceiver is used for transceiving data, and the processor is used for reading the computer program and executing the real-time detection method of a pantograph sheep corner as may be designed in any one of the first aspect or the first aspect. For example, the Memory may include, but is not limited to, a Random-Access Memory (RAM), a Read-Only Memory (ROM), a Flash Memory (Flash Memory), a First-in First-out (FIFO), and/or a First-in Last-out (FILO), and the like; the processor may be, but is not limited to, a microprocessor of the model number STM32F105 family. In addition, the computer device may also include, but is not limited to, a power module, a display screen, and other necessary components.
For the working process, working details, and technical effects of the foregoing computer device provided in the third aspect of this embodiment, reference may be made to the method in the first aspect or any one of the possible designs in the first aspect, which is not described herein again.
A fourth aspect of the present embodiment provides a storage medium storing instructions including any one of the first aspect or any one of the first aspect possible designs of the real-time detection method for a pantograph sheep corner, that is, the storage medium stores instructions that, when executed on a computer, perform the real-time detection method for a pantograph sheep corner as described in any one of the first aspect or any one of the first aspect possible designs. The storage medium refers to a carrier for storing data, and may include, but is not limited to, a computer-readable storage medium such as a floppy disk, an optical disk, a hard disk, a flash Memory, a flash disk and/or a Memory Stick (Memory Stick), and the computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.
For the working process, the working details and the technical effects of the foregoing readable storage medium provided in the fourth aspect of this embodiment, reference may be made to the method in the first aspect or any one of the possible designs in the first aspect, which is not described herein again.
A fifth aspect of the present embodiment provides a computer program product containing instructions for causing a computer to execute the real-time detection method of the cavum pantograph as described in the first aspect or any one of the possible designs of the first aspect when the instructions are run on the computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable devices.
Finally, it should be noted that the present invention is not limited to the above alternative embodiments, and that various other forms of products can be obtained by anyone in light of the present invention. The above detailed description should not be taken as limiting the scope of the invention, which is defined in the claims, and which the description is intended to be interpreted accordingly.

Claims (10)

1. A real-time detection method for a pantograph goat's horn is characterized by comprising the following steps:
acquiring a video acquired by a monitoring camera in real time, wherein the monitoring camera is arranged on the roof of the vehicle and enables the camera view to cover the area where the pantograph is located;
carrying out histogram equalization processing on the latest image in the video to obtain a sample image to be detected;
importing the sample image to be tested into a trained target detection model, and identifying the position of the goat's horn of the pantograph in the area of the sample image to be tested;
intercepting a goat horn image from the sample image to be detected according to the position of the area;
carrying out binarization processing on the cavel image to obtain a binarized image;
carrying out opening and closing operation processing on the binary image to obtain a new cavel image;
fitting to obtain a real-time geometric outline of the goat horn according to the new goat horn image;
acquiring a real-time value of a goat horn geometric parameter according to the real-time geometric contour, wherein the goat horn geometric parameter comprises goat horn width, goat horn height and/or goat horn area;
and judging whether the goat horn is qualified in the current state according to the comparison result of the real-time value of the goat horn geometric parameter and the design allowable variation range.
2. The method for real-time detection of the angle of a pantograph as claimed in claim 1, wherein before introducing the image of the sample to be detected into the trained target detection model, the method further comprises:
acquiring a pantograph monitoring video historically acquired by the monitoring camera in one trip;
respectively carrying out histogram equalization processing on each frame of image in the pantograph monitoring video to obtain a plurality of training sample images;
acquiring horn region labeling data corresponding to each training sample image in the plurality of training sample images one to one;
and importing the training sample image and the cavel region labeling data corresponding to the training sample image into the target detection model for training to obtain the trained target detection model.
3. The real-time detection method of the pantograph sheep horn according to claim 1, wherein the step of importing the training sample image and the sheep horn region labeling data corresponding to the training sample image into the target detection model for training to obtain the trained target detection model comprises:
importing the training sample image and the cavel region labeling data corresponding to the training sample image into a YOLO-v4 target detection model, and executing the following training steps in the YOLO-v4 target detection model:
adjusting the training sample image to have a target size and is divided into
Figure 654480DEST_PATH_IMAGE001
A square image of a grid, wherein,
Figure 588938DEST_PATH_IMAGE002
a natural number not less than 5;
judging whether the target center falls on the target center
Figure 785565DEST_PATH_IMAGE003
In a certain grid of the grids, wherein the target center is a center of a horn area of the pantograph;
if so, the grid is responsible for predicting a plurality of target frames and calculating to obtain the predicted value of each target frame in the target frames on frame parameters, wherein the frame parameters comprise a frame center horizontal coordinate, a frame center vertical coordinate, a frame width, a frame height, a frame type and a confidence coefficient corresponding to the frame type;
and performing iterative optimization of a loss function according to the predicted value and the cavel region labeling data to obtain a detection model which is finished with target training.
4. The method for real-time detection of the toe of a pantograph of claim 3, wherein the iterative optimization of the loss function is performed according to the predicted value and the labeled data of the toe area to obtain a detection model with a completed target training, comprising:
extracting a real value of a real frame on the frame parameter according to the cavel region labeling data, wherein the real frame comprises a cavel labeling frame in the square image;
calculating the frame position loss value according to the following formula according to the predicted value and the real value
Figure 211998DEST_PATH_IMAGE004
Figure 621114DEST_PATH_IMAGE005
In the formula (I), the compound is shown in the specification,
Figure 675657DEST_PATH_IMAGE006
the frame of the target is represented by a frame,
Figure 279070DEST_PATH_IMAGE007
representing the real border of the frame,
Figure 786275DEST_PATH_IMAGE008
representing the intersection ratio of the target bounding box and the real bounding box,
Figure 733502DEST_PATH_IMAGE009
representing a Euclidean distance between a center of the target bounding box and a center of the real bounding box,
Figure 908132DEST_PATH_IMAGE010
representing a diagonal length of a minimum bounding box that bounds the target bounding box and the real bounding box,
Figure 649823DEST_PATH_IMAGE011
it is indicated that the intermediate quantities are calculated,
Figure 316428DEST_PATH_IMAGE012
representing the real value of the bounding box width among the real values,
Figure 926400DEST_PATH_IMAGE013
representing the real values of the bounding box heights among the real values,
Figure 329438DEST_PATH_IMAGE014
representing a bounding box width prediction value of the prediction values,
Figure 366664DEST_PATH_IMAGE015
representing a bounding box height prediction value of the prediction values,
Figure 254985DEST_PATH_IMAGE016
representing the circumferential ratio;
calculating a frame confidence coefficient loss value according to the predicted value and the true value and the following formula
Figure 544015DEST_PATH_IMAGE017
Figure 693237DEST_PATH_IMAGE018
In the formula (I), the compound is shown in the specification,
Figure 42310DEST_PATH_IMAGE019
which represents a pre-set weight parameter that is,
Figure 11403DEST_PATH_IMAGE020
respectively represent a positive integer, and each represents a positive integer,
Figure 605589DEST_PATH_IMAGE021
representing a total number of bounding boxes of the plurality of target bounding boxes,
Figure 484683DEST_PATH_IMAGE022
is shown with
Figure 863712DEST_PATH_IMAGE023
Corresponding to each grid
Figure 195467DEST_PATH_IMAGE024
Whether individual target bounding box is responsible for prediction
The logical value of the goat horn is 1 when the logical value is positive and 0 when the logical value is negative,
Figure 950933DEST_PATH_IMAGE025
represents the first
Figure 684534DEST_PATH_IMAGE024
Each target frame contains the probability of the goat's horn,
Figure 500044DEST_PATH_IMAGE026
represents the first
Figure 817630DEST_PATH_IMAGE024
Each target frame comprises a probability score predicted value of the goat horn;
calculating a class prediction loss value according to the following formula according to the predicted value and the true value
Figure 376787DEST_PATH_IMAGE027
Figure 964895DEST_PATH_IMAGE028
In the formula (I), the compound is shown in the specification,
Figure 951305DEST_PATH_IMAGE029
respectively represent a positive integer, and each represents a positive integer,
Figure 257653DEST_PATH_IMAGE021
representing a total number of bounding boxes of the plurality of target bounding boxes,
Figure 354922DEST_PATH_IMAGE030
is shown with
Figure 797536DEST_PATH_IMAGE031
Corresponding to each grid
Figure 954847DEST_PATH_IMAGE024
Whether the target frame is responsible for predicting the logic value of the cavel or not is judged, if yes, the value is 1, and if not, the value is 0,
Figure 515535DEST_PATH_IMAGE032
a frame class is represented that is a frame class,
Figure 291861DEST_PATH_IMAGE033
a set of bounding box categories is represented,
Figure 979195DEST_PATH_IMAGE034
is represented by the second
Figure 182774DEST_PATH_IMAGE024
The actual code value of the frame class corresponding to the target frame,
Figure 322768DEST_PATH_IMAGE035
is represented by the second
Figure 433944DEST_PATH_IMAGE024
The frame type corresponding to each target frame is predicted and coded;
losing the frame position value
Figure 334640DEST_PATH_IMAGE004
The frame confidence loss value
Figure 240279DEST_PATH_IMAGE036
And the class prediction loss value
Figure 742935DEST_PATH_IMAGE037
The sum is used as a loss function calculation result so as to carry out iterative optimization of the loss function and obtain the detection model.
5. The real-time detection method for the toe of a pantograph as claimed in claim 1, wherein the step of performing an on-off operation on the binarized image to obtain a new toe image comprises the steps of:
the open operation processing is performed according to the following formula:
Figure 628108DEST_PATH_IMAGE038
in the formula (I), the compound is shown in the specification,
Figure 368662DEST_PATH_IMAGE039
representing a new cavel image obtained after the opening operation processing,
Figure 38678DEST_PATH_IMAGE040
representing the binarized image before the on operation processing,
Figure 28631DEST_PATH_IMAGE041
the structural elements of the on-operation are represented,
Figure 809505DEST_PATH_IMAGE042
it is shown that the etching treatment is performed,
Figure 699838DEST_PATH_IMAGE043
showing the expansion treatment;
and/or performing closed operation processing according to the following formula:
Figure 540755DEST_PATH_IMAGE044
in the formula (I), the compound is shown in the specification,
Figure 18004DEST_PATH_IMAGE045
representing a new cavel image obtained after the closed operation processing,
Figure 602569DEST_PATH_IMAGE046
representing the binarized image before the closed arithmetic operation processing,
Figure 114453DEST_PATH_IMAGE047
the structural elements of the closed-loop operation are represented,
Figure 860692DEST_PATH_IMAGE048
it is shown that the etching treatment is performed,
Figure 559658DEST_PATH_IMAGE043
showing the expansion process.
6. The method for real-time detection of a pantograph sheep horn as claimed in claim 1, wherein after determining whether the sheep horn is qualified in a current state according to a comparison result of the real-time value of the geometrical parameter of the sheep horn and a design allowable variation range, the method further comprises:
and if the cavel is judged to be unqualified in the current state, calculating the difference between the real-time value of the geometrical parameters of the cavel and the boundary value of the design allowable variation range, and outputting warning information containing the difference.
7. The method of claim 1, wherein the target detection model is fast R-CNN target detection model, SSD target detection module or YOLO target detection model.
8. A real-time detection device for a pantograph goat horn is characterized by comprising a video acquisition module, a equalization processing module, a goat horn area identification module, a goat horn image intercepting module, a binarization processing module, an opening and closing operation processing module, a goat horn contour fitting module, a goat horn parameter acquisition module and a goat horn qualification judgment module which are sequentially in communication connection;
the video acquisition module is used for acquiring videos acquired by the monitoring camera in real time, wherein the monitoring camera is installed on the roof of the vehicle and enables the camera view to cover the area where the pantograph is located;
the equalization processing module is used for carrying out histogram equalization processing on the latest image in the video to obtain a sample image to be detected;
the cavel region identification module is used for guiding the sample image to be detected into the trained target detection model and identifying the region position of the cavel of the pantograph in the sample image to be detected;
the goat horn image intercepting module is used for intercepting a goat horn image from the sample image to be detected according to the position of the area;
the binarization processing module is used for carrying out binarization processing on the cavel image to obtain a binarization image;
the switching operation processing module is used for carrying out switching operation processing on the binary image to obtain a new cavel image;
the cavel contour fitting module is used for fitting to obtain a real-time geometric contour of the cavel according to the new cavel image;
the cavel parameter acquiring module is used for acquiring a real-time value of a cavel geometric parameter according to the real-time geometric contour, wherein the cavel geometric parameter comprises cavel width, cavel height and/or cavel area;
and the horn qualification judging module is used for judging whether the horn is qualified in the current state according to the comparison result of the real-time value of the geometric parameters of the horn and the design allowable variation range.
9. A computer device, comprising a memory, a processor and a transceiver, which are sequentially connected in communication, wherein the memory is used for storing a computer program, the transceiver is used for transmitting and receiving data, and the processor is used for reading the computer program and executing the real-time detection method of the angle of a pantograph as claimed in any one of claims 1 to 7.
10. A storage medium having stored thereon instructions for performing the real-time detection method of a pantograph horn according to any one of claims 1 to 7 when the instructions are run on a computer.
CN202110919528.9A 2021-08-11 2021-08-11 Pantograph cavel real-time detection method, device, computer equipment and storage medium Active CN113362330B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110919528.9A CN113362330B (en) 2021-08-11 2021-08-11 Pantograph cavel real-time detection method, device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110919528.9A CN113362330B (en) 2021-08-11 2021-08-11 Pantograph cavel real-time detection method, device, computer equipment and storage medium

Publications (2)

Publication Number Publication Date
CN113362330A true CN113362330A (en) 2021-09-07
CN113362330B CN113362330B (en) 2021-11-30

Family

ID=77522973

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110919528.9A Active CN113362330B (en) 2021-08-11 2021-08-11 Pantograph cavel real-time detection method, device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113362330B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117315670A (en) * 2023-09-26 2023-12-29 天津市金超利达科技有限公司 Water meter reading area detection method based on computer vision

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180253613A1 (en) * 2017-03-06 2018-09-06 Honda Motor Co., Ltd. System and method for vehicle control based on red color and green color detection
CN108981811A (en) * 2018-07-18 2018-12-11 东莞市诺丽电子科技有限公司 A kind of train pantograph on-line detecting system
CN111260629A (en) * 2020-01-16 2020-06-09 成都地铁运营有限公司 Pantograph structure abnormity detection algorithm based on image processing
CN111967393A (en) * 2020-08-18 2020-11-20 杭州师范大学 Helmet wearing detection method based on improved YOLOv4
CN112132789A (en) * 2020-08-30 2020-12-25 南京理工大学 Pantograph online detection device and method based on cascade neural network
CN112381031A (en) * 2020-11-24 2021-02-19 中国科学院上海微系统与信息技术研究所 Real-time online pantograph sheep horn detection method based on convolutional neural network
CN112767357A (en) * 2021-01-20 2021-05-07 沈阳建筑大学 Yolov 4-based concrete structure disease detection method
CN112861959A (en) * 2021-02-02 2021-05-28 南京天创电子技术有限公司 Automatic labeling method for target detection image

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180253613A1 (en) * 2017-03-06 2018-09-06 Honda Motor Co., Ltd. System and method for vehicle control based on red color and green color detection
CN108981811A (en) * 2018-07-18 2018-12-11 东莞市诺丽电子科技有限公司 A kind of train pantograph on-line detecting system
CN111260629A (en) * 2020-01-16 2020-06-09 成都地铁运营有限公司 Pantograph structure abnormity detection algorithm based on image processing
CN111967393A (en) * 2020-08-18 2020-11-20 杭州师范大学 Helmet wearing detection method based on improved YOLOv4
CN112132789A (en) * 2020-08-30 2020-12-25 南京理工大学 Pantograph online detection device and method based on cascade neural network
CN112381031A (en) * 2020-11-24 2021-02-19 中国科学院上海微系统与信息技术研究所 Real-time online pantograph sheep horn detection method based on convolutional neural network
CN112767357A (en) * 2021-01-20 2021-05-07 沈阳建筑大学 Yolov 4-based concrete structure disease detection method
CN112861959A (en) * 2021-02-02 2021-05-28 南京天创电子技术有限公司 Automatic labeling method for target detection image

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
ALEXEY BOCHKOVSKIY ET AL.: "YOLOv4: Optimal Speed and Accuracy of Object Detection", 《ARXIV:2004.10934V1》 *
ENHONG WANG ET AL.: "An Early Warning Method of Pantograph Horn Drilling Based on Superpixel HOG Algorithm and YOLOv3 Smart Detector", 《RESILIENCE AND SUSTAINABLE TRANSPORTATION SYSTEMS》 *
朱晓恒: "受电弓典型故障图像检测算法的研究", 《中国优秀博硕士学位论文全文数据库(硕士) 信息科技辑》 *
王淑青 等: "基于YOLOv4神经网络的小龙虾质量检测方法", 《食品与机械》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117315670A (en) * 2023-09-26 2023-12-29 天津市金超利达科技有限公司 Water meter reading area detection method based on computer vision

Also Published As

Publication number Publication date
CN113362330B (en) 2021-11-30

Similar Documents

Publication Publication Date Title
CN104134222A (en) Traffic flow monitoring image detecting and tracking system and method based on multi-feature fusion
CN106023076B (en) The method of the damage condition of the protective fence of the joining method and detection high-speed railway of panorama sketch
CN103442209A (en) Video monitoring method of electric transmission line
CN111652296A (en) Deep learning-based rail wagon lower pull rod fracture fault detection method
JPWO2019111976A1 (en) Object detection device, prediction model creation device, object detection method and program
CN113298059A (en) Pantograph foreign matter intrusion detection method, device, computer equipment, system and storage medium
CN107909012B (en) Real-time vehicle tracking detection method and device based on disparity map
CN110135302B (en) Method, device, equipment and storage medium for training lane line recognition model
CN113324864A (en) Pantograph carbon slide plate abrasion detection method based on deep learning target detection
CN113436157A (en) Vehicle-mounted image identification method for pantograph fault
CN111626170A (en) Image identification method for railway slope rockfall invasion limit detection
CN113362330B (en) Pantograph cavel real-time detection method, device, computer equipment and storage medium
CN111582084B (en) Weak supervision learning-based rail foreign matter detection method and system under empty base view angle
CN115600124A (en) Subway tunnel inspection system and inspection method
CN115761537A (en) Power transmission line foreign matter intrusion identification method oriented to dynamic characteristic supplement mechanism
CN113657305B (en) Video-based intelligent detection method for black smoke vehicle and ringeman blackness level
CN114359286A (en) Insulator defect identification method, device and medium based on artificial intelligence
Zheng et al. Rail detection based on LSD and the least square curve fitting
CN115359306A (en) Intelligent identification method and system for high-definition images of railway freight inspection
Song et al. Modeling and optimization of semantic segmentation for track bed foreign object based on attention mechanism
CN111814582B (en) Method and device for processing driver behavior monitoring image
CN113920089A (en) Target detection method and device and electronic controller
CN111723792B (en) Real-time positioning point identification method suitable for rigid-flexible contact network
CN114066895B (en) Detection method and device for pantograph slide plate
CN114005097A (en) Train operation environment real-time detection method and system based on image semantic segmentation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20220614

Address after: 215300 room 807, building 1, 268 Dengyun Road, Yushan Town, Kunshan City, Suzhou City, Jiangsu Province

Patentee after: Jiangsu LUHANG Rail Transit Technology Co.,Ltd.

Address before: 215300 room 807, building 1, 268 Dengyun Road, Yushan Town, Kunshan City, Suzhou City, Jiangsu Province

Patentee before: KUNSHAN HIGH-NEW TRACK TRAFFIC INTELLIGENT EQUIPMENT Co.,Ltd.

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20221014

Address after: 215300 room 807, building 1, 268 Dengyun Road, Yushan Town, Kunshan City, Suzhou City, Jiangsu Province

Patentee after: KUNSHAN HIGH-NEW TRACK TRAFFIC INTELLIGENT EQUIPMENT Co.,Ltd.

Address before: 215300 room 807, building 1, 268 Dengyun Road, Yushan Town, Kunshan City, Suzhou City, Jiangsu Province

Patentee before: Jiangsu LUHANG Rail Transit Technology Co.,Ltd.

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20230419

Address after: 503-505, Building B, Tianhong Science and Technology Building, No. 18 Changwu Middle Road, Wujin District, Changzhou City, Jiangsu Province, 213164

Patentee after: CHANGZHOU LUHANG RAILWAY TRANSPORTATION TECHNOLOGY CO.,LTD.

Address before: 215300 room 807, building 1, 268 Dengyun Road, Yushan Town, Kunshan City, Suzhou City, Jiangsu Province

Patentee before: KUNSHAN HIGH-NEW TRACK TRAFFIC INTELLIGENT EQUIPMENT Co.,Ltd.

TR01 Transfer of patent right