CN114743166A - Method for detecting brake of railway wagon - Google Patents

Method for detecting brake of railway wagon Download PDF

Info

Publication number
CN114743166A
CN114743166A CN202210396632.9A CN202210396632A CN114743166A CN 114743166 A CN114743166 A CN 114743166A CN 202210396632 A CN202210396632 A CN 202210396632A CN 114743166 A CN114743166 A CN 114743166A
Authority
CN
China
Prior art keywords
detection
brake
network model
information
neural network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210396632.9A
Other languages
Chinese (zh)
Other versions
CN114743166B (en
Inventor
赵波
张渝
彭建平
黄炜
章祥
胡继东
彭华
喻飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Antie Software Technology Co ltd
Original Assignee
Beijing Antie Software Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Antie Software Technology Co ltd filed Critical Beijing Antie Software Technology Co ltd
Priority to CN202210396632.9A priority Critical patent/CN114743166B/en
Publication of CN114743166A publication Critical patent/CN114743166A/en
Application granted granted Critical
Publication of CN114743166B publication Critical patent/CN114743166B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Biophysics (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Quality & Reliability (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Train Traffic Observation, Control, And Security (AREA)

Abstract

本发明公开了一种铁路货车的制动机检测方法,包括:获取铁路货车的参数信息;在RGV小车沿第一方向行驶时,实时获取RGV小车的定位信息,基于所述参数信息和所述定位信息实时生成多列车厢的第一目标检测区域,所述RGV小车采集所述第一目标检测区域内的多张第一检测图像;获取预训练的神经网络模型,将多张所述第一检测图像输入所述神经网络模型生成第一缺陷检测结果;基于所述第一缺陷检测结果生成在RGV小车沿第二方向行驶时的第二目标检测区域,所述RGV小车采集所述第二目标检测区域内的多张第二检测图像,将多张所述第二检测图像输入所述神经网络模型生成第二缺陷检测结果;基于所述第一缺陷检测结果和所述第二缺陷检测结果生成制动机缺陷检测报告。

Figure 202210396632

The invention discloses a method for detecting a brake of a railway freight car, comprising: acquiring parameter information of the railway freight car; acquiring the positioning information of the RGV car in real time when the RGV car travels in a first direction, and obtaining the positioning information of the RGV car in real time based on the parameter information and the The positioning information generates the first target detection area of multiple carriages in real time, and the RGV car collects a plurality of first detection images in the first target detection area; The detection image is input into the neural network model to generate a first defect detection result; based on the first defect detection result, a second target detection area is generated when the RGV trolley travels in the second direction, and the RGV trolley collects the second target Detecting a plurality of second detection images in the area, inputting the plurality of second detection images into the neural network model to generate a second defect detection result; generating a second defect detection result based on the first defect detection result and the second defect detection result Brake defect inspection report.

Figure 202210396632

Description

一种铁路货车的制动机检测方法Brake detection method of a railway freight car

技术领域technical field

本发明涉及轨道车辆检测技术领域,具体涉及一种铁路货车的制动机检测方法。The invention relates to the technical field of rail vehicle detection, in particular to a brake detection method of a railway freight vehicle.

背景技术Background technique

为确保安全运营,故障检测在交通领域扮演了一个主要角色。铁路,航空,航海以及公路桥梁维护中存在着运用故障检测的大量典型事例。由于交通领域责任重大,一旦重要设备出现故障,将引起人员和财产的巨大损失,因此世界上许多国家都投入了大量的人力、物力和财力进行故障检测的研究。故障检测已经成为了当今交通领域的研究热点之一。To ensure safe operation, fault detection plays a major role in the transportation sector. There are many typical examples of applying fault detection in railway, aviation, marine and highway bridge maintenance. Due to the heavy responsibility in the field of transportation, once the important equipment fails, it will cause huge loss of personnel and property. Therefore, many countries in the world have invested a lot of manpower, material resources and financial resources in the research of fault detection. Fault detection has become one of the research hotspots in the field of transportation today.

对于铁路货车,运维方设置了大量列检场对货车车辆进行检测,以确保运行安全。目前该列检场主要依赖人工进行检修,存在工作量大,检测结果无法标准化等问题。对于该问题,我司在先的研究思路为:基于RGV小车连续进行铁路货车的车底图片的采集,再从图片中找出含制动机的图片,最后进行故障诊断。但是该研究思路存在以下两种问题:将所有检测图片在RGV小车端进行筛选,但这对小车上的计算力要求较高,无论是散热、还是算力、还是尺寸均难以满足要求(算力强的,尺寸也大),要按该思路,只能将小车降速,来适应小车算力不足的问题,但效率会降低;将检测图片传输到服务器端,利用服务器的算力进行筛选,但该方法对于网络传输带宽要求太高,处理速度虽然变快,但是传输耗时太久,也无法满足实时性要求。For railway freight cars, the operation and maintenance party has set up a large number of train inspection yards to test the freight cars to ensure safe operation. At present, the inspection field mainly relies on manual maintenance, which has problems such as heavy workload and inability to standardize test results. For this problem, our company's previous research idea is: based on the RGV trolley, the collection of the bottom pictures of the railway freight car is continuously carried out, and then the pictures containing the brakes are found from the pictures, and finally the fault diagnosis is carried out. However, there are two problems in this research idea: all the detection images are screened on the RGV trolley, but this requires high computing power on the trolley, and it is difficult to meet the requirements in terms of heat dissipation, computing power, or size (computing power Strong, large size), according to this idea, you can only reduce the speed of the car to adapt to the problem of insufficient computing power of the car, but the efficiency will be reduced; the detection image is transmitted to the server, and the computing power of the server is used for screening, However, this method has too high requirements for network transmission bandwidth, and although the processing speed becomes faster, the transmission takes too long and cannot meet the real-time requirements.

综上所述,现有的铁路货车的制动机检测方法存在检测效率低、实时性差的问题。To sum up, the existing brake detection methods for railway freight cars have the problems of low detection efficiency and poor real-time performance.

发明内容SUMMARY OF THE INVENTION

有鉴于此,本发明提供一种铁路货车的制动机检测方法,通过改进数据采集及数据处理方法,解决了传统的铁路货车的制动机检测方法存在的检测效率低、实时性差的问题。In view of this, the present invention provides a brake detection method for railway freight cars, which solves the problems of low detection efficiency and poor real-time performance of traditional railway freight car brake detection methods by improving data acquisition and data processing methods.

为解决以上问题,本发明的技术方案为采用一种铁路货车的制动机检测方法,包括:获取铁路货车的参数信息;在RGV小车沿第一方向行驶时,实时获取RGV小车的定位信息,基于所述参数信息和所述定位信息实时生成多列车厢的第一目标检测区域,所述RGV小车采集所述第一目标检测区域内的多张第一检测图像;获取预训练的神经网络模型,将多张所述第一检测图像输入所述神经网络模型生成第一缺陷检测结果;基于所述第一缺陷检测结果生成在RGV小车沿第二方向行驶时的第二目标检测区域,所述RGV小车采集所述第二目标检测区域内的多张第二检测图像,将多张所述第二检测图像输入所述神经网络模型生成第二缺陷检测结果;基于所述第一缺陷检测结果和所述第二缺陷检测结果生成制动机缺陷检测报告。In order to solve the above problems, the technical solution of the present invention is to adopt a method for detecting a brake of a railway freight car, which includes: obtaining parameter information of the railway freight car; and obtaining the positioning information of the RGV car in real time when the RGV car travels in the first direction, Based on the parameter information and the positioning information, the first target detection area of multiple carriages is generated in real time, and the RGV car collects multiple first detection images in the first target detection area; obtains a pre-trained neural network model , input a plurality of the first detection images into the neural network model to generate a first defect detection result; generate a second target detection area when the RGV trolley travels in the second direction based on the first defect detection results, the The RGV trolley collects multiple second detection images in the second target detection area, and inputs the multiple second detection images into the neural network model to generate second defect detection results; based on the first defect detection results and The second defect detection result generates a brake motor defect detection report.

可选地,获取铁路货车的参数信息,包括:在铁路货车驶入列检场时,基于车号识别单元提取所述铁路货车的车号信息及车号信息对应的车辆轴距信息和车辆轴数信息;在铁路货车驶入列检场时,基于计轴传感器提取所述铁路货车已驶入列检场部分的轴数数量;基于所述轴数数量、所述车号信息、所述车辆轴距信息和所述车辆轴数信息构成所述参数信息。Optionally, acquiring the parameter information of the railway freight car includes: when the railway freight car enters the inspection yard, extracting the vehicle number information of the railway freight car and the vehicle wheelbase information and the vehicle axle corresponding to the vehicle number information based on the vehicle number identification unit. When the railway freight car enters the inspection yard, extract the number of axles of the railway freight car that has entered the inspection yard based on the axle counting sensor; based on the number of axles, the vehicle number information, the vehicle The wheelbase information and the vehicle axle number information constitute the parameter information.

可选地,实时获取RGV小车的定位信息,包括:基于RGV小车的编码器获取行驶距离信息;基于RGV小车的车轮传感器生成于RGV小车已经过铁路货车的车轮数量信息,并作为辅助矫正信息;基于所述行驶距离信息、所述辅助矫正信息和RGV小车的初始位置信息生成RGV小车相较于所述铁路货车的所述定位信息,其中,RGV小车的初始位置为铁路货车的车头起始处。Optionally, obtaining the positioning information of the RGV car in real time includes: obtaining travel distance information based on an encoder of the RGV car; generating information on the number of wheels of the RGV car that has passed the railway freight car based on the wheel sensor of the RGV car, and using it as auxiliary correction information; The positioning information of the RGV car compared to the railway freight car is generated based on the travel distance information, the auxiliary correction information and the initial position information of the RGV car, wherein the initial position of the RGV car is the beginning of the front of the railway freight car .

可选地,基于所述参数信息和所述定位信息实时生成第一目标检测区域,包括:在制动机被设置于所述铁路货车的每节车厢的第二车轴与第三车轴之间的情况下,基于所述定位信息、所述车辆轴距信息和车辆轴数信息生成用于检测所述铁路货车的每节车厢的第二车轴与第三车轴之间区域的所述第一目标检测区域。Optionally, generating the first target detection area in real time based on the parameter information and the positioning information includes: a brake is arranged between the second axle and the third axle of each carriage of the railway freight car. in the case of generating the first target detection for detecting the area between the second axle and the third axle of each carriage of the railway freight car based on the positioning information, the vehicle wheelbase information and the vehicle axle number information area.

可选地,预训练所述神经网络模型,包括:构建初始化网络模型,其中,网络模型包括语义分割模型;获取包含多类别标记的制动机图像样本构成的训练数据集和测试数据集,其中,标记类别包括制动机和制动机的多类缺陷;基于所述训练数据集和所述测试数据集训练并测试所述神经网络模型。Optionally, pre-training the neural network model includes: constructing an initialization network model, wherein the network model includes a semantic segmentation model; acquiring a training data set and a test data set composed of brake image samples marked with multiple categories, wherein , the labeling category includes brakes and multiple types of defects of the brakes; the neural network model is trained and tested based on the training data set and the test data set.

可选地,将多张所述第一检测图像输入所述神经网络模型生成第一缺陷检测结果,包括:将同一车厢的多张所述第一检测图像逐张输入所述神经网络模型,在所述神经网络模型初次生成制动机检测框时,停止同一车厢中其余所述第一检测图像的图像识别并将下一车厢的多张所述第一检测图像逐张输入所述神经网络模型,同时,若在所述神经网络模型初次生成制动机检测框时同时生成了其他类别的制动机缺陷检测框,则基于所述制动机检测框和所述制动机缺陷检测框生成该车厢的缺陷检测结果;在所述神经网络模型遍历完全部车厢的所述第一检测图像时,基于全部车厢的缺陷检测结果生成所述第一缺陷检测结果。Optionally, inputting a plurality of the first detection images into the neural network model to generate a first defect detection result includes: inputting a plurality of the first detection images of the same carriage into the neural network model one by one, and When the neural network model generates the brake detection frame for the first time, the image recognition of the remaining first detection images in the same car is stopped, and the first detection images of the next car are input into the neural network model one by one , and at the same time, if other types of brake defect detection frames are simultaneously generated when the neural network model generates the brake detection frame for the first time, then the brake detection frame and the brake defect detection frame are generated based on the brake detection frame and the brake defect detection frame. The defect detection result of the carriage; when the neural network model traverses the first detection images of all the carriages, the first defect detection result is generated based on the defect detection results of all the carriages.

可选地,基于所述第一缺陷检测结果生成在RGV小车沿第二方向行驶时的第二目标检测区域,包括:基于所述第一缺陷检测结果中每列车厢的制动机检测框包含的检测框面积信息和坐标信息,生成每列车厢的第一目标检测区域中面积小于第一目标检测区域面积、大于检测框面积的第二目标检测区域,且所述第二目标检测区域包含所述制动机检测框所属区域。Optionally, generating a second target detection area when the RGV trolley travels in the second direction based on the first defect detection result includes: based on the first defect detection result, the brake detection frame of each row of carriages includes: The area information and coordinate information of the detection frame are generated to generate a second target detection area in the first target detection area of each train whose area is smaller than the area of the first target detection area and larger than the area of the detection frame, and the second target detection area includes all The area to which the brake detection frame belongs.

可选地,将多张所述第二检测图像输入所述神经网络模型生成第二缺陷检测结果,包括:将同一车厢的多张所述第二检测图像逐张输入所述神经网络模型,在所述神经网络模型初次生成制动机检测框时,停止同一车厢中其余所述第二检测图像的图像识别并将下一车厢的多张所述第二检测图像逐张输入所述神经网络模型,同时,若在所述神经网络模型初次生成制动机检测框时同时生成了其他类别的制动机缺陷检测框,则基于所述制动机检测框和所述制动机缺陷检测框生成该车厢的缺陷检测结果;在所述神经网络模型遍历完全部车厢的所述第二检测图像时,基于全部车厢的缺陷检测结果生成所述第二缺陷检测结果。Optionally, inputting a plurality of the second detection images into the neural network model to generate a second defect detection result includes: inputting a plurality of the second detection images of the same carriage into the neural network model one by one, and then When the neural network model generates the brake detection frame for the first time, the image recognition of the remaining second detection images in the same car is stopped, and multiple second detection images of the next car are input into the neural network model one by one , and at the same time, if other types of brake defect detection frames are simultaneously generated when the neural network model generates the brake detection frame for the first time, then the brake detection frame and the brake defect detection frame are generated based on the brake detection frame and the brake defect detection frame. The defect detection result of the carriage; when the neural network model traverses the second detection images of all the carriages, the second defect detection result is generated based on the defect detection results of all the carriages.

本发明的首要改进之处为铁路货车的制动机检测方法,通过采集铁路货车的参数信息和RGV小车相较于铁路列车的定位信息准确定位制动机所处车轴区域作为第一目标检测区域,有效避免了RGV小车在行驶过程中需要实时持续采集列车底部照片导致照片数量庞大进而造成数据处理单元算力负荷巨大的问题出现,使得RGV小车在行驶过程中仅需间断性检测第一目标检测区域即可,降低了输入至RGV小车数据处理单元的数据量,实现了RGV小车实时检测制动机缺陷。同时,由于每节车厢的制动缸可能设置于车体左侧或右侧,应此RGV小车沿第一方向检测时仅能基于每节车厢的车轴位置与RGV小车的定位信息生成制动机所处车轴区域作为第一目标检测区域,但是在生成第一缺陷检测结果后,数据处理单元可由制动机检测框信息能够确定每节车厢的制动缸设置于车体左侧还是右侧,从而进一步缩小检测区域,生成更加精确的第二目标检测区域,从而进一步降低了输入至RGV小车数据处理单元的数据量,实现了铁路货车的制动机实时、准确检测,解决了传统的铁路货车的制动机检测方法存在的检测效率低、实时性差的问题。The primary improvement of the present invention is the detection method of the brake of the railway freight car. By collecting the parameter information of the railway freight car and the positioning information of the RGV car compared to the railway train, the axle area where the brake is located is accurately located as the first target detection area , which effectively avoids the problem that the RGV trolley needs to continuously collect photos of the bottom of the train in real time during the driving process, resulting in a large number of photos and a huge computing power load on the data processing unit, so that the RGV trolley only needs to intermittently detect the first target detection during the driving process. The area is enough, which reduces the amount of data input to the RGV car data processing unit, and realizes the real-time detection of brake defects of the RGV car. At the same time, since the brake cylinder of each car may be located on the left or right side of the car body, when the RGV car is detected in the first direction, the brake can only be generated based on the axle position of each car and the positioning information of the RGV car. The axle area where it is located is used as the first target detection area, but after generating the first defect detection result, the data processing unit can determine whether the brake cylinder of each car is set on the left or right side of the car body from the brake detection frame information, In this way, the detection area is further reduced, and a more accurate second target detection area is generated, thereby further reducing the amount of data input to the RGV trolley data processing unit, realizing real-time and accurate detection of the brakes of railway freight cars, and solving the problem of traditional railway freight cars. The existing brake detection method has the problems of low detection efficiency and poor real-time performance.

附图说明Description of drawings

图1是本发明的一种铁路货车的制动机检测方法的简化流程图。FIG. 1 is a simplified flow chart of a method for detecting a brake of a railway freight car according to the present invention.

具体实施方式Detailed ways

为了使本领域的技术人员更好地理解本发明的技术方案,下面结合附图和具体实施例对本发明作进一步的详细说明。In order to make those skilled in the art better understand the technical solutions of the present invention, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

如图1所示,一种铁路货车的制动机检测方法,包括:获取铁路货车的参数信息;在RGV小车沿第一方向行驶时,实时获取RGV小车的定位信息,基于所述参数信息和所述定位信息实时生成多列车厢的第一目标检测区域,所述RGV小车采集所述第一目标检测区域内的多张第一检测图像;获取预训练的神经网络模型,将多张所述第一检测图像输入所述神经网络模型生成第一缺陷检测结果;基于所述第一缺陷检测结果生成在RGV小车沿第二方向行驶时的第二目标检测区域,所述RGV小车采集所述第二目标检测区域内的多张第二检测图像,将多张所述第二检测图像输入所述神经网络模型生成第二缺陷检测结果;基于所述第一缺陷检测结果和所述第二缺陷检测结果生成制动机缺陷检测报告。其中,第一方向可以是列车车头朝向列车车尾的方向,第二方向可以是列车车尾朝向列车车头的方向;由于第一检测图像和第二检测图像分别由RGV小车在不同行驶方向的不同角度下拍摄,因此,神经网络模型输出的第一缺陷检测结果和第二缺陷检测结果存在一定差异,同时,神经网络模型输出的检测结果的可信度受环境干扰、摄像头参数等因素干扰,用户可根据神经网络模型输出的第一缺陷检测结果和第二缺陷检测结果的可信程度自由选择基于所述第一缺陷检测结果和所述第二缺陷检测结果生成制动机缺陷检测报告的方式,例如:在第一缺陷检测结果和第二缺陷检测结果的可信程度较高的情况下,可基于所述第一缺陷检测结果和所述第二缺陷检测结果的并集生成制动机缺陷检测报告;在第一缺陷检测结果和第二缺陷检测结果的可信程度较低的情况下,可基于所述第一缺陷检测结果和所述第二缺陷检测结果的交集生成制动机缺陷检测报告。As shown in FIG. 1 , a method for detecting a brake of a railway freight car includes: acquiring parameter information of the railway freight car; when the RGV car is traveling in a first direction, acquiring the positioning information of the RGV car in real time, based on the parameter information and The positioning information generates the first target detection area of multiple carriages in real time, and the RGV car collects a plurality of first detection images in the first target detection area; The first detection image is input to the neural network model to generate a first defect detection result; based on the first defect detection result, a second target detection area is generated when the RGV trolley travels in the second direction, and the RGV trolley collects the first defect detection area. Two second detection images in the target detection area, inputting the plurality of second detection images into the neural network model to generate a second defect detection result; based on the first defect detection result and the second defect detection As a result, a brake defect detection report is generated. Wherein, the first direction may be the direction in which the train head faces the train tail, and the second direction may be the direction in which the train tail faces the train head; since the first detection image and the second detection image are respectively generated by the RGV car in different driving directions Therefore, there is a certain difference between the first defect detection result output by the neural network model and the second defect detection result. At the same time, the reliability of the detection result output by the neural network model is affected by environmental interference, camera parameters and other factors. The manner of generating the brake machine defect detection report based on the first defect detection result and the second defect detection result can be freely selected according to the credibility of the first defect detection result and the second defect detection result output by the neural network model, For example: when the reliability of the first defect detection result and the second defect detection result is high, the brake defect detection can be generated based on the union of the first defect detection result and the second defect detection result report; in the case that the reliability of the first defect detection result and the second defect detection result is low, a brake machine defect detection report may be generated based on the intersection of the first defect detection result and the second defect detection result .

进一步的,获取铁路货车的参数信息,包括:在铁路货车驶入列检场时,基于车号识别单元提取所述铁路货车的车号信息及车号信息对应的车辆轴距信息和车辆轴数信息;在铁路货车驶入列检场时,基于计轴传感器提取所述铁路货车已驶入列检场部分的轴数数量;基于所述轴数数量、所述车号信息、所述车辆轴距信息和所述车辆轴数信息构成所述参数信息。其中,车号识别单元、计轴传感器均属于本领域成熟的通用装置,因此本申请不对其设置方式、型号做具体限定。Further, acquiring the parameter information of the railway freight car includes: when the railway freight car enters the inspection yard, extracting the vehicle number information of the railway freight car and the vehicle wheelbase information and the number of vehicle axles corresponding to the vehicle number information based on the vehicle number identification unit. information; when the railway freight car enters the inspection yard, extract the number of axles of the railway freight car that has entered the inspection yard based on the axle counting sensor; based on the number of axles, the vehicle number information, the vehicle axle The distance information and the vehicle axle number information constitute the parameter information. Among them, the vehicle number recognition unit and the axle counting sensor are all mature general-purpose devices in the art, so the present application does not specifically limit their setting methods and models.

进一步的,实时获取RGV小车的定位信息,包括:基于RGV小车的编码器获取行驶距离信息;基于RGV小车的车轮传感器生成于RGV小车已经过铁路货车的车轮数量信息,并作为辅助矫正信息;基于所述行驶距离信息、所述辅助矫正信息和RGV小车的初始位置信息生成RGV小车相较于所述铁路货车的所述定位信息,其中,RGV小车的初始位置为铁路货车的车头起始处。其中,RGV小车为基于轨道导引的自动小车,属于本领域成熟的通用装置,因此本申请不对其设置方式、型号做具体限定,同时,RGV小车可搭载有编码器、车轮传感器、摄像头、数据处理单元等本领域常规检测装置。Further, obtaining the positioning information of the RGV car in real time includes: obtaining the travel distance information based on the encoder of the RGV car; the wheel sensor based on the RGV car is generated from the number of wheels of the RGV car that has passed the railway freight car, and used as auxiliary correction information; The travel distance information, the auxiliary correction information and the initial position information of the RGV car generate the positioning information of the RGV car compared to the railway freight car, wherein the initial position of the RGV car is the beginning of the front of the railway freight car. Among them, the RGV trolley is an automatic trolley based on track guidance, which is a mature general-purpose device in the field. Therefore, this application does not specifically limit its setting method and model. At the same time, the RGV trolley can be equipped with encoders, wheel sensors, cameras, data Processing unit and other conventional detection devices in the field.

进一步的,基于所述参数信息和所述定位信息实时生成第一目标检测区域,包括:在制动机被设置于所述铁路货车的每节车厢的第二车轴与第三车轴之间的情况下,基于所述定位信息、所述车辆轴距信息和车辆轴数信息生成用于检测所述铁路货车的每节车厢的第二车轴与第三车轴之间区域的所述第一目标检测区域。其中,本领域中,通常将制动机设置于所述铁路货车的每节车厢的第二车轴与第三车轴之间,因此以该情况说明如何生成第一目标检测区域。在制动机设置于所述铁路货车的每节车厢的其他车轴之间时,依旧可以基于其他车轴之间的区域作为所述第一目标检测区域。Further, generating the first target detection area in real time based on the parameter information and the positioning information includes: when a brake is arranged between the second axle and the third axle of each carriage of the railway freight car Next, generate the first target detection area for detecting the area between the second axle and the third axle of each carriage of the railway freight car based on the positioning information, the vehicle wheelbase information and the vehicle axle number information . Wherein, in the art, the brake is usually arranged between the second axle and the third axle of each car of the railway freight car, so how to generate the first target detection area will be described in this case. When the brake is arranged between other axles of each car of the railway freight car, the area between the other axles can still be used as the first target detection area.

进一步的,预训练所述神经网络模型,包括:构建初始化网络模型,其中,网络模型包括语义分割模型;获取包含多类别标记的制动机图像样本构成的训练数据集和测试数据集,其中,标记类别包括制动机和制动机的多类缺陷;基于所述训练数据集和所述测试数据集训练并测试所述神经网络模型。其中,应说明的是,本申请所使用的神经网络模型为本领域常规现有技术,不涉及对模型架构的进一步改进,因此不对神经网络模型的类型、架构做具体限定。其中,神经网络模型的类型可以是YOLO-V3,FASTER RCNN等。Further, pre-training the neural network model includes: constructing an initialization network model, wherein the network model includes a semantic segmentation model; obtaining a training data set and a test data set composed of brake image samples containing multi-category labels, wherein, Labeled classes include brakes and brakes of multiple classes of defects; the neural network model is trained and tested based on the training dataset and the test dataset. Among them, it should be noted that the neural network model used in this application is a conventional prior art in the field, and does not involve further improvement of the model architecture, so the type and architecture of the neural network model are not specifically limited. Among them, the type of neural network model can be YOLO-V3, FASTER RCNN, etc.

进一步的,将多张所述第一检测图像输入所述神经网络模型生成第一缺陷检测结果,包括:将同一车厢的多张所述第一检测图像逐张输入所述神经网络模型,在所述神经网络模型初次生成制动机检测框时,停止同一车厢中其余所述第一检测图像的图像识别并将下一车厢的多张所述第一检测图像逐张输入所述神经网络模型,同时,若在所述神经网络模型初次生成制动机检测框时同时生成了其他类别的制动机缺陷检测框,则基于所述制动机检测框和所述制动机缺陷检测框生成该车厢的缺陷检测结果;在所述神经网络模型遍历完全部车厢的所述第一检测图像时,基于全部车厢的缺陷检测结果生成所述第一缺陷检测结果。其中,神经网络模型输出的多种类的检测框的信息均包括(x,y,w,h,i),(x,y)为所述检测框的左上角坐标,w为所述检测框的宽,h为所述检测框的高,i为所述检测框的置信度。Further, inputting a plurality of the first detection images into the neural network model to generate a first defect detection result includes: inputting a plurality of the first detection images of the same carriage into the neural network model one by one, and in the When the neural network model generates the brake detection frame for the first time, stop the image recognition of the remaining first detection images in the same car and input multiple first detection images of the next car into the neural network model one by one, At the same time, if other types of brake defect detection frames are simultaneously generated when the neural network model generates the brake detection frame for the first time, the brake defect detection frame is generated based on the brake detection frame and the brake defect detection frame. Defect detection results of the carriages; when the neural network model traverses the first detection images of all the carriages, the first defect detection results are generated based on the defect detection results of all the carriages. Among them, the information of the various types of detection frames output by the neural network model includes (x, y, w, h, i), (x, y) is the upper left corner coordinate of the detection frame, and w is the detection frame. width, h is the height of the detection frame, and i is the confidence of the detection frame.

进一步的,基于所述第一缺陷检测结果生成在RGV小车沿第二方向行驶时的第二目标检测区域,包括:基于所述第一缺陷检测结果中每列车厢的制动机检测框包含的检测框面积信息和坐标信息,生成每列车厢的第一目标检测区域中面积小于第一目标检测区域面积、大于检测框面积的第二目标检测区域,且所述第二目标检测区域包含所述制动机检测框所属区域。Further, generating a second target detection area when the RGV trolley travels in the second direction based on the first defect detection result includes: based on the first defect detection result, the brake detection frame of each row of carriages includes: Detect frame area information and coordinate information, and generate a second target detection area in the first target detection area of each train whose area is smaller than the area of the first target detection area and larger than the area of the detection frame, and the second target detection area includes the The area to which the brake detection frame belongs.

更进一步的,将多张所述第二检测图像输入所述神经网络模型生成第二缺陷检测结果,包括:将同一车厢的多张所述第二检测图像逐张输入所述神经网络模型,在所述神经网络模型初次生成制动机检测框时,停止同一车厢中其余所述第二检测图像的图像识别并将下一车厢的多张所述第二检测图像逐张输入所述神经网络模型,同时,若在所述神经网络模型初次生成制动机检测框时同时生成了其他类别的制动机缺陷检测框,则基于所述制动机检测框和所述制动机缺陷检测框生成该车厢的缺陷检测结果;在所述神经网络模型遍历完全部车厢的所述第二检测图像时,基于全部车厢的缺陷检测结果生成所述第二缺陷检测结果。Further, inputting a plurality of the second detection images into the neural network model to generate a second defect detection result includes: inputting a plurality of the second detection images of the same carriage into the neural network model one by one, When the neural network model generates the brake detection frame for the first time, the image recognition of the remaining second detection images in the same car is stopped, and multiple second detection images of the next car are input into the neural network model one by one , and at the same time, if other types of brake defect detection frames are simultaneously generated when the neural network model generates the brake detection frame for the first time, then the brake detection frame and the brake defect detection frame are generated based on the brake detection frame and the brake defect detection frame. The defect detection result of the carriage; when the neural network model traverses the second detection images of all the carriages, the second defect detection result is generated based on the defect detection results of all the carriages.

本发明通过采集铁路货车的参数信息和RGV小车相较于铁路列车的定位信息准确定位制动机所处车轴区域作为第一目标检测区域,有效避免了RGV小车在行驶过程中需要实时持续采集列车底部照片导致照片数量庞大进而造成数据处理单元算力负荷巨大的问题出现,使得RGV小车在行驶过程中仅需间断性检测第一目标检测区域即可,降低了输入至RGV小车数据处理单元的数据量,实现了RGV小车实时检测制动机缺陷。同时,由于每节车厢的制动缸可能设置于车体左侧或右侧,应此RGV小车沿第一方向检测时仅能基于每节车厢的车轴位置与RGV小车的定位信息生成制动机所处车轴区域作为第一目标检测区域,但是在生成第一缺陷检测结果后,数据处理单元可由制动机检测框信息能够确定每节车厢的制动缸设置于车体左侧还是右侧,从而进一步缩小检测区域,生成更加精确的第二目标检测区域,从而进一步降低了输入至RGV小车数据处理单元的数据量,实现了铁路货车的制动机实时、准确检测,解决了传统的铁路货车的制动机检测方法存在的检测效率低、实时性差的问题。The invention accurately locates the axle area where the brake is located as the first target detection area by collecting the parameter information of the railway freight car and the positioning information of the RGV trolley compared with the railway train, effectively avoiding the need for the RGV trolley to continuously collect the train in real time during the running process. The bottom photo leads to a huge number of photos, which causes a huge computational load of the data processing unit, so that the RGV car only needs to intermittently detect the first target detection area during driving, which reduces the data input to the RGV car data processing unit. It realizes the real-time detection of brake defects of the RGV trolley. At the same time, since the brake cylinder of each car may be located on the left or right side of the car body, when the RGV car is detected in the first direction, the brake can only be generated based on the axle position of each car and the positioning information of the RGV car. The axle area where it is located is used as the first target detection area, but after generating the first defect detection result, the data processing unit can determine whether the brake cylinder of each car is set on the left or right side of the car body from the brake detection frame information, In this way, the detection area is further reduced, and a more accurate second target detection area is generated, thereby further reducing the amount of data input to the RGV trolley data processing unit, realizing real-time and accurate detection of the brakes of railway freight cars, and solving the problem of traditional railway freight cars. The existing brake detection method has the problems of low detection efficiency and poor real-time performance.

以上对本发明实施例所提供的一种铁路货车的制动机检测方法进行了详细介绍。说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似部分互相参见即可。对于实施例公开的装置而言,由于其与实施例公开的方法相对应,所以描述的比较简单,相关之处参见方法部分说明即可。应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,还可以对本发明进行若干改进和修饰,这些改进和修饰也落入本发明权利要求的保护范围内。The method for detecting a brake of a railway freight car provided by the embodiment of the present invention has been described in detail above. The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the various embodiments can be referred to each other. As for the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant part can be referred to the description of the method. It should be pointed out that for those skilled in the art, without departing from the principle of the present invention, several improvements and modifications can also be made to the present invention, and these improvements and modifications also fall within the protection scope of the claims of the present invention.

专业人员还可以进一步意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、计算机软件或者二者的结合来实现,为了清楚地说明硬件和软件的可互换性,在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明的范围。Professionals may further realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two, in order to clearly illustrate the possibilities of hardware and software. Interchangeability, the above description has generally described the components and steps of each example in terms of functionality. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of the present invention.

结合本文中所公开的实施例描述的方法或算法的步骤可以直接用硬件、处理器执行的软件模块,或者二者的结合来实施。软件模块可以置于随机存储器(RAM)、内存、只读存储器(ROM)、电可编程ROM、电可擦除可编程ROM、寄存器、硬盘、可移动磁盘、CD-ROM、或技术领域内所公知的任意其它形式的存储介质中。The steps of a method or algorithm described in conjunction with the embodiments disclosed herein may be directly implemented in hardware, a software module executed by a processor, or a combination of the two. A software module can be placed in random access memory (RAM), internal memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other in the technical field. in any other known form of storage medium.

Claims (8)

1. A brake detection method of a railway wagon is characterized by comprising the following steps:
acquiring parameter information of a railway wagon;
when the RGV trolley runs along a first direction, acquiring positioning information of the RGV trolley in real time, generating a first target detection area of a plurality of rows of carriages in real time based on the parameter information and the positioning information, and collecting a plurality of first detection images in the first target detection area by the RGV trolley;
acquiring a pre-trained neural network model, and inputting a plurality of first detection images into the neural network model to generate a first defect detection result;
generating a second target detection area when the RGV trolley runs along a second direction based on the first defect detection result, acquiring a plurality of second detection images in the second target detection area by the RGV trolley, and inputting the plurality of second detection images into the neural network model to generate a second defect detection result;
generating a brake defect detection report based on the first defect detection result and the second defect detection result.
2. The brake detection method of claim 1, wherein obtaining parameter information of a rail wagon comprises:
when a railway wagon drives into a train inspection field, extracting the wagon number information of the railway wagon and vehicle wheelbase information and vehicle axle number information corresponding to the wagon number information based on a wagon number identification unit;
when a railway wagon drives into a train inspection field, extracting the number of axles of the part of the railway wagon, which has driven into the train inspection field, based on an axle counting sensor;
and forming the parameter information based on the number of axles, the number information of the vehicle, the wheel base information of the vehicle and the number information of the axles of the vehicle.
3. The brake detection method of claim 2, wherein obtaining location information of the RGV car in real time comprises:
acquiring running distance information based on an encoder of the RGV trolley;
the wheel sensor based on the RGV trolley generates the number information of the wheels of the RGV trolley passing through the rail wagon as auxiliary correction information;
and generating the positioning information of the RGV compared with the rail wagon based on the running distance information, the auxiliary correction information and the initial position information of the RGV, wherein the initial position of the RGV is the head starting position of the rail wagon.
4. The brake detection method of claim 3, wherein generating a first target detection area in real time based on the parameter information and the positioning information comprises:
in the case where a brake is provided between the second axle and the third axle of each of the cars of the railway wagon,
generating the first target detection area for detecting an area between a second axle and a third axle of each car of the railway wagon based on the positioning information, the vehicle wheel base information, and the vehicle axle number information.
5. The brake detection method of claim 1, wherein pre-training the neural network model comprises:
constructing an initialization network model, wherein the network model comprises a semantic segmentation model;
acquiring a training data set and a testing data set which are formed by brake image samples containing multi-class marks, wherein the mark classes comprise the brakes and multi-class defects of the brakes;
training and testing the neural network model based on the training dataset and the testing dataset.
6. The brake detection method of claim 4, wherein inputting a plurality of the first inspection images into the neural network model to generate a first defect detection result comprises:
inputting a plurality of first detection images of the same compartment into the neural network model one by one, stopping image recognition of the rest of first detection images in the same compartment and inputting a plurality of first detection images of the next compartment into the neural network model one by one when a brake detection frame is generated by the neural network model for the first time, and generating a defect detection result of the compartment based on the brake detection frame and the brake defect detection frame if brake defect detection frames of other categories are generated at the same time when the brake detection frame is generated by the neural network model for the first time;
and when the neural network model finishes traversing the first detection images of all the carriages, generating a first defect detection result based on the defect detection results of all the carriages.
7. The brake detection method of claim 5, wherein generating a second target detection zone when the RGV is traveling in a second direction based on the first defect detection result comprises:
and generating a second target detection area with the area smaller than that of the first target detection area and larger than that of the detection frame in the first target detection area of each train of carriages based on the area information and the coordinate information of the detection frame contained in the brake detection frame of each train of carriages in the first defect detection result, wherein the second target detection area contains the area to which the brake detection frame belongs.
8. The brake detection method of claim 7, wherein inputting a plurality of the second detection images into the neural network model to generate a second defect detection result comprises:
inputting a plurality of second detection images of the same compartment into the neural network model one by one, stopping image recognition of the rest of second detection images in the same compartment and inputting a plurality of second detection images of the next compartment into the neural network model one by one when the neural network model generates a brake detection frame for the first time, and generating a defect detection result of the compartment based on the brake detection frame and the brake defect detection frame if brake defect detection frames of other categories are generated at the same time when the brake detection frame is generated for the first time by the neural network model;
and when the neural network model finishes traversing the second detection images of all the carriages, generating a second defect detection result based on the defect detection results of all the carriages.
CN202210396632.9A 2022-04-15 2022-04-15 A method for detecting brakes of railway freight cars Active CN114743166B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210396632.9A CN114743166B (en) 2022-04-15 2022-04-15 A method for detecting brakes of railway freight cars

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210396632.9A CN114743166B (en) 2022-04-15 2022-04-15 A method for detecting brakes of railway freight cars

Publications (2)

Publication Number Publication Date
CN114743166A true CN114743166A (en) 2022-07-12
CN114743166B CN114743166B (en) 2024-12-27

Family

ID=82281021

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210396632.9A Active CN114743166B (en) 2022-04-15 2022-04-15 A method for detecting brakes of railway freight cars

Country Status (1)

Country Link
CN (1) CN114743166B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115416726A (en) * 2022-08-16 2022-12-02 北京主导时代科技有限公司 A dynamic self-adaptive method and system for a track trolley position

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1359821A (en) * 2000-06-28 2002-07-24 西屋气刹车技术股份有限公司 Pneumatic control device and method for stage relief of brake pressure in brake system of freight train
CN102901645A (en) * 2012-08-22 2013-01-30 北京康拓红外技术股份有限公司 Automatic monitoring system and method for brake cylinder state in wind testing work under railway train examination
US20200110965A1 (en) * 2018-10-08 2020-04-09 Baidu Online Network Technology (Beijing) Co., Ltd. Method and apparatus for generating vehicle damage information
CN111507976A (en) * 2020-04-28 2020-08-07 浙江省北大信息技术高等研究院 Defect detection method and system based on multi-angle imaging
CN112418323A (en) * 2020-11-24 2021-02-26 哈尔滨市科佳通用机电股份有限公司 Railway wagon coupler knuckle pin fault detection method based on image processing
WO2021175006A1 (en) * 2020-03-04 2021-09-10 深圳壹账通智能科技有限公司 Vehicle image detection method and apparatus, and computer device and storage medium
CN113744224A (en) * 2021-08-26 2021-12-03 成都盛锴科技有限公司 Method and system for detecting welding seam of running part of railway vehicle

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1359821A (en) * 2000-06-28 2002-07-24 西屋气刹车技术股份有限公司 Pneumatic control device and method for stage relief of brake pressure in brake system of freight train
CN102901645A (en) * 2012-08-22 2013-01-30 北京康拓红外技术股份有限公司 Automatic monitoring system and method for brake cylinder state in wind testing work under railway train examination
US20200110965A1 (en) * 2018-10-08 2020-04-09 Baidu Online Network Technology (Beijing) Co., Ltd. Method and apparatus for generating vehicle damage information
WO2021175006A1 (en) * 2020-03-04 2021-09-10 深圳壹账通智能科技有限公司 Vehicle image detection method and apparatus, and computer device and storage medium
CN111507976A (en) * 2020-04-28 2020-08-07 浙江省北大信息技术高等研究院 Defect detection method and system based on multi-angle imaging
CN112418323A (en) * 2020-11-24 2021-02-26 哈尔滨市科佳通用机电股份有限公司 Railway wagon coupler knuckle pin fault detection method based on image processing
CN113744224A (en) * 2021-08-26 2021-12-03 成都盛锴科技有限公司 Method and system for detecting welding seam of running part of railway vehicle

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
刘盛亚;PHILIP YAMBA;邹荣;许桢英;崔世林;: "基于局部结构化特征稀疏编码的手制动机故障检测", 铁道科学与工程学报, no. 09, 15 September 2018 (2018-09-15) *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115416726A (en) * 2022-08-16 2022-12-02 北京主导时代科技有限公司 A dynamic self-adaptive method and system for a track trolley position

Also Published As

Publication number Publication date
CN114743166B (en) 2024-12-27

Similar Documents

Publication Publication Date Title
Liu et al. A review of applications of visual inspection technology based on image processing in the railway industry
CN111402211A (en) High-speed train bottom foreign matter identification method based on deep learning
CN105260744B (en) The automatic on-line diagnostic method and system of a kind of goods train coupler yoke key position failure
CN103745224B (en) Image-based railway contact net bird-nest abnormal condition detection method
CN103295027B (en) A kind of railway freight-car block key based on SVMs loses fault recognition method
CN103034850B (en) Trouble of moving freight car detection system (TFDS) block key loss fault automatic identification method
CN202793389U (en) On-line routing inspection device for high-speed rail overhead line system
CN107505334A (en) A kind of railway rail clip abnormality detection system based on pointolite array linear array imaging
CN111079819A (en) Method for judging state of coupler knuckle pin of railway wagon based on image recognition and deep learning
CN109238756A (en) Lorry operation troubles motion image detection equipment and detection method
CN103913464B (en) A kind of high speed railway track surface imperfection matching process based on Machine Vision Detection
CN113506269A (en) Turnout and non-turnout rail fastener positioning method based on deep learning
CN113788051A (en) Train on-station running state monitoring and analyzing system
CN111079629A (en) Image recognition method of railway freight car core plate out
CN114743166B (en) A method for detecting brakes of railway freight cars
CN103413439A (en) Method for sorting passenger vehicles and goods vehicles based on videos
CN115527170A (en) Fault identification method and system for door plug handle closing of automatic braking device for derailment of freight cars
CN117409039B (en) Wheel track relative displacement calculation method based on virtual point tracking network
CN113433560B (en) Positioning method and device for robot side inspection, electronic equipment and medium
Li et al. Virtual point tracking method for online detection of relative wheel-rail displacement of railway vehicles
CN114005097A (en) Train operation environment real-time detection method and system based on image semantic segmentation
CN118154928A (en) A railway freight car floor damage identification method and system based on multi-scale feature fusion
CN217385548U (en) Non-contact rail transit train speed direction mileage detection device
CN116188449A (en) Rail wagon relief valve pull rod split pin loss fault identification method and equipment
CN118111331A (en) A wheel-rail relative displacement detection method, device and readable medium based on machine vision

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant