CN113682342A - Track anomaly detection method and related product - Google Patents
Track anomaly detection method and related product Download PDFInfo
- Publication number
- CN113682342A CN113682342A CN202110982111.7A CN202110982111A CN113682342A CN 113682342 A CN113682342 A CN 113682342A CN 202110982111 A CN202110982111 A CN 202110982111A CN 113682342 A CN113682342 A CN 113682342A
- Authority
- CN
- China
- Prior art keywords
- video
- target
- video display
- vibration
- setting information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61K—AUXILIARY EQUIPMENT SPECIALLY ADAPTED FOR RAILWAYS, NOT OTHERWISE PROVIDED FOR
- B61K9/00—Railway vehicle profile gauges; Detecting or indicating overheating of components; Apparatus on locomotives or cars to indicate bad track sections; General design of track recording vehicles
- B61K9/08—Measuring installations for surveying permanent way
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G01M7/00—Vibration-testing of structures; Shock-testing of structures
- G01M7/02—Vibration-testing by means of a shake table
- G01M7/025—Measuring arrangements
Abstract
The embodiment of the application discloses a track abnormity detection method, which comprises the following steps: displaying a vibration analysis interface on a display screen of the vibration detection device, wherein the vibration analysis interface comprises at least one video display window, and each video display window comprises a frequency band display area and a video display area; the frequency band display area of each video display window displays preset frequency setting information; and displaying the target video in the video display area of each video display window. The embodiment of the application provides a method for vibration analysis based on videos, and the intelligence and the accuracy of vibration analysis of vibration detection equipment according to the videos are improved.
Description
Technical Field
The application relates to the technical field of electronic equipment, in particular to a track abnormity detection method and a related product.
Background
If a fault occurs in the track running process, great risk is brought, so that how to accurately detect the track fault is a link which is very necessary.
Disclosure of Invention
The embodiment of the application provides an abnormality detection method for a track and a related product, and aims to improve the intelligence and accuracy of analysis of vibration detection equipment.
In a first aspect, an embodiment of the present application provides an abnormality detection method for a track, which is applied to a vibration detection device for a track, and the method includes:
displaying a vibration analysis interface on a display screen of the vibration detection device of the track, wherein the vibration analysis interface comprises at least one video display window, and each video display window comprises a frequency band display area and a video display area;
displaying preset frequency setting information in a frequency band display area of each video display window;
and displaying a target video in the video display area of each video display window, wherein the target video is a video with a motion amplification effect obtained by processing an original video of a detected target by the vibration detection equipment under the constraint condition of the frequency setting information, the motion amplification effect means that the area where the detected target moves is amplified in the target video, and the amplification factor of the motion amplification effect is associated with the frequency setting information.
In a second aspect, the present application provides an abnormality detection device for a rail, applied to a vibration detection apparatus for a rail, including a display unit, wherein,
the display unit is used for displaying a vibration analysis interface on a display screen of the vibration detection device, the vibration analysis interface comprises at least one video display window, and each video display window comprises a frequency band display area and a video display area;
the display unit is further configured to display preset frequency setting information in a frequency band display area of each video display window;
the display unit is further configured to display a target video in a video display area of each video display window, where the target video is a video with a motion amplification effect obtained by processing an original video of a detected target by the vibration detection device under the constraint condition of the frequency setting information, the motion amplification effect is that an area where the detected target moves is amplified in the target video, and the amplification factor of the motion amplification effect is associated with the frequency setting information.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing steps in any method of the first aspect of the embodiment of the present application.
In a fourth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program makes a computer perform part or all of the steps described in any one of the methods of the first aspect of the present application.
In a fifth aspect, the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform some or all of the steps as described in any one of the methods of the first aspect of the embodiments of the present application. The computer program product may be a software installation package.
It can be seen that, in the embodiment of the present application, first, a vibration analysis interface is displayed on a display screen of the vibration detection device of the track, the vibration analysis interface comprises at least one video display window, each video display window comprises a frequency band display area and a video display area, secondly, displaying preset frequency setting information in the frequency band display area of each video display window, and finally, displaying a target video in the video display area of each video display window, wherein the target video is a video with a motion amplification effect obtained by processing an original video of a detected target by the vibration detection equipment under the constraint condition of the frequency setting information, the motion amplification effect means that the area of the detected target moving is amplified in the target video, and the amplification factor of the motion amplification effect is associated with the frequency setting information. It can be seen that, in this example, the original video is detected by the vibration detection device, the amplified vibration video and/or the frequency setting information are displayed in the vibration analysis interface according to the frequency setting information, the vibration analysis is visually displayed, the current vibration scene can be visually reflected, the vibration effect can be more visually displayed, the vibration detection device can position a new detection point according to operations such as dragging of a user in a specific area and update and display the corresponding vibration video, and the improvement of the intelligence and the accuracy of the video for vibration analysis is facilitated.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a schematic diagram of a system for anomaly detection of a track according to an embodiment of the present application;
fig. 2A is a schematic flowchart of an anomaly detection method for a track according to an embodiment of the present application;
FIG. 2B is a diagram illustrating a vibration analysis interface according to an embodiment of the present disclosure;
FIG. 2C is a schematic view of an interface provided by an embodiment of the present application;
FIG. 3 is a schematic flow chart of another track anomaly detection method provided in the embodiments of the present application;
FIG. 4 is a schematic flow chart of another track anomaly detection method provided in the embodiments of the present application;
fig. 5 is a schematic structural diagram of a vibration detection apparatus provided in an embodiment of the present application;
fig. 6 is a block diagram of functional units of an apparatus for detecting track anomalies according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The electronic device according to the embodiment of the present application may include various handheld devices, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to a wireless modem, which have wireless communication functions, and various forms of User Equipment (UE), Mobile Stations (MS), terminal devices (terminal device), and the like. For convenience of description, the above-mentioned devices are collectively referred to as electronic devices.
The following describes embodiments of the present application in detail.
Referring to fig. 1, fig. 1 is a schematic diagram of an anomaly detection system for a track according to an embodiment of the present application, where fig. 1 includes: a vibration detection device 100 and a track 110, wherein the vibration detection device 100 comprises data processing and display means 101 and data acquisition means 102.
The vibration detection device according to the embodiment of the present application may include various handheld devices, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to a wireless modem, and various forms of User Equipment (UE), Mobile Stations (MS), terminal devices (terminal device), and the like. For convenience of description, the above-mentioned apparatuses are collectively referred to as vibration detecting apparatuses.
In this example, the track 110 is detected by the vibration detection device 100 to obtain an original video, the original video is displayed in the data processing and display apparatus 101 by displaying a vibration analysis interface according to the frequency setting information, the amplified vibration video and/or the frequency setting information are displayed, the vibration analysis is visually displayed, that is, the current vibration scene can be visually reflected, the vibration effect can be more visually displayed, the vibration detection device can position and need new detection points according to the operation of dragging and the like of a specific area by a user, and update and display of the corresponding vibration video, which is beneficial to improving the intelligence and accuracy of the vibration analysis of the video.
Referring to fig. 2A, fig. 2A is a schematic flowchart of a track anomaly detection method in an embodiment of the present application, which is applied to a vibration detection device, and the method for performing vibration analysis based on a video in the embodiment of the present application includes the following steps:
s201, displaying a vibration analysis interface on a display screen of the vibration detection device, wherein the vibration analysis interface comprises at least one video display window, and each video display window comprises a frequency band display area and a video display area.
The frequency band display area can correspond to the video display area one by one or correspond to the video display area according to a certain rule, and the frequency band display area is not limited uniquely.
The video display area may include the frequency band display area or may not include the frequency band display area, which is not limited herein.
As shown in fig. 2B, fig. 2B is an interface for displaying a vibration analysis interface, and is an interface form for displaying a vibration analysis boundary, and the display vibration analysis interface is not limited to this interface form.
And S202, displaying preset frequency setting information in the frequency band display area of each video display window.
The frequency setting information may include frequency, amplitude, phase, and time-domain filtering, which is not limited herein.
And S203, displaying a target video in the video display area of each video display window, wherein the target video is a video with a motion amplification effect obtained by processing the original video of the detected target by the vibration detection equipment under the constraint condition of the frequency setting information, the motion amplification effect means that the area where the detected target moves is amplified in the target video, and the amplification factor of the motion amplification effect is associated with the frequency setting information.
The frequency setting information may be different amplification factors corresponding to different frequency bands.
Optionally, the frequency band and the amplification factor may be set in the following manner: taking a global Fourier basis as an example, considering the global transformation condition f (x + l (t)) of the intensity distribution f of the one-dimensional image along the time, the displacement function is l (t), and synthesizing a segment with the corrected motion
Wherein the amplification factor is
Optionally, a preset mapping relationship is queried, where the preset mapping relationship is set according to prior data, where the prior data may include, but is not limited to, a vibration characteristic of the detected target, such as an amplitude, a resonant frequency band, and the like.
It can be seen that, in the embodiment of the present application, first, a vibration analysis interface is displayed on a display screen of the vibration detection apparatus, the vibration analysis interface comprises at least one video display window, each video display window comprises a frequency band display area and a video display area, secondly, displaying preset frequency setting information in the frequency band display area of each video display window, and finally, displaying a target video in the video display area of each video display window, wherein the target video is a video with a motion amplification effect obtained by processing an original video of a detected target by the vibration detection equipment under the constraint condition of the frequency setting information, the motion amplification effect means that the area of the detected target moving is amplified in the target video, and the amplification factor of the motion amplification effect is associated with the frequency setting information. It can be seen that, in this example, the original video is detected by the vibration detection device, the amplified vibration video and/or the frequency setting information are displayed in the vibration analysis interface according to the frequency setting information, the vibration analysis is visually displayed, the current vibration scene can be visually reflected, the vibration effect can be more visually displayed, the vibration detection device can position a new detection point according to operations such as dragging of a user in a specific area and update and display the corresponding vibration video, and the improvement of the intelligence and the accuracy of the video for vibration analysis is facilitated.
In one possible example, the vibration analysis interface further includes a window layout component and an add display band component;
the window layout component is used for configuring a window layout selected by a user or a default window layout for the vibration analysis interface;
the add display band component is to add a frequency constraint for the configured video display window.
As shown in fig. 2C, fig. 2C is an interface schematic diagram, where the interface includes a window layout component and an add display frequency band component, and the interface schematic diagram of the window layout component and the add display frequency band component is not limited to this interface form.
Therefore, in the example, the window layout assembly and the display frequency band assembly are added in the vibration analysis interface, so that various control can be performed on the target video, the user can watch and control the target video more conveniently, the user can perform the next operation conveniently, the accuracy and the intelligence of vibration analysis based on the amplified video can be improved, and the detected target can be detected more accurately.
In one possible example, the each video display window of the vibration analysis interface further comprises a play control component;
the play control component comprises virtual function buttons for implementing at least one of the following functions: play control, progress control, volume control, and zoom control.
Therefore, in the example, the virtual function buttons in various forms are added in the vibration analysis interface, so that various control can be performed on the target video, the user can watch and control the target video more conveniently, the user can perform the next operation conveniently, the accuracy and the intelligence of vibration analysis based on the amplified video can be improved, and the detected target can be detected more accurately.
In one possible example, the vibration analysis interface includes a plurality of video display windows, wherein the frequency setting information configured for any two video display windows in the plurality of video display windows is different from each other; the target videos displayed in any two video display windows correspond to the same part of the detected target, and at least one of the following vibration parameters of the same part are different from each other: amplitude, frequency and phase.
It can be seen that, in this example, a plurality of video display windows exist in the vibration analysis interface, and frequency information in the plurality of video windows may be the same or different, so that various control is performed on the target video, and therefore, it is more convenient for a user to watch and control the target video, and the user can perform the next operation, so that the accuracy and intelligence of vibration analysis based on the amplified video can be improved, and more accurate detection can be performed on the detected target.
In one possible example, the video display area of each video display window is used for displaying a target video and simultaneously fusing and displaying an abnormal prediction result of the detected target in the target video, wherein the abnormal prediction result is obtained by the vibration detection device according to the target video processed by a preset abnormal prediction model.
The display mode for displaying the abnormal prediction result of the detected target can be to acquire an abnormal part, mark the abnormal part in a range, highlight the mark and explain the abnormal category in a text at the mark.
Therefore, in the example, after the abnormality is detected by the vibration detection device, the abnormality prediction result is displayed in the vibration analysis interface and marked, which is beneficial to improving the intelligence and accuracy of the vibration analysis of the video.
In one possible example, the method further comprises: dividing the original video into a plurality of frames of video images; converting the multi-frame video image from an RGB color space to a YIQ color space to obtain a multi-frame reference image, wherein pixel points of each target image in the multi-frame reference image comprise brightness information and chrominance information; performing Fourier transform FFT processing on the brightness information in the multi-frame reference image to obtain a multi-frame target image; processing the multi-frame target image according to the motion amplification algorithm to obtain a multi-frame amplified image; and synthesizing the multi-frame amplified images to obtain a target amplified video.
After the shot video is divided into a plurality of frames of video images, pixel points in each frame of video image in the plurality of frames of video images contain RGB color information, RGB is a color standard in the industry, and each pixel point contains brightness components corresponding to three color channels of red (R), green (G) and blue (B).
YIQ is a Television system standard of National Television Standards Committee (NTSC). Y is a luminance component providing black-and-white and color tv, I represents a chrominance component from orange to cyan, and Q represents a chrominance component from violet to yellow-green.
In the embodiment of the application, a multi-frame video image can be converted from an RGB color space to a YIQ color space to obtain a multi-frame reference image, and a pixel point of each reference image in the multi-frame reference image includes a luminance component Y, a chrominance component I, and a chrominance component Q. In specific implementation, the RGB color information of each pixel point of each video image in the multi-frame video image can be converted by the following conversion formula to obtain YIQ color information of each pixel point:
Y＝0.299*R+0.587*G+0.114*B；
I＝0.596*R–0.275*G–0.321*B；
Q＝0.212*R-0.523*G+0.311*B。
the luminance information in the multi-frame reference image may be subjected to Fast Fourier Transform (FFT) processing to obtain a multi-frame target image. In specific implementation, the FFT processing may be performed on the luminance information of each pixel point of each reference image in the multi-frame reference image, and the luminance change of the time domain corresponding to the same pixel point in the multi-frame reference image is converted into the phase change of the frequency domain.
Therefore, in the example, the vibration detection device can obtain different amplification effects under different frequencies by setting different frequencies according to the change frequency setting information, and further update and display the corresponding target video, namely flexibly change the amplified video of the target to be detected, so that the diversity and intelligence of vibration analysis of the vibration detection device based on the amplified video are improved, and the target to be detected can be detected more accurately and flexibly.
Referring to fig. 3, in accordance with the embodiment shown in fig. 2A, fig. 3 is a schematic flowchart of another track abnormality detection method provided in the embodiment of the present application, which is applied to a vibration detection device, as shown in fig. 3, the track abnormality detection method in the embodiment of the present application includes the following steps:
s301, segmenting the original video into a plurality of frames of video images.
S302, converting the multi-frame video image from an RGB color space to a YIQ color space to obtain a multi-frame reference image.
And S303, performing Fourier transform FFT processing on the brightness information in the multi-frame reference image to obtain a multi-frame target image.
S304, processing the multi-frame target image according to the motion amplification algorithm to obtain a multi-frame amplified image.
S305, synthesizing the multi-frame amplified images to obtain a target amplified video.
It can be seen that, in the embodiment of the present application, first, a vibration analysis interface is displayed on a display screen of the vibration detection apparatus, the vibration analysis interface comprises at least one video display window, each video display window comprises a frequency band display area and a video display area, secondly, displaying preset frequency setting information in the frequency band display area of each video display window, and finally, displaying a target video in the video display area of each video display window, wherein the target video is a video with a motion amplification effect obtained by processing an original video of a detected target by the vibration detection equipment under the constraint condition of the frequency setting information, the motion amplification effect means that the area of the detected target moving is amplified in the target video, and the amplification factor of the motion amplification effect is associated with the frequency setting information. It can be seen that, in this example, the original video is detected by the vibration detection device, the amplified vibration video and/or the frequency setting information are displayed in the vibration analysis interface according to the frequency setting information, the vibration analysis is visually displayed, the current vibration scene can be visually reflected, the vibration effect can be more visually displayed, the vibration detection device can position a new detection point according to operations such as dragging of a user in a specific area and update and display the corresponding vibration video, and the improvement of the intelligence and the accuracy of the video for vibration analysis is facilitated.
In addition, the amplified video of the detected target is obtained through a plurality of preset algorithms in the vibration detection device, the accuracy and the intelligence of vibration analysis of the vibration detection device based on the amplified video can be improved, and the detected target can be detected more accurately.
Referring to fig. 4, in accordance with the embodiment shown in fig. 2A, fig. 4 is a schematic flowchart of another track abnormality detection method provided in the embodiment of the present application, which is applied to a vibration detection device, and as shown in fig. 4, the track abnormality detection method in the embodiment of the present application includes the following steps:
s401, segmenting the original video into a plurality of frames of video images.
S402, converting the multi-frame video image from an RGB color space to a YIQ color space to obtain a multi-frame reference image.
And S403, performing Fourier transform FFT processing on the brightness information in the multi-frame reference image to obtain a multi-frame target image.
S404, acquiring the frequency setting information.
S405, when a motion amplification algorithm is carried out, the multi-frame target image is processed according to the frequency setting information, and a target multi-frame amplified image is obtained.
And S406, synthesizing the multi-frame amplified images to obtain a target amplified video.
It can be seen that, in the embodiment of the present application, first, a vibration analysis interface is displayed on a display screen of the vibration detection apparatus, the vibration analysis interface comprises at least one video display window, each video display window comprises a frequency band display area and a video display area, secondly, displaying preset frequency setting information in the frequency band display area of each video display window, and finally, displaying a target video in the video display area of each video display window, wherein the target video is a video with a motion amplification effect obtained by processing an original video of a detected target by the vibration detection equipment under the constraint condition of the frequency setting information, the motion amplification effect means that the area of the detected target moving is amplified in the target video, and the amplification factor of the motion amplification effect is associated with the frequency setting information. It can be seen that, in this example, the original video is detected by the vibration detection device, the amplified vibration video and/or the frequency setting information are displayed in the vibration analysis interface according to the frequency setting information, the vibration analysis is visually displayed, the current vibration scene can be visually reflected, the vibration effect can be more visually displayed, the vibration detection device can position a new detection point according to operations such as dragging of a user in a specific area and update and display the corresponding vibration video, and the improvement of the intelligence and the accuracy of the video for vibration analysis is facilitated.
In addition, the amplified video of the detected target is obtained through a plurality of preset algorithms in the vibration detection device, so that the accuracy and intelligence of vibration analysis of the vibration device based on the amplified video can be improved, and the detected target can be detected more accurately.
In addition, the vibration detection equipment can obtain different amplification effects under different frequencies according to the change frequency setting information by setting different frequencies, and further updates and displays corresponding target videos, namely flexibly changes the amplified videos of the detected targets, so that the diversity and intelligence of vibration analysis of the vibration detection equipment based on the amplified videos are improved, and the detected targets can be detected more accurately and flexibly.
The above description has introduced the solution of the embodiment of the present application mainly from the perspective of the method-side implementation process. It is understood that the electronic device comprises corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above-mentioned functions. Those of skill in the art will readily appreciate that the present application is capable of hardware or a combination of hardware and computer software implementing the various illustrative elements and algorithm steps described in connection with the embodiments provided herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiment of the present application, the electronic device may be divided into the functional units according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.
In accordance with the embodiments shown in fig. 2A, fig. 3, and fig. 4, please refer to fig. 5, and fig. 5 is a schematic structural diagram of a vibration detection apparatus according to an embodiment of the present application, where as shown, the electronic apparatus includes a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for performing the following steps;
displaying a vibration analysis interface on a display screen of the vibration detection device, wherein the vibration analysis interface comprises at least one video display window, and each video display window comprises a frequency band display area and a video display area;
displaying preset frequency setting information in a frequency band display area of each video display window;
and displaying a target video in the video display area of each video display window, wherein the target video is a video with a motion amplification effect obtained by processing an original video of a detected target by the vibration detection equipment under the constraint condition of the frequency setting information, the motion amplification effect means that the area where the detected target moves is amplified in the target video, and the amplification factor of the motion amplification effect is associated with the frequency setting information.
It can be seen that, in the embodiment of the present application, first, a vibration analysis interface is displayed on a display screen of the vibration detection apparatus, the vibration analysis interface comprises at least one video display window, each video display window comprises a frequency band display area and a video display area, secondly, displaying preset frequency setting information in the frequency band display area of each video display window, and finally, displaying a target video in the video display area of each video display window, wherein the target video is a video with a motion amplification effect obtained by processing an original video of a detected target by the vibration detection equipment under the constraint condition of the frequency setting information, the motion amplification effect means that the area of the detected target moving is amplified in the target video, and the amplification factor of the motion amplification effect is associated with the frequency setting information. It can be seen that, in this example, the original video is detected by the vibration detection device, the amplified vibration video and/or the frequency setting information are displayed in the vibration analysis interface according to the frequency setting information, the vibration analysis is visually displayed, the current vibration scene can be visually reflected, the vibration effect can be more visually displayed, the vibration detection device can position a new detection point according to operations such as dragging of a user in a specific area and update and display the corresponding vibration video, and the improvement of the intelligence and the accuracy of the video for vibration analysis is facilitated.
In one possible example, the vibration analysis interface further includes a window layout component and an add display band component; the window layout component is used for configuring a window layout selected by a user or a default window layout for the vibration analysis interface; the add display band component is to add a frequency constraint for the configured video display window.
In one possible example, the each video display window of the vibration analysis interface further comprises a play control component; the play control component comprises virtual function buttons for implementing at least one of the following functions: play control, progress control, volume control, and zoom control.
In one possible example, the vibration analysis interface includes a plurality of video display windows, wherein the frequency setting information configured for any two video display windows in the plurality of video display windows is different from each other; the target videos displayed in any two video display windows correspond to the same part of the detected target, and at least one of the following vibration parameters of the same part are different from each other: amplitude, frequency and phase.
In one possible example, the video display area of each video display window is used for displaying a target video and simultaneously fusing and displaying an abnormal prediction result of the detected target in the target video, wherein the abnormal prediction result is obtained by the vibration detection device according to the target video processed by a preset abnormal prediction model.
In one possible example, the instructions in the program are further specifically for performing the following:
dividing the original video into a plurality of frames of video images; converting the multi-frame video image from an RGB color space to a YIQ color space to obtain a multi-frame reference image, wherein pixel points of each target image in the multi-frame reference image comprise brightness information and chrominance information; performing Fourier transform FFT processing on the brightness information in the multi-frame reference image to obtain a multi-frame target image; processing the multi-frame target image according to the motion amplification algorithm to obtain a multi-frame amplified image; and synthesizing the multi-frame amplified images to obtain a target amplified video.
In one possible example, in the aspect that the multiple frames of target images are processed according to the motion amplification algorithm to obtain multiple frames of amplified images, the instructions in the program are specifically configured to perform the following operations:
acquiring the frequency setting information; and when a motion amplification algorithm is carried out, processing the multi-frame target image according to the frequency setting information to obtain a target multi-frame amplified image.
Fig. 6 is a block diagram showing functional units of an abnormality detection device 600 for a track according to an embodiment of the present application. The abnormality detection apparatus 600 for a rail is applied to a vibration detection device, and the abnormality detection apparatus 600 for a rail includes a display unit 601, wherein,
the display unit is used for displaying a vibration analysis interface on a display screen of the vibration detection device, the vibration analysis interface comprises at least one video display window, and each video display window comprises a frequency band display area and a video display area;
the display unit is further configured to display preset frequency setting information in a frequency band display area of each video display window;
the display unit is further configured to display a target video in a video display area of each video display window, where the target video is a video with a motion amplification effect obtained by processing an original video of a detected target by the vibration detection device under the constraint condition of the frequency setting information, the motion amplification effect is that an area where the detected target moves is amplified in the target video, and the amplification factor of the motion amplification effect is associated with the frequency setting information.
It can be seen that, in the embodiment of the present application, first, a vibration analysis interface is displayed on a display screen of the vibration detection apparatus, the vibration analysis interface comprises at least one video display window, each video display window comprises a frequency band display area and a video display area, secondly, displaying preset frequency setting information in the frequency band display area of each video display window, and finally, displaying a target video in the video display area of each video display window, wherein the target video is a video with a motion amplification effect obtained by processing an original video of a detected target by the vibration detection equipment under the constraint condition of the frequency setting information, the motion amplification effect means that the area of the detected target moving is amplified in the target video, and the amplification factor of the motion amplification effect is associated with the frequency setting information. It can be seen that, in this example, the original video is detected by the vibration detection device, the amplified vibration video and/or the frequency setting information are displayed in the vibration analysis interface according to the frequency setting information, the vibration analysis is visually displayed, the current vibration scene can be visually reflected, the vibration effect can be more visually displayed, the vibration detection device can position a new detection point according to operations such as dragging of a user in a specific area and update and display the corresponding vibration video, and the improvement of the intelligence and the accuracy of the video for vibration analysis is facilitated.
In one possible example, the vibration analysis interface further includes a window layout component and an add display band component; the window layout component is used for configuring a window layout selected by a user or a default window layout for the vibration analysis interface; the add display band component is to add a frequency constraint for the configured video display window.
In one possible example, the each video display window of the vibration analysis interface further comprises a play control component; the play control component comprises virtual function buttons for implementing at least one of the following functions: play control, progress control, volume control, and zoom control.
In one possible example, the vibration analysis interface includes a plurality of video display windows, wherein the frequency setting information configured for any two video display windows in the plurality of video display windows is different from each other; the target videos displayed in any two video display windows correspond to the same part of the detected target, and at least one of the following vibration parameters of the same part are different from each other: amplitude, frequency and phase.
In one possible example, the video display area of each video display window is used for displaying a target video and simultaneously fusing and displaying an abnormal prediction result of the detected target in the target video, wherein the abnormal prediction result is obtained by the vibration detection device according to the target video processed by a preset abnormal prediction model.
In one possible example, the display unit 601 is specifically configured to: dividing the original video into a plurality of frames of video images; converting the multi-frame video image from an RGB color space to a YIQ color space to obtain a multi-frame reference image, wherein pixel points of each target image in the multi-frame reference image comprise brightness information and chrominance information; performing Fourier transform FFT processing on the brightness information in the multi-frame reference image to obtain a multi-frame target image; processing the multi-frame target image according to the motion amplification algorithm to obtain a multi-frame amplified image; and synthesizing the multi-frame amplified images to obtain a target amplified video.
In a possible example, in the aspect that the multiple frames of target images are processed according to the motion amplification algorithm to obtain multiple frames of amplified images, the apparatus 600 for performing vibration analysis based on video further includes a processing unit 602, where the processing unit 602 is specifically configured to:
acquiring the frequency setting information; and when a motion amplification algorithm is carried out, processing the multi-frame target image according to the frequency setting information to obtain a target multi-frame amplified image.
Embodiments of the present application also provide a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any one of the methods described in the above method embodiments, and the computer includes a mobile terminal.
Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods as described in the above method embodiments. The computer program product may be a software installation package, the computer comprising a mobile terminal.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required by the invention.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a memory and includes several instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned memory comprises: various media capable of storing program codes, such as a usb disk, a read-only memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and the like.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: a flash disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic or optical disk, and the like.
The foregoing embodiments of the present invention have been described in detail, and the principles and embodiments of the present invention are explained herein by using specific examples, which are only used to help understand the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. An abnormality detection method for a track, comprising:
displaying a vibration analysis interface on a display screen of a vibration detection device of a track, wherein the vibration analysis interface comprises at least one video display window, and each video display window comprises a frequency band display area and a video display area;
displaying preset frequency setting information in a frequency band display area of each video display window;
and displaying a target video in the video display area of each video display window, wherein the target video is a video with a motion amplification effect obtained by processing an original video of a detected target by the vibration detection equipment under the constraint condition of the frequency setting information, the motion amplification effect means that the area where the detected target moves is amplified in the target video, and the amplification factor of the motion amplification effect is associated with the frequency setting information.
2. The method of claim 1, wherein the vibration analysis interface further comprises a window layout component and an add display band component;
the window layout component is used for configuring a window layout selected by a user or a default window layout for the vibration analysis interface;
the add display band component is to add a frequency constraint for the configured video display window.
3. The method of claim 1 or 2, wherein each of the video display windows of the vibration analysis interface further comprises a play control component;
the play control component comprises virtual function buttons for implementing at least one of the following functions: play control, progress control, volume control, and zoom control.
4. The method according to any one of claims 1-3, wherein the vibration analysis interface comprises a plurality of video display windows, and wherein the frequency setting information configured for any two of the plurality of video display windows is different from each other;
the target videos displayed in any two video display windows correspond to the same part of the detected target, and at least one of the following vibration parameters of the same part are different from each other: amplitude, frequency and phase.
5. The method according to any one of claims 1 to 4, wherein the video display area of each video display window is used for displaying the target video and simultaneously fusing and displaying the abnormal prediction result of the detected target in the target video, wherein the abnormal prediction result is obtained by the vibration detection device according to the processing of the target video through a preset abnormal prediction model.
6. The method according to any one of claims 1-4, further comprising:
dividing the original video into a plurality of frames of video images;
converting the multi-frame video image from an RGB color space to a YIQ color space to obtain a multi-frame reference image, wherein pixel points of each target image in the multi-frame reference image comprise brightness information and chrominance information;
performing Fourier transform FFT processing on the brightness information in the multi-frame reference image to obtain a multi-frame target image;
processing the multi-frame target image according to the motion amplification algorithm to obtain a multi-frame amplified image;
and synthesizing the multi-frame amplified images to obtain a target amplified video.
7. The method according to claim 6, wherein the processing the plurality of frames of target images according to the motion amplification algorithm to obtain a plurality of frames of amplified images comprises:
acquiring the frequency setting information;
and when a motion amplification algorithm is carried out, processing the multi-frame target image according to the frequency setting information to obtain a target multi-frame amplified image.
8. A video-based vibration analysis apparatus applied to a vibration detection device, the video-based vibration analysis apparatus including a display unit, wherein,
the display unit is used for displaying a vibration analysis interface on a display screen of the vibration detection device, the vibration analysis interface comprises at least one video display window, and each video display window comprises a frequency band display area and a video display area;
the display unit is further configured to display preset frequency setting information in a frequency band display area of each video display window;
the display unit is further configured to display a target video in a video display area of each video display window, where the target video is a video with a motion amplification effect obtained by processing an original video of a detected target by the vibration detection device under the constraint condition of the frequency setting information, the motion amplification effect is that an area where the detected target moves is amplified in the target video, and the amplification factor of the motion amplification effect is associated with the frequency setting information.
9. An electronic device comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 1-7.
10. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110982111.7A CN113682342A (en) | 2021-08-25 | 2021-08-25 | Track anomaly detection method and related product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110982111.7A CN113682342A (en) | 2021-08-25 | 2021-08-25 | Track anomaly detection method and related product |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113682342A true CN113682342A (en) | 2021-11-23 |
Family
ID=78582539
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110982111.7A Withdrawn CN113682342A (en) | 2021-08-25 | 2021-08-25 | Track anomaly detection method and related product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113682342A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115170254A (en) * | 2022-09-08 | 2022-10-11 | 深圳市永安环保实业有限公司 | Method for realizing sleeper remote customization, network customization platform and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110108348A (en) * | 2019-05-15 | 2019-08-09 | 湖南科技大学 | Thin-wall part micro breadth oscillation measurement method and system based on motion amplification optical flow tracking |
| CN110595749A (en) * | 2019-04-26 | 2019-12-20 | 深圳市豪视智能科技有限公司 | Method and device for detecting vibration fault of electric fan |
| CN110595605A (en) * | 2019-04-26 | 2019-12-20 | 深圳市豪视智能科技有限公司 | Vibration detection system |
| CN110595603A (en) * | 2019-04-26 | 2019-12-20 | 深圳市豪视智能科技有限公司 | Video-based vibration analysis method and related product |
| CN110595745A (en) * | 2019-04-26 | 2019-12-20 | 深圳市豪视智能科技有限公司 | Detection method for abnormality of fixing screw of equipment and related product |
| CN110617965A (en) * | 2019-04-26 | 2019-12-27 | 深圳市豪视智能科技有限公司 | Method for detecting gear set abnormality and related product |
| CN110617973A (en) * | 2019-04-26 | 2019-12-27 | 深圳市豪视智能科技有限公司 | Vibration detection method and related device |
| CN110631812A (en) * | 2019-04-26 | 2019-12-31 | 深圳市豪视智能科技有限公司 | Track vibration detection method and device and vibration detection equipment |
| CN111447403A (en) * | 2019-01-16 | 2020-07-24 | 杭州海康威视数字技术股份有限公司 | Video display method, device and system |
-
2021
- 2021-08-25 CN CN202110982111.7A patent/CN113682342A/en not_active Withdrawn
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111447403A (en) * | 2019-01-16 | 2020-07-24 | 杭州海康威视数字技术股份有限公司 | Video display method, device and system |
| CN110595749A (en) * | 2019-04-26 | 2019-12-20 | 深圳市豪视智能科技有限公司 | Method and device for detecting vibration fault of electric fan |
| CN110595605A (en) * | 2019-04-26 | 2019-12-20 | 深圳市豪视智能科技有限公司 | Vibration detection system |
| CN110595603A (en) * | 2019-04-26 | 2019-12-20 | 深圳市豪视智能科技有限公司 | Video-based vibration analysis method and related product |
| CN110595745A (en) * | 2019-04-26 | 2019-12-20 | 深圳市豪视智能科技有限公司 | Detection method for abnormality of fixing screw of equipment and related product |
| CN110617965A (en) * | 2019-04-26 | 2019-12-27 | 深圳市豪视智能科技有限公司 | Method for detecting gear set abnormality and related product |
| CN110617973A (en) * | 2019-04-26 | 2019-12-27 | 深圳市豪视智能科技有限公司 | Vibration detection method and related device |
| CN110631812A (en) * | 2019-04-26 | 2019-12-31 | 深圳市豪视智能科技有限公司 | Track vibration detection method and device and vibration detection equipment |
| CN110108348A (en) * | 2019-05-15 | 2019-08-09 | 湖南科技大学 | Thin-wall part micro breadth oscillation measurement method and system based on motion amplification optical flow tracking |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115170254A (en) * | 2022-09-08 | 2022-10-11 | 深圳市永安环保实业有限公司 | Method for realizing sleeper remote customization, network customization platform and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8976191B1 (en) | Creating a realistic color for a virtual object in an augmented reality environment | |
| CN112423082B (en) | Dynamic video overlay | |
| WO2021036637A1 (en) | Gear set abnormality detection method and related product | |
| WO2021036663A1 (en) | Method for detecting anomaly of fixed screw for device, and related products | |
| CN110595603B (en) | Video-based vibration analysis method and related product | |
| CN106980510B (en) | Window self-adaption method and device of player | |
| EP3472801B1 (en) | Image processing apparatus and recording medium | |
| EP2573670B1 (en) | Character display method and device | |
| US20200272399A1 (en) | Image processing method and apparatus | |
| CN110595779B (en) | Bearing abnormity detection method and related equipment | |
| US20110293177A1 (en) | Efficient Image and Video Recoloring for Colorblindness | |
| CN110070551A (en) | Rendering method, device and the electronic equipment of video image | |
| CN113682342A (en) | Track anomaly detection method and related product | |
| CN107402757A (en) | Page rendering method and device | |
| US20140218571A1 (en) | Image processing method capable of reducing image noise | |
| KR101985880B1 (en) | Display device and control method thereof | |
| KR20120015980A (en) | Method, system and computer program product for object color correction | |
| CN109766530B (en) | Method and device for generating chart frame, storage medium and electronic equipment | |
| US10109077B2 (en) | Image generation device and display device | |
| CN106383679B (en) | Positioning method and terminal equipment thereof | |
| CN103959204A (en) | Information processing device, information processing method, and recording medium | |
| US20160086377A1 (en) | Determining an image target's suitability for color transfer in an augmented reality environment | |
| US10262441B2 (en) | Using features at multiple scales for color transfer in augmented reality | |
| JP5825681B2 (en) | Image processing apparatus, image processing method, and program | |
| CN111784574A (en) | Single-screen multi-picture boundary display method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20211123 |
|
| WW01 | Invention patent application withdrawn after publication |