WO2021042906A1 - Procédé de détection de vibration et appareil associé - Google Patents

Procédé de détection de vibration et appareil associé Download PDF

Info

Publication number
WO2021042906A1
WO2021042906A1 PCT/CN2020/104816 CN2020104816W WO2021042906A1 WO 2021042906 A1 WO2021042906 A1 WO 2021042906A1 CN 2020104816 W CN2020104816 W CN 2020104816W WO 2021042906 A1 WO2021042906 A1 WO 2021042906A1
Authority
WO
WIPO (PCT)
Prior art keywords
vibration
exhaust manifold
vibration detection
feature points
video
Prior art date
Application number
PCT/CN2020/104816
Other languages
English (en)
Chinese (zh)
Inventor
高风波
Original Assignee
深圳市豪视智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市豪视智能科技有限公司 filed Critical 深圳市豪视智能科技有限公司
Publication of WO2021042906A1 publication Critical patent/WO2021042906A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M17/00—Testing of vehicles
    • G01M17/007—Wheeled or endless-tracked vehicles

Definitions

  • This application relates to the technical field of vibration detection, and in particular to a vibration detection method and related devices.
  • Exhaust manifolds in vehicles often produce various vibrations when the engine is working. Among them, there are some abnormal motions of vibration response components. In order to maintain the exhaust manifolds in the vehicle, the exhaust manifold Vibration detection cannot be ignored.
  • Existing vibration detection technology usually uses accelerometer equipment, but accelerometers require long preparation and installation time. During testing, they need to be in direct contact with the exhaust manifold under test, which affects the exhaust manifold components. Vibration response, and only a limited number of discrete points can be tested.
  • the embodiments of the present application provide a vibration detection method and related devices, in order to ensure the stability of vibration detection.
  • an embodiment of the present application provides a vibration detection method, which is characterized in that it is applied to an electronic device, and the electronic device is connected to a camera device, and the method includes:
  • the vibration detection entrance provides a vibration detection type option, and the vibration detection type option includes an automobile exhaust manifold;
  • an embodiment of the present application provides a vibration detection device, which is characterized in that it is applied to an electronic device, the electronic device is connected to a camera device, and the electronic device includes a processing unit and a communication unit, wherein:
  • the processing unit is configured to display a vibration detection entrance through the main interface of the vibration detection device, the vibration detection entrance provides a vibration detection type option, the vibration detection type option includes an automobile exhaust manifold; and is used to obtain user input
  • the vibration detection type information, the information signal is transmitted through the communication unit, and vibration operation prompt information is generated according to the vibration detection type information, the vibration operation prompt information is used to instruct the user to perform a preset operation on the vehicle to be tested; and It is used to obtain the vibration video of the automobile exhaust manifold through a vibration device, and process the vibration video according to a preset strategy to obtain a target video with a motion amplification effect.
  • the motion amplification effect refers to the vehicle exhaust
  • the manifold is amplified in the target video; and used to obtain the vibration data of the automobile exhaust manifold according to the target video; and used to determine according to the target video and/or the vibration data Whether the vibration state of the automobile exhaust manifold is abnormal; if so, output a preset alarm message.
  • an embodiment of the present application provides an electronic device, including a processor, a memory, a communication interface, and one or more programs.
  • the one or more programs are stored in the memory and configured by The processor executes, and the program includes instructions for executing the steps in any method in the first aspect of the embodiments of the present application.
  • an embodiment of the present application provides a computer-readable storage medium, wherein the above-mentioned computer-readable storage medium stores a computer program for electronic data exchange, wherein the above-mentioned computer program enables a computer to execute In one aspect, part or all of the steps described in any method.
  • the embodiments of the present application provide a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute as implemented in this application.
  • the computer program product may be a software installation package.
  • the electronic device first displays the vibration detection entrance through the main interface of the vibration detection device, and the vibration detection entrance provides vibration detection type options.
  • the vibration detection type options include automobile exhaust manifolds, and then obtain the user input Vibration detection type information, and generate vibration operation prompt information based on the vibration detection type information.
  • the vibration operation prompt information is used to instruct the user to perform a preset operation on the vehicle to be tested.
  • the vibration video is processed to obtain a target video with a motion amplification effect.
  • the motion amplification effect means that the car exhaust manifold is amplified in the target video.
  • the vibration data of the car exhaust manifold is obtained according to the target video, and then , According to the target video and/or vibration data, determine whether the vibration state of the automobile exhaust manifold is abnormal, and if so, output a preset alarm message. It can be seen that the embodiment of the application obtains the vibration information of the exhaust manifold of the automobile by processing the vibration video of the exhaust manifold of the automobile, determines the vibration state of the exhaust manifold of the automobile to be tested, and improves the convenience of electronic equipment for vibration detection.
  • FIG. 1 is a schematic diagram of a system architecture for vibration detection according to an embodiment of the present application
  • FIG. 2A is a schematic flowchart of a vibration detection method provided by an embodiment of the present application.
  • 2B is a schematic diagram of an interface of a vibration detection portal provided by an embodiment of the application.
  • 2C is a schematic diagram of an automobile exhaust manifold partition provided by an embodiment of the application.
  • FIG. 3 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • Fig. 4 is a block diagram of functional units of a vibration detection device provided by an embodiment of the present application.
  • Exhaust manifold vibration detection technology refers to a technology that can detect exhaust manifolds. After the electronic equipment is equipped with a vibration detection device, it obtains the vibration video of the tested exhaust manifold through the vibration detection device, and processes and analyzes the vibration video to determine whether the vibration state of the tested exhaust manifold is abnormal.
  • the electronic device 101 is a device with the exhaust manifold vibration detection function
  • the camera device 102 is a video recording device. After the electronic device 101 and the camera device 102 establish a control connection, The user sends related instructions to the camera 102 through the electronic device 101 to obtain a vibration video of the area where the vehicle 103 is moving.
  • the electronic device involved in the embodiments of the present application may be an electronic device with a vibration detection function.
  • the electronic device may include various computing devices with a vibration detection function or other processing devices connected to a wireless modem, as well as various forms of electronic equipment. Equipment (terminaldevice) and so on.
  • the vibration detection of the exhaust manifold cannot be ignored.
  • the existing vibration detection technology usually uses accelerometer equipment, but the accelerometer requires a long preparation and installation time.
  • the direct contact of the exhaust manifold will affect the vibration response of the exhaust manifold components, and only a limited number of discrete points can be tested.
  • embodiments of the present application propose a vibration detection method, in order to improve the convenience of vibration detection of the exhaust manifold in a vehicle.
  • the embodiments of the present application will be described in detail below in conjunction with the drawings.
  • FIG. 2A is a schematic flowchart of a vibration detection method provided by an embodiment of the present application, which is applied to an electronic device. As shown in FIG. 2A, the vibration detection method includes:
  • the electronic device displays a vibration detection portal through the main interface of the vibration detection device, the vibration detection portal provides a vibration detection type option, and the vibration detection type option includes an automobile exhaust manifold.
  • the vibration detection type options may include the vibration detection area option and the "start vibration detection" operation corresponding to the vibration detection area option.
  • the vibration detection area may be the exhaust manifold, tires, suspension, and engine of the vehicle, and is not specifically limited. .
  • FIG. 2B is a schematic diagram of an interface of a vibration detection entrance provided by an embodiment of the application, including exhaust manifolds, tires, suspensions, and engines.
  • the user interface provides a vibration detection area for the user.
  • the "Start Vibration Detection" virtual button corresponding to the option and the vibration detection area option, when the user selects the "Start Vibration Detection" corresponding to the exhaust manifold, the electronic device will perform vibration detection for the exhaust manifold.
  • the electronic device can provide the user with a human-computer interaction interface for vibration detection, and the user can click the corresponding vibration detection type option through the interface, thereby improving the intelligence of the vibration detection of the electronic device.
  • the electronic device obtains the vibration detection type information input by the user, and generates vibration operation prompt information according to the vibration detection type information, where the vibration operation prompt information is used to instruct the user to perform a preset operation on the vehicle to be tested.
  • the preset operation is used to make the exhaust manifold of the automobile work and vibrate.
  • the preset operation can hoist the vehicle, turn on the engine, and place the camera device in a suitable position to prepare to shoot the vibration video.
  • the preset operation can also be the operation of stepping on the accelerator pedal in neutral gear and placing the camera device in a suitable position. Position to prepare for shooting vibration video.
  • the electronic device can prompt the user to perform preset operations on the vehicle, so that the exhaust manifold of the vehicle is in a working vibration state, which improves the convenience of vibration detection.
  • the electronic device obtains the vibration video of the exhaust manifold of the automobile through a vibration device, and processes the vibration video according to a preset strategy to obtain a target video with a motion amplification effect, where the motion amplification effect refers to all The automobile exhaust manifold is enlarged in the target video.
  • the electronic device processes the vibration video according to a preset strategy to obtain a target video with a motion amplification effect.
  • the implementation manner may be: the electronic device divides the vibration video into frames to obtain sequence frames; The device converts the color space of the sequence frame to obtain the brightness information of the sequence frame; the electronic device performs fast Fourier transform FFT on the brightness information to obtain the phase information of the sequence frame; The phase information performs motion amplification processing on the sequence frame to obtain an amplified sequence frame, and synthesizes the amplified sequence frame into a target video.
  • the electronic device performs motion amplification processing on the sequence frame according to the phase information to obtain the amplified sequence frame
  • the implementation manner of synthesizing the amplified sequence frame into the target video may be: transforming the FFT
  • the latter Y channel image is subjected to spatial decomposition of the complex steerable gold tower to obtain the first image; the first image is subjected to time domain band pass filtering, amplified time domain band pass filtering, and complex steerable pyramid reconstruction to obtain the amplified Y channel Image; synthesize the target video according to the enlarged Y-channel image.
  • the electronic device can obtain a target video with a motion amplification effect through color space conversion and FFT, which improves the intelligence of vibration detection.
  • S204 The electronic device obtains vibration data of the exhaust manifold of the automobile according to the target video.
  • the implementation manner of the electronic device acquiring the vibration data of the moving area according to the target video may be: performing phase calculation and interpolation filtering on the synthesized target video to obtain the moving area Vibration data of, where the vibration data can be at least one of vibration amplitude, vibration frequency, and vibration phase.
  • the vibration frequency refers to the number of complete vibrations that are partially completed in the area where the movement occurs per unit time
  • the vibration amplitude is the absolute value of the maximum displacement from the equilibrium position when the area where the movement occurs vibrates, and the amplitude is in the numerical value.
  • the upper is equal to the magnitude of the maximum displacement, which describes the magnitude of the object's vibration amplitude and the strength of the vibration.
  • the electronic device obtains the vibration data of the area where the movement occurs by processing the target video.
  • S205 The electronic device determines whether the vibration state of the exhaust manifold of the automobile is abnormal according to the target video and/or the vibration data.
  • the electronic device determines whether the vibration state of the automobile exhaust manifold is abnormal according to the target video and/or the vibration data, including: the electronic device obtains reference vibration data, and the vibration reference data is Vibration data corresponding to the automobile exhaust manifold under normal conditions; when the electronic device determines that the vibration data is greater than the reference vibration data, it determines that the vibration state of the automobile exhaust manifold is an abnormal state.
  • the vibration data may be a vibration amplitude
  • the vibration amplitude is the maximum vibration amplitude of the exhaust manifold of the automobile
  • the maximum vibration amplitude of the exhaust manifold of the automobile is compared with the reference vibration data If the maximum vibration amplitude of the exhaust manifold of the automobile is greater than the reference vibration amplitude in the reference vibration data, it is determined that the vibration state of the vehicle under test is an abnormal state.
  • the electronic device determines that the vibration state of the vehicle to be tested is an abnormal state by comparing the maximum vibration amplitude of the moving area with the reference vibration amplitude.
  • obtaining the reference vibration data by the electronic device includes: the electronic device uses the number of the automobile exhaust manifold as a query identifier to query a database to obtain the configuration condition corresponding to the number, and the database includes the automobile exhaust manifold. Correspondence between the number of the gas manifold and the configuration condition, the configuration condition including the reference vibration data of the exhaust manifold of the automobile.
  • the number of the exhaust manifold is the code number of the exhaust manifold of the automobile stored in the electronic device.
  • the reference vibration data in the database is experimental data obtained through experiments under normal conditions of the exhaust manifold of the automobile, including the resonance frequency.
  • the electronic device obtains the reference vibration data through the number of the exhaust manifold of the car, so as to ensure the reliability of the vibration detection.
  • the preset alarm message may be "replace the exhaust manifold”.
  • the electronic device improves the reliability of vibration detection by outputting alarm information.
  • the electronic device first displays the vibration detection entrance through the main interface of the vibration detection device, and the vibration detection entrance provides vibration detection type options.
  • the vibration detection type options include automobile exhaust manifolds, and then obtain the user input Vibration detection type information, and generate vibration operation prompt information based on the vibration detection type information.
  • the vibration operation prompt information is used to instruct the user to perform a preset operation on the vehicle to be tested.
  • the vibration video is processed to obtain a target video with a motion amplification effect.
  • the motion amplification effect means that the car exhaust manifold is amplified in the target video.
  • the vibration data of the car exhaust manifold is obtained according to the target video, and then , According to the target video and/or vibration data, determine whether the vibration state of the automobile exhaust manifold is abnormal, and if so, output a preset alarm message. It can be seen that the embodiment of the application obtains the vibration information of the exhaust manifold of the automobile by processing the vibration video of the exhaust manifold of the automobile, determines the vibration state of the exhaust manifold of the automobile to be tested, and improves the convenience of electronic equipment for vibration detection.
  • the electronic device processes the vibration video according to a preset strategy to obtain a target video with a motion amplification effect, including: the electronic device performs a frame sequence composed of multiple frames of the target video Spatial pyramid decomposition, to obtain a pyramid structure composed of multiple sub-images with different spatial resolutions; the electronic device performs time-domain band-pass filtering processing on each of the multiple sub-images in the pyramid structure to obtain the target frequency band corresponding The conversion signal of the conversion signal; the electronic device amplifies the displacement corresponding to the conversion signal by A times to obtain the amplified signal, where the value range of A is (2, Amax), where the value of Amax is determined by the displacement function of the target frequency band and the conversion signal Determine; the electronic device combines the amplified signal and the pyramid structure to perform pyramid reconstruction to obtain an amplified output video.
  • the frame sequence composed of multiple frames of the target video is decomposed into multiple Sub-images of different spatial resolutions and different scale sizes form a pyramid structure.
  • a Gaussian pyramid is used to decompose the multi-frame image of the target video, that is, a pyramid structure is composed of a set of image sequences that are halved in size.
  • Each level of image in the sequence is the result of low-pass filtering of the previous level of image and sampling every other row and every column.
  • Pyramid decomposition is to perform spatial filtering on the frame sequence, decompose to obtain frequency bands of different spatial frequencies, and amplify these frequency bands respectively. Because frequency bands at different spatial frequencies correspond to different signal-to-noise ratios, the lower the spatial frequency, the less image noise and the higher the signal-to-noise ratio. Therefore, different amplification factors can be set for each layer of spatial frequency bands. For example, a linearly variable magnification factor can be used to amplify frequency bands of different frequencies. In the pyramid structure, from the top to the bottom, the magnifications are sequentially reduced.
  • time-domain band-pass filtering can be performed on each frequency band to obtain the transformed signal of interest, that is, the transformed signal corresponding to the target frequency band, and only the transformation corresponding to the target frequency band The signal is amplified.
  • ideal band-pass filters, Butterworth band-pass filters, second-order infinite impulse response filters, etc. can be used.
  • ⁇ (t) represents the displacement signal
  • Amplify I(x,t) by ⁇ times, that is, amplify the displacement signal ⁇ (t), and the amplified signal is:
  • magnification is related to the spatial frequency and satisfies the following relationship:
  • the spatial frequency is ⁇
  • the spatial wavelength of the target frequency band is ⁇
  • ⁇ 2 ⁇ / ⁇
  • the maximum value of ⁇ can be determined by the displacement function of the target frequency band and the transformed signal. Amax ⁇ .
  • the amplified signal After the amplified signal is obtained, it is recombined with the original frequency band, and then pyramid reconstruction, such as Laplace pyramid transform reconstruction, is used to obtain the amplified image, and then proceed to obtain the amplified output video.
  • pyramid reconstruction such as Laplace pyramid transform reconstruction
  • the electronic device magnifies the vibration video to more clearly present the vibration of the exhaust manifold of the automobile, thereby improving the accuracy of vibration detection.
  • the electronic device acquiring the vibration data of the automobile exhaust manifold according to the target video includes: the electronic device acquiring multiple image frames of the automobile exhaust manifold in the target video, Performing image recognition on each of the multiple image frames; the electronic device performs a preset area division on the automobile exhaust manifold in each image frame according to the recognition result to obtain multiple areas; The electronic device determines multiple target feature points corresponding to each of the multiple regions; the electronic device tracks the multiple target feature points to obtain position change information of the multiple target feature points; The electronic device generates vibration tracking images of the multiple target feature points according to the position information; the electronic device obtains vibration data corresponding to the target video according to the vibration tracking image.
  • the electronic device may implement the preset area division of the automobile exhaust manifold in each image frame as follows: according to the exhaust gas main pipe, exhaust branch pipe, and exhaust flange A preset area is divided into the exhaust manifold of the automobile in each image frame.
  • FIG. 2C is a schematic diagram of an automobile exhaust manifold partition provided by an embodiment of the application, as shown in FIG. 2C.
  • the automobile exhaust manifold is divided into a first vibration area 201, a second vibration area 202, a third vibration area 203, a fourth vibration area 204, a fifth vibration area 205, and a sixth vibration area 206.
  • the first vibration area 201 corresponds to the exhaust main pipe of the automobile exhaust manifold
  • the second vibration zone 202 corresponds to the first exhaust branch of the automobile exhaust manifold
  • the third vibration zone 203 corresponds to the second exhaust branch and fourth of the automobile exhaust manifold.
  • the vibration area 204 corresponds to the third exhaust branch of the automobile exhaust manifold
  • the fifth vibration area 205 corresponds to the fourth sub-exhaust branch of the automobile exhaust manifold
  • the sixth vibration area 206 corresponds to the flange of the automobile exhaust manifold.
  • the electronic device can identify the car exhaust manifold and divide the car exhaust manifold in the image frame into a preset area according to the structure of the exhaust manifold, and then determine the target feature points in each area of the area Number.
  • the electronic device determining the multiple target feature points corresponding to each of the multiple regions includes: the electronic device according to the preset type corresponding to each of the multiple regions As the initial feature points, the preset types of feature points include at least one of the following: corner points, edge points, bright points in dark areas, and dark points in bright areas; the electronic device is based on the minimum difference square sum SSD Matching, calculating the flow vectors of the multiple initial feature points; the electronic device calculates the offset distances of the multiple initial feature points according to the flow vectors corresponding to the multiple initial feature points; The multiple offset distances corresponding to the multiple initial feature points are clustered, and the multiple offset distances are clustered using the K-means clustering algorithm, wherein the k value is set to 5 to obtain 5 clustering classes Cluster; the electronic device averages the 5 clusters, and obtains the average of the first type of cluster, the average of the second type of cluster, the average of the third type of cluster, the average of the fourth type of cluster, and the first Five types of cluster average
  • the corner point is the intersection between the contours.
  • the corner point usually has the characteristics of stability, and the pixels in the area near the point have both the gradient direction and the gradient magnitude. Big change.
  • the edge point is the intersection between the vibrating object and the background image.
  • the dark point in the bright area and the bright point in the dark area have high contrast with other pixels, and can be used as the initial feature point for better observation of the motion feature point.
  • the Sum of Squared Differences (SSD) matching is used to calculate the flow vector of the initial feature points. The smaller the value of SSD, the greater the similarity between the feature points.
  • the motion trajectory of the initial feature point can be determined, and then the flow vector of the initial feature point can be obtained. Then calculate the offset distance of the initial feature point according to the flow vector, for example, Find the modulus, get It is the offset distance of the initial feature point from point A to point B.
  • the electronic device averages the 5 clusters, and obtains the average of the first type of cluster, the average of the second type of cluster, the average of the third type of cluster, the average of the fourth type of cluster, and the first Five cluster averages, among which, the average of the first cluster ⁇ the average of the second cluster ⁇ the average of the third cluster ⁇ the average of the fourth cluster ⁇ the average of the fifth cluster.
  • the initial feature points corresponding to the clusters of the first cluster average and the second cluster average can be determined as stationary points (background points), and the clusters of the fourth cluster average and the fifth cluster average
  • the corresponding initial feature point can be determined as the point of violent movement
  • the initial feature point corresponding to the cluster of the third cluster average is determined as the target feature point.
  • the implementation manner for the electronic device to determine the multiple initial feature points corresponding to each of the multiple regions may be: selecting a specific number of initial feature points in each of the multiple regions, wherein: The specific number can be any number greater than 10, and the specific number selected for each of the multiple regions can be the same or different.
  • the electronic device can determine multiple target feature points from multiple initial feature points, which improves the effectiveness of vibration detection.
  • the electronic device generating vibration tracking images of the multiple target feature points according to the position information includes: the electronic device uses time as the abscissa, and takes the multiple target feature points as the The relative displacement of each target feature point is the ordinate to construct a rectangular coordinate system; the electronic device draws vibration tracking images of multiple target feature points in the rectangular coordinate system according to the position information.
  • the relative displacement of each target feature point corresponds to the amplitude of each target feature point.
  • the electronic device can construct a vibration tracking image of the target feature point, and can clearly display the vibration data such as the amplitude of the target feature point.
  • FIG. 3 is a schematic structural diagram of an electronic device 300 according to an embodiment of the present application.
  • the electronic device 300 includes an application processor 310 , A memory 320, a communication interface 330, and one or more programs 321, wherein the one or more programs 321 are stored in the above-mentioned memory 320 and are configured to be executed by the above-mentioned application processor 310, and the one or more The program 321 includes instructions for performing the following steps;
  • the vibration detection entrance provides a vibration detection type option, and the vibration detection type option includes an automobile exhaust manifold;
  • the motion amplification effect means that the vehicle exhaust manifold is in the The target video is magnified;
  • the electronic device first displays the vibration detection entrance through the main interface of the vibration detection device, and the vibration detection entrance provides vibration detection type options.
  • the vibration detection type options include automobile exhaust manifolds, and then obtain the user input Vibration detection type information, and generate vibration operation prompt information based on the vibration detection type information.
  • the vibration operation prompt information is used to instruct the user to perform a preset operation on the vehicle to be tested.
  • the vibration video is processed to obtain a target video with a motion amplification effect.
  • the motion amplification effect means that the car exhaust manifold is amplified in the target video.
  • the vibration data of the car exhaust manifold is obtained according to the target video, and then , According to the target video and/or vibration data, determine whether the vibration state of the automobile exhaust manifold is abnormal, and if so, output a preset alarm message. It can be seen that the embodiment of the application obtains the vibration information of the exhaust manifold of the automobile by processing the vibration video of the exhaust manifold of the automobile, determines the vibration state of the exhaust manifold of the automobile to be tested, and improves the convenience of electronic equipment for vibration detection.
  • the instructions of the one or more programs 321 are specifically used to:
  • the frame sequence composed of multi-frame images is subjected to spatial pyramid decomposition to obtain a pyramid structure composed of multiple sub-images with different spatial resolutions; each sub-image in the multiple sub-images in the pyramid structure is subjected to time-domain band-pass filtering.
  • the instructions of the one or more programs 321 are specifically used to: obtain Reference vibration data, the vibration reference data is the vibration data corresponding to the automobile exhaust manifold under normal conditions; when it is determined that the vibration data is greater than the reference vibration data, the vibration data of the automobile exhaust manifold is determined The vibration state is abnormal.
  • the instructions of the one or more programs 321 are specifically used to: use the number of the exhaust manifold of the automobile as a query identifier, query the database, and obtain the number
  • the database includes the corresponding relationship between the number of the exhaust manifold of the automobile and the configuration conditions
  • the configuration condition includes reference vibration data of the exhaust manifold of the automobile.
  • the instructions of the one or more programs 321 are specifically used to: obtain the exhaust manifold of the automobile in the target video. Perform image recognition on each of the multiple image frames of the tube; perform a preset area division on the automobile exhaust manifold in each image frame according to the recognition result to obtain Multiple regions; determine multiple target feature points corresponding to each of the multiple regions; track the multiple target feature points to obtain position change information of the multiple target feature points; according to the position The information generates vibration tracking images of the multiple target feature points; according to the vibration tracking image, the vibration data corresponding to the target video is obtained.
  • the instructions of the one or more programs 321 are specifically used to:
  • the feature points of the preset type corresponding to each area are used as the initial feature points, and the feature points of the preset type include at least one of the following: corner points, edge points, bright spots in dark areas, and dark points in bright areas; based on the minimum difference
  • the value square is matched with the SSD, and the flow vectors of the multiple initial feature points are calculated;
  • the electronic device calculates the offset distances of the multiple initial feature points according to the flow vectors corresponding to the multiple initial feature points;
  • the device clusters the multiple offset distances corresponding to the multiple initial feature points, and uses the K-means clustering algorithm to cluster the multiple offset distances, where the k value is set to 3, and 3 is obtained.
  • Clusters average the three clusters, and obtain the average of the first cluster, the average of the second cluster, the average of the third cluster, the average of the fourth cluster, and the fourth Five cluster averages, where the first cluster average ⁇ the second cluster average ⁇ the third cluster average ⁇ the fourth cluster average ⁇ the fifth cluster average; the electronic device determines the The initial feature points corresponding to the offset distance in the average value of the third type of clusters are used as the multiple target feature points.
  • the instructions of the one or more programs 321 are specifically used to: take time as the abscissa, and The relative displacement of each target feature point in the multiple target feature points is the ordinate to construct a rectangular coordinate system; and the vibration tracking images of the multiple target feature points are drawn in the rectangular coordinate system according to the position information.
  • an electronic device includes hardware structures and/or software units corresponding to each function.
  • the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software-driven hardware depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.
  • the embodiment of the present application may divide the electronic device into functional units according to the foregoing method examples.
  • each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit. It should be noted that the division of units in the embodiments of the present application is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.
  • FIG. 4 is a block diagram of functional units of the vibration detection device 400 involved in an embodiment of the present application.
  • the vibration detection device 400 is applied to electronic equipment, and includes a processing unit 401 and a communication unit 402, wherein,
  • the processing unit 401 is configured to display a vibration detection portal through the main interface of the vibration detection device, the vibration detection portal provides vibration detection type options, and the vibration detection type options include automobile exhaust manifolds; and for obtaining users
  • the input vibration detection type information transmits the information signal through the communication unit 402, and generates vibration operation prompt information according to the vibration detection type information, and the vibration operation prompt information is used to instruct the user to perform a preset operation on the vehicle to be tested And used to obtain the vibration video of the automobile exhaust manifold through a vibration device, and process the vibration video according to a preset strategy to obtain a target video with a motion amplification effect, the motion amplification effect refers to the car
  • the exhaust manifold is amplified in the target video; and used to obtain vibration data of the automobile exhaust manifold according to the target video; and used to obtain vibration data according to the target video and/or the vibration
  • the data determines whether the vibration state of the automobile exhaust manifold is abnormal; if it is, the preset alarm information is output.
  • control device 400 may further include a storage unit 403 for storing program codes and data of the electronic device.
  • the processing unit 401 may be a processor
  • the communication unit 402 may be a touch screen or a transceiver
  • the storage unit 403 may be a memory.
  • the electronic device first displays the vibration detection entrance through the main interface of the vibration detection device, and the vibration detection entrance provides vibration detection type options.
  • the vibration detection type options include automobile exhaust manifolds, and then obtain the user input Vibration detection type information, and generate vibration operation prompt information based on the vibration detection type information.
  • the vibration operation prompt information is used to instruct the user to perform a preset operation on the vehicle to be tested.
  • the vibration video is processed to obtain a target video with a motion amplification effect.
  • the motion amplification effect means that the car exhaust manifold is amplified in the target video.
  • the vibration data of the car exhaust manifold is obtained according to the target video, and then , According to the target video and/or vibration data, determine whether the vibration state of the automobile exhaust manifold is abnormal, and if so, output a preset alarm message. It can be seen that the embodiment of the application obtains the vibration information of the exhaust manifold of the automobile by processing the vibration video of the exhaust manifold of the automobile, determines the vibration state of the exhaust manifold of the automobile to be tested, and improves the convenience of electronic equipment for vibration detection.
  • the processing unit 401 is specifically configured to: compose multiple frames of the target video The frame sequence is subjected to spatial pyramid decomposition to obtain a pyramid-shaped structure composed of multiple sub-images with different spatial resolutions; each sub-image in the multiple sub-images in the pyramid-shaped structure is subjected to time-domain band-pass filtering to obtain the corresponding target frequency band Transform the signal; Amplify the displacement corresponding to the transformed signal by A times to obtain the amplified signal, where the value range of A is (2, Amax), where the value of Amax is determined by the target frequency band and the displacement function of the transformed signal; combined with the amplification Pyramid reconstruction is performed on the signal and pyramid structure to obtain an amplified output video.
  • the processing unit 401 is specifically configured to: obtain reference vibration data, and
  • the vibration reference data is the vibration data corresponding to the exhaust manifold of the automobile under normal conditions; when it is determined that the vibration data is greater than the reference vibration data, it is determined that the vibration state of the exhaust manifold of the automobile is an abnormal state .
  • the processing unit 401 is specifically configured to: use the number of the automobile exhaust manifold as a query identifier, query a database, and obtain the configuration conditions corresponding to the number,
  • the database includes the corresponding relationship between the serial number of the automobile exhaust manifold and the configuration condition, and the configuration condition includes the reference vibration data of the automobile exhaust manifold.
  • the processing unit 401 is specifically configured to: obtain multiple images of the exhaust manifold of the automobile in the target video Frame, performing image recognition on each of the multiple image frames; performing preset area division on the automobile exhaust manifold in each image frame according to the recognition result to obtain multiple areas; determining Multiple target feature points corresponding to each of the multiple regions; tracking the multiple target feature points to obtain position change information of the multiple target feature points; generating the multiple target feature points according to the location information A vibration tracking image of a target feature point; according to the vibration tracking image, the vibration data corresponding to the target video is obtained.
  • the processing unit 401 is specifically configured to:
  • the feature points of the preset type are used as the initial feature points, and the feature points of the preset type include at least one of the following: corner points, edge points, bright points in dark areas, and dark points in bright areas; based on minimum difference square sum SSD matching Calculate the flow vectors of the multiple initial feature points;
  • the electronic device calculates the offset distances of the multiple initial feature points according to the flow vectors corresponding to the multiple initial feature points;
  • the multiple offset distances corresponding to multiple initial feature points are clustered, and the multiple offset distances are clustered using the K-means clustering algorithm, where the k value is set to 5 to obtain 5 clusters Calculate the average of the 5 clusters, and obtain the average of the first type of cluster, the average of the second type of cluster, the average of the third type of cluster, the average of the fourth type of cluster, and the average of the fifth type of cluster ,
  • the average value is set to 5 to obtain 5 clusters Calculate the average of the 5 clusters,
  • the processing unit 401 is specifically configured to: take time as the abscissa and take the multiple target The relative displacement of each target feature point in the feature points is the ordinate to construct a rectangular coordinate system; the vibration tracking images of multiple target feature points are drawn in the rectangular coordinate system according to the position information.
  • An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any method as recorded in the above method embodiment ,
  • the above-mentioned computer includes electronic equipment.
  • the embodiments of the present application also provide a computer program product.
  • the above-mentioned computer program product includes a non-transitory computer-readable storage medium storing a computer program.
  • the above-mentioned computer program is operable to cause a computer to execute any of the methods described in the above-mentioned method embodiments. Part or all of the steps of the method.
  • the computer program product may be a software installation package, and the above-mentioned computer includes electronic equipment.
  • the disclosed device may be implemented in other ways.
  • the device embodiments described above are only illustrative, for example, the division of the above-mentioned units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or integrated. To another system, or some features can be ignored, or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical or other forms.
  • the units described above as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
  • the above integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable memory.
  • the technical solution of the present application essentially or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory.
  • a number of instructions are included to enable a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the foregoing methods of the various embodiments of the present application.
  • the aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.
  • the program can be stored in a computer-readable memory, and the memory can include: a flash disk , Read-only memory (English: Read-OnlyMemory, abbreviation: ROM), random access device (English: RandomAccessMemory, abbreviation: RAM), magnetic disk or CD, etc.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)

Abstract

Procédé de détection de vibration, appliqué à un dispositif électronique (101). Le dispositif électronique (101) comprend un appareil de caméra. Le procédé comprend les étapes suivantes : un dispositif électronique (101) affichant une entrée de détection de vibrations au moyen d'une interface principale d'un dispositif de détection de vibrations (S201) ; l'acquisition d'informations de type de détection de vibration pour l'entrée de détection de vibration entrées par un utilisateur, et la génération d'informations d'invite d'opération de vibration selon les informations de type de détection de vibration, les informations d'invite d'opération de vibration étant utilisées pour ordonner à l'utilisateur de réaliser une opération préconfigurée sur un véhicule en cours de détection (S202) ; l'acquisition d'une vidéo de vibration d'un collecteur d'échappement de véhicule, et la réalisation d'un traitement d'amplification de mouvement sur la vidéo de vibration selon une politique préconfigurée de façon à acquérir une vidéo cible (S203) ; l'acquisition de données de vibration du collecteur d'échappement de véhicule en fonction de la vidéo cible (S204) ; la détermination, en fonction de la vidéo cible et/ou des données de vibration, si un état de vibration du collecteur d'échappement de véhicule est anormal (S205) ; et si tel est le cas, la délivrance en sortie des informations d'alarme préconfigurées (S206). La présente invention concerne également un appareil de détection de vibration, un dispositif électronique et un support de stockage lisible par ordinateur. L'invention facilite la détection de vibration réalisée sur le collecteur d'échappement de véhicule.
PCT/CN2020/104816 2019-04-26 2020-07-27 Procédé de détection de vibration et appareil associé WO2021042906A1 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201910359178 2019-04-26
CN201910847229.1A CN110617973B (zh) 2019-04-26 2019-09-06 振动检测方法及相关装置
CN201910847229.1 2019-09-06

Publications (1)

Publication Number Publication Date
WO2021042906A1 true WO2021042906A1 (fr) 2021-03-11

Family

ID=68922767

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/104816 WO2021042906A1 (fr) 2019-04-26 2020-07-27 Procédé de détection de vibration et appareil associé

Country Status (2)

Country Link
CN (1) CN110617973B (fr)
WO (1) WO2021042906A1 (fr)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110617973B (zh) * 2019-04-26 2021-08-27 深圳市豪视智能科技有限公司 振动检测方法及相关装置
CN111366375A (zh) * 2020-03-05 2020-07-03 三一汽车起重机械有限公司 基于音频和图像处理的车辆噪声和振动诊断方法和系统
CN111735534A (zh) * 2020-07-02 2020-10-02 江苏弘冉智能科技有限公司 一种车辆停放安全行为预警系统及方法
CN112150413A (zh) * 2020-09-01 2020-12-29 珠海格力电器股份有限公司 一种管路振动检测方法、装置、设备及存储介质
CN112528854B (zh) * 2020-12-12 2023-07-25 南方电网调峰调频发电有限公司 振动对象监测方法、装置、计算机设备和存储介质
CN113063484B (zh) * 2021-03-31 2022-10-04 中煤科工集团重庆研究院有限公司 一种振动识别放大方法
CN113682342A (zh) * 2021-08-25 2021-11-23 深圳市永安环保实业有限公司 轨道的异常检测方法及相关产品
CN116558733B (zh) * 2023-07-11 2023-09-29 湖南大学 一种状态检测方法、系统、电子装置及存储介质
CN117664552B (zh) * 2024-01-30 2024-04-16 四川懋润电力科技有限公司 一种设备运行状态监测方法、装置、系统及控制设备

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104048744A (zh) * 2014-07-08 2014-09-17 安徽常春藤光电智能科技有限公司 一种非接触式的基于影像的实时在线振动测量方法
CN106355563A (zh) * 2016-08-31 2017-01-25 河南工业大学 一种图像去雾方法和装置
CN107909575A (zh) * 2017-12-30 2018-04-13 煤炭科学研究总院唐山研究院 针对振动筛运行状态的双目视觉在线检测装置及检测方法
CN107945166A (zh) * 2017-11-24 2018-04-20 中国船舶重工集团公司第七〇九研究所 基于双目视觉的待测物体三维振动轨迹的测量方法
JP2018085627A (ja) * 2016-11-24 2018-05-31 川原　功 動画解像度評価用画像発生装置
CN108414240A (zh) * 2018-03-15 2018-08-17 广东工业大学 一种检测机器异常振动的方法与装置
CN108946360A (zh) * 2018-06-15 2018-12-07 太原理工大学 一种矿井提升设备的位移监测系统及方法
CN109345148A (zh) * 2018-11-26 2019-02-15 南智（重庆）能源技术有限公司 天然气管道及场站工艺装置安全隐患识别的智能诊断方法
CN110108348A (zh) * 2019-05-15 2019-08-09 湖南科技大学 基于运动放大光流跟踪的薄壁件微幅振动测量方法及系统
CN110617973A (zh) * 2019-04-26 2019-12-27 深圳市豪视智能科技有限公司 振动检测方法及相关装置

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101309920B1 (ko) * 2011-12-13 2013-09-17 주식회사 포스코 에지댐의 진동 측정 장치 및 방법
CN103033253B (zh) * 2012-12-10 2015-07-15 太原科技大学 一种塔式起重机结构的非接触振动检测方法
CN104089697B (zh) * 2014-07-08 2017-02-15 安徽常春藤光电智能科技有限公司 一种基于线程池并发技术的实时在线的视觉振动测量方法
EP3179440B1 (fr) * 2015-12-10 2018-07-11 Airbus Defence and Space Dispositif modulaire pour une analyse de vibrations vidéo à grande vitesse
CN105651377B (zh) * 2016-01-11 2018-12-07 衢州学院 一种基于视频数据挖掘的非接触式物体振动频率测量方法
US9922428B2 (en) * 2016-08-19 2018-03-20 Crystal Instruments Corporation Vibration image acquisition and processing
JP6895269B2 (ja) * 2017-02-21 2021-06-30 株式会社竹中工務店 計測装置、健全性判定装置、及び建物管理システム
EP3462146A1 (fr) * 2017-07-29 2019-04-03 Tata Consultancy Services Limited Systèmes et procédés d'inspection de machine stroboscopique autonome pour mesures de vibrations multipoints et multifréquences
CN109060285B (zh) * 2018-09-10 2020-03-17 西安交通大学 一种螺旋弹簧动态振动特性的检测装置及方法
CN109341847A (zh) * 2018-09-25 2019-02-15 东莞青柳新材料有限公司 一种基于视觉的振动测量系统

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104048744A (zh) * 2014-07-08 2014-09-17 安徽常春藤光电智能科技有限公司 一种非接触式的基于影像的实时在线振动测量方法
CN106355563A (zh) * 2016-08-31 2017-01-25 河南工业大学 一种图像去雾方法和装置
JP2018085627A (ja) * 2016-11-24 2018-05-31 川原　功 動画解像度評価用画像発生装置
CN107945166A (zh) * 2017-11-24 2018-04-20 中国船舶重工集团公司第七〇九研究所 基于双目视觉的待测物体三维振动轨迹的测量方法
CN107909575A (zh) * 2017-12-30 2018-04-13 煤炭科学研究总院唐山研究院 针对振动筛运行状态的双目视觉在线检测装置及检测方法
CN108414240A (zh) * 2018-03-15 2018-08-17 广东工业大学 一种检测机器异常振动的方法与装置
CN108946360A (zh) * 2018-06-15 2018-12-07 太原理工大学 一种矿井提升设备的位移监测系统及方法
CN109345148A (zh) * 2018-11-26 2019-02-15 南智（重庆）能源技术有限公司 天然气管道及场站工艺装置安全隐患识别的智能诊断方法
CN110617973A (zh) * 2019-04-26 2019-12-27 深圳市豪视智能科技有限公司 振动检测方法及相关装置
CN110108348A (zh) * 2019-05-15 2019-08-09 湖南科技大学 基于运动放大光流跟踪的薄壁件微幅振动测量方法及系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
FU HONGLI: "Research of Vibration Detection Based on the Visual Microphone Technology", 29 June 2019 (2019-06-29), XP055787904, Retrieved from the Internet <URL:DOC88 https://www.doc88.com/p-4931662163487.html> *

Also Published As

Publication number Publication date
CN110617973A (zh) 2019-12-27
CN110617973B (zh) 2021-08-27

Similar Documents

Publication Publication Date Title
WO2021042906A1 (fr) Procédé de détection de vibration et appareil associé
CN110674700B (zh) 基于数字孪生模型的电子设备的智能健康预测方法及装置
WO2021052025A1 (fr) Procédé et appareil de détection de défaut de vibration de ventilateur électrique
WO2021036663A1 (fr) Procédé de détection d&#39;anomalie de vis fixe pour dispositif et produits associés
CN110288547A (zh) 用于生成图像去噪模型的方法和装置
US8094828B2 (en) Sound source separating apparatus and sound source separating method
WO2021036631A1 (fr) Procédé d&#39;analyse de vibrations basé sur une vidéo, et produit associé
JP2007000205A (ja) 画像処理装置及び画像処理方法並びに画像処理プログラム
JP2008185375A (ja) Ｓａｒ画像の３ｄ形状算出装置及びｓａｒ画像の歪補正装置
JP2012516485A (ja) 画像における変化した可能性のあるオブジェクトの検出
CN105849804A (zh) 过滤噪声的计算高效方法
Fahmy et al. Micro‐movement magnification in video signals using complex wavelet analysis
KR101627062B1 (ko) 지문 융선 화상 합성 시스템, 지문 융선 화상 합성 방법, 및 그 프로그램
JP2008217526A (ja) 画像処理装置、画像処理プログラム及び画像処理方法
JP2020154479A (ja) 物体検出装置、物体検出方法、プログラム、および移動体
JP4385077B1 (ja) 動きベクトル検出装置および画像処理装置
JP5679406B2 (ja) 目標物速度特定装置、目標物速度特定プログラム及び目標物速度特定方法
CN112862748B (zh) 一种多维域特征联合sar船舰智能检测方法
JP2012008657A (ja) 物体形状生成装置及び方法
CN111479109A (zh) 基于视听联合注意的视频质量评价方法、系统及终端
JP7286896B2 (ja) 音源分離システム、音源位置推定システム、音源分離方法および音源分離プログラム
JPH0937153A (ja) キー信号生成装置および画像合成装置、並びにキー信号生成方法および画像合成方法
JP3697433B2 (ja) 目標識別装置
JPH10276987A (ja) 視線位置検出装置
JP2005173158A (ja) 画像表示装置および方法、並びにプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20859756

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20859756

Country of ref document: EP

Kind code of ref document: A1