WO2021036663A1 - Method for detecting anomaly of fixed screw for device, and related products - Google Patents

Method for detecting anomaly of fixed screw for device, and related products Download PDF

Info

Publication number
WO2021036663A1
WO2021036663A1 PCT/CN2020/105619 CN2020105619W WO2021036663A1 WO 2021036663 A1 WO2021036663 A1 WO 2021036663A1 CN 2020105619 W CN2020105619 W CN 2020105619W WO 2021036663 A1 WO2021036663 A1 WO 2021036663A1
Authority
WO
WIPO (PCT)
Prior art keywords
preset
test point
video
target
vibration data
Prior art date
Application number
PCT/CN2020/105619
Other languages
French (fr)
Chinese (zh)
Inventor
高风波
Original Assignee
深圳市豪视智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市豪视智能科技有限公司 filed Critical 深圳市豪视智能科技有限公司
Publication of WO2021036663A1 publication Critical patent/WO2021036663A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01HMEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
    • G01H9/00Measuring mechanical vibrations or ultrasonic, sonic or infrasonic waves by using radiation-sensitive means, e.g. optical means
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M13/00Testing of machine parts

Definitions

  • This application relates to the technical field of vibration detection, and specifically relates to a detection method for abnormality of a fixing screw of a device and related products.
  • vibration detection is an important part. For example, when the equipment is running, if the fixing screws on the equipment are abnormal, the equipment may be unstable. Therefore, it is necessary to correct the equipment when it is unstable. The vibration of the equipment is detected to provide a reference for the maintenance of the equipment.
  • the accelerometer requires a long preparation and installation time, requires physical contact with the system under test during the test (therefore, it will change the vibration response of the system under test), and can only test a limited number of discrete points, so In order to better maintain the equipment, it is necessary to detect the vibration of the equipment caused by the abnormal screw more accurately and reliably.
  • the embodiment of the present application provides a method for detecting an abnormality of a fixing screw of a device and related products, which can extract the vibration data of the fixing screw through a shooting video of the fixing screw on the device, so as to detect the abnormality of the fixing screw of the device more accurately.
  • the first aspect of the embodiments of the present application provides a method for detecting abnormality of a fixing screw of a device, which is applied to a vibration detection device, and the method includes:
  • the vibration data determine at least one target test point whose vibration data does not meet a preset condition among the plurality of test points, mark the at least one target test point as an abnormal test point, and compare the The target video area corresponding to at least one target test point is displayed.
  • a second aspect of the embodiments of the present application provides a device for detecting an abnormality of a fixing screw of a device, which is applied to a vibration detection device, and the device includes:
  • An acquiring unit configured to acquire a shooting video for a fixing screw set on a preset component on the device to be tested
  • a processing unit configured to process the shot video according to a preset motion amplification algorithm to obtain an enlarged video; and extract vibration data of a plurality of test points for the fixed screw from the enlarged video;
  • a determining unit configured to determine, according to the vibration data, at least one target test point whose vibration data does not meet a preset condition among the plurality of test points, and mark the at least one target test point as an abnormal test point;
  • the display unit is configured to display the target video area corresponding to the at least one target test point in the enlarged video.
  • a third aspect of the embodiments of the present application provides a vibration detection device, including a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured Executed by the foregoing processor, the foregoing program includes instructions for executing the steps in the method described in the first aspect of the embodiments of the present application.
  • the fourth aspect of the embodiments of the present application provides a computer-readable storage medium.
  • the above-mentioned computer-readable storage medium is used to store a computer program, and the above-mentioned computer program is executed by a processor to implement the method described in the first aspect of the embodiments of the present application. Part or all of the steps described in the method.
  • the fifth aspect of the embodiments of the present application provides a computer program product.
  • the computer program product includes a non-transitory computer-readable storage medium storing a computer program.
  • the computer program is operable to cause a computer to execute Part or all of the steps described in the method described in one aspect.
  • FIG. 1A is a system architecture diagram of a method for detecting abnormality of a fixing screw of a device according to an embodiment of the application;
  • FIG. 1B is a schematic flowchart of a method for detecting abnormality of a fixing screw of a device according to an embodiment of the application;
  • FIG. 2 is a schematic flowchart of another method for detecting abnormality of a fixed screw of a device provided by an embodiment of the application;
  • FIG. 3 is a schematic flowchart of another method for detecting abnormality of a fixing screw of a device provided by an embodiment of the application;
  • FIG. 4 is a schematic structural diagram of a vibration detection device provided by an embodiment of the application.
  • FIG. 5 is a schematic structural diagram of a device for detecting abnormality of a fixing screw of a device according to an embodiment of the application.
  • FIG. 1A is a schematic structural diagram of a detection system for an abnormality of a fixed screw of a device according to an embodiment of the present application.
  • the detection system includes: a device to be detected and a vibration detection device, wherein the device to be detected is provided with Fix the screws.
  • the vibration detection devices involved in the embodiments of the present application may include various handheld devices with wireless communication functions, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to wireless modems, as well as various forms of users.
  • Equipment user equipment, UE
  • mobile station mobile station, MS
  • terminal device terminal device
  • the devices mentioned above are collectively referred to as vibration detection devices.
  • the vibration involved in the embodiments of the present application refers to the reciprocating motion of an object relative to a stationary reference object or an object in a balanced state.
  • the vibration generated by the device to be tested during operation may include mechanical vibration generated by the internal interaction of the device to be tested, for example, engine vibration or gear vibration, or mechanical vibration due to external force.
  • the equipment to be tested will mechanically vibrate at a fixed frequency during operation, and when the equipment to be tested fails, the vibration frequency of the equipment to be tested will also change, for example, when the fixed screws on the equipment to be tested Looseness may cause changes in the vibration of the equipment to be tested during operation. Therefore, the vibration detection equipment can be used to perform vibration testing on the equipment to be tested, and the abnormality of the fixing screws can be estimated, so as to facilitate the maintenance of the equipment to be tested.
  • FIG. 1B is a schematic flowchart of a method for detecting abnormality of a fixing screw of a device according to an embodiment of the present application.
  • the method for detecting an abnormality of a fixing screw of a device provided by an embodiment of the present application is applied to a vibration detection device, and the method for detecting an abnormality of a fixing screw of the device may include the following steps:
  • the above-mentioned preset component is a component provided with fixing screws on the equipment to be tested, and the preset component may be, for example, a base of the equipment to be tested.
  • the vibration detection device can obtain the shooting video for the fixed screw on the device to be detected through the camera.
  • the inspector can aim the camera of the vibration detection device at the fixing screw on the device to be tested, and the vibration detection device can take a video of the device to be tested containing vibration and the fixing screw.
  • the vibration detection device may receive the shooting video transmitted by other devices, and the other device refers to an electronic device that stores the shooting video.
  • the preset motion amplification algorithm may include at least one of the following: Lagrangian motion amplification algorithm, Euler motion amplification algorithm, complex phase motion amplification algorithm, RIESZ pyramid motion amplification algorithm.
  • the motion amplification algorithm can be used to amplify the fixed screw and the minute vibration near the fixed screw in the shooting video to obtain an enlarged video.
  • processing the captured video according to a preset motion zoom algorithm to obtain the zoomed video may include the following steps:
  • the pixels in each frame of the multiple frames of video images contain RGB color information.
  • RGB is a color standard in the industry, and each pixel contains red (R).
  • R red
  • YIQ is the television system standard of the National Television Standards Committee (NTSC).
  • NTSC National Television Standards Committee
  • Y is the brightness component that provides black-and-white TV and color TV
  • I represents the chromaticity component of the color from orange to cyan
  • Q represents the chromaticity component of the color from purple to yellow-green.
  • a multi-frame video image can be converted from the RGB color space to the YIQ color space to obtain a multi-frame reference image.
  • the pixels of each reference image in the multi-frame reference image include luminance component Y, chrominance component I, and Chrominance component Q.
  • the RGB color information of each pixel of each video image in the multi-frame video image can be converted by the following conversion formula to obtain the YIQ color information of each pixel:
  • the brightness information in the multiple frames of reference images may be subjected to Fourier transform (fast fourier transform, FFT) processing to obtain multiple frames of target images.
  • FFT processing can be performed on the brightness information of each pixel of each reference image in the multi-frame reference image, and the brightness change in the time domain corresponding to the same pixel in the multi-frame reference image can be converted into the phase change in the frequency domain. .
  • the multi-frame target image can be processed according to any one of the Lagrangian motion amplification algorithm, Euler motion amplification algorithm, complex phase motion amplification algorithm, and RIESZ pyramid motion amplification algorithm to obtain multi-frame zoomed images.
  • processing the multi-frame target image according to the motion magnification algorithm to obtain a multi-frame magnified image may include the following steps:
  • each frame of the target image can be calibrated to obtain stable multiple motion feature points.
  • multiple motion feature points refer to feature points whose motion amplitude is less than a preset range, so as to be consistent with the stillness in the target video.
  • the point background point
  • the trajectory vector uses numerical values to describe the motion direction, motion distance, and brightness change of the motion feature point; then clustering algorithm is used to analyze the multiple motion feature points.
  • the trajectory vector is clustered to obtain the K-type motion layer, and the K-type motion layer is divided according to the correlation and similarity of the trajectory vector, so that different motion layers can contain different types of motion, so as to select the small motion in the K-type motion layer
  • the corresponding motion layer is enlarged to obtain an enlarged motion layer.
  • the multi-frame target image can be magnified by the Lagrangian motion magnification algorithm to obtain a multi-frame magnified image.
  • processing the multi-frame target image according to the motion magnification algorithm to obtain a multi-frame magnified image may include the following steps:
  • a Gaussian pyramid is used to decompose a multi-frame target image, that is, a set of multi-frame target images whose size is halved layer by layer constitutes a pyramid structure.
  • Each level of image in the structure is the result of low-pass filtering of the previous level of image and interlaced sampling.
  • Pyramid decomposition is to perform spatial filtering on multiple frames of target images, decompose to obtain frequency bands of different spatial frequencies, and amplify these frequency bands respectively. Because frequency bands at different spatial frequencies correspond to different signal-to-noise ratios, the lower the spatial frequency, the less image noise and the higher the signal-to-noise ratio. Therefore, different amplification factors can be set for each layer of spatial frequency bands. For example, a linearly variable magnification factor can be used to amplify frequency bands of different frequencies. In the pyramid structure, from the top to the bottom, the magnifications are sequentially reduced.
  • time-domain band-pass filtering can be performed on each frequency band to obtain the transformed signal of interest, that is, the transformed signal corresponding to the target frequency band, and only the transformation corresponding to the target frequency band The signal is amplified.
  • ideal band-pass filters, Butterworth band-pass filters, second-order infinite impulse response filters, etc. can be used.
  • ⁇ (t) represents the displacement signal
  • Amplify I(x,t) by ⁇ times, that is, amplify the displacement signal ⁇ (t), and the amplified signal is:
  • magnification is related to the spatial frequency and satisfies the following relationship:
  • the spatial frequency is ⁇
  • the spatial wavelength of the target frequency band is ⁇
  • 2 ⁇ / ⁇
  • the maximum value of ⁇ can be determined by the displacement function of the target frequency band and the transformed signal. A max ⁇ .
  • the amplified signal After the amplified signal is obtained, it is combined with the original frequency band again, and then pyramid reconstruction, such as Laplace pyramid transformation reconstruction, is used to obtain multiple frames of enlarged images.
  • pyramid reconstruction such as Laplace pyramid transformation reconstruction
  • phase correlation calculation, interpolation filtering, and inverse Fourier transform processing DFFT processing can be performed on the enlarged image in the enlarged video to obtain the vibration data of the pixels in the enlarged image.
  • extracting vibration data of multiple test points for the fixing screw from the enlarged video may include the following steps:
  • the first cross cross power spectrum between the multiple frames of the zoomed-in images in the zoomed-in video may be calculated according to a preset phase correlation algorithm.
  • the following formula may be used to calculate the first cross cross power spectrum.
  • R is a first cross crosspower, F.
  • F * 'b of the b-th frame image signal of the conjugated Fourier transform in addition to two lower Fourier formula The modulus of the correlation product of the transformed signal.
  • the filter bank can be adaptively selected for filtering according to the position of the correlation peak of the first cross cross power spectrum R to obtain the filtered second cross cross power spectrum R′.
  • performing interpolation filtering according to the first cross cross power spectrum to obtain the second cross cross power spectrum after interpolation filtering may include the following steps:
  • the first cross cross power spectrum R is a frequency domain signal, which includes one or more correlation peaks.
  • the state change signal corresponding to each correlation peak can be obtained.
  • Each state change signal can reflect the state change of a certain position in the amplified video. Therefore, a predetermined length of the target state change signal segment can be extracted from the multiple state change signals to obtain multiple target state change signal segments .
  • the state change information includes vibration data and other noise information. For example, changes in illumination can also cause state changes in the video screen, and the vibration data can reflect the operating conditions of the object to be vibrated.
  • the vibration of the equipment to be tested is periodic when it is running, and the state change caused by the vibration is also periodic.
  • the state change caused by noise is often not periodic, and when the operating condition of the device to be tested is analyzed according to the vibration of the device to be tested, it shows periodic vibration. It can be used to reflect the operating conditions of the device to be tested, because the non-periodic vibration is often caused by the external environment, not by the device to be tested itself, and this part of the non-periodic signal cannot be used to analyze the device to be tested. Health status. Acquire noise signals that are not caused by self-vibration by acquiring non-periodic signals in the state change signals.
  • aperiodic signals are often signals that have little effect or no effect or even interference in analyzing the operating conditions of the device to be tested, this part of the aperiodic signal can be removed, so that the state change signal obtained from the amplified video, More useful information.
  • each state change signal is a periodic signal.
  • a target state change signal segment with a preset length can be extracted first, the target frequency of the target change signal segment can be obtained, and then the state The frequencies of other parts in the change signal are compared with the target frequency. If the frequencies of other parts in the state change signal are not consistent with the target frequency, the state change signal can be regarded as a non-periodic signal.
  • the preset length can be set by a user to a certain value, or it can be self-adapted according to the length of the signal during signal processing. For example, the preset length can be set to 1/10 of the length of the state change signal.
  • the window size of the sliding window can be set according to the target frequency.
  • the window size of the sliding window can be set to be consistent with the target frequency, so that only signals with the same frequency as the target frequency can pass through the sliding window.
  • signals that are inconsistent with the target frequency cannot pass through the sliding window.
  • the state change signal cannot pass through the corresponding sliding window, it means that there is a signal segment whose frequency is inconsistent with the target frequency in the state change signal, that is, the state change signal is a non-periodic signal. In this way, by judging whether the frequencies of other parts of the state change signal are consistent with the target frequency by means of sliding windows, conclusions can be obtained conveniently and quickly, and the amount of calculation is smaller.
  • the filtered second cross cross power spectrum R' can be subjected to inverse Fourier transform, and phase comparison (phase-by-phase comparison) can be performed.
  • the sliding window adaptive matching method can be used to extract the distance fixation screw preset Vibration data of pixels corresponding to multiple test points within the distance range. The calculation formula is as follows:
  • F -1 ⁇ R' ⁇ is the inverse Fourier transform of the second cross cross power spectrum R'
  • r is the vibration data of the pixels in the zoomed-in video, so that the vibrations of all the pixels in the zoomed-in video can be obtained data.
  • the target position of the fixing screw can be obtained, and then the vibration data of the pixel points corresponding to the multiple test points within the preset distance range from the target position can be determined.
  • the vibration data includes at least one of the following: vibration amplitude, frequency, phase, and time-domain waveform.
  • the vibration data of the pixels corresponding to the multiple test points within the preset distance range near the fixed screw in the enlarged video can be selected to obtain multiple sets of vibration data. Therefore, each of the multiple sets of vibration data can be further selected based on the vibration data. The group of vibration data determines whether the corresponding test point is an abnormal test point.
  • determining at least one target test point whose vibration data does not satisfy a preset condition among the plurality of test points according to the vibration data may include the following steps:
  • the vibration amplitude is in the preset vibration amplitude range; the frequency is in the preset frequency range; the phase is in the preset phase range; the time domain waveform is matched with the preset reference time domain waveform to obtain A matching value, the matching value being in a preset matching value range;
  • determining whether the test point is a target test point according to the vibration data corresponding to the test point may include: determining whether the vibration data corresponding to the test point meets the aforementioned requirements. Condition, if the vibration amplitude is in the preset vibration amplitude range; the frequency is in the preset frequency range; the phase is in the preset phase range; the time domain waveform is matched with the preset reference time domain waveform to obtain the matching value, matching If the value is within the preset matching value range, the test point is not the target test point. If the vibration data corresponding to the test point does not meet any of the above conditions, the test point can be determined as the target test point. And mark the test point as an abnormal test point.
  • At least one target test point and non-target test points other than the target test point among the plurality of test points can be determined, and the target test point can be marked as an abnormal test point.
  • the target video area corresponding to at least one target test point in the zoomed-in video may be displayed, specifically, the target video area corresponding to at least one target test point in the zoomed-in video may be displayed.
  • the preset component is the base of the device to be tested. In the embodiment of the present application, it may further include the following steps:
  • A1 Obtain the position of each target test point in the base in the at least one target test point to obtain at least one position
  • A2 Determine a shock reduction strategy according to the at least one location and the vibration data of each target test point in the at least one target test point.
  • the position of each target test point on the base can be determined, and if there is a target position in the first position area in at least one position, the vibration reduction strategy can be further determined according to the vibration data of the target test point at the target position.
  • determining a vibration reduction strategy according to the at least one location and the vibration data of each target test point in the at least one target test point may include the following steps:
  • A22 For the vibration data of each target test point in the at least one target test point, determine a vibration amplitude deviation value according to the vibration amplitude and a preset vibration amplitude threshold; determine the frequency according to the frequency and the preset frequency threshold Deviation value; determining a frequency deviation value according to the phase and a preset phase threshold; determining a time-domain waveform deviation value according to the matching value and the preset matching value threshold;
  • the vibration The amplitude deviation value is greater than the first preset deviation value; the frequency deviation value is greater than the second preset deviation value; the frequency deviation value is greater than the third preset deviation value; the time domain waveform deviation value is greater than the fourth preset deviation value.
  • the vibration amplitude threshold corresponding to the vibration amplitude, the frequency threshold corresponding to the frequency, the phase threshold corresponding to the phase, and the matching value threshold corresponding to the matching value can be preset. Therefore, for the vibration data of each target test point in at least one target test point, the vibration amplitude and the preset vibration amplitude threshold value can be determined to determine the vibration amplitude deviation value; the frequency deviation value is determined according to the frequency and the preset frequency threshold value; and the frequency deviation value is determined according to the phase Determine the frequency deviation value with the preset phase threshold; determine the time-domain waveform deviation value according to the matching value and the preset matching value threshold.
  • the vibration amplitude deviation value is greater than the first preset Deviation value; the frequency deviation value is greater than the second preset deviation value; the frequency deviation value is greater than the third preset deviation value; the time domain waveform deviation value is greater than the fourth preset deviation value.
  • the anti-vibration plate strategy is the strategy of adding anti-vibration plates to the base.
  • the effect of shock absorption can be achieved by the anti-vibration plate.
  • the vibration detection device can obtain the shooting video for the fixing screws set on the preset component on the device to be detected, and process the shooting video according to the preset motion amplification algorithm to obtain the enlarged video, from Extract the vibration data of multiple test points for the fixed screw from the enlarged video, determine at least one target test point whose vibration data does not meet the preset conditions among the multiple test points according to the vibration data, and mark the at least one target test point as an abnormal test point , And display the target video area corresponding to at least one target test point in the enlarged video.
  • the vibration data of the fixed screw can be extracted from the video of the fixed screw on the device, and the test point with abnormal vibration near the fixed screw can be determined based on the vibration data Therefore, the abnormality of the fixing screw of the device can be detected more accurately.
  • FIG. 2 is a schematic flowchart of another method for detecting abnormality of a fixed screw of a device provided by an embodiment of the present application.
  • the method for detecting abnormality of a fixed screw of a device provided by the embodiment of the present application is applied to a vibration detection device ,
  • the detection method for the abnormality of the fixed screw of the device includes:
  • the vibration detection device can obtain the shooting video for the fixing screws set on the preset component on the device to be detected, divide the shooting video into multiple frames of video images, and divide the multiple frames of video images from RGB colors.
  • the space is converted to YIQ color space to obtain a multi-frame reference image, Fourier transform FFT processing is performed on the brightness information in the multi-frame reference image, and a multi-frame target image is obtained.
  • the multi-frame target image is processed according to the motion amplification algorithm to obtain a multi-frame target image.
  • Frame magnified images combine multiple magnified images to obtain a magnified video, extract vibration data of multiple test points for the fixed screw from the magnified video, and determine the vibration data of multiple test points that do not meet the preset conditions according to the vibration data
  • At least one target test point at least one target test point is marked as an abnormal test point, and the target video area corresponding to at least one target test point in the zoomed-in video is displayed.
  • the vibration data of the fixed screw can be extracted by the motion zoom algorithm, And according to the vibration data, determine the test point of abnormal vibration near the fixing screw, so that the abnormality of the fixing screw of the device can be detected more accurately.
  • FIG. 3 is a schematic flowchart of a method for detecting abnormality of a fixing screw of a device according to an embodiment of the present application.
  • the method for detecting abnormality of a fixed screw of a device provided by an embodiment of the present application is applied to a vibration detection device, and the method for detecting abnormality of a fixed screw of the device may include the following steps:
  • the vibration detection device can obtain the shooting video for the fixing screws set on the preset component on the device to be detected, and process the shooting video according to the preset motion zoom algorithm to obtain the zoomed video.
  • the video extracts the vibration data of multiple test points for the fixed screw, determines at least one target test point whose vibration data does not meet the preset condition among the multiple test points according to the vibration data, and marks the at least one target test point as an abnormal test point,
  • the target video area corresponding to at least one target test point in the zoomed-in video is displayed, and the position of each target test point in the at least one target test point on the base is obtained, and at least one position is obtained.
  • the vibration data of each target test point in the test point determines the vibration reduction strategy.
  • the vibration data of the fixed screw can be extracted from the video of the fixed screw on the device, and the test point with abnormal vibration near the fixed screw can be determined based on the vibration data, so that, It can detect the abnormality of the fixed screw of the equipment more accurately.
  • it can also provide the corresponding shock absorption strategy for the abnormal test point, which is conducive to the maintenance of the equipment to be tested.
  • the image information determining apparatus includes hardware structures and/or software modules corresponding to each function.
  • the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software-driven hardware depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.
  • the embodiment of the present application may divide the image information determining apparatus into functional units according to the foregoing method examples.
  • each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit. It should be noted that the division of units in the embodiments of the present application is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.
  • FIG. 4 is a schematic structural diagram of a vibration detection device disclosed in an embodiment of the present application.
  • the vibration detection device includes a processor, a memory, a communication interface, and one or more programs. Or multiple programs are stored in the above-mentioned memory and configured to be executed by the above-mentioned processor, and the above-mentioned programs include instructions for executing the following steps:
  • the vibration data determine at least one target test point whose vibration data does not meet a preset condition among the plurality of test points, mark the at least one target test point as an abnormal test point, and compare the The target video area corresponding to at least one target test point is displayed.
  • the foregoing program includes instructions for executing the following steps:
  • the multiple frames of enlarged images are synthesized to obtain the enlarged video.
  • the motion amplification algorithm may include at least one of the following: Lagrangian motion amplification algorithm, Euler motion amplification algorithm, complex phase motion amplification algorithm, RIESZ pyramid motion amplification algorithm.
  • the above program includes instructions for executing the following steps:
  • vibration data of pixels corresponding to a plurality of test points within a preset distance from the fixing screw are selected.
  • the vibration data includes at least one of the following: vibration amplitude, frequency, phase, and time-domain waveform. It is determined according to the vibration data that the vibration data does not satisfy a preset value among the multiple test points.
  • the above-mentioned program includes instructions for performing the following steps:
  • the vibration amplitude is in the preset vibration amplitude range; the frequency is in the preset frequency range; the phase is in the preset phase range; the time domain waveform is matched with the preset reference time domain waveform to obtain A matching value, the matching value being in a preset matching value range;
  • test point corresponding to a pixel point that does not meet any of the foregoing conditions is the target test point, and at least one target test point is obtained.
  • the preset component is the base of the device to be tested, and the above program further includes instructions for executing the following steps:
  • a shock reduction strategy is determined according to the at least one location and the vibration data of each target test point in the at least one target test point.
  • the program further includes instructions for executing the following steps :
  • each target test point in the at least one target test point determine a vibration amplitude deviation value according to the vibration amplitude and a preset vibration amplitude threshold; determine a frequency deviation value according to the frequency and the preset frequency threshold Determine the frequency deviation value according to the phase and the preset phase threshold; determine the time-domain waveform deviation value according to the matching value and the preset matching value threshold;
  • the shock absorber strategy of the shock absorption strategy determines the shock absorber strategy of the shock absorption strategy: the vibration amplitude deviation The value is greater than the first preset deviation value; the frequency deviation value is greater than the second preset deviation value; the frequency deviation value is greater than the third preset deviation value; the time domain waveform deviation value is greater than the fourth preset deviation value.
  • FIG. 5 is a schematic structural diagram of a device for detecting an abnormality of a fixing screw of a device disclosed in an embodiment of the present application, which is applied to a vibration detection device.
  • the device for detecting an abnormality of a fixing screw of the device includes an acquiring unit 501 , The processing unit 502, the determining unit 503, and the display unit 504, wherein:
  • the acquiring unit 501 is configured to acquire a shooting video of a fixing screw set on a preset component on the device to be tested;
  • the processing unit 502 is configured to process the shooting video according to a preset motion amplification algorithm to obtain an enlarged video; and extract vibration data for multiple test points of the fixed screw from the enlarged video;
  • the determining unit 503 is configured to determine at least one target test point whose vibration data does not meet a preset condition among the plurality of test points according to the vibration data, and mark the at least one target test point as an abnormal test point;
  • the display unit 504 is configured to display the target video area corresponding to the at least one target test point in the zoomed-in video.
  • the processing unit 502 is specifically configured to:
  • the multiple frames of enlarged images are synthesized to obtain the enlarged video.
  • the motion amplification algorithm may include at least one of the following: Lagrangian motion amplification algorithm, Euler motion amplification algorithm, complex phase motion amplification algorithm, RIESZ pyramid motion amplification algorithm.
  • the processing unit 502 is specifically configured to:
  • vibration data of pixels corresponding to a plurality of test points within a preset distance from the fixing screw are selected.
  • the vibration data includes at least one of the following: vibration amplitude, frequency, phase, and time-domain waveform, and it is determined according to the vibration data that the vibration data does not meet a preset condition at least A target test point, the determining unit 503 is specifically configured to:
  • the vibration amplitude is in the preset vibration amplitude range; the frequency is in the preset frequency range; the phase is in the preset phase range; the time domain waveform is matched with the preset reference time domain waveform to obtain A matching value, the matching value being in a preset matching value range;
  • test point corresponding to a pixel point that does not meet any of the foregoing conditions is the target test point, and at least one target test point is obtained.
  • the preset component is a base of the device to be tested
  • the acquiring unit 501 is further configured to acquire the position of each target test point in the base in the at least one target test point to obtain at least one position;
  • the determining unit 503 is further configured to determine a vibration reduction strategy according to the at least one location and the vibration data of each target test point in the at least one target test point.
  • the determining unit 503 is specifically configured to:
  • each target test point in the at least one target test point determine a vibration amplitude deviation value according to the vibration amplitude and a preset vibration amplitude threshold; determine a frequency deviation value according to the frequency and the preset frequency threshold Determine the frequency deviation value according to the phase and the preset phase threshold; determine the time-domain waveform deviation value according to the matching value and the preset matching value threshold;
  • the shock absorber strategy of the shock absorption strategy determines the shock absorber strategy of the shock absorption strategy: the vibration amplitude deviation The value is greater than the first preset deviation value; the frequency deviation value is greater than the second preset deviation value; the frequency deviation value is greater than the third preset deviation value; the time domain waveform deviation value is greater than the fourth preset deviation value.
  • the vibration detection device can obtain the shooting video of the fixed screw set on the preset component on the device to be detected, and process the shooting video according to the preset motion amplification algorithm to obtain the enlarged video , Extract the vibration data of multiple test points for the fixed screw from the enlarged video, determine at least one target test point whose vibration data does not meet the preset condition among the multiple test points according to the vibration data, and mark the at least one target test point as abnormal Test points, and display the target video area corresponding to at least one target test point in the enlarged video.
  • the vibration data of the fixed screw can be extracted from the video of the fixed screw on the device, and the vibration data near the fixed screw can be determined according to the vibration data.
  • the test point can detect the abnormality of the fixing screw of the device more accurately.
  • An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program causes the computer to execute any of the fixing screws for the device as described in the above method embodiments. Part or all of the steps of the abnormal detection method.
  • the embodiments of the present application also provide a computer program product.
  • the computer program product includes a non-transitory computer-readable storage medium storing a computer program.
  • the computer program causes a computer to execute any of the methods described in the above-mentioned method embodiments. Part or all of the steps of the method of detecting abnormality of the fixing screws of the equipment.
  • the disclosed device may be implemented in other ways.
  • the device embodiments described above are merely illustrative, for example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • each functional unit in each embodiment may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be realized in the form of hardware or software program module.
  • the integrated unit is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer readable memory.
  • the technical solution of the present application essentially or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory.
  • a number of instructions are included to enable a computer device (which may be a personal computer, a vibration detection device, or a network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned memory includes: U disk, read-only memory (read-only memory, ROM), random access memory (random access memory, RAM), mobile hard disk, magnetic disk, or optical disk and other media that can store program codes.
  • the program can be stored in a computer-readable memory, and the memory can include: a flash disk , Read-only memory, random access device, magnetic or optical disk, etc.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)

Abstract

A method for detecting anomaly of a fixed screw for a device. The method comprises: obtaining a photographing video for a fixed screw disposed in a preset component on a device to be detected (101); processing the photographing video according to a preset motion amplification algorithm to obtain an amplification video (102); extracting vibration data of a plurality of test points for the fixed screw from the amplification video (103); and determining at least one target test point whose vibration data does not satisfy a preset condition in the plurality of test points according to the vibration data, marking the at least one target test point as an abnormal test point, and displaying a target video region corresponding to the at least one target test point in the amplification video (104). According to the method, the vibration data can be extracted by means of the photographing video of the fixed screw, and the test points with abnormal vibration near the fixed screw are determined according to the vibration data, so that the anomaly of the fixed screw of the device can be detected more accurately. The present invention further provides an apparatus and device for detecting the anomaly of the fixed screw of the device.

Description

针对设备的固定螺丝异常的检测方法及相关产品Detection method and related products for equipment fixing screw abnormality 技术领域Technical field
本申请涉及振动检测技术领域,具体涉及一种针对设备的固定螺丝异常的检测方法及相关产品。This application relates to the technical field of vibration detection, and specifically relates to a detection method for abnormality of a fixing screw of a device and related products.
背景技术Background technique
所有的机械和运动系统都会产生各种各样的振动,其中一些振动反映的是系统的正常运动状态,而另外一些则反映了系统的异常运动状态(内部故障、轴连接不平衡等)。所以,要预测性维护系统设备,振动检测都是重要的一环,例如,设备运行时,若设备上的固定螺丝异常,可能导致设备不稳定,从而,需要对设备的在不稳定时,对设备的振动情况进行检测,为设备的维修提供参考。All machinery and motion systems produce various vibrations, some of which reflect the normal motion state of the system, while others reflect the abnormal motion state of the system (internal failure, unbalanced shaft connection, etc.). Therefore, to predictively maintain system equipment, vibration detection is an important part. For example, when the equipment is running, if the fixing screws on the equipment are abnormal, the equipment may be unstable. Therefore, it is necessary to correct the equipment when it is unstable. The vibration of the equipment is detected to provide a reference for the maintenance of the equipment.
目前,振动检测大多采用加速度计设备。尽管比较精确和可靠,但是加速度计需要长的准备和安装时间,在测试时需要和被测系统物理接触(因此会改变被测系统的振动响应),并且仅能测试很有限的离散点,因此,为了更好地对设备进行维护,需要对由螺丝异常导致的设备的振动进行更加精确、可靠的检测。At present, most of the vibration detection uses accelerometer equipment. Although more accurate and reliable, the accelerometer requires a long preparation and installation time, requires physical contact with the system under test during the test (therefore, it will change the vibration response of the system under test), and can only test a limited number of discrete points, so In order to better maintain the equipment, it is necessary to detect the vibration of the equipment caused by the abnormal screw more accurately and reliably.
发明内容Summary of the invention
本申请实施例提供一种针对设备的固定螺丝异常的检测方法及相关产品,能够通过设备上固定螺丝的拍摄视频提取固定螺丝的振动数据,对设备的固定螺丝异常进行更加精确地检测。The embodiment of the present application provides a method for detecting an abnormality of a fixing screw of a device and related products, which can extract the vibration data of the fixing screw through a shooting video of the fixing screw on the device, so as to detect the abnormality of the fixing screw of the device more accurately.
本申请实施例的第一方面提供了一种针对设备的固定螺丝异常的检测方法,应用于振动检测设备,所述方法包括:The first aspect of the embodiments of the present application provides a method for detecting abnormality of a fixing screw of a device, which is applied to a vibration detection device, and the method includes:
获取针对待检测设备上设置于预设部件的固定螺丝的拍摄视频;Obtain a shooting video for the fixing screws set on the preset component on the device to be tested;
根据预设的运动放大算法对所述拍摄视频进行处理,得到放大视频;Processing the shooting video according to a preset motion zoom algorithm to obtain a zoomed video;
从所述放大视频中提取针对所述固定螺丝的多个测试点的振动数据;Extracting vibration data of multiple test points for the fixing screw from the enlarged video;
根据所述振动数据确定所述多个测试点中振动数据不满足预设条件的至少一个目标测试点,将所述至少一个目标测试点标记为异常测试点,并对所述放大视频中所述至少一个目标测试点对应的目标视频区域进行显示。According to the vibration data, determine at least one target test point whose vibration data does not meet a preset condition among the plurality of test points, mark the at least one target test point as an abnormal test point, and compare the The target video area corresponding to at least one target test point is displayed.
本申请实施例的第二方面提供了一种针对设备的固定螺丝异常的检测装置,应用于振动检测设备,所述装置包括:A second aspect of the embodiments of the present application provides a device for detecting an abnormality of a fixing screw of a device, which is applied to a vibration detection device, and the device includes:
获取单元,用于获取针对待检测设备上设置于预设部件的固定螺丝的拍摄视频;An acquiring unit, configured to acquire a shooting video for a fixing screw set on a preset component on the device to be tested;
处理单元,用于根据预设的运动放大算法对所述拍摄视频进行处理,得到放大视频;以及,从所述放大视频中提取针对所述固定螺丝的多个测试点的振动数据;A processing unit, configured to process the shot video according to a preset motion amplification algorithm to obtain an enlarged video; and extract vibration data of a plurality of test points for the fixed screw from the enlarged video;
确定单元,用于根据所述振动数据确定所述多个测试点中振动数据不满足预设条件的至少一个目标测试点,将所述至少一个目标测试点标记为异常测试点;A determining unit, configured to determine, according to the vibration data, at least one target test point whose vibration data does not meet a preset condition among the plurality of test points, and mark the at least one target test point as an abnormal test point;
显示单元,用于并对所述放大视频中所述至少一个目标测试点对应的目标视频区域进行显示。The display unit is configured to display the target video area corresponding to the at least one target test point in the enlarged video.
本申请实施例的第三方面提供了一种振动检测设备,包括处理器、存储器、通信接口,以及一个或多个程序,其中,上述一个或多个程序被存储在上述存储器中,并且被配置由上述处理器执行,上述程序包括用于执行本申请实施例第一方面所述的方法中的步骤的指令。A third aspect of the embodiments of the present application provides a vibration detection device, including a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured Executed by the foregoing processor, the foregoing program includes instructions for executing the steps in the method described in the first aspect of the embodiments of the present application.
本申请实施例的第四方面提供了一种计算机可读存储介质,上述计算机可读存储介质用于存储计算机程序,上述计算机程序被处理器执行,以实现如本申请实施例第一方面所述的方法中所描述的部分或全部步骤。The fourth aspect of the embodiments of the present application provides a computer-readable storage medium. The above-mentioned computer-readable storage medium is used to store a computer program, and the above-mentioned computer program is executed by a processor to implement the method described in the first aspect of the embodiments of the present application. Part or all of the steps described in the method.
本申请实施例的第五方面提供了一种计算机程序产品,上述计算机程序产品包括存储了计算机程序的非瞬时性计算机可读存储介质,上述计算机程序可操作来使计算机执行如本申请实施例第一方面所述的方法中所描述的部分或全部步骤。The fifth aspect of the embodiments of the present application provides a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program. The computer program is operable to cause a computer to execute Part or all of the steps described in the method described in one aspect.
附图说明Description of the drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly describe the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.
图1A为本申请实施例提供的一种针对设备的固定螺丝异常的检测方法的系统架构图;FIG. 1A is a system architecture diagram of a method for detecting abnormality of a fixing screw of a device according to an embodiment of the application;
图1B为本申请实施例提供的一种针对设备的固定螺丝异常的检测方法的流程示意图;FIG. 1B is a schematic flowchart of a method for detecting abnormality of a fixing screw of a device according to an embodiment of the application;
图2为本申请实施例提供的另一种针对设备的固定螺丝异常的检测方法的流程示意图;2 is a schematic flowchart of another method for detecting abnormality of a fixed screw of a device provided by an embodiment of the application;
图3为本申请实施例提供的另一种针对设备的固定螺丝异常的检测方法的流程示意图;FIG. 3 is a schematic flowchart of another method for detecting abnormality of a fixing screw of a device provided by an embodiment of the application;
图4为本申请实施例提供的一种振动检测设备的结构示意图;4 is a schematic structural diagram of a vibration detection device provided by an embodiment of the application;
图5为本申请实施例提供的一种针对设备的固定螺丝异常的检测装置的结构示意图。FIG. 5 is a schematic structural diagram of a device for detecting abnormality of a fixing screw of a device according to an embodiment of the application.
具体实施方式detailed description
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别不同对象,而不是用于描述特定顺序。此外,术语“包括”和“具有”以及它们任何变形,意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括没有列出的步骤或单元,或可选地还包括对于这些过程、方法、产品或设备固有的其他步骤或单元。The terms "first" and "second" in the specification and claims of the present application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific sequence. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes unlisted steps or units, or optionally also includes Other steps or units inherent to these processes, methods, products or equipment.
在本申请中提及“实施例”意味着,结合实施例描述的特定特征、结构或特性可以包含在本申请的至少一个实施例中。在说明书中的各个位置出现该短语并不一定均是指相同的实施例,也不是与其它实施例互斥的独立的或备选的实施例。本领域技术人员显式地和隐式地理解的是,本申请所描述的实施例可以与其它实施例相结合。The reference to "embodiments" in this application means that a specific feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art clearly and implicitly understand that the embodiments described in this application can be combined with other embodiments.
请参阅图1A,图1A是本申请实施例提供的一种针对设备的固定螺丝异常的检测系统的结构示意图,该检测系统包括:待检测设备和振动检测设备,其中,待检测设备上设置有固定螺丝。Please refer to FIG. 1A. FIG. 1A is a schematic structural diagram of a detection system for an abnormality of a fixed screw of a device according to an embodiment of the present application. The detection system includes: a device to be detected and a vibration detection device, wherein the device to be detected is provided with Fix the screws.
其中,本申请实施例所涉及到的振动检测设备可以包括各种具有无线通信功能的手持 设备、车载设备、可穿戴设备、计算设备或连接到无线调制解调器的其他处理设备,以及各种形式的用户设备(user equipment,UE),移动台(mobile station,MS),终端设备(terminal device)等等。为方便描述,上面提到的设备统称为振动检测设备。Among them, the vibration detection devices involved in the embodiments of the present application may include various handheld devices with wireless communication functions, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to wireless modems, as well as various forms of users. Equipment (user equipment, UE), mobile station (mobile station, MS), terminal device (terminal device), and so on. For ease of description, the devices mentioned above are collectively referred to as vibration detection devices.
其中,本申请实施例涉及的振动是指一个物体相对于静止参照物或处于平衡状态的物体的往复运动。待检测设备在运行过程中产生的振动可包括待检测设备内部相互作用产生的机械振动,例如,引擎振动或者齿轮振动等,或者由于外力作用产生的机械振动。在正常情况下,待检测设备在运行过程中会按照固定的频率机械振动,而当待检测设备产生故障时,待检测设备的振动频率也会发生变化,例如,当待检测设备上的固定螺丝松动,可能导致待检测设备在运行过程中的振动产生变化,因此,可通过振动检测设备针对待检测设备进行振动检测,对固定螺丝的异常进行估计,以便于对待检测设备进行维修。Among them, the vibration involved in the embodiments of the present application refers to the reciprocating motion of an object relative to a stationary reference object or an object in a balanced state. The vibration generated by the device to be tested during operation may include mechanical vibration generated by the internal interaction of the device to be tested, for example, engine vibration or gear vibration, or mechanical vibration due to external force. Under normal conditions, the equipment to be tested will mechanically vibrate at a fixed frequency during operation, and when the equipment to be tested fails, the vibration frequency of the equipment to be tested will also change, for example, when the fixed screws on the equipment to be tested Looseness may cause changes in the vibration of the equipment to be tested during operation. Therefore, the vibration detection equipment can be used to perform vibration testing on the equipment to be tested, and the abnormality of the fixing screws can be estimated, so as to facilitate the maintenance of the equipment to be tested.
下面对本申请实施例进行详细介绍。The following describes the embodiments of the present application in detail.
请参阅图1B,图1B为本申请实施例提供的一种针对设备的固定螺丝异常的检测方法的流程示意图。如图1B所示,本申请实施例提供的针对设备的固定螺丝异常的检测方法应用于振动检测设备,该针对设备的固定螺丝异常的检测方法可包括以下步骤:Please refer to FIG. 1B. FIG. 1B is a schematic flowchart of a method for detecting abnormality of a fixing screw of a device according to an embodiment of the present application. As shown in FIG. 1B, the method for detecting an abnormality of a fixing screw of a device provided by an embodiment of the present application is applied to a vibration detection device, and the method for detecting an abnormality of a fixing screw of the device may include the following steps:
101、获取针对待检测设备上设置于预设部件的固定螺丝的拍摄视频。101. Obtain a shooting video of a fixing screw set on a preset component on a device to be tested.
其中,上述预设部件为待检测设备上设置固定螺丝的部件,预设部件例如可以是待检测设备的底座。Wherein, the above-mentioned preset component is a component provided with fixing screws on the equipment to be tested, and the preset component may be, for example, a base of the equipment to be tested.
本申请实施例中,振动检测设备可通过摄像头获取针对待检测设备上固定螺丝的拍摄视频。具体实施中,在待检测设备运行时,检测人员可将振动检测设备的摄像头对准待检测设备上的固定螺丝,振动检测设备可拍摄包含振动的待检测设备以及固定螺丝的拍摄视频。In the embodiment of the present application, the vibration detection device can obtain the shooting video for the fixed screw on the device to be detected through the camera. In specific implementation, when the device to be tested is running, the inspector can aim the camera of the vibration detection device at the fixing screw on the device to be tested, and the vibration detection device can take a video of the device to be tested containing vibration and the fixing screw.
可选地,振动检测设备可接收其他设备传输的拍摄视频,其他设备是指存储有拍摄视频的电子设备。Optionally, the vibration detection device may receive the shooting video transmitted by other devices, and the other device refers to an electronic device that stores the shooting video.
102、根据预设的运动放大算法对所述拍摄视频进行处理,得到放大视频。102. Process the shooting video according to a preset motion amplification algorithm to obtain an enlarged video.
其中,预设的运动放大算法可以包括以下至少一种:拉格朗日运动放大算法、欧拉运动放大算法、复数相位运动放大算法、RIESZ金字塔运动放大算法。The preset motion amplification algorithm may include at least one of the following: Lagrangian motion amplification algorithm, Euler motion amplification algorithm, complex phase motion amplification algorithm, RIESZ pyramid motion amplification algorithm.
本申请实施例中,通过运动放大算法,可对拍摄视频中固定螺丝以及固定螺丝附近的微小的振动进行放大,得到放大视频。In the embodiment of the present application, the motion amplification algorithm can be used to amplify the fixed screw and the minute vibration near the fixed screw in the shooting video to obtain an enlarged video.
可选地,上述步骤102中,根据预设的运动放大算法对所述拍摄视频进行处理,得到放大视频,可包括以下步骤:Optionally, in the foregoing step 102, processing the captured video according to a preset motion zoom algorithm to obtain the zoomed video may include the following steps:
21、将所述拍摄视频分割成多帧视频图像;21. Split the shooting video into multiple frames of video images;
22、将所述多帧视频图像从RGB颜色空间转换到YIQ颜色空间,得到多帧参考图像,所述多帧参考图像中每一参考图像的像素点包含亮度信息和色度信息;22. Convert the multi-frame video image from the RGB color space to the YIQ color space to obtain a multi-frame reference image, and the pixel of each reference image in the multi-frame reference image contains luminance information and chrominance information;
23、对所述多帧参考图像中的亮度信息进行傅里叶变换FFT处理,得到多帧目标图像;23. Perform Fourier transform FFT processing on the brightness information in the multi-frame reference image to obtain a multi-frame target image;
24、根据所述运动放大算法对所述多帧目标图像进行处理,得到多帧放大图像;24. Process the multi-frame target image according to the motion magnification algorithm to obtain a multi-frame magnified image;
25、将所述多帧放大图像进行合成,得到所述放大视频。25. Synthesize the multiple frames of enlarged images to obtain the enlarged video.
其中,拍摄视频分割成多帧视频图像后,多帧视频图像中每一帧视频图像中的像素点包含RGB颜色信息,RGB是工业界的一种颜色标准,每一像素点包含红(R)、绿(G)、蓝(B)三个颜色通道对应的亮度分量。Among them, after the shooting video is divided into multiple frames of video images, the pixels in each frame of the multiple frames of video images contain RGB color information. RGB is a color standard in the industry, and each pixel contains red (R). The brightness components corresponding to the three color channels of, green (G) and blue (B).
其中,YIQ是美国全国电视标准委员会(National Television Standards Committee,NTSC)的电视系统标准。Y是提供黑白电视及彩色电视的亮度分量,I代表色彩从橙色到青色的色度分量,Q代表色彩从紫色到黄绿色的色度分量。Among them, YIQ is the television system standard of the National Television Standards Committee (NTSC). Y is the brightness component that provides black-and-white TV and color TV, I represents the chromaticity component of the color from orange to cyan, and Q represents the chromaticity component of the color from purple to yellow-green.
本申请实施例中,可将多帧视频图像从RGB颜色空间转换到YIQ颜色空间,得到多帧参考图像,多帧参考图像中每一参考图像的像素点包含亮度分量Y、色度分量I和色度 分量Q。具体实施中,可通过以下转换公式将多帧视频图像中每一视频图像的每一像素点的RGB颜色信息进行转换,得到每一像素点的YIQ颜色信息:In the embodiment of this application, a multi-frame video image can be converted from the RGB color space to the YIQ color space to obtain a multi-frame reference image. The pixels of each reference image in the multi-frame reference image include luminance component Y, chrominance component I, and Chrominance component Q. In specific implementation, the RGB color information of each pixel of each video image in the multi-frame video image can be converted by the following conversion formula to obtain the YIQ color information of each pixel:
Y=0.299*R+0.587*G+0.114*B;Y=0.299*R+0.587*G+0.114*B;
I=0.596*R–0.275*G–0.321*B;I=0.596*R–0.275*G–0.321*B;
Q=0.212*R-0.523*G+0.311*B。Q=0.212*R-0.523*G+0.311*B.
其中,可对多帧参考图像中的亮度信息进行傅里叶变换(fast fourier transform,FFT)处理,得到多帧目标图像。具体实施中,可对多帧参考图像中每一参考图像的每一像素点的亮度信息进行FFT处理,将多帧参考图像中同一像素点对应的时域的亮度变化转换为频域的相位变化。Among them, the brightness information in the multiple frames of reference images may be subjected to Fourier transform (fast fourier transform, FFT) processing to obtain multiple frames of target images. In specific implementation, FFT processing can be performed on the brightness information of each pixel of each reference image in the multi-frame reference image, and the brightness change in the time domain corresponding to the same pixel in the multi-frame reference image can be converted into the phase change in the frequency domain. .
其中,可根据拉格朗日运动放大算法、欧拉运动放大算法、复数相位运动放大算法、RIESZ金字塔运动放大算法中任一中运动放大算法对多帧目标图像进行处理,得到多帧放大图像。Among them, the multi-frame target image can be processed according to any one of the Lagrangian motion amplification algorithm, Euler motion amplification algorithm, complex phase motion amplification algorithm, and RIESZ pyramid motion amplification algorithm to obtain multi-frame zoomed images.
可选地,以拉格朗日运动放大算法为例,上述步骤24中,根据所述运动放大算法对所述多帧目标图像进行处理,得到多帧放大图像,可包括以下步骤:Optionally, taking the Lagrangian motion magnification algorithm as an example, in the above step 24, processing the multi-frame target image according to the motion magnification algorithm to obtain a multi-frame magnified image may include the following steps:
针对所述多帧目标图像中每一帧目标图像执行以下步骤:Perform the following steps for each frame of the target image in the multi-frame target image:
2401、对所述每一帧目标图像进行校准,获得稳定的多个运动特征点;2401. Calibrate each frame of target image to obtain a plurality of stable motion feature points;
2402、对所述多个运动特征点进行跟踪,获得所述多个运动特征点的轨迹向量;2402. Tracking the plurality of motion feature points to obtain trajectory vectors of the plurality of motion feature points;
2403、采用聚类算法对所述多个运动特征点的轨迹向量聚类,获得K类运动层;2403. Use a clustering algorithm to cluster the trajectory vectors of the multiple motion feature points to obtain K-type motion layers;
2404、从所述K类运动层中获得需要进行放大的目标运动层;2404. Obtain a target motion layer that needs to be amplified from the K-type motion layer;
2405、对所述目标运动层中运动特征点的偏移距离乘以一个放大倍数放大,获得放大的运动层;2405. Multiply the offset distance of the movement feature point in the target movement layer by a magnification to obtain an enlarged movement layer.
2406、对所述放大的运动层进行渲染得到放大图像。2406. Render the enlarged motion layer to obtain an enlarged image.
首先,可对所述每一帧目标图像进行校准,获得稳定的多个运动特征点,具体地,多个运动特征点是指运动幅度小于预设范围的特征点,以便与目标视频中的静止点(背景点)和剧烈运动的点进行区分,从而,可以防止放大由于拍摄视频时摄像头晃动而产生的动作。然后,对多个运动特征点进行跟踪,获得其对应的轨迹向量,轨迹向量用数值来描述运动特征点的运动方向、运动距离和亮度变化等;再采用聚类算法对多个运动特征点的轨迹向量进行聚类,获得K类运动层,根据轨迹向量的相关性和相似度进行K类运动层的划分,可以使得不同运动层中包含不同类别的运动,以便选择K类运动层中微小运动对应的运动层进行放大处理,获得放大的运动层。最后,因为对运动层的放大造成目标图像中存在一些空白区域,需要进行渲染对目标图像进行纹理填充,将运动层的运动幅度加大,得到放大图像。从而,可通过拉格朗日运动放大算法对多帧目标图像进行放大,得到多帧放大图像。First, each frame of the target image can be calibrated to obtain stable multiple motion feature points. Specifically, multiple motion feature points refer to feature points whose motion amplitude is less than a preset range, so as to be consistent with the stillness in the target video. The point (background point) is distinguished from the point of violent movement, thereby preventing zooming in motion caused by camera shake when shooting video. Then, track multiple motion feature points to obtain their corresponding trajectory vector. The trajectory vector uses numerical values to describe the motion direction, motion distance, and brightness change of the motion feature point; then clustering algorithm is used to analyze the multiple motion feature points. The trajectory vector is clustered to obtain the K-type motion layer, and the K-type motion layer is divided according to the correlation and similarity of the trajectory vector, so that different motion layers can contain different types of motion, so as to select the small motion in the K-type motion layer The corresponding motion layer is enlarged to obtain an enlarged motion layer. Finally, because the enlargement of the motion layer causes some blank areas in the target image, rendering needs to be performed to fill the target image with texture, and the motion amplitude of the motion layer is increased to obtain an enlarged image. Therefore, the multi-frame target image can be magnified by the Lagrangian motion magnification algorithm to obtain a multi-frame magnified image.
可选地,以欧拉运动放大算法为例,上述步骤24中,根据所述运动放大算法对所述多帧目标图像进行处理,得到多帧放大图像,可包括以下步骤:Optionally, taking the Euler motion magnification algorithm as an example, in the above step 24, processing the multi-frame target image according to the motion magnification algorithm to obtain a multi-frame magnified image may include the following steps:
2407、将所述多帧目标图像进行空域金字塔分解,得到由多个不同空间分辨率的子图像组成的金字塔形结构;2407. Perform spatial pyramid decomposition on the multi-frame target image to obtain a pyramid structure composed of multiple sub-images with different spatial resolutions.
2408、对金字塔型结构中的多个子图像中每个子图像进行时域带通滤波处理,得到目标频带对应的变换信号;2408. Perform time-domain band-pass filtering processing on each of the multiple sub-images in the pyramid structure to obtain a transformed signal corresponding to the target frequency band;
2409、对变换信号对应的位移进行A倍放大,获得放大后信号,其中A的取值范围为(4,Amax),其中Amax的值由目标频带和变换信号的位移函数确定;2409. Amplify the displacement corresponding to the transformed signal by A times to obtain the amplified signal, where the value range of A is (4, Amax), and the value of Amax is determined by the target frequency band and the displacement function of the transformed signal;
2410、结合放大后信号和金字塔形结构进行金字塔重构,得到所述多帧放大图像。2410. Perform pyramid reconstruction in combination with the amplified signal and the pyramid structure to obtain the multi-frame enlarged image.
具体地,采用欧拉运动放大对多帧目标图像进行放大,首先需要将多帧目标图像中的像素转换成时间和空间的函数,即通过图像金字塔变换将多帧目标图像分解成多个不同空 间分辨率、不同尺度大小的子图像以构成一个金字塔塔型结构,例如采用高斯金字塔对多帧目标图像进行分解,即由一组在尺寸上逐层减半的多帧目标图像组成金字塔结构,金字塔结构中的每一级图像均为其前一级图像低通滤波并隔行隔列采样的结果。Specifically, to use Euler motion magnification to amplify a multi-frame target image, it is first necessary to convert the pixels in the multi-frame target image into a function of time and space, that is, to decompose the multi-frame target image into multiple different spaces through image pyramid transformation The sub-images of different resolutions and sizes form a pyramid structure. For example, a Gaussian pyramid is used to decompose a multi-frame target image, that is, a set of multi-frame target images whose size is halved layer by layer constitutes a pyramid structure. Each level of image in the structure is the result of low-pass filtering of the previous level of image and interlaced sampling.
进行金字塔分解即对多帧目标图像进行空域滤波,分解得到不同空间频率的频带,并对这些频带分别进行放大。因为处于不同空间频率的频带对应的信噪比不同,空间频率越低,图像噪声越少,信噪比越高,因此每层空间频率的频带可以设置不同的放大系数。例如可以使用一个线性可变的放大倍数来放大不同频率的频带。金字塔结构中,从顶层到底层,放大倍数依次降低。Pyramid decomposition is to perform spatial filtering on multiple frames of target images, decompose to obtain frequency bands of different spatial frequencies, and amplify these frequency bands respectively. Because frequency bands at different spatial frequencies correspond to different signal-to-noise ratios, the lower the spatial frequency, the less image noise and the higher the signal-to-noise ratio. Therefore, different amplification factors can be set for each layer of spatial frequency bands. For example, a linearly variable magnification factor can be used to amplify frequency bands of different frequencies. In the pyramid structure, from the top to the bottom, the magnifications are sequentially reduced.
通过金字塔处理得到不同空间频率的频带后,还可以对每个频带进行时域的带通滤波处理,以得到感兴趣的变换信号,即目标频带对应的变换信号,并只对目标频带对应的变换信号进行放大处理。在进行带通滤波处理时,可以采用理想带通滤波器,Butterworth带通滤波器,二阶无限脉冲响应滤波器等。After the frequency bands of different spatial frequencies are obtained through pyramid processing, time-domain band-pass filtering can be performed on each frequency band to obtain the transformed signal of interest, that is, the transformed signal corresponding to the target frequency band, and only the transformation corresponding to the target frequency band The signal is amplified. When performing band-pass filtering, ideal band-pass filters, Butterworth band-pass filters, second-order infinite impulse response filters, etc. can be used.
获得目标频带对应的变换信号后,令I(x,t)为点x在时刻t的灰度值,且初始值为f(x),则:After obtaining the transformed signal corresponding to the target frequency band, let I(x,t) be the gray value of point x at time t, and the initial value is f(x), then:
Figure PCTCN2020105619-appb-000001
Figure PCTCN2020105619-appb-000001
其中δ(t)表示位移信号。Where δ(t) represents the displacement signal.
对I(x,t)放大α倍,即对位移信号δ(t)进行放大,且放大后的信号为:Amplify I(x,t) by α times, that is, amplify the displacement signal δ(t), and the amplified signal is:
Figure PCTCN2020105619-appb-000002
Figure PCTCN2020105619-appb-000002
因为微小运动进行放大时,倍数太小是没有意义的,因此A的最小取值大于4。另外,放大倍数与空间频率相关,且满足如下关系:It is meaningless if the magnification is too small when zooming in on small movements, so the minimum value of A is greater than 4. In addition, the magnification is related to the spatial frequency and satisfies the following relationship:
Figure PCTCN2020105619-appb-000003
Figure PCTCN2020105619-appb-000003
其中,空间频率为ω,目标频带的空间波长为λ,且λ=2π/ω,则可通过目标频带和变换信号的位移函数确定α的最大值。A max≤α。 Among them, the spatial frequency is ω, the spatial wavelength of the target frequency band is λ, and λ=2π/ω, the maximum value of α can be determined by the displacement function of the target frequency band and the transformed signal. A max ≤α.
获得放大后信号之后,将其重新与原本的频带相结合,再通过金字塔重构,例如拉普拉斯金字塔变换重构,得到多帧放大图像。After the amplified signal is obtained, it is combined with the original frequency band again, and then pyramid reconstruction, such as Laplace pyramid transformation reconstruction, is used to obtain multiple frames of enlarged images.
103、从所述放大视频中提取针对所述固定螺丝的多个测试点的振动数据。103. Extract vibration data of multiple test points for the fixed screw from the enlarged video.
本申请实施例中,可对放大视频中的放大图像进行相位相关计算、插值滤波和反傅里叶变换处理DFFT处理,得到放大图像中像素点的振动数据。In the embodiment of the present application, phase correlation calculation, interpolation filtering, and inverse Fourier transform processing DFFT processing can be performed on the enlarged image in the enlarged video to obtain the vibration data of the pixels in the enlarged image.
可选地,上述步骤103中,从所述放大视频中提取针对所述固定螺丝的多个测试点的振动数据,可包括以下步骤:Optionally, in the foregoing step 103, extracting vibration data of multiple test points for the fixing screw from the enlarged video may include the following steps:
31、根据预设的相位相关算法计算所述放大视频中的多帧放大图像之间的第一交叉互功率谱;31. Calculate the first cross cross power spectrum between the multiple frames of zoomed-in images in the zoomed-in video according to a preset phase correlation algorithm;
32、根据所述第一交叉互功率谱进行插值滤波,得到插值滤波后的第二交叉互功率谱;32. Perform interpolation filtering according to the first cross cross power spectrum to obtain a second cross cross power spectrum after interpolation filtering;
33、针对所述第二交叉互功率谱进行反傅里叶变换DFFT处理,得到所述放大视频中所有像素点的振动数据;33. Perform inverse Fourier transform DFFT processing on the second cross cross power spectrum to obtain vibration data of all pixels in the amplified video;
34、从所述放大视频中所有像素点的振动数据中选取距离所述固定螺丝预设距离范围内的多个测试点对应的像素点的振动数据。34. From the vibration data of all pixels in the enlarged video, select vibration data of pixels corresponding to multiple test points within a preset distance range from the fixing screw.
其中,可根据预设的相位相关算法计算放大视频中的多帧放大图像之间的第一交叉互功率谱。具体实施中,可采用如下的公式计算第一交叉互功率谱。Wherein, the first cross cross power spectrum between the multiple frames of the zoomed-in images in the zoomed-in video may be calculated according to a preset phase correlation algorithm. In a specific implementation, the following formula may be used to calculate the first cross cross power spectrum.
Figure PCTCN2020105619-appb-000004
Figure PCTCN2020105619-appb-000004
其中,R为第一交叉互功率谱,F a为第a帧图像的傅立叶变换,F *' b为第b帧图像的傅里叶变换的共轭信号,除式下边为两个傅里叶变换的信号的相关积的模。 Wherein, R is a first cross crosspower, F. To a frame image of a Fourier transform, F * 'b of the b-th frame image signal of the conjugated Fourier transform, in addition to two lower Fourier formula The modulus of the correlation product of the transformed signal.
其中,可根据第一交叉互功率谱R的相关峰的位置自适应选择滤波器组进行滤波,得到滤波后的第二交叉互功率谱R'。Wherein, the filter bank can be adaptively selected for filtering according to the position of the correlation peak of the first cross cross power spectrum R to obtain the filtered second cross cross power spectrum R′.
可选地,上述步骤32中,根据所述第一交叉互功率谱进行插值滤波,得到插值滤波后的第二交叉互功率谱,可包括以下步骤:Optionally, in the foregoing step 32, performing interpolation filtering according to the first cross cross power spectrum to obtain the second cross cross power spectrum after interpolation filtering may include the following steps:
3201、获取所述放大视频中所述第一交叉互功率谱对应的多个状态变化信号,状态变化信号为时域信号;3201. Acquire a plurality of state change signals corresponding to the first cross power spectrum in the amplified video, where the state change signals are time-domain signals;
3202、从所述多个状态变化信号中提取预设长度的目标状态变化信号段,得到多个目标状态变化信号段,并获取所述多个目标状态变化信号段中每一目标状态变化信号段的目标频率,得到多个目标频率;3202. Extract a target state change signal segment of a preset length from the plurality of state change signals to obtain a plurality of target state change signal segments, and obtain each target state change signal segment of the plurality of target state change signal segments The target frequency of, get multiple target frequencies;
3203、根据所述多个状态变化信号中每一状态变化信号对应的目标频率设定对应的滑窗,得到多个滑窗,将所述多个状态变化信号中每一状态变化信号发送至对应的滑窗;3203. Set the corresponding sliding window according to the target frequency corresponding to each state change signal in the multiple state change signals to obtain multiple sliding windows, and send each state change signal in the multiple state change signals to the corresponding Sliding window
3204、将所述多个状态变化信号中不能通过对应的滑窗的状态变化信号作为非周期信号,得到至少一个非周期信号;3204. Use the state change signal of the plurality of state change signals that cannot pass through the corresponding sliding window as an aperiodic signal to obtain at least one aperiodic signal;
3205、去除所述多个状态变化信号中的所述至少一个非周期信号,得到滤除频域噪音后的第二交叉互功率谱。3205. Remove the at least one non-periodic signal from the multiple state change signals to obtain a second cross cross power spectrum after frequency domain noise is filtered out.
其中,第一交叉互功率谱R为频域信号,其中包括一个或多个相关峰。将第一交叉互功率谱R进行反傅里叶变换之后即可得到各相关峰对应的状态变化信号。每个状态变化信号可以反应放大视频中的某个位置的状态变化情况,因此,可从所述多个状态变化信号中提取预设长度的目标状态变化信号段,得到多个目标状态变化信号段。状态变化信息包括振动数据和其他噪声信息,例如光照的变化也会导致视频画面中的状态变化,振动数据可以反应待振动物体的运行状况。待检测设备运行时自身的振动是周期性的,振动引起的状态变化也是周期性的。很多噪声信息虽然会导致放大视频中各像素点的状态变化,但是,噪声引起的状态变化常常不是周期性的,而且根据待检测装置的振动分析待检测装置的运行状况时,呈周期性的振动才能用于反应待检测装置的运行状况,因为非周期性的振动常常是由外界环境导致的,而不是由待检测设备自身引起的,这部分非周期性的信号也不能用于分析待检测设备的运行状况。通过获取状态变化信号中的非周期信号获取不是由自身振动引起的噪声信号。由于非周期信号常常是对分析待检测装置的运行状况作用不大或者没有作用甚至会有干扰的信号,那么可去除这部分非周期信号,以使得从放大视频中获取到的状态变化信号中,有用信息更多。Wherein, the first cross cross power spectrum R is a frequency domain signal, which includes one or more correlation peaks. After performing the inverse Fourier transform on the first cross cross power spectrum R, the state change signal corresponding to each correlation peak can be obtained. Each state change signal can reflect the state change of a certain position in the amplified video. Therefore, a predetermined length of the target state change signal segment can be extracted from the multiple state change signals to obtain multiple target state change signal segments . The state change information includes vibration data and other noise information. For example, changes in illumination can also cause state changes in the video screen, and the vibration data can reflect the operating conditions of the object to be vibrated. The vibration of the equipment to be tested is periodic when it is running, and the state change caused by the vibration is also periodic. Although a lot of noise information will cause the state of each pixel in the amplified video to change, the state change caused by noise is often not periodic, and when the operating condition of the device to be tested is analyzed according to the vibration of the device to be tested, it shows periodic vibration. It can be used to reflect the operating conditions of the device to be tested, because the non-periodic vibration is often caused by the external environment, not by the device to be tested itself, and this part of the non-periodic signal cannot be used to analyze the device to be tested. Health status. Acquire noise signals that are not caused by self-vibration by acquiring non-periodic signals in the state change signals. Since aperiodic signals are often signals that have little effect or no effect or even interference in analyzing the operating conditions of the device to be tested, this part of the aperiodic signal can be removed, so that the state change signal obtained from the amplified video, More useful information.
其中,在获取多个状态变化信号之后,可判断各状态变化信号是否为周期信号,具体地,可先提取预设长度的目标状态变化信号段,获取目标变化信号段的目标频率,然后将状态变化信号中的其他部分的频率与目标频率比对,如果状态变化信号中的其他部分的频率与目标频率不一致,则可认为该状态变化信号为非周期信号。预设长度可以由用户设定一个确定的值,也可以在信号处理过程中根据信号的长度自行适配,例如可将预设长度设定为状态变化信号长度的1/10。获得目标状态变换信号段的目标频率之后,根据目标频率 设定滑窗的窗口大小,例如可将滑窗的窗口大小设定为与目标频率一致,这样只有频率与目标频率一致的信号才能通过滑窗,而与目标频率不一致的信号则不能通过滑窗。如果状态变化信号不能通过对应的滑窗,则说明该状态变化信号中存在频率与目标频率不一致的信号段,也即该状态变化信号为非周期信号。如此,通过滑窗的方式判断状态变化信号中的其他部分的频率与目标频率是否一致,可以方便快捷地得到结论,计算量更小。Among them, after obtaining multiple state change signals, it can be judged whether each state change signal is a periodic signal. Specifically, a target state change signal segment with a preset length can be extracted first, the target frequency of the target change signal segment can be obtained, and then the state The frequencies of other parts in the change signal are compared with the target frequency. If the frequencies of other parts in the state change signal are not consistent with the target frequency, the state change signal can be regarded as a non-periodic signal. The preset length can be set by a user to a certain value, or it can be self-adapted according to the length of the signal during signal processing. For example, the preset length can be set to 1/10 of the length of the state change signal. After obtaining the target frequency of the target state transition signal segment, the window size of the sliding window can be set according to the target frequency. For example, the window size of the sliding window can be set to be consistent with the target frequency, so that only signals with the same frequency as the target frequency can pass through the sliding window. However, signals that are inconsistent with the target frequency cannot pass through the sliding window. If the state change signal cannot pass through the corresponding sliding window, it means that there is a signal segment whose frequency is inconsistent with the target frequency in the state change signal, that is, the state change signal is a non-periodic signal. In this way, by judging whether the frequencies of other parts of the state change signal are consistent with the target frequency by means of sliding windows, conclusions can be obtained conveniently and quickly, and the amount of calculation is smaller.
进一步地,可对滤波之后的第二交叉互功率谱R'进行反傅里叶变换,并进行相位比较(逐相位比较),此时可采用滑窗的自适应匹配方法提取距离固定螺丝预设距离范围内的多个测试点对应的像素点的振动数据。运算公式如下:Further, the filtered second cross cross power spectrum R'can be subjected to inverse Fourier transform, and phase comparison (phase-by-phase comparison) can be performed. In this case, the sliding window adaptive matching method can be used to extract the distance fixation screw preset Vibration data of pixels corresponding to multiple test points within the distance range. The calculation formula is as follows:
r=F -1{R'} r=F -1 {R'}
其中,F -1{R'}为对第二交叉互功率谱R'进行反傅里叶变换,r为放大视频中的像素点的振动数据,如此,可得到放大视频中所有像素点的振动数据。 Among them, F -1 {R'} is the inverse Fourier transform of the second cross cross power spectrum R', r is the vibration data of the pixels in the zoomed-in video, so that the vibrations of all the pixels in the zoomed-in video can be obtained data.
最后,可获取固定螺丝的目标位置,然后确定距离目标位置预设距离范围内的多个测试点对应的像素点的振动数据。Finally, the target position of the fixing screw can be obtained, and then the vibration data of the pixel points corresponding to the multiple test points within the preset distance range from the target position can be determined.
104、根据所述振动数据确定所述多个测试点中振动数据不满足预设条件的至少一个目标测试点,将所述至少一个目标测试点标记为异常测试点,并对所述放大视频中所述至少一个目标测试点对应的目标视频区域进行显示。104. Determine, according to the vibration data, at least one target test point whose vibration data does not meet a preset condition among the plurality of test points, mark the at least one target test point as an abnormal test point, and compare the results in the enlarged video The target video area corresponding to the at least one target test point is displayed.
其中,所述振动数据包括以下至少一种:振动幅度、频率、相位、时域波形。Wherein, the vibration data includes at least one of the following: vibration amplitude, frequency, phase, and time-domain waveform.
本申请实施例中,可选取放大视频中固定螺丝附近预设距离范围内的多个测试点对应的像素点的振动数据,得到多组振动数据,从而,可进一步根据多组振动数据中每一组振动数据确定对应的测试点是否为异常测试点。In the embodiment of the present application, the vibration data of the pixels corresponding to the multiple test points within the preset distance range near the fixed screw in the enlarged video can be selected to obtain multiple sets of vibration data. Therefore, each of the multiple sets of vibration data can be further selected based on the vibration data. The group of vibration data determines whether the corresponding test point is an abnormal test point.
可选地,上述步骤104中,根据所述振动数据确定所述多个测试点中振动数据不满足预设条件的至少一个目标测试点,可包括以下步骤:Optionally, in the foregoing step 104, determining at least one target test point whose vibration data does not satisfy a preset condition among the plurality of test points according to the vibration data may include the following steps:
41、确定所述多个测试点中每一测试点对应的像素点对应的振动数据是否满足下列条件:41. Determine whether the vibration data corresponding to the pixel point corresponding to each test point in the plurality of test points meets the following conditions:
所述振动幅度处于预设的振动幅度范围;所述频率处于预设的频率范围;所述相位处于预设的相位范围;将所述时域波形与预设的参考时域波形进行匹配,得到匹配值,所述匹配值处于预设匹配值范围;The vibration amplitude is in the preset vibration amplitude range; the frequency is in the preset frequency range; the phase is in the preset phase range; the time domain waveform is matched with the preset reference time domain waveform to obtain A matching value, the matching value being in a preset matching value range;
42、确定不满足上述任一条件的像素点对应的测试点为所述目标测试点,得到至少一个目标测试点。42. Determine the test point corresponding to the pixel point that does not meet any of the above conditions as the target test point, and obtain at least one target test point.
本申请实施例中,针对多个测试点中每一测试点,根据该测试点对应的振动数据确定该测试点是否为目标测试点,可包括:确定该测试点对应的振动数据是否满足上述各项条件,若振动幅度处于预设的振动幅度范围;频率处于预设的频率范围;相位处于预设的相位范围;将时域波形与预设的参考时域波形进行匹配,得到匹配值,匹配值处于预设匹配值范围,则该测试点不为目标测试点,若该测试点对应的振动数据是否不满足上述各项条件中的任一项,则可确定该测试点为目标测试点,并将该测试点标记为异常测试点。In the embodiment of the present application, for each test point of the multiple test points, determining whether the test point is a target test point according to the vibration data corresponding to the test point may include: determining whether the vibration data corresponding to the test point meets the aforementioned requirements. Condition, if the vibration amplitude is in the preset vibration amplitude range; the frequency is in the preset frequency range; the phase is in the preset phase range; the time domain waveform is matched with the preset reference time domain waveform to obtain the matching value, matching If the value is within the preset matching value range, the test point is not the target test point. If the vibration data corresponding to the test point does not meet any of the above conditions, the test point can be determined as the target test point. And mark the test point as an abnormal test point.
从而,可确定多个测试点中的至少一个目标测试点和除了目标测试点以外的非目标测试点,并将目标测试点标记为异常测试点。Thus, at least one target test point and non-target test points other than the target test point among the plurality of test points can be determined, and the target test point can be marked as an abnormal test point.
进一步地,可对放大视频中至少一个目标测试点对应的目标视频区域进行显示,具体地,可对放大视频中至少一个目标测试点对应的目标视频区域进行显示。Further, the target video area corresponding to at least one target test point in the zoomed-in video may be displayed, specifically, the target video area corresponding to at least one target test point in the zoomed-in video may be displayed.
可选地,所述预设部件为所述待检测设备的底座,本申请实施例中,还可包括以下步骤:Optionally, the preset component is the base of the device to be tested. In the embodiment of the present application, it may further include the following steps:
A1、获取所述至少一个目标测试点中每一目标测试点在所述底座的位置,得到至少一个位置;A1. Obtain the position of each target test point in the base in the at least one target test point to obtain at least one position;
A2、根据所述至少一个位置和所述至少一个目标测试点中每一目标测试点的振动数据 确定减震策略。A2. Determine a shock reduction strategy according to the at least one location and the vibration data of each target test point in the at least one target test point.
其中,可确定每一目标测试点在所述底座的位置,若至少一个位置中存在处于第一位置区域的目标位置,则可进一步根据目标位置的目标测试点的振动数据确定减震策略。Wherein, the position of each target test point on the base can be determined, and if there is a target position in the first position area in at least one position, the vibration reduction strategy can be further determined according to the vibration data of the target test point at the target position.
可选地,上述步骤A2中,根据所述至少一个位置和所述至少一个目标测试点中每一目标测试点的振动数据确定减震策略,可包括以下步骤:Optionally, in the above step A2, determining a vibration reduction strategy according to the at least one location and the vibration data of each target test point in the at least one target test point may include the following steps:
A22、针对所述至少一个目标测试点中每一目标测试点的振动数据,根据所述振动幅度和预设的振动幅度阈值确定振动幅度偏差值;根据所述频率和预设的频率阈值确定频率偏差值;根据所述相位和预设的相位阈值确定频率偏差值;根据所述匹配值和预设匹配值阈值确定时域波形偏差值;A22. For the vibration data of each target test point in the at least one target test point, determine a vibration amplitude deviation value according to the vibration amplitude and a preset vibration amplitude threshold; determine the frequency according to the frequency and the preset frequency threshold Deviation value; determining a frequency deviation value according to the phase and a preset phase threshold; determining a time-domain waveform deviation value according to the matching value and the preset matching value threshold;
A23、若所述至少一个位置中存在处于第一位置区域的目标位置,且所述目标位置对应的目标测试点的振动数据满足以下至少一项,确定减震策略为止震板策略:所述振动幅度偏差值大于第一预设偏差值;所述频率偏差值大于第二预设偏差值;所述频率偏差值大于第三预设偏差值;所述时域波形偏差值大于第四预设偏差值。A23. If there is a target position in the first position area in the at least one position, and the vibration data of the target test point corresponding to the target position meets at least one of the following, determine the shock absorption strategy and the anti-vibration plate strategy: the vibration The amplitude deviation value is greater than the first preset deviation value; the frequency deviation value is greater than the second preset deviation value; the frequency deviation value is greater than the third preset deviation value; the time domain waveform deviation value is greater than the fourth preset deviation value.
本申请实施例中,可预先设定振动幅度对应的振动幅度阈值、频率对应的频率阈值、相位对应的相位阈值和匹配值对应的匹配值阈值。从而,针对至少一个目标测试点中每一目标测试点的振动数据,可确定振动幅度和预设的振动幅度阈值确定振动幅度偏差值;根据频率和预设的频率阈值确定频率偏差值;根据相位和预设的相位阈值确定频率偏差值;根据匹配值和预设匹配值阈值确定时域波形偏差值。若至少一个位置中存在处于第一位置区域的目标位置,且目标位置对应的目标测试点的振动数据满足以下至少一项,确定减震策略为止震板策略:振动幅度偏差值大于第一预设偏差值;所述频率偏差值大于第二预设偏差值;所述频率偏差值大于第三预设偏差值;所述时域波形偏差值大于第四预设偏差值。In the embodiment of the present application, the vibration amplitude threshold corresponding to the vibration amplitude, the frequency threshold corresponding to the frequency, the phase threshold corresponding to the phase, and the matching value threshold corresponding to the matching value can be preset. Therefore, for the vibration data of each target test point in at least one target test point, the vibration amplitude and the preset vibration amplitude threshold value can be determined to determine the vibration amplitude deviation value; the frequency deviation value is determined according to the frequency and the preset frequency threshold value; and the frequency deviation value is determined according to the phase Determine the frequency deviation value with the preset phase threshold; determine the time-domain waveform deviation value according to the matching value and the preset matching value threshold. If there is a target location in the first location area in at least one location, and the vibration data of the target test point corresponding to the target location meets at least one of the following, determine the shock absorber strategy: the vibration amplitude deviation value is greater than the first preset Deviation value; the frequency deviation value is greater than the second preset deviation value; the frequency deviation value is greater than the third preset deviation value; the time domain waveform deviation value is greater than the fourth preset deviation value.
其中,止震板策略为在底座添加止震板的策略。通过止震板可实现减震的效果。Among them, the anti-vibration plate strategy is the strategy of adding anti-vibration plates to the base. The effect of shock absorption can be achieved by the anti-vibration plate.
可以看出,本申请实施例中,振动检测设备可获取针对待检测设备上设置于预设部件的固定螺丝的拍摄视频,根据预设的运动放大算法对拍摄视频进行处理,得到放大视频,从放大视频中提取针对固定螺丝的多个测试点的振动数据,根据振动数据确定多个测试点中振动数据不满足预设条件的至少一个目标测试点,将至少一个目标测试点标记为异常测试点,并对放大视频中至少一个目标测试点对应的目标视频区域进行显示,如此,可通过设备上固定螺丝的拍摄视频提取固定螺丝的振动数据,并根据振动数据确定固定螺丝附近振动异常的测试点,从而,可对设备的固定螺丝异常进行更加精确地检测。It can be seen that, in this embodiment of the application, the vibration detection device can obtain the shooting video for the fixing screws set on the preset component on the device to be detected, and process the shooting video according to the preset motion amplification algorithm to obtain the enlarged video, from Extract the vibration data of multiple test points for the fixed screw from the enlarged video, determine at least one target test point whose vibration data does not meet the preset conditions among the multiple test points according to the vibration data, and mark the at least one target test point as an abnormal test point , And display the target video area corresponding to at least one target test point in the enlarged video. In this way, the vibration data of the fixed screw can be extracted from the video of the fixed screw on the device, and the test point with abnormal vibration near the fixed screw can be determined based on the vibration data Therefore, the abnormality of the fixing screw of the device can be detected more accurately.
请参阅图2,图2是本申请实施例提供的另一种针对设备的固定螺丝异常的检测方法的流程示意图,本申请实施例提供的针对设备的固定螺丝异常的检测方法应用于振动检测设备,该针对设备的固定螺丝异常的检测方法包括:Please refer to FIG. 2. FIG. 2 is a schematic flowchart of another method for detecting abnormality of a fixed screw of a device provided by an embodiment of the present application. The method for detecting abnormality of a fixed screw of a device provided by the embodiment of the present application is applied to a vibration detection device , The detection method for the abnormality of the fixed screw of the device includes:
201、获取针对待检测设备上设置于预设部件的固定螺丝的拍摄视频。201. Obtain a shooting video for a fixing screw set on a preset component on a device to be tested.
202、将所述拍摄视频分割成多帧视频图像。202. Split the captured video into multiple frames of video images.
203、将所述多帧视频图像从RGB颜色空间转换到YIQ颜色空间,得到多帧参考图像,所述多帧参考图像中每一参考图像的像素点包含亮度信息和色度信息。203. Convert the multi-frame video image from the RGB color space to the YIQ color space to obtain a multi-frame reference image, where the pixel of each reference image in the multi-frame reference image includes luminance information and chrominance information.
204、对所述多帧参考图像中的亮度信息进行傅里叶变换FFT处理,得到多帧目标图像。204. Perform Fourier transform FFT processing on the brightness information in the multi-frame reference image to obtain a multi-frame target image.
205、根据所述运动放大算法对所述多帧目标图像进行处理,得到多帧放大图像。205. Process the multi-frame target image according to the motion magnification algorithm to obtain a multi-frame magnified image.
206、将所述多帧放大图像进行合成,得到所述放大视频。206. Synthesize the multiple frames of enlarged images to obtain the enlarged video.
207、从所述放大视频中提取针对所述固定螺丝的多个测试点的振动数据。207. Extract vibration data of multiple test points for the fixed screw from the enlarged video.
208、根据所述振动数据确定所述多个测试点中振动数据不满足预设条件的至少一个目标测试点,将所述至少一个目标测试点标记为异常测试点,并对所述放大视频中所述至少 一个目标测试点对应的目标视频区域进行显示。208. Determine, according to the vibration data, at least one target test point whose vibration data does not meet a preset condition among the plurality of test points, mark the at least one target test point as an abnormal test point, and compare the results in the enlarged video The target video area corresponding to the at least one target test point is displayed.
其中,201-208的具体实现过程可参照图1B所示的方法中相应的描述,在此不再赘述。For the specific implementation process of 201-208, please refer to the corresponding description in the method shown in FIG. 1B, which is not repeated here.
可以看出,本申请实施例中,振动检测设备可获取针对待检测设备上设置于预设部件的固定螺丝的拍摄视频,将拍摄视频分割成多帧视频图像,将多帧视频图像从RGB颜色空间转换到YIQ颜色空间,得到多帧参考图像,对多帧参考图像中的亮度信息进行傅里叶变换FFT处理,得到多帧目标图像,根据运动放大算法对多帧目标图像进行处理,得到多帧放大图像,将多帧放大图像进行合成,得到放大视频,从放大视频中提取针对固定螺丝的多个测试点的振动数据,根据振动数据确定多个测试点中振动数据不满足预设条件的至少一个目标测试点,将至少一个目标测试点标记为异常测试点,并对放大视频中至少一个目标测试点对应的目标视频区域进行显示,如此,可通过运动放大算法提取固定螺丝的振动数据,并根据振动数据确定固定螺丝附近振动异常的测试点,从而,可对设备的固定螺丝异常进行更加精确地检测。It can be seen that in this embodiment of the application, the vibration detection device can obtain the shooting video for the fixing screws set on the preset component on the device to be detected, divide the shooting video into multiple frames of video images, and divide the multiple frames of video images from RGB colors. The space is converted to YIQ color space to obtain a multi-frame reference image, Fourier transform FFT processing is performed on the brightness information in the multi-frame reference image, and a multi-frame target image is obtained. The multi-frame target image is processed according to the motion amplification algorithm to obtain a multi-frame target image. Frame magnified images, combine multiple magnified images to obtain a magnified video, extract vibration data of multiple test points for the fixed screw from the magnified video, and determine the vibration data of multiple test points that do not meet the preset conditions according to the vibration data At least one target test point, at least one target test point is marked as an abnormal test point, and the target video area corresponding to at least one target test point in the zoomed-in video is displayed. In this way, the vibration data of the fixed screw can be extracted by the motion zoom algorithm, And according to the vibration data, determine the test point of abnormal vibration near the fixing screw, so that the abnormality of the fixing screw of the device can be detected more accurately.
请参阅图3,图3为本申请实施例提供了一种针对设备的固定螺丝异常的检测方法的流程示意图。如图3所示,本申请实施例提供的针对设备的固定螺丝异常的检测方法应用于振动检测设备,该针对设备的固定螺丝异常的检测方法可包括以下步骤:Please refer to FIG. 3. FIG. 3 is a schematic flowchart of a method for detecting abnormality of a fixing screw of a device according to an embodiment of the present application. As shown in FIG. 3, the method for detecting abnormality of a fixed screw of a device provided by an embodiment of the present application is applied to a vibration detection device, and the method for detecting abnormality of a fixed screw of the device may include the following steps:
301、获取针对待检测设备上设置于预设部件的固定螺丝的拍摄视频。301. Obtain a shooting video for a fixing screw set on a preset component on a device to be tested.
302、根据预设的运动放大算法对所述拍摄视频进行处理,得到放大视频。302. Process the captured video according to a preset motion zoom algorithm to obtain an enlarged video.
303、从所述放大视频中提取针对所述固定螺丝的多个测试点的振动数据。303. Extract vibration data of multiple test points for the fixed screw from the enlarged video.
304、根据所述振动数据确定所述多个测试点中振动数据不满足预设条件的至少一个目标测试点,将所述至少一个目标测试点标记为异常测试点,并对所述放大视频中所述至少一个目标测试点对应的目标视频区域进行显示。304. Determine, according to the vibration data, at least one target test point whose vibration data does not meet a preset condition among the plurality of test points, mark the at least one target test point as an abnormal test point, and compare the results in the enlarged video The target video area corresponding to the at least one target test point is displayed.
305、获取所述至少一个目标测试点中每一目标测试点在所述底座的位置,得到至少一个位置。305. Obtain the position of each target test point on the base in the at least one target test point to obtain at least one position.
306、根据所述至少一个位置和所述至少一个目标测试点中每一目标测试点的振动数据确定减震策略。306. Determine a shock reduction strategy according to the at least one location and the vibration data of each target test point in the at least one target test point.
其中,301-306的具体实现过程可参照图1B所示的方法中相应的描述,在此不再赘述。Among them, the specific implementation process of 301-306 can refer to the corresponding description in the method shown in FIG. 1B, which will not be repeated here.
可以看出,通过本实施例,振动检测设备可获取针对待检测设备上设置于预设部件的固定螺丝的拍摄视频,根据预设的运动放大算法对拍摄视频进行处理,得到放大视频,从放大视频中提取针对固定螺丝的多个测试点的振动数据,根据振动数据确定多个测试点中振动数据不满足预设条件的至少一个目标测试点,将至少一个目标测试点标记为异常测试点,并对放大视频中至少一个目标测试点对应的目标视频区域进行显示,获取至少一个目标测试点中每一目标测试点在所述底座的位置,得到至少一个位置,根据至少一个位置和至少一个目标测试点中每一目标测试点的振动数据确定减震策略,如此,可通过设备上固定螺丝的拍摄视频提取固定螺丝的振动数据,并根据振动数据确定固定螺丝附近振动异常的测试点,从而,可对设备的固定螺丝异常进行更加精确地检测,此外,还可针对异常的测试点提供对应的减震策略,有利于对待检测设备进行维护。It can be seen that through this embodiment, the vibration detection device can obtain the shooting video for the fixing screws set on the preset component on the device to be detected, and process the shooting video according to the preset motion zoom algorithm to obtain the zoomed video. The video extracts the vibration data of multiple test points for the fixed screw, determines at least one target test point whose vibration data does not meet the preset condition among the multiple test points according to the vibration data, and marks the at least one target test point as an abnormal test point, The target video area corresponding to at least one target test point in the zoomed-in video is displayed, and the position of each target test point in the at least one target test point on the base is obtained, and at least one position is obtained. According to the at least one position and the at least one target The vibration data of each target test point in the test point determines the vibration reduction strategy. In this way, the vibration data of the fixed screw can be extracted from the video of the fixed screw on the device, and the test point with abnormal vibration near the fixed screw can be determined based on the vibration data, so that, It can detect the abnormality of the fixed screw of the equipment more accurately. In addition, it can also provide the corresponding shock absorption strategy for the abnormal test point, which is conducive to the maintenance of the equipment to be tested.
上述主要从方法侧执行过程的角度对本申请实施例的方案进行了介绍。可以理解的是,图像信息确定装置为了实现上述功能,其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。The foregoing mainly introduces the solution of the embodiment of the present application from the perspective of the execution process on the method side. It can be understood that, in order to realize the above-mentioned functions, the image information determining apparatus includes hardware structures and/or software modules corresponding to each function. Those skilled in the art should easily realize that in combination with the units and algorithm steps of the examples described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software-driven hardware depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.
本申请实施例可以根据上述方法示例对图像信息确定装置进行功能单元的划分,例如,可以对应各个功能划分各个功能单元,也可以将两个或两个以上的功能集成在一个处理单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。需要说明的是,本申请实施例中对单元的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。The embodiment of the present application may divide the image information determining apparatus into functional units according to the foregoing method examples. For example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit. It should be noted that the division of units in the embodiments of the present application is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.
请参阅图4,图4是本申请实施例公开的振动检测设备的结构示意图,如图所示,该振动检测设备包括处理器、存储器、通信接口,以及一个或多个程序,其中,上述一个或多个程序被存储在上述存储器中,并且被配置由上述处理器执行,上述程序包括用于执行以下步骤的指令:Please refer to FIG. 4, which is a schematic structural diagram of a vibration detection device disclosed in an embodiment of the present application. As shown in the figure, the vibration detection device includes a processor, a memory, a communication interface, and one or more programs. Or multiple programs are stored in the above-mentioned memory and configured to be executed by the above-mentioned processor, and the above-mentioned programs include instructions for executing the following steps:
获取针对待检测设备上设置于预设部件的固定螺丝的拍摄视频;Obtain a shooting video for the fixing screws set on the preset component on the device to be tested;
根据预设的运动放大算法对所述拍摄视频进行处理,得到放大视频;Processing the shooting video according to a preset motion zoom algorithm to obtain a zoomed video;
从所述放大视频中提取针对所述固定螺丝的多个测试点的振动数据;Extracting vibration data of multiple test points for the fixing screw from the enlarged video;
根据所述振动数据确定所述多个测试点中振动数据不满足预设条件的至少一个目标测试点,将所述至少一个目标测试点标记为异常测试点,并对所述放大视频中所述至少一个目标测试点对应的目标视频区域进行显示。According to the vibration data, determine at least one target test point whose vibration data does not meet a preset condition among the plurality of test points, mark the at least one target test point as an abnormal test point, and compare the The target video area corresponding to at least one target test point is displayed.
在一个可能的示例中,在所述根据预设的运动放大算法对所述拍摄视频进行处理,得到放大视频方面,上述程序包括用于执行以下步骤的指令:In a possible example, in terms of processing the captured video according to the preset motion zoom algorithm to obtain the zoomed video, the foregoing program includes instructions for executing the following steps:
将所述拍摄视频分割成多帧视频图像;Dividing the shooting video into multiple frames of video images;
将所述多帧视频图像从RGB颜色空间转换到YIQ颜色空间,得到多帧参考图像,所述多帧参考图像中每一参考图像的像素点包含亮度信息和色度信息;Converting the multi-frame video image from the RGB color space to the YIQ color space to obtain a multi-frame reference image, where the pixel of each reference image in the multi-frame reference image contains luminance information and chrominance information;
对所述多帧参考图像中的亮度信息进行傅里叶变换FFT处理,得到多帧目标图像;Performing Fourier transform FFT processing on the brightness information in the multi-frame reference image to obtain a multi-frame target image;
根据所述运动放大算法对所述多帧目标图像进行处理,得到多帧放大图像;Processing the multi-frame target image according to the motion magnification algorithm to obtain a multi-frame magnified image;
将所述多帧放大图像进行合成,得到所述放大视频。The multiple frames of enlarged images are synthesized to obtain the enlarged video.
在一个可能的示例中,所述运动放大算法可以包括以下至少一种:拉格朗日运动放大算法、欧拉运动放大算法、复数相位运动放大算法、RIESZ金字塔运动放大算法。In a possible example, the motion amplification algorithm may include at least one of the following: Lagrangian motion amplification algorithm, Euler motion amplification algorithm, complex phase motion amplification algorithm, RIESZ pyramid motion amplification algorithm.
在一个可能的示例中,在所述从所述放大视频中提取针对所述固定螺丝的多个测试点的振动数据方面,上述程序包括用于执行以下步骤的指令:In a possible example, in terms of extracting vibration data of multiple test points for the fixing screw from the enlarged video, the above program includes instructions for executing the following steps:
根据预设的相位相关算法计算所述放大视频中的多帧放大图像之间的第一交叉互功率谱;Calculating the first cross cross power spectrum between the multiple frames of enlarged images in the enlarged video according to a preset phase correlation algorithm;
根据所述第一交叉互功率谱进行插值滤波,得到插值滤波后的第二交叉互功率谱;Performing interpolation filtering according to the first cross cross power spectrum to obtain a second cross cross power spectrum after interpolation filtering;
针对所述第二交叉互功率谱进行反傅里叶变换DFFT处理,得到所述放大视频中所有像素点的振动数据;Performing inverse Fourier transform DFFT processing on the second cross cross power spectrum to obtain vibration data of all pixels in the amplified video;
从所述放大视频中所有像素点的振动数据中选取距离所述固定螺丝预设距离范围内的多个测试点对应的像素点的振动数据。From the vibration data of all pixels in the enlarged video, vibration data of pixels corresponding to a plurality of test points within a preset distance from the fixing screw are selected.
在一个可能的示例中,所述振动数据包括以下至少一种:振动幅度、频率、相位、时域波形,在所述根据所述振动数据确定所述多个测试点中振动数据不满足预设条件的至少一个目标测试点方面,上述程序包括用于执行以下步骤的指令:In a possible example, the vibration data includes at least one of the following: vibration amplitude, frequency, phase, and time-domain waveform. It is determined according to the vibration data that the vibration data does not satisfy a preset value among the multiple test points. Regarding at least one target test point of the condition, the above-mentioned program includes instructions for performing the following steps:
确定所述多个测试点中每一测试点对应的像素点对应的振动数据是否满足下列条件:Determine whether the vibration data corresponding to the pixel point corresponding to each test point in the plurality of test points meets the following conditions:
所述振动幅度处于预设的振动幅度范围;所述频率处于预设的频率范围;所述相位处于预设的相位范围;将所述时域波形与预设的参考时域波形进行匹配,得到匹配值,所述匹配值处于预设匹配值范围;The vibration amplitude is in the preset vibration amplitude range; the frequency is in the preset frequency range; the phase is in the preset phase range; the time domain waveform is matched with the preset reference time domain waveform to obtain A matching value, the matching value being in a preset matching value range;
确定不满足上述任一条件的像素点对应的测试点为所述目标测试点,得到至少一个目标测试点。It is determined that a test point corresponding to a pixel point that does not meet any of the foregoing conditions is the target test point, and at least one target test point is obtained.
在一个可能的示例中,所述预设部件为所述待检测设备的底座,上述程序还包括用于执行以下步骤的指令:In a possible example, the preset component is the base of the device to be tested, and the above program further includes instructions for executing the following steps:
获取所述至少一个目标测试点中每一目标测试点在所述底座的位置,得到至少一个位置;Acquiring the position of each target test point of the at least one target test point on the base to obtain at least one position;
根据所述至少一个位置和所述至少一个目标测试点中每一目标测试点的振动数据确定减震策略。A shock reduction strategy is determined according to the at least one location and the vibration data of each target test point in the at least one target test point.
在一个可能的示例中,在所述根据所述至少一个位置和所述至少一个目标测试点中每一目标测试点的振动数据确定减震策略方面,上述程序还包括用于执行以下步骤的指令:In a possible example, in the aspect of determining a shock absorption strategy based on the at least one location and the vibration data of each target test point in the at least one target test point, the program further includes instructions for executing the following steps :
针对所述至少一个目标测试点中每一目标测试点的振动数据,根据所述振动幅度和预设的振动幅度阈值确定振动幅度偏差值;根据所述频率和预设的频率阈值确定频率偏差值;根据所述相位和预设的相位阈值确定频率偏差值;根据所述匹配值和预设匹配值阈值确定时域波形偏差值;For the vibration data of each target test point in the at least one target test point, determine a vibration amplitude deviation value according to the vibration amplitude and a preset vibration amplitude threshold; determine a frequency deviation value according to the frequency and the preset frequency threshold Determine the frequency deviation value according to the phase and the preset phase threshold; determine the time-domain waveform deviation value according to the matching value and the preset matching value threshold;
若所述至少一个位置中存在处于第一位置区域的目标位置,且所述目标位置对应的目标测试点的振动数据满足以下至少一项,确定减震策略为止震板策略:所述振动幅度偏差值大于第一预设偏差值;所述频率偏差值大于第二预设偏差值;所述频率偏差值大于第三预设偏差值;所述时域波形偏差值大于第四预设偏差值。If there is a target position in the first position area in the at least one position, and the vibration data of the target test point corresponding to the target position meets at least one of the following, determine the shock absorber strategy of the shock absorption strategy: the vibration amplitude deviation The value is greater than the first preset deviation value; the frequency deviation value is greater than the second preset deviation value; the frequency deviation value is greater than the third preset deviation value; the time domain waveform deviation value is greater than the fourth preset deviation value.
请参阅图5,图5是本申请实施例公开的一种针对设备的固定螺丝异常的检测装置的结构示意图,应用于振动检测设备,所述针对设备的固定螺丝异常的检测装置包括获取单元501、处理单元502、确定单元503和显示单元504,其中,Please refer to FIG. 5. FIG. 5 is a schematic structural diagram of a device for detecting an abnormality of a fixing screw of a device disclosed in an embodiment of the present application, which is applied to a vibration detection device. The device for detecting an abnormality of a fixing screw of the device includes an acquiring unit 501 , The processing unit 502, the determining unit 503, and the display unit 504, wherein:
所述获取单元501,用于获取针对待检测设备上设置于预设部件的固定螺丝的拍摄视频;The acquiring unit 501 is configured to acquire a shooting video of a fixing screw set on a preset component on the device to be tested;
所述处理单元502,用于根据预设的运动放大算法对所述拍摄视频进行处理,得到放大视频;以及,从所述放大视频中提取针对所述固定螺丝的多个测试点的振动数据;The processing unit 502 is configured to process the shooting video according to a preset motion amplification algorithm to obtain an enlarged video; and extract vibration data for multiple test points of the fixed screw from the enlarged video;
所述确定单元503,用于根据所述振动数据确定所述多个测试点中振动数据不满足预设条件的至少一个目标测试点,将所述至少一个目标测试点标记为异常测试点;The determining unit 503 is configured to determine at least one target test point whose vibration data does not meet a preset condition among the plurality of test points according to the vibration data, and mark the at least one target test point as an abnormal test point;
所述显示单元504,用于对所述放大视频中所述至少一个目标测试点对应的目标视频区域进行显示。The display unit 504 is configured to display the target video area corresponding to the at least one target test point in the zoomed-in video.
可选地,在所述根据预设的运动放大算法对所述拍摄视频进行处理,得到放大视频方面,所述处理单元502具体用于:Optionally, in the aspect of processing the captured video according to a preset motion amplification algorithm to obtain an enlarged video, the processing unit 502 is specifically configured to:
将所述拍摄视频分割成多帧视频图像;Dividing the shooting video into multiple frames of video images;
将所述多帧视频图像从RGB颜色空间转换到YIQ颜色空间,得到多帧参考图像,所述多帧参考图像中每一参考图像的像素点包含亮度信息和色度信息;Converting the multi-frame video image from the RGB color space to the YIQ color space to obtain a multi-frame reference image, where the pixel of each reference image in the multi-frame reference image contains luminance information and chrominance information;
对所述多帧参考图像中的亮度信息进行傅里叶变换FFT处理,得到多帧目标图像;Performing Fourier transform FFT processing on the brightness information in the multi-frame reference image to obtain a multi-frame target image;
根据所述运动放大算法对所述多帧目标图像进行处理,得到多帧放大图像;Processing the multi-frame target image according to the motion magnification algorithm to obtain a multi-frame magnified image;
将所述多帧放大图像进行合成,得到所述放大视频。The multiple frames of enlarged images are synthesized to obtain the enlarged video.
可选地,所述运动放大算法可以包括以下至少一种:拉格朗日运动放大算法、欧拉运动放大算法、复数相位运动放大算法、RIESZ金字塔运动放大算法。Optionally, the motion amplification algorithm may include at least one of the following: Lagrangian motion amplification algorithm, Euler motion amplification algorithm, complex phase motion amplification algorithm, RIESZ pyramid motion amplification algorithm.
可选地,在所述从所述放大视频中提取针对所述固定螺丝的多个测试点的振动数据方面,所述处理单元502具体用于:Optionally, in terms of extracting vibration data of multiple test points for the fixing screw from the enlarged video, the processing unit 502 is specifically configured to:
根据预设的相位相关算法计算所述放大视频中的多帧放大图像之间的第一交叉互功率谱;Calculating the first cross cross power spectrum between the multiple frames of enlarged images in the enlarged video according to a preset phase correlation algorithm;
根据所述第一交叉互功率谱进行插值滤波,得到插值滤波后的第二交叉互功率谱;Performing interpolation filtering according to the first cross cross power spectrum to obtain a second cross cross power spectrum after interpolation filtering;
针对所述第二交叉互功率谱进行反傅里叶变换DFFT处理,得到所述放大视频中所有 像素点的振动数据;Performing inverse Fourier transform DFFT processing on the second cross cross power spectrum to obtain vibration data of all pixels in the amplified video;
从所述放大视频中所有像素点的振动数据中选取距离所述固定螺丝预设距离范围内的多个测试点对应的像素点的振动数据。From the vibration data of all pixels in the enlarged video, vibration data of pixels corresponding to a plurality of test points within a preset distance from the fixing screw are selected.
可选地,所述振动数据包括以下至少一种:振动幅度、频率、相位、时域波形,在所述根据所述振动数据确定所述多个测试点中振动数据不满足预设条件的至少一个目标测试点,所述确定单元503具体用于:Optionally, the vibration data includes at least one of the following: vibration amplitude, frequency, phase, and time-domain waveform, and it is determined according to the vibration data that the vibration data does not meet a preset condition at least A target test point, the determining unit 503 is specifically configured to:
确定所述多个测试点中每一测试点对应的像素点对应的振动数据是否满足下列条件:Determine whether the vibration data corresponding to the pixel point corresponding to each test point in the plurality of test points meets the following conditions:
所述振动幅度处于预设的振动幅度范围;所述频率处于预设的频率范围;所述相位处于预设的相位范围;将所述时域波形与预设的参考时域波形进行匹配,得到匹配值,所述匹配值处于预设匹配值范围;The vibration amplitude is in the preset vibration amplitude range; the frequency is in the preset frequency range; the phase is in the preset phase range; the time domain waveform is matched with the preset reference time domain waveform to obtain A matching value, the matching value being in a preset matching value range;
确定不满足上述任一条件的像素点对应的测试点为所述目标测试点,得到至少一个目标测试点。It is determined that a test point corresponding to a pixel point that does not meet any of the foregoing conditions is the target test point, and at least one target test point is obtained.
可选地,所述预设部件为所述待检测设备的底座,Optionally, the preset component is a base of the device to be tested,
所述获取单元501,还用于获取所述至少一个目标测试点中每一目标测试点在所述底座的位置,得到至少一个位置;The acquiring unit 501 is further configured to acquire the position of each target test point in the base in the at least one target test point to obtain at least one position;
所述确定单元503,还用于根据所述至少一个位置和所述至少一个目标测试点中每一目标测试点的振动数据确定减震策略。The determining unit 503 is further configured to determine a vibration reduction strategy according to the at least one location and the vibration data of each target test point in the at least one target test point.
可选地,在根据所述至少一个位置和所述至少一个目标测试点中每一目标测试点的振动数据确定减震策略方面,所述确定单元503具体用于:Optionally, in terms of determining a shock absorption strategy based on the at least one location and the vibration data of each target test point in the at least one target test point, the determining unit 503 is specifically configured to:
针对所述至少一个目标测试点中每一目标测试点的振动数据,根据所述振动幅度和预设的振动幅度阈值确定振动幅度偏差值;根据所述频率和预设的频率阈值确定频率偏差值;根据所述相位和预设的相位阈值确定频率偏差值;根据所述匹配值和预设匹配值阈值确定时域波形偏差值;For the vibration data of each target test point in the at least one target test point, determine a vibration amplitude deviation value according to the vibration amplitude and a preset vibration amplitude threshold; determine a frequency deviation value according to the frequency and the preset frequency threshold Determine the frequency deviation value according to the phase and the preset phase threshold; determine the time-domain waveform deviation value according to the matching value and the preset matching value threshold;
若所述至少一个位置中存在处于第一位置区域的目标位置,且所述目标位置对应的目标测试点的振动数据满足以下至少一项,确定减震策略为止震板策略:所述振动幅度偏差值大于第一预设偏差值;所述频率偏差值大于第二预设偏差值;所述频率偏差值大于第三预设偏差值;所述时域波形偏差值大于第四预设偏差值。If there is a target position in the first position area in the at least one position, and the vibration data of the target test point corresponding to the target position meets at least one of the following, determine the shock absorber strategy of the shock absorption strategy: the vibration amplitude deviation The value is greater than the first preset deviation value; the frequency deviation value is greater than the second preset deviation value; the frequency deviation value is greater than the third preset deviation value; the time domain waveform deviation value is greater than the fourth preset deviation value.
可以看出,通过本申请实施例提供的,振动检测设备可获取针对待检测设备上设置于预设部件的固定螺丝的拍摄视频,根据预设的运动放大算法对拍摄视频进行处理,得到放大视频,从放大视频中提取针对固定螺丝的多个测试点的振动数据,根据振动数据确定多个测试点中振动数据不满足预设条件的至少一个目标测试点,将至少一个目标测试点标记为异常测试点,并对放大视频中至少一个目标测试点对应的目标视频区域进行显示,如此,可通过设备上固定螺丝的拍摄视频提取固定螺丝的振动数据,并根据振动数据确定固定螺丝附近振动异常的测试点,从而,可对设备的固定螺丝异常进行更加精确地检测。It can be seen that through the embodiments of the present application, the vibration detection device can obtain the shooting video of the fixed screw set on the preset component on the device to be detected, and process the shooting video according to the preset motion amplification algorithm to obtain the enlarged video , Extract the vibration data of multiple test points for the fixed screw from the enlarged video, determine at least one target test point whose vibration data does not meet the preset condition among the multiple test points according to the vibration data, and mark the at least one target test point as abnormal Test points, and display the target video area corresponding to at least one target test point in the enlarged video. In this way, the vibration data of the fixed screw can be extracted from the video of the fixed screw on the device, and the vibration data near the fixed screw can be determined according to the vibration data. The test point can detect the abnormality of the fixing screw of the device more accurately.
本申请实施例还提供一种计算机存储介质,其中,该计算机存储介质存储用于电子数据交换的计算机程序,该计算机程序使得计算机执行如上述方法实施例中记载的任何一种针对设备的固定螺丝异常的检测方法的部分或全部步骤。An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program causes the computer to execute any of the fixing screws for the device as described in the above method embodiments. Part or all of the steps of the abnormal detection method.
本申请实施例还提供一种计算机程序产品,所述计算机程序产品包括存储了计算机程序的非瞬时性计算机可读存储介质,该计算机程序使得计算机执行如上述方法实施例中记载的任何一种针对设备的固定螺丝异常的检测方法的部分或全部步骤。The embodiments of the present application also provide a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program. The computer program causes a computer to execute any of the methods described in the above-mentioned method embodiments. Part or all of the steps of the method of detecting abnormality of the fixing screws of the equipment.
需要说明的是,对于前述的各方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请并不受所描述的动作顺序的限制,因为依据本申请,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知 悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作和模块并不一定是本申请所必须的。It should be noted that for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should know that this application is not limited by the described sequence of actions. Because according to this application, some steps can be performed in other order or at the same time. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by this application.
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。In the above-mentioned embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in an embodiment, reference may be made to related descriptions of other embodiments.
在本申请所提供的几个实施例中,应该理解到,所揭露的装置,可通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed device may be implemented in other ways. For example, the device embodiments described above are merely illustrative, for example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
另外,在申请明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件程序模块的形式实现。In addition, it is stated in the application that each functional unit in each embodiment may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be realized in the form of hardware or software program module.
所述集成的单元如果以软件程序模块的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储器中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储器中,包括若干指令用以使得一台计算机设备(可为个人计算机、振动检测设备或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储器包括:U盘、只读存储器(read-only memory,ROM)、随机存取存储器(random access memory,RAM)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。If the integrated unit is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer readable memory. Based on this understanding, the technical solution of the present application essentially or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory. A number of instructions are included to enable a computer device (which may be a personal computer, a vibration detection device, or a network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned memory includes: U disk, read-only memory (read-only memory, ROM), random access memory (random access memory, RAM), mobile hard disk, magnetic disk, or optical disk and other media that can store program codes.
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储器中,存储器可以包括:闪存盘、只读存储器、随机存取器、磁盘或光盘等。Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by a program instructing relevant hardware. The program can be stored in a computer-readable memory, and the memory can include: a flash disk , Read-only memory, random access device, magnetic or optical disk, etc.
以上对本申请实施例进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。The embodiments of the application are described in detail above, and specific examples are used in this article to illustrate the principles and implementation of the application. The descriptions of the above embodiments are only used to help understand the methods and core ideas of the application; at the same time, for Those of ordinary skill in the art, based on the ideas of the application, will have changes in the specific implementation and the scope of application. In summary, the content of this specification should not be construed as limiting the application.

Claims (10)

  1. 一种针对设备的固定螺丝异常的检测方法,其特征在于,应用于振动检测设备,所述方法包括:A detection method for an abnormality of a fixing screw of a device is characterized in that it is applied to a vibration detection device, and the method includes:
    获取针对待检测设备上设置于预设部件的固定螺丝的拍摄视频;Obtain a shooting video for the fixing screws set on the preset component on the device to be tested;
    根据预设的运动放大算法对所述拍摄视频进行处理,得到放大视频;Processing the shooting video according to a preset motion zoom algorithm to obtain a zoomed video;
    从所述放大视频中提取针对所述固定螺丝的多个测试点的振动数据;Extracting vibration data of multiple test points for the fixing screw from the enlarged video;
    根据所述振动数据确定所述多个测试点中振动数据不满足预设条件的至少一个目标测试点,将所述至少一个目标测试点标记为异常测试点,并对所述放大视频中所述至少一个目标测试点对应的目标视频区域进行显示。According to the vibration data, determine at least one target test point whose vibration data does not meet a preset condition among the plurality of test points, mark the at least one target test point as an abnormal test point, and compare the The target video area corresponding to at least one target test point is displayed.
  2. 根据权利要求1所述的方法,其特征在于,所述根据预设的运动放大算法对所述拍摄视频进行处理,得到放大视频,包括:The method according to claim 1, wherein the processing the captured video according to a preset motion zoom algorithm to obtain the zoomed video comprises:
    将所述拍摄视频分割成多帧视频图像;Dividing the shooting video into multiple frames of video images;
    将所述多帧视频图像从RGB颜色空间转换到YIQ颜色空间,得到多帧参考图像,所述多帧参考图像中每一参考图像的像素点包含亮度信息和色度信息;Converting the multi-frame video image from the RGB color space to the YIQ color space to obtain a multi-frame reference image, where the pixel of each reference image in the multi-frame reference image contains luminance information and chrominance information;
    对所述多帧参考图像中的亮度信息进行傅里叶变换FFT处理,得到多帧目标图像;Performing Fourier transform FFT processing on the brightness information in the multi-frame reference image to obtain a multi-frame target image;
    根据所述运动放大算法对所述多帧目标图像进行处理,得到多帧放大图像;Processing the multi-frame target image according to the motion magnification algorithm to obtain a multi-frame magnified image;
    将所述多帧放大图像进行合成,得到所述放大视频。The multiple frames of enlarged images are synthesized to obtain the enlarged video.
  3. 根据权利要求1或2所述的方法,其特征在于,所述运动放大算法包括以下至少一种:拉格朗日运动放大算法、欧拉运动放大算法、复数相位运动放大算法、RIESZ金字塔运动放大算法。The method according to claim 1 or 2, wherein the motion amplification algorithm comprises at least one of the following: Lagrangian motion amplification algorithm, Euler motion amplification algorithm, complex phase motion amplification algorithm, RIESZ pyramid motion amplification algorithm.
  4. 根据权利要求1-3任一项所述的方法,其特征在于,所述从所述放大视频中提取针对所述固定螺丝的多个测试点的振动数据,包括:The method according to any one of claims 1 to 3, wherein the extracting vibration data of a plurality of test points of the fixing screw from the enlarged video comprises:
    根据预设的相位相关算法计算所述放大视频中的多帧放大图像之间的第一交叉互功率谱;Calculating the first cross cross power spectrum between the multiple frames of enlarged images in the enlarged video according to a preset phase correlation algorithm;
    根据所述第一交叉互功率谱进行插值滤波,得到插值滤波后的第二交叉互功率谱;Performing interpolation filtering according to the first cross cross power spectrum to obtain a second cross cross power spectrum after interpolation filtering;
    针对所述第二交叉互功率谱进行反傅里叶变换DFFT处理,得到所述放大视频中所有像素点的振动数据;Performing inverse Fourier transform DFFT processing on the second cross cross power spectrum to obtain vibration data of all pixels in the amplified video;
    从所述放大视频中所有像素点的振动数据中选取距离所述固定螺丝预设距离范围内的多个测试点对应的像素点的振动数据。From the vibration data of all pixels in the enlarged video, vibration data of pixels corresponding to a plurality of test points within a preset distance from the fixing screw are selected.
  5. 根据权利要求4所述的方法,其特征在于,所述振动数据包括以下至少一种:振动幅度、频率、相位、时域波形,所述根据所述振动数据确定所述多个测试点中振动数据不满足预设条件的至少一个目标测试点,包括:The method according to claim 4, wherein the vibration data includes at least one of the following: vibration amplitude, frequency, phase, and time-domain waveform, and the vibration data in the multiple test points are determined according to the vibration data. At least one target test point whose data does not meet the preset conditions, including:
    确定所述多个测试点中每一测试点对应的像素点对应的振动数据是否满足下列条件:It is determined whether the vibration data corresponding to the pixel point corresponding to each test point in the plurality of test points meets the following conditions:
    所述振动幅度处于预设的振动幅度范围;所述频率处于预设的频率范围;所述相位处于预设的相位范围;将所述时域波形与预设的参考时域波形进行匹配,得到匹配值,所述匹配值处于预设匹配值范围;The vibration amplitude is in the preset vibration amplitude range; the frequency is in the preset frequency range; the phase is in the preset phase range; the time domain waveform is matched with the preset reference time domain waveform to obtain A matching value, the matching value being in a preset matching value range;
    确定不满足上述任一条件的像素点对应的测试点为所述目标测试点,得到至少一个目标测试点。It is determined that a test point corresponding to a pixel point that does not meet any of the foregoing conditions is the target test point, and at least one target test point is obtained.
  6. 根据权利要求5所述的方法,其特征在于,所述预设部件为所述待检测设备的底座,所述方法还包括:The method according to claim 5, wherein the preset component is a base of the device to be tested, and the method further comprises:
    获取所述至少一个目标测试点中每一目标测试点在所述底座的位置,得到至少一个位置;Acquiring the position of each target test point in the base in the at least one target test point to obtain at least one position;
    根据所述至少一个位置和所述至少一个目标测试点中每一目标测试点的振动数据确定减震策略。A shock reduction strategy is determined according to the at least one location and the vibration data of each target test point in the at least one target test point.
  7. 根据权利要求6所述的方法,其特征在于,根据所述至少一个位置和所述至少一个目标测试点中每一目标测试点的振动数据确定减震策略,包括:The method according to claim 6, wherein determining a vibration reduction strategy according to the at least one location and the vibration data of each target test point in the at least one target test point comprises:
    针对所述至少一个目标测试点中每一目标测试点的振动数据,根据所述振动幅度和预设的振动幅度阈值确定振动幅度偏差值;根据所述频率和预设的频率阈值确定频率偏差值;根据所述相位和预设的相位阈值确定频率偏差值;根据所述匹配值和预设匹配值阈值确定时域波形偏差值;For the vibration data of each target test point in the at least one target test point, determine a vibration amplitude deviation value according to the vibration amplitude and a preset vibration amplitude threshold; determine a frequency deviation value according to the frequency and the preset frequency threshold Determine the frequency deviation value according to the phase and the preset phase threshold; determine the time-domain waveform deviation value according to the matching value and the preset matching value threshold;
    若所述至少一个位置中存在处于第一位置区域的目标位置,且所述目标位置对应的目标测试点的振动数据满足以下至少一项,确定减震策略为止震板策略:所述振动幅度偏差值大于第一预设偏差值;所述频率偏差值大于第二预设偏差值;所述频率偏差值大于第三预设偏差值;所述时域波形偏差值大于第四预设偏差值。If there is a target position in the first position area in the at least one position, and the vibration data of the target test point corresponding to the target position meets at least one of the following, determine the shock absorber strategy: the vibration amplitude deviation The value is greater than the first preset deviation value; the frequency deviation value is greater than the second preset deviation value; the frequency deviation value is greater than the third preset deviation value; the time domain waveform deviation value is greater than the fourth preset deviation value.
  8. 一种针对设备的固定螺丝异常的检测装置,其特征在于,应用于振动检测设备,所述装置包括:A device for detecting abnormality of fixing screws of equipment is characterized in that it is applied to vibration detection equipment, and the device includes:
    获取单元,用于获取针对待检测设备上设置于预设部件的固定螺丝的拍摄视频;An acquiring unit, configured to acquire a shooting video for a fixing screw set on a preset component on the device to be tested;
    处理单元,用于根据预设的运动放大算法对所述拍摄视频进行处理,得到放大视频;以及,从所述放大视频中提取针对所述固定螺丝的多个测试点的振动数据;A processing unit, configured to process the shot video according to a preset motion amplification algorithm to obtain an enlarged video; and extract vibration data of a plurality of test points for the fixed screw from the enlarged video;
    确定单元,用于根据所述振动数据确定所述多个测试点中振动数据不满足预设条件的至少一个目标测试点,将所述至少一个目标测试点标记为异常测试点;A determining unit, configured to determine, according to the vibration data, at least one target test point whose vibration data does not meet a preset condition among the plurality of test points, and mark the at least one target test point as an abnormal test point;
    显示单元,用于对所述放大视频中所述至少一个目标测试点对应的目标视频区域进行显示。The display unit is configured to display the target video area corresponding to the at least one target test point in the enlarged video.
  9. 一种振动检测设备,其特征在于,包括处理器、存储器、通信接口,以及一个或多个程序,所述一个或多个程序被存储在所述存储器中,并且被配置由所述处理器执行,所述程序包括用于执行如权利要求1-7任一项所述的方法中的步骤的指令。A vibration detection device, characterized by comprising a processor, a memory, a communication interface, and one or more programs, the one or more programs are stored in the memory and configured to be executed by the processor The program includes instructions for executing the steps in the method according to any one of claims 1-7.
  10. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质用于存储计算机程序,所述计算机程序被处理器执行,以实现如权利要求1-7任一项所述的方法。A computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program, and the computer program is executed by a processor to implement the method according to any one of claims 1-7.
PCT/CN2020/105619 2019-04-26 2020-07-29 Method for detecting anomaly of fixed screw for device, and related products WO2021036663A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201910345991 2019-04-26
CN201910802315.0A CN110595745B (en) 2019-04-26 2019-08-28 Detection method for abnormality of fixing screw of equipment and related product
CN201910802315.0 2019-08-28

Publications (1)

Publication Number Publication Date
WO2021036663A1 true WO2021036663A1 (en) 2021-03-04

Family

ID=68856069

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/105619 WO2021036663A1 (en) 2019-04-26 2020-07-29 Method for detecting anomaly of fixed screw for device, and related products

Country Status (2)

Country Link
CN (1) CN110595745B (en)
WO (1) WO2021036663A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110617965B (en) * 2019-04-26 2021-10-15 深圳市豪视智能科技有限公司 Method for detecting gear set abnormality and related product
CN110595745B (en) * 2019-04-26 2021-05-07 深圳市豪视智能科技有限公司 Detection method for abnormality of fixing screw of equipment and related product
CN112414683B (en) * 2019-12-24 2022-08-02 湖南科技大学 Mean mahalanobis distance-based loose bolt position positioning method and system
CN111445466B (en) * 2020-04-01 2023-05-05 山东浪潮科学研究院有限公司 Bolt anti-leakage screwing detection method, equipment and medium
CN112528854B (en) * 2020-12-12 2023-07-25 南方电网调峰调频发电有限公司 Vibration object monitoring method, device, computer equipment and storage medium
CN112801987B (en) * 2021-02-01 2022-11-08 上海万物新生环保科技集团有限公司 Mobile phone part abnormity detection method and equipment
CN113682342A (en) * 2021-08-25 2021-11-23 深圳市永安环保实业有限公司 Track anomaly detection method and related product
CN114166479A (en) * 2021-10-26 2022-03-11 山东大齐通信电子有限公司 Dynamic detection and fastening device and method for motor bolt
CN117664552B (en) * 2024-01-30 2024-04-16 四川懋润电力科技有限公司 Equipment running state monitoring method, device, system and control equipment

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040223143A1 (en) * 2003-05-06 2004-11-11 Nobuyuki Yasuda Device and method for optically inspecting operating holes formed in heads of screws
JP2010085179A (en) * 2008-09-30 2010-04-15 Yutaka:Kk Side-surface inspecting device
CN103328958A (en) * 2010-11-25 2013-09-25 (株)首尔金属 Parts-supply device and parts-inspection apparatus
CN104122265A (en) * 2013-04-28 2014-10-29 郑州大学 Method and system for checking screw hole thread missing of metal plate
CN107356386A (en) * 2017-06-22 2017-11-17 歌尔股份有限公司 A kind of method that vibratory equipment confirms
CN109520690A (en) * 2018-10-30 2019-03-26 西安交通大学 A kind of rotary machine rotor Mode Shape global measuring device and method based on video
CN110595745A (en) * 2019-04-26 2019-12-20 深圳市豪视智能科技有限公司 Detection method for abnormality of fixing screw of equipment and related product

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104778728A (en) * 2015-05-04 2015-07-15 华北电力大学(保定) Sky image cloud cluster movement velocity computing method based on phase correlation principle
CN105067245B (en) * 2015-08-11 2018-01-12 招商局重庆交通科研设计院有限公司 Bridge vibration frequency measuring method tension member and system
CN107529646B (en) * 2017-05-02 2021-01-26 广东工业大学 Non-contact heart rate measurement method and device based on Euler image amplification
CN108731788B (en) * 2018-05-22 2020-06-09 河海大学常州校区 Visual detection device and method for low-frequency vibration of aerial work arm
CN110836775B (en) * 2019-12-25 2021-07-27 济南大学 Rolling bearing fault identification method and system based on multi-dimensional entropy space distance

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040223143A1 (en) * 2003-05-06 2004-11-11 Nobuyuki Yasuda Device and method for optically inspecting operating holes formed in heads of screws
JP2010085179A (en) * 2008-09-30 2010-04-15 Yutaka:Kk Side-surface inspecting device
CN103328958A (en) * 2010-11-25 2013-09-25 (株)首尔金属 Parts-supply device and parts-inspection apparatus
CN104122265A (en) * 2013-04-28 2014-10-29 郑州大学 Method and system for checking screw hole thread missing of metal plate
CN107356386A (en) * 2017-06-22 2017-11-17 歌尔股份有限公司 A kind of method that vibratory equipment confirms
CN109520690A (en) * 2018-10-30 2019-03-26 西安交通大学 A kind of rotary machine rotor Mode Shape global measuring device and method based on video
CN110595745A (en) * 2019-04-26 2019-12-20 深圳市豪视智能科技有限公司 Detection method for abnormality of fixing screw of equipment and related product

Also Published As

Publication number Publication date
CN110595745B (en) 2021-05-07
CN110595745A (en) 2019-12-20

Similar Documents

Publication Publication Date Title
WO2021036663A1 (en) Method for detecting anomaly of fixed screw for device, and related products
WO2021036631A1 (en) Vibration analysis method based on video, and related product
CN110595749B (en) Method and device for detecting vibration fault of electric fan
WO2021036637A1 (en) Gear set abnormality detection method and related product
WO2021036638A1 (en) Bridge vibration detection method and related apparatus
JP4653235B2 (en) Composition of panoramic images using frame selection
WO2021042906A1 (en) Vibration detection method and related apparatus
US10127635B2 (en) Method and device for image noise estimation and image capture apparatus
WO2021042907A1 (en) Rope vibration measurement method and related apparatus
WO2021052020A1 (en) Vibration testing system
WO2021036640A1 (en) Bearing abnormality detection method and related device
WO2021036672A1 (en) Intelligent vibration augmented reality test method and related product
WO2021036661A1 (en) Filtering method and apparatus, and related product
WO2021036662A1 (en) Signal processing method and device, and related product
WO2021036634A1 (en) Fault detection method and related product
Gu et al. Learning a unified blind image quality metric via on-line and off-line big training instances
CN110595605A (en) Vibration detection system
WO2021052024A1 (en) Washing machine vibration fault detection method and apparatus
JP2011134200A (en) Image evaluation method, image processing method and image processing device
JP2021043874A (en) Image processing apparatus, image processing method, and program
KR20230142636A (en) Directional scaling systems and methods
KR20120015980A (en) Method, system and computer program product for object color correction
Kim et al. On recent results in demosaicing of Samsung 108MP CMOS sensor using deep learning
CN116109962A (en) Vibration frequency measurement method and device based on video phase, electronic equipment and storage medium
JP2019207464A (en) Phase difference detection device, image processing device, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20858095

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20858095

Country of ref document: EP

Kind code of ref document: A1