WO2021215600A1

WO2021215600A1 - Portable ultrasonic visualization device equipped with thermographic camera

Info

Publication number: WO2021215600A1
Application number: PCT/KR2020/014485
Authority: WO
Inventors: 김영기; 김인권; 이광현; 안병호
Original assignee: (주)에스엠인스트루먼트
Priority date: 2020-04-21
Filing date: 2020-10-22
Publication date: 2021-10-28

Abstract

The present invention relates to a facility malfunction diagnosis device using emitted ultrasonic wave detection. More particularly, the present invention relates to a mobile ultrasonic-image facility diagnosis device comprising an electronic means for visualizing emitted ultrasonic waves, the device comprising: an ultrasonic sensor array (10) which comprises multiple (N) ultrasonic sensors (11) and which is configured to detect ultrasonic signals emitted from a facility while aiming at an emitted sound source; a data acquisition board (DAQ board, 20) having an electronic circuit mounted on the substrate thereof to acquire ultrasonic signals (x_n) at a sampling frequency f_s) from ultrasonic signals detected by the ultrasonic sensor array (10); a main board (30) having a computing/processing device (31) mounted on the substrate thereof so as to process ultrasonic signals received from the DAQ board (20), the main board (30) transferring processed ultrasonic sound source information to a display device (70); a data storage medium (40) for storing data processed by the computing/processing device (31) of the main board (30); a display device (70) for visually displaying data processed by the computing/processing device (31) of the main board (30); an optical camera (80) for capturing images in the direction aimed by the ultrasonic sensor array (10) and transferring same to the main board (30); and a thermographic camera (90) for capturing thermal images in the direction aimed by the optical camera (80).

Description

Portable ultrasonic visualization device with thermal imaging camera

The present invention relates to a portable ultrasound visualization device equipped with a thermal imaging camera capable of overlaying an ultrasound image, an optical image, and a thermal image measured through a thermal imaging camera) on a single screen by superimposing 2-3 types. , In addition, instead of analyzing echo-reflected ultrasonic waves by providing ultrasonic waves with a projectile and an ultrasonic receiver, it shows the location of ultrasonic waves that are naturally radiated (not echo signals) from mechanical equipment or gas pipes as image images, and also generates ultrasonic waves. It relates to a portable ultrasound visualization device equipped with a thermal imaging camera used for diagnosing equipment failures by showing a location image and a thermal image on one screen.

Registered Patent 10-1477755: A high voltage panel, a low pressure panel, a distribution panel, and a motor control panel equipped with an ultrasound-based arc and corona discharge monitoring and diagnosis system are based on ultrasound to diagnose the arc or corona discharge state of a housing containing a high voltage panel inside. In the high-pressure panel equipped with the arc and corona discharge monitoring and diagnosis system of ; And, based on the ultrasonic signal detected by the sensor unit, detects arc or corona discharge generated in the facility, and configures an abnormality determination unit for controlling the internal state of the housing according to the detected arc or corona discharge information To provide a high-voltage panel, a low-pressure panel, a distribution panel, and a motor control panel equipped with an ultrasound-based arc and corona discharge monitoring and diagnosis system including a monitoring device.

An object of the present invention is to provide a portable ultrasound equipment failure diagnosis apparatus capable of overlaying an ultrasound image, an optical image, and a thermal image measured by a thermal imager on a single screen by superimposing 2-3 types. Unlike a medical ultrasound diagnostic device that visualizes an internal shape by a reflected wave after an ultrasonic wave is emitted by a conventional ultrasound device, an ultrasonic sound source that is naturally radiated by interaction between components in a pipe leakage, defective power equipment, and broken mechanical equipment (devices) It is to provide a portable ultrasound equipment failure diagnosis device that visualizes the occurrence location image together with a thermal image or an optical image.

In addition, the present invention can implement the sound of the ultrasonic region more efficiently than the vibration sound that can diagnose the initial failure in machinery failure diagnosis, failure prediction, and monitoring, and the ultrasonic sensor, the processing device, the battery, the display device (display), etc. are one It is provided in the body case and enables the user to perform ultrasound visualization while easily moving the measurement point, and to display the result in real time with a thermal image as a visual display device or to recognize it through an auditory display device. to provide the device.

In addition, the present invention optimizes and minimizes the data processing amount (processing step) for radiation ultrasound visualization without losing the location size information of the ultrasound sound source in the ultrasound region where the data processing capacity is inevitably large, thereby providing proper performance and computational processing capability. Provided with a program and electronic means that form an arithmetic processing step so as to be executable by electronic means having a

In order to improve the efficiency of detecting anomalies, the present invention visually shows the thermal images taken with a thermal imaging camera together with the ultrasonic visualization results in real time so that not only the visualization of ultrasound but also the heat dissipation phenomenon can be visualized together with the results of ultrasound visualization, pipe leakage, faulty power equipment and An object of the present invention is to provide a portable ultrasonic visualization device equipped with a thermal imaging camera that increases the accuracy of detecting malfunctions in mechanical equipment (device).

The apparatus for diagnosing a mobile ultrasound imaging facility of the present invention is an apparatus for diagnosing equipment failure using radiated ultrasonic sensing, and includes a plurality of (N) ultrasonic sensors and a sound wave sensor array that senses ultrasonic signals radiated from the equipment while oriented toward the radiated sound source. Wow;

a data acquisition board having an electronic circuit mounted on a substrate for acquiring ultrasonic signals (x _n ) at a sampling frequency (f _{s) of ultrasonic signals detected by the ultrasonic sensor array;}

a main board having an arithmetic processing device for processing the ultrasonic signal received from the data acquisition beam mounted on a substrate, and transmitting the processed ultrasonic sound source information to the display device;

a data storage medium for storing data processed by the arithmetic processing unit of the main board;

a display device for visually displaying the data processed by the arithmetic processing device of the main board; an optical camera that captures an image in a direction in which the sound wave sensor array is directed and delivers it to the main board 30; It characterized in that it comprises a; thermal imaging camera for taking a thermal image (Thermal Image) in the direction the optical camera is directed.

In addition, the portable ultrasound imaging equipment diagnosis apparatus of the present invention further includes a case-built rechargeable battery or an external portable battery for supplying power to the data acquisition board, the main board, and the display device, the sound wave sensor array) and the data acquisition board The main board and data storage medium are mounted and fixed in a hard plastic body case,

The main board expresses at least two or three selected from the ultrasonic sound source information, the optical image in the direction the sensor array imaged by the optical camera is facing, and the thermal image photographed by the thermal imaging camera by matching the position coordinates. It is preferable to display it by overlaying it on the device together.

According to the present invention, an ultrasound image, an optical image, and a portable ultrasound equipment failure diagnosis device capable of overlaying two or three types of thermal images (thermal images, infared images) measured through a thermal imaging camera by superimposing them on one screen is provided

According to the present invention, unlike the medical ultrasonic diagnostic device that visualizes the internal shape by the reflected wave after the ultrasonic wave is emitted by the conventional ultrasonic device, the interaction between the components in the pipe leakage, faulty power equipment, and malfunctioning mechanical equipment (device), etc. Provided is a portable ultrasound equipment failure diagnosis apparatus that visualizes an ultrasound sound source image naturally radiated by a thermal image or an optical image.

In addition, according to the present invention, it is possible to implement the sound of the ultrasonic region more efficiently than the vibration sound that can diagnose the initial failure in the diagnosis of machinery failure or failure prediction and monitoring, and the ultrasonic sensor, processing device, battery, display device (display), etc. A portable ultrasonic wave provided in this single body case that enables the user to perform ultrasound visualization while easily moving the measurement point, and to display the result in real time with a thermal image as a visual display device or to recognize it through an auditory display device A device for diagnosing equipment failure is provided.

In addition, according to the present invention, in the ultrasonic region where the data processing capacity is inevitably large, the data processing amount (processing step) for radiation ultrasound visualization is reduced as much as possible without losing the ultrasonic sound source position size information, so that proper performance and calculation processing are performed. Provided with a program and electronic means that form an arithmetic processing step so as to be executable by electronic means having the capability,

In order to improve the efficiency of detecting anomalies, the thermal images taken with a thermal imaging camera are visually displayed together with the ultrasonic visualization results in real time to visualize the heat dissipation phenomenon as well as the visualization of ultrasonic waves. (Apparatus) A portable ultrasonic visualization apparatus equipped with a thermal imaging camera having increased accuracy of anomaly detection is provided.

1 is a conceptual diagram showing the coordinates of the radiation ultrasound visualization sensor and the virtual plane coordinates of the present invention.

Figure 2 is a conceptual diagram of the time delay summation of the radiation ultrasound visualization of the present invention.

3 is a block diagram of a mobile ultrasound equipment failure diagnosis apparatus according to the present invention.

4 and 5 are explanatory views of the radiation ultrasound visualization process of the present invention.

Figure 6 is a state diagram showing the ultrasonic sound source generated from the side of the laptop and the high and low of the temperature with a color gradient.

Hereinafter, an apparatus for diagnosing a portable equipment failure equipped with an electronic means for radiation ultrasound visualization and a computer program according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings. 1 is a conceptual diagram of the radiation ultrasound visualization sensor coordinates and virtual plane coordinates of the present invention, FIG. 2 is a conceptual diagram of the radiation ultrasound visualization time delay summation of the present invention, and FIG. It is a configuration diagram of the apparatus, and FIGS. 4 and 5 are explanatory diagrams of the radiation ultrasound visualization process of the present invention.

The present invention does not analyze echo-reflected ultrasonic waves by providing ultrasonic waves with a projectile and an ultrasonic receiver, but shows the location of ultrasonic waves that are naturally radiated (not echo signals) from mechanical equipment or gas pipes as image images, and also generates ultrasonic waves. The present invention relates to a portable ultrasound imaging equipment diagnosis apparatus used to diagnose equipment failures by displaying a location image and a thermal image on one screen.

An apparatus for diagnosing a portable equipment failure provided with an electronic means for radiation ultrasound visualization and a computer program according to an embodiment of the present invention includes an ultrasonic sensor array (10, Array), a data acquisition board (DAQ board, 20), and a main board (30). ), a data storage medium 40 , a battery 50 , a plastic body case 60 , a display device 70 , an optical camera 80 , and a thermal imaging camera 90 .

As shown in FIG. 3 , the ultrasonic sensor array 10 ( Array) is composed of a plurality of (N) ultrasonic sensors 11 and senses ultrasonic signals radiated from the facility while directing the radiation sound source. The ultrasonic sensor array 10 may be a type in which a plurality of MEMS microphones, ultrasonic transducers, and ultrasonic sensors are mounted on a flat printed circuit board (PCB) or a curved (three-dimensional) flexible printed circuit board (Flexible PCB).

The data acquisition board (DAQ board, 20) has an electronic circuit for acquiring the _{ultrasonic signals (x n} _{) at a sampling frequency (Sampling Frequency, f s} ) of the ultrasonic signals detected by the ultrasonic sensor array (10, Array) on the board. is mounted The data acquisition board (DAQ board) 20 may be in charge of sampling and may have a built-in signal amplification circuit.

The main board 30 has an arithmetic processing unit 31 that processes digital (or analog) ultrasonic signals received from the data acquisition board (DAQ board, 20) mounted on the board, and displays the processed ultrasonic sound source information ( 70). The data storage medium 40 stores data processed by the arithmetic processing unit 31 of the main board 30 .

The battery 50 supplies power to the data acquisition board 20 and the main board 30 , and it is preferable that it is provided in a removable and rechargeable manner inside the plastic body case 60 , but on the outside of the plastic body case 60 . It may be a separate portable rechargeable battery that is located and supplies power to the data acquisition board 20 and the main board 30 and the display device 70 with wires. Alternatively, both an internal battery and an external auxiliary battery may be provided and used.

The plastic body case 60 is made of a hard material for fixing the ultrasonic sensor array 10 , the data acquisition board 20 , the main board 30 , and the data storage medium 40 .

The plastic body case 60 supports an array 10 composed of a plurality of ultrasonic sensors 11 electrically connected to each other, or an ultrasonic sensor array PCB on a flat or curved plate on which the ultrasonic sensors 11 are mounted. It is preferable to support the ultrasonic sensor array (10, Array) by supporting and fixing the substrate. A hollow chamber is formed inside the plastic body case 60 , and the data acquisition board 20 and the main board 30 having arithmetic processing capability are fixedly installed in the hollow chamber.

The display device 70 visually expresses the data processed by the arithmetic processing device 31 of the main board 30 and is integrally installed in the plastic body case 60 . In addition, the expression device 70 is integrally fixed to the plastic body case 60 so as to be exposed to the outside of the plastic body case 60 .

The optical camera 80 captures an image in a direction in which the ultrasonic sensor array 10 is oriented and transmits it to the main board 30 . As for the lens of the optical camera 80, when the sensor array 10 (Array) has a flat plate shape, the optical lens is exposed toward the direction it is directed. The front of the plastic body case 60 has a hole for exposing the lens of the optical camera 80 .

The thermal imaging camera 90 photographing takes a thermal image in the direction the optical camera 80 is oriented and transmits it to the main board 30 having an arithmetic processing unit. The main board 30 is displayed by overlaying the ultrasonic sound source information and the optical image in the direction in which the sensor array 10 captured by the optical camera 70 is facing on the display device 70 (Over Lay). will do The thermal imaging camera 90 may be replaced by a thermal imaging camera having a different thermal imaging principle. The thermal imaging camera takes an infrared image in the direction the user is pointing, and transmits the high and low temperature to the display device as a color gradient.

<메인 보드 기능> <Main board function>

5 is a flow chart of the radiation ultrasound visualization method of the present invention. 1 to 5 , in the delay distance calculation step S10 , the distances between the sensors 11 and the virtual plane points are calculated using the sensor coordinates and the virtual plane coordinates.

1 is a diagram showing the relationship between sensor coordinates and virtual plane coordinates. _{As shown, the distance d k} between the sensor coordinates (Xs, Ys) and the virtual plane coordinates (Xg, Yg) is calculated as follows. When the distance L is 1 m, ^{the operation of +L 2} is expressed as +1 operation.

Next, in the ultrasonic sensing step (S20), the ultrasonic sensor array (10, Array) consisting of a plurality of (N) ultrasonic sensors 11 and directing the radiation source detects ultrasonic signals.

In the data acquisition step (S30), the data acquisition board (DAQ board, 20) acquires the ultrasonic signals (x _n ) by sampling the ultrasonic signals detected by the ultrasonic sensor array (10, Array) at a sampling frequency (Sampling Frequency, f _{s )} do. A detailed equation for the ultrasound signal (x _{n ) is as follows.}

Here, S: Sample Number. f _s : Sampling Rate (frequency).

After the data acquisition step (S30), the main board 30 having the arithmetic processing unit is _{preset to the ultrasonic signals (x n} ) acquired in the step (S30) in the ultrasonic frequency band (f ₁ to f ₂ ) band A step S40 of applying a band pass filter is performed. In the filtered data x _nf [s], 1 ≤ nf ≤ N.

2 is a conceptual diagram illustrating the time delay summation of radiation ultrasound visualization according to the present invention. In the next sound source value calculation step (S50), _{time delay correction is applied to each of the ultrasound signals (x n} ) using the delay distances of the step (S10), and by summing them, the sound source values of M virtual plane points ( r _nk ) are computed.

First, the number of delayed samples is calculated. The time delay is calculated using the distance between the sensor and the virtual plane and the speed of sound, and the number of delay samples is calculated using the calculated time delay. Details are as follows.

(time delay),

where C _{d is the} time delay coefficient, and c is the speed of sound. N _k is the number of delayed samples.

Next, the sum is performed after compensating for the time delay using the number of delayed samples. At this time, a correction coefficient for each sensor is applied.

Here, 1 ≤ nk ≤ M. M is the number of all elements in the row and column in the imaginary plane coordinates.

Next, a beam power level calculation step (S60) of calculating the beam power levels (z, Beam Power Levels) of the sound source values (r _{nk ) generated in step S40 is performed.}

In the visual expression step (S70), the beam power levels (z) calculated in the step (S50) are overlaid on the display device 70 together with the optical image of the direction in which the sensor array 10 (Array) is facing. ) to express

<센서 어레이, 샘플링 주파수><sensor array, sampling frequency>

As shown in FIG. 3 , the ultrasonic sensor array 10 may be configured in such a way that a plurality of ultrasonic sensors 11 are mounted on a printed circuit board forming a single plane. The ultrasonic sensor array (10, Array) is exposed to the front of the device and positioned so as to face the front (one direction). Alternatively, a plurality of ultrasonic sensors 11 may be arranged at regular intervals on a sphere, a substantially ball-shaped polyhedron, a hemisphere, or a rear open convex curved body. The ultrasonic sensor array 10 may be in a form in which a MEMS microphone, an ultrasonic transducer, or a plurality of ultrasonic sensors are mounted on a flexible printed circuit board (Flexible PCB) on a curved (three-dimensional) surface.

Here, the sampling frequency (Sampling Frequency, f _s ) is in the range of 20KHz (40KHz) to 200KHz, and the lower limit (f ₁ ) and the upper limit (f ₂ ) of the ultrasonic frequency band of the band pass filter are 10 KHz It is preferable that one range exists between (20KHz) and 100KHz.

As a result of the test, it is possible to obtain the ultrasonic sound source location information that is effective and necessary for the detection performance of the currently released ultrasonic sensors in this area and the diagnosis and monitoring of machinery failure, rotating machinery failure, gas pipe gas leak, and power equipment, and also reduces the data throughput in this area appropriately The test results showed that it could be done. If the sampling frequency is too large, more data processing is required, and if the sampling frequency is too small, the ultrasonic sound source information is lost.

<밴드 패스, 헤테로 가청 변환><Band pass, hetero-audible conversion>

It is preferable that the apparatus for diagnosing a portable equipment failure provided with an electronic means for visualizing radiation ultrasound and a computer program according to an embodiment of the present invention further includes an audio output means (80, speaker) for listening. Here, the main board 30 converts _{some or all of the generated sound source values (r nk} ) by heterodyne conversion to convert an audible sound signal of a sound wave band (100Hz to 20KHz), and the main board 30 transmits the audible sound signal to the audio output means 90 for listening, so that the user can perceive the radiated ultrasound by hearing.

In addition, the portable ultrasound imaging equipment diagnosis apparatus includes an input window for a user interface electrically and electronically connected to the main board 30 so as to be exposed to the plastic body case 60, and includes a band pass filter. It is preferable that the lower limit (f ₁ ) and the upper limit (f ₂ ) of the ultrasonic frequency band of can be input by the user through an input window for a user interface. That is, before the ultrasonic sensing step ( S20 ), the step of inputting the lower limit ( f ₁ ) and the upper limit ( f ₂ ) of the ultrasonic frequency band of the band pass filter through the input window is performed. It may be entered through a user input window or a method may be performed in which the user selects from among a plurality of ranges previously input by the designer.

6 is a state diagram showing the ultrasonic sound source generated from the side of the notebook computer and the high and low temperature in a color gradient. In the case where the noise is severe and the temperature is high at the point of occurrence of the anomaly, the detection of the anomaly can be more perfect, and it was found that it is more effective than when only the noise visualization was applied to the detection of the anomaly.

Although the present invention has been described in relation to the above-mentioned preferred embodiments, the scope of the present invention is not limited to these embodiments, and the scope of the present invention is defined by the following claims and is equivalent to the present invention various modifications and variations pertaining to

The reference numerals described in the claims below are merely intended to aid the understanding of the invention and do not affect the interpretation of the scope of rights.

Claims

In the equipment failure diagnosis apparatus using radiation ultrasonic detection,

a sound wave sensor array (10, Array) comprising a plurality of (N) ultrasonic sensors 11 and sensing ultrasonic signals radiated from the facility while oriented toward the radiated sound source;

A data acquisition board (DAQ board, 20) on which an electronic circuit for acquiring ultrasonic signals (x n ) for ultrasonic signals detected by the ultrasonic sensor array (10, Array) at a sampling frequency (Sampling Frequency, f s) is mounted on a substrate )Wow;

The data acquisition board (DAQ board, 20), the arithmetic processing device 31 for processing the ultrasonic signal received from the board is mounted on the main board 30, which transmits the processed ultrasonic sound source information to the display device (70) Wow;

a data storage medium 40 for storing data processed by the arithmetic processing unit 31 of the main board 30;

a display device 70 for visually displaying the data processed by the arithmetic processing device 31 of the main board 30;

an optical camera 80 that captures an image in the direction the sound wave sensor array 10 is directed and delivers to the main board 30;

Thermal imaging camera 90 for taking a thermal image in the direction the optical camera 80 is directed,

A portable ultrasound visualization device equipped with a thermal imaging camera, characterized in that it comprises a.
According to claim 1,

Further comprising a case-built rechargeable battery 110 or an external portable battery for supplying power to the data acquisition board 20 and the main board 30 and the display device 70,

The sound wave sensor array (10, Array), the data acquisition board 20, the main board 30, and the data storage medium 40 are mounted and fixed to the hard plastic body case 60,

The main board 30 includes ultrasonic sound source information, an optical image in a direction in which the sensor array 10 captured by the optical camera 70 is facing, and a thermal image captured by the thermal imaging camera 90 . A portable ultrasound visualization device equipped with a thermal imaging camera, characterized in that at least two or three selected from among the position coordinates are matched and overlaid together on the display device 70 to display.
According to claim 1,

The main board 30,

Calculating the delay distance for calculating the distances between the sensors 11 and the virtual plane point using the sensor coordinates and the virtual plane coordinates,

Using the delay distances, time delay correction is applied to each of the ultrasound signals (x n ) and summed to generate sound source values (r nk ) of virtual plane points,

Generated by calculating the beam power levels (z, Beam Power Levels) of the generated sound source values (r nk ),

A portable ultrasound visualization device equipped with a thermal imaging camera, characterized in that it embeds and executes a computer program.
4. The method of claim 3,

The main board 30,

A thermal imaging camera characterized in that the beam power level (z) is visually expressed by overlaying the beam power level (z) on the display device 70 together with the optical image in the direction the sensor array (10, Array) is facing. A portable ultrasound visualization device.
4. The method of claim 3,

The main board 30,

A band pass filter of a preset ultrasonic frequency band (f 1 ~ f 2 ) is applied to the ultrasonic signals (x n) acquired during data acquisition,

A portable ultrasound visualization apparatus equipped with a thermal imaging camera, characterized in that the sound source value (r nk ) is calculated using the signal to which the band pass filter is applied.
According to claim 1,

The ultrasonic sensor array (10, Array) is positioned so that a plurality of ultrasonic sensors 11 on one plane to face forward, or

A portable ultrasound visualization device equipped with a thermal imaging camera, characterized in that a plurality of ultrasound sensors 11 are arranged at regular intervals on a sphere.
6. The method of claim 5,

The sampling frequency (Sampling Frequency, f s ) is in the range of 20KHz ~ 200KHz,

The lower limit (f 1 ) and the upper limit (f 2 ) of the ultrasonic frequency band of the band pass filter are portable ultrasonic waves equipped with a thermal imaging camera, characterized in that one range exists between 10KHz and 100KHz. visualization device.
4. The method of claim 3,

It is configured to further include an audio output means (90, speaker) for listening,

The main board 30,

Some or all of the generated sound source values (r nk ) are heterodyne-converted to convert an audible sound signal of a sound wave band (100Hz ~ 20KHz),

The main board 30 transmits the audible sound signal to the audio output means 110 for hearing, so that the user can perceive the radiated ultrasound by hearing. .
6. The method of claim 5,

Portable ultrasound equipped with a thermal imaging camera, characterized in that it further comprises an input window for a user interface in which the lower limit (f 1 ) and the upper limit (f 2 ) of the ultrasonic frequency band of the band pass filter are input visualization device.