CN110631708B

CN110631708B - Analysis configuration device and analysis configuration method

Info

Publication number: CN110631708B
Application number: CN201910546016.5A
Authority: CN
Inventors: 王浩
Original assignee: Hangzhou Alpha Infrared Detection Technology Co ltd
Current assignee: Hangzhou Alpha Infrared Detection Technology Co ltd
Priority date: 2018-06-22
Filing date: 2019-06-23
Publication date: 2022-05-17
Anticipated expiration: 2039-06-23
Also published as: CN110631708A

Abstract

The analysis configuration device comprises an acquisition part, a processing part and a display part, wherein the acquisition part is used for acquiring thermal image data (one or more); the analysis part is used for analyzing the acquired thermal image data based on the set analysis area; and a display control unit for displaying the analysis data at a position where the analysis regions can correspond to each other, wherein the analysis results in the analysis regions can be displayed without overlapping or overflowing. Thereby, the observation is facilitated.

Description

Analysis configuration device and analysis configuration method

Technical Field

The invention discloses an analysis configuration device and an analysis configuration method, and relates to the application fields of thermal image devices, thermal image processing devices and infrared thermal image detection.

Background

When the infrared thermal image is analyzed, the thermal image analysis result is calculated according to the analysis area arranged on the thermal image of the measured body and the specified analysis mode, and a user judges the state of the measured body by observing the thermal image, the analysis area and the analysis result of the measured body. The analysis area corresponds to a part to be analyzed in the infrared thermal image, such as a point, a line, a surface and other area units or a combination of a plurality of area units; the analysis mode represents an analysis calculation rule adopted for obtaining an analysis result by performing a specified analysis based on the thermal image data determined by the analysis area, such as calculating a maximum temperature, an average temperature, a minimum temperature, and the like, and may further include a calculation relationship between each area unit, such as a temperature difference, and the like; the analysis result may be, for example, an analysis value, or may further include a diagnosis result.

As shown in the prior art analysis area setting and displaying manner shown in FIGS. 3 and 4, S01-S03 represent the analysis sites in the thermal image of the tested object; obviously, the thermal image of the measured object, the displayed shooting parameters, the analysis result, the color code and the like may have certain shielding or overlapping, and the observation and the judgment of the thermal image by a user are influenced; when the user needs to avoid such a situation, the analysis area needs to be moved, and even then, it is not effective and the operation work is cumbersome.

Accordingly, it is appreciated that there is a need for a thermographic analytical configuration device that assists a user in viewing a desired analysis area and analysis results.

Disclosure of Invention

In view of the drawbacks of the prior art, the present invention provides an analysis configuration apparatus and an analysis configuration method, which determine the display state, such as position, size, angle, etc., of an analysis area and/or an analysis result according to the position of the analysis area, the position of the analysis result, and necessary information displayed on a screen. Therefore, the user can observe conveniently.

Therefore, the invention adopts the following technical scheme that the analysis configuration device comprises:

an acquisition section for acquiring thermal image data(s);

the analysis part is used for analyzing the acquired thermal image data based on the set analysis area;

and a display control unit for displaying the analysis results at positions where the analysis regions can correspond to each other, wherein the analysis results in the analysis regions can be displayed without overlapping or overflowing.

The analysis configuration method comprises the following steps:

an acquisition step, for acquiring thermal image data;

an analysis step of analyzing the acquired thermal image data based on the set analysis area;

and a display control step of displaying the analysis results at positions where the analysis regions may correspond, wherein the analysis results of the analysis regions may be displayed without overlapping or overflowing with each other.

Other aspects and advantages of the invention will become apparent from the following description.

Description of the drawings:

fig. 1 is a block diagram of an electrical structure of a thermal image device of an embodiment.

Fig. 2 is an external view of the portable thermal imaging device of embodiment 1.

Fig. 3-4 are schematic diagrams showing the results of prior art analyses.

FIG. 5 is an exemplary diagram representing an analysis result display area;

FIG. 6 is a display example representing the analysis result of example 1;

FIG. 7 is a flow chart representing example 1;

FIG. 8 is a schematic diagram representing an analysis result display location and size strategy;

fig. 9 is a schematic diagram of an example of the problem solved by embodiment 2.

FIG. 10 is a display example representing the analysis result of example 2;

FIG. 11 is a display example representing a reference image;

FIG. 12 is a display example representing embodiment 3;

FIG. 13 is another display example representing embodiment 3.

Detailed Description

Embodiments of the present invention are explained with reference to the drawings. Note that the examples to be described below are for better understanding of the present invention without limiting the scope of the present invention, and may be changed in various forms within the scope of the present invention. Embodiment 1 uses a portable thermal imaging device 13 as an example of an analysis configuration device, and can also be applied to various software for designing infrared processing, analysis, and report generation.

The structure of the thermal image device 13 of embodiment 1 is explained with reference to fig. 1. Fig. 1 is a block diagram of an electrical structure of the thermal image device 13 of the embodiment.

The thermal image device 13 is provided with a shooting part 1, an image processing part 2, a display control part 3, a display part 4, a communication I/F5, a temporary storage part 6, a memory card I/F7, a memory card 8, a flash memory 9, a control part 10 and an operation part 11, wherein the control part 10 is connected with the corresponding parts through a control and data bus 12 and is responsible for the overall control of the thermal image device 13. The control unit 10 is realized by, for example, a CPU, an MPU, an SOC, a programmable FPGA, or the like.

The imaging unit 1 is configured by an optical component, a lens driving component, an infrared detector, a signal preprocessing circuit, and the like, which are not shown. The optical component is composed of an infrared optical lens for focusing the received infrared radiation to the infrared detector. The lens driving part drives the lens to perform focusing or zooming operation according to a control signal of the control part 10. Furthermore, it may be an optical component that is manually adjusted. An infrared detector, such as a refrigeration or non-refrigeration type infrared focal plane detector, converts infrared radiation passing through the optical components into electrical signals. The signal preprocessing circuit includes a sampling circuit, an AD conversion circuit, a timing trigger circuit, and the like, performs signal processing such as sampling on an electrical signal output from the infrared detector in a predetermined period, and converts the electrical signal into digital thermal image data, such as 14-bit or 16-bit binary data (also referred to as an AD value), through the AD conversion circuit.

The image processing unit 2 performs predetermined processing on the thermal image data obtained by the image pickup unit 1, and the image processing unit 2 performs processing for converting the thermal image data into data suitable for display, recording, and the like, such as correction, interpolation, pseudo color, synthesis, compression, decompression, and the like. The image processing unit 2 may be implemented by, for example, a DSP, another microprocessor, a programmable FPGA, or the like, or may be integrated with the control unit 10.

The display control unit 3 performs display of the image data for display stored in the temporary storage unit 6 on the display unit 4 under the control of the control unit 10.

The display section 4 is an example of a display section. The display may also be another display connected to the thermal image system 13, whereas the thermal image system 13 may have no display in its own electrical structure.

The communication I/F5 is an interface for connecting the thermal image device 13 to an external device and exchanging data according to communication specifications such as USB, 1394, and network, and examples of the external device include a personal computer, a server, a PDA (personal digital assistant), another thermal image device, a visible light camera, and a storage device.

The temporary storage unit 6 is a volatile memory such as a RAM or a DRAM, and functions as a buffer memory for temporarily storing thermal image data output from the imaging unit 1, and also functions as a work memory for the image processing unit 2 and the control unit 10, and temporarily stores data processed by the image processing unit 2 and the control unit 10.

The memory card I/F7 is connected to the memory card I/F7 as an interface of the memory card 8, as a rewritable nonvolatile memory, and is detachably mounted in a card slot of the thermal image device 13 main body, and records data such as thermal image data under the control of the control unit 10.

The flash memory 9 stores a program for control and various data used for control of each part.

The operation unit 11: the control unit 10 executes a program in response to an operation signal from the operation unit 11, for the user to perform various instruction operations or various operations such as inputting setting information. The operation unit 11 includes keys, a touch panel, and the like for user operations.

The overall operation of the thermal image system 13 is controlled by the control unit 10, and a program for control and various data used for controlling each part are stored in a storage medium such as the flash memory 9.

The control procedure of embodiment 1 is explained with reference to the flowchart of fig. 8.

And step A01, shooting to obtain thermal image data, and entering step A02.

Step a02, the control unit 10 performs analysis processing; analyzing according to the configured analysis region S01\ analysis region S02\ analysis region S03 to obtain analysis results

Step A03, determining the display position, size and angle of the analysis result corresponding to each analysis area;

in particular, in one example, as explained with reference to FIGS. 5-7,

firstly, the presentation range of the analysis result in the infrared image can be determined; the presentation range may represent a display range in which the analysis result is displayed in the infrared image.

Preferably, the range should generally avoid the occlusion or overlap of other presentation information in the displayed image, such as screen information of shooting parameters, color codes, screen touch keys, etc., or other picture information except the analysis result in the infrared image, to determine the presentation range; as shown in fig. 5, the determined presentation range is the area represented by F01;

in other examples, the presentation area may exclude an area included in the analysis area. Lines and surrounding areas of the analysis area of the type of a point, line, circle, polygon, frame, etc., are preferably not overlapped with the analysis results; avoiding the influence on the analysis result and the observation of the local infrared image in the analysis area;

then, the position of the analysis result, or the size, the inclination angle and the like can be configured according to the presentation strategy of the analysis result relative to the analysis area;

presentation policies are explained with reference to the example of FIG. 6; fig. 6 represents the presentation strategy of the analysis result positions of a single analysis area, that is, the positions in which the presentation conditions are satisfied are selected according to the order of 1-8 positions to present the analysis results corresponding to the analysis area. And on the premise that other analysis results are not overlapped or an analysis area is also included, whether the analysis result can be placed or not is the presentation condition, if the position 1 is not the case, the position 2 is judged until the condition is found. In other examples, the analysis results may also be configured according to the presentation range in which the analysis regions are adjacent, for example, according to a clockwise order. The presentation policy may be preset according to the application.

The analysis results of the analysis regions may be arranged according to the order of their presentation policies; in fig. 6, the boxes are taken as examples, and points, lines, circles and polygons can be configured with similar presentation strategies;

in other examples, in combination with the order policy of the presentation positions, a policy of a certain range of sizes of the analysis result, such as text size scaling, tilt angle, transparency, color, etc., may be configured; the presentation effect can be determined according to the attention degree of the pre-configured and analyzed result.

Referring to fig. 7, the analysis results of the analysis regions overlap with each other at position 1, and therefore, the color patches are displayed at position 2 in fig. 6, and the display is clear and does not overlap with each other.

When there are a plurality of analysis regions in the infrared image, it is preferable that the presentation strategy further combines the order of the analysis regions, i.e., the processing order of the analysis regions in which the analysis results are to be arranged and the arrangement order of the analysis results; if the positions of the analysis results corresponding to the analysis regions can be respectively determined according to the sequence of the analysis regions, such as the numbering sequence; such as first determining S01, then S02, then S03.

If the analysis result position of the analysis area determined after the occurrence conflicts with the occurrence position determined before, such as overlapping, the configuration position of the analysis result needs to be determined again until all conflicts are not formed. For example, if the positions of the analysis results determined after occurrence, such as S03, overlap the analysis results of the first 2, the positions of the analysis results of S01 and S02 are changed in the strategic order to see if the effect of avoiding occlusion or overlap is satisfied. Preferably, one or more of the character size, line feed, and arrangement angle of the analysis result can be changed to see whether the non-overlapping effect can be achieved; if not, a prompt can be popped up to ask the user to adjust the position, the type and the like of the analysis area; preferably, the user is prompted to change the analysis area, e.g. to flash the analysis area, based on the presentation strategy.

Step A04, presenting the analysis results, as shown in FIG. 7.

As described above, in example 1, the analysis area and the analysis result were displayed in the infrared thermography. The analysis results are displayed according to the presentation strategy, so that the condition that the analysis results are mutually overlapped can be reduced, and the observation of a user is facilitated.

For the thermal image data obtained subsequently, or the analysis area is changed, or the composition of the analysis result is changed, corresponding presentation processing may be performed, for example, steps a02-a04 are repeated, so as to achieve the purpose of facilitating observation.

Example 2

Referring to fig. 9, for the presentation strategy in embodiment 1, there may be some shielding or overlapping of the thermal images of the object to be measured, and in some application occasions, the user may want to reduce the shielding or overlapping of the thermal images of the object to be measured as much as possible;

the shielding or overlapping of the thermal images of the measured body can be reduced or avoided according to the determination of the position area of the thermal images of the measured body; there may be many embodiments;

in one example, the relative position relationship between the analysis area and the analysis result is associated with the measured object information in advance and stored in the storage medium, and since the analysis area can represent a part to be analyzed of a specific measured object thermal image, the measured object thermal image can not be shielded if the relative distance between the analysis result and the analysis area is ensured. Therefore, when the device is used, the display position of the analysis result is positioned outside the thermal image of the measured body. As shown in fig. 10, the analysis area S01\ S02\ S03 and the analysis result thereof, the corresponding presentation position includes a relative position relationship, which is associated with the information of the object to be measured in advance, after the information of the object to be measured is selected, the analysis area and the analysis result thereof can be displayed in the image, and when the analysis area corresponds to the analysis portion of the thermal image of the object to be measured, the analysis result of the analysis area can be displayed according to the predetermined presentation position without shielding the thermal image of the object to be measured.

In yet another example, a reference image of the subject, such as a contour map, is configured as a reference for capturing, and based on the area of the reference image, an area of the thermal image of the subject may be represented as an area where the analysis result shows position avoidance; the reference image is, for example, the contour image in fig. 11.

In another example, the thermal images of the measured object are identified, for example, areas of the specific thermal image of the measured object, such as the position, the size and the inclination angle, in the infrared image are identified according to template matching, and the areas are used as the areas where the thermal images of the measured object are located and the areas where the positions are avoided are presented as the analysis results.

For the thermal image data which is continuously acquired subsequently, or the composition of the shot picture, or the information of the selected measured object is changed, or the analysis area is changed, or the composition of the analysis result is changed, the corresponding presentation processing can be carried out, so as to achieve the purpose of convenient observation.

Example 3

Referring to fig. 12, when the detected objects are dense, the common analysis area and the presentation technique of the analysis result thereof may cause great trouble to the user; even if the strategy presented in embodiment 1 is adopted, the analysis frame and the corresponding analysis result may not be easily distinguished;

preferably, at least one analysis area and the corresponding analysis result have identification capable of identifying corresponding relationship.

As shown in fig. 12, the analysis blocks S01 and S02 are marked with arrows between the corresponding analysis results, which is easy for the user to observe. The arrangement of the corresponding marks such as the arrows can be positioned flush with the characters of the analysis result, and the marks can be correspondingly arranged up, down, left and right according to the up, down, left and right arrangement of the analysis result.

As shown in fig. 13, the analysis blocks S01 and S02 are marked with a lead line between the analysis results corresponding thereto, which is easy for the user to observe.

For the thermal image data which is continuously acquired subsequently, or the analysis area is changed, or the composition of the analysis result is changed, corresponding presentation processing can be performed, for example, according to the change of the position, the content and the like of the analysis result, the change of the direction, the arrangement and the like of the arrow, so as to achieve the purpose of convenient observation.

Other embodiments

The

above embodiments

1, 2, and 3 can be combined with each other, so that the analysis area and the corresponding analysis result have a corresponding mark such as an arrow mark; according to the configured presentation area and the presentation strategy, the analysis result is not shielded from other presentation information in the image; determining according to the position area of the thermal image of the specific measured object, so as to achieve the effect that the analysis result does not shield the thermal image of the specific measured object; one or more of the above effects may be simultaneously achieved.

Moreover, the processing sequence in the above embodiments is not limited to the processing, and may have various sequences, and even some processing steps may be parallel; many different combinations are possible.

The analysis area related to the analysis configuration and the presentation processing of the analysis result thereof can be used for processing an infrared picture; the method can also be used for processing the infrared pictures formed by splicing multiple frames of infrared pictures; the presentation follow-up processing of the analysis result may also be performed when the position of the analysis region is changed; the method can also be used for processing the content of the analysis result; the method can also be used for processing dynamic infrared images, frames in the dynamic infrared images can be processed according to a specified frame frequency and presented, and the effect of position follow-up of an analysis result can be presented; so as to achieve the purpose of convenient observation.

In the above embodiments, the portable thermal image capturing device is taken as an example, but the present invention can also be widely applied to various applications for receiving and displaying thermal image pictures and thermal image videos, and as an example of an analysis configuration device, the present invention can also be applied to various portable terminals, such as a mobile phone, a notebook computer, a PAD, a dedicated computer, a server, and the like; the method is used for processing various pictures, such as thermal image pictures, visible light, ultraviolet images and the like.

In addition, the processing and control functions of some or all of the components in embodiments of the present invention may also be implemented using dedicated circuits or general purpose processors or programmable FPGAs.

In addition, in the embodiment, the application of the detected object in the power industry is taken as an example of a scene, and the method is also suitable for being widely applied to various industries of infrared detection.

The foregoing describes only embodiments of the invention and is presented by way of illustration rather than limitation, and further modifications and variations of the embodiments may be made by persons skilled in the art in light of the foregoing description without departing from the spirit or scope of the invention.

Claims

1. An analytical configuration device, comprising,

the acquisition part is used for acquiring thermal image data;

an arrangement unit for arranging the analysis result corresponding to the analysis region at a position corresponding to the analysis region; the configuration part is used for setting the presentation range of the analysis result in the infrared thermal image and configuring the position of the analysis result of the analysis area according to the presentation strategy, or further comprises one of the size, the inclination angle, the transparency and the color of the analysis result;

the presentation range is configured to be one or more of the following cases:

1) avoiding occlusion or overlap of other presentation information in the display image;

2) avoiding the occlusion or overlap of the area ranges contained in the analysis area;

3) reducing or avoiding the shielding or overlapping of the thermal images of the measured body;

the presentation policy comprises the following policy combinations;

1) presentation strategies of analysis result positions of the analysis areas, including the order of the analysis result positions, to select the positions satisfying the presentation conditions to present the analysis results corresponding to the analysis areas; the presentation condition is that the analysis result can be placed on the premise that other analysis results are not overlapped or the analysis region is not overlapped;

2) configuring the analysis results according to a specific order according to the adjacent presentation ranges of the analysis areas;

when there are multiple analysis regions, the presentation strategy also combines the order of the analysis regions, and the order of the configuration of the analysis results; and respectively determining the position of the analysis result corresponding to each analysis area.

2. Analytical configuration device according to claim 1,

the configuration part adopts corresponding arrow marks between at least one analysis area and the analysis result thereof, and/or leads marks.

3. Analytical configuration device according to claim 1 or 2,

the arrangement part is used for preventing the analysis results of the analysis areas from overlapping or overflowing;

the presentation policy further comprises one of the following policies:

1) arranging the analysis results of the analysis regions according to the order of the presentation strategies of the analysis regions;

2) configuring a certain range of sizes of the analysis results in combination with a sequence strategy of the presentation positions;

when the analysis result position of the analysis area determined after the occurrence conflicts with the occurrence position determined before, the configuration position of the analysis result needs to be determined again until all conflicts are not formed; the presentation strategy comprises at least 1 order, which is the 1 order in which the analysis regions or analysis results are relevant.

4. Analytical configuration device according to claim 1 or 2,

the analysis part is used for analyzing the acquired thermal image data based on the set analysis area to obtain an analysis result;

when the analysis result position of the analysis area determined after the occurrence conflicts with the occurrence position determined before, the configuration part prompts the user of the analysis area needing to be changed according to the presentation strategy; the presentation follow-up processing of the analysis result is performed when the position of the analysis area is changed.

5. The analytical configuration device according to claim 1 or 2, wherein the analytical configuration device is a portable thermographic camera.

6. Analytical configuration device according to claim 1 or 2,

the configuration part is used for configuring the presentation range by determining the thermal image position area of the measured body; adopting one or the combination of the following modes:

1) the relative position relation between the analysis area and the analysis result is associated with the information of the measured object in advance, when the information of the measured object is selected, the relative distance between the analysis result and the analysis area is ensured, and the thermal image of the measured object is not shielded; when the analysis area corresponds to an analysis part of the thermal image of the measured body, the analysis result of the analysis area is displayed according to a preset presentation position, and the thermal image of the measured body cannot be shielded;

2) the area for identifying the thermal image of the measured body is used as the area where the thermal image of the measured body is located and is used as the area for presenting the position avoidance of the analysis result;

3) and taking the reference image as a shooting reference, and representing the area of the thermal image of the detected body according to the area of the reference image to be used as an area for avoiding the display position of the analysis result.

7. The analysis configuration method comprises the steps of,

an acquisition step, for acquiring thermal image data;

a configuration step, which is used for configuring the analysis result corresponding to the analysis area at the position corresponding to the analysis area; the configuration step is used for setting a presentation range of the analysis result in the infrared thermal image, and configuring the position of the analysis result in the analysis area according to a presentation strategy, or further comprising one of the size, the inclination angle, the transparency and the color of the analysis result;

the presentation range is configured to be one or more of the following cases:

the presentation policy comprises the following policy combinations;

8. The analytical configuration method of claim 7, wherein the configuration step identifies at least one analytical zone and its analytical result by corresponding arrows and/or leads;

the presentation policy further comprises one of the following policies:

when the analysis result position of the analysis area determined after the occurrence conflicts with the occurrence position determined before, the configuration position of the analysis result needs to be determined again until all conflicts are not formed;

the presentation strategy comprises at least 1 order, which is the 1 order in which the analysis regions or analysis results are relevant.

9. The analysis configuration method according to claim 7 or 8, characterized in that the configuration step is to make the analysis results of the analysis areas not overlap or overflow with each other and/or with other presentation information in the display image.