CN104751445A - Thermal image analysis configuration device and thermal image analysis configuration method - Google Patents

Abstract

The invention discloses a thermal image analysis configuration device and a thermal image analysis configuration method, and relates to the application field of thermal image analysis. The thermal image device in the prior art is very troublesome to operate and difficult to realize when subjective experience of a user is required in shooting to design analysis region and the like of a shot body thermal image. According to the thermal image analysis configuration device, when the special shot body thermal image is detected, the analysis area and the corresponding analysis mode as well as the diagnosis rule are automatically set to obtain the diagnosis results, so that the shooting operation is simple, the precision of the diagnosis data is improved; the user further can be noticed to facilitate processing or operations of diagnosis, storage and the like.

Description

Thermography analysis inking device and thermography analysis collocation method

Technical field

Thermography analysis inking device of the present invention and thermography analysis collocation method, relate to the various thermal image device of hand-held shooting or online shooting, receive and process the thermal imagery treatment facility of thermal imagery, and the application of IR thermal imaging inspection.

Background technology

When thermography analysis, if for acquisition is to the analysis data of subject thermal imagery and diagnostic result, at present, need manually to arrange analyzed area, analytical model, diagnostic rule to thermal-image data frame, the combination in one or more regions such as analyzed area such as point, line, surface, the position of corresponding subject thermal imagery Water demand; Analytical model, the analytical calculation rule that such as analyzed area is corresponding, as calculated maximum temperature, medial temperature, minimum temperature, degree etc., and the calculated relationship that also can comprise between analyzed area is as the temperature difference etc.; Diagnostic rule, such as, with analyzed area and analytical model, corresponding comparison and threshold value etc.

The setting of analyzed area, analytical model, diagnostic rule, when by manually completing, operates very loaded down with trivial details; Current operation steps is generally the composition data in first selection analysis region, such as point, line, surface; Then, analyzed area is arranged in infrared thermal imagery, and adjusts the location parameter that analyzed area is arranged in infrared thermal imagery; During as arranged multiple analyzed area, by setting operation repeatedly.Then, according to the numbering of analyzed area, input analytical model; Then according to analytical model, carry out layout diagnostic rule.

Manually arrange the operation of analyzed area, analytical model, diagnostic rule, technical requirement is very high; Because for subject thermal imagery, the analytical model, diagnostic rule etc. of position corresponding to analyzed area, application have very strict requirement, need user to have subject thermography analysis very strong professional; Such as, in power industry, according to the regulation of power industry specification, various subject such as switch, lightning arrester, cable termination etc. all have the position of particular analysis and specific analytical model, diagnostic rule, for the analysis of cable termination, wherein need the predetermined portion of the upper and lower to its body sleeve, analyzed area is set, then, respective maximum temperature and the temperature difference is each other calculated; If analyzed area is not accurately arranged on above-mentioned position, or analytical model arranges unreasonable, then cannot obtain correct analysis data.And diagnostic rule is set, then need the diagnosis basis etc. of user to subject to be proficient in very much, require very high.And the subject kind of infrared detection that needs that power industry relates to reaches tens kinds, divide according to different electric pressures, thousands of types may be reached, technical difficulty wherein can be thought.

And, in application deep further, the sizes of analyzed area etc. also have strict requirement, because the analyzed area of different size, even if be arranged on identical position, its analysis result also may be different, what such as arrange is too little, likely miss crucial position scope, as too large in what arrange, then likely cause easily being disturbed factor impact.

In more deep application, also to the numbering of analyzed area, there is the requirement of specification, otherwise the same area of similar subject, if the analyzed area being provided with different numbering, even if respective analytical model, diagnostic rule are correct, follow-up being still difficult to carries out contrast each other.

And for the subject thermal imagery that very eurypalynous subject shooting obtains, as meticulous analysis result will be pursued, need to arrange more analyzed area and more complicated analytical model, diagnostic rule, at this moment, operate very loaded down with trivial details fallibility.

In addition, even if sophisticated user, the thermal imagery due to shooting might not meet the requirement analyzed, and at this moment, even if carried out careful setting, also may not necessarily obtain satisfied analysis result.At present, for a lot of user, because setting operation during shooting is too loaded down with trivial details and technical too by force, therefore the shooting work of thermal imagery and analyzed area, analytical model, the follow-up of diagnostic rule arrange work, are often completed by different personnel, also exacerbate this situation.

To sum up, prior art needs manually to arrange analyzed area corresponding to subject thermal imagery, analytical model, diagnostic rule, needs to rely on the subjective experience of user, and it is large etc. that its drawback can be summarized as complex operation, technical difficulty.

Therefore, understand need a kind of thermography analysis inking device, it can reach without the need to depending on the subjective idea of user unduly, can arrange easily analyzed area, analytical model, diagnostic rule one of them or multiple, solve the part or all of problem of prior art problem.

Summary of the invention

The invention provides a kind of thermography analysis inking device and thermography analysis collocation method, jointly show with reference to image and the infrared thermal imagery obtained, the vision reference of user using this reference picture as shooting subject thermal imagery, carry out the shooting of subject, when obtain thermal-image data frame in detect specific shot body heat as time, can one or more automatically in Allocation Analysis region, analytical model, diagnostic rule, be convenient to follow-up analysis; Thus, require to reduce to the technique for taking of user.

For this reason, by the following technical solutions, thermography analysis inking device, has in the present invention,

Acquisition unit, for obtaining thermal-image data frame;

Display control unit, for controlling the infrared thermal imagery making display obtain based on obtained thermal-image data frame, and reference picture;

Test section, for based on the thermal-image data frame obtained, detects the provisioning information relevant with specific shot body heat picture;

Analysis configuration portion, for detecting the provisioning information obtained according to test section, configurable one or more as follows: the composition data of analyzed area, the location parameter of analyzed area, analytical model, diagnostic rule.

Thermography analysis collocation method of the present invention, has

Obtaining step, for obtaining thermal-image data frame;

Display and control step, for controlling the infrared thermal imagery making display obtain based on obtained thermal-image data frame, and reference picture;

Detecting step, for based on the thermal-image data frame obtained, detects the provisioning information relevant with specific shot body heat picture;

Analysis configuration step, for detecting the provisioning information obtained according to detecting step, configurable one or more as follows: the composition data of analyzed area, the location parameter of analyzed area, analytical model, diagnostic rule.

Other aspects of the present invention and advantage are set forth by instructions below.

Accompanying drawing illustrates:

Fig. 1 is the block diagram of the schematic configuration of the thermal image device 100 of the example of the thermography analysis inking device representing embodiments of the invention 1.

Fig. 2 is the external form figure of the thermal image device 100 of embodiment 1.

Fig. 3 is the schematic diagram of the subject information, reference picture, subject identifying information, analyzed area, analytical model, diagnostic rule etc. stored in embodiment 1 storage medium.

Fig. 4 is the control flow chart representing embodiment 1.

Fig. 5 is the indication example of the display interface of the processing procedure of embodiment 1.

Fig. 6 is the example representing that analyzed area is arranged.

Fig. 7 is the control flow chart representing embodiment 2.

Fig. 8 is the indication example of the display interface of the processing procedure of embodiment 2.

Fig. 9 is the control flow chart representing embodiment 3.

Figure 10 is the indication example of the display interface of the processing procedure of embodiment 3.

Figure 11 is the schematic diagram that multiple detection window detects.

Figure 12 is the schematic diagram of detection window.

Figure 13 is the indication example of the display interface of the processing procedure of embodiment 4.

Figure 14 is the control flow chart representing embodiment 4.

Figure 15 is the table of comparisons representing evaluation of estimate and analyzed area, analytical model, diagnostic rule.

Figure 16 is the indication example that embodiment 4 carries out diagnosing.

Embodiment

To describe exemplary embodiments of the present invention with reference to the accompanying drawings in detail now.Note, the embodiment that below will illustrate, for understanding the present invention better, so do not limit the scope of the invention, and can change the various forms in scope of the present invention.

Embodiment 1

Fig. 1 is the block diagram of the schematic configuration of the thermal image device 100 as infrared analysis area setting device example representing embodiment 1.

Specifically, thermal image device 100 has shoot part 1, interim storage part 2, flash memory 3, communication I/F4, storage card 5, diagnostics division 6, image processing part 7, test section 8, display control unit 9, display part 10, control part 11, operating portion 12, control part 11, by controlling to be connected with above-mentioned appropriate section with data bus 13, are responsible for the overall control of thermal image device 100.

Shoot part 1 is made up of not shown optics, lens driving parts, infrared eye, signal pre-processing circuit etc.Optics is made up of infrared optics lens, for will receive focus IR radiation to infrared eye.Lens driving parts drive lens to perform focusing or zoom operation according to the control signal of control part 11.In addition, also can be the optics of manual adjustments.Infrared eye, as refrigeration or the infrared focal plane detector of non-brake method type, is converted to electric signal the infrared radiation by optics.Signal pre-processing circuit comprises sample circuit, A/D convertor circuit, timing trigger circuit etc., the electric signal exported from infrared eye is carried out the signal transacting such as sampling within the cycle of regulation, change through A/D convertor circuit, obtain the thermal-image data frame of numeral, the thermal imagery AD Value Data that this thermal-image data frame comprises is such as the binary data of 14 or 16 etc.; Thermal-image data frame is not limited to infrared eye intrinsic resolution, also can below or above infrared eye resolution.Thermal-image data frame obtains after being not limited to the simulating signal predetermined processing of infrared eye output, such as, also can obtain according to the digital signal of infrared eye therein output.In embodiment 1, shoot part 1 as acquisition unit, for obtaining thermal-image data frame.

Thermal-image data frame, is not limited to comprise thermal imagery AD Value Data; Such as also can comprise the view data of infrared thermal imagery, such as, also can comprise the array data of temperature value, or other data etc. generated based on thermal imagery AD Value Data.So-called thermal-image data frame is to comprise thermal imagery AD Value Data hereinafter.

Interim storage part 2 is as volatile memory such as RAM, DRAM, the interim memory buffer stored is carried out as the thermal-image data frame exported shoot part 1, such as be repeated below process, be about to the thermal-image data frame interim store predetermined time obtained, and when obtaining new frame by described acquisition unit, after deleting old frame, store new thermal-image data frame; Meanwhile, the working storage as diagnostics division 6, image processing part 7, test section 8, control part 11 etc. works, and is temporarily stored into the data of row relax.

Flash memory 3, stores the program for controlling, and the various data used in each several part control.In the present embodiment, as shown in Figure 3, the data relevant with reference picture, diagnosis, detection are stored in flash memory 3, such as, store the database of subject identifying information, such as, also can data file etc. in the specific format store.Table as shown in Figure 3, by the composition data of the composition data of the subject information of each subject, reference picture, subject identifying information, judgment value, analyzed area, with to analyze relevant analytical model, diagnostic rule etc. mutually corresponding, stores; In the present embodiment, also stored for the assigned position relation (not shown in the table of Fig. 3) between analyzed area and reference picture, such as, analyzed area is arranged in the base position, size, the anglec of rotation etc. of reference picture.In addition, when having the configuration information of analyzed area of assigned position relation according to subject identifying information, analyzed area is set, as different from reference picture in subject identifying information, such as can assigned position relation (not shown in the table of Fig. 3) between inventory analysis region and subject identifying information, this assigned position relation such as analyzed area is arranged in the location parameter of template, as base position, size, the anglec of rotation etc.; Such as analyzed area is arranged in the location parameter with characteristic quantity corresponding region, as base position, size, the anglec of rotation etc.

Subject information is the information relevant with subject, such as represent the information of subject place, type, numbering etc., the subject indication information generated should allow user can debate the captured subject known and understand, in addition, the various information such as resume, build date, term of life that can comprise the relevant ownership unit of subject, classification grade (as electric pressure, important level etc.), model, manufacturer, performance and characteristic, the shooting in past or maintenance can also be exemplified.Adopting the embodiment of subject information association subject identifying information, is preferred mode, can prepare various applicable subject information according to the difference of application.Such as power industry, preferably, subject information is the cognizable identity information representing subject of user, as represented subject place, type, separate information; But also can be the information representing subject type.Obviously, subject identifying information be not limited to must with subject information association.

The composition data of called reference image, such as vector figure data, dot matrix image data, also comprise the composition data of the reference picture be made up of multiple coordinate points data.

So-called subject identifying information, such as relevant with calculating the degree of correlation template, characteristic quantity etc.; So-called subject identifying information can be such as the template for template matches; It also can be such as the characteristic quantity that parameter describes.Described template such as template image, such as each pixel is the template etc. of temperature value data.So-called characteristic quantity is as represented the features such as point, line, surface in specific region, such as, for the value determined according to the state of the pixel comprised in detection window, as central point, area etc. for the ratio of the established part pixel in particular detection window, the mean value of pixel value, the profile of specific shot body.Such as, in Fig. 3, the subject identifying information of subject 1 correspondence is template image 301, and the subject identifying information of subject 2 correspondence is characteristic quantity 302.In a particular application, the combination of one or more subject identifying information modes can according to circumstances be selected.

Such as, the table shown in Fig. 3, for subject 1, can will embody the composition data 301 of the reference picture T1 of subject morphological feature to obtain template; Template also can be different from the template of the composition data of reference picture, as subject 3 corresponding templates 303.

So-called judgment value, such as by detects the value of the degree of correlation of acquisition, contrast with judgment value, judge whether that there is specific shot body heat picture.Preferably, the judgment value of regulation is corresponding with subject identifying information to be in advance stored in flash memory 3, but also can adopt other modes to prepare, as the judgment value that user is arranged temporarily.

The composition data of so-called analyzed area, be used for arranging analyzed area, as represented the data of point, line, surface, it can be such as vector figure data, also can be such as dot matrix image data, the composition data of analyzed area can comprise the information such as the numbering of analyzed area, comprises when analyzed area is made up of multiple analyzed area, the number information etc. of each analyzed area.

So-called analytical model, as the analytical calculation rule in correspondence analysis region; Such as represent the thermal-image data determined based on analyzed area and carry out temperature analysis acquisition analysis result, the analytical calculation adopted rule, as calculated maximum temperature, medial temperature, minimum temperature, degree etc.; And, also can comprise the calculated relationship of the analyzed area between the analyzed area of same thermal-image data frame and/or different thermal-image data frame, as the temperature difference etc.Preferably, analytical model can in advance with the association store such as composition data, subject identifying information of reference picture.

Same analyzed area can corresponding multiple different analytical model, and same analytical model also may correspond to multiple different analyzed area.

So-called diagnostic rule, such as, contain corresponding to analyzed area and analytical model, at least one comparison and diagnostic threshold thereof, or be also associated with diagnosis further; Described diagnosis, such as diagnosis basis, detailed defect type, defect level, treatment advice etc.Such as contain corresponding to analytical model, at least one comparison and diagnostic threshold thereof, or be also associated with diagnosis further; Wherein, omit the analyzed area of refering in particular to, any analyzed area of this analytical model of application can be common to.

Also can by analyzed area, analytical model, corresponding comparison and diagnostic threshold thereof, or be also associated with diagnosis etc. further and fit together and understand diagnostic rule as a whole.

For the combination of same analyzed area and analytical model, one or more comparison and diagnostic threshold can be had, or also corresponding respectively one or more diagnosis; Such as normal, pay close attention to, the diagnosis of defect, have comparisons different separately and diagnostic threshold respectively.A corresponding subject, can have multiple diagnostic rule combined for different analyzed area and analytical model.

Such as, diagnostic rule also can be such configuration, and corresponding to multiple analyzed area and analytical model combination, the evaluation of estimate of the multiple analysis results obtained, is configured with comparison and the diagnostic threshold of corresponding evaluation of estimate.The evaluation of estimate of multiple analysis result, such as shared separately according to multiple analysis result weight is weighted and obtains.Multiple analysis result is not limited to obtain a frame thermal-image data frame, also can obtain according to the analysis of multiple thermal-image data frame.

Communication I/F4 be such as according to USB, 1394, the communication specification such as network, thermal image device 100 and external device (ED) are carried out being connected and the interface of exchanges data, as external device (ED), such as, can enumerate personal computer, server, PDA (personal digital assistant device), other thermal image device, visible ray filming apparatus, memory storage etc.

Storage card 5, as rewritable nonvolatile memory, is connected with thermal image device 100 by memory card interface, is arranged in the draw-in groove of thermal image device 100 main body detachably, according to data such as the control record thermal-image data frames of control part 11.

Analysis portion 6, can comprise analysis configuration unit, analyzed area setting unit, analytic unit, diagnosis unit.

Analysis configuration unit, for detecting the provisioning information obtained according to test section, configurable one or more as follows: the composition data of analyzed area, the location parameter of analyzed area, analytical model, diagnostic rule.

Preferably, detect the location parameter of the specific shot body heat picture obtained according to test section, carry out the location parameter in Allocation Analysis region;

Such as, according to location parameter specific shot body heat picture being detected, Allocation Analysis region can be come; In one example in which, will detect and the detection window, template image etc. of specific shot body heat picture will be configured to analyzed area.

Preferably, in the present embodiment, according to the composition data of the analyzed area of subject identifying information association, the composition data of analyzed area is determined; Based on the assigned position relation between subject identifying information and analyzed area, and the location parameter of specific shot body heat image position in thermal-image data frame, carry out the location parameter that Allocation Analysis region is arranged in thermal-image data frame.

According to the location parameter of specific shot body heat picture, carry out the location parameter in Allocation Analysis region; According to the composition data of the different analyzed area such as point, line, surface (as circle, frame etc.), the location parameter of analyzed area, such as only can comprise position (as point), such as, comprise position and size, such as, comprise position, size, the anglec of rotation.Preferably, such as, according to the position of specific shot body heat picture, size, angle of inclination, the position of analyzed area (as point) is set, or the position of analyzed area (as frame), size or also comprise the anglec of rotation.Such as, but what be not limited to arrange in the location parameter of analyzed area is whole, also can be part wherein, arrange the position of analyzed area (as frame) according to the position of subject thermal imagery, and its size and anglec of rotation etc., be the parameter of acquiescence.

In addition, analyzed area, also can obtain according to the composition data of reference picture or reference picture association, for the subject 1 in Fig. 3, the reference picture T1 such as obtained with reference to the composition data (t1 composition data) of image is as analyzed area; According to the composition data (f1 composition data) of the analyzed area that the composition data (t1 composition data) of reference picture associates, analyzed area is set; In figure 3, store the composition data of the analyzed area corresponding to reference picture, and the relative position relation between analyzed area and reference picture, such as subject 1, store the composition data (f1 composition data) of the analyzed area of composition data (t1 composition data) correspondence of reference picture.The location parameter of set analyzed area (anglec of rotation is in addition obtained in position, or also have size) can be that the location parameter being arranged in infrared thermal imagery according to reference picture is arranged (haveing nothing to do with the result of test section 8); The analyzed area obtained as prepared t1 composition data is arranged in the location parameter of thermal-image data frame, also can configure according to this information.Preferably, Allocation Analysis region is come according to the object that there is assigned position relation with reference picture.

In addition, in another embodiment, can to regulation calculating object according to the rules computation rule calculate, based on detecting the location parameter of provisioning information such as subject thermal imagery obtained, analyzed area is set.Wherein, regulation calculating object, such as, thermal-image data in detection window, template image, detection window, reference picture, to have in other objects (as having the analyzed area of assigned position relation) of assigned position relation one or more with reference picture or subject identifying information; Described regulation computation rule, at least comprise regulation calculating object is sheared, feature extraction (such as extracting regulation as the character pixel, edge extracting etc. of numerical range), convergent-divergent, distortion, segmentation, decile, calculating outsourcing rectangle, calculate inscribe rectangle, computing center's line, calculate unique point, calculate in envelope, calculate in enveloping outer enclosure one or more; In storage medium, parameter corresponding to regulation computation rule (such as based on the parameter of central point convergent-divergent: based on central point, zoom ratio) can be prestored, or be configured by user.

With reference to the example of the analyzed area that figure 6 exposed installation is put.

Shown in figure 6 (a), the reference picture T1 of the composition data acquisition of the reference picture T1 associated by the subject 1 in Fig. 3, and the composition data of analyzed area (f1 composition data, and the relative position relation between incidental analyzed area and reference picture), the analyzed area F1 arranged.

Shown in figure 6 (b), with reference to image T2 as calculating object, using central point as basic point, after carrying out convergent-divergent and distortion, the analyzed area F2 of acquisition; Can be used for the Temperature Distribution in regulation region on analytical calculation subject body, reduce the impact of surrounding environment on assessment.

Shown in figure 6 (c), with reference to image T3 as calculating object, carry out the analyzed area F3 that 8 grades divide setting; Can be used for the heterogeneity phantom of labor subject body different piece.When the analyzed area arranged comprises multiple analyzed area unit, as required, automatic numbering can be carried out, as analyzed area F3 comprises the analyzed area F01-F08 of numbering.

With reference to figure 6 (d), detection window is set to analyzed area F4; Can be used for the maximum temperature of analysis to measure subject, the impact of the high temp objects in background can be reduced.Note: T4 is template image data.

With reference to figure 6 (e), the thermal-image data in detection window is carried out edge contour extraction, the analyzed area F5 of the edge contour of acquisition, can be used for the maximum temperature of analysis to measure subject, the impact of the high temp objects in background can be reduced.Note: TU5 is the thermal-image data in detection window.

With reference to figure 6 (f), TU6 (TU6 is template image) is extracted the pixel of more than prescribed threshold, the analyzed area F6 of acquisition, can be used for carrying out analytical calculation to subject characteristic portion.

In addition, the evaluation of estimate etc. that also can obtain according to the provisioning information detected and/or provisioning information, with the corresponding relation of analyzed area, arranges analyzed area; Adopt the set-up mode of any analyzed area can configure according to the object of infrared detection.

Preferably, the provisioning information obtained is detected according to test section, the composition data in Allocation Analysis region, the location parameter of analyzed area, analytical model, diagnostic rule.

Such as, prestore with subject identifying information and the analyzed area composition data associated thereof, assigned position relation between analyzed area and subject identifying information, analytical model, diagnostic rule at least one of them or multiple; When specific shot body heat picture being detected, analysis configuration unit, according to above-mentioned information, comes the composition data in Allocation Analysis region, the location parameter of analyzed area, analytical model, diagnostic rule.

Preferred further, prestore subject information and associate subject identifying information and analyzed area composition data, the assigned position relation between analyzed area and subject identifying information, analytical model, diagnostic rule; Selection portion, for selecting subject information; Described test section detects specific shot body heat picture according to the specific shot body identifying information of selected subject information association; Analysis configuration unit, according to above-mentioned information, comes the composition data in Allocation Analysis region, the location parameter of analyzed area, analytical model, diagnostic rule.

Preferably, described analysis configuration unit, according to following factor:

1) provisioning information

2) supplementary;

3) evaluation of estimate that obtains of provisioning information;

4) evaluation of estimate that obtains of supplementary;

5) evaluation of estimate that obtains of provisioning information and supplementary;

Wherein one or more, the corresponding relation with one or more in the location parameter of the composition data of analyzed area, analyzed area, analytical model, diagnostic rule, configures in corresponding analyzed area, analytical model, diagnostic rule one or more.

But also according to the provisioning information etc. detected, subitem wherein can be configured, remaining other modes such as can be adopted to configure as thermal image device 100 give tacit consent to etc.Such as according to position and the size of the specific shot body heat picture detected, the position data of analyzed area is set, but configures according to the composition data of analyzed area of acquiescence, analytical model, diagnostic rule; When analyzed area, analytical model, diagnostic rule not all are decided by detected provisioning information, but be also better than prior art.

Analyzed area setting unit, according to composition data and the location parameter of the analyzed area of analysis configuration cell location, arranges analyzed area to thermal-image data frame.

Analytic unit, according to the analyzed area that analyzed area setting unit is arranged, the analytical model that analysis configuration unit is arranged, carries out the analysis of thermal-image data frame, the embodiment of analytic unit is described for temperature analysis.

A kind of embodiment, analytic unit is to obtained thermal-image data frame, based on the analyzed area set by analyzed area setting unit, the thermal-image data that extraction and analysis region determines, carry out predetermined processing, the conversion process of temperature value is then carried out in such as correction, interpolation, obtains the temperature value that these thermal-image datas are corresponding, then to the temperature value obtained, carry out analytical calculation according to analytical model.Such as calculate wherein maximal value, then extract wherein maximum temperature value as analysis result.When analyzed area comprises multiple territory element, as shown in 504 in Fig. 5, analyzed area F1 has territory element S01, S02, then successively to the thermal-image data in each territory element, carry out the conversion of temperature value and analyze, obtain the analysis result of each territory element, to the numbering association store of analysis result and the territory element obtained be calculated in the regulation region of interim storage part 6, then according to the analysis result of each territory element, according to the mutual relationship of unit each in analytical model, calculate the analysis result obtaining mutual relationship.

Above-mentioned exemplifies not as the restriction of the embodiment of analyzing and processing.Such as, the thermal-image data in analyzed area being converted to the process of temperature value, can be that thermal-image datas all in analyzed area is all converted to temperature value; Also can be that the part thermal-image data specified is converted to temperature value; Can also be that deciding the conversion to thermal-image data, is a part of thermal-image data in transformational analysis region according to calculating the different pattern such as the highest, minimum, medial temperature in analytical model, or all; As analytical model be maximum temperature in computational analysis region time, also can for the thermal-image data in analyzed area, first compare the size of thermal-image data AD value, wherein maximum AD value is converted to temperature value, and the thermal-image data in analyzed area all must be converted into temperature value.In addition, also the situation that algorithm is different is comprised, such as, when calculating maximum temperature, not with single pixel but with the mean value of the AD value of the neighbor of specified quantity, the AD value of the neighbor of maximum average value is converted to temperature value, and using the mean value of the temperature value of this neighbor thermal-image data as maximum temperature value.Wherein, thermal-image data is converted to temperature value through predetermined processing, embodiment is such as according to the conversion coefficient between the AD value of the distance of the radiation coefficient of subject arranged, environment temperature, humidity and thermal image device 13 etc. and thermal-image data and temperature, by regulation conversion formula, obtain temperature value.In addition, the thermal-image data that analyzed area determines, as shown in 504 in Fig. 5, can be analyzed area F1 analytic unit S01, S02 in thermal-image data, also can be the thermal-image data outside analytic unit S01, S02, also can be the thermal-image data of the lines place pixel of analytic unit S01, S02.

The situation obtaining temperature analysis result according to analyzed area that example above illustrates, but do not limit therewith, for thermal imagery diagnosis according to the difference of application scenario, thermal-image data might not be converted to temperature value to carry out, such as, the situation that radiation energy value, gray-scale value, emissivity values etc. carry out analyzing can be converted to.The present invention is equally applicable to these situations.

In addition, analysis, diagnosis etc., non-essential based on specific analyzed area, such as, and also can using all pixels of thermal-image data frame as analytic target, analyze the highest, minimum, medial temperature wherein etc.

Further, analysis portion 6 has diagnosis unit, obtains analysis result according to analytic unit, diagnoses according to the diagnostic rule of configuration, obtains diagnostic result.

For the subject 1 in Fig. 3, the information of diagnostic rule 1 can be: contain at least one comparison corresponding to analyzed area (being obtained by f1 composition data), analytical model (being obtained by analytical model 1) and diagnostic threshold (being obtained by diagnostic rule 1).

Further, due in power industry, expect the conclusion directly obtaining diagnosing, to subject normal, pay close attention to, defect 3 kinds (also may be a kind of or more than 3 kinds) situation, there is corresponding comparison and diagnostic threshold respectively; Preferably, such as, in diagnostic rule or be associated with the annotation information of corresponding diagnosis, diagnosis basis, detailed defect type, defect level, treatment advice etc.For the diagnostic rule 1 (F1 diagnostic rule) of subject 1, the analysis result that correspondence analysis region (S01, S02) and analytical model (difference of S01 and S02 maximum temperature) obtain, diagnostic rule comprises:

1) 2 DEG C are less than or equal to; Diagnosis: normal;

2) be less than 4 DEG C, be greater than 2 DEG C; Diagnosis: pay close attention to;

3) 4 DEG C are more than or equal to; Diagnosis and annotation: defect, doubtful dielectric loss exceeds standard, and overhauls immediately!

The diagnosis comparison of analysis result foundation diagnostic rule and diagnostic threshold specifically, such as, according to the analysis result obtained, compare by diagnostic process, by the comparison in this diagnostic threshold and analysis result foundation diagnostic rule, obtain diagnostic result; The output of diagnostic result can be control signal, exports to other external device (ED)s be connected with thermal image device 100; Preferably, notify according to diagnostic result, such as, by controlling the display change with word or image (comprising infrared thermal imagery, reference picture etc.) in display part 10 grade; Or light, auditory tone cues, vibration etc. that pilot lamp produces, as long as the appreciable method of user is included.Preferred mode, control display part 10 diagnosis is shown, further, also the diagnostic threshold, diagnosis basis, defect type, defect level, treatment advice etc. relevant with diagnosis can be notified in the mode of user's energy perception such as word, accordingly, the data of these relevant data and diagnostic rule can prepare in advance such as association store in storage medium.As in Fig. 5 504 the display example of diagnostic result.

Preferably, when detect specific shot body heat as time, to regulation thermal-image data frame diagnose.Wherein, the thermal-image data frame of regulation can be thermal-image data frame specific shot body heat picture being detected; But be not limited thereto, also can be this frame sequential before or after that frame, or that frame etc. obtained by multiframe computing.Or also can be the multiframe thermal-image data frame of regulation.

The process of image processing part 7 for specifying the thermal-image data frame obtained by shoot part 1, such as it is when Displaying timer arrives at every turn, from the thermal-image data frame of stipulated time being temporarily stored in described interim storage part 2, select and read the frame of each specific time interval; The process of image processing part 7, as correction, interpolation, pseudo-coloured silk, synthesis, compression, decompress(ion) etc., carries out being converted to the process being suitable for showing and using, record the data such as use.Image processing part 7 such as can adopt DSP or other microprocessor or programmable FPGA etc. to realize, or, also can be integrated with the processor of analysis portion 6, test section 8, control part 11 etc.

Image processing part 7 obtains the view data of infrared thermal imagery for the process thermal-image data frame obtained being implemented to regulation.Specifically, such as, image processing part 7 carries out the predetermined processing such as Nonuniformity Correction, interpolation to the thermal-image data frame that shooting obtains, and then carries out the view data that Pseudo-color technology obtains infrared thermal imagery; A kind of embodiment of Pseudo-color technology, such as determine the color table scope of corresponding puppet according to the AD value scope of thermal-image data frame or the setting range of AD value, using the view data of concrete color value corresponding in pseudo-colored steel scope for thermal imagery AD Value Data as its respective pixel position in infrared thermal imagery.

In addition, image processing part 7 possesses synthesis unit, described synthesis unit is based on the composition data of the reference picture specified by reference picture specifying part 11A, and the location parameter that position setting unit 11B is arranged, obtain reference picture, and with the infrared thermal imagery that image processing part 7 generates, carry out the view data of synthesizing rear generation composograph.Specifically, synthesis unit transparent rate according to the rules, synthesizes with reference to image and infrared thermal imagery; Comprise this situation, the transparent rate of reference picture was 1 (if reference picture is the string diagram picture of edge contour), namely opaquely synthesized with infrared thermal imagery.

Image processing part 7, for based on the location parameter set by the composition data of specified reference picture and position setting unit 11B, carries out predetermined processing to obtained thermal-image data frame, generates the infrared thermal imagery embodying reference picture.

In addition, synthesis also can be according to such process, such as be arranged in the location of pixels of infrared thermal imagery according to reference picture, Pseudo-color technology is carried out to thermal-image data frame, to generate the display image data (effect of similar overlap) embodying reference picture and infrared thermal imagery; Such as, according to the location of pixels being arranged in infrared thermal imagery of reference picture, Pseudo-color technology is not carried out to the thermal-image data of this location of pixels, carries out Pseudo-color technology with reference to the thermal-image data beyond the location of pixels of image, then in conjunction with the view data of reference picture, generate display image data.

Or, also can with reference to the pixel of the location of pixels in the corresponding thermal-image data frame of image, carry out (as Pseudo-color technology, generating the image with embodying this reference picture with the Pseudo-color technology difference process of other thermal-image datas put as numerical digit generating infrared thermal imagery.In this case, the image composing unit for synthesizing with reference to image and infrared thermal imagery can be removed in thermal image device 100.

So-called reference picture, shows jointly with infrared thermal imagery, and user can be helped to take specific shot body.Such as, the image of the morphological feature of this specific shot body is embodied; Reference picture also can be other shape, as square, circular; Such as, embody subject thermal imagery be arranged in the expectation image space of infrared thermal imagery identification image; Such as embody the identification image of the surveyed area (surveyed area can comprise one or more detection window) in infrared thermal imagery; Such as embody the identification image etc. of the analyzed area of the subject thermal imagery of expectation.Preferred mode, reference picture shows according to the location parameter (position or also comprise size, or also comprise the anglec of rotation) of regulation is overlapping with infrared thermal imagery; In addition, reference picture also can be shown in display part, the region outside infrared thermal imagery window; In addition, also the thumbnail of the relation such as position and dimension scale representing reference picture and infrared thermal imagery can be presented at the region of the display part outside infrared thermal imagery window.

Test section 8, based on the thermal-image data frame obtained, can carry out relatedness computation according to subject identifying information; Such as, test section 8 is based on the control of control part 11, the thermal-image data frame obtained can be taken by reading the shoot part 1 stored in interim storage part 2, or the thermal-image data frame of shooting acquisition carries out the data of predetermined processing acquisition, the view data of the infrared thermal imagery that such as Pseudo-color technology obtains, the check processing of the degree of correlation between the subject identifying information performing and register.Thermal-image data frame, is not limited to shooting and obtains, such as, also can receive outside thermal-image data frame and obtain, such as, also can read thermal imagery file etc. and obtain from storage medium.

Test section 8 comprises feature registration unit, detection window setting unit, detecting unit, judging unit (not shown).

Feature registration unit, for registering for the relevant subject identifying information of relatedness computation.Subject identifying information can be registered according to the subject identifying information prestored in storage medium; Such as, according to the subject identifying information of the subject information association of the selection of user, register with the subject identifying information relevant with relatedness computation.In addition, also can specify subject identifying information by user, such as, by the infrared thermal imagery from display, subject region can be specified to obtain subject identifying information, such as, obtain template image.The subject identifying information registered such as is stored in the assigned position of interim storage part 2, or distinguishes with mark and other subject identifying informations stored when storing.

Detection window setting unit, for arranging detection window, based on thermal-image data frame or particular detection region wherein, can arrange one or more detection window.Wherein, in the present embodiment, be arranged in the location parameter of infrared thermal imagery according to reference picture, detection window is set.Detection window is not limited to square, also can be other shape, such as, can determine according to the shape of template.

In order to equal the size of detection window, template image is used with the state reduced or expand herein, or, also can prepare and template image that sizes of memory equals window size in order to using.In template matches, check template image and by the degree of correlation between the window thermal imagery that uses detection window cutting from thermal-image data frame.

Detecting unit, by read thermal-image data frame, based on the thermal-image data in the detection window set by detection window setting unit, such as, comparing with subject identifying information, obtaining the value of the degree of correlation for evaluating similar degree.As when being provided with multiple detection window, such as, will can wherein detect the value of the maximum relation degree of acquisition, as the value of the degree of correlation of this thermal-image data frame.

Judging unit, by the value of the degree of correlation, judgment value according to the rules judges, determines whether specific shot body heat picture to be detected; Such as, the value of the degree of correlation of the similar degree between representative and template image, when having exceeded judgment value, is judged as this frame the frame including specific shot body heat picture, specific shot body heat picture namely detected.

The check processing of test section 8 can be the detection mode based on template matches, carries out the calculating of the degree of correlation and compare based on the thermal-image data in detection window with template image; Such as, calculate infrared thermal imagery in detection window and as the mutually corresponding position of the infrared thermal imagery of template pixel between difference and, the difference calculated and less, the degree of correlation is higher.Wherein, the process of template matches, also can be configured to and extracts characteristic quantity and carry out the embodiment that mates, utilizes the characteristic quantity of the thermal-image data in the characteristic quantity of template image and detection window, therebetween relatively determine the degree of correlation.Such as, extract the ratio of the specific pixel of the subject image in detection window, more close with the ratio of the specific pixel in template image, the difference calculated is less, and the degree of correlation is higher.

The check processing of test section 8, based on the detection embodiment of the characteristic quantity that parameter describes.Such as, the characteristic quantity obtaining thermal-image data in detection window can be calculated, as the value of the degree of correlation according to subject identifying information; Such as, subject identifying information also can comprise characteristic quantity reference value, and the computing can carrying out specifying to obtain the characteristic quantity of the thermal-image data in detection window, and compares with characteristic quantity reference value, obtains the value of the degree of correlation; In one example, described characteristic quantity reference value is the determined pixel ratio of particular pixel values, and detecting unit calculates the pixel ratio of particular pixel values in thermal-image data, and the two compares, and obtains the value of the degree of correlation, and the difference calculated is less, and the degree of correlation is higher.By the value of the degree of correlation, compare with judgment value, determine whether specific shot body heat picture to be detected.

Display control unit 9, the view data for the display stored by interim storage part 2 is presented at display part 10.Such as, the infrared thermal imagery of the thermal-image data frame generation that shooting obtains can be shown continuously, various set information can be shown.Specifically, display control unit 9 has VRAM, VRAM control module, signal generation unit (not shown) etc., and, signal generation unit is under the control of control part 11, view data (read from interim storage part 2 and be stored into the view data of VRAM) is regularly read from VRAM, generation vision signal exports, and is presented at display part 10.In thermal image device 100, display part 10 is such as liquid crystal indicator.Be not limited thereto, display part 10 can also be other display device be connected with thermal image device 100, and can not have display part in the electrical structure of thermal image device 100 self.

Control part 11 controls the action of the entirety of thermal image device 100, stores the program for controlling in storage medium such as flash memory 3, and the various data used in each several part control.Control part 11 is such as realized by CPU, MPU, SOC, programmable FPGA etc.

In the present embodiment, control part 11 as the example of selection portion, for selecting subject information; Such as according to the selection of user to subject indication information, select the subject information that described subject indication information is corresponding.

Control part 11 possesses reference picture specifying part 11A, is used to specify the composition data of the reference picture that jointly will show with infrared thermal imagery; Such as, based on the composition data (dot array data or vector data) of the reference picture of the subject information association stored in storage medium, according to the selection of user to subject information, specify the composition data with the reference picture of subject information association; In addition, also according to the default configuration of thermal image device 100, the composition data of reference picture can be specified, the identification data of such as surveyed area.

In addition, control part 11 possesses position setting unit 11B, is arranged in the location parameter (position, or also comprise size, or also comprise the anglec of rotation) of display part for arranging reference picture.Preferably, position setting unit 11B is arranged in position and the size of infrared thermal imagery for arranging reference picture; Such as, according to the self-adaptation viewing area specified in infrared thermal imagery, in this adaptive region, maximize position and the size of display placed in the middle according to calculated reference picture, thus position and the size that reference picture is arranged in infrared thermal imagery is set; Such as, also according to the incidental parameter of reference picture (such as embodying the parameter of position in infrared thermal imagery and size), position and the size that reference picture is arranged in infrared thermal imagery can be set according to this parameter; Or, also position and size that reference picture is arranged in infrared thermal imagery can be set according to the configuration of thermal image device 100 (placed in the middle, original size); Or, also can according to the location parameter of user's input.

In addition, control part 11 possesses notification unit (not shown), when test section 8 detect specific shot body heat as time, perform and carry out the control that notifies.The one or more of change of the vibration of the vibrating mass in the change of display part generation displaying contents, thermal image device 100, the light change of pilot lamp, the sound of sound components etc. can be made; As long as the appreciable mode of user all can.

Operating portion 12: carry out various instruction operation for user, or input the various operations such as set information, control part 11, according to the operation signal of operating portion 12, performs corresponding program.With reference to figure 2, operating portion 12 is described, the button providing user to operate has that record key 01, focusing key 02, acknowledgement key 03, playback key 04, menu are strong 05, directionkeys 06 etc.; In addition, touch-screen 07 or speech recognition component (not shown) etc. also can be adopted to realize the operation of being correlated with.

The control flow of the reference pattern of thermal image device 100 is described see Fig. 4, the change of the display interface in shooting process is described with reference to figure 5.The subject of this application scene thermal image device 100 pairs of transformer stations as hand-held in user is taken.After switching on power, control part 11 carries out the initialization of internal circuit, then enter screening-mode, namely shoot part 1 is taken and is obtained thermal-image data frame, the thermal-image data frame that shoot part 1 is taken acquisition by image processing part 7 carries out the process specified, be stored in interim storage part 2, display part 10 shows infrared thermal imagery continuously with dynamic image form, in this state, control part 11 is implemented it and is controlled, whether persistent surveillance has been switched to the process of other patterns according to scheduled operation or has carried out power-off operation, if had, then enters corresponding processing controls.The rate-determining steps of reference pattern is as follows:

Steps A 01, whether control part 11 persistent surveillance user have selected reference pattern.

At standby shooting state, display part 10 shows dynamic infrared thermal imagery, at this moment shooting angle and distance obtain the infrared thermal imagery IR1 as shown in Figure 5 shown in interface 501, user can puzzle image space, size, the angle in the morphological feature of subject thermal imagery IR1 and the infrared thermal imagery at its place in the past, in this case, the complex operation of analyzed area is manually set, for ensure analyzed area specification is set, simple to operate, diagnosis accurately; Select reference pattern by the scheduled operation of operating portion 12, when control part 11 detects that user have selected reference pattern (steps A 01: yes), then enter reference pattern process.

Steps A 02, then, reference picture specifying part 11A specifies the composition data of reference picture, such as, control part 11 is based on the Fig. 3 stored in flash memory 3, the subject indication information that subject information generates is presented at display part 10, as shown in Fig. 5 502, when user is according to the subject " subject 1 " of floor, selected " subject 1 " shown on display part 10 by operating portion 12, reference picture specifying part 11A is according to the selection of user, just determine t1 composition data and be used for generating reference image T1, the data such as t1 composition data are read from flash memory 3, be sent to interim storage part 2.

Steps A 03, position setting unit 8 arranges the location parameter (position and size) that reference picture T1 is positioned at infrared thermal imagery.Such as, according to profile composition data t1 attach location parameter, the location parameter that reference picture T1 is arranged in infrared thermal imagery is set.In addition, also can self-adaptation viewing area according to the rules (maximizing display placed in the middle in such as self-adaptation viewing area), or the location parameter that user specifies, determine that reference picture T1 is arranged in the location parameter of infrared thermal imagery.

Steps A 04, then, obtains thermal-image data frame, and the shoot part 1 thermal-image data frame that shooting obtains immediately is sent to interim storage part 2;

Steps A 05, display part 10 shows jointly with reference to image T1 and infrared thermal imagery.

Specifically, image processing part 7 carries out predetermined processing such as pseudo-color conversion to obtained thermal-image data frame, obtain the view data of infrared thermal imagery, and, determined composition data is obtained the view data of reference picture T1 by synthesis unit according to the given size arranged, according to set assigned position, carry out synthesizing (overlapping) with the view data of the infrared thermal imagery generated, leave the view data of synthesis in interim storage part 2, then, composograph is presented at display part 10 by display control unit 9, as shown in Figure 5 shown in interface 503, location between subject thermal imagery IR1 and contour images T1, the difference of size, user can take subject thermal imagery IR1 according to reference picture.When acquisition unit obtains thermal-image data frame continuously, constantly can synthesize with the thermal-image data frame newly obtained, with this, show dynamic composograph.

In steps A 06, the reference picture T1 that the t1 composition data that subject 1 associates by feature registration unit obtains registers as template image.

Then, in steps A 07, the thermal-image data frame in interim storage part 2 is read, detection window setting unit, be arranged in the location parameter of infrared thermal imagery according to reference picture T1, the detection window J1 (J1 of meaning shown in 503, can show or not show) of equivalent locations parameter is set.

Steps A 08, carries out the process of relatedness computation.

Test section 8 is based on the detection window J1 set by detection window setting unit, and the template that feature registration unit is registered (reference picture T1), read the thermal-image data obtained by shoot part 1 shooting immediately in interim storage part 2, wherein, extract the thermal-image data being arranged in this detection window J1, carry out template matches, calculate the degree of correlation therebetween.

Specifically, test section 8 such as detects the degree of correlation of thermal-image data and reference picture T1 by following process, first, test section 8 extracts the thermal-image data being arranged in detection window, carries out binaryzation according to the reservation threshold of AD value to the thermal-image data in the detection window read; Then, the Contiguous graphics that the pixel with predetermined pixel value (1 or 0) extracting this bianry image is connected; Then judge whether this Contiguous graphics has the size of preset range; If judge that the size of this Contiguous graphics is in preset range, then a nearly step performs similar degree process between the Contiguous graphics extracted and the template (reference picture T1) registered, such as calculate the ratio sum of overlapping area in the respective total area therebetween, thus, the degree of correlation between the Contiguous graphics representing and extract and reference picture T1 is obtained.

Further, in steps A 09, if the degree of correlation is greater than regulation judgment value, then test section 8 is determined specific shot body heat picture to be detected.As specific shot body heat picture do not detected; Then arriving steps A 11, as do not exited, then getting back to steps A 04, and jointly show at the infrared thermal imagery that steps A 05 generates with reference to image and the thermal-image data frame newly obtained.At this, user is according to the reference of reference picture T1, by the position that changes shooting and the shooting distance, image space, the angle that adjust between the optics of thermal image device 100 and " subject 1 ", what make to obtain is visually in the similar state of image space, size, form as subject thermal imagery IR10 in Fig. 5 display interface 504 and reference picture T1 as far as possible.Adjustment along with user operates, and in steps A 08, carries out check processing to the thermal-image data frame newly obtained, when the degree of correlation detected in steps A 09 is greater than the judgment value of regulation, then enters steps A 10.

It is to be noted, the check processing that the thermal-image data frame that test section 8 obtains continuously based on acquisition unit carries out, such as all can carry out check processing successively to the thermal-image data frame obtained continuously, the thermal-image data frame that such as also only can read predetermined distance carries out check processing; Such as, carry out process such as reducing, sparse before also the thermal-image data in the thermal-image data frame read or detection window being detected; With this, check processing burden can be alleviated.

Steps A 10, after detecting the thermal-image data frame with specific shot body heat picture; Carry out the process such as analysis configuration, analyzed area setting, analysis, diagnostic process.

Preferred mode, after the thermal-image data frame with specific shot body heat picture being detected, analysis configuration unit carries out the configuration of analyzed area; Specifically, according to the composition data (f1 composition data) of the analyzed area of composition data (t1 composition data) corresponding stored with reference picture, comprise the assigned position relation of reference picture and analyzed area F1, reference picture T1 is arranged in position and the size of infrared thermal imagery, is used as the configuration information that the location parameter of analyzed area is relevant; Further, can according to the corresponding relation in Fig. 3, Allocation Analysis pattern 1, diagnostic rule 1 are as analytical model, diagnostic rule.In another example, also can according to the assigned position relation of analyzed area F1 and reference picture T1, reference picture T1 is arranged in position and the size of infrared thermal imagery, calculate and obtain the location parameter that analyzed area F1 is arranged in thermal-image data frame, then the process such as corresponding convergent-divergent are carried out to the composition data of analyzed area, the composition data of the analyzed area obtained and the location parameter of analyzed area, the configuration information be used as.

Analyzed area setting unit, according to the configuration information of analyzed area, such as, after carrying out the process such as calculating location parameter, corresponding convergent-divergent, arranges analyzed area F1 to this thermal-image data frame, comprises analyzed area S01, S02;

Analytic unit, according to the analyzed area F1 set by analyzed area setting unit, and analytical model 1 corresponding to analyzed area F1 is analyzed, and obtains analysis result.

Then, can diagnostic process be carried out, according to analysis result and diagnostic rule (diagnostic rule 1 of analyzed area F1, analytical model 1 correspondence), obtain diagnostic result.

Specifically, analytic unit, the analytical model 1 according to analyzed area F1 and correspondence is analyzed, and obtains analysis result; Diagnosis unit, according to analysis result, " diagnostic rule 1 " corresponding with analyzed area F1 and analytical model 1, obtains diagnostic result.Analyzed area F1 as shown in 504 in Fig. 5, the display field of analysis result, diagnostic result, wherein, the difference according to S01 and S02 maximum temperature is 5 DEG C, is greater than 5 DEG C; Diagnosis and annotation: defect, doubtful dielectric loss exceeds standard, and overhauls immediately! (shown in 504 in Fig. 5).Note, analyzed area F1, analysis result, diagnostic result must not show.

Further, the notice of diagnostic result can be carried out, the mode of notice, such as by changing with the display of word or image (comprising infrared thermal imagery, reference picture etc.) in display part 10 grade, the vibration etc. of the light produced by the pilot lamp in thermal image device 100, auditory tone cues that loudspeaker sends, vibrating mass, as long as the appreciable method of user is included.Preferred mode, controls display part 10 and is shown by diagnosis, further, also the diagnostic threshold, diagnosis basis, defect type, defect level, treatment advice etc. relevant with diagnosis can be notified in the mode of user's energy perception such as word.

Such as, or also exportable diagnostic result, exports from communication interface I/F4, receive by other external device (ED)s of being connected with thermal image device 100.

Steps A 11, judges whether to exit reference model, as exited, then terminates, and as do not exited, then getting back to steps A 04, repeating above-mentioned process.

Like this, to the thermal-image data frame that continuous shooting obtains, when the thermal-image data frame of the degree of correlation higher than the judgment value of regulation being detected, Lookup protocol analyzed area can be carried out according to the subject thermal imagery detected.And automatically diagnose according to diagnostic rule.。。。

Like this, user just not must pass through artificial subjective judgement subject thermal imagery morphological feature, maybe need by the similar degree between artificial subjective judgement subject thermal imagery and reference picture, analyzed area, analytical model, diagnostic rule are manually set, the workload alleviating analyzed area setting operation, the technical difficulty reducing analyzed area setting can be reached, be convenient to arrange analyzed area, analytical model, diagnostic rule accurately.Avoid the beneficial effect taking error location, angle etc.

Further, set analyzed area, does not limit and is applied to and will detects this thermal-image data frame of subject thermal imagery, can be used for the process such as analysis, record of the thermal-image data frame of the new acquisition of such as stipulated time yet.When interim storage part 2 is the thermal-image data frame storing multiframe part, even can be used for the thermal-image data frame had detected by analyzing before the sequential of the thermal-image data frame of specific shot body heat picture.

As mentioned above, in the present embodiment, the reference picture of the predetermined morphological feature of subject is also corresponded to owing to showing assigned position, given size simultaneously, vision reference is provided to the morphological feature and the image space of subject thermal imagery in infrared thermal imagery, size, angle of taking subject thermal imagery, diagnosed after specific shot body heat picture being detected, significantly can be reduced shooting difficulty and the intensity of user.

Further, although for reducing calculated amount, arrange the detection window of the location parameter identical with the location parameter of the reference picture set by the setting unit of position; But also multiple detection window can be set.In addition, the local time in the corresponding reference picture of the subject identifying information such as template, according to the relative position relation (template that such as prestores is arranged in the relation of the base position of reference picture, size, the anglec of rotation) for template and reference picture.

Embodiment 2

Embodiment 2 is with the difference of embodiment 1, and reference picture is for representing the mark of surveyed area (can arrange one or more detection window within a detection region).Further, be different from the check processing in embodiment 1, embodiment 2 by comparing between subject thermal imagery with characteristic quantity reference value is detected specific shot body heat picture, and, detect specific shot body heat as time, also carried out the notice to user.

The control flow of the reference pattern of the thermal image device 100 of embodiment 2 is described see Fig. 7, the change of the display interface in shooting process is described with reference to figure 8.

Step B01, whether control part 11 persistent surveillance user have selected with reference to detecting pattern.When control part 11 detects that user have selected reference pattern (step B01: yes), then enter reference pattern process.

Step B02-B03, at this, assuming that shooting subject 2, according to the selection of user, reference picture specifying part 11A specifies the composition data t2 (assuming that representing the identification data of surveyed area) of reference picture.Then, position setting unit 11B arranges assigned position and the given size that reference picture T2 is positioned at infrared thermal imagery.

Step B04, then, the thermal-image data frame that control part 11 controls shoot part 1 to take acquisition is sent to interim storage part 2;

Step B05, reference picture (rectangle frame T2) overlap representing surveyed area is presented in infrared thermal imagery by display control unit 9, and user according to this rectangle frame T2, will adjust image space and the size of subject thermal imagery IR2 shooting.As shown in the display interface 801 in Fig. 8.

Then, in step B06, the characteristic quantity 302 (contain the reference value of characteristic quantity) of feature registration unit 8 associated by the subject information subject 2 selected in step B02, register the subject identifying information as subsequent calculations similarity, at this, this characteristic quantity 302 represents the special ratios that the pixel of particular pixel values is shared in all pixels in regulation detection window (such as rectangle frame T2).

Then, in step B07, detection window setting unit, is arranged detection window.At this, the detection window in infrared thermal imagery is set according to the position of rectangle frame T2 and size.

Thereafter, step B08, carries out the process of relatedness computation.

Specifically, test section 8 such as detects the degree of correlation between subject thermal imagery in infrared thermal imagery and characteristic quantity by following process, test section 8 extracts the thermal-image data being arranged in detection window, is created on the ratio that specific pixel in detection window (such as the pixel of specific AD value) is shared in all pixels; As step B09, the ratio value obtained meets the predetermined ratio scope (judgment value of regulation) of characteristic quantity, is judged as specific shot body heat picture being detected.Note, can use the computing method of various Characteristic Extraction and similarity, the process in this embodiment is only example.

As specific shot body heat picture do not detected; To step B11, as do not released, get back to step B04, that is, read the thermal-image data frame that shooting obtains, and continue follow-up process.At this, user is according to the reference of rectangle frame T2, by the position that changes shooting and the shooting distance, image space, the angle that adjust between the optics of thermal image device 100 and " subject 1 ", what make to obtain is visually in image space, state that size is similar as subject thermal imagery IR2 in Fig. 8 display interface 802 and rectangle frame T2 as far as possible.Adjustment along with user operates, and in step B05, carries out check processing to the new thermal-image data frame read, and when the judgment value conformed with the regulations with the degree of correlation of characteristic quantity detected, then enters step B10.

Step B10; Carry out the process such as analysis configuration, analyzed area setting, analysis, diagnostic process.Wherein, as shown in 802 in Fig. 8, detection window T2 is set to analyzed area by analyzed area setting unit, effectively can avoid reducing other object in background to the impact of IR2 according to this analyzed area when analyzing.

Further, control part 11 controls display part 10, except can except display analysis result points out user, with the one of under type or simultaneously multiplely can also notify user.

Such as, by change the transparent rate of reference picture, color, size, flicker, reference picture composition data the mode such as change notify, text prompt, freeze to show image, mode in the display notice such as other position display specified image frames (infrared thermal imagery that the thermal-image data frame as detected with specific shot body heat picture obtains) of display part 10.Wherein, the mode of notice can continue official hour such as reference picture and to glimmer continuously 1 second and along with variable color.

Step B11, judges whether to exit reference model, as exited, then terminates, and as do not exited, then gets back to step B04, repeats above-mentioned process.

As mentioned above, in the present embodiment, because display represents the mark of surveyed area simultaneously, to morphological feature and the image space of subject thermal imagery in infrared thermal imagery of shooting subject thermal imagery, the approximate range of size provides vision reference, user adjusts thermal image device 100 according to this mark, take subject thermal imagery, coincide to make the image space of subject thermal imagery and size and marking frame, and, after specific shot body heat picture being detected, analyzed area is set, difficulty and the intensity of the aligning shooting of user can be reduced, improve Detection job and speed, common user easily grasps this shooting technical ability.

Shown reference picture is not limited to the rectangle frame representing surveyed area (or detection window), can be such as circular or corresponding to the subject thermal imagery detected arbitrary shape or correspond to the mark such as point, line of roughly surveyed area.

The distortion of embodiment 1,2, due in embodiment 1,2, when the factor with the relevant analyzed area, analytical model, diagnostic rule etc. of diagnosis, with when whether detecting that specific shot body heat picture has nothing to do, also can be configured to complete before check processing, have the embodiment of various deformation.Such as, analyzed area is set according to the position of reference picture and reference picture and size, due to whether detect that specific shot body heat picture has nothing to do, the setting of analyzed area also can perform before specific shot body heat picture being detected, but did not analyze; Or also to the analysis that the thermal-image data frame obtained successively carries out, and the analysis result before the analysis result newly obtained is replaced it that circulates, be stored in the regulation region of interim storage part 2, just do not diagnose; Or also carry out analyzing and diagnosing, when detect specific shot body heat as time, just show diagnostic result and notify user; Or, also show diagnostic result, when detect specific shot body heat as time, just notify user's (such as diagnostic result font difference, information flicker, variable color, vibration etc.); Like this, do not detect specific shot body heat as time, can avoid user by the analysis that shows all the time and diagnostic result the puzzlement that causes.

Embodiment 3

Embodiment 3 is with the difference of embodiment 1,2, and user specifies the region in infrared thermal imagery by operating portion, based on the region in the infrared thermal imagery that user specifies, specify the data of reference picture and the follow-up template image as subject identifying information.

The control flow of the reference pattern of the thermal image device 100 of embodiment 3 is described see Fig. 9, the change of the display interface in shooting process is described with reference to Figure 10.

Step C01, whether control part 11 persistent surveillance user have selected reference pattern.

At standby shooting state, display part 10 shows dynamic infrared thermal imagery, at this moment shooting angle and distance obtain the infrared thermal imagery IR3 as shown in display interface in Figure 10 1001, when control part 11 detects that user have selected reference pattern (step C01: yes), then enter reference pattern process.

Step C02, control part 11 controls to make display one scissor rectangle frame J3; User adjusts angle, the distance of subject IR3 shooting, or adjustment share zone J3, makes the subject thermal imagery IR3 of expectation generating reference image be arranged in rectangle frame J3, as shown in Figure 10 display interface 1002.Then, when user presses acknowledgement key, the view data sheared in this region is stored in the regulation region of interim storage part by reference picture specifying part 11A, and the view data shearing acquisition is specified the composition data as generating reference image TU3;

And, in step C03, assigned position and given size that the reference picture TU3 obtained based on sheared view data is positioned at infrared thermal imagery are set, at this, the location parameter (position and size) of reference picture TU3 is set according to the mode maximizing display placed in the middle in adaptive region Z1.

Step C04, obtain thermal-image data frame, thermal-image data frame shoot part 1 being taken acquisition is sent to interim storage part 2;

Step C05, obtained thermal-image data frame is carried out the Pseudo-color technology specified by image processing part 7, the view data obtaining infrared thermal imagery is stored in the regulation region of interim storage part 2, synthesis unit according to sheared view data according to set size generating reference image TU3, further, synthesis unit synthesizes according to set position and this infrared thermal imagery with reference to image TU3; Then, display part 10 shows this image.As shown in the display interface display interface 1003 in Figure 10, reference picture TU3 overlap is presented in infrared thermal imagery, and user according to this reference picture TU3, can adjust thermal image device 100, changes image space and the size of the shooting of subject thermal imagery.

Then, in step C06, feature registration unit registers the subject identifying information as follow-up Similarity Measure with reference to image TU3.

Then, in step C07, detection window setting unit, is arranged detection window.At this, the position equal according to reference picture TU3 and size arrange the detection window in infrared thermal imagery.

Step C08, carry out the process detecting the degree of correlation, specifically, test section 8 such as detects the degree of correlation between subject thermal imagery in infrared thermal imagery and reference picture by following process, test section 8 reads in step C05 and is stored in infrared thermal imagery in interim storage part 2 regulation region, extract the infrared thermal imagery being arranged in detection window, detecting unit calculate infrared thermal imagery in detection window and as the mutually corresponding position of the reference picture TU2 of template pixel between difference and, the difference calculated and less, the degree of correlation is higher; When in step C09, judge to be judged as the judgment value that the value obtained conforms with the regulations specific shot body heat picture being detected.In addition, various Characteristic Extraction method also can be used to carry out comparing of template image TU3 and the infrared thermal imagery in detection window, and the process in embodiment is only example.

As specific shot body heat picture do not detected; To step C11, as do not released, getting back to step C04, repeating follow-up process.At this, user is by the position that changes shooting and the shooting distance, image space, the angle that adjust between the optics of thermal image device 100 and " subject 1 ", and what make to obtain is visually in image space, the similar level state of size as subject thermal imagery IR3 in Figure 10 display interface 1004 and reference picture TU3 as far as possible.Adjustment along with user operates, and carrying out check processing, when specific shot body heat picture being detected, then entering step C10 to the infrared thermal imagery that the thermal-image data frame newly obtained obtains.

Step C10; Carry out the process such as analysis configuration, analyzed area setting, analysis, diagnostic process.Wherein, analyzed area setting unit, arranges analyzed area (line F4), the edge contour that this analyzed area F4 such as analyzed area setting unit extracts according to the infrared thermal imagery in detection window, set center line, is used for measuring the center line heterogeneity phantom of subject thermal imagery IR3.In addition, also can various applicable analyzed area be set according to extracted edge contour.Can the diagnostic rule (as in this example, diagnostic rule is, normal: the temperature difference≤1 DEG C of center line, defect: the temperature difference > of center line 1 DEG C) that rule and correspondence are set of pre-configured analyzed area; Then, thermography analysis is carried out; Then, to the analysis result that thermography analysis exports, diagnose according to diagnostic rule, export diagnostic result; Analysis result such as shown in 1004 in Figure 10 and diagnostic result.

Step C11, judges whether to exit reference model, as exited, then terminates, and as do not exited, then gets back to step C04, repeats above-mentioned process.

As mentioned above, in the present embodiment, by specifying reference picture and the subject identifying information for check processing, being convenient to the reference picture that not cut-and-dried situation gets off to obtain reference, and carrying out check processing; According to the thermal-image data in the detection window detected corresponding to specific shot body heat picture, generate analyzed area, when reducing detection burden, even if the precision detecting similarity is not high, that still effectively can improve analyzed area arranges precision.Reach simple to operate, user-friendly, the burden of test section (processor) is light, and it is high that analyzed area arranges precision, and analysis result precision is high, the beneficial effect that diagnostic result precision is high.

In addition, when having or be connected with the imaging device (such as Visible Light Camera, not shown in FIG) of other types in thermal image device 100, the image of other imaging device collections also can be used therefrom to specify as the composition data with reference to image.

In addition, also can carry out Choice and process object from storage medium etc., such as from storage card 5, the infrared thermal imagery or visible images etc. of reading pre-stored therefrom specifies generating reference image.

Further, although to illustrate with reference to image simultaneously as the data of the template image of detection similarity in an embodiment, the data of the template image different from reference picture also can be set, such as, with reference to the data of the local in image as template image.

Embodiment 4

Embodiment 4 and embodiment 1,2, the difference of 3 is, test section 8 detects the degree of correlation with subject identifying information by the multiple detection windows in thermal-image data frame, due to the increase of the sensing range in thermal-image data frame, make the operation of user in shooting more convenient, the precision of detection is improved.

Owing to depending on the factors such as the distance of shooting, the size of subject thermal imagery is not a constant, although the reference of imaging size can be carried out according to reference picture, and detection window is set to consistent with reference picture location parameter, simultaneously, to detecting that specific shot body heat picture whether judgment value gives wider scope, the precision detected can also be reduced, carrys out to detect more quickly specific shot body heat picture.But in the conditional situations of tool such as the distance of taking, or inconvenience uses.

By increasing the quantity of detection window, obtained window thermal-image data is detected and the degree of correlation of subject identifying information, when being provided with multiple detection window, the judgement of specific shot body heat picture such as whether can be detected based on the value of the maximum relation degree wherein detecting acquisition, when being judged as specific shot body heat picture being detected, the setting of analyzed area can be carried out according to the position, size etc. of this specific shot body heat picture; Make the operation of user in shooting more convenient.In addition, also according to the assigned position between detection window, the multiple specific shot body heat pictures be included in same thermal-image data frame can be detected.

The detection window setting unit of test section 8, for arranging detection window, based on thermal-image data frame or particular detection region wherein, can arrange one or more detection window.Such as according to the surveyed area (G4 as in Figure 11) of certain limit, in this surveyed area G4, arrange multiple detection window, can be the detection window of multiple different size, also can be the detection window after a nearly step tilts; Usually the size, inclination etc. of detection window can be preset according to the requirement of shooting quality; As shown in figure 12, wherein Figure 12 (a) detection window that is standard, Figure 12 (b) is the detection window according to minification, the detection window that Figure 12 (c) is arranged for up-sizing, Figure 12 (d) is for angular slope according to the rules and the detection window arranged.In order to equal the size of detection window, template image is to reduce or to amplify or the state that also tilts is used herein, or, also can to prepare and sizes of memory equals the template image of window size in order to using.In addition, also can by the thermal-image data in detection window to reduce or to amplify or the state that also tilts is used, with corresponding templates image.Detection window is not limited to square, also can be other shape, such as, can determine according to the shape of template image.

Surveyed area such as can be arranged according to shooting custom by user, and the position can specified according to user and size arrange one or more surveyed area; Also can be such as prestore as with subject information association etc.; In addition, also can not arrange specific surveyed area, the scope namely giving tacit consent to thermal-image data frame is surveyed area.

For the application of infrared detection, it is similar such as, to be flooded with a large amount of profile in transformer station, but the equipment that title is different, for avoiding misleading user and shooting by mistake, preferably surveyed area is set.Overlapping display surveyed area on infrared thermal imagery, user is easy to the approximate location, size etc. of understanding captured subject thermal imagery, is convenient to take reference.But surveyed area also can not show.Preferably, by the information to arrange in the relevant surveyed area of check processing, detection window etc., together with subject identifying information, be associated with subject information.

The detecting unit of test section 8, based on the thermal-image data in the detection window set by detection window setting unit, according to subject identifying information, calculates the degree of correlation of the two.

For the example of the detection of multiple detection window, as shown in figure 11, test section 8 from the upper left corner of the regulation surveyed area G4 of thermal-image data frame 1101 to lower right corner moving window J4 to detect, the thermal-image data in cutout window, and the degree of correlation detecting itself and template image T4.Specifically, window J4 moves with the window shifts of setting (such as a pixel) to the right step by step from left end, and after arrival right-hand member, is set up and returns left end and move down window shifts, and again move right step by step subsequently.For detecting subject accurately, the transformation range of the anglec of rotation of the window size detected, window shifts, window is predefined, the variation range of such as window size is from 150 × 50 pixels to 120 × 40 pixels, the variation range of window shifts is from 11 pixels to 1 pixel, and the variation range of the anglec of rotation of window is 0 ° to 10 ° based on central point.Successively, each 5 pixels ground changes window size to test section 8, and each 1 pixel ground changes window shifts, and each 2 ° of ground change the window anglecs of rotation.Now, test section 8 carries out the relatedness computation of template image T4 and thermal-image data frame 1101; After the detection completing all detection windows, the position, size etc. that obtain the highest detection window of the degree of correlation arrange relevant information with analyzed area.Note, based on subject identifying information, can calculate the various methods of the degree of correlation of thermal-image data frame, the above-mentioned process exemplified is only can the example of using method.

The change of the display interface in shooting process is described with reference to Figure 13; Figure 14 illustrates the control flow of the reference pattern of the thermal image device 100 of embodiment 4.

Step D01-step D05, roughly the same with the steps A 01-A05 in embodiment 1, eliminates repeated description.Assuming that have selected subject information " subject 4 ";

In step D06, feature registration unit registration subject identifying information; Then, in step D07, read the thermal-image data frame in interim storage part 2, detection window setting unit, be arranged in size and the position of infrared thermal imagery according to reference picture T4, the central point multiplying gauge certainty ratio based on reference picture T4 arranges surveyed area G4; Further, based on the upper left corner of surveyed area G4, the measure-alike detection window J4 with reference picture T4 is provided with; As shown in 1301 in Figure 13, surveyed area and contour images T4 can be overlapped in infrared thermal imagery jointly and show as reference image, user is easy to the approximate location, size etc. of understanding captured subject thermal imagery, is convenient to take reference.But surveyed area Q4, contour images T4 also can not show.

Thereafter, step D08, carries out check processing, calculates the thermal-image data of detection window and the degree of correlation of template T4, and in step D09, the location parameter of the value of the degree of correlation detected and corresponding detection window is stored in the regulation region of interim storage part 2;

In step D10, when test section 8 judges to arrange detection window in thermal-image data frame, whether calculate the degree of correlation for all detection windows.If residue does not also calculate the region (being no in step D10) of the degree of correlation, get back in step D07, detection window setting unit says the position skew intended pixel number of detection window in a predetermined direction, this position is set to the next position of detection window, and repeats follow-up process.

If calculate the degree of correlation (being yes in step D10) for all detection windows that will arrange in thermal-image data frame, in step D11, then select the value of obtained maximum relation degree, compare with the judgment value of regulation in step D12, if specific shot body heat picture detected

Then in step D13, the configuration of analyzed area is carried out according to the detected region with the detection window of the specific shot body heat picture of maximum relation degree, a kind of mode that analyzed area is arranged is illustrated in 1302 of Figure 13, by the detection window J40 corresponding to maximal correlation angle value, be set to analyzed area J40.Equally, this analyzed area not must show.

Step D14, according to set analyzed area J40, analyzes the thermal-image data frame of regulation and diagnoses, and such as, to detecting that the thermal-image data frame of specific shot body heat picture is analyzed and diagnoses, exports diagnostic result.As specific shot body heat picture do not detected at D12; Get back to step D04, repeat follow-up process.Further, the thermal-image data frame of regulation also can be detect there is specific shot body heat picture thermal-image data frame sequential after the frame of specified quantity that obtains of acquisition unit, with this, the burden of test section 8 continuous detecting can be reduced.

In the field of infrared detection, owing to considering the difference of value etc. of the position of specific shot body heat picture in thermal-image data frame, size, angle of inclination, the degree of correlation, corresponding different shooting quality; Therefore, such as consider that above-mentioned factor is as the factor generating corresponding different analyzed area, improves the quality of analysis.

Thus, when test section 8 is configured to the multiple provisioning information detecting subject thermal imagery, analysis portion 6 can detect according to test section 8 provisioning information obtained, and arranges the analyzed area of identical or different diagnosis effect and/or analytical model and/or diagnostic rule, carries out analyzing and diagnosing.

In the present embodiment, the evaluation of estimate of information acquisition and the table of comparisons (or corresponding relation) of analyzed area (can be the composition data of analyzed area or the computation rule of regulation calculating object) and/or analytical model and/or diagnostic rule arrange analyzed area and/or analytical model and/or diagnostic rule according to the rules.Such as, the combination of different analyzed area that different evaluations of estimate is corresponding, analytical model, diagnostic rule, thus, carries out analyzing and diagnosing.

The table of comparisons of evaluation of estimate as shown in figure 15 and analyzed area, analytical model, diagnostic rule, analyzed area, analytical model, diagnostic rule that wherein evaluation of estimate 80-90% is corresponding; With evaluation of estimate 91%-100%, corresponding analyzed area, analytical model, diagnostic rule; The two is different.

Comprehensive evaluation of estimate is obtained by provisioning information, such as, the different coefficient of the correspondence of the customizing messages in detected provisioning information can have been adopted, and obtained evaluation of estimate by the provisioning information of other in detected provisioning information in conjunction with this coefficient, such as, as shown in Figure 16, corresponding 0.8 of Figure 16 (a) detection window J1, and the window coefficient of Figure 16 (b) detection window J2 is 0.95, value × the window coefficient of evaluation of estimate=degree of correlation, therefore, when the same thermal-image data of the degree of correlation being detected in two windows, the value of the degree of correlation detected by Figure 16 (b) will be greater than the evaluation of estimate (be such as scaled 80%) of value in conjunction with detection window J1 of Figure 16 (a) degree of correlation in conjunction with the evaluation of estimate (being such as scaled 95%) of detection window J2, analyzed area corresponding to evaluation of estimate, obtain the analyzed area J1 of Figure 16 (a), and the analyzed area J2 of Figure 16 (b) and F1, with each self-corresponding analytical model, diagnostic rule.The detection window of specific shot body heat picture detected, such as represent this specific shot body heat picture location parameter roughly (position or also comprise size or also comprise the anglec of rotation), the location parameter of more accurate specific shot body heat picture is obtained as expected, an embodiment, the profile that can extract specific shot body heat picture further from thermal-image data corresponding to this detection window obtains, and obviously can obtain evaluation of estimate more accurately.

In addition, also can adopt the weight shared by different information, obtain evaluation of estimate by weighting.Final evaluation of estimate can be obtained by various different account form.

Preferably, prepare the table of comparisons between the evaluation of estimate of information acquisition according to the rules and analyzed area and/or analytical model and/or diagnostic rule in advance according to different subjects, and with the corresponding stored such as subject information, subject identifying information in Fig. 3.

Step D15, judges whether to exit, and as do not exited, then gets back to step D04.

In addition, from thermal-image data frame when search and the frame part that template image T4 is similar, for when amplifying and reduce and detection window J4 is rotated the detection window after predetermined angular, the check processing of similar above-mentioned explanation is also carried out.

In addition, the edge contour of the subject thermal imagery that also can extract according to the detection window of maximum relation degree, or thus obtained relevant composition data (such as, according to profile calculate the analyzed area of acquisition), arrange analyzed area; Or according to detect obtain provisioning information, the position of such as specific shot body heat picture and size etc., with reference to image according to this position and size, to reference picture self or carry out regulation calculate generate analyzed area.

The distortion of embodiment 4, when some is applied, whether specific subject thermal imagery is detected to shooting, be not limited to comparing between the value of the degree of correlation and the judgment value of regulation, also by changing to such as according to the comparative result of the fiducial value of the provisioning information and/or evaluation of estimate and correspondence that detect acquisition, as foundation specific shot body heat picture being detected.Wherein, described provisioning information, at least comprises the information of a kind of or combination in any in the value of the position of specific shot body heat picture, size, angle of inclination, the degree of correlation.

As mentioned above, in the present embodiment, not only can obtain the effect of embodiment 1, owing to being provided with multiple detection window, the operation easier that vision is aimed at can be lowered, and, the accuracy of detection of subject can be improved, detection window according to maximum relation degree arranges analyzed area, and what can increase substantially analyzed area arranges precision.Further, the overlapping position of subject thermal imagery IR4 that detects and the analyzed area J40 of size in infrared thermal imagery, common user easily grasps this shooting technical ability.Reach raising accuracy of detection, thus improve analyzed area precision and diagnostic accuracy are set, and simplify user and aim at the beneficial effects such as the operation of subject shooting according to reference picture.

Embodiment 5

Also supplementary according to the rules and test section 8 can detect the provisioning information obtained and obtain evaluation of estimate, according to the table of comparisons (or corresponding relation) of evaluation of estimate and analyzed area and/or analytical model and/or diagnostic rule, analyzed area and/or analytical model and/or diagnostic rule are set, and carry out analyzing and diagnosing.

Described provisioning information, at least comprises the information of a kind of or combination in any in the value of the position of specific shot body heat picture, size, angle of inclination, the degree of correlation.Described supplementary, at least comprise the information of a kind of or combination in any in assay value, diagnostic result, environment temperature, contextual factor, wind speed, humidity, distance, and other supplementarys obtained by thermal image device 100 (comprise and undertaken arranging by user), comprise other and various analysis portion 6 is determined that the influential factor of analyzed area and/or analytical model and/or diagnostic rule is all in its scope.

In the application of infrared detection, according to the difference of above-mentioned supplementary, the quality of the thermal-image data frame obtained and significance level difference, should have different conditions to deal with the process such as comparison, selection, notice of the thermal-image data frame of regulation; Such as, when there is the assay value of the correlative value (threshold values of such as defect) being greater than regulation in the specific shot body heat picture obtained, represent subject and there is defect, so, even if at this moment when the degree of correlation close to, also preferential more careful analysis and diagnosis are carried out to the thermal-image data frame that assay value exceeds standard, significant to infrared detection; And to not being greater than the subject thermal imagery of correlative value of regulation, and unnecessaryly carry out careful analysis and diagnosis, in order to avoid analyzing and diagnosing result data too much disturbs the observation of user to analyzing and diagnosing result.Such as consider environment temperature, background, wind speed, contextual factor (the such as otherness of background and subject thermal imagery, the heterogeneity phantom etc. of background) etc. influence factor, when the degree of correlation close to, these influence factors may cause the value of different thermal imagery quality and subsequent analysis diagnosis to reduce, and different analyzed areas and/or analytical model and/or diagnostic rule should be selected to reduce the impact of other influences factor interference.

Wherein, supplementary, such as can obtain above-mentioned supplementary according to thermal image device 100 or with the parts (not shown) of the corresponding function be connected in thermal image device 100, such as, (assay value is not limited to temperature value to obtain assay value by analysis portion 6 self, such as, also can be AD value, color value in pseudo-color thermal imagery, the ratio of specific picture numerical value, or also by these numerical value according to the rules formulae discovery obtain value etc., the assay value that analysis portion 6 obtains can for the whole pixel in thermal-image data frame or the pixel in particular analysis region), diagnostic result, environment temperature is obtained by temperature sensor, humidity is obtained by hygrometer, the distance etc. of thermal image device 100 and subject is obtained by stadimeter.Supplementary also can obtain according to the above-mentioned supplementary prestored in storage medium, such as, and the historical data of supplementary; Or the supplementary that the contrast of the historical data of supplementary prestored in the supplementary combined when pre-test obtains and storage medium obtains.

Comprehensive evaluation of estimate is obtained by provisioning information and supplementary; Such as, the customizing messages in provisioning information or supplementary can have been adopted corresponding different coefficient, and obtain evaluation of estimate by other provisioning information or supplementary in conjunction with this coefficient.Or also can adopt weight shared by different information, obtain evaluation of estimate by weighting; Such as, obtain the evaluation of estimate that obtains of value combining the position of specific shot body heat picture, size, angle of inclination, supplementary, the degree of correlation, such as obtain comprehensive evaluation value according to following formula, the value × degree of correlation weighting coefficient of the weighting coefficient+degree of correlation of comprehensive evaluation value=position × position weighting coefficient+size × size weighting coefficient+angle of inclination × angle of inclination weighting coefficient+supplementary × supplementary.Or obtain evaluation of estimate according to the table of comparisons of described provisioning information and described supplementary and comprehensive evaluation value.

Then, according to the table of comparisons of evaluation of estimate and analyzed area and/or analytical model and/or diagnostic rule, decide analyzed area and/or analytical model and/or diagnostic rule, and carry out analyzing and diagnosing.

Embodiment 6

Embodiment 6, there is recording unit, for analyzed area that above-described embodiment is obtained and/or analysis result and/or diagnostic result, with the thermal-image data frame (such as there is the thermal-image data frame of maximum relation degree) of the thermal-image data frame such as detected specific shot body heat picture of regulation, associated record.

Control part 11 possesses recording unit (not shown), carries out the control of recording.Such as based on the testing result of test section 8, response record indicates, and selects the thermal-image data frame that will experience described recording processing, and perform the control selected thermal-image data frame being carried out to recording processing from interim storage part 2 in the thermal-image data frame stored.Preferably, the thermal-image data frame of regulation and regulation recorded information are carried out associated record.

Wherein, the thermal-image data frame of described regulation is take the thermal-image data frame obtained and/or the data obtained after carrying out predetermined processing by the thermal-image data frame that shoot part 1 shooting obtains by shoot part.The one or simultaneously multiple that predetermined processing is such as revised, interpolation, puppet are color, be converted to Temperature numerical, fall the process such as pixel, compression.

In the present embodiment, be the moment of response record instruction, what keep in interim storage part 2 regulation region detects specific shot body heat picture and is provided with the thermal-image data frame corresponding to analyzed area.In addition, also can be the moment (or regulation moment afterwards) judging to detect specific shot body heat picture, the thermal-image data frame obtained by infrared eye reading signal; In addition, also can be the maximum thermal-image data frame of the degree of correlation selected in multiframe thermal-image data frame stored from interim storage part 2; In addition, also can be the multiframe thermal-image data frame recording specified quantity; In addition, also can being the thermal-image data frame that the multiframe thermal-image data of specified quantity obtains through predetermined processing, obtaining the frame thermal-image data after this process as carried out integral operation to the multiframe thermal-image data stored in interim storage part 2.Can be one or more of thermal-image data that these situations obtain, the temperature value of each pixel that thermal-image data obtains as recorded simultaneously and the view data of infrared thermal imagery.

Wherein, regulation recorded information, such as set analyzed area and/or analysis result and/or diagnostic result, comprise the location parameter (position, or also comprise size, or also comprise the anglec of rotation) that analyzed area is arranged in infrared thermal imagery.

Specifically, a kind of embodiment, recording unit controls, and the thermal-image data frame after regulation recorded information and compression is associated, and Heat of Formation to storage card 8, terminates this process as file record.An embodiment for associated record, adds the information of regulation recorded information as the thermal-image data frame of prescribed form.In addition, associated record process also refer to regulation recorded information can be recorded in the message file of thermal imagery file association or index file medium, recording unit can generate this message file or index file.

In addition, the storage medium of record is not limited to storage card 8, flash memory 9 etc., also can be the network destination by communication section 4 communication.

Other embodiments

Illustrate respectively the thermal image device 100 of example in the above-described embodiments, be obviously applicable to the various thermal image device of portable shooting or online shooting, but the present invention is not only applicable to the thermal image device with shoot function, being also applicable to the thermal imagery treatment facility receiving and process thermal imagery, obtaining thermal-image data frame as read thermal imagery file, as received and process the thermal imagery treating apparatus of thermal imagery (as obtained thermal-image data frame chronologically) continuously from outside (as computing machine, personal digital assistant, with the matching used display device of thermal image device etc. of shoot function), this thermal imagery treating apparatus is such as computing machine, by the communication port (example of acquisition unit, such as according to USB, 1394, the communication specifications such as network, thermal imagery treating apparatus is connected with external unit) carry out wired or wireless connection with thermal image device, by accepting the thermal-image data frame that connected thermal image device exports continuously, realize examples of implementation, the processing modes such as its check processing and above-mentioned embodiment are roughly the same, eliminate explanation.

Further, be not limited to shooting or obtain thermal-image data frame from outside, also can be used as a component parts in thermal image device or thermal imagery treating apparatus or functional module, such as, obtain thermal-image data frame from miscellaneous part, at this moment, also form embodiments of the present invention.

In addition, preferably there is notification unit, for notice (as advice methods such as display, voice) diagnostic result as diagnosis; Also other advice method can being adopted as changed the Show Color etc. of reference picture, notifying diagnostic result, but also can as diagnostic result passed through the network destination of communication I/F4 communication.

Further, not only can detect the overall region of whole subject, and detect multiple detection windows subject being divided into multiple parts formation, like this, can more accurately detect; Wherein, for each parts, identical with entirety, prepare corresponding subject identifying information (can be template or characteristic quantity).Also according to multiple characteristic quantities of template, the multiple characteristic of correspondence amounts in corresponding detection window can be calculated, and the correlative value corresponding to multiple characteristic quantity, obtain judged result, such as, according to the weighting of multiple characteristic quantity, obtain final judged result.Also according to multiple characteristic quantity, can first calculating the comparative result of one of them characteristic quantity and infrared thermal imagery, when being greater than the threshold values of regulation, calculating the comparative result of next characteristic quantity and infrared thermal imagery, according to repeatedly comparing, obtaining final judged result.

In an embodiment, surveyed area can be shown as reference image or part; Obviously, when reference picture embodies morphological feature, also can be arranged in the location parameter of infrared thermal imagery according to this reference picture, surveyed area (as carried out the surveyed area that multiplying gauge certainty ratio obtains according to the outsourcing rectangle of reference picture) is set; Can accelerate check processing speed and guarantee take quality.

Further, to whether specific shot body heat picture being detected, comparing between the value of the degree of correlation and the judgment value of the degree of correlation is not limited to; Also can be deformed into, such as according to the evaluation of estimate detecting evaluation of estimate that the provisioning information, the provisioning information that obtain obtain, provisioning information and supplementary obtain, wherein one or more, or also combine the evaluation of estimate of supplementary, supplementary acquisition, wherein one or more, with comparing of the judgment value specified, determine whether specific shot body heat picture being detected.Preferably, according to the value of the position detected, size, angle of inclination, the degree of correlation, and/or the evaluation of estimate of these information acquisitions, with comparing of specific correlative value, determine whether specific shot body heat picture being detected.

In addition, also can be deformed into, such as according to the evaluation of estimate detecting evaluation of estimate that the provisioning information, the provisioning information that obtain obtain, provisioning information and supplementary obtain, wherein one or more, or also combine the evaluation of estimate of supplementary, supplementary acquisition, wherein one or more, with the corresponding relation of analysis configuration information, arranges analyzed area.And do not judge whether specific shot body heat picture to be detected.

At above-mentioned example, be describe according to certain order of steps, but various sequencing can be had according to different embodiments, be not limited to the processing order described by above-mentioned example.When control part 11 and image processing part etc. contain multiple processor, the parallel processing that part steps is suitable for also may be there is.

Storing the storage medium of subject identifying information etc., can be the storage medium in thermal image device 100, as non-volatile memory mediums such as flash memory 3, storage cards 6, and the volatile storage medium such as interim storage part 2; Can also be other storage mediums of being connected wired or wireless with thermal image device 100, as by with the storage medium of communication I/F4 wired or wireless other devices be connected as the storage medium in other memory storages, thermal image device, computer etc. or network destination.

In addition, example exemplifies using the application of the subject of power industry as scene, and the every profession and trade being also useful in infrared detection is extensively used.

Although the functional block that can be realized in accompanying drawing by hardware, software or its combination, does not need to arrange the structure carrying out practical function block with man-to-man corresponded manner usually.The block of multiple function can be realized by a software or hardware module.Or the block of a function is also realized by multiple software or hardware cell.In addition, process and the controlling functions of the part or all of function part in embodiments of the present invention also can be realized with special circuit or general processor or programmable FPGA.

The above-mentioned described object lesson (embodiment) being only invention, variously exemplifies explanation and does not limit essence of an invention Composition of contents, and various embodiment is replaced accordingly and combined, and can form more embodiment.Those skilled in the art can carry out other modifications and variations after having read instructions to embodiment, and does not deviate from essence of an invention and scope.

Claims (19)

1. thermography analysis inking device, comprises,

Acquisition unit, for obtaining thermal-image data frame;

Display control unit, for controlling the infrared thermal imagery making display obtain based on obtained thermal-image data frame, and reference picture;

Test section, for based on the thermal-image data frame obtained, detects the provisioning information relevant with specific shot body heat picture;

Analysis configuration portion, for detecting the provisioning information obtained according to test section, configurable one or more as follows: the composition data of analyzed area, the location parameter of analyzed area, analytical model, diagnostic rule.

2. thermography analysis inking device as claimed in claim 1, is characterized in that,

Described analysis setting unit, according to following factor:

1) provisioning information

2) supplementary;

3) evaluation of estimate that obtains of provisioning information;

4) evaluation of estimate that obtains of supplementary;

5) evaluation of estimate that obtains of provisioning information and supplementary;

Wherein one or more, corresponding relation with one or more in the location parameter of the composition data of analyzed area, analyzed area, analyzed area, analytical model, diagnostic rule, arranges in corresponding analyzed area, analytical model, diagnostic rule one or more.

3. thermography analysis inking device as claimed in claim 2, is characterized in that,

Analyzed area corresponding to Different factor and/or analytical model and/or diagnostic rule, can be the analyzed area of identical or different analytical effect and/or analytical model and/or diagnostic rule, and/or, the analyzed area of identical or different display effect.

4. thermography analysis inking device as claimed in claim 2, is characterized in that, described provisioning information, at least comprises the information of a kind of or combination in any in the value of the position of specific shot body heat picture, size, angle of inclination, similarity; Described supplementary, at least comprises the information of a kind of or combination in any in assay value, environment temperature, wind speed, contextual factor, humidity, distance.

5. thermography analysis inking device as claimed in claim 1, is characterized in that,

Described analysis configuration portion, according to the location parameter of specific shot body heat image position in thermal-image data frame detected, carrys out the location parameter in Allocation Analysis region, the position of configurable analyzed area, or position, size, or position, size, the anglec of rotation.

6. thermography analysis inking device as claimed in claim 5, is characterized in that,

According to the position of the specific shot body heat image position detected in thermal-image data frame and size, position and size that analyzed area is put in establishing can be come; Or according to the position of specific shot body heat image position in thermal-image data frame detected, size, angle of inclination, the position in Allocation Analysis region, size, the anglec of rotation can be come.

7. thermography analysis inking device as claimed in claim 5, is characterized in that,

Described analysis configuration portion, according to the composition data of the analyzed area associated with subject identifying information, determines the composition data of described analyzed area; According to the analyzed area that this analyzed area composition data obtains, with the assigned position relation of subject identifying information, and the location parameter of specific shot body heat image position in thermal-image data frame detected, determine the location parameter of analyzed area.

8. thermography analysis inking device as claimed in claim 1, is characterized in that having

Described analysis configuration portion, for the analytical model, the diagnostic rule that associate according to the composition data of analyzed area, the analyzed area that the composition data configuring described analyzed area obtains, corresponding analytical model, diagnostic rule.

9. thermography analysis inking device as claimed in claim 7, is characterized in that

Selection portion, for selecting subject information;

Described reference picture, for according to selected subject information, the composition data of the reference picture associated by it, and the reference picture obtained;

Described test section, according to selected subject information, based on the subject identifying information of this subject information association, detects the provisioning information relevant with specific shot body heat picture;

Described analysis configuration portion, for detecting the provisioning information obtained according to test section, based on composition data, analytical model, the diagnostic rule wherein or multi-thread of the analyzed area of described subject identifying information association, configure corresponding analyzed area, analytical model, diagnostic rule.

10. thermography analysis inking device as claimed in claim 5, is characterized in that,

Described analysis configuration portion, to regulation calculating object according to the rules computation rule calculate, and based on the location parameter of the specific shot body heat picture detected, come Allocation Analysis region;

Described regulation computation rule, at least comprise feature extraction, convergent-divergent, distortion, segmentation, shearing, decile, calculating outsourcing rectangle are carried out to described regulation calculating object, calculate inscribe rectangle, computing center's line, calculate unique point, calculate in envelope, calculate in enveloping outer enclosure one or more.

11. thermography analysis inking devices, comprise,

Acquisition unit, for obtaining thermal-image data frame;

Display control unit, for controlling the infrared thermal imagery making display obtain based on obtained thermal-image data frame, and reference picture;

Test section, for based on the thermal-image data frame obtained, detects whether have specific shot body heat picture;

Analysis configuration portion, for according to test section testing result, configurable one or more as follows: the composition data of analyzed area, the location parameter of analyzed area, analytical model, diagnostic rule.

12. thermography analysis inking devices as claimed in claim 11, is characterized in that

The location parameter of described analyzed area, for having assigned position relation according to this analyzed area and reference picture, and reference picture is arranged in the location parameter of infrared thermal imagery, configures; Or the position parameter data of thermal-image data frame is arranged according to analyzed area, configure.

13. thermography analysis inking devices as claimed in claim 12, is characterized in that

Selection portion, for selecting subject information;

Described reference picture, for according to selected subject information, the composition data of the reference picture associated by it, and the reference picture obtained;

Described test section, according to selected subject information, based on the subject identifying information of this subject information association, detects the provisioning information relevant with specific shot body heat picture;

Described analysis configuration portion, for according to test section testing result, the composition data of the analyzed area associated based on described reference picture, analytical model, diagnostic rule are wherein one or more, configure corresponding analyzed area, analytical model, diagnostic rule.

14. thermography analysis inking devices as described in claim 1-13 any one, is characterized in that

Have recording unit, for response record instruction, one or more by the location parameter of the composition data of set analyzed area, analyzed area, analyzed area, analytical model, diagnostic rule, is associated with the thermal-image data frame of regulation and carries out record.

15. thermography analysis inking devices as described in claim 1-13 any one, it is characterized in that, there is analyzed area setting unit, according to the composition data of configured analyzed area and/or the location parameter of analyzed area, analyzed area is arranged to obtained thermal-image data frame.

16. thermography analysis inking devices as described in claim 1-13 any one, it is characterized in that, there is analysis portion, for determined one or more as follows according to analysis configuration portion: the composition data of analyzed area, the location parameter of analyzed area, analytical model, analyze.

17. thermography analysis inking devices as described in claim 1-13 any one, is characterized in that,

There is diagnostics division, for diagnosing obtained thermal-image data frame, wherein, at least comprise according to analysis configuration portion configure one or more as follows: the composition data of analyzed area, the location parameter of analyzed area, analytical model, diagnostic rule, diagnose.

18. thermography analysis collocation methods, comprise,

Obtaining step, for obtaining thermal-image data frame;

Display and control step, for controlling the infrared thermal imagery making display obtain based on obtained thermal-image data frame, and reference picture;

Detecting step, for based on the thermal-image data frame obtained, detects the provisioning information relevant with specific shot body heat picture;

Analysis configuration step, for detecting the provisioning information obtained according to detecting step, configurable one or more as follows: the composition data of analyzed area, the location parameter of analyzed area, analytical model, diagnostic rule.

19. thermography analysis collocation methods, comprise,

Obtaining step, for obtaining thermal-image data frame;

Display and control step, for controlling the infrared thermal imagery making display obtain based on obtained thermal-image data frame, and reference picture;

Detecting step, for based on the thermal-image data frame obtained, detects whether have specific shot body heat picture;

Analysis configuration step, for according to detecting step testing result, configurable one or more as follows: the composition data of analyzed area, the location parameter of analyzed area, analytical model, diagnostic rule.