CN103900703A - Infrared matching updating device and infrared matching updating method - Google Patents

Infrared matching updating device and infrared matching updating method Download PDF

Info

Publication number
CN103900703A
CN103900703A CN201210581674.6A CN201210581674A CN103900703A CN 103900703 A CN103900703 A CN 103900703A CN 201210581674 A CN201210581674 A CN 201210581674A CN 103900703 A CN103900703 A CN 103900703A
Authority
CN
China
Prior art keywords
thermal
image data
correlative value
value
data frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201210581674.6A
Other languages
Chinese (zh)
Inventor
王浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Original Assignee
Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Mission Infrared Electro Optics Technology Co Ltd filed Critical Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Priority to CN201210581674.6A priority Critical patent/CN103900703A/en
Priority to CN202211002685.4A priority patent/CN116358711A/en
Publication of CN103900703A publication Critical patent/CN103900703A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention provides an infrared matching updating device and an infrared matching updating method and relates to the application field of a thermal image device, a thermal image processing device and infrared thermal imaging detection. According to a thermal image device in the prior art, during shooting, a thermal image of an object under shooting is shot based on the subjective experience of a user, so that the workload is heavy and the quality of the thermal image is hard to guarantee. According to the infrared matching updating device and the infrared matching updating method provided in the invention, a reference image and the infrared thermal images are displayed jointly; when a detection indication is responded, prescribed information of thermal images of a specific object under shooting in a plurality of frames of thermal image data frames in a storage medium can be detected; or with the factor of auxiliary information taken into consideration, and in the comparison of prescribed comparison values, the prescribed comparison values are updated based on prescribed conditions, so that the optimal thermal image data frame can be obtained by comparison of the thermal image data frames obtained continuously; further processing or operation, such as selection, notification, analysis and storage and the like can be carried out favorably; and the shooting operation is simple and the quality of the thermal image is good.

Description

Infrared coupling updating device and infrared coupling update method
Technical field
Infrared coupling updating device of the present invention and infrared coupling update method, relate to hand-held shooting or the online various thermal imagery devices of taking, and receives and process the thermal imagery treatment facility of thermal imagery, and the application of infrared detection.
Background technology
Since the application of thermal imagery detection technique, user is the puzzled cognition of subject imaging form and the control of shooting distance under to correct shoot part position, shooting angle always, these depend on user's subjective idea and experience, cause at present if guarantee that the quality detecting needs the thinking of shooting limit, limit, shooting speed is very slow, if pick up speed, easily omits crucial position or the subject defect of taking, affect the effect of state estimation.Conventionally need the practice accumulation of several years, user just can reach higher detection level.
Those skilled in the art is attempting to address this problem always, there is such technology, the reference picture that has embodied the predetermined morphological feature of subject is carried out to continuous overlapping demonstration with the infrared thermal imagery of taking acquisition, user is using this reference picture as the vision reference of taking subject thermal imagery, carry out the shooting of subject, guarantee morphological feature correct of position, size and the subject thermal imagery of subject thermal imagery in infrared thermal imagery, to have guaranteed the quality of taking.For example patent documentation application number: 201210008404.6 disclose such thermal imagery filming apparatus.
But aforesaid way needs user manually to judge the matching degree of reference picture and subject thermal imagery by vision, user easily produces visual fatigue; When use be hand-held thermal imagery device time, aim at the processing ease fatigue of taking, time of the shooting that aiming repeatedly extends, and affected the thermal imagery quality of taking.And it is stiff that this mode operates, requiring that shooting is aimed at is high.
Therefore, understand need a kind of infrared coupling updating device, it can reach without depending on the subjective idea of user unduly, can be convenient to automatically compare the superior in quality thermal-image data frame of the condition of conforming with the regulations from obtained thermal-image data frame; Be beneficial to that follow-up selection, notice, analysis, storage etc. are processed or operation, thereby make simple to operately, the thermal-image data frame quality of acquisition is high,
Summary of the invention
The invention provides a kind of infrared coupling updating device and infrared coupling update method, jointly show reference picture with infrared thermal imagery, in the time that response detects indication, can detect the provisioning informations such as position, size, the angle of inclination of the specific shot body heat picture in the thermal-image data frame of the multiframe part in storage medium, the value of the degree of correlation, or also consider the factor of supplementary, and with regulation correlative value relatively in, condition is in accordance with regulations upgraded the correlative value of regulation, can from the thermal-image data frame obtaining continuously, compare optimum thermal-image data frame with this.Be beneficial to further select, notify, analyze, storage etc. processed or operation.Thereby make the simple to operate of shooting, shooting speed is fast, and thermal imagery quality is high.For example, and the present invention is also applicable to detect qualified thermal-image data frame the thermal-image data frame (being obtained from thermal imagery file) from a large amount of processing.
For this reason, by the following technical solutions, infrared coupling updating device, has in the present invention,
Acquisition unit, for obtaining continuously thermal-image data frame;
Reference picture specifying part, is used to specify the composition data of reference picture;
Position setting unit, for arranging the location parameter of reference picture;
Display part, for the infrared thermal imagery that shows that reference picture and the thermal-image data frame obtaining continuously obtain;
Thermal imagery storage part, the multiframe thermal-image data frame obtaining for storing described acquisition unit;
Test section, for responding the indication of regulation, the multiframe thermal-image data frame based on storing in thermal imagery storage part, detects the provisioning information relevant with specific shot body heat picture in thermal-image data frame;
Comparing section, compares for test section being detected to the provisioning information obtaining and/or the evaluation of estimate obtaining based on detecting the provisioning information of acquisition and the correlative value of regulation;
Correlative value renewal portion, for upgrading correlative value;
Wherein, after correlative value is upgraded, described comparing section, the evaluation of estimate obtaining for test section being responded to follow-up regulation indication, detect the provisioning information obtaining and/or the provisioning information obtaining based on detection, compares with the correlative value after upgrading.
Infrared coupling update method of the present invention, has,
Obtaining step, for obtaining continuously thermal-image data frame;
Reference picture given step, is used to specify the composition data of reference picture;
Position setting steps, for arranging the location parameter of reference picture;
Step display, for the infrared thermal imagery that shows that reference picture and the thermal-image data frame obtaining continuously obtain;
Thermal imagery storing step, the multiframe thermal-image data frame obtaining for storing described obtaining step;
Detecting step, for responding the indication of regulation, the multiframe thermal-image data frame based on storing in thermal imagery storing step, detects the provisioning information relevant with specific shot body heat picture in thermal-image data frame;
Comparison step, compares for detecting step being detected to the provisioning information obtaining and/or the evaluation of estimate obtaining based on detecting the provisioning information of acquisition and the correlative value of regulation;
Correlative value step of updating, for upgrading correlative value;
Wherein, after correlative value is upgraded, described comparison step, the evaluation of estimate obtaining for detecting step being responded to follow-up regulation indication, detect the provisioning information obtaining and/or the provisioning information obtaining based on detection, compares with the correlative value after upgrading.
Other aspects of the present invention and advantage will be set forth by instructions below.
Accompanying drawing explanation:
Fig. 1 is the block diagram that represents the summary formation of the thermal imagery device 100 of embodiments of the invention 1.
Fig. 2 is the external form figure of the thermal imagery device 100 of embodiment 1.
Fig. 3 is the schematic diagram of subject information, the subject identifying information etc. stored in embodiment 1 storage medium.
Fig. 4 is the schematic diagram of the detection window of different parameters.
Fig. 5 arranges the schematic diagram that detection window detects in surveyed area.
Fig. 6-Fig. 9 is the display case of the display interface of the control processing of embodiment 1.
Figure 10 is the control flow chart that represents embodiment 1.
Figure 11-12nd, represents the control flow chart of embodiment 2.
Figure 13 is the display case of the display interface of the control processing of embodiment 2.
Embodiment
To describe with reference to the accompanying drawings now exemplary embodiments of the present invention in detail.Note, the embodiment that below will illustrate is for understanding better the present invention, thus do not limit the scope of the invention, and can change the various forms in scope of the present invention.And, although the present invention in following examples for the thermal imagery capture apparatus of hand-held, shoot function not necessarily, can use any thermal-image data source that will carry out special object survey for the present invention.Therefore the present invention is widely used in to read and play or show and records thermal imagery or the thermal imagery treatment facility from outside reception and processing thermal imagery.Described thermal imagery treatment facility comprises devices as various in personal computer, personal digital assistant etc.
Embodiment 1
The infrared coupling updating device 100 of thermal imagery device 100(of embodiment 1) based on being taken the thermal-image data frame of acquisition by shoot part 1 and being stored in the multiframe thermal-image data frame (being thermal imagery signal frame) in interim storage part 2 here, indication according to the rules, detect the degree of correlation between multiframe thermal-image data frame and the subject identifying information of storing in interim storage part 2, and, the thermal-image data frame of the correlative value that be greater than regulation of thermal imagery device 100 based on obtaining for information about, is notified user.
Fig. 1 be represent the infrared coupling updating device 100 of embodiments of the invention 1 example thermal imagery device 100 summary form block diagram.
Particularly, thermal imagery device 100 has shoot part 1, interim storage part 2, flash memory 3, communication I/F4, storage card I/F5, storage card 6, image processing part 7, test section 8, display control unit 9, display part 10, control part 11, operating portion 12, control part 11 are connected with above-mentioned appropriate section with data bus 13 by controlling, and are responsible for the overall control of thermal imagery device 100.
Shoot part 1 is made up of not shown optics, lens driving parts, infrared eye, signal pre-processing circuit etc.Optics is made up of infrared optics lens, for the infrared radiation of reception is focused on to infrared eye.Lens driving parts drive lens to carry out according to the control signal of control part 11 and focus on or zoom operation.In addition also can be, the optics of manual adjustments.Infrared eye, as the infrared focal plane detector of refrigeration or non-refrigeration type, is converted to electric signal the infrared radiation by optics.Signal pre-processing circuit comprises sample circuit, A/D convertor circuit, timing trigger circuit etc., by signal processing such as the electric signal from infrared eye output sample within the cycle of regulation, be converted to digital thermal imagery signal through A/D convertor circuit, this thermal imagery signal is for example 14 or 16 s' binary data (being called again AD value).In embodiment 1, shoot part 1 is as the example of acquisition unit.
So-called thermal-image data, can be thermal imagery signal (the AD Value Data that infrared eye output signal obtains after AD conversion), or the view data of infrared thermal imagery, or the array data of temperature value, or other data that generate based on thermal imagery signal etc.Thermal-image data is take thermal imagery signal as example hereinafter.
Interim storage part 2 is as the volatile memory such as RAM, DRAM, carry out the memory buffer of interim storage as the thermal-image data frame that shoot part 1 is exported, for example be repeated below processing, by the thermal-image data frame interim store predetermined time of obtaining, and in the time obtaining new frame by described acquisition unit (shoot part 1), store new thermal-image data frame after deleting old frame; , work as the working storage of image processing part 7, test section 8, control part 11 etc. meanwhile, the data that temporary transient storage is processed.Be not limited to this, storer or register etc. that the processor inside such as image processing part 7, test section 8, control part 11 comprise also can be interpreted as a kind of temporary storage medium.
In interim storage part 2, distributed specific region to store the circulation memory block (thermal imagery storage part) of the thermal-image data frame of multiframe part (for example 50 frames), circulation storage is taken multiple thermal imagery signal frames of acquisition by shoot part 1 temporarily.Or also can configure separately the cyclic store of the thermal-image data frame that can temporarily store multiframe part (for example 50 frames).But be not limited to interim storage part 2, also can in other storage medium, distribute as thermal imagery storage part.
Flash memory 3, stores the program for controlling, and the various data that use in each several part control.In the present embodiment, as shown in Figure 3, the data relevant with reference picture, detection etc. are stored in flash memory 3, for example store the database (table 3) of subject identifying information, the composition data of the subject information of each subject, reference picture, subject identifying information is mutually corresponding, be stored in this property data base, in addition, also can store with the data file of specific format etc.The composition data of called reference image, for example vector figure data, dot matrix image data, also comprise the composition data that is made up of reference picture multiple coordinate points data.Wherein template can reference picture and identical or different.Subject information is the information relevant with subject, for example represent the information of subject place, type, numbering etc., in addition, can also exemplify the various information such as the relevant ownership unit of subject, classification grade (as electric pressure, important level etc.), model, manufacturer, performance and characteristic, the shooting in past or the resume of maintenance, build date, term of life.
Communication I/F4 is for example according to communication specifications such as USB, 1394, networks, thermal imagery device 100 is connected to the also interface of exchanges data with external device (ED), as external device (ED), for example, can enumerate personal computer, server, PDA(personal digital assistant device), other thermal imagery device, visible ray filming apparatus, memory storage etc.
Storage card I/F5, as the interface of storage card 6, on storage card I/F5, be connected with the storage card 6 as rewritable nonvolatile memory, be arranged in the draw-in groove of thermal imagery device 100 main bodys detachable, record the data such as thermal-image data according to the control of the record control unit of control part 11 (omitting diagram).
The processing that image processing part 7 stipulates for the thermal-image data frame to obtaining by shoot part 1, for example it is when the each arrival of Displaying timer, from be stored in the thermal-image data frame of stipulated time of described interim storage part 2 temporarily, select and read the frame of each specific time interval; The processing of image processing part 7 is as correction, interpolation, pseudo-color, synthetic, compression, decompress(ion) etc., is converted to and is suitable for showing the processing of using etc. data with, record.Image processing part 7 for example can adopt DSP or other microprocessors or programmable FPGA etc. to realize, or, also can be integrated with test section 8, processor that control part 11 is corresponding.
Image processing part 7 obtains the view data of infrared thermal imagery for shoot part 1 being taken to the processing of the thermal imagery signal enforcement regulation obtaining.Particularly, for example, image processing part 7 is taken to shoot part 1 the thermal imagery signal obtaining and is carried out the predetermined processing such as Nonuniformity Correction, interpolation, and the thermal imagery signal after predetermined processing is carried out to the color processing of puppet, obtains the view data of infrared thermal imagery; Pseudo-color a kind of embodiment of processing, for example determine the color table scope of corresponding puppet, the view data using the concrete color value of thermal imagery signal correspondence in pseudo-colored steel scope as its respective pixel position in infrared thermal imagery according to the setting range of the scope of thermal imagery signal (AD value) or AD value.The view data obtaining from pseudo-color processing of image processing part 7 is sent in the interim storage part 2 using as memory buffer.
So-called reference picture, refers to infrared thermal imagery and jointly shows, helps user and take the image of specific shot body.For example, embody the image of the morphological feature of this specific shot body; Reference picture can be also other shape, as square, circular; For example, embody subject thermal imagery be arranged in infrared thermal imagery expectation image space identification image; For example embody the identification image of the surveyed area (surveyed area can comprise one or more detection windows) in infrared thermal imagery; For example embody the identification image of the analyzed area of the subject thermal imagery of expecting etc.Preferred mode, location parameter according to the rules of reference picture (position or also comprise size, or also comprise the anglec of rotation) and the overlapping demonstration of infrared thermal imagery; In addition, reference picture also can be shown in display part, the region outside infrared thermal imagery window; In addition also the thumbnail of the relation such as position and dimension scale that represents reference picture and infrared thermal imagery can be presented at, to the region of the display part outside infrared thermal imagery window.
In embodiment, be shown in infrared thermal imagery as example take reference picture, image processing part 7 possesses synthesis unit (not shown), the composition data of described synthesis unit based on the specified reference picture of reference picture specifying part 11F, and the location parameter of position setting unit 11G setting, obtain reference picture, and with the infrared thermal imagery that image processing part 7 generates, after synthesizing, produce the view data of composograph.Specifically, image synthesis unit transparent rate according to the rules, synthesizes with reference to image and infrared thermal imagery; Comprise this situation, the transparent rate of reference picture is the string diagram picture that 1(is edge contour as reference picture), opaque synthetic with infrared thermal imagery.
Image processing part 7, for composition data and the set location parameter of position setting unit 11G of the reference picture based on specified, carries out predetermined processing to obtained thermal-image data frame, generates the infrared thermal imagery that has embodied reference picture.
In addition, synthetic can be also according to such processing, for example be arranged in the location of pixels of infrared thermal imagery according to reference picture, thermal-image data frame is carried out to the color processing of puppet, embodied the display image data (similar overlapping effect) of reference picture and infrared thermal imagery to generate; For example, according to the location of pixels that is arranged in infrared thermal imagery of reference picture, the thermal-image data of this location of pixels is not carried out to the color processing of puppet, carry out the color processing of puppet with reference to the thermal-image data beyond the location of pixels of image, then, in conjunction with the view data of reference picture, generate display image data.
Or, also can be with reference to the pixel of the location of pixels in the corresponding thermal-image data frame of image, carry out (as pseudo-color processing, generating with the image that embodies this reference picture with the color processing of the puppet difference processing of other thermal-image datas of putting as numerical digit that generate infrared thermal imagery.In this case, in thermal imagery device 100, can remove for reference to image and the synthetic image synthesis unit of infrared thermal imagery.
Test section 8 is based on interim storage part 2(thermal imagery storage part) the middle multiframe thermal-image data frame of storing, carries out the relatedness computation between subject identifying information; Wherein, can be that the part or all of thermal-image data frame in interim storage part 2 is carried out to Check processing, for example read successively whole thermal-image data frames and carry out Check processing, the thermal-image data frame that for example only reads predetermined distance carries out Check processing; For example, when detecting for the first time while being greater than the thermal-image data frame of correlative value with the degree of correlation and/or evaluation of estimate, no longer continue to detect; The scheduled operation that for example responds user starts to detect or stops detecting; Or carry out dwindling processing before also the thermal-image data in the thermal-image data frame reading or detection window being detected; With this, can alleviate the processing load that is accompanied by detection.
So-called thermal-image data, can be thermal imagery signal (AD value), or the view data of infrared thermal imagery, or the array data of temperature value, or other data based on thermal imagery signal acquisition etc.For example, the control of test section 8 based on control part 11, can take the thermal imagery signal frame obtaining by reading the shoot part 1 of storing in interim storage part 2, or the data (for example view data of the pseudo-color infrared thermal imagery of processing acquisition) of carrying out predetermined processing acquisition by reading the image processing part thermal imagery signal frame that 1 shooting obtains to shoot part of storing in interim storage part 2, the Check processing of the degree of correlation between the subject identifying information of carrying out and registering.Being not limited to shoot part 1 and taking the thermal-image data frame obtaining, can be also that the data of outside input obtain by predetermined processing, for example, by the I/F4 thermal imagery signal frame (or picture frame of infrared thermal imagery) that decoding obtains from other thermal imagery devices receive.Also can from recording medium, obtain, for example, from storage card 5, read thermal imagery file and obtain thermal imagery signal frame (or picture frame of infrared thermal imagery).
Test section 8 comprises feature registration unit, detection window setting unit, detecting unit (not shown).
Feature registration unit, for registering the subject identifying information relevant for relatedness computation.For example, can register subject identifying information according to subject identifying information pre-stored in storage medium; For example, according to the subject identifying information of the subject information association of user's selection, register the subject identifying information for relatedness computation.In addition, also can specify subject identifying information by user, for example can for example, by specifying subject region to obtain subject identifying information (template data, or the characteristic quantity extracting) from show image.The subject identifying information of registering is for example stored in the assigned position of interim storage part 2, or when storage is distinguished with other subject identifying informations of mark and storage.
So-called subject identifying information can be the template data for template matches; In addition, subject identifying information can be also the characteristic quantity of parametric description, so-called characteristic quantity features such as () point, line, surface, for example, for the value determining according to the state of the pixel comprising in detection window, as be central point, the area etc. of the profile of mean value, the specific shot body of ratio, the pixel value of the established part pixel in particular detection window.For example, for the subject 1 in table 3, subject identifying information is template data 301, and for the subject 2 in table 3, subject identifying information is characteristic quantity 302.In concrete application, can according to circumstances select the wherein combination of one or more modes.
Detection window setting unit, for arranging detection window.For example, according to the surveyed area of certain limit (as the G1 in Fig. 5), multiple detection windows (for example carrying out the parameter of predetermined detection window according to quality requirements) are set in this surveyed area G1, it can be the detection window of multiple different sizes, also can be the detection window after a nearly step tilts, as shown in Figure 4, the detection window that wherein Fig. 4 (a) is standard, Fig. 4 (b) is the detection window according to minification, Fig. 4 (c) is the detection window that up-sizing arranges, and Fig. 4 (d) is angle tilts to arrange according to the rules detection window.In order to equal the size of detection window, template image to be to dwindle or to amplify or the state that also tilts is used herein, or, also can prepare and template image that sizes of memory equals window size in order to using.In addition, also can by the thermal-image data in detection window with dwindle amplify or also tilt state used, with corresponding templates image.Detection window is not limited to square, can be also other shape, for example, can determine according to the shape of template.
Surveyed area can be arranged according to taking custom by user; Or can be also prestore as with subject information association; Also can generate according to the position that detected specific shot body heat picture last time; Surveyed area also can be set, and the scope of giving tacit consent to thermal-image data frame is surveyed area.Also can be that position and the size that user specifies arranges multiple detection windows.In addition, and nonessential multiple detection windows are set, a detection window also can be only set.
It should be noted that the application for infrared detection, for example, in transformer station, be flooded with a large amount of profiles similar, but the different equipment of title, for avoiding misleading user and mistake is taken, surveyed area is preferably set.The mark of overlapping demonstration surveyed area on infrared thermal imagery, user is easy to understand approximate location, the size etc. of captured specific shot body heat picture, be convenient to take reference, and can accelerate the speed of Check processing, but surveyed area also can not show.
Detecting unit, reads thermal-image data frame from interim storage part 2, by the thermal-image data based in the set detection window of detection window setting unit in read thermal-image data frame, according to subject identifying information, obtains the value for evaluating the degree of correlation.In the time being provided with multiple detection window, for example can be using the value of maximal correlation degree that wherein detects acquisition as the value of the degree of correlation of this thermal-image data frame.
The Check processing of test section 8 can be the detection mode based on template matches, and the thermal-image data based in detection window and template image carry out calculating and the comparison of the degree of correlation; For example, detecting unit calculate infrared thermal imagery in detection window and as the infrared thermal imagery of template mutually the difference between the pixel of corresponding position and, the difference calculating and less, the degree of correlation is higher.
Also can be configured to and extract the embodiment that mates of characteristic quantity, utilize and relatively carry out to determine the degree of correlation between the characteristic quantity of the thermal-image data in template and detection window.For example, extract the ratio of the specific pixel of the subject image in detection window, more approaching with the ratio of the specific pixel in template image, the degree of correlation is higher.
The Check processing of test section 8 can be also the detection embodiment of the characteristic quantity based on parametric description, the computing stipulating obtains the characteristic quantity of the thermal-image data in detection window, and compare with the reference value (subject identifying information) of characteristic quantity, obtain the value of the degree of correlation.For example, the ratio of the pixel that the reference value of described characteristic quantity is particular pixel values, detecting unit calculates the ratio of the pixel of particular pixel values in thermal-image data, compares with the reference value of characteristic quantity, obtains the value of the degree of correlation between the two.
Preferred mode, adopt the template of contour images as coupling, test section 8 for example calculates the degree of correlation by following processing, first, test section 8 extracts the thermal-image data that is arranged in detection window, according to the reservation threshold of AD value, the thermal-image data in the detection window reading is carried out to binaryzation; Then, extract the Contiguous graphics that the pixel with predetermined pixel value (1 or 0) of this bianry image is connected; Then judge whether this Contiguous graphics has the size of preset range; If judge the size of this Contiguous graphics in preset range, a nearly step is carried out relatively processing between the Contiguous graphics extracting and the template registered, for example calculate overlapping area between the two the ratio sum in the total area separately, thus, obtain the degree of correlation between the thermal-image data that extracts and template.
For the example detecting, as shown in Figure 5, test section 8 from the upper left corner of the regulation surveyed area G1 of thermal-image data frame 501 to lower right corner moving window J1 to detect, the thermal-image data in cutout window, and detect the degree of correlation of itself and template image T1.Particularly, window J1 for example, moves with the window shifts (pixel) of setting to the right step by step from left end, and arriving after right-hand member, is set up and returns to left end and move down window shifts, and again move right step by step subsequently.For detecting accurately subject, the transformation range at window size, the window shifts detecting, the angle of inclination of window is predefined, the variation range of for example window size is from 150 × 50 pixel to 120 × 40 pixels, the variation range of window shifts is from 10 pixel to 1 pixels, and the variation range at the angle of inclination of window is 0 ° to 10 ° based on central point.Successively, each 5 pixels ground changes window size to test section 8, and each 1 pixel ground changes window shifts, and each 2 ° of ground change window angle of inclination.Test section 8 carries out the relatedness computation of template image T1 and thermal-image data frame 501; After the detection that completes all detection windows, therefrom select the value of the degree of correlation that detection window that the degree of correlation is the highest obtains, as the value of the degree of correlation of these thermal-image data frame 501 correspondences.
Note, can, based on subject identifying information, calculate the whole bag of tricks of the degree of correlation of thermal-image data frame, the above-mentioned processing exemplifying be only can using method example.
Display control unit 9, is presented at display part 10 for the view data of demonstration use that interim storage part 2 is stored.For example, in shooting standby mode, show continuously the infrared thermal imagery of taking the thermal-image data generation obtaining; At playback mode, show the infrared thermal imagery of reading and expanding from storage card 6, in addition, also can show various set informations.Particularly, display control unit 9 has VRAM, VRAM control module, signal generation unit (not shown) etc., and, signal generation unit is under the control of control part 11, from VRAM, regularly read view data (reading and store into the view data of VRAM from interim storage part 2), the output of generation vision signal, is presented at display part 10.In thermal imagery device 100, display part 10 is for example liquid crystal indicator.Be not limited to this, display part 10 can also be other display device that are connected with thermal imagery device 100, and can there is no display part in the electrical structure of thermal imagery device 100 self, at this moment display control unit 9 also can be used as the example of the output block of the image that embodies advise fate.
In addition, in embodiment 1, the control of display part 10 based on notification unit 11D, for showing announcement information; For example warn with writings and image, as show the information of maximal correlation degree, show the infrared thermal imagery that the thermal-image data frame of maximal correlation degree obtains, or the mode such as variation that is also accompanied by the transparent rate, color, size of word, image, linear, thickness, flicker, brightness, frame is notified.
Wherein, the mode of notice can continue official hour.In addition, also controlled vibrating mass, the pilot lamp (not shown) heating in picture device 100, analysis component (not shown), deagnostic package (not shown), in the time the thermal-image data frame of maximal correlation degree being detected, also can produce light by pilot lamp and change, produce vibrations by vibrating device, analyzed and display analysis result by analysis component, diagnose and show diagnostic result by deagnostic package; Or simultaneously in the above described manner one or more notified, as long as the appreciable mode of user all can.
Control part 11 has been controlled the overall action of thermal imagery device 100, for example in flash memory 3, stores the program for controlling at storage medium, and the various data that use in each several part control.Control part 11 is for example realized by CPU, MPU, SOC, programmable FPGA etc.In the present embodiment, control part 11, display part 10 etc., also as the formation of subject alternative pack, are used for selecting subject information.
In addition, control part 11 possesses comparing section 11A, compare for test section 8 being detected to the provisioning information obtaining and/or the evaluation of estimate obtaining based on detecting the provisioning information of acquisition and the correlative value of regulation, described provisioning information, at least comprises the information of a kind of or combination in any in the value of position, size, angle of inclination, the degree of correlation of specific shot body heat picture; In embodiment 1, the value of the degree of correlation of the thermal-image data frame that test section 8 is obtained, compares with the correlative value of the degree of correlation.Note, the correlative value of the degree of correlation can be the pre-prepd degree of correlation judgment value (for example with subject identifying information corresponding stored in table 3, the correlative value that for example user arranges), in the time being greater than this correlative value, judging and in this thermal-image data frame, there is specific shot body heat picture; Also correlative value that can the pre-prepd degree of correlation, and obtain according to the value of the degree of correlation in thermal-image data frame, the for example correlative value using the value of the degree of correlation that Check processing obtains for the first time as the follow-up contrast degree of correlation, and, in the time that subsequent detection is greater than this correlative value to the degree of correlation, upgraded.
In addition, control part 11 has the correlative value renewal 11B of portion, for condition according to the rules, correlative value is upgraded; And after correlative value is upgraded, described comparing section 11A, detects the provisioning information obtaining and/or the evaluation of estimate obtaining based on detecting the provisioning information of acquisition to test section 8, compares with the correlative value after upgrading.
The update condition of correlative value, for example user's indication is upgraded; For example, according to the comparative result of comparing section 11A, correlative value is upgraded; For example time according to the rules upgrades.
According to the comparative result of comparing section 11A, correlative value is upgraded, can be according to pre-prepd multiple correlative values, upgrade successively; For example prepare the correlative value of three degrees of correlation, when the degree of correlation detecting when test section 8 is greater than first correlative value, follow-uply will be updated to second correlative value, in the time being greater than second correlative value, will be updated to the 3rd correlative value.
According to the comparative result of comparing section 11A, correlative value is upgraded, can be also to upgrade pre-prepd correlative value according to detecting the provisioning information obtaining; For example detect according to test section 8 value that obtains the degree of correlation, in the time that the value of this degree of correlation is greater than the correlative value of the pre-prepd degree of correlation, upgrade replacing correlative value according to the value of the obtained degree of correlation.
According to the comparative result of comparing section 11A, correlative value is upgraded, can be also to carry out self according to detecting the provisioning information obtaining, wherein, there is no pre-prepd correlative value; For example detect according to test section 8 value that obtains the degree of correlation, in the time that the value of this degree of correlation is greater than the correlative value (for example, before the value of detected degree of correlation maximum is used as correlative value) of the degree of correlation, corresponding the value of obtained degree of correlation replacement correlative value is upgraded.
In addition, it is not shown that control part 11 has selection portion 11C(), the comparative result of the 11A of portion based on the comparison, selects the customizing messages relevant with the thermal-image data frame of regulation.Selected customizing messages can be used for by the predetermined processing of experience, as analysis, record, notice etc.
Wherein, the relevant customizing messages of thermal-image data frame of regulation, is a frame or the relevant customizing messages of multiframe thermal-image data frame in the multiframe thermal-image data frame of interim storage part 2; For example, the comparative result of the 11A of portion based on the comparison, selection has the relevant customizing messages of thermal-image data frame of maximal correlation degree; But be not limited to that frame thermal-image data frame of detected maximal correlation degree, for example, also can select suboptimum, or that frame before or after the sequential of frame of maximal correlation degree for example detected, or that frame being obtained by multiframe computing, or earliest detection is to the relevant customizing messages of thermal-image data frame corresponding to the degree of correlation of correlative value that is greater than regulation.Also can be configured to select the relevant customizing messages of multiple thermal-image data frames, for example, select the relevant customizing messages of three frame thermal-image data frames of the degree of correlation first, second, third, also may select the customizing messages of the thermal-image data frame that the multiframe degree of correlation is the same.
Described customizing messages is the thermal-image data frame of selecting from the multiframe thermal-image data frame of interim storage part 2, the thermal-image data frame of selecting from multiframe thermal-image data frame carries out the data that predetermined processing obtains, detect the provisioning information obtaining, the evaluation of estimate the obtaining based on detecting the provisioning information obtaining, based on the information that detects the provisioning information that obtains and/or described evaluation of estimate and generate, wherein one or more.
Wherein, the thermal-image data frame of selecting from multiframe thermal-image data frame carries out the data that predetermined processing obtains, for example selected thermal-image data frame is carried out to the data that obtain after predetermined processing, the specific shot body heat picture for example extracting from this thermal-image data frame, the view data of infrared thermal imagery for example generating, for example, be converted to this thermal-image data frame and analyze numerical example as the array of Temperature numerical etc.
Wherein, detect the provisioning information obtaining, described provisioning information is described provisioning information for example, at least comprises the information of a kind of or combination in any in the value of position, size, angle of inclination, thermal imagery assay value, the degree of correlation of specific shot body heat picture.
Wherein, the evaluation of estimate that obtains based on detecting the provisioning information that obtains, for according to detecting the provisioning information that obtains according to weighting coefficient is weighted, the table of comparisons of provisioning information and evaluation of estimate etc. obtains evaluation thermal imagery quality etc. evaluation of estimate.
Wherein, based on the information that detects the provisioning information that obtains and/or described evaluation of estimate and generate, for example, will detect the provisioning information that obtains and/or described evaluation of estimate and be converted to user and be convenient to the prompting etc. of the number percent information of understanding.
Selection portion 11C is to keep/or the control that do not keep of selected customizing messages; The customizing messages keeping remains on the regulation region of interim storage part 2, in addition, also can keep (storage) in flash memory 3 storage mediums such as grade such as.Hereinafter, the regulation region that customizing messages such as thermal-image data frames is remained on interim storage part 2 by selection portion 11C is example.
Selection portion 11C can remain selected customizing messages, also can under defined terms, keep, and the customizing messages of for example current selection keeps official hour; For example before the thermal-image data frame of the larger degree of correlation being detected, remain current customizing messages; For example before being changed for detection of the subject identifying information of comparison, remain selected customizing messages; The customizing messages for example keeping according to user's indication (determining maintenance as user has selected certain customizing messages showing in display part).In addition also can not keep, for example, be sent to other external device (ED)s by communication I/F4; For example experience other process as after notice delete etc.
And, selection portion 11C, the customizing messages interim storage part 2 being kept for condition according to the rules, is updated to the customizing messages of the follow-up selection of selection portion 11C.So-called defined terms, for example official hour, for example detect the thermal-image data frame of specified quantity, for example, such as, according to comparing section 11A comparative result (obtained the degree of correlation and be greater than the situations such as the degree of correlation of kept thermal-image data frame), user indication etc.In addition, also the customizing messages being kept before can be continued to keep.
In embodiment 1, the comparative result of the 11A of portion based on the comparison, the control that selection portion 11C selects, keeps and upgrade customizing messages.While being greater than the correlative value of the degree of correlation as the value of the degree of correlation of the specific shot body heat picture detecting when test section 8, the customizing messages such as value and corresponding thermal-image data frame of selecting this degree of correlation is remained in the storage mediums such as interim storage part 2; In the time having the customizing messages such as value and corresponding thermal-image data frame of the degree of correlation before, by the customizing messages before replacing it; Have the higher thermal-image data frame of the degree of correlation during until follow-up, can be replaced (the higher thermal-image data frame of the degree of correlation that also can keep specified quantity).Like this, kept as the customizing messages such as value and corresponding thermal-image data frame of the maximum degree of correlation.In addition, also the customizing messages being kept before can be continued to keep.
In addition, it is not shown that control part 11 possesses notification unit 11D(), the relevant customizing messages of thermal-image data frame selected based on selection portion 11C and regulation, notifies.Notification unit 11D, preferred, the infrared thermal imagery that the thermal-image data frame that the announcement information that current selected customizing messages is obtained and acquisition unit are obtained continuously obtains shows jointly.The continuous infrared thermal imagery that infrared thermal imagery and the shoot part 1 for example current thermal-image data frame selected and that keep being obtained obtains shows jointly, in addition, and also can the while or show separately other announcement information, the value of for example degree of correlation, evaluation of estimate etc.In addition, also Dynamic IR thermal imagery can be switched to the freeze frame that shows this thermal-image data frame.
Wherein, in the time that selection portion 11C selects to have kept the relevant customizing messages of multiple thermal-image data frames, notification unit 11D can be to one of them or multiple notice, and for example, the continuous infrared thermal imagery that the infrared thermal imagery that multiple thermal-image data frames are obtained and shoot part 1 obtain shows jointly.
Wherein, the relevant customizing messages of thermal-image data frame selected according to selection portion 11C and regulation, obtains announcement information, for example, the value of the degree of correlation can be scaled to the information that user understands of being convenient to of the similar degree of signal, shows; For example, according to the table of comparisons of the regulation of the value of the degree of correlation and number percent, or the mode of calculating is (as the specific shot body profile being extracted and the profile T1 overlapping area ratio sum in the total area separately, divided by 200%, can be scaled the percent value of the degree of correlation) value of the degree of correlation is scaled to percent value); Also can be other mode, the value that for example directly will calculate the degree of correlation shows, as the difference of direct display pixel value and numerical value etc.Note, in the time not detecting that with representative specific shot body heat picture whether regulation correlative value (representing the judgment value whether specific shot body heat picture mates with subject identifying information) contrasts, the information of the shown degree of correlation might not represent whether specific shot body heat picture (coupling) detected.For ease of explanation, hereinafter, using the percent value of the value of the degree of correlation, evaluation of estimate, correlative value conversion as example, but in reality, must not be converted into percent value.
Wherein, the mode of notice can continue official hour.And, based on the control of notification unit 11D, can make display part 10 produce the vibration of the vibrating mass in variation, the thermal imagery device 100 of displaying contents, the light variation of pilot lamp, the sound of sound components, the analyzing and processing (and making display part 10 display analysis results) of analysis component, deagnostic package is diagnosed the color one or more of variation changing etc. of the puppet of (and making display part 10 show diagnostic result), infrared thermal imagery; As long as the appreciable mode of user all can.
In addition, it is not shown that control part 11 has recording unit 11E(), the record indication of response regulation, is recorded to storage card 8 by thermal-image data frame selected selection portion 11C and that remain in interim storage part 2.For example respond the indications such as the selection of user to notified thermal-image data frame, the indications such as for example automatic record of timing, are recorded to storage card 8 by described thermal-image data frame.
In addition, it is not shown that control part 11 possesses reference picture specifying part 11F(), be used to specify will with the composition data of the common reference picture showing of infrared thermal imagery; For example, the composition data of the reference picture of the subject information association based on storing in storage medium (dot array data or vector data), the selection according to user to subject information, specifies the composition data with the reference picture of subject information association; Be not limited to by subject information, also can from storage medium, select such as thermal imagery file etc. to obtain the composition data of reference picture; In addition, also can, according to the default configuration of thermal imagery device 100, carry out the composition data of designated reference image, for example the data of the surveyed area of acquiescence; In addition, appointed area the infrared thermal imagery that also can for example show from display part, and using the infrared thermal imagery in this region as the mode with reference to various appointments such as images.
In addition, it is not shown that control part 11 possesses position setting unit 11G(), for being set, reference picture is positioned at the location parameter (position, or also comprise size, or also comprise the anglec of rotation) of display part.Preferably, setting unit 11G in position is positioned at the location parameter of infrared thermal imagery for reference picture is set; For example, according to the self-adaptation viewing area stipulating in infrared thermal imagery, in this adaptive region, maximize the placed in the middle location parameter showing according to calculated reference picture, thereby reference picture is set is arranged in the location parameter of infrared thermal imagery; For example, also can for example, according to the incidental parameter of reference picture (having embodied the location parameter in infrared thermal imagery), reference picture be set be arranged in the location parameter of infrared thermal imagery according to this parameter; Or, also can reference picture is set be arranged according to the configuration of thermal imagery device 100 (placed in the middle, original size) location parameter of infrared thermal imagery; Or, also can be according to the location parameter of user's input.
Operating portion 12: carry out various indication operations for user, or input the various operations such as set information, control part 11, according to the operation signal of operating portion 12, is carried out corresponding program.With reference to figure 2, operating portion 12 is described, provides that button that user operates records that key 1, focusing key 2, acknowledgement key 3, playback key 4, menu are strong 5, directionkeys 6 etc.; In addition, also can adopt touch-screen 7 or speech recognition component (not shown) etc. to realize relevant operation.
The control flow of the detecting pattern of thermal imagery device 100 is described referring to Figure 10, the variation of the display interface in shooting process is described with reference to figure 6-9.This application scene thermal imagery device 100 as hand-held in user is taken the subject of transformer station.The control program of control part 11 based on storage in flash memory 3, and the various data that use in each several part control, controlled the overall action of thermal imagery device 100 and the control of execution various modes processing.After switching on power, control part 11 carries out the initialization of internal circuit,
Then, enter standby screening-mode, be that shoot part 1 is taken and obtained thermal imagery signal, shoot part 1 is taken the processing that the thermal imagery signal of acquisition stipulates by image processing part 7, is stored in interim storage part 2, on display part 10, show continuously infrared thermal imagery with dynamic image form, at this state, control part 11 is implemented it and is controlled, and whether persistent surveillance has been switched to the processing of other patterns or has carried out power-off operation according to scheduled operation, if had, enter corresponding processing controls.The control step of detecting pattern is as follows:
Steps A 01, the thermal-image data frame obtaining is taken in interim storage part 2 circulation storages, shows infrared thermal imagery and reference picture;
At standby shooting state, display part 10 shows dynamic infrared thermal imagery, and control based on control part 11, and in interim storage part 2, circulation storage shoot part 1 is taken the thermal imagery signal frame obtaining.
User can puzzle in specific shot body heat as the image space in the morphological feature of IR1 and the infrared thermal imagery at its place in the past, size, angle, for guaranteeing shooting quality standard, scheduled operation by operating portion 12 is selected detecting pattern, the table 3 of control part 11 based on storage in flash memory 3, the subject indication information of subject Information generation is presented to display part 10, when user is according to the subject of floor " subject 1 ", select " subject 1 " shown on display part 10 by operating portion 12, reference picture specifying part 11F is according to user's selection, just determine reference picture T1, from flash memory 3, read the composition data of reference picture T1, be sent to interim storage part 2, and position setting unit 11G arranges the location parameter (position and size) that reference picture T1 is positioned at infrared thermal imagery.For example, according to attached location parameter, reference picture T1 be set be arranged in the location parameter of infrared thermal imagery.In addition, self-adaptation viewing area that also can be according to the rules, or user's location parameter of specifying, determine that reference picture T1 is arranged in the location parameter of infrared thermal imagery.The thermal-image data frame of shoot part 1 being taken to acquisition is sent to interim storage part 2, image processing part 7 carries out for example pseudo-color conversion of predetermined processing to obtained thermal-image data frame, obtain the view data of infrared thermal imagery, and, synthesis unit obtains determined composition data the view data of reference picture T1 according to the given size arranging, according to set assigned position, synthesize (overlapping) with the view data of the infrared thermal imagery generating, then composograph is presented to display part 10, as shown in Figure 6 (a), location between subject thermal imagery IR1 and contour images T1, the difference of size, user can take subject thermal imagery IR1 according to reference picture.
Steps A 02, user can puzzle in the trouble of aiming at according to reference picture in the past, for making rapid operation, selects to send to detect indicate by the scheduled operation of operating portion 12, when detecting, control part 11 user's detecting pattern (steps A 02: be) enters Check processing.
And the indication of detection is not limited to user and sends, can be also the timing of regulation, or the trigger pip of the external device (ED) being connected with thermal imagery device 100 etc., control part 11 responds and carries out the control that test section 8 detects.
In steps A 03, feature registration unit registration subject identifying information.Feature registration unit is according to user's selection " subject 1 ", just determined to be used for the subject identifying information of coupling, at this, supposes with reference to image T1 as the template image that calculates the degree of correlation.(in addition, also can from flash memory 3, read template data 301 and be used as calculating the subject identifying information of the degree of correlation).This step also can complete in A01.
Then,, in steps A 04, from interim storage part 2, read thermal-image data frame;
Steps A 05, detection window setting unit, arranges detection window.For example, the upper left corner of the surveyed area G1 based on regulation, is first provided with detection window;
Steps A 06, carries out the processing of the relatedness computation between thermal-image data and the subject identifying information in detection window.
Test section 8, based on the set detection window of detection window setting unit, extracts the thermal-image data that is arranged in this detection window, and the template data 301(registering according to feature registration unit obtains contour images T1), calculate the degree of correlation between the two.For example, the profile of the specific shot body heat picture extracting according to the thermal-image data in detection window, with the silhouette contrast of contour images T1, calculates overlapping area between the two the ratio sum in the total area separately.
And, in steps A 07, the value of the obtained degree of correlation is stored in to interim storage part 2.
In steps A 08, test section 8 judges while detection window being set in thermal-image data frame, whether has calculated the degree of correlation for all detection windows.If the region (being no in steps A 08) that residue is not also calculated the degree of correlation, gets back in steps A 05, detection window setting unit is in a predetermined direction by the position skew intended pixel number of detection window, this position is set to the next position of detection window, and repeats follow-up processing.
In addition, from thermal-image data frame, search is with like template class when frame part, for amplifying and dwindle and during by detection window after detection window J1 inclination predetermined angular, the Check processing that also carries out similar above-mentioned explanation.
If calculated the degree of correlation (being yes in steps A 08) for all detection windows that will arrange in thermal-image data frame, the value of the maximal correlation degree the detecting location parameter of corresponding detection window (or also have) is remained on to the regulation region of interim storage part 2 in steps A 09.
In steps A 10, whether calculate the degree of correlation for all thermal-image data frames.As no, get back to steps A 04, repeat follow-up processing.In this way,, in steps A 11, by the thermal-image data frame of detected multiframe part, pick out the maximum degree of correlation, compare with the correlative value of the degree of correlation;
In steps A 11, compare with the correlative value of the degree of correlation;
The maximal correlation degree and the correlative value that in the thermal-image data frame of multiframe part wherein, detect can be compared; If be less than this correlative value, represent not detect the maximal correlation degree (as the correlative value after upgrading) of the thermal-image data frame that is better than previous correlative value with the degree of correlation or obtained before; Get back to steps A 01, show the printed words that better thermal-image data frame do not detected; Or be shown as Dynamic IR thermal imagery, as shown in Figure 6; Then, shooting distance, image space, angle between the position that user takes by change and optics and the subject thermal imagery of adjustment thermal imagery device 100, when user sends indication again, repeat follow-up processing.When the degree of correlation detecting in steps A 11 is greater than the correlative value of the degree of correlation, enter steps A 12;
Wherein, the correlative value of the degree of correlation can be that the correlative value of the pre-prepd initial degree of correlation is (for example, by the judgment value that judges whether to detect that whether specific shot body heat picture mates with subject identifying information, as the correlative value of the initial degree of correlation), when the value that detects the degree of correlation obtaining is greater than this judgment value, the degree of correlation of the specific shot body heat picture that detects of representative is better than prepared judgment value, this judgment value is replaced with to the correlative value that the value of current the detected degree of correlation obtains; As the correlative value of the subsequent detection degree of correlation, whether can obtain the specific shot body heat picture that the degree of correlation is higher so that follow-up.In the present embodiment, the correlative value of the thermal imagery device 100 initial degrees of correlation is 72%, this initial correlative value is the judgment value that judges whether to detect specific shot body heat picture, if the degree of correlation of the thermal-image data frame obtaining is less than this correlative value, represents and specific shot body heat picture in this thermal-image data frame, do not detected; Its effect is repeatedly to take also cannot obtain announcement information time as user, means whether taken wrong subject.So, in Fig. 6, because the value of the detected degree of correlation is less than 72%, do not have show be used for notice information.And as shown in Figure 7, the degree of correlation of the thermal-image data frame of the maximal correlation degree detecting is 80%, notifies follow-up.
In addition, the correlative value of the degree of correlation, also can not prepare in advance, at this moment, for example, when by the value of the degree of correlation of the thermal-image data frame detecting for the first time, the correlative value of the value of the degree of correlation obtaining as subsequent detection thermal-image data frame, when subsequent detection is when being greater than this correlative value, replace this correlative value.
At this, whether to be greater than correlative value as evaluating the foundation of the degree of correlation, be less than correlative value or approach correlative value (pre-prepd judgment value) as the situation of evaluating the degree of correlation but also have.And correlative value can be the value of the degree of correlation, it can be also the value of the degree of correlation value etc. through converting and obtaining.
Steps A 12, the correlative value renewal 11B of portion, by according to the detected value with maximal correlation degree, upgrades the correlative value of the degree of correlation, and the correlative value after renewal is as the correlative value of the comparison degree of correlation of follow-up thermal-image data frame.
Steps A 13, the processing stipulating;
For example, selection portion 11C, by customizing messages such as thermal-image data the frames corresponding detected value with maximal correlation degree, remains on the regulation region of interim storage part 2, and the customizing messages (if there is) before replacing it, to carry out follow-up processing.And the customizing messages keeping, before not receiving the customizing messages that selection portion 11C reselects, will be maintained in interim storage part 2 always.In addition, also can keep the relevant customizing messages of multiple thermal-image data frames of specified quantity, for example, keep the customizing messages such as 3 frame thermal-image data frames and the value of the degree of correlation thereof that the degree of correlation is the highest.Then, can carry out the processing such as follow-up notice, analysis, record, diagnosis.And notice is not limited to the selected customizing messages of selection portion 11C, the event that also can upgrade correlative value is notified or the correlative value after further update notifications also.
Take notice as example, as the image that this thermal-image data frame is obtained, jointly show with dynamic infrared thermal imagery.Being not limited to and showing infrared thermal imagery 601, can be also other mode, for example, directly the value of calculating the degree of correlation is shown, in addition, also can will show that Dynamic IR thermal imagery switches to the freeze frame that shows this thermal-image data frame; And, in the time that selection portion 11C is configured to indication maintenance multiframe thermal-image data frame, can show the infrared thermal imagery that multiple kept thermal-image data frames obtain simultaneously, for example, also carry out sequencing display according to the height of the degree of correlation.
Note, in the time not contrasting with the correlative value (representing the judgment value whether specific shot body heat picture mates with subject identifying information) that judges whether to have specific shot body heat picture, the information of the shown degree of correlation might not represent whether specific shot body heat picture detected.
In addition, also can omit steps A 13, for example, in shooting, constantly update correlative value, until user sends indication, just the relevant information of thermal-image data frame be kept, and in the processing of regulation.
Steps A 14, judges whether to exit, as does not exit, and gets back to steps A 01, repeats follow-up processing.At this moment, because correlative value is before upgraded, therefore, when user sends the indication of detection again, the thermal-image data frame obtaining in follow-up shooting, by with upgrade after the correlative value of the degree of correlation compare, and, in the time being greater than the correlative value of the degree of correlation, will again correlative value be upgraded.Thus, in the time the larger thermal-image data frame of the degree of correlation being detected, upgrade by correlative value.
And after correlative value is upgraded, described comparing section 11A, detects the provisioning information obtaining and/or the evaluation of estimate obtaining based on detecting the provisioning information of acquisition to test section 8, compares with the correlative value after upgrading; Due to according to user to the adjustment of taking, correlative value may constantly promote, and like this, is more easy to the customizing messages of thermal-image data frame corresponding to maximal correlation degree obtaining in repeated detection is processed.
As shown in Figure 7, in shooting, the indication that response detects, first the maximal correlation degree detecting is 80%(according to the ratio sum of the overlapping area information obtaining that converts), the correlative value of the degree of correlation using the value of this degree of correlation as follow-up comparison, and show with Dynamic IR thermal imagery the infrared thermal imagery 601 that this thermal-image data frame obtains simultaneously.In the time that subsequent detection is greater than 80% to the value of maximal correlation degree, as shown in Figure 8, the value of the degree of correlation is 85%, replace the correlative value 80% of the degree of correlation, as the correlative value (85%) of the new degree of correlation, by that analogy, in the time again detecting, when the value of the degree of correlation detecting is 95%, as shown in Figure 9, if user is satisfied, can stop the aiming of subject to take, because this thermal-image data frame remains in interim storage part 2 storage mediums such as grade, can conveniently carry out follow-up analysis, storage etc. and process or operate.At this moment, record key if user presses, the processing that the thermal-image data frame of infrared thermal imagery 603 correspondences stipulated (as compression etc.) is recorded to storage card 8.And, even if the not mode of display reminding information or infrared thermal imagery, for example mode of pilot lamp flicker, because this thermal-image data frame remains in interim storage part 2 storage mediums such as grade, equally can be in the time of the pressing acknowledgement key or record key of user, show, the processing such as record.
For example, and owing to having stored the thermal-image data frame of 50 frame parts in thermal imagery storage part, therefore, the thermal-image data frame that before can also recalling, in the stipulated time, (2 seconds before) are taken, is so just difficult for omitting the second best in quality thermal-image data frame; At this moment, can suspend the thermal-image data frame that shoot part 1 is obtained and be sent to interim storage part 2, also can continue in other regions of interim storage part 2 circulation storage thermal-image data frame.
As mentioned above, in the present embodiment, in the time the degree of correlation being detected higher than the thermal-image data frame of fiducial value, upgrade by correlative value, and follow-up whenever detect higher than the degree of correlation before correlative value time, can constantly update correlative value.Make selection portion 11C can select all the time the relevant customizing messages of thermal-image data frame of maximal correlation degree to keep, user just can adjust thermal imagery device 100 like a cork like this, to pursue the thermal imagery of taking optimum efficiency.Can reach and significantly reduce the operation easier that vision is aimed at, significantly reduce the physical strength of taking, improve the beneficial effect of the quality of the final thermal-image data frame obtaining.And, in the time receiving the indication of detection, just detect and in interim storage part 2, store to obtain the highest frame of the degree of correlation in thermal imagery signal frame, can lower the manipulation strength that vision matching is aimed at, common user easily grasps this shooting technical ability, simple to operate, and can reduce the arithmetic speed burden of processor, the beneficial effect of the cost of reduction thermal imagery device 100 etc., and be applicable to the shooting to fast-moving target.Certainly, arbitrary product of enforcement embodiments of the present invention might not need to reach above-described all advantages simultaneously.
And, in the present embodiment, effect of the present invention for convenience of explanation, and upgrade the explanation of the predetermined processing of effect as embodiment using selection portion 11C and notification unit 11D, but also can remove said structure, also form the present invention.
Embodiment 2
Be with the difference of embodiment 1, the infrared coupling updating device of thermal imagery device 100() multiframe thermal-image data frame based in interim storage part 2, indication according to the rules, detects the provisioning information relevant with specific shot body heat picture in the multiframe thermal-image data frame of storing in interim storage part 2; Wherein, described provisioning information, at least comprises the information of a kind of or combination in any in the value of position, size, angle of inclination, the degree of correlation of specific shot body heat picture.Control part 11 has supplementary acquisition unit (not shown), for obtaining supplementary; Comparing section 11A, the supplementary that the evaluation of estimate obtaining for test section being detected to the provisioning information obtaining, supplementary that supplementary acquisition unit is obtained, evaluation of estimate that provisioning information that test section 8 detects acquisition obtains, supplementary that supplementary acquisition unit is obtained, the provisioning information that test section 8 detects acquisition and supplementary acquisition unit are obtained and the evaluation of estimate that obtains one or more, compares with corresponding one or more correlative values; The correlative value renewal 11B of portion, for the renewal of correlative value.Selection portion 11C, the comparative result of the 11A of portion based on the comparison, selects the customizing messages relevant with the thermal-image data frame of regulation, when there being multinomial comparison, according to different comparative results, the customizing messages of notifying may be a frame or the relevant customizing messages of multiframe thermal-image data frame; Notification unit 11D, the relevant customizing messages of thermal-image data frame selected based on selection portion 11C and regulation, notifies.
In the field of infrared detection, owing to considering the difference at the position of specific shot body heat picture in infrared thermal imagery, size, angle of inclination etc., corresponding different shooting quality, even if the degree of correlation is high, if above-mentioned parameter is undesirable, the quality of the thermal-image data frame obtaining is not necessarily high; Therefore, consider the factors such as the position of specific shot body heat image position in thermal-image data frame, size, angle of inclination, as the factor that generates notice, point out user to note the quality of taking, or select the thermal-image data frame of best shooting quality to carry out follow-up processing.
Wherein, described supplementary, at least comprise the information of a kind of or combination in any in assay value, environment temperature, contextual factor, wind speed, humidity, distance, and other supplementarys of being obtained by thermal imagery device 100 (comprise by user and arranging), comprise other various to the relevant information of the selected regulation thermal-image data of selection portion 11C frame and/or the influential factor of information that notification unit 11D is notified all in its scope.
In the application of infrared detection, according to the difference of above-mentioned supplementary, the quality of the thermal-image data frame obtaining and significance level difference, should have different conditions to deal with the processing such as the comparison of the thermal-image data frame of regulation, selection, notice; For example, for example, in the time thering is the assay value of correlative value (threshold values of defect) that is greater than regulation in the specific shot body heat picture obtaining, represent that subject has defect, so, should cause user's attention, at this moment, in the situation that the degree of correlation approaches, also preferably select the relevant customizing messages of thermal-image data frame that also notification analysis value exceeds standard, user's attention will be caused immediately, significant to infrared detection; For example consider environment temperature, background, wind speed, the contextual factor (otherness of for example background and subject thermal imagery, the thermal field distribution of background etc.) etc. influence factor, in the situation that the degree of correlation approaches, these influence factors may cause the value of different thermal imagery quality and subsequent analysis to reduce, and should select and notify other influences factor to disturb little thermal-image data frame.
Wherein, supplementary acquisition unit, for example can obtain above-mentioned supplementary according to thermal imagery device 100 or with the parts (not shown) of the corresponding function being connected in thermal imagery device 100, for example, (assay value is not limited to temperature value to obtain assay value by analysis component, for example, also can be AD value, color value in pseudo-color thermal imagery, the ratio of specific picture numerical value, or also by these numerical value according to the rules formula calculate the value etc. obtaining, the assay value that analysis component is obtained can be for the pixel in whole pixels or particular analysis region in thermal-image data frame), obtain environment temperature by temperature sensor, obtain humidity by hygrometer, obtain the distance of thermal imagery device 100 and subject etc. by stadimeter.Also can obtain according to above-mentioned supplementary pre-stored in storage medium, for example, the historical data of supplementary; Or in conjunction with the historical data of supplementary pre-stored in the supplementary of obtaining when pre-test and storage medium to recently obtaining supplementary.
And, can obtain comprehensive evaluation of estimate by provisioning information and/or supplementary; For example, the different coefficient that can adopt customizing messages correspondence in detected provisioning information, and obtain evaluation of estimate by other the provisioning information in detected provisioning information in conjunction with this coefficient; For example, can adopt the shared weight of different information, obtain evaluation of estimate by weighting.Can obtain final evaluation of estimate by various account form.
For example, as shown in figure 13, the detection window that the infrared thermal imagery 1301 of supposing Figure 13 (c) is 0.94 according to window coefficient obtains, and the detection window that infrared thermal imagery 1302 is 0.8 according to window coefficient obtains, value × window coefficient of evaluation of estimate=degree of correlation, therefore, even if the degree of correlation of infrared thermal imagery 1301 is less than the degree of correlation of infrared thermal imagery 1302, but evaluation of estimate is high on the contrary.
And, also can, by described provisioning information and described supplementary, obtain comprehensive evaluation of estimate.For example, acquisition combines the evaluation of estimate that the value of position, size, angle of inclination, assay value, the degree of correlation of specific shot body heat picture obtains, for example obtain comprehensive evaluation value according to following formula, value × degree of correlation weighting coefficient of weighting coefficient+size × size weighting coefficient+angle of inclination × angle of inclination, comprehensive evaluation value=position × position weighting coefficient+assay value × assay value weighting coefficient+degree of correlation; Or another kind of preferred mode, obtains evaluation of estimate according to detected provisioning information and the supplementary of obtaining and the table of comparisons of comprehensive evaluation value.
And, also can be according to described provisioning information and described supplementary, wherein part obtains evaluation of estimate, then, according to the provisioning information and/or the supplementary that obtain evaluation of estimate of having neither part nor lot in wherein, together with the evaluation of estimate obtaining, the object of the comparison of the correlative value of portion and regulation as a comparison.
Wherein, the correlative value renewal 11B of portion, according to the comparative result of comparing section 11A, upgrades correlative value; And, in the time having multinomial correlative value, at least one in corresponding correlative value is upgraded; Wherein, when multinomial correlative value update all, after renewal, described comparing section 11A, for the provisioning information that test section 8 subsequent detection are obtained, and/or, the supplementary of obtaining based on supplementary acquisition unit, and/or, by described provisioning information and/or described supplementary and the evaluation of estimate obtaining compare with the correlative value of multinomial renewal; Wherein, when part in multinomial correlative value is upgraded, after renewal, with the correlative value of the renewal item in multinomial correlative value and a correlative value of not upgrading compare.Preferably, the optimum provisioning information relatively obtaining according to comparing section or optimum supplementary or optimum according to one that detects in the evaluation of estimate that the provisioning information that obtains and/or supplementary obtain, upgrade corresponding at least one correlative value.
Wherein, when test section 8 is configured to detect multiple provisioning informations of specific shot body heat picture, and comparing section 11A, when the provisioning information that 8 detections obtain to test section and/or the multinomial correlative value of the evaluation of estimate obtaining based on detecting the provisioning information of acquisition and regulation compare, result based on the comparison, selection portion 11C may select the relevant customizing messages of multiple thermal-image data frames, and at this moment, notification unit 11D can be to one of them or multiple notice.Preferably, described selection portion, the comparative result of portion based on the comparison, the relevant customizing messages of thermal-image data frame that the value of the selection degree of correlation and/or provisioning information and/or supplementary and/or evaluation of estimate (evaluation of estimate that provisioning information and/or supplementary obtain) are better than the correlative value of regulation keeps.Described notification unit, selected based on selection portion and the keep relevant customizing messages of the thermal-image data frame with regulation, the value of the selection degree of correlation and/or provisioning information and/or supplementary and/or evaluation of estimate (evaluation of estimate that provisioning information and/or supplementary obtain) are better than the relevant customizing messages of thermal-image data frame of the correlative value of regulation and notify.
The control flow of the detecting pattern of the thermal imagery device 100 of embodiment 3 is described referring to Figure 11,12, and in this example, having configured three correlative values is example.The provisioning information (value of the degree of correlation) relevant with specific shot body heat picture in the thermal-image data frame that test section 8 is detected, based on detecting the supplementary (assay value) that the provisioning information that obtains and supplementary acquisition unit obtain, the evaluation of estimate obtaining compares with first, second, third correlative value.
The first correlative value is prepared (being the first correlative value of the degree of correlation in the present embodiment) in advance, the correlative value (representing the judgment value whether specific shot body heat picture mates with subject identifying information) that is used for judging whether to have specific shot body heat picture, the first correlative value is not upgraded.
The second correlative value (being the second correlative value of the degree of correlation in the present embodiment), for being greater than the correlative value of the degree of correlation of the first correlative value, its value according to the degree of correlation of the thermal-image data frame detecting obtains, in the time that follow-up thermal-image data frame detects the value of the higher degree of correlation, the second correlative value will be updated to higher value thereupon.
The 3rd correlative value, value, assay value etc. with position, size, angle of inclination, the degree of correlation obtain comprehensive evaluation value, as for example, comparing with corresponding (pre-prepd) the 3rd correlative value, in the time that follow-up thermal-image data frame detects the comprehensive evaluation value of higher (more excellent), the 3rd correlative value will be updated to higher value thereupon.
Finally, selection portion 11C is by the relevant customizing messages of thermal-image data frame of selecting to be better than the second correlative value and/or to be better than the 3rd correlative value; Be convenient to the processing such as follow-up notice, analysis, diagnosis, record.
Step C01-step C02, is analogous to the steps A 01-A02 of embodiment 1, has omitted explanation;
Step C03, is analogous to the steps A 03-A10 of embodiment 1, detects the degree of correlation of the thermal-image data frame that obtains multiframe part, has omitted explanation;
Step C04, whether the value of the degree of correlation of the thermal-image data frame that judgement detects, be greater than the first correlative value, as no, represents specific specific shot body heat picture not detected, gets back to step C02, for example, also show the printed words of the thermal imagery that coupling do not detected.Repeat follow-up processing.
When the degree of correlation detecting at step C04 is greater than the first correlative value, enter step C05.
Step C05, supplementary acquisition unit is greater than the thermal-image data in thermal-image data frame and/or this thermal-image data frame detection window of the first correlative value to the degree of correlation, obtain for example assay value relevant with specific shot body heat picture of supplementary etc., for example control analysis parts are analyzed acquisition assay value.In addition, for example, in the time that test section 8 is configured to calculate the degree of correlation by detection pixel ratio, be not limited to decide according to the location parameter of detection window the location parameter of detected specific shot body heat picture, at this moment, also can, according to the profile that further extracts specific shot body in the detection window detecting, obtain the provisioning informations relevant with specific shot body heat picture such as more accurate position, size, angle of inclination.
Step C06, obtain evaluation of estimate, acquisition combines the evaluation of estimate that the value of position, size, angle of inclination, assay value, the degree of correlation of specific shot body heat picture obtains, for example obtain comprehensive evaluation value according to following formula, value × degree of correlation weighting coefficient of weighting coefficient+size × size weighting coefficient+angle of inclination × angle of inclination, comprehensive evaluation value=position × position weighting coefficient+assay value × assay value weighting coefficient+degree of correlation; Or another kind of preferred mode, obtains evaluation of estimate according to the table of comparisons of detected information and comprehensive evaluation value.
Step C07, do are the maximal correlation degree in the thermal-image data frame that judgement detects and the thermal-image data frame of maximum evaluation of estimate same frames?
(step C07: be), enters step C08 in this way, and evaluation of estimate and the 3rd correlative value are compared.
As while being less than the 3rd correlative value (step C08: no), at step C09, the value and the second correlative value that detect the degree of correlation obtaining are compared; As no, jump to step C32, for example representative before the degree of correlation detected, than the thermal-image data frame of the thermal-image data vertical frame dimension of current detection.In this way, at step C10-C11, the correlative value renewal 11B of portion, by according to the value of detected maximal correlation degree, upgrades the second correlative value.And, selection portion 11C is by customizing messages relevant this thermal-image data frame, remain on the regulation region of interim storage part 2, customizing messages (if the relevant customizing messages of thermal-image data frame before having before replacing it, and the degree of correlation of thermal-image data frame is before less than the thermal-image data frame of current detection, and when evaluation of estimate is not maximum in kept thermal-image data frame, just replace), and at step C12, the relevant customizing messages of thermal-image data frame that the degree of correlation is greater than to the second correlative value is notified.
As comprehensive evaluation value is greater than the 3rd correlative value (step C08: be), at step C13, the value of the degree of correlation and the second correlative value are compared;
If be greater than the second correlative value (step C13: be), at C14-C15, the correlative value renewal 11B of portion is by according to the value of the detected maximal correlation degree of this thermal-image data frame, and maximum comprehensive evaluation value upgrades the second correlative value, the 3rd correlative value.And, selection portion 11C is by the customizing messages relevant with this thermal-image data frame, remain on the regulation region of interim storage part 2, customizing messages (if there is) before replacing it, and at step C16, the degree of correlation is greater than to the relevant customizing messages of thermal-image data frame that the second correlative value and comprehensive evaluation value be greater than the 3rd correlative value and notifies.
If be less than the second correlative value (step C13: no), at C17-C18, the correlative value renewal 11B of portion, by according to the comprehensive evaluation value of detected this thermal-image data frame, upgrades the 3rd correlative value.And, selection portion 11C has by detected a relevant customizing messages of thermal-image data frame that maximum comprehensive evaluation value is corresponding, remain on the regulation region of interim storage part 2, customizing messages (if the relevant customizing messages of thermal-image data frame before having before replacing it, and the evaluation of estimate of thermal-image data frame is before less than the thermal-image data frame of current detection, and when the degree of correlation is not maximum in kept thermal-image data frame, just replace), and at step C19, the relevant customizing messages of thermal-image data frame that comprehensive evaluation value is greater than to the 3rd correlative value is notified.
As step, C07(is no), represent in detected thermal-image data frame, the thermal-image data frame of degree of correlation maximum and the thermal-image data frame of evaluation of estimate maximum are different two frames (also may have multiframe), enter step C20, the evaluation of estimate of the thermal-image data frame of maximum evaluation of estimate and the 3rd correlative value are compared, see Figure 12.
As while being less than the 3rd correlative value (step C20: no), at step C21, value and second correlative value of the degree of correlation that detects the thermal-image data frame that obtains maximal correlation degree are compared; As no, jump to step B32, before representative, detect that the degree of correlation, evaluation of estimate are than the thermal-image data frame of the thermal-image data vertical frame dimension of current detection, display part will not show, or show the printed words that better thermal-image data frame do not detected.In this way, at step C22-C23, the correlative value renewal 11B of portion, by according to the value of detected maximal correlation degree, upgrades the second correlative value.And, selection portion 11C is by customizing messages relevant this thermal-image data frame, remain on the regulation region of interim storage part 2, customizing messages (if the relevant customizing messages of thermal-image data frame before having before replacing it, and the degree of correlation of thermal-image data frame is before less than the thermal-image data frame of current detection, and when evaluation of estimate is not maximum in kept thermal-image data frame, just replace), and at step C24, the relevant customizing messages of thermal-image data frame that the degree of correlation is greater than to the second correlative value is notified.
As comprehensive evaluation value is greater than the 3rd correlative value (step C20: be), at step C25, the value of the degree of correlation and the second correlative value are compared; If be greater than the second correlative value (step C25: be), at C26-C27, the correlative value renewal 11B of portion is by according to the value of the detected maximal correlation degree of this thermal-image data frame, and maximum comprehensive evaluation value upgrades the second correlative value, the 3rd correlative value.And, selection portion 11C is by the customizing messages relevant with this thermal-image data frame, remain on the regulation region of interim storage part 2, customizing messages (if there is) before replacing it, and at step C28, thermal-image data frame, the comprehensive evaluation value that the degree of correlation is greater than to the second correlative value is greater than the relevant customizing messages of thermal-image data frame of the 3rd correlative value and notifies (for example two frames show) simultaneously.
If be less than the second correlative value (step C25: no), at C29-C30, the correlative value renewal 11B of portion, by according to the comprehensive evaluation value of detected this thermal-image data frame, upgrades the 3rd correlative value.And, selection portion 11C has by detected a relevant customizing messages of thermal-image data frame that maximum comprehensive evaluation value is corresponding, remain on the regulation region of interim storage part 2, customizing messages (if the relevant customizing messages of thermal-image data frame before having before replacing it, and the evaluation of estimate of thermal-image data frame is before less than the thermal-image data frame of current detection, and when the degree of correlation is not maximum in kept thermal-image data frame, just replace), and at step C31, the relevant customizing messages of thermal-image data frame that comprehensive evaluation value is greater than to the 3rd correlative value is notified.
Step C32, judges whether to exit detecting pattern, as exits, and finishes, as does not exit, and gets back to step C01, repeats above-mentioned processing.Like this, when the thermal-image data frame that continuous shooting is obtained circulation are stored in interim storage part 2, when response detects indication, by according to detected provisioning information, the relevant customizing messages of thermal-image data frame that is better than the second correlative value and/or is better than the 3rd correlative value is selected and notified; Be convenient to the processing such as follow-up notice, analysis, diagnosis, record, maintenance.Wherein, whether the degree of correlation of the thermal-image data frame of detection is greater than to the condition of the first correlative value as further detection provisioning information, can further avoids the beneficial effect of taking error location, pointing out effective customizing messages.Here so-called being better than, according to the difference of correlative value, may there is the situation that is less than or greater than correlative value.
The variation of the display interface in shooting process is described with reference to Figure 13.
As shown in Figure 13 (a), in the time not detecting that the degree of correlation is greater than the thermal-image data frame of the first correlative value (degree of correlation number percent that supposition the first correlative value converts is 72%), show dynamic infrared thermal imagery.
Response detects indication for the first time, as shown in Figure 13 (b), in the time detecting that the degree of correlation is greater than the thermal-image data frame of the first correlative value for the first time, show the announcement information that dynamic infrared thermal imagery is relevant with detected thermal-image data frame, the customizing messages of this thermal-image data frame of this announcement information based on the indicated storage of selection portion 11C for example this thermal-image data frame, the value of the degree of correlation, evaluation of estimate generate; Announcement information comprises the infrared thermal imagery 1301 that this thermal-image data frame generates, the degree of correlation number percent 85% that the value of the degree of correlation converts, the evaluation of estimate number percent 80% that evaluation of estimate converts.And the correlative value renewal 11B of portion is for example updated to 85%, the three correlative value by the second correlative value and is for example updated to 80%; And, not detecting when being greater than the second correlative value and/or being greater than the thermal-image data frame of the 3rd correlative value when follow-up, display part 10 will keep showing the state of infrared thermal imagery 1301 announcement informations such as grade and Dynamic IR thermal imagery; And due to the announcement information that infrared thermal imagery 1301 generates for the current customizing messages newly obtaining, the frame of overstriking is reminded user.
Response detects indication for the second time, as shown in Figure 13 (c), in the time that detects the thermal-image data frame that is greater than the second correlative value and the 3rd correlative value, show the customizing messages that dynamic infrared thermal imagery is relevant with detected thermal-image data frame, this customizing messages comprises the infrared thermal imagery 1302 that this thermal-image data frame generates etc., at this, because the corresponding degree of correlation of infrared thermal imagery 1302 is greater than infrared thermal imagery 1301, and its evaluation of estimate is less than infrared thermal imagery 1301, so selection portion 11C keeps these two relevant customizing messages of thermal-image data frame; And the correlative value renewal 11B of portion will, according to the corresponding degree of correlation of infrared thermal imagery 1302, upgrade the second correlative value; The announcement information that notification unit 11D generates the customizing messages that makes display part 10 show that two different thermal-image data frames obtain.At this moment, because the customizing messages such as infrared thermal imagery 1301,1302 corresponding thermal-image data frames remain on interim storage part 2, the information that user can show from display part 10, as infrared thermal imagery 1301,1302, is selected the follow-up corresponding thermal-image data frame that records or analyze.
Response detects indication for the third time, and, as shown in Figure 13 (d), in the time that degree of correlation detecting is greater than the second correlative value and evaluation of estimate and is greater than the thermal-image data frame of the 3rd correlative value, selection portion 11C keeps the customizing messages relevant with infrared thermal imagery 1303, or also infrared thermal imagery 1301,1302 relevant customizing messages is deleted; And the correlative value renewal 11B of portion will, according to the corresponding degree of correlation of infrared thermal imagery 1303 (95%) and evaluation of estimate (95%), upgrade second, third correlative value; Notification unit 11D will make display part 10 show the customizing messages that dynamic infrared thermal imagery is relevant with detected this thermal-image data frame, and this customizing messages comprises the infrared thermal imagery 1303 that this thermal-image data frame generates etc.
Like this, selection portion 11C, the comparative result of portion based on the comparison, selects and keeps the value of the degree of correlation and/or evaluation of estimate to be greater than the relevant customizing messages of thermal-image data frame of the correlative value (the second correlative value, the 3rd correlative value) of regulation; In the interface of display part 10, the information that thermal-image data frame that always can the display notification degree of correlation is the highest and/or evaluation of estimate is the highest obtains, helps greatly user's shooting.
As mentioned above, in the present embodiment, not only can obtain the effect of embodiment 1, and, be provided with according to provisioning information and the supplementary of the specific shot body heat picture detecting, be used as the factor of comparison, in the time more excellent thermal-image data frame being detected, selection portion is selected this thermal-image data frame, and correlative value renewal portion upgrades accordingly to correlative value, thereby can choose the more preferably relevant customizing messages of thermal-image data frame; Can reach the operation easier that further attenuating vision is aimed at, improve the quality of the thermal-image data frame while shooting, the beneficial effect of prompting particular state, common user easily grasps this shooting technical ability, and random shooting is also easy to obtain high-quality thermal-image data frame.Certainly, arbitrary product of enforcement embodiments of the present invention might not need to reach above-described all advantages simultaneously.
In addition, although exemplified three correlative values, also more correlative value, evaluation of estimate and/or the supplementary that corresponding several differences stress and/or detect the provisioning information obtaining, the evaluation of estimate for example being obtained by position, size, the angle of inclination of specific shot body heat picture, the evaluation of estimate being obtained by assay value, environment temperature etc. etc.
In addition,, although exemplified multiple correlative values (three, or also can be reduced to two) in embodiment 2, wherein part is upgraded, part do not upgrade; But also can be configured to update all; Or also can remove the structure of the correlative value renewal 11B of portion, and prepare multiple corresponding correlative values in advance, all do not upgrade.
In embodiment 2, introduce according to the value of the degree of correlation and evaluation of estimate as example, also, according to obtaining multiple evaluations of estimate according to the detected provisioning information of test section 8, determine whether notifying according to multiple evaluations of estimate; Or, also will notify multiple thermal-image data frames that obtain according to different evaluations of estimate; Or, also the value of the degree of correlation and multiple evaluation of estimate are notified according to order or priority level.Notification unit 11D, (can be the action of upgrading according to the lastest imformation of the relevant customizing messages of the regulation thermal-image data frame of selection portion 11C selection and/or the correlative value renewal 11B of portion, also can be the information etc. of the correlative value after upgrading) notify, and preferred, the relevant customizing messages of regulation thermal-image data frame of up-to-date selection portion selection (normally the degree of correlation and/or evaluation of estimate are greater than correlative value) is notified.Like this, user is very convenient; For example heat is determined to position, size, the degree of tilt of subject, the value of the degree of correlation, as factor of evaluation, be convenient to obtain the thermal-image data frame of high-quality thermal-image data frame or specific photographing request; Using the value of thermal imagery assay value, the degree of correlation as factor of evaluation, be convenient to obtain subject analysis conditions in time.User is easy to hold and recognize the focus such as quality of shooting.
And, in the time the thermal-image data frame that is greater than the previous degree of correlation and/or evaluation of estimate being detected, the customizing messages that selection portion 11C obtains thermal-image data frame is before deleted, but also can continue to keep, at this moment, notification unit 11D also can show the relevant customizing messages of multiple thermal-image data frames, for example according to height of the degree of correlation and/or evaluation of estimate etc. because of these customizing messages of sequencing display usually.
And, in the present embodiment, effect of the present invention for convenience of explanation, and upgrade the explanation of the predetermined processing of effect as embodiment using selection portion 11C and notification unit 11D, but also can remove said structure, also form the present invention.
Other embodiment
Thermal imagery device 100 as the example of infrared coupling updating device has been described in the above-described embodiments separately.But the present invention is not only applicable to the thermal imagery device with shoot function, be also applicable to various devices as described above.
In addition, the detection time of regulation or the detection of specified quantity frame also can be set, notify the wherein the highest frame of the degree of correlation.
Also be not limited to the only the highest frame of notice, can be also other frame for example, the frame before or after sequential; Also can notify multiframe.
And, can not only detect the overall region of whole subject, and detect the multiple detection windows that subject are divided into multiple parts formations, like this, can more accurately detect; Wherein, for each parts, identical with entirety, prepare corresponding subject identifying information (can be template or characteristic quantity).
Also can be such embodiment, detection computations unit, also can be according to multiple characteristic quantities of template, calculate the multiple characteristic of correspondence amounts in corresponding detection window, and according to the corresponding correlative value of multiple characteristic quantities, obtain judged result, for example, according to the weighting of multiple characteristic quantities, obtain final judged result.
Also can be such embodiment, detection computations unit, also can be according to multiple characteristic quantities, first calculate the comparative result of one of them characteristic quantity and infrared thermal imagery, when being greater than the threshold values of regulation, and calculate the comparative result of next characteristic quantity and infrared thermal imagery, according to repeatedly comparing, obtain final judged result.
Note, in the above-described embodiment, can, to processing such as obtaining of the renewal of the quantity of the detection of the provisioning information of thermal-image data frame, correlative value, correlative value, supplementary, carry out different combinations, these combine all within the scope of the present invention.
Aspect of the present invention can also by stay alone and the program of executive logging on memory storage carried out the computing machine (or such as CPU, MPU etc. device) of the system or equipment of the function of above-described embodiment and by its step by the computing machine of system or equipment by for example reading with executive logging the program on memory storage and carrying out the function of above-described embodiment and the method for intellectual realizes.For this purpose, for example, via network or from for example, as in various types of recording mediums (, computer-readable medium) of memory storage program being provided to computing machine.
Although, can realize the functional block in accompanying drawing by hardware, software or its combination, conventionally do not need to arrange the structure of carrying out practical function piece with man-to-man corresponded manner.Can realize by a software or hardware module the piece of multiple functions.

Claims (10)

1. infrared coupling updating device, has,
Acquisition unit, for obtaining continuously thermal-image data frame;
Reference picture specifying part, is used to specify the composition data of reference picture;
Position setting unit, for arranging the location parameter of reference picture;
Display part, for the infrared thermal imagery that shows that reference picture and the thermal-image data frame obtaining continuously obtain;
Thermal imagery storage part, the multiframe thermal-image data frame obtaining for storing described acquisition unit;
Test section, for responding the indication of regulation, the multiframe thermal-image data frame based on storing in thermal imagery storage part, detects the provisioning information relevant with specific shot body heat picture in thermal-image data frame;
Comparing section, compares for test section being detected to the provisioning information obtaining and/or the evaluation of estimate obtaining based on detecting the provisioning information of acquisition and the correlative value of regulation;
Correlative value renewal portion, for upgrading correlative value;
Wherein, after correlative value is upgraded, described comparing section, the evaluation of estimate obtaining for test section being responded to follow-up regulation indication, detect the provisioning information obtaining and/or the provisioning information obtaining based on detection, compares with the correlative value after upgrading.
2. infrared coupling updating device, has,
Acquisition unit, for obtaining continuously thermal-image data frame;
Reference picture specifying part, is used to specify the composition data of reference picture;
Position setting unit, for arranging the location parameter of reference picture;
Display part, for the infrared thermal imagery that shows that reference picture and the thermal-image data frame obtaining continuously obtain;
Thermal imagery storage part, the multiframe thermal-image data frame obtaining for storing described acquisition unit;
Test section, for responding the indication of regulation, the multiframe thermal-image data frame based on storing in thermal imagery storage part, detects the provisioning information relevant with specific shot body heat picture in thermal-image data frame;
Supplementary acquisition unit, for obtaining supplementary;
Comparing section, for test section being detected to the provisioning information obtaining, supplementary that supplementary acquisition unit is obtained, test section detect the supplementary that the provisioning information that obtains and supplementary acquisition unit obtain and evaluation of estimate, the test section obtaining detected the provisioning information obtaining and the evaluation of estimate obtaining, supplementary that supplementary acquisition unit is obtained and the evaluation of estimate that obtains, the one or more and correlative value of regulation wherein compares;
Correlative value renewal portion, for upgrading according to comparing section correlative value;
Wherein, after correlative value is upgraded, described comparing section, for test section being responded to follow-up regulation indication, test section is detected to the provisioning information obtaining, supplementary that supplementary acquisition unit is obtained, test section detect the supplementary that the provisioning information that obtains and supplementary acquisition unit obtain and evaluation of estimate, the test section obtaining detected the provisioning information obtaining and the evaluation of estimate obtaining, supplementary that supplementary acquisition unit is obtained and the evaluation of estimate that obtains, wherein one or more with upgrade after correlative value compare.
3. infrared coupling updating device as claimed in claim 1, is characterized in that, described provisioning information at least comprises the information of a kind of or combination in any in the value of position, size, angle of inclination, the degree of correlation of specific shot body heat picture.
4. infrared coupling updating device as claimed in claim 2, is characterized in that, described provisioning information at least comprises the information of a kind of or combination in any in the value of position, size, angle of inclination, the degree of correlation of specific shot body heat picture; Described supplementary, at least comprises the information of a kind of or combination in any in assay value, environment temperature, wind speed, contextual factor, humidity, distance.
5. infrared coupling updating device as claimed in claim 1, is characterized in that having
Correlative value renewal portion, for upgrading correlative value; Wherein, in the time having multinomial correlative value, at least one item to the multinomial correlative value of major general upgrades;
And, after correlative value is upgraded, described comparing section, the evaluation of estimate obtaining for test section being responded to follow-up regulation indication, detect the provisioning information obtaining and/or the provisioning information obtaining based on detection, compares with the correlative value after upgrading; Wherein, in the time that the correlative value of the subitem in multinomial correlative value is upgraded, after renewal, described comparing section, for provisioning information that test section subsequent detection is obtained and/or based on detecting the provisioning information that obtains the evaluation of estimate that obtains, with the correlative value of the renewal item in multinomial correlative value and a correlative value of not upgrading compare.
6. infrared coupling updating device as claimed in claim 2, is characterized in that having
Correlative value renewal portion, for upgrading correlative value; Wherein, in the time having multinomial correlative value, at least one item to the multinomial correlative value of major general upgrades;
And, after correlative value is upgraded, described comparing section, for regulation follow-up response is indicated, test section detects the provisioning information obtaining, supplementary that supplementary acquisition unit is obtained, test section and detects the supplementary that the provisioning information that obtains and/or supplementary acquisition unit obtain and the evaluation of estimate obtaining, wherein at least one with renewal after correlative value compare; Wherein, in the time that the correlative value of the subitem in multinomial correlative value is upgraded, after renewal, the provisioning information that test section subsequent detection is obtained, supplementary that supplementary acquisition unit is obtained, test section detect the supplementary that the provisioning information that obtains and/or supplementary acquisition unit obtain and the evaluation of estimate obtaining, and compare with the correlative value of the renewal item in corresponding multinomial correlative value and the correlative value do not upgraded.
7. as claim 1, the infrared coupling updating device described in 2, is characterized in that,
Described correlative value renewal portion, according to predetermined correlative value, upgrades correlative value; Wherein, in the time having multinomial correlative value, at least one in corresponding correlative value is upgraded.
8. infrared coupling updating device as claimed in claim 1, is characterized in that,
Comparing section, compares for test section being detected to the value of the degree of correlation obtaining and/or the evaluation of estimate obtaining based on detecting the provisioning information of acquisition and the correlative value of regulation; In the time that the value of the described degree of correlation and/or evaluation of estimate are better than correlative value, correlative value renewal portion upgrades correlative value.
9. the infrared coupling updating device as described in claim 1-8, is characterized in that having
Selection portion, the comparative result of portion based on the comparison, selects the customizing messages relevant with the thermal-image data frame of regulation; Described customizing messages at least comprises the thermal-image data frame of selecting from the multiframe thermal-image data frame of thermal imagery storage portion stores, the data that the thermal-image data frame of selecting from the multiframe thermal-image data frame of thermal imagery storage portion stores obtains after processing according to the rules, detect the provisioning information obtaining, the evaluation of estimate the obtaining based on detecting the provisioning information obtaining, the information generating based on described provisioning information and/or described evaluation of estimate, wherein one or more;
Notification unit, the renewal of the customizing messages to the up-to-date selection of selection portion and/or the lastest imformation of correlative value and/or correlative value, notifies.
10. infrared coupling update method, has,
Obtaining step, for obtaining continuously thermal-image data frame;
Reference picture given step, is used to specify the composition data of reference picture;
Position setting steps, for arranging the location parameter of reference picture;
Step display, for the infrared thermal imagery that shows that reference picture and the thermal-image data frame obtaining continuously obtain;
Thermal imagery storing step, the multiframe thermal-image data frame obtaining for storing described obtaining step;
Detecting step, for responding the indication of regulation, the multiframe thermal-image data frame based on storing in thermal imagery storing step, detects the provisioning information relevant with specific shot body heat picture in thermal-image data frame;
Comparison step, compares for detecting step being detected to the provisioning information obtaining and/or the evaluation of estimate obtaining based on detecting the provisioning information of acquisition and the correlative value of regulation;
Correlative value step of updating, for upgrading correlative value;
Wherein, after correlative value is upgraded, described comparison step, the evaluation of estimate obtaining for detecting step being responded to follow-up regulation indication, detect the provisioning information obtaining and/or the provisioning information obtaining based on detection, compares with the correlative value after upgrading.
CN201210581674.6A 2012-12-27 2012-12-27 Infrared matching updating device and infrared matching updating method Pending CN103900703A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201210581674.6A CN103900703A (en) 2012-12-27 2012-12-27 Infrared matching updating device and infrared matching updating method
CN202211002685.4A CN116358711A (en) 2012-12-27 2012-12-27 Infrared matching updating device and infrared matching updating method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210581674.6A CN103900703A (en) 2012-12-27 2012-12-27 Infrared matching updating device and infrared matching updating method

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202211002685.4A Division CN116358711A (en) 2012-12-27 2012-12-27 Infrared matching updating device and infrared matching updating method

Publications (1)

Publication Number Publication Date
CN103900703A true CN103900703A (en) 2014-07-02

Family

ID=50992169

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202211002685.4A Pending CN116358711A (en) 2012-12-27 2012-12-27 Infrared matching updating device and infrared matching updating method
CN201210581674.6A Pending CN103900703A (en) 2012-12-27 2012-12-27 Infrared matching updating device and infrared matching updating method

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202211002685.4A Pending CN116358711A (en) 2012-12-27 2012-12-27 Infrared matching updating device and infrared matching updating method

Country Status (1)

Country Link
CN (2) CN116358711A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014190913A1 (en) * 2013-05-29 2014-12-04 Wang Hao Thermal imaging device, analysis device and thermal image photography method and analysis method
CN110426748A (en) * 2019-08-26 2019-11-08 深圳市枫芒科技有限公司 There are detection method, device, storage mediums for quasi- static human body

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060164682A1 (en) * 2005-01-25 2006-07-27 Dspv, Ltd. System and method of improving the legibility and applicability of document pictures using form based image enhancement
CN101505372A (en) * 2008-02-06 2009-08-12 凹凸电子(武汉)有限公司 System and method for optimizing camera settings
CN102538980A (en) * 2012-01-12 2012-07-04 杭州美盛红外光电技术有限公司 Thermal image device and shooting method for thermal image
US8253105B1 (en) * 2007-06-15 2012-08-28 Fluke Corporation System and method for analyzing thermal images

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060164682A1 (en) * 2005-01-25 2006-07-27 Dspv, Ltd. System and method of improving the legibility and applicability of document pictures using form based image enhancement
US8253105B1 (en) * 2007-06-15 2012-08-28 Fluke Corporation System and method for analyzing thermal images
CN101505372A (en) * 2008-02-06 2009-08-12 凹凸电子(武汉)有限公司 System and method for optimizing camera settings
CN102538980A (en) * 2012-01-12 2012-07-04 杭州美盛红外光电技术有限公司 Thermal image device and shooting method for thermal image

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014190913A1 (en) * 2013-05-29 2014-12-04 Wang Hao Thermal imaging device, analysis device and thermal image photography method and analysis method
CN110426748A (en) * 2019-08-26 2019-11-08 深圳市枫芒科技有限公司 There are detection method, device, storage mediums for quasi- static human body

Also Published As

Publication number Publication date
CN116358711A (en) 2023-06-30

Similar Documents

Publication Publication Date Title
CN105611230B (en) Image processing apparatus and image processing method
CN103900715A (en) Infrared selecting device and infrared selecting method
CN103900712A (en) Device and method for selecting thermal image
JP2018182593A (en) Image processing apparatus and image processing method
CN103900711A (en) Infrared selecting device and infrared selecting method
CN104748862A (en) Analyzing device and analyzing method
CN104215336A (en) Thermal-image device, thermal-image analyzing device, thermal-image shooting method and thermal-image analyzing method
CN103900703A (en) Infrared matching updating device and infrared matching updating method
CN103900714A (en) Device and method for thermal image matching
CN103900705A (en) Thermal image selection notification device and thermal image selection notification method
CN103900706A (en) Infrared selection notification device and infrared selection notification method
CN103900702A (en) Thermal image matching updating device and thermal image matching updating method
CN103900713A (en) Device and method for detecting thermal image
CN103900709A (en) Thermal image selection notification device and thermal image selection notification method
CN103900708A (en) Infrared selection notification device and infrared selection notification method
CN103900704A (en) Infrared detection updating device and infrared detection updating method
CN104751445A (en) Thermal image analysis configuration device and thermal image analysis configuration method
CN103900710A (en) Device and method for selecting thermal image
CN104748861A (en) Selecting device and selecting method
CN105208299A (en) Thermal image shooting device, thermal image processing device, thermal image shooting method and thermal image processing method
CN104655638A (en) Analytical comparison device and analytical comparison method
CN103900707A (en) Thermal image detection updating device and thermal image detection updating method
CN103900697A (en) Infrared recording and controlling device and infrared recording and controlling method
CN103900721A (en) Device and method for recording and controlling thermal image
CN103902967A (en) Image identification control device and image identification control method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Yuhang District of Hangzhou city in Zhejiang province 311113 Qixian Village Building 1 Liangzhu Street Bridge

Applicant after: MISSION INFRARED ELECTRO OPTICS TECHNOLOGY Co.,Ltd.

Address before: Hangzhou City, Zhejiang province Binjiang District 310051 shore road 1180, room 1 No. 2 factory on the west side of the five floor corridor Room 501

Applicant before: MISSION INFRARED ELECTRO OPTICS TECHNOLOGY Co.,Ltd.

CB02 Change of applicant information
RJ01 Rejection of invention patent application after publication

Application publication date: 20140702

RJ01 Rejection of invention patent application after publication