CN103900708A - Infrared selection notification device and infrared selection notification method - Google Patents

Infrared selection notification device and infrared selection notification method Download PDF

Info

Publication number
CN103900708A
CN103900708A CN201210584104.2A CN201210584104A CN103900708A CN 103900708 A CN103900708 A CN 103900708A CN 201210584104 A CN201210584104 A CN 201210584104A CN 103900708 A CN103900708 A CN 103900708A
Authority
CN
China
Prior art keywords
thermal
image data
data frame
value
obtaining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201210584104.2A
Other languages
Chinese (zh)
Inventor
王浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Original Assignee
Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Mission Infrared Electro Optics Technology Co Ltd filed Critical Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Priority to CN202210406409.8A priority Critical patent/CN114923580A/en
Priority to CN201210584104.2A priority patent/CN103900708A/en
Publication of CN103900708A publication Critical patent/CN103900708A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention provides an infrared selection notification device and an infrared selection notification method, and relates to the fields of thermal image devices, thermal image processing devices, and the application of infrared thermal imaging detection. According to a thermal image device in the prior art, the thermal image of a shot object is shot depending on the subjective experience of a user when shooting is carried out; the workload is heavy; and the quality of the thermal image is difficultly ensured. According to the invention, the provided infrared selection notification device and infrared selection notification method can detect the set information of the thermal image of the specific shot object in an acquired thermal image data frame, or the factor of auxiliary information is considered; the device and the method can automatically select a thermal image data frame which satisfies a set condition from thermal image data frames which are continuously acquired and carry out notification, which is conductive to further analysis, storage and other processing or operation; and the device and the method have the advantages of simple shooting operation, fast shooting speed and high thermal image quality.

Description

Infrared selection notifying device and infrared selection Notification Method
Technical field
Infrared selection notifying device of the present invention and infrared selection Notification Method, relate to hand-held shooting or the online various thermal imagery devices of taking, and receives and process the thermal imagery treatment facility of thermal imagery, and the application of infrared detection.
Background technology
Since the application of thermal imagery detection technique, user is the puzzled cognition of subject imaging form and the control of shooting distance under to correct shoot part position, shooting angle always, these depend on user's subjective idea and experience, cause at present if guarantee that the quality detecting needs the thinking of shooting limit, limit, shooting speed is very slow, if pick up speed, easily omits crucial position or the subject defect of taking, affect the effect of state estimation.Conventionally need the practice accumulation of several years, user just can reach higher detection level.
Those skilled in the art attempts to address this problem always, there is such technology, the reference picture and the infrared thermal imagery that have embodied subject morphological feature are carried out to continuous overlapping demonstration, user is using this reference picture as the vision reference of taking specific shot body heat picture, carry out the shooting of subject, guarantee morphological feature correct of position, size and the specific shot body heat picture of specific shot body heat picture in infrared thermal imagery, to have guaranteed the quality of taking.For example patent documentation application number: 201210008404.6 disclose such thermal imagery filming apparatus.
But aforesaid way needs user manually to judge the matching degree of reference picture and specific shot body heat picture by vision, user easily produces visual fatigue; When use be hand-held thermal imagery device time, aim at the processing ease fatigue of taking, time of the shooting that aiming repeatedly extends, and affected the thermal imagery quality of taking.And it is stiff that this mode operates, requiring that shooting is aimed at is high.
Therefore, understand need a kind of infrared selection notifying device, it can reach without depending on the subjective idea of user unduly, can from obtained thermal-image data frame, automatically select to meet the thermal-image data frame of rated condition, going forward side by side works knows, is beneficial to analysis, storage etc. and processes or operate, thereby make simple to operate, the thermal-image data frame quality obtaining is high
Summary of the invention
The invention provides a kind of infrared selection notifying device and infrared selection Notification Method, in infrared thermal imagery, show reference picture, and can automatically detect the provisioning informations such as position, size, the angle of inclination of specific shot body heat picture in obtained thermal-image data frame, the value of the degree of correlation, or also consider the factor of supplementary, from the thermal-image data frame obtaining continuously, automatically select to meet the thermal-image data frame of rated condition with this, be beneficial to further notify, analyze, storage etc. processed or operation.Thereby make the simple to operate of shooting, shooting speed is fast, and thermal imagery quality is high.For example, and the present invention is also applicable to detect qualified thermal-image data frame the thermal-image data frame (being obtained from thermal imagery file) from a large amount of processing.
For this reason, by the following technical solutions, infrared selection notifying device, has in the present invention,
Acquisition unit, for obtaining continuously thermal-image data frame;
Reference picture specifying part, is used to specify the composition data of reference picture;
Position setting unit, is positioned at the location parameter of infrared thermal imagery for reference picture is set;
Image processing part, for composition data and the set location parameter of position setting unit of the reference picture based on specified, carries out predetermined processing to obtained thermal-image data frame, generates the infrared thermal imagery that has embodied reference picture;
Display part, for showing the image obtaining after predetermined processing;
Test section, for the thermal-image data frame obtaining continuously based on acquisition unit, detects the provisioning information relevant with specific shot body heat picture in thermal-image data frame;
Comparing section, compares for test section being detected to the provisioning information obtaining and/or the evaluation of estimate obtaining based on detecting the provisioning information of acquisition and the correlative value of regulation;
Notification unit, the comparative result of portion, notifies based on the comparison.
Adopting on the basis of technique scheme, the present invention also can adopt following further technical scheme simultaneously: infrared selection notifying device, have,
Acquisition unit, for obtaining continuously thermal-image data frame;
Reference picture specifying part, is used to specify the composition data of reference picture;
Position setting unit, is positioned at the location parameter of infrared thermal imagery for reference picture is set;
Image processing part, for composition data and the set location parameter of position setting unit of the reference picture based on specified, carries out predetermined processing to obtained thermal-image data frame, generates the infrared thermal imagery that has embodied reference picture;
Display part, for showing the image obtaining after predetermined processing;
Test section, for the thermal-image data frame obtaining continuously based on acquisition unit, detects the provisioning information relevant with specific shot body heat picture in thermal-image data frame;
Supplementary acquisition unit, for obtaining supplementary;
Comparing section, for test section being detected to the provisioning information that obtains and the supplementary obtained of supplementary acquisition unit and/or test section detect the supplementary that the provisioning information that obtains and supplementary acquisition unit obtain and the evaluation of estimate obtaining compares with the correlative value of regulation;
Notification unit, the comparative result of portion, notifies based on the comparison.
Infrared selection Notification Method of the present invention, has,
Obtaining step, for obtaining continuously thermal-image data frame;
Reference picture given step, is used to specify the composition data of reference picture;
Position setting steps, is positioned at the location parameter of infrared thermal imagery for reference picture is set;
Image processing step, for composition data and the set location parameter of position setting steps of the reference picture based on specified, carries out predetermined processing to obtained thermal-image data frame, generates the infrared thermal imagery that has embodied reference picture;
Step display, for showing the image obtaining after predetermined processing;
Detecting step, for the thermal-image data frame obtaining continuously based on obtaining step, detects the provisioning information relevant with specific shot body heat picture in thermal-image data frame;
Comparison step, compares for detecting step being detected to the provisioning information obtaining and/or the evaluation of estimate obtaining based on detecting the provisioning information of acquisition and the correlative value of regulation;
Notifying process, the comparative result of step, notifies based on the comparison.
Other aspects of the present invention and advantage will be set forth by instructions below.
Accompanying drawing explanation:
Fig. 1 is the block diagram that represents the summary formation of the thermal imagery device 100 of embodiments of the invention 1.
Fig. 2 is the external form figure of the thermal imagery device 100 of embodiment 1.
Fig. 3 is the schematic diagram of subject information, the subject identifying information etc. stored in embodiment 1 storage medium.
Fig. 4 is the schematic diagram of the detection window of different parameters.
Fig. 5 arranges the schematic diagram that detection window detects in surveyed area.
Fig. 6 is the display case of the display interface of the processing procedure of embodiment 1.
Fig. 7 is the control flow chart that represents embodiment 1.
Fig. 8 is the control flow chart that represents embodiment 2.
Fig. 9 is the display case of the display interface of the processing procedure of embodiment 2.
Figure 10 is the control flow chart that represents embodiment 3.
Figure 11 is the display case of the display interface of the processing procedure of embodiment 4.
Embodiment
To describe with reference to the accompanying drawings now exemplary embodiments of the present invention in detail.Note, the embodiment that below will illustrate is for understanding better the present invention, thus do not limit the scope of the invention, and can change the various forms in scope of the present invention.And, although the present invention in following examples for the thermal imagery capture apparatus of hand-held, shoot function not necessarily, can use any thermal-image data source that will carry out special object survey for the present invention.Therefore the present invention is widely used in to read and play or show and records thermal imagery or the thermal imagery treatment facility from outside reception and processing thermal imagery.Described thermal imagery treatment facility comprises devices as various in personal computer, personal digital assistant etc.
Embodiment 1
The infrared selection notifying device of thermal imagery device 100(of embodiment 1) thermal-image data frame (take obtain thermal-image data frame refer to thermal imagery signal frame) based on taken acquisition by shoot part 1, the degree of correlation between thermal-image data frame and subject identifying information that detection is obtained, and, thermal-image data frame relevant customizing messages corresponding to maximal correlation degree of thermal imagery device 100 based on obtaining, notifies user.
Fig. 1 be represent the infrared selection notifying device of embodiments of the invention 1 example thermal imagery device 100 summary form block diagram.
Particularly, thermal imagery device 100 has shoot part 1, interim storage part 2, flash memory 3, communication I/F4, storage card I/F5, storage card 6, image processing part 7, test section 8, display control unit 9, display part 10, control part 11, operating portion 12, control part 11 are connected with above-mentioned appropriate section with data bus 13 by controlling, and are responsible for the overall control of thermal imagery device 100.
Shoot part 1 is made up of not shown optics, lens driving parts, infrared eye, signal pre-processing circuit etc.Optics is made up of infrared optics lens, for the infrared radiation of reception is focused on to infrared eye.Lens driving parts drive lens to carry out according to the control signal of control part 11 and focus on or zoom operation.In addition also can be, the optics of manual adjustments.Infrared eye, as the infrared focal plane detector of refrigeration or non-refrigeration type, is converted to electric signal the infrared radiation by optics.Signal pre-processing circuit comprises sample circuit, A/D convertor circuit, timing trigger circuit etc., by signal processing such as the electric signal from infrared eye output sample within the cycle of regulation, be converted to digital thermal imagery signal through A/D convertor circuit, this thermal imagery signal is for example 14 or 16 s' binary data (being called again AD value).In embodiment 1, shoot part 1 is as the example of acquisition unit.
So-called thermal-image data, can be thermal imagery signal (the AD Value Data that infrared eye output signal obtains after AD conversion), or the view data of infrared thermal imagery, or the array data of temperature value, or other data that generate based on thermal imagery signal etc.Thermal-image data is take thermal imagery signal as example hereinafter.
Interim storage part 2 is as the volatile memory such as RAM, DRAM, carry out the memory buffer of interim storage as the thermal-image data frame that shoot part 1 is exported, for example be repeated below processing, by the thermal-image data frame interim store predetermined time of obtaining, and in the time obtaining new frame by described acquisition unit (shoot part 1), store new thermal-image data frame after deleting old frame; , work as the working storage of image processing part 7, test section 8, control part 11 etc. meanwhile, the data that temporary transient storage is processed.Be not limited to this, storer or register etc. that the processor inside such as image processing part 7, test section 8, control part 11 comprise also can be interpreted as a kind of temporary storage medium.
Flash memory 3, stores the program for controlling, and the various data that use in each several part control.In the present embodiment, as shown in Figure 3, the data relevant with reference picture, detection etc. are stored in flash memory 3, for example store the database (table 3) of subject identifying information, the composition data of the subject information of each subject, reference picture, subject identifying information is mutually corresponding, be stored in this property data base, in addition, also can store with the data file of specific format etc.The composition data of called reference image, for example vector figure data, dot matrix image data, also comprise the composition data that is made up of reference picture multiple coordinate points data.Wherein template can reference picture and identical or different.Subject information is the information relevant with subject, for example represent the information of subject place, type, numbering etc., in addition, can also exemplify the various information such as the relevant ownership unit of subject, classification grade (as electric pressure, important level etc.), model, manufacturer, performance and characteristic, the shooting in past or the resume of maintenance, build date, term of life.
Communication I/F4 is for example according to communication specifications such as USB, 1394, networks, thermal imagery device 100 is connected to the also interface of exchanges data with external device (ED), as external device (ED), for example, can enumerate personal computer, server, PDA(personal digital assistant device), other thermal imagery device, visible ray filming apparatus, memory storage etc.
Storage card I/F5, as the interface of storage card 6, on storage card I/F5, be connected with the storage card 6 as rewritable nonvolatile memory, be arranged in the draw-in groove of thermal imagery device 100 main bodys detachable, record the data such as thermal-image data according to the control of the record control unit of control part 11 (omitting diagram).
The processing that image processing part 7 stipulates for the thermal-image data frame to obtaining by shoot part 1, for example it is when the each arrival of Displaying timer, from be stored in the thermal-image data frame of stipulated time of described interim storage part 2 temporarily, select and read the frame of each specific time interval; The processing of image processing part 7 is as correction, interpolation, pseudo-color, synthetic, compression, decompress(ion) etc., is converted to and is suitable for showing the processing of using etc. data with, record.Image processing part 7 for example can adopt DSP or other microprocessors or programmable FPGA etc. to realize, or, also can be integrated with test section 8, processor that control part 11 is corresponding.
Image processing part 7 obtains the view data of infrared thermal imagery for shoot part 1 being taken to the processing of the thermal-image data enforcement regulation obtaining.Particularly, for example, image processing part 7 is taken to shoot part 1 thermal-image data obtaining and is carried out the predetermined processing such as Nonuniformity Correction, interpolation, and the thermal-image data after predetermined processing is carried out to the color processing of puppet, obtains the view data of infrared thermal imagery; Pseudo-color a kind of embodiment of processing, for example determine the color table scope of corresponding puppet, the view data using the concrete color value of thermal-image data correspondence in pseudo-colored steel scope as its respective pixel position in infrared thermal imagery according to the setting range of the scope of thermal-image data (AD value) or AD value.The view data obtaining from pseudo-color processing of image processing part 7 is sent in the interim storage part 2 using as memory buffer.
In addition, image processing part 7 possesses synthesis unit (not shown), the composition data of described synthesis unit based on the specified reference picture of reference picture specifying part 11F, and the location parameter of position setting unit 11G setting, obtain reference picture, and with the infrared thermal imagery that image processing part 7 generates, after synthesizing, produce the view data of composograph.Specifically, image synthesis unit transparent rate according to the rules, synthesizes with reference to image and infrared thermal imagery; Comprise this situation, the transparent rate of reference picture is the string diagram picture that 1(is edge contour as reference picture), opaque synthetic with infrared thermal imagery.
Image processing part 7, for composition data and the set location parameter of position setting unit 11G of the reference picture based on specified, carries out predetermined processing to obtained thermal-image data frame, generates the infrared thermal imagery that has embodied reference picture.
In addition, synthetic can be also according to such processing, for example be arranged in the location of pixels of infrared thermal imagery according to reference picture, thermal-image data frame is carried out to the color processing of puppet, embodied the display image data (similar overlapping effect) of reference picture and infrared thermal imagery to generate; For example, according to the location of pixels that is arranged in infrared thermal imagery of reference picture, the thermal-image data of this location of pixels is not carried out to the color processing of puppet, carry out the color processing of puppet with reference to the thermal-image data beyond the location of pixels of image, then, in conjunction with the view data of reference picture, generate display image data.
Or, also can be with reference to the pixel of the location of pixels in the corresponding thermal-image data frame of image, carry out (as pseudo-color processing, generating with the image that embodies this reference picture with the color processing of the puppet difference processing of other thermal-image datas of putting as numerical digit that generate infrared thermal imagery.In this case, in thermal imagery device 100, can remove for reference to image and the synthetic image synthesis unit of infrared thermal imagery.
So-called reference picture, refers to infrared thermal imagery and jointly shows, helps user and take the image of specific shot body.For example, embody the image of the morphological feature of this specific shot body; Reference picture can be also other shape, as square, circular; For example, embody subject thermal imagery be arranged in infrared thermal imagery expectation image space identification image; For example embody the identification image of the surveyed area (surveyed area can comprise one or more detection windows) in infrared thermal imagery; For example embody the identification image of the analyzed area of the subject thermal imagery of expecting etc.Preferred mode, location parameter according to the rules of reference picture (position or also comprise size, or also comprise the anglec of rotation) and the overlapping demonstration of infrared thermal imagery; In addition, reference picture also can be shown in display part, the region outside infrared thermal imagery window; In addition also the thumbnail of the relation such as position and dimension scale that represents reference picture and infrared thermal imagery can be presented at, to the region of the display part outside infrared thermal imagery window.
The thermal-image data frame of test section 8 based on obtaining, carries out the relatedness computation between subject identifying information; Wherein, the thermal-image data frame that test section 8 obtains continuously based on acquisition unit, can be that thermal-image data frame to obtaining continuously all carries out Check processing successively, also can from the thermal-image data frame obtaining continuously, select part thermal-image data frame to carry out Check processing, the thermal-image data frame that for example only reads predetermined distance carries out Check processing; For example, when detecting for the first time while being greater than the thermal-image data frame of correlative value with the degree of correlation and/or evaluation of estimate, no longer continue to detect; The scheduled operation that for example responds user starts to detect or stops detecting; Or before being detected, the thermal-image data in the thermal-image data frame reading or detection window carries out dwindling processing; With this, can alleviate the processing load that is accompanied by detection.
So-called thermal-image data, can be thermal imagery signal (AD value), or the view data of infrared thermal imagery, or the array data of temperature value, or other data based on thermal imagery signal acquisition etc.For example, the control of test section 8 based on control part 11, can take the thermal imagery signal frame obtaining by reading the shoot part 1 of storing in interim storage part 2, or the data (for example view data of the pseudo-color infrared thermal imagery of processing acquisition) of carrying out predetermined processing acquisition by reading the image processing part thermal imagery signal frame that 1 shooting obtains to shoot part of storing in interim storage part 2, the Check processing of the degree of correlation between the subject identifying information of carrying out and registering.Being not limited to shoot part 1 and taking the thermal-image data frame obtaining, can be also that the data of outside input obtain by predetermined processing, for example, by the I/F4 thermal imagery signal frame (or picture frame of infrared thermal imagery) that decoding obtains from other thermal imagery devices receive.Also can from recording medium, obtain, for example, from storage card 5, read thermal imagery file and obtain thermal imagery signal frame (or picture frame of infrared thermal imagery).
Test section 8 comprises feature registration unit, detection window setting unit, detecting unit (not shown).
Feature registration unit, for registering the subject identifying information relevant for relatedness computation.For example, can register subject identifying information according to subject identifying information pre-stored in storage medium; For example, according to the subject identifying information of the subject information association of user's selection, register the subject identifying information for relatedness computation.In addition, also can specify subject identifying information by user, for example can for example, by specifying subject region to obtain subject identifying information (template data, or the characteristic quantity extracting) from show image.The subject identifying information of registering is for example stored in the assigned position of interim storage part 2, or when storage is distinguished with other subject identifying informations of mark and storage.
So-called subject identifying information can be the template data for template matches; In addition, subject identifying information can be also the characteristic quantity of parametric description, so-called characteristic quantity features such as () point, line, surface, for example, for the value determining according to the state of the pixel comprising in detection window, as be central point, the area etc. of the profile of mean value, the specific shot body of ratio, the pixel value of the established part pixel in particular detection window.For example, for the subject 1 in table 3, subject identifying information is template data 301, and for the subject 2 in table 3, subject identifying information is characteristic quantity 302.In concrete application, can according to circumstances select the wherein combination of one or more modes.
Detection window setting unit, for arranging detection window.For example, according to the surveyed area of certain limit (as the G1 in Fig. 5), multiple detection windows (for example carrying out the parameter of predetermined detection window according to quality requirements) are set in this surveyed area G1, it can be the detection window of multiple different sizes, also can be the detection window after a nearly step tilts, as shown in Figure 4, the detection window that wherein Fig. 4 (a) is standard, Fig. 4 (b) is the detection window according to minification, Fig. 4 (c) is the detection window that up-sizing arranges, and Fig. 4 (d) is angle tilts to arrange according to the rules detection window.In order to equal the size of detection window, template image to be to dwindle or to amplify or the state that also tilts is used herein, or, also can prepare and template image that sizes of memory equals window size in order to using.In addition, also can by the thermal-image data in detection window with dwindle amplify or also tilt state used, with corresponding templates image.Detection window is not limited to square, can be also other shape, for example, can determine according to the shape of template.
Surveyed area can be arranged according to taking custom by user; Or can be also prestore as with subject information association; Also can generate according to the position that detected specific shot body heat picture last time; Surveyed area also can be set, and the scope of giving tacit consent to thermal-image data frame is surveyed area.Also can be that position and the size that user specifies arranges multiple detection windows.In addition, and nonessential multiple detection windows are set, a detection window also can be only set.
It should be noted that the application for infrared detection, for example, in transformer station, be flooded with a large amount of profiles similar, but the different equipment of title, for avoiding misleading user and mistake is taken, surveyed area is preferably set.The mark of overlapping demonstration surveyed area on infrared thermal imagery, user is easy to understand approximate location, the size etc. of captured specific shot body heat picture, is convenient to take reference.And can accelerate the speed of Check processing, but surveyed area also can not show.
Detecting unit, by the thermal-image data based in the set detection window of detection window setting unit in read thermal-image data frame, according to registered subject identifying information, obtains the value of the degree of correlation for evaluating similar degree.In the time being provided with multiple detection window, for example can be using the value of maximal correlation degree that wherein detects acquisition as the value of the degree of correlation of this thermal-image data frame.
The Check processing of test section 8 can be the detection mode based on template matches, and the thermal-image data based in detection window and template image carry out calculating and the comparison of the degree of correlation; For example, detecting unit calculate infrared thermal imagery in detection window and as the infrared thermal imagery of template mutually the difference between the pixel of corresponding position and, the difference calculating and less, the degree of correlation is higher.
Also can be configured to and extract the embodiment that mates of characteristic quantity, utilize and relatively carry out to determine the degree of correlation between the characteristic quantity of the thermal-image data in template and detection window.For example, extract the ratio of the specific pixel of the subject image in detection window, more approaching with the ratio of the specific pixel in template image, the degree of correlation is higher.
The Check processing of test section 8 can be also the detection embodiment of the characteristic quantity based on parametric description, the computing stipulating obtains the characteristic quantity of the thermal-image data in detection window, and compare with the reference value (subject identifying information) of characteristic quantity, obtain the value of the degree of correlation.For example, the ratio of the pixel that the reference value of described characteristic quantity is particular pixel values, detecting unit calculates the ratio of the pixel of particular pixel values in thermal-image data, compares with the reference value of characteristic quantity, obtains the value of the degree of correlation between the two.
Preferred mode, adopt the template of contour images as coupling, test section 8 for example calculates the degree of correlation by following processing, first, test section 8 extracts the thermal-image data that is arranged in detection window, according to the reservation threshold of AD value, the thermal-image data in the detection window reading is carried out to binaryzation; Then, extract the Contiguous graphics that the pixel with predetermined pixel value (1 or 0) of this bianry image is connected; Then judge whether this Contiguous graphics has the size of preset range; If judge the size of this Contiguous graphics in preset range, a nearly step is carried out relatively processing between the Contiguous graphics extracting and the template registered, for example calculate overlapping area between the two the ratio sum in the total area separately, thus, obtain the degree of correlation between the thermal-image data that extracts and template.
For the example detecting, as shown in Figure 5, test section 8 from the upper left corner of the regulation surveyed area G1 of thermal-image data frame 501 to lower right corner moving window J1 to detect, the thermal-image data in cutout window, and detect the degree of correlation of itself and template image T1.Particularly, window J1 for example, moves with the window shifts (pixel) of setting to the right step by step from left end, and arriving after right-hand member, is set up and returns to left end and move down window shifts, and again move right step by step subsequently.For detecting accurately subject, the transformation range at window size, the window shifts detecting, the angle of inclination of window is predefined, the variation range of for example window size is from 150 × 50 pixel to 120 × 40 pixels, the variation range of window shifts is from 10 pixel to 1 pixels, and the variation range at the angle of inclination of window is 0 ° to 10 ° based on central point.Successively, each 5 pixels ground changes window size to test section 8, and each 1 pixel ground changes window shifts, and each 2 ° of ground change window angle of inclination.Test section 8 carries out the relatedness computation of template image T1 and thermal-image data frame 501; After the detection that completes all detection windows, therefrom select the value of the degree of correlation that detection window that the degree of correlation is the highest obtains, as the value of the degree of correlation of these thermal-image data frame 501 correspondences.
Note, can, based on subject identifying information, calculate the whole bag of tricks of the degree of correlation of thermal-image data frame, the above-mentioned processing exemplifying be only can using method example.
Display control unit 9, is presented at display part 10 for the view data of demonstration use that interim storage part 2 is stored.For example, in shooting standby mode, show continuously the infrared thermal imagery of taking the thermal-image data generation obtaining; At playback mode, show the infrared thermal imagery of reading and expanding from storage card 6, in addition, also can show various set informations.Particularly, display control unit 9 has VRAM, VRAM control module, signal generation unit (not shown) etc., and, signal generation unit is under the control of control part 11, from VRAM, regularly read view data (reading and store into the view data of VRAM from interim storage part 2), the output of generation vision signal, is presented at display part 10.In thermal imagery device 100, display part 10 is for example liquid crystal indicator.Be not limited to this, display part 10 can also be other display device that are connected with thermal imagery device 100, and can there is no display part in the electrical structure of thermal imagery device 100 self, at this moment display control unit 9 also can be used as the example of the output block of the image that embodies advise fate.
In addition, in embodiment 1, the control of display part 10 based on notification unit 11D, for showing announcement information; For example warn with writings and image, as show the information of maximal correlation degree, show the infrared thermal imagery that the thermal-image data frame of maximal correlation degree obtains, or the mode such as variation that is also accompanied by the transparent rate, color, size of word, image, linear, thickness, flicker, brightness, frame is notified.
Wherein, the mode of notice can continue official hour.In addition, also controlled vibrating mass, the pilot lamp (not shown) heating in picture device 100, analysis component (not shown), deagnostic package (not shown), in the time the thermal-image data frame of maximal correlation degree being detected, also can produce light by pilot lamp and change, produce vibrations by vibrating device, analyzed and display analysis result by analysis component, diagnose and show diagnostic result by deagnostic package; Or simultaneously in the above described manner one or more notified, as long as the appreciable mode of user all can.
Control part 11 has been controlled the overall action of thermal imagery device 100, for example in flash memory 3, stores the program for controlling at storage medium, and the various data that use in each several part control.Control part 11 is for example realized by CPU, MPU, SOC, programmable FPGA etc.In the present embodiment, control part 11, display part 10 etc., also as the formation of subject alternative pack, are used for selecting subject information.
In addition, control part 11 possesses comparing section 11A, compare for test section 8 being detected to the provisioning information obtaining and/or the evaluation of estimate obtaining based on detecting the provisioning information of acquisition and the correlative value of regulation, described provisioning information, at least comprises the information of a kind of or combination in any in the value of position, size, angle of inclination, the degree of correlation of specific shot body heat picture; In embodiment 1, the value of the degree of correlation of the thermal-image data frame that test section 8 is obtained, compares with the correlative value of the degree of correlation.Note, the correlative value of the degree of correlation can be the pre-prepd degree of correlation judgment value (for example with subject identifying information corresponding stored in table 3, the correlative value that for example user arranges), in the time being greater than this correlative value, judging and in this thermal-image data frame, there is specific shot body heat picture; Also correlative value that can the pre-prepd degree of correlation, and obtain according to the value of the degree of correlation in thermal-image data frame, the for example correlative value using the value of the degree of correlation that Check processing obtains for the first time as the follow-up contrast degree of correlation, and, in the time that subsequent detection is greater than this correlative value to the degree of correlation, upgraded.
In addition, control part 11 has selection portion 11B, and the comparative result of the 11A of portion is based on the comparison selected the customizing messages relevant with the thermal-image data frame of regulation.Selected customizing messages can be used for follow-up by the predetermined processing of experience, as analysis, record, notice etc.
Wherein, the relevant customizing messages of thermal-image data frame of regulation, can be a frame or the relevant customizing messages of multiframe thermal-image data frame in the multiframe thermal-image data frame of interim storage part 2; For example, the comparative result of the 11A of portion based on the comparison, selection has the relevant customizing messages of thermal-image data frame of maximal correlation degree; But be not limited to that frame thermal-image data frame of detected maximal correlation degree, that frame before or after the sequential of frame of maximal correlation degree for example detected, or that frame being obtained by multiframe computing, or earliest detection is to the relevant customizing messages of thermal-image data frame corresponding to the degree of correlation of correlative value that is greater than regulation.Also can be configured to select the relevant customizing messages of multiple thermal-image data frames, for example, select the relevant customizing messages of three frame thermal-image data frames of the degree of correlation first, second, third, also may select the customizing messages of the thermal-image data frame that the multiframe degree of correlation is the same.
Or, can be also when the thermal-image data frame of maximal correlation degree detected, a frame or multiframe that shoot part 1 is taken in the multiple thermal-image data frames that obtain and be stored in interim storage part 2; Or, can be also to detect after the thermal-image data frame of maximal correlation degree, a frame or multiframe that shoot part 1 is taken in the multiple thermal-image data frames that obtain and be stored in interim storage part 2.
Described customizing messages is the thermal-image data frame of selecting from the multiframe thermal-image data frame of interim storage part 2, the thermal-image data frame of selecting from multiframe thermal-image data frame carries out the data that predetermined processing obtains, detect the provisioning information obtaining, the evaluation of estimate the obtaining based on detecting the provisioning information obtaining, based on the information that detects the provisioning information that obtains and/or described evaluation of estimate and generate, wherein one or more.
Wherein, the thermal-image data frame of selecting from multiframe thermal-image data frame carries out the data that predetermined processing obtains, for example selected thermal-image data frame is carried out to the data that obtain after predetermined processing, the specific shot body heat picture for example extracting from this thermal-image data frame, the view data of infrared thermal imagery for example generating, for example, be converted to this thermal-image data frame and analyze numerical example as the array of Temperature numerical etc.
Wherein, detect the provisioning information obtaining, described provisioning information is described provisioning information for example, at least comprises the information of a kind of or combination in any in the value of position, size, angle of inclination, the degree of correlation of specific shot body heat picture.
Wherein, the evaluation of estimate that obtains based on detecting the provisioning information that obtains, for according to detecting the provisioning information that obtains according to weighting coefficient is weighted, the table of comparisons of provisioning information and evaluation of estimate etc. obtains evaluation thermal imagery quality etc. evaluation of estimate.
Wherein, based on the information that detects the provisioning information that obtains and/or described evaluation of estimate and generate, for example, will detect the provisioning information that obtains and/or described evaluation of estimate and be converted to user and be convenient to the prompting etc. of the number percent information of understanding.
Selection portion 11B is to keep/or the control that do not keep of selected customizing messages; The customizing messages keeping remains on the regulation region of interim storage part 2, in addition, also can keep (storage) in flash memory 3 storage mediums such as grade such as.Hereinafter, the regulation region that customizing messages such as thermal-image data frames is remained on interim storage part 2 by selection portion 11B is example.
Selection portion 11B can remain selected customizing messages, also can under defined terms, keep, and the customizing messages of for example current selection keeps official hour; For example before the thermal-image data frame of the larger degree of correlation being detected, remain current customizing messages; For example before being changed for detection of the subject identifying information of comparison, remain selected customizing messages; The customizing messages for example keeping according to user's indication (determining maintenance as user has selected certain customizing messages showing in display part).In addition also can not keep, for example, be sent to other external device (ED)s by communication I/F4; For example experience other process as after notice delete etc.
And, selection portion 11B, the customizing messages interim storage part 2 being kept for condition according to the rules, is updated to the customizing messages of the follow-up selection of selection portion 11B.So-called defined terms, for example official hour, for example detect the thermal-image data frame of specified quantity, for example, such as, according to comparing section 11A comparative result (obtained the degree of correlation and be greater than the situations such as the degree of correlation of kept thermal-image data frame), user indication etc.In addition, also the customizing messages being kept before can be continued to keep.
In embodiment 1, the comparative result of the 11A of portion based on the comparison, the control that selection portion 11B selects, keeps and upgrade customizing messages.While being greater than the correlative value of the degree of correlation as the value of the degree of correlation of the specific shot body heat picture detecting when test section 8, the customizing messages such as value and corresponding thermal-image data frame of selecting this degree of correlation is remained in the storage mediums such as interim storage part 2; In the time having the customizing messages such as value and corresponding thermal-image data frame of the degree of correlation before, by the customizing messages before replacing it; Have the higher thermal-image data frame of the degree of correlation during until follow-up, can be replaced (the higher thermal-image data frame of the degree of correlation that also can keep specified quantity).Like this, kept as the customizing messages such as value and corresponding thermal-image data frame of the maximum degree of correlation.In addition, also the customizing messages being kept before can be continued to keep.
Note, selection portion 11B is not limited to select the relevant customizing messages of a frame thermal-image data frame of optimum (for example degree of correlation maximum), for example, also can select suboptimum, or select multiframe computing to obtain that frame, or also can be configured to select the relevant customizing messages of multiple thermal-image data frames, for example select the three frame thermal-image data frames relevant customizing messages of storage (maintenance) degree of correlation first, second, third, also may preserve the customizing messages of the thermal-image data frame that the three frame degrees of correlation are the same.
In addition, control part 11 has the correlative value renewal 11C of portion, for condition according to the rules, correlative value is upgraded; And after correlative value is upgraded, described comparing section 11A, detects the provisioning information obtaining and/or the evaluation of estimate obtaining based on detecting the provisioning information of acquisition to test section 8, compares with the correlative value after upgrading.
The update condition of correlative value, for example user's indication is upgraded; For example, according to the comparative result of comparing section 11A, correlative value is upgraded; For example time according to the rules upgrades.
According to the comparative result of comparing section 11A, correlative value is upgraded, can be according to pre-prepd multiple correlative values, upgrade successively; For example prepare the correlative value of three degrees of correlation, when the degree of correlation detecting when test section 8 is greater than first correlative value, follow-uply will be updated to second correlative value, in the time being greater than second correlative value, will be updated to the 3rd correlative value.
According to the comparative result of comparing section 11A, correlative value is upgraded, can be also to upgrade pre-prepd correlative value according to detecting the provisioning information obtaining; For example detect according to test section 8 value that obtains the degree of correlation, in the time that the value of this degree of correlation is greater than the correlative value of the pre-prepd degree of correlation, upgrade replacing correlative value according to the value of the obtained degree of correlation.
According to the comparative result of comparing section 11A, correlative value is upgraded, can be also to carry out self according to detecting the provisioning information obtaining, wherein, there is no pre-prepd correlative value; For example detect according to test section 8 value that obtains the degree of correlation, in the time that the value of this degree of correlation is greater than the correlative value (for example, before the value of detected degree of correlation maximum is used as correlative value) of the degree of correlation, corresponding the value of obtained degree of correlation replacement correlative value is upgraded.
In addition, control part 11 possesses notification unit 11D, and the information that the customizing messages that thermal-image data frame selected based on selection portion 11B and regulation is relevant and/or correlative value are upgraded, notifies.For example, selected and that keep and the relevant customizing messages of thermal-image data frame regulation based on selection portion 11B, the announcement information that customizing messages is obtained shows jointly with the infrared thermal imagery of the thermal-image data frame acquisition that acquisition unit is obtained continuously.Preferably, the infrared thermal imagery that the thermal-image data frame that the announcement information current selected customizing messages being obtained and acquisition unit are obtained continuously obtains shows jointly.The continuous infrared thermal imagery that infrared thermal imagery and the shoot part 1 for example current thermal-image data frame selected and that keep being obtained obtains shows jointly, in addition, and also can the while or show separately other announcement information, the value of for example degree of correlation, evaluation of estimate etc.In addition, also Dynamic IR thermal imagery can be switched to the freeze frame that shows this thermal-image data frame.
Wherein, in the time that selection portion 11B selects and kept the relevant customizing messages of multiple thermal-image data frames, notification unit 11D can be to one of them or multiple notice, and for example, the continuous infrared thermal imagery that the infrared thermal imagery that multiple thermal-image data frames are obtained and shoot part 1 obtain shows jointly.
Wherein, the relevant customizing messages of thermal-image data frame selected according to selection portion 11B and regulation, obtains announcement information, for example, the value of the degree of correlation can be scaled to the information that user understands of being convenient to of the similar degree of signal, shows; For example, according to the table of comparisons of the regulation of the value of the degree of correlation and number percent, or the mode of calculating is (as the specific shot body profile being extracted and the profile T1 overlapping area ratio sum in the total area separately, divided by 200%, can be scaled the percent value of the degree of correlation) value of the degree of correlation is scaled to percent value); Also can be other mode, the value that for example directly will calculate the degree of correlation shows, as the difference of direct display pixel value and numerical value etc.Note, in the time not detecting that with representative specific shot body heat picture whether regulation correlative value (representing the judgment value whether specific shot body heat picture mates with subject identifying information) contrasts, the information of the shown degree of correlation might not represent whether specific shot body heat picture (coupling) detected.For ease of explanation, hereinafter, using the percent value of the value of the degree of correlation, evaluation of estimate, correlative value conversion as example, but in reality, must not be converted into percent value.
Wherein, the mode of notice can continue official hour.And, based on the control of notification unit 11D, can make display part 10 produce the vibration of the vibrating mass in variation, the thermal imagery device 100 of displaying contents, the light variation of pilot lamp, the sound of sound components, the analyzing and processing (and making display part 10 display analysis results) of analysis component, deagnostic package is diagnosed the color one or more of variation changing etc. of the puppet of (and making display part 10 show diagnostic result), reference picture flickering display or variable color etc., infrared thermal imagery; As long as the appreciable mode of user all can.
In addition, it is not shown that control part 11 has recording unit 11E(), the record indication of response regulation, is recorded to storage card 8 by thermal-image data frame selected selection portion 11B and that remain in interim storage part 2.For example respond the indications such as the selection of user to notified thermal-image data frame, the indications such as for example automatic record of timing, are recorded to storage card 8 by described thermal-image data frame.
In addition, it is not shown that control part 11 possesses reference picture specifying part 11F(), be used to specify will with the composition data of the common reference picture showing of infrared thermal imagery; For example, the composition data of the reference picture of the subject information association based on storing in storage medium (dot array data or vector data), the selection according to user to subject information, specifies the composition data with the reference picture of subject information association; Be not limited to by subject information, also can from storage medium, select such as thermal imagery file etc. to obtain the composition data of reference picture; In addition, also can, according to the default configuration of thermal imagery device 100, carry out the composition data of designated reference image, for example the data of the surveyed area of acquiescence; In addition, appointed area the infrared thermal imagery that also can for example show from display part, and using the infrared thermal imagery in this region as the mode with reference to various appointments such as images.
In addition, it is not shown that control part 11 possesses position setting unit 11G(), for being set, reference picture is positioned at the location parameter (position, or also comprise size, or also comprise the anglec of rotation) of display part.Preferably, setting unit 11G in position is positioned at the location parameter of infrared thermal imagery for reference picture is set; For example, according to the self-adaptation viewing area stipulating in infrared thermal imagery, in this adaptive region, maximize the placed in the middle location parameter showing according to calculated reference picture, thereby reference picture is set is arranged in the location parameter of infrared thermal imagery; For example, also can for example, according to the incidental parameter of reference picture (having embodied the location parameter in infrared thermal imagery), reference picture be set be arranged in the location parameter of infrared thermal imagery according to this parameter; Or, also can reference picture is set be arranged according to the configuration of thermal imagery device 100 (placed in the middle, original size) location parameter of infrared thermal imagery; Or, also can be according to the location parameter of user's input.
Operating portion 12: carry out various indication operations for user, or input the various operations such as set information, control part 11, according to the operation signal of operating portion 12, is carried out corresponding program.With reference to figure 2, operating portion 12 is described, provides that button that user operates records that key 1, focusing key 2, acknowledgement key 3, playback key 4, menu are strong 5, directionkeys 6 etc.; In addition, also can adopt touch-screen 7 or speech recognition component (not shown) etc. to realize relevant operation.
The variation of the display interface in shooting process is described with reference to figure 6, the control flow of the detecting pattern of thermal imagery device 100 is described referring to Fig. 7.This application scene thermal imagery device 100 as hand-held in user is taken the subject of transformer station.The control program of control part 11 based on storage in flash memory 3, and the various data that use in each several part control, controlled the overall action of thermal imagery device 100 and the control of execution various modes processing.After switching on power, control part 11 carries out the initialization of internal circuit, then, enter standby screening-mode, be that shoot part 1 is taken acquisition thermal-image data, shoot part 1 is taken the processing that the thermal-image data of acquisition stipulates by image processing part 7, be stored in interim storage part 2, on display part 10, show continuously infrared thermal imagery with dynamic image form, at this state, control part 11 is implemented it and is controlled, and whether persistent surveillance has been switched to the processing of other patterns or has carried out power-off operation according to scheduled operation, if had, enter corresponding processing controls.The control step of detecting pattern is as follows:
Steps A 01, determines reference picture;
At standby shooting state, display part 10 shows dynamic infrared thermal imagery, user can puzzle in specific shot body heat as the image space in the morphological feature of IR1 and the infrared thermal imagery at its place in the past, size, angle, for guaranteeing shooting quality standard, scheduled operation by operating portion 12 is selected detecting pattern, the table 3 of control part 11 based on storage in flash memory 3, the subject indication information of subject Information generation is presented to display part 10, when user is according to the subject of floor " subject 1 ", select " subject 1 " shown on display part 10 by operating portion 12, reference picture specifying part 11F is according to user's selection, just determine reference picture T1, from flash memory 3, read the composition data of reference picture T1, be sent to interim storage part 2, and position setting unit 11G arranges the location parameter (position and size) that reference picture T1 is positioned at infrared thermal imagery.For example, according to attached location parameter, reference picture T1 be set be arranged in the location parameter of infrared thermal imagery.In addition, self-adaptation viewing area that also can be according to the rules, or user's location parameter of specifying, determine that reference picture T1 is arranged in the location parameter of infrared thermal imagery.
In steps A 02, feature registration unit registration subject identifying information.Feature registration unit is according to user's selection " subject 1 ", just determined to be used for the subject identifying information of coupling, at this, supposes with reference to image T1 as the template image that calculates the degree of correlation.(in addition, also can from flash memory 3, read template data 301 and be used as calculating the subject identifying information of the degree of correlation).
Steps A 03, obtains thermal-image data frame, and the thermal-image data frame of shoot part 1 being taken to acquisition is sent to interim storage part 2, image processing part 7 carries out for example pseudo-color conversion of predetermined processing to obtained thermal-image data frame, obtain the view data of infrared thermal imagery, and, synthesis unit obtains determined composition data the view data of reference picture T1 according to the given size arranging, according to set assigned position, synthesize (overlapping) with the view data of the infrared thermal imagery generating, leave synthetic view data in interim storage part 2, then, composograph is presented at display part 10 by display control unit 9, as shown in Figure 6 (a), location between subject thermal imagery IR1 and contour images T1, the difference of size, user can take subject thermal imagery IR1 according to reference picture.As specific shot body heat picture do not detected in subsequent treatment, by constantly synthesizing with the thermal-image data frame newly obtaining, with this, constantly show dynamic composograph.
Then, in steps A 04, read the thermal-image data frame for example being obtained by the instant shooting of shoot part 1 in interim storage part 2, detection window setting unit, arranges detection window.For example, the upper left corner of the surveyed area G1 based on regulation, is first provided with detection window;
Steps A 05, carries out the processing of the relatedness computation between thermal-image data and the subject identifying information in detection window.
Test section 8, based on the set detection window of detection window setting unit, extracts the thermal-image data that is arranged in this detection window, and the template of registering according to feature registration unit, calculates the degree of correlation between the two.For example, the profile of the specific shot body heat picture extracting according to the thermal-image data in detection window, with the silhouette contrast of contour images T1, calculates overlapping area between the two the ratio sum in the total area separately.
And, in steps A 06, the value of the degree of correlation that storage obtains.
In steps A 07, test section 8 judges while detection window being set in thermal-image data frame, whether has calculated the degree of correlation for all detection windows.If the region (being no in steps A 07) that residue is not also calculated the degree of correlation, gets back in steps A 04, detection window setting unit is in a predetermined direction by the position skew intended pixel number of detection window, this position is set to the next position of detection window, and repeats follow-up processing.
In addition, from thermal-image data frame, search is with like template class when frame part, for amplifying and dwindle and during by detection window after detection window J1 inclination predetermined angular, the Check processing that also carries out similar above-mentioned explanation.
If calculated the degree of correlation (being yes in steps A 07) for all detection windows of thermal-image data frame, the value of the maximal correlation degree detecting (or also by location parameter of corresponding detection window) is remained on to the regulation region of interim storage part 2 in steps A 08.
In steps A 09, compare with the correlative value of the degree of correlation;
If be less than this correlative value, represent specific shot body heat picture in the thermal-image data frame of current detection and the similarity degree of contour images T1, the correlative value obtaining before not being better than; Get back to steps A 03, repeat follow-up processing; At this, shooting distance, image space, angle between the position that user takes by change and optics and the specific shot body heat picture of adjustment thermal imagery device 100, be accompanied by user's adjustment operation, repeats follow-up processing.When the degree of correlation detecting in steps A 09 is greater than the correlative value of the degree of correlation, enter steps A 10;
Wherein, the correlative value of the degree of correlation can be that the correlative value of the pre-prepd initial degree of correlation is (for example, by the judgment value that judges whether to detect that whether specific shot body heat picture mates with subject identifying information, as the correlative value of the initial degree of correlation), when the value that detects the degree of correlation obtaining is greater than this judgment value, the degree of correlation of the specific shot body heat picture that detects of representative is better than prepared judgment value, this judgment value is replaced with to the correlative value that the value of current the detected degree of correlation obtains; As the correlative value of the subsequent detection degree of correlation, whether can obtain the specific shot body heat picture that the degree of correlation is higher so that follow-up.In the present embodiment, the correlative value of the thermal imagery device 100 initial degrees of correlation is 72%, this initial correlative value is the judgment value that judges whether to detect specific shot body heat picture, if the degree of correlation of the thermal-image data frame obtaining is less than this correlative value, represents and specific shot body heat picture in this thermal-image data frame, do not detected; Its effect is repeatedly to take also cannot obtain announcement information time as user, means whether taken wrong subject.So, in Fig. 6 (a), because the value of the detected degree of correlation is less than 72%, do not have show be used for notice information.And as shown in Fig. 6 (b), the degree of correlation of the thermal-image data frame of the maximal correlation degree detecting is 80%, notify follow-up.
In addition, the correlative value of the degree of correlation, also can not prepare in advance, at this moment, for example, when by the value of the degree of correlation of the thermal-image data frame detecting for the first time, the correlative value of the value of the degree of correlation obtaining as subsequent detection thermal-image data frame, when subsequent detection is when being greater than this correlative value, replace this correlative value.
At this, whether to be greater than correlative value as evaluating the foundation of the degree of correlation, be less than correlative value or approach correlative value (pre-prepd judgment value) as the situation of evaluating the degree of correlation but also have.And correlative value can be the value of the degree of correlation, it can be also the value of the degree of correlation value etc. through converting and obtaining.
Steps A 10, the correlative value renewal 11C of portion, by according to the detected value with maximal correlation degree, upgrades the correlative value of the degree of correlation, and the correlative value after renewal is as the correlative value of the comparison degree of correlation of follow-up thermal-image data frame.
Steps A 11, selection portion 11B, by customizing messages such as thermal-image data the frames corresponding detected value with maximal correlation degree, remains on the regulation region of interim storage part 2, the customizing messages (if there is) before replacing it.In addition, also can keep the relevant customizing messages of multiple thermal-image data frames of specified quantity, for example, keep the customizing messages such as 3 frame thermal-image data frames and the value of the degree of correlation thereof that the degree of correlation is the highest.
Steps A 12, notifies, and the relevant customizing messages of thermal-image data frame that detects the degree of correlation maximum obtaining is notified.
For example, the image that this thermal-image data frame is obtained, shows jointly with dynamic infrared thermal imagery.And the customizing messages keeping, before not receiving customizing messages that selection portion 11B reselects or user's indication, will be maintained in interim storage part 2 always.
Being not limited to and showing infrared thermal imagery 601, can be also other mode, and the value that for example directly will calculate the degree of correlation shows, as the difference of direct display pixel value and numerical value etc.In addition, also can will show that Dynamic IR thermal imagery switches to the freeze frame that shows this thermal-image data frame; Preferred mode, also can notify the region of the detected detection window with maximal correlation degree (or the location parameter of subject etc.).The mark of the position of the subject thermal imagery with maximal correlation degree that for example signal detects in the infrared thermal imagery freezing etc.Maybe will show that Dynamic IR thermal imagery switches to the freeze frame that shows this thermal-image data frame, then, response user's indication, then switch the show state of state infrared thermal imagery of reversing, or this thermal-image data frame image and the common state showing of dynamic infrared thermal imagery that obtain.In addition, also can not show the infrared thermal imagery that this thermal-image data frame obtains, and display reminding information; Or with vibration, pilot lamp flicker etc., the mode that various users can discover.And, in the time that selection portion 11B is configured to indication maintenance multiframe thermal-image data frame, can show the infrared thermal imagery that multiple kept thermal-image data frames obtain simultaneously, for example, also carry out sequencing display according to the height of the degree of correlation.
Note, in the time not contrasting with the correlative value (representing the judgment value whether specific shot body heat picture mates with subject identifying information) that judges whether to have specific shot body heat picture, the information of the shown degree of correlation might not represent whether specific shot body heat picture detected.
And, be not limited to and notify selection portion selected customizing messages, the event that also can upgrade correlative value or also further notice correlative value.
Steps A 13, judges whether to exit, as does not exit, and gets back to steps A 03, repeats follow-up processing.At this moment, due in steps A 11, the correlative value of the degree of correlation is upgraded, therefore, the thermal-image data frame obtaining in follow-up shooting, by with upgrade after the correlative value of the degree of correlation compare, and, in the time being greater than the correlative value of the degree of correlation, kept customizing messages is upgraded, and, in steps A 12, notify.
As shown in Fig. 6 (b), in shooting, first the maximal correlation degree detecting is 80%(according to the ratio sum of the overlapping area information obtaining that converts), the correlative value of the degree of correlation using the value of this degree of correlation as follow-up comparison, and show with Dynamic IR thermal imagery the infrared thermal imagery 601 that this thermal-image data frame obtains simultaneously.In the time that subsequent detection is greater than 80% to the value of maximal correlation degree, as shown in Fig. 6 (c), the value of the degree of correlation is 95%, replace the correlative value 80% of the degree of correlation, as the correlative value (95%) of the new degree of correlation, by that analogy, in the time that the value of the detected degree of correlation is 95%, as shown in Fig. 6 (c), if user is satisfied, can stop the aiming of subject to take, because this thermal-image data frame remains in interim storage part 2 storage mediums such as grade, can conveniently carry out follow-up analysis, storage etc. and process or operate.At this moment, record key if user presses, the processing that the thermal-image data frame of infrared thermal imagery 603 correspondences stipulated (as compression etc.) is recorded to storage card 8.And, even if the not mode of display reminding information or infrared thermal imagery, for example mode of pilot lamp flicker, because this thermal-image data frame remains in interim storage part 2 storage mediums such as grade, equally can be in the time of the pressing acknowledgement key or record key of user, show, the processing such as record.
And, information that also can update notifications correlative value, and do not notify the information of thermal-image data frame.
And, the in the situation that of some application, to specific shot body heat picture whether being detected, be not limited to the comparison between the value of the degree of correlation and the correlative value of the degree of correlation, also deformable is for example according to detecting evaluation of estimate that the provisioning information that obtains and/or provisioning information obtain and the comparative result of predetermined correlative value, is used as whether detecting the foundation of specific shot body heat picture.
As mentioned above, in the present embodiment, show that reference picture assists shooting, and in the time the degree of correlation being detected higher than the thermal-image data frame of fiducial value, just select this thermal-image data frame or also notified, and follow-up whenever detect higher than the degree of correlation before correlative value time, can constantly update correlative value, and the information of notifying, can reach and significantly reduce the operation easier that vision is aimed at, significantly reduce the physical strength of taking, improve the beneficial effect of the quality of the final thermal-image data frame obtaining.Common user easily grasps this shooting technical ability.Certainly, arbitrary product of enforcement embodiments of the present invention might not need to reach above-described all advantages simultaneously.
And, in the field of infrared detection, owing to considering the difference at the position of specific shot body heat picture in infrared thermal imagery, size, angle of inclination etc., corresponding different shooting quality, even if the degree of correlation is high, if above-mentioned parameter is undesirable, the quality of the thermal-image data frame obtaining is not necessarily high; Therefore, consider the factor such as value of the position of specific shot body heat image position in thermal-image data frame, size, angle of inclination, the degree of correlation, for example according to above-mentioned because usually obtaining evaluation of estimate (can be one or more), compare with the correlative value of regulation, as carrying out the selection of regulation thermal-image data frame and the factor of notifying, point out user to note the quality of taking, or select the thermal-image data frame of best shooting quality to carry out follow-up processing.
Embodiment 2
Embodiment 2, is with the difference of embodiment 1, and the thermal-image data frame that the test section 8 of described thermal imagery device 100 obtains continuously based on acquisition unit (shoot part 1) detects the provisioning information relevant with specific shot body heat picture in thermal-image data frame; Control part 11 has supplementary acquisition unit (not shown), for obtaining supplementary; Comparing section 11A, for test section being detected to the provisioning information obtaining, supplementary that supplementary acquisition unit is obtained, test section detect evaluation of estimate that the provisioning information that obtains obtains, supplementary that supplementary acquisition unit is obtained and the evaluation of estimate, the test section that obtain detect the supplementary that the provisioning information that obtains and supplementary acquisition unit obtain and the evaluation of estimate obtaining one or more compares with corresponding one or more correlative values; Selection portion 11B, the comparative result of the 11A of portion based on the comparison, selects the customizing messages relevant with the thermal-image data frame of regulation, when there being multinomial comparison, according to different comparative results, the customizing messages of notifying may be a frame or the relevant customizing messages of multiframe thermal-image data frame; Notification unit 11D, the relevant customizing messages of thermal-image data frame selected based on selection portion 11B and regulation, notifies.The correlative value renewal 11C of portion, for the renewal of correlative value.
Wherein, described provisioning information, at least comprises the information of a kind of or combination in any in the value of position, size, angle of inclination, the degree of correlation of specific shot body heat picture.
In the field of infrared detection, owing to considering the difference at the position of specific shot body heat picture in infrared thermal imagery, size, angle of inclination etc., corresponding different shooting quality, even if the degree of correlation is high, if above-mentioned parameter is undesirable, the quality of the thermal-image data frame obtaining is not necessarily high; Therefore, consider the factors such as the position of specific shot body heat image position in thermal-image data frame, size, angle of inclination, as the factor that generates notice, point out user to note the quality of taking, or select the thermal-image data frame of best shooting quality to carry out follow-up processing.
Wherein, described supplementary, at least comprise the information of a kind of or combination in any in assay value, environment temperature, contextual factor, wind speed, humidity, distance, and other supplementarys of being obtained by thermal imagery device 100 (comprise by user and arranging), comprise other various to the relevant information of the selected regulation thermal-image data of selection portion 11B frame and/or the influential factor of information that notification unit 11D is notified all in its scope.
In the application of infrared detection, according to the difference of above-mentioned supplementary, the quality of the thermal-image data frame obtaining and significance level difference, should have different conditions to deal with the processing such as the comparison of the thermal-image data frame of regulation, selection, notice; For example, for example, in the time thering is the assay value of correlative value (threshold values of defect) that is greater than regulation in the specific shot body heat picture obtaining, represent that subject has defect, so, should cause user's attention, at this moment, in the situation that the degree of correlation approaches, also preferably select the relevant customizing messages of thermal-image data frame that also notification analysis value exceeds standard, user's attention will be caused immediately, significant to infrared detection; For example consider environment temperature, background, wind speed, the contextual factor (otherness of for example background and subject thermal imagery, the thermal field distribution of background etc.) etc. influence factor, in the situation that the degree of correlation approaches, these influence factors may cause the value of different thermal imagery quality and subsequent analysis to reduce, and should select and notify other influences factor to disturb little thermal-image data frame.
Wherein, supplementary acquisition unit, for example can obtain above-mentioned supplementary according to thermal imagery device 100 or with the parts (not shown) of the corresponding function being connected in thermal imagery device 100, for example, (assay value is not limited to temperature value to obtain assay value by analysis component, for example, also can be AD value, color value in pseudo-color thermal imagery, the ratio of specific picture numerical value, or also by these numerical value according to the rules formula calculate the value etc. obtaining, the assay value that analysis component is obtained can be for the pixel in whole pixels or particular analysis region in thermal-image data frame), obtain environment temperature by temperature sensor, obtain humidity by hygrometer, obtain the distance of thermal imagery device 100 and subject etc. by stadimeter.Also can obtain according to above-mentioned supplementary pre-stored in storage medium, for example, the historical data of supplementary; Or in conjunction with the historical data of supplementary pre-stored in the supplementary of obtaining when pre-test and storage medium to recently obtaining supplementary.
And, can obtain comprehensive evaluation of estimate by provisioning information and/or supplementary; For example, the different coefficient that can adopt customizing messages correspondence in detected provisioning information, and obtain evaluation of estimate by other the provisioning information in detected provisioning information in conjunction with this coefficient; For example, can adopt the shared weight of different information, obtain evaluation of estimate by weighting.Can obtain final evaluation of estimate by various account form.For example, as shown in Figure 9, the detection window that the infrared thermal imagery 901 of supposing Fig. 9 (c) is 0.94 according to window coefficient obtains, and the detection window that infrared thermal imagery 902 is 0.8 according to window coefficient obtains, value × window coefficient of evaluation of estimate=degree of correlation, therefore, even if the degree of correlation of infrared thermal imagery 901 is less than the degree of correlation of infrared thermal imagery 902, but evaluation of estimate is high on the contrary.
And, also can, by described provisioning information and described supplementary, obtain comprehensive evaluation of estimate.For example, acquisition combines the evaluation of estimate that the value of position, size, angle of inclination, assay value, the degree of correlation of specific shot body heat picture obtains, for example obtain comprehensive evaluation value according to following formula, value × degree of correlation weighting coefficient of weighting coefficient+size × size weighting coefficient+angle of inclination × angle of inclination, comprehensive evaluation value=position × position weighting coefficient+assay value × assay value weighting coefficient+degree of correlation; Or another kind of preferred mode, obtains evaluation of estimate according to detected provisioning information and the supplementary of obtaining and the table of comparisons of comprehensive evaluation value.
And, also can be according to described provisioning information and described supplementary, wherein part obtains evaluation of estimate, then, according to the provisioning information and/or the supplementary that obtain evaluation of estimate of having neither part nor lot in wherein, together with the evaluation of estimate obtaining, the object of the comparison of the correlative value of portion and regulation as a comparison.
Wherein, the correlative value renewal 11C of portion, according to the comparative result of comparing section 11A, upgrades correlative value; And, in the time having multinomial correlative value, at least one in corresponding correlative value is upgraded; Wherein, when multinomial correlative value update all, after renewal, described comparing section 11A, for the provisioning information that test section 8 subsequent detection are obtained, and/or, the supplementary of obtaining based on supplementary acquisition unit, and/or, by described provisioning information and/or described supplementary and the evaluation of estimate obtaining compare with the correlative value of multinomial renewal; Wherein, when part in multinomial correlative value is upgraded, after renewal, with the correlative value of the renewal item in multinomial correlative value and a correlative value of not upgrading compare.Preferably, the optimum provisioning information relatively obtaining according to comparing section or optimum supplementary or optimum according to one that detects in the evaluation of estimate that the provisioning information that obtains and/or supplementary obtain, upgrade corresponding at least one correlative value.
Wherein, when test section 8 is configured to detect multiple provisioning informations of specific shot body heat picture, and comparing section 11A, when the provisioning information that 8 detections obtain to test section and/or the multinomial correlative value of the evaluation of estimate obtaining based on detecting the provisioning information of acquisition and regulation compare, result based on the comparison, selection portion 11B may select the relevant customizing messages of multiple thermal-image data frames, and at this moment, notification unit 11D can be to one of them or multiple notice.Preferably, described selection portion, the comparative result of portion based on the comparison, the relevant customizing messages of thermal-image data frame that the value of the selection degree of correlation and/or provisioning information and/or supplementary and/or evaluation of estimate (evaluation of estimate that provisioning information and/or supplementary obtain) are better than the correlative value of regulation keeps.Described notification unit, selected based on selection portion and the keep relevant customizing messages of the thermal-image data frame with regulation, the value of the selection degree of correlation and/or provisioning information and/or supplementary and/or evaluation of estimate (evaluation of estimate that provisioning information and/or supplementary obtain) are better than the relevant customizing messages of thermal-image data frame of the correlative value of regulation and notify.
The control flow of the detecting pattern of the thermal imagery device 100 of embodiment 2 is described referring to Fig. 8, and in the following description, having configured three correlative values is example.The provisioning information (value of the degree of correlation) relevant with specific shot body heat picture in the thermal-image data frame that test section 8 is detected, based on detecting the supplementary (assay value) that the provisioning information that obtains and supplementary acquisition unit obtain, the evaluation of estimate obtaining compares with first, second, third correlative value.
The first correlative value is prepared (being the first correlative value of the degree of correlation in the present embodiment) in advance, the correlative value (representing the judgment value whether specific shot body heat picture mates with subject identifying information) that is used for judging whether to have specific shot body heat picture, the first correlative value is not upgraded.
The second correlative value (being the second correlative value of the degree of correlation in the present embodiment), for being greater than the correlative value of the degree of correlation of the first correlative value, its value according to the degree of correlation of the thermal-image data frame detecting obtains, in the time that follow-up thermal-image data frame detects the value of the higher degree of correlation, the second correlative value will be updated to higher value thereupon.
The 3rd correlative value, value, assay value etc. with position, size, angle of inclination, the degree of correlation obtain comprehensive evaluation value, as for example, comparing with corresponding (pre-prepd) the 3rd correlative value, in the time that follow-up thermal-image data frame detects the comprehensive evaluation value of higher (more excellent), the 3rd correlative value will be updated to higher value thereupon.
Finally, selection portion 11B is by the relevant customizing messages of thermal-image data frame of selecting to be better than the second correlative value and/or to be better than the 3rd correlative value; Be convenient to the processing such as follow-up notice, analysis, diagnosis, record.
Steps A 01-steps A 03, is analogous to the steps A 01-A03 of embodiment 1, has omitted explanation;
Step B03, is analogous to the steps A 04-A08 of embodiment 1, detects and obtains the degree of correlation, has omitted explanation;
Step B04, whether the value of the degree of correlation of the thermal-image data frame that judgement detects, be greater than the first correlative value, as no, represents specific specific shot body heat picture not detected, gets back to steps A 03, repeats follow-up processing.
When the degree of correlation detecting at step B04 is greater than the first correlative value, enter step B05.
Step B05, supplementary acquisition unit is greater than the thermal-image data in thermal-image data frame and/or this thermal-image data frame detection window of the first correlative value to the degree of correlation, obtain for example assay value relevant with specific shot body heat picture of supplementary etc., for example control analysis parts are analyzed acquisition assay value.In addition, for example, in the time that test section 8 is configured to calculate the degree of correlation by detection pixel ratio, be not limited to decide according to the location parameter of detection window the location parameter of detected specific shot body heat picture, at this moment, also can, according to the profile that further extracts specific shot body in the detection window detecting, obtain the provisioning informations relevant with specific shot body heat picture such as more accurate position, size, angle of inclination.
Step B06, obtain evaluation of estimate, acquisition combines position, size, the angle of inclination of specific shot body heat picture, the value of the degree of correlation, the evaluation of estimate that assay value obtains, for example obtain comprehensive evaluation value according to following formula, value × degree of correlation weighting coefficient+assay value × assay value weighting coefficient of weighting coefficient+size × size weighting coefficient+angle of inclination × angle of inclination, comprehensive evaluation value=position × position weighting coefficient+degree of correlation; Or another kind of preferred mode, obtains evaluation of estimate according to detecting the provisioning information of acquisition and the table of comparisons of the supplementary of obtaining and comprehensive evaluation value.
Step B07, compares with the 3rd correlative value, as while being less than the 3rd correlative value, at step B08, the value and the second correlative value that detect the degree of correlation obtaining is compared; As no, jump to step B19, before representative, detect that the degree of correlation is than the thermal-image data frame of the thermal-image data vertical frame dimension of current detection.In this way, at step B09-B10, the correlative value renewal 11C of portion, by according to the value of detected maximal correlation degree, upgrades the second correlative value.And, selection portion 11B is by customizing messages relevant this thermal-image data frame, remain on the regulation region of interim storage part 2, or also replace it front customizing messages (if there is the previous relevant customizing messages of thermal-image data frame, and the degree of correlation of thermal-image data frame is before less than the thermal-image data frame of current detection, and when evaluation of estimate is not maximum in kept thermal-image data frame, just replace), and at step B11, the relevant customizing messages of thermal-image data frame that the degree of correlation is greater than to the second correlative value is notified.
If step B07, as comprehensive evaluation value is greater than the 3rd correlative value, at step B12, compares the value of the degree of correlation and the second correlative value;
If be greater than the second correlative value, at B13-B14, the correlative value renewal 11C of portion is by according to the value of the detected maximal correlation degree of this thermal-image data frame, and maximum comprehensive evaluation value upgrades the second correlative value, the 3rd correlative value.And, selection portion 11B is by the customizing messages relevant with this thermal-image data frame, remain on the regulation region of interim storage part 2, or also replace it before customizing messages (if there is), and at step B11, the degree of correlation is greater than to the relevant customizing messages of thermal-image data frame that the second correlative value and comprehensive evaluation value be greater than the 3rd correlative value and notifies.
If be less than the second correlative value, at B16-B17, the correlative value renewal 11C of portion, by according to the comprehensive evaluation value of detected this thermal-image data frame, upgrades the 3rd correlative value.And, selection portion 11B has by detected a relevant customizing messages of thermal-image data frame that maximum comprehensive evaluation value is corresponding, remain on the regulation region of interim storage part 2, customizing messages (if the relevant customizing messages of thermal-image data frame before having before replacing it, and the evaluation of estimate of thermal-image data frame is before less than the thermal-image data frame of current detection, and when the degree of correlation is not maximum in kept thermal-image data frame, just replace), and at step B18, the relevant customizing messages of thermal-image data frame that comprehensive evaluation value is greater than to the 3rd correlative value is notified.
Step B19, judges whether to exit detecting pattern, as exits, and finishes, as does not exit, and gets back to step B02, repeats above-mentioned processing.Like this, the thermal-image data frame that continuous shooting is obtained, according to detected provisioning information, selects the relevant customizing messages of thermal-image data frame that is better than the second correlative value and/or is better than the 3rd correlative value and notify; Be convenient to the processing such as follow-up notice, analysis, diagnosis, record.Wherein, whether the degree of correlation of the thermal-image data frame of detection is greater than to the condition of the first correlative value as further detection provisioning information, can further avoids the beneficial effect of taking error location, pointing out effective customizing messages.Here so-called being better than, according to the difference of correlative value, may there is the situation that is less than or greater than correlative value.
The variation of the display interface in shooting process is described with reference to figure 9.
As shown in Fig. 9 (a), in the time not detecting that the degree of correlation is greater than the thermal-image data frame of the first correlative value (degree of correlation number percent that supposition the first correlative value converts is 72%), show dynamic infrared thermal imagery.
Then, as shown in Fig. 9 (b), in the time detecting that the degree of correlation is greater than the thermal-image data frame of the first correlative value for the first time, show the announcement information that dynamic infrared thermal imagery is relevant with detected thermal-image data frame, the customizing messages of this thermal-image data frame of this announcement information based on the indicated maintenance of selection portion 11B for example this thermal-image data frame, the value of the degree of correlation, evaluation of estimate generate; Announcement information comprises the infrared thermal imagery 901 that this thermal-image data frame generates, the degree of correlation number percent 85% that the value of the degree of correlation converts, the evaluation of estimate number percent 80% that evaluation of estimate converts.And the correlative value renewal 11C of portion is for example updated to 85%, the three correlative value by the second correlative value and is for example updated to 80%; And, not detecting when being greater than this second correlative value and/or being greater than the thermal-image data frame of the 3rd correlative value when follow-up, display part 10 will keep showing the state of infrared thermal imagery 901 announcement informations such as grade and Dynamic IR thermal imagery; And due to the announcement information that infrared thermal imagery 901 generates for the current customizing messages newly obtaining, the frame of overstriking is reminded user.
Then, as shown in Fig. 9 (c), in the time that detects the thermal-image data frame that is greater than the second correlative value, show the customizing messages that dynamic infrared thermal imagery is relevant with detected thermal-image data frame, this customizing messages comprises the infrared thermal imagery 902 that this thermal-image data frame generates etc., at this, because the corresponding degree of correlation of infrared thermal imagery 902 is greater than infrared thermal imagery 901, and its evaluation of estimate is less than infrared thermal imagery 901, so selection portion 11B keeps these two relevant customizing messages of thermal-image data frame; And the correlative value renewal 11C of portion will, according to the corresponding degree of correlation of infrared thermal imagery 902, upgrade the second correlative value; The announcement information that notification unit 11D generates the customizing messages that makes display part 10 show that two different thermal-image data frames obtain, and, infrared thermal imagery 901 is removed to the frame of overstriking, and infrared thermal imagery 902 gives the frame of overstriking.At this moment, because the customizing messages such as infrared thermal imagery 901,902 corresponding thermal-image data frames remain on interim storage part 2, the information that user can show from display part 10, as infrared thermal imagery 901,902, is selected the follow-up corresponding thermal-image data frame that records or analyze.
And, as shown in Fig. 9 (d), in the time that degree of correlation detecting is greater than the second correlative value and evaluation of estimate and is greater than the thermal-image data frame of the 3rd correlative value, selection portion 11B keeps the customizing messages relevant with infrared thermal imagery 903, or also infrared thermal imagery 901,902 relevant customizing messages is deleted; And the correlative value renewal 11C of portion will, according to the corresponding degree of correlation of infrared thermal imagery 903 (95%) and evaluation of estimate (95%), upgrade second, third correlative value; Notification unit 11D will make display part 10 show the customizing messages that dynamic infrared thermal imagery is relevant with detected this thermal-image data frame, and this customizing messages comprises the infrared thermal imagery 903 that this thermal-image data frame generates etc.
Like this, selection portion, the comparative result of portion based on the comparison, selects and keeps the value of the degree of correlation and/or evaluation of estimate to be greater than the relevant customizing messages of thermal-image data frame of the correlative value (the second correlative value, the 3rd correlative value) of regulation; Based on the control of notification unit 11D, in the interface of display part 10, the information that thermal-image data frame that always can the display notification degree of correlation is the highest and/or evaluation of estimate is the highest obtains, helps greatly user's shooting, and random shooting is also easy to obtain high-quality thermal-image data frame.
As mentioned above, in the present embodiment, not only can obtain the effect of embodiment 1, and, be provided with according to the provisioning information of the specific shot body heat picture detecting and the supplementary that supplementary acquisition unit is obtained, be used as the factor of selecting and notifying, can reach the operation easier that further attenuating vision is aimed at, improve the accuracy of detection of the subject while detecting coupling, avoid maloperation, the beneficial effect of prompting particular state, common user easily grasps this shooting technical ability.Certainly, arbitrary product of enforcement embodiments of the present invention might not need to reach above-described all advantages simultaneously.
In addition, although exemplified three correlative values, also more correlative value, evaluation of estimate and/or the supplementary that corresponding several differences stress and/or detect the provisioning information obtaining, the evaluation of estimate for example being obtained by position, size, the angle of inclination of specific shot body heat picture, the evaluation of estimate being obtained by assay value, environment temperature etc. etc.
In addition,, although exemplified multiple correlative values (three, or also can be reduced to two) in embodiment 2, wherein part is upgraded, part do not upgrade; But also can be configured to update all; Or also can remove the structure of the correlative value renewal 11C of portion, and prepare multiple corresponding correlative values in advance, all do not upgrade.
In embodiment 2, introduce the evaluation of estimate obtaining according to the value of the degree of correlation and provisioning information and supplementary as example, also notify according to maximal correlation degree and/or maximum evaluation of estimate.When also can only notifying one of them; Or, also configure more comparative run, corresponding also multiple according to the be dominant customizing messages of the thermal-image data frame of selecting of different comparative run by notifying; Or, also the value of the degree of correlation and multiple evaluation of estimate are notified according to order or priority level.
Notification unit 11D, (can be the action of upgrading according to the lastest imformation of the relevant customizing messages of the regulation thermal-image data frame of selection portion 11B selection and/or the correlative value renewal 11C of portion, also can be the information etc. of the correlative value after upgrading) notify, and preferred, the relevant customizing messages of regulation thermal-image data frame of up-to-date selection portion selection (normally the degree of correlation and/or evaluation of estimate are greater than correlative value) is notified.Like this, user is very convenient; For example heat is determined to position, size, the degree of tilt of subject, the value of the degree of correlation, as factor of evaluation, be convenient to obtain the thermal-image data frame of high-quality thermal-image data frame or specific photographing request; Using supplementary as factor of evaluation, be convenient to optimize notice thermal-image data frame.
And, in embodiment 2, in the time the thermal-image data frame that is greater than the previous degree of correlation and/or evaluation of estimate being detected, the customizing messages that selection portion 11B obtains thermal-image data frame is before replaced (for example deleting), but also can continue to keep, at this moment, notification unit 11D also can show the relevant customizing messages of multiple thermal-image data frames, for example according to height of the degree of correlation and/or evaluation of estimate etc. because of these customizing messages of sequencing display usually.
Embodiment 3
Embodiment 3, with above-described embodiment 1,2 difference is, in the structure of stating thermal imagery device 100 as shown in Figure 1, remove the functional part (not shown) of the correlative value renewal 11C of portion, when the thermal-image data frame detecting in judgement is greater than the correlative value of the degree of correlation of regulation, notify, do not upgrade the correlative value of the degree of correlation.
Steps A 01-steps A 03, is analogous to the steps A 01-A03 of embodiment 1, has omitted explanation;
Step C03, is analogous to the steps A 04-A08 of embodiment 1, has omitted explanation;
Step C04, for example, by the value of the degree of correlation of obtained thermal-image data frame and the correlative value of regulation (, representing the judgment value whether specific shot body heat picture mates with subject identifying information), compares, and if not, gets back to step C02.
In this way, at step C05, the relevant information of thermal-image data frame of the correlative value that is greater than regulation is selected and notified, for example, the image that this thermal-image data frame is obtained, shows jointly with dynamic infrared thermal imagery.In addition, also can will show that Dynamic IR thermal imagery switches to the freeze frame that shows this thermal-image data frame; Maybe will show that Dynamic IR thermal imagery switches to the freeze frame that shows this thermal-image data frame, then, response user's indication, then switch the show state of state infrared thermal imagery of reversing, or this thermal-image data frame image and the common state showing of dynamic infrared thermal imagery that obtain.
Whether step C06, detect and exit, and as no, gets back to steps A 02, repeats follow-up processing; In this way, exit.
And, in follow-up thermal-image data frame, detect specific shot body heat as time, replace it front kept thermal-image data frame, carry out the display notification of relevant information; Or, also show relevant information simultaneously; For example, in the time having kept the thermal-image data frame of specified quantity, notify user from these thermal-image data frames, to select to carry out the thermal-image data frame that trailer record, analysis etc. are processed.
As mentioned above, in the present embodiment 3, in the time that the detection degree of correlation is greater than the thermal-image data frame of correlative value of regulation, notify user, also can lower the manipulation strength that vision is aimed at, common user easily grasps this shooting technical ability, simple to operate.Owing to not upgrading fiducial value, therefore, in follow-up shooting, poor before the mass ratio of thermal-image data frame likely obtaining.
The present embodiment also deformable is, according to detecting the provisioning information relevant with specific shot body heat picture in thermal-image data frame, or according to detecting provisioning information relevant with specific shot body heat picture in thermal-image data frame and the supplementary of obtaining, and detect according to test section the evaluation of estimate that the provisioning information that obtains and/or the supplementary obtained of supplementary acquisition unit obtain, compare with the correlative value of regulation, obtain result relatively, decide notice.
In addition, also can remove the structure of selection portion 11B, when detect specific shot body heat as time, notify, user is reminded in for example vibration etc.
Embodiment 4
Embodiment 4, with above-described embodiment 1,2,3 difference is, described thermal imagery device 100 has in judgement when indication of detection, based on the multiframe thermal-image data of storing in interim storage part 2, detects and wherein has the thermal-image data frame of the high degree of correlation.Be applicable to rapid movement subject to take.
The control flow of the detecting pattern of the thermal imagery device 100 of embodiment 3 is described with reference to Figure 11.
At step D01, by the thermal-image data frame obtaining, for example shoot part 1 is taken the thermal-image data obtaining and is sent to interim storage part 2; Display part 10 shows dynamic infrared thermal imagery and reference picture, and wherein, interim storage part 2 is for example configured to the cyclic store of the thermal-image data frame that can temporarily store multiframe part (for example 50 frames), and circulation storage is taken the thermal-image data frame of acquisition by shoot part 1.
Step D02, does control part 11 judge whether the indication of detection? for example,, when detecting that user passes through the detection indication of operating portion 12, enters next step; And, detect indication and must do not sent by user's operation, can be also that the mode such as timing of regulation is sent.
Step D03, reads stored thermal-image data frame from interim storage part 2 and carries out Check processing, and the degree of correlation of calculating the thermal-image data frame acquisition of reading is stored in to interim storage part 2; When having detected after the thermal-image data frame of specified quantity (or all thermal-image data frames), obtain value and the corresponding thermal-image data frame thereof of the maximum degree of correlation
At step D04, obtained maximal correlation degree and the correlative value of regulation are compared, if not, get back to step D01, continue to show infrared thermal imagery, or show the printed words that the thermal-image data frame that is greater than correlative value do not detected;
In this way, at step D05, according to the value that detects the maximal correlation degree obtaining, correlative value is upgraded; And at D06, the relevant customizing messages of the thermal-image data frame of degree of correlation maximum is kept, and notify at step D07, for example show infrared thermal imagery and dynamic infrared thermal imagery that this thermal-image data frame obtains.
Whether step D08, detect and exit, and as no, gets back to step D01, repeats follow-up processing; In this way, exit.
As mentioned above, in the present embodiment 4, when receiving the indication of detection, detect and in interim storage part 2, store to obtain the highest frame of the degree of correlation in thermal-image data frame, can lower the manipulation strength that vision is aimed at, common user easily grasps this shooting technical ability, simple to operate, and can reduce the arithmetic speed burden of processor, reduce the beneficial effect of the cost etc. of thermal imagery device 100, and be applicable to the shooting to fast-moving target.
Other embodiment
Thermal imagery device 100 as the example of infrared selection notifying device has been described in the above-described embodiments separately.But the present invention is not only applicable to the thermal imagery device with shoot function, be also applicable to various thermal imagery treating apparatus as described above.
And, can not only detect the overall region of whole subject, and detect the multiple detection windows that subject are divided into multiple parts formations, like this, can more accurately detect; Wherein, for each parts, identical with entirety, prepare corresponding subject identifying information (can be template or characteristic quantity).
Also can be such embodiment, detecting unit, also can be according to subject identifying information, and according to the corresponding judgment value of multiple subject identifying informations, obtains judged result, for example, according to the weighting of multiple characteristic quantities, obtains final judged result.
Also can be such embodiment, detecting unit, also can be according to multiple subject identifying informations, first calculate the comparative result of one of them characteristic quantity and thermal-image data frame, when being greater than the threshold values of regulation, and calculate the comparative result of next subject identifying information and thermal-image data frame, according to repeatedly comparing, obtain final judged result.
Note, can use the whole bag of tricks that detects specific shot body heat picture, processing be in this embodiment only can using method example.
Note, can use the whole bag of tricks that detects specific shot body heat picture, processing be in this embodiment only can using method example.
Note, in the above-described embodiment, can, to processing such as obtaining of the renewal of the quantity of the detection of thermal-image data frame, selection, notice, correlative value, correlative value, supplementary, carry out different combinations, these combine all within the scope of the present invention.
The present invention can also by stay alone and the program of executive logging on memory storage carried out the computing machine (or such as CPU, MPU etc. device) of the system or equipment of the function of above-described embodiment and by its step by the computing machine of system or equipment by for example reading with executive logging the program on memory storage and carrying out the function of above-described embodiment and the method for intellectual realizes.For this purpose, for example, via network or from for example, as in various types of recording mediums (, computer-readable medium) of memory storage program being provided to computing machine.
Although, can realize the functional block in accompanying drawing by hardware, software or its combination, conventionally do not need to arrange the structure of carrying out practical function piece with man-to-man corresponded manner.Can realize by a software or hardware module the piece of multiple functions.

Claims (10)

1. infrared selection notifying device, has,
Acquisition unit, for obtaining continuously thermal-image data frame;
Reference picture specifying part, is used to specify the composition data of reference picture;
Position setting unit, is positioned at the location parameter of infrared thermal imagery for reference picture is set;
Image processing part, for composition data and the set location parameter of position setting unit of the reference picture based on specified, carries out predetermined processing to obtained thermal-image data frame, generates the infrared thermal imagery that has embodied reference picture;
Display part, for showing the image obtaining after predetermined processing;
Test section, for the thermal-image data frame obtaining continuously based on acquisition unit, detects the provisioning information relevant with specific shot body heat picture in thermal-image data frame;
Comparing section, compares for test section being detected to the provisioning information obtaining and/or the evaluation of estimate obtaining based on detecting the provisioning information of acquisition and the correlative value of regulation;
Notification unit, the comparative result of portion, notifies based on the comparison.
2. infrared selection notifying device, has,
Acquisition unit, for obtaining continuously thermal-image data frame;
Reference picture specifying part, is used to specify the composition data of reference picture;
Position setting unit, is positioned at the location parameter of infrared thermal imagery for reference picture is set;
Image processing part, for composition data and the set location parameter of position setting unit of the reference picture based on specified, carries out predetermined processing to obtained thermal-image data frame, generates the infrared thermal imagery that has embodied reference picture;
Display part, for showing the image obtaining after predetermined processing;
Test section, for the thermal-image data frame obtaining continuously based on acquisition unit, detects the provisioning information relevant with specific shot body heat picture in thermal-image data frame;
Supplementary acquisition unit, for obtaining supplementary;
Comparing section, for test section being detected to the provisioning information that obtains and the supplementary obtained of supplementary acquisition unit and/or test section detect the supplementary that the provisioning information that obtains and supplementary acquisition unit obtain and the evaluation of estimate obtaining compares with the correlative value of regulation;
Notification unit, the comparative result of portion, notifies based on the comparison.
3. infrared selection notifying device as claimed in claim 1, is characterized in that having
Selection portion, the comparative result of portion based on the comparison, selects the customizing messages relevant with the thermal-image data frame of regulation; Described customizing messages is the thermal-image data frame of selecting the thermal-image data frame obtaining continuously from acquisition unit, the thermal-image data frame obtaining continuously from acquisition unit carries out the thermal-image data frame of selecting in the thermal-image data frame predetermined processing, the thermal-image data frame that the thermal-image data frame obtaining continuously from acquisition unit is selected carries out the data that obtain predetermined processing, detect the provisioning information obtaining, the evaluation of estimate the obtaining based on detecting the provisioning information obtaining, the information generating based on described provisioning information and/or described evaluation of estimate, wherein one or more;
Notification unit, based on the selected customizing messages of selection portion, notifies.
4. infrared selection notifying device as claimed in claim 2, is characterized in that having
Selection portion, the comparative result of portion based on the comparison, selects the customizing messages relevant with the thermal-image data frame of regulation, described customizing messages is the thermal-image data frame of selecting the thermal-image data frame obtaining continuously from acquisition unit, the thermal-image data frame obtaining continuously from acquisition unit carries out the thermal-image data frame of selecting in the thermal-image data frame predetermined processing, the thermal-image data frame that the thermal-image data frame obtaining continuously from acquisition unit is selected carries out the data that obtain predetermined processing, detect the provisioning information obtaining, the supplementary that supplementary acquisition unit is obtained, the evaluation of estimate that obtains based on detecting the provisioning information that obtains and/or supplementary, based on the information of described provisioning information and/or described supplementary and/or the generation of described evaluation of estimate, wherein one or more,
Notification unit, based on the selected customizing messages of selection portion, notifies.
5. infrared selection notifying device as claimed in claim 1, is characterized in that, described provisioning information at least comprises the information of a kind of or combination in any in the value of position, size, angle of inclination, the degree of correlation of specific shot body heat picture.
6. infrared selection notifying device as claimed in claim 2, is characterized in that, described provisioning information at least comprises the information of a kind of or combination in any in the value of position, size, angle of inclination, the degree of correlation of specific shot body heat picture; Described supplementary, at least comprises the information of a kind of or combination in any in assay value, environment temperature, wind speed, background, humidity, distance.
7. infrared selection notifying device as claimed in claim 1, is characterized in that having
Correlative value renewal portion, for upgrading correlative value; Wherein, in the time having multinomial correlative value, at least one item to the multinomial correlative value of major general upgrades;
And after correlative value is upgraded, described comparing section, for the provisioning information that test section subsequent detection is obtained and/or the evaluation of estimate obtaining based on detecting the provisioning information of acquisition, compares with the correlative value after upgrading; Wherein, in the time that the correlative value of the subitem in multinomial correlative value is upgraded, after renewal, described comparing section, for provisioning information that test section subsequent detection is obtained and/or based on detecting the provisioning information that obtains the evaluation of estimate that obtains, with the correlative value of the renewal item in multinomial correlative value and a correlative value of not upgrading compare.
8. infrared selection notifying device as claimed in claim 2, is characterized in that having
Correlative value renewal portion, for upgrading correlative value; Wherein, in the time having multinomial correlative value, at least one item to the multinomial correlative value of major general upgrades;
And, after correlative value is upgraded, described comparing section, for test section being detected to the provisioning information that obtains and the supplementary obtained of supplementary acquisition unit and/or test section detect the supplementary that the provisioning information that obtains and supplementary acquisition unit obtain and the evaluation of estimate obtaining compares with the correlative value after upgrading; ; Wherein, in the time that the correlative value of the subitem in multinomial correlative value is upgraded, after renewal, described comparing section, detect the supplementary that the provisioning information that obtains and supplementary acquisition unit obtain and the evaluation of estimate obtaining for test section being detected to the provisioning information that obtains and the supplementary obtained of supplementary acquisition unit and/or test section, with the correlative value of the renewal item in multinomial correlative value and a correlative value of not upgrading compare.
9. the infrared selection notifying device as described in claim 3 or 4, is characterized in that notification unit, to the customizing messages of the up-to-date selection of selection portion, is notified.
10. infrared selection Notification Method, has,
Obtaining step, for obtaining continuously thermal-image data frame;
Reference picture given step, is used to specify the composition data of reference picture;
Position setting steps, is positioned at the location parameter of infrared thermal imagery for reference picture is set;
Image processing step, for composition data and the set location parameter of position setting steps of the reference picture based on specified, carries out predetermined processing to obtained thermal-image data frame, generates the infrared thermal imagery that has embodied reference picture;
Step display, for showing the image obtaining after predetermined processing;
Detecting step, for the thermal-image data frame obtaining continuously based on obtaining step, detects the provisioning information relevant with specific shot body heat picture in thermal-image data frame;
Comparison step, compares for detecting step being detected to the provisioning information obtaining and/or the evaluation of estimate obtaining based on detecting the provisioning information of acquisition and the correlative value of regulation;
Notifying process, the comparative result of step, notifies based on the comparison.
CN201210584104.2A 2012-12-27 2012-12-27 Infrared selection notification device and infrared selection notification method Pending CN103900708A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202210406409.8A CN114923580A (en) 2012-12-27 2012-12-27 Infrared selection notification device and infrared selection notification method
CN201210584104.2A CN103900708A (en) 2012-12-27 2012-12-27 Infrared selection notification device and infrared selection notification method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210584104.2A CN103900708A (en) 2012-12-27 2012-12-27 Infrared selection notification device and infrared selection notification method

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202210406409.8A Division CN114923580A (en) 2012-12-27 2012-12-27 Infrared selection notification device and infrared selection notification method

Publications (1)

Publication Number Publication Date
CN103900708A true CN103900708A (en) 2014-07-02

Family

ID=50992174

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202210406409.8A Pending CN114923580A (en) 2012-12-27 2012-12-27 Infrared selection notification device and infrared selection notification method
CN201210584104.2A Pending CN103900708A (en) 2012-12-27 2012-12-27 Infrared selection notification device and infrared selection notification method

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202210406409.8A Pending CN114923580A (en) 2012-12-27 2012-12-27 Infrared selection notification device and infrared selection notification method

Country Status (1)

Country Link
CN (2) CN114923580A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014190913A1 (en) * 2013-05-29 2014-12-04 Wang Hao Thermal imaging device, analysis device and thermal image photography method and analysis method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060164682A1 (en) * 2005-01-25 2006-07-27 Dspv, Ltd. System and method of improving the legibility and applicability of document pictures using form based image enhancement
CN101505372A (en) * 2008-02-06 2009-08-12 凹凸电子(武汉)有限公司 System and method for optimizing camera settings
CN102525381A (en) * 2010-12-16 2012-07-04 奥林巴斯株式会社 Image processing apparatus, image processing method and computer-readable recording device
CN102538980A (en) * 2012-01-12 2012-07-04 杭州美盛红外光电技术有限公司 Thermal image device and shooting method for thermal image
CN102564607A (en) * 2012-01-12 2012-07-11 杭州美盛红外光电技术有限公司 Thermal imaging device and standard thermal image photographing method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060164682A1 (en) * 2005-01-25 2006-07-27 Dspv, Ltd. System and method of improving the legibility and applicability of document pictures using form based image enhancement
CN101505372A (en) * 2008-02-06 2009-08-12 凹凸电子(武汉)有限公司 System and method for optimizing camera settings
CN102525381A (en) * 2010-12-16 2012-07-04 奥林巴斯株式会社 Image processing apparatus, image processing method and computer-readable recording device
CN102538980A (en) * 2012-01-12 2012-07-04 杭州美盛红外光电技术有限公司 Thermal image device and shooting method for thermal image
CN102564607A (en) * 2012-01-12 2012-07-11 杭州美盛红外光电技术有限公司 Thermal imaging device and standard thermal image photographing method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014190913A1 (en) * 2013-05-29 2014-12-04 Wang Hao Thermal imaging device, analysis device and thermal image photography method and analysis method

Also Published As

Publication number Publication date
CN114923580A (en) 2022-08-19

Similar Documents

Publication Publication Date Title
CN103900715A (en) Infrared selecting device and infrared selecting method
CN104811660A (en) Control apparatus and control method
CN103900712A (en) Device and method for selecting thermal image
CN104677504A (en) Decision-making device and decision-making method
CN104215336A (en) Thermal-image device, thermal-image analyzing device, thermal-image shooting method and thermal-image analyzing method
CN104748862A (en) Analyzing device and analyzing method
CN103900711A (en) Infrared selecting device and infrared selecting method
CN103900718A (en) Device and method for setting analysis zone of thermal image
CN103900714A (en) Device and method for thermal image matching
CN103900705A (en) Thermal image selection notification device and thermal image selection notification method
CN103900703A (en) Infrared matching updating device and infrared matching updating method
CN103900708A (en) Infrared selection notification device and infrared selection notification method
CN103776539A (en) Analysis device and analysis method
CN103900704A (en) Infrared detection updating device and infrared detection updating method
CN103900706A (en) Infrared selection notification device and infrared selection notification method
CN103900713A (en) Device and method for detecting thermal image
CN103900709A (en) Thermal image selection notification device and thermal image selection notification method
CN104748863A (en) Infrared analysis area setting device and infrared analysis area setting method
CN103900702A (en) Thermal image matching updating device and thermal image matching updating method
CN104751445A (en) Thermal image analysis configuration device and thermal image analysis configuration method
CN103900707A (en) Thermal image detection updating device and thermal image detection updating method
CN104748861A (en) Selecting device and selecting method
CN103900710A (en) Device and method for selecting thermal image
CN104655638A (en) Analytical comparison device and analytical comparison method
CN103900721A (en) Device and method for recording and controlling thermal image

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Yuhang District of Hangzhou city in Zhejiang province 311113 Qixian Village Building 1 Liangzhu Street Bridge

Applicant after: MISSION INFRARED ELECTRO OPTICS TECHNOLOGY Co.,Ltd.

Address before: Hangzhou City, Zhejiang province Binjiang District 310051 shore road 1180, room 1 No. 2 factory on the west side of the five floor corridor Room 501

Applicant before: MISSION INFRARED ELECTRO OPTICS TECHNOLOGY Co.,Ltd.

CB02 Change of applicant information
RJ01 Rejection of invention patent application after publication

Application publication date: 20140702

RJ01 Rejection of invention patent application after publication