CN114923581A

CN114923581A - Infrared selecting device and infrared selecting method

Info

Publication number: CN114923581A
Application number: CN202210407107.2A
Authority: CN
Inventors: 王浩
Original assignee: Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Current assignee: Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Priority date: 2012-12-27
Filing date: 2013-12-26
Publication date: 2022-08-19
Also published as: WO2014101805A1; CN103900711A

Abstract

The invention discloses an infrared selection device and an infrared selection method, and relates to the application fields of thermal image devices, thermal image processing devices and infrared detection. In the thermal image device in the prior art, a shot object thermal image needs to be shot by depending on the subjective experience of a user during shooting, the workload is large, and the quality of the thermal image is difficult to ensure; the invention provides an infrared selecting device and an infrared selecting method, which can automatically detect specified information of a specific shot thermal image from multi-frame thermal image data frames stored in a storage medium, or automatically select specific information related to the thermal image data frames which meet specified conditions from the specified information by considering the factors of auxiliary information. To facilitate further processing or manipulation of notifications, analysis, storage, etc. Therefore, the shooting operation is simple, the shooting speed is high, and the thermal image quality is high.

Description

Infrared selection device and infrared selection method

Technical Field

The invention discloses an infrared selection device and an infrared selection method, and relates to the field of application of infrared detection.

Background

Since the application of the thermal image detection technology, a user is always confused about the cognition of the imaging form of a shot object under the condition of a correct shooting part and a shooting angle and the control of the shooting distance, which depend on the subjective idea and experience of the user, so that the shooting and thinking are required at the same time if the detection quality is required to be ensured, the shooting speed is very low, and the defects of the key shooting part or the shot object are easily omitted if the speed is increased, thereby influencing the state evaluation effect. It usually takes years of practice to accumulate to reach a high level of detection for the user.

Technical personnel in the field have been trying to solve the problem, and there is a technology that a reference image representing predetermined morphological characteristics of a subject and an infrared thermal image obtained by shooting are continuously displayed in an overlapping manner, and a user takes the reference image as a visual reference for shooting the thermal image of the subject to shoot the subject, so as to ensure the position and size of the subject in the infrared thermal image and the morphological characteristics of the thermal image of the subject to be shot, and ensure the shooting quality. For example, patent document application No.: 201210008404.6 discloses such a thermographic imaging apparatus.

However, the above method requires the user to judge the matching degree between the reference image and the thermal image of the object by visual manual work, and the user is prone to visual fatigue; when a handheld thermal imaging device is used, the operation of aiming for shooting is easy to be fatigue, the shooting time is repeatedly aimed for prolonging, and the quality of the shot thermal image is influenced. Moreover, the operation of the mode is stiff, and the requirement on shooting alignment is high.

Accordingly, it is appreciated that there is a need for an infrared picking apparatus that addresses the problems of the prior art.

Disclosure of Invention

The invention provides an infrared selecting device and an infrared selecting method, which can display a reference image in an infrared thermal image, automatically detect specified information such as the position, the size, the inclination angle, the value of the degree of correlation and the like of a specific shot thermal image in an acquired thermal image data frame, or also consider the factors of auxiliary information, so as to automatically select a thermal image data frame meeting specified conditions, and further facilitate the processing or operation such as notification, analysis, storage and the like. Therefore, the shooting operation is simple, the shooting speed is high, and the thermal image quality is high.

Therefore, the invention adopts the following technical scheme that the infrared selection device comprises a shooting part, a selection part and a selection part, wherein the shooting part is used for continuously shooting and acquiring thermal image data frames; the thermal image storage part is used for storing a plurality of frames of continuously acquired thermal image data frames; a display control section for controlling to display the dynamic infrared thermal image and the reference image obtained based on the acquired thermal image data frame; a detection unit that detects prescribed information related to the thermal image of the specific object based on the plurality of frames of thermal image data stored in the thermal image storage unit; a comparison unit for comparing an evaluation value obtained based on the predetermined information detected by the detection unit and/or the predetermined information obtained based on the detection with a predetermined contrast value; and a selection unit that selects specific information related to a predetermined thermal image data frame based on the comparison result of the comparison unit.

The infrared selecting device also can adopt the following technical scheme that the infrared selecting device comprises an acquisition part used for continuously acquiring thermal image data frames; the thermal image storage part is used for storing continuously acquired multi-frame thermal image data frames; a display control section for controlling to display the dynamic infrared thermal image and the reference image obtained based on the acquired thermal image data frame; a detection part for detecting the specified information related to the thermal image of the specific object based on the multi-frame thermal image data frames stored in the thermal image storage part; a comparison unit for comparing a predetermined contrast value with predetermined information obtained by the detection unit and/or an evaluation value obtained based on the predetermined information obtained by the detection unit; and a selection unit that selects specific information related to a predetermined thermal image data frame based on the comparison result of the comparison unit.

The infrared selecting method comprises a shooting step, a selecting step and a selecting step, wherein the shooting step is used for continuously shooting and obtaining thermal image data frames; a thermal image storage step, which is used for storing continuously acquired multi-frame thermal image data frames; a display control step of controlling to display a dynamic infrared thermal image and a reference image obtained based on the acquired thermal image data frame; a detection step of detecting prescribed information related to the thermal image of the specific object based on the multi-frame thermal image data frames stored in the thermal image storage step; a comparison step of comparing an evaluation value obtained based on the predetermined information obtained by the detection step and/or the predetermined information obtained by the detection with a predetermined contrast value; and a selection step of selecting specific information related to a prescribed thermal image data frame based on the comparison result of the comparison step.

The infrared selection method also can adopt the following technical scheme that the infrared selection method comprises an acquisition step for continuously acquiring thermal image data frames; a thermal image storage step, which is used for storing a plurality of frames of continuously acquired thermal image data frames; a display control step for controlling to display the dynamic infrared thermal image and the reference image obtained based on the acquired thermal image data frame; a detection step for detecting prescribed information related to the thermal image of the specific object based on the multiple frames of thermal image data stored in the thermal image storage step; a comparison step of comparing the predetermined information obtained by the detection step and/or an evaluation value obtained based on the predetermined information obtained by the detection with a predetermined contrast value; and a selection step of selecting specific information related to a prescribed thermal image data frame based on the comparison result of the comparison step.

The infrared selection method can also adopt the following technical scheme that the infrared selection method comprises a shooting step and a thermal image data frame acquisition step, wherein the shooting step is used for continuously shooting to acquire the thermal image data frame; a thermal image storage step, which is used for storing continuously acquired multi-frame thermal image data frames; a display control step for controlling to display the dynamic infrared thermal image and the reference image obtained based on the acquired thermal image data frame; a detection step for detecting prescribed information related to the thermal image of the specific object based on the multi-frame thermal image data frames stored in the thermal image storage step; a comparison step of comparing the plurality of thermal image data frames based on the prescribed information obtained by the detection step and/or an evaluation value obtained based on the prescribed information obtained by the detection step; and a selection step of selecting specific information related to a prescribed thermal image data frame based on the comparison result of the comparison step.

The infrared selecting method can also adopt the following technical scheme, and comprises an acquisition step, a selection step and a selection step, wherein the acquisition step is used for continuously acquiring thermal image data frames; a thermal image storage step, which is used for storing the multi-frame thermal image data frames continuously acquired in the acquisition step; a display control step for controlling to display the dynamic infrared thermal image and the reference image obtained based on the acquired thermal image data frame; a detection step for detecting prescribed information related to the thermal image of the specific object based on the multi-frame thermal image data frames stored in the thermal image storage step; a comparison step of comparing the plurality of thermal image data frames based on the prescribed information obtained by the detection step and/or an evaluation value obtained based on the prescribed information obtained by the detection step; and a selection step of selecting specific information related to a prescribed thermal image data frame based on the comparison result of the comparison step.

Other aspects and advantages of the invention will become apparent from the following description.

Description of the drawings:

fig. 1 is a block diagram showing a schematic configuration of a thermal image device 100 according to embodiment 1 of the present invention.

FIG. 2 is a profile view of the thermal image device 100 of embodiment 1.

Fig. 3 is a schematic diagram of object information, object identification information, and the like stored in the storage medium of embodiment 1.

Fig. 4 is a schematic illustration of detection windows for different parameters.

Fig. 5 is a schematic view of a detection window provided in a detection area for detection.

Fig. 6 is a display example of a display interface of the control processing of embodiment 1.

Fig. 7 is a block diagram showing a schematic configuration of the thermal image device 100 according to embodiment 2 of the present invention.

Fig. 8 is a control flowchart showing embodiment 1.

Fig. 9 is a control flowchart showing embodiment 2.

Fig. 10 is a display example of a display interface of the processing procedure of embodiment 2.

FIGS. 11 to 12 are control flowcharts showing embodiment 3.

Fig. 13 is a display example of a display interface of the control processing of embodiment 3.

Detailed Description

Exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. Note that the following examples are to be described for better understanding of the present invention, so the scope of the present invention is not limited and various forms within the scope of the present invention may be changed. Furthermore, although the present invention is used for a handheld thermographic photographing apparatus in the following embodiments, a photographing function is not essential to the present invention, and any thermal image data source to be subject-specific thermal image detected may be used. The invention is therefore widely used in thermal image processing devices for receiving and processing thermal images. The thermal image processing apparatus includes various devices such as a personal computer, a personal digital assistant, and the like.

Example 1

The thermal image device 100 (infrared selecting device 100) of embodiment 1 detects the degree of correlation between the multiple frames of thermal image data frames stored in the temporary storage 2 and the object identification information and the like according to a predetermined instruction based on the multiple frames of thermal image data frames captured by the imaging unit 1 and stored in the temporary storage 2, and selects specific information related to the thermal image data frames based on the comparison result.

Fig. 1 is a block diagram showing a schematic configuration of a thermal image device 100 as an example of an infrared sorting device 100 according to embodiment 1 of the present invention.

Specifically, the thermal image device 100 includes an image capturing unit 1, a temporary storage unit 2, a flash memory 3, a communication I/F4, a memory card I/F5, a memory card 6, an image processing unit 7, a detection unit 8, a display control unit 9, and a display unit 10, and the control unit 11, the operation unit 12, and the control unit 11 are connected to the corresponding units via a control and data bus 13, and are responsible for overall control of the thermal image device 100.

The imaging unit 1 is configured by an optical component, a lens driving component, an infrared detector, a signal preprocessing circuit, and the like, which are not shown. The optical component is composed of an infrared optical lens for focusing the received infrared radiation to the infrared detector. The lens driving part drives the lens to perform focusing or zooming operations according to a control signal of the control part 11. Furthermore, it may be a manually adjusted optical component. An infrared detector, such as an infrared focal plane detector of the refrigerated or non-refrigerated type, converts the infrared radiation passing through the optical component into an electrical signal. The signal preprocessing circuit comprises a sampling circuit, an AD conversion circuit, a timing trigger circuit and the like, and performs signal processing such as sampling on an electric signal output from the infrared detector in a specified period, and the electric signal is converted into a digital thermal image signal through the AD conversion circuit, wherein the thermal image signal is binary data (also called thermal image AD value data, AD value data for short) with 14 bits or 16 bits, for example. In embodiment 1, the photographing part 1 is an example of an acquiring part for acquiring a frame of thermal image data.

The thermal image data frame may be a thermal image signal (thermal image AD value data obtained by AD converting an output signal of an infrared detector), or image data of an infrared thermal image, or array data of a temperature value, or other data generated based on the thermal image signal, according to different embodiments of the acquiring unit. The thermal image data frame is exemplified by thermal image signals hereinafter.

The temporary storage unit 2 is a volatile memory such as RAM, DRAM, or the like, and is used as a buffer memory for temporarily storing the thermal image data frames output by the image capturing unit 1, and for example, the following processing is repeated to temporarily store the acquired thermal image data frames for a predetermined time, and when a new frame is acquired by the acquiring unit (image capturing unit 1), the old frame is deleted and the new thermal image data frame is stored; at the same time, the image processing unit 7, the detection unit 8, the control unit 11, and the like function as working memories, and temporarily store data to be processed. Not limited to this, a memory, a register, or the like included in a processor such as the image processing unit 7, the detection unit 8, or the control unit 11 may be interpreted as a type of temporary storage medium.

A cyclic storage area (an example of the thermal image storage section) in which a plurality of thermal image data frames (for example, 50 frames) are temporarily stored in a specific area is allocated in the temporary storage section 2, and a plurality of thermal image data frames obtained by shooting by the shooting section 1 are cyclically stored. Or a circular memory capable of temporarily storing a plurality of frame copies (for example, 50 frames) of thermal image data may be separately configured. But not limited to, the temporary storage 2 may be distributed as a thermal image storage in another storage medium.

The flash memory 3 stores a program for control and various data used for control of each part. In the present embodiment, as shown in table 3 of fig. 3, data related to the reference image, detection, and the like is stored in a storage medium such as a flash memory 3, for example, a database (table 3) storing subject identification information, and subject information of each subject, configuration data of the reference image, and subject identification information are stored in the feature database in association with each other, and may be stored in a data file of a specific format or the like. The reference image configuration data includes, for example, vector graphics data and dot matrix image data, and also includes configuration data in which a reference image is configured by a plurality of coordinate point data. Where the template data may be the same or different from the reference image.

The subject information is information related to a subject, and includes, for example, information representing a subject location, a type, a number, and the like, and various information related to a subject, such as an attribution unit, a classification level (for example, a voltage level, an importance level, and the like), a model number, a manufacturer, performance, and characteristics, a history of past shooting or inspection, a manufacturing date, and a lifetime. Various kinds of applicable subject information can be prepared according to the application.

The communication I/F4 is an interface for connecting the thermal image device 100 to an external device and exchanging data according to communication specifications such as USB, 1394, and network, and examples of the external device include a personal computer, a server, a PDA (personal digital assistant), another thermal image device, a visible light camera, and a storage device.

The memory card I/F5 is connected to the memory card I/F5 as an interface of the memory card 6, is detachably mounted in a card slot of the thermal image device 100 main body, and records data such as thermal image data frames under the control of a recording control unit (not shown) of the control unit 11, as a rewritable nonvolatile memory of the memory card 6.

The image processing unit 7 is configured to perform predetermined processing on the thermal image data frames obtained by the imaging unit 1, for example, to select and read out frames for each predetermined time interval from the thermal image data frames for each predetermined time interval temporarily stored in the temporary storage unit 2 when the display timing arrives; the image processing unit 7 performs processing such as correction, interpolation, pseudo color, synthesis, compression, decompression, and the like, and converts the data into data suitable for display, recording, and the like. The image processing unit 7 may be implemented by, for example, a DSP, another microprocessor, a programmable FPGA, or the like, or may be integrated with a processor corresponding to the detection unit 8 or the control unit 11.

The image processing unit 7 is configured to perform predetermined processing on a thermal image data frame (e.g., a thermal image signal) captured by the imaging unit 1 to obtain image data of an infrared thermal image. Specifically, for example, the image processing unit 7 performs predetermined processing such as non-uniformity correction and interpolation on a thermal image data frame captured by the imaging unit 1, and performs pseudo color processing on the thermal image data frame after the predetermined processing to obtain image data of an infrared thermal image; one embodiment of the pseudo color processing is to determine a corresponding range of the pseudo color table according to a range of the thermal image AD value data or a set range of the thermal image AD value data, for example, and take a specific color value of the thermal image data corresponding to the range of the pseudo color plate as image data of a corresponding pixel position in the infrared thermal image. The image data obtained after the pseudo-color processing by the image processing section 7 is transferred to the temporary storage section 2 used as a buffer memory.

The image processing unit 7 further includes a synthesizing unit (not shown) that obtains a reference image based on the configuration data of the reference image specified by the reference image specifying unit 11F and the position parameter set by the position setting unit 11G, synthesizes the reference image with the infrared thermal image generated by the image processing unit 7, and generates image data of a synthesized image. Specifically, the image synthesis unit synthesizes the reference image and the infrared thermal image according to a specified transparency rate; including the case where the reference image has a transparency of 1 (e.g., the reference image is a line image of an edge contour), i.e., the opacity is combined with the infrared thermography.

And an image processing unit 7 for performing predetermined processing on the acquired thermal image data frame based on the specified reference image configuration data and the position parameter set by the position setting unit 11G to generate an infrared thermal image representing the reference image.

In addition, the synthesis may also be based on such processing, for example, pseudo-color processing may be performed on the thermal image data frame according to the pixel position of the reference image in the infrared thermal image, so as to generate image data for display (similar to an overlapping effect) that embodies the reference image and the infrared thermal image; for example, according to the pixel position of the reference image in the infrared thermal image, the thermal image data of the pixel position is not subjected to pseudo-color processing, the thermal image data outside the pixel position of the reference image is subjected to pseudo-color processing, and then the image data of the reference image is combined to generate the image data for display.

Or, the thermal image data of the pixel position in the thermal image data frame corresponding to the reference image may be processed differently (for example, differently processed) from the pseudo-color processing of the thermal image data of other image number positions for generating the infrared thermal image, so as to generate an image with the reference image. In this case, an image synthesizing unit for synthesizing the image data of the reference image with the image data of the infrared thermal image may be eliminated in the thermal image device 100.

The so-called reference image, displayed together with the infrared thermal image, can help the user to shoot a specific object. For example, an image showing morphological characteristics of the specific subject; the reference image may also be of other shapes, such as square, circular; for example, an identification image representing a subject thermal image at a desired imaging location in an infrared thermal image; for example, an identification image representing a detection area (which may contain one or more detection windows) in an infrared thermography; such as an identification image or the like, that embodies an analysis area of a desired subject thermal image. Preferably, the reference image is displayed superimposed on the infrared thermography according to defined position parameters (position, or also dimensions, or also rotation angle).

In addition, the reference image can also be displayed in the display part and in the area outside the infrared thermal image window; in addition, thumbnails representing the relationship between the reference image and the infrared thermal image, such as the position and size ratio, may be displayed in an area of the display portion outside the infrared thermal image window.

The detection unit 8 calculates the correlation between the subject identification information and the thermal image data frames of the plurality of frames stored in the temporary storage unit 2 (thermal image storage unit); the detection processing may be performed on part or all of the thermal image data frames in the temporary storage 2, for example, all of the thermal image data frames are sequentially read for detection processing, for example, only the thermal image data frames at predetermined intervals are read for detection processing; for example, when a thermal image data frame with the correlation and/or the evaluation value larger than the contrast value is detected for the first time, the detection is not continued; starting or stopping the detection, for example, in response to a predetermined operation by the user; or the read thermal image data frame or the thermal image data in the detection window is subjected to reduction processing before detection; thus, the processing load associated with detection can be reduced.

The thermal image data frame related to detection may be a thermal image signal (thermal image AD value data), or image data of an infrared thermal image, or array data of thermal image temperature values, or other data obtained based on the thermal image signal. For example, the detection section 8 may perform the detection processing of the degree of correlation with the registered object identification information by reading the frame of thermal image data obtained by the photographing section 1 stored in the temporary storage section 2 or by reading data obtained by performing prescribed processing on the frame of thermal image data obtained by the photographing section 1 by the image processing section stored in the temporary storage section 2 (for example, image data of infrared thermal image obtained by pseudo-color processing), based on the control by the control section 11.

The frames of thermal image data captured by the capturing portion 1 are not limited, and in other examples, the frames of thermal image data may be obtained from externally input data, such as data received and decoded continuously from other thermal image devices via the I/F4.

In embodiment 1, the detection unit 8 includes a feature registration unit, a detection window setting unit, and a detection unit (not shown).

A feature registration unit for registering object identification information relating to the correlation calculation. For example, the subject identification information may be registered from subject identification information stored in advance in a storage medium; for example, the subject identification information used for the correlation calculation is registered in accordance with the subject identification information associated with the subject information selected by the user. Further, the subject identification information may also be specified by the user, and the subject identification information (e.g., template data, or extracted feature amount) may be obtained by specifying a subject region from the display image, for example. The registered subject identification information is stored in a predetermined position of the temporary storage unit 2, for example, or is distinguished from other stored subject identification information by a mark when stored.

The subject identification information may be template data (such as a template image) for template matching; the object identification information may be a feature quantity described by a parameter, i.e., a feature quantity (a feature such as a point, a line, or a plane) determined based on the state of the pixels included in the detection window, such as the ratio of pixels in a predetermined portion in a specific detection window, the average value of pixel values, and the center point or the area of the outline of the specific object. For example, the object identification information is the template data 301 for the object 1 in table 3, and the object identification information is the feature amount 302 for the object 2 in table 3. In a specific application, one or more combinations of the subject identification information modes can be selected according to the situation.

And the detection window setting unit is used for setting the detection window. For example, based on a certain range of detection regions (e.g., G1 in fig. 5), a plurality of detection windows (e.g., parameters of the detection windows are predetermined according to quality requirements) are set in the detection region G1, which may be a plurality of detection windows of different sizes, or may be a detection window tilted further, as shown in fig. 4, where fig. 4(a) is a standard detection window, fig. 4(b) is a detection window based on a reduced size, fig. 4(c) is a detection window set in an enlarged size, and fig. 4(d) is a detection window set tilted at a predetermined angle. In order to be equal to the size of the detection window, the template image is used here in a reduced or enlarged or further tilted state, or a template image having a size equal to the window size may be prepared and stored for use. In addition, the thermal image data in the detection window may also be used in a reduced or enlarged or also tilted state to correspond to the template image. The detection window is not limited to a square shape, and may have other shapes, for example, according to the shape of the template image.

The detection area can be set by a user according to shooting habits; or may be pre-stored as being associated with the subject information; or generated according to the position of the thermal image of the specific shot object detected last time; instead of setting a specific detection area, the range of the thermal image data frame may be set as the detection area. A plurality of detection windows may be provided at positions and sizes designated by the user. Further, it is not necessary to provide a plurality of detection windows, and only one detection window may be provided.

It should be noted that for the application field of infrared detection, such as a substation, where a large number of devices with similar appearances but different names are filled, it is preferable to set the detection area in order to avoid misleading users and misshooting. The identification of the detection area is displayed on the infrared thermal image in an overlapping manner, so that a user can easily understand the approximate position, size and the like of the shot specific object thermal image, the shooting reference is convenient, the detection processing speed can be increased, but the detection area can not be displayed.

And the detection unit is used for acquiring the value for evaluating the correlation degree according to the shot object identification information based on the thermal image data in the detection window set by the detection window setting unit in the read thermal image data frame. When a plurality of detection windows are set, for example, the value of the maximum correlation obtained by detection therein may be used as the value of the correlation of the thermal image data frame.

The detection processing of the detection part 8 can be a detection mode based on template matching, and the correlation degree calculation and comparison are carried out on the basis of the thermal image data in the detection window and the template image; for example, the detection unit calculates the sum of differences between pixels at positions where the infrared thermal images in the detection window and the infrared thermal images as the template correspond to each other, and the smaller the calculated sum of differences, the higher the degree of correlation. For example,

the embodiment may also be configured to extract the feature quantities for matching, and the correlation may be determined by comparing the template image with the feature quantities of the thermal image data in the detection window. For example, the proportion of a specific pixel of the object image in the extraction detection window is higher as the proportion of the specific pixel in the template image is closer.

The detection processing of the detection unit 8 may be performed by performing a predetermined calculation based on the detection embodiment of the feature amount described by the parameter to obtain the feature amount of the thermal image data in the detection window, and comparing the feature amount with a reference value (object identification information) of the feature amount to obtain a value of the correlation. For example, the reference value of the characteristic quantity is the proportion of pixels with specific pixel values, the detection unit calculates the proportion of pixels with specific pixel values in the thermal image data, and the proportion is compared with the reference value of the characteristic quantity to obtain the value of the correlation degree between the proportion and the reference value.

Preferably, the contour image is used as a matched template, and the detection unit 8 calculates the correlation by, for example, extracting thermal image data located in a detection window by the detection unit 8, and binarizing the read thermal image data in the detection window according to a predetermined threshold value of the AD value; then, extracting connected images of the binary image, wherein the pixels with the preset pixel value (1 or 0) are connected with each other; then judging whether the connected image has the size of a preset range or not; if the size of the connected image is judged to be within the predetermined range, comparison processing is further performed between the extracted connected image and the registered template, for example, the sum of the proportions of the overlapping area between the two in the respective total areas is calculated, thereby obtaining the correlation between the extracted thermal image data and the template.

For an example of inspection, as shown in fig. 5, the inspection section 8 moves the window J1 from the upper left corner to the lower right corner of the prescribed inspection area G1 of the thermal image data frame 501 for inspection, cuts out the thermal image data in the window, and inspects the degree of correlation thereof with the template image T1. Specifically, the window J1 is moved stepwise by a window displacement (e.g., one pixel) of a prescribed value from the left end to the right end, and after reaching the right end, is set to return to the left end and move the window displacement downward, and then is moved stepwise to the right again. In order to detect a subject with high accuracy, the detected window size, window displacement, and conversion range of the tilt angle of the window are defined in advance, for example, the window size varies from 150 × 50 pixels to 120 × 40 pixels, the window displacement varies from 10 pixels to 1 pixel, and the tilt angle of the window varies from 0 ° to 10 ° based on the center point. The detection section 8 changes the window size 5 pixels by 5 pixels and changes the window displacement 1 pixel by 1 pixel and changes the window inclination angle 2 ° by 2 ° one by one. The detection part 8 calculates the correlation between the template image T1 and the thermal image data frame 501; after the detection of all the detection windows is completed, the correlation value obtained by the detection window with the highest correlation is selected from the detection windows as the correlation value corresponding to the thermal image data frame 501.

Note that various methods of calculating the degree of correlation of thermal image data frames based on subject identification information are possible, and the above-exemplified processing is only an example of a usable method.

And a display control unit 9 for displaying the image data for display stored in the temporary storage unit 2 on the display unit 10. For example, in a shooting standby mode, infrared thermal images generated by thermal image data obtained by shooting are continuously displayed; in the playback mode, the infrared thermal image read out and expanded from the memory card 6 is displayed, and in addition, various setting information can be displayed. Specifically, the display control unit 9 includes a VRAM, a VRAM control means, a signal generation means (not shown), and the like, and the signal generation means periodically reads image data from the VRAM (image data read from the temporary storage unit 2 and stored in the VRAM) under the control of the control unit 11, generates a video signal output, and displays the video signal on the display unit 10. In the thermal image device 100, the display portion 10 is, for example, a liquid crystal display device. Without being limited thereto, the display 10 may also be another display device connected to the thermal image device 100, and the thermal image device 100 may not have a display in its own electrical structure, and the display control unit 9 may also be an example of an image output unit.

In addition, in embodiment 1, the display section 10 is for displaying notification information based on the control of the notification section 11C; for example, the warning is performed by text and image, such as information showing the maximum correlation, infrared thermal image obtained by thermal image data frame showing the maximum correlation, or notification is performed along with the transparency, color, size, line shape, thickness, flicker, brightness, frame change of text and image.

The notification may be continued for a predetermined time. In addition, the thermal image device 100 may also be controlled by a vibration component, an indicator light (not shown), an analysis component (not shown), and a diagnosis component (not shown), wherein when the thermal image data frame with the maximum correlation degree is detected, the indicator light generates light change, the vibration device generates vibration, the analysis component analyzes and displays the analysis result, and the diagnosis component diagnoses and displays the diagnosis result; or simultaneously notify in one or more of the above manners, as long as the user can perceive it.

The control unit 11 controls the overall operation of the thermal image system 100, and a program for controlling and various data used for controlling each part are stored in a storage medium such as the flash memory 3. The control unit 11 is realized by, for example, a CPU, an MPU, an SOC, a programmable FPGA, or the like. In the present embodiment, the control unit 11, the display unit 10, and the like also function as a configuration of a subject information selection unit for selecting subject information.

The control unit 11 further includes a comparing unit 11A for comparing predetermined information detected by the detecting unit 8 and/or an evaluation value obtained based on the predetermined information obtained by the detection with a predetermined comparison value, the predetermined information including at least one or any combination of values of a position, a size, an inclination angle, and a correlation of the specific subject thermal image; in embodiment 1, the correlation value of the thermal image data frame obtained by the detecting unit 8 is compared with the contrast value of the correlation. Note that the contrast value of the correlation may be a judgment value of the correlation (for example, stored in table 3 corresponding to the subject identification information, such as a contrast value set by a user) prepared in advance, and when the comparison value is greater than the contrast value, it is judged that the specific subject thermal image is present in the thermal image data frame; instead of the previously prepared contrast value of the correlation, the correlation value may be obtained from the correlation value in the thermal image data frame, for example, the correlation value obtained by the first detection processing may be used as the contrast value of the subsequent contrast correlation, and when the correlation is subsequently detected to be greater than the contrast value, the subsequent contrast correlation is updated.

The control unit 11 further includes a selection unit 11B for selecting specific information on a predetermined thermal image data frame based on the comparison result of the comparison unit 11A. The specific information selected may be used for specified processing to be experienced, such as analysis, recording, notification, and the like.

Wherein, the specific information related to the specified thermal image data frames is the specific information related to one or more frames of thermal image data frames in the multiple frames of thermal image data frames of the temporary storage part 2; for example, based on the comparison result of the comparing section 11A, specific information on the thermal image data frame having the largest degree of correlation is selected; but is not limited to the frame of thermal image data with the maximum detected correlation, for example, it is also possible to select a frame before or after the timing of the frame with the maximum detected correlation, or a frame obtained by multi-frame operation, or specific information related to the frame of thermal image data corresponding to the correlation with the earliest detected correlation larger than a prescribed contrast value. The system may also be configured to select specific information related to a plurality of thermal image data frames, for example, specific information related to three thermal image data frames with the first, second, and third degrees of correlation, or specific information related to a plurality of thermal image data frames with the same degree of correlation.

The specific information is one or more of a thermal image data frame selected from the multi-frame thermal image data frames of the temporary storage unit 2, data obtained by performing specified processing on the thermal image data frame selected from the multi-frame thermal image data frames, specified information obtained by detection, an evaluation value obtained based on the specified information obtained by detection, and prompt information generated based on the specified information obtained by detection and/or the evaluation value.

The image processing method includes the steps of obtaining data obtained by performing specified processing on a thermal image data frame selected from a plurality of thermal image data frames, for example, obtaining data obtained by performing specified processing on the selected thermal image data frame, for example, obtaining image data of a specific object thermal image extracted from the thermal image data frame, for example, obtaining image data of a generated infrared thermal image, and for example, converting the thermal image data frame into an analysis numerical value such as an array of temperature numerical values.

The obtained specified information is detected, and the specified information at least comprises information of one or any combination of values of the position, the size, the inclination angle and the degree of correlation of the specific object thermal image.

The evaluation value obtained based on the predetermined information obtained by the detection is obtained by weighting the predetermined information obtained by the detection based on a weighting coefficient, or an evaluation value for evaluating the quality of the thermal image or the like may be obtained based on a comparison table between the predetermined information and the evaluation value, or the like.

The indication information generated based on the specified information obtained by detection and/or the evaluation value may be, for example, an indication that the specified information obtained by detection and/or the evaluation value is converted into percentage information that is easy for a user to understand.

The selection unit 11B controls to hold or not hold the selected specific information; the held specific information may be held in a predetermined area of the temporary storage unit 2 or may be held (stored) in a storage medium such as the flash memory 3. Hereinafter, the selector 11B holds specific information such as the thermal image data frame in a predetermined area of the temporary storage 2 as an example.

The selection unit 11B may hold the selected specific information all the time, or may hold the selected specific information under a predetermined condition, for example, the currently selected specific information is held for a predetermined time; for example, the current specific information is always maintained until a frame of thermal image data of greater relevance is detected; for example, the selected specific information is always maintained until the subject identification information for detection of comparison or the selected subject information is changed; for example, specific information that is held or not held according to an instruction from the user (e.g., the user selects a specific information displayed in the display section to determine holding). Or not, e.g., sent to other external devices via communication I/F4; e.g., undergo other processing such as deletion upon notification, etc.

The selection unit 11B updates the specific information held in the temporary storage unit 2 to specific information selected by the selection unit 11B subsequently, in accordance with a predetermined condition. The predetermined condition, for example, a predetermined time, for example, a predetermined number of thermal image data frames are detected, for example, according to the comparison result of the comparing unit 11A (a case where the correlation degree is greater than the correlation degree of the held thermal image data frames is obtained), for example, an instruction of the user, or the like. In addition, the specific information that was previously retained can be retained.

In embodiment 1, the selection unit 11B controls the selection, holding, and updating of the specific information based on the comparison result of the comparison unit 11A. If the correlation value of the thermal image of the specific object detected by the detection part 8 is greater than the contrast value of the correlation, the correlation value and the corresponding specific information such as the thermal image data frame are selected and kept in the storage media such as the temporary storage part 2; when the previous specific information such as the correlation value and the corresponding thermal image data frame exists, the previous specific information is replaced; until a subsequent frame of more highly correlated thermal image data is available, it can be replaced (a defined number of more highly correlated frames of thermal image data can also be maintained). In this way, the value of the maximum correlation and the corresponding specific information such as the thermal image data frame are retained. In addition, the specific information that was previously retained can be retained.

Preferably, the control unit 11 includes a notification unit 11C for notifying the user based on the specific information about the predetermined thermal image data frame selected by the selection unit 11B. The notification unit 11C preferably displays notification information obtained from the currently selected specific information together with the infrared thermal images, the reference images, and the like obtained from the thermal image data frames continuously obtained by the obtaining unit. For example, the infrared thermal images (for example, after reduction) obtained from the currently selected and held thermal image data frame are displayed together with the continuous infrared thermal images, the reference images, and the like acquired by the imaging unit 1, and in addition, other notification information, such as a value of the degree of correlation, an evaluation value, and the like, may be displayed simultaneously or separately. In addition, the dynamic infrared thermal image can also be switched to display the frozen image of the thermal image data frame.

When the selection unit 11B selects that the specific information related to the plurality of thermal image data frames is maintained, the notification unit 11C may notify one or more of the plurality of frames, for example, displaying the reduced infrared thermal images obtained from the plurality of frames of thermal image data together with the continuous infrared thermal images obtained by the photographing unit 1.

The notification information is obtained according to the specific information about the predetermined thermal image data frame selected by the selection unit 11B, and for example, the value of the degree of correlation may be converted into information indicating a degree of similarity that is easy for a user to understand, and displayed; for example, the correlation value is converted to a percentage value according to a predetermined lookup table of the correlation value and the percentage, or a calculation manner (for example, the sum of the proportion of the overlapped area of the extracted specific subject contour and the contour T1 in the respective total areas is divided by 200%, that is, the correlation value is converted to a percentage value); other ways are also possible, such as displaying the value of the calculated correlation directly, such as displaying the value of the sum of the differences between pixel values directly, etc. Note that when no comparison is made with a prescribed contrast value representing whether or not the specific subject thermal image is detected (a determination value representing whether or not the specific subject thermal image matches the subject identification information), the displayed information of the degree of correlation does not necessarily represent whether or not the specific subject thermal image (matching) is detected. For convenience of explanation, hereinafter, the value of the correlation, the evaluation value, and the percentage value to which the contrast value is converted are taken as examples, but in practice, conversion to the percentage value is not necessary.

The notification may be performed for a predetermined time. Based on the control of the notification unit 11C, the display unit 10 may be caused to generate one or more changes such as a change in display content, vibration of a vibration member in the thermal image device 100, a change in light of an indicator lamp, sound of a sound member, and analysis processing of an analysis member (and the display unit 10 may be caused to display an analysis result), and the diagnosis member may perform diagnosis (and the display unit 10 may be caused to display a diagnosis result), blinking display or color change of a reference image, and a pseudo-color change of infrared thermography; as long as it is in a manner perceptible to the user.

The control unit 11 includes a recording unit 11E (not shown) and records the thermal image data frame selected by the selection unit 11B and held in the temporary storage unit 2 in the memory card 8 in response to a predetermined recording instruction. The thermal image data frames are recorded to the memory card 8, for example, in response to an indication such as a user's selection of the notified thermal image data frames, for example, an indication such as a timed automatic recording.

The control unit 11 further includes a reference image specification unit 11F (not shown) for specifying the configuration data of a reference image to be displayed together with the infrared thermography; for example, based on the constituent data (dot matrix data or vector data) of the reference image associated with the subject information stored in the storage medium, the constituent data of the reference image associated with the subject information is specified in accordance with the selection of the subject information by the user; the method is not limited to obtaining the composition data of the reference image by the shot object information, and for example, a thermal image file and the like can be selected from a storage medium; in addition, the configuration data of the reference image, for example, the data of the default detection area, may also be specified according to the default configuration of the thermal image device 100; in addition, various modes of designation may be used, such as designating an area from an infrared thermal image displayed on the display unit and using the infrared thermal image of the area as a reference image.

The control unit 11 also includes a position setting unit 11G (not shown) for setting a position parameter (position, size, or rotation angle) of the reference image on the display unit. Preferably, the position setting part 11G is configured to set a position parameter of the reference image in the infrared thermal image; for example, according to a self-adaptive display area specified in the infrared thermal image, according to a position parameter of the calculated reference image in the self-adaptive area, which is maximally and centrally displayed, the position parameter of the reference image in the infrared thermal image is set; for example, the position parameter of the reference image in the infrared thermal image can be set according to the parameter attached to the reference image (for example, the position parameter in the infrared thermal image is embodied); alternatively, the position parameters of the reference image in the infrared thermal image may also be set according to the configuration (centered, original size) of the thermal image apparatus 100; alternatively, the position parameter may be input by the user.

The operation unit 12: the control unit 11 executes a program in response to an operation signal from the operation unit 12, in order for the user to perform various instruction operations or various operations such as inputting setting information. The operation unit 12 will be described with reference to fig. 2, and the keys for the user to operate include a record key 1, a focus key 2, a confirm key 3, a playback key 4, a menu key 5, a direction key 6, and the like; the related operation may be implemented by using the touch panel 7, a voice recognition unit (not shown), or the like.

The control flow of the detection mode of the thermal image device 100 is described with reference to fig. 8, and the change of the display interface during the photographing process is described with reference to fig. 6. In the application scenario, for example, the user holds the thermal imaging device 100 to shoot the object of the transformer substation. The control unit 11 controls the overall operation of the thermal image apparatus 100 and controls the execution of the processing in the plurality of modes based on the control program stored in the flash memory 3 and various data used for controlling each part. After the power is turned on, the control unit 11 initializes the internal circuit,

then, entering a standby shooting mode, namely shooting by the shooting part 1 to obtain a thermal image data frame, carrying out specified processing on the thermal image data frame obtained by the shooting part 1 by the image processing part 7, storing the thermal image data frame in the temporary storage part 2, continuously displaying the infrared thermal image on the display part 10 in a dynamic image form, and in the state, implementing control by the control part 11, continuously monitoring whether the processing is switched to other modes according to a preset operation or shutdown operation is carried out, and if yes, entering corresponding processing control. The control steps of the detection mode are as follows:

step A01, the display part displays dynamic infrared thermal images and reference images, and the temporary storage part 2 circularly stores thermal image data frames obtained by the shooting part 1;

based on the control of the control part 11, the display part 10 displays dynamic infrared thermal images and reference images, and the temporary storage part 2 stores thermal image data frames obtained by shooting by the shooting part 1 in a circulating manner.

Specifically, in order to ensure the shooting quality specifications, the display mode of the reference image is selected by a predetermined operation of the operation section 12, and the control section 11 displays the subject instruction information generated from the subject information on the display section 10 (not shown) based on the table 3 stored in the flash memory 3;

then, when the user selects "subject 1" displayed on the display section 10 through the operation section 12 according to the subject "subject 1" at the shooting site;

the reference image designating unit 11F determines the reference image T1 according to the user's selection, reads the configuration data of the reference image T1 from the flash memory 3, and transfers the configuration data to the temporary storage unit 2; and the position setting section 11G sets the position parameters (position and size) of the reference image T1 at the infrared thermal image. For example, the position parameters of the reference image T1 in the infrared thermal image are set according to the attached belt position parameters. In addition, the position parameter of the reference image T1 in the infrared thermal image may also be determined according to a specified adaptive display area, or a user-specified position parameter.

The image processing unit 7 performs predetermined processing such as pseudo-color conversion on the acquired thermal image data frame to obtain image data of an infrared thermal image, and the synthesizing unit synthesizes (overlaps) the determined configuration data with the image data of the generated infrared thermal image according to the set predetermined position by obtaining the image data of the reference image T1 according to the set predetermined size, and stores the synthesized image data in the temporary storage unit 2;

then, the display controller 9 displays the composite image on the display 10, as shown in fig. 6(a), where there is a difference in position and size between the subject thermal image and the contour image T1, and the user can take the subject thermal image according to the reference image.

The temporary storage unit 2 cyclically stores the thermal image data frames captured by the imaging unit 1.

In step a02, the user would be confused about the alignment operation for thermography of the object based on the contour image T1, and in order to ensure the photographing quality and simplify the operation, the detection instruction is selectively issued by the predetermined operation of the operating unit 12, and when the control unit 11 detects the detection instruction of the user (step a 02: yes), the detection process is performed.

The instruction for detection is not limited to being issued by the user, and the control unit 11 may perform control for detection by the detection unit 8 in response to a predetermined timing or a trigger signal from an external device connected to the thermal image device 100.

In step a03, the feature registration unit registers the object identification information. The feature registration unit determines the subject identification information for matching in accordance with the previous selection of "subject 1" by the user, and here, assumes the reference image T1 as the template image for calculating the degree of correlation. (further, the template data 301 may be read from the flash memory 3 as the object identification information for calculating the degree of correlation). This step may be completed before the a02 step, for example, after the object information is selected.

Next, in step a04, reading the thermal image data frame from the temporary storage 2;

step A05, a detection window setting unit sets a detection window. For example, based on the upper left corner of the prescribed detection region G1, a detection window is first set;

step a06, a process of calculating the correlation between the thermal image data in the detection window and the subject identification information is performed.

The detection unit 8 extracts thermal image data located in the detection window based on the detection window set by the detection window setting unit, and calculates the correlation between the two based on the profile image T1 registered by the feature registration unit. For example, the contour of a specific subject thermal image extracted from the thermal image data in the detection window is compared with the contour of the contour image T1, and the sum of the proportions of the overlapping areas between the two in the respective total areas is calculated, thereby obtaining the value of the degree of correlation.

Then, in step a07, the obtained correlation value is stored in the temporary storage unit 2.

In step a08, the detection section 8 determines whether or not the correlation has been calculated for all detection windows when the detection windows are set in the thermal image data frame. If there remain areas for which the correlation has not been calculated (no in step a 08), returning to step a05, the detection window setting unit shifts the position of the detection window by a predetermined number of pixels in a predetermined direction, sets the position as the next position of the detection window, and repeats the subsequent processing.

When a frame portion similar to the template is searched for from the frame of the thermal image data, the detection processing similar to the above-described detection processing is also performed when the detection window J1 is enlarged or reduced and tilted by a predetermined angle.

If the degrees of correlation have been calculated for all detection windows to be set in the thermal image data frame (yes in step a 08), the value of the maximum degree of correlation detected (or also the position parameters of the corresponding detection windows) is held in a prescribed area of the temporary storage 2 in step a 09; and obtaining the value of the correlation of the thermal image data frame.

In step a10, whether correlations have been calculated for all thermal image data frames. If not, the process returns to step A04, and the subsequent processes are repeated. If yes, in step A11, selecting the maximum correlation degree from the detected multiple thermal image data frames, and comparing the maximum correlation degree with the contrast value of the correlation degree;

in step a11, comparison is made with a contrast value of the correlation;

the contrast value of the correlation may be a contrast value of an initial correlation prepared in advance (for example, a determination value for determining whether or not matching between the specific subject thermal image and the subject identification information is detected is used as the contrast value of the initial correlation).

If the correlation value is less than the contrast value, the thermal image data frame with the correlation degree superior to the contrast value is not detected; entering step A13; if not, go back to step A01 to display dynamic infrared thermal image, or display the word "no specific object thermal image detected" in the display 10 to inform the user, as shown in FIG. 6 (a); then, the user repeats the subsequent processes when the detection instruction is issued again by changing the position of photographing and adjusting the photographing distance, the imaging position, and the angle between the optical components of the thermal image device 100 and the subject thermal image.

When the detected correlation value is greater than the judgment value, the process proceeds to step a12, and selects the specific information related to the thermal image data frame with the highest correlation (or a plurality of frames with high correlation), and the specific information is retained in the temporary storage 2 for subsequent processing. The held specific information may be held in the temporary storage unit 2 until the specific information that has not been newly selected by the selection unit 11B.

As shown in fig. 6(B), the correlation of the detected thermal image data frame of the maximum correlation is 80%, and the selector 11B holds specific information related to the thermal image data frame, such as the value of the correlation, the thermal image data frame in the temporary storage 2. Or, the notification is also performed by the notification part 11C, and the infrared thermal image 601 obtained by the thermal image data frame is displayed together with the dynamic infrared thermal image and the reference image.

The display of the infrared thermal image 601 is not limited, and other manners are also possible, as shown in fig. 6(b), the value of the correlation degree is converted into information indicating the matching degree, and the information is displayed; for example, the value of the correlation may be converted into a percentage (obtained by a predetermined comparison table of the value of the correlation and the percentage, or by conversion), or another method may be used, for example, the value of the correlation may be directly displayed, for example, a numerical value of the sum of the proportions of the overlapping areas in the respective areas may be directly displayed. Note that when the comparison value (the determination value representing whether the specific object thermal image matches the object identification information) for determining whether there is a specific object thermal image is not compared, the displayed information of the degree of correlation does not necessarily represent whether the specific object thermal image is detected. In addition, the displayed dynamic infrared thermal image can be switched to display the frozen image of the thermal image data frame; preferably, the detected region of the detection window having the largest correlation (or the position parameter of the object, etc.) may be notified. Such as an identification of the location of the object thermal image with the greatest correlation that is schematically detected in a frozen infrared thermal image, etc. Or switching the displayed dynamic infrared thermal image to a frozen image displaying the thermal image data frame, then responding to the indication of a user, and switching back to the display state of the dynamic infrared thermal image, or the state of the image obtained by the thermal image data frame and the dynamic infrared thermal image which are displayed together. In addition, the infrared thermal image obtained by the thermal image data frame can be not displayed, and prompt information can be displayed; or in a manner that is perceptible to the various users, such as by vibration, flashing of an indicator light, etc.

At this time, if the user presses the record key, the thermal image data frame corresponding to the infrared thermal image 601 is recorded to the memory card 8 by performing a predetermined process (e.g., compression, etc.). Even in a system in which the presentation information or the infrared thermal image is not displayed, for example, a system in which an indicator lamp blinks, since the thermal image data frame is held in the storage medium such as the temporary storage unit 2, it is also possible to perform processing such as display and recording when the user presses the enter key or the record key. In addition, the thermal image data frame can be directly recorded without the operation of a user. In addition, analysis, diagnosis and the like related to thermal image shooting can be carried out on the selected thermal image data frames.

Also, it may be detected from the temporary storage 2 that a plurality of degrees of correlation are greater than a prescribed contrast value, and when the selector 11B is configured to indicate that a multi-frame thermal image data frame is held, then infrared thermal images obtained from a plurality of held thermal image data frames may be displayed simultaneously, as shown in fig. 6(c), or also displayed in order of the degree of correlation. From which the user can select thermal image data frames or the like to be subjected to subsequent processing.

In addition, the comparison value of the correlation may not be prepared in advance, and in this case, for example, the selector 11B selects and holds the frame or frames of the thermal image data having the highest correlation in the temporary storage 2 based on the comparison result of the comparator 11A. Note that when no comparison is made with the contrast value as a judgment of whether or not it is consistent with the subject identification information, the selected thermal image data frame having the largest correlation degree does not necessarily represent whether or not there is a specific subject thermal image (matching).

And step A13, judging whether quitting, if not, returning to step A01, and repeating the subsequent processing. Also, after the next detection processing, the specific information selected by the selection section 11B may be configured to continue to be held, and the notification section 11C may display the specific information instructed to be held by the selection section in common when different detection processing is performed before and after. Alternatively, the specific information obtained later may be replaced with the previous specific information.

As described above, in the present embodiment, since the predetermined detection area is set, the user can easily understand the range of the imaging, and when receiving the detection instruction, the frame having the highest correlation among the frames of the thermal image data stored in the temporary storage unit 2 is detected, and the specific information can be held for the subsequent processing such as recording and analysis; the operation intensity of visual matching alignment can be reduced, common users can easily master the shooting skill, the operation is simple, the operation speed burden of a processor can be reduced, the cost of the thermal image device 100 is reduced, and the method is suitable for shooting the fast moving target.

Further, the configuration of the notification section 11C may be eliminated, such as performing processing of recording, analysis, and the like when a specific subject thermal image is detected.

Example 2

Embodiment 2 is different from embodiment 1 in that the thermal image device 100 (infrared sorting device 100) has a contrast value updating section 11D for updating the contrast value. Fig. 7 is a block diagram showing a schematic configuration of the thermal image device 100 as an example of the infrared sorting device 100 according to embodiment 2 of the present invention. The same components as those in example 1 are assigned the same reference numerals, and the description thereof is omitted.

When the contrast value is updated, the comparison unit 11A compares the predetermined information detected and obtained by the detection unit 8 and/or the evaluation value obtained based on the predetermined information obtained by the detection with the updated contrast value; because the contrast value may be continuously improved according to the adjustment of the user on the shooting, the user is more easily informed of the specific information of the thermal image data frame corresponding to the maximum correlation degree obtained in the multiple detection processes.

Wherein, the updating condition of the contrast value, such as the instruction of the user, is updated; for example, update according to a prescribed time; for example, the comparison value is updated based on the comparison result of the comparison unit 11A.

The comparison values used for updating may be updated sequentially from a plurality of comparison values prepared in advance; for example, three contrast values of the correlation are prepared, and when the correlation detected by the detection unit 8 is higher than the first contrast value, the second contrast value is updated in the subsequent stage, and when the correlation is higher than the second contrast value, the third contrast value is updated.

The comparison value for updating may be obtained based on predetermined information obtained by detection; for example, a value of the obtained correlation is detected by the detection unit 8, and when the value of the correlation is larger than a previously prepared contrast value of the correlation, the value of the obtained correlation is updated in place of the contrast value. The specified information at least comprises one or any combination of information of the position, the size, the inclination angle, the analysis value and the correlation value of the specific shot object thermal image.

The comparison value is updated based on the comparison result of the comparison section 11A, or may be updated from me based on the prescribed information obtained by detection, in which there is no previously prepared comparison value; for example, the detection unit 8 detects a value of the obtained correlation, and updates the value of the obtained correlation in accordance with the comparison value when the value of the correlation is larger than the comparison value of the correlation (for example, a value of the correlation detected before is the largest as the comparison value).

Preferably, the notification unit 11C is provided to notify the user based on the specific information and/or the information for updating the contrast value selected by the selection unit 11B in relation to the predetermined thermal image data frame.

In addition, in this embodiment, the selecting part 11B is configured to replace, after the updating of the contrast value, at least one of the specific information related to the previously selected thermal image data frames with the specific information related to the multiple thermal image data frames that is maintained before the updating of the contrast value according to the comparison result of the comparing part. However, the present invention is not limited to this, and specific information before and after the update may be held. The notification unit 11C notifies the selection unit 11B of specific information on the newly selected thermal image data frame.

The control flow of the detection mode of the thermal image device 100 is described with reference to fig. 9, and the change of the display interface during the photographing process is described with reference to fig. 10.

Step A01-step A02, which is similar to steps A01-A02 of example 1 and whose description is omitted;

step B03, similar to the steps a03-a10 of example 1, detects the correlation of the thermal image data frames of the obtained multiple frames, and omits description;

at step B04, comparison is made with the contrast value of the correlation; comparing the value of the maximum correlation degree with a comparison value;

if the correlation value is less than the contrast value, the correlation value is not detected to be superior to the previous contrast value or the maximum correlation value of the thermal image data frames obtained previously (as the updated contrast value); returning to the step A01, displaying the characters of the thermal image data frames with no better detection; it may also be configured to go to step B08, if not exiting then go back to A01. Then, the user repeats the subsequent processes when the user gives an instruction again by changing the photographing position and adjusting the photographing distance, the imaging position, and the angle between the optical components of the thermal image device 100 and the thermal image of the subject.

Preferably, a starting correlation contrast value may be set (for example, a contrast value for judging whether a specific subject thermal image exists is used as the starting correlation contrast value), and when the correlation value obtained by detection is greater than the judgment value and represents that the correlation of the detected specific subject thermal image is better than the prepared judgment value, the judgment value is replaced with the contrast value obtained by the currently detected correlation value; as a contrast value for subsequently detecting the correlation, so as to determine whether a specific object thermal image with higher correlation can be obtained subsequently. In this embodiment, it is assumed that the initial correlation contrast of the thermal image device 100 is 72%, where the initial correlation contrast is a determination value for determining whether to detect a thermal image of a specific object, and if the correlation of the obtained thermal image data frame is smaller than the comparison value, it represents that the specific object thermal image is not detected in the thermal image data frame; this has the effect of indicating whether or not an erroneous subject has been shot when the user cannot obtain the notification information even after shooting repeatedly.

In addition, the contrast value of the correlation may not be prepared in advance, and in this case, for example, when the correlation value of the first detected thermal image data frame is used as the contrast value of the correlation value obtained by subsequently detecting the thermal image data frame, and when the correlation value is detected later to be greater than the contrast value, the contrast value is replaced.

Here, whether or not the correlation is larger than the contrast value is taken as a criterion for evaluating the correlation, but the correlation may be smaller than the contrast value or close to the contrast value (a judgment value prepared in advance). The contrast value may be a value of the correlation, or may be a value obtained by converting the value of the correlation.

When the detected correlation is greater than the contrast value of the correlation at step B04, go to step B05; wherein, if the contrast value of the correlation is not previously stored, the correlation value obtained for the first time may be taken as the contrast value of the correlation.

In step B05, the contrast value updating section 11D updates the contrast value of the correlation according to the detected value having the maximum correlation, and the updated contrast value is used as the contrast value of the comparative correlation of the subsequent thermal image data frame.

In step B06, the selection unit 11B holds the specific information such as the thermal image data frame corresponding to the detected value having the greatest degree of correlation in the predetermined area of the temporary storage unit 2, and replaces the previous specific information (if any). In addition, specific information related to a predetermined number of plural thermal image data frames, for example, specific information such as a 3-frame thermal image data frame having the highest degree of correlation and a value of the degree of correlation thereof may be held. Then, in step B07, subsequent notification, analysis, recording, diagnosis, and the like processes may be performed. Further, not limited to the notification of the specific information selected by the selector 11B, an event for updating the contrast value or a notification of the updated contrast value may be further performed.

And step B08, judging whether to quit, if not, returning to the step A01, and repeating the subsequent processing. At this time, when the user issues an instruction to detect again, since the contrast value of the correlation is updated, when the thermal image data frame is subsequently read from the thermal image storage and detected, the contrast value of the correlation after the update is compared, and when it is larger than the contrast value of the correlation, the held specific information is updated, and at step B07, notification is made.

In embodiment 1, since comparison is made only with a prescribed comparison value (for example, a comparison value representing whether the subject thermal image matches the subject identification information or not) and the comparison value is not updated, in subsequent shooting, if a detection indication is issued, it is possible to obtain a thermal image data frame of poorer quality than before.

In embodiment 2, as the infrared thermal image 1001 shown in fig. 10(a) is detected first, since the contrast value of the correlation (assuming that the initial contrast value is 72%) is updated (updated to 85%), when the correlation of the thermal image data frame detected in the temporary storage unit 2 is lower than 85% after the detection indication is issued again, the word "better infrared thermal image is not captured" will not be selected, notified, or notified. Then, when the detection instruction is issued, when it is detected that the infrared thermal image 1002 (95%) shown in fig. 6(b) is captured, selection is performed, and further notification is performed; moreover, the selection unit 11B always selects the specific information related to the thermal image data frame with the maximum correlation degree to maintain, so that the user can safely adjust the thermal image device 100 to pursue the thermal image with the best shooting effect.

Note that in embodiments 1 and 2, whether or not the specific object thermal image is detected is not limited to the comparison between the value of the degree of correlation and the contrast value of the degree of correlation, and may be modified as a basis for whether or not the specific object thermal image is detected, for example, from the result of comparison between the predetermined information obtained by detection and/or the evaluation value obtained from the predetermined information and a predetermined contrast value.

As described above, in this embodiment, when a thermal image data frame with a correlation higher than the comparison value is detected, the thermal image data frame is selected or further notified, and when a comparison value higher than the previous correlation is detected in the subsequent process, the comparison value can be continuously updated, and specific information related to the selected subsequent thermal image data frame is maintained, or the original maintained specific information is also replaced; obviously, the subsequent processing such as notification and analysis is performed according to the specific information selected by the selection unit, so that the processing efficiency can be improved; the method can achieve the beneficial effects of greatly reducing the operation difficulty of visual matching alignment, greatly reducing the physical strength of shooting and improving the quality of the finally obtained thermal image data frame. The ordinary user can easily grasp such shooting skills. Of course, it is not necessary for any product that implements an embodiment of the invention to achieve all of the above-described advantages simultaneously.

In addition, in the field of infrared detection, different shooting qualities are achieved by considering the difference of the position, the size, the inclination angle and the like of a specific shot thermal image in the infrared thermal image, even if the correlation degree is high, if the parameters are not ideal, the quality of an obtained thermal image data frame is not necessarily high; therefore, it is preferable to consider factors such as the position, size, inclination angle, and correlation value of the specific object thermal image in the thermal image data frame, for example, to obtain an evaluation value (which may be one or more) based on the above factors, and to compare the evaluation value with a prescribed contrast value, as a factor for selecting and notifying the prescribed thermal image data frame, to prompt the user to pay attention to the quality of shooting, or to select a thermal image data frame with the best shooting quality for subsequent processing.

Example 3

The difference from the embodiments 1 and 2 is that the thermographic device 100 (the infrared selecting device 100) detects prescribed information related to the thermal image of the specific object in the multi-frame thermal image data frames stored in the temporary storage 2 according to a prescribed instruction based on the multi-frame thermal image data frames in the temporary storage 2; wherein, the prescribed information, for example, at least includes one or any combination of information of the position, size, inclination angle and correlation value of the specific object thermal image. The control unit 11 includes an auxiliary information acquisition unit (not shown) for acquiring auxiliary information; a comparing unit 11A for comparing one or more of the predetermined information detected by the detecting unit, the auxiliary information acquired by the auxiliary information acquiring unit, the evaluation value obtained by the predetermined information detected by the detecting unit 8, the evaluation value obtained by the auxiliary information acquired by the auxiliary information acquiring unit, the predetermined information detected by the detecting unit 8, and the evaluation value obtained by the auxiliary information acquired by the auxiliary information acquiring unit with corresponding one or more contrast values; the selection part 11B selects specific information related to a specified thermal image data frame based on the comparison result of the comparison part 11A, and when a plurality of comparisons exist, the selected specific information may be specific information related to one or more frames of thermal image data frames according to different comparison results; the notification unit 11C notifies the user based on the specific information about the predetermined thermal image data frame selected by the selection unit 11B. The contrast value update unit 11D updates the contrast value.

In the field of infrared detection, different shooting qualities are corresponding due to the fact that different positions, sizes, inclination angles and the like of thermal images of specific objects in the infrared thermal images are considered, even if the correlation degree is high, if the parameters are not ideal, the quality of the acquired thermal image data frames is not necessarily high; therefore, the position, the size, the inclination angle and other factors of the thermal image of the specific shot object in the thermal image data frame are taken into consideration as the factors for generating the notification to prompt the user to pay attention to the shooting quality or select the thermal image data frame with the best shooting quality for subsequent processing.

The auxiliary information, for example, at least includes one or any combination of the analysis value, the ambient temperature, the background factor, the wind speed, the humidity, and the distance, or other auxiliary information (including setting by the user) acquired by the thermal image device 100, and includes various other information about the specific thermal image data frame selected by the selecting portion 11B and/or factors having influence on the information notified by the notifying portion 11C.

In the application field of infrared detection, the quality and the importance degree of the obtained thermal image data frames are different according to the difference of the auxiliary information, and different conditions are required to deal with the processing of comparison, selection, notification and the like of the specified thermal image data frames; for example, when a specific object thermal image obtained has an analysis value greater than a predetermined contrast value (e.g., a threshold value of a defect), it is considered that the object has a defect, and the user should pay attention to the specific object, and in this case, it is preferable to select and notify specific information related to a thermal image data frame whose analysis value exceeds the predetermined threshold value even when the correlation is close, and the specific information will immediately attract the attention of the user, and is significant for infrared detection; for example, considering influence factors such as ambient temperature, background, wind speed, background factors (for example, differences between the background and the thermal image of the object, thermal field distribution of the background, etc.), etc., where the correlation degrees are close, the influence factors may cause reduction in quality of different thermal images and value of subsequent analysis, and a thermal image data frame with small interference of other influence factors should be selected and notified.

The auxiliary information acquiring unit may acquire the auxiliary information according to the thermal image device 100, a device connected to the thermal image device 100, or a component (not shown) with a corresponding function, for example, an analysis component acquires an analysis value (the analysis value may be a temperature value obtained by analysis, and is not limited to the temperature value, and may also be an AD value, a color value in a pseudo-color thermal image, a ratio of a specific pixel value, or a value obtained by further calculating these values according to a predetermined formula, and the like), the analysis value acquired by the analysis component may be for all pixels in a thermal image data frame or pixels in a specific analysis area, the ambient temperature is acquired by a temperature sensor, the humidity is acquired by a hygrometer, and the distance between the thermal image device 100 and the subject is acquired by a distance meter. The auxiliary information may be acquired from the auxiliary information stored in advance in the storage medium, for example, history data of the auxiliary information; or the auxiliary information obtained by combining the current measurement with the historical data of the auxiliary information stored in the storage medium in advance. The obtaining of various auxiliary information is a technique known to those skilled in the art.

Further, a comprehensive evaluation value can be obtained by the prescribed information and/or the auxiliary information; for example, it is possible to adopt a case where specific information among the detected predetermined information corresponds to a different coefficient, and the other predetermined information among the detected predetermined information is combined with the coefficient to obtain an evaluation value; for example, the evaluation value may be obtained by weighting with weights occupied by different pieces of information. The final evaluation value can be obtained by various calculation means.

For example, as shown in fig. 13, assuming that the infrared thermal image 1301 of fig. 13(c) is obtained from a detection window having a window coefficient of 0.94 and the infrared thermal image 1302 is obtained from a detection window having a window coefficient of 0.8, the evaluation value is the value of the degree of correlation × the window coefficient (the detection window may represent a rough position and size, for example), and therefore, even if the degree of correlation of the infrared thermal image 1301 is smaller than that of the infrared thermal image 1302, the evaluation value is rather high.

For example, a comprehensive evaluation value can be obtained by the prescribed information and the auxiliary information. For example, an evaluation value obtained by integrating values of the position, size, inclination angle, analysis value, and correlation of a specific subject thermal image is obtained, for example, an integrated evaluation value is obtained according to the following expression, where the integrated evaluation value is position × position weighting coefficient + size × size weighting coefficient + inclination angle × inclination angle weighting coefficient + analysis value × analysis value weighting coefficient + correlation × correlation weighting coefficient; alternatively, in another preferable mode, the evaluation value is obtained from a comparison table of the detected predetermined information and the acquired auxiliary information with the comprehensive evaluation value.

Further, some of the predetermined information and the auxiliary information may be used to obtain an evaluation value, and the predetermined information and/or the auxiliary information not involved in obtaining the evaluation value may be used as a target of comparison between the comparison unit and a predetermined contrast value together with the obtained evaluation value.

Wherein, the comparison value updating part 11D updates the comparison value according to the comparison result of the comparison part 11A; when a plurality of contrast values exist, at least one of the corresponding contrast values is updated; when all the contrast values of the plurality of items are updated, after the update, the comparing part 11A is configured to compare the predetermined information obtained by the subsequent detection by the detecting part 8, and/or the auxiliary information obtained by the auxiliary information obtaining part, and/or the evaluation value obtained from the predetermined information and/or the auxiliary information with the contrast values of the plurality of items; when part of the contrast values are updated, the updated contrast values are compared with the contrast values of the updated items and the contrast values of the non-updated items in the contrast values. Preferably, the comparison unit compares the obtained optimal predetermined information or optimal auxiliary information with each other, or compares the obtained optimal predetermined information or optimal auxiliary information with each other, and updates at least one of the corresponding comparison values based on one of the obtained optimal predetermined information or optimal auxiliary information or optimal evaluation values obtained based on the obtained predetermined information and/or auxiliary information.

When the detection unit 8 is configured to detect a plurality of pieces of predetermined information of a specific subject thermal image and the comparison unit 11A compares the predetermined information detected by the detection unit 8 and/or an evaluation value obtained based on the predetermined information obtained by the detection with predetermined contrast values, the selection unit 11B may select specific information related to a plurality of thermal image data frames based on the comparison result, and at this time, the notification unit 11C may notify one or more of the specific information. Preferably, the selecting unit selects and holds specific information on the thermal image data frame having a correlation value and/or the predetermined information and/or the auxiliary information and/or an evaluation value (an evaluation value obtained by the predetermined information and/or the auxiliary information) superior to a predetermined contrast value based on a comparison result of the comparing unit. The notifying part selects the specific information related to the thermal image data frame with the correlation value and/or the specified information and/or the auxiliary information and/or the evaluation value (the evaluation value obtained by the specified information and/or the auxiliary information) better than the specified contrast value to notify based on the specific information related to the specified thermal image data frame selected and held by the selecting part.

Referring to fig. 11 and 12, a control flow of the detection mode of the thermal image device 100 of embodiment 3 will be described, in this example, three contrast values are configured as an example. The predetermined information (correlation value) on the specific subject thermal image in the thermal image data frame detected by the detection unit 8, the evaluation value obtained based on the predetermined information obtained by the detection and the auxiliary information (analysis value) obtained by the auxiliary information acquisition unit, and the first, second, and third contrast values are compared.

The first contrast ratio is prepared in advance (in this embodiment, the first contrast ratio of the correlation) and is used to determine whether there is a contrast value of the specific subject thermal image (a determination value representing whether the specific subject thermal image matches the subject identification information), and the first contrast ratio is not updated.

The second contrast value (in this embodiment, the second contrast value of the correlation) is a contrast value of the correlation greater than the first contrast value, and is obtained according to the detected correlation value of the thermal image data frame, and when a subsequent thermal image data frame detects a higher correlation value, the second contrast value is updated to a higher value.

The third contrast value, which is obtained as a comprehensive evaluation value in terms of values of position, size, inclination angle, degree of correlation, analysis value, etc., is compared with a corresponding (e.g., previously prepared) third contrast value, and when a higher (more optimal) comprehensive evaluation value is detected in a subsequent thermal image data frame, the third contrast value is updated to a higher value accordingly.

Finally, the selecting part 11B will select specific information about the thermal image data frame that is better than the second contrast value and/or better than the third contrast value; and subsequent processing such as notification, analysis, diagnosis, recording and the like is facilitated.

Step C01-step C02, which is similar to steps A01-A02 of example 1 and whose description is omitted;

step C03, similar to the steps a03-a10 of example 1, detects the correlation of the thermal image data frames of the obtained multiple frames, and omits description;

and step C04, judging whether the correlation value of the detected thermal image data frame is greater than the first contrast value, if not, indicating that the specific shot object thermal image is not detected, returning to the step C01, and for example, displaying the character of the thermal image which is not detected to be matched. Repeating the subsequent processing; it may also be configured to go to step C32, and go back to C01 if not exited.

When the detected correlation is greater than the first contrast value at step C04, the process proceeds to step C05.

And step C05, the auxiliary information acquisition part acquires auxiliary information such as an analysis value related to the thermal image of the specific object and the like for the thermal image data frames with the correlation degree larger than the first contrast value and/or the thermal image data in the detection window of the thermal image data frames, and for example, controls an analysis component to analyze to acquire the analysis value. Further, for example, when the detection unit 8 is configured to calculate the correlation by detecting the pixel ratio or the like, it is not limited to determining the position parameter of the detected thermal image of the specific object based on the position parameter of the detection window, and in this case, it is also possible to further extract the outline of the specific object based on the detected detection window to obtain the specific information about the thermal image of the specific object such as a more accurate position, size, inclination angle, and the like.

A step C06 of obtaining an evaluation value obtained by integrating the values of the position, size, inclination angle, analysis value, and correlation of the thermal image of the specific object, for example, obtaining an integrated evaluation value according to the following formula, where the integrated evaluation value is position × position weighting coefficient + size × size weighting coefficient + inclination angle × inclination angle weighting coefficient + analysis value × analysis value weighting coefficient + correlation value × correlation weighting coefficient; alternatively, in another preferable mode, the evaluation value is obtained from a look-up table of the detected information and the comprehensive evaluation value.

Step C07, determine whether the frame of the detected thermal image data is the same frame for the maximum correlation and the maximum evaluation value?

If so (step C07: Yes), the flow proceeds to step C08, where the evaluation value is compared with the third contrast value.

If the second contrast value is smaller than the third contrast value (NO in step C08), comparing the detected correlation value with the second contrast value in step C09; if not, the process jumps to step C32, for example, representing a higher frame of thermal image data than the currently detected frame of thermal image data for which a correlation has been previously detected. If so, at step C10-C11, the contrast value update section 11D will update the second contrast value in accordance with the detected value of the maximum degree of correlation. The selection unit 11B holds the specific information on the thermal image data frame in a predetermined area of the temporary storage unit 2, replaces the previous specific information (if the specific information on the previous thermal image data frame exists, the correlation degree of the previous thermal image data frame is smaller than that of the currently detected thermal image data frame, and the evaluation value is not the maximum value in the held thermal image data frame, the replacement is performed), and in step C12, notifies the specific information on the thermal image data frame whose correlation degree is greater than the second contrast value.

If the comprehensive evaluation value is greater than the third contrast value (step C08: Yes), comparing the value of the degree of correlation with the second contrast value in step C13;

if the difference is larger than the second contrast value (step C13: Yes), the contrast value update unit 11D updates the second contrast value and the third contrast value according to the maximum correlation value detected by the thermal image data frame and the maximum comprehensive evaluation value at C14-C15. And, the selecting part 11B holds the specific information on the frame of thermal image data in the prescribed area of the temporary storage part 2, replaces the previous specific information (if any), and notifies the specific information on the frame of thermal image data having a correlation greater than the second contrast value and a comprehensive evaluation value greater than the third contrast value at step C16.

If the contrast ratio is smaller than the second contrast ratio (step C13: No), at C17-C18, the contrast ratio updating section 11D updates the third contrast ratio according to the detected integrated evaluation value of the thermal image data frame. And, the selection part 11B holds the detected specific information about the thermal image data frame corresponding to the maximum comprehensive evaluation value in a prescribed area of the temporary storage part 2, replaces the previous specific information (if there is the specific information about the previous thermal image data frame, and the evaluation value of the previous thermal image data frame is smaller than the currently detected thermal image data frame, and the correlation is not the maximum in the held thermal image data frame, the replacement is performed), and in step C19, notifies the specific information about the thermal image data frame whose comprehensive evaluation value is larger than the third correlation value.

If the step C07 (no) indicates that the thermal image data frame with the largest correlation and the thermal image data frame with the largest evaluation value are two different frames (or possibly multiple frames) in the detected thermal image data frames, the step C20 is performed, and the evaluation value of the thermal image data frame with the largest evaluation value is compared with a third comparison value, as shown in fig. 12.

If the correlation value is smaller than the third contrast value (step C20: No), comparing the correlation value of the thermal image data frame detected to obtain the maximum correlation with a second contrast value in step C21; if not, jumping to step B32, representing that the thermal image data frame with the correlation degree and the evaluation value higher than that of the currently detected thermal image data frame is detected before, and the display part does not display the thermal image data frame or displays the word sample of the thermal image data frame with better correlation degree and evaluation value. If so, at step C22-C23, the contrast value update section 11D will update the second contrast value in accordance with the detected value of the maximum degree of correlation. The selection unit 11B holds the specific information on the thermal image data frame in a predetermined area of the temporary storage unit 2, replaces the previous specific information (if the specific information on the previous thermal image data frame exists, the correlation degree of the previous thermal image data frame is smaller than that of the currently detected thermal image data frame, and the evaluation value is not the maximum value in the held thermal image data frame, the replacement is performed), and in step C24, notifies the specific information on the thermal image data frame whose correlation degree is greater than the second contrast value.

If the comprehensive evaluation value is greater than the third contrast value (step C20: Yes), comparing the value of the degree of correlation with the second contrast value in step C25; if the value is larger than the second contrast value (step C25: Yes), at C26-C27, the contrast value update section 11D updates the second contrast value and the third contrast value according to the maximum correlation value detected by the thermal image data frame and the maximum comprehensive evaluation value. Further, the selector 11B holds the specific information about the frame of thermal image data in the prescribed area of the temporary storage 2, replaces the previous specific information (if any), and notifies the frame of thermal image data having a correlation greater than the second contrast value and the specific information about the frame of thermal image data having a comprehensive evaluation value greater than the third contrast value (for example, two frames are displayed simultaneously) at step C28.

If the comparison value is smaller than the second comparison value (step C25: No), at C29-C30, the comparison value update section 11D updates the third comparison value according to the detected overall evaluation value of the thermal image data frame. And, the selection part 11B holds the detected specific information about the thermal image data frame corresponding to the maximum comprehensive evaluation value in a prescribed area of the temporary storage part 2, replaces the previous specific information (if there is the specific information about the previous thermal image data frame, and the evaluation value of the previous thermal image data frame is smaller than the currently detected thermal image data frame, and the correlation is not the maximum in the held thermal image data frame, the replacement is performed), and in step C31, notifies the specific information about the thermal image data frame whose comprehensive evaluation value is larger than the third correlation value.

Step C32, judging whether the detection mode exits, if exiting, ending, if not exiting, returning to step C01, obviously, if selecting specific information, displaying the notification information, infrared thermal image and reference image obtained by the selected specific information; the above-described process is repeated. In this way, when thermal image data frames obtained by continuous shooting are stored in the temporary storage part 2 in a circulating manner, specific information related to the thermal image data frames which are better than the second contrast value and/or better than the third contrast value is selected and notified according to the detected specified information in response to the detection indication; facilitating subsequent notification, analysis, diagnosis, recording, maintenance, and the like. Whether the correlation degree of the detected thermal image data frames is larger than the first contrast value is used as a condition for further detecting the specified information, so that the beneficial effects of shooting wrong parts and prompting effective specific information can be further avoided. The "better" referred to herein may be smaller or larger than the contrast value, depending on the contrast value.

A change of the display interface during shooting is explained with reference to fig. 13.

As shown in fig. 13(a), when no frame of thermal image data having a correlation greater than the first contrast value (assuming that the percentage of correlation converted from the first contrast value is 72%) is detected in response to the detection indication, a dynamic infrared thermal image is displayed.

In response to the first detection instruction, as shown in fig. 13(B), when a thermal image data frame whose correlation is greater than the first contrast value is detected for the first time, displaying notification information of the dynamic infrared thermal image, the reference image, and the detected thermal image data frame, the notification information being generated based on specific information of the thermal image data frame, such as the thermal image data frame, the value of the correlation, and the evaluation value, which is indicated to be stored by the selecting portion 11B; the notification information includes an infrared thermal image 1301 generated by the thermal image data frame, the correlation percentage converted from the correlation value is 85%, and the evaluation value percentage converted from the evaluation value is 80%. Then, contrast value update unit 11D updates the second contrast value to, for example, 85% and the third contrast value to, for example, 80%; moreover, when the thermal image data frame larger than the second contrast value and/or larger than the third contrast value is not detected subsequently, the display part 10 keeps displaying the notification information such as the thermal infrared image 1301 and the state of the dynamic thermal infrared image; in addition, since the infrared thermal image 1301 is notification information generated by specific information newly obtained at present, a thickened frame reminds a user.

In response to the second detection instruction, as shown in fig. 13(c), when a thermal image data frame greater than the second contrast value or the third contrast value is detected, displaying specific information about the dynamic infrared thermal image and the detected thermal image data frame, where the specific information includes an infrared thermal image 1302 generated by the thermal image data frame, and the like, where the correlation degree corresponding to the infrared thermal image 1302 is greater than that of the infrared thermal image 1301, and the evaluation value is smaller than that of the infrared thermal image 1301, so that the selecting part 11B maintains the specific information about the two thermal image data frames; the contrast value updating part 11D updates the second contrast value according to the correlation corresponding to the infrared thermal image 1302; the notification portion 11C generates notification information that causes the display portion 10 to display the specific information obtained by the two different thermal image data frames. At this time, since the specific information such as the thermal image data frames corresponding to the infrared thermal images 1301 and 1302 is maintained in the temporary storage 2, the user may select the corresponding thermal image data frames for subsequent recording or analysis from the information displayed by the display 10, such as the infrared thermal images 1301 and 1302.

In response to the third detection instruction, and as shown in fig. 13(d), when the first detected correlation is greater than the second contrast value and the evaluation value is greater than the third contrast value, the selecting part 11B holds the specific information about the infrared thermal image 1303, or deletes the specific information about the infrared thermal images 1301, 1302; moreover, the contrast value updating part 11D updates the second and third contrast values according to the correlation (95%) and the evaluation value (95%) corresponding to the thermal infrared image 1303; the notification portion 11C will cause the display portion 10 to display a dynamic infrared thermal image, specific information regarding the reference image and the detected thermal image data frame, including the infrared thermal image 1303 generated by the thermal image data frame, and the like.

In this way, the selection unit 11B selects and holds the specific information on the thermal image data frame whose correlation value and/or evaluation value is greater than the predetermined contrast value (second contrast value, third contrast value) based on the comparison result of the comparison unit; in the interface of the display part 10, the information obtained by notifying the thermal image data frame with the highest correlation and/or the highest evaluation value can be always displayed, and the shooting assistance to the user is great.

As described above, in the present embodiment, not only the effect of embodiment 1 can be obtained, but also the predetermined information and the auxiliary information according to the detected specific subject thermal image are set as the comparison factors, when a better thermal image data frame is detected, the selecting unit selects and holds the specific information related to the thermal image data frame, and the comparison value updating unit correspondingly updates the comparison value, so that the specific information related to a more ideal thermal image data frame can be selected; the method can further reduce the operation difficulty of visual alignment, improve the quality of thermal image data frames during shooting, and prompt the beneficial effect of a specific state, so that a common user can easily master the shooting skill, and can easily obtain high-quality thermal image data frames during random shooting. Of course, it is not necessary for any product that implements an embodiment of the invention to achieve all of the above-described advantages simultaneously.

Further, although three contrast values are exemplified, more contrast values may be used, and several different evaluation values and/or auxiliary information and/or predetermined information obtained by detection, such as evaluation values obtained from the position, size, and inclination angle of the specific object thermal image, evaluation values obtained from an analysis value, an ambient temperature, and the like, may be applied.

In addition, although a plurality of contrast values (three, or may be reduced to two) are exemplified in embodiment 2, part of them is updated and part is not updated; but may also be configured as a total update; alternatively, a plurality of corresponding contrast values may be prepared in advance without removing the configuration of the contrast value update unit 11D, and all of the contrast values are not updated.

In embodiment 3, a value according to the degree of correlation and an evaluation value are described as an example, and whether or not to select and hold specific information is determined based on comparison between a plurality of evaluation values and corresponding contrast values, based on a plurality of evaluation values obtained from predetermined information detected by the detection unit 8; or informing a plurality of thermal image data frames obtained according to different evaluation values; alternatively, the value of the degree of correlation and the plurality of evaluation values are also notified in order or priority. It is also preferable to notify the specific information about the predetermined thermal image data frame that is newly selected by the selection unit (generally, the correlation and/or the evaluation value is larger than the contrast value). Thus, the user is very convenient; for example, the values of the position, size, inclination and correlation degree of a thermal target object are used as evaluation factors, so that high-quality thermal image data frames or thermal image data frames required by specific shooting are conveniently obtained; and the thermal image analysis value and the correlation value are used as evaluation factors, so that the analysis condition of the shot object can be obtained in time conveniently. The user can easily grasp and understand the attention points such as the quality of the shot.

When a thermal image data frame with a correlation and/or an evaluation value greater than the previous correlation and/or evaluation value is detected, the selection unit 11B deletes specific information obtained from the previous thermal image data frame, but may keep the same, and at this time, the notification unit 11C may display specific information related to a plurality of thermal image data frames, for example, the specific information may be displayed in order according to the correlation and/or evaluation value.

The exemplary thermal image devices 100 are each described in the above embodiments, and are obviously applicable to various thermal image devices for portable shooting or online shooting; however, the present invention is not only applicable to thermal image devices with a shooting function, but also applicable to thermal image processing apparatuses that receive and process thermal images, such as thermal image processing apparatuses (e.g., computers, personal digital assistants, display apparatuses used in cooperation with thermal image devices with a shooting function, etc.) that continuously receive and process thermal images from the outside (e.g., acquiring thermal image data frames in time sequence), such as computers, that are wired or wirelessly connected to the thermal image devices through communication ports (examples of the acquiring portion, such as connecting the thermal image processing apparatus to the external apparatus according to communication specifications of USB, 1394, network, etc.), and that implement an embodiment by continuously receiving thermal image data frames output by the thermal image device connected thereto, and the processing manners of detection processing, comparison processing, selection processing, etc. are similar to those of the above-described embodiments, and descriptions thereof are omitted.

Furthermore, the present invention is not limited to photographing or acquiring a thermal image data frame from the outside, and may also be used as one component or functional module in a thermal image device or a thermal image processing device, for example, acquiring a thermal image data frame from another component.

Further, the thermal image storage unit is not limited to the embodiment of cyclically storing a plurality of frames of thermal image data captured by the capturing unit 1, and may be obtained at intervals or by other capturing methods (e.g., a user presses a record key many times to capture and store), or may be obtained and stored in a mixture of multiple methods.

Further, it is preferable to have a notification portion, but it is also possible to have no notification portion, such as by the user viewing selected specific information by operation;

in addition, a predetermined detection time or a predetermined number of frames may be set to notify the most suitable (e.g., highest correlation) frame. It is not limited to notifying only the optimal frame, and multiple frames may be notified.

Moreover, not only the entire region of the entire subject but also a plurality of detection windows that divide the subject into a plurality of parts can be detected, so that more accurate detection is possible; in each of the components, corresponding object identification information (which may be a template or a feature) is prepared in the same manner as in the whole. It is also possible to calculate a plurality of corresponding feature quantities in the corresponding detection windows according to a plurality of feature quantities of the template, and obtain the determination result according to the contrast values corresponding to the plurality of feature quantities, for example, obtain the final determination result according to the weighting of the plurality of feature quantities. And according to the plurality of characteristic quantities, firstly calculating a comparison result of one characteristic quantity and the infrared thermal image, when the comparison result is larger than a specified threshold value, calculating a comparison result of the next characteristic quantity and the infrared thermal image, and obtaining a final judgment result according to multiple comparisons.

In an embodiment, the detection area may be displayed as a reference image or portion; obviously, for example, when the reference image embodies morphological features, the detection area (such as the detection area obtained by enlarging a specified scale according to the outsourcing rectangle of the reference image) can also be set according to the position parameters of the reference image in the infrared thermal image; the speed of the detection process can be increased and the quality of the shot can be ensured.

Note that in the above-described embodiments, different combinations of the detection, selection, notification, number of contrast values, update of contrast values, acquisition of auxiliary information, and the like of the thermal image data frames may be performed, and these combinations are within the scope of the present invention.

Whether or not the specific subject thermal image is detected is not limited to the comparison between the value of the degree of correlation and the contrast value of the degree of correlation, and may be modified to determine whether or not the specific subject thermal image is detected, for example, based on one or more of the predetermined information obtained by the detection, the auxiliary information, the evaluation value obtained by the predetermined information, the evaluation value obtained by the auxiliary information, the evaluation value obtained by the predetermined information, and the evaluation value obtained by the auxiliary information, and the comparison between the predetermined information and the predetermined contrast value.

In the above-described embodiment, the contrast value updating section may update at least one of the corresponding contrast values based on one of the optimum predetermined information, the optimum auxiliary information, or the optimum evaluation value obtained based on the predetermined information and/or the auxiliary information obtained by the comparison by the comparing section. A selection unit which can select or maintain specific information related to the thermal image data frame, at least one of which is better than a predetermined contrast value, among the predetermined information and/or the auxiliary information and/or the evaluation value, based on the comparison result of the comparison unit; the selected condition, such as the prescribed information and/or auxiliary information and/or evaluation value obtained by detection, at least one of which is superior to the prescribed contrast value. The notifying section may notify the value of the degree of correlation and/or the prescribed information and/or the auxiliary information and/or the specific information about the thermal image data frame having the best or better evaluation value than a prescribed contrast value, based on the specific information about the prescribed thermal image data frame selected and held by the selecting section. These advantages may be in various cases, such as smaller than the comparison value, larger than the comparison value, within the range of the comparison value, beyond the range of the comparison value, or close to the comparison value; when there are a plurality of contrast values, there may be a case where one or all of them are greater than, less than, in the range of, or beyond, or close to the contrast value, etc.; the term "optimum" means that a value related to the detected predetermined information and/or auxiliary information and/or evaluation value may be the largest, the smallest, or the closest to the contrast value or a value in the contrast value range.

The selected thermal image data frame can be used for subsequent processing such as displaying, analyzing, diagnosing, sending and recording; such as obtaining analytical values, e.g. temperature values, proportional values of specific image values, or values obtained by further calculating these values according to a prescribed formula, etc., and such as comparing the analytical values with prescribed threshold values, such as obtaining diagnostic results, e.g. diagnostic conclusions (e.g. information about defects, normality, etc.), trigger signals, etc., the meaning of which processes are well known to those skilled in the art.

In the above examples, a certain step order is described, but various sequences are possible according to different embodiments, and the processing order described in the above examples is not limited. When the control unit 11, the image processing unit, and the like include a plurality of processors, there may be parallel processing in which some steps are applied.

The storage medium for storing the object identification information and the like may be a storage medium in the thermal image device 100, such as a nonvolatile storage medium like a flash memory 3 and a memory card 6, or a volatile storage medium like a temporary storage unit 2; other storage media wired or wirelessly connected to the thermal imaging device 100 may also be possible, such as storage media in other devices such as other storage devices, thermal imaging devices, computers, etc., or storage media of network destinations, through wired or wireless connection with the communication I/F4.

In the embodiment in which the subject identification information is associated with the subject information, various kinds of subject information can be prepared according to the application, which is preferable. For example, for the application in the power industry, it is preferable that the object information is identity information representing the object recognizable by the user, such as information representing the location, type, and phase of the object; but may be information representing the type of subject. Obviously, the object identification information is not limited to being necessarily associated with the object information.

Aspects of the present invention can also be realized by a computer of a system or apparatus (or devices such as a CPU, MPU, or the like) that performs the functions of the above-described embodiments, alone and executing a program recorded on a storage device, and a method known by a computer of a system or apparatus, the steps of which perform the functions of the above-described embodiments by, for example, reading out and executing a program recorded on a storage device. For this purpose, the program is provided to the computer or the thermal imaging device, for example, via a network or from a recording medium of various types serving as a storage device (e.g., a computer-readable medium).

The present invention provides a computer program, and a digital signal formed by the computer program is recorded in a recording medium readable by a computer or a thermal imaging device, such as a hard disk, a memory, or the like. After the program is operated, the following steps are executed:

a shooting step, which is used for continuously shooting and acquiring thermal image data frames; a thermal image storage step, which is used for storing continuously acquired multi-frame thermal image data frames; a display control step for controlling to display the dynamic infrared thermal image and the reference image obtained based on the acquired thermal image data frame; a detection step of detecting prescribed information related to the thermal image of the specific object based on the multiple frames of thermal image data stored in the thermal image storage step; a comparison step of comparing an evaluation value obtained based on the predetermined information obtained by the detection step and/or the predetermined information obtained by the detection with a predetermined contrast value; and a selection step of selecting specific information related to a prescribed thermal image data frame based on the comparison result of the comparison step.

Or the following steps can be executed, the acquiring step is used for continuously acquiring the thermal image data frames; a thermal image storage step, which is used for storing continuously acquired multi-frame thermal image data frames; a display control step for controlling to display the dynamic infrared thermal image and the reference image obtained based on the acquired thermal image data frame; a detection step for detecting prescribed information related to the thermal image of the specific object based on the multi-frame thermal image data frames stored in the thermal image storage step; a comparison step of comparing an evaluation value obtained based on the predetermined information obtained by the detection step and/or the predetermined information obtained by the detection with a predetermined contrast value; and a selection step of selecting specific information related to a prescribed thermal image data frame based on the comparison result of the comparison step.

Embodiments of the present invention also provide a readable storage medium storing a computer program for electronic data exchange, wherein the computer program causes a computer in a thermography arrangement to perform the steps of:

the method comprises a shooting step for continuously shooting to obtain thermal image data frames; a thermal image storage step, which is used for storing continuously acquired multi-frame thermal image data frames; a display control step for controlling to display the dynamic infrared thermal image and the reference image obtained based on the acquired thermal image data frame; a detection step for detecting prescribed information related to the thermal image of the specific object based on the multi-frame thermal image data frames stored in the thermal image storage step; a comparison step of comparing the plurality of thermal image data frames based on the prescribed information obtained by the detection step and/or an evaluation value obtained based on the prescribed information obtained by the detection step; and a selection step of selecting specific information related to a prescribed thermal image data frame based on the comparison result of the comparison step.

Or the following steps can be executed, the obtaining step is used for continuously obtaining thermal image data frames; a thermal image storage step, which is used for storing the multi-frame thermal image data frames continuously acquired in the acquisition step; a display control step of controlling to display a dynamic infrared thermal image and a reference image obtained based on the acquired thermal image data frame; a detection step for detecting prescribed information related to the thermal image of the specific object based on the multi-frame thermal image data frames stored in the thermal image storage step; a comparison step of comparing the plurality of thermal image data frames based on the prescribed information obtained by the detection step and/or an evaluation value obtained based on the prescribed information obtained by the detection step; and a selection step of selecting specific information related to a prescribed thermal image data frame based on the comparison result of the comparison step.

Although the functional blocks in the drawings may be implemented by hardware, software, or a combination thereof, there is generally no need for structures to implement the functional blocks in a one-to-one correspondence. Blocks of multiple functions may be implemented by one software or hardware module. Or a functional block may be implemented by a plurality of software or hardware units. In addition, the processing and control functions of some or all of the functional sections in the embodiments of the present invention may also be implemented by a dedicated circuit or a general-purpose processor or a programmable FPGA.

In addition, the subject application in the power industry is exemplified as a scene, and the method is also applicable to various industries of infrared detection. The above description is only a specific example (embodiment) of the invention, and various illustrations do not limit the essence of the invention, and various embodiments can be configured into more embodiments by performing corresponding substitution and combination. Other modifications and variations to the specific embodiments can be practiced by those skilled in the art upon reading the present specification without departing from the spirit and scope of the invention.

Claims

1. The infrared selecting device comprises a first infrared selecting device,

the shooting part is used for continuously shooting and acquiring thermal image data frames;

the thermal image storage part is used for storing continuously acquired multi-frame thermal image data frames;

a display control section for controlling to display the dynamic infrared thermal image and the reference image obtained based on the acquired thermal image data frame;

a detection unit that detects prescribed information relating to the thermal image of the specific object based on the plurality of frames of thermal image data stored in the thermal image storage unit;

a comparison unit for comparing an evaluation value obtained based on the predetermined information detected by the detection unit and/or the predetermined information obtained based on the detection with a predetermined contrast value;

a selection part which selects and maintains specific information related to a prescribed thermal image data frame when a prescribed selection condition is met based on a comparison result of the comparison part;

a notification unit configured to notify the selected and held specific information of the thermal image data; displaying a dynamic infrared thermal image obtained based on the captured thermal image data frame, and notification information reflecting the selected specific information;

the infrared selecting device is a portable thermal image shooting device.

2. The infrared selecting device comprises a light source,

the acquisition part is used for continuously acquiring thermal image data frames;

a detection part for detecting the specified information related to the specific object thermal image based on the multi-frame thermal image data frames stored in the thermal image storage part;

a comparison unit for comparing a predetermined contrast value with predetermined information obtained by the detection unit and/or an evaluation value obtained based on the predetermined information obtained by the detection unit;

a selection unit that selects specific information related to a predetermined thermal image data frame based on a comparison result of the comparison unit;

a notification unit that displays a dynamic infrared thermal image obtained based on the acquired thermal image data frame and notification information that embodies the selected specific information;

a predetermined processing unit configured to perform predetermined processing on the thermal image data frame selected by the selection unit based on an operation instruction of a user; the prescribed processing at least comprises one or more of recording, sending, analyzing, diagnosing and displaying.

3. The infrared selecting device comprises a light source,

a comparison unit for comparing the plurality of thermal image data frames based on the predetermined information detected by the detection unit and/or an evaluation value obtained based on the predetermined information detected by the detection unit;

a notification unit configured to notify the selected and held specific information of the thermal image data;

the second selection part is used for selecting the thermal image data frame selected by the selection part by a user; a specification processing unit that performs specification processing on the selected thermal image data frame;

the thermal image selection device is a portable thermal image shooting device.

4. The infrared selecting device comprises a first infrared selecting device,

the thermal image storage part is used for storing the multi-frame thermal image data frames continuously acquired by the acquisition part;

a predetermined processing unit configured to perform predetermined processing on the thermal image data frame selected by the selection unit based on an operation instruction of a user; the prescribed processing at least comprises one or more than one processing of recording, sending, analyzing, diagnosing and displaying.

5. The infrared sorting device according to any one of claims 1-4, characterized in that it has

An auxiliary information acquisition section for acquiring auxiliary information;

a comparison unit configured to compare the plurality of frames of the thermographic data or to a predetermined comparison value based on one or more of the predetermined information detected by the detection unit, the auxiliary information acquired by the auxiliary information acquisition unit, an evaluation value obtained from the predetermined information and the auxiliary information, an evaluation value obtained from the predetermined information, and an evaluation value obtained from the auxiliary information;

the specified information at least comprises one or any combination of information of the position, the size, the inclination angle and the correlation value of the specific shot object thermal image; the auxiliary information at least comprises information of one or any combination of analysis value, environment temperature, wind speed, background factor, humidity and distance.

6. The infrared picking apparatus as claimed in any one of claims 1 to 4, wherein the predetermined information includes at least one or any combination of the detected values of the position, size, inclination angle and correlation of the thermal image of the specific object.

7. The thermal image selection apparatus according to claims 1-4, characterized in that the selection section selects specific information relating to a prescribed thermal image data frame when a prescribed selection condition is met; the selection condition includes one of the following cases:

1) specifying information and/or auxiliary information and/or an evaluation value, at least one of which is better than a specified contrast value;

the advantages include at least one of the advantages being greater than a specified contrast value, less than a specified contrast value, within a range of contrast values, or beyond a range of contrast values;

2) the specification information and/or the auxiliary information and/or the evaluation value, at least one of which is optimal.

The specified thermal imagery data frame includes one or more of:

1) detecting an optimal thermal image data frame based on the acquired thermal image data frame;

the optimal thermal image data frame is an optimal thermal image data frame according to at least one item of specified information and/or auxiliary information and/or evaluation value;

2) detecting a thermal image data frame of a thermal image of a specific shot object;

3) thermal image data frames with at least one item superior to a specified contrast value according to specified information and/or auxiliary information and/or evaluation values;

4) thermal image data frames closest to the position, size and rotation angle of the reference image;

5) thermal image data frames selected from the preceding and following time sequences of the thermal image data frames of 1) -4) above;

6) when the thermal image data frames of 1) -4) are detected, the thermal image data frames obtained by shooting from the shooting part are shot;

the specific information is one or more of:

1) the method at least comprises the data obtained after specified thermal image data frames or specified thermal image data frames are subjected to specified processing;

2) prescribed information obtained based on the detection;

3) an evaluation value obtained based on the predetermined information obtained by the detection;

4) and prompt information generated based on the prescribed information and/or the evaluation value.

8. The infrared sorting apparatus according to any one of claims 1 to 4, wherein said selection section controls to hold or not hold the selected specific information.

And a selection unit configured to replace the held specific information with specific information selected by the selection unit in accordance with a predetermined condition.

9. The infrared sorting device according to any one of claims 1-4, characterized in that it has

A contrast value update unit for updating the contrast value; and when the contrast value is updated, the comparison part is used for comparing one or more of the specified information obtained by the subsequent detection of the detection part, the auxiliary information obtained by the subsequent acquisition of the auxiliary information acquisition part, the evaluation value obtained by the specified information, the evaluation value obtained by the auxiliary information, the evaluation value obtained by the specified information and the evaluation value obtained by the auxiliary information with the updated contrast value.

10. The infrared sorting device according to any one of claims 1-4, characterized in that it has

A subject information selection section for selecting subject information based on the subject information stored in the storage medium; the storage medium is used for storing the shot object information and the associated shot object identification information;

and a detection unit configured to perform detection processing based on the object identification information associated with the selected object information and the object identification information associated with the detection processing.

11. The infrared selecting method comprises the following steps of,

a shooting step, which is used for continuously shooting and acquiring thermal image data frames;

a thermal image storage step, which is used for storing continuously acquired multi-frame thermal image data frames;

a display control step of controlling to display a dynamic infrared thermal image and a reference image obtained based on the acquired thermal image data frame;

a detection step of detecting prescribed information related to the thermal image of the specific object based on the multi-frame thermal image data frames stored in the thermal image storage step;

a comparison step of comparing the predetermined information obtained by the detection step and/or an evaluation value obtained based on the predetermined information obtained by the detection with a predetermined contrast value;

a selection step of selecting and holding specific information related to a prescribed thermal image data frame when a prescribed selection condition is satisfied based on a comparison result of the comparison step;

a notification step of notifying the specific information of the selected and held thermal image data; displaying a dynamic infrared thermal image obtained based on the captured thermal image data frame, and notification information reflecting the selected specific information;

the infrared selection method is applied to a portable thermal image shooting device.

12. The infrared selecting method comprises the following steps of,

an acquisition step, which is used for continuously acquiring thermal image data frames;

a detection step for detecting prescribed information related to the thermal image of the specific object based on the multi-frame thermal image data frames stored in the thermal image storage step;

a selection step of selecting specific information related to a prescribed thermal image data frame based on a comparison result of the comparison step;

a notification step of displaying a dynamic infrared thermal image obtained based on the acquired thermal image data frame, and notification information reflecting the selected specific information;

a specified processing step, based on the operation instruction of the user, performing specified processing on the thermal image data frame selected in the selecting step; the prescribed processing at least comprises one or more of recording, sending, analyzing, diagnosing and displaying.

13. The infrared selecting method comprises the following steps of,

a shooting step, which is used for continuously shooting and obtaining thermal image data frames;

a thermal image storage step, which is used for storing a plurality of frames of continuously acquired thermal image data frames;

a display control step for controlling to display the dynamic infrared thermal image and the reference image obtained based on the acquired thermal image data frame;

a comparison step of comparing the plurality of thermal image data frames based on the prescribed information obtained by the detection step and/or an evaluation value obtained based on the prescribed information obtained by the detection step;

a notification step of notifying the specific information of the selected and held thermal image data;

a second selection step, which is used for selecting the thermal image data frame selected in the selection step by a user; a prescribed processing step, in which prescribed processing is carried out on the selected thermal image data frame;

the infrared selection method is applied to the portable thermal image shooting device.