CN116358711A

CN116358711A - Infrared matching updating device and infrared matching updating method

Info

Publication number: CN116358711A
Application number: CN202211002685.4A
Authority: CN
Inventors: 王浩
Original assignee: Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Current assignee: Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Priority date: 2012-12-27
Filing date: 2012-12-27
Publication date: 2023-06-30
Also published as: CN103900703A

Abstract

The invention discloses an infrared matching updating device and an infrared matching updating method, and relates to the application fields of thermal imaging devices, thermal image processing devices and infrared thermal imaging detection. The thermal imaging device in the prior art needs to rely on subjective experience of a user to shoot a thermal image of a shot object, has large workload and is difficult to ensure the quality of the thermal image; the invention provides an infrared matching updating device and an infrared matching updating method, which display a reference image together with an infrared thermal image, and can detect the specified information of a specific shot thermal image in a plurality of frames of thermal image data frames in a storage medium or consider the factors of auxiliary information when responding to a detection instruction, and update the specified comparison value according to the specified condition in the comparison with the specified comparison value so as to compare the optimal thermal image data frame from the thermal image data frames continuously acquired. To facilitate further processing or operations such as selecting, notifying, analyzing, storing, etc. Therefore, the shooting operation is simple, and the thermal image quality is high.

Description

Infrared matching updating device and infrared matching updating method

Technical Field

The invention discloses an infrared matching updating device and an infrared matching updating method, and relates to the application fields of various thermal image devices for handheld shooting or online shooting, thermal image processing equipment for receiving and processing thermal images and infrared detection.

Background

Since the application of the self-heating image detection technology, users are always confused about the cognition of the imaging form of the shot object and the control of the shooting distance under the correct shooting position and the shooting angle, and the cognition and the control depend on the subjective idea and experience of the users, so that the users need to take the shot while thinking if the quality of detection is to be ensured, the shooting speed is very slow, and the key shooting position or the shot object defect is easy to miss if the speed is accelerated, and the effect of state evaluation is influenced. Typically years of practice accumulate before a user can reach a higher level of detection.

One skilled in the art has been trying to solve this problem, and there is a technique of continuously overlapping and displaying a reference image representing a predetermined morphological feature of a subject with an infrared thermal image obtained by photographing, and performing photographing of the subject by using the reference image as a visual reference for photographing the subject thermal image, so as to ensure that the position, size and morphological feature of the subject thermal image in the infrared thermal image are correct, so as to ensure photographing quality. For example, patent document application No.: 201210008404.6 discloses such a thermal image capturing device.

However, the above-mentioned method requires the user to judge the matching degree of the reference image and the subject thermal image by visual manual work, and the user is liable to generate visual fatigue; when a hand-held thermal imaging device is used, the operation of aiming the shot is prone to fatigue, repeated aiming extends the shot time, and affects the quality of the shot thermal image. And, this way of operation is stiff, and the requirement for shooting alignment is high.

Therefore, it is understood that there is a need for an infrared matching update apparatus that can automatically compare thermal image data frames of good quality that meet prescribed conditions from among the acquired thermal image data frames without excessively relying on subjective ideas of the user; so as to facilitate the subsequent processing or operation of selection, notification, analysis, storage and the like, thereby having simple operation and high quality of the obtained thermal image data frame,

disclosure of Invention

The invention provides an infrared matching updating device and an infrared matching updating method, which display a reference image together with an infrared thermal image, and can detect specified information such as the position, the size, the inclination angle, the correlation value and the like of a specific shot thermal image in a plurality of frames of thermal image data frames in a storage medium when responding to a detection instruction, or consider factors of auxiliary information, and update the specified comparison value according to specified conditions in comparison with the specified comparison value, so that an optimal thermal image data frame can be compared from continuously acquired thermal image data frames. To facilitate further processing or operations such as selecting, notifying, analyzing, storing, etc. Therefore, the shooting operation is simple, the shooting speed is high, and the thermal image quality is high. The present invention is also applicable to detecting a satisfactory thermal image data frame from a large number of processed thermal image data frames (for example, acquired from a thermal image file).

Therefore, the invention adopts the following technical proposal that the infrared matching updating device is provided with,

an acquisition section for continuously acquiring thermal image data frames;

a reference image specification section for specifying constituent data of a reference image;

a position setting section for setting a position parameter of the reference image;

a display section for displaying the reference image and an infrared thermal image obtained by continuously obtaining thermal image data frames;

a thermal image storage unit for storing the multi-frame thermal image data frame acquired by the acquisition unit;

a detection section for detecting prescribed information about a specific subject thermal image in a thermal image data frame based on a plurality of frames of thermal image data frames stored in the thermal image storage section in response to a prescribed instruction;

a comparison unit for comparing the predetermined information detected and obtained by the detection unit and/or an evaluation value obtained based on the predetermined information detected and obtained by the detection unit with a predetermined comparison value;

a contrast value updating part for updating the contrast value;

wherein, after the comparison value is updated, the comparison part is used for responding the subsequent specified instruction to the detection part, detecting the obtained specified information and/or the evaluation value obtained based on the detected specified information, and comparing the obtained specified information and the updated comparison value.

The infrared matching updating method of the invention has,

an acquisition step for continuously acquiring thermal image data frames;

a reference image specifying step of specifying constituent data of a reference image;

a position setting step of setting a position parameter of a reference image;

a display step for displaying the reference image and the infrared thermal image obtained by the thermal image data frame obtained continuously;

a thermal image storage step for storing the multi-frame thermal image data frame acquired in the acquisition step;

a detection step of detecting prescribed information related to a specific subject thermal image in a thermal image data frame based on the multi-frame thermal image data frame stored in the thermal image storage step in response to a prescribed instruction;

a comparison step of comparing the predetermined information detected and obtained by the detection step and/or an evaluation value obtained based on the predetermined information detected and obtained by the detection with a predetermined comparison value;

a comparison value updating step, which is used for updating the comparison value;

wherein, after the comparison value is updated, the comparing step is used for responding to the subsequent specified instruction in the detecting step, detecting the obtained specified information and/or the evaluation value obtained based on the detected obtained specified information, and comparing the obtained specified information and the updated comparison value.

Additional aspects and advantages of the invention will be set forth in the description which follows.

Description of the drawings:

fig. 1 is a block diagram showing a schematic configuration of a thermal imaging apparatus 100 according to embodiment 1 of the present invention.

Fig. 2 is an exterior view of the thermal imaging device 100 of embodiment 1.

Fig. 3 is a schematic diagram of object information, object identification information, and the like stored in the storage medium of embodiment 1.

Fig. 4 is a schematic diagram of detection windows for different parameters.

Fig. 5 is a schematic diagram of setting a detection window in a detection area for detection.

Fig. 6 to 9 are display examples of the display interface of the control process of embodiment 1.

Fig. 10 is a control flow chart showing embodiment 1.

Fig. 11 to 12 are control flowcharts showing embodiment 2.

Fig. 13 is a display example of a display interface of the control process of embodiment 2.

Detailed Description

Exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. Note that the embodiments to be described below are for better understanding of the present invention, so that the scope of the present invention is not limited, and various forms within the scope of the present invention may be changed. Moreover, although the present invention is used in the following embodiments for a hand-held thermal image capturing apparatus, a capturing function is not essential to the present invention, and any thermal image data source to be subjected to specific object detection may be used. The present invention is therefore widely used for a thermal image processing apparatus that reads out and plays or displays recorded thermal images, or receives and processes thermal images from the outside. The thermal image processing apparatus includes various devices such as a personal computer, a personal digital assistant, and the like.

Example 1

The thermal image device 100 (infrared matching updating device 100) of embodiment 1 detects the correlation between the multi-frame thermal image data frame stored in the temporary storage section 2 and the subject identification information according to a predetermined instruction based on the multi-frame thermal image data frame (here, thermal image signal frame) obtained by the photographing section 1 and stored in the temporary storage section 2, and the thermal image device 100 notifies the user based on the obtained information on the thermal image data frame greater than the predetermined contrast value.

Fig. 1 is a block diagram showing a schematic configuration of a thermal imaging apparatus 100 which is an example of an infrared matching update apparatus 100 according to embodiment 1 of the present invention.

Specifically, the thermal imaging apparatus 100 includes an imaging unit 1, a temporary storage unit 2, a flash memory 3, a communication I/F4, a memory card I/F5, a memory card 6, an image processing unit 7, a detection unit 8, a display control unit 9, and a display unit 10, and the control unit 11, the operation unit 12, and the control unit 11 are connected to the corresponding parts via a control and data bus 13, and are responsible for overall control of the thermal imaging apparatus 100.

The imaging unit 1 is configured by an optical component, a lens driving component, an infrared detector, a signal preprocessing circuit, and the like, which are not shown. The optical component consists of an infrared optical lens for focusing the received infrared radiation to the infrared detector. The lens driving section drives the lens according to a control signal of the control section 11 to perform focusing or zooming operation. Furthermore, manually adjustable optical components are also possible. Infrared detectors, such as infrared focal plane detectors of the refrigerated or uncooled type, convert infrared radiation passing through the optical component into an electrical signal. The signal preprocessing circuit includes a sampling circuit, an AD conversion circuit, a timing trigger circuit, and the like, and performs signal processing such as sampling in a predetermined period on an electric signal output from the infrared detector, and converts the electric signal into a digital thermal image signal, which is, for example, 14-bit or 16-bit binary data (also referred to as an AD value), through the AD conversion circuit. In embodiment 1, the photographing section 1 is an example of an acquisition section.

The thermal image data may be a thermal image signal (AD value data obtained by AD conversion of an infrared detector output signal), image data of an infrared thermal image, array data of temperature values, or other data generated based on a thermal image signal. The thermographic data is hereinafter exemplified by a thermographic signal.

The temporary storage unit 2, for example, a volatile memory such as a RAM or a DRAM, is a buffer memory for temporarily storing the thermal image data frames outputted from the imaging unit 1, and for example, repeatedly stores the acquired thermal image data frames for a predetermined period of time, and when a new frame is acquired by the acquisition unit (imaging unit 1), deletes the old frame and stores the new thermal image data frame; at the same time, the image processing unit 7, the detecting unit 8, the control unit 11, and the like function as working memories, and temporarily store data to be processed. The present invention is not limited to this, and a memory, a register, or the like included in the processor such as the image processing unit 7, the detecting unit 8, and the control unit 11 may be interpreted as a temporary storage medium.

The temporary storage unit 2 is a cyclic storage area (thermal image storage unit) in which a specific area is allocated to temporarily store a plurality of thermal image data frames (for example, 50 frames), and cyclically stores a plurality of thermal image signal frames obtained by the photographing unit 1. Alternatively, a cyclic memory capable of temporarily storing thermal image data frames of a plurality of frames (for example, 50 frames) may be separately configured. However, the present invention is not limited to the temporary storage unit 2, and may be distributed as a thermal image storage unit in another storage medium.

The flash memory 3 stores a program for control and various data used for control of each part. In the present embodiment, as shown in fig. 3, data relating to reference images, detection, and the like is stored in the flash memory 3, for example, a database (fig. 3) storing object identification information, and the object information of each object, the composition data of the reference images, and the object identification information are associated with each other and stored in the feature database, or may be stored in a data file or the like of a specific format. The constituent data of the reference image includes, for example, vector graphics data and dot matrix image data, and also includes constituent data of the reference image composed of a plurality of coordinate point data. Wherein the template may be the same or different from the reference image. The subject information is information about the subject, for example, information representing the subject's place, type, number, etc., and various kinds of information such as a attribution unit, classification level (e.g., voltage level, importance level, etc.), model number, manufacturer, performance, characteristics, history of past photographing or inspection, date of manufacture, and lifetime of the subject may be mentioned.

The communication I/F4 is an interface for connecting the thermal imaging device 100 to an external device according to a communication standard such as USB, 1394, or a network, and data exchange is performed, and examples of the external device include a personal computer, a server, a PDA (personal digital assistant), other thermal imaging devices, a visible light imaging device, and a storage device.

The memory card I/F5 is connected to the memory card I/F5 as an interface of the memory card 6, and the memory card 6 as a rewritable nonvolatile memory is detachably mounted in a card slot of the main body of the thermal image device 100, and data such as thermal image data is recorded under control of a recording control unit (not shown) of the control unit 11.

The image processing unit 7 performs predetermined processing on the thermal image data frames obtained by the imaging unit 1, and selects and reads out frames for each predetermined time interval from thermal image data frames temporarily stored in the temporary storage unit 2 at each arrival of display timing, for example; the image processing unit 7 performs processing such as correction, interpolation, pseudo-color, synthesis, compression, decompression, and the like, and converts the processing into processing suitable for data for display, recording, and the like. The image processing unit 7 may be implemented by a DSP, other microprocessor, or a programmable FPGA, for example, or may be integrated with a processor corresponding to the detection unit 8 or the control unit 11.

The image processing unit 7 performs predetermined processing on the thermal image signal obtained by the imaging unit 1 to obtain image data of an infrared thermal image. Specifically, for example, the image processing unit 7 performs predetermined processing such as non-uniformity correction and interpolation on the thermal image signal obtained by the imaging unit 1, and performs pseudo-color processing on the thermal image signal after the predetermined processing to obtain image data of an infrared thermal image; one embodiment of the pseudo color processing determines a corresponding pseudo color table range according to a range of a thermal image signal (AD value) or a set range of AD values, and uses a specific color value corresponding to the thermal image signal in the pseudo color table range as image data corresponding to a pixel position in an infrared thermal image. The image data obtained after the pseudo color processing by the image processing section 7 is transferred to the temporary storage section 2 used as a buffer memory.

The reference image is displayed together with an infrared thermal image to assist a user in capturing an image of a specific subject. For example, an image that embodies morphological features of the specific subject; the reference image may also be other shapes, such as square, circular; for example, an identification image embodying a desired imaging position in the infrared thermal image of the subject thermal image; for example, an identification image representing a detection region in an infrared thermography (the detection region may contain one or more detection windows); for example, an identification image of an analysis region in which a desired subject thermal image is embodied. Preferably, the reference image is displayed in an overlapping manner with the infrared thermal image according to a specified position parameter (position, or further including size, or further including rotation angle); in addition, the reference image can also be displayed in the display part, and the area outside the infrared thermal image window; in addition, a thumbnail representing the relationship between the position and the size ratio of the reference image and the infrared thermal image may be displayed in an area of the display portion other than the infrared thermal image window.

In the embodiment, taking an example in which the reference image is displayed in the infrared thermal image, the image processing section 7 is provided with a synthesizing unit (not shown) that obtains the reference image based on the configuration data of the reference image specified by the reference image specifying section 11F and the position parameter set by the position setting section 11G, synthesizes the reference image with the infrared thermal image generated by the image processing section 7, and generates image data of the synthesized image. Specifically, the image synthesizing unit synthesizes the reference image and the infrared thermal image according to a prescribed transparency; including the case where the reference image has a transparency of 1 (e.g., the reference image is a line image of an edge contour), i.e., the opacity is combined with the infrared thermal image.

The image processing unit 7 performs predetermined processing on the acquired thermal image data frame based on the configuration data of the specified reference image and the positional parameter set by the positional setting unit 11G, and generates an infrared thermal image in which the reference image is represented.

In addition, the composition may be based on processing of performing pseudo-color processing on the thermal image data frame, for example, based on the pixel position of the reference image in the infrared thermal image, to generate image data for display in which the reference image and the infrared thermal image are present (an effect similar to overlapping); for example, according to the pixel position of the reference image in the infrared thermal image, the thermal image data of the pixel position is not subjected to pseudo-color processing, the thermal image data other than the pixel position of the reference image is subjected to pseudo-color processing, and then the image data of the reference image is combined to generate the image data for display.

Alternatively, pixels of the reference image corresponding to pixel positions in the thermal image data frame may be subjected to a process (e.g., a pseudo-color process to generate an image with the reference image embodied therein) different from the pseudo-color process of the thermal image data of other image number positions for generating the infrared thermal image.

The detection section 8 performs correlation calculation with the subject identification information based on the multi-frame thermal image data frame stored in the temporary storage section 2 (thermal image storage section); in this case, it is possible to perform detection processing on some or all of the thermal image data frames in the temporary storage unit 2, for example, to sequentially read all of the thermal image data frames, for example, to read only thermal image data frames at predetermined intervals; for example, when a thermal image data frame with the correlation degree and/or the evaluation value being larger than the comparison value is detected for the first time, the detection is not continued; for example, starting detection or stopping detection in response to a predetermined operation by a user; or the thermal image data frame or the thermal image data in the detection window is also subjected to shrinkage processing before being detected; this reduces the processing load associated with the detection.

The thermal image data may be image data of a thermal image signal (AD value), an infrared thermal image, array data of temperature values, or other data obtained based on the thermal image signal. For example, the detection unit 8 may perform detection processing of the correlation with the registered subject identification information by reading the thermal image signal frame obtained by photographing by the photographing unit 1 stored in the temporary storage unit 2 or by reading data obtained by performing prescribed processing on the thermal image signal frame obtained by photographing by the photographing unit 1 (for example, image data of an infrared thermal image obtained by pseudo-color processing) by the image processing unit stored in the temporary storage unit 2, based on control of the control unit 11. The present invention is not limited to the thermal image data frame obtained by the imaging unit 1, and the thermal image signal frame (or the image frame of the infrared thermal image) obtained by decoding the data input from the outside after being received from another thermal image device by the I/F4 may be obtained by a predetermined process. The thermal image signal frame (or the image frame of the infrared thermal image) may be obtained by reading the thermal image file from the recording medium, for example, from the memory card 5.

The detection unit 8 includes a feature registration unit, a detection window setting unit, and a detection unit (not shown).

And a feature registration unit configured to register object identification information related to the correlation calculation. For example, the object identification information may be registered according to object identification information stored in advance in the storage medium; for example, the object identification information for correlation calculation is registered in accordance with the object identification information associated with the object information selected by the user. The object identification information (for example, template data, or extracted feature amounts) may be specified by the user, and may be obtained by specifying an object region from the display image, for example. The registered subject identification information is stored, for example, in a predetermined position of the temporary storage section 2, or is distinguished from other stored subject identification information by a flag at the time of storage.

The so-called subject identification information may be template data for template matching; the object identification information may be a feature amount described by a parameter (feature such as a point, a line, or a plane), and the feature amount may be a value determined according to the state of a pixel included in the detection window, for example, a ratio of a predetermined portion of pixels in the specific detection window, an average value of pixel values, a center point, an area, or the like of the outline of the specific object. For example, for object 1 in fig. 3, the object identification information is template data 301, and for object 2 in fig. 3, the object identification information is feature quantity 302. In particular applications, combinations of one or more of these may be selected as appropriate.

And the detection window setting unit is used for setting the detection window. For example, according to a certain range of detection area (e.g., G1 in fig. 5), a plurality of detection windows (e.g., parameters of a detection window are predetermined according to quality requirements) may be set in the detection area G1, and a plurality of detection windows of different sizes may be set, or detection windows after further tilting may be set, as shown in fig. 4, where fig. 4 (a) is a standard detection window, fig. 4 (b) is a detection window according to a reduced size, fig. 4 (c) is a detection window set in an enlarged size, and fig. 4 (d) is a detection window set in a tilt according to a prescribed angle. In order to be equal to the size of the detection window, the template image is used here in a state of being reduced or enlarged or also inclined, or a template image having a size equal to the size of the window may be prepared and stored for use. In addition, the thermal image data in the detection window may be used in a state of being reduced or enlarged or also tilted so as to correspond to the template image. The detection window is not limited to a square, and may have other shapes, for example, may be determined according to the shape of the template.

The detection area can be set by a user according to shooting habits; or may be pre-stored as associated with subject information; the specific object thermal image may be generated based on the position where the specific object thermal image was last detected; the detection area may not be set, i.e., the range of the default thermal image data frame is the detection area. The plurality of detection windows may be set in a position and a size designated by a user. In addition, a plurality of detection windows need not be provided, and only one detection window may be provided.

It should be noted that for the application field of infrared detection, such as a transformer substation, a large number of devices with similar shapes but different names are filled, it is preferable to set a detection area in order to avoid misleading the user and misshooting. The mark of the detection area is displayed on the infrared thermal image in an overlapping way, so that a user can easily understand the approximate position, the size and the like of the photographed thermal image of the specific object, the photographing reference is facilitated, the speed of the detection processing can be increased, and the detection area can be not displayed.

And a detection unit that reads the thermal image data frame from the temporary storage unit 2, and obtains a value for evaluating the correlation from the object identification information based on the thermal image data in the detection window set by the detection window setting unit in the read thermal image data frame. When a plurality of detection windows are set, for example, a value of the maximum correlation obtained by detection therein may be taken as a value of the correlation of the thermal image data frame.

The detection processing by the detection unit 8 may be a detection method based on template matching, and the correlation between the thermal image data in the detection window and the template image may be calculated and compared; for example, the detection unit calculates the sum of differences between pixels at positions where the infrared thermal image in the detection window and the infrared thermal image as the template correspond to each other, the smaller the calculated sum of differences, the higher the correlation degree.

The method can also be configured to be an embodiment of extracting the characteristic quantity for matching, and the correlation degree is determined by utilizing the comparison between the template and the characteristic quantity of the thermal image data in the detection window. For example, the closer the proportion of a specific pixel of the object image in the detection window is extracted to the proportion of a specific pixel in the template image, the higher the correlation degree is.

The detection processing by the detection unit 8 may be performed by performing a predetermined operation based on the detection embodiment of the feature amount described by the parameter to obtain the feature amount of the thermal image data in the detection window, and comparing the feature amount with the reference value (object identification information) of the feature amount to obtain the value of the correlation. For example, the reference value of the feature quantity is a proportion of pixels of a specific pixel value, and the detection unit calculates the proportion of pixels of the specific pixel value in the thermal image data, and compares the proportion with the reference value of the feature quantity to obtain a value of the degree of correlation therebetween.

Preferably, the detection unit 8 calculates the correlation by using the contour image as a matching template, for example, by extracting thermal image data located in a detection window by the detection unit 8 and binarizing the thermal image data in the read detection window according to a predetermined threshold of the AD value; next, a connected image in which pixels having a predetermined pixel value (1 or 0) of the binary image are connected is extracted; then judging whether the connected image has the size of a preset range or not; if it is determined that the size of the connected image is within the predetermined range, a comparison process is further performed between the extracted connected image and the registered template, for example, a sum of proportions of overlapping areas therebetween in respective total areas is calculated, whereby a correlation between the extracted thermal image data and the template is obtained.

For the example of detection, as shown in fig. 5, the detection section 8 moves the window J1 from the upper left corner to the lower right corner of the prescribed detection region G1 of the thermal image data frame 501 to perform detection, cuts out the thermal image data in the window, and detects the correlation with the template image T1. Specifically, the window J1 is moved stepwise from the left end to the right by a window displacement (for example, one pixel) of a prescribed value, and after reaching the right end, is set back to the left end and moved down by the window displacement, and then is moved stepwise to the right again. In order to detect an object with high accuracy, a conversion range of a detected window size, window displacement, and an inclination angle of a window is predefined, for example, a window size ranges from 150×50 pixels to 120×40 pixels, a window displacement ranges from 10 pixels to 1 pixel, and an inclination angle of a window ranges from 0 ° to 10 ° based on a center point. The detection unit 8 successively changes the window size 5 pixels at a time, changes the window displacement 1 pixel at a time, and changes the window inclination angle 2 ° at a time. The detection unit 8 performs correlation calculation between the template image T1 and the thermal image data frame 501; after the detection of all the detection windows is completed, a value of the correlation obtained by the detection window having the highest correlation is selected as the value of the correlation corresponding to the thermal image data frame 501.

Note that various methods of calculating the correlation degree of the thermal image data frame may be used based on the subject identification information, and the above-described exemplary processing is only an example of a usable method.

The display control unit 9 displays the image data for display stored in the temporary storage unit 2 on the display unit 10. For example, in the photographing standby mode, an infrared thermal image generated from thermal image data obtained by photographing is continuously displayed; in the playback mode, an infrared thermal image read out and expanded from the memory card 6 is displayed, and in addition, various setting information can be displayed. Specifically, the display control unit 9 includes a VRAM, a VRAM control unit, a signal generation unit (not shown), and the like, and the signal generation unit periodically reads out image data from the VRAM (image data read out from the temporary storage unit 2 and stored in the VRAM) under the control of the control unit 11, generates a video signal output, and displays the video signal output on the display unit 10. In the thermal imaging device 100, the display unit 10 is, for example, a liquid crystal display device. The display unit 10 is not limited to this, and may be another display device connected to the thermal imaging device 100, and the thermal imaging device 100 itself may not have a display unit in its electrical structure, and the display control unit 9 may be an example of an output means for displaying an image of a notification result.

In embodiment 1, the display unit 10 displays notification information based on the control of the notification unit 11D; for example, warning is performed by text or image, such as information showing maximum correlation, an infrared thermal image obtained by displaying a thermal image data frame of maximum correlation, or notification is performed by a method accompanied by a change in transparency, color, size, line shape, thickness, blinking, brightness, frame, or the like of text or image.

The notification may be performed for a predetermined time. Further, the vibration means and the indicator lamp (not shown) in the thermal imaging apparatus 100 may be controlled, the analysis means (not shown), the diagnosis means (not shown), and when the thermal image data frame of the maximum correlation is detected, the indicator lamp may generate a light change, the vibration means may generate vibration, the analysis means may analyze and display the analysis result, and the diagnosis means may diagnose and display the diagnosis result; or simultaneously, in one or more of the above ways, as long as it is perceivable by the user.

The control unit 11 controls the overall operation of the thermal imaging device 100, and stores a program for control and various data used for control of each part in a storage medium such as the flash memory 3. The control unit 11 is implemented by, for example, CPU, MPU, SOC, a programmable FPGA, or the like. In the present embodiment, the control section 11, the display section 10, and the like are also configured as object selection means for selecting object information.

The control unit 11 further includes a comparison unit 11A for comparing predetermined information obtained by detection by the detection unit 8 and/or an evaluation value obtained based on the predetermined information obtained by detection, including at least information of one or any combination of values of a position, a size, an inclination angle, and a correlation of the specific subject thermal image, with a predetermined comparison value; in embodiment 1, the correlation value of the thermal image data frame obtained by the detection unit 8 is compared with the correlation comparison value. Note that the comparison value of the correlation may be a previously prepared determination value of the correlation (for example, a comparison value stored in fig. 3 corresponding to the subject identification information, for example, set by the user), and when it is larger than the comparison value, it is determined that the thermal image data frame has a specific subject thermal image; the correlation value obtained from the correlation value in the thermal image data frame may be obtained without preparing the correlation value in advance, for example, the correlation value obtained by the first detection process is used as the correlation value of the subsequent correlation, and when the correlation value is detected to be larger than the comparison value, the correlation value is updated.

The control unit 11 further includes a comparison value update unit 11B for updating the comparison value according to a predetermined condition; when the comparison value is updated, the comparison unit 11A compares the predetermined information detected by the detection unit 8 and/or the evaluation value obtained based on the predetermined information detected by the detection unit with the updated comparison value.

Update conditions for the comparison value, such as an indication by the user; for example, the comparison value is updated according to the comparison result of the comparison unit 11A; for example, the update is performed according to a predetermined time.

The comparison value may be updated according to the comparison result of the comparison unit 11A, or may be sequentially updated according to a plurality of comparison values prepared in advance; for example, three contrast values of the correlation degree are prepared, and when the correlation degree detected by the detecting section 8 is larger than the first contrast value, the second contrast value is updated later, and when it is larger than the second contrast value, the third contrast value is updated.

The comparison value may be updated based on the comparison result of the comparison unit 11A, or a comparison value prepared in advance may be updated based on predetermined information obtained by detection; for example, when the value of the correlation is detected to be larger than the previously prepared correlation value based on the detection section 8, the correlation value is replaced with the value of the correlation to be updated.

The comparison value may be updated according to the comparison result of the comparison unit 11A, or may be updated by itself according to the predetermined information obtained by the detection, wherein the comparison value is not prepared in advance; for example, when the value of the correlation is detected to be larger than the comparison value of the correlation (for example, the value of the correlation detected to be the largest before is used as the comparison value) based on the detection of the detection section 8, the obtained value of the correlation is updated in place of the comparison value.

The control unit 11 further includes a selection unit 11C (not shown) that selects specific information related to a predetermined thermal image data frame based on the comparison result of the comparison unit 11A. The specific information selected may be used for prescribed processing to be experienced, such as analysis, recording, notification, and the like.

Wherein the specific information related to the specified thermal image data frame is the specific information related to one or more thermal image data frames in the multi-frame thermal image data frames of the temporary storage part 2; for example, based on the comparison result of the comparing section 11A, specific information on the thermal image data frame having the greatest correlation is selected; however, the present invention is not limited to the frame of thermal image data having the maximum detected correlation, and for example, a frame that is suboptimal or that is before or after the timing of the frame having the maximum detected correlation, or that is obtained by a multi-frame operation, or that is the earliest to detect specific information on the thermal image data frame corresponding to the correlation larger than the predetermined contrast value may be selected. The method may also be configured to select specific information related to a plurality of thermal image data frames, for example, specific information related to three thermal image data frames with first, second and third correlation degrees, and may also select specific information of thermal image data frames with the same multi-frame correlation degree.

The specific information is a thermal image data frame selected from the multi-frame thermal image data frames of the temporary storage unit 2, data obtained by performing a predetermined process on the thermal image data frame selected from the multi-frame thermal image data frames, predetermined information obtained by detection is detected, an evaluation value obtained based on the predetermined information obtained by detection is detected, and one or more of the pieces of presentation information generated based on the predetermined information obtained by detection and/or the evaluation value is generated.

The thermal image data frame selected from the multi-frame thermal image data frames is subjected to a prescribed process, for example, the thermal image data frame selected is subjected to a prescribed process, for example, a specific subject thermal image extracted from the thermal image data frame, for example, image data of a generated infrared thermal image, for example, the thermal image data frame is converted into an analysis value such as an array of temperature values, or the like.

Wherein, the obtained specified information is detected, and for example, the specified information at least comprises one or any combination of the position, the size, the inclination angle, the thermal image analysis value and the correlation value of the thermal image of the specific object.

Wherein, the evaluation value obtained based on the detected and obtained prescribed information is obtained by weighting the detected and obtained prescribed information according to a weighting coefficient, and comparing the prescribed information with the evaluation value, etc., to obtain the evaluation value for evaluating the thermal image quality, etc.

Wherein the prompt information generated based on the detected and obtained prescribed information and/or the evaluation value is, for example, a prompt for converting the detected and obtained prescribed information and/or the evaluation value into percentage information which is convenient for the user to understand.

The selection unit 11C performs control to hold or not hold the selected specific information; the specific information held may be held in a predetermined area of the temporary storage unit 2, or may be held (stored) in a storage medium such as the flash memory 3. Hereinafter, the selection unit 11C will be exemplified by holding specific information such as a thermal image data frame in a predetermined area of the temporary storage unit 2.

The selection unit 11C may hold the selected specific information at all times or may hold the selected specific information under a predetermined condition, for example, the currently selected specific information may be held for a predetermined time; for example, the current specific information is always kept until a thermal image data frame with larger correlation degree is detected; for example, the selected specific information is always held until the subject identification information for detecting the comparison is changed; for example, specific information is held according to an instruction of a user (for example, the user selects a specific information displayed on the display unit to determine holding). In addition, it may not be maintained, for example, transmitted to other external devices through communication I/F4; for example, undergo other processing such as deletion upon notification, etc.

The selection unit 11C updates the specific information held in the temporary storage unit 2 to the specific information selected by the selection unit 11C later, according to a predetermined condition. For example, a predetermined condition is that a predetermined number of thermal image data frames are detected for a predetermined time, and a user instruction is given, for example, based on the comparison result of the comparing unit 11A (when a correlation greater than that of the thermal image data frames held is obtained). In addition, the specific information which is kept before can be kept.

In embodiment 1, the selection unit 11C performs control of selecting, holding, and updating specific information based on the comparison result of the comparison unit 11A. If the correlation value of the specific subject thermal image detected by the detection unit 8 is greater than the correlation value, the correlation value and the specific information such as the corresponding thermal image data frame are selected and held in the storage medium such as the temporary storage unit 2; when the previous specific information such as the correlation value and the corresponding thermal image data frame exists, the previous specific information is replaced; until a thermal image data frame with higher correlation is located later, the thermal image data frame can be replaced (a specified number of thermal image data frames with higher correlation can also be kept). In this way, specific information such as a corresponding thermal image data frame and the like is held as the value of the maximum correlation. In addition, the specific information which is kept before can be kept.

The control unit 11 further includes a notification unit 11D (not shown) that notifies the user based on the specific information on the predetermined thermal image data frame selected by the selection unit 11C. The notification unit 11D preferably displays notification information obtained by the currently selected specific information together with the infrared thermal image obtained by the thermal image data frames continuously acquired by the acquisition unit. For example, the infrared thermal image obtained by the thermal image data frame currently selected and held is displayed together with the continuous infrared thermal image obtained by the imaging unit 1, and other notification information such as a correlation value, an evaluation value, and the like may be displayed simultaneously or individually. In addition, the dynamic infrared thermal image may be switched to a frozen image displaying the thermal image data frame.

When the selecting unit 11C selects and holds specific information on a plurality of thermal image data frames, the notifying unit 11D may notify one or more of the plurality of thermal image data frames, for example, to display the infrared thermal images obtained by the plurality of thermal image data frames together with the continuous infrared thermal images obtained by the photographing unit 1.

The notification information is obtained based on the specific information on the predetermined thermal image data frame selected by the selecting unit 11C, and for example, the value of the correlation degree can be converted into information indicating the degree of similarity for easy understanding by the user and displayed; for example, the correlation value is converted into a percentage value according to a prescribed comparison table of the correlation value and the percentage, or by a calculation method (such as the sum of the ratios of the extracted overlapping areas of the specific object profile and the profile T1 in the respective total areas, divided by 200%, namely, the percentage value of the correlation value is converted); other means are possible, such as directly displaying the value of the calculated correlation, such as directly displaying the value of the sum of the pixel values, etc. Note that when not compared with a prescribed contrast value representing whether or not a specific subject thermal image is detected (a judgment value representing whether or not the specific subject thermal image matches the subject identification information), the displayed information of the degree of correlation does not necessarily represent whether or not the specific subject thermal image is detected (matched). For convenience of explanation, hereinafter, the values of the correlation degree, the evaluation value, and the percentage value converted from the comparison value are taken as examples, but the conversion into the percentage value is not necessarily required in practice.

The notification may be performed for a predetermined time. Based on the control of the notification unit 11D, the display unit 10 may be caused to generate a change in one or more of a display content, a vibration of a vibration member in the thermal imaging device 100, a change in light of an indicator, a sound of a sound member, an analysis process of an analysis member (and the display unit 10 may be caused to display an analysis result), a diagnosis by a diagnosis member (and the display unit 10 may be caused to display a diagnosis result), a pseudo-color change of an infrared thermal image, and the like; as long as it is perceivable by the user.

The control unit 11 includes a recording unit 11E (not shown) for recording the thermal image data frame selected and held in the temporary storage unit 2 by the selection unit 11C in response to a predetermined recording instruction to the memory card 8. For example, the thermal image data frame is recorded in the memory card 8 in response to an instruction such as a user selection of the thermal image data frame to be notified, for example, an instruction such as automatic recording of a timing.

The control unit 11 further includes a reference image specification unit 11F (not shown) for specifying configuration data of a reference image to be displayed together with the infrared thermal image; for example, based on the composition data (dot matrix data or vector data) of the reference image associated with the subject information stored in the storage medium, the composition data of the reference image associated with the subject information is specified in accordance with the user's selection of the subject information; the present invention is not limited to the configuration data of obtaining the reference image by the subject information, and for example, a thermal image file or the like may be selected from the storage medium; in addition, the configuration data of the reference image, for example, the data of the default detection area may be specified according to the default configuration of the thermal imaging apparatus 100; for example, the region may be specified from the infrared thermal image displayed on the display unit, and the infrared thermal image of the region may be used as various specified modes such as a reference image.

The control unit 11 further includes a position setting unit 11G (not shown) for setting a position parameter (position, size, or rotation angle) of the reference image on the display unit. Preferably, the position setting part 11G is configured to set a position parameter of the reference image in the infrared thermal image; for example, according to an adaptive display area specified in the infrared thermal image, setting a position parameter of the reference image in the infrared thermal image according to the calculated position parameter of the reference image in the adaptive area that maximizes the centered display; for example, the position parameter of the reference image in the infrared thermal image may be set according to the parameter attached to the reference image (for example, the position parameter in the infrared thermal image is reflected); alternatively, the position parameter of the reference image in the infrared thermal image may be set according to the configuration (centered, original size) of the thermal image apparatus 100; alternatively, the position parameter may be input by the user.

An operation unit 12: for the user to perform various instruction operations or to input various operations such as setting information, the control unit 11 executes a corresponding program in accordance with an operation signal of the operation unit 12. The operation unit 12 is described with reference to fig. 2, and the keys provided for the user to operate are a record key 1, a focus key 2, a confirm key 3, a playback key 4, a menu key 5, a direction key 6, and the like; further, the touch panel 7, a voice recognition unit (not shown), or the like may be used to realize the relevant operation.

A control flow of the detection mode of the thermal imaging apparatus 100 will be described with reference to fig. 10, and changes in the display interface during photographing will be described with reference to fig. 6 to 9. The application scenario is that a user holds the thermal imaging device 100 to shoot an object of a transformer substation. The control unit 11 controls the overall operation of the thermal imaging device 100 and controls the execution of the multi-mode processing based on the control program stored in the flash memory 3 and various data used for the control of each part. After the power is turned on, the control unit 11 initializes the internal circuit,

then, the standby shooting mode is entered, that is, the shooting unit 1 shoots and obtains a thermal image signal, the image processing unit 7 performs a predetermined process on the thermal image signal obtained by the shooting unit 1, stores the thermal image signal in the temporary storage unit 2, and continuously displays an infrared thermal image as a moving image on the display unit 10, and in this state, the control unit 11 performs control thereof to continuously monitor whether or not a process of switching to another mode according to a predetermined operation is performed or a shutdown operation is performed, and if so, the corresponding process control is entered. The control steps of the detection mode are as follows:

step A01, a temporary storage part 2 circularly stores a thermal image data frame obtained by shooting and displays an infrared thermal image and a reference image;

In the standby shooting state, the display unit 10 displays a dynamic infrared thermal image, and based on the control of the control unit 11, the thermal image signal frame obtained by the shooting unit 1 is stored in the temporary storage unit 2 in a circulating manner.

In the past, a user would be confused about the morphological characteristics of a specific subject thermal image IR1 and the imaging position, size and angle in the infrared thermal image where the specific subject thermal image IR1 is located, in order to ensure the shooting quality specification, a detection mode is selected by a predetermined operation of an operation part 12, a control part 11 displays subject indication information generated by subject information on the basis of storage in a flash memory 3 on a display part 10, when the user selects a subject 1 displayed on the display part 10 according to a subject 1 at a shooting site by the operation part 12, a reference image specification part 11F determines a reference image T1 according to the selection of the user, and constituent data of the reference image T1 is read from the flash memory 3 and transferred to a temporary storage part 2; and the position setting section 11G sets the position parameters (position and size) of the reference image T1 in the infrared thermal image. For example, the positional parameter of the reference image T1 in the infrared thermal image is set according to the attached positional parameter. In addition, the position parameter of the reference image T1 in the infrared thermal image may be determined according to a predetermined adaptive display area or a user-specified position parameter. Transmitting the thermal image data frame obtained by shooting by the shooting part 1 to the temporary storage part 2; the image processing section 7 performs predetermined processing such as pseudo color conversion on the acquired thermal image data frame to obtain image data of the infrared thermal image, and the synthesizing means obtains image data of the reference image T1 from the determined constituent data according to the set predetermined size, synthesizes (overlaps) the image data of the generated infrared thermal image according to the set predetermined position, and then displays the synthesized image on the display section 10, and as shown in fig. 6, the difference in position and size between the subject thermal image IR1 and the contour image T1 exists, and the user can photograph the subject thermal image IR1 from the reference image.

In step A02, the user is confused about the trouble of alignment based on the reference image, and in order to save the operation, the detection instruction is given by the predetermined operation selection of the operation unit 12, and when the control unit 11 detects the detection mode of the user (step A02: yes), the detection process is entered.

The instruction for detection is not limited to the user, and the control unit 11 may respond to a trigger signal from an external device connected to the thermal imaging device 100 or perform control for detection by the detection unit 8 at a predetermined timing.

In step a03, the feature registration unit registers object identification information. The feature registration unit determines subject identification information for matching in accordance with the selection "subject 1" by the user, and here, presumes the reference image T1 as a template image for calculating the correlation. (in addition, the template data 301 may be read from the flash memory 3 as subject identification information for calculating the correlation). This step can also be done in a 01.

Next, in step a04, a thermal image data frame is read from the temporary storage section 2;

step A05, a detection window setting unit sets a detection window. For example, based on the upper left corner of the prescribed detection area G1, a detection window is first set;

Step a06, a process of calculating a correlation between the thermal image data in the detection window and the subject identification information is performed.

The detection section 8 extracts thermal image data located in the detection window based on the detection window set by the detection window setting unit, and calculates the degree of correlation between the two from the template data 301 (obtained profile image T1) registered by the feature registration unit. For example, the sum of the proportions of the overlapping areas between the two in the respective total areas is calculated from the contour of the specific subject thermal image extracted from the thermal image data in the detection window, compared with the contour of the contour image T1.

Then, in step a07, the obtained correlation value is stored in the temporary storage unit 2.

In step a08, the detection section 8 determines whether or not the correlation has been calculated for all detection windows when the detection windows are set in the thermal image data frame. If there remains an area where the correlation has not been calculated (no in step a 08), then the detection window setting unit shifts the position of the detection window by a predetermined number of pixels in a predetermined direction, sets the position as the next position of the detection window, and repeats the subsequent processing.

In addition, when a frame portion similar to the template is searched for from the thermal image data frame, detection processing similar to the above description is performed also for the detection window after enlarging and reducing and tilting the detection window J1 by a predetermined angle.

If the correlation has been calculated for all the detection windows to be set in the thermal image data frame (yes in step a 08), the value of the detected maximum correlation (or also the position parameter of the corresponding detection window) is held in step a09 in a prescribed area of the temporary storage section 2.

In step a10, whether the correlation has been calculated for all thermal image data frames. If not, returning to the step A04, and repeating the subsequent processing. If yes, in step a11, selecting the largest correlation degree from the detected thermal image data frames of multiple frames, and comparing the correlation degree with a comparison value of the correlation degree;

in step a11, comparing with a correlation comparison value;

comparing the maximum correlation detected in the thermal image data frames of the multiple frames with a comparison value; if the correlation value is smaller than the comparison value, the correlation value is not detected to be better than the previous comparison value or the maximum correlation value of the thermal image data frame obtained before (used as the updated comparison value); returning to step A01, displaying the typeface of the thermal image data frame where no better thermal image data frame is detected; or as a dynamic infrared thermography, as shown in fig. 6; then, the user repeats the subsequent processing by changing the shooting position and adjusting the shooting distance, imaging position, angle between the optical component of the thermal image apparatus 100 and the subject thermal image, when the user issues an instruction again. When the correlation degree detected in the step A11 is larger than the contrast value of the correlation degree, the step A12 is entered;

The correlation comparison value may be a previously prepared initial correlation comparison value (for example, a judgment value that judges whether or not a specific subject thermal image is detected to match the subject identification information, as a comparison value of the initial correlation), and when the value of the correlation obtained by the detection is larger than the judgment value, which represents that the correlation of the detected specific subject thermal image is better than the prepared judgment value, the judgment value is replaced with the comparison value obtained by the value of the correlation currently detected; as a comparison value of the subsequent detection correlation, so as to obtain a specific subject thermal image with higher correlation later. In this embodiment, the initial correlation value of the thermal image device 100 is 72%, where the initial correlation value is a determination value for determining whether a specific object thermal image is detected, and if the correlation value of the obtained thermal image data frame is smaller than the correlation value, it indicates that the specific object thermal image is not detected in the thermal image data frame; this has the effect that when the user cannot obtain notification information even if photographing is repeated, it means whether or not an erroneous subject is photographed. Therefore, in fig. 6, since the detected correlation value is less than 72%, no information for notification is displayed. In contrast, as shown in fig. 7, if the correlation of the thermal image data frame with the maximum correlation detected is 80%, the notification is performed later.

In addition, the correlation value may not be prepared in advance, and in this case, for example, when the correlation value of the thermal image data frame detected for the first time is used as the correlation value of the correlation value obtained by detecting the thermal image data frame subsequently, the correlation value is replaced when the correlation value is detected to be larger than the correlation value subsequently.

Here, whether or not the comparison value is larger than the reference value is used as a basis for evaluating the correlation, but there are cases where the comparison value is smaller than or close to the reference value (judgment value prepared in advance) as the basis for evaluating the correlation. The comparison value may be a correlation value, or may be a value obtained by converting the correlation value.

In step a12, the contrast value updating unit 11B updates the contrast value of the correlation according to the detected value having the greatest correlation, and the updated contrast value is used as the contrast value of the comparison correlation of the subsequent thermal image data frame.

Step A13, performing a predetermined process;

for example, the selecting unit 11C holds specific information such as a thermal image data frame corresponding to the detected value having the greatest correlation in a predetermined area of the temporary storage unit 2, and replaces the previous specific information (if any) to perform the subsequent processing. The held specific information is held in the temporary storage unit 2 until the specific information reselected by the selection unit 11C is not received. Further, specific information on a predetermined number of the plurality of thermal image data frames may be held, for example, specific information such as 3 thermal image data frames having the highest correlation degree and a value of the correlation degree thereof may be held. Subsequent notification, analysis, recording, diagnosis, etc. may then be performed. The notification is not limited to the specific information selected by the selection unit 11C, and may be performed by notifying an event of updating the contrast value or further notifying the updated contrast value.

For example, the notification is used to display the image obtained by the thermal image data frame together with the dynamic infrared thermal image. The display of the dynamic infrared thermal image may be switched to a frozen image in which the thermal image data frame is displayed, for example, by directly displaying the calculated correlation value; also, when the selecting section 11C is configured to instruct to hold a plurality of frames of thermal image data, then the infrared thermal images obtained by a plurality of held thermal image data frames may be displayed simultaneously, for example, also displayed in order of the degree of correlation.

Note that when not compared with a comparison value (a determination value representing whether or not the specific subject thermal image matches the subject identification information) for determining whether or not the specific subject thermal image is present, the displayed information of the degree of correlation does not necessarily represent whether or not the specific subject thermal image is detected.

In addition, step a13 may be omitted, for example, the contrast value may be updated continuously during shooting, and the information on the thermal image data frame may not be held until the user gives an instruction, and may be processed in a predetermined manner.

Step A14, judging whether to exit, if not, returning to step A01, and repeating the subsequent processing. At this time, since the previous contrast value is updated, when the user gives a detection instruction again, the obtained thermal image data frame in the subsequent photographing will be compared with the updated contrast value of the correlation, and when it is larger than the contrast value of the correlation, the contrast value will be updated again. Thus, the contrast value is updated whenever a thermal image data frame with a greater degree of correlation is detected.

When the comparison value is updated, the comparison unit 11A compares the predetermined information detected and obtained by the detection unit 8 and/or the evaluation value obtained based on the predetermined information detected and obtained with the updated comparison value; since the contrast value may be continuously increased according to the adjustment of the photographing by the user, it is easier to obtain the specific information of the thermal image data frame corresponding to the maximum correlation degree in the multiple detection processes.

As shown in fig. 7, in photographing, in response to an instruction of detection, the maximum detected correlation is 80% (a hint information converted from the sum of the proportions of the overlapping areas), the value of the correlation is taken as the comparison value of the correlation for the subsequent comparison, and an infrared thermal image 601 obtained by the thermal image data frame is displayed simultaneously with a dynamic infrared thermal image. When the value of the maximum correlation is detected to be greater than 80% in the following, as shown in fig. 8, the correlation value is 85%, the correlation value is replaced by 80% as the new correlation value (85%), and so on, and when the detected correlation value is 95% in the detecting again, as shown in fig. 9, the user can stop aiming shooting of the object if satisfied, and since the thermal image data frame is held in the storage medium such as the temporary storage section 2, the subsequent analysis, storage and the like can be performed conveniently. At this time, if the user presses the record key, a thermal image data frame corresponding to the infrared thermal image 603 is recorded in the memory card 8 by a predetermined process (such as compression). Even in a case where the presentation information or the infrared thermal image is not displayed, for example, in a case where the indicator lights flash, the thermal image data frame is held in the storage medium such as the temporary storage unit 2, and processing such as display and recording can be performed when the user presses the confirm key or the record key.

Further, since 50 thermal image data frames are stored in the thermal image storage unit, it is also possible to trace back thermal image data frames captured within a predetermined time period (for example, 2 seconds before), and thus it is not easy to miss thermal image data frames of good quality; at this time, the transfer of the thermal image data frame acquired by the imaging unit 1 to the temporary storage unit 2 may be suspended, or the thermal image data frame may be stored in a cycle in another area of the temporary storage unit 2.

As described above, in the present embodiment, when a thermal image data frame having a higher correlation than a comparison value is detected, the comparison value is updated, and the comparison value can be updated continuously every time a comparison value having a higher correlation than the previous one is detected later. The selection unit 11C can always select and hold specific information on the thermal image data frame with the highest correlation, so that the user can easily adjust the thermal image device 100 to pursue capturing the thermal image with the best effect. The visual alignment method has the beneficial effects of greatly reducing the operation difficulty of visual alignment, greatly reducing the physical strength of shooting and improving the quality of the finally obtained thermal image data frame. When the detection instruction is received, the frame with the highest correlation degree in the thermal image signal frames stored in the temporary storage part 2 is detected, so that the operation intensity of visual matching alignment can be reduced, an ordinary user can easily grasp the shooting skill, the operation is simple, the operation speed burden of a processor can be reduced, the cost of the thermal image device 100 and the like can be reduced, and the thermal image device is suitable for shooting a fast moving object. Of course, it is not necessary for any of the products embodying the embodiments of the invention to achieve all of the advantages set forth above at the same time.

In the present embodiment, the selecting unit 11C and the notifying unit 11D are described as predetermined processing for showing the update effect for the convenience of description of the effect of the present invention, but the present invention may be constituted by removing the above-described configuration.

Example 2

The difference from embodiment 1 is that the thermal imaging device 100 (infrared matching update device) detects prescribed information about a specific subject thermal image in a plurality of frames of thermal image data stored in the temporary storage section 2 according to a prescribed instruction based on the plurality of frames of thermal image data in the temporary storage section 2; the predetermined information includes at least one or any combination of the position, size, inclination angle, and correlation value of the specific subject thermal image. The control unit 11 includes an auxiliary information acquisition unit (not shown) for acquiring auxiliary information; a comparing unit 11A for comparing one or more of the predetermined information detected and obtained by the detecting unit, the auxiliary information acquired by the auxiliary information acquiring unit, the evaluation value obtained by the detecting unit 8 detecting the predetermined information acquired by the auxiliary information acquiring unit, and the evaluation value obtained by the auxiliary information acquiring unit with the corresponding one or more comparison values; a contrast value updating unit 11B for updating the contrast value. A selection unit 11C for selecting specific information on a predetermined thermal image data frame based on the comparison result of the comparison unit 11A, wherein the specific information notified may be specific information on one or more thermal image data frames according to different comparison results when there are a plurality of comparisons; the notification unit 11D performs notification based on the specific information on the predetermined thermal image data frame selected by the selection unit 11C.

In the field of infrared detection, different shooting quality is corresponding due to the fact that the position, the size, the inclination angle and the like of a specific object thermal image in an infrared thermal image are considered, even if the correlation degree is high, if the parameters are not ideal, the quality of an acquired thermal image data frame is not necessarily high; therefore, the thermal image data frame with the best shooting quality is selected for subsequent processing, or the user is prompted to pay attention to the shooting quality by considering the factors such as the position, the size, the inclination angle, and the like of the thermal image of the specific object in the thermal image data frame as the factors for generating the notification.

The auxiliary information includes at least one or any combination of an analysis value, an ambient temperature, a background factor, a wind speed, a humidity, and a distance, and other auxiliary information (including a setting by a user) acquired by the thermal imaging device 100, and includes other various factors that affect the predetermined thermal image data frame selected by the selecting unit 11C and/or the information notified by the notifying unit 11D.

In the application field of infrared detection, according to the difference of the auxiliary information, the quality and the importance degree of the obtained thermal image data frames are different, and different conditions are needed to deal with the processing of comparing, selecting, notifying and the like of the specified thermal image data frames; for example, when the obtained thermal image of a specific object has an analysis value greater than a specified contrast value (such as a threshold value of a defect), representing that the object has the defect, the attention of the user should be paid, and in the case that the correlation degree is close, the specific information about the thermal image data frame with the analysis value exceeding the standard is preferably selected and notified, so that the attention of the user is immediately paid, and the significance of infrared detection is great; for example, considering the influence factors of the environmental temperature, the background, the wind speed, the background factors (such as the difference between the background and the thermal image of the shot object, the thermal field distribution of the background, etc.), and the like, in the case of the close correlation, the influence factors may cause different thermal image quality and the value reduction of subsequent analysis, and other influence factors should be selected and notified to interfere with the thermal image data frame with little.

The auxiliary information acquiring unit may acquire the auxiliary information, for example, from the thermal imaging device 100 or a component (not shown) having a function corresponding to that of the thermal imaging device 100, and may acquire an analysis value (the analysis value is not limited to a temperature value, and may be, for example, an AD value, a color value in a pseudo color thermal image, a ratio of specific image values, or a value obtained by calculating these values according to a predetermined formula, etc., the analysis value acquired by the analysis unit may be for all pixels in a thermal image data frame or pixels in a specific analysis region), an ambient temperature by a temperature sensor, a humidity by a hygrometer, a distance between the thermal imaging device 100 and an object by a range finder, etc. The auxiliary information may be acquired based on the auxiliary information stored in the storage medium in advance, for example, history data of the auxiliary information; or in combination with a comparison of the current measurement acquired auxiliary information with historical data of auxiliary information pre-stored in the storage medium.

And, the comprehensive evaluation value can be obtained by the prescribed information and/or the auxiliary information; for example, it is possible to obtain the evaluation value by associating a different coefficient with specific information among the detected specific information and by combining the coefficient with other specific information among the detected specific information; for example, the evaluation value may be obtained by weighting with weights occupied by different pieces of information. The final evaluation value may be obtained by various calculation methods.

For example, as shown in fig. 13, it is assumed that the infrared thermal image 1301 of fig. 13 (c) is obtained from a detection window having a window coefficient of 0.94, and the infrared thermal image 1302 is obtained from a detection window having a window coefficient of 0.8, and the evaluation value=the value of the correlation x the window coefficient, and therefore, even if the correlation of the infrared thermal image 1301 is smaller than the correlation of the infrared thermal image 1302, the evaluation value is rather high.

The integrated evaluation value may be obtained by the predetermined information and the auxiliary information. For example, an evaluation value obtained by integrating the values of the position, size, inclination angle, analysis value, and correlation of a specific subject thermal image is obtained, for example, an integrated evaluation value is obtained according to the following formula, the integrated evaluation value=position×position weighting coefficient+size×size weighting coefficient+inclination angle×inclination angle weighting coefficient+analysis value×analysis value weighting coefficient+correlation value×correlation weighting coefficient; alternatively, it is preferable that the evaluation value is obtained based on the detected prescribed information and a table of the acquired auxiliary information and the comprehensive evaluation value.

Further, the evaluation value may be obtained by dividing the predetermined information and the auxiliary information, and the comparison unit may be configured to compare the obtained evaluation value with a predetermined comparison value based on the predetermined information and/or the auxiliary information not participating in the obtaining of the evaluation value.

Wherein, the comparison value updating part 11B updates the comparison value according to the comparison result of the comparison part 11A; and when a plurality of contrast values exist, updating at least one of the corresponding contrast values; wherein, when the plurality of comparison values are updated, after the updating, the comparing part 11A is configured to compare the specified information obtained by the subsequent detection of the detecting part 8 and/or the evaluation value obtained based on the auxiliary information obtained by the auxiliary information obtaining part and/or the specified information and/or the auxiliary information with the plurality of updated comparison values; and when part of the plurality of comparison values is updated, comparing the updated value with the comparison value of the updated item and the comparison value of the non-updated item in the plurality of comparison values after updating. Preferably, the comparison unit compares the obtained optimal predetermined information, the optimal auxiliary information, or the optimal evaluation value obtained from the detected predetermined information and/or auxiliary information, and updates at least one corresponding comparison value.

Wherein, when the detecting section 8 is configured to detect a plurality of pieces of prescribed information of a specific subject thermal image, and the comparing section 11A compares the prescribed information detected by the detecting section 8 and/or an evaluation value obtained based on the detected prescribed information with a prescribed plurality of comparison values, the selecting section 11C may select the specific information on the plurality of thermal image data frames based on the result of the comparison, and at this time, the notifying section 11D may notify one or more of them. Preferably, the selection unit selects and holds the correlation value and/or the predetermined information and/or the auxiliary information and/or the specific information on the thermal image data frame, which is superior to the predetermined contrast value, based on the comparison result of the comparison unit. The notification unit selects and notifies the specific information on the thermal image data frame having a correlation value and/or predetermined information and/or auxiliary information and/or evaluation value (evaluation value obtained by the predetermined information and/or auxiliary information) that is better than the predetermined contrast value, based on the specific information on the predetermined thermal image data frame selected and held by the selection unit.

Referring to fig. 11 and 12, a control flow of the detection mode of the thermal imaging apparatus 100 of embodiment 3 will be described, and in this example, three comparison values are provided as an example. The predetermined information (correlation value) related to the specific subject thermal image in the thermal image data frame detected by the detection unit 8, and the evaluation value obtained based on the predetermined information obtained by the detection and the auxiliary information (analysis value) obtained by the auxiliary information obtaining unit are compared with the first, second, and third comparison values.

The first contrast value (the first contrast value of the correlation in the present embodiment) is prepared in advance for judging whether or not there is a contrast value of a specific subject thermal image (a judgment value representing whether or not the specific subject thermal image matches the subject identification information), and the first contrast value is not updated.

The second contrast value (the second contrast value of the correlation in the present embodiment) is a contrast value of the correlation larger than the first contrast value, which is obtained from the detected correlation value of the thermal image data frame, and when the subsequent thermal image data frame detects a higher correlation value, the second contrast value is updated to a higher value accordingly.

The third comparison value, which is obtained as a comparison with a corresponding (e.g., prepared in advance) third comparison value, is updated to a higher (more optimal) value when a subsequent thermal image data frame detects the higher (more optimal) comprehensive evaluation value.

Finally, the selecting section 11C will select specific information on the thermal image data frame that is better than the second contrast value and/or better than the third contrast value; facilitating subsequent notification, analysis, diagnosis, recording, etc.

Step C01 to step C02 are similar to steps A01 to A02 of example 1, and the explanation is omitted;

step C03, similar to steps A03-A10 of embodiment 1, detects the correlation degree of the thermal image data frames of the obtained multiple frames, and omits the explanation;

step C04, judging whether the correlation value of the detected thermal image data frame is larger than the first contrast value, if not, indicating that the specific thermal image of the specific object is not detected, returning to step C02, for example, displaying the word pattern of the thermal image which is not detected to be matched. The subsequent processing is repeated.

When the correlation degree detected in step C04 is greater than the first contrast value, step C05 is entered.

In step C05, the auxiliary information acquiring unit acquires auxiliary information, such as an analysis value related to a thermal image of a specific subject, for example, by controlling the analysis unit to analyze the thermal image data frame having a correlation degree greater than the first contrast value and/or the thermal image data in the thermal image data frame detection window, and acquires the analysis value. Further, for example, when the detecting section 8 is configured to calculate the correlation by detecting the pixel ratio, it is not limited to determining the position parameter of the detected specific subject thermal image based on the position parameter of the detection window, and in this case, it is also possible to further extract the contour of the specific subject based on the detected detection window to obtain more accurate predetermined information on the specific subject thermal image, such as the position, the size, the inclination angle, and the like.

Step C06 of obtaining an evaluation value obtained by integrating the values of the position, size, inclination angle, analysis value, and correlation of the specific subject thermal image, for example, obtaining an integrated evaluation value according to the following formula, the integrated evaluation value=position×position weighting coefficient+size×size weighting coefficient+inclination angle×inclination angle weighting coefficient+analysis value×analysis value weighting coefficient+correlation value×correlation weighting coefficient; alternatively, it is preferable that the evaluation value is obtained based on a table of the detected information and the integrated evaluation value.

Step C07, judging whether or not the thermal image data frame of the maximum correlation degree and the maximum evaluation value among the detected thermal image data frames is the same frame?

If so (step C07: yes), the process proceeds to step C08, and the evaluation value is compared with a third comparison value.

If the correlation value is smaller than the third comparison value (NO in step C08), comparing the detected correlation value with the second comparison value in step C09; if not, go to step C32, for example, to represent a thermal image data frame that has previously detected a higher degree of correlation than the thermal image data frame currently detected. If so, at step C10-C11, the comparison value updating section 11B will update the second comparison value based on the detected value of the maximum correlation. The selecting unit 11C holds the specific information on the thermal image data frame in the predetermined area of the temporary storage unit 2, replaces the previous specific information (if there is the specific information on the previous thermal image data frame, and the correlation of the previous thermal image data frame is smaller than the thermal image data frame currently detected, and the evaluation value is not the largest among the held thermal image data frames), and notifies the specific information on the thermal image data frame whose correlation is larger than the second contrast value in step C12.

If the comprehensive evaluation value is greater than the third comparison value (yes in step C08), then in step C13, the value of the correlation is compared with the second comparison value;

if the correlation value is greater than the second correlation value (step C13: yes), the correlation value updating unit 11B updates the second and third correlation values based on the maximum correlation value detected by the thermal image data frame, and the maximum integrated evaluation value, at C14-C15. The selecting unit 11C holds the specific information on the thermal image data frame in the predetermined area of the temporary storage unit 2, replaces the previous specific information (if any), and notifies the specific information on the thermal image data frame having the correlation degree larger than the second contrast value and the integrated evaluation value larger than the third contrast value in step C16.

If it is smaller than the second contrast value (step C13: NO), the contrast value updating section 11B will update the third contrast value based on the detected comprehensive evaluation value of the thermal image data frame at C17-C18. The selecting unit 11C holds the detected specific information on the thermal image data frame corresponding to the maximum integrated evaluation value in the predetermined area of the temporary storage unit 2, replaces the previous specific information (if there is the specific information on the previous thermal image data frame, and the evaluation value of the previous thermal image data frame is smaller than the thermal image data frame currently detected, and the degree of correlation is replaced when the held thermal image data frame is not the maximum), and notifies the specific information on the thermal image data frame having the integrated evaluation value larger than the third contrast value in step C19.

If step C07 (no), which represents that the thermal image data frame with the largest correlation and the thermal image data frame with the largest evaluation value are two different frames (or may have multiple frames), step C20 is performed, and the evaluation value of the thermal image data frame with the largest evaluation value is compared with the third comparison value, see fig. 12.

If the correlation value is smaller than the third comparison value (step C20: NO), in step C21, comparing the correlation value of the thermal image data frame detected to obtain the maximum correlation with the second comparison value; if not, the process goes to step B32, and the display unit will not display the thermal image data frame with higher correlation degree and evaluation value than the thermal image data frame detected currently or display the word pattern of the thermal image data frame with no better correlation degree. If so, at step C22-C23, the comparison value updating section 11B will update the second comparison value based on the detected value of the maximum correlation. The selecting unit 11C holds the specific information on the thermal image data frame in the predetermined area of the temporary storage unit 2, replaces the previous specific information (if there is the specific information on the previous thermal image data frame, and the correlation of the previous thermal image data frame is smaller than the thermal image data frame currently detected, and the evaluation value is not the largest among the held thermal image data frames), and notifies the specific information on the thermal image data frame whose correlation is larger than the second contrast value in step C24.

If the integrated evaluation value is greater than the third comparison value (step C20: yes), then in step C25, the value of the correlation is compared with the second comparison value; if the correlation value is greater than the second correlation value (step C25: yes), the correlation value updating unit 11B updates the second and third correlation values based on the maximum correlation value detected by the thermal image data frame, and the maximum integrated evaluation value, at C26-C27. The selecting unit 11C holds the specific information on the thermal image data frame in the predetermined area of the temporary storage unit 2, replaces the previous specific information (if any), and notifies (for example, two frames are simultaneously displayed) of the specific information on the thermal image data frame having the correlation degree higher than the second contrast value and the thermal image data frame having the comprehensive evaluation value higher than the third contrast value in step C28.

If it is smaller than the second contrast value (step C25: NO), the contrast value updating section 11B will update the third contrast value based on the detected comprehensive evaluation value of the thermal image data frame at C29-C30. The selecting unit 11C holds the detected specific information on the thermal image data frame corresponding to the maximum integrated evaluation value in the predetermined area of the temporary storage unit 2, replaces the previous specific information (if there is the specific information on the previous thermal image data frame, and the evaluation value of the previous thermal image data frame is smaller than the thermal image data frame currently detected, and the degree of correlation is replaced when the held thermal image data frame is not the maximum), and notifies the specific information on the thermal image data frame having the integrated evaluation value larger than the third contrast value in step C31.

Step C32, judging whether to exit the detection mode, if so, ending, if not, returning to step C01, and repeating the above processing. In this way, when the thermal image data frames obtained by continuous shooting are stored in the temporary storage section 2 in a cyclic manner, specific information about the thermal image data frames that are better than the second contrast value and/or better than the third contrast value will be selected and notified in accordance with the detected prescribed information in response to the detection instruction; facilitating subsequent notification, analysis, diagnosis, recording, maintenance, etc. The method and the device have the advantages that whether the correlation degree of the detected thermal image data frame is larger than the first comparison value is used as a condition for further detecting the specified information, and therefore shooting of wrong parts and prompting of effective specific information can be further avoided. The advantages here are, depending on the contrast value, possibly smaller or larger than the contrast value.

The change of the display interface during shooting is described with reference to fig. 13.

As shown in fig. 13 (a), when a thermal image data frame having a correlation greater than the first contrast value (assuming that the correlation percentage converted by the first contrast value is 72%) is not detected, a dynamic infrared thermal image is displayed.

In response to the first detection instruction, as shown in fig. 13 (b), when a thermal image data frame having a correlation degree greater than the first contrast value is detected for the first time, notification information of a dynamic infrared thermal image with respect to the detected thermal image data frame is displayed, the notification information being generated based on specific information of the thermal image data frame, such as the thermal image data frame, the value of the correlation degree, the evaluation value, which is instructed to be stored by the selection section 11C; the notification information includes an infrared thermal image 1301 generated by the thermal image data frame, a correlation percentage of 85% in terms of a correlation value, and an evaluation value percentage of 80% in terms of an evaluation value. The contrast value updating unit 11B updates the second contrast value to, for example, 85% and the third contrast value to, for example, 80%; and, when the thermal image data frame greater than the second contrast value and/or greater than the third contrast value is not detected subsequently, the display part 10 will keep displaying the notification information such as the infrared thermal image 1301 and the state of the dynamic infrared thermal image; in addition, the infrared thermal image 1301 is a notification message generated for the specific message newly acquired at present, and the thickened frame reminds the user.

In response to the second detection instruction, as shown in fig. 13 (C), when a thermal image data frame larger than the second contrast value and the third contrast value is detected first, specific information of a dynamic infrared thermal image related to the detected thermal image data frame is displayed, the specific information including an infrared thermal image 1302 generated by the thermal image data frame, and the like, where, since the correlation degree corresponding to the infrared thermal image 1302 is larger than the infrared thermal image 1301 and the evaluation value thereof is smaller than the infrared thermal image 1301, the selecting section 11C holds the specific information related to the two thermal image data frames; and the comparison value updating part 11B updates the second comparison value according to the correlation degree corresponding to the infrared thermal image 1302; the notification unit 11D causes the display unit 10 to display notification information generated from specific information obtained by two different thermal image data frames. At this time, since specific information such as thermal image data frames corresponding to the infrared thermal images 1301 and 1302 is held in the temporary storage section 2, the user can select a corresponding thermal image data frame to be recorded or analyzed later from the information displayed on the display section 10 such as the infrared thermal images 1301 and 1302.

In response to the third detection instruction, and as shown in fig. 13 (d), when the thermal image data frame in which the correlation degree detected by the first detection unit is larger than the second contrast value and the evaluation value is larger than the third contrast value, the selection unit 11C holds the specific information on the infrared thermal image 1303 or also deletes the specific information on the infrared thermal images 1301, 1302; the comparison value updating unit 11B updates the second and third comparison values based on the correlation (95%) and the evaluation value (95%) corresponding to the infrared thermal image 1303; the notification unit 11D causes the display unit 10 to display specific information on the detected thermal image data frame, including the infrared thermal image 1303 generated by the thermal image data frame, and the like.

In this way, the selection unit 11C selects and holds specific information on the thermal image data frame in which the correlation value and/or the evaluation value is greater than the predetermined contrast value (second contrast value, third contrast value) based on the comparison result of the comparison unit; the interface of the display unit 10 can always display information obtained by notifying the thermal image data frame having the highest correlation and/or the highest evaluation value, and thus the user can be given a great deal of assistance in capturing images.

As described above, in this embodiment, not only the effect of embodiment 1 can be obtained, but also specific information on a more desirable thermal image data frame can be selected by providing the specific information and auxiliary information on the thermal image of the specific subject detected as factors for comparison, and when a more preferable thermal image data frame is detected, the selection unit selects the thermal image data frame, and the comparison value update unit correspondingly updates the comparison value; the method can further reduce the operation difficulty of visual alignment, improve the quality of the thermal image data frame during shooting, prompt the beneficial effects of a specific state, enable a common user to easily grasp the shooting skill, and enable random shooting to easily obtain the thermal image data frame with high quality. Of course, it is not necessary for any of the products embodying the embodiments of the invention to achieve all of the advantages set forth above at the same time.

Further, although three comparison values are exemplified, more comparison values may be used, and evaluation values and/or auxiliary information and/or predetermined information obtained by detection, such as evaluation values obtained from the position, size, inclination angle, and the like of a specific subject thermal image, evaluation values obtained from analysis values, environmental temperature, and the like, may be used in correspondence with several different emphasis.

Further, although a plurality of comparison values (three or may be reduced to two) are exemplified in embodiment 2, part updated, part not updated; but may also be configured as a full update; alternatively, the configuration of the contrast value updating unit 11B may be eliminated, and a plurality of corresponding contrast values may be prepared in advance, and all of the contrast values may not be updated.

In embodiment 2, a description is given of a case where a value and an evaluation value according to the degree of correlation are taken as examples, a plurality of evaluation values are obtained based on predetermined information to be detected by the detection unit 8, and whether or not to notify is determined based on the plurality of evaluation values; or, a plurality of thermal image data frames obtained according to different evaluation values will also be notified; alternatively, the value of the correlation degree and the plurality of evaluation values are also notified in order or priority. The notification unit 11D notifies the specific information on the predetermined thermal image data frame selected by the selection unit 11C and/or the update information (the updated operation may be the updated contrast value information or the like) of the contrast value update unit 11B, and preferably notifies the specific information on the predetermined thermal image data frame selected by the selection unit most recently (usually, the correlation and/or the evaluation value is greater than the contrast value). Thus, the user is very convenient; for example, the position, the size, the gradient and the correlation value of the thermally fixed object are used as evaluation factors, so that a high-quality thermal image data frame or a thermal image data frame required by specific shooting can be conveniently obtained; and the thermal image analysis value and the correlation value are used as evaluation factors, so that the object analysis condition can be obtained in time conveniently. The user can easily grasp and understand the focus such as the quality of shooting.

When a thermal image data frame having a higher correlation and/or evaluation value than the previous thermal image data frame is detected, the selecting unit 11C may delete the specific information obtained in the previous thermal image data frame, but may continue to hold the specific information, and the notifying unit 11D may display the specific information on the plurality of thermal image data frames, for example, by sorting the specific information according to the correlation and/or evaluation value.

Other embodiments

The thermal image apparatuses 100 as examples of the infrared matching update apparatus are each described in the above embodiments. However, the present invention is applicable not only to a thermal imaging apparatus with a photographing function but also to various apparatuses as described previously.

Further, a prescribed detection time or detection of a prescribed number of frames may be set to notify a frame in which the correlation degree is highest.

The present invention is not limited to the case where only the highest frame is notified, and other frames may be used, for example, frames before or after the time series; multiple frames may also be notified.

Also, not only the entire region of the entire subject but also a plurality of detection windows configured by dividing the subject into a plurality of parts can be detected, so that more accurate detection can be performed; in this case, the corresponding object identification information (which may be a template or a feature amount) is prepared for each component similarly to the whole.

The detection calculation unit may calculate a plurality of corresponding feature amounts in the corresponding detection window based on the plurality of feature amounts of the template, and obtain a determination result based on the comparison value corresponding to the plurality of feature amounts, for example, obtain a final determination result based on weighting of the plurality of feature amounts.

In this embodiment, the detection calculation unit may calculate the comparison result between one of the feature amounts and the infrared thermal image based on the plurality of feature amounts, and calculate the comparison result between the next feature amount and the infrared thermal image based on the plurality of comparisons when the comparison result is larger than a predetermined threshold value, thereby obtaining the final determination result.

Note that in the above-described embodiment, the detection of the prescribed information of the thermal image data frame, the number of comparison values, the update of the comparison values, the acquisition of the auxiliary information, and the like may be variously combined, and these combinations are all within the scope of the present invention.

Aspects of the present invention can also be realized by a computer of a system or apparatus (or a device such as a CPU, MPU, or the like) that performs the functions of the above-described embodiments alone and in combination with a program recorded on a storage device, and a method of knowledge that the functions of the above-described embodiments are performed by a computer of a system or apparatus by its steps by, for example, reading out and executing a program recorded on a storage device. For this purpose, the program is supplied to the computer, for example, via a network or from various types of recording media (e.g., computer-readable media) serving as a storage device.

Although the functional blocks in the drawings may be implemented by hardware, software, or a combination thereof, it is generally not necessary to provide a structure in which the functional blocks are implemented in a one-to-one correspondence. Blocks of functions may be implemented by one software or hardware module.

Claims

1. An infrared matching updating device is provided with,

an acquisition section for continuously acquiring thermal image data frames;

a selection unit that selects specific information on a predetermined thermal image data frame based on a comparison result of the comparison unit;

a notification unit that notifies the user based on the specific information selected by the selection unit;

a contrast value updating part for updating the contrast value;

wherein, after the comparison value is updated, the comparison part is used for responding to the subsequent specified instruction to the detection part, detecting the obtained specified information and/or the evaluation value obtained based on the detected specified information, and comparing the obtained specified information and the updated comparison value;

the infrared matching updating device is a portable thermal image shooting device.

2. An infrared matching updating device is provided with,

an acquisition section for continuously acquiring thermal image data frames;

An auxiliary information acquisition section for acquiring auxiliary information;

a comparison unit configured to compare one or more of the predetermined information obtained by the detection unit, the auxiliary information obtained by the auxiliary information obtaining unit, the evaluation value obtained by the detection unit detecting the predetermined information obtained by the auxiliary information obtaining unit, and the evaluation value obtained by the auxiliary information obtaining unit with a predetermined comparison value;

a comparison value updating part for updating the comparison value according to the comparison part;

wherein, after the comparison value is updated, the comparing part is used for responding to the subsequent specified instruction to the detecting part, and comparing one or more of the specified information obtained by the detecting part, the auxiliary information obtained by the auxiliary information obtaining part, the evaluation value obtained by the detecting part and the auxiliary information obtained by the auxiliary information obtaining part with the updated comparison value;

3. The infrared matching update apparatus according to claim 1, wherein the predetermined information includes at least information of one or any combination of values of a position, a size, an inclination angle, and a correlation of a specific subject thermal image.

4. The infrared matching update apparatus according to claim 2, wherein the predetermined information includes at least information of one or any combination of values of a position, a size, an inclination angle, and a correlation of a specific subject thermal image; the auxiliary information at least comprises one or any combination of analysis value, ambient temperature, wind speed, background factor, humidity and distance.

5. The infrared matching update apparatus of claim 1, comprising

A contrast value updating part for updating the contrast value; wherein when there are multiple contrast values, at least one of the multiple contrast values is updated;

and, after the comparison value is updated, the comparison part is used for comparing the detection part with the updated comparison value in response to the subsequent specified instruction, the obtained specified information is detected and/or the evaluation value obtained based on the detected specified information is obtained; when the comparison value of a part of items in the plurality of comparison values is updated, after the updating, the comparison part is used for comparing the specified information obtained by the subsequent detection of the detection part and/or the evaluation value obtained based on the specified information obtained by the detection with the comparison value of the updated item and the comparison value of the non-updated item in the plurality of comparison values.

6. The infrared matching update apparatus as claimed in claim 2, comprising

and, after the comparison value is updated, the comparison part is used for comparing at least one item of the specified information obtained by the detection part, the auxiliary information obtained by the auxiliary information obtaining part, the evaluation value obtained by the detection part and/or the auxiliary information obtained by the auxiliary information obtaining part with the updated comparison value in response to the subsequent specified instruction; when the comparison value of a part of items in the plurality of comparison values is updated, after the updating, the specified information obtained by the subsequent detection of the detection part, the auxiliary information obtained by the auxiliary information obtaining part, the evaluation value obtained by the detection of the specified information obtained by the detection part and/or the auxiliary information obtained by the auxiliary information obtaining part are compared with the comparison value of the updated item and the comparison value of the non-updated item in the corresponding plurality of comparison values.

7. The infrared matching update apparatus of claim 1 or 2,

The comparison value updating part updates the comparison value according to a preset comparison value; and when a plurality of contrast values exist, updating at least one of the corresponding contrast values.

8. The infrared match updating device of claim 1, wherein the infrared match updating device,

a comparison unit for comparing the correlation value detected by the detection unit and/or an evaluation value obtained based on predetermined information obtained by the detection with a predetermined comparison value; when the correlation value and/or the evaluation value is better than the contrast value, the contrast value updating section updates the contrast value.

9. The infrared matching update apparatus as recited in claims 1-8, having

the prescribed thermal image data frame may be one or more frames; including one of the following:

1) Selecting specific information related to a thermal image data frame with the maximum correlation degree and/or the optimal evaluation value;

2) Selecting specific information related to a thermal image data frame of which the specified information and/or evaluation value is better than the specified contrast value;

the specific information is one or more items thereof;

1) A thermal image data frame;

2) Detecting the obtained specified information; the prescribed information includes at least one or any combination of information of a position, a size, an inclination angle, and a correlation value of a specific subject thermal image;

3) An evaluation value obtained based on the predetermined information obtained by the detection;

4) Prompt information generated based on the prescribed information and/or the evaluation value;

a notification unit that notifies the selection unit of the latest selected specific information and/or the latest selected comparison value update; causing the display of successive infrared thermal images and notification information to notify the user.

10. An infrared matching updating method is provided with the following steps,

an acquisition step for continuously acquiring thermal image data frames;

A selection step of selecting specific information related to a predetermined thermal image data frame based on a comparison result of the comparison unit;

a notification step of notifying based on the specific information selected by the selection unit;