CN109413346B

CN109413346B - Thermal image photographing device and thermal image photographing method

Info

Publication number: CN109413346B
Application number: CN201811297573.XA
Authority: CN
Inventors: 王浩
Original assignee: Hangzhou Alpha Infrared Detection Technology Co ltd
Current assignee: Hangzhou Alpha Infrared Detection Technology Co ltd
Priority date: 2012-05-23
Filing date: 2013-05-23
Publication date: 2021-01-26
Anticipated expiration: 2033-05-23
Also published as: CN103428437A; CN104704815A; WO2013174285A1; CN108848299B; CN104704815B; CN109413346A; CN103428437B; CN108848299A

Abstract

The invention discloses a thermal image shooting device and a thermal image shooting method, and relates to the application fields of thermal image shooting devices, thermal image processing devices and thermal image shooting. In the prior art, the shot object is selected by depending on the subjective experience of a user, so that the efficiency is low, the shooting quality is difficult to control, and omission is easy. The thermal imagery shooting device and the thermal imagery shooting method provided by the invention are based on pre-stored object information added with a sequencing order and associated reference image composition data, the object information which is special object information is appointed, object indication information obtained by the special object information is especially displayed, a reference image is displayed and used as an information prompt of an object needing shooting at present, and then when a switching indication is sent, the appointed special object information and the reference image are switched in sequence. Therefore, the purpose of prompting the user of the shot objects needing to be shot at present according to the sorting sequence is achieved, the shooting speed is improved, the shooting quality is improved, and omission is not prone to occurring.

Description

Thermal image photographing device and thermal image photographing method

Technical Field

The invention discloses a thermal image shooting device and a thermal image shooting method, and relates to the application fields of thermal image shooting devices, thermal image processing devices and thermal image shooting.

Background

As a known technology, thermal image capturing devices are widely used in the fields of industry and the like, and regular infrared detection of power equipment, buildings and the like is an important part of state maintenance.

Infrared thermography is different from visible light images, and in the captured visible light images, the captured objects can be confirmed through information in the images, such as colors, nameplates, shapes and the like, so as to identify the objects; the infrared thermography is not easy to confirm the shot specific shot object through the information in the image, and if the shot specific shot object cannot be effectively identified through colors, nameplates and the like, a user is very easy to miss shooting when shooting.

The infrared detection work is quite heavy, and for example, a 500KV electric power substation usually has dozens of equipment areas, each equipment area has dozens of objects to be subjected to infrared detection, and the objects to be subjected to infrared detection have many similar objects to be photographed, and the similar objects may be the same or different types. For example, a plurality of groups of shot objects with different equipment areas exist in a transformer substation, and the plurality of groups of shot objects may be adjacent to each other, and even if three different shot objects with the same shape of A, B, C with different numbers exist in the same group of shot objects, because the different shot objects with the same type are almost the same in an infrared image, a user is very easy to miss shooting, and shooting is mixed and disordered, so that the efficiency is reduced; this situation is exacerbated when multi-angle shooting is required, or when multiple parts (e.g., specific parts, specific locations) of the same subject are shot.

At present, a shooting person selects a subject to be shot according to subjective experience, and due to the reasons and the like, the detection efficiency is low, the working intensity is high, and the subject is easy to be shot by mistake and missed.

In addition, at present, thermal image files obtained by shooting by a thermal image shooting device generate file names according to time or sequence numbers; for subsequent archiving, analysis and arrangement, and distinguishing thermal image files corresponding to a shot object, during infrared detection, a user is required to correspondingly record shot object information according to a field nameplate recognized or recognized by the shot object, and the existing common recording mode, such as manual paper recording of the file name of the thermal image file and the corresponding shot object information, such as attaching voice annotation of the field shot object information to the thermal image file, is adopted; the above methods have various inconveniences such as inconvenient operation, easy error, influence on the shooting speed, large subsequent arrangement workload and the like. The user holds the portable thermal image shooting device in the prior art, the workload is very large, and usually in infrared detection, one person is needed to shoot and the other person needs to record paper.

Since the application of the thermal image detection technology, no proper means is provided for conveniently realizing information prompt of a shot object, a user often feels confused in shooting, and technicians in the field always try to solve the problem, for example, a thermal image shooting device provided with a GPS device can prompt GPS prompt information in shooting of a power line; however, the user is not easy to correspondingly understand the specific object to be shot through the GPS information; when a plurality of objects are densely located at the same position and need to be photographed individually, specific objects cannot be dealt with. The prior art also does not solve the problem that shooting is easy to miss, and how to guide a user to carry out infrared thermal image shooting is a difficult problem.

Therefore, it is understood that there is a need for an infrared camera that can conveniently provide the prompt information of the subject for the user to shoot the subject, and the user can perform thermal image shooting according to the instruction of the prompt information of the subject, thereby solving the existing problems. Moreover, when the object prompt information of the user for shooting the object is provided, the problems that the object information is easy to be mistaken and the operation is inconvenient to record manually and the like are solved.

Disclosure of Invention

The invention provides a thermal imagery photography device and a thermal imagery photography method, which form data according to a plurality of shot object information and associated reference images, for example, representing the shot objects to be shot, and appointing the shot object information as special shot object information from the shot objects during shooting; the user can take the information of the shot object which is taken as the information prompt of the shot object which needs to be shot at present, the shot object is shot after the recognition and the check are carried out according to the cognition of the on-site shot object, such as an equipment indicator and the like, or the infrared data is further recorded in a correlation way with the specified correlation information, the shot object indication information can be displayed or switched according to the sequencing order (for example, the preset shooting order) of the shot object information, and the search and the selection of the shot object information are not needed or are easy. Obviously, the shooting speed is improved, omission is not easy to occur, and the operation is simple.

Therefore, the invention adopts the following technical scheme that the thermal image photographing device comprises:

the acquisition part is used for acquiring thermal image data;

an information specifying section for specifying, based on the plurality of object information stored by the information storage section, object information as special object information therein;

a reference image determining unit configured to determine, based on the specified object information, composition data related to a reference image based on the composition data associated with the object information; the determined composition data is used for obtaining a reference image, and the reference image is used for embodying a specified morphological characteristic and/or an analysis area of the shot object;

a position determining part for determining the position and the size of the reference image in the infrared thermal image;

the display control part is used for controlling the display part to display the infrared thermal image generated by the thermal image data and simultaneously displaying a reference image obtained based on the reference image composition data related to the special shot object information;

and the display control part is used for controlling a reference image obtained by forming the reference image into data according to a specified size to be displayed at a specified position in the infrared thermal image.

According to another technical scheme, the thermal image photographing device comprises:

the acquisition part is used for acquiring thermal image data;

an analysis region specifying unit configured to specify, based on the specified object information, configuration data related to the analysis region based on the configuration data associated with the object information; the determined composition data is used to obtain an analysis region;

a position determining part for determining the specified position and the specified size of the analysis area positioned in the infrared thermal image; the analysis area is arranged at a specified position in the thermal image data or the infrared thermal image according to a specified size.

the acquisition part is used for acquiring thermal image data;

an information specifying unit configured to specify reference image configuration data for obtaining a reference image based on the reference image configuration data to which the sort order is added and which is stored in the information storage unit;

a display control unit for controlling the display unit to display the infrared thermal image generated from the thermal image data and displaying a reference image obtained based on the designated reference image configuration data;

the information specifying unit switches the specified reference image configuration data based on the sort order in response to a switching instruction operation or in accordance with a predetermined switching condition.

Further, an information specifying unit configured to specify subject information as special subject information based on the plurality of subject information added with the sorting order stored in the information storage unit;

a display control part for controlling the display part to display the infrared thermal image generated by the thermal image data, and at the same time, specially displaying the shot object indication information obtained according to the special shot object information specified by the information specifying part and displaying the reference image obtained based on the reference image composition data related to the special shot object information;

the information specifying unit switches the specified special object information based on the plurality of object information items to which the sort order is added in response to a switching instruction operation or in accordance with a predetermined switching condition.

Further, the acquiring part is used for continuously acquiring thermal image data;

the display control part is used for controlling the display part to display dynamic infrared thermal images generated by the thermal image data which are continuously acquired, and simultaneously displaying the shot object indication information which is acquired by the shot object information of a specified quantity, wherein the shot object indication information which is acquired by the special shot object information is specially displayed in a display mode which is different from other shot object indication information.

Further, the recording section is configured to perform associated recording of the prescribed thermal image data with information relating to the specified special subject information and/or information relating to the analysis area in response to a recording instruction operation or in accordance with prescribed recording conditions.

Further, the display control unit controls display of a predetermined number of pieces of subject instruction information based on the plurality of pieces of subject information stored in the information storage unit.

Further, an information specifying section that specifies subject information as special subject information therein based on a user's selection;

further, the display control section displays, in a special display mode, subject instruction information obtained based on the special subject information specified by the information specifying section;

and the display control part is used for controlling the display part to display the infrared thermal image generated by the thermal image data, and particularly displaying the shot object indication information obtained according to the special shot object information specified by the information specifying part and displaying the reference image obtained based on the reference image composition data related to the special shot object information.

Further, the acquiring part is used for continuously acquiring thermal image data; and the display control part is used for controlling the display part to display the continuously acquired thermal image data to generate a dynamic infrared thermal image.

Further, there is a task determination section for determining object information from the object information stored in the information storage section;

an information specifying unit configured to specify subject information as special subject information from the subject information specified by the task specifying unit; the information specifying unit switches the specified special object information in response to a switching instruction operation or in accordance with a predetermined switching condition, based on the order of the addition of the object information specified by the task specifying unit.

Further, the task determination unit is configured to determine subject information that meets a predetermined filtering condition, based on the filtering condition;

a task setting section for setting a filtering condition of the subject information; the keyword related to the filtering condition may be one or more of a belonging unit, a classification level, a model, a manufacturer, performance, and characteristics related to the subject, a history of photographing, a history of inspection, a defect condition, a manufacturing date, a lifetime, a location, a subject region, a type, a past photographing time, a photographing angle, and a subject component.

Further, the subject indication information displayed specifically contains information representing the identity of the subject, or information representing the identity of the subject and at least one of the subject part, the photographing angle information; the sorting order represents a predetermined shooting order of one or more of an object, an object part, an object shooting angle, and an object in a specific path.

Further, the specially displayed object indication information and/or the reference image may be used for the user to confirm one or more of the photographed object, the part of the photographed object, and the photographing angle of the photographed object.

Further, the recording device is provided with a recording part for performing recording processing for performing associated recording of prescribed infrared data and prescribed associated information in response to a recording instruction operation or in accordance with prescribed recording conditions; the prescribed associated information includes at least one or more of information relating to the specified special subject information, information relating to reference image composition data, and information relating to a positional parameter of the reference image in the infrared thermography.

Further, the information on the specified special subject information includes information representing the identity of the subject, or information representing the identity of the subject and at least one of the subject part, the photographing angle information.

Further, the recording device is provided with a recording part for performing recording processing for performing associated recording of prescribed infrared data and prescribed associated information in response to a recording instruction operation or in accordance with prescribed recording conditions; the recording part generates a thermal image file based on prescribed infrared data, and the recording part is provided with a file name generating unit for generating a file name of the thermal image file, wherein the file name contains information related to specified special shot object information.

Further, the file name comprises classification information arranged in an information classification form, or the classification information and time; the classification information includes classification information obtained based on information specified in the specified special subject information.

Further, the freeze instruction operation, the record instruction operation, and the switch instruction operation can be performed by the same key operation.

Further, the thermal image photographing device can be a portable thermal image photographing device; or may be a thermal image capturing device mounted on a vehicle.

The thermal imagery shooting method of the invention comprises the following steps:

an acquisition step, for acquiring thermal image data;

an information specifying step of specifying subject information as special subject information among the plurality of subject information stored in the information storage section;

an analysis region determining step of determining, from the specified subject information, composition data relating to an analysis region based on the composition data associated with the subject information; the determined composition data is used to obtain an analysis region;

a position determining step, which is used for determining that the analysis area is positioned at the specified position and the specified size of the infrared thermal image; the analysis area is arranged at a specified position in the thermal image data or the infrared thermal image according to a specified size.

Furthermore, the present invention provides a computer program, which is a program executed in a thermographic imaging apparatus, the computer program causing the thermographic imaging apparatus to execute the steps of:

an acquisition step, for acquiring thermal image data;

a reference image determining step of determining, from the specified subject information, composition data relating to a reference image based on the composition data associated with the subject information; the determined composition data is used for obtaining a reference image, and the reference image is used for embodying a specified morphological characteristic and/or an analysis area of the shot object;

a position determining step, which is used for determining that the reference image is positioned at the specified position and the specified size of the infrared thermal image;

a display control step of displaying a reference image obtained based on the reference image composition data associated with the particular subject information while controlling the infrared thermal image generated by the thermal image data to be displayed in the display step;

and the display control step is used for controlling the reference image which is obtained by forming the reference image into data according to the specified size to be displayed at the specified position in the infrared thermal image.

The invention provides a readable storage medium storing a computer program, wherein the computer program causes a thermographic imaging apparatus to perform the steps of:

an acquisition step, for acquiring thermal image data;

Other aspects and advantages of the invention will become apparent from the following description.

Description of the drawings:

fig. 1 is an electrical configuration block diagram of the thermographic imaging apparatus of the embodiment.

Fig. 2 is a profile view of the thermographic imaging apparatus of the embodiment.

FIG. 3 is a flow chart illustrating one control embodiment of an information schema.

Fig. 4 is a schematic diagram showing an example of the subject information added with the sorting order and the reference image configuration data associated therewith stored in the information storage unit.

Fig. 5 is a schematic diagram of another example of the subject information with the sorting order added and the reference image configuration data associated therewith stored in the information storage section.

Fig. 6 is a schematic diagram of an example of one display interface in which the display section simultaneously displays the object indication information, the plurality of types of reference images.

Fig. 7 is a schematic diagram of one example of a display interface of the subject indication information and the reference image which are displayed in particular.

Fig. 8 is a schematic diagram showing an example of a display interface before and after switching of the subject instruction information to be particularly displayed.

Fig. 9 is a schematic diagram showing an example of a display interface in which a predetermined number of pieces of subject instruction information are hierarchically displayed in accordance with predetermined attribute information.

Fig. 10 is a schematic diagram showing the distribution of objects in the

equipment areas

1, 2, 3 in the substation 1 and the shooting route represented in the sorting order according to embodiment 1.

FIG. 11 is a flow chart illustrating one control implementation of an information schema with task determination.

Fig. 12 is a schematic diagram of a filter condition setting interface of one setting example of filter conditions.

Fig. 13 is a schematic diagram of a filter condition setting interface of another setting example of the filter condition.

Fig. 14 is a schematic diagram of another example of the object information stored in the information storage section.

Fig. 15 is a schematic diagram of one example of object information determined according to the filtering condition set by the task.

Fig. 16 is a schematic diagram of a photographing route in which the subject information determined according to the filtering condition set by the task of embodiment 2 is photographed in the order of sorting.

Fig. 17 is a schematic diagram showing an example of object information added with a sorting order and its associated reference image configuration data of a plurality of types stored in the information storage unit of embodiment 3.

Fig. 18 is a schematic diagram of a display information setting interface showing one example of information setting.

Fig. 19 is a flowchart showing another control embodiment of the information mode.

Fig. 20 is a schematic diagram showing an example of a display interface before and after the subject instruction information, the photographing adjustment based on the reference image, and the switching, which are displayed in particular.

Fig. 21 is a schematic diagram of one example of a data format of a recorded thermal image file.

Fig. 22 is a diagram showing an example of reference image configuration data to which a sort order is added, stored in the information storage unit of embodiment 4.

Fig. 23 is a flowchart showing another control embodiment of the information mode.

Fig. 24 is an example of a display interface of a reference image of embodiment 4.

Fig. 25 is another display interface example of the reference image of embodiment 4.

Fig. 26 is a block diagram of an electrical structure of an implementation of the thermographic imaging system in which the thermal image processing device 100 and the thermal image acquisition device 101 of example 5 are connected.

Fig. 27 is an implementation schematic diagram of a thermal image photographing system formed by connecting the thermal image processing device 100 and the thermal image acquisition device 101.

Detailed Description

The following describes embodiments of the present invention, although in embodiment 1, a thermal imaging photographing apparatus with a thermal imaging photographing function (hereinafter referred to as a thermal imaging apparatus) is exemplified. But may also be applied to thermal image photographing devices that receive thermal image data, such as processing devices like personal computers, personal digital processing devices, etc.

The thermal image data is not limited to thermal image AD value data, and may be image data of infrared thermal images, array data of temperature values, compressed data obtained by mixing one or more of these data, or the like.

Exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. Note that the following examples are to be described for better understanding of the present invention, so the scope of the present invention is not limited and various forms within the scope of the present invention may be changed.

Fig. 1 is an electrical configuration block diagram of the thermal image device 13 of embodiment 1. FIG. 2 is a profile view of the portable thermal imaging device 13 according to embodiment 1.

The thermal image device 13 is provided with a shooting part 1, an image processing part 2, a display control part 3, a display part 4, a communication I/F5, a temporary storage part 6, a memory card I/F7, a memory card 8, a flash memory 9, a control part 10 and an operation part 11, wherein the control part 10 is connected with the corresponding parts through a control and data bus 12 and is responsible for the overall control of the thermal image device 13.

The imaging unit 1 is configured by an optical component, a lens driving component, an infrared detector, a signal preprocessing circuit, and the like, which are not shown. The optical component is composed of an infrared optical lens for focusing the received infrared radiation to the infrared detector. The lens driving unit drives the lens to perform focusing or zooming operations according to a control signal of the control unit 10, and may be a manually adjusted optical unit. An infrared detector, such as a refrigeration or non-refrigeration type infrared focal plane detector, converts infrared radiation passing through the optical components into electrical signals. The signal preprocessing circuit comprises a sampling circuit, an AD conversion circuit and the like, and performs signal processing such as sampling and automatic gain control on signals read out from the infrared detector at a specified period, and the signals are converted into digital thermal image data (thermal image AD value data) through the AD conversion circuit. In the present embodiment, the photographing part 1 is used as an example of a photographing part and is used for photographing to obtain thermal image data.

The image processing unit 2 performs predetermined processing on the thermal image data obtained by the image pickup unit 1, and the image processing unit 2 performs processing for converting the thermal image data into data suitable for display, analysis, recording, and the like, such as correction, interpolation, pseudo-color, synthesis, compression, decompression, and the like. The image processing unit 2 may be implemented by a DSP, another microprocessor, a programmable FPGA, or the like, or may be integrated with or the same as the control unit 10. Specifically, in one embodiment, a corresponding pseudo-color plate range is determined according to an AD value range of the thermal image data or a set range of the AD value, and a specific color value corresponding to the AD value of the thermal image data in the pseudo-color plate range is used as image data of a corresponding pixel position in the thermal infrared image, where the grayscale infrared image may be regarded as a special case in the pseudo-color image. Further, the image processing section 2 is configured to obtain compressed thermal image data by performing a predetermined compression process on the thermal image data based on the control of the control section 10, and then record the thermal image data to a recording medium such as the memory card 8.

The display control unit 3 performs display of the image data for display stored in the temporary storage unit 6 on the display unit 4 based on the control of the control unit 10. For example, in the present embodiment, in the normal mode, infrared thermal images generated from thermal image data obtained by shooting are continuously displayed; in the information mode, the subject indication information and the infrared thermal image that are specifically displayed are displayed at the same time, and in the reproduction mode, the infrared thermal image that is read out from the memory card 8 and expanded is displayed, and in addition, various setting information can be displayed. Specifically, in one embodiment, the display control unit 3 includes a VRAM, a VRAM control means, a signal generation means, and the like, and based on the control of the control unit 10, the signal generation means periodically reads the image data read from the temporary storage unit 6 and stored in the VRAM from the VRAM via the VRAM control means, generates a display signal such as a video signal, outputs the display signal, and displays the display signal on the display unit 4; in the present embodiment, the display section 4 is taken as an example of the display section 4. Without being limited thereto, the display 4 may also be another display device connected to the thermal image device 13, while the thermal image device 13 itself may have no display device in its electrical structure. Obviously, when the thermal image device 13 has no display device in its electrical structure, the control unit 10 may also control to output image data for display, for example, output image data for display through an image output interface (such as various wired or wireless image output interfaces, for example, an AV port, an RJ45 port, etc.) (or it is understood that the control unit 10, the display control unit 3, etc. are examples of the display control unit); the display control unit controls the display unit to display the image, including the display output. The display control unit 3 may be integrated with the image processing unit or the control unit 10.

The communication I/F5 is an interface for connecting the thermal image device 13 to an external device such as an external computer, a storage device, or a thermal image device according to communication specifications such as USB, 1394, or network.

The temporary storage unit 6 is a volatile memory such as RAM, DRAM, or the like, and serves as a buffer memory for temporarily storing thermal image data output from the image pickup unit 1, and also serves as a work memory for the image processing unit 2 and the control unit 10, and temporarily stores data processed by the image processing unit 2 and the control unit 10. Not limited to this, a memory, a register, or the like included in a processor such as the control unit 10 or the image processing unit 2 may be interpreted as a type of temporary storage unit.

The memory card I/F7 is connected to the memory card I/F7 as an interface of the memory card 8, as a rewritable nonvolatile memory, and is detachably mounted in a card slot of the thermal image device 13 main body, and records data such as thermal image data under the control of the control unit 10.

The flash memory 9 stores therein a program for control and various data used in control of each part.

An information storage unit for storing a plurality of pieces of subject information to which a sort order is added and reference image configuration data associated with the subject information; wherein the sorting order represents a sorting order among the plurality of subject information. The information storage unit may be a storage medium in the thermal image device 13, such as a nonvolatile storage medium like a flash memory 9 and a memory card 8, or a volatile storage medium like a temporary storage unit 6; other storage media connected with the thermal image device 13 by wire or wirelessly, such as other storage devices communicating by wire or wirelessly connected with the communication I/F5 or other storage media in a thermal image device, a computer, etc., are also possible. Preferably, the plurality of subject information to which the sorting order is added and the reference image configuration data associated therewith are stored in advance in the thermal image device 13 or in a nonvolatile storage medium connected thereto. Obviously, the stored information may be generated in an external computer (for sorting the object information, or recording a serial number of the sorting order, etc.) and stored in the information storage unit, or may be completed in the thermal image device (for sorting the object information, or recording a serial number of the sorting order, etc.) and stored in the information storage unit.

The subject information is information related to the subject, and includes, for example, information representing a subject location, a type, a number, and the like, and various information related to the subject, such as an attribution unit, a classification level (for example, a voltage level, an importance level, and the like), a model number, a manufacturer, performance, and characteristics, past imaging or inspection history, a manufacturing date, and a lifetime. Information included in the subject information is convenient for a user to determine a subject to be photographed when the subject instruction information is generated; such as in association with infrared data, for subsequent processing, such as batch analysis, etc.

Preferably, various information in the subject information is configured in a form of information classification, and as an implementation drawing in which the exemplary list representative information storage unit shown in fig. 4 stores subject information, each of the subject information is configured by attribute information of a plurality of predetermined attributes, such as the subject information "substation 1 equipment area 1 equipment ic phase" having attribute information "substation 1" corresponding to the substation attribute 401, attribute information "equipment area 1" corresponding to the equipment area attribute 402, attribute information "equipment i" corresponding to the equipment type attribute 403, and attribute information "C phase" corresponding to the phase attribute 404.

In another embodiment in which the information storage unit represented by the exemplary list shown in fig. 5 stores subject information, the subject information 500 "substation 1 device area 1 ic phase" includes information representing a substation, a device area, a device type, and a phase to which the subject belongs, but does not store the information in a form of information classification as shown in the subject information in fig. 4.

The ordinal numbers of the sort orders in fig. 4 and 5 represent the sort orders to which these pieces of subject information are attached (including associated); the added sort order is, for example, recognizable sort order information such as numerals, letters, codes, and the like, which may be added as attribute information of the subject information; or may be added as index information corresponding to the object information; or storing the subject information at a predetermined address in the data file or in the storage medium, or may be a form to which the sort order information is added; preferably, the added sort order represents a shooting order of the subject corresponding to the subject information to which the sort order is added. The sorting order information may be generated by an external computer (sorting the object information, or recording a sorting order number) and stored in the information storage unit, or may be completed in the thermal image device 13 (sorting the object information, or recording a sorting order number) and stored in the information storage unit. The order representing the shooting order, which is made by arranging the subject information as per the shooting path L10 in fig. 10, is arranged in such a manner that, for example, the subject information having the order obtained by inputting the subject information in a prescribed input order, for example, a number representing the order is set, for example, an order rule (such as a chronological order rule, an alphabetical order rule, or the like) is arranged to be ordered to obtain subject information to which the order is added.

The reference image configuration data is used for obtaining image data of a reference image to be displayed together with the infrared thermal image (or switched to be displayed), and is used for providing a user with reference to shooting of a shot object.

Depending on the use of the reference image in infrared detection, the reference image may be, for example, an image representing a predetermined morphological feature of a subject, and the subject morphology represented by the reference image is provided as a visual reference for imaging. It may be a prescribed morphological feature that embodies a thermal image of the subject, for example, it may be an infrared thermal image containing a thermal image of the subject; without being limited thereto, since other types of images of the subject, such as visible light and ultraviolet, have similarity to the infrared thermography and a reference property in cooperative use, various types of subject images that embody a prescribed morphological feature, such as a visible light image of the subject, a pre-rendered image, and the like, may be used. The reference image composition data may be dot matrix data, vector graphics data, or data composed of dot matrix data and vector graphics data, where dot matrix data refers to matrix image data, and also refers to dot matrix data composed of array data such as thermal image data. Such as reference images T1 (contour image) and C1 (visible light image) in fig. 6. Further, an analysis area predetermined as a subject; the infrared thermal images are displayed in an overlapped mode according to the specified position and the specified size. As shown in fig. 6, an analysis graph F1 including three frame-shaped analysis area cells prompts the user to observe an analysis site corresponding to a subject indicated by subject indication information "1 substation 1 equipment area 1 device ic phase" displayed in the subject information display field 601. The analysis region configuration data is used to obtain image data of an analysis pattern, and the analysis region configuration data is usually vector pattern data, but may be dot matrix data.

The reference image and the infrared thermal image are jointly displayed on the same display, for example, the reference image is superimposed in the infrared thermal image according to a specified transparency ratio, as shown in fig. 6, the reference image T1 is superimposed in the infrared thermal image; for example, the reference image is combined with the infrared thermal image, as shown in fig. 6, the reference image C1 is not superimposed in the infrared thermal image, and is displayed in combination with the infrared thermal image for the user to refer to; for example, a reference image and an infrared thermal image are fused (not shown), in one embodiment of fusion, the transparency of the overlap between the image data of the reference image located at the pixel and the image data of the infrared thermal image is determined according to the color value of each pixel in the infrared thermal image, and the image data obtained after the overlap is used as the image data of the pixel, so as to obtain the effect of fusing the reference image and the infrared thermal image.

In one embodiment, a reference image is superimposed at a predetermined position in an infrared thermal image according to a predetermined size and a predetermined transparency, and as shown in fig. 6, a contour image T1 is displayed (superimposed) in an infrared thermal image IR0, and has a predetermined position and a predetermined size, and indicates the morphological characteristics corresponding to a thermal image of a subject and the position and size of the thermal image of the subject in the infrared thermal image IR0, so as to prompt a user to observe the shooting position, imaging position and size corresponding to the subject indicated by subject indication information "1 substation 1 equipment area 1 equipment ic phase" specifically displayed in a subject information display column 601.

T1-T15 illustrated in the reference image list 405 in fig. 4 represent associated reference image configuration data, and different subject information is associated with different reference image configuration data; however, the present invention is not limited to this, and different subject information may be associated with the same reference image configuration data. Related embodiments, for example, the subject information to which the sorting order information is added is taken as the file name of the reference image data file; for example, it is preferable that identification information such as a file name and a number of the reference image configuration data is associated with the subject information, and a file of the reference image configuration data corresponding to the identification information is stored in the information storage unit, thereby avoiding data redundancy.

In a preferred embodiment, the object information is associated with the configuration data of a plurality of types of reference images, and is used in combination or switching. See example 3.

The operation unit 11: the control unit 10 executes a program in response to an operation signal from the operation unit 11, in order to perform various operations such as a switching instruction operation, a recording instruction operation, or an input of setting information by a user. For example, the operation unit 11 is configured by a recording key 01 (configured to perform a recording instruction operation), a switching key 02 (configured to perform a switching instruction operation of subject information), a focus key 03, a confirmation key 04, a cross key 05, and the like shown in fig. 2, and the recording key 01, the switching key 02, and the like may be configured to perform a predetermined instruction operation (like a one-touch operation), and in response to this operation, the control unit 10 will continuously execute the recording process and the switching process. Without being limited thereto, the operation may be realized by using the touch panel 06, a voice recognition part, or the like.

The control unit 10 controls the overall operation of the thermal image system 13, and the flash memory 9 stores a program for control and various data used for controlling each unit. The control program enables the control part 10 to execute the control of processing in various modes, after the power is switched on, the control part 10 initializes the internal circuit, then, the common mode is entered, namely, the shooting part 1 shoots and obtains the thermal image data, the image processing part 2 carries out the specified processing on the thermal image data shot and obtained by the shooting part 1 and stores the thermal image data in the temporary storage part 6, the control part 10 executes the control on the display control part 3, the infrared thermal image is continuously displayed on the display part 4 in a dynamic image form, in this state, the control part 10 implements the control and continuously monitors whether the processing is switched to other modes or the shutdown operation is carried out according to the preset conditions, if the processing is carried out, the corresponding processing control is entered. The control unit 10 is realized by, for example, a CPU, an MPU, an SOC, a programmable FPGA, or the like.

In the present embodiment, the control section 10, as an information specifying section, displays an example of a control section and a progress statistic section. In this embodiment, a scene in which a user performs infrared detection on a subject whose device types are device i, device ii, and device iii in a device area 1(1001), a device area 2(1002), and a device area 3(1003) in a substation 1 shown in fig. 10 is taken as an example; before the main shooting, a related data file of the subject information and the associated reference image configuration data, which are related to the subjects and are sorted in order, is stored in advance in the flash memory 9 (or in a storage medium such as the memory card 8). The present embodiment is explained with reference to fig. 3 to 10. Referring to fig. 3, the control steps of the information mode are as follows:

in step S101, the control unit 10 performs control to continuously detect whether the user selects the information mode through the operation unit 11.

When it is detected that the user selects the information mode, the process proceeds to step S102. The control unit 10 transfers the subject information (partially or entirely) added with the sort order stored in the flash memory 9 (or in a storage medium such as the memory card 8) to the temporary storage unit 6, and the transferred subject information may be all of the subject information or predetermined partial information, for example, predetermined partial information for obtaining subject instruction information. Further, after the power is turned on, the information may be transferred to the temporary storage unit 6.

In step S102, object information as special object information is specified.

An information specifying unit (control unit 10) for specifying subject information as special subject information based on the subject information added with the sorting order stored in the information storage unit; in a preferred embodiment, the first object information "substation 1 device area 1 device ic phase" in the ranking order is designated as the special object information based on the ranking order, and the process proceeds to step S103.

In another embodiment, the control unit 10 monitors whether or not there is an operation instruction to select the special object information; here, in a case where the operation instruction is confirmed, the subject information corresponding to the selected subject instruction information is designated as special subject information; a display control unit for controlling the display unit to display a predetermined number of pieces of subject instruction information based on the plurality of pieces of subject information added with the sort order stored in the information storage unit; an information specifying unit specifies subject information as special subject information based on a user's selection. For example, in the object instruction information shown in the object information display field 801 in fig. 8, the user can select one of the object instruction information through the operation unit 11, and the control unit 10 designates the object information corresponding to the object instruction information as the special object information. In addition, the user can also enter a display interface of new shot object indication information in a mode of page turning, scroll bar moving and the like to select the new shot object indication information as the shot object indication information; further, the subject information as the special subject information may be specified from the starting point of the previously default sorting order, for example, the subject information as the special subject information which was last specified when used last time, and the subject information next to the sorting order thereof as the currently specified starting point.

Step S103, transmitting the thermal image data obtained by shooting through the shooting part 1 to the temporary storage part 6; the image processing unit 2 performs predetermined processing such as pseudo-color processing on the thermal image data captured by the imaging unit 1 to obtain image data of an infrared thermal image, and stores the image data in the temporary storage unit 6.

And step S104, the control part 10 controls the display part 4 to display the infrared thermal image generated by the thermal image data, and at the same time, specially displays the shot object indication information obtained according to the special shot object information specified by the information specifying part, and/or displays the reference image obtained according to the reference image composition data related to the special shot object information.

Preferably, in the present embodiment, the infrared thermal image, the object indication information obtained from the specified special object information, and the reference image obtained from the reference image composition data associated with the specified special object information are displayed together.

The special display is, for example, as shown in fig. 7, as the object instruction information obtained by displaying only the specified special object information.

The special display is, as when the subject instruction information obtained by the prescribed number of subject information not limited to the special subject information is displayed, wherein the subject instruction information obtained from the specified special subject information is specially displayed in a display manner distinguished from other subject instruction information. For example, a display position, color, background, size, font, and character description that are easily distinguished by the user may be used as a special display mode for distinguishing the subject instruction information from other subject instruction information. Such as shown in fig. 8 and 9.

In a preferred embodiment, the display control unit is configured to control the display unit 4 to display an infrared thermal image generated from the thermal image data, and to display the subject indication information obtained from the specified special subject information in a manner distinguished from other subject indication information by sorting the subject indication information obtained by displaying a predetermined number of pieces of subject information based on the plurality of pieces of subject information added with the sorting order stored in the information storage unit (determined by the task determination unit when there is the task determination step); then, image data of a reference image obtained from reference image configuration data associated with the specified special subject information is superimposed and displayed at a predetermined position in the infrared thermal image in a predetermined size and a predetermined transparency ratio. As shown in a display interface 801 in fig. 8, the control section 10 as a display control section controls to display object indication information 806 obtained by displaying a prescribed number of object information in order, to distinguish the underlined mark of "substation 1 device area 1 ic phase" from the other object indication information, and also simultaneously display a reference image T1 obtained by associating reference image configuration data with the object information "substation 1 device area 1 ic phase".

In another preferred embodiment, the display control unit displays predetermined information for generating the subject instruction information among the subject information in a hierarchical manner, that is, in a predetermined hierarchy and attribute information corresponding to each hierarchy. The hierarchical display is, for example, a tree display, and as shown in a subject information column 901 in fig. 9, the control section 10 displays the subject instruction information in predetermined three layers and in predetermined positions according to the attribute information of the predetermined attribute of the substation, the equipment area, the equipment type, and the other; specially displayed subject indication information 902 is also superimposed in the infrared thermal image for easy observation by the user.

Specifically, in one display control implementation mode, the constituent data of the reference image T1 associated with the designated object information "substation 1 equipment area 1 device ic phase" is read from the flash memory 9, the image processing unit 2 is controlled to obtain the image data of the infrared thermal image obtained from the captured thermal image data according to the predetermined display configuration parameters (for example, parameters such as the content of the image data to be displayed in the display interface and the display position, color, size, transparency, and superimposition order of the contents), the image data of the specific object information is obtained from the image data of the specific object indication information, and the image data of the reference image T1 obtained from the reference image constituent data associated with the specific object information is continuously synthesized; storing the synthesized image data in a temporary storage unit 6; the control display control unit 3 displays the synthesized image data on the display unit 4. As shown in fig. 7, the synthesis superimposes the subject indication information and the reference image in the infrared thermal image. When there is other predetermined indication information, the image processing unit 2 is controlled to combine the image data of the infrared thermal image generated by the captured thermal image data, the image data of the specially displayed object indication information obtained by the specified special object information (when there is a specially displayed mark, the image data including the mark such as an underline mark), and the image data of the other predetermined indication information; and controls the display control part 3 to display the synthesized image data on the display part 4, as shown in fig. 8, the synthesis combines the subject indication information and the infrared thermal image, and displays the combined image data in different areas without overlapping each other or with a small amount of overlap. Other instruction information includes a predetermined number of pieces of subject information and schedule information, and instruction information such as date and battery capacity displayed on the display unit.

The object indication information obtained from the object information may be obtained as all or a predetermined part of the object information, and a reference image type for obtaining the configuration and display of the object indication information in the object information may be predetermined. The display configuration data may be default, or some or all of them may be configured by the user.

The display control unit controls image data of a reference image obtained from reference image configuration data associated with specified special subject information to be superimposed at a predetermined position in the infrared thermal image in a predetermined size.

The reference image is located at a predetermined position and a predetermined size of the infrared thermography, and may be obtained for various embodiments.

For example, the display control unit may be position information in which reference image configuration data is associated in advance, and the display control unit may be configured to determine a predetermined position and a predetermined size represented by the position information, determine that a reference image obtained for the reference image configuration data is to be located at the predetermined position and the predetermined size in the infrared thermal image, and control the image processing unit 2 to synthesize the reference image obtained based on the size at the predetermined position in the infrared thermal image. In addition, the position, size, or rotation angle of the reference image may be determined by the user input through the operation unit.

And is determined by a predetermined adaptive display area. The self-adaptive display area is an area which is determined in the infrared thermal image and is used for self-adaptively displaying the reference image, and the self-adaptive display refers to that the reference image is displayed at a specified position in the self-adaptive display area in a non-overflowing and fixed-aspect-ratio maximizing mode in the self-adaptive display area. Specifically, the control unit 10 (display control unit) is configured to calculate the predetermined position and the predetermined size of the reference image after the adaptive scaling, take the example that the set adaptive display area is centered in the infrared thermal image and the reference image is "centered on the reference image" in the adaptive display area, and the control unit 10 calculates the ratio of the X axis and the Y axis of the adaptive display area (size X1, Y1) to the reference image (size X2, Y2 of the reference image before scaling), selects the ratio of the smaller one of X1/X2 and Y1/Y2 as the scaling ratio based on the center point of the reference image when the reference image is centered, and thereby obtains the predetermined position and the predetermined size of the reference image after the adaptive scaling. The effect of the reference image T1 being displayed "centered on the reference image" in the adaptive display zone Z1 is illustrated in fig. 9.

The reference image adaptive display also includes a case where the control unit 10 is configured to combine a plurality of pieces of configuration data as objects to be combined and calculate the position and size of the adaptive display of the combined reference image. It is to be noted that the images generated by each type of composition data participating in the combination are not necessarily all displayed.

In addition, based on the relative position relationship between the images obtained by referring to the image composition data, the position and the size of the image generated by other composition data in the infrared thermal image are obtained according to the position and the size of the image obtained by one composition data in the infrared thermal image.

Wherein the control section 10 functions as a progress counting section for counting the shooting progress information on the basis of the number of the subject information to which the sorting order is added (determined based on the task determining section when there is the task determining step) stored in the information storage section and the currently specified special subject information; the control section 10 controls the display of progress information, such as progress information 805 shown in

progress information

804 and 803 shown in 801, 802 in fig. 8; note that, in fig. 8, in the case where the order indication information of the specifically designated subject information has already been displayed, the progress information may also be constituted with the total number of displayed subject information "15".

Note that the sort order corresponding to the subject information may be displayed or not, and in fig. 8, order instruction information (serial number) obtained from the sort order information corresponding to the subject information to which the sort order is added stored in the information storage unit (when the task determination unit determines that there is a task determination step), is displayed.

In step S105, the control unit determines whether or not a switching instruction operation has been performed. If not, the steps S103-S105 are repeated, and the object indication information, the reference image T1 and the continuous dynamic infrared thermal image (continuous synthesis) are displayed together. When the switching instruction operation from the operation unit 11 is detected, the process proceeds to step S106.

As shown in the display interface 801, the user uses specially displayed object instruction information "substation 1 equipment area 1 device ic phase" and reference image T1 (outline image) as the presentation information for capturing the current object, the object instruction information includes information representing the identity of the object, and the corresponding object is verified and captured by recognizing the corresponding object or viewing the device identification plate. In the display interface 801, there is a difference in position and size between the object thermal image IR1 and the outline image T1; it is conceivable that, without the subject prompting information and the reference image prompting means, the form of the subject thermal image IR1 captured by the user (in practice, many users often capture only incomplete subject thermal images or improper capturing angles) and the imaging position, size and angle thereof in the infrared thermal image are difficult to be subjectively grasped. Then, according to the reference of the outline image T1, the user visually locates the object thermal image IR10 and the reference image T1 in the display interface 802 of fig. 8 obtained after adjustment in the imaging position and size matching state by changing the shooting position and adjusting the shooting distance, imaging position and angle between the optical component of the thermal image device 13 and the object "1 device ic phase in the substation 1 device area 1"; in this case, the user can judge or record the state of the subject thermal image IR10 in accordance with the predetermined form, and the result of the state evaluation can be easily obtained in accordance with the subject thermal image IR10 specification. When the user finishes shooting the corresponding object according to the object indication information "equipment ic phase 1 in equipment area 1 of substation 1", and then presses the switching key 02 of the operation part 11 or other keys representing switching, the switching indication operation can be finished by one-key operation, and here, the user does not need to look at the object information shown in the display interface 802 in fig. 8 for selection or search, and the operation is simple.

Further, the control unit 10 may be configured to perform the switching operation based on a predetermined switching condition; for example, when it is determined that a predetermined time interval is met, for example, the temperature value in the thermal image exceeds a predetermined threshold, for example, when a predetermined switching condition such as a trigger signal of a device connected to the thermal image device 13, for example, another sensor device is received, the process automatically proceeds to step S106 even if the switching instruction operation of the operating unit 11 is not performed; the predetermined switching condition includes a process of performing a switching designation when other predetermined conditions are simultaneously satisfied, for example, a predetermined time interval is satisfied or a temperature value in the thermal image exceeds a predetermined threshold value even if the switching instruction operation of the operation unit 11 is performed. Obviously, the prescribed switching condition may be various conditions configured in advance.

In step S106, the control unit 10 determines whether or not the task is completed.

The control section 10 determines whether or not the designation of the last subject information in the sorting order sequence is completed; if not, the process returns to step S102, and at this time, the designated special object information is switched in the order of the order based on the object information to which the order is added, which is stored in the information storage unit. If the operation is finished, the information mode is finished, characters such as 'task completion' and the like can be displayed on the screen, and then the thermal image device returns to the standby state to wait for the user to enter the operation of other modes. Alternatively, the imaging may be performed by switching to a predetermined starting point of the sort order, for example, the starting point of the sort order.

Specifically, in one embodiment, the information designating unit (control unit 10) adds 1 to the sequence number of the sorting order corresponding to the special subject information designated before the switching, and then determines whether the last one in the sequence of the sorting order is completed, and if the last one is not completed, searches for and designates the subject information corresponding to the sequence number of the sorting order obtained by adding 1 to the sequence number of the sorting order as the special subject information; and if the operation is finished, exiting. Further, it is not necessary to judge whether or not the designation of the last object information in the sequence of the sort order is completed, and it may not be judged that every time the switching instruction operation is received, that is, the object information corresponding to the sequence number of the sort order obtained by adding 1 to the sequence number of the sort order is designated as the special object information, and when not found, the 1 is added to continue the search until a prescribed timing is exceeded, or the information mode is not ended until the control section 10 receives the exit instruction.

Returning to step S102, the information specifying unit switches the specified special object information (i.e., switches the specified object information as the special object information) based on the sort order.

In a preferred embodiment, the information specifying unit switches the single object information specified as the special object information from the single object information specified as the special object information before switching to the next object information in the sorting order sequence (the sorting order sequence of the object information determined by the task determining unit when there is the task determining step). For example, in this example, the single object information designated as the special object information is switched from the single object information "substation 1 equipment area 1 device ic phase" designated as the special object information before switching to the next object information "substation 1 equipment area 1 device ib phase" in the sorted order "designated as the special object information before switching.

The display control part controls the display part to display the infrared thermal image generated by the thermal image data, and particularly displays the shot object indication information obtained by switching the specified special shot object information by the information specifying part, and/or displays the reference image obtained based on the reference image composition data related to the shot object information. As shown in the display interface 803, the object indication information of "substation 1 equipment area 1 equipment ib phase" is switched to be displayed; the reference picture T1 is switched to the reference picture T2; the progress information 804 in the display interfaces 801, 802 changes to the progress information 805 displayed in 803. Then, the user can shoot the corresponding shot object according to the specially displayed shot object indication information and/or reference image of the equipment I B phase in the equipment area 1 of the transformer substation 1. This allows the user to easily perform imaging through the imaging path L10 shown in fig. 10, and thus the user is less likely to miss an object.

The information specifying unit switches the single object information specified as the special object information from the object information specified before switching as the special object information to the object information specified before switching as the last object information in the sorting order. The switching is performed based on the sort order, which may be the order of the sort order sequence or the reverse order, and it may be specified whether the switching is performed in the order of the sort order or the reverse order.

Further, when the information specifying section specifies the subject information as the special subject information as two or more pieces of subject information adjacent in order; the information designating unit sorts the specified specific number of pieces of adjacent subject information as the special subject information into the specific number of pieces of adjacent subject information starting from the specific number of pieces of adjacent subject information designated before switching.

For example, when "equipment zone 1 of substation 1, equipment zone 1, equipment ib of substation 1, and" equipment zone 1, equipment ia phase of substation 1 "are designated at the same time, in response to the switching instruction operation, the switching designation" equipment zone 1 of substation 1, equipment ia, equipment zone 1 of substation 1, equipment iib of substation 1, and equipment zone 1, equipment iic phase of substation 1 "are used as the special subject information. Generally, the shapes of the different subjects in the same group are the same, and only one of the reference images can be displayed.

Further, when the information specifying section specifies the subject information as the special subject information as two or more pieces of subject information adjacent in order; there may also be cases where switching is done in reverse order.

It should be noted that in this embodiment, the information of the object with a small number is exemplified, and in the actual infrared detection operation, the number of objects is large, and the effect of the embodiment of the present invention is significant.

Similarly, for complex equipment or the situation that multi-angle shooting is needed, relevant object information, reference image composition data and the sequencing sequence thereof can be prestored and stored for objects (such as components, angles and the like) needing to be shot separately, and omission of shot parts can be avoided.

As described above, the subject information, the reference image, and the infrared thermography obtained by designating the special subject information based on the pre-stored subject information added with the sort order and the associated reference image configuration data, and displaying the special subject information on the display unit 4, in this embodiment, the subject information includes information representing the location (such as a substation, a facility area), the type (such as the type of the power equipment, a transformer, a switch, etc.), the number (such as the phase), etc. of the subject, the specially displayed subject indication information includes information representing the identity of the subject, which is convenient for the user to confirm the shot subject, and the user confirms the shot subject by checking the recognition of the subject or the equipment identification plate with the specially displayed subject indication information and the reference image as the indication information of the shot subject at present, the situation of error shooting is reduced; when a switching instruction operation is performed, namely, the specified special object information and/or the reference image are switched according to the sorting order, and the object instruction information obtained by switching the specified special object information by the information specifying part and/or the reference image obtained according to the reference image composition data related to the special object information are/is displayed. The purpose of prompting the user of the shot objects which need to be shot at present according to the sequencing sequence is achieved, and the operation is simple. The condition of wrong path or disorder is greatly reduced, and omission is avoided; the infrared thermal image shows a reference image with a specified position and a specified size and embodying the outline characteristics of a shot object, provides a visual reference for a user to shoot a thermal image of the shot object, and prompts and standardizes the shooting angle, the shooting part and the shooting distance of the shot object; obviously, according to the reference of the shot object indication information and the reference image, the user can clearly see the shooting requirements at a glance without excessively depending on experience accumulation and subjective idea, the shooting difficulty can be greatly reduced, the detection quality and speed are improved, and a common user can also achieve a good shooting skill level. Wherein, through the display of the statistical shooting progress information, the user can reasonably arrange the shooting progress. In summary, example 1 is a preferred embodiment, although it is not necessary that all of the above advantages be achieved simultaneously in any one product that embodies the invention.

Example 2

In the present embodiment, in the thermal image device 13 having the same structure as that shown in fig. 1, a control program for setting a filtering condition by a user, a control program for determining object information according to the filtering condition, and various data used in controlling each part are stored in the flash memory 9, and the shooting task of this time is to shoot an object whose object type is the object i in the substation 1. In the past, if the detection purposes are different, all objects in the whole station are detected, and specific types of objects are also detected, and the specific types of objects are distributed in different equipment areas, so that a user needs to search according to the equipment areas, which is very troublesome. The present embodiment is explained with reference to fig. 11 to 16.

In step S201, the control unit 10 performs control to continuously monitor whether the user selects the information mode through the operation unit 11, and if so, the process proceeds to step S202.

Step S202, setting filtering conditions; and a task setting part for setting a filtering condition by a user, wherein the filtering condition is composed of a keyword related to the filtering condition and a filtering logic relation.

In the present embodiment, the control unit 10 controls the display unit to display the filtering condition setting interface shown in fig. 12; the display section 4, the operation section 11, and the control section 10 constitute an example of a task setting section.

A task setting section for a user to set a filtering condition (of object information included in the shooting task) composed of a keyword and a filtering logical relationship related to the filtering condition.

The task setting part is provided with a keyword determining unit, a logic determining unit and a filtering condition generating unit, wherein the keyword determining unit is used for determining keywords related to filtering conditions; a logic determination unit for determining a filtering logic relationship of the keywords related to the filtering condition; and a filtering condition generating unit for generating a filtering condition according to the keywords related to the filtering condition and the specified filtering logic relation.

The keyword related to the filtering condition may be one keyword or a plurality of keywords; wherein the plurality of keywords includes representing a range of keywords such as a numeric range, an alphabetical range, a sort order range, a time range, and the like. In addition, when the subject information includes various information such as the attribution unit, classification level (for example, voltage level, importance level, etc.), model, manufacturer, performance, and characteristics, history of past shooting or inspection, date of manufacture, and lifetime, which are related to the subject, the keyword may be determined from the information to set the filtering condition.

A keyword determination unit for determining a keyword related to the filtering condition; for example, one or more of the following embodiments may be combined to determine keywords related to filtering conditions.

One embodiment, for example, pre-stored keywords, determines keywords associated with the filter criteria based on user selection. As when the subject information as shown in fig. 5 is stored in the information storage portion, keywords for selection may be prestored, and the keyword selected by the user is determined as the keyword related to the filter condition.

One embodiment, for example, is a default keyword associated with the filter criteria.

One embodiment, for example, enters keywords by the user, and determines the keywords entered by the user as keywords related to the filter condition.

One embodiment, for example, provides a selection item of the selected keyword attribute, and determines the keyword corresponding to the keyword attribute as the keyword related to the filtering condition based on the keyword attribute selected by the user; this is the case where when some of the subject information has attribute information of a specific attribute, and other portions of the subject information do not have attribute information of the specific attribute, the subject information can be conveniently filtered.

In a preferred embodiment, a keyword for obtaining attribute information of a predetermined attribute in the subject information is searched based on the subject information stored in the information storage unit, and the keyword related to the filter condition is specified based on a selection of a user.

Specifically, the control unit 10 controls the display unit 4 to display a keyword menu item of a keyword query configured to represent attribute information of a predetermined attribute, such as the substation 1203, the device area 1204, and the device type 1205, on the filter condition setting interface illustrated in fig. 12. When the information storage unit stores the subject information as shown in fig. 14, the control unit 10 searches the subject information stored in the information storage unit based on the device type 1205 selected by the user in accordance with the "subject i" shot this time, obtains the keywords "subject i, subject ii, device iii …" of the attribute information of the predetermined attribute (device type), causes the display list 1206 to be displayed, and the user selects "subject i" from among them, and the keyword determination unit determines "subject i" as the keyword related to the filter condition. Here, the display section 4, the operation section 11, and the control section 10 constitute an example of a task setting section; in this embodiment, when the types of keywords of the attribute information of the subject information are large, the operation becomes complicated.

In still another preferred embodiment, the keyword determination unit determines a keyword search condition, searches for a keyword that obtains attribute information of a predetermined attribute in the subject information that matches the keyword search condition based on the subject information stored in the information storage unit, and determines a keyword related to the filter condition based on a user's selection; wherein the keyword query condition is one or more of the keywords related to the filtering condition determined before.

Specifically, when the object information as shown in fig. 14 is stored in the information storage portion, the object information of some other substation is also included, unlike the case of fig. 4. The control unit 10 causes the display unit 4 to display a filter condition setting interface in the setting operation, as shown in the example of fig. 13, and when the user selects the substation 1303 via the operation unit 11, the control unit 10 inquires about keywords of attribute information of attributes of the substation based on the subject information stored in the information storage unit, and causes the list 1306 to be displayed; the user selects "substation 1" from among them, and the control unit 10 determines "substation 1" as a keyword related to the filter condition; then, when the device type 1305 is selected, the control section 10 determines "substation 1" selected by the user as a keyword query condition, and queries a keyword of attribute information that meets the device type attribute of the subject information of "substation 1", so that a list 1307 of "subject i, subject ii, and device iii" is displayed, and the user selects the device type "subject i" from the list; the control unit 10 specifies "the substation 1" and "the object i" as keywords relating to the filtering condition. Obviously, this way, the number of keywords to be selected will be simplified.

A logic determination unit for determining a filtering logic relationship of the keywords related to the filtering condition; the filtering logical relationship may be that when the keyword related to the filtering condition is a keyword, the filtering of the keyword is a non-relationship; when the keywords related to the filtering condition are a plurality of keywords, the keywords are the combination of AND, OR, NOT logical relationship and filtering NOT relationship among the keywords; the filtering may be a default and the logical relationship between the non-relational and the keyword may be determined according to user settings.

An example of a keyword, such as a keyword relating to a filtering condition being a keyword "subject i", in fig. 12, the options "yes" 1201 and "no" 1202 of the shooting condition are used to set the filtering non-relation; when yes is selected, the filtering condition generated by combining the keyword 'subject I' is used for subsequent searching and determining subject information meeting the 'subject I' as a shooting task; when 'not' is selected, the filter condition generated in combination with the keyword 'subject i' is used for subsequent search to determine subject information conforming to the 'subject i' that is not. In this case, the logic determination unit determines the filtering non-relationship as "yes" according to the default filtering non-relationship as "yes". When the user specifies the filtering condition through the operation unit 11, the filtering condition generating means (control unit 10) generates the filtering condition by combining the default filtering non-relationship "yes" with the keyword "subject i" selected by the user. At the time of task determination, object information conforming to the keyword "object i" is searched for as determined object information.

Examples of the plurality of keywords such as "substation 1" and "subject i" as the keywords related to the filtering condition, in fig. 13, the logic determination unit determines the filtering non-relationship as "yes" according to the default filtering non-relationship, and determines the logical relationship of the keywords "substation 1" and "subject i" as "and" according to the default logical relationship (the keywords of different attributes are "and" relationship "); when the user specifies the filtering condition through the operation unit 11, the filtering condition generating means (control unit 10) combines the keywords "substation 1" and "subject i" related to the filtering condition with the default logical relationship "and combines the default filtering with the non-relationship" yes "to generate the filtering condition. At the time of task determination, object information conforming to the keyword "substation 1" and conforming to the "object i" will be searched as determined object information.

But not limited thereto, the filtering non-relationship and the logical relationship between the plurality of keywords may also be determined according to user settings (not shown). The generated filter condition is recorded in the temporary storage unit 6 or in the flash memory 9 or the like (for example, a configuration file is generated) for later use.

In step S203, a task determination section determines object information from the object information stored in the information storage section to determine a plurality of object information, the determined object information being used to specify the special object information therefrom.

If "substation 1" and "equipment area 1" are used as the filter conditions, when the information storage section stores the subject information as stored in fig. 14, the subject information that matches the keyword "substation 1" and that matches "subject i" is searched as the determined subject information.

The determined subject information is shown in fig. 15, in which the number of shooting tasks for the other substations, "equipment area 2", and "equipment ii", "equipment iii", is reduced to "6" compared to before the task determination.

Obviously, the shooting path during the specific shooting task is simplified, the user looks at the equipment area information in the shot object indication information, the searching work of the equipment I in the equipment area 2 is avoided, the working strength is reduced,

further, step S202 is not essential, and the task determination section may determine subject information that meets the filter condition based on a pre-stored filter condition as a default; further, there is also an embodiment of the task determination, for example, when a plurality of data files (each including the object information and the configuration data of the reference image to which the sort order is added) are stored in advance in the flash memory 9 (or the memory card 8), a user is provided to select a data file and the object information in the data file selected by the user is determined as the object information included in the shooting task; further, the object information may be determined based on a user's selection of a plurality of object information.

Step S204 of specifying special subject information; an information specifying unit that specifies subject information as special subject information from the plurality of subject information specified by the task specifying unit.

The control unit 10 controls to designate, as the special object information, the object information "substation 1 equipment area 1 device ic phase" at the top of the added sort order among the plurality of pieces of object information thus determined, and proceeds to step S205.

Step S205, transmitting the thermal image data obtained by shooting by the shooting part 1 to the temporary storage part 6; the image processing part 2 carries out pseudo-color processing on the thermal image data shot by the shooting part 1 to obtain image data of the infrared thermal image, and the image data is stored in the temporary storage part 6.

In step S206, the subject indication information obtained by the special subject information, the reference image obtained by the reference image configuration data associated with the special subject information, and the infrared thermography are simultaneously displayed on the display unit 4.

In step S207, the control unit determines whether or not a switching instruction operation is performed, and if not, the steps S205 to S207 are repeated, and if a switching instruction operation is performed, the process proceeds to step S208.

In step S208, the control unit 10 determines whether or not the task is completed.

And if the operation is finished, the information indicates that the shooting in the shooting mode is finished, the thermal image device returns to the standby state, and the user waits for the operation in other modes. If not, the process returns to step S204, and switches the designated special object information based on the sort order added to the object information determined by the task determination unit.

Specifically, in one embodiment, the information specification unit (control unit 10) adds 1 to the serial number of the sorting order corresponding to the special subject information before switching, and then determines whether the last one of the sorting orders is completed, if not, searches for the subject information corresponding to the sorting order serial number obtained by adding 1 to the sorting order serial number (among a plurality of pieces of subject information determined by the task determination unit shown in fig. 15), specifies the searched subject information as the special subject information, and if not, continues adding 1 and continues searching until the searched subject information is found; and so on; and when the judgment is finished, ending.

In another embodiment, the determined object information is added with the serial numbers of 1, 2 and 3 … temporarily according to the sequence order, then the serial number of the appointed object information before switching is added with 1, whether the last one of the temporary serial numbers is finished is judged, if not, the corresponding object information after adding 1 with the serial number is searched and designated as special object information, and if the judgment is finished, the operation is ended. Similarly to embodiment 1, it is not essential to determine whether or not the designation of the last object information is completed.

Returning to step S204, the information specifying unit switches the specified special object information based on the sort order added to the object information specified by the task specifying unit.

Wherein the specified special subject information is switched; in a preferred embodiment, the information specifying unit switches the single object information specified as the special object information to the next object information in the ranking order (the ranking order being the ranking order added to the object information determined by the task determining unit) of the object information specified as the special object information before switching.

The information specification unit switches the single object information specified as the special object information from the object information specified before switching as the special object information to the object information specified before switching in the order immediately before the object information specified before switching (the order being the order added to the object information specified by the task specification unit). The switching is performed based on the sorting order, which may be the order of the sorting order sequence or the reverse order.

Further, when the information specifying section specifies the subject information as the special subject information as two or more pieces of subject information adjacent in order; the information specifying unit changes the specified specific number of pieces of the object information to be sorted adjacent to each other, which is specified before the change, to the specific number of pieces of the object information to be sorted adjacent to each other, which is specified before the change, in the sorting order (the sorting order is the sorting order added to the object information specified by the task specifying unit) starting from the next piece of the object information to be sorted adjacent to each other. Further, there may be a case where switching is performed in the reverse order.

In this embodiment, when the user finishes shooting the device i in the device area 1, the user will go to the device i in the shooting device area 3, and the device i in the device area 2 is prevented from being searched, and the shooting path of the device areas 1(1601), 2(1602), 3(1603) in fig. 16 is changed from L10 in fig. 10 to L16 in fig. 16.

In the embodiment, after entering the information mode, task setting is performed; however, it is also possible to perform task setting separately and then enter the information mode, for example, to record the filter condition or the subject information determined based on the filter condition and the sorting order thereof in the information storage, for example, to generate a new data file or to generate a configuration file for subsequent use. Further, a plurality of task settings may be performed. Further, the filtering condition setting step and the task determining step are set forth in steps, but may be configured to be an immediate progressive process, that is, when one of the filtering conditions is set, the task determining section determines the subject information in accordance with the filtering condition, and when the setting is completed, the task determining section completes the determination of the subject information in accordance with the filtering condition; when the setting is determined, processing proceeds to a specifying step of the special subject information. It is obvious that many more embodiments can be obtained by different combinations.

As described above, by setting the filtering condition of the subject information in the shooting task, the display of redundant information can be reduced, the displayed subject indication information is more instructive, the shooting path is simplified, and the purposes of reducing strength, improving efficiency and avoiding omission are achieved. Obviously, when various filtering conditions are set, great convenience is brought to shooting of a user. If the object information has the attribute information of the history (such as the past defect situation), the user can quickly find the related information of the defect object by inquiring the defect situation, thereby being convenient for the retest.

In the case of the example 3, the following examples are given,

in the thermal image device 13 having the same structure as that shown in fig. 1, a control program for setting display configuration parameters by a user and a control program for recording prescribed association information in association with infrared data are stored in the flash memory 9; the present embodiment is explained with reference to fig. 17 to 21.

Before the main shooting, a related data file of a plurality of pieces of subject information added with a sorting order and a plurality of types of related reference image configuration data shown in fig. 17 is stored in advance in the memory card 8 as a current shooting task; unlike fig. 4, the object information is associated with a plurality of types of reference image configuration data, and preferably, in the present embodiment, a predetermined positional relationship between images obtained from the respective configuration data or a predetermined position and size (not shown) of an image obtained from the respective configuration data in the infrared thermography is also stored in the plurality of types of configuration data. The subject information also includes other attribute information 1701 such as a production manufacturer and history. In order to avoid that observation of the shot object indication information is influenced by excessive information display, a user sets display information; in the present embodiment, the display section 4, the operation section 11, and the control section 10 constitute an example of a display information setting section for setting at least one of the display configuration parameters of the configuration type of the reference image, the object indication information configuration, the transparency, the color, and the display manner.

In one embodiment, in response to a setting instruction from a user, the control unit 10 causes the display unit 4 to display a corresponding display information setting interface, and fig. 18 is a display information setting interface after setting of the configuration parameters. The transparency 0 of the outline image, the analysis pattern, and the visible light image, and the transparency 0 of the subject indication information, that is, the non-transparent display are displayed. Wherein, the following steps are carried out: yes "and" show: the setting of "no" represents displaying or not displaying the content, and the displayed content is such that the contour image and the subject instruction information are configured to display attribute information of a substation, a facility area, a facility type, and a phase. Wherein, the color setting can set various colors for the displayed content so as to be distinguished. The display mode of the infrared thermal image display method is that the infrared thermal image display method is used for displaying the infrared thermal image; and combining, representing and displaying in combination with infrared thermography. These settings can be done by a cross key, and the set display configuration parameters are recorded in the temporary storage section 6 or the flash memory 9 (e.g., a configuration file is generated) for use as subsequent display control. In addition, the thermal imaging device 13 may be configured when it leaves the factory. Then, the normal mode is entered through the operation section 11.

Further, there may be a setting of a configuration of the subject instruction information which is displayed specifically; in addition, in the display mode, the display position and size, the parameter setting such as self-adaptive display area parameter, superposition sequence and the like, line type, line width, font and the like can be further subdivided; the related settings can also be configured in the form of shortcut keys so as to be convenient for the user to operate.

Referring to fig. 20, the control procedure of the information mode is as follows:

in step S301, the control unit 10 performs control to continuously monitor whether or not the user selects the information mode via the operation unit 11, and if so, the process proceeds to step S302.

Step S302, specifying special subject information;

the control unit 10 controls to designate the first object information "substation 1 equipment area 1 equipment ic phase" in the sorting order added to the object information as the special object information, and proceeds to step S303.

Step S303, transmitting the thermal image data obtained by shooting through the shooting part 1 to the temporary storage part 6; the image processing part 2 carries out pseudo-color processing on the thermal image data shot by the shooting part 1 to obtain image data of the infrared thermal image, and the image data is stored in the temporary storage part 6.

Step S304, the control part 10 is used for controlling the display part 4 to display the infrared thermal image generated by the thermal image data and controlling the display composition of the shot object indication information and the reference image according to the display configuration parameters set by the display information setting part; the display unit 4 is caused to display a display interface 2001 as in fig. 20, in which the reference image T1 is superimposed in the infrared thermal image at the set transparency 0.

In step S305, the control unit 10 determines whether or not a recording instruction operation is performed, and if not, the process proceeds to step S307;

the user finds the subject according to the subject indication information "device ic phase 1 in device area 1 of substation 1" in the display interface 2001, and then shoots the corresponding subject with reference to the reference image T1; in the display interface 2001, there is a large morphological difference between the object thermal image IR1 and the contour image T1; it is conceivable that, without the subject prompting information and the reference image prompting means, the form of the subject thermal image IR1 taken by the user (in practice, many users often only take incomplete subject thermal images or improper shooting angles) and the imaging position, size and angle in the infrared thermal image are difficult to subjectively grasp. Then, the user visually places the thermal image IR10 of the object obtained after adjustment and the contour image T1 in the display interface 2002 of fig. 20 in the imaging position and size matching state by changing the shooting position and adjusting the shooting distance, the imaging position, and the shooting angle between the optical components of the thermal imaging device 13 and the object "equipment ic phase 1 of the equipment area 1 of the substation 1" according to the reference of the contour image T1. At this time, the user presses the recording key 2 of the operation unit 10 or the like to issue a recording instruction operation, and the control unit 10 proceeds to step S306 in response to the recording instruction operation.

In addition, the control unit 10 may be configured to perform the recording operation based on other predetermined recording conditions; for example, when it is determined that a predetermined time interval is met, for example, the temperature value in the thermal image exceeds a predetermined threshold, for example, when a predetermined recording condition such as a trigger signal of another sensor device connected to the thermal image device 13 is detected, the process automatically proceeds to step S306 even if there is no recording instruction operation from the operating unit 11. The predetermined recording condition includes that even if the recording instruction operation of the operation unit 11 is performed, the recording process is performed when other predetermined conditions are simultaneously satisfied, for example, a predetermined time interval is satisfied, or a temperature value in the thermal image exceeds a predetermined threshold value. Obviously, the prescribed recording condition may be various conditions configured in advance.

Step S306, recording processing.

The control unit 10 as a recording unit performs a recording process of associating predetermined infrared data with predetermined association information in response to a recording instruction operation or in accordance with predetermined recording conditions. The infrared data is thermal image data obtained by shooting through the shooting part and/or data obtained by performing specified processing on the thermal image data obtained by shooting through the shooting part.

And then proceeds to step S307.

Prescribed infrared data, for example, thermal image data (frames) obtained by reading signals by an infrared detector in response to (or following) a prescribed time at which a recording instruction operation is performed or a prescribed recording condition is judged to be satisfied; for example; specified thermal image data (frames) among the thermal image data of the plurality of frames temporarily stored in the temporary storage 6 at a time (or a specified time thereafter) when a recording instruction operation is responded or when it is judged that a specified recording condition is satisfied; for example, the thermal image data in the above case is data obtained by performing predetermined processing (one or more of predetermined processing such as correction, interpolation, pseudo color, conversion to a temperature value, pixel reduction, compression, and the like); for example, a prescribed number of frames of thermal image data are recorded; for example, thermal image data (frames) obtained by performing predetermined processing on a predetermined number of frames of thermal image data, for example, integrating the multiple frames of thermal image data stored in the temporary storage unit 6 to obtain one frame of thermal image data after the processing; for example, one or more of the infrared data obtained in these cases may be used, such as simultaneously recording the temperature value of each pixel obtained from the thermal image data and the image data of the infrared thermal image.

Specifically, in one embodiment, in response to the recording instruction operation of the operating unit 11, the control unit 10 controls the infrared detector to read the signal to obtain the thermal image data, and causes the image processing unit 2 to perform a predetermined thermal image data compression process on the thermal image data, or performs a predetermined process such as correction or interpolation on the thermal image data, and then performs a compression process, associates the predetermined associated information in the temporary storage unit 6 with the compressed thermal image data, generates a thermal image file, records the thermal image file on the memory card 8, and ends the process. Further, the compression may be performed after the information is added.

Wherein, the specified association information may include one or more of the following information;

for example, the information related to the specified special subject information may be all of the information of the subject information as the special subject information, or part of the information, for example, preferably, may record information representing the identity of the subject, such as "substation 1 device area 1 device ic phase"; however, in other examples, "device area 1 device ic phase" may also be recorded; for example, the order information added to the subject information may be recorded; other information not used for generating the instruction information may be included in the subject information, and for example, the subject information may include information such as other numbers and types, and information of other numbers and types may be recorded, although not shown.

For example, information related to reference image composition data. Reference image configuration data associated with the particular subject information as specified, or identity information of the configuration data; wherein when the specified special subject information is associated with a plurality of types of reference image configuration data, one or more of them may be recorded, wherein the recorded reference image configuration data is not necessarily the configuration data of the reference image for which display is obtained; for example, in the present embodiment, the reference image configuration data T1 (obtaining the displayed reference image T1) may be recorded, the configuration data (even if F1 is not displayed) or the identity information of the analysis area F1 may also be recorded, and obviously, the configuration data of other objects (for example, the center line of T1 generated from the contour image T1, an outsourcing rectangle, or the like) having a relative positional relationship with the contour image T1, which are generated by the reference image, for example, the contour T1 in accordance with a prescribed rule algorithm, may also be recorded.

For example, information about the position parameters of the reference image in the infrared thermography. The reference image associated with the specified special subject information constitutes position information of the image obtained by the data in the infrared thermography. When a plurality of types of reference image composition data are associated with the specified particular subject information, the position information of the image obtained from one or more of the composition data in the infrared thermal image may be recorded, for example, in the present embodiment, the position parameter (position, or one or both of the size and the rotation angle) of the reference image T1 in the infrared thermal image may be recorded, and the position parameter of the analysis region F1 in the infrared thermal image may be recorded (even if F1 is not shown). Obviously, the position parameters of other objects (such as the central line of the T1 generated according to the outline image T1, an outsourcing rectangle, and the like) which are generated by a reference image such as the outline T1 according to a prescribed rule algorithm and have a relative position relationship with the outline image T1 can also be recorded.

An embodiment of association recording, in which prescribed association information is attached as information of infrared data of a prescribed format, is shown in an implementation diagram of a thermal image file structure in fig. 21, wherein the infrared data 2101 is thermal image data obtained by reading from an infrared detector at that time, corresponding to the thermal image IR0 shown as 2002 in fig. 20, since the reference image T1 is taken as a reference, the subject thermal image IR10 is located at a prescribed position in the thermal image IR0 and has a prescribed size; associated with the regulations information 2102, which is object information representing "substation 1 equipment area 1 equipment ic phase", reference image T1 configuration data and position information thereof in infrared thermography IR 0; other additional information 2103 such as time of shooting, shooting parameters such as ring temperature, distance, etc.

In addition, the association recording process may also record the prescribed association information in an information file or an index file associated with the thermal image file, and the control section 10 may generate the information file or the index file; furthermore, a thermographic file name may also be generated from the particular subject information, the recording section having a file name generating unit for generating a file name of the thermographic file, the file name containing at least information relating to the specified particular subject information; for example, the generated thermal image file name: the equipment zone 1 of the transformer substation 1 is provided with equipment I C phase and jpg phase; but attribute information is not classified and stored, so that subsequent batch processing is not convenient, and the computer is inconvenient to recognize mixed characters; preferably, the file name including the classification information is generated by performing information classification arrangement based on the classification information in the object information, and for example, the file name is generated based on predetermined attribute information: the method comprises the following steps that 1, a transformer substation 1-equipment area 1-equipment I-C phase and jpg, wherein attribute information can be classified in a '-' equal separation mode; further, a file name is generated by combining the time information '20120223', such as 1 part of the transformer substation, 1 part of the equipment area, I-C phase of the equipment, 20120223. jpg; the essence of the association record is to record the information needed for subsequent batch analysis, the file name contains the shot object information to facilitate the user to check, and the file name containing specific classification information is generated according to the classification information in the shot object information to facilitate the subsequent batch analysis to read and identify the classification information in the file name.

It is obvious that it is preferable that the classification information in the file name should include information representing the identity of the object to be photographed, corresponding to the object to be photographed.

In step S307, the control unit 10 determines whether or not there is a switching instruction operation, and if not, returns to step S303, and the display unit 4 displays the continuous infrared thermal image, the subject instruction information, and the reference image T1. If the switching instruction operation is performed, the process proceeds to step S308.

In step S308, the control unit 10 determines whether or not the task is completed.

And if the operation is finished, the information indicates that the shooting in the shooting mode is finished, the thermal image device returns to the standby state, and the user waits for the operation in other modes. If not, the process returns to step S302, and the subject information is assigned in the sorted order, and the switching designation is performed in the sorted order. Specifying the subject information "substation 1 equipment area 1 device ib phase" according to the sorting order, as shown in 2003 in fig. 20, specifically displaying the subject indication information "substation 1 equipment area 1 device ib phase" and the reference image T2; obviously, when the recording instruction operation is performed again, since the specified special subject information is switched by the information specifying section, the recording section, in response to the recording instruction, performs the association recording of the specified thermal image data and the specified association information corresponding to the specified special subject information "substation 1 equipment area 1 equipment ib" after the switching.

Further, it is also possible to have a single key (e.g., recording key) configured to represent the recording instruction operation and the switching instruction operation, and a corresponding control program, for example, in the state shown in 2002 of fig. 20, the specified special subject information "substation 1 equipment area 1 device ic phase", and in response to a prescribed instruction operation (like a same operation) or a prescribed condition of pressing the key, the control section 10 continuously performs control of the recording processing of step S306 and the switching processing of step S307; the operation is simpler. Wherein, the recording process can be carried out firstly, and then the switching process can be carried out; however, the case is also included in which the switching process is performed first, and then predetermined related information corresponding to the specified special object information "substation 1 equipment area 1 equipment ic is recorded in association with predetermined thermal image data, and the recording unit is configured to record predetermined infrared data in association with the predetermined related information in response to the recording instruction operation or in accordance with predetermined recording conditions.

In order to correctly describe the internal working principle and steps, a step-by-step description mode is adopted in the embodiment, but in the actual implementation process, different implementation modes can be adopted for facilitating the operation of a user, for example, the operation can be optimized from the aspect of operation based on the same (secondary) operation and/or the action of continuously recording and switching according to the specified conditions, so that the operation is more convenient, the same operation is the same operation action for the same key, and the same operation action can complete a plurality of steps (such as completing the recording indication operation and switching indication operation) described above; for example, different operation actions (such as half-pressing and full-pressing) in the same operation on the same key, where the different operation actions in the same operation implement one or more steps described above respectively (such as completing the recording indication operation and the switching indication operation respectively, or completing the recording indication operation and the switching indication operation simultaneously); for example, the operation actions of different keys within a specified time (e.g., the recording instruction operation and the switching instruction operation can be completed separately, or the recording instruction operation and the switching instruction operation can be completed simultaneously). Further embodiments can be obtained by performing different combinations of configurations such as a switching instruction operation and a recording instruction operation (for example, a combination of functions such as a key function and an operation). The operation is not limited to the key, and may be performed by other operation means such as a touch panel.

Preferably, the thermal infrared imager further includes a freezing control unit having a freezing control unit for performing freezing display of the thermal infrared image in response to a freezing instruction operation or in accordance with a predetermined freezing condition. For example, when a record key (assumed to be configured to perform a freeze instruction operation first) is pressed, freeze display of the thermal infrared image is performed (a freeze display step is provided before the recording processing step), and the user can confirm the recording of the quality of the thermal infrared image and then perform recording to ensure the shooting quality. Further, the control unit 10 may be configured to perform freezing under other predetermined freezing conditions; for example, when it is determined that a predetermined time interval is met, for example, a temperature value in the thermal image exceeds a predetermined threshold value, or when a predetermined freezing condition such as a trigger signal of another sensor device connected to the thermal image device 13 is detected, the freezing process is automatically performed even if the freezing operation of the operating unit 11 is not performed. The predetermined freezing condition includes that the freezing process is performed when other predetermined conditions, such as a predetermined time interval is satisfied or a temperature value in the thermal image exceeds a predetermined threshold, are satisfied even if the freezing operation of the operation unit 11 is performed. Obviously, the freeze instruction operation can be combined with the configurations such as the switch instruction operation and the record instruction operation to obtain more embodiments. The operation is not limited to the key, and may be performed by other operation means such as a touch panel.

In this embodiment, the setting of the display configuration parameters is performed before entering the information mode; however, the present invention is not limited to this, and the display configuration parameters may be set in the display information mode, and further embodiments may be obtained by performing different combinations.

Example 4

The difference from the above-described embodiment is that the information storage section stores reference image configuration data to which the sort order is added as shown in fig. 22, and does not store the subject information as in the above-described embodiment.

The reference mode is explained with reference to fig. 23:

in step S401, it is determined whether or not the user selects the information mode through the operation unit 11. If so, in step S402, the reference image configuration data is designated, and the information designating unit (control unit 10) may designate the reference image configuration data based on the reference image configuration data added with the sort order stored in the information storage unit, such as automatically designating the reference image configuration data based on the sort order (for example, selecting the top reference image configuration data), or displaying thumbnails corresponding to the reference image configuration data according to the sort order for the user to select, and the like, and the reference image configuration data is designated, and the first reference image configuration data (T1) is designated for obtaining the reference image, and the process proceeds to step S403.

Step S403, transmitting the thermal image data obtained by shooting by the shooting part 1 to the temporary storage part 6;

in step S404, the control unit 10 controls the display unit 4 to display the infrared thermal image generated by the thermal image data, and at the same time, to display the reference image T1 obtained from the designated reference image configuration data.

As shown in fig. 24, the reference image T1 is displayed together with the infrared thermography, wherein each piece of sorting order information 2401 is displayed in fig. 24, but may not be displayed, or thumbnails or the like corresponding to reference image configuration data corresponding to the sorting order are also displayed. Thus, the user can take the image of the object by referring to the reference image.

In step S405, the control unit determines whether or not a switching instruction operation has been performed. If not, the steps S403-S405 are repeated, and the reference image T1 is displayed together with the continuous dynamic infrared thermal image (continuous synthesis). If the switching instruction operation from the operation unit 11 is detected, the process proceeds to step S406. In step S406, the control unit 10 determines whether or not the task is completed. The control section 10 judges whether or not the designation of the last reference image configuration data in the sorted order sequence is completed; if not, the process returns to step S402, and at this time, switching is performed based on the reference image configuration data to which the sort order is added, which is stored in the information storage unit.

In the present embodiment, although the subject information is not attached, the actual effects of the above-described embodiments can be achieved also in the case where the user is familiar with the subject, and the display interface is more concise.

Further, as shown in fig. 25, but unlike the above-described embodiment, T1 configuration data may include contents of object instruction information 2501 concerning an object, for example, information representing a location, a type, a number, and the like of an object (contents similar to the object information described in embodiment 1), and the object instruction information may be a component of a vector graphic or a component of a dot image. Therefore, a typeface of the subject indication information, such as a watermark or the like, can be embodied in the reference image; when the task determination is performed in the present embodiment, unlike the filtering of the above-described embodiment, it is not convenient to set the filtering condition of the object indication information, but the filtering may be performed according to the associated information of the reference image configuration data, such as the serial number, time, and the like. The effect in use is similar to the above described embodiment.

Although, in fig. 22, the sorting order information and the reference image configuration data are in one-to-one correspondence; obviously, one or more pieces of sorting order information can be attached to the same reference image configuration data so as to be suitable for shooting similar equipment and reduce data redundancy; alternatively, the plurality of reference picture composition data may be added with the same sort order information to make the display richer.

Example 5

The present invention is applied to the thermal image device 13 having the photographing function in the above-described embodiments, and may also be applied to a thermal image processing device or the like that receives and processes thermal image data from the outside. The present embodiment takes the thermal image processing apparatus 100 as an example of the thermal image photographing apparatus.

In the embodiment, as shown in fig. 27, the thermal image acquisition device 101 is erected on the detection vehicle by using a cradle head and the like, and is connected to the thermal image processing device 100 by using a communication line such as a dedicated cable or a local area network formed in a wired and wireless manner. The user views the subject thermal image through the thermal image processing apparatus 100. And the thermal image acquisition device 101 is connected with the thermal image processing device 100 to form a thermal image shooting system in the embodiment.

Fig. 26 is a block diagram of an electrical structure of one implementation of the thermal image shooting system formed by connecting the thermal image processing device 100 and the thermal image device 101.

The thermal image processing apparatus 100 includes a communication interface, an auxiliary storage unit, a display unit, a hard disk, a temporary storage unit, an operation unit, and a CPU connected to the above units via a bus and performing overall control. The thermal image processing device 100 may be, for example, a computer or a dedicated processing device. The thermal image processing device 100 receives thermal image data output by a thermal image acquisition device 101 connected with the thermal image processing device 100 through a communication interface based on the control of the CPU. The communication interface is used for continuously receiving thermal image data output by the thermal image acquisition device 101; receiving thermal image data (transmitted by the relay device through the thermal image data output by the thermal image acquisition device 101) transmitted by the relay device; meanwhile, the thermal image acquisition device can also be used as a communication interface for controlling the thermal image acquisition device 101. Here, the communication interface may be various wired or wireless communication interfaces on the thermal image processing apparatus 100, such as a network interface, a USB interface, a 1394 interface, a video interface, and the like. The auxiliary storage unit includes a storage medium such as a CD-ROM or a memory card, and a related interface. The display control unit displays a display image on the display unit under the control of the CPU. The display portion, such as a liquid crystal display, may not have a display in the electrical structure of the thermal image processing apparatus 100 itself. The hard disk stores therein a program for control and various data used in the control. The temporary storage unit is a volatile memory such as RAM, DRAM, or the like, and functions as a buffer memory for temporarily storing thermal image data received by the communication interface, and as a work memory of the CPU. An operation unit: for the user to operate. The CPU controls the overall operation of the thermal image processing apparatus 100 and performs various related processes. For example, the received thermal image data is subjected to predetermined processing such as correction, interpolation, pseudo color, synthesis, compression, decompression, and the like, and converted into data suitable for display, recording, and the like. For example, when the received thermal image data is compressed thermal image AD data, prescribed processing such as the CPU decompressing the thermal image data received by the acquisition part and performing corresponding pseudo-color processing; for example, when the received thermal image data itself is already image data of a compressed infrared thermal image, the image data of the infrared thermal image is decompressed to obtain image data of the infrared thermal image. For example, when the communication interface receives an analog infrared thermal image, the image data of the digital infrared thermal image is obtained after AD conversion by the related AD conversion circuit.

The thermal image capturing device 101 includes a communication interface 10, an image capturing unit 20, a flash memory 30, a temporary storage unit 50, an image processing unit 40, and a CPU 60. The CPU60 controls the overall operation of the thermal image acquisition device 101, and the flash memory 30 stores a control program and various data used for controlling each part. The photographing part 20 is used for photographing to obtain thermal image data, the temporary storage part 50 is used for temporarily storing processed data, the image processing part 40 is used for compressing the photographed thermal image data and the like, and the CPU60 controls the processed thermal image data to be output through the communication interface 10.

The structure of the thermal image device 13 excluding the photographing part 1 is substantially the same as that of the thermal image processing device 100, and it is obvious that the present embodiment is equally applicable by acquiring thermal image data received from the outside. Therefore, the description of the embodiments is omitted. Obviously, the thermal image processing device 100 can be used with various thermal image acquisition devices having a thermal image shooting function, such as various handheld thermal image devices.

Other embodiments

In addition, the display unit of the display unit 4 may be configured as more than one, and there are both displays for displaying infrared thermal images and displays dedicated to displaying the information of the object, and the display control of the simultaneous display indicated by the display control unit may be simultaneous display on the same display or different displays.

Further, the reference image configuration data with which the subject information is associated does not necessarily have to be stored in advance in the same physical storage medium; for example, the storage medium of the thermal image device 13 stores the object information and the identification information of the corresponding reference image configuration data, and the reference image configuration data corresponding to the object information is stored in an external device such as a memory, a computer, or the like connected by wire or wirelessly through the communication I/F8, and when the specific object information is specified, the control unit 10 instructs the external device to obtain the reference image configuration data corresponding to the object information by wire or wirelessly.

Preferably, the shot indication information, the reference image and the continuous infrared thermal images are displayed simultaneously; without being limited thereto, either the subject indication information or the reference image may be displayed simultaneously with the continuous infrared thermography. Further, it may be a switching display of the subject information and the reference image. In addition, the switching display of the shot object information and/or the reference image and the infrared thermal image can be realized. For example, a dynamic infrared thermal image may be displayed on the display unit 4, and when a display instruction of the subject information or the reference image is received (for example, a button representing the display of the subject information is pressed), the subject instruction information and the frozen infrared thermal image are simultaneously displayed; in addition, the switching display of the shot object information and the infrared thermal image can be realized; the display control part responds to the corresponding display instruction, switches the display infrared thermal image to specially display the shot object instruction information and/or the display reference image obtained according to the special shot object information specified by the information specifying part; then, the switching operation can be carried out, and the indication information of the shot object after switching is particularly displayed, or the infrared thermal image is switched back to be displayed. After the special display, the display may be blanked after a predetermined time or based on a user operation to avoid occupation of the display screen. Further, the information specifying unit may specify the subject information as the special subject information based on the selection by the user; in this way, the user can select easily.

Preferably, the shot indication information and the continuous infrared thermal images are displayed simultaneously; for example, when a display instruction of predetermined specially displayed subject instruction information is received, the subject instruction information and the frozen infrared thermal image may be displayed simultaneously; in addition, the switching display of the shot object information and the infrared thermal image can be performed, and after the special display, the display can be blanked according to the preset time or based on the operation of a user so as to avoid the occupation of the display screen. Further, the information specifying unit may specify the subject information as the special subject information based on the selection by the user; in this way, the user can select easily. Furthermore, the device is also suitable for thermal image shooting of static imaging.

In the above embodiments, the subject application in the power industry is exemplified as a scene, but the present invention is also applicable to various industrial applications of infrared detection.

In addition, the processing and control functions of some or all of the components in embodiments of the present invention may also be implemented using dedicated circuits or general purpose processors or programmable FPGAs. Although the functional blocks in the drawings may be implemented by hardware, software, or a combination thereof, there is generally no need for structures to implement the functional blocks in a one-to-one correspondence; for example, a functional block may be implemented by one software or hardware unit, or a functional block may be implemented by multiple software or hardware units.

The foregoing describes only embodiments of the invention and is presented by way of illustration rather than limitation, and further modifications and variations of the embodiments may be made by persons skilled in the art in light of the foregoing description without departing from the spirit or scope of the invention.

Claims

1. Thermal imagery camera device includes:

the acquisition part is used for acquiring thermal image data;

2. The thermographic imaging apparatus of claim 1,

the acquisition part is used for continuously acquiring thermal image data;

and a display control unit for displaying the subject indication information obtained by the specific subject information in a display manner different from other subject indication information, while controlling the display unit to display a dynamic infrared thermal image generated by the thermal image data acquired continuously.

3. The thermographic imaging apparatus of claim 1,

and a recording unit for recording the specified thermal image data in association with the specified information on the special subject information and/or the information on the analysis area in response to the recording instruction operation or in accordance with the specified recording condition.

4. The thermographic imaging apparatus of claim 1,

and a display control unit for controlling display of a predetermined number of pieces of subject instruction information based on the plurality of pieces of subject information stored in the information storage unit.

5. The thermographic imaging apparatus of claim 1,

an information specifying unit specifies subject information as special subject information based on a user's selection.

6. The thermographic imaging apparatus of claim 1,

and the display control part is used for controlling the display part to display the infrared thermal image generated by the thermal image data and particularly displaying the shot object indication information obtained according to the special shot object information specified by the information specifying part.

7. The thermal imagery photography method comprises the following steps:

an acquisition step, for acquiring thermal image data;