CN103090976A

CN103090976A - Thermal imagery display device, thermal imagery display system and thermal imagery display method

Info

Publication number: CN103090976A
Application number: CN2013100099830A
Authority: CN
Inventors: 王浩
Original assignee: Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Current assignee: Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Priority date: 2012-01-12
Filing date: 2013-01-10
Publication date: 2013-05-08
Anticipated expiration: 2033-01-10
Also published as: CN103090976B

Abstract

The invention discloses a thermal imagery display device, a thermal imagery display system and a thermal imagery display method, belongs to the application field of infrared thermal imagery detection and aims to solve the serial problems that a user erects or adjusts a thermal imagery shoot device according to subjective experience, so that shot body thermal imagery of the same shot body or shot bodies of the same kind always has difference on the imaging position, the size and the angle, and key shoot parts are prone to omission and the like. According to the thermal imagery display device, the thermal imagery display system and the thermal imagery display method, an assigned position and a specified dimension are displayed on infrared thermal imagery, and a reference image corresponding to specified shape characteristics of the shot body is displayed, so that simple operation without over dependence on accumulation of experience is achieved, and the user is helped to grasp the imaging shape of the shot body, the imaging position, the size and the angle of the shot body in the infrared thermal imagery correctly. Shoot quality of thermal imagery of the shot body can be improved and standardized, and the speed of erecting or adjusting the thermal imagery shoot device is accelerated.

Description

IR image display device, thermal image display system and IR image display method

Technical field

IR image display device of the present invention, thermal image display system and IR image display method relate to IR image display device, thermal image display system and IR image display method, and the application of infrared thermal imaging detection.

Background technology

As known technology, the thermal imagery filming apparatus comes imaging by receiving extraneous infrared energy radiation, the thermal image display system that is connected to form by thermal imagery filming apparatus and IR image display device, be used for the continuous monitoring to subject, and lift-launch is maked an inspection tour shooting etc. to subject on motion platform such as vehicle.

In the application of infrared shooting, various subjects have shooting position and the shooting angle of its particular requirement, and the subject thermal imagery that meets this requirement is rendered as specific imaging form, the shooting distance that has in addition particular requirement.In use, at present by the IR image display of user according to and IR image display device cognitive to subject, select shooting position, shooting angle, the shooting distance of subject, carry out setting up or the adjustment of thermal imagery filming apparatus of thermal imagery filming apparatus, then carry out continuous monitoring or make an inspection tour and take.

Since the thermal imagery detection technique is used, the user is the puzzled cognition of subject imaging form and the control of shooting distance under to correct shoot part position, shooting angle always, the user need rely on subjective experience to set up or adjust the thermal imagery filming apparatus, cause each same or subject thermal imagery similar subject of taking always to have difference on image space, size, angle, and easily omit crucial shooting position.

Each otherness of taking the subject thermal imagery that obtains, make the batch processing difficulty of computing machine, cause follow-up analytical work need manually complete (as analyzed area corresponding to subject thermal imagery is set, analyzed area is comprised of the territory element of several point, line, surface, for example S01, S02, S03 territory element in Fig. 8 analyzed area F7, the numbering of territory element, kind, position, size etc. are slightly different, and final analysis result all may be different, and it is loaded down with trivial details that this arranges work); And this otherness causes the discreteness of wayward analysis data, and horizontal and vertical analysis correlation data validity is not high.How taking the subject thermal imagery that obtains standard is a problems to be solved.

Those skilled in the art is attempting to address this problem always, and recently, some expectations can reduce the means of the technical difficulty of thermal imagery shooting and behave known.For example patent documentation open (bulletin) numbers 200310112472.8 discloses a kind of infrared thermal imagery on-line equipment, it has visual light imaging parts and infrared imaging parts, its IR image display device can improve the intuitive of infrared shooting to the visible light of shooting and the compound display of infrared thermal imagery.And for example known use mesh lines, cross curve etc. aim at; And for example adopt overtemperature alarm to point out the user concern to the overtemperature subject.

Yet, aforesaid way and unsolved problem, the situation that for example temperature is high might not be defective in infrared detection, the IR image display device of prior art, thermal image display system, even if the user has learnt a large amount of infrared shooting theories and the knowledge of subject, but in infrared detection, owing to lacking effective means, still need rely on subjective experience to select shooting position, shooting angle and the shooting distance of subject during shooting, set up or adjust the thermal imagery filming apparatus, shooting quality is difficult to improve.

Therefore, understand and need a kind of IR image display device, or comprise the thermal image display system of this IR image display device, it can reach the accumulation that need not the experience of depending on unduly and loaded down with trivial details operation, imaging form, image space, size, the angle of subject thermal imagery in infrared thermal imagery of auxiliary user's paying attention subject, help to improve shooting quality, thus, make common user also can reach good shooting level of skill.

Summary of the invention

defective for the prior art existence, the invention provides a kind of IR image display device, show simultaneously infrared thermal imagery that the thermal imagery acquisition unit receives and with reference to image, according to present in infrared thermal imagery have assigned position and given size and embodied corresponding to subject regulation morphological feature with reference to image, as the vision reference of taking the subject thermal imagery, its imaging form to subject has been carried out visual cues, avoided omission and position to take mistake, pointed out simultaneously the image space of subject thermal imagery standard in infrared thermal imagery, size, angle, according to this with reference to image as the reference of taking, the adjustment that the thermal imagery filming apparatus that connects with the IR image display device is set up and takes, technical requirement to the user reduces, the user can obtain the subject thermal imagery of standard with this.

For this reason, the present invention by the following technical solutions, the IR image display device comprises:

The thermal imagery acquisition unit is used for receiving continuously infrared data; With reference to the image determination portion, be used for to determine and the composition data with reference to image correlation that embodies subject regulation morphological feature, determined composition data be used for obtaining embodying subject regulation morphological feature with reference to image; Location positioning section is used for definite assigned position and given size that is positioned at infrared thermal imagery with reference to image; Display control unit, be used for the described given size that will obtain based on determined composition data with reference to image, according to described assigned position, the infrared thermal imagery that the infrared data that receives continuously with the thermal imagery acquisition unit generates, the common demonstration.

The present invention also can be by the following technical solutions, and the IR image display device comprises:

The thermal imagery acquisition unit is used for receiving continuously infrared data; With reference to the image determination portion, be used for to determine and the composition data with reference to image correlation that embodies subject regulation morphological feature, determined composition data be used for obtaining embodying subject regulation morphological feature with reference to image; Location positioning section is used for definite assigned position and given size that is positioned at infrared thermal imagery with reference to image; Synthetic section is used for according to described assigned position, continuously synthetic infrared thermal imagery and with reference to image, to obtain composograph; Wherein said infrared thermal imagery is to generate according to the infrared data that the thermal imagery acquisition unit receives continuously, described with reference to image for according to described given size and obtain according to the determined composition data of reference image determination portion.

The thermal imagery acquisition unit is used for receiving continuously infrared data; With reference to the image determination portion, be used for to determine and the composition data with reference to image correlation that embodies subject regulation morphological feature, determined composition data be used for obtaining embodying subject regulation morphological feature with reference to image; Location positioning section is used for definite assigned position and given size that is positioned at infrared thermal imagery with reference to image; Synthetic section, be used for according to described assigned position, according to obtain based on determined composition data described given size with reference to image, the thermal-image data that the infrared data that the thermal imagery acquisition unit is received continuously obtains carries out pseudo-color processing of selectivity, obtains to have embodied with reference to the composograph of image with the infrared thermal imagery of thermal-image data generation.

Thermal image display system of the present invention is characterized in that, has the IR image display device as above-mentioned technical scheme, and, having the thermal imagery filming apparatus that is connected with the IR image display device, described thermal imagery filming apparatus is used for taking and exporting infrared data.

IR image display method of the present invention comprises: the thermal imagery obtaining step is used for receiving continuously infrared data; With reference to the image determining step, be used for to determine and the composition data with reference to image correlation that embodies subject regulation morphological feature, determined composition data be used for obtaining embodying subject regulation morphological feature with reference to image; The location positioning step is used for definite assigned position and given size that is positioned at infrared thermal imagery with reference to image; Show to control step, be used for will based on determined composition data obtain described given size with reference to image, according to described assigned position, the infrared thermal imagery that the infrared data that receives continuously with the thermal imagery obtaining step generates, the common demonstration.

Other aspects of the present invention and advantage will be set forth by following instructions.

Description of drawings:

Fig. 1 is the block diagram of electrical structure of a kind of enforcement of the thermal image display system that connects and composes as the IR image display device 8 of embodiment and thermal imagery filming apparatus 9.

Fig. 2 is the schematic diagram of a kind of enforcement of the IR image display device 8 of embodiment 1 and the thermal image display system that thermal imagery filming apparatus 9 connects and composes.

Fig. 3 is the schematic diagram at IR image display device 8 setup menu interfaces.

Fig. 4 is a kind of enforcement schematic diagram of subject information and the morphosis data of storage portion stores.

Fig. 5 is a kind of enforcement schematic diagram of subject information and a plurality of type constitution data of storage portion stores.

Fig. 6 is with the composograph schematic diagram of visible images formation with reference to image.

Fig. 7 is with the composograph schematic diagram of texture image formation with reference to image.

Fig. 8 is that contour images and analyzed area figure consist of the composograph schematic diagram with reference to image.

Fig. 9 is that contour images and cue mark consist of the composograph schematic diagram with reference to image.

Figure 10 means the process flow diagram of embodiment 1 reference pattern processing controls.

Figure 11 carries out the display interface schematic diagram of shooting process for utilizing to subject h7 with reference to image.

Figure 12 means that embodiment 2(self-adaptation shows) process flow diagram controlled of reference record mode treatment.

Figure 13 is the self-adaptation display effect schematic diagram after local configuration image " placed in the middle with reference to image " is processed.

Figure 14 is the self-adaptation display effect schematic diagram after local configuration image " placed in the middle with reference to scope " is processed.

Figure 15 is that the subject information of storage portion stores and the another kind of morphosis data are implemented schematic diagram.

Figure 16 is that the subject information of storage portion stores and the another kind of a plurality of type constitution data are implemented schematic diagram.

The display interface schematic diagram of Figure 17 for determining that (self-adaptation demonstration) takes subject h7 with reference to image.

Figure 18 is that a kind of data structure of the thermal imagery file of embodiment 3 records is implemented schematic diagram.

Figure 19 means when the subject thermal imagery when mating with reference to picture registration, the infrared thermal imagery effect schematic diagram of record.

Figure 20 means the process flow diagram of embodiment 4 processing reference pattern processing controls.

Figure 21 is a kind of display interface schematic diagram with reference to shooting with reference to image that shearing obtains the morphosis data and utilizes these morphosis data to generate of implementing.

Figure 22 a kind ofly implements edge extracting processing and obtains the morphosis data and generate display interface schematic diagram with reference to the process of image.

To be 5 one kinds of enforcements of embodiment arrange the interface schematic diagram to what the morphosis data generated with reference to what image carried out the related information setting to Figure 23.

Figure 24 is the schematic diagram of the IR image display device setup menu of embodiment 6.

Figure 25 is the schematic diagram at setup menu interface of the object processing of embodiment 6.

Figure 26 is the schematic diagram at setup menu interface of the calculation and object of embodiment 6.

Figure 27 for explanation by calculating or processing, 5 display cases with reference to the effect of image of acquisition.

Figure 28 is the schematic diagram with reference to the setup menu interface of image of embodiment 6.

Figure 29 is the schematic diagram at the switching setup menu interface of embodiment 6.

Figure 30 is the schematic diagram at setup menu interface of the regulation recorded information of embodiment 6.

Figure 31 is subject being taken with reference to image of utilizing that profile and analyzed area consist of and switches schematic diagram with reference to the display interface of image.

Figure 32 utilizes profile and with reference to image, subject being taken and switching schematic diagram with reference to the display interface of image of the zone prompting image construction that calculate to obtain.

Figure 33 is the control flow chart of an example of the reference pattern of embodiment 6.

Embodiment

The present invention is described further below in conjunction with the drawings and specific embodiments.Note, the embodiment that below will illustrate is used for understanding better the present invention, and does not limit the scope of the invention, and can change over the various forms in the scope of the invention.

Describe embodiment in detail with reference to accompanying drawing 1.Fig. 1 is the block diagram of electrical structure of a kind of enforcement of the thermal image display system that connects and composes of IR image display device 8 and thermal imagery filming apparatus 9.Fig. 2 is the schematic diagram of a kind of enforcement of the thermal image display system that connects and composes of IR image display device 8 and thermal imagery filming apparatus 9.

In embodiment 1, thermal imagery filming apparatus 9 adopts tripods, The Cloud Terrace etc. to be erected at the subject scene, and the modes such as LAN (Local Area Network) that consist of via the order wire such as private cable or wired mode with being connected are connected with IR image display device 8.The user watches and monitors the subject thermal imagery by IR image display device 8.

The CPU1 that the IR image display device 8 of the present embodiment has display part 2, interim storage part 3, communication interface 4, hard disk 5, auxiliary storage section 6, operating portion 7, is connected and carries out integral body control by bus with above-mentioned parts.IR image display device 8 is as being computing machine or special-purpose treating apparatus.In IR image display device 8, received the infrared data of thermal imagery filming apparatus 9 outputs that are connected with IR image display device 8 by communication interface 4, and CPU1 carries out the control handling procedure that is stored in hard disk 5, and the data of accepting are carried out various processing.

Wherein, infrared data can be one or more of the data of view data after the prescribed form compression etc. of view data, thermal-image data or the infrared thermal imagery of the shooting of thermal imagery filming apparatus 9 thermal-image data (AD Value Data) that obtains and export, infrared thermal imagery, is called for short infrared data.

Display part 2 is as liquid crystal display, the interface that demonstration is relevant with infrared thermal imagery, composograph, analysis etc.In addition, also can be based on the relevant various set informations of the control display of CPU1.

Interim storage part 3 carries out the memory buffer of interim storage as volatile memory such as RAM, DRAM as the infrared data that the thermal imagery acquisition unit is received, simultaneously, work as the working storage of CPU1, temporarily stores the data of being processed by CPU1.Do not limit therewith, the storer that the processor such as CPU1 inside comprises or register etc. also can be interpreted as a kind of temporary storage medium.

Communication interface 4 is used for receiving continuously the infrared data of thermal imagery filming apparatus 9 outputs as the thermal imagery acquisition unit.Simultaneously, can be used as the communication interface that thermal imagery filming apparatus 9 is controlled.At this, communication interface 4 comprises the various wired or wireless communication interfaces on IR image display device 8, as network interface, USB interface, 1394 interfaces, video interface etc.; IR image display device 8 is connected the also interface of exchanges data with external device (ED), as external device (ED), such as enumerating personal computer, server, PDA(personal digital assistant device), other thermal imagery filming apparatus, visible light filming apparatus, memory storage etc.

Store in hard disk 5 for the program of controlling, and the various data of using in controlling.Hard disk 5 is used for storage and embodies at least the composition data with reference to image correlation of subject regulation morphological feature in the present embodiment as the example of storage part; The composition data of storing comprises the morphosis data at least, and the composition data of namely storing is the morphosis data, or the composition data of storing comprises the composition data (hereinafter referred to auxiliary composition data) of morphosis data and other types.

At this, the storage part indication can be namely the storage medium in IR image display device 8, as hard disk 5 non-volatile memory mediums such as grade, and the volatile storage medium such as the internal storage of interim storage part 3 indications, register; Can also be with wired or wireless other storage mediums that are connected of IR image display device 8 in, as by with the storage medium of wired or wireless other devices that carry out communication that are connected of communication interface 4 as the storage medium of other memory storages or thermal imagery filming apparatus 9, computer etc. or network destination.Preferably, the data in advance such as composition data is stored in IR image display device 8 or in connected non-volatile memory medium.

As shown in Figure 4, a kind of preferred implementation of the composition data of storing in storage part is described, namely stores morphosis data of a plurality of subject information and each subject information association.Comprise that image that the morphosis data, morphosis data of a plurality of subject information, subject information association generate is arranged in the positional information of infrared thermal imagery (for example position, size or also have the anglec of rotation); Obviously, for example when the morphosis data of storage are made of the coordinate of a plurality of points, also be considered as having stored simultaneously with reference to picture size, determined by the coordinate of a plurality of points of storage the size with reference to image that these points consist of; In like manner, when location positioning section has determined to consist of a plurality of points with reference to image and is arranged in the position of infrared thermal imagery, also be equivalent to determine this given size with reference to image.Wherein, subject information type, title, numbering, place of being subject etc. represents one or more combination of the information of subject identity.In addition, the concrete manifestation form of positional information can be also to be arranged in the whole picture of the display part coordinate system location parameter (but dropping on the infrared thermal imagery display window) of (for example when picture comprises the infrared thermal imagery display window and be arranged in other information display window outside the infrared thermal imagery display window).

The morphosis data are the composition data that represents the image of subject regulation morphological feature, refer to embody the image of subject regulation morphological feature and/or the composition data of figure, it can be for example dot array data, or vector figure data, or the data that formed by dot array data and vector figure data etc., at this, dot array data is the dot matrix image data for example, such as the dot array data of the array datas such as thermal-image data formation.The morphosis data such as being from shooting angle according to the rules, taking the position and extract acquisition various types of subject images of obtaining such as infrared thermal imagery, visible images etc., can be also to be stored in advance in storage part (as hard disk 5).

Embodied subject the regulation morphological feature with reference to image, can be the regulation morphological feature that has embodied the subject thermal imagery, can be for example the infrared thermal imagery that comprises the subject thermal imagery; Be not limited to this, because the other types image such as the visible light of subject, ultraviolet and infrared thermal imagery have the similarity of profile, texture or the referential in collaborative the use, various types of subject images such as the visible images of subject, pre-rendered image etc. that the regulation morphological feature requires have also been referred to embody.After synthetic this class image in composograph according to the rules transparency ratio be rendered as translucent demonstration, provide its representative the regulation shooting angle, take the subject form at position as the vision reference of taking reference.In Fig. 6, for visible images with reference to the translucent demonstration of image TU7, subject thermal imagery H7 is positioned at translucent part with reference to image TU7 can produces translucent blocking, although observing effect is affected to some extent, but such is more lively with reference to image ratio, is convenient to understand.

Embodied subject the regulation morphological feature with reference to image, can be if only embody the profile of subject and/or the image of textural characteristics.Such with reference to image in composograph with reference to signal profile and/or the textural characteristics relevant with the subject form on image pixel positions, other positions of composograph can unobstructedly show infrared thermal imagery, and blocking of subject thermal imagery lacked.For example, at the contour images T7 shown in Fig. 8, only can produce the infrared thermal imagery of contour images T7 location of pixels and block, can not produce the infrared thermal imagery of other position and block.Such morphosis data can be vector figure data (as generating the contour images T7 in Fig. 8), can be also dot array data (as generating the texture image W7 in Fig. 7), be that all-transparent shows infrared thermal imagery with reference to profile in image and/or textural characteristics position other location of pixels in addition; Such can opaque or translucent demonstration with reference to image.

Embodied subject the regulation morphological feature with reference to image, can also comprise simultaneously other prompting image as auxiliary, the analyzed area F7(analyzed area F7 that for example represents the primary part observation zone in Fig. 8 is three shaped as frame analyzed area cell formations of S01, S02, S03 by number information), the cue mark B7 that in Fig. 9, representative is taken etc., prompting user note observing with reference to paying close attention to accordingly the position in image.For example, although can by morphosis data obtain to comprise analyzed area F7 in Fig. 8 and profile T7 with reference to image; But preferred embodiment, by morphosis data (obtain profile T7) and auxiliary composition data the analyzed area composition data of analyzed area (as be used for obtaining) jointly obtain as shown in Figure 8 with reference to image (comprising analyzed area F7 and profile T7); Thus, with promote profile T7 with reference to effect, and avoided single assistant images F7 etc. with reference to the shortcoming a little less than property.In an embodiment, auxiliary composition data can be vector figure data, can be also dot array data, or includes simultaneously vector figure data and dot array data.For example be used for acquisition analyzed area as shown in Figure 8, cue mark as shown in Figure 9 etc.Wherein, analyzed area is point, line, surface for example, in reality, usually can comprise the number information of one or more analyzed areas unit (point, line, surface) and territory element; Be used for obtaining the analyzed area composition data of analyzed area, for example comprise the number information of vector figure data and the territory element of territory element.With the composition data of reference image correlation, for example various types of morphosis data reach auxiliary composition data; The composition data that is used for obtaining with reference to image can be one or more, but wherein comprises at least morphosis data.

In addition, specifically auxiliary composition data for example also be used for standard with reference to image the location parameter in infrared thermal imagery; As assist auxiliary object that composition data obtains to be set to the term of reference district, the zone that has represented the auxiliary object representative is as the purpose of primary part observation etc.In addition, specific auxiliary composition data for example has the data of point, line, surface of the relative position relation of regulation with the reference image, when recording processing and the thermal-image data association store, because the data volume of morphosis data is relatively large, record can reduce the storage data volume with the auxiliary composition data of the auxiliary object of the relative position relation that has regulation with reference to image, the object that obtains when auxiliary composition data represented analyzed area the time, this recording mode is of value to follow-up batch processing.

The another kind of the storage part of Fig. 5 signal is implemented the memory contents example, deposited the composition data image-related with reference with type information of a plurality of types of a plurality of subject information and subject information association, the auxiliary composition data such as morphosis data, analyzed area composition data that comprises a plurality of types, the positional information of the image that various composition datas generate in infrared thermal imagery (for example position, size or also have the anglec of rotation), wherein, when auxiliary composition data is a single point (when for example analyzed area is a single point), memory location only.These composition datas can be used to consist of different images with reference to type, and are convenient in use switch, and make good to average out with reference to effect with between the blocking of infrared thermal imagery.

Type information shows the type of various composition datas, and type can be classified according to reference feature, data layout etc. that take to measure purpose, composition data; A kind of embodiment of classification, classify with reference feature, determine type for the regulation that is used for generating with reference to the composition data of image, the user can arrange in menu setting hurdle SZ31 as shown in Figure 3, can arrange with generating with reference to image-related composition data is one or more of morphosis data of profile, texture, other types such as (as visible light, infrared thermal imageries), in addition, also can comprise analyzed area composition data etc.; When multiselect arranges, represented that a plurality of composition datas obtain with reference to image with reference to type, for example, profile and texture have been selected, with reference to having comprised contour images and texture image in image, profile and analyzed area have been selected, with reference to comprising contour images and analyzed area in image.The definite type that arranges can be determined the default value preservation of type as regulation.Obviously, the classification be not limited to single composition data, also can to a plurality of composition datas constitute classify.

The storage implementation mode of morphosis data that represented a subject information association in Fig. 4; The storage implementation mode of composition data of a plurality of types that represented a subject information association in Fig. 5; Also may exist the different subject information of part (as the subject of same model) related identical composition data such as the situation of morphosis data.In the storage implementation example of Fig. 5, also addition type information not, selected by the user.Memory contents in Fig. 4 and Fig. 5 can be deposited with some document forms, for example with the data file of depositing morphosis data of subject information as filename, or further adopts file that these files are classified.Also the memory contents in Fig. 4 or Fig. 5 can be left in the data file of database or prescribed form etc.The composition data of subject information association is for example the composition data of subject information direct correlation; Certain composition data of the direct correlation of subject information for example, this composition data are related again other composition datas, described other composition datas are also the subject information association; For example the subject information association index information of composition data, the composition data that this index information is corresponding is also composition data of subject information association etc.(as filename etc.) carries out related mode if the index information by storage morphosis data in the table of Fig. 4 or Fig. 5, in storage medium also respective stored the file of morphosis data corresponding to index information (as filename etc.) etc.Occasion in infrared detection, often there are the identical different subjects of a large amount of profiles, adopt the mode of subject information and morphosis data correlation to store morphosis data etc., being convenient to the user selects subject information to select according to on-the-spot cognitive subject, avoid composition data to select mistake, and can reduce data redundancy.

Auxiliary storage section 6 is used for reading CD-ROM, storage card etc., is used for reading the infrared thermal imagery that is stored in as storage card, composition data etc.

Operating portion 7: be used for the user and send indication to thermal imagery display device 8, perhaps input set information, operating portion 7 formations such as keyboard, mouse are not limit therewith, can adopt touch-screen or voice control assembly etc. to realize operation yet.

Thermal imagery filming apparatus 9 connects and composes thermal image display system in embodiment with IR image display device 8, is used for subject is taken the acquisition thermal-image data, and the output infrared data.Exemplify a kind of embodiment, see the electrical diagram of thermal imagery filming apparatus 9 in Fig. 1, comprise not shown optics, driver part, infrared eye, signal pre-processing circuit by communication interface 10, shoot part 20(), the formations such as flash memory 30, interim storage part 40, image processing part 50, CPU60, CPU60 has controlled the action of the integral body of thermal imagery filming apparatus 9, has stored control program in flash memory 30.Optics is comprised of the infrared optics lens, and the infrared radiation that is used for receiving focuses on infrared eye; Driver part is carried out according to the control signal driving lens of CPU60 and is focused on or zoom operation, in addition, also can be the optics of manual adjustments; Infrared eye is converted to electric signal to the infrared radiation by optics as the infrared focal plane detector of refrigeration or non-refrigeration type; The signals such as signal pre-processing circuit will be taken a sample under the cycle of regulation from the signal that infrared eye is read, automatic gain control are processed, and are converted to the thermal-image data of numeral through A/D convertor circuit wherein.The thermal-image data that is obtained by shoot part 20 shootings temporarily is stored in interim storage part 40, and by image processing part 50(such as DSP) compress and process or compress through after predetermined processing, the infrared data that obtains is exported through communication interface 10.Difference according to the design and use purpose, the infrared data of thermal imagery filming apparatus 9 outputs can be thermal-image data (the digital thermal-image data of the thermal imagery signal that the infrared eye in thermal imagery filming apparatus 9 produces after the AD conversion, or change through AD the digital thermal-image data that laggard professional etiquette is processed surely), can be also the view data (thermal-image data generate infrared thermal imagery) of infrared thermal imagery, also or the above-mentioned data after the regulation compression algorithm.

CPU1 has controlled the action of the integral body of IR image display device 8, in hard disk 5, the described control program of storage makes described CPU1 carry out the processing that will stipulate by the infrared data that communication interface 4 receives, the processing of CPU1 such as correction, interpolation, pseudo-color, synthetic, compression, decompress(ion) etc. are converted to and are suitable for showing that use, record the processing of data such as use.

CPU1 is as synthetic section, be used for according to described assigned position, continuously the infrared thermal imagery that generates of the infrared data that receives of combined image acquisition unit and according to described given size and according to the determined composition data of reference image determination portion obtain with reference to image, to obtain composograph.

The infrared data that CPU1 is used for that the thermal imagery acquisition unit is received is implemented the processing of regulation and is obtained infrared thermal imagery.For example, the thermal-image data after the data that receive are for compression, the infrared data that the processing of regulation such as CPU1 receive the thermal imagery acquisition unit carry out decompress(ion), pseudo-color the processing; Pseudo-color the processing particularly, for example determine corresponding pseudo-colored steel scope according to the scope of the AD value of thermal-image data or the setting range of AD value, with each AD value of thermal-image data in pseudo-colored steel scope corresponding concrete color value as the view data of its respective pixel position in infrared thermal imagery, at this, the gray scale infrared image can be considered as a kind of special case in the pcolor picture.In addition, the regulations processing such as Nonuniformity Correction, interpolation are also carried out in the processing of regulation as the thermal-image data after decompress(ion), and the thermal-image data after predetermined processing is carried out the color processing of puppet.

Synthetic a kind of embodiment of processing, particularly, position according to the rules for example, with the regulation transparency ratio continuously synthetic infrared thermal imagery and given size with reference to image so that can present simultaneously the subject thermal imagery in the composograph that obtains and embodied subject regulation morphological feature assigned position, given size with reference to image.here said transparency ratio has represented when synthetic the ratio of view data in the composograph respective pixel with reference to image and background (infrared thermal imagery), in pixel after synthetic, with reference to the transparency ratio of image and infrared thermal imagery and be generally 1(when having a plurality of overlapping image, the transparency ratio that can have separate provision, itself and also be generally 1), all overlapping pixels for reference image and infrared thermal imagery, for example obtain the view data of pixel overlapping after synthetic according to formula " pixel after synthetic=with reference to the view data x of the image view data x (1-is with reference to the image transparency ratio) with reference to image transparency ratio+infrared thermal imagery ".The transparency ratio of for example working as with reference to image is 1, the transparency ratio of infrared thermal imagery is 0 o'clock, the view data with reference image relevant position pixel substitutes infrared thermal imagery in the view data of this relevant position pixel, and representative is blocked the image of the infrared thermal imagery of this relevant position fully; As when transparency ratio is impartial, with the view data of the impartial addition of the view data ratio of two images view data as this pixel in composograph, in such composograph, describedly be rendered as translucent state with reference to image, can see through with reference to image demonstration infrared thermal imagery, or be interpreted as that seeing through infrared thermal imagery shows with reference to image.The regulation transparency ratio can be the default value of storage in filming apparatus 1 arranged by operating portion 7 by the user or with attribute with reference to image-related composition data in deposited the transparency ratio of regulation.

obviously, when have a plurality of need to be with the synthetic synthetic object of background (for example, infrared thermal imagery) when (comprising a plurality of synthetic objects with reference to image), for example, synthetic order and corresponding transparency ratio according to each synthetic object successively synthesize processing and obtain final composograph, for example, it is 1 that the synthetic order of synthetic object 1(is arranged) and synthetic object 2(to synthesize order be 2), first synthetic object 1 is synthesized according to its transparency ratio and background (infrared thermal imagery) and obtain data " the view data x of the transparency ratio+background of the view data x synthetic object 1 of synthetic object 1 (transparency ratio of 1-synthetic object 1) " midway, then, synthetic object 2 is synthesized again according to its transparency ratio and described data midway process, namely, the synthetic pixel that this processing obtains obtains according to following formula, the data * (transparency ratio of 1-synthetic object 2) of the transparency ratio of synthetic object 2* synthetic object 2+midway.

The transparency ratio of the threshold values interval range that also can stipulate in addition, and corresponding regulation determines to be arranged in reference to image or infrared thermal imagery the transparency ratio corresponding to view data of this threshold values interval range; Wherein, the threshold values interval range of regulation and the transparency ratio of defined can prestore, and can be also that the user arranges and regulates; The form of expression of described threshold values interval range such as AD value scope, temperature band (value) scope, tonal range, color gamut etc.For example, when the composition data of reference image is thermal-image data, with transparency ratio corresponding to the threshold values interval range (as AD value scope or temperature band scope) of this thermal-image data, when determining to synthesize, the view data that generates with reference to which thermal-image data in image is for show (for example the regulation transparency ratio of the view data that generates of the thermal-image data in the threshold values interval range is 1, other be 0) at composograph.Otherwise, also can decide according to the threshold values interval range (as AD value scope or temperature band scope) of the thermal-image data that take to obtain view data that in infrared thermal imagery, which thermal-image data generates is for show (for example the view data regulation transparency ratio of the generation of the thermal-image data in the threshold values interval range is 1, other be 0) at composograph.Avoid the infrared thermal imagery of part and parcel (in the threshold values interval range) to be blocked.At this, with reference to the transparency ratio of image, or can be also the value that changes.

With infrared thermal imagery with synthesize another embodiment of processing with reference to image, carry out optionally pseudo-color the processing and the acquisition composograph to taking the thermal-image data that obtains in the respective pixel position in infrared thermal imagery with reference to image of position, given size according to the rules as the CPU1 of synthetic section.Particularly, for example be in the respective pixel position with reference to the view data of the image view data as the composograph of this location of pixels, the thermal-image data of this respective pixel position is no longer carried out the processing of pseudo-color conversion, only the thermal-image data beyond the location of pixels of reference image is carried out the view data that pseudo-color conversion obtains infrared thermal imagery, generate composograph with this; For example, thermal-image data with reference to the location of pixels in the corresponding thermal-image data of image, carrying out the pseudo-color difference of processing of the thermal-image data put as numerical digit with other processes, the for example pseudo-color processing of different pseudo-colored steels, carry out again the color processing of puppet etc. after deducting setting such as the thermal-image data to the location of pixels in the corresponding thermal-image data of reference image, generate composograph.But speed up processing.Be applicable to the lines form with reference to image, for hope synthesize by this way process can add respective type information or sign in advance with reference to image in the attribute of its composition data.

Display control unit (CPU1), preferably make display part show the composograph that a kind of of aforesaid way or simultaneously multiple processing mode obtain, realize the described given size that will obtain based on determined composition data with reference to image, according to described assigned position, with the infrared thermal imagery that the thermal-image data of continuous acquisition generates, the common demonstration.But be not limited to this, for example, based on specific display device, also can realize common demonstration with reference to image projection on infrared thermal imagery, at this moment, can remove the above-mentioned functions of the synthetic processing of CPU1.

CPU1 has controlled the action of the integral body of IR image display device 8, for example stores for the program of controlling in hard disk at storage medium, and the various data of using in each several part control.The structure of above-mentioned IR image display device 8 is used for illustrating the specific implementation of embodiments of the invention, is not for the present invention is done restriction.Even those skilled in the art changes said structure as can be known, the present invention also can realize.Below will describe the IR image display method.In the present embodiment, CPU1 is as the example of reference image determination portion, location positioning section, display control unit etc.Figure 10 means the process flow diagram of processing for reference pattern, and Figure 11 is for carrying out the display interface schematic diagram with reference to shooting process to subject.

the present embodiment carries out the application scenarios of continuous monitoring of infrared thermal imagery as example take the subject h7 to power equipment, as shown in Figure 2, the user carries IR image display device 8 and thermal imagery filming apparatus 9 and necessary power supply and telecommunication cable, after IR image display device 8 being connected with thermal imagery filming apparatus 9 and starting, CPU1 implements its control and relevant treatment, make IR image display device 8 receive the infrared data of thermal imagery filming apparatus 9 outputs, and enter the standby display mode, the processing that the infrared data that namely repeatedly the thermal imagery acquisition unit is received is stipulated, be stored in interim storage part 3, and make on display part 2 and show continuously infrared thermal imagery with the dynamic image form, at this state, CPU1 implements its control, whether persistent surveillance has switched to the processing of other patterns or has carried out power-off operation according to predetermined condition, if have, enter corresponding processing controls.When the user is by the reference with reference to image, carry out setting up and adjusting of thermal imagery filming apparatus 9, avoid omitting critical points of measurement, the scheduled operation by operating portion 7 such as mode key or menu setecting reference pattern enter the control procedure that reference pattern is processed; Step is as follows:

Step S101, whether CPU1 persistent surveillance user has selected reference pattern.

At the standby show state, display part 2 shows dynamic infrared thermal imagery, at this moment shooting angle and distance obtain the infrared thermal imagery as shown in display interface G1101 in Figure 11, the user can puzzle in the regulation morphological feature of subject thermal imagery H7 and image space, size, the angle in the infrared thermal imagery at its place in the past, what make thermal imagery filming apparatus 9 sets up and adjusts the reference that there is no quality standard, the speed of setting up or adjusting is slow, and is difficult to obtain the thermal imagery of standard; For guaranteeing the shooting quality standard, select reference pattern to enter step S102 by scheduled operation such as the mode key of operating portion 7.

Step S102 determines and the composition data with reference to image correlation that will be synthetic with infrared thermal imagery.CPU1, determines to stipulate with the synthetic embodiment subject of infrared thermal imagery the composition data with reference to image correlation of morphological feature for the composition data of storing according to storage part as reference image determination portion.Determined composition data comprises morphosis data at least, and namely determined composition data is the morphosis data, or determined composition data comprises morphosis data and auxiliary composition data.

In the present embodiment, in hard disk 5, storage is as Fig. 4 or memory contents shown in Figure 5, in response to the operation of user in step S101, CPU1 is according to the subject information of storage in hard disk 5, to be presented at display part 2 according to the subject information constraint term of the specified quantity of subject Information generation, subject information constraint term list LB as shown in the G1102 in Figure 11, the user is according to the cognition to subject h7, by the cross key in operating portion 7, acknowledgement key is selected and pressed to the subject information constraint term " subject h7 " that finds in LB.At the present embodiment, consisted of the example of selection portion by CPU1, display part 2, operating portion 7, be used for selecting subject information, just selected subject information " subject h7 " according to user's operation.Wherein, subject information is one or more combination of the information that represents the subject identity such as type, title, numbering, place of subject, thus, when subject information constraint term was the combination of a plurality of constraint terms, the operation of selecting to determine subject information constraint term may need a plurality of constraint terms are selected to determine final subject information.The form of expression of subject information constraint term can be numeral, word, icon, figure etc.Selection portion is not limited to show subject information constraint term, also can select subject information by the mode such as the numbering of input subject information etc.

As storage memory contents as shown in Figure 4 in hard disk 5, in response to this operation, CPU1 reads the profile T7 vector figure data corresponding with subject information " subject h7 ", with reference to the positional information of image (contour images T7) in infrared thermal imagery, be sent to interim storage part 3, CPU1 determines the composition data with reference to image correlation that the conduct of profile T7 vector figure data will be synthetic with infrared thermal imagery.

As storage memory contents as shown in Figure 5 in hard disk 5, in response to this operation, CPU1 reads the profile T7 corresponding with subject information " subject h7 ", the composition data of texture W7, analyzed area F7 etc., the positional informations in infrared thermal imagery such as profile T7, texture W7, analyzed area F7, be sent to interim storage part 3, the standby follow-up as uses such as switching, record (also can transmit and wherein set the part that needs).CPU1 determines that according to the rules type is profile, according to the type information of profile T7 vector figure data, determines the composition data with reference to image correlation that the conduct of profile T7 vector figure data will be synthetic with infrared thermal imagery.As not stipulating to determine type, the follow-up composition data of definite corresponding profile T7 of subject information, texture W7, analyzed area F7 etc. simultaneously is configured for generating the composition data with reference to image, or provides the user again to select.Determine type for regulation, the user can arrange in the menu setting hurdle SZ31 of as shown in Figure 3 IR image display device 8, can be wherein one or more.

Be not limited to above-mentioned mode, CPU1 also can be according to the composition datas such as morphosis data of storage in hard disk 5, the selection information relevant with the composition data such as morphosis data that makes that the assigned position of display part 2 shows specified quantity, the user can select, can select one or more, described selection information, as the word that represent composition data identity information relevant with composition datas such as morphosis data, character, icon, numeral, code, thumbnail etc., the composition data identity information can define or edit different application implications.For example, stored the situation of a plurality of composition datas in storage part, CPU1 can show that the image thumbnails that the composition data of specified quantity generates provides the user to select, the user selects with subject applicable according to the form of thumbnail, according to user's selection, determine and composition data with reference to image correlation.As when storing composition data with the form of graphic file, image file in storage medium, when entering reference pattern, CPU1 shows based on relevant filename or the thumbnail of storage in hard disk 5, is selected by the user.Thus, subject information is not to be necessary, and storage part also can only have been preserved the composition datas such as morphosis data.

In addition, the CPU1 as reference image determination portion comes to determine composition data like this; For example, acquiescence is determined certain morphosis data, and it is used as surveys for special object.For example, the also corresponding relation of the composition datas such as the specific keys in setting operation section and specific modality composition data in advance, afterwards, the composition datas such as morphosis data of correspondence are determined in the operation of response specific keys.

In addition, also can determined composition data generate with reference to image and infrared thermal imagery compound display after, response user's scheduled operation such as the switching of directionkeys, determine that the composition data relevant with current composition data generates with reference to image, the composition data relevant with current composition data, refer to relatedly with current composition data, or generated by current composition data, or with other composition datas of selected subject information association.For example the subject information association a plurality of composition datas, can determine to switch at these a plurality of composition datas.

In addition, also can be according to predetermined trigger condition such as extraneous trigger pip as induction, gps signal etc., by the triggering of the corresponding receiving trap (not shown) on IR image display device 8, come definite corresponding with this signal and the composition data reference image correlation.

In addition, also there is this situation, for example preserved the information of subject in the storage medium of IR image display device 8, and be kept at by by in the wired or wireless external unit such as storer, computer etc. that is connected of communication interface 4 with the composition data of subject information association, when the user has selected subject information, CPU1 sends indication to external unit, to obtain by wired or wireless mode and to determine composition data corresponding to subject information.

Step S103, definite assigned position and given size that is positioned at infrared thermal imagery with reference to image;

CPU1 determines that according to the positional information that is sent to interim storage part 3 contour images T7 is arranged in assigned position and the given size of infrared thermal imagery.For example, as shown in Figure 4, storage morphosis data and related positional information thereof in hard disk 5, the representative of described positional information will be arranged in assigned position and the given size of infrared thermal imagery by what these morphosis data generated with reference to image, described location positioning section is used for assigned position, the given size with described positional information representative, and what be defined as that these morphosis data obtain will be arranged in assigned position and the given size of infrared thermal imagery with reference to image.In addition, the position that shows with reference to image, size or also have the anglec of rotation also can input definite by operating portion according to the user; Or, location positioning section arranges with reference to assigned position and the given size of image and (for example gives tacit consent to center position according to position and the size of acquiescence, show with original size, can prepare the composition data with reference to image of suitable dimensions in advance), for example determined by predetermined adaptive region in addition, seen for details embodiment 2.

Step S104 controls the thermal imagery acquisition unit and receives the perform region that infrared data is sent to interim storage part 3.

The infrared data that CPU1 receives communication interface 4 is sent to the perform region of interim storage part 3.In addition, also exist by receiving the situation as PAL video infrared thermal imagery.

Step S105 synthesizes with reference to image and infrared thermal imagery; Particularly, such as the compression thermal-image data (infrared data) that receives is decompressed, revises, the regulation such as pseudo-color conversion processes, the view data of acquisition infrared thermal imagery is kept at interim storage part 3; CPU1 is according to the given size of determining or also have the anglec of rotation to the corresponding predetermined processing of carrying out of profile T7 composition data (vector figure data), position according to the rules, with the view data that generates after processing predetermined monochromatic view data for example, the view data that obtains infrared thermal imagery with institute infrared data experience predetermined processing is synthesized.In the present embodiment, profile T7 can be translucent or opaque.

Step S106, the CPU1 control as display control unit is presented at display part 2 with composograph, as shown in display interface G1103, namely jointly shows with reference to image and infrared thermal imagery, then enters step S107.can find out between subject thermal imagery H7 and contour images T7 and have larger difference, can imagine, as not having with reference to image with reference to means, the user relies on subjectivity to set up or adjust thermal imagery filming apparatus 9, (a lot of users have often only taken incomplete subject thermal imagery in practice often to make the form of the subject thermal imagery H7 of shooting, perhaps inappropriate shooting angle) and the image space in infrared thermal imagery, size, angle, be difficult to subjective assurance, not only easily omit the focus measurement position, and cause the quality of infrared thermal imagery continuous monitoring or record lack of standardization.

at this, the user also can be switched the operation with reference to the image construction data, as when in hard disk 5 during as shown in Figure 5 memory contents of storage, the changeable demonstration other types of user with reference to image etc., to help reference, particularly, CPU1 response user's blocked operation, to be sent to the analyzed area F7 of interim storage part 3 in step S102, the composition data of the other types that texture W7 etc. are related with subject information or contour images T7 is determined, separately or synthesize (not shown in Figure 11) with infrared thermal imagery together with contour images T7, strengthen with reference to effect.

Step S107, CPU1 implement its control, monitor whether the user withdraws from reference pattern.

If have, finish reference pattern and process, for example switch to the pattern that shows infrared thermal imagery, or enter the logging mode as embodiment 3.As do not have, with the step of repeating step S104-S106, display part 2 shows synthetic continuously Dynamic IR thermal imagery and with reference to image, has reflected that the user takes the process (setting up or adjust the process of thermal imagery filming apparatus 9) of adjustment according to reference image T7.for example, all there is larger morphological differences in display interface G1103 between subject thermal imagery H7 and contour images T7, the user is according to the vision reference of contour images T7, the form of just having understood the subject thermal imagery H7 that needs shooting requires and the image space in infrared thermal imagery, size, angle, then by the optics of adjustment thermal imagery filming apparatus 9 and the shooting distance between subject h7, angle, image space, make visually being in contour images T7 as display interface G1104 subject thermal imagery H7 in Figure 11 of obtaining overlap matching status, obviously, the infrared thermal imagery that obtains like this meets the desired standard quality standard that reaches as reference image T7, the thermal imagery filming apparatus 9 that representative is set up and the position of subject h7, distance, angle reaches the requirement of expection, can greatly improve the quality of infrared thermal imagery continuous monitoring, can imagine, in infrared shooting as do not embody subject regulation morphological feature with reference to image with reference to means, the user needs the position of the subjective shooting angle that remove to try to figure out subject h7, distance, shooting, easily omit the focus measurement position, and the speed of setting up is slow.Afterwards, reselect the reference shooting that reference pattern enters next subject, also can enter other mode treatment.

As mentioned above, in the present embodiment, owing to having adopted pre-stored subject information and the morphosis data of subject information association, therefore be convenient to the morphosis data according to subject information is selected and definite subject is corresponding; Due to the associated positional information of storage morphosis data in hard disk 5, avoided like this position adjustment to the reference image, standard simple to operate; Due to the assigned position that presents in composograph, given size and embodied the subject contour feature with reference to image, take the subject thermal imagery vision reference be provided for the user sets up or adjust thermal imagery filming apparatus 9, to the shooting angle of subject, take the position, shooting distance has carried out prompting and standard; And, owing to having adopted the outline shape composition data to consist of with reference to image, make the effect of reference better.Obviously, reference according to the reference image, the user is very clear to photographing request, need not the accumulation of the experience of depending on unduly and subjective idea, can take difficulty by decrease, improve and detect setting up and regulating the speed of quality and thermal imagery filming apparatus, common user also can reach good shooting level of skill.Embodiment 1 is more excellent embodiment, and certainly, arbitrary product of implementing embodiments of the present invention might not need to reach simultaneously above-described all advantages.

Embodiment 2,

Different from embodiment 1 is, the present embodiment is in having the IR image display device 8 identical with structure shown in Figure 1, in hard disk 5, has stored for carrying out and has made the control program that shows in the adaptive region self-adaptation with reference to image.Figure 12 means the process flow diagram that (self-adaptation demonstration) reference record mode treatment is controlled.Figure 13 is the self-adaptation display effect schematic diagram after local configuration image " placed in the middle with reference to image " is processed.Figure 14 is the self-adaptation display effect schematic diagram after local configuration image " placed in the middle with reference to scope " is processed.Figure 15 is that the subject information of storage portion stores and the another kind of morphosis data are implemented schematic diagram.Figure 16 is that the subject information of storage portion stores and the another kind of a plurality of type constitution data are implemented schematic diagram.The display interface schematic diagram of Figure 17 for determining that (self-adaptation demonstration) takes subject h7 with reference to image.Figure 18 implements schematic diagram for a kind of data structure of the thermal imagery file of record.Figure 19 means when the subject thermal imagery when mating with reference to picture registration, the infrared thermal imagery effect schematic diagram that comprises the subject thermal imagery of record.

In the present embodiment, as the CPU1 of location positioning section according to adaptive region the size in infrared thermal imagery and position, and with reference to image the position in adaptive region, determine with reference to image assigned position and given size in infrared thermal imagery.

Adaptive region is to be used for self-adaptation to show regulation zone with reference to image etc. in infrared thermal imagery, the self-adaptation demonstration refers to reference to the assigned address of image in this adaptive region, carry out that the fixing maximization of non-that overflow, aspect ratio shows in adaptive region, the present embodiment is varied angle not.But the situation that varied angle also can be arranged.

Usually, the subject thermal imagery that expectation is taken has the size of regulation, and is preferably placed in the middle, adaptive region is set can be convenient to show with reference to the image standard.Adaptive region hurdle SZ32 in Fig. 3 is used for adaptive region being set in position, the size of infrared thermal imagery, accounts for appointed area in infrared thermal imagery window ratio or infrared thermal imagery etc. as setting.Wherein with reference to hurdle, picture position SZ33, be used for arranging with reference to image in the position of adaptive region as " placed in the middle with reference to image ", " district is placed in the middle with reference to scope " are set, be not limited to central point, also other assigned addresses, or also have the anglec of rotation.After completing, can preserve the self-adaptation parameters that is provided as acquiescence.

CPU1 is used for carrying out with reference to the assigned position that is positioned at infrared thermal imagery after the image adaptive convergent-divergent, the calculating of given size, " show between two parties " as example in adaptive region between two parties and with reference to image in infrared thermal imagery take the adaptive region that arranges, CPU1 calculates adaptive region (size X1, Y1) with reference to image (before convergent-divergent with reference to picture size X2, Y2) X-axis, Y-axis ratio, choose the ratio of an axle less in X1/X2 and Y1/Y2, when placed in the middle as the reference image based on the convergent-divergent rate of reference image center, thus, what obtain that self-adaptation shows is arranged in the assigned position of infrared thermal imagery with reference to image, given size.Figure 13 has illustrated the effect that local configuration image T13 " placed in the middle with reference to image " shows.

In addition, also comprise between two parties this situation with reference to image, when determining that a plurality of composition datas are used as with reference to image-related composition data, the composition data that CPU1 is used for determining makes up to obtain combination with reference to image as compound object, and the at this moment processing of " the placed in the middle demonstration " can be that combination is with reference to the demonstration placed in the middle of image.The image that it should be noted that the composition data generation of each type that participates in combination might not all show.

but the image that the composition data that ought for example represent the local regulation morphological feature of subject generates adopts the processing of " placed in the middle with reference to image ", may bring image that these composition datas generate (with reference to image, or with reference to the part in image) be not to be to represent desired subject with reference to scope, for example shown in Figure 15ly can't be used for taking that subject is whole uses with reference to image, the assigned position in infrared thermal imagery and the given size with reference to image section that generate for further various composition datas of standard, can be one of image setting that composition data generates common with reference to the scope district, with reference to image corresponding with reference to the scope district represented this with reference to the demonstration of image specification with reference to scope, storage for example each image that generates in a plurality of composition datas of corresponding same subject with respect to described positional information (position with reference to the scope district, size, or also has the anglec of rotation), image that these composition datas generate can be kept and standard with reference to the relative position in scope district.When the reference image has with it corresponding to the scope district, at this moment the processing of " placed in the middle with reference to scope " refers to reference to the self-adaptation in scope district placed in the middle, after self-adaptive processing with reference to image with remain unchanged with reference to the relative position in scope district (position, size or also have the anglec of rotation).

On the one hand, show excessive situation with reference to what the application in scope district can avoid representing the local regulation morphological feature of subject with reference to image, for example usually with the outsourcing rectangle of integrity profile as local configuration with reference to image with reference to the scope district; Figure 14 has illustrated local configuration image T13 " placed in the middle with reference to scope " display effect, and with the difference that the local configuration image T13 " placed in the middle with reference to image " of Figure 13 shows, in Figure 14, T13 is corresponding is that it not necessarily shows with reference to scope district L13.The district can be pre-stored with reference to scope, can be also that the user arranges input, can be also in the composition data with the reference image correlation, or acquisition is calculated in a plurality of combination afterwards.When the reference image has with it corresponding to the scope district, at this moment the processing of " placed in the middle with reference to scope " refers to reference to the self-adaptation in scope district placed in the middle, after processing with reference to image with remain unchanged with reference to the relative position in scope district (position, size or also have the anglec of rotation).CPU1 is positioned at the assigned position of infrared thermal imagery and the calculating of given size with reference to image when being used for carrying out " placed in the middle with reference to scope ".At first calculate adaptive region (size X1, Y1) with X-axis, Y-axis ratio with reference to (size X3, the Y3 before convergent-divergent) in scope district, choose the ratio of an axle less in X1/X3 and Y1/Y3, obtain the convergent-divergent rate based on reference scope district center point when placed in the middle with reference to scope district self-adaptation; Then can be according to reference image (before convergent-divergent) relative position in reference scope district (convergent-divergent before) (position, size or the anglec of rotation) in addition, convergent-divergent rate when placed in the middle according to reference scope district self-adaptation is carried out the convergent-divergent rate of convergent-divergent based on reference scope district center point as the reference image, calculate when placed in the middle with reference to scope district self-adaptation, be arranged in assigned position, the given size of infrared thermal imagery with reference to image.

On the other hand, also the user can be needed the primary part observation position as reference scope district, further improve the effect of reference.For example with analyzed area as reference scope district.At this moment, although may cause overflowing with reference to image section, this overflowing because being suitable for using needs can be accepted.Like this, the user comes into subject and takes, and the reference with reference to image has also been arranged, and has guaranteed the quality of taking.By conversion term of reference district, can realize the conversion on different display positions, realize different shooting purposes.

In the present embodiment, a kind of storage implementation mode memory contents as shown in figure 15, comprise subject information, the corresponding outline shape composition data of subject information, can not store the positional information in infrared thermal imagery with reference to image that each outline shape composition data generates.

another kind of storage implementation mode memory contents as shown in figure 16, comprise subject information, the corresponding various composition datas with type information of subject information, , the image that various composition datas obtain (convergent-divergent is processed front) (for example is arranged in the position of profile with respect to the positional information of profile (convergent-divergent is processed front), size, or also has the anglec of rotation), the image that the outsourcing rectangle that also can be regarded as profile obtains as other composition datas with reference to the scope district, can store or not store the positional information of image in infrared thermal imagery that the outline shape composition data generates.The image that also combination that obtains after a plurality of composition datas (a plurality of composition datas of a subject information association of for example storing in Figure 16) combinations can be generated as these composition datas with reference to the outsourcing rectangle of image in addition, with reference to the scope district; Can store each image that generates in a plurality of composition datas with respect to described position and dimension information with reference to the scope district.The image that generates with reference to scope district and each composition data corresponding to the image that preferably, storage composition data and composition data generate in described storage part (hard disk 5) is with respect to the relative position information (for example storage is arranged in position, the size with reference to the scope district or also has the anglec of rotation) in reference scope district.

Note, store the relative position relation of the regulation between the object that each composition data of same subject information association obtains (hereinafter, relative position relation also referred to as the regulation between composition data), the embodiment of Fig. 5 is for example stored the positional information that object that all types of composition data of same subject information association obtains lays respectively at (for example in infrared thermal imagery) in same reference system; Embodiment that also can be as shown in figure 16; But be not limited to this, for example given the relative position relation of the regulation between the object that each composition data obtains by the user, perhaps given the relative position relation etc. of the regulation between the object that each composition data obtains by the location rule of the acquiescence of IR image display device 8.

The below introduce shown in Figure 12 according to adaptive region with reference to the photographing process flow process, the present embodiment is according to the situation of the adaptive region Z1 that arranges and " placed in the middle with reference to image ".

Step S201, at the standby show state, display part 2 shows dynamic infrared thermal imagery, the infrared thermal imagery as shown in display interface G1701 in Figure 17, CPU1 are implemented its control, when the user has selected the self-adaptation reference pattern, enter step S202;

Step S202, the composition data that is identified for generating with reference to image is profile T7 vector figure data.The enforcement processing mode of determining is referring to step S102.

Step S203 determines with reference to image the assigned position in infrared thermal imagery and given size according to adaptive region;

As the CPU1 of location positioning section according to adaptive region Z1 size and the position in infrared thermal imagery, assigned position, the given size of contour images T7 in infrared thermal imagery determined in and the middle position in adaptive region Z1.

Step S204 controls thermal imagery acquisition unit reception infrared data and is sent to interim storage part 3.

Step S205, CPU1 is according to the carry out respective handling of the given size of determining to profile T7 composition data (vector figure data), synthesize the view data of the contour images T7 that obtains after processing position according to the rules with the view data of the infrared thermal imagery of the infrared data experience predetermined processing acquisition of reception.

Step S206, the CPU1 control as display control unit is presented at display part 2 with composograph.Display interface as shown in display interface G1702 in Figure 17,

Step S207, CPU1 implement its control, monitor whether the user withdraws from reference pattern.

If have, finish reference pattern and process.As do not have, step with repeating step S204-S206, display part 2 shows synthetic continuously Dynamic IR thermal imagerys and with reference to image, the reflection user utilizes composograph to set up or adjusts the process of thermal imagery filming apparatus 9, when the subject thermal imagery H7 that reaches as shown in display interface G1703 in Figure 17 overlaps matching status with contour images T7, represent that setting up thermal imagery filming apparatus 9 reaches predetermined requirement.In follow-up monitoring, the user can also switch (reassigning) display analysis zone F7 or demonstration comprise analyzed area F7 and contour images T7 with reference to image, monitor purpose, the display interface as shown in display interface G1704 in Figure 17 to strengthen.

As mentioned above, according to predetermined size and the position of adaptive region in composograph, and with reference to image the position in adaptive region, determine the position, the size that show with reference to image in infrared thermal imagery.Therefore have the following advantages, to the demonstration of reference image standard more, the user is more readily understood for the demonstration of reference image.According to the reference of reference image, the user is very clear to requiring of taking, and has avoided omission, thereby has guaranteed the quality of infrared thermal imagery.

Embodiment 3,

In the above-described embodiment, when completing after the setting up and adjust of thermal imagery filming apparatus 9, CPU1 is as recording section, the operation that response is predetermined, the data recording that the infrared data that will receive by the thermal imagery acquisition unit and/or the infrared data of reception carry out obtaining after predetermined processing is to recording medium (as hard disk 5).

Particularly, for example a kind of embodiment is the response record indication, CPU1 carries out predetermined processing to the infrared data of the infrared data that receives and/or reception and (processes as compressing after the processing such as decompress(ion), correction, interpolation the data that obtain again, can be static or dynamic embodiment), be saved in interim storage part 3, then be recorded to hard disk 5.In the infrared thermal imagery that the infrared data of record acquisition generates like this, the imaging form of subject thermal imagery H7 and the image space in infrared thermal imagery, size, angle meet contour images T7 as the code requirement with reference to desired acquisition, and for example Figure 19 comprises the schematic diagram of the infrared thermal imagery of subject thermal imagery H7.

Preferred mode is related and be recorded to recording medium (as hard disk 5) for the infrared data of infrared data that regulation recorded information and thermal imagery acquisition unit are received and/or reception carries out the data foundation that obtains after predetermined processing.The regulation recorded information has following situation at least:

1) represent the information of subject information;

Described subject information is selected subject information; Representing the information of subject information, can be subject information, perhaps the part in subject information, perhaps index information corresponding to subject information; For example, in the present embodiment, the subject information of subject h7 can be set up the related record that carries out with infrared data, when comprising the configuration information such as device type, numbering, place when this subject information, can record all or wherein a part as record number.

2) has the composition data of object of the relative position relation of regulation with reference to the composition data of image or with the reference image.

Wherein, when definite a plurality of composition datas obtain with reference to image, can record one or more with reference in the composition data of image.

Wherein, the composition data of object that has the relative position relation of regulation with the reference image; For example, with reference to the composition data of the composition data association of image, in the present embodiment, the information of record is the vector figure data of profile T7; The composition data that also is associated with other when the vector figure data of profile T7 is as being associated with analyzed area F7 composition data, texture W7 dot array data, and the composition data that so also can record other is as record analysis zone F7 composition data.When by the subject information association during composition data, be for example the composition data with selected subject information association, or wherein one or more during related a plurality of composition data.Although it should be noted that the composition data of determining is profile T7 vector figure data, when being associated with a plurality of composition data, also can not record profile T7 vector figure data, and the regional F7 composition data of record analysis etc.For the regulation record type of composition data, the user can arrange in menu setting hurdle SZ35 as shown in Figure 3, such as can be set to the types such as profile, texture, analyzed area composition data one or more etc.

Wherein, the composition data of object that has the relative position relation of regulation with the reference image; For example processing rule according to the rules is to specifying the composition data of processing object processing acquisition; Described processing object for example, specified with reference to image the morphosis data or (having the relative position relation of regulation) other morphosis data of its association.See follow-up embodiment for details.

Wherein, the composition data of object that has the relative position relation of regulation with the reference image; For example computation rule calculates to the appointment calculating object composition data that obtains according to the rules; Described calculating object for example, specified with reference to image composition data or (having the relative position relation of regulation) other composition datas of its association.See follow-up embodiment for details.

3) with reference to image, or have the object of the relative position relation of regulation with the reference image, be arranged in the positional information of infrared thermal imagery.

For example, in the present embodiment, when the subject information association of subject h7 profile T7 vector figure data, texture W7 dot array data, analyzed area F7 composition data, the location parameter in each comfortable infrared thermal imagery of object that these composition datas obtain can be recorded, wherein one or more can be preserved.In addition, positional information comprises location parameter and/or the rule relevant with location parameter, for example can record the parameter information of adaptive region as positional information, follow-uply can reappear according to this parameter information the location parameter of contour images T7.

4) has the identity information of composition data of object of the relative position relation of regulation with reference to the composition data of image or with the reference image.The above-mentioned composition data of storing in storage part has with it corresponding identity information (as the numbering of composition data, index information etc.), also identity information and infrared data can be set up associated record.

Obviously, can be one or more in above-mentioned information.The essence of above-mentioned associated record is that the follow-up needed information of batch processing analysis be convenient in record.Wherein, record subject information and be convenient to follow-up infrared data be sorted out, the infrared data after sorting out according to for example database of memory contents shown in Figure 5, is arranged corresponding analyzed area according to subject information, carry out the batch processing analysis.Record can obtain the morphosis data of subject form and/or positional information and be convenient to follow-uply arrange with reference to analyzed area corresponding to image or also can re-start adjustment; Follow-up batch processing analysis is convenient in the record analysis zone.For ease of multiple applications, preferred, be composition data and the positional information in infrared thermal imagery, analyzed area F7 composition data and the positional information in infrared thermal imagery thereof that records simultaneously subject information, contour images T7.

According to the difference of using, the recording processing of infrared data has following situation, the data that for example will obtain afterwards by the processing that infrared data and/or the infrared data of communication interface 4 receptions are stipulated are carried out record, processing such as the decompress(ion), correction, interpolation of regulation, pseudo-color, to be converted to Temperature numerical, compression etc. a kind of or simultaneously multiple, also thermal-image data can be experienced the common record of the data that obtain after different disposal, for example record the temperature value of each pixel that thermal-image data obtains and the view data of infrared thermal imagery.

For the two kinds of situations that record of IR image display device 1, record infrared thermal imagery picture (capturing as utilizing to make an inspection tour), continuous recording thermal-image data stream.

For recording the infrared thermal imagery picture, for example, based on the control of CPU1, utilize the infrared data in this moment obtain, compress after the processing that CPU1 puts rules into practice to this infrared data; CPU1 controls afore mentioned rules recorded information and compression heat picture in interim storage part 3 is stored in hard disk 5 explicitly.Its essence is and recorded position and the size of subject thermal imagery in infrared thermal imagery, be convenient to follow-up batch processing analysis.

For continuous recording thermal-image data stream, for example, based on the control of CPU1, utilize the infrared data that is obtained continuously, the living document compression that CPU1 puts rules into practice to this continuous infrared data; Perhaps, the living document compression that puts rules into practice after the image that this infrared data is put rules into practice is processed; CPU1 controls afore mentioned rules recorded information and compression heat in interim storage part 3 is stored in hard disk 5 explicitly as data streaming file.

Associated record is processed particularly, for example CPU1 response user sends the record indication, be saved in interim storage part 3 after the processing that CPU1 puts rules into practice to infrared data, CPU1 controls regulation recorded information and infrared data in interim storage part 3 is recorded in hard disk 5 explicitly.The regulation recorded information mode related with infrared thermal imagery added as the information of the infrared data of prescribed form as stipulating recorded information, see the schematic diagram of the infrared thermal imagery file storage structure that comprises the regulation recorded information in Figure 18, wherein, infrared data 1801 is the thermal-image data after compressing; Regulation recorded information 1802: subject h7, T7 composition data, F7 composition data, profile T7 are arranged in the positional information of infrared thermal imagery, the positional information that analyzed area F7 is arranged in infrared thermal imagery; The time of other additional informations 1803 as shooting etc.In addition, also the regulation recorded information can be recorded in message file or the index file of thermal imagery file association mediumly, can generate this message file or index file as the CPU1 that records section.

Wherein, " positional information of T7 " expressed position and the size that subject thermal imagery H7 as shown in the display interface G1704 in Figure 17 is arranged in infrared thermal imagery IR0." positional information of F7 " represents that analyzed area F7 is arranged in assigned position and the given size of infrared thermal imagery IR0, when having stored table as shown in Figure 5 in hard disk 5, can obtain according to the positional information of the composition data association of analyzed area F7 the positional information of analyzed area; When in hard disk 5 during as shown in figure 16 table of storage, positional information that can profile T7 relative to analyzed area F7, and assigned position and given size that T7 is arranged in infrared thermal imagery obtain position and the size that analyzed area F7 is arranged in infrared thermal imagery.Can be when the assigned position in infrared thermal imagery and given size are set with reference to image T7, also be provided with the location parameter that analyzed area F7 is arranged in infrared thermal imagery, be stored in the regulation zone of interim storage part 3, in order to follow-up use.Can be also when recording processing, the location parameter that analyzed area F7 is arranged in infrared thermal imagery is set.In addition, be that (processing and/or calculate) generates if need the composition data of record, can be when the composition data of specifying with reference to image, namely generating needs the composition data that record; Also can when recording processing, generate the composition data of needs record etc.

The schematic diagram of the corresponding infrared thermal imagery IR0 of thermal-image data that Figure 19 records for reference image T7 vision matching the time, wherein subject thermal imagery H7 is arranged in position and the size standard of infrared thermal imagery IR0, and profile T7 positional information has represented that namely H7 is positioned at the location parameter of infrared thermal imagery IR0.

In addition, the storage medium of record is not limited to hard disk etc., can be also the network destination by communication interface 4 communications.

In addition, also can generate the thermal imagery filename according to subject information, the described section of record has the filename generation unit, is used for Heat of Formation as the filename of file, and described filename comprises the information information-related with the subject of appointment at least; The thermal imagery filename that for example generates: subject h7.jpg; Preferably, generate the filename that comprises classified information according to the classified information in subject information, further, with temporal information " 20080222 " in conjunction with the spanned file name, subject h7-20080222.jpg for example; The essence of associated record is that the follow-up needed information of batch processing analysis be convenient in record, make the user be convenient to check and comprised subject information in filename, generate the discernible filename that comprises classified information according to the classified information in subject information, make follow-up batch processing analysis be convenient to read and identify classified information in filename.

In addition, can be also that frame of recording prescribed, for example the infrared data of record can be the regulation frame that is kept in interim storage part 3; For example record that frame thermal-image data that temperature surpasses reservation threshold; Such as continuous recording multiframe thermal-image data etc.

In addition, record indication also is not limited to send indication by the user, can be for example CPU1 judgement subject thermal imagery when being complementary with reference to image or feature templates, and perhaps, when temperature surpassed threshold values, perhaps, regulation waits constantly carried out record.

In addition, if adjust position, the size of (redefining) contour images T7 or also have the anglec of rotation to remove to mate subject thermal imagery H7 as shown in display interface G1103, the record indication that the CPU1 response is predetermined, for example the user sends record by operating portion when contour images T7 coincides with subject H7 to it and indicates adjusting, contour images T7 after record is adjusted in infrared thermal imagery position, size or also have the anglec of rotation, its essence is recorded subject thermal imagery H7 in infrared thermal imagery position, size or also have the anglec of rotation.This application also can be regarded as utilize contour images T7 measure and record subject thermal imagery H7 as shown in display interface G1103 in infrared thermal imagery position, size or also have the anglec of rotation.In addition, can be also that frame of recording prescribed, for example the infrared data of record can be the regulation frame that is kept in interim storage part 3; For example record that frame thermal-image data that temperature surpasses reservation threshold.

In addition, CPU1 can also have the transparent object specifying part, be used for the user from display part show with reference to image, specify the object that needs to change transparency ratio (for example in the present embodiment with reference to image T7), and response user's scheduled operation, change the transparency ratio of specified object.

As mentioned above, in the present embodiment, when the regulation morphological feature image section of reference image representative overlaps the laggard line item of coupling with the subject thermal imagery, like this, can obtain the subject thermal imagery of standard.Obviously, regulation recorded information and infra red data as-sodation are preserved and are made the follow-up computing machine batch processing that is easy to.

Embodiment 4, the present embodiment is in having the IR image display device 8 identical with structure shown in Figure 1, different from embodiment 1, in hard disk 5, stored and be used for carrying out the predetermined operation of response, shoot part is taken the thermal-image data of acquisition regulation or the infrared thermal imagery that described thermal-image data obtains, be defined as with (embodiment subject regulation morphological feature) with reference to image-related composition data, further, this composition data is processed to obtain morphosis data or the further control program that obtains with reference to image.Below will describe this IR image display method (the processing reference pattern comprises cooked mode, reference pattern), and take in enforcement at this, processing object specifying part (CPU1) is used to specify processing object; Image processing department (CPU1), processing such as the image that described processing object is put rules into practice that is used for that described processing object is carried out process such as shear, feature extraction (as the threshold values scope extract, edge extracting), enhancing, filtering, pseudo-coloured silk, brightness adjustment, color adjustment etc. one or more.Storage part (interim storage part 3 etc.) is used for the morphosis data that storage processing obtains; With reference to image determination portion (CPU1), be used for to process the composition data with reference to image correlation that the morphosis data that obtain are defined as and will be synthetic with infrared thermal imagery.Figure 20 means the process flow diagram of processing reference pattern processing controls.Figure 21 is a kind of display interface schematic diagram with reference to shooting with reference to image that shearing obtains the morphosis data and utilizes these morphosis data to generate of implementing.Figure 22 a kind ofly implements edge extracting processing and obtains the morphosis data and generate display interface schematic diagram with reference to the process of image.The present embodiment carries out infrared monitoring based on following use scenes to the subject h21 in certain transformer station, and is different from embodiment 1, do not store the morphosis data of corresponding subject h21 in hard disk 5, for clearly taking task and guaranteeing to detect quality; Utilize IR image display device 8 to carry out the collection of morphosis data.Processing is as follows with reference to controlling step in photographing process:

Step S301, display part 2 shows dynamic infrared thermal imagery, and CPU1 implements its control, and whether the persistent surveillance user has selected cooked mode; At this moment, the infrared thermal imagery shown in display part 2 interface G2101 may be puzzled in distance and the angle of taking subject thermal imagery H21 user in the past, thereby setting up or adjusting of thermal imagery filming apparatus 9 produced puzzlement; At this moment, selected the shearing pattern to enter step S302 by the mode key of operating portion 7, the user can be in processing menu setting hurdle SZ34 as shown in Figure 3 the Choice and process type.

Whether step S302, CPU1 persistent surveillance user have sent the indication of processing object appointment; The selection of response shearing pattern, CPU1 controls and makes display part 2 show a rectangle shearing frame J21, the user adjusts angle, the distance that subject h21 takes, or adjustment share zone J21, the subject thermal imagery H21 that makes expectation therefrom obtain the morphosis data is arranged in share zone J21, as shown in display interface G2102.Then, press acknowledgement key, CPU1 responds this operation, for example the infrared data that receives is kept at the regulation zone of interim storage part 3, CPU1 is defined as processing object with thermal-image data or the infrared thermal imagery that this infrared data carries out obtaining after predetermined processing, enters step S303.At this, the infrared thermal imagery that this thermal-image data can be carried out obtaining after predetermined processing (as pseudo-color the processing) is defined as processing object, as follow-up need, the pseudo-coloured silk with reference to image of processing the morphosis data that obtain is carried out conversion, thermal-image data is more suitable as processing object.In addition, when IR image display device 8 also with the imaging device (not shown in Fig. 1) of other types, the image that also can use other imaging devices to gather, the image that the Visible Light Camera that for example is connected with IR image display device 8 (not shown in Fig. 1) gathers is used as processing object; In addition, can also be to be used as processing object such as the infrared thermal imagery of reading pre-stored from hard disk 5 or visible images etc. or other morphosis data.

Step S303 carries out the processing of processing object and processes; Thermal-image data as in the CPU1 extraction share zone J21 of image processing department then enters next step.

Step S304, the morphosis data that storage processing obtains, the data that this shearing obtains are kept at interim storage part 3 as the morphosis data, at this, also the morphosis data that processing obtains can be recorded in hard disk 5, or enter the pattern that arranges as embodiment 5.

Step S305, the morphosis data that processing is obtained are defined as the morphosis data with the reference image correlation;

To process as the CPU1 of reference image determination portion the morphosis data that obtain is defined as for generating the morphosis data with reference to image correlation synthetic with infrared thermal imagery.Enter step S306.

Step S306, definite assigned position and given size that is arranged in infrared thermal imagery with reference to image; In the present embodiment, viewing area parameters (adaptive region Z1 according to acquiescence, what the morphosis data of, in Figure 21 not shown viewing area Z1 placed in the middle with reference to image) determining to obtain according to processing generated will be arranged in position and the size of infrared thermal imagery with reference to image.

Step S307, the infrared data that the thermal imagery acquisition unit is received is sent to interim storage part 3;

Step S308 synthesizes with reference to image and infrared thermal imagery; CPU1 controls, according to the given size of determining, CPU1 carries out respective handling and changes through the puppet coloured silk view data that obtains with reference to image TU21 shearing the morphosis data that obtain, position according to the rules, according to the corresponding acquiescence transparency ratio of shearing, the infrared thermal imagery that the infrared data that receives with reference to the view data of image TU21 and thermal imagery acquisition unit generates synthesizes.

At step S309, show composograph, as shown in the display interface G2103 in Figure 21.Like this, the user can take subject thermal imagery H21 according to the reference of the part of the subject thermal imagery form in translucent image TU21, and carries out setting up of thermal imagery filming apparatus with this.

Step S310, CPU1 implement its control, monitor whether the user withdraws from reference pattern.If have, finish reference pattern and process.As do not have, with the step of repeating step S307-S309.

Then, the user is according to the vision reference of translucent image TU21, the form that needs the subject thermal imagery H21 that takes and the image space in infrared thermal imagery, size, angle have just been understood, the then optics by adjusting thermal imagery filming apparatus 9 and shooting distance, angle, the image space between subject h21, make obtain as subject thermal imagery H21(display interface G2104 in Figure 21) visually be in matching status with subject thermal imagery form part in translucent image TU21.At this moment, just reached the quality requirements that sets up and adjust.

The user also can arrange the morphosis data with reference to image TU21 that obtain and be saved in hard disk 5 so that later consulting and using similar subject.

As mentioned above, in the present embodiment, carry out shearing by the processing object of determining, the composition data with reference to image correlation that will process then that the morphosis data that obtain are defined as and will synthesize with infrared thermal imagery can obtain applicable with reference to image quickly and easily; Determine the assigned position in infrared thermal imagery and given size with reference to image according to adaptive region, can promptly carry out standard to position and the size of reference image; Afterwards, rely on reference to image similar subject based on identical distance, roughly the same the shooting of angle, guaranteed the standardization of infrared thermal imagery.At this, above-mentioned advantage is that the representational embodiment operation as a system is performed.But also might the user carry out certain situation, as shear, directly with operation response and the infrared data that the thermal imagery acquisition unit receives is determined to use as the morphosis data, and carry out translucent synthetic with follow-up infrared thermal imagery.Certainly, arbitrary product of enforcement embodiments of the present invention might not need to reach simultaneously above-described all advantages.

In addition, also might the user carry out certain situation, the morphosis data that the processing that for example will obtain obtains arrange related information record (seeing embodiment 5 for details), then enter the shooting reference pattern again, and the similar subject of follow-up shooting can conveniently be used.

Below introduce the processing of edge extracting, the extraction of prescribed threshold scope.

By processing sets up hurdle SZ34 shown in Figure 3, select edge extracting as the user, as the CPU1 of the image processing department algorithm according to regulation, the processing object of determining is carried out the processing of edge extracting.

Exemplify a kind of embodiment that edge extracting is processed.the infrared thermal imagery of processing object as shown in G2201 in Figure 22, at first, threshold values scope is according to the rules carried out binaryzation to the processing object of determining, wherein, the threshold values scope of regulation can be the threshold values scope that prestores, it can be also the threshold values scope that the user arranges and regulates, the image of binaryzation can show or not show, the setting of manually carrying out binaryzation threshold values scope is convenient to obtain the bianry image effect of user's wish, therefore, the image of demonstration binaryzation is convenient to manually carry out the adjusting setting of binaryzation threshold values scope, take infrared thermal imagery as example, the operation format of the threshold values scope that arranges and regulate for example arranges thermal-image data AD value scope, the threshold values scope of temperature, tonal range, colour code scope etc., the oblique line part of subject thermal imagery after binaryzation as shown in the G2202 in Figure 22.Then, arrange and extract regional J22, as shown in the G2203 in Figure 22, determine the extraction zone J22 of expectation, wherein have the image EZ22 after subject H22 two-value.Then, to the two-value thermal imagery EZ22 after the binary conversion treatment that is arranged in the extraction zone, the processing of extracting connected region.Then, connected region is carried out edge detection process, the edge contour data of two-value thermal imagery EZ22 in the G2203 that obtains after edge extracting.After completing the edge extracting processing, the morphosis data that processing is obtained are kept in interim storage part 3 or hard disk 5, wherein, also can carry out preserving after vectorized process to the edge contour data that obtain.In this example, edge extracting is processed and is comprised binary conversion treatment, then arranges and extracts the zone, then extract connected region and edge detection process.But the edge extracting processing that also can comprise binary conversion treatment, extract connected region, edge detection process is then sheared or does not shear.In addition, can be also infrared thermal imagery or the visible images that other processing obtain as shearing, then carry out edge extracting and process.

The morphosis data that the processing that process to obtain when edge extracting obtains be confirmed as to will with infrared thermal imagery synthetic with reference to the relevant composition data of image, be shown as contour images T22 as shown in G2204 through self-adaptation placed in the middle, angle, position, the distance of taking just easily held in the shooting of H22 and later similar subject.

By processing sets up hurdle SZ34 shown in Figure 3, select the threshold values scope to extract as the user, as the CPU1 of the image processing department algorithm according to regulation, the processing object of determining is carried out the processing that the threshold values scope is extracted.A kind of embodiment of threshold values scope extraction process, at first the infrared thermal imagery of determining is carried out the setting of threshold values scope, carry out setting and the adjusting of threshold values scope, such as the threshold values scope that thermal-image data AD value scope, temperature are set, tonal range, colour code scope etc. of its operation format by the user according to the infrared thermal imagery that shows; In addition, can be also the threshold values scope that prestores.Then, after confirmation was set, thermal-image data or the infrared thermal imagery that will be positioned at this threshold values scope as the CPU1 of image processing department carried out extraction process (being to extract the temperature band) for infrared thermal imagery.After completing the extraction of threshold values scope, the morphosis data that processing is obtained are kept in interim storage part 3 or hard disk 5.Also can first shear in this example, after carry out threshold values scope extraction process, but also can first carry out threshold values scope extraction process, after shear or do not shear.

One or more in described processing such as image processing such as the shearing that described processing object is put rules into practice, feature extraction (as the extraction of threshold values scope, edge extracting), enhancing, filtering, pseudo-coloured silk, brightness adjustment, color adjustment etc., can only carry out wherein a kind ofly, also can carry out multiple.Can adopt the method for comparative maturity in the industry for other concrete processing and treating methods, here repeat no more.

Embodiment 5

The present embodiment is in having the IR image display device 8 identical with structure shown in Figure 1, in hard disk 5, has stored to be used for carrying out the morphosis data are carried out the control program that related information arranges.CPU1, display part 2, operating portion 7 arrange the example of section as related information, be used for arranging the configuration information one of at least of the corresponding auxiliary composition data of morphosis data (be used for corresponding acquisition analyzed area, cue mark information etc. one or more), subject information, CPU1 records the example of section as related information, be used for morphosis data and configuration information are set up associated record.

For example, at the step S303 of embodiment 4, the morphosis data that processing obtains have been obtained, at this moment, can temporarily not carry out follow-up reference pattern yet and take, can first carry out the setting of the corresponding analyzed area of morphosis data, cue mark, subject information etc.In addition, setting can be also show in current composograph with reference to image or the morphosis data that read from hard disk 5 etc.

Particularly, response arranges indication, and CPU1 controls display part 2 is shown as the interface that arranges in Figure 23, and what the morphosis data that processing obtained by the user generated arranges with reference to the corresponding various information of image TU21.This arranges the interface has and shows with reference to image and adjustment hurdle SZ0, the analyzed area of adjusting analyzed area hurdle SZ1, cue mark hurdle SZ2, subject Data Enter hurdle SZ3 etc. are set.

Comprise S01, S02, S03 having shown with reference to image TU21 and analyzed area F21() adjustment hurdle SZ0 in, the user can carry out as reducing, change position, adjustment, change (point, line, surface) kind as changing S01, S02, S03 into circular etc. modification from square territory element S01, S02 in analyzed area F21, S03, or new territory element is set.

Analyzed area arranges hurdle SZ1, be used for to select the generating mode kind with reference to the corresponding analyzed area of image (comprise analyzed area unit), wherein, " point, line, surface " expression arranges analyzed area by the mode that the user selects point, line, surface are set in the reference image.Cue mark hurdle SZ2 is used for arranging cue mark information, indicates the position that needs concern, the diagnosis criterion of word such as this subject such as word, arrow etc.In addition, the method that also can introduce according to embodiment 5 is by processing and/or calculate the composition data of setting example such as analyzed area etc.

Subject Data Enter hurdle SZ3 is used for typing subject information.

When the user completes, confirmation is set, CPU1 sets up associated record with reference to the configuration information of image TU21, and namely the positional information in TU21, subject information h21 set up the related hard disk 5 that is kept at dimension information, B21 with reference to the composition data of the composition data of the morphosis data of image TU21, analyzed area F21, cue mark B21, the F21 position in TU21.

As mentioned above, in the present embodiment, configuration information one of at least in the corresponding auxiliary composition data of morphosis data (be used for corresponding acquisition analyzed area, cue mark information etc. one or more), subject information is set, and morphosis data and configuration information are set up associated record, in using after being convenient to the calling of morphosis data correlation data.Then, can enter processing as above-mentioned reference pattern.Operation with associated record also can be set repeatedly.

Embodiment 6, and the present embodiment is in having the IR image display device 8 identical with structure shown in Figure 1, in hard disk 5, also stored to be used for carrying out the control program that obtains composition data is processed and/or calculated to appointed object.And, when specifying main object from the object of a plurality of relative position relations with regulation, the position that location positioning section first arranges main object is arranged in the location parameter of infrared thermal imagery, then, determines that object that other composition datas obtain is arranged in the location parameter of infrared thermal imagery.At this, for embody subject regulation morphological feature with reference to image, location parameter comprises position, size or also has the anglec of rotation; For the object that auxiliary composition data obtains, location parameter comprises the position or also has size or also have the anglec of rotation, when for example analyzed area is a single point, for the position etc.

Wherein, so-called coverage district in embodiment 2 can be considered a kind of situation in main object, with reference to image corresponding with reference to the scope district represented this with reference to the demonstration of image specification with reference to scope, can be considered the coverage district as main object; Main object can have for all the object of the relative position relation of regulation.In the present embodiment, suppose subject information and the related composition data thereof of having stored in hard disk 5 as shown in figure 16.

With reference to Figure 24, the embodiment of another kind of setup menu is described, when the user supresses Menu key, enter menu mode, the menu that display part 2 shows as shown in figure 24.Wherein menu item in elected shows corresponding configuration interface.CPU1 and operating portion 7 etc. have consisted of configuration section, and response user's operation signal carries out corresponding the demonstration and controls, and with the content record of user's configuration to storage medium.Carry out associative operation by operating portion 7.

Configuration interface with reference to shown in Figure 25 illustrates " object processing CD1 " menu item, is used for the user and specifies processing object and setting (increase, modification, deletion) processing rule.

Composition data CD11: the information that shows selective composition data.The information of selective composition data is such as obtain the type information of the morphosis data such as " profile ", " texture " from the table of Figure 16; In addition, when the type information that other are arranged, for example the processing object type of appointment in conjunction with the type information of the corresponding composition data of particular process rule, also shows the type information of selecting as for the election.

Processing object CD12: be used for user's selection as the composition data of processing object, obviously, can select one or more composition datas as processing object, for example can process and obtain one or more new composition datas.

Process regular CD13: be used for the user and arrange for the processing of processing object regular; Processing rule comprises algorithm and the correlation parameter that processing is processed, and is choosing processing algorithm duration by acknowledgement key, with the display parameter hurdles for typing parameter (not shown).Processing is processed such as at least a processing in shearing, the extraction of threshold values scope, edge extracting, enhancing, filtering, pseudo-coloured silk, gray scale (color variable gray scale, black and white), brightness adjustment, color adjustment etc., also can select simultaneously multiple processing, in addition, can also configuration line known other various processing processing in the industry.

Configuration interface with reference to shown in Figure 26 illustrates " calculation and object CD2 " menu item, selects calculating object and (increase, revise, delete) computation rule is set for the user.

Composition data CD21: the information that shows selective composition data.The information of selective composition data for example obtains the type information of " profile ", " texture ", " analyzed area " from the table of Figure 16, in addition, when the type information that other are arranged, for example the calculating object type of appointment is in conjunction with the type information of the corresponding composition data of specific calculation rule, for example the processing object of appointment in conjunction with the type information of the corresponding composition data of particular process rule, also shows the type information of selecting as for the election.

Calculating object CD22: be used for the user and select calculating object; Obviously, can select one or more composition datas as calculating object, for example can calculate and obtain one or more new auxiliary composition datas.

Computation rule CD23: be used for user's selection and setting for the computation rule of calculating object; Computation rule comprises algorithm and correlation parameter, the algorithm of algorithm such as convergent-divergent, distortion, unique point, characteristic area, decile, outsourcing rectangle, inscribe rectangle, center line etc., the parameters relevant to algorithm such as quantity of the calculating parameter of the basic point of the basic point of parameter such as convergent-divergent and convergent-divergent rate, distortion and deformation rate (as aspect ratio), unique point, the characteristic area type (as point, line, surface etc.) that arranges based on unique point and size, decile, choosing algorithm often by acknowledgement key, with display parameter hurdle confession typing parameter (not shown).Can select one or more computation rules to selected calculating object.Calculated characteristics point wherein for example calculates the central point of profile, such as calculating unique point (such as the maximum temperature point) in thermal-image data etc.

In addition, also can be configured to based on show with reference to image or the thermal imagery file from the storage mediums such as storage card 6 or take in the thermal-image data that obtains or infrared thermal imagery etc., provide and select to specify processing and/or calculating object.

Obviously, " object processing CD2 " and the configuration menu of " calculation and object CD3 " also can be merged into a configuration interface, can select one or more processing rules to appointed object (as the thermal imagery file in composition data pre-stored in Figure 16, storage card 6, the thermal-image data that take to obtain etc.), and/or, select one or more computation rules, processing and/or calculating can be referred to as to be processed appointed object.In addition, also can only configure relevant processing rule or computation rule, and not point to specific composition data; For example configuration by default, be applicable to follow-up selected composition data.

Illustrate by calculating or processing the effect with reference to image of acquisition with reference to Figure 27.

With reference to figure 27(a) shown in reference to image, with profile T1 composition data as calculating object, with the central point of profile T1 as basic point, after carrying out convergent-divergent and distortion, the image F101 of acquisition; Can be used for pointing out the user to note observing the Temperature Distribution in regulation zone on the subject body, reduce surrounding environment to the impact of assessment.

With reference to figure 27(b) shown in reference to image, as calculating object, algorithm parameter is for carrying out 8 deciles, the regional F102 of 8 deciles of acquisition with profile T1 composition data; Can be used for pointing out the user to note observing the Temperature Distribution of subject body different piece.

With reference to figure 27(c) shown in reference to image, as calculating object, algorithm parameter is for calculating based on unique point (for example central point) and the analyzed area F103 of given size being set based on this central point with profile T1 composition data; Can be used for pointing out the user to note observing this zone.

With reference to figure 27(d) shown in reference to image, with local infrared thermal imagery TU1 composition data as processing object, processing rule as edge contour extraction, the edge contour image F104 of acquisition can improve the reference effect of local infrared thermal imagery TU1.

With reference to figure 27(e) shown in reference to image, with local infrared thermal imagery TU1 composition data as processing object, processing rule as the above pixel (scope extraction) of extraction set point of temperature threshold values, the image F105 that obtains, under some applicable cases, the subject main body is better than TU1 as the effect of reference image with reference to effect.

Configuration interface with reference to shown in Figure 28 illustrates the configuration of " with reference to image C D3 ".

" with reference to image C D3 ": be used for the user and be chosen in reference pattern, under non-switching state, the composition data image-related with reference, location rule, synthetic parameters etc. are set.

composition data CD31: the information that shows selective composition data, for example obtain from Figure 16 " profile ", " texture ", type informations such as " analyzed areas ", in addition, when the type information that other are arranged, as the processing object type of the appointment that arranges at " the object processing CD1 " type information " profile (processing) " in conjunction with the regular corresponding composition data of particular process, as the calculating object type of the appointment that arranges in " calculation and object CD2 " type information " profile (calculating) " in conjunction with the corresponding composition data of specific calculation rule, also show selective.

With reference to image C D32: be used for the user and select to be used for to obtain composition data with reference to image.Can select one or more composition datas to obtain with reference to image.In the present embodiment, the object that each composition data is obtained namely when having selected a plurality of composition data, will comprise a plurality of synthetic objects (also can understand by a plurality of composition datas and obtain with reference to image) with reference to image all as a synthetic object; Also can choose with reference to image C D32, and the long acknowledgement key of pressing, can with in selected composition data partly or entirely as a synthetic object (not shown).

with reference to Figure 28, selective composition data is described: obviously, " profile " that can store from storage medium such as hard disk 5, " texture ", " analyzed area ", and the regulation processing object is in conjunction with the corresponding morphosis data of processing rule of regulation for example " profile (processing) ", the composition data of regulation calculating object is in conjunction with in regulation computation rule corresponding auxiliary composition data such as " profile (calculating) " etc., select wherein at least one morphosis data, an also optional majority composition data, a plurality of composition datas can be a plurality of morphosis data, perhaps also can comprise morphosis data and auxiliary composition data.

In addition, also can be configured to as can will be chosen as composition data based on the thermal-image data that take to obtain etc., or also can be chosen as composition data based on the thermal imagery file that obtains from storage card 6.Then can be based on composition data and the above-mentioned option and installment of storage medium (in hard disk 5, interim storage part 4 etc.) storage, determine with reference to image-related composition data.

Location rule CD33: be used for user's configuration location rule relevant with the location parameter that is positioned at infrared thermal imagery with reference to image.

Wherein, when having specified main object, location positioning section is used for arranging the location parameter that main object is positioned at infrared thermal imagery, then, be combined main object by the relative position relation of the regulation of other objects between main object and be arranged in the location parameter of infrared thermal imagery, come other objects of Lookup protocol to be arranged in the location parameter of infrared thermal imagery.For example, first determine and have the main object of the relative position relation of regulation with reference to image, the location parameter that main object is arranged in infrared thermal imagery is set, then, location parameter based on relative position relation and the main object of the regulation between reference image and main object is arranged in infrared thermal imagery arranges the location parameter that is arranged in infrared thermal imagery with reference to image.

When not selecting when obtaining the composition data of main object, the object that selected composition data obtains in " with reference to image C D32 " arranges its location parameter according to location rule separately.

As can be seen from Fig. 28, main object can be selected from composition data CD31, obviously, can be for example with reference to image, or with reference to the part of image, can be also the main object that obtains with reference to other the composition data outside the composition data of image.Namely be used for obtaining the composition data of main object, for example can be based in the composition data of the object of the relative position relation with regulation one or more: morphosis data (for example " profile "), or with the composition data (for example " analyzed area ") of morphosis data correlation, or based on the calculating object of appointment in conjunction with the regulation corresponding composition data of computation rule (for example " profile (calculatings) "), or process regular corresponding composition data (such as " profile (processing) ") etc. based on the processing object of appointment in conjunction with regulation.When having specified a plurality of composition datas to obtain main object, the compound object that for example a plurality of composition datas is obtained is as main object.

Usually set main object has represented the zone that needs primary part observation, by conversion master object, can realize realizing different shooting purposes with reference to the conversion of image on different display positions.In addition, the user can be chosen in also that display part 2 shows with reference to image (one or more of synthetic object wherein), be used as main object.

Wherein, self-adaptation: be used for selecting the position set-up mode of self-adaptive processing and specify self-adaptation object (when having selected main object, referring to main object).Adaptive region is the regulation zone in infrared thermal imagery, choose self-adaptation, then length is pressed acknowledgement key 29, position, size, the anglec of rotation that adaptive region is arranged in infrared thermal imagery can be set, and the self-adaptation object is arranged in position (can be used as adaptive convergent-divergent basic point) and the anglec of rotation of adaptive region.In this example, the window area placed in the middle of infrared thermal imagery 90% ratio is set as adaptive region, hereinafter to be referred as Z1, the self-adaptation object in Z1, self-adaptation placed in the middle.

Wherein, assigned address: what be used to specify that selected composition data obtains is arranged in the location parameter of infrared thermal imagery with reference to (when having selected main object, referring to main object) such as images.When the user chooses " assigned address hurdle ", show input field (not shown), the user can input object that selected composition data obtains position in infrared thermal imagery, size, the anglec of rotation etc.When all not inputting, for example, can the default location starting point be infrared thermal imagery the upper left corner, be of a size of original size, the anglec of rotation is 0.

Wherein, relative position: select this, will be according to selected composition data (when having selected main object, referring to main object) related positional information in advance, obtain the location parameter that object that this composition data obtains will be arranged in infrared thermal imagery.

Synthetic parameters CD34: be used for arranging the synthetic parameters with reference to image and infrared thermal imagery that selected composition data obtains, synthetic parameters such as transparency ratio, according to the dissimilar of composition data or also have (not shown) such as color, line styles, synthetic order when the reference image comprises a plurality of synthetic object etc., or also can select the synthetic parameters of composition data self association.

Obviously, when having determined a plurality of composition data, for example can obtain a synthetic object (as the reference image) by a plurality of composition datas, location positioning section can arrange position and the size that a plurality of composition datas are positioned at background when mutually synthetic, and final obtain be arranged in position and the size of infrared thermal imagery with reference to image.Also can obtain a plurality of synthetic objects (as the reference image) by a plurality of composition datas, according to the rules synthetic order and transparency ratio, synthesize with infrared thermal imagery the composograph that obtains with reference to image and infrared thermal imagery successively, realize common demonstration, at this moment, location positioning section will arrange a plurality of synthetic objects and lay respectively at position and size in infrared thermal imagery.

Switch CD4: be used for being arranged on reference pattern, for example " with reference to image C D3 " configure with reference under the common state that shows of image and infrared thermal imagery, when pressing the switch key of single job section, the configuration information relevant with the switching object.With reference to configuration interface shown in Figure 29, the configuration of " switching CD4 " is described, the type of configuration information such as the composition data that switches that switches, switch after the conversion of any one such as location rule, synthetic parameters (as overlapping order, transparency ratio, color) of the object that obtains of composition data, obtain from Figure 28 in reference to image the configuration of different results of use.Infrared thermal imagery can be arranged in addition as switching object, other roughly the same, have omitted explanation with " with reference to image C D3 ".Arrow C D40 in switching CD4: be used for arranging (increase, modification, deletion) switching law, for example can enter the interface of next switching by arrow C D40, configure the configuration information of more switching object.

Configuration interface with reference to shown in Figure 30 illustrates the configuration of " record arranges CD5 "; Be used for the user and arrange, when recording, will with the regulation recorded information of infra red data as-sodation storage.The regulation recorded information is the recorded information of regulation, one or more formation as stipulating recorded information in the positional information of the object that the user can obtain from the index information of subject information, composition data, composition data (as the filename of composition data, numbering etc.), composition data (defined, for example the positional information when response record indicate).Obviously, the composition data that records must not be the composition data that obtains with reference to image.

Wherein, the regulation recorded information is as shown in Figure 30, and is obvious, can be one or more in following information:

1) represent the information of subject information;

Wherein, with reference to the composition data of image for example " profile " and/or " analyzed area ", has the composition data of object of the relative position relation of regulation with the reference image; For example, with reference to the composition data " texture " of the composition data association of image; For example processing rule according to the rules is to specifying the composition data " profile (processing) " of processing object processing acquisition; For example computation rule calculates to the appointment calculating object composition data " profile (calculating) " that obtains according to the rules.

4) has the identity information of composition data of object of the relative position relation of regulation with reference to the composition data of image or with the reference image.

In embodiment 5, user's shooting purpose is the overall thermal field distribution (integral part of profile T6 representative) that detects subject h6.If the discovery shadow of doubt also will change the position and take subject selective analysis position (zone of analyzed area F6 representative).Realize for convenience this testing goal, the user has carried out with reference to the configuration before and after image switching and the configuration of record.

The configuration that the user arranges by " with reference to image C D3 " as shown in figure 28, with reference to image: " profile " reaches " analyzed area "; Location rule: profile (main object), adaptive region Z1, self-adaptation is placed in the middle; Synthetic parameters: transparency ratio is 1, and " profile " synthetic order is 1, and " analyzed area " synthetic order is 2, and color can be given tacit consent to the color of self attributes.

The configuration of user by " switch CD4 " " switching one " as shown in figure 29, with reference to image: " profile ", " analyzed area "; Location rule: analyzed area (main object), adaptive region Z1, self-adaptation is placed in the middle; Synthetic parameters: transparency ratio is 1, and " profile " synthetic order is 1, and " analyzed area " synthetic order is 2, and color can be given tacit consent to the color of self attributes.

The configuration of user by " record arranges CD5 " " regulation recorded information " as shown in figure 30, the regulation recorded information is: subject information, the positional information of profile composition data and profile, the composition data of analyzed area and positional information.It should be noted that the state that shows with reference to image that configures for Figure 28, and under the state of the switching that configures of Figure 29, in this example, with reference to the positional information of image etc., variation has occured, the corresponding positional information that records is also with difference.

Namely click switch key, switched to the common demonstration of " profile, analyzed area (main object) " and infrared thermal imagery by " profile (main object), analyzed area " and the common demonstration of infrared thermal imagery; Click again, get back to the show state of the common demonstration of " profile (main object), analyzed area " and infrared thermal imagery.Adopt different main objects, represented the control mode of different focal points.

Although, in the present embodiment, with in hard disk 5 storage the part composition data as the example that configures with reference to image.But obviously, by the above-mentioned explanation to the menu shown in Figure 24-30, the user can be based on the composition data of storage part, comprises it can being that calculating object with appointment is in conjunction with computation rule, comprise can be with the processing object of appointment in conjunction with the processing rule, configure various different-effects with reference to image.With reference to one of at least difference in the composition data of image, location rule, synthetic parameters, just may obtain different with reference to effect and application purpose with reference to image.By just can obtain the switching image of different purposes and effect to the configuration of switching; Just can obtain the regulation recorded information of different purposes by the configuration to record.

In addition, namely box lunch as Fig. 4 or subject information shown in Figure 15 only association during morphosis data, the user can (for example the user can pass through " calculation and object CD1 " to configure relevant composition data by " with reference to image C D3 " or " switching object CD4 ", " object processing CD2 " arranges these related morphosis data and combines regulation processing rule or composition data corresponding to computation rule) etc., also can configure different-effect with reference to image.Obviously, also configurable should association the morphosis data and the regulation of the composition data of processing and/or calculating determine type, be convenient to flexible use.

When completing setting operation, press acknowledgement key, CPU1 with set every configuration store in hard disk 5 (for example as a configuration file), as after the default configuration of IR image display device 8, and do not need each the use all to arrange once, then, get back to the standby shooting state.Can be carried out by the user embodiment of relevant configuration although it should be noted that example; But being not limited to this, can be also such embodiment, and namely thermal imagery display device 8 when dispatching from the factory, has namely configured the relevant configuration of above-mentioned various processing, and do not needed the user to carry out any artificial setting; Perhaps externally in computing machine configuration complete, configuration file is loaded into IR image display device 8 before shooting; Perhaps, carried out the configuration of the partial content of above-mentioned explanation by the user.Thus, can determine that type (such as the type, processing object of storage in conjunction with the regular corresponding type of processing, calculating object in conjunction with the corresponding type of computation rule etc.) determines composition data automatically according to the regulation of composition data, automatically determine to be arranged in reference to image assigned position and the given size of infrared thermal imagery according to the location rule of reference image, or also have the anglec of rotation.

The process flow diagram of embodiment 5 is described referring to Figure 33, and step is as follows:

Step B01, whether CPU1 persistent surveillance user has selected reference pattern.When the user has selected reference pattern by operating portion, enter step B02.

Step B02, CPU1 carry out definite processing of composition data.According to the configuration in Figure 28, when having selected subject h6, the composition data conduct of namely determining profile T6 and analyzed area F6 is used for obtaining the composition data with reference to image.

Step B03, definite assigned position and the given size that is arranged in infrared thermal imagery with reference to image of location positioning section.According to the configuration in Figure 28, for example calculate respectively the location parameter that profile T6 that the composition data of composition data, the F6 of T6 obtains and analyzed area F6 are arranged in infrared thermal imagery.At first, be " profile " according to the type of main object, calculate assigned position and the given size of main object T6 in infrared thermal imagery; Then, according to the relative position relation of the regulation of analyzed area F6 and profile T6, and the location parameter of profile T6 in infrared thermal imagery, determine position and the size of analyzed area F6 in infrared thermal imagery, keep the relative position relation stipulated constant.

But this applicable cases is arranged also, according to the location parameter of profile T6 in infrared thermal imagery, determine (assistant images) positions in infrared thermal imagery such as analyzed area F6, keep the relative position of analyzed area F6 and profile T6 constant, but the size of analyzed area F6 can be according to original size.

Step B04, then, the infrared data that the thermal imagery acquisition unit is received is sent to interim storage part 3;

Step B05, will based on determined composition data obtain described given size with reference to image, position according to the rules, the infrared data that receives with the thermal imagery acquisition unit and continuous infrared thermal imagery that the thermal-image data that obtains generates, the common demonstration.A kind of embodiment, CPU1 is with the composition data of the selected T6 image that obtains of size according to the rules, the composition data of determined F6, synthesizes with infrared thermal imagery according to assigned position separately successively according to the image that the set location parameter of location positioning section obtains; Leave synthetic view data in interim storage part 3, then, composograph is presented at display part 2.

In the present embodiment, because the reference image includes contour images T6, analyzed area F6, and synthetic order is different, a kind of embodiment, synthetic order and transparency ratio according to each object, at first with contour images T6 transparency ratio and the synthetic data midway that obtain of infrared thermal imagery according to the rules, then the composograph data that analyzed area F6 transparency ratio according to the rules and the synthetic acquisition of data midway is final.

Shown in the display interface G3101 in Figure 31, contour images T6 shows the demonstration that is accompanied by analyzed area F6, according to contour images T6 reference, the regulation morphological feature of easy to understand subject thermal imagery, be easy to obtain the prompting at primary part observation position according to the reference of analyzed area F6, thus, make shooting purpose easy to understand.

Step B06, CPU1 judge the blocked operation whether user carries out, as have carried out blocked operation, carry out hand-off process, get back to step B02, will according to set handover configurations determine to switch with reference to image or infrared thermal imagery.

Namely when the user under the show state as Figure 31 (G3101), press switch key, according to as arrange in Figure 29 " profile, analyzed area (main object) is calculated assigned position and the given size of main object (analyzed area F6) in infrared thermal imagery; Then, according to the relative position relation of the regulation of analyzed area F6 and profile T6, and the location parameter of F6 in infrared thermal imagery, determine the location parameter of profile T6 in infrared thermal imagery.Display interface G3102 example in Figure 31 analyzed area F6 be set to the display effect of main object (self-adaptation: adaptive region Z1, placed in the middle), the zone of having embodied analyzed area F6 representative is that purpose is observed in main shooting.Although may cause profile T6 partly to overflow, this overflowing because being suitable for using needs can be accepted.Like this, the user comes into subject and takes, and the reference with reference to image of regulation morphological feature has also been arranged, and has guaranteed the quality of taking.Obviously, again press switch key as the user, with the show state that switches back as shown in figure G3101.

Step B07 detects the user and whether has carried out the record operation, as nothing, jumps to step B09, if any, enter next step.

Step B08, recording processing.

Record the record indication operation of operation response section of section 7, the thermal-image data after making the regulation recorded information and compressing is associated, and Heat of Formation to hard disk 5, finishes this processing as file record.

Each the self-corresponding location parameter of profile T6, analyzed area F6 that it should be noted that as scheme to record under the state of G3102, and each the self-corresponding location parameter of profile T6, analyzed area F6 that records under the state of figure G3101, both different.

And, (calculate and/or processing) of composition data for generating when the needs record, for example when the regulation recorded information of configuration has " profile (calculating) " and positional information thereof, can at the composition data of specifying with reference to image, namely generate to the composition data of profile T6 the composition data that needs record; Also can when recording processing, generate the composition data that needs record.Can be to arrange when being arranged in the assigned position of infrared thermal imagery and given size with reference to image T6, the object that also is provided with the composition data acquisition of " profile (calculating) " is arranged in the location parameter of infrared thermal imagery, be stored in the regulation zone of interim storage part 3, in order to follow-up use, can be also when recording processing, the location parameter that this composition data is arranged in infrared thermal imagery is set.The composition data that records and location parameter thereof are not limited to the composition data with reference to image.

Step B09, CPU1 judge whether the user withdraws from reference pattern.

As nothing, get back to step B04, embodied contour images T6 and analyzed area F6 and continuously dynamic infrared thermal imagery, synthetic continuously, the common demonstration, if any withdrawing from indication, finish reference pattern.

In addition, another kind of embodiment, the relative position relation of the regulation between the object that also can obtain according to the composition data (morphosis data) of T6, the composition data of F6 (auxiliary composition data), first synthesize a synthetic object, assigned position and given size that this synthetic object is arranged in infrared thermal imagery then are set, and do not calculate respectively assigned position and the given size of synthetic object in infrared thermal imagery that obtains separately; Then with the synthetic object of described given size, according to described assigned position, the infrared thermal imagery that the thermal-image data that obtains with the infrared data of thermal imagery acquisition unit reception generates is synthetic continuously, realizes the common demonstration with reference to image and infrared thermal imagery.

And, in order to embody the effect of different main objects, in the present embodiment with before and after switching with reference to image as example, but can not switch yet.And, in Figure 31 with profile T6 and analyzed area F6 respectively as main object and the example that switches, obviously, other also can be used as main object with the object that has the relative position relation of regulation with reference to image.

Shown in figure 32, suppose that the user wishes that the position of primary part observation is the middle part of subject; Can carry out following configuration to profile, namely obtain regional F103 as calculating object configuration based on the size at central point and desired primary part observation position with profile T6 in Figure 26 (calculation and object CD2); When having the calculating object that combines computational algorithm in the composition data (a plurality of) of determining, a kind of embodiment, CPU1 calculate calculating object (profile T6) and obtain regional F103; The data that location positioning section obtains after calculating based on the composition data of non-calculating object in determined composition data wherein and calculating object, obtain with reference to image, this is set is arranged in the positional information of infrared thermal imagery with reference to image.During as main object, for example come the location parameter of definite area F103 according to the location parameter after profile T6 self-adaptation, as profile T6 as shown in the G3201 in Figure 32; During as main object, determine the location parameter of profile T6 as regional F103 according to the location parameter after regional F103 self-adaptation, as shown in the G3202 in Figure 32 (profile T6 overstriking shows, but also can not overstriking); The user can configure with reference to image neatly according to the purpose of taking like this.And regional F103 is not limited to show, also can be used for record, and when as analyzed area, follow-up batch processing analysis can be convenient in record.

For processing object in conjunction with the processing rule in like manner, for example determined by processing object and processed regular corresponding composition data (and as main object) to obtain with reference to image, a kind of embodiment, CPU1 processes processing object, then, what location positioning section determined that processing obtains is arranged in the positional information of infrared thermal imagery with reference to image, obtains with reference to image thus.in (a plurality of) composition data of determining, when having processing object and processing regular corresponding composition data (non-main object), a kind of embodiment, location positioning section is based on determined composition data, the composition data and composition data corresponding to processing object processing that comprise non-processing object, obtain with reference to image, determine that this is arranged in the location parameter of infrared thermal imagery with reference to image, wherein, the location parameter of main object will first be determined, then according to the location parameter of main object, determine the location parameter of the image that composition data that processing object processing obtains generates, with this, obtain with reference to image.

As mentioned above, in embodiment 5, obviously, according to the reference with reference to image that the composition data of a plurality of types obtains, be convenient to take the position according to taking motivated emphasis, further improved the effect of reference; By processing and/or calculate and to obtain composition data, can reduce the workload of preparing in advance the composition datas such as analyzed area, and be convenient to configure cater to the shooting purpose with reference to image, or be convenient to the required analyzed area of follow-up batch processing analysis; By conversion master object, can realize the conversion on different display positions, satisfy different shooting purposes; Stipulate recorded information by configuration, be convenient to record follow-up batch processing and analyze required information.Present embodiment provides very convenient and has used means flexibly, has improved the oeverall quality of taking and recording.it should be noted that, although introduced in embodiment 6 with reference to image-related multiple composition data configuration (comprise processing and/or calculate), the regulation of composition data is determined type, the reference picture position arranges, with reference to image display parameters, with reference to image switching, the configuration mode of regulation recorded information, but also can be configured to, IR image display device 8 do not need the user to arrange, and when IR image display device 8 dispatches from the factory, these key elements have namely been configured, in use, according to morphosis data in storage medium etc., automatically carry out the composition data configuration with reference to image, determine, the position arranges, display parameter, switch, the embodiment of the associated record of regulation recorded information etc.Certainly, arbitrary product of enforcement embodiments of the present invention might not need to reach simultaneously above-described all advantages.

It should be noted that, although in the above embodiments, it is to be described with independent or certain combination that reference pattern, cooked mode, related information arrange the mode of operations such as pattern, but does not limit therewith, can obtain more embodiment according to above-mentioned mode of operation is carried out different combinations.In addition, also can realize part or all of function in embodiments of the present invention with special circuit or general processor or programmable FPGA.

IR image display device of the present invention can be applied to the device of the various IR image display that are connected with the thermal imagery filming apparatus, processing etc., such as enumerating personal computer, server, PDA(personal digital assistant device), various display device etc., and also can be connected use with various thermal imagery filming apparatus (as portable, online etc.).

The above-mentioned described only embodiment for inventing, variously exemplify explanation and the essence of an invention Composition of contents is not limited, the those skilled in the art can carry out to embodiment other modifications and variations having read after the instructions, and does not deviate from essence of an invention and scope.

Claims

1. IR image display device comprises:

The thermal imagery acquisition unit is used for receiving continuously infrared data;

With reference to the image determination portion, be used for to determine and the composition data with reference to image correlation that embodies subject regulation morphological feature, determined composition data be used for obtaining embodying subject regulation morphological feature with reference to image;

Location positioning section is used for definite assigned position and given size that is positioned at infrared thermal imagery with reference to image;

Display control unit, be used for the described given size that will obtain based on determined composition data with reference to image, according to described assigned position, the infrared thermal imagery that the infrared data that receives continuously with the thermal imagery acquisition unit generates, the common demonstration.

2. IR image display device comprises:

Synthetic section is used for according to described assigned position, continuously synthetic infrared thermal imagery and with reference to image, to obtain composograph; Wherein said infrared thermal imagery is to generate according to the infrared data that the thermal imagery acquisition unit receives continuously, described with reference to image for according to described given size and obtain according to the determined composition data of reference image determination portion.

3. IR image display device comprises:

Synthetic section, be used for according to described assigned position, according to obtain based on determined composition data described given size with reference to image, the thermal-image data that the infrared data that the thermal imagery acquisition unit is received continuously obtains carries out pseudo-color processing of selectivity, obtains to have embodied with reference to the composograph of image with the infrared thermal imagery of thermal-image data generation.

4. IR image display device as described in claim 1-3 any one, is characterized in that,

With reference to the image determination portion, be used for the predetermined operation of response, the infrared thermal imagery that the infrared data that receives continuously based on the thermal imagery acquisition unit and/or described infrared data obtain is determined and composition data with reference to image correlation.

5. according to claim 1-3 described IR image display devices of any one, is characterized in that, described composition data is divided into morphosis data and auxiliary composition data, described morphosis data the have been representative composition data of image of subject regulation morphological feature; Described auxiliary composition data is the composition data beyond described morphosis data; Described can be based on determined morphosis data with reference to image, or the morphosis data obtain in conjunction with auxiliary composition data.

6. IR image display device according to claim 5, is characterized in that, with reference to the image determination portion, is used for based on the composition data that is stored in storage part, comes composition data definite and with reference to image correlation.

7. IR image display device as claimed in claim 6, is characterized in that, the composition data of storage portion stores comprises the outline shape composition data at least, and described outline shape composition data is the composition data that represents the image of subject edge contour.

8. IR image display device as claimed in claim 6, is characterized in that, described storage part is for the composition data of storing a plurality of subject information and each subject information association;

And, have selection portion, be used for subject information is selected;

Described with reference to the image determination portion, can be according to selected subject information, based on the composition data of this subject information association, be identified for obtaining the composition data with reference to image.

9. IR image display device as claimed in claim 8, is characterized in that, and is described with reference to the image determination portion, determines type according to the regulation of composition data, is identified for obtaining the composition data with reference to image.

10. IR image display device as described in claim 1-3, is characterized in that,

Have the processing object specifying part, be used to specify processing object;

And, having the image processing department, the processing that is used for described processing object is put rules into practice is processed, to obtain the morphosis data;

And, the storage part with the morphosis data that obtain for storage processing;

Described with reference to consisting of determination portion, the morphosis data that the image processing department processing that is used for that storage part is stored obtains are defined as the composition data with the reference image correlation.

11. IR image display device according to claim 6, it is characterized in that, the described composition data of determining with reference to the image determination portion is morphosis data pre-stored in storage part, to a kind of or combination of processing object according to the regular resulting morphosis data of processing, or pre-stored auxiliary composition data in above-mentioned morphosis data and storage part is or/and to the combination of calculating object according to the resulting auxiliary composition data of computation rule; Described processing object can be the morphosis data of storing in storage part; Described processing rule comprises carries out one or more processing processing to processing object; Described calculating object can be the composition data of storing in storage part; Described calculating object can select to carry out one or more computation rule.

12. IR image display device as described in claim 10-11 any one is characterized in that,

Described processing processing is at least one or more in shearing, the extraction of threshold values scope, edge extracting, enhancing, filtering, pseudo-coloured silk, gray scale, brightness adjustment, color adjustment.

13. IR image display device as claimed in claim 11, it is characterized in that, computation rule is at least calculating object is carried out one or more calculating in convergent-divergent, distortion, unique point, characteristic area, decile, outsourcing rectangle, inscribe rectangle, center line.

14. IR image display device as claimed in claim 6, it is characterized in that, storage part is used for storage composition data and related positional information thereof, and the image that described positional information representative is obtained by this composition data will be arranged in assigned position and the given size of infrared thermal imagery; Described location positioning section is used for assigned position and the given size with described positional information representative, is defined as assigned position and given size that image that this composition data obtains will be arranged in infrared thermal imagery.

15. IR image display device according to claim 6, it is characterized in that, when having specified main object, described location positioning section is used for arranging the location parameter that main object is positioned at infrared thermal imagery, then, be combined main object by the relative position relation of the regulation of other objects between main object and be arranged in the location parameter of infrared thermal imagery, come other objects of Lookup protocol to be arranged in the location parameter of infrared thermal imagery; Wherein in main object and other objects, have at least with reference to the composition data of image correlation or the object that obtains with reference to one of composition data of image correlation.

16. IR image display device as described in claim 1-3 any one, it is characterized in that, position and the size of described location positioning section adaptive region according to the rules in infrared thermal imagery, and with reference to image the position in adaptive region, carry out the size after thereby in the adaptive region fixing maximization convergent-divergent of non-that overflow, aspect ratio obtains self-adaptation, and then determine to be arranged in reference to image assigned position and the given size of infrared thermal imagery.

17. IR image display device as claimed in claim 4, it is characterized in that, position and the size of described location positioning section adaptive region according to the rules in infrared thermal imagery, and with reference to image corresponding with reference to the position of scope district in adaptive region, and with reference to image corresponding with reference to the positional information in the scope district, determine to be arranged in reference to image assigned position and the given size of infrared thermal imagery.

18. IR image display device as claimed in claim 2 is characterized in that,

Described synthetic section according to the rules transparency ratio continuously synthetic infrared thermal imagery and with reference to image to obtain composograph, so that in shown composograph, be rendered as translucent with reference to image.

19. IR image display device according to claim 18, it is characterized in that, also comprise the transparent object specifying part, described transparent object specifying part is used to specify the object that needs to change transparency ratio, described synthetic section can respond user's scheduled operation, change the transparency ratio of specified object, described object is with reference to image or with reference to the part of image.

20. IR image display device as described in claim 1-3 any one is characterized in that having the section of record, the described section of record is used for described infrared data and/or infrared data are carried out record through the data that predetermined processing obtains.

21. IR image display device as claimed in claim 20, it is characterized in that, the described section that records, be used for the regulation recorded information is set up the related record that carries out with described infrared data and/or infrared data through the data of predetermined processing acquisition, described regulation recorded information comprises following one or more at least:

1) represent the information of subject information;

2) with reference to the composition data of image, or has the composition data of object of the relative position relation of regulation with reference picture;

3) with reference to image, or have the object of the relative position relation of regulation with the reference image, be arranged in the positional information of infrared thermal imagery;

4) has the identity information of composition data of object of the relative position relation of regulation with reference to the composition data of image or with reference picture.

22. as claim 8,9 described IR image display devices, it is characterized in that, has the section of record, be used for the regulation recorded information is set up the related record that carries out with described infrared data and/or infrared data through the data of predetermined processing acquisition, described regulation recorded information comprises following one or more at least:

1) represent the information of subject information;

2) has the composition data of object of the relative position relation of regulation with reference to the composition data of image or with reference picture;

23. as claim 8, the 9 described IR image display devices of any one is characterized in that, described storage part is for the composition data of a plurality of types of storing a plurality of subject information and each subject information association; Described with reference to the image determination portion, determine type according to the regulation of composition data, be identified for obtaining the composition data with reference to image.

24. IR image display device as described in claim 1-3 any one, it is characterized in that, have configuration section, be used for user's configuration with reference to the composition data of image correlation, processing rule, computation rule, location rule, synthetic parameters, switching law one of at least.

25. thermal image display system, it is characterized in that, has IR image display device as described in above-mentioned claim 1-3 any one, and, has the thermal imagery filming apparatus that is connected with the IR image display device, described thermal imagery filming apparatus is used for taking and export infrared data, and described thermal imagery acquisition unit is used for receiving continuously the infrared data that the thermal imagery filming apparatus is exported.

26. the IR image display method comprises:

The thermal imagery obtaining step is used for receiving continuously infrared data;

With reference to the image determining step, be used for to determine and the composition data with reference to image correlation that embodies subject regulation morphological feature, determined composition data be used for obtaining embodying subject regulation morphological feature with reference to image;

The location positioning step is used for definite assigned position and given size that is positioned at infrared thermal imagery with reference to image;

Show to control step, be used for will based on determined composition data obtain described given size with reference to image, according to described assigned position, the infrared thermal imagery that the infrared data that receives continuously with the thermal imagery obtaining step generates, the common demonstration.

27. the IR image display method comprises:

Synthesis step is used for according to described assigned position, continuously synthetic infrared thermal imagery and with reference to image, to obtain composograph; Wherein said infrared thermal imagery is to generate according to the infrared data that the thermal imagery obtaining step receives continuously, described with reference to image for according to described given size and obtain according to the determined composition data of reference image determining step.

28. the IR image display method comprises:

Synthesis step, be used for according to described assigned position, according to obtain based on determined composition data described given size with reference to image, the thermal-image data that the infrared data that the thermal imagery obtaining step is received continuously obtains carries out pseudo-color processing of selectivity, obtains to have embodied with reference to the composograph of image with the infrared thermal imagery of thermal-image data generation.

29. IR image display method as described in claim 26-28 any one is characterized in that,

With reference to the image determining step, be used for the predetermined operation of response, the infrared thermal imagery that the infrared data that receives continuously based on the thermal imagery obtaining step and/or described infrared data obtain is determined and composition data with reference to image correlation.

30. according to claim 26-28 described IR image display methods of any one is characterized in that, with reference to the image determining step, are used for based on the composition data that is stored in storage part, come composition data definite and with reference to image correlation.

31. IR image display method as claimed in claim 30 is characterized in that,

Have the selection step, be used for the composition data based on a plurality of subject information of storage portion stores and each subject information association, subject information is selected;

Described with reference to the image determining step, can be according to selected subject information, based on the composition data of this subject information association, be identified for obtaining the composition data with reference to image.