WO2014101803A1 - 红外选择装置和红外选择方法 - Google Patents

红外选择装置和红外选择方法 Download PDF

Info

Publication number
WO2014101803A1
WO2014101803A1 PCT/CN2013/090609 CN2013090609W WO2014101803A1 WO 2014101803 A1 WO2014101803 A1 WO 2014101803A1 CN 2013090609 W CN2013090609 W CN 2013090609W WO 2014101803 A1 WO2014101803 A1 WO 2014101803A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
thermal image
image data
data frame
value
Prior art date
Application number
PCT/CN2013/090609
Other languages
English (en)
French (fr)
Inventor
王浩
Original Assignee
Wang Hao
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wang Hao filed Critical Wang Hao
Priority to US14/758,248 priority Critical patent/US20160005156A1/en
Publication of WO2014101803A1 publication Critical patent/WO2014101803A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/30Transforming light or analogous information into electric information
    • H04N5/33Transforming infrared radiation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • G06T7/001Industrial image inspection using an image reference approach
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/143Sensing or illuminating at different wavelengths
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/25Determination of region of interest [ROI] or a volume of interest [VOI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103Static body considered as a whole, e.g. static pedestrian or occupant recognition
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/635Region indicators; Field of view indicators
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/10Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors
    • G01J2005/106Arrays

Definitions

  • the infrared selection device and the infrared selection method of the invention relate to the application field of infrared detection.
  • a reference image embodies a feature of a subject and a thermal image are continuously superimposed and displayed by the user as a specific subject thermal image.
  • the visual reference is made to take a picture of the subject to ensure the position, size and morphological characteristics of the specific subject thermal image of the specific subject thermal image in the infrared thermal image to ensure the quality of the shooting.
  • Such a thermal image capturing apparatus is disclosed, for example, in Patent Document Application No. 201210008404.6 ;
  • the above method requires the user to visually judge the degree of matching between the reference image and the specific subject thermal image, and the user is prone to visual fatigue; when using the handheld thermal imaging device, the alignment shooting operation is performed. It is easy to fatigue, repeatedly aiming for extended shooting time, and affecting the quality of the thermal image taken. Moreover, this way of operation is dull, and the requirements for photographing alignment are high.
  • an infrared selection device that achieves a subjective idea without excessive reliance on the user, such as the ability to automatically select specific information relating to a thermal image data frame that meets the specified conditions based on the acquired thermal image data frame, To facilitate analysis, notification, storage, and the like, so that the operation is simple, and the obtained thermal image data frame is of high quality.
  • the invention provides an infrared selection device and an infrared selection method, which display a reference image in an infrared thermal image, and can automatically detect the position, size, inclination angle and correlation of a specific subject thermal image in the acquired thermal image data frame.
  • the value of the specified information, or the factor of the auxiliary information can automatically select the specific information related to the thermal image data frame that meets the specified conditions, thereby making the shooting operation simple, the shooting speed fast, and the thermal image quality high.
  • an infrared selection device including: a photographing portion for continuously capturing a thermal image data frame; and a display control portion for controlling dynamic display obtained based on the acquired thermal image data frame An infrared thermal image and a reference image; a detecting unit configured to detect predetermined information related to a specific subject thermal image based on the acquired thermal image data frame; and a comparing unit configured to detect the obtained predetermined information and/or The evaluation value obtained based on the detection of the obtained predetermined information is compared with a predetermined comparison value.
  • the selection unit selects specific information related to the predetermined thermal image data frame based on the comparison result of the comparison unit.
  • the infrared selection device includes: an acquisition unit for continuously acquiring the thermal image data frame; and a display control unit configured to control the dynamic infrared thermal image obtained by the display based on the acquired thermal image data frame And a reference image, configured to detect predetermined information related to a specific subject thermal image based on the acquired thermal image data frame; a comparison portion configured to detect the obtained predetermined information and/or obtain the detection based on the detection The evaluation value obtained by the predetermined information is compared with a predetermined comparison value; and the selection unit selects specific information related to the predetermined thermal image data frame based on the comparison result of the comparison unit.
  • the infrared selection method of the present invention comprises: a photographing step for continuously capturing a thermal image data frame; and a display control step for controlling a dynamic infrared thermal image and a reference image obtained by the display based on the acquired thermal image data frame; a detecting step, configured to detect predetermined information related to a specific subject thermal image based on the acquired thermal image data frame; and a comparing step, configured to / However, the values are compared; the selection step selects specific information related to the specified thermal image data frame based on the comparison result of the comparison step.
  • Another infrared selection method of the present invention includes an acquisition step of continuously acquiring a thermal image data frame, and a display control step for controlling a dynamic infrared thermal image and a reference image obtained by the display based on the acquired thermal image data frame.
  • a detecting step of detecting predetermined information related to a specific subject thermal image based on the acquired thermal image data frame;
  • a comparing step for specifying information obtained by detecting the detecting step and/or specifying information obtained based on the detecting
  • the obtained evaluation value is compared with a predetermined comparison value; and the selection step selects specific information related to the predetermined thermal image data frame based on the comparison result of the comparison step.
  • Fig. 1 is a block diagram showing a schematic configuration of a thermal imaging device 100 according to a first embodiment of the present invention.
  • Fig. 2 is an external view of the thermal imaging device 100 of the first embodiment.
  • Fig. 3 is a view showing object information, reference image configuration data, object identification information, and the like stored in the storage medium of the first embodiment.
  • Figure 4 is a schematic illustration of the detection window for different parameters.
  • Fig. 5 is a schematic view showing the detection window set in the detection area for detection.
  • Fig. 6 is a view showing an example of display of a display interface in the processing procedure of the first embodiment.
  • Fig. 7 is a flowchart showing the control of the first embodiment.
  • Fig. 8 is a flow chart showing the control of the second embodiment.
  • Fig. 9 is a view showing a display example of the display interface of the processing procedure of the second embodiment.
  • Fig. 10 is a flow chart showing the control of the third embodiment.
  • Figure 11 is a control flow chart of Embodiment 4.
  • the present invention is applied to a portable thermal image capturing apparatus in the following embodiments, the photographing function is not essential to the present invention, and any thermal image data source for which specific subject detection is to be performed may be used. Therefore, the present invention is also widely applicable to a thermal image processing apparatus that receives and processes a thermal image from the outside, and the thermal image processing apparatus includes various apparatuses such as a personal computer, a personal digital assistant, and the like.
  • the thermal imaging device 100 (infrared selection device) of the first embodiment detects the correlation between the acquired thermal image data frame and the subject identification information based on the thermal image data frame continuously captured by the imaging unit 1, based on the comparison result. , to select specific information about the thermal image data frame.
  • Fig. 1 is a block diagram showing a schematic configuration of a thermal imaging device 100 as an example of an infrared selecting device of the first embodiment.
  • the thermal imaging device 100 includes an imaging unit 1, a temporary storage unit 2, a flash memory 3, a communication I/F 4, a memory card I/F 5, a memory card 6, an image processing unit 7, a detection unit 8, and a display control unit 9,
  • the display unit 10, the control unit 11, the operation unit 12, and the control unit 11 are connected to the corresponding portion of the data bus 13 by the control, and are responsible for the overall control of the thermal image device 100.
  • the optical component consists of an infrared optical lens for focusing the received infrared radiation onto the infrared detector.
  • the lens driving section drives the lens in accordance with a control signal of the control section 11 to perform a focusing or zooming operation. In addition, it can also be a manually adjusted optical component.
  • Infrared detectors such as infrared or non-refrigerated infrared focal plane detectors, convert infrared radiation through optical components into electrical signals.
  • the signal pre-processing circuit comprises a sampling circuit, an AD conversion circuit, a timing trigger circuit, etc., and the signal output from the infrared detector is sampled and processed in a predetermined period, and converted into a digital thermal image signal by the AD conversion circuit.
  • the thermal image signal is, for example, 14-bit or 16-bit binary data (also referred to as thermal image AD value data, abbreviated as AD value data).
  • the photographing section 1 is used as an example of an acquisition section for photographing and acquiring a thermal image data frame.
  • the thermal image data frame may be a thermal image signal (the thermal image AD value data obtained by the AD detector after the AD detector is converted), or the image data of the infrared thermal image, or the temperature value, according to different implementations of the acquisition unit.
  • the thermal image data frame is exemplified by a thermal image signal.
  • the temporary storage unit 2 is a buffer memory that temporarily stores a thermal image data frame output from the imaging unit 1 as a buffer memory that temporarily stores the thermal image data frame output from the imaging unit 1. For example, the following processing is repeated, and the acquired thermal image data frame is temporarily stored for a predetermined time. When a new frame is acquired by the acquisition unit (the imaging unit 1), the old frame is deleted and a new thermal image data frame is stored. Meanwhile, as a work memory of the image processing unit 7, the detection unit 8, the control unit 11, and the like. Acts to temporarily store the data for processing.
  • the memory, the register, and the like included in the processor such as the image processing unit 7, the detecting unit 8, and the control unit 11 may be interpreted as a temporary storage medium.
  • the flash memory 3 stores programs for control and various data used in the control of each part.
  • data related to reference images, detection, and the like are stored in a storage medium such as the flash memory 3, for example, a database storing subject identification information (Table 3), and each subject is
  • Table 3 subject identification information
  • each subject is The subject information, the constituent data of the reference image, and the subject identification information are stored in association with each other, and may be stored in a data file of a specific format or the like.
  • the constituent data of the reference image for example, vector graphics data, and bitmap image data, also includes constituent data in which the reference image is composed of a plurality of coordinate point data.
  • the template data may be the same as or different from the reference image constituent data.
  • the subject information is information related to the subject, for example, information representing the location, type, number, and the like of the subject, and may also be exemplified by the belonging unit and the classification level (such as the voltage level, the important level) related to the subject. Etc., model, manufacturer, performance and characteristics, history of past shooting or overhaul, date of manufacture, age of use, etc. Various applicable subject information can be prepared depending on the application.
  • the communication I/F 4 is an interface that connects and exchanges data between the thermal image device 100 and an external device in accordance with a communication specification such as USB, 1394, or network.
  • a communication specification such as USB, 1394, or network.
  • an external device for example, a personal computer, a server, or a PDA (personal digital assistant device) can be cited. ), other thermal imaging devices, visible light imaging devices, storage devices, and the like.
  • the memory card I/F 5 is an interface of the memory card 6, and a memory card 6 as a rewritable nonvolatile memory is connected to the memory card I/F 5, and is detachably attached to the main body of the thermal image device 100.
  • data such as a thermal image data frame is recorded under the control of a recording control unit (not shown) of the control unit 11.
  • the image processing unit 7 is configured to perform predetermined processing on the thermal image data frame obtained by the imaging unit 1, for example, a thermal image of a predetermined time portion temporarily stored in the temporary storage unit 2 when the display timing comes. In the data frame, the frame of each predetermined time interval is selected and read; the processing of the image processing unit 7 is converted into data suitable for display, recording, etc., such as correction, interpolation, pseudo color, synthesis, compression, decompression, and the like. deal with.
  • the image processing unit 7 can be realized by, for example, a DSP or another microprocessor, a programmable FPGA, or the like, or can be integrated with the processor corresponding to the detecting unit 8 and the control unit 11. At 1:
  • Image data Specifically, for example, the image processing unit 7 performs predetermined processing such as non-uniformity correction and interpolation on the thermal image data frame obtained by the imaging unit 1, and performs pseudo color processing on the thermal image data frame after the predetermined processing to obtain an infrared thermal image.
  • Image data an embodiment of the pseudo color processing, for example, determining the corresponding pseudo color table range according to the range of the AD value data of the thermal image data frame or the setting range of the AD value data, and placing the thermal image data on the pseudo color plate
  • the corresponding specific color value in the range is taken as the image data of the corresponding pixel position in the infrared thermal image.
  • the image data obtained after the pseudo color processing by the image processing unit 7 is transferred to the temporary storage unit 2 used as a buffer memory.
  • the image processing unit 7 includes a synthesizing unit (not shown) that obtains a reference image based on the configuration data of the reference image specified by the reference image specifying unit 11F and the positional parameter set by the position setting unit 11G, and The infrared thermal image generated by the image processing unit 7 is combined to generate image data of the composite image.
  • the image synthesizing unit synthesizes the reference image and the infrared thermal image according to a prescribed transparency ratio; in this case, the transparency of the reference image is 1 (eg, the reference image is a line image of the edge contour), that is, opaque and Infrared thermography synthesis.
  • the image processing unit 7 is configured to perform predetermined processing on the acquired thermal image data frame based on the configuration data of the designated reference image and the position parameter set by the position setting unit 11G to generate an infrared thermal image in which the reference image is reflected.
  • the synthesis may also be based on such processing, for example, performing pseudo color processing on the thermal image data frame according to the pixel position of the reference image located in the infrared thermal image to generate display image data embodying the reference image and the infrared thermal image. (similar to the effect of overlapping); for example, according to the pixel position of the reference image located in the infrared thermal image, the thermal image data of the pixel position is not subjected to pseudo color processing, and the thermal image data other than the pixel position of the reference image is pseudo-colored. Processing, and then combining the image data of the reference image to generate image data for display.
  • the reference image may be subjected to processing different from the pseudo-color processing of the thermal image data of the other image position (for example, different pseudo color processing) corresponding to the thermal image data of the pixel position in the thermal image data frame to generate a band.
  • processing different from the pseudo-color processing of the thermal image data of the other image position for example, different pseudo color processing
  • the image synthesizing unit for synthesizing the reference image and the infrared thermal image can be removed in the thermal image device 100.
  • the so-called reference image which is displayed together with the infrared thermal image, helps the user to shoot a specific subject.
  • an image embodying the morphological features of the particular subject may also be other shapes, such as a square or a circle; for example, an identification image that reflects a desired imaging position of the subject thermal image in the infrared thermal image.
  • an identification image that reflects a detection area in the infrared thermal image (the detection area may include one or more detection windows); for example, an identification image of an analysis area that embodies a desired subject thermal image, and the like.
  • the reference image is displayed superimposed on the infrared thermal image according to a prescribed positional parameter (position, or also including size, or also including a rotation angle).
  • the reference image may also be displayed in the display portion, outside the infrared thermal image window; in addition, a thumbnail representing the relationship between the reference image and the position and size ratio of the infrared thermal image may be displayed in the infrared thermal image window.
  • the detecting unit 8 performs the correlation calculation with the object identification information based on the acquired thermal image data frame.
  • the detection unit 8 may be the continuously acquired thermal image data based on the thermal image data frame continuously acquired by the acquisition unit.
  • the frame is sequentially subjected to detection processing, and part of the thermal image data frames may be selected from the continuously acquired thermal image data frames for detection processing, for example, only the thermal image data frames of a predetermined interval are read for detection processing; for example, when the first detection is performed When the thermal image data frame with the correlation degree and/or the evaluation value is larger than the comparison value, the detection is not continued; for example, the detection is started or stopped in response to the predetermined operation of the user; or the thermal image data frame or the detection is performed.
  • the reduction of the thermal image data in the window is performed before the detection of the thermal image data; thereby, the processing load associated with the detection can be reduced.
  • the detecting unit 8 can read the obtained thermal image data frame by reading the imaging unit 1 stored in the temporary storage unit 2 or by reading the image processing unit stored in the temporary storage unit 2 based on the control of the control unit 11.
  • the data obtained by performing predetermined processing on the obtained thermal image data frame by the imaging unit 1 (for example, image data of an infrared thermal image obtained by pseudo color processing) is used to perform detection of correlation between the registered subject identification information and the registered object identification information. deal with.
  • thermal image data frame captured by the imaging unit 1 may be obtained by externally input data in other examples, for example, a thermal image continuously received and decoded from other thermal imaging devices by the I/F 4 .
  • Data Frame may be obtained by externally input data in other examples, for example, a thermal image continuously received and decoded from other thermal imaging devices by the I/F 4 .
  • the detecting unit 8 includes a feature registration unit, a detection window setting unit, and a detecting unit (not shown).
  • the feature registration unit is configured to register the subject identification information related to the correlation calculation.
  • the subject identification information may be registered according to the subject identification information stored in advance in the storage medium; for example, registered for the correlation calculation based on the subject identification information associated with the selected subject information of the user.
  • Subject identification information may be specified by the user, for example, subject identification information (e.g., template data, or extracted feature amount) may be obtained by specifying a subject region from the display image.
  • the registered subject identification information is stored, for example, at a predetermined position of the temporary storage unit 2, or is distinguished from other stored subject identification information by the mark when stored.
  • the object identification information may be template data (such as a template image) for template matching; in addition, the object identification information may also be a feature quantity of the parameter description, so-called feature quantity (point, line, surface, etc.), For example, a value determined according to the state of the pixel included in the detection window, such as a ratio of a predetermined partial pixel in a specific detection window, an average value of pixel values, a center point of an outline of a specific subject, an area, and the like.
  • the subject identification information is the template data 301, and for the subject 2 in Table 3, the subject identification information is the feature amount 302.
  • a combination of one or more types of subject identification information may be selected according to circumstances.
  • a detection window setting unit for setting a detection window For example, according to a certain range of detection areas (such as G1 in FIG. 5), a plurality of detection windows (for example, parameters for predetermining the detection window according to quality requirements) are disposed in the detection area G1, and may be a plurality of detection windows of different sizes. It can also be the detection window after the tilting step, as shown in Fig. 4, where Fig. 4 (a) is the standard detection window, Fig. 4 (b) is the detection window according to the reduced size, and Fig. 4 (c) is the enlarged size.
  • the set detection window, Figure 4 (d) is the detection window set to tilt at a specified angle.
  • the template image is used here in a state of being reduced or enlarged or also tilted, or a template image having a size equal to the window size may be prepared and stored for use. Further, the thermal image data in the detection window may be used in a state of being reduced or enlarged or also tilted to correspond to the template image.
  • the detection window is not limited to a square shape, and may be other shapes, for example, depending on the shape of the template.
  • the detection area may be set by the user according to the shooting habit; or may be pre-stored as associated with the subject information; or may be generated based on the position where the specific subject thermal image was last detected; or the specific detection may not be set.
  • the area, and the range of the thermal image data frame is used as the detection area. It is also possible to set a plurality of detection windows by a user-specified position and size. In addition, it is not necessary to set multiple detection windows, or only one detection window.
  • a substation is filled with a large number of similarly shaped devices, but different names, in order to avoid misleading users and accidental shooting, it is preferable to set the detection area.
  • the identification of the detection area is superimposed on the infrared thermal image, and the user can easily understand the approximate position and size of the specific thermal image of the captured subject, which is convenient for taking a reference and speeds up the detection process, but the detection area may not be displayed. . , Yu, Yukouyuan /
  • a value for evaluating the degree of similarity is obtained.
  • the value of the maximum correlation obtained by the detection may be used as the value of the correlation of the thermal image data frame.
  • the detection processing of the detecting portion 8 may be based on a template matching detection method, and based on the thermal image data in the detection window, the correlation degree is calculated and compared with the template image; for example, the detecting unit calculates the infrared thermal image in the detection window and serves as a template image.
  • the detection processing of the detection unit 8 may be a detection method based on the feature amount described by the parameter, and perform a predetermined calculation to obtain a feature amount of the thermal image data in the detection window, and a reference value of the feature amount (subject identification information) ) Compare to get the value of the correlation.
  • the reference value of the feature amount is a ratio of pixels of a specific pixel value
  • the detecting unit calculates a ratio of pixels of a specific pixel value in the thermal image data, and compares it with a reference value of the feature amount to obtain a correlation between the two.
  • the value of the degree is a detection method based on the feature amount described by the parameter, and perform a predetermined calculation to obtain a feature amount of the thermal image data in the detection window, and a reference value of the feature amount (subject identification information) ) Compare to get the value of the correlation.
  • the reference value of the feature amount is a ratio of pixels of a specific pixel value
  • the detecting unit calculates a ratio of pixels of a
  • the contour image is used as a matching template, and the detecting unit 8 calculates the correlation degree by, for example, the following processing.
  • the detecting unit 8 extracts the thermal image data located in the detection window, and reads it according to a predetermined threshold value of the AD value.
  • the thermal image data in the detection window is binarized; then, a connected image of pixels of the binary image having a predetermined pixel value (1 or 0) is connected; and then it is determined whether the connected image has a predetermined range of sizes; If it is judged that the size of the connected image is within a predetermined range, a comparison process is performed between the extracted connected image and the registered template, for example, the sum of the ratios of the overlapping areas between the two in the respective total areas is calculated. Thereby, the correlation between the extracted thermal image data and the template is obtained.
  • the detecting section 8 moves the window J1 from the upper left corner to the lower right corner of the prescribed detection area G1 of the thermal image data frame 501 for detection, cuts the thermal image data in the window, and detects it.
  • the range of the detected window size, window shift, and tilt angle of the window can be defined in advance, for example, the window size varies from 150 X 50 pixels to 120 X 40 pixels, and the window shift changes.
  • the range is from 10 pixels to 1 pixel, and the tilt angle of the window varies from 0° to 10° based on the center point.
  • the detecting section 8 successively changes the window size by 5 pixels each time, and changes the window displacement by 1 pixel at a time, and changes the window tilt angle by 2° each time.
  • the detecting unit 8 performs correlation calculation of the template image T1 and the thermal image data frame 501; after completing the detection of all the detection windows, the value of the correlation obtained by selecting the detection window with the highest correlation is selected as the thermal image data frame 501. The value of the corresponding relevance.
  • the display control unit 9 displays the image data for display stored in the temporary storage unit 2 on the display unit 10. For example, in the shooting standby mode, the infrared thermal image generated by the thermal image data obtained by the shooting is continuously displayed; in the playback mode, the infrared thermal image read and expanded from the memory card 6 is displayed, and various setting information can be displayed. .
  • the display control unit 9 includes a VRAM, a VRAM control unit, a signal generating unit (not shown), and the like, and the signal generating unit periodically reads out image data from the VRAM under the control of the control unit 11 (from temporary storage). Part 2 reads and stores the image data to the VRAM) R — R — ⁇ R —
  • the video 1 is a loser, and it is not obvious. Loo, not obvious l CTW set y instrument day is not.
  • the display unit 10 may be other display devices connected to the thermal image device 100, and the thermal image device 100 itself may have no display portion in its electrical configuration. In this case, the display control portion 9 may also be an example of an image output member. .
  • the display unit 10 is configured to display the notification information based on the control of the notification unit 11D; for example, to warn with characters and images, such as displaying the information of the maximum correlation, and displaying the thermal image data of the maximum correlation.
  • the infrared thermal image obtained by the frame is also notified by means of the transparency of the text, the image, the color, the size, the line shape, the thickness, the flicker, the brightness, and the change of the frame.
  • the notification method can last for a specified time. Further, it is also possible to control a vibrating member, an indicator lamp (not shown) in the thermal imaging device 100, an analyzing member (not shown), and a diagnostic member (not shown) when the thermal image data frame of the maximum correlation is detected. , the light can also be changed by the indicator light, the vibration is generated by the vibration device, analyzed by the analysis component and the analysis result is displayed, the diagnosis component is diagnosed and the diagnosis result is displayed; or one or more of the above methods are notified, as long as The way the user can perceive it.
  • the control unit 11 controls the overall operation of the thermal imaging device 100, and stores a program for control and various data used for control of each part in a storage medium such as the flash memory 3.
  • the control unit 11 is realized by, for example, a CPU, an MPU, a SOC, a programmable FPGA, or the like.
  • the control unit 11, the display unit 10, and the like are also configured as a subject information selecting unit for selecting subject information.
  • control unit 11 includes a comparison unit 11A for comparing the obtained predetermined information with the detection unit 8 and/or an evaluation value obtained based on the predetermined information obtained by the detection with a predetermined comparison value, the predetermined information including at least Information of one or any combination of the position, size, inclination angle, and correlation value of the specific subject thermal image; in Embodiment 1, the value of the correlation of the thermal image data frame obtained by the detecting portion 8, Compare with the correlation value of the correlation.
  • the comparison value of the correlation may be a judgment value of the correlation degree prepared in advance (for example, stored in Table 3 corresponding to the subject identification information, for example, a comparison value set by the user), and when it is larger than the comparison value, it is determined
  • the thermal image data frame has a specific subject thermal image; it is also possible to obtain the correlation value according to the correlation degree in the thermal image data frame without the comparison value of the correlation degree prepared in advance, for example, the correlation obtained by the first detection processing
  • the value of the degree is used as a comparison value of the subsequent comparison correlation, and is updated when the correlation is detected to be greater than the comparison value.
  • control unit 11 has a selection unit 11B that selects specific information on a predetermined thermal image data frame based on the comparison result of the comparison unit 11A.
  • the specific information selected can be used for prescribed processing that will be experienced later, such as analysis, recording, notification, and the like.
  • the specific information related to the predetermined thermal image data frame may be specific information related to one or more frames of the thermal image data frame in the multi-frame thermal image data frame of the temporary storage unit 2; for example, based on the comparison portion 11A Comparing the result, the specific information related to the thermal image data frame having the largest correlation is selected; but it is not limited to the frame of the thermal image data frame of the detected maximum correlation, for example, the timing of the frame in which the maximum correlation is detected.
  • It may also be configured to select specific information related to multiple thermal image data frames, for example, to select specific information related to the first, second, and third three-frame thermal image data frames of the correlation, or to select the same hotness as the multi-frame correlation.
  • Specific information like a data frame.
  • the imaging unit 1 may capture one or more frames of the plurality of thermal image data frames obtained and stored in the temporary storage unit 2 when the thermal image data frame of the maximum correlation is detected; or After detecting the thermal image data frame of the maximum correlation, the imaging unit 1 captures one or more frames of the plurality of thermal image data frames obtained and stored in the temporary storage unit 2. , 2
  • the data obtained by performing predetermined processing on the thermal image data frame selected from the multi-frame thermal image data frame for example, data obtained by performing predetermined processing on the selected thermal image data frame, for example, extracted from the thermal image data frame.
  • the specific subject thermal image such as image data of the generated infrared thermal image, for example, converts the thermal image data frame into an array of analytical values such as temperature values, and the like.
  • the predetermined information obtained by the detection includes at least one of a position, a size, an inclination angle, and a value of a correlation of a specific subject thermal image, or any combination thereof.
  • the evaluation value obtained based on the detection of the obtained predetermined information is obtained by, for example, weighting the weighted coefficient based on the predetermined information obtained by the detection, or obtaining a thermal image quality or the like based on a comparison table between the predetermined information and the evaluation value. Evaluation value.
  • the presentation information generated based on the detection and/or the presentation information generated by the evaluation value for example, the specification information obtained by the detection and/or the evaluation value is converted into a prompt for percentage information that the user can easily understand.
  • the selection unit 11B controls the selected specific information to be held or not held; the held specific information is held in a predetermined area of the temporary storage unit 2, and may be held (stored) in a storage medium such as the flash memory 3.
  • the selection unit 11B holds an example in which specific information such as a thermal image data frame is held in a predetermined area of the temporary storage unit 2.
  • the selection section 11B may hold the selected specific information at all times, or may hold it under a prescribed condition, for example, the currently selected specific information is maintained for a prescribed time; for example, until a thermal image data frame of a greater correlation is detected.
  • Current specific information for example, the selected specific information is always held until the subject identification information for detecting the comparison or the selected subject information is changed; for example, according to the user's instruction (eg, the user selects the display portion)
  • a specific piece of information is displayed to determine the specific information that is maintained or not maintained.
  • it may not be maintained, for example, by communication I/F4 to other external devices; for example, undergoing other processing such as deleting after notification.
  • the selection unit 11B is configured to update the specific information held by the temporary storage unit 2 to the specific information selected by the selection unit 11B in accordance with a predetermined condition.
  • the predetermined condition for example, the predetermined time, for example, detects a predetermined number of thermal image data frames, for example, according to the comparison result of the comparison unit 11A (when the correlation degree is greater than the correlation degree of the held thermal image data frame, etc.), for example, User's instructions, etc.
  • specific information that was previously maintained can be maintained.
  • the selection unit 11B controls the selection, retention, and update of the specific information. For example, when the value of the correlation degree of the specific subject thermal image detected by the detecting unit 8 is greater than the comparison value of the correlation degree, the specific information such as the value of the correlation degree and the corresponding thermal image data frame is selected and held in the temporary storage unit. In the storage medium of 2; when there is specific information such as the correlation value and the corresponding thermal image data frame, the previous specific information will be replaced; until the subsequent hot image data frame with higher correlation can be replaced ( It is also possible to maintain a prescribed number of highly correlated thermal image data frames). Thus, specific information such as the value of the maximum correlation and the corresponding thermal image data frame is maintained. In addition, specific information that was previously maintained can be maintained.
  • the selection unit 11B is not limited to the specific information related to selecting one frame of the thermal image data frame that is optimal (for example, the most relevant), for example, the sub-optimal or the frame obtained by selecting the multi-frame operation may be selected. Or may be configured to select specific information related to multiple thermal image data frames, such as selecting to store (hold) the specific information related to the first, second, and third three-frame thermal image data frames, or may save The specific information of the thermal image data frame is the same as the three-frame correlation. 11 i ic, after: the comparison unit 11A detects the obtained predetermined information and/or the evaluation value obtained based on the detection of the obtained predetermined information, and the updated comparison value after the comparison value is updated. Compare.
  • the update condition of the comparison value is updated, for example, by the user's instruction; for example, the comparison value is updated based on the comparison result of the comparison unit 11A; for example, the update is performed according to a predetermined time.
  • the comparison value is updated according to the comparison result of the comparison unit 11A, and may be sequentially updated according to a plurality of comparison values prepared in advance; for example, comparison values of three correlation degrees are prepared, and the correlation detected by the detection unit 8 is greater than
  • the first comparison value will be updated to the second comparison value, and when it is greater than the second comparison value, it will be updated to the third comparison value.
  • the comparison value is updated according to the comparison result of the comparison unit 11A, and the comparison value prepared in advance may be updated based on the predetermined information obtained by the detection or the like; for example, the value of the correlation is detected according to the detection unit 8, and the value of the correlation is obtained.
  • the comparison value is greater than the correlation degree prepared in advance, the comparison value is replaced according to the value of the obtained correlation degree for updating.
  • the comparison value is updated, or may be updated according to the predetermined information obtained by the detection, wherein there is no comparison value prepared in advance; for example, according to the detection unit 8 detecting the value of the correlation degree, when When the value of the correlation is greater than the comparison value of the correlation (for example, the value of the correlation detected before is used as the comparison value), the value of the obtained correlation is updated correspondingly with the comparison value.
  • the control unit 11 includes a notification unit 11D that notifies the specific information related to the predetermined thermal image data frame and/or the information of the comparison value update based on the selection unit 11B.
  • a notification unit 11D that notifies the specific information related to the predetermined thermal image data frame and/or the information of the comparison value update based on the selection unit 11B.
  • the notification information obtained by the specific information and the infrared thermal image, reference image, etc. obtained by the thermal image data frame continuously acquired by the acquisition unit are used. Show together.
  • the notification information obtained by the currently selected specific information is displayed together with the infrared thermal image, the reference image, and the like obtained by the thermal image data frame continuously acquired by the acquisition unit.
  • the infrared thermal image obtained by the currently selected and held thermal image data frame is displayed together with the continuous infrared thermal image and the reference image acquired by the imaging unit 1, and other or other displays may be displayed simultaneously or separately.
  • Notification information such as the value of the correlation, the evaluation value, and the like.
  • the dynamic infrared thermal image can also be switched to display a frozen image of the thermal image data frame.
  • the notification unit 11D may notify one or more of the plurality of thermal image data frames, for example, the infrared heat obtained by the plurality of thermal image data frames.
  • the image (if reduced) is displayed together with the continuous infrared thermal image acquired by the imaging unit 1.
  • the notification information is obtained according to the specific information about the predetermined thermal image data frame selected by the selection unit 11B.
  • the value of the correlation can be converted into information that is easy for the user to understand, and displayed.
  • the specified comparison table of the value of the correlation and the percentage, or the calculation method (such as the sum of the extracted specific object contour and the ratio of the overlap area of the contour T1 in the total area, divided by 200%, can be converted into
  • the percentage value of the correlation is converted into the percentage value); it can also be other methods, such as directly displaying the value of the correlation, such as directly displaying the sum of the differences of the pixel values.
  • the displayed correlation degree is not compared with a predetermined comparison value (a judgment value representing whether or not a specific subject thermal image matches the subject identification information) indicating that a specific subject thermal image is detected or not.
  • the information does not necessarily represent the detection of a specific subject thermal image (match) or not.
  • the value of the correlation degree, the evaluation value, and the percentage value converted by the comparison value are taken as an example, but in practice, it is not necessary to convert into a percentage value.
  • the notification method can last for a specified time. Further, based on the control of the notification unit 11D, the display unit 10 can cause the display unit 10 to change the display content, the vibration of the vibrating member in the thermal imaging device 100, the light change of the indicator light, the sound of the sound component, and the analysis processing of the analysis component (and The display unit 10 displays the analysis result), and the diagnostic component performs diagnosis (and displays Show u), display,
  • control unit 11 has a recording unit 11E (not shown), and records the thermal image data frame selected by the selection unit 11B and held in the temporary storage unit 2 in the memory card 8 in response to a predetermined recording instruction.
  • the thermal image data frame is recorded to the memory card 8 in response to an instruction by the user to select a notified thermal image data frame, such as an automatic recording of timing.
  • control unit 11 includes a reference image specifying unit 11F (not shown) for specifying constituent data of a reference image to be displayed together with the infrared thermal image; for example, a reference image associated with the subject information stored in the storage medium.
  • the constituent data (dot matrix data and/or vector data) specifies the constituent data of the reference image associated with the subject information based on the user's selection of the subject information; and is not limited to the subject information, It is also possible to select, for example, a thermal image file or the like from the storage medium to obtain the constituent data of the reference image; in addition, the constituent data of the reference image, such as the data of the default detection area, may also be specified according to the default configuration of the thermal image device 100; For example, an area may be specified from an infrared thermal image displayed on the display unit, and an infrared thermal image of the area may be used as a reference image or the like.
  • control unit 11 is provided with a position setting unit 11G (not shown) for setting a position parameter (position, or also including a size, or a rotation angle) in which the reference image is located in the display unit.
  • the position setting portion 11G is configured to set a position parameter in which the reference image is located in the infrared thermal image; for example, according to the adaptive display region specified in the infrared thermal image, the centering is maximized in the adaptive region according to the calculated reference image
  • the position parameter displayed to set the position parameter of the reference image in the infrared thermal image; for example, the reference image may be set according to the parameter attached to the reference image (for example, the position parameter in the infrared thermal image is reflected)
  • the positional parameter in the infrared thermal image; or, the positional parameter of the reference image in the infrared thermal image may be set according to the configuration (centered, original size) of the thermal image device 100; or, according to the positional parameter input by the user .
  • Operation unit 12 Various operations such as various instruction operations or input of setting information are input by the user, and the control unit 11 executes a corresponding program based on the operation signal of the operation unit 12. Referring to FIG. 2, the operation unit 12 is provided.
  • the buttons for providing user operations include a record button 1, a focus button 2, a confirmation button 3, a play button 4, a menu button 5, a direction button 6, and the like;
  • a speech recognition component (not shown) or the like is used to implement related operations.
  • the change of the display interface during photographing will be described with reference to Fig. 6, and the control flow of the detection mode of the thermal image device 100 will be described with reference to Fig. 7.
  • the control unit 11 controls the overall operation of the thermal imaging device 100 and the control for executing a plurality of mode processes based on the control program stored in the flash memory 3 and various data used in the respective partial controls.
  • the control unit 11 initializes the internal circuit, and then enters the standby shooting mode, that is, the imaging unit 1 captures and obtains thermal image data, and the image processing unit 7 performs predetermined processing on the thermal image data obtained by the imaging unit 1.
  • the infrared thermal image is continuously displayed in the form of a moving image on the display unit 10.
  • the control unit 11 performs control thereof, and continuously monitors whether or not the processing is switched to another mode or the shutdown is performed according to a predetermined operation. Operation, if any, enters the appropriate processing control.
  • the control mode of the detection mode is as follows: Step ⁇ 01, determine the reference image;
  • the display unit 10 displays a dynamic infrared thermal image.
  • the detection mode is selected by the predetermined operation of the operation unit 12, and the control unit 11 displays the subject instruction information generated by the subject information on the display unit 10 based on the table 3 stored in the flash memory 3, when the user performs shooting.
  • the subject "subject 1" on the spot selects "subject 1" displayed on the display unit 10 by the operation unit 12, and the reference image specifying unit 11F selects the user according to the selection.
  • the position setting portion 11G sets the positional parameter (position and size) of the reference image T1 located in the infrared thermal image.
  • a positional parameter in which the reference image T1 is located in the infrared thermal image is set according to the attached positional parameter.
  • the positional parameter of the reference image T1 in the infrared thermal image may also be determined according to the specified adaptive display area or the position parameter specified by the user.
  • the feature registration unit registers the subject identification information.
  • the feature registration unit determines the subject identification information for matching based on the user's selection "subject 1", and here, the reference image T1 is assumed to be a template image for calculating the correlation.
  • the template data 301 can also be read from the flash memory 3 as the subject identification information for calculating the correlation).
  • Step ⁇ 03 acquiring a thermal image data frame, and transmitting the thermal image data frame obtained by the imaging unit 1 to the temporary storage unit 2; the image processing unit 7 performs predetermined processing such as pseudo color conversion on the acquired thermal image data frame to obtain infrared heat.
  • the synthesizing unit 7 obtains the image data of the reference image T1 based on the set predetermined size, and synthesizes (overlaps) the image data of the generated infrared thermal image in accordance with the set predetermined position.
  • the synthesized image data is stored in the temporary storage unit 2.
  • the display control unit 9 displays the composite image on the display unit 10, as shown in Fig. 6(a), between the subject thermal image IR1 and the contour image T1.
  • the difference in position and size allows the user to take a subject thermal image IR1 based on the reference image. If a specific subject thermal image is not detected in the subsequent processing, it will be continuously synthesized with the newly acquired thermal image data frame, thereby continuously displaying the dynamic composite image.
  • step A04 the thermal image data frame obtained by the photographing unit 1 for immediate shooting, for example, in the temporary storage unit 2, the detection window setting unit, and the detection window are set. For example, based on the upper left corner of the prescribed detection area G1, a detection window is first set;
  • Step A05 a process of calculating the correlation between the thermal image data and the subject identification information in the detection window is performed.
  • the detecting unit 8 extracts the thermal image data located in the detection window based on the detection window set by the detection window setting unit, and calculates the correlation between the two based on the template registered by the feature registration unit. For example, according to the contour of the specific subject thermal image extracted by the thermal image data in the detection window, compared with the contour of the contour image T1, the sum of the ratios of the overlapping areas between the two in the respective total areas is calculated; The value of the correlation can be obtained;
  • step A06 the value of the obtained correlation is stored.
  • step A07 the detecting section 8 judges whether or not the correlation has been calculated for all the detection windows when the detection window is set in the thermal image data frame. If there is no area in which the correlation has not been calculated (NO in step A07), the process returns to step A04, and the detection window setting unit shifts the position of the detection window by a predetermined number of pixels in a predetermined direction, and sets the position as the detection window. Next position, and repeat the subsequent processing.
  • the detection processing similar to that described above is also performed for the enlargement and reduction and the detection window in which the detection window J1 is tilted by a predetermined angle.
  • the value of the maximum correlation detected in step A08 (or the position parameter of the corresponding detection window will also be) It is held in a predetermined area of the temporary storage unit 2.
  • step A09 a comparison with the correlation value is compared
  • step A10 If it is smaller than the comparison value, it indicates that the specific subject thermal image in the currently detected thermal image data frame is similar to the contour image T1, which is not better than the previously obtained comparison value; returning to step A03, repeating the subsequent processing ; can also be configured to go to step A12, if not exit, return to A03; here, the user changes the position of the shooting and adjusts the optical of the thermal image device 100 Distance, , , , , and subsequent processing.
  • the correlation detected in step A09 is greater than the comparison value of the correlation, then proceeds to step A10;
  • the comparison value of the correlation degree may be a comparison value of the correlation degree of the initial preparation prepared in advance (for example, a judgment value for determining whether or not the specific subject thermal image is matched with the subject identification information is detected, as the initial value Correlation value of correlation degree), when the value of the correlation obtained by the detection is greater than the judgment value, and the correlation of the detected specific subject thermal image is better than the prepared judgment value, the judgment value is replaced with the current judgment
  • the comparison value obtained by the value of the detected correlation degree as a comparison value of the subsequent detection correlation degree, so as to whether or not a specific subject thermal image with higher correlation can be obtained subsequently.
  • the comparison value of the initial correlation of the thermal imaging device 100 is 72%, and the initial comparison value is a judgment value for determining whether a specific subject thermal image is detected, if the obtained thermal image data frame is If the correlation is less than the comparison value, it means that a specific subject thermal image is not detected in the thermal image data frame; the effect is that when the user repeatedly captures and cannot obtain the notification information related to the selected specific information, it means that Did you take the wrong subject? Therefore, in Fig. 6(a), since the value of the detected correlation is less than 72%, the notification information is not displayed, and the word "no match" is displayed.
  • the comparison value of the correlation may not be prepared in advance. For example, when the value of the correlation of the first detected thermal image data frame is used as the value of the correlation obtained by the subsequent detection of the thermal image data frame. The comparison value, when the subsequent detection is greater than the comparison value, the comparison value is replaced.
  • the contrast value may be a value of the correlation degree, or a value obtained by converting the value of the correlation degree, etc. (correspondingly, the value of the correlation degree obtained by the detection should be converted and compared with the comparison value).
  • the comparison value updating unit 11C updates the comparison value of the correlation degree according to the detected value having the largest correlation degree, and uses the updated comparison value as the comparison correlation degree of the subsequent thermal image data frame. Contrast value. For example, when the correlation of the detected thermal image data frame of the maximum correlation is 80%, the original contrast value can be replaced by 72%.
  • the selection unit 11B holds the specific information such as the thermal image data frame corresponding to the detected value having the greatest correlation in the predetermined area of the temporary storage unit 2, and replaces the previous specific information (if any). Further, it is also possible to maintain a specific number of pieces of specific information relating to a plurality of thermal image data frames, for example, to maintain specific information such as a three-frame thermal image data frame having the highest correlation and a correlation value thereof.
  • the image obtained by the thermal image data frame is displayed together with the dynamic infrared thermal image and the reference image generated by the subsequently obtained thermal image data frame. Further, the held specific information is always held in the temporary storage unit 2 until the specific information reselected by the selection unit 11B or the user's instruction is received.
  • the display dynamic infrared thermal image can also be switched to display a frozen image of the thermal image data frame; in a preferred manner, the detected detection window having the largest correlation (or the position parameter of the object) Etc.) to make a notification. For example, the detected position of the position of the thermal image of the subject having the greatest correlation is detected in the frozen infrared thermal image.
  • the thermal image data frame is generated by the dynamic infrared thermal image, and the reference image is displayed together.
  • the infrared thermal image obtained by the thermal image data frame may not be displayed, and the prompt information may be displayed; or in a manner that various users can perceive by vibration, blinking of the indicator light, and the like.
  • the selection portion 11B is configured to indicate , can be displayed
  • the reduced infrared thermal image for example, is also sorted according to the degree of correlation.
  • the information of the correlation degree displayed is It does not necessarily mean that a specific subject thermal image is detected.
  • the comparison value may be updated or the comparison value may be further notified.
  • step A12 it is judged whether to exit. If not, the process returns to step A03, and the subsequent processing is repeated. At this time, since the contrast value of the correlation is updated in step A1, the thermal image data frame obtained in the subsequent shooting is compared with the updated correlation value, and when greater than the correlation When comparing the values, the specific information held is replaced.
  • the initial contrast value of the correlation is 72%; as shown in FIG. 6(a), when the value of the detected correlation is less than 72%, the specific information for notification is not displayed, If the word "No match" can be displayed.
  • the maximum correlation detected first is 80% (prompt information obtained by converting the sum of the ratios of the overlapping areas)
  • the value of the correlation is used as a correlation for subsequent comparison.
  • the contrast value of the degree replaces the correlation value of the correlation degree by 72%), and simultaneously displays the reduced infrared thermal image 601 obtained by the selected thermal image data frame with the dynamic infrared thermal image and the reference image.
  • the selection unit 11B holds the specific information such as the detected thermal image data frame corresponding to the value of 95% of the maximum correlation in the predetermined area of the temporary storage unit 2, and replaces the previous specific information;
  • the image, the reference image simultaneously displays the reduced infrared thermal image 603 obtained by the selected thermal image data frame; and so on, when the value of the detected correlation is 95%, the display is as shown in FIG.
  • the user If it is satisfactory, the aiming shooting of the subject can be stopped, and since the thermal image data frame is held in the storage medium such as the temporary storage unit 2, subsequent processing or operation such as analysis, storage, and the like can be facilitated.
  • the thermal image data frame corresponding to the infrared thermal image 603 is subjected to predetermined processing (e.g., compression, etc.) to the memory card 8.
  • predetermined processing e.g., compression, etc.
  • the indicator light blinks, since the thermal image data frame is held in the storage medium such as the temporary storage unit 2, the user can press the confirmation key. Or when recording a key, perform processing such as display, recording, and the like.
  • information for updating the comparison value may be notified without notifying the information of the thermal image data frame.
  • whether or not a specific subject thermal image is detected is not limited to a comparison between the correlation value and the correlation value of the correlation, and may be transformed into, for example, prescribed information obtained based on the detection. / or a comparison result of the evaluation value obtained by the information and the predetermined comparison value as a basis for detecting whether or not the specific subject thermal image is detected.
  • the reference image is displayed to assist the shooting, and when the thermal image data frame whose correlation is higher than the comparison value is detected, the thermal image data frame is selected or notified, and each subsequent
  • the comparison value and the notified information can be continuously updated, which can greatly reduce the difficulty of visual alignment, greatly reduce the physical strength of the shooting, and improve the final obtained.
  • the beneficial effect of the quality of the thermal image data frame It is easy for ordinary users to master this shooting skill.
  • implementing any of the products of the embodiments of the present invention does not necessarily require all of the advantages described above to be achieved at the same time.
  • the quality of the acquired thermal image data frame is not necessarily high; therefore, preferably, considering the position of the specific subject thermal image in the thermal image data frame, Ruler, f
  • the evaluation value obtained by one or more predetermined information is compared with a predetermined comparison value as a factor for selecting and notifying the predetermined thermal image data frame, and prompting the user to pay attention to the quality of the shooting, or selecting the most The quality of the thermal image data frame is processed for subsequent processing.
  • the second embodiment is different from the first embodiment in that the detecting unit 8 of the thermal imaging device 100 detects a thermal image data frame and a specific subject based on the thermal image data frame continuously acquired by the acquisition unit (the imaging unit 1).
  • the control unit 11 includes an auxiliary information acquiring unit (not shown) for acquiring auxiliary information, and a comparing unit 11A for detecting the obtained predetermined information and the auxiliary information acquired by the auxiliary information acquiring unit.
  • the detection unit detects the evaluation value obtained by the obtained predetermined information, the evaluation value obtained by the auxiliary information acquisition unit, and the evaluation value obtained by the detection unit and the auxiliary information obtained by the auxiliary information acquisition unit.
  • the selection unit 11B selects specific information related to the specified thermal image data frame based on the comparison result of the comparison unit 11A, when there are multiple comparisons, according to Different comparison results, in different embodiments, the specific information notified may be one or more frames of thermal image data frames Specific information relating; notification unit 11D, based on specific information selected by the selector 11B and the thermal image data of a predetermined frame related notification.
  • the comparison value updating section 11C is for updating the comparison value.
  • the predetermined information includes at least one of a position, a size, a tilt angle, and a value of a correlation of a specific subject thermal image, or any combination thereof.
  • the position, size, tilt angle, etc. of a specific subject thermal image in the infrared thermal image are considered, corresponding to different shooting qualities, even if the correlation is high, if the above parameters are not ideal,
  • the quality of the acquired thermal image data frame is not necessarily high; therefore, considering the position, size, tilt angle, and the like of the specific subject thermal image located in the thermal image data frame, as a factor for generating the notification, the user is prompted to pay attention to the shooting. Quality, or select the thermal image data frame of the best shooting quality for subsequent processing.
  • the auxiliary information may include at least one of an analysis value, an ambient temperature, a background factor, a wind speed, a humidity, a distance, and the like, or other auxiliary information acquired by the thermal imaging device 100 (including The setting by the user includes various other factors relating to the predetermined thermal image data frame selected by the selection unit 11B and/or factors affecting the information notified by the notification unit 11D.
  • the quality and importance of the obtained thermal image data frames are different, and there should be different conditions to cope with the comparison, selection, notification, etc. of the specified thermal image data frames.
  • the specified contrast value for example, the threshold value of the defect
  • the correlation When the correlation is close, it is also preferable to select and notify the specific information related to the thermal image data frame whose analysis value exceeds the standard, which will immediately attract the attention of the user, which is significant for infrared detection; for example, considering the ambient temperature, background, wind speed, background Influencing factors such as the difference between the background and the thermal image of the subject, the thermal field distribution of the background, etc., in the case of close correlation, these influencing factors may lead to different thermal image quality and the value of subsequent analysis. To reduce, other influencing factors should be selected and notified to interfere with the thermal image data frame.
  • the auxiliary information acquiring unit may acquire the auxiliary information according to the thermal image device 100 or a device connected to the thermal imaging device 100 or a component (not shown) of the corresponding function, for example, obtaining an analysis value by analyzing the component (analysis)
  • the value may be a temperature value obtained by the analysis, and is not limited to the temperature value, for example, it may be an AD value, a color value in a pseudo color thermal image, a ratio of a specific image value, or a value calculated by a predetermined formula. Value, etc.
  • the analysis value obtained by the analysis component can be obtained for all pixels in the thermal image data frame or pixels in a specific analysis area, and the temperature sensor is used to obtain the environment.
  • the temperature/humidity and the distance loo may be obtained according to the foregoing auxiliary information pre-stored in the storage medium, for example, historical data of the auxiliary information; or the auxiliary data acquired in combination with the current measurement and the historical data of the auxiliary information pre-stored in the storage medium. Compare to get auxiliary information.
  • the acquisition of the above auxiliary information is a technique well known to those skilled in the art.
  • the comprehensive evaluation value may be obtained by specifying information and/or auxiliary information; for example, the specific information in the detected prescribed information may correspond to different coefficients, and other specified information in the detected prescribed information may be used.
  • the evaluation value is obtained by combining the coefficient; for example, the weight of the different information may be used, and the evaluation value is obtained by weighting.
  • a comprehensive evaluation value may be obtained by the predetermined information and the auxiliary information.
  • the comparison unit compares with the specified comparison value.
  • the comparison value update unit 11C is configured to update the comparison value; if the comparison value is updated according to the comparison result of the comparison unit 11A; and, when there are multiple comparison values, at least one of the corresponding comparison values The item is updated; after the update, the comparison unit 11A is used for the predetermined information obtained by the detection unit 8 for subsequent detection, and/or the auxiliary information acquired by the auxiliary information acquisition unit, and/or by the predetermined information.
  • the evaluation value obtained by the auxiliary information is compared with the updated comparison value; when there are multiple comparison values, wherein, when the multiple comparison values are all updated, after the update, the corresponding multiple update The comparison values are compared; wherein, when a part of the plurality of comparison values is updated, after the update, the comparison value of the update item in the plurality of comparison values and the comparison value of the unupdated item are compared.
  • the optimal prescribed information obtained by the comparison unit comparison, or the optimal auxiliary information, or the optimal evaluation value obtained by the predetermined information and/or the auxiliary information obtained by the detection at least one of A comparison value is updated.
  • the detecting unit 8 is configured to detect a plurality of pieces of predetermined information of a specific subject thermal image, and the comparing unit 11A detects the obtained predetermined information and/or the evaluation value obtained based on the detected predetermined information by the detecting unit 8
  • the selection unit 11B may select specific information about a plurality of thermal image data frames based on the result of the comparison, and the notification unit 11D may notify one or more of them.
  • the selection unit selects a value of the correlation degree and/or a predetermined information and/or auxiliary information and/or an evaluation value (such as an evaluation value obtained by specifying information and/or auxiliary information) based on the comparison result of the comparison unit.
  • the specific information related to the thermal image data frame of the specified contrast value is maintained.
  • the notification unit may, based on the specific information related to the predetermined thermal image data frame selected and held by the selection unit, the value of the correlation and/or the predetermined information and/or the auxiliary information and/or the evaluation value (prescribed information and / or the evaluation value obtained by the auxiliary information is notified of the specific information related to the thermal image data frame of the specified comparison value. 2 100 with three comparison values.
  • the predetermined information (the value of the correlation) related to the specific subject thermal image in the thermal image data frame detected by the detecting unit 8, the predetermined information obtained by the detection, and the auxiliary information (analytical value) acquired by the auxiliary information acquiring unit.
  • the obtained evaluation values are compared with the first, second, and third comparison values.
  • the first contrast value is prepared in advance (in the present embodiment, the first contrast value of the correlation degree), and is used to determine whether or not there is a contrast value of the specific subject thermal image (representing the specific subject thermal image and the subject identification information) The judgment value of matching or not), the first comparison value is not updated.
  • a second comparison value in the present embodiment, a second comparison value of the correlation degree
  • the first comparison value which is obtained according to the value of the correlation of the detected thermal image data frame
  • the third comparison value obtains the comprehensive evaluation value by the position, the size, the inclination angle, the correlation value, the analysis value, and the like as a comparison with the corresponding (for example, prepared) third comparison value, and the subsequent thermal image data frame detection.
  • the third comparison value will be updated to a higher value.
  • the selection section 11B will select specific information relating to the second contrast value and/or the thermal image data frame superior to the third contrast value; facilitating subsequent processing of notification, analysis, diagnosis, recording, and the like.
  • Step A01-step ⁇ 03 similar to the steps A01-A03 of the embodiment 1, the description is omitted;
  • Step ⁇ 03 similar to the step of Embodiment 1 ⁇ 04- ⁇ 08, the correlation is detected, and the description is omitted;
  • Step ⁇ 04 determining whether the value of the correlation of the detected thermal image data frame is greater than the first comparison value, and if not, indicating that a specific specific subject thermal image is not detected, returning to step ⁇ 03, repeating the subsequent processing; It can also be configured to go to step 19, and if it is not exited, return to ⁇ 03; when the correlation detected at step ⁇ 04 is greater than the first comparison value, proceed to step ⁇ 05.
  • the auxiliary information acquiring unit obtains auxiliary information such as an image related to a specific subject thermal image, for the thermal image data frame whose correlation degree is greater than the first comparison value and/or the thermal image data in the thermal image data frame detection window. Values, etc., such as control analysis components for analysis to obtain analytical values.
  • the detecting section 8 is configured to calculate the correlation by detecting the pixel ratio or the like, it is not limited to determining the positional parameter of the detected specific subject thermal image based on the positional parameter of the detection window, and in this case, Further extracting a contour of a specific subject from the detected detection window to obtain more precise position, size, tilt angle, and the like, and predetermined information related to a specific subject thermal image.
  • the evaluation information is obtained by comparing the prescribed information and the obtained auxiliary information with the comprehensive evaluation value.
  • Step ⁇ 07 comparing with the third comparison value, if less than the third comparison value, at step ⁇ 08, comparing the value of the correlation obtained by the detection with the second comparison value; if not, jumping to step ⁇ 19, representing A thermal image data frame having a higher correlation than the currently detected thermal image data frame has been previously detected. If so, in steps B09-B10, the comparison value update unit 11C updates the second comparison value based on the value of the detected maximum correlation.
  • the selection unit 11B holds the specific information on the thermal image data frame in a predetermined area of the temporary storage unit 2, or also replaces the previous specific information (if there is specific information about the previous thermal image data frame, and the previous If the correlation of the thermal image data frame is smaller than the currently detected thermal image data frame, and the evaluation value is not maximized in the held thermal image data frame, the replacement is performed), and in step B1, the correlation is greater than the second The specific information related to the thermal image data frame of the comparison value is notified. Mi, comment on three, B12, daily value comparison;
  • the comparison value update unit 11C updates the second comparison value and the third comparison value based on the value of the maximum correlation detected by the thermal image data frame, the maximum comprehensive evaluation value. . Further, the selection unit 11B holds the specific information relating to the thermal image data frame in a predetermined area of the temporary storage unit 2, or also replaces the previous specific information (if any), and in step B11, the correlation degree is greater than The second comparison value and the specific evaluation information whose comprehensive evaluation value is larger than the third comparison value are notified.
  • the comparison value updating portion 11C updates the third comparison value based on the detected comprehensive evaluation value of the thermal image data frame.
  • the selection unit 11B holds the detected specific information on the thermal image data frame corresponding to the largest comprehensive evaluation value in the predetermined area of the temporary storage unit 2, and replaces the previous specific information (if there is a previous thermal image data frame) Regarding the specific information, and the evaluation value of the previous thermal image data frame is smaller than the currently detected thermal image data frame, and the correlation is not maximized in the held thermal image data frame, the replacement is performed), and in step B18 And notifying the specific information related to the thermal image data frame whose comprehensive evaluation value is greater than the third comparison value.
  • Step B19 determining whether to exit the detection mode, if exiting, ending, if not exiting, returning to step A03, obviously displaying the notification information obtained by the selected specific information, the infrared thermal image, the reference image, and repeating the above follow-up Processing.
  • specific information related to the second contrast value and/or the thermal image data frame superior to the third comparison value is selected and notified; Subsequent processing of notifications, analysis, diagnostics, records, etc.
  • whether the correlation degree of the detected thermal image data frame is greater than the first contrast value is used as a condition for further detecting the predetermined information, and the beneficial effect of capturing the wrong part and prompting the effective specific information can be further avoided.
  • the so-called superiority may be less than or greater than the contrast value depending on the comparison value.
  • the thermal image data frame whose correlation is greater than the first comparison value is detected for the first time, displaying the dynamic infrared thermal image and the reference image is related to the detected thermal image data frame.
  • the reduced infrared thermal image 901 the correlation degree of the correlation value is 85%, and the evaluation value converted by the evaluation value is 80%.
  • the comparison value updating portion 11C updates the second comparison value to, for example, 85%, and the third comparison value is, for example, updated to 80%; and, when the subsequent detection is not greater than the second comparison value and/or greater than the third comparison value
  • the display unit 10 maintains the state of displaying the notification information such as the infrared thermal image 901 and the dynamic infrared thermal image; and the infrared thermal image 901 is the notification information generated by the currently newly obtained specific information, and is bold. The border is used to alert the user.
  • the dynamic infrared thermal image, the reference image, and the specific information related to the detected thermal image data frame are displayed.
  • the specific information includes the reduced infrared thermal image 902 generated by the thermal image data frame, etc., where the correlation value corresponding to the infrared thermal image 902 is greater than the infrared thermal image 901, and the evaluation value is smaller than the infrared thermal image 901, and thus,
  • the selection unit 11B holds the specific information about the two thermal image data frames; and the comparison value update unit 11C updates the second comparison value according to the correlation degree corresponding to the infrared thermal image 902; the notification unit 11D causes the display unit 11D to display
  • the portion 10 displays the notification information generated by the specific information obtained by the two different thermal image data frames, and removes the bold frame from the infrared thermal image 901, and the infrared thermal image 902 thickens the frame. At this time, due to the infrared thermal
  • the selection portion 11B when the detected correlation is greater than the second comparison value and the evaluation value is larger than the thermal image data frame of the third comparison value, the selection portion 11B will specify the specific information related to the infrared thermal image 903.
  • the specific information related to the infrared thermal images 901, 902 is deleted, and the comparison value update portion 11C will be based on the correlation (95%) and the evaluation value (95%) corresponding to the infrared thermal image 903.
  • the second and third comparison values are updated; the notification unit 11D causes the display unit 10 to display the dynamic infrared thermal image, the reference image, and the detected specific information relating to the thermal image data frame, the specific information including the thermal image data.
  • the reduced infrared thermal image 903 generated by the frame or the like.
  • the selection unit selects and maintains the thermal image data frame of the correlation value and/or the evaluation value superior to (eg, greater than) the specified comparison value (the second comparison value, the third comparison value) based on the comparison result of the comparison portion.
  • the specific information and, if the notification is made, based on the control of the notification unit 11D, in the interface of the display unit 10, the information obtained by notifying the thermal image data frame having the highest correlation degree and/or the highest evaluation value can always be displayed, The user's shooting is extremely helpful, and it is easy to obtain high-quality thermal image data frames for random shooting.
  • the notification factor can achieve the difficulty of further reducing the visual alignment operation, improve the detection accuracy of the subject when the detection is matched, avoid the erroneous operation, and prompt the beneficial effects of the specific state, and the ordinary user can easily grasp the shooting skill.
  • comparison values are exemplified, more comparison values may be used, corresponding to several different evaluation values and/or auxiliary information and/or prescribed information obtained by the detection, for example, by a specific subject thermal image.
  • comparison value (three, or may be reduced to two) is exemplified in Embodiment 2, some of them are updated, some are not updated; but they may be configured to be all updated; or the comparison value may be removed.
  • the structure of the portion 11C is prepared in advance with a plurality of corresponding comparison values, all of which are not updated.
  • an evaluation value obtained based on the value of the correlation degree and the predetermined information and the auxiliary information is introduced as an example, and the notification is also performed based on the maximum correlation degree and/or the maximum evaluation value. It is also possible to notify only one of them; or, more contrast items are also configured, and correspondingly, a plurality of specific information of the thermal image data frame selected according to the preference of the different comparison items are also notified; or, The value of the correlation and the plurality of evaluation values are notified in order or priority.
  • the notification unit 11D is based on the specific information about the predetermined thermal image data frame selected by the selection unit 11B and/or the update information of the comparison value update unit 11C (may be an update operation, or may be information of the updated comparison value, etc.)
  • the notification is made, and preferably, the specific information related to the predetermined thermal image data frame of the latest selection (usually the correlation and/or the evaluation value is greater than the comparison value) is newly notified.
  • the user is very convenient; for example, the position, size, inclination, and correlation value of the heat-fixed subject are used as evaluation factors, and it is convenient to obtain a high-quality thermal image data frame or a thermal image data frame required for a specific shooting. ;
  • the auxiliary information is used as an evaluation factor to facilitate optimization of the notification thermal image data frame.
  • the selection portion 11B replaces (for example, deletes) the specific information obtained by the previous thermal image data frame
  • the notification unit 11D can also display specific information about a plurality of thermal image data frames, for example, sorting and displaying the specific information according to factors such as the degree of correlation and/or the evaluation value.
  • the functional component (not shown) of the contrast value updating unit 11C is removed, and when it is determined that the detected thermal image data frame is larger than the contrast value of the predetermined correlation degree, the selection is performed, and the comparison value of the correlation degree is not updated.
  • Step A01-Step A03 similar to the steps A01-A03 of Embodiment 1, the description is omitted;
  • Step C03 similar to the step A04-A08 of Embodiment 1, the description is omitted;
  • Step C04 comparing the value of the correlation degree of the obtained thermal image data frame with a predetermined contrast value (for example, a judgment value indicating whether the specific subject thermal image matches the subject identification information), if no , then return to step A03; it can also be configured to go to step C06, and if not exit, return to A03.
  • a predetermined contrast value for example, a judgment value indicating whether the specific subject thermal image matches the subject identification information
  • step C05 information related to the thermal image data frame larger than the specified contrast value is selected, or further processing such as notification, analysis, recording, etc., for example, the image obtained by the thermal image data frame, and the dynamic The infrared thermal image and reference image are displayed together.
  • the display dynamic infrared thermal image may be switched to display a frozen image of the thermal image data frame; or the display dynamic infrared thermal image may be switched to display a frozen image of the thermal image data frame, and then, in response to the user's instruction, Switching back to the display state of the dynamic infrared thermal image, or the state in which the image obtained by the thermal image data frame is displayed together with the dynamic infrared thermal image and the reference image.
  • Step C06 detecting whether to exit, if not, returning to step A03, repeating the subsequent processing; if yes, exiting. And, when a specific subject thermal image is detected in the subsequent thermal image data frame, the previously held thermal image data frame is replaced, and the related information display notification is performed; or, the related information is also displayed; for example, when When a predetermined number of thermal image data frames are specified, the user is notified to select a thermal image data frame from which to perform subsequent recording, analysis, and the like from the thermal image data frames.
  • the thermal image data frame whose correlation degree is larger than the predetermined contrast value is detected, the specific information related to the selection of the thermal image data frame is performed; or the user is further notified It reduces the operation intensity of visual alignment, and it is easy for ordinary users to master this shooting skill, and the operation is simple. Since the comparison value is not updated, it is possible to obtain a thermal image data frame having a lower quality than the previous one in subsequent shooting.
  • the present embodiment can also be modified to determine information according to a specific subject thermal image in the thermal image data frame, or to specify information related to a specific subject thermal image in the thermal image data frame and the auxiliary assistance.
  • the information, and the evaluation value obtained based on the predetermined information obtained by the detecting unit and/or the auxiliary information acquired by the auxiliary information acquiring unit, one or more of the comparison values are compared with a predetermined comparison value to obtain a comparison result. It is decided to select specific information related to the specified thermal image data frame.
  • the configuration of the selection portion 11B may be removed, that is, when a specific subject thermal image is detected, a notification such as vibration or the like is given to alert the user.
  • the fourth embodiment is different from the above-described first, second, and third embodiments in that the thermal imaging device 100 detects the multi-frame thermal image data stored in the temporary storage unit 2 when determining the detection instruction. And select the thermal image data frame that is optimal (for example, with the highest correlation). Suitable for shooting fast moving subjects.
  • step D01 the obtained thermal image data frame, for example, the thermal image data obtained by the imaging unit 1 is transmitted to the temporary storage unit 2; the display unit 10 displays the dynamic infrared thermal image and the reference image, wherein the temporary storage unit 2 is configured, for example.
  • the thermal image data frame captured by the imaging unit 1 is cyclically stored. 11 show? , 12 detects the instruction, then proceeds to the next step; and, the detection indication does not have to be issued by the user's operation, or may be issued by a predetermined timing or the like.
  • Step D03 reading the stored thermal image data frame from the temporary storage unit 2 to perform detection processing, and storing the correlation obtained by calculating the read thermal image data frame in the temporary storage unit 2 corresponding to the thermal image data frame; After detecting the thermal image data frame of the specified number (or all thermal image data frames), the maximum correlation value and its corresponding thermal image data frame are obtained.
  • step D04 the obtained maximum correlation is compared with a specified comparison value, and if not, returning to step D01, continuing to display the infrared thermal image, or displaying the not-detected thermal image data frame larger than the contrast value ; It can also be configured to go to step D08 first, and return to D01 if it has not exited.
  • step D05 the comparison value is updated according to the value of the maximum correlation obtained by the detection; and the specific information related to the thermal image data frame having the highest correlation is selected and maintained at D06, and notified in step D07, For example, an infrared thermal image obtained by the thermal image data frame and a dynamic infrared thermal image are displayed.
  • the updated comparison value can be used in the next detection process to ensure that specific information related to higher quality thermal image data frames is selected.
  • Step D08 detecting whether to exit, if not, returning to step D01, repeating the subsequent processing; if yes, exiting.
  • the frame having the highest correlation among the thermal image data frames stored in the temporary storage unit 2 is detected, which can reduce the operation intensity of the visual alignment.
  • the user can easily grasp such shooting skills, is simple in operation, can reduce the computational speed burden of the processor, reduces the cost of the thermal image device 100, and the like, and is suitable for shooting fast moving objects.
  • the exemplary thermal imaging device 100 is illustrated in each of the above embodiments, and is obviously applicable to various thermal imaging devices for portable shooting or online shooting; however, the present invention is applicable not only to thermal imaging devices with shooting functions, but also to A thermal image processing apparatus that receives and processes thermal images, such as thermal image processing devices that continuously receive and process thermal images from the outside (such as acquiring thermal image data frames in time series) (such as computers, personal digital assistants, thermal imaging devices with shooting functions)
  • a thermal display processing device for example, a computer, and a communication port (an example of an acquisition unit, for example, a thermal image processing device connected to an external device according to a communication specification such as USB, 1394, or network) and a thermal image
  • the device performs wired or wireless connection, and realizes an embodiment by continuously receiving the thermal image data frame outputted by the thermal image device connected thereto.
  • the processing methods such as detection processing, comparison processing, and selection processing are the same as those of the above embodiment, and the description is omitted. Description.
  • thermal image data frame from the outside
  • thermal image processing device for example, acquiring a thermal image data frame from other components, and also forming Embodiments of the invention.
  • notification unit it is preferable to have a notification unit, but there may be no notification unit, such as the user viewing the selected specific information by operation;
  • a prescribed detection time or a detection of a prescribed number of frames may be set to notify the optimal (e.g., most relevant) frame. It is also not limited to only notifying the optimal frame, and it is also possible to notify a plurality of frames.
  • Subject identification information may be a template or feature quantity.
  • the plurality of feature quantities in the corresponding detection window may be calculated according to the plurality of feature quantities of the template, and the determination result is obtained according to the comparison value corresponding to the plurality of feature quantities, for example, according to the plurality of feature quantities. Weighted to get the final judgment result. It is also possible to calculate one of the feature quantities first based on a plurality of feature quantities. , Yu, Next, according to multiple comparisons, to obtain the final judgment result.
  • the detection area may be displayed as a reference image or part; obviously, when the reference image embodies the morphological feature, the detection area may also be set according to the position parameter of the reference image located in the infrared thermal image (eg, according to the reference image)
  • the outer envelope is enlarged to enlarge the detection area obtained by the specified ratio); the speed of the detection process can be accelerated and the quality of the shooting can be ensured.
  • the comparison between the value of the correlation degree and the comparison value of the correlation degree is not limited to whether or not the specific subject thermal image is detected, and may be deformed into, for example, the predetermined information, the auxiliary information, and the prescribed information obtained by the detection.
  • the comparison value update unit may obtain the optimal evaluation value obtained based on the optimal predetermined information obtained by the comparison unit, or the optimal auxiliary information, or the predetermined information and/or the auxiliary information obtained based on the detection.
  • One of the items, the corresponding at least one comparison value is updated.
  • a selection unit that selects, according to a comparison result of the comparison unit, specific information related to at least one of the predetermined information and/or the auxiliary information and/or the evaluation value that is superior to the thermal image data frame of the specified comparison value, or further maintains;
  • the selected condition is such that at least one of the prescribed information and/or the auxiliary information and/or the evaluation value obtained by the detection is superior to the prescribed comparison value.
  • the notification unit may optimize the value of the correlation and/or the specified information and/or the auxiliary information and/or the evaluation value based on the specific information related to the predetermined thermal image data frame selected and maintained by the selection unit.
  • the specific information related to the thermal image data frame of the specified contrast value is notified.
  • the selected thermal image data frame can be used for subsequent display, analysis, diagnosis, transmission, recording, etc.; the analysis can obtain analytical values such as temperature values, ratio values of specific image values, or also according to prescribed formulas.
  • the obtained value or the like is calculated, and the diagnosis is obtained by comparing the analysis value with a predetermined threshold value to obtain a diagnosis result such as a diagnosis conclusion (for example, information such as defects, normal, etc.), a trigger signal, and the like, and the meaning of these processes is known to those skilled in the art. .
  • thermal image storage unit for storing continuously acquired multi-frame thermal image data frames
  • temporary storage unit 2 for example, configured to temporarily store multiple frames.
  • a circular memory of a thermal image data frame (for example, 50 frames) cyclically stores a thermal image data frame continuously acquired by an acquisition unit (e.g., the imaging unit 1 or the like).
  • processing such as detection is performed in response to a predetermined instruction.
  • the detecting unit is configured to detect predetermined information related to a specific subject thermal image in the thermal image data frame based on the continuously acquired thermal image data frame; the thermal image storage unit is configured to correspond to the storage heat a predetermined information obtained by the data frame and the detection thereof; and a comparison unit for determining the obtained predetermined information and/or the detection information by the detection unit based on the thermal image data frame stored in the thermal image storage unit and the associated predetermined information based on the predetermined instruction The evaluation value obtained by the predetermined information is compared with a predetermined comparison value. The selection unit selects specific information related to the predetermined thermal image data frame based on the comparison result of the comparison unit.
  • the comparison unit can perform comparison processing when a predetermined instruction such as a user's instruction or a predetermined timing comes. Or may be further modified to have multiple detection processes, for example, the detection unit detects (eg, roughly) the first predetermined information, and the thermal image storage unit is configured to store the thermal image data frame and its detection. And, in the indication, the comparison, according to the detection result, compared with the specified comparison value; or may be deformed to have multiple detection and/or comparison processing, for example, the thermal image storage unit may store the previous comparison selection The thermal image data frame and its corresponding specified information are used for subsequent detection (and, in response to a specified indication) detection and comparison.
  • control unit 11 and the image processing unit and the like include a plurality of processors, there may be parallel processing to which some steps are applicable.
  • the storage medium storing the object identification information or the like may be a storage medium in the thermal imaging device 100, such as a nonvolatile storage medium such as the flash memory 3 or the memory card 6, or a volatile storage medium such as the temporary storage unit 2;
  • Other storage media that are wired or wirelessly connected to the thermal image device 100 such as storage media or network destination storage in other devices that are wired or wirelessly connected to the communication I/F 4, such as other storage devices, thermal imaging devices, computers, and the like. medium.
  • the embodiment in which the subject identification information is associated with the subject information is a preferred mode, and various applicable subject information can be prepared depending on the application.
  • the object information is identity information of the representative object recognizable by the user, such as information representing the location, type, and location of the subject; but may also represent the subject. Type of information.
  • the subject identification information is not limited to being associated with the subject information.
  • aspects of the present invention may also be a computer (or a device such as a CPU, an MPU, etc.) of a system or device that performs the functions of the above-described embodiments by arranging and executing a program recorded on a storage device, and a system or device by the steps thereof
  • the computer is realized by, for example, a method of reading and executing a program recorded on a storage device to perform the functions of the above-described embodiments.
  • the program is provided to a computer or a thermal image device, for example, via a network or from various types of recording media (e.g., computer readable media) used as storage devices.
  • the present invention provides a computer program in which digital signals are recorded in a recording medium readable by a computer or a thermal image device, such as a hard disk, a memory or the like. After the program runs, perform the following steps:
  • An obtaining step configured to continuously acquire a thermal image data frame
  • a display control step for controlling a dynamic infrared thermal image and a reference image obtained based on the acquired thermal image data frame
  • the selecting step selects specific information related to the specified thermal image data frame based on the comparison result of the comparing step.
  • Embodiments of the present invention also provide a readable storage medium storing a computer program for electronic data exchange, wherein the computer program causes a computer in the thermal image device to perform the following steps:
  • An obtaining step configured to continuously acquire a thermal image data frame
  • a display control step for controlling a dynamic infrared thermal image and a reference image obtained based on the acquired thermal image data frame
  • the selecting step selects specific information related to the specified thermal image data frame based on the comparison result of the comparing step. Hard, present, one-to-one correspondence to achieve the structure of the function block.
  • a block of multiple functions can be implemented by one software or hardware module. Or a block of functionality can be implemented by multiple software or hardware units.
  • the processing and control functions of some or all of the functional portions of the embodiments of the present invention may also be implemented by a dedicated circuit or a general purpose processor or a programmable FPGA.
  • the example is based on the application of the subject in the power industry, and is also widely used in various industries of infrared detection.

Abstract

公开了一种红外选择装置和红外选择方法。红外选择装置包括:拍摄部(1),用于连续拍摄和获取热像数据帧;显示控制部(9),用于控制显示部,使其显示基于所获取的热像数据帧获得的动态的红外热像和参考图像;检测部(8),用于基于所获取的热像数据帧,检测与特定被摄体热像有关的规定信息;比较部(11A),用于对检测部检测获得的规定信息和/或基于检测获得的规定信息而得到的评价值,与规定的比较值进行比较;选择部(11B),基于比较部的比较结果,选择与规定的热像数据帧有关的特定信息。还公开了使用该红外选择装置的红外选择方法。因此,拍摄的操作简单,拍摄速度快,热像质量高。

Description

、 又 π 丫 、 又 、 /
技术领域
本发明的红外选择装置和红外选择方法, 涉及红外检测的应用领域。
背景技术
自热像检测技术应用以来, 使用者一直困惑于对正确拍摄部位、 拍摄角度下被摄体成像 形态的认知和拍摄距离的控制, 这些取决于使用者的主观意念和经验, 导致目前如果要确保 检测的质量则需边拍摄边思考, 拍摄速度很慢, 如果加快速度则易遗漏关键拍摄部位或被摄 体缺陷, 影响状态评估的效果。通常需要数年的实践积累, 使用者才能达到较高的检测水平。
本领域的技术人员一直试图解决这个问题, 存在这样的技术, 将体现了被摄体形态特征 的参考图像与红外热像进行连续重叠显示, 使用者以该参考图像作为拍摄特定被摄体热像的 视觉参照, 进行被摄体的拍摄, 来确保特定被摄体热像在红外热像中的位置、 尺寸和特定被 摄体热像的形态特征的正确, 以保证了拍摄的质量。 例如专利文献申请号: 201210008404.6 公开了这样的热像拍摄装置 ;
然而,上述方式需要使用者通过视觉人工来判断参考图像和特定被摄体热像的匹配程度, 使用者容易产生视觉上的疲劳; 当使用的是手持的热像装置时, 对准拍摄的操作容易疲劳, 反复的瞄准延长的拍摄的时间, 并影响了拍摄的热像质量。 并且, 这种方式操作呆板, 对拍 摄对准的要求高。
因此, 所理解需要一种红外选择装置, 其能达到无需过度依赖使用者主观上的意念, 如 能基于所获取的热像数据帧中自动选择符合规定条件的热像数据帧有关的特定信息, 以利于 分析、 通知、 存储等处理或操作, 从而使操作简单, 获得的热像数据帧质量高,
发明内容
本发明提供一种红外选择装置和红外选择方法, 在红外热像中显示参考图像, 并能自动 检测出所获取的热像数据帧中特定被摄体热像的位置、 尺寸、 倾斜角度、 相关度的值等规定 信息, 或还考虑辅助信息的因素, 以此如能自动选择符合规定条件的热像数据帧有关的特定 信息, 从而使拍摄的操作简单, 拍摄速度快, 热像质量高。 为此, 本发明采用以下技术方案, 红外选择装置, 包括, 拍摄部, 用于连续拍摄获取热像数据帧; 显示控制部, 用于控制 使显示基于所获取的热像数据帧获得的动态的红外热像和参考图像; 检测部, 用于基于所获 取的热像数据帧, 检测与特定被摄体热像有关的规定信息; 比较部, 用于对检测部检测获得 的规定信息和 /或基于检测获得的规定信息而得到的评价值, 与规定的对比值进行比较; 选择 部, 基于比较部的比较结果, 选择与规定的热像数据帧有关的特定信息。
还可采用这样的技术方案, 红外选择装置, 包括, 获取部, 用于连续获取热像数据帧; 显示控制部, 用于控制使显示基于所获取的热像数据帧获得的动态的红外热像和参考图像; 检测部, 用于基于所获取的热像数据帧, 检测与特定被摄体热像有关的规定信息; 比较部, 用于对检测部检测获得的规定信息和 /或基于检测获得的规定信息而得到的评价值,与规定的 对比值进行比较; 选择部, 基于比较部的比较结果, 选择与规定的热像数据帧有关的特定信 息。
本发明的红外选择方法, 包括, 拍摄步骤, 用于连续拍摄获取热像数据帧; 显示控制步 骤, 用于控制使显示基于所获取的热像数据帧获得的动态的红外热像和参考图像; 检测步骤, 用于基于所获取的热像数据帧, 检测与特定被摄体热像有关的规定信息; 比较步骤, 用于对 / 于 而 至 , 值进行比较; 选择步骤, 基于比较步骤的比较结果, 选择与规定的热像数据帧有关的特定信 息。
本发明的另一红外选择方法, 包括, 获取步骤, 用于连续获取热像数据帧; 显示控制步 骤, 用于控制使显示基于所获取的热像数据帧获得的动态的红外热像和参考图像; 检测步骤, 用于基于所获取的热像数据帧, 检测与特定被摄体热像有关的规定信息; 比较步骤, 用于对 检测步骤检测获得的规定信息和 /或基于检测获得的规定信息而得到的评价值,与规定的对比 值进行比较; 选择步骤, 基于比较步骤的比较结果, 选择与规定的热像数据帧有关的特定信 息。
本发明的其他方面和优点将通过下面的说明书进行阐述。
附图说明:
图 1是表示本发明的实施例 1的热像装置 100的概略构成的框图。
图 2是实施例 1的热像装置 100的外型图。
图 3是实施例 1存储介质中存储的被摄体信息、 参考图像构成数据、 被摄体识别信息等 的示意图。
图 4是不同参数的检测窗口的示意图。
图 5是检测区域中设置检测窗口进行检测的示意图。
图 6是实施例 1的处理过程的显示界面的显示例。
图 7是表示实施例 1的控制流程图。
图 8是表示实施例 2的控制流程图。
图 9是实施例 2的处理过程的显示界面的显示例。
图 10是表示实施例 3的控制流程图。
图 11是实施例 4的控制流程图。
具体实施方式
现在将根据附图详细说明本发明的典型实施例。 注意, 以下要说明的实施例用于更好地 理解本发明, 所以不限制本发明的范围, 并且可以改变本发明的范围内的各种形式。 而且, 虽然本发明在以下实施例中用于便携式的热像拍摄设备, 但对于本发明来说拍摄功能不是必 须的, 可以使用要进行特定被摄体检测的任意热像数据源。 因此本发明还可广泛用于从外部 接收和处理热像的热像处理设备, 所述热像处理设备包括如个人计算机、 个人数字助理等各 种装置。
实施例 1
实施方式 1的热像装置 100 (红外选择装置) 基于由拍摄部 1连续拍摄获得的热像数据 帧, 检测获取的热像数据帧与被摄体识别信息之间的相关度等, 基于比较结果, 来选择热像 数据帧有关的特定信息。
图 1是表示实施例 1的红外选择装置示例的热像装置 100的概略构成的框图。
具体而言,热像装置 100具有拍摄部 1、临时存储部 2、闪存 3、通信 I/F4、存储卡 I/F5、 存储卡 6、 图像处理部 7、 检测部 8、 显示控制部 9、 显示部 10, 控制部 11、 操作部 12、 控 制部 11通过控制与数据总线 13与上述相应部分进行连接, 负责热像装置 100的总体控制。 示 、 驱 、 器、 。 光学部件由红外光学透镜组成, 用于将接收的红外辐射聚焦到红外探测器。 镜头驱动部件根 据控制部 11的控制信号驱动透镜来执行聚焦或变焦操作。此外,也可为手动调节的光学部件。 红外探测器如制冷或非制冷类型的红外焦平面探测器, 把通过光学部件的红外辐射转换为电 信号。 信号预处理电路包括采样电路、 AD转换电路、 定时触发电路等, 将从红外探测器输出 的电信号在规定的周期内进行取样等信号处理, 经 AD转换电路转换为数字的热像信号, 该热 像信号例如为 14位或 16位的二进制数据(又称为热像 AD值数据, 简称 AD值数据)。在实施 例 1中, 拍摄部 1作为获取部的实例, 用于拍摄获取热像数据帧。
所谓热像数据帧, 根据获取部不同的实施方式, 可以是热像信号 (红外探测器输出信号 经 AD转换后获得的热像 AD值数据), 或红外热像的图像数据, 或温度值的阵列数据, 或其他 基于热像信号生成的数据等。 在下文中热像数据帧以热像信号为例。
临时存储部 2如 RAM、 DRAM等易失性存储器, 作为对拍摄部 1输出的热像数据帧进行临 时存储的缓冲存储器, 例如重复如下处理, 将获取的热像数据帧临时存储规定时间份, 并在 由所述获取部 (拍摄部 1 ) 获取新的帧时, 删除旧的帧后存储新的热像数据帧; 同时, 作为 图像处理部 7、 检测部 8、 控制部 11等的工作存储器起作用, 暂时存储进行处理的数据。 不 限于此, 图像处理部 7、 检测部 8、 控制部 11等处理器内部包含的存储器或者寄存器等也可 以解释为一种临时存储介质。
闪存 3, 存储有用于控制的程序, 以及各部分控制中使用的各种数据。 本实施例中, 如 图 3所示, 与参考图像、 检测等有关的数据存储在存储介质如闪存 3中, 例如存储被摄体识 别信息的数据库 (表 3), 将每个被摄体的被摄体信息、 参考图像的构成数据、 被摄体识别信 息相互对应进行存储, 此外, 也可以以特定格式的数据文件等来存储。 所谓参考图像的构成 数据, 例如矢量图形数据, 点阵图像数据, 也包括由多个坐标点数据构成参考图像的构成数 据。 其中模板数据可以与参考图像构成数据相同或不同。
被摄体信息为与被摄体有关的信息, 例如代表被摄体地点、 类型、 编号等的信息, 此外, 还可以例举被摄体有关的归属单位、分类等级(如电压等级、重要等级等)、型号、制造厂商、 性能和特性、 过去的拍摄或检修的履历、 制造日期、 使用期限等各种信息。 根据应用的不同 可以准备各种适用的被摄体信息。
通信 I/F4是例如按照 USB、 1394、 网络等通信规范, 将热像装置 100与外部装置进行连 接并数据交换的接口, 作为外部装置, 例如可以列举个人计算机、 服务器、 PDA (个人数字助 理装置)、 其他的热像装置、 可见光拍摄装置、 存储装置等。
存储卡 I/F5 , 作为存储卡 6的接口, 在存储卡 I/F5上, 连接有作为可改写的非易失性 存储器的存储卡 6, 可自由拆装地安装在热像装置 100主体的卡槽内, 根据控制部 11的记录 控制单元 (省略图示) 的控制记录热像数据帧等数据。
图像处理部 7用于对通过拍摄部 1获得的热像数据帧进行规定的处理, 例如其在显示定 时每次到来之际, 从临时存储在所述临时存储部 2的规定时间份的热像数据帧中, 选择并读 出每个规定时间间隔的帧; 图像处理部 7的处理如修正、 插值、 伪彩、 合成、 压缩、 解压等, 进行转换为适合于显示用、 记录用等数据的处理。 图像处理部 7例如可以采用 DSP或其他微 处理器或可编程的 FPGA等来实现, 或者, 也可与检测部 8、 控制部 11对应的处理器为一体。 于 1 :
图像数据。 具体而言, 例如, 图像处理部 7对拍摄部 1拍摄获得的热像数据帧进行非均匀性 校正、 插值等规定处理, 对规定处理后的热像数据帧进行伪彩处理, 获得红外热像的图像数 据; 伪彩处理的一种实施方式, 例如根据热像数据帧的 AD值数据的范围或 AD值数据的设定 范围来确定对应的伪彩表范围, 将热像数据在伪彩板范围中对应的具体颜色值作为其在红外 热像中对应像素位置的图像数据。 从图像处理部 7伪彩处理后获得的图像数据传送到作为缓 冲存储器使用的临时存储部 2中。
另外, 图像处理部 7具备合成单元(未图示), 所述合成单元基于参考图像指定部 11F所 指定的参考图像的构成数据, 及位置设置部 11G设置的位置参数, 来获得参考图像, 并与图 像处理部 7生成的红外热像, 进行合成后产生合成图像的图像数据。 具体地说, 图像合成单 元根据规定的透明率, 将参考图像与红外热像进行合成; 包括这种情况, 参考图像的透明率 为 1 (如参考图像为边缘轮廓的线条图像), 即不透明与红外热像合成。
图像处理部 7, 用于基于所指定的参考图像的构成数据及位置设置部 11G所设置的位置 参数, 对所获取的热像数据帧进行规定处理, 生成体现了参考图像的红外热像。
此外, 合成也可以是根据这样的处理, 例如根据参考图像位于红外热像中的像素位置, 来对热像数据帧进行伪彩处理, 以生成体现了参考图像和红外热像的显示用图像数据 (类似 重叠的效果); 例如, 根据参考图像的位于红外热像中的像素位置, 对该像素位置的热像数据 不进行伪彩处理, 将参考图像的像素位置以外的热像数据进行伪彩处理, 而后结合参考图像 的图像数据, 来生成显示用图像数据。
或者, 也可以将参考图像对应热像数据帧中的像素位置的热像数据, 进行与其他像数位 置的热像数据的伪彩处理所不同的处理(如不同伪彩处理), 来生成带有体现该参考图像的图 像。 这种情况下, 在热像装置 100中可以去除用来将参考图像与红外热像合成的图像合成单 元。
所谓的参考图像, 与红外热像共同显示, 可帮助使用者拍摄特定被摄体。 例如, 体现该 特定被摄体的形态特征的图像; 参考图像也可以是其他的形状, 如方形、 圆形; 例如, 体现 被摄体热像位于红外热像中的期望成像位置的的标识图像; 例如体现红外热像中的检测区域 (检测区域可以包含一个或多个检测窗口) 的标识图像; 例如体现了期望的被摄体热像的分 析区域的标识图像等。 优选的方式, 参考图像按照规定的位置参数 (位置、 或还包括尺寸, 或还包括旋转角度) 与红外热像重叠显示。
此外, 参考图像也可显示于显示部中, 红外热像窗口之外的区域; 此外, 也可以将代表 参考图像与红外热像的位置及尺寸比例等关系的缩略图显示在红外热像窗口之外的显示部的 区域。
检测部 8基于获取的热像数据帧, 进行与被摄体识别信息之间的相关度计算; 其中, 检 测部 8基于获取部连续获取的热像数据帧, 可以是对连续获取的热像数据帧依次全部进行检 测处理, 也可以从连续获取的热像数据帧中选择部分热像数据帧进行检测处理, 例如只读取 规定间隔的热像数据帧进行检测处理;例如当第一次检测到与相关度和 /或评价值大于对比值 的热像数据帧时, 即不再继续检测; 例如响应使用者的预定操作来开始进行检测或停止检测; 或者对读取的热像数据帧或检测窗口中的热像数据检测前进行了缩小处理; 以此, 能减轻伴 随着检测的处理负担。 , 可 (AD ), ; i i , 温 值的阵列数据, 或其他基于热像信号获得的数据等。 例如, 检测部 8基于控制部 11的控制, 可以通过读取临时存储部 2中所存储的拍摄部 1拍摄获得的热像数据帧, 或通过读取临时存 储部 2中所存储的图像处理部对拍摄部 1拍摄获得的热像数据帧进行规定处理获得的数据 (例 如伪彩处理获得的红外热像的图像数据),来执行与所登记的被摄体识别信息之间的相关度的 检测处理。
不限定于拍摄部 1拍摄获取的热像数据帧, 在其他的例子中, 如也可以是外部输入的数 据获得的, 例如通过 I/F4从其他热像装置所连续接收并解码获得的热像数据帧。
在实施例 1中, 检测部 8包括特征登记单元、 检测窗口设置单元、 检测单元 (未图示)。 特征登记单元, 用于登记用来相关度计算有关的被摄体识别信息。 例如, 可根据存储介 质中预先存储的被摄体识别信息来登记被摄体识别信息; 例如, 根据使用者的选择的被摄体 信息关联的被摄体识别信息, 来登记用于相关度计算的被摄体识别信息。 此外, 也可以由用 户来指定被摄体识别信息, 例如可以通过从显示图像中指定被摄体区域来获得被摄体识别信 息 (例如模板数据, 或提取的特征量)。 所登记的被摄体识别信息例如被存储在临时存储部 2 的规定位置, 或存储时以标记与存储的其他被摄体识别信息区别。
所谓被摄体识别信息可以是用于模板匹配的模板数据(如模板图像); 此外, 被摄体识别 信息也可以是参数描述的特征量, 所谓特征量(点、 线、 面等特征), 例如, 为根据检测窗口 中所包含的像素的状态所决定的值, 如为特定检测窗口中的规定部分像素的比例、 像素值的 平均值、 特定被摄体的轮廓的中心点、 面积等。 例如, 对于表 3中的被摄体 1, 被摄体识别 信息为模板数据 301, 对于表 3中的被摄体 2,被摄体识别信息为特征量 302。在具体应用中, 可以根据情况选择其中一种或多种被摄体识别信息方式的结合。
检测窗口设置单元,用于设置检测窗口。例如根据一定范围的检测区域(如图 5中的 Gl ), 在该检测区域 G1中设置多个检测窗口 (例如按照质量要求来预定检测窗口的参数), 可以是 多个不同尺寸的检测窗口, 也可以是近一步倾斜后的检测窗口, 如图 4所示, 其中图 4 (a) 为标准的检测窗口, 图 4 (b)为根据缩小尺寸的检测窗口, 图 4 ( c)为放大尺寸设置的检测 窗口, 图 4 (d) 为按照规定角度倾斜而设置的检测窗口。 为了等于检测窗口的尺寸, 此处模 板图像以缩小或放大或还倾斜的状态被使用, 或者, 也可以准备及存储尺寸等于窗口尺寸的 模板图像以备使用。 此外, 也可将检测窗口中的热像数据以缩小或放大或还倾斜的状态被使 用, 以对应模板图像。 检测窗口不限定于方形, 也可以是其它形状, 例如可以根据模板的形 状来定。
检测区域可由使用者根据拍摄习惯来设置;或者也可以是预存的如与被摄体信息关联的; 也可以根据上次检测出特定被摄体热像的位置生成的; 也可不设置特定的检测区域, 而将热 像数据帧的范围作为检测区域。 也可以是使用者指定的位置和尺寸来设置多个检测窗口。 此 外, 并非必须设置多个检测窗口, 也可以只设置一个检测窗口。
需要注意的是, 对于红外检测的应用领域, 例如变电站中充斥着大量外形类似, 但名称 不同的设备, 为避免误导使用者及误拍摄, 优选的是设置检测区域。 在红外热像上重叠显示 检测区域的标识, 使用者易于明白所拍摄的特定被摄体热像的大致位置、 尺寸等, 便于拍摄 参照, 并能加快检测处理的速度, 但检测区域也可不显示。 , 于 , 于 口 元 /
像数据, 根据所登记的被摄体识别信息, 获得用于评价类似程度的相关度的值。 当设置了多 个检测窗口时, 例如可将其中检测获得的最大相关度的值作为该热像数据帧的相关度的值。
检测部 8的检测处理可以是基于模板匹配的检测方式, 基于检测窗口中的热像数据与模 板图像进行相关度的计算和比较; 例如, 检测单元计算检测窗口中的红外热像和作为模板图 像的红外热像相互对应的位置的像素之间的差的和, 所计算出的差的和越小, 相关度越高。 例如, 也可配置为提取特征量进行匹配的实施方式, 利用模板图像与检测窗口中的热像数据 的特征量之间的比较来确定相关度。例如, 提取检测窗口中的被摄体图像的特定像素的比例, 与模板图像中的特定像素的比例越接近, 相关度越高。
检测部 8的检测处理也可以是基于参数描述的特征量的检测实施方式, 进行规定的运算 来获得检测窗口中的热像数据的特征量, 并与特征量的基准值(被摄体识别信息)进行比较, 来获得相关度的值。 例如, 所述特征量的基准值为特定像素值的像素的比例, 检测单元计算 热像数据中特定像素值的像素的比例, 与特征量的基准值进行比较, 来获得二者之间的相关 度的值。
优选的方式, 采用轮廓图像作为匹配的模板, 检测部 8例如通过以下的处理来计算相关 度, 首先, 检测部 8提取位于检测窗口中的热像数据, 按照 AD值的预定阀值对读取的检测窗 口中的热像数据进行二值化; 接着, 提取该二值图像的具有预定像素值(1或 0 ) 的像素相连 通的连通图像; 而后判断该连通图像是否具有预定范围的大小; 如果判断出该连通图像的大 小在预定范围内, 则近一步在提取的连通图像与所登记的模板之间执行比较处理, 例如计算 二者之间的重叠面积在各自总面积中的比例之和, 由此, 获得所提取热像数据与模板之间相 关度。
对于检测的示例, 如图 5所示, 检测部 8从热像数据帧 501的规定检测区域 G1的左上角 到右下角移动窗口 J1以进行检测, 剪切窗口中的热像数据, 并检测其与模板图像 T1的相关 度。 具体而言, 窗口 J1从左端向右以规定值的窗口位移(例如一个像素)逐步地移动, 并在 到达右端后, 被设置返回左端并向下移动窗口位移, 以及随后再次逐步地向右移动。 为高精 度地检测被摄体, 检测的窗口尺寸、 窗口位移、 窗口的倾斜角度的变换范围可被预先定义, 例如窗口尺寸的变化范围从 150 X 50像素到 120 X 40像素,窗口位移的变化范围从 10个像素 到 1个像素, 窗口的倾斜角度的变化范围为基于中心点的 0° 到 10° 。 检测部 8逐次的, 每 次 5个像素地改变窗口尺寸, 并每次 1个像素地改变窗口位移, 并每次 2° 地改变窗口倾斜 角度。检测部 8进行模板图像 T1和热像数据帧 501的相关度计算; 在完成所有检测窗口的检 测后, 从中选择相关度最高的检测窗口所获得的相关度的值, 作为该热像数据帧 501对应的 相关度的值。
注意, 可以基于被摄体识别信息, 来计算热像数据帧的相关度的各种方法, 上述例举的 处理仅是可使用方法的示例。
显示控制部 9, 用于将临时存储部 2所存储的显示用的图像数据显示在显示部 10。例如, 在拍摄待机模式中, 连续显示拍摄获得的热像数据生成的红外热像; 在回放模式, 显示从存 储卡 6读出和扩展的红外热像, 此外, 还可显示各种设定信息。 具体而言, 显示控制部 9具 有 VRAM、 VRAM控制单元、 信号生成单元 (未图示) 等, 并且, 信号生成单元在控制部 11的 控制下, 从 VRAM中定期读出图像数据(从临时存储部 2读出并存储到 VRAM的图像数据), 产 RRΛ R
视频 1目亏卿 , 显不 显不邰 ιο。 loo , 显不邰 l CTW定 y仪日 並不 。 不限于此, 显示部 10还可以是与热像装置 100连接的其他显示装置, 而热像装置 100自身的 电气结构中可以没有显示部, 这时显示控制部 9也可作为图像输出部件的实例。
另外, 在实施例 1中, 显示部 10基于通知部 11D的控制, 用于对通知信息进行显示; 例 如以文字和图像进行警告, 如显示最大相关度的信息, 显示最大相关度的热像数据帧获得的 红外热像, 或者还伴随着文字、 图像的透明率、 颜色、 尺寸、 线形、 粗细、 闪烁、 亮度、 边 框的变化等方式来进行通知。
其中, 通知的方式可以持续规定的时间。 此外, 也可控制热像装置 100中的振动部件、 指示灯 (未图示), 分析部件 (未图示), 诊断部件 (未图示), 在检测到最大相关度的热像数 据帧时, 也可由指示灯产生灯光变化, 由振动装置产生震动, 由分析部件进行分析并显示分 析结果, 由诊断部件进行诊断并显示诊断结果; 或同时以上述方式之一或多个进行通知, 只 要是使用者可以感知的方式都可。
控制部 11控制了热像装置 100的整体的动作,在存储介质例如闪存 3中存储有用于控制 的程序, 以及各部分控制中使用的各种数据。控制部 11例如由 CPU、 MPU、 S0C、可编程的 FPGA 等来实现。 在本实施例中, 控制部 11、 显示部 10等还作为被摄体信息选择部的构成, 用来 选择被摄体信息。
另外, 控制部 11具备比较部 11A, 用于对检测部 8检测获得的规定信息和 /或基于检测 获得的规定信息而得到的评价值与规定的对比值进行比较, 所述规定信息, 至少包括特定被 摄体热像的位置、 尺寸、 倾斜角度、 相关度的值中的一种或任意组合的信息; 实施例 1中, 将检测部 8所获得的热像数据帧的相关度的值, 与相关度的对比值进行比较。 注意, 相关度 的对比值可以是预先准备的相关度的判断值 (例如与被摄体识别信息对应存储在表 3中, 例 如使用者设置的对比值), 当大于该对比值时, 判断该热像数据帧中具有特定被摄体热像; 也 可不必预先准备的相关度的对比值, 而根据热像数据帧中的相关度的值来获得, 例如将第一 次检测处理获得的相关度的值作为后续对比相关度的对比值, 并且, 当后续检测到相关度大 于该对比值时, 予以更新。
另外, 控制部 11具有选择部 11B, 基于比较部 11A的比较结果, 选择与规定的热像数据 帧有关的特定信息。 所选择的特定信息可用于后续将经历的规定处理, 如分析、 记录、 通知 等。
其中, 规定的热像数据帧有关的特定信息, 可以是在临时存储部 2的多帧热像数据帧中 的一帧或多帧热像数据帧有关的特定信息; 例如, 基于比较部 11A的比较结果, 选择具有最 大相关度的热像数据帧有关的特定信息; 但并不限定于所检测到的最大相关度的那一帧热像 数据帧, 例如检测到最大相关度的帧的时序之前或之后的那一帧, 或由多帧运算获得的那一 帧, 或最早检测到大于规定的对比值的相关度对应的热像数据帧有关的特定信息。 也可以配 置为选择多个热像数据帧有关的特定信息, 例如选择相关度第一、 第二、 第三的三帧热像数 据帧有关的特定信息, 也可能选择多帧相关度一样的热像数据帧的特定信息。
或者, 也可以是检测到最大相关度的热像数据帧时, 拍摄部 1拍摄获得并存储在临时存 储部 2中的多个热像数据帧中的一帧或多帧; 或者, 也可以是检测到最大相关度的热像数据 帧后, 拍摄部 1拍摄获得并存储在临时存储部 2中的多个热像数据帧中的一帧或多帧。 、 2
据帧中选择的热像数据帧进行规定处理获得的数据, 检测获得的规定信息, 基于检测获得的 规定信息而得到的评价值, 基于检测获得的规定信息和 /或所述评价值生成的提示信息, 其中 的一项或多项。
其中, 从多帧热像数据帧中选择的热像数据帧进行规定处理获得的数据, 例如将所选择 的热像数据帧进行规定处理后获得的数据, 例如从该热像数据帧中提取的特定被摄体热像, 例如生成的红外热像的图像数据, 例如将该热像数据帧转换为分析数值例如温度数值的阵列 等。
其中, 检测获得的规定信息, 所述规定信息例如至少包括特定被摄体热像的位置、 尺寸、 倾斜角度、 相关度的值中的一种或任意组合的信息。
其中, 基于检测获得的规定信息而得到的评价值, 例如为根据检测获得的规定信息根据 加权系数进行加权获得、 或也可根据规定信息与评价值的对照表等来获得评价热像质量等的 评价值。
其中, 基于检测获得的规定信息和 /或所述评价值生成的提示信息, 例如将检测获得的规 定信息和 /或所述评价值转换为使用者便于理解的百分比信息的提示等。
选择部 11B对所选择的特定信息进行保持 /或不保持的控制;所保持的特定信息保持在临 时存储部 2的规定区域, 此外, 也可保持 (存储) 在例如闪存 3等存储介质中。 在下文中, 选择部 11B将热像数据帧等特定信息保持在临时存储部 2的规定区域为例。
选择部 11B可以将所选择的特定信息始终保持, 也可以在规定的条件下进行保持, 例如 当前选择的特定信息保持规定的时间; 例如在检测到更大相关度的热像数据帧之前始终保持 当前的特定信息; 例如在用于检测比对的被摄体识别信息或选择的被摄体信息被变更之前始 终保持所选择的特定信息; 例如根据使用者的指示 (如使用者选择了显示部中显示的某个特 定信息来确定保持)来保持或不保持的特定信息。此外也可不保持, 例如通过通信 I/F4发送 至其他外部装置; 例如经历其他处理如在通知后即删除等。
并且, 选择部 11B, 用于按照规定的条件将临时存储部 2所保持的特定信息, 更新为选 择部 11B后续选择的特定信息。 所谓规定的条件, 例如规定的时间, 例如检测了规定数量的 热像数据帧, 例如根据比较部 11A的比较结果 (获得了相关度大于所保持的热像数据帧的相 关度等情况), 例如使用者的指示等。 此外, 还可将之前予以保持的特定信息继续保持。
实施例 1中, 基于比较部 11A的比较结果, 选择部 11B对特定信息进行选择、 保持及更 新的控制。 如当检测部 8检测到的特定被摄体热像的相关度的值大于相关度的对比值时, 将 选择该相关度的值及对应的热像数据帧等特定信息予以保持在临时存储部 2等存储介质中; 当之前有相关度的值及对应的热像数据帧等特定信息时, 将替换之前的特定信息; 直到后续 有相关度更高的热像数据帧时, 可被替换 (也可保持规定数量的相关度较高的热像数据帧)。 这样, 作为最大的相关度的值及对应的热像数据帧等特定信息得以保持。 此外, 还可将之前 予以保持的特定信息继续保持。
注意, 选择部 11B并不限定于选择最优 (例如相关度最大) 的一帧热像数据帧有关的特 定信息, 例如, 也可以选择次优的, 或选择多帧运算来获得的那一帧; 或也可以配置为选择 多个热像数据帧有关的特定信息, 例如选择存储 (保持) 相关度第一、 第二、 第三的三帧热 像数据帧有关的特定信息, 也可能保存了三帧相关度一样的热像数据帧的特定信息。 11 i ic, 于 : 且, 当对比值更新后, 所述比较部 11A, 对检测部 8检测获得的规定信息和 /或基于检测获得的规 定信息而得到的评价值, 与更新后的对比值进行比较。
对比值的更新条件, 例如使用者的指示来更新; 例如根据比较部 11A的比较结果, 将对 比值进行更新; 例如根据规定的时间来进行更新。
根据比较部 11A的比较结果, 将对比值进行更新, 可以是根据预先准备的多个对比值, 依次进行更新; 例如准备了三个相关度的对比值, 当检测部 8检测到的相关度大于第一个对 比值时, 后续将更新为第二个对比值, 当大于第二个对比值时, 将更新为第三个对比值。
根据比较部 11A的比较结果, 将对比值进行更新, 也可以是根据检测获得的规定信息等 来更新预先准备的对比值; 例如根据检测部 8检测获得相关度的值, 当该相关度的值大于预 先准备的相关度的对比值时, 将根据所获得相关度的值来替换对比值进行更新。
根据比较部 11A的比较结果, 将对比值进行更新, 也可以是根据检测获得的规定信息来 自我更新, 其中, 没有预先准备的对比值; 例如根据检测部 8检测获得相关度的值, 当该相 关度的值大于相关度的对比值 (例如之前所检测到的相关度最大的值来作为对比值) 时, 将 所获得相关度的值相应替换对比值进行更新。
优选的, 控制部 11具备通知部 11D, 基于选择部 11B所选择与规定的热像数据帧有关的 特定信息和 /或对比值更新的信息, 进行通知。 例如, 基于选择部 11B所选择的并保持的与规 定的热像数据帧有关的特定信息, 将特定信息获得的通知信息与获取部连续获取的热像数据 帧获得的红外热像、 参考图像等共同显示。 优选的, 将当前所选择的特定信息获得的通知信 息与获取部连续获取的热像数据帧获得的红外热像、 参考图像等共同显示。 例如将当前所选 择的并保持的热像数据帧获得的红外热像 (如缩小后) 与拍摄部 1获取的连续的红外热像、 参考图像共同显示, 此外, 也可以同时或单独显示其他的通知信息, 例如相关度的值, 评价 值等。 此外, 也可将动态红外热像切换为显示该热像数据帧的冻结图像。
其中, 当选择部 11B选择并保持了多个热像数据帧有关的特定信息时, 通知部 11D可以 对其中之一或多个进行通知, 例如, 将该多个热像数据帧获得的红外热像 (如缩小后) 与拍 摄部 1获取的连续的红外热像共同显示。
其中, 根据选择部 11B所选择与规定的热像数据帧有关的特定信息, 来获得通知信息, 例如可以将相关度的值换算为示意类似程度的便于使用者理解的信息, 进行显示; 例如根据 相关度的值与百分比的规定的对照表, 或计算的方式 (如所提取的特定被摄体轮廓与轮廓 T1 重叠面积在各自总面积中的比例之和, 除以 200%, 即可换算为相关度的百分比值) 将相关度 的值换算为百分比值); 也可以是其他的方式, 例如直接将计算相关度的值显示, 如直接显示 像素值之差的和的数值等。 注意, 当未与代表检测到特定被摄体热像与否的规定对比值 (代 表特定被摄体热像与被摄体识别信息匹配与否的判断值) 做对比时, 所显示的相关度的信息 并不一定代表检测到特定被摄体热像(匹配)与否。 为便于说明, 在下文中, 将相关度的值、 评价值、 对比值换算的百分比值作为示例, 但实际中并不必须换算成百分比值。
其中, 通知的方式可以持续规定的时间。 并且, 基于通知部 11D的控制, 可以使显示部 10产生显示内容的变化、 热像装置 100中的振动部件的振动、 指示灯的灯光变化、 声音部件 的声音、 分析部件的分析处理 (并使显示部 10显示分析结果), 诊断部件进行诊断 (并使显 示 u )、 显示 、
变化; 只要是使用者可以感知的方式都可。
另外, 控制部 11具有记录部 11E (未图示), 响应规定的记录指示, 将选择部 11B所选 择并保持在临时存储部 2中的热像数据帧进行记录到存储卡 8。 例如响应使用者对所通知的 热像数据帧的选择等指示, 例如定时的自动记录等指示, 将所述热像数据帧进行记录到存储 卡 8。
另外, 控制部 11具备参考图像指定部 11F (未图示), 用于指定要与红外热像共同显示 的参考图像的构成数据; 例如, 基于存储介质中存储的被摄体信息关联的参考图像的构成数 据 (点阵数据和 /或矢量数据), 根据使用者对被摄体信息的选择, 来指定与被摄体信息关联 的参考图像的构成数据; 并不限定于通过被摄体信息, 也可从存储介质中选择例如热像文件 等来获得参考图像的构成数据; 此外, 也可以根据热像装置 100的默认配置, 来指定参考图 像的构成数据, 例如默认的检测区域的数据; 此外, 也可以例如从显示部显示的红外热像中 指定区域, 并将该区域的红外热像作为参考图像等各种指定的方式。
另外, 控制部 11具备位置设置部 11G (未图示), 用于设置参考图像位于显示部中的位 置参数(位置, 或还包括尺寸, 或还包括旋转角度)。 优选的, 位置设置部 11G用于设置参考 图像位于红外热像中的位置参数; 例如, 根据红外热像中规定的自适应显示区域, 根据所计 算的参考图像在该自适应区域中最大化居中显示的位置参数, 从而来设置参考图像位于红外 热像中的位置参数; 例如, 也可根据参考图像所附带的参数 (例如体现了红外热像中的位置 参数), 根据该参数来设置参考图像位于红外热像中的位置参数; 或者, 也可以根据热像装置 100的配置 (居中, 原始尺寸) 来设置参考图像位于红外热像中的位置参数; 或者, 也可以 根据使用者输入的位置参数。
操作部 12 : 用于使用者进行各种指示操作, 或者输入设定信息等各种操作, 控制部 11 根据操作部 12的操作信号, 执行相应的程序。 参考图 2来说明操作部 12, 提供使用者操作 的按键有记录键 1、 调焦键 2、 确认键 3、 回放键 4、 菜单健 5、 方向键 6等; 此外, 也可采 用触摸屏 7或语音识别部件 (未图示) 等来实现相关的操作。
参考图 6来说明拍摄过程中的显示界面的变化, 参见图 7来说明热像装置 100的检测模 式的控制流程。 本应用场景如使用者手持热像装置 100对变电站的被摄体进行拍摄。 控制部 11基于闪存 3中存储的控制程序, 以及各部分控制中使用的各种数据, 控制了热像装置 100 的整体的动作及执行多种模式处理的控制。在接通电源后,控制部 11进行内部电路的初始化, 而后, 进入待机拍摄模式, 即拍摄部 1拍摄获得热像数据, 图像处理部 7将拍摄部 1拍摄获 得的热像数据进行规定的处理, 存储在临时存储部 2中, 显示部 10上以动态图像形式连续显 示红外热像, 在此状态, 控制部 11实施其控制, 持续监视是否按照预定操作切换到了其他模 式的处理或进行了关机操作, 如果有, 则进入相应的处理控制。 检测模式的控制步骤如下: 步骤 Α01, 确定参考图像;
在待机拍摄状态, 显示部 10显示动态的红外热像, 以往使用者会困惑于特定被摄体热像 IR1的形态特征和在其所在的红外热像中的成像位置、 大小、 角度, 为保证拍摄质量规范, 通过操作部 12的预定操作选择检测模式, 控制部 11基于闪存 3中存储的表 3, 将被摄体信 息生成的被摄体指示信息显示在显示部 10, 当使用者根据拍摄现场的被摄体"被摄体 1 ", 通 过操作部 12来选择显示部 10上所显示的 "被摄体 1 ", 参考图像指定部 11F根据使用者的选 , Tl, 3 T1 2; 并且位置设置部 11G设置参考图像 T1位于红外热像的位置参数 (位置和尺寸)。 例如, 根据 所附带位置参数, 来设置参考图像 T1位于红外热像中的位置参数。此外, 也可根据规定的自 适应显示区, 或使用者指定的位置参数, 来确定参考图像 T1位于红外热像中的位置参数。
在步骤 Α02, 特征登记单元登记被摄体识别信息。 特征登记单元根据使用者的选择 "被 摄体 1 ", 就确定了用来匹配的被摄体识别信息, 在此, 假定将参考图像 T1作为计算相关度 的模板图像。 (此外,也可以从闪存 3中读取模板数据 301来作为计算相关度的被摄体识别信 息)。
步骤 Α03, 获取热像数据帧, 将拍摄部 1拍摄获得的热像数据帧传送到临时存储部 2; 图 像处理部 7对所获取的热像数据帧进行规定处理例如伪彩转换, 获得红外热像的图像数据, 并且, 合成部 7Α将所确定的构成数据根据设置的规定尺寸获得参考图像 T1的图像数据, 按 照所设置的规定位置, 与生成的红外热像的图像数据进行合成(重叠), 将合成的图像数据存 放在临时存储部 2, 接着, 显示控制部 9将合成图像显示在显示部 10, 如图 6 ( a) 所示, 被 摄体热像 IR1与轮廓图像 T1之间存在位置、尺寸的差异, 使用者可根据参考图像来拍摄被摄 体热像 IR1。 如在后续处理中未检测到特定被摄体热像, 将不断与新获取的热像数据帧进行 合成, 以此, 来不断显示动态的合成图像。
接着, 在步骤 A04, 读取临时存储部 2中例如由拍摄部 1即时拍摄获得的热像数据帧, 检测窗口设置单元, 设置检测窗口。 例如, 基于规定的检测区域 G1的左上角, 首先设置了检 测窗口;
步骤 A05, 进行检测窗口中的热像数据与被摄体识别信息之间的相关度计算的处理。 检测部 8基于检测窗口设置单元所设置的检测窗口,抽取位于该检测窗口中的热像数据, 根据特征登记单元所登记的模板, 计算二者之间的相关度。 例如, 根据检测窗口中的热像数 据所提取的特定被摄体热像的轮廓, 与轮廓图像 T1的轮廓对比, 计算二者之间的重叠面积在 各自总面积中的比例之和; 由此可获得相关度的值;
并且, 在步骤 A06, 存储所得到的相关度的值。
在步骤 A07中, 检测部 8判断在热像数据帧中设置检测窗口时, 是否已经针对所有检测 窗口计算了相关度。 如果剩余还没有计算相关度的区域 (步骤 A07中为否) 则回到步骤 A04 中, 检测窗口设置单元在预定方向上将检测窗口的位置偏移预定像素数, 将该位置设置为检 测窗口的下一位置, 并重复后续的处理。
此外, 从热像数据帧中搜索与模板类似的帧部分时, 对于放大及缩小、 以及将检测窗口 J1倾斜规定角度后的检测窗口时, 也进行类似上述说明的检测处理。
如果已经针对热像数据帧的所有检测窗口计算了相关度 (步骤 A07中为是), 则在步骤 A08中将检测到的最大相关度的值 (或还将所对应的检测窗口的位置参数) 保持在临时存储 部 2的规定区域。
在步骤 A09中, 与相关度的对比值进行比较;
如果小于该对比值,则表示当前检测的热像数据帧中的特定被摄体热像与轮廓图像 T1的 相似程度, 未优于之前所获得的对比值; 回到步骤 A03, 重复后续的处理; 也可配置为到步 骤 A12, 如未退出则回到 A03; 在此, 使用者通过改变拍摄的位置和调整热像装置 100的光学 距 、 、 , 」 , 后续的处理。 当在步骤 A09检测到的相关度大于相关度的对比值, 则进入步骤 A10;
其中, 相关度的对比值可以是预先准备的起始的相关度的对比值 (例如将判断是否检测 到特定被摄体热像与被摄体识别信息匹配与否的判断值, 作为起始的相关度的对比值), 当检 测获得的相关度的值大于该判断值, 代表所检测的特定被摄体热像的相关度优于所准备的判 断值, 则将该判断值替换为当前所检测的相关度的值所获得的对比值; 作为后续检测相关度 的对比值, 以便后续是否能获得相关度更高的特定被摄体热像。 本实施例中, 热像装置 100 起始相关度的对比值为 72%, 该起始的对比值为判断是否检测到特定被摄体热像的判断值, 如果所获得的热像数据帧的相关度小于该对比值, 则代表该热像数据帧中未检测到特定被摄 体热像; 其效果是当使用者反复拍摄也无法获得与所选择的特定信息有关的通知信息时, 意 味着是否拍摄了错误的被摄体。 所以, 在图 6 (a)中, 由于所检测到的相关度的值小于 72%, 没有显示通知信息, 而显示 "不匹配"字样。
此外, 相关度的对比值, 也可以没有预先准备, 这时, 例如, 当将第一次检测到的热像 数据帧的相关度的值, 作为后续检测热像数据帧获得的相关度的值的对比值, 当后续检测到 大于该对比值时, 则替换该对比值。
在此, 以是否大于对比值为评价相关度的依据的例子, 但也有小于对比值或接近对比值 (预先准备的判断值) 作为评价相关度等的情况。 并且, 对比值可以是相关度的值, 也可以 是相关度的值经过换算获得的值等 (相应的, 检测获得的相关度的值应换算后与对比值进行 比较)。
步骤 A10, 对比值更新部 11C, 将根据所检测到的具有最大相关度的值, 来更新相关度的 对比值, 并且, 以更新后的对比值作为后续的热像数据帧的比较相关度的对比值。 如当检测 到的最大相关度的热像数据帧的相关度为 80%, 可替换原对比值 72%。
步骤 Al l , 选择部 11B将所检测到的具有最大相关度的值对应的热像数据帧等特定信息, 保持在临时存储部 2的规定区域, 替换之前的特定信息(如果有)。 此外, 也可以保持规定数 量的多个热像数据帧有关的特定信息, 例如保持相关度最高的 3帧热像数据帧及其相关度的 值等特定信息。
进一步, 对所选择的相关度最大的热像数据帧有关的特定信息进行通知。
例如, 将该热像数据帧获得的图像, 与后续获得的热像数据帧生成的动态的红外热像、 参考图像共同显示。 并且, 所保持的特定信息, 在未接受到选择部 11B重新选择的特定信息 或使用者的指示之前, 一直将被保持在临时存储部 2中。
如图 6 (b)所示, 但不限定于显示缩小的红外热像 601, 也可以是其他的方式, 例如直接 将计算获得的相关度的值显示(在一个例子中,如直接显示像素值之差的和的数值等)。此外, 也可将显示动态红外热像切换为显示该热像数据帧的冻结图像; 优选的方式, 还可将所检测 到的具有最大相关度的检测窗口的区域 (或被摄体的位置参数等) 进行通知。 例如在冻结的 红外热像中示意检测到的具有最大相关度的被摄体热像的位置的标识等。 或将显示动态红外 热像切换为显示该热像数据帧的冻结图像, 而后, 响应使用者的指示, 再切换回动态红外热 像的显示状态,或该热像数据帧获得的图像与后续获得的热像数据帧生成的动态的红外热像、 参考图像共同显示的状态。 此外, 也可不显示该热像数据帧获得的红外热像, 而显示提示信 息; 或以振动、 指示灯闪烁等, 各种使用者能察觉的方式。 并且, 当选择部 11B配置为指示 , 可同 显示
缩小的红外热像, 例如, 还按照相关度的高低来排序显示。
注意, 当未与判断是否具有特定被摄体热像的对比值 (代表特定被摄体热像与被摄体识 别信息匹配与否的判断值) 做对比时, 所显示的相关度的信息并不一定代表检测到特定被摄 体热像与否。
并且, 不限于与通知选择部所选择的特定信息, 也可对对比值进行更新的事件或还进一 步通知对比值。
步骤 A12, 判断是否退出, 如未退出, 则回到步骤 A03, 重复后续的处理。 这时, 由于在 步骤 Al l中, 对相关度的对比值进行了更新, 因此, 在后续拍摄获得的热像数据帧, 将与更 新后的相关度的对比值进行比较, 并且, 当大于相关度的对比值时, 将所保持的特定信息予 以替换。
在一个通知方式的例子中, 由于相关度的起始对比值为 72%; 如图 6 ( a)所示, 当所检测 到的相关度的值小于 72%, 没有显示用来通知的特定信息, 如可显示 "不匹配"字样。 如图 6 (b)所示, 在拍摄中, 当首先检测到的最大相关度为 80% (根据重叠面积的比例之和换算得 到的提示信息),将该相关度的值作为后续比较的相关度的对比值 (替换相关度的对比值 72%), 并且与动态红外热像、 参考图像同时显示所选择的热像数据帧获得的缩小的红外热像 601。 当后续检测到最大相关度的值大于 80%时, 如图 6 ( c)所示, 相关度的值为 95%, 则替换相关 度的对比值 80%, 作为新的相关度的对比值 (95%), 选择部 11B将所检测到的具有最大相关 度的值 95%对应的热像数据帧等特定信息, 保持在临时存储部 2的规定区域, 替换之前的特 定信息;与动态红外热像、参考图像同时显示所选择的热像数据帧获得的缩小的红外热像 603; 以此类推, 当所检测的相关度的值为 95%时, 显示如图 6 ( c)所示, 使用者如果满意, 可以停 止对被摄体的瞄准拍摄, 由于该热像数据帧保持在临时存储部 2等存储介质中, 可方便进行 后续的分析、 存储等处理或操作。 这时, 如果使用者按下记录键, 则将红外热像 603对应的 热像数据帧进行规定的处理 (如压缩等) 记录到存储卡 8。 并且, 即便是不显示提示信息或 红外热像的方式, 例如指示灯闪烁的方式, 由于该热像数据帧保持在临时存储部 2等存储介 质中, 可配置为在使用者的按下确认键或记录键时, 进行显示、 记录等处理。
并且, 也可通知更新对比值的信息, 而不通知热像数据帧的信息。
并且, 在有些应用的情况下, 对是否检测到特定被摄体热像, 并不限于相关度的值与相 关度的对比值之间的比较,也可变形为例如根据检测获得的规定信息和 /或规定信息获得的评 价值及预定的对比值的比较结果, 来作为是否检测到特定被摄体热像的依据。
如上所述, 在本实施例中, 显示参考图像来辅助拍摄, 并当检测到相关度高于比较值的 热像数据帧时, 才选择该热像数据帧或还予以通知, 并在后续每当检测到高于之前的相关度 的对比值时, 能不断更新对比值, 及所通知的信息, 能达到大幅度降低视觉对准的操作难度, 大幅度降低拍摄的体力强度, 提高最终获得的热像数据帧的质量的有益效果。 普通使用者容 易掌握这种拍摄技能。 当然, 实施本发明的实施方式的任一产品并不一定需要同时达到以上 所述的所有优点。
并且, 在红外检测的领域, 由于考虑到特定被摄体热像在红外热像中的位置、 尺寸、 倾 斜角度等的不同, 对应了不同的拍摄质量, 即便相关度高, 如果上述参数不理想, 所获取的 热像数据帧的质量不一定高; 因此, 优选的, 考虑特定被摄体热像位于热像数据帧中的位置、 尺 , f 一 个或多个规定信息获得的评价值), 与规定的对比值进行比较, 作为进行规定热像数据帧的选 择和进行通知的因素, 来提示使用者注意拍摄的质量, 或选择最佳拍摄质量的热像数据帧进 行后续的处理。
实施例 2
实施例 2, 与实施例 1的不同之处在于, 所述热像装置 100 的检测部 8基于获取部 (拍 摄部 1 ) 连续获取的热像数据帧, 检测热像数据帧与特定被摄体热像有关的规定信息; 控制 部 11具有辅助信息获取部 (未图示), 用于获取辅助信息; 比较部 11A, 用于将检测部检测 获得的规定信息、 辅助信息获取部获取的辅助信息、 检测部检测获得的规定信息得到的评价 值、 辅助信息获取部获取的辅助信息而得到的评价值、 检测部检测获得的规定信息及辅助信 息获取部获取的辅助信息而得到的评价值中的一项或多项, 与对应的一个或多个对比值进行 比较; 选择部 11B, 基于比较部 11A的比较结果, 选择与规定的热像数据帧有关的特定信息, 当有多项比较, 根据不同的比较结果, 在不同的实施方式中, 所通知的特定信息可能是一帧 或多帧热像数据帧有关的特定信息; 通知部 11D, 基于选择部 11B所选择与规定的热像数据 帧有关的特定信息, 进行通知。 对比值更新部 11C, 用于对比值的更新。
其中, 所述规定信息, 至少包括特定被摄体热像的位置、 尺寸、 倾斜角度、 相关度的值 中的一种或任意组合的信息。
在红外检测的领域, 由于考虑到特定被摄体热像在红外热像中的位置、 尺寸、 倾斜角度 等的不同, 对应了不同的拍摄质量, 即便相关度高, 如果上述参数不理想, 所获取的热像数 据帧的质量不一定高; 因此, 考虑特定被摄体热像位于热像数据帧中的位置、 尺寸、 倾斜角 度等因素, 作为生成通知的因素, 来提示使用者注意拍摄的质量, 或选择最佳拍摄质量的热 像数据帧进行后续的处理。
其中, 所述辅助信息, 例如可至少包括分析值、 环境温度、 背景因素、 风速、 湿度、 距 离等中的一种或任意组合的信息, 或其他由热像装置 100所获取的辅助信息 (包括由使用者 进行设置), 包括其他各种对选择部 11B所选择的规定热像数据帧有关的信息和 /或对通知部 11D所通知的信息有影响的因素都在其范围中。
在红外检测的应用领域, 根据上述的辅助信息的不同, 所获得的热像数据帧的质量及重 要程度不同, 应有不同的条件来应对规定的热像数据帧的比较、 选择、 通知等处理; 例如, 当获得的特定被摄体热像中具有大于规定的对比值 (例如缺陷的阀值) 的分析值时, 代表被 摄体具有缺陷, 那么, 应引起使用者的重视, 这时在相关度接近的情况下, 也优选选择并通 知分析值超标的热像数据帧有关的特定信息, 将立即引起使用者的注意, 对红外检测的意义 重大; 例如考虑环境温度、 背景、 风速、 背景因素 (例如背景与被摄体热像的差异性, 背景 的热场分布等) 等的影响因素, 在相关度接近的情况下, 这些影响因素可能会导致不同的热 像质量及后续分析的价值降低, 应选择并通知其他影响因素干扰小的热像数据帧。
其中, 辅助信息获取部, 例如可以根据热像装置 100或与热像装置 100中连接的装置或 相应功能的部件 (未图示) 来获取上述辅助信息, 例如, 通过分析部件获取分析值 (分析值 可以是分析获得的温度值,并不限定于温度值,例如,也可以是 AD值、伪彩热像中的颜色值、 特定像数值的比例, 或还将这些数值按照规定公式计算获得的值等, 分析部件所获取的分析 值可以针对热像数据帧中的全部像素或特定分析区域中的像素),通过温度传感器来获取环境 温 / , 湿 , 距 loo 可 根据存储介质中预先存储的上述辅助信息来获取, 例如, 辅助信息的历史数据; 或结合当前 测量获取的辅助信息与存储介质中预先存储的辅助信息的历史数据的对比来获得辅助信息。 上述辅助信息的获得为本领域技术人员所公知的技术。
并且, 可以通过规定信息和 /或辅助信息来获得综合的评价值; 例如, 可以采用所检测的 规定信息中的特定信息对应了不同的系数, 而由所检测的规定信息中的其他的规定信息结合 该系数来获得评价值; 例如, 可以采用不同的信息所占的权重, 通过加权来获得评价值。 可 以通过各种不同的计算方式来获得最终的评价值。 例如, 如图 9所示, 假定图 9 ( c ) 的红外 热像 901根据窗口系数为 0. 94的检测窗口获得,而红外热像 902根据窗口系数为 0. 8的检测 窗口获得, 评价值 =相关度的值 X窗口系数 (检测窗口如可体现粗略的位置、 尺寸), 因此, 即便红外热像 901的相关度小于红外热像 902的相关度, 但评价值反而高。
并且, 也可以通过所述规定信息和所述辅助信息, 来获得综合的评价值。 例如, 获得综 合了特定被摄体热像的位置、 尺寸、 倾斜角度、 分析值、 相关度的值获得的评价值, 例如根 据下式来获得综合评价值,综合评价值 =位置 X位置加权系数 +尺寸 X尺寸加权系数 +倾斜角度 X倾斜角度加权系数 +分析值 X分析值加权系数 +相关度的值 X相关度加权系数; 或者, 另一 种优选的方式, 根据所检测的规定信息和所获取的辅助信息与综合评价值的对照表来获得评 价值。
并且, 也可以根据所述规定信息和所述辅助信息, 将其中部分来获得评价值, 而后, 根 据其中的未参与获得评价值的规定信息和 /或辅助信息, 与获得的评价值一起, 作为比较部与 规定的对比值进行比较的对象。
其中, 对比值更新部 11C, 用于将对比值进行更新; 如根据比较部 11A的比较结果, 将 对比值进行更新; 并且, 当有多项对比值时, 将对应的对比值中的至少一项进行更新; 在更 新后, 所述比较部 11A, 用于对检测部 8后续检测获得的规定信息, 和 /或, 基于辅助信息获 取部获取的辅助信息, 和 /或, 由所述规定信息和 /或所述辅助信息而得到的评价值, 与更新 后的对比值进行比较; 当有多项对比值时, 其中, 当多项对比值全部更新, 在更新后, 与对 应的多项更新的对比值进行比较; 其中, 当多项对比值中的部分更新, 在更新后, 与多项对 比值中的更新项的对比值及未更新项的对比值进行比较。 优选的, 根据比较部比较获得的最 优的规定信息、或最优的辅助信息、或最优的根据检测获得的规定信息和 /或辅助信息获得的 评价值中的一项, 将相应的至少一项对比值进行更新。
其中, 当检测部 8被配置为检测特定被摄体热像的多个规定信息, 并且比较部 11A, 对 检测部 8检测获得的规定信息和 /或基于检测获得的规定信息而得到的评价值与规定的多项 对比值进行比较时, 基于比较的结果, 选择部 11B可能选择多个热像数据帧有关的特定信息, 这时, 通知部 11D可以对其中之一或多个进行通知。 优选的, 所述选择部, 基于比较部的比 较结果, 选择相关度的值和 /或规定信息和 /或辅助信息和 /或评价值 (如规定信息和 /或辅助 信息获得的评价值)优于规定的对比值的热像数据帧有关的特定信息进行保持。所述通知部, 基于选择部所选择并保持的与规定的热像数据帧有关的特定信息,可对相关度的值和 /或规定 信息和 /或辅助信息和 /或评价值(规定信息和 /或辅助信息获得的评价值)最优或优于规定的 对比值的热像数据帧有关的特定信息进行通知。 2 100 ,配 了三个对比值为例。将检测部 8所检测的热像数据帧中与特定被摄体热像有关的规定信息(相 关度的值)、基于检测获得的规定信息及辅助信息获取部获取的辅助信息(分析值)而得到的 评价值, 与第一、 第二、 第三对比值进行比较。
第一对比值预先准备(在本实施例中为相关度的第一对比值), 用来判断是否具有特定被 摄体热像的对比值(代表特定被摄体热像与被摄体识别信息匹配与否的判断值), 第一对比值 不更新。
第二对比值(在本实施例中为相关度的第二对比值), 为大于第一对比值的相关度的对比 值, 其根据检测到的热像数据帧的相关度的值而获得, 当后续的热像数据帧检测到更高的相 关度的值时, 第二对比值将随之更新为更高的值。
第三对比值, 以位置、 尺寸、 倾斜角度、 相关度的值、 分析值等获得综合评价值, 作为 与对应 (例如预先准备的) 第三对比值进行比较, 当后续的热像数据帧检测到更高 (更优) 的综合评价值时, 第三对比值将随之更新为更高的值。
最终,选择部 11B将选择优于第二对比值和 /或优于第三对比值的热像数据帧有关的特定 信息; 便于后续的通知、 分析、 诊断、 记录等处理。
步骤 A01-步骤 Α03, 类同于实施例 1的步骤 A01-A03 , 省略了说明;
步骤 Β03, 类同于实施例 1的步骤 Α04-Α08, 检测获得相关度, 省略了说明;
步骤 Β04, 判断所检测的热像数据帧的相关度的值, 是否大于第一对比值, 如否, 表示 未检测到特定的特定被摄体热像, 回到步骤 Α03, 重复后续的处理; 也可配置为到步骤 Β19, 如未退出则回到 Α03; 当在步骤 Β04检测到的相关度大于第一对比值, 则进入步骤 Β05。
步骤 Β05, 辅助信息获取部对相关度大于第一对比值的热像数据帧和 /或该热像数据帧检 测窗口中的热像数据, 获得辅助信息例如与特定被摄体热像有关的分析值等, 例如控制分析 部件进行分析获得分析值。 此外, 例如, 当检测部 8配置为通过检测像素比例等来计算相关 度时, 不限于根据检测窗口的位置参数来决定所检测到的特定被摄体热像的位置参数, 这时, 也可根据检测到的检测窗口中进一步提取特定被摄体的轮廓, 来获得更为精确的位置、尺寸、 倾斜角度等与特定被摄体热像有关的规定信息。
步骤 Β06, 获得评价值, 获得综合了特定被摄体热像的位置、 尺寸、 倾斜角度、 相关度 的值、 分析值获得的评价值, 例如根据下式来获得综合评价值, 综合评价值 =位置 X位置加权 系数 +尺寸 X尺寸加权系数 +倾斜角度 X倾斜角度加权系数 +相关度的值 X相关度加权系数 +分 析值 X分析值加权系数; 或者, 另一种优选的方式, 根据检测获得的规定信息及获取的辅助 信息与综合评价值的对照表来获得评价值。
步骤 Β07, 与第三对比值进行比较, 如小于第三对比值时, 则在步骤 Β08, 将检测获得的 相关度的值与第二对比值进行比较; 如否, 则跳到步骤 Β19, 代表之前已检测到相关度比当 前检测的热像数据帧高的热像数据帧。 如是, 则在步骤 B09-B10, 对比值更新部 11C将根据 所检测到的最大相关度的值, 来更新第二对比值。 并且, 选择部 11B将该热像数据帧有关的 特定信息, 保持在临时存储部 2的规定区域, 或还替换之前的特定信息 (如果有之前的热像 数据帧有关的特定信息, 并且之前的热像数据帧的相关度小于当前检测的热像数据帧, 并且 评价值在所保持的热像数据帧中并不最大时, 才进行替换), 并且在步骤 Bl l, 对相关度大于 第二对比值的热像数据帧有关的特定信息进行通知。 mi, 评 于 三 , B12, 日 二 值进行比较;
如果大于第二对比值, 则在 B13-B14, 对比值更新部 11C将根据该热像数据帧所检测到 的最大相关度的值, 最大综合评价值来更新第二对比值、 第三对比值。 并且, 选择部 11B将 与该热像数据帧有关的特定信息, 保持在临时存储部 2的规定区域, 或还替换之前的特定信 息 (如果有), 并且在步骤 Bl l, 对相关度大于第二对比值并且综合评价值大于第三对比值的 热像数据帧有关的特定信息进行通知。
如果小于第二对比值, 则在 B16-B17, 对比值更新部 11C将根据所检测到的该热像数据 帧的综合评价值, 来更新第三对比值。 并且, 选择部 11B将所检测到的具有最大综合评价值 对应的热像数据帧有关的特定信息, 保持在临时存储部 2的规定区域, 替换之前的特定信息 (如果有之前的热像数据帧有关的特定信息, 并且之前的热像数据帧的评价值小于当前检测 的热像数据帧, 并且相关度在所保持的热像数据帧中并不最大时, 才进行替换), 并且在步骤 B18, 对综合评价值大于第三对比值的热像数据帧有关的特定信息进行通知。
步骤 B19, 判断是否退出检测模式, 如退出, 则结束, 如未退出, 则回到步骤 A03, 可显 然可显示所选择的特定信息获得的通知信息、 红外热像、 参考图像, 并重复上述后续的处理。 这样, 对连续拍摄获得的热像数据帧, 根据所检测的规定信息, 将优于第二对比值和 /或优于 第三对比值的热像数据帧有关的特定信息进行选择和通知; 便于后续的通知、 分析、 诊断、 记录等处理。 其中, 将检测的热像数据帧的相关度是否大于第一对比值作为进一步检测规定 信息的条件, 能进一步避免拍摄错误部位、 提示有效特定信息的有益效果。 所谓的优于, 根 据对比值的不同, 可能有小于或大于对比值等的情况。
参考图 9来说明拍摄过程中的显示界面的变化。
如图 9 (a)所示, 当未检测到相关度大于第一对比值(假定第一对比值换算的相关度百分 比为 72%) 的热像数据帧时, 显示动态的红外热像、 参考图像。
接着, 如图 9 (b)所示, 当第一次检测到相关度大于第一对比值的热像数据帧时, 显示动 态的红外热像、 参考图像与所检测到的热像数据帧有关的通知信息, 该通知信息基于选择部 11B所指示保持的该热像数据帧的特定信息例如该热像数据帧、 相关度的值、 评价值来生成; 通知信息包括该热像数据帧生成的缩小的红外热像 901, 相关度的值换算的相关度百分比 85%,评价值换算的评价值百分比 80%。并且,对比值更新部 11C将第二对比值例如更新为 85%, 第三对比值例如更新为 80%; 并且, 当后续未检测到大于该第二对比值和 /或大于第三对比值 的热像数据帧时, 显示部 10将保持显示红外热像 901等通知信息及动态红外热像的状态; 并 且, 由于红外热像 901为当前所新获得的特定信息生成的通知信息, 加粗的边框予以提醒使 用者。
而后, 如图 9 (c)所示, 当检测到大于第二对比值的热像数据帧时, 显示动态的红外热像、 参考图像与所检测到的热像数据帧有关的特定信息, 该特定信息包括该热像数据帧生成的缩 小的红外热像 902等, 在此, 由于红外热像 902所对应的相关度大于红外热像 901, 而其评 价值又小于红外热像 901, 于是, 选择部 11B将该二个热像数据帧有关的特定信息进行保持; 并且对比值更新部 11C将根据红外热像 902所对应的相关度, 将第二对比值进行更新; 通知 部 11D将使显示部 10显示二个不同的热像数据帧所获得的特定信息生成的通知信息, 并且, 将红外热像 901去除加粗的边框,而红外热像 902予以加粗的边框。这时,由于红外热像 901、 gos 2, 司 示 息如红外热像 901、 902中, 来选择后续进行记录或分析的所对应的热像数据帧。
并且, 如图 9 (d)所示, 当检测到的相关度大于第二对比值并且评价值大于第三对比值 的热像数据帧时, 选择部 11B将与红外热像 903有关的特定信息进行保持, 或还将红外热像 901、 902有关的特定信息予以删除; 并且, 对比值更新部 11C将根据红外热像 903所对应的 相关度 (95%) 和评价值 (95%), 将第二、 第三对比值进行更新; 通知部 11D将使显示部 10 显示动态的红外热像、 参考图像与所检测到的该热像数据帧有关的特定信息, 该特定信息包 括该热像数据帧生成的缩小的红外热像 903等。
这样, 选择部, 基于比较部的比较结果, 选择并保持相关度的值和 /或评价值优于(如大 于) 规定的对比值 (第二对比值、 第三对比值) 的热像数据帧有关的特定信息; 并且, 如果 进行通知, 基于通知部 11D的控制, 在显示部 10的界面中, 总是能显示通知相关度最高和 / 或评价值最高的热像数据帧获得的信息, 对使用者的拍摄帮助极大, 随意的拍摄也易于获得 高质量的热像数据帧。
如上所述, 在本实施例中, 不仅可以获得实施例 1的效果, 并且, 设置了根据检测到的 特定被摄体热像的规定信息及辅助信息获取部获取的辅助信息, 来作为选择及通知的因素, 能达到进一步减低视觉对准的操作难度, 提高检测匹配时的被摄体的检测精度, 避免误操作, 提示特定状态的有益效果, 普通使用者容易掌握这种拍摄技能。 当然, 实施本发明的实施方 式的任一产品并不一定需要同时达到以上所述的所有优点。
此外, 虽然例举了三个对比值, 也可以更多的对比值, 对应了几个不同侧重的评价值和 / 或辅助信息和 /或检测获得的规定信息, 例如由特定被摄体热像的位置、 尺寸、倾斜角度获得 的评价值, 由分析值、 环境温度等获得的评价值等。
此外, 虽然实施例 2中例举了多个对比值(三个, 或者也可以减少为二个), 其中部分更 新、 部分不更新; 但也可以配置为全部更新; 或也可去除对比值更新部 11C的结构, 而预先 准备多个相应的对比值, 全部不更新。
在实施例 2中, 介绍了根据相关度的值及规定信息与辅助信息获得的评价值作为示例, 也根据最大相关度和 /或最大评价值来进行通知。 当也可以只通知其中之一; 或者, 还配置了 更多的对比项, 相应的还将通知多个根据不同的对比项所占优而选择的热像数据帧的特定信 息; 或者, 还将相关度的值及多个评价值按照次序或优先等级来进行通知。
通知部 11D, 根据选择部 11B选择的规定热像数据帧有关的特定信息和 /或对比值更新部 11C的更新信息 (可以是更新的动作, 也可以是是更新后的对比值的信息等) 进行通知, 并 且优选的, 将选择部最新选择(通常是相关度和 /或评价值大于对比值)的规定热像数据帧有 关的特定信息进行通知。 这样, 使用者非常的方便; 例如将热定被摄体的位置、 尺寸、 倾斜 度、 相关度的值, 作为评价因素, 便于获得高质量的热像数据帧或特定拍摄要求的热像数据 帧; 将辅助信息作为评价因素, 便于优化通知热像数据帧。
并且, 在实施例 2中, 当检测到大于之前的相关度和 /或评价值的热像数据帧时, 选择部 11B将之前的热像数据帧所获得的特定信息予以替换 (例如删除), 但也可继续保持, 这时, 通知部 11D也可显示多个热像数据帧有关的特定信息,例如按照相关度和 /或评价值的高低等 因素来排序显示这些特定信息。
实施例 3 ' 1, 2 同 于, 1 示
中去除了对比值更新部 11C的功能部件(未图示), 在判断所检测的热像数据帧大于规定的相 关度的对比值时, 即进行选择, 并不更新相关度的对比值。
步骤 A01-步骤 A03, 类同于实施例 1的步骤 A01-A03 , 省略了说明;
步骤 C03, 类同于实施例 1的步骤 A04-A08, 省略了说明;
步骤 C04, 将所获得的热像数据帧的相关度的值与规定的对比值 (例如, 代表特定被摄 体热像与被摄体识别信息匹配与否的判断值), 进行比较, 如果否, 则回到步骤 A03; 也可配 置为到步骤 C06, 如未退出则回到 A03。
如是, 在步骤 C05, 对大于规定的对比值的热像数据帧有关的信息进行选择, 或还进一 步进行通知、 分析、 记录等处理, 例如, 将该热像数据帧获得的图像, 与动态的红外热像、 参考图像共同显示。 此外, 也可将显示动态红外热像切换为显示该热像数据帧的冻结图像; 或将显示动态红外热像切换为显示该热像数据帧的冻结图像, 而后, 响应使用者的指示, 再 切换回动态红外热像的显示状态, 或该热像数据帧获得的图像与动态的红外热像、 参考图像 共同显示的状态。
步骤 C06, 检测是否退出, 如否, 则回到步骤 A03, 重复后续的处理; 如是, 则退出。 并且, 在后续的热像数据帧中检测到特定被摄体热像时, 替换之前所保持的热像数据帧, 进行相关信息的显示通知; 或者, 也同时显示相关的信息; 例如当保持了规定数量的热像数 据帧时, 通知使用者从这些热像数据帧中选择要进行后续记录、 分析等处理的热像数据帧。
如上所述, 在本实施例 3中, 当检测相关度大于规定的对比值的热像数据帧时, 即进行 选择该热像数据帧有关的特定信息; 或还进一步来通知使用者, 也能减低视觉对准的操作强 度, 普通使用者容易掌握这种拍摄技能, 操作简单。 由于不更新比较值, 因此, 在后续的拍 摄中, 有可能获得的热像数据帧的质量比之前的要差。
本实施例也可变形为, 根据检测热像数据帧中与特定被摄体热像有关的规定信息, 或根 据检测热像数据帧中与特定被摄体热像有关的规定信息及获取的辅助信息, 及根据检测部检 测获得的规定信息和 /或辅助信息获取部获取的辅助信息而得到的评价值, 其中的一项或多 项, 与规定的对比值进行比较, 获得比较的结果, 来决定选择与规定的热像数据帧有关的特 定信息。
此外, 也可去除选择部 11B的结构, 即当检测到特定被摄体热像时, 进行通知, 例如振 动等来提醒使用者。
实施例 4
实施例 4, 与上述实施例 1, 2, 3的不同之处在于, 所述热像装置 100, 在判断有检测指 示时, 基于临时存储部 2中所存储的多帧热像数据, 来检测并选择其中最优 (例如具有最高 相关度) 的热像数据帧。 适用于对快速运动被摄体拍摄。
参考图 11来说明实施例 3的热像装置 100的检测模式的控制流程。
在步骤 D01, 将获得的热像数据帧, 例如拍摄部 1拍摄获得的热像数据传送到临时存储 部 2; 显示部 10显示动态的红外热像和参考图像, 其中, 临时存储部 2例如配置为能临时存 储多帧份(例如 50帧)的热像数据帧的循环存储器, 循环存储由拍摄部 1拍摄获得的热像数 据帧。 11 示? , 12 检测指示, 则进入下一步; 并且, 检测指示并不必须由使用者的操作来发出, 也可以是规定 的定时等方式来发出。
步骤 D03, 从临时存储部 2读取所存储的热像数据帧进行检测处理, 将计算所读取的热 像数据帧获得的相关度与该热像数据帧对应存储在临时存储部 2 ; 当检测了规定数量 (或所 有热像数据帧) 的热像数据帧后, 获得最大的相关度的值及其对应的热像数据帧
在步骤 D04,将所获的的最大相关度与规定的对比值进行比较,如果否,则回到步骤 D01, 继续显示红外热像, 或显示未检测到大于对比值的热像数据帧的字样; 也可配置为先到步骤 D08, 如未退出则回到 D01。
如是, 在步骤 D05, 根据检测获得的最大相关度的值, 将对比值进行更新; 并在 D06对 相关度最大的热像数据帧有关的特定信息进行选择并保持, 并在步骤 D07进行通知, 例如显 示该热像数据帧获得的红外热像与动态的红外热像。 所更新的对比值可用于下一次检测处理 时使用, 以能确保选择更高质量的热像数据帧有关的特定信息。
步骤 D08, 检测是否退出, 如否, 则回到步骤 D01, 重复后续的处理; 如是, 则退出。 如上所述, 在本实施例 4中, 当接收到检测的指示, 则检测临时存储部 2中所存储得热 像数据帧中的相关度最高的帧, 能减低视觉对准的操作强度, 普通使用者容易掌握这种拍摄 技能, 操作简单, 并能降低处理器的运算速度负担, 降低热像装置 100的成本等的有益效果, 并适用于对快速运动目标的拍摄。
其他实施例
在上述实施例中各自说明了示例的热像装置 100, 显然可适用于便携拍摄或在线拍摄的 各种热像装置; 然而, 本发明不仅适用于带有拍摄功能的热像装置, 还适用于接收和处理热 像的热像处理设备, 如从外部连续接收和处理热像 (如按时序获取热像数据帧) 的热像处理 装置(如计算机、 个人数字助理、 与拍摄功能的热像装置配套使用的显示装置等), 该热像处 理装置例如为计算机, 通过通信口 (获取部的例子, 例如按照 USB、 1394、 网络等通信规范, 将热像处理装置与外部设备连接) 与热像装置进行有线或无线连接, 通过连续接受与其连接 的热像装置输出的热像数据帧, 来实现一个实施例子, 其检测处理、 比较处理、 选择处理等 处理方式与上述实施方式类同, 省略了说明。
并且, 不限于拍摄或从外部获取热像数据帧, 也可作为热像装置或热像处理装置中的一 个构成部件或功能模块, 例如从其他部件来获取热像数据帧, 这时, 也构成本发明的实施方 式。
此外, 优选的具有通知部, 但也可以没有通知部, 如由使用者通过操作来查看所选择的 特定信息;
此外, 也可设置规定的检测时间或规定数量帧的检测, 来通知其中最优(如相关度最高) 的帧。 也不限定于仅通知最优的帧, 也可以通知多帧。
并且, 可以不仅检测整个被摄体的整体区域, 而且检测将被摄体划分为多个部件构成的 多个检测窗口, 这样, 能够更精确检测; 其中, 对于各部件, 与整体相同, 准备对应的被摄 体识别信息(可以是模板或特征量)。 也可根据模板的多个特征量, 来计算相应的检测窗口中 的多个对应的特征量, 并根据多个特征量所对应的对比值, 来获得判断结果, 例如, 根据多 个特征量的加权, 来获得最终的判断结果。 也可根据多个特征量, 先计算其中的一个特征量 , 于 , 下一 , 据多次比较, 来获得最终的判断结果。
在实施例中, 可显示检测区域作为参考图像或部分; 显然, 当参考图像体现了形态特征 时, 也可根据该参考图像位于红外热像中的位置参数, 来设置检测区域 (如根据参考图像的 外包矩形来放大规定比例获得的检测区域); 可加快检测处理的速度并确保拍摄的质量。
注意, 在上述的实施例中, 可以对热像数据帧的检测、 选择、 通知、 对比值的数量、 对 比值的更新、 辅助信息的获取等处理, 进行不同的组合, 这些组合均在本发明的范围之内。
并且, 对是否检测到特定被摄体热像, 并不限于相关度的值与相关度的对比值之间的比 较, 也可变形为例如根据检测获得的规定信息、 辅助信息、 规定信息获得的评价值、 辅助信 息获得的评价值、 规定信息和辅助信息获得的评价值, 其中的一项或多项, 与规定的对比值 的比较, 来决定是否检测到特定被摄体热像。
在上述实施例中, 对比值更新部, 可根据比较部比较获得的最优的规定信息、 或最优的 辅助信息、或根据检测获得的规定信息和 /或辅助信息获得的最优的评价值中的一项, 将相应 的至少一项对比值进行更新。选择部, 基于比较部的比较结果, 可选择规定信息和 /或辅助信 息和 /或评价值其中的至少一项优于规定的对比值的热像数据帧有关的特定信息,或还进行保 持; 选择的条件如检测获得的规定信息和 /或辅助信息和 /或评价值, 其中的至少一项, 优于 规定的对比值。 所述通知部, 基于选择部所选择并保持的与规定的热像数据帧有关的特定信 息,可对相关度的值和 /或规定信息和 /或辅助信息和 /或评价值最优或优于规定的对比值的热 像数据帧有关的特定信息进行通知。这些所说的优于, 可能存在小于对比值、 或大于对比值、 或位于对比值的范围、 或超出对比值的范围、 或接近对比值等的各种情况; 当有多个对比值 时,可能存在其中之一或全部大于、 小于对比值、 位于对比值的范围、 或超出对比值的范围、 或接近对比值等的情况; 所说的最优, 如检测获得的规定信息和 /或辅助信息和 /或评价值等 相关的值, 可能有最大的情况、 或最小的情况、 或最接近对比值或对比值范围中的某个值等 的情况, 应能理解优于和最优的含义。
所选择的热像数据帧可用于后续的显示、 分析、 诊断、 发送、 记录等处理; 所述分析如 可获得分析值如温度值、 特定像数值的比例值、 或还将这些数值按照规定公式计算获得的值 等, 所述诊断如将分析值与规定的阈值进行比较可获得诊断结果如诊断结论 (例如缺陷、 正 常等信息)、 触发信号等, 这些处理的含义为本领域技术人员所公知。
此外, 也可以各种变形的实施方式, 如采用热像存储部, 用于存储连续获取的多帧热像 数据帧; 热像存储部如临时存储部 2, 例如配置为能临时存储多帧份 (例如 50帧) 的热像数 据帧的循环存储器, 循环存储由获取部 (如拍摄部 1等) 连续获取的热像数据帧。 由此, 例 如在实施例 4中, 响应规定的指示, 来进行检测等处理。 此外, 其他变形的实施方式, 检测 部, 用于基于连续获取的热像数据帧, 检测热像数据帧中与特定被摄体热像有关的规定信息; 热像存储部, 用于对应存储热像数据帧及其检测获得的规定信息; 基于规定的指示, 比较部, 用于基于热像存储部存储的热像数据帧及其关联的规定信息, 对检测部检测获得的规定信息 和 /或所述规定信息得到的评价值, 与规定的对比值进行比较; 选择部, 基于比较部的比较结 果, 选择与规定的热像数据帧有关的特定信息。 这样可以在规定的指示如使用者的指示或规 定的定时到来之际等, 比较部来进行比较处理。 或者还可变形为存在多次的检测处理, 例如 检测部检测获得 (如粗略的) 第一规定信息, 热像存储部, 用于对应存储热像数据帧及其检 ; 而 于 示, , 较部, 根据检测结果, 与规定的对比值进行比较; 或者还可变形为还存在多次的检测和 /或比 较处理, 例如热像存储部可存储在前比较选择的热像数据帧及其对应的规定信息, 用于在后 (如响应规定的指示) 检测和比较时的使用。
在上述的例子, 是按照一定的步骤次序来描述, 但根据不同的实施方式可以有各种先后 顺序, 并不限于上述例子所描述的处理次序。 当控制部 11和图像处理部等包含了多个处理器 时, 还可能存在部分步骤适用的并行处理。
存储被摄体识别信息等的存储介质, 可以是热像装置 100中的存储介质, 如闪存 3、 存 储卡 6等非易失性存储介质, 临时存储部 2等易失性存储介质; 还可以是与热像装置 100有 线或无线连接的其他存储介质,如通过与通信 I/F4有线或无线连接的其他装置如其他存储装 置、 热像装置、 电脑等中的存储介质或网络目的地的存储介质。
采用被摄体信息关联被摄体识别信息的实施方式, 为优选的方式, 可根据应用的不同可 以准备各种适用的被摄体信息。 例如对于电力行业的应用, 优选的, 被摄体信息为使用者可 辨识的代表被摄体的身份信息, 如代表被摄体地点、 类型、 相别的信息; 但也可以是代表被 摄体类型的信息。 显然, 被摄体识别信息并不限于必须与被摄体信息关联。
本发明的方面还可以通过独处和执行记录在存储装置上的程序来执行上述实施例的功能 的系统或设备的计算机 (或诸如 CPU、 MPU等的装置)、 以及通过其步骤由系统或设备的计 算机通过例如读出和执行记录在存储装置上的程序来执行上述实施例的功能而知性的方法来 实现。 为此目的, 例如经由网络或从用作存储装置的各种类型的记录介质 (例如, 计算机可 读介质) 中将程序提供至计算机或热像装置。
本发明提供一种计算机程序,计算机程序构成的数字信号记录在计算机或热像装置可读的记录介 质中, 例如硬盘、 存储器等中。 该程序运行后执行如下步骤:
获取步骤, 用于连续获取热像数据帧;
显示控制步骤, 用于控制使显示基于所获取的热像数据帧获得的动态的红外热像和参考 图像;
检测步骤, 用于基于所获取的热像数据帧, 检测与特定被摄体热像有关的规定信息; 比较步骤,用于对检测步骤检测获得的规定信息和 /或基于检测获得的规定信息而得到的 评价值, 与规定的对比值进行比较;
选择步骤, 基于比较步骤的比较结果, 选择与规定的热像数据帧有关的特定信息。 本发明的实施方式还提供一种可读存储介质, 其存储用于电子数据交换的计算机程序, 其中, 所 述计算机程序使得热像装置中的计算机执行如下步骤:
获取步骤, 用于连续获取热像数据帧;
显示控制步骤, 用于控制使显示基于所获取的热像数据帧获得的动态的红外热像和参考 图像;
检测步骤, 用于基于所获取的热像数据帧, 检测与特定被摄体热像有关的规定信息; 比较步骤,用于对检测步骤检测获得的规定信息和 /或基于检测获得的规定信息而得到的 评价值, 与规定的对比值进行比较;
选择步骤, 基于比较步骤的比较结果, 选择与规定的热像数据帧有关的特定信息。 硬 、 现 , 1 一 一的对应方式来实现功能块的结构。 可以通过一个软件或硬件模块来实现多个功能的块。 或 也可通过多个软件或硬件单元来实现一个功能的块。 此外, 也可以用专用电路或通用处理器 或可编程的 FPGA实现本发明的实施方式中的部分或全部功能部的处理和控制功能。
此外, 例子以电力行业的被摄体应用作为场景例举, 也适用在红外检测的各行业广泛运 用。
上述所描述的仅为发明的具体例子(实施方式), 各种例举说明不对发明的实质内容构成 限定, 并且, 各种实施方式进行相应的替换和组合, 可构成更多的实施方式。 所属领域的技 术人员在阅读了说明书后可对具体实施方式进行其他的修改和变化, 而不背离发明的实质和 范围。

Claims

权 利 要 求 书 WO 2014/101803 PCT/CN2013/090609
1、 红外选择装置, 包括,
拍摄部, 用于连续拍摄获取热像数据帧;
显示控制部, 用于控制使显示基于所获取的热像数据帧获得的动态的红外热像和参考图 像;
检测部, 用于基于所获取的热像数据帧, 检测与特定被摄体热像有关的规定信息; 比较部,用于对检测部检测获得的规定信息和 /或基于检测获得的规定信息而得到的评价 值, 与规定的对比值进行比较;
选择部, 基于比较部的比较结果, 选择与规定的热像数据帧有关的特定信息。
2、 红外选择装置, 包括,
获取部, 用于连续获取热像数据帧;
显示控制部, 用于控制使显示基于所获取的热像数据帧获得的动态的红外热像和参考图 像;
检测部, 用于基于所获取的热像数据帧, 检测与特定被摄体热像有关的规定信息; 比较部,用于对检测部检测获得的规定信息和 /或基于检测获得的规定信息而得到的评价 值, 与规定的对比值进行比较;
选择部, 基于比较部的比较结果, 选择与规定的热像数据帧有关的特定信息。
3、 如权利要求 1-2任意一项所述的红外选择装置, 其特征在于, 所述规定信息, 至少包 括检测获得的特定被摄体热像的位置、 尺寸、 倾斜角度、 相关度的值中的一种或任意组合的 信息。
4、 如权利要求 1-2任意一项所述的红外选择装置, 其特征在于, 具有
辅助信息获取部, 用于获取辅助信息;
比较部, 用于基于检测部检测获得的规定信息、 辅助信息获取部获取的辅助信息、 所述 规定信息及所述辅助信息而得到的评价值、 所述规定信息得到的评价值、 所述辅助信息得到 的评价值, 其中的一项或多项, 与规定的对比值进行比较。
5、 如权利要求 4所述的红外选择装置, 其特征在于, 所述规定信息, 至少包括特定被摄 体热像的位置、 尺寸、 倾斜角度、 相关度的值中的一种或任意组合的信息; 所述辅助信息, 至少包括分析值、 环境温度、 风速、 背景因素、 湿度、 距离中的一种或任意组合的信息。
6、 如权利要求 1-5所述的红外选择装置, 其特征在于, 所述特定信息至少包括, 基于所 连续获取的热像数据帧中选择的热像数据帧, 基于所连续获取的热像数据帧进行规定处理后 的热像数据帧中选择的热像数据帧, 基于所连续获取的热像数据帧选择的热像数据帧进行规 定处理后获得的数据, 基于检测获得的规定信息, 基于所述规定信息生成的提示信息, 基于 检测获得的规定信息而得到的评价值, 基于所述评价值生成的提示信息, 其中的一项或多项。
7、 如权利要求 1-5所述的红外选择装置, 其特征在于, 所述特定信息为, 基于所连续获 取的热像数据帧中选择的热像数据帧, 基于所连续获取的热像数据帧进行规定处理后的热像 数据帧中选择的热像数据帧, 基于所连续获取的热像数据帧选择的热像数据帧进行规定处理 后获得的数据, 基于检测获得的规定信息, 基于辅助信息获取部获取的辅助信息, 基于所述 规定信息得到的评价值, 基于所述辅助信息得到的评价值, 基于所述规定信息和所述辅助信 权 利 要 求 书
WO 2014/101803 PCT/CN2013/090609 息得到的评价值, 基于所述规定信息生成的提示信息, 基于所述辅助信息生成的提示信息, 基于上述评价值之一或多个生成的提示信息, 其中的一项或多项。
8、 如权利要求 1-5所述的红外选择装置, 其特征在于, 当符合规定的选择条件时, 选择 部选择与规定的热像数据帧有关的特定信息。
9、 如权利要求 8所述的红外选择装置, 其特征在于, 所述选择条件包括规定信息和 /或 辅助信息和 /或评价值, 其中的至少一项, 优于规定的对比值。
10、 如权利要求 1-5所述的红外选择装置, 其特征在于, 所述选择部, 基于比较部的比 较结果, 根据规定信息和 /或辅助信息和 /或评价值其中至少一项优于规定的对比值的热像数 据帧, 可选择该热像数据帧有关的特定信息。
11、 如权利要求 1-5任意一项所述的红外选择装置, 其特征在于, 所述与规定的热像数 据帧有关的特定信息, 至少包括规定的热像数据帧或规定的热像数据帧进行规定处理后获得 的数据。
12、 如权利要求 1-5任意一项所述的红外选择装置, 其特征在于, 规定的热像数据帧, 至少包括, 基于所获取的热像数据帧检测到的最优的热像数据帧、 或相关度最大的热像数据 帧、 或所检测到的评价值最优的热像数据帧、 或与参考图像位置、 尺寸、 旋转角度最为接近 的热像数据帧、 或检测到特定被摄体热像的热像数据帧, 其中之一或多项。
13、 如权利要求 1-5任意一项所述的红外选择装置, 其特征在于, 所述选择部对所选择 的特定信息进行保持或不保持的控制。
14、 如权利要求 13所述的红外选择装置, 其特征在于,
所述选择部, 用于按照规定的条件, 将所保持的特定信息, 替换为选择部后续选择的特 定信息。
15、 如权利要求 1-5所述的红外选择装置, 其特征在于, 具有
对比值更新部, 用于将对比值进行更新; 当对比值更新后, 所述比较部, 用于对检测部 后续检测获得的规定信息和 /或所述规定信息而得到的评价值, 与更新后的对比值进行比较。
16、 如权利要求 4所述的红外选择装置, 其特征在于, 具有
对比值更新部, 用于将对比值进行更新; 当对比值更新后, 所述比较部, 用于将检测部 后续检测获得的规定信息、 辅助信息获取部后续获取的辅助信息、 所述规定信息得到的评价 值, 所述辅助信息得到的评价值, 所述规定信息及所述辅助信息得到的评价值, 其中的一项 或多项, 与更新后的对比值进行比较。
17、 如权利要求 1-5所述的红外选择装置, 其特征在于, 具有
对比值更新部, 可根据比较部比较获得的最优的规定信息、 或最优的辅助信息、 或根据 检测获得的规定信息和 /或辅助信息获得的最优的评价值, 其中的至少一项, 将相应的至少一 项对比值进行更新。
18、 如权利要求 1-5所述的红外选择装置, 其特征在于, 具有通知部, 对选择部选择的 特定信息和 /或对比值的更新信息和 /或对比值的更新事件, 进行通知。
19、 如权利要求 1-5所述的红外选择装置, 其特征在于, 具有通知部, 对选择部最新选 择的特定信息进行通知。 权 利 要 求 书
WO 2014/101803 PCT/CN2013/090609
20、 如权利要求 1-5所述的红外选择装置, 其特征在于, 所述通知部, 基于选择部所选 择的与规定的热像数据帧有关的特定信息,可对相关度的值和 /或规定信息和 /或辅助信息和 / 或评价值, 最优或优于规定的对比值的热像数据帧有关的特定信息进行通知。
21、 如权利要求 1-5所述的红外选择装置, 其特征在于,
所述通知部使显示基于所获取的热像数据帧获得的动态的红外热像、 规定位置参数的参 考图像、 体现了所选择的特定信息的通知信息。
22、 如权利要求 21所述的红外选择装置, 其特征在于,
所述通知信息, 至少包括基于所选择的一个热像数据帧获得的缩小的红外热像、 所选择 的一个热像数据帧对应的相关度的值、 所选择的一个热像数据帧对应的评价值, 其中之一或 多个的信息。
23、 如权利要求 1-5任意一项所述的红外选择装置, 其特征在于, 具有规定处理部, 用 于对选择部所选择的特定信息进行规定处理。
24、 如权利要求 23所述的红外选择装置, 其特征在于, 具有第二选择部, 用于对所保持 的热像数据帧进行选择; 所述规定处理部, 对所选择的热像数据帧进行规定处理。
25、 如权利要求 23或 24任意一项所述的红外选择装置, 其特征在于, 所述规定处理至 少包括记录、 发送、 分析、 诊断、 显示等一种或一种以上的处理。
26、 如权利要求 1-5任意一项所述的红外选择装置, 其特征在于, 所述参考图像位于红 外热像中, 具有规定的位置参数。
27、 如权利要求 1-5任意一项所述的红外选择装置, 其特征在于, 所述参考图像体现了 被摄体的形态特征。
28、 如权利要求 1-5任意一项所述的红外选择装置, 其特征在于, 所述检测部, 根据热 像数据帧中规定的检测区域来进行检测处理。
29、 如权利要求 28任意一项所述的红外选择装置, 其特征在于, 所述检测部, 所述检测 区域, 为根据参考图像位于红外热像中的位置参数, 而设置的检测区域。
30、 如权利要求 1-5任意一项所述的红外选择装置, 其特征在于, 具有
被摄体信息选择部, 用于基于存储介质所存储的被摄体信息, 来选择被摄体信息; 所述 存储介质, 用于存储被摄体信息及其关联的被摄体识别信息;
检测部, 用于根据所选择的被摄体信息关联的被摄体识别信息, 而配置的与检测处理有 关的被摄体识别信息, 来进行检测处理。
31、 如权利要求 1-5任意一项所述的红外选择装置, 其特征在于, 具有
被摄体信息选择部, 用于基于存储介质所存储的被摄体信息, 来选择被摄体信息; 所述 存储介质, 用于存储被摄体信息及其关联的参考图像的构成数据和 /或被摄体识别信息; 与红外热像共同显示的参考图像, 为根据所选择的被摄体信息关联的参考图像的构成数 据, 而获得的参考图像;
检测部, 用于根据所选择的被摄体信息关联的参考图像的构成数据和 /或被摄体识别信 息, 而配置的与检测处理有关的被摄体识别信息, 来进行检测处理。 权 利 要 求 书
WO 2014/101803 PCT/CN2013/090609
32、 如权利要求 8所述的红外选择装置, 其特征在于, 所述选择条件包括规定信息和 / 或辅助信息和 /或评价值, 其中的至少一项, 大于规定的对比值、 或小于规定的对比值、 或位 于对比值的范围,或超出了对比值的范围、 或接近对比值。
33、 红外选择方法, 包括,
拍摄步骤, 用于连续拍摄获取热像数据帧;
显示控制步骤, 用于控制使显示基于所获取的热像数据帧获得的动态的红外热像和参考 图像;
检测步骤, 用于基于所获取的热像数据帧, 检测与特定被摄体热像有关的规定信息; 比较步骤,用于对检测步骤检测获得的规定信息和 /或基于检测获得的规定信息而得到的 评价值, 与规定的对比值进行比较;
选择步骤, 基于比较步骤的比较结果, 选择与规定的热像数据帧有关的特定信息。
34、 红外选择方法, 包括,
获取步骤, 用于连续获取热像数据帧;
显示控制步骤, 用于控制使显示基于所获取的热像数据帧获得的动态的红外热像和参考 图像;
检测步骤, 用于基于所获取的热像数据帧, 检测与特定被摄体热像有关的规定信息; 比较步骤,用于对检测步骤检测获得的规定信息和 /或基于检测获得的规定信息而得到的 评价值, 与规定的对比值进行比较;
选择步骤, 基于比较步骤的比较结果, 选择与规定的热像数据帧有关的特定信息。
35、 如权利要求 33-34任意一项所述的红外选择方法, 其特征在于, 所述规定信息, 至 少包括检测获得的特定被摄体热像的位置、 尺寸、 倾斜角度、 相关度的值中的一种或任意组 合的信息。
36、 如权利要求 33-34任意一项所述的红外选择方法, 其特征在于, 具有
辅助信息获取步骤, 用于获取辅助信息;
比较步骤, 用于基于检测步骤检测获得的规定信息、辅助信息获取步骤获取的辅助信息、 所述规定信息及所述辅助信息而得到的评价值、 所述规定信息得到的评价值、 所述辅助信息 得到的评价值, 其中的一项或多项, 与规定的对比值进行比较。
37、 如权利要求 36所述的红外选择方法, 其特征在于, 所述规定信息, 至少包括特定被 摄体热像的位置、 尺寸、 倾斜角度、 相关度的值中的一种或任意组合的信息; 所述辅助信息, 至少包括分析值、 环境温度、 风速、 背景因素、 湿度、 距离中的一种或任意组合的信息。
38、 如权利要求 33-34所述的红外选择方法, 其特征在于, 所述特定信息至少包括, 基 于所连续获取的热像数据帧中选择的热像数据帧, 基于所连续获取的热像数据帧进行规定处 理后的热像数据帧中选择的热像数据帧, 基于所连续获取的热像数据帧选择的热像数据帧进 行规定处理后获得的数据, 基于检测获得的规定信息, 基于所述规定信息生成的提示信息, 基于检测获得的规定信息而得到的评价值, 基于所述评价值生成的提示信息, 其中的一项或 多项。
39、 如权利要求 36所述的红外选择方法, 其特征在于, 所述特定信息为, 基于所连续获 取的热像数据帧中选择的热像数据帧, 基于所连续获取的热像数据帧进行规定处理后的热像 权 利 要 求 书
WO 2014/101803 PCT/CN2013/090609 数据帧中选择的热像数据帧, 基于所连续获取的热像数据帧选择的热像数据帧进行规定处理 后获得的数据, 基于检测获得的规定信息, 基于辅助信息获取步骤获取的辅助信息, 基于所 述规定信息得到的评价值, 基于所述辅助信息得到的评价值, 基于所述规定信息和所述辅助 信息得到的评价值, 基于所述规定信息生成的提示信息, 基于所述辅助信息生成的提示信息, 基于上述评价值之一或多个生成的提示信息, 其中的一项或多项。
40、如权利要求 33-39所述的红外选择方法, 其特征在于, 当符合规定的选择条件时, 选 择步骤选择与规定的热像数据帧有关的特定信息。
41、 如权利要求 40所述的红外选择方法, 其特征在于, 所述选择条件包括规定信息和 / 或辅助信息和 /或评价值, 其中的至少一项, 优于规定的对比值。
42、 如权利要求 33-39任意一项所述的红外选择方法, 其特征在于, 规定的热像数据帧, 至少包括, 基于所获取的热像数据帧检测到的最优的热像数据帧、 或相关度最大的热像数据 帧、 或所检测到的评价值最优的热像数据帧、 或与参考图像位置、 尺寸、 旋转角度最为接近 的热像数据帧、 或检测到特定被摄体热像的热像数据帧, 其中之一或多项。
43、 如权利要求 33-39任意一项所述的红外选择方法, 其特征在于, 所述选择步骤对所 选择的特定信息进行保持或不保持的控制。
44、 如权利要求 33-39所述的红外选择方法, 其特征在于, 具有
对比值更新步骤, 用于将对比值进行更新; 当对比值更新后, 所述比较步骤, 用于对检 测步骤后续检测获得的规定信息和 /或所述规定信息而得到的评价值,与更新后的对比值进行 比较。
45、 如权利要求 33-39所述的红外选择方法, 其特征在于, 具有
对比值更新步骤, 用于将对比值进行更新; 当对比值更新后, 所述比较步骤, 用于将检 测步骤后续检测获得的规定信息、 辅助信息获取步骤后续获取的辅助信息、 所述规定信息得 到的评价值, 所述辅助信息得到的评价值, 所述规定信息及所述辅助信息得到的评价值, 其 中的一项或多项, 与更新后的对比值进行比较。
46、 如权利要求 33-39所述的红外选择方法, 其特征在于, 具有通知步骤, 对选择步骤 选择的特定信息和 /或对比值的更新信息和 /或对比值的更新事件, 进行通知。
47、 如权利要求 33-39任意一项所述的红外选择方法, 其特征在于, 具有规定处理步骤, 用于对选择步骤所选择的特定信息进行规定处理。
48、 如权利要求 33-39任意一项所述的红外选择方法, 其特征在于, 所述参考图像位于 红外热像中, 具有规定的位置参数。
49、 如权利要求 33-39任意一项所述的红外选择方法, 其特征在于, 具有
被摄体信息选择步骤, 用于基于存储介质所存储的被摄体信息, 来选择被摄体信息; 所 述存储介质, 用于存储被摄体信息及其关联的参考图像的构成数据和 /或被摄体识别信息; 与红外热像共同显示的参考图像, 为根据所选择的被摄体信息关联的参考图像的构成数 据, 而获得的参考图像;
检测步骤,用于根据所选择的被摄体信息关联的参考图像的构成数据和 /或被摄体识别信 息, 而配置的与检测处理有关的被摄体识别信息, 来进行检测处理。
50、 红外选择方法, 包括的方法或步骤实现如上述权利要求 1-33所述的红外选择装置。
PCT/CN2013/090609 2012-12-27 2013-12-26 红外选择装置和红外选择方法 WO2014101803A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/758,248 US20160005156A1 (en) 2012-12-27 2013-12-26 Infrared selecting device and method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210584184.1 2012-12-27
CN201210584184 2012-12-27

Publications (1)

Publication Number Publication Date
WO2014101803A1 true WO2014101803A1 (zh) 2014-07-03

Family

ID=50992181

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/090609 WO2014101803A1 (zh) 2012-12-27 2013-12-26 红外选择装置和红外选择方法

Country Status (3)

Country Link
US (1) US20160005156A1 (zh)
CN (1) CN103900715A (zh)
WO (1) WO2014101803A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113421282A (zh) * 2021-05-28 2021-09-21 深圳数联天下智能科技有限公司 运动检测方法、装置、设备和介质

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103776543A (zh) * 2012-09-21 2014-05-07 杭州美盛红外光电技术有限公司 热像分析装置和热像分析方法
WO2015136714A1 (ja) * 2014-03-14 2015-09-17 オムロン株式会社 画像識別装置、画像センサ、画像識別方法
US20170039567A1 (en) * 2015-08-03 2017-02-09 Capital One Services, LLC. Systems and methods for item-based transaction authentication
JP6333871B2 (ja) * 2016-02-25 2018-05-30 ファナック株式会社 入力画像から検出した対象物を表示する画像処理装置
CN110412964A (zh) * 2019-07-17 2019-11-05 广东科鉴检测工程技术有限公司 一种仪器电控系统的步入式热测试方法及系统

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102103754A (zh) * 2009-12-21 2011-06-22 佳能株式会社 被摄体跟踪设备、被摄体区域提取设备及其控制方法
CN102147856A (zh) * 2010-02-10 2011-08-10 佳能株式会社 图像识别设备及其控制方法
CN102538974A (zh) * 2012-01-12 2012-07-04 杭州美盛红外光电技术有限公司 热像显示装置、热像显示系统和热像显示方法
CN102525381A (zh) * 2010-12-16 2012-07-04 奥林巴斯株式会社 图像处理装置、图像处理方法及计算机可读取的记录装置
CN102538980A (zh) * 2012-01-12 2012-07-04 杭州美盛红外光电技术有限公司 热像装置和热像拍摄方法
CN102564607A (zh) * 2012-01-12 2012-07-11 杭州美盛红外光电技术有限公司 热像装置和热像规范拍摄方法
CN102780882A (zh) * 2011-05-12 2012-11-14 佳能株式会社 图像处理设备和图像处理方法

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060164682A1 (en) * 2005-01-25 2006-07-27 Dspv, Ltd. System and method of improving the legibility and applicability of document pictures using form based image enhancement
TW200828988A (en) * 2006-12-22 2008-07-01 Altek Corp System and method for image evaluation
KR101247147B1 (ko) * 2007-03-05 2013-03-29 디지털옵틱스 코포레이션 유럽 리미티드 디지털 영상 획득 장치에서의 얼굴 탐색 및 검출
JP5354767B2 (ja) * 2007-10-17 2013-11-27 株式会社日立国際電気 物体検知装置
US8111942B2 (en) * 2008-02-06 2012-02-07 O2Micro, Inc. System and method for optimizing camera settings
JP5219795B2 (ja) * 2008-12-26 2013-06-26 キヤノン株式会社 被写体追跡装置、その制御方法、撮像装置、表示装置及びプログラム
US8599264B2 (en) * 2009-11-20 2013-12-03 Fluke Corporation Comparison of infrared images
JP5818409B2 (ja) * 2010-06-17 2015-11-18 キヤノン株式会社 眼底撮像装置及びその制御方法
CN102169017B (zh) * 2010-12-25 2016-08-10 江西九江供电公司 一种变电站红外热成像在线监测系统
CN102147290A (zh) * 2011-01-14 2011-08-10 北京广微积电科技有限公司 红外成像温度监测方法和系统
JP5772272B2 (ja) * 2011-06-16 2015-09-02 富士通株式会社 情報処理装置、及び情報処理方法
US20130155249A1 (en) * 2011-12-20 2013-06-20 Fluke Corporation Thermal imaging camera for infrared rephotography

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102103754A (zh) * 2009-12-21 2011-06-22 佳能株式会社 被摄体跟踪设备、被摄体区域提取设备及其控制方法
CN102147856A (zh) * 2010-02-10 2011-08-10 佳能株式会社 图像识别设备及其控制方法
CN102525381A (zh) * 2010-12-16 2012-07-04 奥林巴斯株式会社 图像处理装置、图像处理方法及计算机可读取的记录装置
CN102780882A (zh) * 2011-05-12 2012-11-14 佳能株式会社 图像处理设备和图像处理方法
CN102538974A (zh) * 2012-01-12 2012-07-04 杭州美盛红外光电技术有限公司 热像显示装置、热像显示系统和热像显示方法
CN102538980A (zh) * 2012-01-12 2012-07-04 杭州美盛红外光电技术有限公司 热像装置和热像拍摄方法
CN102564607A (zh) * 2012-01-12 2012-07-11 杭州美盛红外光电技术有限公司 热像装置和热像规范拍摄方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113421282A (zh) * 2021-05-28 2021-09-21 深圳数联天下智能科技有限公司 运动检测方法、装置、设备和介质

Also Published As

Publication number Publication date
CN103900715A (zh) 2014-07-02
US20160005156A1 (en) 2016-01-07

Similar Documents

Publication Publication Date Title
WO2014101803A1 (zh) 红外选择装置和红外选择方法
US10230907B2 (en) Thermal imaging device and normative photographing method for thermal image
WO2016112704A1 (zh) 调节投影仪焦距的方法和装置、计算机存储介质
CN103776542B (zh) 热像诊断装置和热像诊断方法
WO2015078418A1 (zh) 决定装置和决定方法
WO2014101804A1 (zh) 热像选择装置和热像选择方法
JP2015534364A (ja) 熱画像情報記録装置および熱画像情報記録方法
WO2015096824A1 (zh) 分析装置和分析方法
WO2014101805A1 (zh) 红外挑选装置和红外挑选方法
US10163214B2 (en) Device and method for analyzing thermal images
WO2014101811A1 (zh) 热像匹配装置和热像匹配方法
CN104655636B (zh) 热像分析装置、配置装置和热像分析方法、配置方法
WO2014101809A1 (zh) 热像检测装置和热像检测方法
CN116358711A (zh) 红外匹配更新装置和红外匹配更新方法
WO2015074628A1 (zh) 分析对比装置和分析对比方法
US20160119556A1 (en) Device for dynamically recording thermal images, replay device, method for dynamically recording thermal images, and replay method
CN114838829A (zh) 热像选择通知装置和热像选择通知方法
CN115993191A (zh) 热像匹配更新装置和热像匹配更新方法
WO2015074627A1 (zh) 热像整理装置、记录装置、整理系统和热像整理方法、记录方法
WO2014101802A1 (zh) 热像挑选装置和热像挑选方法
CN105021290B (zh) 拍摄装置、伪彩设置装置和拍摄方法、伪彩设置方法
CN114923580A (zh) 红外选择通知装置和红外选择通知方法
WO2013174291A1 (zh) 红外摄影装置和红外摄影方法
CN114923582A (zh) 热像挑选通知装置和热像挑选通知方法
JP2014067142A (ja) 画像処理装置、画像処理方法、撮像装置、および撮像方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13866607

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 14758248

Country of ref document: US

122 Ep: pct application non-entry in european phase

Ref document number: 13866607

Country of ref document: EP

Kind code of ref document: A1