JP2005338359A - Imaging unit - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a mobile type imaging unit that has excellent portability and capable of easily detecting the presence or no presence of defects of a structure, such as a crack and a cavity. <P>SOLUTION: The imaging unit 10 has, in a housing forming its appearance, a digital camera 12 and an infrared camera 13 for imaging visible image data and thermal image data of a structure to be imaged, a display part 14 for displaying thermally visible integrated image data which is obtained by superimposing thermal image data on the visible image data and integrating them and/or extracted display image data which is obtained by extracting only data in the arbitrary temperature range from the thermal image data, an operation button 15, an image processing part 53 for creating the thermally visible integrated image data and/or extracted display image data; a main control part 55 for displaying the thermally visible integrated image data and/or the extracted display image data on the display part 14; and an optical axis adjustment mechanism for adjusting the optical axes of the digital camera 12 and infrared camera 13 so that the axes are parallel to each other. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a portable imaging apparatus that captures image data, and more particularly to an imaging apparatus that is suitable for use in diagnosing defects such as concrete and mortar lifting and cracking in structures such as buildings and bridges.

  In recent years, there has been an accident in which concrete of a concrete structure such as a tunnel or a viaduct deteriorates and a part of the concrete is peeled off. In connection with this, establishment of the nondestructive inspection method which can test | inspect the soundness of concrete exactly is calculated | required. As a nondestructive inspection method for concrete, infrared photography (thermography) using an infrared camera and digital photography using a digital still camera are known.

  Infrared photography is a method for grasping the presence or absence and degree of defects based on an image of a concrete surface by light in the infrared region. According to this infrared photography, it is possible to find internal defects near the surface such as floating concrete, mortar, tiles, etc., cavities and jumpers covering the surface of the structure.

  Phenomena where defects are present in structures such as floating parts such as tiles and mortar, junkers in concrete, cavities, and water leakage parts are phenomena in which thermal properties such as thermal conductivity and specific heat differ from healthy parts where no defects exist. Presents. The difference in thermal properties between the sound part and the defective part appears as a difference in surface temperature in the temperature fluctuation of the structure caused by the temperature, solar radiation, or artificial overheating / cooling. Infrared photography in the civil engineering / architecture field is to measure the surface temperature distribution of an object by acquiring a thermal image of the object using an infrared imaging device that receives infrared light emitted from the object and visualizes it, This is a method for estimating the presence of an internal defect based on an abnormal portion of the surface temperature appearing on a thermal image. Specifically, in the infrared photography method, as shown in FIG. 9, since the defect portion 101 generated in the structure 100 becomes a gap heat insulating layer, the surface temperature generated due to solar radiation or temperature change is reduced. An internal defect can be detected using the fact that there is a time zone in which a surface temperature difference occurs between the defective portion 101 and the healthy portion in the daily fluctuation.

  On the other hand, the digital photography method is a method of grasping the presence or absence and the extent of defects based on an image of the concrete surface by light in the visible region. According to this digital photography method, it is possible to find cracks in concrete, mortar, tiles, etc. and surface defects.

  These infrared photography and digital photography are excellent in terms of safety during measurement, ease of handling, and high speed of processing, and are rapidly spreading in recent years. As a technique for detecting a defect of a structure using such infrared photography, for example, Patent Document 1 is proposed. As a technique for detecting a defect in a structure using digital photography, for example, Patent Document 2 is proposed.

JP 2001-50921 A JP 2003-57188 A

  Specifically, Patent Document 1 discloses an automatic detection device for an internal defect of an object that automatically detects a defect inside a structure. In particular, this automatic detection device for internal defects of an object includes means for measuring a thermal image of an object in the process of increasing or decreasing the object surface temperature, and means for determining an inflection point of the pixel line by analyzing a pixel line of the thermal image. And a means for detecting and calculating an area that is surrounded by these inflection points and that has a convex or concave temperature gradient. As a result, the automatic detection device for internal defects of the object can prevent misdiagnosis due to individual differences in judgment criteria.

  Patent Document 2 discloses a method of capturing at least one image of an existing artificial building and detecting the presence of one or more defects in the artificial building. In particular, the defect detection method includes (a) providing a detectable material on or in an existing man-made structure such that a portion thereof is present in one or more defects of the man-made structure; (B) an imaging step of capturing at least one digital image of the artificial building with an image sensor; and (c) processing the one or more captured digital images to provide a visual image of the artificial building; A processing step for determining the presence of one or more defects in the building, wherein the image sensor captures at least one image of the artificial building and determines the presence or absence of a detectable material in the one or more defects. The above defects are identified. Thereby, in this defect detection method, it is supposed that it can be judged appropriately whether the existing artificial building has a defect.

  However, the conventional infrared photography and digital photography have the following problems.

  First, in order to inspect and diagnose defects such as cracks and cavities, it is necessary to know the presence or absence of a defective part, the position of the defective part, and the size of the defective part. In conventional infrared photography and digital photography, Even if it was possible to detect the presence or absence of a defective part, it was difficult to measure its size.

  In digital photography, since it is impossible to avoid distortion of the captured image, it is necessary to specify which position in the actual structure the position of the defect portion specified on the image corresponds to, There is a problem that this processing takes time.

  Furthermore, in infrared photography, the outline of the structure and the reference point do not appear on the image, so even if the defective part is specified, the position of the actual structure is specified. There is a problem that this processing takes time.

  Furthermore, in infrared photography and digital photography, when a structure is a large building, it is necessary to take a number of partial images and synthesize these partial images. In addition, in the partial image captured at an angle with respect to the structure, the size of the defect on the screen is different even if the size of the actual defect in the structure is the same. Therefore, in the infrared photography method and the digital photography method, there is a problem that it is necessary to obtain the size and shape of the defective portion when such partial images are combined, and this processing takes time.

  In addition, in the method of using infrared photography or digital photography individually, since there is only a display mode in which the captured image is simply displayed or displayed in an enlarged / reduced manner, the defective portion is regarded as a healthy portion. In many cases, it was difficult to distinguish from each other.

  Furthermore, in recent years, a device having excellent portability in which a digital camera and an infrared camera are mounted has been developed, such as “Infrared Thermography Device: Thermo Tracer TH9100MV / WV” manufactured by NEC Sanei Co., Ltd. However, the number of pixels of the digital camera is as small as about 400,000 pixels, and there is a problem that the dimensional accuracy of the defective portion is poor. Further, such a device can display only one of a visible image by a digital camera or a thermal image by an infrared camera, and the angle of view and the field of view of these both images are different. There was also.

  The present invention has been made in view of such a situation, and can realize downsizing and weight reduction, easy operability, excellent portability, and distortion of an image. It is an object of the present invention to provide a portable imaging device that can easily correct or synthesize an image and can easily detect the presence or absence of a defect such as a crack in a structure or a cavity.

  An imaging device according to the present invention that achieves the above-described object is a portable imaging device that captures image data, and a housing that forms an appearance and a camera lens are exposed to the outside from a side wall surface of the housing. As described above, the digital camera that captures the visible image data of the structure to be imaged and the camera lens are disposed inside the casing so that the camera lens is exposed to the outside from the side wall surface of the casing. An infrared camera that captures thermal image data of the structure, operating means disposed inside the casing such that the operation surface is exposed to the outside from the side wall surface of the casing, and inside the casing And image processing means for performing various image processing on visible image data captured by the digital camera and thermal image data captured by the infrared camera, and a display screen from the side wall surface of the housing Display means for displaying various information including at least image data, which is disposed inside the casing so as to be exposed to the part, and disposed within the casing and detachable from the imaging apparatus. Storage medium control means for controlling reading and / or writing of data to and from the storage medium for storing the visible image data and / or the thermal image data; and at least image data stored in the display means. Control means for controlling the storage medium control means to store data in the storage medium, and an optical axis for each of the digital camera and the infrared camera. Optical axis adjusting means for adjusting so as to be parallel to each other, and the image processing means includes at least the thermal image data and the visible image. Thermo-visible fusion image data obtained by superimposing and fusing data and / or extraction display image data obtained by extracting only data in an arbitrary temperature range from the thermal image data, and the control means includes the image processing means The thermo-visible fusion image data and / or the extracted display image data generated by the above is displayed on the display means.

  Such an imaging apparatus according to the present invention includes a user interface including a digital camera, an infrared camera, a display unit, and an operation unit, a circuit including an image processing unit, a storage medium control unit, a control unit, and an optical axis adjustment unit. All the mechanisms are housed in a single casing that is portable. Therefore, the imaging apparatus according to the present invention is extremely portable and contributes to easy on-site work. In addition, since the imaging apparatus according to the present invention displays the thermo-visible fusion image data and / or the extracted display image data on the display means, it can easily detect the presence or absence of a defect such as a crack in the structure or a cavity. it can.

  Here, in the imaging apparatus according to the present invention, the image processing unit arbitrarily sets a display intensity ratio of the visible image data and the thermal image data to be superimposed on the thermo-visible fusion image data based on the operation of the operation unit. It can be variable.

  At this time, the display means desirably displays index information indicating the display intensity ratio of the visible image data and the thermal image data by the operation of the operation means, and the index information includes a visible image by the operation of the operation means. A scroll bar that scrolls according to changes in the display intensity ratio of the data and the thermal image data can be used.

  In the imaging apparatus according to the present invention, the image processing unit can arbitrarily change a temperature range extracted from the thermal image data for the extracted display image data based on an operation of the operation unit. .

  Specifically, the image processing means can arbitrarily select a temperature range extracted from the thermal image data in accordance with an operation of the operation means that can change a sensitivity indicating a temperature range and a center value of the temperature range. Variable. At this time, the image processing unit sets the initial values of the sensitivity and the center value based on a predetermined empirical formula. The image processing means divides an arbitrary temperature range between the maximum value and the minimum value of the temperature in the thermal image data into predetermined stages, converts each stage into a predetermined color, and extracts display image data Is generated. When the maximum value and the minimum value of the temperature in the thermal image data are unknown, the image processing unit sets initial values of the maximum value and the minimum value based on a predetermined prediction formula, and When the measured values of the maximum value and the minimum value of the image data are acquired, the maximum value and the minimum value can be set using the measured values.

  The display means preferably displays index information indicating a temperature range extracted from the thermal image data. As the index information, any one of the maximum value and the minimum value of the temperature in the thermal image data is displayed. It is possible to use a temperature range bar indicating which color is used to display the temperature range portion.

  Furthermore, in the imaging apparatus according to the present invention, the image processing unit corrects the visible image data and the thermal image data of the structure so as to have the same field of view and the same angle of view, and the corrected visible image data and thermal image data. The extracted and displayed image data for the thermal-visible fusion image data and / or the corrected thermal image data is generated.

  Specifically, in the imaging apparatus according to the present invention, the following series of processing is performed in order to generate thermo-visible fusion image data and / or extracted display image data.

  First, the control means displays the thermo-visible fusion image data on the display means so as to follow the movement of the field of view of the digital camera and the infrared camera in order to determine the imaging target, and the image processing means When the imaging target is determined, visible image data and thermal image data of the structure are captured.

  At this time, the image processing means acquires distance data from the digital camera and the infrared camera to the structure using an autofocus function or a manual focus function of the digital camera or the infrared camera. Thereby, in the imaging device concerning this invention, it is not necessary to provide a rangefinder separately, and size reduction can be achieved.

  Further, the image processing unit corrects the supplied visible image data and thermal image data to an equal scale, and corrects the equal scale visible image data and thermal image data so as to have the same field of view and the same angle of view.

  When the image processing means corrects the visible image data and the thermal image data of the same scale so as to have the same field of view and the same angle of view, the image processing means takes into account the distortion aberration of the camera lens of the digital camera and the infrared camera. A process for correcting the optical distortion of the image based thereon, a process for correcting the parallax between the digital camera and the infrared camera, and a process for correcting a camera lens field angle difference between the digital camera and the infrared camera are performed.

  At this time, the image processing means uses the distance between the center of the optical system of each of the digital camera and the infrared camera, and the distance to the structure at the time of imaging by the digital camera and the infrared camera. A process for correcting the parallax between the digital camera and the infrared camera is performed. Further, the image processing means uses the value of the smaller camera lens angle of view between the camera lens angle of view of the digital camera and the camera lens angle of view of the infrared camera, and the digital camera, the infrared camera, The camera lens field angle difference is corrected.

  Here, in the imaging apparatus according to the present invention, the digital camera is disposed at a position where the optical axis is directly above the optical axis of the infrared camera. Thereby, in the imaging device concerning this invention, while being able to achieve size reduction, the process which correct | amends the parallax of the said digital camera and the said infrared camera can be simplified.

  In the imaging apparatus according to the present invention, the operation means includes at least a power button for turning on / off a secondary battery that is detachable from the imaging apparatus, the digital camera, and the digital camera. A shutter button for capturing still image data with an infrared camera, a display intensity ratio of visible image data and thermal image data to be superimposed as the thermo-visible fusion image data, and / or the heat to be displayed as the extracted display image data A setting button for setting the temperature range of the image data, an image data storage button for storing the image data in the storage medium, and the image data stored in the storage medium are read and displayed on the display means. It is only necessary to provide an image data read button for this purpose.

  In the imaging apparatus according to the present invention, an encoding unit that encodes analog thermal image data captured by the infrared camera and generates digital thermal image data is disposed inside the casing. Thereby, the imaging apparatus according to the present invention can perform digital processing even if the infrared camera can capture only analog thermal image data.

  The image processing unit converts the thermal image data captured by the infrared camera into display data by color coding according to temperature, and the visible image data captured by the digital camera is captured by the infrared camera. The visible image data is scaled so as to match the resolution of the thermal image data, and the generated thermo-visible fusion image data and / or the extracted display image data is converted into a format that can be displayed by the display means. Further, the image processing means compresses the thermo-visible fusion image data and / or the extracted display image data into a predetermined format when storing them in the storage medium.

  Furthermore, in the imaging apparatus according to the present invention, the control means can read out the image data stored in the storage medium, and can display a list of these image data on the display means as a thumbnail display. The desired image data selected from the list displayed as thumbnails can be read from the storage medium and displayed on the display means.

  Note that the imaging apparatus according to the present invention is extremely suitable for use in diagnosing defects in the structure.

  In the present invention, it is possible to realize a significant reduction in size and weight, as well as easy operability, excellent portability, and correction of image distortion or synthesis of an image. Therefore, it is possible to easily detect the presence or absence of a defect such as a crack or a cavity in the structure.

  Hereinafter, specific embodiments to which the present invention is applied will be described in detail with reference to the drawings.

  This embodiment is a portable imaging device that captures image data. This imaging device is suitable for use in diagnosing structural defects using infrared rays, and is excellent in portability and capable of detecting the presence or absence of defects while being equipped with a digital camera and an infrared camera. It can be done. In particular, this imaging apparatus has been devised with a focus on realizing a small size and a light weight, which has been impossible in the past, and an easy operability.

  The applicant of the present application considered that, when diagnosing a defect in a structure, the application is limited to an application that only focuses on imaging after accurately grasping the presence or absence of a defect in the structure rather than performing an analysis on site. In other words, the applicant of the present application mounts only the indispensable functions that contribute to the grasp of the presence or absence of defects while giving consideration to the convenience of post-processing with an emphasis on on-site workability, excellent portability, and image analysis. Therefore, it was considered to propose an imaging device in which unnecessary functions were omitted. Under such a premise, the applicant of the present application has reduced the size and weight of the imaging device that can reduce the size and weight of the structure and can facilitate the operability. It is essential to reduce the number of components and the weight and volume of each component in order to make it easier to operate, and to eliminate operability with a personal computer using a mouse, etc. .

  Therefore, in order to reduce the number of components, the applicant of the present application has removed a distance meter that measures the distance to the structure, an angle measuring device that measures the imaging angle of the structure, and a personal computer that performs various processes. In addition, in order to reduce the weight and volume of each component, instead of using a camera as a general-purpose product, a semi-finished camera module is mounted, and the operation by a personal computer using a mouse is abolished. For, we adopted an operation method with several operation buttons. Here, the reason why the rangefinder and the angle measuring device can be reduced is that the image data obtained by imaging as detailed in Japanese Patent Application No. 2004-129597 already filed by the applicant of the present application. This is because even if the information itself does not have distance or angle information, it is possible to perform processing using the distance and angle information effectively in post-processing. The reason why the number of personal computers that perform various types of processing can be reduced is that a dedicated LSI (Large Scale Integration), a predetermined display means, and several operation buttons are installed, which is necessary for diagnostics such as image processing. By being able to realize the function.

  Hereinafter, an imaging apparatus devised based on such a background will be described in detail.

  As shown in FIG. 1A and FIG. 1B, the imaging device 10 has an external appearance formed by a substantially rectangular parallelepiped casing 11, and various constituent members are disposed inside the casing 11. Is done.

  The imaging device 10 includes a digital camera 12 that captures visible image data of a structure that is an imaging target, and an infrared camera 13 that captures thermal image data of the structure inside the housing 11.

  The digital camera 12 can be configured using a digital still camera having, for example, about 4 million effective pixels. Here, the specification when the digital camera 12 having the number of pixels of about 4 million pixels is used will be examined. Assume that the camera has a camera lens with a horizontal pixel number of 2272 pixels, a vertical pixel number of 1704 pixels, a horizontal field angle of 36 °, and a vertical field angle of 28 °. In the digital camera 12, when imaging a structure separated by a distance of 10 m based on such specifications, the horizontal distance per pixel is 2.86 mm and the vertical distance is 2 .93 mm. That is, the digital camera 12 captures visible image data corresponding to a distance of about 3 mm per pixel. In addition, in the digital camera 12, when the optical 3 × zoom is applied, visible image data corresponding to a distance of about 1 mm per pixel can be captured. On the other hand, when the specification in the case of using the digital camera having the number of pixels of about 400,000 pixels is examined, the horizontal direction pixel number and the vertical direction pixel number are respectively compared with the digital camera 12 having the number of pixels of about 4 million pixels. Therefore, the distance per pixel is 3.3 times, which is about 10 mm. Therefore, even if the optical 3 × zoom is applied under this specification, visible image data corresponding to a distance of about 3.3 mm per pixel is only captured.

  On the other hand, the crack as a defect part is normally classified into three about 0.2 mm or less, 0.2 mm-1.0 mm, and 1.0 mm or more about the width. Therefore, in order to image a 0.2 mm defect portion, in order to correspond to a distance of 0.2 mm per pixel, an optical 3 × zoom was applied to a digital camera having about 4 million pixels. In this case, it is sufficient that the imaging distance to the structure is further close to 2 m. However, when the optical 3 × zoom is applied to a digital camera having the number of pixels of about 400,000 pixels, It needs to be close to 60cm. In addition, when an optical 3 × zoom is applied to a digital camera having a number of pixels of about 400,000 pixels and the structure is close to 60 cm, the imaging area obtained by one imaging is horizontal. The distance is 39 cm and the vertical distance is 30 cm, which is extremely narrow and cannot be put to practical use. Therefore, it is desirable to use a digital camera 12 having an effective pixel number of about 4 million pixels.

  As shown in FIGS. 1A and 2, the digital camera 12 is arranged such that the camera lens is exposed to the outside from the front side wall surface of the housing 11. The digital camera 12 is disposed at a position where its optical axis is directly above the optical axis of the infrared camera 13 in order to reduce the size of the entire apparatus.

  On the other hand, the infrared camera 13 uses, for example, an infrared camera whose measurement temperature range is about −20 ° C. to 100 ° C. and the number of pixels of captured image data is about 320 (H) × 240 (V) dots. Can be configured. As shown in FIGS. 1A and 2, the infrared camera 13 is also disposed so that the camera lens is exposed to the outside from the front side wall surface of the housing 11, as in the digital camera 12.

  In addition, the imaging apparatus 10 includes a display unit 14 that is a display unit that displays various types of information including at least image data, such as an LCD (Liquid Crystal Display), for example. Specifically, the display unit 14 is configured as a VGA (Video Graphics Array) type 5.5 inch TFT (Thin Film Transistor) liquid crystal device, and may be configured as a device capable of displaying 16-bit RGB format data. it can. As shown in FIGS. 1B and 2, the display unit 14 is disposed so that its display screen is exposed to the outside from the rear side wall surface of the housing 11, and at least thermal image data and visible image described later are provided. Image data obtained by superimposing and fusing data (hereinafter referred to as thermo-visible fusion image data), or image data obtained by extracting only data in an arbitrary temperature range from thermal image data (hereinafter referred to as extracted display image data). The image data IM including is displayed.

  Furthermore, the imaging apparatus 10 includes various operation buttons 15 that are operation means inside the housing 11. As shown in FIGS. 1A, 1 </ b> B, and 2, the operation button 15 is disposed so that its operation surface is exposed to the outside from the upper side wall surface of the housing 11. As these operation buttons 15, at least a power button for turning on / off the battery 16 that is a secondary battery that is detachable from the imaging apparatus 10, a still image by the digital camera 12 and the infrared camera 13. A shutter button for capturing data, the above-described visible image data to be superimposed as the thermo-visible fusion image data, the display intensity ratio of the thermal image data, and / or the temperature range of the thermal image data to be displayed as the extracted display image data are set. Image data in a PCMCIA (Personal Computer Memory Card International Association) card-type memory 17 as a storage medium that is detachable from the imaging device 10 and stores at least visible image data and / or thermal image data. An image data storage button for storing Five types of image data read buttons for reading image data stored in the PCMCIA card type memory 17 and displaying the image data on the display unit 14 may be provided.

  Furthermore, the imaging device 10 is not particularly shown, but in the housing 11, the optical axes of the digital camera 12 and the infrared camera 13 are parallel to each other in order to increase the imaging accuracy of the structure. An optical axis adjustment mechanism that is an optical axis adjustment means for adjustment is provided. In the imaging apparatus 10, the angle of view of each optical system for the digital camera 12 and the infrared camera 13 is often not the same. However, by providing such an optical axis adjustment mechanism, the digital camera 12 and the infrared camera 13 have different angles of view. Since the center of the image data captured by each can be adjusted to indicate a point on the subject that is separated by the same distance as the distance between the digital camera 12 and the infrared camera 13, the digital camera 12 and the infrared ray can be adjusted. Taking into account the field size ratio calculated based on the angle of view of each optical system for the camera 13, the angle of view of the image with the smaller angle of view is calculated from the vicinity of the center of the image with the larger angle of view. Cut and superimpose this by moving the same distance as the distance between the digital camera 12 and the infrared camera 13 Ri, regardless of the distance to the subject, it is possible to overlay the visible image data and thermal image data, it is possible to generate heat visible fused image data described above with high accuracy.

As shown in FIG. 1A, such an imaging apparatus 10 has, for example, a case 11 having a lateral length of 120 mm, a depth direction length of 120 mm, a height direction length of 100 mm, and a volume of 1440 ×. The total weight is about 10 ³ mm ³ and the weight is suitable for a portable device of less than 1.0 kg. In addition, the imaging device 10 is configured by attaching a predetermined strap 18 to the housing 11 in order to provide extremely excellent portability to the user. Although not particularly illustrated, the imaging device 10 is provided with a buffer mechanism for protecting the digital camera 12 and the infrared camera 13 from an impact, and dust and water prevention for preventing dust and water droplets from entering the housing 11. Needless to say, the spray mechanism is also provided.

  Now, such an imaging device 10 includes a circuit configuration as shown in FIG. That is, the imaging apparatus 10 includes a camera control unit 51 that controls the digital camera 12, a video encoder 52 that encodes thermal image data captured by the infrared camera 13, and visible image data and digital camera 12 that are captured by the digital camera 12. The image processing unit 53 is an image processing unit that performs various types of image processing on the thermal image data, and an SDRAM (Synchronous Dynamic Random Access Memory) 54 that is used as a work area of the image processing unit 53. In addition, the imaging apparatus 10 includes a main control unit 55 that is a control unit that comprehensively controls each unit, a flash ROM (Read Only Memory) 56 that stores various information such as programs, and a work area for the main control unit 55. The SDRAM 57 used and a PCMCIA controller 58 which is a storage medium control means for controlling reading and / or writing of data with respect to the PCMCIA card type memory 17 installed in the PCMCIA card slot 59 are provided.

  The camera control unit 51 controls the digital camera 12 under the control of a main control unit 55 connected by, for example, a USB (Universal Serial Bus), and a 10-bit digital visible image captured by the digital camera 12, for example. Data is acquired and supplied to the image processing unit 53 as resolution data of, for example, VGA format. At this time, the camera control unit 51 uses the autofocus function or the manual focus function of either the digital camera 12 or the infrared camera 13, and the distance to the structure imaged by the digital camera 12 and the infrared camera 13. Data is acquired and supplied to the image processing unit 53.

  The video encoder 52 is provided when the thermal image data captured by the infrared camera 13 is analog data. That is, when the video encoder 52 acquires the analog thermal image data captured by the infrared camera 13, the video encoder 52 performs a predetermined encoding on the thermal image data, for example, digital VQGA (Quarter Video Graphics Array) format or the like. Generate thermal image data. The video encoder 52 supplies the generated thermal image data to the image processing unit 53. Note that the infrared camera 13 may be manually set for focus or the like, or may be controlled based on the control of the main control unit 55 as in the digital camera 12.

  The image processing unit 53 is configured by, for example, a DSP (Digital Signal Processor) that executes processing using the SDRAM 54 as a work area. The image processing unit 53 captures thermal image data captured by the infrared camera 13 and digitized by the video encoder 52, and converts the thermal image data into display data by color coding according to temperature. As a result, the image processing unit 53 can generate the extracted display image data. The image processing unit 53 captures the visible image data captured by the digital camera 12 and performs scaling of the visible image data so as to match the resolution of the thermal image data supplied from the video encoder 52. Furthermore, as will be described in detail later, the image processing unit 53 performs a series of processes for generating thermal visible fusion image data by superimposing and fusing the thermal image data and the visible image data, and an arbitrary temperature range from the thermal image data. A series of processes for generating extracted display image data by extracting only the above data is performed. Then, the image processing unit 53 is a so-called YUV type thermo-visible that is represented by a luminance signal (Y), a difference signal (U) between the luminance signal and the red component, and a difference signal (V) between the luminance signal and the blue component. The fused image data and / or the extracted display image data are converted into a format that can be displayed by the display unit 14 such as RGB format, and the thermo-visible fused image data and / or the extracted display image data are stored in the PCMCIA card type memory 17. For this purpose, the image data is compressed into a predetermined format such as JPEG (Joint Photographic Experts Group) format.

  The SDRAM 54 stores temporary data generated by execution of processing by the image processing unit 53. For example, two 128M bits are provided, and a total of 256M bits of data can be read and / or written. Memorize temporarily.

  The main control unit 55 can be configured by a dedicated LSI, and operates based on operation of the operation buttons 15 and time information by an RTC (Real Time Clock) 60. The main control unit 55 controls the display unit 14 to display the heat-visible fusion image data and / or the extracted display image data generated by the image processing unit 53 on the display unit 14. Further, the main control unit 55 controls the camera control unit 51 by transmitting a predetermined command to the camera control unit 51 connected via USB, for example. Further, the main control unit 55 controls the PCMCIA controller 58 to store the visible image data of the maximum number of pixels captured by the digital camera 12 in the PCMCIA card type memory 17. Furthermore, the main control unit 55 controls the PCMCIA controller 58 to extract the heat-visible fusion image data and / or the extraction when the personal computer is connected to the personal computer via the PCMCIA card slot 59 or the like, though not shown. The display image data is transferred to the personal computer. Further, the main control unit 55 controls the PCMCIA controller 58 to transmit the thermo-visible fusion image data and / or the extracted display image data compressed by the image processing unit 53 to the JPEG format or the like, and the digital thermal image data. It is stored in the card type memory 17.

  The flash ROM 56 stores various information such as a program executed by the main control unit 55. For example, two 16M bit data are provided, and a total of 32M bit data is stored in a readable and / or writable manner. .

  The SDRAM 57 stores temporary data generated by execution of processing by the main control unit 55. For example, two 128M bits are provided, and a total of 256M bits of data can be read and / or written. Memorize temporarily.

  The PCMCIA controller 58 controls reading and / or writing of data with respect to the PCMCIA card type memory 17 installed in the PCMCIA card slot 59 under the control of the main control unit 55.

  As described above, the imaging apparatus 10 having such a circuit configuration is large enough to carry the user interface including the digital camera 12, the infrared camera 13, the display unit 14, and the operation buttons 15, and various circuits and mechanisms. The unit is housed in a single casing 11 and is configured as an integrated unit having excellent portability. At this time, the imaging apparatus 10 is configured such that the digital camera 12 and the infrared camera 13 are arranged so as to be directed to substantially the same part of the structure to be imaged. In the imaging apparatus 10, the spatial coordinate values of the center of the camera optical system of the digital camera 12 and the infrared camera 13 that are spatially separated and the distance between these optical axes are known and stored in the flash ROM 56 or the like. .

  In such an imaging apparatus 10, under the control of the main control unit 55, the thermo-visible fusion image data and the extracted display image data generated by the image processing unit 53 are displayed on the display unit 14 and presented to the diagnostician. To do. The diagnostician can grasp the defective portion recognized on the thermo-visible fusion image data and the extracted display image data while visually recognizing the thermo-visible fusion image data and the extracted display image data. Further, in the imaging apparatus 10, by operating the image data storage button in the operation button 15, the thermo-visible fusion image data and the extracted display image data are compressed into the JPEG format or the like by the image processing unit 53, and then the PCMCIA card. It can be stored in the mold memory 17. Further, in the imaging device 10, visible image data captured by the digital camera 12 and thermal image data captured by the infrared camera 13 can also be stored in the PCMCIA card type memory 17. Furthermore, in the imaging device 10, various images stored in the PCMCIA card type memory 17 under the control of the main control unit 55 and the PCMCIA controller 58 by operating the image data read button in the operation button 15. Data can be read and a list of these image data can be displayed on the display unit 14 as a so-called thumbnail display. In the imaging apparatus 10, the desired image data is selected from the thumbnail display list, and the image data is read from the PCMCIA card type memory 17 under the control of the main control unit 55. Can be displayed on the display unit 14. The imaging apparatus 10 can also be connected to a personal computer via the PCMCIA card slot 59 and transfer image data to the personal computer, facilitating image analysis as post-processing using the personal computer. be able to.

  Now, the generation of the thermo-visible fusion image data and the extracted display image data will be described in detail along with the operation of the imaging device 10.

  In the imaging device 10, when the operation button 15 is operated to operate the power button, the image processing unit 53 generates the thermo-visible fusion image data based on the visible image data and the thermal image data of the structure. Generated and displayed on the display unit 14. At this time, the imaging apparatus 10 displays the thermo-visible fusion image data on the display unit 14 so as to follow the movement of the visual field of the digital camera 12 and the infrared camera 13 in order to determine the imaging target. The thermo-visible fusion image data displayed on the display unit 14 is sent to the digital camera 12 or the infrared camera 13 by requesting the image data at regular time intervals under the control of the main control unit 55. The display intensity ratio of the visible image data and the thermal image data to be superimposed is set to a predetermined standard value such as, for example, thermal image intensity: visible image intensity = 50: 50. It is what. The display intensity ratio can be arbitrarily changed as necessary, as will be described later. At this time, in the imaging device 10, the thermo-visible fusion image data is generated based on the visible image data and the thermal image data having a smaller number of pixels than the number of pixels of the digital camera 12 and the infrared camera 13 and displayed on the display unit 14. As a result, the processing load on the image processing unit 53 and the main control unit 55 is reduced, and real-time thermo-visible fusion image data smoothly following the movement of the visual field of the digital camera 12 and the infrared camera 13 can be displayed on the display unit 14. it can.

  In the imaging device 10, when a diagnostician visually confirms the real-time thermo-visible fusion image data and determines an imaging target, the shutter button in the operation button 15 is operated to display visible image data from the digital camera 12 and the infrared camera 13. In addition, the thermal image data can be taken into the image processing unit 53 as still image data, and various processes such as storing various image data in the PCMCIA card type memory 17 can be performed. Here, in the imaging apparatus 10, it is desirable to perform processing on the image data of the maximum number of pixels of the digital camera 12 and the infrared camera 13 after taking the visible image data and the thermal image data into the image processing unit 53. As a result, it is convenient for the diagnostician, and it is possible to easily and reliably detect the defective portion.

  By the way, in the imaging device 10, distance information to the structure at the time of imaging by the digital camera 12 and the infrared camera 13 in the later-described parallax processing performed to generate such thermo-visible fusion image data. However, since this measurement accuracy requires only short distance measurement, the focus function of either the digital camera 12 or the infrared camera 13 can be used. Therefore, in the imaging device 10, when the visible image data and the thermal image data from the digital camera 12 and the infrared camera 13 are taken into the image processing unit 53, the distance data from the digital camera 12 and the infrared camera 13 to the structure is digitally converted. Obtained using the focus function of either the camera 12 or the infrared camera 13. That is, in the imaging device 10, when either the digital camera 12 or the infrared camera 13 used for acquiring distance data has an autofocus function, the distance data is acquired using that function. . On the other hand, in the imaging apparatus 10, when either the digital camera 12 or the infrared camera 13 used for acquiring distance data does not have an autofocus function and performs manual focus manually, the function is provided. To obtain the distance data. At this time, since the positional relationship between the digital camera 12 and the infrared camera 13 is known in the imaging device 10 as described above, the focus function of either the digital camera 12 or the infrared camera 13 is provided. By using the distance data to obtain the distance data, the distance to the structure for both the digital camera 12 and the infrared camera 13 can be obtained. Thereby, in the imaging device 10, it is not necessary to separately provide a distance meter and an angle measuring device, and the device can be greatly reduced in size. In the imaging apparatus 10, when the distance data is acquired using the focus function of the digital camera 12, the distance data can be obtained with higher accuracy than when the infrared camera 13 having a small number of pixels is used. On the other hand, in the imaging apparatus 10, when distance data is acquired using the focus function of the infrared camera 13, the amount of mechanical movement of the optical system that occurs when the distance data is converted based on the focus information is digital. There is an advantage that the movement amount of the camera 12 is small. Therefore, in the imaging apparatus 10, which of the digital camera 12 and the infrared camera 13 is used may be determined by a trade-off based on the usage situation or the like.

  Now, in the imaging device 10, when the operation button 15 is operated to move to the operable state and the thermo-visible fusion image data as described above is generated, the following processing is performed. .

  First, in the imaging device 10, when visible image data and thermal image data are supplied to the image processing unit 53, the image processing unit 53 corrects the visible image data and thermal image data to an equal scale, and after this correction Are stored in the SDRAM 54. In the imaging apparatus 10, the image processing unit 53 executes lens aberration correction processing and parallax correction processing described below.

  First, in the imaging device 10, the image processing unit 53 executes lens correction processing of the isometric image data captured in the image processing unit 53.

  This lens aberration correction process is a process for correcting optical distortion called distortion of the camera lens, and an example thereof is described in Japanese Patent Application No. 2002-379548. In other words, in the imaging apparatus 10, in order to correct distortion that causes a phenomenon that image data after imaging is distorted in a barrel shape, the image processing unit 53 performs a process called affine transformation.

  This affine transformation is a method of moving or transforming figures and shapes by a combination of Euclidean geometric linear transformation and parallel movement, and can be represented by 4 × 4 matrix operations. Shear's coordinate transformation. This affine transformation is a transformation method in which geometrical properties are maintained such that points arranged in a straight line in the original figure are arranged in a straight line after conversion, and parallel lines are parallel lines after conversion. Therefore, in the imaging apparatus 10, the properties of the optical distortion of the camera lens of the digital camera 12 and the infrared camera 13, that is, the aberration characteristic of the camera lens are collected in advance as data and stored in the flash ROM 56 or the like. Thereby, in the imaging device 10, by the calculation of the image processing unit 53, the visible image data and the thermal image data from which the optical distortion due to the aberration of the camera lens is removed are obtained using the data indicating the aberration characteristic of the camera lens. Can do.

  In the imaging apparatus 10, when such lens aberration correction processing is performed, the parallax correction processing is executed by the image processing unit 53.

  This parallax correction process is described in detail in Japanese Patent Application No. 2002-379548. That is, the imaging device 10 has a structure in which the digital camera 12 and the infrared camera 13 are housed side by side in the housing 11, so that the imaging range of the digital camera 11 and the imaging range of the infrared camera 13 are In other words, a shift, that is, parallax occurs. The parallax correction process is a process for correcting such a parallax.

  In the imaging device 10, when the digital camera 12 and the infrared camera 13 having the same horizontal camera lens field angle and the same vertical camera lens field angle are arranged in parallel in the vertical direction, a subject in the same direction is imaged. By moving the captured image data of one of these two cameras in the vertical direction by the amount of the parallax, the image data obtained by these two cameras are superimposed and matched. Image data can be synthesized. In the imaging device 10, when the camera lens field angles of the digital camera 12 and the infrared camera 13 are different from each other, the distance between the centers of the camera optical systems of the digital camera 12 and the infrared camera 13 and the digital camera 12 The parallax due to the difference in viewpoint between the visible image data and the thermal image data can be corrected using the distance to the structure acquired using the autofocus function.

  Here, in the imaging device 10, since the digital camera 12 is disposed at a position directly above the infrared camera 13, such parallax correction can be simplified.

  Further, in the imaging apparatus 10, when the camera lens field angles of the digital camera 12 and the infrared camera 13 are different, the visible image data and the thermal image data are corrected so as to have the same field of view and the same field angle. At this time, in the imaging device 10, the visual field data and the thermal image data are matched in the field of view and the angle of view using the value with the smaller camera lens angle of view.

  In the imaging apparatus 10, when such parallax correction processing is performed, thermo-visible fusion image data obtained by superimposing and fusing visible image data and thermal image data having the same field of view and angle of view, or a corrected thermal image. Extracted display image data obtained by extracting only data in an arbitrary temperature range from the data is generated by the image processing unit 53, and the generated thermo-visible fusion image data and / or extracted display image data under the control of the main control unit 55 Is displayed on the display unit 14.

  Here, in the imaging device 10, by operating the setting button in the operation button 15, the image processing unit 53 can change the display intensity ratio of the visible image data and the thermal image data to be superimposed on the thermal-visible fusion image data. can do. Specifically, in the imaging device 10, when the thermal image intensity: visible image intensity is set to 75:25, the thermal image data component appears stronger than the visible image data component as shown in FIG. The thermo-visible fusion image data is displayed on the display unit 14. In the imaging apparatus 10, when the thermal image intensity is reduced and the thermal image intensity: visible image intensity is 50:50, as shown in FIG. 5, the components of the visible image data and the components of the thermal image data are as shown in FIG. Is displayed on the display unit 14. Furthermore, in the imaging device 10, when the thermal image intensity is further reduced and the thermal image intensity: visible image intensity is set to 25:75, as shown in FIG. Thermo-visible fusion image data superimposed at a weak level is displayed on the display unit 14. Therefore, in the imaging device 10, when the thermal image intensity: visible image intensity is set to 1: 0, the thermal image data can be displayed on the display unit 14, and the thermal image intensity: visible image intensity is set to 0: 1. In this case, visible image data can be displayed on the display unit 14.

  In the imaging apparatus 10, it is desirable to visually present the display intensity ratio of the visible image data and the thermal image data to be superimposed as the thermo-visible fusion image data to the diagnostician. For example, as shown in FIG. A scroll bar which is index information that can indicate the current display intensity ratio by scrolling in one direction according to the change in the display intensity ratio of the visible image data and the thermal image data by the operation of the setting button in 15. Further, it may be displayed on the display unit 14 together with the thermo-visible fusion image data. At this time, in the imaging device 10, a scroll bar for the display unit 14 may be displayed as necessary so as not to hinder the display of the thermo-visible fusion image data displayed on the display unit 14 having a limited display screen area. A function of switching between display and non-display may be provided.

  As described above, in the imaging apparatus 10, when the thermo-visible fusion image data is displayed on the display unit 14, the display intensity ratio between the visible image data and the thermal image data can be arbitrarily changed. Therefore, in the imaging device 10, when it is desired to grasp the existence of a defective portion that cannot be recognized only by the visible image data, the thermal image intensity is increased or the defective portion is obtained from the thermo-visible fusion image data with the reduced thermal image intensity. It is possible to perform an operation of confirming the estimated location by increasing the thermal image intensity.

  Further, in the imaging device 10, the extracted display image data can be generated by the image processing unit 53 and displayed on the display unit 14 by the operation of the operation button 15 as described above. Specifically, in the imaging device 10, the thermal image data is converted into temperature by the image processing unit 53, a range from the maximum value (Max) to the minimum value (Min) of the temperature, and these maximum value to minimum value. An arbitrary temperature range between the values is divided into predetermined stages, and each of these stages is converted into a predetermined color to generate extracted display image data. Here, the maximum value and the minimum value of the temperature require values for the entire structure to be imaged, but in the imaging device 10, these maximum values and minimum values are unknown before measurement. The image processing unit 53 automatically sets the initial values of the maximum value and the minimum value based on a predetermined prediction formula. In the imaging apparatus 10, after acquiring the actual values of the maximum value and the minimum value, the image processing unit 53 can set the maximum value and the minimum value to be used for diagnosis using the actual value.

  Here, in the imaging device 10, the temperature range extracted from the thermal image data for display on the display unit 14 as the extracted display image data, the “sensitivity” indicating the temperature range, and the “center value” of the temperature range are variable. By operating the two setting buttons in the operation button 15 that can be set as follows, the image processing unit 53 can arbitrarily change the setting button. That is, in the imaging device 10, by operating the setting button in the operation button 15, the temperature range extracted from the thermal image data can be made variable for the extracted display image data. At this time, in the imaging device 10, the image processing unit 53 automatically sets initial values of sensitivity and center value based on a predetermined empirical formula.

Specifically, in the imaging device 10, for example, as shown in FIG. 8 (a), when the sensitivity S _a and the center value C _a are set as initial values, as shown in FIG. 8 (b). When the central value is changed to C _b (> C _a ) without changing the sensitivity as S _b (= S _a ), only the high temperature data is changed without changing the width of the temperature range. Extract from thermal image data. Further, in the imaging apparatus 10, as shown in (c) in the figure, when the center value is changed to C _c (<C _a ) without changing the sensitivity as S _c (= S _a ). First, only the low temperature data is extracted from the thermal image data without changing the width of the temperature range. Furthermore, in the imaging device 10, as shown in FIG. 6D, when the sensitivity is changed to S _d (<S _a ) without changing the center value as C _d (= C _a ). First, the width of the temperature range extracted from the thermal image data is increased. Furthermore, in the imaging apparatus 10, as shown in (e) in the figure, the sensitivity is changed to S _e (<S _a ) without changing the center value as C _e (= C _a ). In this case, the width of the temperature range extracted from the thermal image data is narrowed. Therefore, in the imaging device 10, when the sensitivity and the center value are set so as to include all of the maximum value and the minimum value of the temperature range, the thermal image data can be displayed on the display unit 14.

  As described above, the imaging apparatus 10 extracts only data belonging to an arbitrary temperature range between the maximum value and the minimum value of the thermal image data determined by the sensitivity and the center value from the thermal image data. Can be displayed on the display unit 14 as extracted display image data. Thereby, in the imaging device 10, it becomes possible to grasp | ascertain the presence of the defective part which cannot be recognized only by normal visible image data or thermal image data with high accuracy.

  In the imaging device 10, it is desirable that the temperature range extracted from the thermal image data to be displayed on the display unit 14 as the extracted display image data is also visually presented to the diagnostician. A temperature range bar as shown in FIG. 8 is extracted as index information that can indicate which temperature range of the maximum value to the minimum value is displayed using which color. You may make it display on the display part 14 with display image data. Even in this case, in the imaging device 10, the temperature range for the display unit 14 may be set as necessary so as not to hinder the display of the extracted display image data displayed on the display unit 14 having a limited display screen area. You may provide the function to switch display / non-display of a bar.

  As described above, in the imaging device 10, the thermal-visible fusion image data that can arbitrarily change the display intensity ratio of the visible image data and the thermal image data to be superimposed, and the temperature range to be displayed can be arbitrarily changed. By generating the extracted display image data, it is possible to provide a tool that is extremely convenient for the diagnostician.

  As described above, the imaging apparatus 10 shown as an embodiment of the present invention has a user interface including a digital camera 12, an infrared camera 13, a display unit 14, and operation buttons 15, and various circuits and mechanisms. Since it is configured to be housed in a single casing 11 having a possible size, it is extremely portable and can be easily operated on site. In addition, the imaging apparatus 10 displays a thermal visible fusion image data in which the display intensity ratio of the visible image data and the thermal image data can be changed, and an extracted display image data in which the temperature range to be displayed can be changed. 14 and the data can be stored in the PCMCIA card type memory 17 which is removable from the image pickup apparatus 10, so that the presence or absence of defects such as cracks and cavities in the structure can be easily detected. can do.

  Note that the present invention is not limited to the above-described embodiment, and it is needless to say that modifications can be made as appropriate without departing from the spirit of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a perspective view of an imaging apparatus viewed from the front side in order to describe an external configuration of the imaging apparatus shown as an embodiment of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a perspective view of an imaging apparatus viewed from the back side in order to describe an external configuration of the imaging apparatus shown as an embodiment of the present invention. It is the side view of the imaging device, and the top view of a display part. It is a block diagram explaining the circuit structure of the imaging device. Thermal image intensity: It is a figure explaining the example of thermo-visible fusion image data in case visible image intensity is set to 75:25. Thermal image intensity: It is a figure explaining the example of thermo-visible fusion image data when visible image intensity is 50:50. Thermal image intensity: It is a figure explaining the example of thermo-visible fusion image data when visible image intensity is 25:75. It is a figure explaining the example of the scroll bar which shows the display intensity ratio of the visible image data and thermal image data to superimpose as thermo-visible fusion image data. It is a figure explaining the example of a setting of the sensitivity and center value which determine the temperature range displayed on a display part as extraction display image data. It is a figure for demonstrating the principle of the defect part detection by an infrared photography.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Image pick-up device 11 Case 12 Digital camera 13 Infrared camera 14 Display part 15 Operation button 16 Battery 17 PCMCIA card type memory 18 Strap 51 Camera control part 52 Video encoder 53 Image processing part 54 SDRAM
55, 57 Main controller 56 Flash ROM
58 PCMCIA controller 59 PCMCIA card slot 60 RTC
IM image data

Claims (27)

A portable imaging device that captures image data,
A housing that forms the exterior;
A digital camera that is disposed inside the housing such that a camera lens is exposed to the outside from the side wall surface of the housing, and that captures visible image data of a structure to be imaged;
An infrared camera that is disposed inside the housing such that the camera lens is exposed to the outside from the side wall surface of the housing, and captures thermal image data of the structure;
Operating means disposed inside the housing such that the operation surface is exposed to the outside from the side wall surface of the housing;
Image processing means disposed in the housing and performing various image processing on visible image data captured by the digital camera and thermal image data captured by the infrared camera;
A display means disposed inside the housing such that a display screen is exposed to the outside from the side wall surface of the housing, and displaying various information including at least image data;
A storage medium that is disposed inside the casing and is detachable from the imaging apparatus and controls reading and / or writing of data to / from a storage medium that stores at least the visible image data and / or the thermal image data Control means;
A control unit disposed in the housing, displaying at least image data on the display unit, and controlling the storage medium control unit to store the data in the storage medium;
An optical axis adjusting means that is disposed inside the casing and adjusts so that optical axes of the digital camera and the infrared camera are parallel to each other;
The image processing means extracts at least thermal range fusion image data obtained by superimposing and fusing the thermal image data and the visible image data, and / or extracting only data in an arbitrary temperature range from the thermal image data. Generate display image data,
The image pickup apparatus, wherein the control means causes the display means to display the thermo-visible fusion image data and / or the extracted display image data generated by the image processing means. The image processing means is configured to arbitrarily change a display intensity ratio between the visible image data and the thermal image data to be superimposed on the thermo-visible fusion image data based on the operation of the operation means. The imaging device described. The imaging apparatus according to claim 2, wherein the display means displays index information indicating a display intensity ratio of visible image data and thermal image data by operation of the operation means. The imaging apparatus according to claim 3, wherein the index information is a scroll bar that scrolls according to a change in a display intensity ratio of visible image data and thermal image data by operation of the operation means. The imaging apparatus according to claim 1, wherein the image processing unit arbitrarily varies a temperature range extracted from the thermal image data for the extracted display image data based on an operation of the operation unit. The image processing means may arbitrarily change a temperature range extracted from the thermal image data in accordance with an operation of the operation means capable of changing a sensitivity indicating a temperature range and a center value of the temperature range. The imaging apparatus according to claim 5. The imaging apparatus according to claim 6, wherein the image processing unit sets the initial values of the sensitivity and the center value based on a predetermined empirical formula. The image processing unit divides an arbitrary temperature range between the maximum value and the minimum value of the temperature in the thermal image data into predetermined stages, and converts each stage into a predetermined color to generate extracted display image data. The imaging apparatus according to claim 7, wherein: When the maximum value and the minimum value of the temperature in the thermal image data are unknown, the image processing means sets initial values of the maximum value and the minimum value based on a predetermined prediction formula, and the thermal image data 9. The imaging apparatus according to claim 8, wherein when the measured values of the maximum value and the minimum value of temperature are acquired, the maximum value and the minimum value are set using the measured values. The imaging apparatus according to claim 8, wherein the display unit displays index information indicating a temperature range extracted from the thermal image data. The index information is a temperature range bar indicating which temperature range portion is displayed using which color among the maximum temperature value to the minimum value of the thermal image data. The imaging device according to claim 10. The image processing means corrects the visible image data and thermal image data of the structure so as to have the same field of view and the same angle of view, and the thermo-visible fusion image data for the corrected visible image data and thermal image data, The imaging apparatus according to claim 1, wherein the extracted display image data for the corrected thermal image data is generated. The control means displays the thermo-visible fusion image data on the display means so as to follow the movement of the field of view of the digital camera and the infrared camera in order to determine the imaging target,
13. The imaging apparatus according to claim 12, wherein the image processing means captures visible image data and thermal image data of the structure when an imaging target is determined. The image processing means acquires distance data from the digital camera and the infrared camera to the structure using an autofocus function or a manual focus function of the digital camera or the infrared camera. 13. The imaging device according to 13. The image processing means corrects the supplied visible image data and thermal image data to an equal scale, and corrects the equal scale visible image data and thermal image data to have the same field of view and the same angle of view. The imaging apparatus according to claim 13. When the image processing means corrects the visible image data and the thermal image data of the same scale so as to have the same field of view and the same angle of view, an image based on distortion aberration of the camera lens of the digital camera and the infrared camera. And a process for correcting parallax between the digital camera and the infrared camera, and a process for correcting a camera lens field angle difference between the digital camera and the infrared camera. The imaging device according to claim 15. The image processing means uses the distance between the center of the optical system of each of the digital camera and the infrared camera and the distance to the structure at the time of imaging by the digital camera and the infrared camera. The imaging apparatus according to claim 16, wherein a process of correcting parallax between the camera and the infrared camera is performed. The image processing means uses the value of the smaller camera lens field angle of the camera lens field angle of the digital camera and the camera lens field angle of the infrared camera, and the camera of the digital camera and the infrared camera. The imaging apparatus according to claim 16, wherein a process of correcting a difference in lens angle of view is performed. The imaging apparatus according to claim 1, wherein the digital camera is disposed at a position where an optical axis thereof is directly above the optical axis of the infrared camera. The operating means is at least
A power button for turning on / off a secondary battery that is detachable from the imaging device;
A shutter button for capturing still image data by the digital camera and the infrared camera;
A setting button for setting a display intensity ratio of visible image data and thermal image data to be superimposed as the thermo-visible fusion image data, and / or a temperature range of the thermal image data to be displayed as the extracted display image data;
An image data storage button for storing image data in the storage medium;
The imaging apparatus according to claim 1, further comprising an image data read button for reading image data stored in the storage medium and displaying the image data on the display unit. The imaging apparatus according to claim 1, further comprising an encoding unit that is disposed inside the casing and encodes analog thermal image data captured by the infrared camera to generate digital thermal image data. . The image processing means performs scaling of the visible image data so that the visible image data captured by the digital camera matches the resolution of the thermal image data captured by the infrared camera. 21. The imaging device according to item 21. The imaging apparatus according to claim 22, wherein the image processing means converts the generated thermo-visible fusion image data and / or the extracted display image data into a format that can be displayed by the display means. 23. The imaging apparatus according to claim 22, wherein the image processing means compresses the thermo-visible fusion image data and / or the extracted display image data into a predetermined format when storing the data in the storage medium. The image pickup apparatus according to claim 1, wherein the control means reads out image data stored in the storage medium and causes the display means to display a list of the image data as a thumbnail display. 26. The imaging apparatus according to claim 25, wherein the control means reads desired image data selected from a list displayed as thumbnails on the display means from the storage medium and displays the data on the display means. The imaging apparatus according to claim 1, wherein the imaging apparatus is used for diagnosis of a defect in the structure.