JP2021012124A - Temperature measurement device, temperature measurement program and temperature measurement method - Google Patents

Abstract

To provide a technique which indicates a sign of malfunction by illustrating distribution information of the temperature.SOLUTION: A temperature measurement device comprises: an image processing unit which is connected to one or more imaging devices for obtaining images by imaging a subject and specifies a surface temperature of the subject at a prescribed point of the one or more images; an analysis processing unit which sets the aggregation of points having the surface temperature within one or more ranges to the image as one or more regions; and an output information generation unit which generates screen information displaying the region in a distinguishable manner.SELECTED DRAWING: Figure 1

Description

The present invention relates to a temperature measuring device, a temperature measuring program, and a temperature measuring method.

In Patent Document 1, a two-dimensional luminance image signal input from an optical detection device is converted into two-dimensional array data divided into a plurality of parts in the width direction and the moving direction of the material to be inspected, and whether the temperature at a predetermined coordinate is equal to or less than a threshold value. A technique for determining the presence or absence of scratches based on whether or not there is a scratch is described.

Japanese Unexamined Patent Publication No. 2004-279161

The above technique can detect an abnormal part, that is, a scratch on the inspection material, but cannot show a sign of a defect in the inspection material or the like.

An object of the present invention is to provide a technique for showing signs of failure by illustrating temperature distribution information.

The present application includes a plurality of means for solving at least a part of the above problems, and examples thereof are as follows. The temperature measuring device according to one aspect of the present invention is an image that is connected to one or more image pickup devices that capture an image of a subject and obtains an image, and specifies the surface temperature of the subject at a predetermined point of the one or more images. The processing unit, the analysis processing unit that sets a set of points having a surface temperature in one or more ranges with respect to the image as one or more regions, and the output information that generates screen information that displays the regions in a distinguishable manner. It is characterized by including a generation unit.

Further, in the temperature measuring device, the output information generation unit may display a plurality of the images and the regions thereof in a time series of shooting in the screen information.

Further, the temperature measuring device may be characterized in that the plurality of the images are a plurality of images in which the subject is common.

Further, in the temperature measuring device, the subject is a product that undergoes a predetermined process, the imaging device captures a plurality of the subjects in each step, and the plurality of images are the above. It may be characterized in that it is a plurality of images having a common process.

Further, in the temperature measuring device, the image processing unit superimposes a plurality of the images and synthesizes them by a predetermined calculation to generate a composite image, and the analysis processing unit generates a composite image with respect to the composite image. Alternatively, a set of points having a surface temperature in a plurality of ranges is set as one or a plurality of regions, and the output information generation unit generates screen information for displaying the regions in a distinguishable manner in the composite image. May be good.

Further, the temperature measuring device may be characterized in that the plurality of the images are a plurality of images in which the subject is common.

Further, in the temperature measuring device, the subject is a product that undergoes a predetermined process, the imaging device captures a plurality of the subjects in each step, and the plurality of images are the above. It may be characterized in that it is a plurality of images having a common process.

Further, the temperature measuring device according to another aspect of the present invention is connected to one or a plurality of imaging devices for photographing a subject to obtain an image, and measures the surface temperature of the subject at a predetermined point of the one or a plurality of the images. It is characterized by including an image processing unit to be specified, an output information generation unit that generates screen information for displaying a three-dimensional histogram centered on the coordinate values on the image and the surface temperature at the coordinate values. And.

Further, in the temperature measuring device, the output information generation unit may generate screen information for displaying the three-dimensional histogram in a time series of shooting a plurality of the images.

Further, the temperature measuring device may be characterized in that the plurality of the images are a plurality of images in which the subject is common.

Further, in the temperature measuring device, the subject is a product that undergoes a predetermined process, the imaging device captures a plurality of the subjects in each step, and the plurality of images are the above. It may be characterized in that it is a plurality of images having a common process.

Further, in the temperature measuring device, the image processing unit superimposes a plurality of the images and synthesizes them by a predetermined calculation to generate a composite image, and the output information generation unit generates coordinates on the composite image. It may generate screen information for displaying a three-dimensional histogram centered on the value and the surface temperature at the coordinate value.

Further, the temperature measuring device may be characterized in that the plurality of the images are a plurality of images in which the subject is common.

Further, in the temperature measuring device, the subject is a product that undergoes a predetermined process, the imaging device captures a plurality of the subjects in each step, and the plurality of images are the above. It may be characterized in that it is a plurality of images having a common process.

Further, a program according to another aspect of the present invention is a temperature measurement program that causes a computer to measure a temperature, and the computer is connected to or controlled by one or a plurality of image pickup devices that capture a subject and obtain an image. The control unit includes an image processing unit that specifies the surface temperature of the subject at a predetermined point of the image, and a set of points having a surface temperature in the range of one or more with respect to the image. It is characterized in that an analysis processing unit for setting one or a plurality of areas and an output information generation unit for generating screen information for displaying the above areas in a distinguishable manner are executed.

Further, the temperature measuring method according to another aspect of the present invention is a temperature measuring method using a temperature measuring device connected to one or a plurality of imaging devices for photographing a subject to obtain an image, and the temperature measuring device is described above. The control unit includes an image processing step for specifying the surface temperature of the subject at a predetermined point of the image, and the control unit has one or a plurality of surface temperatures with respect to the image. It is characterized in that an analysis processing step of setting a set of points as one or a plurality of areas and an output information generation step of generating screen information for displaying the above areas in a distinguishable manner are performed.

According to the present invention, it is possible to provide a technique for showing signs of failure by illustrating temperature distribution information.

Issues, configurations and effects other than those described above will be clarified by the description of the following embodiments.

It is a block diagram which shows the temperature measurement system example which concerns on embodiment. It is a figure which shows the example of the data structure of an image storage part. It is a figure which shows the example of the data structure of the analysis information storage part. It is a figure which shows the hardware configuration example of a temperature measuring apparatus. It is a figure which shows the example of the flow of the imaging process. It is a figure which shows the example of the flow of analysis processing. It is a figure which shows the example of the setting value input screen. It is a figure which shows the example of the analysis information display screen. It is a figure which shows the example of the area superimposition image screen. It is a figure which shows the example of the flow of 3D histogram processing. It is a figure which shows the example of the 3D histogram screen. It is a figure which shows the example of the flow of the animation display processing. It is a figure which shows the example of the animation screen. It is a figure which shows the example of the flow of the equipment state confirmation processing. It is a block diagram which shows the example of the temperature measurement system which concerns on 2nd Embodiment.

Hereinafter, the temperature measurement system 1 to which the embodiment according to one aspect of the present invention is applied will be described with reference to the drawings. In the following embodiments, when necessary for convenience, the description will be divided into a plurality of sections or embodiments, but unless otherwise specified, they are not unrelated to each other, and one is the other. It is related to some or all of the modified examples, details, supplementary explanations, etc.

In addition, in the following embodiments, when the number of elements (including the number, numerical value, quantity, range, etc.) is referred to, when it is specified in particular, or when it is clearly limited to a specific number in principle, etc. Except, the number is not limited to the specific number, and may be more than or less than the specific number.

Furthermore, in the following embodiments, the components (including element steps, etc.) are not necessarily essential unless otherwise specified or clearly considered to be essential in principle. Needless to say.

Similarly, in the following embodiments, when referring to the shape, positional relationship, etc. of a component or the like, the shape is substantially the same except when it is clearly stated or when it is considered that it is not so clearly in principle. Etc., etc. shall be included. This also applies to the above numerical values and ranges.

Further, in all the drawings for explaining the embodiment, the same members are, in principle, given the same reference numerals, and the repeated description thereof will be omitted.

FIG. 1 is a configuration diagram showing an example of a temperature measurement system according to an embodiment. In the temperature measurement system 1, the user uses the analysis instruction device 300, but the analysis instruction device 300 is not limited to the browser of the user's smartphone, personal computer, tablet device, etc. (hereinafter referred to as the user terminal). It may be used by connecting via software or application software. Alternatively, it may be used by connecting to the temperature measuring device 100 via the browser software or application software of the user terminal.

When connecting to the analysis instruction device 300 or the temperature measurement device 100 from the user terminal, a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, a mobile phone network, or a communication network in which these are combined is used. It is connected via the network 50. The network 50 may be a VPN (Virtual Private Network) or the like on a wireless communication network such as a mobile phone communication network.

The temperature measuring device 100 is connected to the imaging device 170 and the analysis instruction device 300 by wire or wirelessly so as to be able to communicate with each other. The temperature measuring device 100 is a wired communication device such as HDMI (High-Definition Multimedia Interface), USB (Universal Serial Bus), 2.4 GHz (gigahertz) band or 5 GHz band wireless communication, Bluetooth (registered trademark), etc. Alternatively, it is connected by a wireless communication path. The image pickup apparatus 170 photographs the measurement object 10 as a subject in response to an instruction from the temperature measuring apparatus 100.

The measurement object 10 as a subject includes a product manufactured by high temperature treatment such as a steel plate. Since the steel sheet is processed at a high temperature, it is necessary to measure the temperature in a non-contact manner, and it is necessary to keep the flow of the transfer line including the walking beam, the transfer roll, the conveyor, etc. at a constant speed or higher, so that the steel sheet cannot be stopped. .. However, the measured object 10 is not limited to the steel plate as long as it has such characteristics. For example, glass, ceramics, resins, frozen foods, and the like may be superior or inferior in quality depending on the temperature at the time of manufacture. Furthermore, in the case of efficiently finding a hypothermia patient (for example, triage at the time of a large-scale disaster), the living body may be the measurement object 10.

The image pickup device 170 is an image pickup device capable of measuring the surface temperature (for example, measuring 8 frames per second) in a short time without contacting the object 10 to be measured. For example, the image pickup device 170 is a thermal camera device that records the radiation intensity of infrared rays by using various image pickup elements.

In the temperature measurement system 1, the temperature measurement device 100 is communicably connected to the analysis instruction device 300 via the network 50.

When the temperature measuring device 100 receives an analysis instruction from the analysis instruction device 300, the temperature measuring device 100 performs an analysis process according to the instruction, generates output information as a result, and passes it to the analysis instruction device 300. Further, the temperature measuring device 100 instructs the imaging device 170 to take a picture of the measured object 10 at a predetermined timing. For example, the temperature measuring device 100 takes a picture of the measured object 10 when the measured object 10 flows on the conveyor and comes to a predetermined position. In this shooting, if the exposure time is too long, the measurement object 10 cannot be properly shot due to movement or saturation, and if the exposure time is too short, the amount of light is insufficient and sufficient contrast and S / N ratio cannot be obtained. .. Therefore, the shutter speed, the exposure value such as the aperture, and the depth of field and the shooting distance according to the distance to the measuring object 10 must be controlled so that the moving measurement object 10 can be appropriately photographed. This control is performed by the temperature measuring device 100. However, the present invention is not limited to this, and the image pickup apparatus 170 may take a picture with a predetermined fixed value or an automatically calculated value.

The analysis instruction device 300 issues an analysis instruction to the temperature measurement device 100 at a timing instructed by the user or a predetermined timing, and obtains output information (for example, screen information) from the temperature measurement device 100.

The analysis instruction device 300 is an information processing device such as a so-called server device or a personal computer, includes an input / output device such as a keyboard or a display, and can be connected to the temperature measuring device 100 via the network 50.

The temperature measuring device 100 includes a storage unit 110, a control unit 120, an input unit 130, an output unit 140, a camera IF (interface) unit 150, a communication unit 160, and an imaging device 170. The storage unit 110 includes an image storage unit 111 and an analysis information storage unit 112.

FIG. 2 is a diagram showing an example of a data structure of the image storage unit. The image storage unit 111 includes an image ID 111A, a shooting date and time 111B, image data 111C, a measurement target ID 111D, and an imaging pass number 111E.

The image ID 111A is information for identifying an image obtained as a result of the image pickup apparatus 170 imaging the measurement object 10. The shooting date and time 111B is information for specifying the date and time when the image pickup apparatus 170 imaged the measurement object 10. The image data 111C is image data (still image) obtained as a result of the imaging device 170 imaging the measurement object 10. The measurement target ID 111D is information for identifying an individual of the measurement object 10. The number of imaging passes 111E is information for specifying in which process the individual of the measurement object 10 was photographed.

FIG. 3 is a diagram showing an example of a data structure of the analysis information storage unit. The analysis information storage unit 112 contains the image ID 112A, the temperature zone identifier 112B, the temperature zone (low, high) 112C, the number of detection areas 112D, the detection area ID 112E, the center coordinates 112F, the range 112G, and the area 112H. And are included.

The image ID 112A is information for specifying an image obtained as a result of the image pickup device 170 imaging the measurement object 10, and is the same as the image ID of the image storage unit 111. The temperature zone identifier 112B is information to be labeled for a predetermined temperature zone. The temperature zone (low, high) 112C is information for specifying the temperature zone, that is, the minimum temperature and the maximum temperature. The number of detection regions 112D is information for specifying the number of regions belonging to the temperature zone specified by the temperature zone identifier 112B among the subjects. The detection area ID 112E is information that identifies the area from other areas. The center coordinates 112F, the range 112G, and the area 112H are the coordinates that are the center of the area, the information that specifies the range of the area from the center coordinates, and the information that specifies the area of the area.

The analysis information is configured such that the number of detected regions N (N is a natural number) has a 1: N relationship for one image. That is, 0 or one or more sets of the detection area ID 112E, the center coordinates 112F, the range 112G, and the area 112H are associated with each other according to the value of the number of detection areas 112D.

Returning to the description of FIG. The control unit 120 includes a camera control unit 121, an image processing unit 122, an analysis processing unit 123, and an output information generation unit 124. The camera control unit 121 gives the image pickup device 170 instructions regarding imaging (for example, angle of view, focus position matching shooting distance, aperture value, exposure time, data size, capture timing, exposure compensation, contrast setting, trim rate, etc. ) And data communication control.

The image processing unit 122 is a processing unit that generates image data from the information obtained by the camera control unit 121. Specifically, the image processing unit 122 acquires the RAW data of the image sensor from the image pickup device 170, performs development processing, and stores the RAW data in the image storage unit 111. In addition, the temperature of each coordinate of the developed image data that has already been saved is specified, and various arithmetic processes and the like with other images are performed.

The analysis processing unit 123 sets a set of points having a surface temperature within a predetermined range as a region for the image data.

The output information generation unit 124 generates screen information for displaying the area set by the analysis processing unit 123 in a distinguishable manner. For example, the output information generation unit 124 generates screen information to be displayed by superimposing the display color on the image with different display colors for each area set by the analysis processing unit 123. However, the present invention is not limited to this, and for example, the output information generation unit 124 may generate screen information to be superimposed and displayed on an image with different shades for each area set by the analysis processing unit 123, or the analysis processing unit. The hatching notation may be different for each area set by 123 to generate screen information to be superimposed and displayed on the image. In addition, the output information generation unit 124 may generate screen information for extracting contour lines for each area set by the analysis processing unit 123 and superimposing them on an image for display. Further, the output information generation unit 124 further generates screen information for displaying a three-dimensional histogram centered on the two-dimensional coordinate values on the image and the surface temperature at the coordinate values. Further, the output information generation unit 124 further identifies one or a plurality of images in which the subject is common, and a three-dimensional histogram centered on the two-dimensional coordinate values on each image and the surface temperature at the coordinate values. Generates screen information that displays images in order of shooting time.

Further, the output information generation unit 124 corrects the images of a plurality of measurement objects 10 for the same process so that the positions and sizes of the measurement objects 10 are the same, and then superimposes and composites (layers) the composite images. Is generated, and various screen information described above is generated for the composite image. The output information generation unit 124 not only generates a composite image by superimposing and synthesizing (layer processing) images of a plurality of measurement objects in the same process, but also generates a composite image of a plurality of measurement objects 10 in the same process. After correcting the image so that the position and size of the measurement object 10 are the same, various operations (for example, OR, AND, exclusive OR, deviation value calculation, difference calculation, etc.) are performed to generate a composite image. To do.

The input unit 130 receives an input from the user to the temperature measuring device 100. For example, the input unit 130 receives various contact inputs such as received typing, touch, and flick inputs, or various inputs such as voice input and line-of-sight input.

The output unit 140 outputs from the temperature measuring device 100 to the user. The output information is various output information such as screens and forms.

The camera IF unit 150 performs connection management and communication processing with the image pickup apparatus 170 via a wired connection using an HDMI cable or the like or a wireless connection such as Bluetooth.

The communication unit 160 communicates with another device via the network 50. Packet communication based on the TCP / IP protocol is adopted for the communication, but the communication is not limited to this.

FIG. 4 is a diagram showing a hardware configuration example of the temperature measuring device. The temperature measuring device 100 includes a hardware configuration realized by a housing of a so-called server device, workstation, personal computer, smartphone or tablet terminal. The temperature measuring device 100 is a bus that connects the arithmetic unit 101, the main storage device 102, the auxiliary storage device 103, the input device 104, the display device 105, the wired communication device 106, the wireless communication device 107, and each device. 108 and.

The arithmetic unit 101 is, for example, an arithmetic unit such as a CPU (Central Processing Unit).

The main storage device 102 is, for example, a memory device such as a RAM (Random Access Memory).

The auxiliary storage device 103 is a non-volatile storage device such as a so-called hard disk (Hard Disk Drive), SSD (Solid State Drive), or flash memory that can store digital information.

The input device 104 is a device that receives one or more inputs of a keyboard, a mouse, a touch panel, and a microphone. The display device 105 is a device that displays one or more of various output devices such as an organic EL (Electro-Luminescence) display.

The wired communication device 106 is a network interface card (NIC) that communicates with another device via a network, a board that communicates with another device via an HDMI cable, and the like.

The wireless communication device 107 is an antenna device that wirelessly communicates with another device via a wireless network, a communication module that communicates with another device by one-to-one wireless communication, and the like.

The camera control unit 121, the image processing unit 122, the analysis processing unit 123, and the output information generation unit 124 of the temperature measuring device 100 described above are realized by a program that causes the arithmetic unit 101 to perform processing. This program is stored in the main storage device 102, the auxiliary storage device 103, or a ROM device (not shown), is loaded on the main storage device 102 for execution, and is executed by the arithmetic unit 101.

Further, the storage unit 110 of the temperature measuring device 100 is realized by the main storage device 102 and the auxiliary storage device 103. Further, the input unit 130 and the output unit 140 are realized by the input device 104 and the display device 105, respectively. The camera IF unit 150 is realized by a wired communication device 106 or a wireless communication device 107. The communication unit 160 is realized by a wired communication device 106 or a wireless communication device 107. The above is an example of the hardware configuration of the temperature measuring device 100.

The configuration of the temperature measuring device 100 can be further classified into more components according to the processing content. It can also be categorized so that one component performs more processing.

Further, each control unit (camera control unit 121, image processing unit 122, analysis processing unit 123, and output information generation unit 124) is constructed by dedicated hardware (ASIC, GPU, etc.) that realizes each function. May be done. Further, the processing of each control unit may be executed by one hardware or may be executed by a plurality of hardware.

The analysis instruction device 300 also has basically the same hardware configuration as the temperature measurement device.

Next, the operation of the temperature measurement system 1 in this embodiment will be described.

FIG. 5 is a diagram showing an example of the flow of the imaging process. The imaging process is started when the temperature measuring device 100 instructs the imaging device 170 to perform imaging periodically or in real time.

First, the temperature measuring device 100 transmits an imaging instruction to the imaging device 170 (step S001). Specifically, the camera control unit 121 of the temperature measuring device 100 issues an imaging instruction to the imaging device 170 via the camera IF unit 150. The instructions may include a set of instructions for controlling various imaging devices 170. For example, the imaging instruction includes an angle of view adjustment instruction as needed, a focus adjustment instruction according to a shooting distance, and at least an instruction to determine an imaging timing.

Then, the image pickup apparatus 170 takes an image of the measurement object 10 (step S002). Then, the imaging device 170 transmits the captured image to the temperature measuring device 100 (step S003). Specifically, the captured image is RAW (raw) data output from the image pickup element or various developed general image data (BMP, JPEG, PNG, MPEG, AVI, MOV, etc.).

Then, the temperature measuring device 100 stores the transmitted captured image (step S004). Specifically, the camera control unit 121 assigns the image ID 111A to the received captured image and stores the image data 111C in the image storage unit 111.

Then, the image processing unit 122 stores the shooting date / time 111B, the measurement target ID 111D, and the number of imaging paths 111E in association with each other (step S005). Specifically, the image processing unit 122 acquires information on the date and time, the measurement target ID, and the imaging path from a predetermined process management device or the like (not shown) and stores the information in the image storage unit 111.

The above is an example of the flow of the imaging process. According to the image pickup process, the image pickup device 170 can image the measurement object 10 according to the instruction timing from the temperature measurement device 100. In the case of steel plate manufacturing, the steel plate, which is the object to be measured 10, is carried by a conveyor and is constantly moving. Therefore, when the imaging device 170 takes a one-shot image, it is appropriate if the imaging timing is not strictly controlled. It is difficult to obtain a good image. Therefore, the image pickup device 170 may transmit the image in real time in a moving image format to the temperature measurement device 100, and the camera control unit 121 may selectively obtain (snapshot) an appropriate image.

FIG. 6 is a diagram showing an example of a flow of analysis processing. The analysis process is started when the analysis instruction device 300 instructs the temperature measurement device 100 to perform analysis periodically or in real time.

First, the analysis instruction device 300 receives the set value related to the analysis (step S101). Specifically, the analysis instruction device 300 receives a temperature zone identifier or a temperature zone designation input and an image ID for designating an image to be analyzed from the user.

Then, the analysis instruction device 300 instructs the temperature measurement device 100 to perform analysis (step S102). Specifically, the analysis instruction device 300 transmits the received analysis set value and the analysis instruction to the temperature measurement device 100.

Then, the temperature measuring device 100 reads out the captured image to be analyzed (step S103). Specifically, the image processing unit 122 reads out the image data 111C and its related information from the image storage unit 111 by using the image ID of the captured image to be analyzed included in the analysis set value as a key.

Then, the temperature measuring device 100 specifies a closed region (specifies the contour and the coloring range) for each temperature zone identifier (step S104). Specifically, the image processing unit 122 specifies the temperature based on the far-infrared intensity at each coordinate of the image, and specifies the temperature zone specified by the received temperature zone identifier or the coordinates belonging to the specified temperature zone. Then, the analysis information such as the contour of the closed region, the center coordinates, the range, and the area is calculated according to the set of coordinates.

Then, the temperature measuring device 100 superimposes the closed regions of the temperature zone identifiers to be displayed (step S105). Specifically, the output information generation unit 124 creates a superposed image by superimposing a predetermined colored layer on the closed region specified in step S104 for the image to be analyzed. Then, the output information generation unit 124 transmits the generated analysis information and the screen information including the superimposed image to the analysis instruction device 300.

Then, the analysis instruction device 300 displays the analysis information of the closed region and the region superimposed image (step S106). Specifically, the analysis instruction device 300 displays the screen information transmitted in step S105.

The above is an example of the flow of analysis processing. According to the analysis process, the temperature measuring device 100 is made to analyze the temperature of the object 10 according to the instruction timing from the analysis instruction device 300, and the part (range) belonging to the predetermined temperature zone is visually confirmed. Can be done.

The example of the above analysis process is not limited to this. For example, a plurality of captured images to be read out are used, a closed region is specified for each image, a temperature zone display is superimposed, and this is displayed in the horizontal direction or the vertical direction. You may want to generate screen information to be paralleled to. Further, for example, a plurality of captured images to be read out are used, a closed region is specified for each image, the temperature zone display is superimposed, and screen information is generated to be displayed so as to be displayed in a time series such as animation. (It may be described in detail in the animation display process described later and a modification thereof). Further, for example, a plurality of captured images to be read out are used, and each image is combined by a predetermined operation to generate a composite image, a closed region is specified for the composite image, and the display of the temperature zone is superimposed. The screen information to be displayed may be generated.

Further, when a plurality of captured images to be read out are used, the captured images may be any plurality of images, or may be a plurality of images in which the measurement object 10 (measurement target ID) as the subject is common. It may be a plurality of images having a common (number of imaging passes).

FIG. 7 is a diagram showing an example of a setting value input screen. The setting value input screen 500 is an example of a screen that accepts the setting value of the analysis process in step S101 of the analysis process. The set value input screen 500 includes a temperature zone identifier display area 501, a temperature zone (lowest) input reception area 502, a temperature zone (highest) input reception area 503, a temperature zone setting / measurement button 504, and a second. Temperature zone identifier display area 511, second temperature zone (lowest) input reception area 512, second temperature zone (highest) input reception area 513, second temperature zone setting / measurement button 514, and close button 515 and are included.

The temperature zone identifier display area 501 and the second temperature zone identifier display area 511 are areas where the temperature zone identifier is displayed. The temperature zone (minimum) input reception area 502 and the second temperature zone (minimum) input reception area 512 receive the designated input of the lower limit value of the temperature zone identified by the temperature zone identifier. The temperature zone (maximum) input reception area 503 and the second temperature zone (maximum) input reception area 513 receive the designated input of the upper limit value of the temperature zone identified by the temperature zone identifier. When the temperature zone setting / measurement button 504 and the second temperature zone setting / measurement button 514 receive input, respectively, the temperature zone and the second temperature zone are analyzed for the temperature zone in which the lower limit value and the upper limit value are input. The process is started from the process step S102.

When the close button 515 accepts the input, the analysis setting value and the analysis result storage instruction are transmitted to the analysis processing unit 123, and the setting value input screen 500 is closed. When the analysis processing unit 123 receives the storage instruction of the analysis result, the analysis processing unit 123 stores the analysis result in the analysis information storage unit 112.

FIG. 8 is a diagram showing an example of an analysis information display screen. The analysis information display screen 500'has basically the same screen configuration as the set value input screen 500, but the value passed from the temperature measuring device 100 as the analysis result to the area where the analysis result information is displayed. Is a screen showing the displayed state. The analysis information display screen 500'includes a measurement result display area 551 and a second measurement result display area 561 in addition to the components shown on the setting value input screen 500.

The measurement result display area 551 includes an area number display area 552, an area number designation reception area 553, an area display area 554, a center X coordinate display area 555, a center Y coordinate display area 556, and an area width display area. 557 and the area height display area 558 are included. Similarly, for the second measurement result display area 561, the area number display area 562, the area number designation reception area 563, the area display area 564, the center X coordinate display area 565, and the center Y coordinate display area 566 are also obtained. The width display area 567 of the area and the height display area 568 of the area are included.

The area number display area 552 and the area number display area 562 show the analysis result of the number of areas corresponding to the designated temperature zone. The area number designation reception area 553 and the area number designation reception area 563 receive the designation of the area number (detection area ID), and the analysis results of the detection area are displayed in the area display area 554 (564) and the center X coordinate display area 555 (. 565), the center Y coordinate display area 556 (566), the area width display area 557 (567), and the area height display area 558 (568).

In the area display area 554 and the area display area 564, the area of the area corresponding to the area number received by the area number designation reception area 553 and the area number designation reception area 563 is displayed.

In the center X coordinate display area 555 and the center X coordinate display area 565, the center X coordinates of the areas corresponding to the area numbers received by the area number designation reception area 553 and the area number designation reception area 563 are displayed.

In the center Y coordinate display area 556 and the center Y coordinate display area 566, the center Y coordinates of the areas corresponding to the area numbers received by the area number designation reception area 553 and the area number designation reception area 563 are displayed.

The width display area 557 of the area and the width display area 567 of the area display the width of the area corresponding to the area number received by the area number designation reception area 553 and the area number designation reception area 563, respectively.

In the area height display area 558 and the area height display area 568, the height of the area corresponding to the area number received by the area number designation reception area 553 and the area number designation reception area 563 is displayed.

FIG. 9 is a diagram showing an example of a region superimposed image screen. In the area superimposition image screen 600, the captured image display area 601 and the area belonging to the designated temperature zone of the image are superimposed and displayed.

Different display colors are determined for each temperature zone identifier according to a predetermined rule, and are superimposed on the image display area 601. In this example, the temperature zones in which the temperature zone identifier is "WARN (minimum 630 degrees Celsius to maximum rate 780 degrees Celsius)" are "1-01" 611, "1-02" 613, and "1-03" 612. , And are displayed in three places. In addition, the temperature zone whose temperature zone identifier is "ERR (minimum 500 degrees Celsius to maximum 630 degrees Celsius)" is displayed in two places, "2-01" 621 and "2-02" 622. ..

According to the region superimposition image screen 600, the region of the designated temperature zone can be visually confirmed, so that the temperature abnormality of the measurement object 10 can be determined and the heat control device of the measurement object 10 (for example, a heating device or a cooling device). It becomes possible to easily determine the occurrence of the abnormality.

FIG. 10 is a diagram showing an example of a flow of 3D histogram processing. The 3D histogram processing is started when the analysis instruction device 300 instructs the temperature measurement device 100 to perform analysis periodically or in real time.

First, the analysis instruction device 300 receives the set value related to the analysis (step S201). Specifically, the analysis instruction device 300 receives an image ID that specifies an image to be analyzed in the 3D histogram from the user.

Then, the analysis instruction device 300 instructs the temperature measurement device 100 to create a histogram (step S202). Specifically, the analysis instruction device 300 transmits the received image ID and the creation instruction to the temperature measurement device 100.

Then, the temperature measuring device 100 reads out the captured image to be analyzed (step S203). Specifically, the image processing unit 122 reads out the image data 111C and its related information from the image storage unit 111 using the image ID as a key.

Then, the temperature measuring device 100 calculates the temperature Z of the (X, Y) coordinates for each coordinate (step S204). Specifically, the image processing unit 122 specifies the temperature Z based on the far-infrared intensity at each coordinate of the image.

Then, the temperature measuring device 100 generates a 3D histogram corresponding to (X, Y, Z) (step S205). Specifically, the output information generation unit 124 uses the temperature Z specified in step S204 as the Z-axis, and the (X, Y) coordinates of the image plotted on the X-axis and the Y-axis, respectively, as a 3D histogram. Screen information including an image is created and transmitted to the analysis instruction device 300.

Then, the analysis instruction device 300 displays the 3D histogram (step S206). Specifically, the analysis instruction device 300 displays the screen information transmitted in step S205.

The above is an example of the flow of 3D histogram processing. According to the 3D histogram processing, the temperature measuring device 100 is made to create a 3D histogram of the temperature of the measurement object 10 according to the instruction timing from the analysis instruction device 300, and the relationship between the position of the measurement object and the temperature is visually confirmed. be able to.

The above example of 3D histogram processing is not limited to this. For example, a plurality of captured images to be read out are used, the temperature Z is specified for each image, a 3D histogram image is created, and the image is created in the horizontal direction or the vertical direction. The screen information to be paralleled to may be generated. Further, for example, a plurality of captured images to be read out are used, the temperature Z is specified for each image, a 3D histogram image is created, and screen information to be displayed so as to be displayed in a time series such as animation is generated. You may. Further, for example, a plurality of captured images to be read out are used, and each image is combined by a predetermined calculation to generate a composite image, the temperature Z is specified for the composite image, and a 3D histogram image is created and created. The screen information for displaying the 3D histogram image may be generated.

Further, when a plurality of captured images to be read out are used, the captured images may be any plurality of images, or may be a plurality of images in which the measurement object 10 (measurement target ID) as the subject is common. It may be a plurality of images having a common (number of imaging passes).

FIG. 11 is a diagram showing an example of a 3D histogram screen. The 3D histogram screen 700 includes a 3D histogram display. In this example, the height of the temperature is expressed by the height of the apex by taking the X-axis and the Y-axis as the two axes of the bottom surface and the Z-axis in the height direction. Therefore, the temperature distribution can be understood at a glance, and the temperature abnormality of the measurement object 10 can be easily detected.

FIG. 12 is a diagram showing an example of a flow of animation display processing. The animation display process is started when the analysis instruction device 300 instructs the temperature measurement device 100 to perform analysis periodically or in real time.

First, the analysis instruction device 300 receives the set value related to the analysis (step S301). Specifically, the analysis instruction device 300 receives a temperature zone identifier or a temperature zone designation input and a measurement target ID for designating the measurement object 10 to be displayed as an animation from the user.

Then, the analysis instruction device 300 instructs the temperature measurement device 100 to create an animation (step S302). Specifically, the analysis instruction device 300 transmits the received temperature zone identifier or temperature zone designation input, the measurement target ID, and the animation creation instruction to the temperature measurement device 100.

Then, the temperature measuring device 100 reads out all the captured images having the designated measurement target ID (step S303). Specifically, the image processing unit 122 reads out the image data 111C and its related information from the image storage unit 111 using the measurement target ID 111D as a key.

Then, the temperature measuring device 100 specifies a closed region for each temperature zone identifier for each image (specifies the contour and the coloring range) (step S304). Specifically, the image processing unit 122 specifies the temperature for each image based on the far-infrared intensity at each coordinate, and the temperature zone specified by the received temperature zone identifier or the coordinates belonging to the specified temperature zone. Is specified, and analysis information such as the contour, center coordinates, range, and area of the closed region is calculated according to the set of coordinates.

Then, the temperature measuring device 100 superimposes the closed regions of the temperature zone identifiers to be displayed (step S305). Specifically, the output information generation unit 124 creates a superposed image by superimposing a layer in which a predetermined coloring is applied to the closed region specified in step S304 for each image.

Then, the temperature measuring device 100 unifies the reference position, the size (scale), and the rotation angle of the measurement target between the images (step S306). Specifically, the output information generation unit 124 specifies the position, size, and rotation amount of the image for each image so that the feature points of the measurement target included in the image match.

Then, the temperature measuring device 100 connects the images in which the closed regions are superimposed in time series (step S307). Specifically, the output information generation unit 124 connects the images in which the closed regions are superimposed in chronological order to generate an image superimposition sequence (animation), and transmits the image superimposition sequence (animation) to the analysis instruction device 300.

Then, the analysis instruction device 300 animates the superimposed image sequence (step S308). Specifically, the analysis instruction device 300 displays the superimposed image sequence transmitted in step S307 as an animation by sequentially switching the display in chronological order.

The above is an example of the flow of animation display processing. According to the animation display process, the temperature measuring device 100 is made to create an animation image of the temperature of the measured object 10 according to the instruction timing from the analysis instruction device 300, and the position of the measured object and the change in temperature are visually confirmed. be able to. Note that in step S308 of the animation display process, the display is not limited to the display in which the animation is automatically played back, and a display in which frame advance, fast forward, rewind, pause, and still image are manually switched in chronological order (for example, mouse wheel display). It may be set to fast forward or rewind depending on the amount of rotation and the angular velocity).

FIG. 13 is a diagram showing an example of an animation screen. The animation screen 800 is a screen in which a measurement target is fixed and changes in the surface temperature thereof are displayed in chronological order. On the animation screen 800, a region having a predetermined coloration is superimposed on the region belonging to the designated temperature zone and displayed on the region superimposed image 801. Further, the animation screen 800 includes a play / stop input button 802 that controls the progress of the animation, a fast forward button 803, a rewind button 804, and a progress bar 805 that indicates the degree of progress.

FIG. 14 is a diagram showing an example of a flow of equipment state confirmation processing. The equipment state confirmation process is started when the analysis instruction device 300 instructs the temperature measurement device 100 to perform analysis periodically or in real time.

First, the analysis instruction device 300 receives the set value related to the analysis (step S401). Specifically, the analysis instruction device 300 receives a temperature zone identifier or a temperature zone designation input from the user and the number of imaging passes that specify a predetermined process.

Then, the analysis instruction device 300 instructs the temperature measurement device 100 to create an equipment state image (step S402). Specifically, the analysis instruction device 300 transmits the received temperature zone identifier or temperature zone designation input, the number of imaging passes, and the equipment state image creation instruction to the temperature measurement device 100.

Then, the temperature measuring device 100 reads out all the captured images having the designated imaging path (step S403). Specifically, the image processing unit 122 reads out the image data 111C and its related information from the image storage unit 111 using the number of imaging passes 111E as a key.

Then, the temperature measuring device 100 divides the pixel value of the image by the number of images and adds them between the images (images of different measurement targets) to obtain a composite image (step S404). That is, the image processing unit 122 obtains a composite image by adding the corresponding pixels of the different measurement objects 10 so that the pixel values of the image are not saturated.

Then, the temperature measuring device 100 specifies a closed region (specifies the contour and the coloring range) for each temperature identifier in the composite image (step S405). Specifically, the image processing unit 122 specifies the temperature of the composite image obtained in step S404 based on the pixel value at each coordinate, and the temperature zone specified by the received temperature zone identifier, or the specified temperature. The coordinates belonging to the band are specified, and the analysis information such as the contour, center coordinates, range, and area of the closed region is calculated according to the set of coordinates.

Then, the temperature measuring device 100 superimposes the closed regions of the temperature zone identifiers to be displayed (step S406). Specifically, the output information generation unit 124 creates a superposed image by superimposing a layer in which a predetermined coloring is applied to the closed region specified in step S405 on the composite image. Then, the output information generation unit 124 transmits the generated analysis information and the screen information including the superimposed image to the analysis instruction device 300.

Then, the analysis instruction device 300 displays the analysis information of the closed region and the region superimposed image (step S407). Specifically, the analysis instruction device 300 displays the screen information transmitted in step S406.

The above is an example of the flow of equipment status confirmation processing. According to the equipment state confirmation process, the temperature measuring device 100 is made to analyze the temperature of different measurement objects 10 in the same process according to the instruction timing from the analysis indicating device 300, and the part (range) belonging to a predetermined temperature zone is determined. It can be confirmed visually. Therefore, regardless of the individual difference of the measurement object 10, it is possible to easily detect a defect or deterioration of the equipment used in the process common to the measurement object 10 at an early stage or in advance.

According to the temperature measurement system 1 as described above, the temperature distribution information can be illustrated to show signs of failure of the product and the equipment used for the production.

The present invention is not limited to the above embodiments. The above embodiments can be modified in various ways within the scope of the technical idea of the present invention. For example, in the above embodiment, the temperature measuring device 100 stores the image information in the storage unit of the own device, but the temperature measuring device 100 is not limited to this. For example, it may be stored in a storage device that is communicably connected via the network 50. In this case, the imaging information from the plurality of temperature measuring devices 100 can be centrally managed. Therefore, it can be easily realized even at a large-scale production site.

FIG. 15 is a configuration diagram showing an example of a temperature measurement system according to the second embodiment. In the temperature measuring system 1 ′ according to the second embodiment, the storage device 200 is communicably connected to the temperature measuring device 100 ′ via the network 50. The storage device 200 is different from the first embodiment in that an image is received from the temperature measuring device 100'and stored, and the image is taken out in response to a request from the temperature measuring device 100'. The storage device 200 includes a storage unit 210 and a communication unit 220, and the storage unit 210 stores the image storage unit 211 and the analysis information storage unit 212. The image storage unit 211 and the analysis information storage unit 212 have the same data structure as the image storage unit 111 and the analysis information storage unit 112 of the temperature measuring device 100 according to the first embodiment.

Further, the image processing unit 122'and the analysis processing unit 123'of the temperature measuring device 100'are basically the same as the image processing unit 122 and the analysis processing unit 123 of the temperature measuring device 100 according to the first embodiment. However, there is a difference in that the access to the image data is not performed in the storage unit 110 but is performed in the storage unit 210 of the storage device 200. Alternatively, not limited to this, the temperature measuring device 100'provides a storage unit 110 as cache information, and the information regarding the latest imaging data or display information is cached in the storage unit 110, and a predetermined period has passed or a predetermined capacity is used. If it exceeds, the past portion may be moved or copied to the storage device 200. By doing so, it is possible to avoid a decrease in responsiveness.

The above is an example of the temperature measurement system according to the second embodiment. According to the temperature measurement system 1'according to the second embodiment, since the data can be centrally managed in the storage device 200, it is possible to easily increase or decrease the number of the temperature measurement devices 100'provided. Therefore, the scalability of the system is improved, and the cost (TCO: Total Cost of Ownership) required for the maintenance of the system can be suppressed.

Further, for example, even when there are a plurality of image pickup devices 170 connected to the temperature measurement device 100, the same measurement target ID is assigned to the same measurement object 10 for the image of each image pickup device 170, and the image pickup path is given. It can be implemented by controlling the image processing unit 122 so that the numbers do not overlap.

Further, for example, in the above-mentioned equipment state confirmation process, the output information generation unit 124 generates a composite image by superimposing and compositing (layer processing) images of a plurality of measured objects in the same process. The composite image may be generated by appropriately performing various operations (for example, logical sum, logical product, exclusive logical sum, logical negation, deviation value calculation, difference calculation, etc.) without limitation.

Further, for example, ideal temperature distribution data derived from the specifications of the measurement object 10 is stored in the storage unit 110 in advance, and the analysis processing unit 123 combines the data obtained by imaging the measurement object 10 with the ideal temperature distribution data. The output information generation unit 124 identifies a part that is significantly different in the difference or ratio, and the output information generation unit 124 generates a screen that highlights the part as an area where an abnormality is detected on the imaging data and outputs it on the user terminal. May be good. Further, the occurrence of an abnormality may be notified by various notification means such as an alarm or an e-mail.

Further, the technical elements of the above-described embodiment may be applied independently, or may be applied separately in a plurality of parts such as a program component and a hardware component.

The present invention has been described above with a focus on embodiments.

1,1'... temperature measurement system, 10 ... measurement object, 50 ... network, 100 ... temperature measurement device, 110 ... storage unit, 111 ... image storage unit, 112 ... -Analysis information storage unit, 120 ... Control unit, 121 ... Camera control unit, 122 ... Image processing unit, 123 ... Analysis processing unit, 124 ... Output information generation unit, 130 ... Input unit, 140 ... output unit, 150 ... camera IF unit, 160 ... communication unit, 170 ... image pickup device, 300 ... analysis instruction device.

Claims (16)

Connected to one or more imaging devices that capture the subject and obtain an image,
An image processing unit that specifies the surface temperature of the subject at a predetermined point of the image, and
An analysis processing unit that sets a set of points having a surface temperature in one or more ranges with respect to the image as one or more regions.
An output information generator that generates screen information that displays the area in a distinguishable manner,
A temperature measuring device characterized by being provided with. The temperature measuring device according to claim 1.
The output information generation unit
In the screen information, a plurality of the images and the regions thereof are displayed in a time series of shooting.
A temperature measuring device characterized by this. The temperature measuring device according to claim 2, further
The plurality of the images are a plurality of images in which the subject is common.
A temperature measuring device characterized by this. The temperature measuring device according to claim 2, further
The subject is a product that has undergone a predetermined process.
The imaging device captures a plurality of the subjects in each of the steps.
The plurality of the images are a plurality of images in which the steps are common.
A temperature measuring device characterized by this. The temperature measuring device according to claim 1.
The image processing unit superimposes a plurality of the images and synthesizes them by a predetermined calculation to generate a composite image.
The analysis processing unit
A set of points having a surface temperature in one or more ranges with respect to the composite image is set as one or more regions.
The output information generation unit
Generates screen information that distinguishably displays the area in the composite image.
A temperature measuring device characterized by this. The temperature measuring device according to claim 5, further
The plurality of the images are a plurality of images in which the subject is common.
A temperature measuring device characterized by this. The temperature measuring device according to claim 5, further
The subject is a product that has undergone a predetermined process.
The imaging device captures a plurality of the subjects in each of the steps.
The plurality of the images are a plurality of images in which the steps are common.
A temperature measuring device characterized by this. Connected to one or more imaging devices that capture the subject and obtain an image,
An image processing unit that specifies the surface temperature of the subject at a predetermined point of the image, and
An output information generation unit that generates screen information for displaying a three-dimensional histogram centered on the coordinate values on the image and the surface temperature at the coordinate values.
A temperature measuring device characterized by being provided with. The temperature measuring device according to claim 8.
The output information generation unit
Generate screen information for displaying the three-dimensional histogram in a time series of shooting a plurality of the images.
A temperature measuring device characterized by this. The temperature measuring device according to claim 9, further
The plurality of the images are a plurality of images in which the subject is common.
A temperature measuring device characterized by this. The temperature measuring device according to claim 9, further
The subject is a product that has undergone a predetermined process.
The imaging device captures a plurality of the subjects in each of the steps.
The plurality of the images are a plurality of images in which the steps are common.
A temperature measuring device characterized by this. The temperature measuring device according to claim 8.
The image processing unit superimposes a plurality of the images and synthesizes them by a predetermined calculation to generate a composite image.
The output information generation unit
Generates screen information for displaying a three-dimensional histogram centered on the coordinate values on the composite image and the surface temperature at the coordinate values.
A temperature measuring device characterized by this. The temperature measuring device according to claim 12, further
The plurality of the images are a plurality of images in which the subject is common.
A temperature measuring device characterized by this. The temperature measuring device according to claim 12, further
The subject is a product that has undergone a predetermined process.
The imaging device captures a plurality of the subjects in each of the steps.
The plurality of the images are a plurality of images in which the steps are common.
A temperature measuring device characterized by this. A temperature measurement program that lets a computer measure temperature
The computer is connected to one or more imaging devices that capture a subject and obtain an image, and includes a control unit.
In the control unit
An image processing unit that specifies the surface temperature of the subject at a predetermined point of the image, and
An analysis processing unit that sets a set of points having a surface temperature in one or more ranges with respect to the image as one or more regions.
An output information generator that generates screen information that displays the area in a distinguishable manner,
A temperature measurement program characterized by executing. A temperature measurement method using a temperature measurement device connected to one or more image pickup devices for photographing a subject and obtaining an image.
The temperature measuring device includes a control unit.
The control unit
An image processing step that identifies the surface temperature of the subject at a predetermined point in the image, and
An analysis process step in which a set of points having a surface temperature in one or more ranges with respect to the image is set as one or more regions.
An output information generation step that generates screen information that displays the area in a distinguishable manner, and
A temperature measurement method characterized by carrying out.