JP2023098883A - Temperature measurement device, temperature measurement program and temperature measurement method - Google Patents

Abstract

To provide a technique which indicates a sign of malfunction by illustrating distribution information of the temperature.SOLUTION: A temperature measurement device comprises: an image processing unit which is connected to one or more imaging devices for obtaining images by imaging a subject and specifies a surface temperature of the subject at a prescribed point of the one or more images; an analysis processing unit which sets the aggregation of points having the surface temperature within one or more ranges to the image as one or more regions; and an output information generation unit which generates screen information displaying the region in a distinguishable manner.SELECTED DRAWING: Figure 1

Description

The present invention relates to a temperature measuring device, a temperature measuring program, and a temperature measuring method.

In Patent Document 1, a two-dimensional luminance image signal input from an optical detection device is converted into two-dimensional array data divided into a plurality of pieces in the width direction and the moving direction of an object to be inspected, and whether the temperature at a predetermined coordinate is less than or equal to a threshold value. A technique for determining whether or not there is a scratch is described.

JP-A-2004-279161

Although the above technique can detect an abnormal portion, that is, a scratch on the test material, it cannot show signs of defects such as the test material.

SUMMARY OF THE INVENTION An object of the present invention is to provide a technique for showing signs of trouble by graphically showing temperature distribution information.

The present application includes a plurality of means for solving at least part of the above problems, and examples thereof are as follows. A temperature measurement device according to an aspect of the present invention is connected to one or more imaging devices that obtain images by photographing a subject, and is an image that specifies the surface temperature of the subject at a predetermined point in one or more of the images. a processing unit; an analysis processing unit that sets a set of points having surface temperatures in one or more ranges in the image as one or more regions; and output information that generates screen information that displays the regions in a distinguishable manner. and a generator.

Further, in the above-described temperature measuring device, the output information generating section may display the plurality of images and the areas thereof in the time series of photographing in the screen information.

Further, in the temperature measuring device described above, the plurality of images may be a plurality of images in which the subject is common.

Further, in the above temperature measuring device, the subject is a product that has undergone a predetermined process, the imaging device captures a plurality of the subject for each of the processes, and the plurality of images is the It may be characterized by being a plurality of images having a common process.

Further, in the above-described temperature measuring device, the image processing section superimposes the plurality of images and synthesizes them by a predetermined operation to generate a composite image, and the analysis processing section performs an analysis on the composite image. Alternatively, a set of points having surface temperatures in a plurality of ranges is set as one or a plurality of regions, and the output information generating unit generates screen information that displays the regions in the composite image in a distinguishable manner. good too.

Further, in the temperature measuring device described above, the plurality of images may be a plurality of images in which the subject is common.

Further, in the above temperature measuring device, the subject is a product that has undergone a predetermined process, the imaging device captures a plurality of the subject for each of the processes, and the plurality of images is the It may be characterized by being a plurality of images having a common process.

Further, a temperature measuring device according to another aspect of the present invention is connected to one or a plurality of imaging devices that obtain an image by photographing a subject, and measures the surface temperature of the subject at a predetermined point in the one or the plurality of images. and an output information generating unit for generating screen information for displaying a three-dimensional histogram whose axes are coordinate values on the image and the surface temperature at the coordinate values. and

Further, in the temperature measurement device described above, the output information generating section may generate screen information for displaying the three-dimensional histogram in time series of photographing of the plurality of images.

Further, in the temperature measuring device described above, the plurality of images may be a plurality of images in which the subject is common.

Further, in the above temperature measuring device, the subject is a product that has undergone a predetermined process, the imaging device captures a plurality of the subject for each of the processes, and the plurality of images is the It may be characterized by being a plurality of images having a common process.

Further, in the above temperature measuring device, the image processing unit generates a composite image by superimposing a plurality of the images and synthesizing them by a predetermined operation, and the output information generating unit generates coordinates on the composite image. It is also possible to generate screen information that displays a three-dimensional histogram whose axis is the value and the surface temperature at the coordinate value.

Further, in the temperature measuring device described above, the plurality of images may be a plurality of images in which the subject is common.

Further, in the above temperature measuring device, the subject is a product that has undergone a predetermined process, the imaging device captures a plurality of the subject for each of the processes, and the plurality of images is the It may be characterized by being a plurality of images having a common process.

Further, a program according to another aspect of the present invention is a temperature measurement program that causes a computer to measure temperature, wherein the computer is connected to and controls one or more imaging devices that obtain images by photographing a subject. an image processing unit for identifying the surface temperature of the subject at predetermined points in one or more of the images; and a set of points having surface temperatures in one or more ranges with respect to the image. as one or a plurality of areas, and an output information generating unit that generates screen information that displays the areas in a distinguishable manner.

Further, a temperature measuring method according to another aspect of the present invention is a temperature measuring method using a temperature measuring device connected to one or a plurality of imaging devices for capturing an image of a subject, wherein the temperature measuring device comprises a control unit, the control unit having an image processing step of identifying the surface temperature of the subject at a predetermined point in one or more of the images; and one or more ranges of surface temperature for the image. The method is characterized by performing an analysis processing step of setting a set of points as one or a plurality of areas, and an output information generating step of generating screen information for displaying the areas in a distinguishable manner.

According to the present invention, it is possible to provide a technique for showing signs of trouble by graphically showing temperature distribution information.

Problems, configurations, and effects other than those described above will be clarified by the following description of the embodiments.

1 is a configuration diagram showing an example of a temperature measurement system according to an embodiment; FIG. It is a figure which shows the data structure example of an image memory|storage part. It is a figure which shows the data structure example of an analysis information storage part. It is a figure which shows the hardware structural example of a temperature measuring device. FIG. 10 is a diagram showing an example of the flow of imaging processing; FIG. 10 is a diagram showing an example of the flow of analysis processing; It is a figure which shows the example of a setting value input screen. FIG. 10 is a diagram showing an example of an analysis information display screen; FIG. 10 is a diagram showing an example of an area superimposed image screen; FIG. 5 is a diagram showing an example of the flow of 3D histogram processing; It is a figure which shows the example of a 3D histogram screen. FIG. 10 is a diagram showing an example of a flow of animation display processing; It is a figure which shows the example of an animation screen. It is a figure which shows the example of the flow of a facility state confirmation process. It is a block diagram which shows the example of the temperature measurement system which concerns on 2nd embodiment.

A temperature measurement system 1 to which an embodiment according to one aspect of the present invention is applied will be described below with reference to the drawings. For the sake of convenience, the following embodiments are divided into a plurality of sections or embodiments when necessary, but unless otherwise specified, they are not independent of each other, and one There is a relationship of part or all of the modification, details, supplementary explanation, etc.

In addition, in the following embodiments, when referring to the number of elements (including the number, numerical value, amount, range, etc.), when it is particularly specified, when it is clearly limited to a specific number in principle, etc. Except, it is not limited to the specific number, and may be more or less than the specific number.

Furthermore, in the following embodiments, the constituent elements (including element steps, etc.) are not necessarily essential, unless otherwise specified or clearly considered essential in principle. Needless to say.

Similarly, in the following embodiments, when referring to the shape, positional relationship, etc. of components, etc., unless otherwise explicitly stated or in principle, it is considered that the shape is substantially the same. It shall include things that are similar or similar to, etc. This also applies to the above numerical values and ranges.

In addition, in all the drawings for explaining the embodiments, the same members are basically given the same reference numerals, and repeated description thereof will be omitted.

FIG. 1 is a configuration diagram showing an example of a temperature measurement system according to an embodiment. The temperature measurement system 1 uses the analysis instruction device 300 by the user, but is not limited to this. It may be used by connecting via software or application software. Alternatively, it may be used by connecting to the temperature measuring device 100 via browser software or application software of the user terminal.

When connecting the user terminal to the analysis instruction device 300 or the temperature measurement device 100, LAN (Local Area Network), WAN (Wide Area Network), the Internet, a mobile phone network, etc., or a communication network combining these are connected via a network 50 . Note that the network 50 may be a VPN (Virtual Private Network) or the like on a wireless communication network such as a mobile phone communication network.

The temperature measuring device 100 is communicably connected to the imaging device 170 and the analysis instruction device 300 by wire or wirelessly. The temperature measurement device 100 is connected to an imaging device 170 via, for example, HDMI (High-Definition Multimedia Interface), USB (Universal Serial Bus), wireless communication in the 2.4 GHz (gigahertz) band or 5 GHz band, and wired communication such as Bluetooth (registered trademark). Alternatively, they are connected by a wireless communication path. The image capturing device 170 captures an image of the measurement object 10 as a subject according to an instruction from the temperature measuring device 100 .

The object to be measured 10 includes a product such as a steel plate that is manufactured by high temperature treatment. Since steel sheets are treated at high temperatures, it is necessary to measure the temperature without contact, and the flow of the transport line including walking beams, transport rolls, conveyors, etc. must be maintained at a constant speed or higher, so it cannot be stopped. . However, the object to be measured 10 is not limited to a steel plate as long as it has such properties. For example, glass, ceramics, resins, frozen foods, etc., may have superiority or inferiority in quality depending on the temperature at the time of manufacture. Furthermore, in the case of efficiently discovering hypothermia patients (for example, triage in the event of a large-scale disaster), the living body may be the object 10 to be measured.

The imaging device 170 is an imaging device capable of measuring the surface temperature of the measurement object 10 in a short time (for example, measuring 8 frames per second) without contact. For example, the imaging device 170 is a thermal camera device that records infrared radiant intensity using various imaging elements.

In the temperature measurement system 1 , the temperature measurement device 100 is communicably connected to the analysis instruction device 300 via the network 50 .

Upon receiving an analysis instruction from the analysis instruction device 300 , the temperature measurement device 100 performs analysis processing according to the instruction, generates output information as a result, and transfers the output information to the analysis instruction device 300 . Further, the temperature measuring device 100 instructs the imaging device 170 to photograph the measurement object 10 at a predetermined timing. For example, the temperature measurement device 100 takes an image of the measurement object 10 when the measurement object 10 flows on a conveyor and reaches a predetermined position. In this photography, if the exposure time is too long, proper photography cannot be performed due to the movement of the measurement object 10 or saturation, and if the exposure time is too short, the amount of light will be insufficient and sufficient contrast and S/N ratio cannot be obtained. . Therefore, it is necessary to control the exposure values such as the shutter speed and the aperture for appropriately photographing the moving object 10, and the depth of field and the photographing distance according to the distance to the object 10 to be measured. This control is performed by the temperature measurement device 100 . However, it is not limited to this, and the imaging device 170 may shoot with predetermined fixed values or automatically calculated values.

The analysis instruction device 300 issues an analysis instruction to the temperature measurement device 100 at a timing instructed by a user or at a predetermined timing, and obtains output information (for example, screen information) from the temperature measurement device 100 .

The analysis instruction device 300 is an information processing device such as a so-called server device or a personal computer, has an input/output device such as a keyboard and a display, and is connectable to the temperature measurement device 100 via the network 50 .

The temperature measurement device 100 includes a storage section 110 , a control section 120 , an input section 130 , an output section 140 , a camera IF (interface) section 150 , a communication section 160 and an imaging device 170 . The storage unit 110 includes an image storage unit 111 and an analysis information storage unit 112 .

FIG. 2 is a diagram showing an example data structure of an image storage unit. The image storage unit 111 includes an image ID 111A, a shooting date and time 111B, image data 111C, a measurement target ID 111D, and an imaging pass number 111E.

The image ID 111A is information for specifying an image obtained as a result of imaging the measurement object 10 by the imaging device 170 . The imaging date and time 111B is information specifying the date and time when the imaging device 170 captured the object 10 . The image data 111C is image data (still image) obtained as a result of imaging the measurement object 10 by the imaging device 170 . The measurement target ID 111D is information that identifies an individual object 10 to be measured. The imaging pass number 111E is information specifying in which process the individual object 10 was photographed.

FIG. 3 is a diagram illustrating an example data structure of an analysis information storage unit. The analysis information storage unit 112 stores an image ID 112A, a temperature zone identifier 112B, a temperature zone (low, high) 112C, a number of detection areas 112D, a detection area ID 112E, a center coordinate 112F, a range 112G, and an area 112H. and are included.

The image ID 112A is information specifying an image obtained as a result of imaging the measurement object 10 by the imaging device 170, and is the same as the image ID of the image storage unit 111. FIG. The temperature zone identifier 112B is information for labeling a predetermined temperature zone. The temperature zone (low, high) 112C is information specifying the temperature zone, ie, the lowest temperature and the highest temperature. The number of detection areas 112D is information specifying the number of areas of the subject that belong to the temperature zone specified by the temperature zone identifier 112B. The detection area ID 112E is information that identifies the area from other areas. The center coordinates 112F, the range 112G, and the area 112H are the coordinates of the center of the area, the information specifying the range of the area from the center coordinates, and the information specifying the area of the area.

The analysis information is configured such that the number of detected regions N (N is a natural number) for one image has a 1:N relationship. That is, 0 or more sets of detection area ID 112E, center coordinates 112F, range 112G, and area 112H are associated with the value of the number of detection areas 112D.

Returning to the description of FIG. The control unit 120 includes a camera control unit 121 , an image processing unit 122 , an analysis processing unit 123 and an output information generation unit 124 . The camera control unit 121 gives the imaging device 170 instructions regarding imaging (for example, angle of view, focus position matching the shooting distance, aperture value, exposure time, data size, capture timing, exposure correction, contrast setting, trim rate, etc.). ) and control data communication.

The image processing unit 122 is a processing unit that generates image data from information obtained by imaging by the camera control unit 121 . Specifically, the image processing unit 122 acquires RAW data of the imaging device from the imaging device 170 , performs development processing, and stores the data in the image storage unit 111 . In addition, the temperature of each coordinate is specified for the developed image data that has already been saved, and various arithmetic processing and the like with other images are performed.

The analysis processing unit 123 sets a set of points having a surface temperature within a predetermined range as an area for the image data.

The output information generation unit 124 generates screen information that displays the areas set by the analysis processing unit 123 in a distinguishable manner. For example, the output information generation unit 124 generates screen information that is superimposed on the image and displayed in a different display color for each area set by the analysis processing unit 123 . However, the present invention is not limited to this. For example, the output information generation unit 124 may generate screen information that is superimposed on an image and displayed with different shades for each region set by the analysis processing unit 123. It is also possible to generate screen information that is superimposed on the image and displayed with different notation of hatching for each area set by 123 . In addition, the output information generation unit 124 may generate screen information that extracts a contour line for each region set by the analysis processing unit 123 and superimposes it on the image for display. In addition, the output information generation unit 124 further generates screen information for displaying a three-dimensional histogram with two-dimensional coordinate values on the image and the surface temperature at the coordinate values as axes. In addition, the output information generation unit 124 further specifies one or more images having a common subject, and a three-dimensional histogram whose axes are the two-dimensional coordinate values on each image and the surface temperature at the coordinate values. Generates screen information that displays the images in order of shooting time.

Furthermore, the output information generation unit 124 corrects the images of the plurality of measurement objects 10 so that the positions and sizes of the measurement objects 10 are common to each of the same steps, and then superimposes them (layer processing) to compose a composite image. , and the above-described various screen information is generated for the synthesized image. Note that the output information generation unit 124 not only generates a composite image by superimposing and synthesizing (layer processing) images of a plurality of objects to be measured for each same process, but also generates a composite image by overlapping and synthesizing images of a plurality of objects to be measured for each same process. After correcting the image so that the position and size of the measurement object 10 are common, various calculations (for example, logical sum, logical product, exclusive logical sum, deviation value calculation, difference calculation, etc.) are performed to generate a composite image. do.

The input unit 130 receives input from the user to the temperature measuring device 100 . For example, the input unit 130 receives various types of input such as typing, touch, and flick input, voice input, and line-of-sight input.

The output unit 140 outputs the temperature measurement device 100 to the user. The information to be output is various kinds of output information such as a screen and a form.

The camera IF unit 150 performs connection management and communication processing with the imaging device 170 via a wired connection using an HDMI cable or the like or a wireless connection such as Bluetooth.

The communication unit 160 communicates with other devices via the network 50 . Packet communication by TCP/IP protocol is adopted for the communication, but it is not limited to this.

FIG. 4 is a diagram showing a hardware configuration example of the temperature measuring device. The temperature measurement device 100 has a hardware configuration realized by a housing of a so-called server device, workstation, personal computer, smartphone, or tablet terminal. The temperature measurement device 100 includes an arithmetic device 101, a main memory device 102, an auxiliary memory device 103, an input device 104, a display device 105, a wired communication device 106, a wireless communication device 107, and a bus connecting each device. 108;

The computing device 101 is, for example, a computing device such as a CPU (Central Processing Unit).

The main memory device 102 is, for example, a memory device such as a RAM (Random Access Memory).

The auxiliary storage device 103 is a non-volatile storage device such as a so-called hard disk drive, SSD (Solid State Drive), flash memory, or the like, which can store digital information.

The input device 104 is a device that accepts one or more inputs from a keyboard, mouse, touch panel, and microphone. The display device 105 is one or more of various output devices such as an organic EL (Electro-Luminescence) display.

The wired communication device 106 is a network interface card (NIC) that communicates with other devices via a network, a board that communicates with other devices via an HDMI cable, or the like.

The wireless communication device 107 is an antenna device that wirelessly communicates with another device via a wireless network, a communication module that communicates with another device by one-to-one wireless communication, or the like.

The camera control unit 121, the image processing unit 122, the analysis processing unit 123, and the output information generation unit 124 of the temperature measurement device 100 described above are implemented by a program that causes the arithmetic device 101 to perform processing. This program is stored in the main memory device 102, the auxiliary memory device 103, or a ROM device (not shown), loaded onto the main memory device 102 for execution, and executed by the arithmetic unit 101. FIG.

Also, the storage unit 110 of the temperature measuring device 100 is realized by the main storage device 102 and the auxiliary storage device 103 . Input unit 130 and output unit 140 are implemented by input device 104 and display device 105, respectively. Camera IF unit 150 is implemented by wired communication device 106 or wireless communication device 107 . Communication unit 160 is implemented by wired communication device 106 or wireless communication device 107 . The hardware configuration example of the temperature measurement device 100 has been described above.

The configuration of the temperature measurement device 100 can also be classified into more components according to the content of processing. Also, one component can be grouped to perform more processing.

Further, each control unit (camera control unit 121, image processing unit 122, analysis processing unit 123, and output information generation unit 124) is constructed by dedicated hardware (ASIC, GPU, etc.) that realizes each function. may be Also, the processing of each control unit may be executed by one piece of hardware, or may be executed by a plurality of pieces of hardware.

Note that the analysis instruction device 300 also basically has the same hardware configuration as the temperature measurement device.

Next, the operation of the temperature measurement system 1 according to this embodiment will be described.

FIG. 5 is a diagram illustrating an example of the flow of imaging processing. The imaging process is started when the temperature measurement device 100 instructs the imaging device 170 to perform imaging periodically or in real time.

First, the temperature measuring device 100 transmits an imaging instruction to the imaging device 170 (step S001). Specifically, the camera control unit 121 of the temperature measuring device 100 issues an imaging instruction to the imaging device 170 via the camera IF unit 150 . The instructions may include instructions for controlling various imaging devices 170 . For example, the imaging instruction includes an angle of view adjustment instruction and a focus adjustment instruction according to the shooting distance as necessary, and includes at least an instruction to determine the imaging timing.

Then, the imaging device 170 takes an image of the measurement object 10 (step S002). The imaging device 170 then transmits the captured image to the temperature measuring device 100 (step S003). Specifically, the captured image is RAW (raw) data output from the image sensor or various general developed image data (BMP, JPEG, PNG, MPEG, AVI, MOV, etc.).

Then, temperature measuring device 100 stores the transmitted captured image (step S004). Specifically, the camera control unit 121 assigns an image ID 111A to the received captured image and stores it in the image storage unit 111 as image data 111C.

Then, the image processing unit 122 associates and stores the shooting date and time 111B, the measurement target ID 111D, and the imaging pass number 111E (step S005). Specifically, the image processing unit 122 acquires information on the date and time, the measurement object ID, and the imaging path from a predetermined process control device (not shown) or the like, and stores the information in the image storage unit 111 .

The above is an example of the imaging processing flow. According to the imaging process, it is possible to cause the imaging device 170 to capture an image of the measurement object 10 according to the instruction timing from the temperature measuring device 100 . In the case of steel plate manufacturing, the steel plate, which is the object 10 to be measured, is transported by a conveyor and is constantly moving. difficult to obtain a clear image. Therefore, the imaging device 170 may transmit the video in real time to the temperature measuring device 100 in a moving image format, and the camera control unit 121 may selectively obtain (snapshot) an appropriate video to capture the video.

FIG. 6 is a diagram illustrating an example of the flow of analysis processing. The analysis process is started when the analysis instruction device 300 instructs the temperature measurement device 100 to perform analysis periodically or in real time.

First, the analysis instruction device 300 receives setting values related to analysis (step S101). Specifically, the analysis instruction device 300 receives a temperature zone identifier or temperature zone designation input and an image ID designating a captured image to be analyzed from the user.

The analysis instruction device 300 then instructs the temperature measurement device 100 to perform analysis (step S102). Specifically, the analysis instruction device 300 transmits the received analysis set values and analysis instruction to the temperature measurement device 100 .

Then, the temperature measuring device 100 reads the captured image of the analysis target (step S103). Specifically, the image processing unit 122 reads out the image data 111C and related information from the image storage unit 111 using the image ID of the captured image to be analyzed included in the analysis setting value as a key.

Then, the temperature measuring device 100 identifies a closed region (identifies an outline and a coloring range) for each temperature zone identifier (step S104). Specifically, the image processing unit 122 identifies the temperature based on the far-infrared intensity at each coordinate of the image, and identifies the temperature zone identified by the received temperature zone identifier or the coordinates belonging to the specified temperature zone. Then, analysis information such as the contour, center coordinates, range, area, etc. of the closed region is calculated according to the set of coordinates.

Then, the temperature measuring device 100 superimposes the closed region of each temperature zone identifier to be displayed (step S105). Specifically, the output information generation unit 124 creates a superimposed image by superimposing a predetermined colored layer on the closed region identified in step S104 for the image to be analyzed. The output information generation unit 124 then transmits screen information including the generated analysis information and the superimposed image to the analysis instruction device 300 .

Then, the analysis instruction device 300 displays the analysis information of the closed region and the region superimposed image (step S106). Specifically, the analysis instruction device 300 displays the screen information transmitted in step S105.

The above is an example of the analysis processing flow. According to the analysis process, the temperature measurement device 100 is caused to analyze the temperature of the measurement object 10 according to the instruction timing from the analysis instruction device 300, and the part (range) belonging to a predetermined temperature zone is visually confirmed. can be done.

The above analysis process is not limited to this example. For example, a plurality of captured images to be analyzed are read, a closed region is specified for each image, a temperature zone display is superimposed, and this is displayed in the horizontal or vertical direction. It is also possible to generate screen information to be arranged in parallel with . Alternatively, for example, a plurality of captured images to be read to be analyzed are specified, a closed region is specified for each image, a display of a temperature zone is superimposed, and screen information is generated so as to be displayed in chronological order such as an animation. (detailed later in the animation display process and its modification). Alternatively, for example, a plurality of captured images to be read to be analyzed are synthesized by predetermined calculation to generate a synthesized image, a closed region is specified in the synthesized image, and a temperature zone display is superimposed. Screen information to be displayed may be generated.

In addition, when a plurality of captured images are to be read out as the analysis target, the captured images may be arbitrary multiple images, or may be multiple images having a common object to be measured 10 (measurement target ID). A plurality of images having a common (number of imaging passes) may be used.

FIG. 7 is a diagram showing an example of a setting value input screen. A setting value input screen 500 is an example of a screen for accepting setting values for analysis processing in step S101 of the analysis processing. The set value input screen 500 includes a temperature zone identifier display area 501, a temperature zone (minimum) input reception area 502, a temperature zone (maximum) input reception area 503, a temperature zone setting/measurement button 504, and a second A temperature zone identifier display area 511, a second temperature zone (minimum) input reception area 512, a second temperature zone (maximum) input reception area 513, a second temperature zone setting/measurement button 514, and a close button. 515 and .

The temperature zone identifier display area 501 and the second temperature zone identifier display area 511 are areas where temperature zone identifiers are displayed. A temperature zone (minimum) input reception area 502 and a second temperature zone (minimum) input reception area 512 receive a specified input of the lower limit value of the temperature zone identified by the temperature zone identifier. A temperature zone (maximum) input reception area 503 and a second temperature zone (maximum) input reception area 513 receive a specified input of the upper limit value of the temperature zone identified by the temperature zone identifier. When the temperature zone setting/measurement button 504 and the second temperature zone setting/measurement button 514 respectively receive the input, the temperature zone for which the lower limit value and the upper limit value of the temperature zone and the second temperature zone are inputted is analyzed. The process starts from step S102 of the process.

Upon receiving an input, the close button 515 sends an instruction to store the analysis set values and analysis results to the analysis processing unit 123 and closes the set value input screen 500 . Upon receiving the instruction to store the analysis result, the analysis processing unit 123 stores the analysis result in the analysis information storage unit 112 .

FIG. 8 is a diagram showing an example of an analysis information display screen. The analysis information display screen 500′ basically has the same screen configuration as the set value input screen 500, but the value passed from the temperature measuring device 100 as the analysis result is displayed in the area where the information of the analysis result is displayed. is displayed on the screen. The analysis information display screen 500 ′ includes a measurement result display area 551 and a second measurement result display area 561 in addition to the components shown in the set value input screen 500 .

The measurement result display area 551 includes an area number display area 552, an area number specification reception area 553, an area display area 554, a center X coordinate display area 555, a center Y coordinate display area 556, and a width display area of the area. 557 and a region height display area 558 are included. Similarly, for the second measurement result display area 561, an area number display area 562, an area number specification reception area 563, an area display area 564, a center X coordinate display area 565, and a center Y coordinate display area 566 are displayed. , and a region width display area 567 and a region height display area 568 .

A region number display area 552 and a region number display area 562 show the analysis result of the number of regions corresponding to the specified temperature zone. The area number designation reception area 553 and the area number designation reception area 563 receive the designation of the area number (detection area ID), and the analysis result of the detection area is displayed in the area display area 554 (564) and the center X coordinate display area 555 ( 565), center Y coordinate display area 556 (566), area width display area 557 (567), and area height display area 558 (568).

An area display area 554 and an area display area 564 display areas corresponding to the area numbers received by the area number designation receiving area 553 and the area number designation receiving area 563, respectively.

A center X coordinate display area 555 and a center X coordinate display area 565 display the center X coordinates of the areas corresponding to the area numbers received by the area number designation reception area 553 and the area number designation reception area 563, respectively.

A center Y coordinate display area 556 and a center Y coordinate display area 566 display the center Y coordinates of the areas corresponding to the area numbers received by the area number designation reception area 553 and the area number designation reception area 563, respectively.

A region width display region 557 and a region width display region 567 display the widths of regions corresponding to the region numbers received by the region number designation reception region 553 and the region number designation reception region 563, respectively.

A region height display region 558 and a region height display region 568 display the heights of regions corresponding to the region numbers received by the region number designation reception region 553 and the region number designation reception region 563, respectively.

FIG. 9 is a diagram showing an example of an area superimposed image screen. An area-superimposed image screen 600 displays an image display area 601 superimposed on an area of the image that belongs to a specified temperature range and is colored in a predetermined manner.

A different display color for each temperature zone identifier is determined according to a predetermined rule and superimposed on the image display area 601 . In this example, the temperature zones with the temperature zone identifier "WARN (minimum 630 degrees Celsius to maximum 780 degrees Celsius)" are "1-01" 611, "1-02" 613, and "1-03" 612. and are displayed in three places. Also, the temperature zone whose temperature zone identifier is "ERR (minimum 500 degrees Celsius to maximum 630 degrees Celsius)" is displayed in two places, "2-01" 621 and "2-02" 622. .

According to the area superimposed image screen 600, since the area of the specified temperature zone can be visually confirmed, it is possible to judge the abnormal temperature of the measurement object 10 and control the heat of the measurement object 10 (for example, a heating device or a cooling device). It becomes possible to easily judge the occurrence of an abnormality.

FIG. 10 is a diagram illustrating an example of the flow of 3D histogram processing. The 3D histogram processing is started when the analysis instruction device 300 instructs the temperature measurement device 100 to analyze periodically or in real time.

First, the analysis instruction device 300 receives setting values related to analysis (step S201). Specifically, the analysis instruction device 300 receives an image ID designating a captured image to be analyzed for the 3D histogram from the user.

The analysis instruction device 300 then instructs the temperature measurement device 100 to create a histogram (step S202). Specifically, the analysis instruction device 300 transmits the received image ID and creation instruction to the temperature measurement device 100 .

Then, the temperature measuring device 100 reads the captured image of the analysis target (step S203). Specifically, the image processing unit 122 reads the image data 111C and related information from the image storage unit 111 using the image ID as a key.

Then, the temperature measuring device 100 calculates the temperature Z of the (X, Y) coordinates for each coordinate (step S204). Specifically, the image processing unit 122 identifies the temperature Z based on the far-infrared intensity at each coordinate of the image.

The temperature measuring device 100 then generates a 3D histogram corresponding to (X, Y, Z) (step S205). Specifically, the output information generation unit 124 plots the (X, Y) coordinates of the image on the X axis and the Y axis, respectively, with the temperature Z specified in step S204 as the Z axis. Screen information including images is created and transmitted to the analysis instruction device 300 .

The analysis instruction device 300 then displays the 3D histogram (step S206). Specifically, the analysis instruction device 300 displays the screen information transmitted in step S205.

The above is an example of the flow of 3D histogram processing. According to the 3D histogram processing, the temperature measurement device 100 is caused to create a 3D histogram of the temperature of the measurement object 10 according to the instruction timing from the analysis instruction device 300, and the relationship between the position of the measurement object and the temperature is visually confirmed. be able to.

Note that the above example of 3D histogram processing is not limited to this, for example, a plurality of captured images to be read out and analyzed are used, the temperature Z is specified for each image, a 3D histogram image is created, and this is horizontally or vertically It is also possible to generate screen information to be arranged in parallel with . Further, for example, a plurality of captured images to be read out and analyzed are used, the temperature Z is specified for each image, a 3D histogram image is created, and screen information is generated to display the images in chronological order such as an animation. may Further, for example, a plurality of captured images to be read to be analyzed are synthesized by predetermined calculation to generate a synthesized image, the temperature Z is specified for the synthesized image, and a 3D histogram image is created and created. Screen information for displaying a 3D histogram image may be generated.

In addition, when a plurality of captured images are to be read out as the analysis target, the captured images may be arbitrary multiple images, or may be multiple images having a common object to be measured 10 (measurement target ID). A plurality of images having a common (number of imaging passes) may be used.

FIG. 11 is a diagram showing an example of a 3D histogram screen. 3D histogram screen 700 includes a 3D histogram display. In this example, the X-axis and Y-axis are the two axes of the bottom surface, and the Z-axis is taken in the height direction, so that the height of the temperature is expressed by the height of the top. Therefore, the temperature distribution can be understood at a glance, and the temperature abnormality of the measurement object 10 can be easily detected.

FIG. 12 is a diagram illustrating an example of the flow of animation display processing. The animation display process is started when the analysis instruction device 300 instructs the temperature measurement device 100 to analyze periodically or in real time.

First, the analysis instruction device 300 receives setting values related to analysis (step S301). Specifically, the analysis instruction device 300 receives a temperature zone identifier or temperature zone designation input from the user and a measurement object ID that designates the measurement object 10 to be displayed in animation.

The analysis instruction device 300 then instructs the temperature measurement device 100 to create an animation (step S302). Specifically, the analysis instruction device 300 transmits to the temperature measurement device 100 the received temperature zone identifier or temperature zone specification input, measurement object ID, and animation creation instruction.

Then, the temperature measuring device 100 reads out all captured images having the designated measurement object ID (step S303). Specifically, the image processing unit 122 reads out the image data 111C and its related information from the image storage unit 111 using the measurement object ID 111D as a key.

Then, the temperature measuring device 100 identifies a closed region for each temperature zone identifier (identifies an outline and a coloring range) for each image (step S304). Specifically, the image processing unit 122 specifies the temperature based on the far-infrared intensity at each coordinate for each image, and determines the temperature zone specified by the received temperature zone identifier or the coordinates belonging to the specified temperature zone. is specified, and analysis information such as the contour, center coordinates, range, area, etc. of the closed region is calculated according to the set of coordinates.

Then, the temperature measuring device 100 superimposes the closed region of each temperature zone identifier to be displayed (step S305). Specifically, the output information generation unit 124 creates a superimposed image by superimposing a layer in which the closed region identified in step S304 is colored in a predetermined manner for each image.

Then, the temperature measurement device 100 unifies the reference position, size (scale), and rotation angle of the measurement target among the images (step S306). Specifically, the output information generation unit 124 identifies the position, size, and amount of rotation of each image so that feature points to be measured included in the image are matched.

Then, the temperature measuring device 100 connects the images on which the closed regions are superimposed in chronological order (step S307). Specifically, the output information generating unit 124 generates an image superimposed sequence (animation) by connecting the images on which the closed regions are superimposed in chronological order, and transmits the superimposed image sequence (animation) to the analysis instruction device 300 .

Then, the analysis instruction device 300 displays an animation of the superimposed image sequence (step S308). Specifically, the analysis instructing device 300 displays the superimposed image sequence transmitted in step S307 as an animation by sequentially switching the display along the time series.

The above is an example of the animation display processing flow. According to the animation display process, the temperature measurement device 100 is caused to create an animation image of the temperature of the measurement object 10 according to the instruction timing from the analysis instruction device 300, and the change in the position and temperature of the measurement object is visually confirmed. be able to. In addition, in step S308 of the animation display processing, the display is not limited to the display for automatically playing back the animation, and the frame-advance, fast-forward, rewind, pause, and display for manually switching still images in chronological order (for example, using the mouse wheel). Fast-forwarding or rewinding may be performed according to the amount of rotation and the angular velocity).

FIG. 13 is a diagram showing an example of an animation screen. The animation screen 800 is a screen that displays changes in the surface temperature of a fixed target in chronological order. On the animation screen 800, a region in which a region belonging to a specified temperature zone is colored in a predetermined manner is superimposed on the region superimposed image 801 and displayed. The animation screen 800 also includes a play/stop input button 802 for controlling the progress of the animation, a fast-forward button 803, a rewind button 804, and a progress bar 805 indicating the degree of progress.

FIG. 14 is a diagram illustrating an example of the flow of equipment status confirmation processing. The equipment state confirmation process is started when the analysis instruction device 300 instructs the temperature measurement device 100 to analyze periodically or in real time.

First, the analysis instruction device 300 receives setting values related to analysis (step S401). Specifically, the analysis instruction device 300 receives a temperature zone identifier or temperature zone designation input from the user, and the number of imaging passes that specify a predetermined process.

The analysis instruction device 300 then instructs the temperature measurement device 100 to create an equipment state image (step S402). Specifically, the analysis instruction device 300 transmits to the temperature measurement device 100 the received temperature zone identifier or temperature zone designation input, the number of imaging passes, and an installation state image creation instruction.

Then, the temperature measuring device 100 reads out all captured images having the specified imaging path (step S403). Specifically, the image processing unit 122 reads out the image data 111C and related information from the image storage unit 111 using the imaging pass number 111E as a key.

Then, the temperature measuring device 100 divides the pixel values of the images by the number of images, and adds between the images (images of different measurement targets) to obtain a composite image (step S404). That is, the image processing unit 122 obtains a composite image by performing addition between corresponding pixels of different objects 10 so that the pixel values of the images are not saturated.

Then, the temperature measuring device 100 identifies a closed region (identifies an outline and a coloring range) for each temperature identifier in the composite image (step S405). Specifically, the image processing unit 122 identifies the temperature of the composite image obtained in step S404 based on the pixel values at each coordinate, and determines the temperature zone specified by the received temperature zone identifier or the specified temperature. Coordinates belonging to the belt are specified, and analysis information such as the outline, center coordinates, range, area, etc. of the closed region is calculated according to the set of coordinates.

Then, the temperature measuring device 100 superimposes the closed region of each temperature zone identifier to be displayed (step S406). Specifically, the output information generation unit 124 creates a superimposed image by superimposing a layer in which the closed region identified in step S405 is given a predetermined color on the synthesized image. The output information generation unit 124 then transmits screen information including the generated analysis information and the superimposed image to the analysis instruction device 300 .

Then, the analysis instruction device 300 displays the analysis information of the closed region and the region superimposed image (step S407). Specifically, the analysis instructing device 300 displays the screen information transmitted in step S406.

The above is an example of the flow of the equipment status confirmation process. According to the facility state confirmation process, the temperature measurement device 100 is caused to analyze the temperature of different objects 10 in the same process in accordance with the timing of an instruction from the analysis instruction device 300, and the portion (range) belonging to a predetermined temperature zone is detected. It can be confirmed visually. Therefore, regardless of the individual difference of the measurement object 10 , it is possible to easily detect malfunctions and deterioration of equipment used in processes common to the measurement object 10 at an early stage or in advance.

As in the above embodiment, according to the temperature measurement system 1, it is possible to graphically display temperature distribution information and indicate signs of defects in products and equipment used for production.

The invention is not restricted to the embodiments described above. Various modifications of the above embodiment are possible within the scope of the technical idea of the present invention. For example, in the above embodiment, the temperature measuring device 100 stores the image information in its own storage unit, but the present invention is not limited to this. For example, it may be stored in a storage device communicably connected via the network 50 . In this case, image information from a plurality of temperature measuring devices 100 can be centrally managed. Therefore, it can be easily realized even in a large-scale production site.

FIG. 15 is a configuration diagram showing an example of a temperature measurement system according to the second embodiment. In the temperature measurement system 1' according to the second embodiment, the storage device 200 is connected to the temperature measurement device 100' via the network 50 so as to be communicable. The storage device 200 is different from the first embodiment in that it receives and stores images from the temperature measurement device 100' and retrieves images in response to requests from the temperature measurement device 100'. The storage device 200 includes a storage unit 210 and a communication unit 220. The storage unit 210 stores an image storage unit 211 and an analysis information storage unit 212. FIG. The image storage unit 211 and the analysis information storage unit 212 have data structures similar to those of the image storage unit 111 and the analysis information storage unit 112 of the temperature measuring device 100 according to the first embodiment.

Also, the image processing unit 122' and the analysis processing unit 123' of the temperature measurement device 100' are basically the same as the image processing unit 122 and the analysis processing unit 123 of the temperature measurement device 100 according to the first embodiment. However, there is a difference in that the image data is not accessed from the storage unit 110 but from the storage unit 210 of the storage device 200 . Alternatively, without being limited to this, the temperature measuring device 100′ is provided with a storage unit 110 as cache information, and information related to the most recent imaging data or display information is cached in the storage unit 110. If it exceeds, the past data may be moved or copied to the storage device 200 . By doing so, a decrease in responsiveness can be avoided.

The above is the example of the temperature measurement system according to the second embodiment. According to the temperature measurement system 1' according to the second embodiment, since data can be collected and managed in the storage device 200, it is possible to easily increase or decrease the number of multiple temperature measurement devices 100'. Therefore, the scalability of the system is improved, and the cost of maintenance and management of the system (TCO: Total Cost of Ownership) can be suppressed.

Further, for example, even if there are a plurality of imaging devices 170 connected to the temperature measuring device 100, the same measurement object ID is given to the same measurement object 10 for the image of each imaging device 170, and the imaging path The image processing unit 122 controls so that the numbers do not overlap, so that it can be implemented.

Further, for example, in the above equipment state confirmation process, the output information generation unit 124 generates a composite image by superimposing and synthesizing (layer processing) images of a plurality of objects to be measured for each of the same steps. Without being limited thereto, a composite image may be generated by appropriately performing various operations (for example, logical sum, logical product, exclusive logical sum, logical negation, deviation value calculation, difference calculation, etc.).

Also, for example, ideal temperature distribution data derived from the specifications of the measurement object 10 is stored in the storage unit 110 in advance, and the analysis processing unit 123 compares the image data of the measurement object 10 and the ideal temperature distribution data. A site where the difference or the ratio deviates significantly is specified, and the output information generation unit 124 generates a screen highlighting the site as an area in which an abnormality is detected on the imaging data and outputs it on the user terminal. good too. Furthermore, the occurrence of an abnormality may be notified by various notification means such as an alarm or e-mail.

Also, the technical elements of the above-described embodiments may be applied singly, or may be applied after being divided into a plurality of parts such as program parts and hardware parts.

The present invention has been described above with a focus on the embodiments.

Reference Signs List 1, 1' temperature measurement system 10 object to be measured 50 network 100 temperature measurement device 110 storage unit 111 image storage unit 112 Analysis information storage unit 120 Control unit 121 Camera control unit 122 Image processing unit 123 Analysis processing unit 124 Output information generation unit 130 Input unit 140 Output unit 150 Camera IF unit 160 Communication unit 170 Imaging device 300 Analysis instruction device.

Claims (16)

connected to one or more imaging devices that capture an object and obtain an image;
an image processing unit that identifies the surface temperature of the subject at a predetermined point in one or more of the images;
an analysis processing unit that sets a set of points having surface temperatures in one or more ranges for the image as one or more regions;
an output information generating unit that generates screen information that displays the areas in a distinguishable manner;
A temperature measuring device comprising: The temperature measurement device according to claim 1,
The output information generation unit is
In the screen information, displaying the plurality of images and the regions thereof in chronological order of shooting;
A temperature measuring device characterized by: The temperature measurement device according to claim 2, further comprising:
wherein the plurality of images are a plurality of images in which the subject is common;
A temperature measuring device characterized by: The temperature measurement device according to claim 2, further comprising:
The subject is a product that undergoes a predetermined process,
The imaging device photographs a plurality of the subjects for each of the steps,
wherein the plurality of images are a plurality of images in which the steps are common;
A temperature measuring device characterized by: The temperature measurement device according to claim 1,
The image processing unit generates a composite image by superimposing a plurality of the images and synthesizing them by a predetermined operation,
The analysis processing unit
setting a set of points having surface temperatures in one or more ranges as one or more regions for the composite image;
The output information generation unit is
generating screen information that distinguishably displays the region in the synthesized image;
A temperature measuring device characterized by: The temperature measurement device according to claim 5, further comprising:
wherein the plurality of images are a plurality of images in which the subject is common;
A temperature measuring device characterized by: The temperature measurement device according to claim 5, further comprising:
The subject is a product that undergoes a predetermined process,
The imaging device photographs a plurality of the subjects for each of the steps,
wherein the plurality of images are a plurality of images in which the steps are common;
A temperature measuring device characterized by: connected to one or more imaging devices that capture an object and obtain an image;
an image processing unit that identifies the surface temperature of the subject at a predetermined point in one or more of the images;
an output information generating unit that generates screen information for displaying a three-dimensional histogram whose axes are the coordinate values on the image and the surface temperature at the coordinate values;
A temperature measuring device comprising: The temperature measurement device according to claim 8,
The output information generation unit is
generating screen information for displaying the three-dimensional histogram in time series of capturing of the plurality of images;
A temperature measuring device characterized by: The temperature measurement device according to claim 9, further comprising:
wherein the plurality of images are a plurality of images in which the subject is common;
A temperature measuring device characterized by: The temperature measurement device according to claim 9, further comprising:
The subject is a product that undergoes a predetermined process,
The imaging device photographs a plurality of the subjects for each of the steps,
wherein the plurality of images are a plurality of images in which the steps are common;
A temperature measuring device characterized by: The temperature measurement device according to claim 8,
The image processing unit generates a composite image by superimposing a plurality of the images and synthesizing them by a predetermined operation,
The output information generation unit is
Generating screen information displaying a three-dimensional histogram whose axes are the coordinate values on the composite image and the surface temperature at the coordinate values;
A temperature measuring device characterized by: The temperature measurement device according to claim 12, further comprising:
wherein the plurality of images are a plurality of images in which the subject is common;
A temperature measuring device characterized by: The temperature measurement device according to claim 12, further comprising:
The subject is a product that undergoes a predetermined process,
The imaging device photographs a plurality of the subjects for each of the steps,
wherein the plurality of images are a plurality of images in which the steps are common;
A temperature measuring device characterized by: A temperature measurement program for causing a computer to measure temperature,
The computer is connected to one or more imaging devices that obtain images by photographing a subject, and has a control unit,
to the control unit,
an image processing unit that identifies the surface temperature of the subject at a predetermined point in one or more of the images;
an analysis processing unit that sets a set of points having surface temperatures in one or more ranges for the image as one or more areas;
an output information generating unit that generates screen information that displays the areas in a distinguishable manner;
A temperature measurement program characterized by executing A temperature measuring method using a temperature measuring device connected to one or more imaging devices for capturing an image of a subject,
The temperature measurement device includes a control unit,
The control unit
an image processing step of identifying the surface temperature of the subject at a given point in one or more of the images;
an analysis processing step of setting a set of points having surface temperatures in one or more ranges for the image as one or more regions;
an output information generating step of generating screen information that displays the areas in a distinguishable manner;
A temperature measurement method characterized by carrying out.

Images