TWI284863B - Image recognition system for smoke and temperature distribution - Google Patents

Abstract

An image recognition system for smoke and temperature distribution. The image recognition system has an image processing device, a thermal image capturing device, a visible image capturing device and an alarm device. The thermal image capturing device captures a thermal image signal and the visible image capturing device captures a visible image signal for sending to the image processing device. The image processing device performs image process on the thermal image signal and the visible image signal to obtain image data and temperature data, and performs image recognition on the image data to obtain a smoke recognition data. When the smoke recognition data and the temperature data correspond to a predetermined condition, the image processing device sends a signal to the alarm device for sending out an alarm signal.

Description

!284863 V Description of invention (1) Description of the invention: Others;: m: ? Smoke and temperature image recognition system, and image recognition system. One of the main products when the fire alarm or smoke detection device is exposed to smoke and temperature. When the smoke rises or the fire occurs, so s %, strain time, and indeed control the actual situation on the spot? ί ί * 警 警 警 警 警 警 警 警 警 警 警 警 警 警 警Use smoke ί particles to choose? In the fire alarm or smoke detector, most of the airborne ties are connected to the physical characteristics derived from '曰σ, and the photoelectric type or the following smoke detectors in ν 7 are used. These two types of smoke detectors each have their own advantages and disadvantages, which are explained separately under u. The I-f-type smoke detector generally has an illuminator and a light receiver. When used, the sub-lighter emits a light source to the detection space. If there is soot particles in the air, the light is scattered, resulting in scattering. The light receptor received by the light receiver changes to detect the occurrence of smoke. The photoelectric type smoke detector uses light as a detection medium, and its reflection time is short, and once the smoke is generated, it will react; however, due to the limitation of the relative position setting of the illuminator and the light receiver, the detection range is relatively limited, if Not applicable when the detection space is large. As for the air sampling type smoke detector, the air is sampled by an air sampling tube distributed in the detection space. However, the air sampling type smoke detector must wait until the smoke or heat is distributed to the air sampling tube to get the detection result. The fire is judged to be a matter of seconds. During the time of the smoke distribution, the impact may be enough to make up for it. Disaster. Therefore, if it can integrate traditional photoelectric detectors and air sampling type smoke detectors

0718-8558TW(NF); CALVIN.ptd Page 5 1284863 V. INSTRUCTIONS (2) The advantages of the device, the substitution of the formula, for example, can be easily limited by space. To make visual judgments, the judgments are different. SUMMARY OF THE INVENTION: There is a clock in this image recognition system, like the image to be monitored. The function of image recognition is the auxiliary function rate for visual judgment. The direct feeling of the person after the occurrence of smoke in the space is detected by the physical side in the visual way of monitoring by the camera, and the smoke generated before the fire is reacted, and the visual type detecting device thus installed needs By people breaking 'not only increases labor costs, but because each person's vision' is easy to make a difference, and may thus cause misjudgment or misuse. The purpose of the invention is to propose a smoke and temperature shadow removal using a conventional visual type smoke detector device to capture the camera In addition to the smoke detection, the image processing and recognition can be processed by image processing and energy to replace the traditional 'temperature detection by thermal image judgment to reduce false positives or errors. Alarm occurrence, improve identification

A / the present invention does not disclose a smoke and temperature image recognition system. In the present invention, the 'smoke and temperature image recognition system includes an image processing identification device, a thermal image capturing device, a visible light image capturing device, and an alarm processing device. The thermal image capturing device can use a common infrared thermal image to capture a thermal image signal from a thermal detection area, and the visible light image can be set by using a general visible light camera to transmit a visible light image to a visible light detection area. To the image processing identification device. The image processing identification device has an image processing module, an image recognition module and a determination group, wherein the image processing module receives the thermal image signal and the visible light image

〇718-8558TW(NF); CALViN.ptd

Page 6 1284863 V. Invention description (3) Signal, and image processing to generate image signal to determine a temperature data. & injury complex number ~ like bedding, and according to thermal image recognition, production = fog mode = image The data is combined with the knowledge data and the temperature data to judge. # According to the smoke identification data, it is combined with a specific condition and temperature. When 盩 卢 搜 搜 壮 从 从 从 彳 彳 彳 彳 彳 彳 彳 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报 警报Identify 4 devices, where image 撷# π ^ fetch - thermal image signal as shadow = 匕; =: see the light shirt like a building device, take a visible light shadow /, J number, image processing identification device Image processing mode, :::=J image=, and image processing to generate complex image data, and the root image signal generates temperature data; the image recognition module receives 3f image recognition, generates smoke identification data; ^ w into the material for judgment, (if there is temperature data, the force == smoke = capital; data " and temperature data) is combined with a specific condition;) heart smoke =, number. When the alarm processing device receives the warning signal In the case of the smoke and temperature image recognition system of the present invention, the image processing method can generate image data by using the thermal image letter i and the visible light image, and the ^ ^ = method. Characteristic database, storing complex smoke characteristics The module is used to compare the image data with the smoke characteristic data.

0718-8558TW(NF);CALVIN.ptd Page 7 1284863 V. INSTRUCTIONS (4) Image recognition. In addition, in the present invention, the thermal image capture is used to adjust the thermal detection area or direction, and the first detection device has a second adjustment device, and the light and visible image is manipulated. The first adjustment device and the second adjustment 襞: see the light detection area $ square mechanism. At this time, the image processing and recognizing device can make a module, and control the first adjusting device and the first-integrated region and the visible light detecting region. Adjusting the device and adjusting the heat detection: 'This t: more includes - the remote connection device, the remote connection J 2: processing the identification device i, and the image processing identification device can receive the thermal image and the visible light image signal, For remote monitoring, the first adjustment device and the second adjustment device may be controlled to adjust the thermal detection area and the visible light detection area by means of J: controlling the image capture control module. In addition, in the present invention, the alarm processing device may be an audible alarm, an email transmitting device, or a short message transmitting device. When the alarm processing device receives the warning signal, the audible alarm can emit an alarm tone; the e-mail device can send an alarm e-mail; and the short message transmitting device can send the alarm mobile phone message. This way, you can alert you in a variety of different ways, including voice, email newsletters, and more. The above and other objects, features, and advantages of the present invention will become more apparent from the aspects of the appended claims appended claims Smoke and Temperature Shadows of an Embodiment of the Invention Page 8 〇 718-8558TlV (NF); CALVIN.ptd 1284863 V. Invention Description (5) Image recognition system. The smoke and temperature image recognition system of the present embodiment has an image processing and identification device 10, a thermal image capturing device 20, a visible/image capturing device 30, and an alarm processing device 50. Hereinafter, a semiconductor factory is used as an application example of the smoke and temperature image recognition system of the present invention, and each component will be described. The smoke and temperature image recognition system of the present invention is improved in accordance with a conventional visual type smoke detecting device. In this embodiment, the thermal image capturing device can adopt a common infrared camera, and its function is to extract a thermal image nickname, such as an infrared image, to a thermal processing image, and send it to the image processing identification device 10; The visible light image capturing device 30 can adopt a common visible light camera, such as a charge coupled component (CCD) or other image capturing device, and the function is a visible light detecting region (which can be the same as the thermal detecting region f). The same detection area can also detect different adjacent areas to capture a visible light image signal and send it to the image processing identification device 1 . In addition, the thermal image capturing device 20 can have a first adjusting device 21 for heat-recovering the detection area, and the visible light image capturing device 3 can have an adjusting device 310 for adjusting the visible light detecting region. The first 2 eccentric 1 以及 以及 and the second adjusting device 31G can use an adjustment mechanism such as a linear motor, so that the thermal image capturing t 2G and the visible light image capturing device 3Q can perform an adjustment operation such as moving or graining, and the heat is made. Detect area fish to cover all areas of semiconductor low-cost housing. = The same can be used to simultaneously use the thermal image clothing π and 』 see the yoke image capturing device 30 to improve the identification rate of the smoke and temperature image recognition system of the present invention, but the present invention can also

Mm iH 〇718-8558TW(NF);CALVIN.ptd 1284863

The identification of smoke or temperature can still be performed using one of the thermal image capture device 2 and the visible light image capture device 3'. Next, the image processing and recognizing device 1 will be described. The image processing device of the present invention can be arranged in a computer host, a server or other suitable processor, or in a form of a control chip. In this embodiment, the image processing and recognition device 1 has an image processing module, an image recognition module 120, a determination module 1 3, and an image capture control module 1 4 . The functions of each module are described below. The image processing module 1 10 is configured to receive the thermal image signal and the visible light image signal captured by the thermal image capturing device 2 and the visible light image capturing device 30, and perform image processing on the thermal image signal and the visible light image signal. And generate multiple image data. At the same time, the image processing module 决定 can also determine a temperature data according to the received thermal image signal. The detailed operation of image processing will be detailed later. The image recognition module 120 receives the image data obtained by the image processing by the image processing module 11 and performs image recognition to generate a smoke identification data. In addition, the image recognition module 12 has a smoke pattern feature database 125 for storing a plurality of smoke feature data, such as pre-captured and stored smoke patterns, so that the image recognition module can compare the image data with the smoke. Image recognition by means of feature data The detailed operation of image recognition will also be detailed later. The judging module 130 judges according to the smoke identification data of the image recognition module 以及2〇 and the temperature data determined by the image processing module 11 〇 according to the thermal image signal. “When the smoke identification data and the temperature data are combined ""

0718-8558TW(NF);CALVIN.ptd Page 10 1284863

When the device sends an early warning signal to the alarm processing device 50°, the image capturing control module 140 is used to control the first adjusting device 210 of the thermal image capturing device 20 and The second adjustment device 310 of the visible light image capturing device 3 is configured to adjust the range of the thermal detection region and the visible light detection region. The alarm processing device 50 is connected to the image processing and recognizing device, and its function is to send an alarm to warn that a fire may occur when receiving the warning signal. In this embodiment, in order to enable the alarm processing device 5 to simultaneously issue alarms in various different manners such as voice, email or mobile phone newsletter, the alarm processing device 50 includes an audible alarm (for example, a voice system or a voice system). Etc., an e-mail sending device (such as a computer or other Internet-enabled device) and a short message transmitting device (such as a mobile phone 8 or a network messaging server). When the alarm processing device 5 receives the warning signal, the port 8 60 sends an alarm noise or a warning voice to notify the field personnel near the semiconductor factory; and the computer 7 can send an alarm email to notify the semiconductor factory not to be present. Nearby, but on the computer network; mobile phone 80 also sent it} | report mobile phone newsletter, inform the outside and can not access the Internet here must explain, the alarm processing device 5 in this embodiment 〇 packaged audible alarm The device, the e-mail sending device, and the short message sending device can be disposed on the same computer host, and the device can be controlled by the --alarm device, and the present invention does not limit the alarm portion. Smoke and temperature image recognition

0718-8558T1V(NF); CALVIN.ptd Page 11 1284863 V. INSTRUCTIONS The system can determine different alarm handling devices depending on the application site and needs. In addition, in the smoke and temperature image recognition system of the present invention, a remote control device, such as a computer 90, can be connected to the image processing and recognizing device 10 through a remote connection such as the Internet to perform remote monitoring. . For example, if the alarm processing device 50 issues an alarm, the person in the vicinity of the conductor factory can use the computer 9 to remotely connect to the computer host where the image processing identification device 10 is located, and receive by the image processing identification device. The thermal image signal and the visible light image signal are used for remote monitoring to understand the situation of the site to determine the contingency measures. Meanwhile, the user can remotely control the image capturing control module 14 by the computer 90 to control The adjusting mechanism of the first adjusting device 2 10 and the linear motor of the second adjusting device 3 adjusts the heat detecting area and the visible light detecting area to grasp the actual situation of the semiconductor factory site. Please refer to Figure 2 below for the operation of the image processing and recognition device, especially the operation of the image processing and image recognition sections. When the smoke and temperature image recognition system of the present invention is applied to a semiconductor factory, the image capturing and recognizing device 10 is continuously taken up in the debt measurement area in the factory. Material, image processing module, / ^ a # thermal image signal and a visible light image signal (step si 〇 趋 】 ΐ = = 信号 image and visible light image signal for image processing > - one, data (step S2 〇) At the same time, according to the thermal image signal, the data of the dish (step S30). In the current month, the thermal image signal of step s 20 and the visible light image letter

0718-8558TW(NF);CALVIN.ptd Page 12 1284863 V. INSTRUCTIONS (9) -- The number can be processed by color frequency adjustment. For example, a general visible light image signal is composed of RGB three colors, and its display range may be R = 0, G = 〇, B = 0 (ie black) sR = 255, G = 255, B = 255 ( That is white). Due to the large variety of devices in the semiconductor factory, if the original visible light image signal is used for image recognition, it may not be easily recognized due to the mixture of smoke color and background color. However, in general, when the material of a semiconductor device generates smoke due to high temperature, since the material thereof is known, the color range of the smoke can be estimated in advance by the component in the smoke. At this time, the action of the color frequency adjustment is performed on the visible light image signal. _ Swatch 9 2 is changed to another set of different swatches' to make the color of the visible light image 唬 较 easier to highlight. Image data of such a pattern. The smoke of Wang Yuexi, I J. It is possible that a thermal image signal (such as an infrared image) may have a large temperature range corresponding to the RGB image of the color. At this time, the image may not be easily recognized. However, in the case of a semiconductor factory, if the measures are taken, such as the general control at 23 °c; this rise is not reluctant: the early factors of the disaster produce smoke, and the temperature is 2 , like the RGB color frequency adjustment, the heart is like a description of the visible light filter, so that the temperature of the smoke temperature & qm 1), the old scene temperature over ~ 3C picture shows that; Highlight the color. For example, the temperature data of the 3A is 91.6t, which is displayed by the thermal image signal '

*Items in 23 C, of which Figures 3A and 3B

1284863

The image shows the image without color-frequency adjustment, while the third c-picture is the image adjusted by color-frequency. This produces an image of the visible smoke pattern. In addition, the thermal image signal may also be displayed in grayscale mode. The grayscale color values of the grayscale image range from 0 (ie, all black) to 255 (that is, all white), and the corresponding temperature range is also large. At this time, the gray-scale color frequency can also be adjusted, for example, the example shown in the 3D to 3F figure, so that the temperature below 23t of the room temperature is displayed in the same color, so that the image processing of the visible smoke pattern can also be produced. After the image processing is performed on the module 11 , the image recognition module 120 can receive the image data and perform image recognition. The method of knowledge is to select the same-color-frequency region, and use the edge method to draw the image boundary curve of the same ^, as shown in Figure 3B, Figure 3C and Figure 3D. In this way, the image data and the smoke feature data stored in the smoke graphic feature database 125 (ie, the smoke pattern pre-captured and stored) are compared to perform image recognition, and a smoke identification data is generated (step S40). . In step S40, in order to speed up the comparison between the image data and the smoke feature data (ie, the smoke pattern captured and stored in advance), the recognition rate can be improved by using various common image recognition rules. The data is divided into a plurality of series to obtain the feature value of each region, for example, the comparison of the feature values is compared with the smoke pattern directly storing the image data and the pre-fetching f, which can greatly increase the rate. Then, the determining module 130 can detect the smoke according to the image recognition module 12

1284863

Identification data Γ 2; » *2/ S50) + The temperature data of the shirt image processing module 110 is judged (step (if the step, the fog identification data and the temperature data are combined in a specific condition invitation = 60), it means that the fire may be Coming soon, send a pre-second b to the alarm processing device 5〇 (step s7〇) to send back to the step-by-step, waiting for the next-group image signal. Reporting otherwise (4) Invented smoke and temperature image recognition system, image processing The η device 10 can periodically receive the thermal image signal and the visible light image signal, and the diffusion and transfer of the smog are directional and fixed. Therefore, the specific condition in i ^ = S SjO can be set, for example, in consecutive numbers. In the cycle, when the image recognition module performs image recognition, the image data is stored in the smoke feature data stored in the smoke pattern feature database 125, and the temperature data of the image processing module 11 is higher than the normal room temperature. At this time, the judging module 1 30 sends an early warning signal according to the number of periodic smoke identification data and the temperature data, so that the identification rate can be improved, and the false positive or false alarm can be reduced. The probability of reporting. As for the judgment period of the image processing and identification device, the smoke characteristic data and the judgment criterion of the temperature data, etc., it can be determined by the application of the smoke and temperature image recognition system of the present invention. The smoke and temperature of the present invention The image recognition system performs image processing and image recognition through image processing and image recognition functions to replace traditional human visual judgments, and can provide temperature detection auxiliary functions by temperature judgment of thermal images to reduce misjudgment or The occurrence of false alarms increases the recognition rate. In addition, multiple alarm functions of the alarm processing device can be used to quickly and effectively issue alarms, and the fires in the smoke can be disposed of in advance, thus greatly reducing the risk of fire, effectively Improve security.

Γ Λ yi yi yi yi 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 284 And the scope of the invention may be modified and modified as such, and the scope of the invention is defined by the scope of the appended claims.

0718-8558TW(NF); CALVIN.ptd Page 16 1284863 BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a schematic diagram of a smoke and temperature image recognition system in accordance with an embodiment of the present invention. Fig. 2 is a flow chart showing the operation of the image processing and recognizing device 10 of an embodiment of the present invention. 3A through 3F are schematic views of embodiments of the smoke and temperature image recognition system of the present invention for image processing and image recognition of smoke. Symbol Description • 10~ Image Processing Identification Device; 110 - '-Image Processing Module; 120 - Image Recognition Module; 125 - , Smoke Graphic Feature Library 130 - ^ Judgment Module; 140 - ^ Image Capture Control Module; 20~ thermal image capture device; 2 1 0~ first adjustment device; 30~ visible light image capture device 310 - ^ second adjustment device; 5 0~ alarm processing device; 60~ 嗦丨J mouth eight; 70~ computer; 8 0~ phone; 9 0~ remote control computer.

0718-8558TW(NF);CALVIN.ptd Page 17

Claims (1)

1284863 The smoke and temperature identification device determines the visible light shadow of the module and determines the mode according to the received image. When the smoke image captures the image of the test area, the image signal, the thermal image information And the group identifies the alarm signal according to the fog; and connects to take a video image of the thermal image recognition system and performs a number decision to perform the shadow smoke discrimination and the image signal, and apply for a patent range 1 · an image recognition module and - a signal and an image data, the identification module is connected to the identification data; when the condition is determined, a pre-heat image is sent to a thermal detection device; comprising: a processing module, an image recognition module receiving one The thermal image processing generates a plurality of temperature data; the image is imaged to generate a smoke identification data, and the temperature data is combined with a special image processing identification device, and sent to the image processing to identify a visible light image. For the alarm processing device to the image, such as the application system, wherein the optical image signal material. 3) a system for storing a plurality of smoke-visible light identification device, receiving the image of the pre-clearing patent image, performing a color frequency picking device, and connecting the image processing identification detecting area to the visible light image signal, And the 'connected to the image processing identification device, when the alarm signal is sent an alarm. The smoke and temperature image recognition module described in item 1 of the stomach circumference processes the thermal image signal and the image of the adjustable image to generate the smoke and temperature image described in item 1 of the patent application. The image recognition module has a smoke pattern feature database and fog feature data, so that the image recognition module compares 0718-8558TW(NF);CALVIN.ptd Page 18 1284863 VI. Patent application scope Image and other smoke characteristics are used for image recognition. 4. The smoke and temperature image recognition system of claim 1, further comprising a remote control device, the remote end being connected to the image processing identification device, and the image processing identification device receiving the thermal image signal and The visible light image signal. 5. The smoke and temperature image recognition system of claim 1, wherein: the thermal image capture device has a first adjustment device for adjusting the thermal detection area; the visible light image capture device has A second adjusting device is configured to adjust the visible light detecting area. 6. The smoke and temperature image recognition system according to claim 5, wherein the image processing and recognizing device further comprises an image capturing control module, and the first adjusting device and the second adjusting device are controlled to adjust the The Russian area and the visible light detection area. 7. The smoke and temperature image identification system described in item 6 of the patent application scope is further id: the device is connected to the image processing and arranging device and the second adjustment device; the control module controls the first Aligning the light detecting area with the image; aligning the heat detecting area with the identifiable number and the visible light image signal. The identification device receives the thermal image signal. 8. The fifth system of claim 5, wherein the first adjustment device, the smoke and the temperature image are recognized. M and the second adjustment device are linear horses 0718-8558TW(NF);CALVIN.ptd Λ Λ Γι 1284863 -------------------- VI. Application for Patent Scope 9. As stated in the scope of application for patents The smoke and temperature image recognition system, wherein the alarm processing device comprises: an audible alarm, when the alarm processing device receives the warning signal, the audible alarm emits an alarm sound; an email transmitting device, when the alarm is processed When the device receives the early warning signal, the email sending device sends an alert email; and a short message transmitting device, when the alert processing device receives the alert signal, the short message transmitting device sends an alert mobile phone message. I 〇 · The smoke and temperature image recognition system of claim 1, wherein the thermal image capture device is an infrared thermal imager. II. The smoke and temperature image recognition system of claim 2, wherein the visible light image capturing device is a visible light camera. The image processing and recognition device has an image processing module, an image recognition module and a determination module, wherein the image processing module receives an image signal and performs The image processing module generates the plurality of image data; the image recognition module receives the image data and performs image recognition to generate a smoke identification data; the determining module determines the smoke identification data according to the smoke identification data, and the smoke identification data is combined with a specific When the condition is sent, an early warning signal is sent; an image capturing device is connected to the image processing and identifying device for capturing the image signal to a detection area and sending the image signal to the image processing identification device; and the alarm processing device And connected to the image processing and recognizing device, and sending an alarm when the alarm processing device receives the warning signal. 〇718-8558TW(NF);CALVIN.ptd Page 20 1284863 13. The smoke and temperature image as described in claim 12, wherein the image processing module performs color-tone image processing on the image signal to obtain the image data. 1 4 · The smoke and temperature image recognition system as described in item 2 of the scope of the patent application, wherein the image recognition module has a smoke pattern characteristic data=storing a plurality of smoke characteristic data, so that the image recognition module is compared Image recognition is performed on the image data and the smoke feature data. $1, 1 5 · The smoke and temperature image recognition system of claim 1 wherein the image capture device comprises a thermal image capture device for taking a thermal image signal as the image signal. And the image processing module generates a temperature data according to the thermal image signal, and the determining module is based on the smoke identification data. The temperature data is judged, and the warning signal is sent to the alarm processing device when the smoke identification data and the temperature data are combined under a specific condition. The smoke and temperature image recognition system of claim 12, wherein the image capturing device comprises a visible light image capturing device </ RTI> operating a visible light image signal as the image signal. The smoke and temperature image recognition system of claim 12, wherein the image capture device has an adjustment device for adjusting the detection area. 19. The smoke and temperature image recognition system of claim 8, wherein the image processing and recognition device further comprises an image capture control module for controlling the adjustment device to adjust the detection area. 0718-8558TW(NF); CALVIN.ptd Page 21 1284863 VI. Application for Patent Range 20. The smoke treatment system described in the patent application scope includes the alarm processing device comprising: “Identification ΐ*2 reporter when the alarm is processed When the device receives the pre-invitation, the audible alarm emits an alarm sound; (pre-"-email transmitting device, when the alarm processing device receives the signal, the e-mail transmitting device sends an alarm electric_s-send message transmitting device When the alarm processing device is set; = police = when the pain transmitting device sends an alert mobile phone message.