TW201140505A - Surveillance video fire detecting and extinguishing system - Google Patents

Surveillance video fire detecting and extinguishing system Download PDF

Info

Publication number
TW201140505A
TW201140505A TW99114742A TW99114742A TW201140505A TW 201140505 A TW201140505 A TW 201140505A TW 99114742 A TW99114742 A TW 99114742A TW 99114742 A TW99114742 A TW 99114742A TW 201140505 A TW201140505 A TW 201140505A
Authority
TW
Taiwan
Prior art keywords
fire
image
feature
video
video image
Prior art date
Application number
TW99114742A
Other languages
Chinese (zh)
Other versions
TWI427562B (en
Inventor
Chao-Ching Ho
Original Assignee
Univ Nat Yunlin Sci & Tech
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Nat Yunlin Sci & Tech filed Critical Univ Nat Yunlin Sci & Tech
Priority to TW99114742A priority Critical patent/TWI427562B/en
Publication of TW201140505A publication Critical patent/TW201140505A/en
Application granted granted Critical
Publication of TWI427562B publication Critical patent/TWI427562B/en

Links

Landscapes

  • Fire-Detection Mechanisms (AREA)
  • Alarm Systems (AREA)
  • Image Analysis (AREA)

Abstract

The present invention is a surveillance video fire detecting and extinguishing system having a control module, a surveillance video detector, an alarm module and an extinguishing robot. The control module continuously reads a video from the surveillance video detector and performs a surveillance video fire detecting method to determine and trace a fire-image in the video. When the fire-image is detected, the control module relocates the extinguishing robot in a new location in real space that is corresponding to the fire-image in the video, and the extinguishing robot executes a fire extinguish method to put the fire off.

Description

201140505 六、發明說明: 【發明所屬之技術領域】 本發明為一種火災偵測及自動滅火的系統,尤其是關 於一種利用拍攝的影像判斷火災發生及自動滅火的系統。 L无前技術】 近年來公共場所接連發生多次重大火災,均造成重大 傷亡及上億7C之財物損失,讓民眾深切感受到公共場所及 居豕是夕麼不女全,#能在第一時間,對足以燎原的星星 之火提出警不,將可大幅減少生命財產的損失。 ,t而,縱觀市面上所使用及販售的火災感測裝置的技 :都疋使用如粒子採樣分析、溫度採樣分析或是環境中的 ,-辰度刀析,因此非要等火災或煙霧所引起的粒子累積 :散布到達感測農置的感應範圍I,火警訊號才會發布, 位詈、Γ Γ的火災感測聚置並不能夠提供引起火災的火談 '敁大小、火燄燃燒程度等資訊。 天的目、用,統的視訊監控方式則需要使用安全人員整 費大量::::外藉以達到防範火災的功纟’則除需要耗 索,在實務使用卜’Μ要儲存大量的視訊資料供曰後檢 貫務使用上而有點不切合實際。 為克服火災4、,目丨壯 等人因而提V、、能侷限於點狀範圍的偵測,」· 煙霧的偵測範圍,:π非列的光學感測裝置來增加火災 整個系統並要妥呈 要安裝夕個紅外線陣列感測裝置, σ 、文裝,以達到效果。 Ε S3 3 201140505 【發明内容】 為了解決前述的既有火災偵測技術或方法偵測速度太 慢、無法偵測火災確切位置及火災發展程度.··等之技術問 題’本發明結合視訊系統(Video surveillance)與視覺祠服 (Visual Sen/oing)進行影響裡判斷火災的位置、狀態,可解 決傳統使用定點式的感測裝置來偵測火災如火燄感測器 (Flame Sensor)、溫度感測器(Temperature Sens〇「)、氣體201140505 VI. Description of the Invention: [Technical Field] The present invention relates to a system for fire detection and automatic fire extinguishing, and more particularly to a system for determining fire occurrence and automatic fire extinguishing using captured images. L no prior technology] In recent years, several major fires have occurred in public places in succession, causing major casualties and losses of property of hundreds of millions of 7C, so that the public deeply felt that public places and residences are eves, not women, #能在第一Time, to warn the fire of the stars enough to poke the original, will greatly reduce the loss of life and property. , t, looking at the technology of the fire sensing device used and sold in the market: use such as particle sampling analysis, temperature sampling analysis or environmental analysis, so it is necessary to wait for a fire or Accumulation of particles caused by smoke: When the spread reaches the sensing range I of the sensed farm, the fire alarm signal will be released. The fire sensory gathering of the 詈, Γ 并不 does not provide the fire that causes the fire. '敁 size, flame burning Level and other information. The purpose of the day, the use of video surveillance, the use of security personnel to use a large amount of money:::: lending to achieve the fire prevention skills, in addition to the need to consume, in practice, the use of Bu 'Μ to store a large amount of video data It is a bit unrealistic to use the post-mortem inspection service. In order to overcome the fire 4, the eye is strong and so people can raise the V, and can be limited to the detection of the spot-like range." · The detection range of the smoke: π non-column optical sensing device to increase the fire system and It is necessary to install an infrared array sensing device, σ, and text to achieve the effect. Ε S3 3 201140505 [Summary of the Invention] In order to solve the aforementioned problem that the existing fire detection technology or method is too slow to detect the exact location of the fire and the degree of fire development, the present invention combines the video system ( Video surveillance) and visual sensing (Visual Sen/oing) to determine the location and state of the fire, can solve the traditional use of fixed-point sensing devices to detect fires such as Flame Sensor, temperature sensing (Temperature Sens〇), gas

感測器(Gas Sensor)等等火警偵測手段之偵測速度太慢、無 法偵測火災確切位置及發展程度之技術問題,並且,本發 明更進-步將判斷的結果結合自動滅火系、統,達成全自動 的火災偵測及自動滅火的發明目的。 配口解决則述的技術問題以及達成發明目的,本發明 提供-種機器視覺火災憤測及自動滅火系、统,其包含一處 理控制終端、一影像擷 趑扨y , 我置、一警報杈組以及一遙控滅 火模組,立中: 該處理控 像,並執行一 像中是否存在 該處理控 控制該警報模 器視覺火災债 視sfl影像的位 s亥處理控 至實體空間中 、、。炎而遠影像擷取裝置持續讀取一視訊影 視見火哭彳貞測方法判斷所擷取的視訊影 一火災特徵; 制、而判定磕視訊影像存在該火災特徵時, 組發出一嬖4e ,· ° ’該處理控制終端繼續以該機 :方法持續追蹤該火災特徵在持續讀入之該 置與狀態;以及 制終端透過益 ,、、、線訊號控制該遙控滅火模組移 與該視訊影佶* u S3 產生火k特徵位置對應之鄰近 4 201140505 位置’以自動判斷控制或遙控的方式對該火災特徵之實體 空間對應位置執行一滅火手段。 其中’ S亥遙控滅火模組是一遙控载台’其承載一滅火 裝置或材料以進行該滅火手段,該遙控滅火模組產生一迴 授訊號予該處理控制模組,使該處理控制模組得知該遙控 滅火模組與該火災特徵之位置關係,以計算該遙控滅火模 組之移動向量與旋轉向量,而逼近該火災特徵。 其中’該迴授訊號為一光源訊號。 其中’該機器視覺火災偵測方法之步驟包含: 分割該視訊影像中火災特徵的的可能範圍:對該視訊 影像以一移動物體判斷手段擷取分割出該視訊影像中之一 火炎特彳政可範圍,其中,該移動物體判斷手段係判別該 視訊影像中具備移動及枓動現象的標的物作為該火災特徵 可能範圍; ^ 衫轉換及火災特徵相關性比對:將該火災特徵可能 粑圍先經一色彩轉換,並依據色彩轉換後之結果與一比對 樣板t行比較分析,並產生—顏色光譜相關係比對值; 分析火災特徵的動態行為·_判斷該火災特徵可能範圍 是否具備—幾何拓撲形狀不規則性及一突然移動的特性, 2算該火災特徵可能範圍之—紊流比,將該顏色光譜相 生比對值及該紊流比經過一模糊邏輯演算取得一可能性 指標,之後將且亡 更將具有最南可能性指標的一火災特徵可能範圍 订時域性分析以及办門你罢八从 & # ^ 次二間位置分析,找出火災特徵在視訊 衫像中的存在性與位置;及 S] 、尺特徵衫像區域追蹤:以一運動追蹤演算法對視訊 5 201140505 影像追蹤該火災特徵在視訊影像之變化與位置。 其中,忒分剎視訊影像中火災特徵的的可能範圍步驟 中’進-步以-顏色框直接在視訊影像中標示找出的該火 人特谜可此範圍’完成該分析火災特徵的動態行為步驟 後,對找出的該火災特徵於該視訊影像中直接標示之。 其中’違移動物體判斷手段為一移動歷史狀態影像的 背景分割演算法。 其中,該運動追蹤演算法為一連續適應性的均值追蹤 演算法。 其中,該運動追蹤演算法為一連續適應性的均值追蹤 演算法。 藉此,本發明所提供機器視覺火災偵測及自動減火系 統可以即時分析、判斷讀取之視訊影像是否存在火災特 徵’由於不需要透過複雜的偵測器,4不需要等待煙霧或 火焰接近偵測n ’目此,可以非f快速地進行火^貞測, 同時判斷火災的確切位置;在火災位置確定後,可以即時 派遣遙控滅火模組進行滅火,達到災害即時偵測'即=滅 火之技術效果。 ' / 【實施方式】 請參考第一圖,其為本發明之機器視覺火災偵測及自 動滅火系統的較佳實施例系統方塊示意圖,其包含—严理 控制終端10' —影像擷取裝置2〇、一警報模組3〇以:= 遙控滅火模組4 0。 該處理控制終端彳〇分別與該影像擷取裝置2〇 201140505 報模,纟且30雷,14、* ·ΙΑ 罨丨生連接,該處理控制終端1Q由 置2 0拄鋅u t 田a々像擷取裝 、“ 3賈取-視訊影像,並執行-機器視覺火災偵刺方 法判斷所掘取& ,s 火偵別方 斷誃葙叫逆你 你人尤特徵’藉以判 "α衫像所對應拍攝的實體空間是 中,該* «·ί牯恤 * \玍X火,其 火X特徵係指火焰或煙霧。其中, 1 0可以β _ / Θ處理控制終端 疋 0個人電腦、伺服器等裝置,I a 訊寻彡德,4f此 具得續項入該視 〜象亚執行該機器視覺火災偵測方法!4刺 影像中是否存在火災特徵。 去…i斷遠視訊 ”=:Γ覺火災谓測方法之判別後,確定當該視 ==火災特徵時’該處理控制終端10控 核組30發出一警報,且該處理控制終端 視覺火炎伯-、目丨I 士、+ j士这 、腔 '只μ 〇茨機益 測方法持續追蹤該火災特徵在持續讀入之,亥視 讯影像的位置與狀態 " 塑、& u Λ s報了以疋聲音訊號(警報聲 ;、無線火災通報訊號(傳給大樓管理員、消防局等) ^不在該處理控制㈣1◦之—人機介面的視覺警示訊 同時,該處理控制線眭彳η、乐ι ρ μ 市j、、、知1 0透過無線訊號控制該遙控滅 火模組40移至實體空間中與該視訊影像產生火災特徵位置 對應之鄰近位置,以自動判斷控制或遙控的方式對該火災 特徵之實體空間對應位置勃 .... 直執仃一滅火手段。所謂的自動判 斷控制或遙控方式係指# $ ^b 、遙控滅火模組4 0執行該減火手段 的控制方式,自動判斷氣# 4 t . ·' w遙控滅火模組4 0可自偵測足夠 接近該火災特徵後自動热< 執仃滅火手段,反之遙控方式則指 該遙控滅火模組4 0接登兮♦油〜Λ 又5亥處理控制終端1 〇之控制執行該 滅火手段。 [S3: 7 201140505 其中,s亥遙控滅火模組4〇可以是一遙控載台(遙控車、 機益人、履f車…),其承載一滅火裝i或一滅火材料藉以 進行該滅火手段’該滅火手段的種類不限定,可以是乾粉、 /包/末一氧化碳等。為了讓該處理控制模組1 〇可以在驅動 @遙控滅火模組40進人火場後,持續藉由該影像榻取裝置 20所即纣拍攝的視訊影像藉以控制該遙控滅火模組4〇持 續進行位置移動逼近該火災特徵,該遙控滅火模組40可以 D又有一迴杈訊號產生單元,其中,該迴授訊號產生單元可 以疋一光源產生元件(例如··發光二極體羌源(丨jght emjttjng diode, LED))或一無線位置位置訊號產生器(如GpS定 位),邊迴授訊號產生單元產生一迴授訊號讓該處理控制 杈組1 0得以得知該遙控滅火模組4〇與火災特徵之位置關 係,使该處理控制模組1 〇持續調整該遙控滅火模組4〇與 °玄火火特彳玫之間的相對位置’並在是當距離範圍下驅使該 遙控滅火模組4 0執行該滅火手段。 本貝施例之該迴授訊號產生單元為一發光二極體,當該 遙控滅火模組40進入火場時,該影像擷取裝置2〇所擷取 的視訊影像不僅可以拍攝到該火災特徵,同時也能拍攝到 。玄遙控滅火模組4 0及該發光二極體。由於發光二極體的發 光波長、形狀等特徵為可控制因子而可以事先設定、規劃, 因此可透過簡單的影像處理與判別程式之執行,使該處理 控制終端1 0可由視訊影像中判別該迴授訊號產生單元所產 生的光源訊號及其位置,藉以判斷該迴授訊號產生單元與 忒火災特徵之間的位置關係,如此,該處理控制終端]〇即 可透過該遙控滅火模組40所迴授的光源訊號,調整控制該 8 201140505 遙控滅火模組40之直 滅火模組40逼近火災J =疑轉向量,驅使該遙控 文特娬,達到滅火目的。 在實際測試使用方% + a 、仗用方面,本實施例使用—具 板的監控攝影機作為兮& # # '至頁天化 " 衫像擷取裝置20以擷取四周之視1 衫像,再將該視訊影像傳送 訊 v ^ 、U及處理控制終端20進行彰偾 勿析,之後,利用模糊理論推 ’ ^ ^ ώ 哪推哪出3亥遙控滅火模組40所愛 的直線運動向量與旋轉向量, 而 付J里以及建立修正角度與旌鏟&The sensor detection (Gas Sensor) and other fire detection means are too slow to detect the exact location of the fire and the technical level of development, and the present invention further combines the results of the judgment with the automatic fire extinguishing system, The goal of the invention is to achieve automatic fire detection and automatic fire extinguishing. The invention provides a machine vision fire intrusion detection and automatic fire extinguishing system, which comprises a processing control terminal, an image 撷趑扨y, an alarm, and an alarm. The group and a remote fire extinguishing module, the center: the processing control image, and whether there is an image in the image to control the alarm mode visual fire sfl image position control to the physical space, . The infra-red image capturing device continuously reads a video and video, and the fire and the crying method determine the captured video-fire feature. When the system determines that the fire image has the fire feature, the group sends a 4e. · ° ' The processing control terminal continues with the machine: the method continuously tracks the state of the fire feature in the continuous reading; and the terminal controls the remote fire extinguishing module to move to the video shadow through the benefit, the, and the line signal佶* u S3 generates a fire k feature position corresponding to the adjacent 4 201140505 position 'automatically determines the control or remote control mode to perform a fire extinguishing means on the physical space corresponding position of the fire feature. The 'Shai remote control fire extinguishing module is a remote control platform' which carries a fire extinguishing device or material for performing the fire extinguishing means, and the remote fire extinguishing module generates a feedback signal to the processing control module to enable the processing control module The positional relationship between the remote fire extinguishing module and the fire feature is known to calculate the motion vector and the rotation vector of the remote fire extinguishing module to approximate the fire feature. Wherein the feedback signal is a light source signal. The step of the machine visual fire detection method includes: dividing a possible range of fire features in the video image: the video image is segmented by the moving object judgment means to be one of the video images a range in which the moving object determining means discriminates the target object having the movement and the swaying phenomenon in the video image as a possible range of the fire feature; ^ Sweater transition and fire feature correlation comparison: the fire feature may be first After a color conversion, and according to the result of color conversion and a comparison of the sample t-line comparison analysis, and generate - color spectrum phase relationship comparison value; analysis of the dynamic behavior of the fire characteristics _ determine whether the fire feature possible range - Geometric topology shape irregularity and a sudden movement characteristic, 2 calculate the possible range of the fire characteristic - turbulence ratio, the color spectrum correlation value and the turbulence ratio through a fuzzy logic calculation to obtain a probability index, After that, the death will be more likely to have the most southern possibility indicator of a fire feature. You will find out the existence and location of the fire features in the video shirt image from the &# ^ second position analysis; and S], the ruler shirt image area tracking: a motion tracking algorithm for video 5 201140505 The image tracks the change and location of the fire feature in the video image. Wherein, in the possible range step of the fire feature in the video image of the camera, the step-by-step color box directly identifies the fireman's special puzzle in the video image to complete the analysis of the dynamic behavior of the fire feature. After the step, the fire feature found is directly indicated in the video image. The 'discriminating moving object judgment means is a background segmentation algorithm for moving the historical state image. The motion tracking algorithm is a continuous adaptive mean tracking algorithm. The motion tracking algorithm is a continuous adaptive mean tracking algorithm. Therefore, the machine vision fire detection and automatic fire reduction system provided by the invention can analyze and judge whether the read video image has a fire feature in real time. 'Because there is no need to pass through a complicated detector, 4 does not need to wait for smoke or flame to approach. Detecting n', you can quickly perform fire detection and determine the exact location of the fire. After the fire location is determined, you can immediately dispatch a remote fire-extinguishing module to extinguish the fire to achieve immediate detection of the disaster. Technical effect. Please refer to the first figure, which is a system block diagram of a preferred embodiment of the machine vision fire detection and automatic fire extinguishing system of the present invention, comprising: a strict control terminal 10' - an image capturing device 2 〇, an alarm module 3〇: = remote fire extinguishing module 40. The processing control terminal 报 reports the image with the image capturing device 2〇201140505, and 30 Ray, 14, * · 罨丨 罨丨 ,, the processing control terminal 1Q is set by 2 0 拄 ut 田 々 々 々 Pick up, "3 Jia take - video image, and perform - machine vision fire detection method to judge the digging & s fire detection side breaks yell against you you especially feature 'by the judgment" The physical space like the corresponding shot is in the middle, the * «· 牯 * * * 玍 X fire, its fire X feature refers to the flame or smoke. Among them, 1 0 can be β _ / Θ processing control terminal 疋 0 PC, Server and other devices, I a search for the German, 4f this has to renew the entry into the visual ~ Xiangya implementation of the machine visual fire detection method! 4 whether there is a fire feature in the image of the thorn. Go ... i break far video" = After the discrimination of the fire detection method, it is determined that when the view == fire feature, the process control terminal 10 controls the core group 30 to issue an alarm, and the process control terminal visualizes the fire-inflammation - the target I, the + j Shi, the cavity 'only μ 〇 机 益 益 持续 持续 持续 持续 持续 持续 持续 持续 持续 持续 持续 持续 持续 持续 持续 持续The location and status of the video video " plastic, & u Λ s reported the sound signal (alarm sound; wireless fire notification signal (passed to the building administrator, fire station, etc.) ^ not in the process control (four) 1◦ At the same time, the visual control signal of the human-machine interface simultaneously controls the remote control fire-extinguishing module 40 to move into the physical space and the video image through the wireless signal by the processing control line 眭彳η, 乐ι ρμ, j, The adjacent position corresponding to the location of the fire feature is generated, and the physical space corresponding to the fire feature is automatically determined by the control or remote control mode. The direct control means. The so-called automatic judgment control or remote control means ## ^b, the remote fire extinguishing module 40 executes the control mode of the fire reduction means, and automatically determines the gas #4 t . · ' w remote fire extinguishing module 40 can automatically detect the fire feature close enough to automatically heat < The fire extinguishing means, on the other hand, the remote control mode means that the remote fire extinguishing module 40 is connected to the 兮 油 oil Λ Λ and the 5 hai processing control terminal 1 〇 is controlled to execute the fire extinguishing means. [S3: 7 201140505 Among them, the shai remote control fire extinguishing module 4〇 can It is a remote control platform (remote control car, machine benefit person, crawling car...), which carries a fire extinguishing device or a fire extinguishing material to carry out the fire extinguishing means. The type of the fire extinguishing means is not limited, and may be dry powder, / bag / In order to allow the process control module 1 to drive the @remote fire extinguishing module 40 into the fire, the video image captured by the image capture device 20 is continuously controlled to control the remote fire extinguishing module. The group 4 〇 continuously moves the position to approach the fire feature, and the remote fire extinguishing module 40 can further have a signal generating unit, wherein the feedback signal generating unit can generate a light source generating component (for example, a light emitting diode)羌源 (丨 jght emjttjng diode, LED)) or a wireless position signal generator (such as GpS positioning), the edge feedback signal generating unit generates a feedback signal for the processing control group 10 to know the remote fire extinguishing The positional relationship between the module 4〇 and the fire feature enables the process control module 1 to continuously adjust the relative position between the remote fire extinguishing module 4〇 and the “Xuanhuohuo”, and Driven by the remote module 40 to execute the fire extinguishing means. The feedback signal generating unit of the present embodiment is a light emitting diode. When the remote fire extinguishing module 40 enters the fire field, the video image captured by the image capturing device 2 can not only capture the fire feature. At the same time, it can be photographed. The remote control fire extinguishing module 40 and the light emitting diode. Since the characteristics such as the wavelength and shape of the light-emitting diode are controllable factors and can be set and planned in advance, the processing control terminal 10 can discriminate the video from the video image through simple image processing and execution of the discrimination program. The position signal relationship between the feedback signal generating unit and the fire feature is determined by the light source signal generated by the signal generating unit, and thus the processing control terminal can be returned through the remote fire extinguishing module 40. The light source signal is given to adjust and control the 8 201140505 remote fire extinguishing module 40. The direct fire extinguishing module 40 approaches the fire J = suspected vector, and drives the remote control to achieve the purpose of fire extinguishing. In terms of the actual test user % + a, use, the present embodiment uses a board-mounted surveillance camera as the 兮&## 'to page stencil" shirt-like capture device 20 to capture the surrounding one-view shirt For example, the video image transmission v^, U and the processing control terminal 20 are further analyzed, and then the fuzzy theory is used to push '^^ ώ which pushes the linear motion of the 3H remote fire extinguishing module 40. Vector and rotation vector, while paying J and establishing correction angle with shovel &

的模糊系統的規則庫;所以當該影像擷取裝置: 現Μ與煙霧’該處理控制終端1G即可計算該遙控 滅模,且40及火災特徵的距離與方向,尋求修正向量盘佟 正角度,並依據分析之修正向量與修正角度來規劃該遙控 滅火模組4 0的速廑侖令,i嗲、a p 度卩v再透過無線通訊方式將命令傳送 到該遙控滅火模組4 0。 〃為了更進-步說明該機器視覺火災偵測方法,請參考 第二圖及第三《 ’其為本發明之機器視覺火災伯測方法之 較佳實施流程範例,其步驟包含: (51)讀取視訊影像:由影像操取裝置2Q連續且即時讀 取該視訊影像60。實際執行時,該影像擷取裝置2〇可以是 具備彩色錄像效果的監視器、攝影機或 CCD(Charge_COUp|ed device)或 CM〇s 等光感應元件。 (53)分割視訊影像中火災特徵可能範圍:由所讀取之該 視訊影像60 ^多動物體判_+段判冑並分取所操取 的視訊影像60中一火災特徵可能範圍68,。 由於火災的產生是一種物質燃燒並有具有紊流行為的 現象,火災之火燄本身具有特別的顏色、形狀及散布的型。 9 201140505 態’該些型態均提供了火警辨識的重要參考。火燄姆燒的 過程包括了化學變化與奈流的行為,且火談並具有會閃燦 的特性,火燄的另一個特性是火燄的形狀會隨空氣中風的 流動而改變,並會有劇烈的抖動與突然的移動現象等,因 此火燄所產生的煙霧亦會隨著火燄的移動也產生抖動的現 象。 因此,本實施例利用發生火災時可能產生的火災特徵 (即火及煙務)以及έ亥火災特徵的移動、抖動等現象,在視 馨 汛影像6 〇中找具備移動及抖動現象的標的物,並將該些標 的物予以分割選擇作為該火災特徵可能範圍681。尋找並判 別視afl影像6 0之移動物的演算方法很多,本實施例之該移 動物體判斷手段為一移動歷史狀態影像(Motion History Image, MHI)的背景分割演算法。MHI演算法主要是用於電 腦視覺在手勢行為之分析與移動研究[j. Davis, Recognizing movement using motion histograms," Technical Report 487, MIT Media Lab, 1999.; J. W. Davis • and A. Bobick, "The Representation and Recognition of Action Using Temporal Templates,” IEEE Transactions on Pattern Analysis and Machine, Intelligence, Vol. 23, No. 3, pp.257-267, 2001. ; G. R. Bradski and J. W. Davis, "Motion segmentation and pose recognition with motion history gradients," Machine Vision and Applications, vol. 13, pp. 174-184, 2002.],MHI演算法不僅可以用來決定當 前的物體的位置,並且可以利用物體在視訊影像60訊號中 場景内的運動資訊,來分割並量測這些運動。這些被分割 201140505 的區域不是運動塊"’而是自然的連接到物體的運動部分。 移動歷史狀態影像(MHI)演算法主要用以描述影像中物體 運動的狀態,並將其每一個像素採用顏色深淺來表示最近 變動的情形。本實施例使用MH丨演算法具有以下的特點: ()可以將發生於標計一段時間内的移動歷史狀態影像用單 張的灰階影像來表示;(2)可以直接地標記運動的區域; (3)使用MHI計算的CPU運算量不大,因此可以實現火談 與煙霧的動態即時偵測。The rule base of the fuzzy system; therefore, when the image capture device: the current control device and the smoke, the process control terminal 1G can calculate the remote control mode, and 40 and the distance and direction of the fire feature, seeking to correct the positive angle of the vector disk And according to the analysis correction vector and the correction angle, the speed of the remote fire extinguishing module 40 is planned, and the command is transmitted to the remote fire extinguishing module 40 by wireless communication. 〃In order to further explain the visual fire detection method of the machine, please refer to the second figure and the third article, which are examples of the preferred implementation process of the machine vision fire detection method of the present invention, and the steps thereof include: (51) Reading the video image: The video image 60 is continuously and instantly read by the image capturing device 2Q. In actual execution, the image capturing device 2〇 may be a monitor having a color recording effect, a camera, or a CCD (Charge_COUp|ed device) or a light sensing element such as a CM〇s. (53) The possible range of the fire feature in the divided video image: the video image 60 is read by the multi-animal image _+ segment and the fire feature range 68 in the captured video image 60 is divided. Since the fire is caused by a burning of the substance and a phenomenon of turbulence, the flame of the fire itself has a special color, shape and spread type. 9 201140505 State These models provide an important reference for fire identification. The process of burning flames involves the behavior of chemical changes and nep flow, and the fire talks and has the characteristics of flashing. Another characteristic of the flame is that the shape of the flame changes with the flow of the air stroke, and there will be sharp jitter. And sudden movements, etc., so the smoke generated by the flame will also produce jitter as the flame moves. Therefore, the present embodiment utilizes the fire characteristics (ie, fire and smoke) that may occur in a fire, and the movement, shaking, and the like of the fire characteristics of the sea, and finds the object with movement and jitter in the image of the image. And the subject matter is segmented and selected as the fire feature possible range 681. There are many calculation methods for finding and discriminating the moving object of the afl image. The moving object determining means of this embodiment is a background segmentation algorithm of a Motion History Image (MHI). The MHI algorithm is mainly used for computer vision in the analysis and movement of gesture behavior [j. Davis, Recognizing movement using motion histograms, " Technical Report 487, MIT Media Lab, 1999.; JW Davis • and A. Bobick, &quot The Representation and Recognition of Action Using Temporal Templates," IEEE Transactions on Pattern Analysis and Machine, Intelligence, Vol. 23, No. 3, pp. 257-267, 2001. ; GR Bradski and JW Davis, "Motion segmentation and Pose recognition with motion history gradients," Machine Vision and Applications, vol. 13, pp. 174-184, 2002.], the MHI algorithm can be used not only to determine the position of the current object, but also to utilize the object in the video image 60 The motion information in the scene in the signal to segment and measure these motions. The regions that are segmented 201140505 are not motion blocks " but are naturally connected to the motion part of the object. The Moving History State Image (MHI) algorithm is mainly used. To describe the state of motion of an object in an image, and to use color depth for each pixel This example uses the MH丨 algorithm to have the following characteristics: () The moving history state image that occurs within a certain period of time can be represented by a single grayscale image; (2) can be directly The area marked by the movement is; (3) The amount of CPU calculation using MHI is not large, so dynamic detection of fire and smoke can be realized.

進一步地,可以在此步驟完成之後,將所選出火災特 徵可能範圍681以一顏色框直接標示於該視訊影像6〇中, 讓使用者可以直接看到演算後、選擇的結果,#以警示使 用者/主思視訊影像6〇對應現場的各種可能狀況,如第三圖 所不。第三圖所顯示的視訊影像6〇中包含兩個可能的火災 特徵可能範圍681,分別為一火焰62 (右側圖形)以及: 紅色葉盆栽65(左側圖形)。舉例而言,該紅色葉盆栽可 能因為隨風搖矣導致經過MH丨演算法之後,與該火焰—起 被判疋、標示為火災特徵可能範圍6 81。 (55)色彩轉換及火災特徵之相關性比對 ^為了將火災特徵可能的火燄與煙霧的影像像素分割出 來,本實施例將前一步驟(53)標記運動的區域(即前述:該 火災特徵可能範圍681) ’先經過一色彩轉換處理,將選Z 的該火災特徵可能範圍681之彩色影像資訊轉換為相對容 易進行處理的色彩空間模式,藉以提昇後續運算的效能與 效果。舉例而言,本實施例之色彩轉換處理即是將該2災 特徵可能範圍681之色彩影像資訊轉成一 %丨⑴ 201140505Further, after the step is completed, the selected fire feature possible range 681 can be directly marked in the video image 6〇 by a color frame, so that the user can directly see the result after the calculation, the selected result, and the warning is used. The main/video video 6〇 corresponds to various possible conditions on the scene, as shown in the third figure. The video image 6〇 shown in the third figure contains two possible fire feature possible ranges 681, a flame 62 (right pattern) and a red leaf pot 65 (left graph). For example, the red leaf pot may be judged by the MH丨 algorithm after being swayed by the wind, and is marked as a fire feature with a range of 6 81. (55) Correlation comparison of color conversion and fire characteristics. In order to segment the image pixels of flame and smoke possible in the fire feature, this embodiment marks the area in which the previous step (53) is moved (ie, the foregoing: the fire feature) Possible range 681) 'First through a color conversion process, the color image information of the fire feature 681 of the selected Z can be converted into a color space mode that is relatively easy to process, thereby improving the performance and effect of subsequent operations. For example, the color conversion processing of the present embodiment converts the color image information of the possible range 681 of the 2 disaster features into a %(1) 201140505

Saturation, Intensity)的色彩空間模式。選擇HIS色彩空間 係因為該HIS色彩空間是從人的視覺系統出發,以色調 (Hue)、色飽和度(Saturation 或 Chroma)和亮度(丨ntensity 或Brightness)來描述、定義色彩。用這種描述HSI色彩空 間的圓錐模型相當複雜,但確能把色調、亮度和色飽和度 的變化情形表現得很清楚。由於人的視覺對亮度的敏感程 度遠優於對顏色濃淡的敏感程度,為了便於色彩處理和識 別’人的視覺系統經常採用HSI色彩空間,它比RGB色彩 空間更符合人的視覺特性。在影像處理和機器視覺中大量 算法都可在H SI色彩空間中方便地使用,它們可以分開處 理而且是相互獨立的。因此,本實施例使用H S丨色彩空間 可以大大簡化影像分析和處理的工作量,可以實現火燄與 煙霧的動態即時偵測。演算時,可將HS丨色彩空間之參數 分別正規化(normalized)到以下範圍: 〇° 客 hues 360° ; saturation^ 255 ; A 0 S intensity S 255。 為了找出的火燄與煙霧的HSI色彩分布範圍,可以將 完成HIS轉換的該火災特徵可能範圍681與一比對樣板進 行比較分析,藉以定義所擷取的該火災特徵可能範圍681 的影像資訊是否確實為火焰或煙霧。其中,該比對樣板之 建立’可以是預先對不同環境、條件產生的火災特徵擷取 一組視訊影像60串流畫面。舉例而言,該比對樣板可以取 自於室内 '室外、不同材質燃燒物等環境或條件之下產生 的火災特徵之HIS色彩空間資料庫。 201140505 換言之,在分析比較火燄與煙霧的樣板之後,就。、 將即時的視訊輸入影像畫面與實驗統計所建 人 , 见的戎比對樣 板,進行直方圖(histogram)的色彩相似度比對計 〜 °下异,得到 相關性比對值,用以代表可能是火燄或是煙霧取得相似度 的分數值。 & (57)分析火災特徵的動態行為 1 火災特徵的紊流特性分析 為了降低與火燄與煙霧的顏色相似的區域或物體所造 成的誤判,藉由分析所擷取的火災特徵可能範圍68彳之動 態行為是用來區別具由相近顏色特徵之重要手段,以決定 正確的火燄與煙霧的視訊中的影像區域。其中,火災特徵 之動態行為包括火燄與煙霧之一幾何拓撲形狀不規則性呈 現’以及具備一突然移動的特性。由於火燄與煙霧都是流 體’其會存在著不規則(幾何拓撲形狀不規則)的起伏和擾動 的奮流(turbulent flow)現象,本實施例即是利用此一紊流現 象’判定並區分真實發生的火燄與煙霧及和相似顏色的背 景與物體(如穿著紅衣服移動的人)的重要依據,當火燄與煙 霧的紊流現象增加時,視訊影像6〇之一紊流比Ω也會隨著 增大。其中’該紊流比Ω之定義為: Ω —, --(1-1) 其中’ P為選取區域的週長(perj meter),A為選取區威 的面積。當選取區域的形狀複雜度上升(即p變大,A變小), [S3 13 201140505 棄流比Ω則增大’因此’奢流比分析可用於所選取的該火 災特徵可能範圍681是否確實為火焰或煙霧。 2.火災特徵的時域性分析 另外,火談與煙霧會隨時間而_的特性,亦是用來 {貞測火談與煙霧的重要依據,因為閃燦的特性會造成視訊 中的火談與煙霧影像,會斷斷續續的不規則出現與消失; 為了區分與火燄與煙霧的相似影像區域並分析火燄與煙霧 • t隨時間而閃爍的時域性質,本實施例使用模糊邏輯 (fuZZy-|0giC-enhanced app「〇ach)來求出火燄與煙霧的一 可能性指標.67,如第四圖所示。 本實施例使用的模糊邏輯有兩個輸入,分別是火燄與 煙霧的一顏色光譜相關性比對值及一紊流比Ω,其先 將SCQrr及Ω經過正規化至〇〜彳之數值範圍,在經一模糊邏 輯廣异後產生火災特徵之可能性指標u。其中,該顏色光譜 鲁相關性比對之計算係依據下列公式·· ^(,4, B) = - B) (12) \ίΣ((Αί ~ - B)2 其中’ A、B分別代表待分析視訊影像中的火災特徵可 此^園以及該比對樣板統計結果,Ai代表統計結果的數 值’ A bar代表平均。 201140505Saturation, Intensity) color space mode. Choosing the HIS color space Because the HIS color space is derived from the human visual system, the color is described and defined by Hue, Saturation or Chroma, and Brightness (丨ntensity or Brightness). This conical model describing the HSI color space is quite complex, but it does show the changes in hue, brightness, and color saturation. Since human vision is much more sensitive to brightness than sensitivity to color shading, in order to facilitate color processing and recognition, the human visual system often uses the HSI color space, which is more in line with human visual characteristics than the RGB color space. A large number of algorithms in image processing and machine vision are conveniently used in the H SI color space, which can be processed separately and independently of each other. Therefore, the H 丨 color space in this embodiment can greatly simplify the workload of image analysis and processing, and can realize dynamic detection of flame and smoke. During the calculation, the parameters of the HS丨 color space can be normalized to the following ranges: 〇° hues 360° ; saturation^ 255 ; A 0 S intensity S 255. In order to find out the HSI color distribution range of the flame and the smoke, the fire feature possible range 681 of the HIS conversion can be compared and analyzed with a comparison template to define whether the captured image information of the possible range of the fire feature 681 is It is indeed a flame or smoke. The establishment of the comparison template may be to capture a set of video images 60 stream pictures in advance for fire characteristics generated by different environments and conditions. For example, the comparison template can be taken from a HIS color space database of fire features generated under ambient or outdoor conditions such as indoors and different materials. 201140505 In other words, after analyzing the samples comparing flames and smoke, just. The real-time video input image screen and the experimental statistics are built. See the 戎 comparison template, and the histogram color similarity comparison meter is different, and the correlation comparison value is obtained to represent It may be the score of the similarity of the flame or the smoke. & (57) Analysis of the dynamic behavior of fire characteristics 1 Analysis of the turbulence characteristics of fire characteristics In order to reduce the misjudgment caused by the area or object similar to the color of the flame and smoke, it is possible to analyze the fire characteristics extracted by the range 68彳The dynamic behavior is used to distinguish image areas in video with the important means of similar color characteristics to determine the correct flame and smoke. Among them, the dynamic behavior of the fire feature includes the geometrical topology irregularity of one of the flame and the smoke, and the characteristic of a sudden movement. Since both the flame and the smoke are fluids, there will be irregularities (irrigation of geometric topological shapes) and turbulent flow phenomena. In this embodiment, the turbulence phenomenon is used to determine and distinguish between the realities. The important basis for the occurrence of flames and smoke and similar backgrounds and objects (such as people moving in red clothes), when the turbulence of flames and smoke increases, the turbulence ratio Ω of the video image will also follow Increase. Where ‘the turbulence ratio Ω is defined as: Ω —, --(1-1) where ' P is the perimeter of the selected area (perj meter) and A is the area of the selected area. When the shape complexity of the selected area increases (ie, p becomes larger, A becomes smaller), [S3 13 201140505 Abandoned flow is increased by Ω] Therefore, the extravagant flow ratio analysis can be used to determine whether the selected fire feature range 681 is indeed For flames or smoke. 2. Time-domain analysis of fire characteristics In addition, the characteristics of fire talk and smoke will be used over time, and it is also used as an important basis for measuring fire and smoke, because the characteristics of flash can cause fire talk in video. With smoke images, intermittent irregularities appear and disappear; in order to distinguish similar image areas from flames and smoke and analyze the time-domain nature of flame and smoke flashing over time, this embodiment uses fuzzy logic (fuZZy-|0giC -enhanced app "〇ach" to find a possible index of flame and smoke. 67, as shown in the fourth figure. The fuzzy logic used in this embodiment has two inputs, one for the color spectrum of the flame and the smoke. The sexual comparison value and the turbulence ratio Ω, which first normalize SCQrr and Ω to the numerical range of 〇~彳, and generate a probability index u of the fire characteristic after a fuzzy logic broadly. The calculation of Lu correlation is based on the following formula: · ^(,4, B) = - B) (12) \ίΣ((Αί ~ - B)2 where 'A and B respectively represent the video image to be analyzed Fire characteristics can be used in this garden and the comparison template statistics Fruit, Ai values representative of statistical results' A bar represents the mean. 201140505

第四圖之功旎方塊Scorr和Ω是將輪入GsScorr和〇/; 的值正規化到[〇,1]的範圍,並產生火燄與煙霧的可能性指 標w。GsScorr和G。的值分別是由四個區域所組成並使用 二角模糊函數,分別是 ZE (zero,無)、pS (p0Sitive sman, 小)、PM (positive middle,中)、和 PL (p〇sitjve |arge, 大),並根據實驗分析而得的影像資料庫,建立模糊(Fuzzy) 規則庫,如表1所示。模糊邏輯演算之輸出包含四個輸出 值(singletons ){#1,v 2,#3, v 4}。本實施例使用加權 平均之解模糊邏輯(Weighted average defuzzmcati〇n)計The fourth block of the work blocks Scorr and Ω normalizes the values of the rounds into GsScorr and 〇/; to the range of [〇,1] and produces a flame and smoke probability index w. GsScorr and G. The values are composed of four regions and use the two-angle fuzzy function, which are ZE (zero, none), pS (p0Sitive sman, small), PM (positive middle, middle), and PL (p〇sitjve | arge). , large), and based on the experimental analysis of the image database, establish a fuzzy (Ruzzy) rule base, as shown in Table 1. The output of the fuzzy logic calculus contains four output values (singletons) {#1, v 2, #3, v 4}. This embodiment uses weighted average defuzzmcati〇n

Flanie-and-smokp index u s娜 ΖΕ PS PM PL Ω ΖΕ Hi il2 PS /// Hi li2 PM Ul lh U4 PL /// ... “4 u4 算取得該可能性^標^。該可能性指標^計算公式為: if = Gi Σ/=ι ... (2) 其中 Gu 為另一常數(sca|ing constant),A (t// )則是 前述的幾個關係參數所計算出來的結果(minimum implication operation)。 在實㈣算方面,本實施例約取20個歷史影像框 (historical frames)之可能性指標u藉以尋找視訊影像6〇 中最可π的存在火尺特徵之區域。如果某個區域得到最高 的可能性’則該影像區域則繼續進行一時域性分析 201140505 (temporal analysis) ° 為了更能區別視訊影像60中與火災特徵具有相似特性 的物體,本實施例利用一平均準位跨越率(Leve| Cr〇ssjngFlanie-and-smokp index us ΖΕ PM PS PM PL Ω ΖΕ Hi il2 PS /// Hi li2 PM Ul lh U4 PL /// ... "4 u4 Calculate the probability ^ standard ^. The probability indicator ^ The calculation formula is: if = Gi Σ/=ι ... (2) where Gu is another constant (sca|ing constant), and A (t// ) is the result of the above several relational parameters ( In the case of real (four) calculation, this embodiment takes about 20 historical image frames (historical frames) possibility index u to find the most π-like area of the video image in the video image. The region has the highest probability', then the image region continues to perform a time domain analysis 201140505 (temporal analysis) ° In order to better distinguish objects in the video image 60 that have similar characteristics to the fire feature, this embodiment utilizes an average level Leap rate (Leve| Cr〇ssjng

Rate ’ LCR)演算法來來區分與火燄與煙霧具有相似特性的 物體。所選取的影像區域中的每個像素(pjxe|)透過LCR演 算以進行時域性分析: 1 7'-' LCR(a·, y) = — [ II(w, > /ij}, ·· (3) /=0 # 其中,Ut 是長度 Τ 的機率(a Probability 〇f length T)。 ΙΚΦ}是指示函數,其中當判斷元素(a「gument)中為真實 (true)時指示函數& 1,反之則為〇。々1是判斷臨界值 (threshold value)。在本實施例中,用來進行lcr演算的 影像長度T為40個影像框(frames),該判斷臨界值Μ是 設定值。The Rate ' LCR ) algorithm is used to distinguish objects that have similar properties to flames and smoke. Each pixel (pjxe|) in the selected image region is subjected to LCR calculation for time domain analysis: 1 7'-' LCR(a·, y) = — [ II(w, > /ij}, · · (3) /=0 # where Ut is the probability of length ( (a Probability 〇f length T). ΙΚΦ} is an indication function indicating the function &amp when the element (a "gument" is true (true) 1, otherwise, it is 〇. 々1 is the threshold value. In this embodiment, the image length T used for the lcr calculation is 40 frames, and the judgment threshold Μ is set. value.

因此,本實施例之視訊影像6〇之火災特徵之空間位 置決定可以下列公式(4):Therefore, the spatial position of the fire feature of the video image 6〇 of the present embodiment can be determined by the following formula (4):

Flume Sm〇ke(.v. v) = lTRUE· if LCR ^ 1 FALSE, if lcr<a-2. ...(4) ”中疋貝驗之臨界值,(χ,y)代表火災特徵的空 置本Λ施例之k2臨界值是利用觀察彳2筆確實具有 h特徵之視訊影像6〇之後取得的實驗結果,於此,本實 施例在進行煙霧判斷時數值為〇.〇5,在進行火焰判斷時其 數值為〇. 〇 7 5。 藉由經過前述的判斷步驟 6〇中的是否存在火焰或煙霧, ’即可以有效判斷視訊影像 以及火焰及煙霧的位置。 16 201140505 (59}火災特徵影像區域追蹤 經過前述的步驟,可以明確定義出視訊影像6〇中是否 出現火災特徵以及其可能的範圍,為了能夠持續追縱火災 特徵的範圍與趨勢,讓觀看者可以能夠持續追縱視訊影像 6〇中的火災特徵之位置,本實施例以一運動追蹤演算法對 視訊影像60持續追縱火災特徵的位置,並適當地予以在視 訊影像60予以標示,加強警示效果。 本實施例使用之該運動追縱演算法為一連續適應性的 均值追縱演算法(CAMS丁,c_inu〇usly AdaptiveFlume Sm〇ke(.v. v) = lTRUE· if LCR ^ 1 FALSE, if lcr<a-2. ...(4) ” The critical value of the mussel test, (χ, y) represents the fire characteristic The k2 threshold value of the vacant embodiment is an experimental result obtained by observing the video image 6 of the h feature, and the value of the embodiment is 〇.〇5 when performing the smoke determination. When the flame is judged, the value is 〇. 〇7 5. By the above judgment step 6〇, whether there is flame or smoke, 'the position of the video image and the flame and smoke can be effectively judged. 16 201140505 (59}Fire characteristics Image area tracking Through the above steps, it is possible to clearly define whether there is a fire feature and its possible range in the video image. In order to continuously track the range and trend of the fire feature, the viewer can continue to track the video image. In the present embodiment, the position of the fire feature is continuously tracked by the video tracking algorithm by a motion tracking algorithm, and the video image 60 is appropriately marked to enhance the warning effect. Use of this algorithm is a continuous motion 追縱 mean 追縱 adaptive algorithm (CAMS butoxy, Adaptive c_inu〇usly

Mean-S_)’CAMSHIFT主要通過視訊影像6〇中運動物體 的顏色資訊來達到追縱的目的,camsh|ft演算法是採用 色彩機率分佈及统計的Mean-S_)'CAMSHIFT mainly achieves the purpose of tracking through the color information of moving objects in the video image. The camsh|ft algorithm uses color probability distribution and statistics.

α方式持、㊉的追蹤火燄與煙霧影像内 的赉生區域,所以CAMSH|FT 、·^法疋利用色彩直方圖來 异出一,准衫像中色彩的機率分佈,CAMSH丨FT演算法可 以處理動態的色彩分佈變化,其具體步驟包含· ^ 步驟1.將整個影像設為搜尋區域。 =驟2·初始化追縱影像圖框視窗的位置和大小。 區域ΓΓ:·計算追縱影像圖框視窗内的色彩機率分佈,此 〇〇 '、比追蹤影像圖框視窗較大一點。 /驟4.操作運行Mean训⑴ 圖框視窗的新位置和大小。 以獲仔追縱影像 步驟5 y- -T- 3獲得的值初始仆:!像圖框的視訊影像6”,採用步驟 ° 、蹤影像圖框視窗的位置和大小 f # 步驟3'4和5,實 置:幻,並重複 以前述之笛二固、 特徵目軚(火燄與煙霧)的追蹤。 —.作為範例說明,經過CAMSH|F丁演算法之 201140505 視訊影像6 0,可以在視訊影像中找到火災特徵6 8 2,並在 視訊影像60中予以標示、追蹤其大小與位置。 综合前述,本實施例以移動歷史狀態影像演算法(Μ Η |) 所分割的有效區域R〇丨(Regi〇n of Interest),該有效區域即 為前述的火災特徵可能範圍681,並再使用顏色光譜相關性 比對值的相關性演算及空間中紊流比值後,再經火談與煙 霧的時域性分析來剔除視訊影像60中可能產生混淆的物件 (如穿著紅色衣物到處移動的人或車等等),最後使用 CAMSHIFT演算法追蹤火燄與煙霧的影像運動區域。 進一步地,本實施例除了可以對視訊影像進行火焰與 煙霧之位置進行醒目的標示之外,可於步驟(57 )或(59 ) 之後所找到火災特徵之後發佈一警示訊號(透過接收該視 訊影像電腦以聲音或無線訊號發佈警示訊號),如此,不 僅可以讓需要持續監視的人員得到警示’藉以防範災情持 續擴大。 本實施例發展出一個使用機器視覺演算法來處理輸入 衫色影像的視訊資料,發展出火燄與煙霧的偵測演算法, 根據顏色特性、空間特性、時域特性來及時的偵測火災, 並於偵測到火燄與煙霧訊號時,發出警報,若配合一内喪 式單晶片系統之軟硬體實現視覺伺服技術,也可達到遠端 監控或甚至遠端監控控制滅火之技術效果。經過不同視訊 影像60之測試,本實施例確實能夠快速、有效的偵測及追 縱視訊影像60中的火災特徵發生位置。 本發明是發展出一個使用機器視覺演算法來處理輸入 彩色影像的視訊資料,利用演算法根據顏色特性、空間特 18 201140505 性、時域特性來及時 到火钻I '、j火災,並加以預防,並於偵測 到火燄與煙霧訊號 內冰_V- M A 5X 警報。同時,可透過配合如一 内甘入式早晶片系統之軟 ^ ^ ^ ^ ^ 更體Λ現視覺伺服技術,藉以可遠 為控制邊遙控滅火模組 擷取裝置20道5!達火源發生處’並透過該影像 娇妲b 風火杈組40滅火,試驗結果顯示, 所k出的演算、# 的發 、 工万式可有效並可靠的偵測火燄與煙霧 & ,並且可持續進行火缓與煙霧的影像追蹤。 【圖式簡單說明】 第圖為本發明之較佳實施例系統方塊示意圖。 第一圖為本發明之較佳實施例流程圖。 證 — 二圖為本發明之較佳實施例所處理之一視訊影像示 意圖。 _ 第四圖為本發明之較佳實施例之一模糊邏輯演算方塊 示意圖。 【主要元件符號說明】 1 0處理控制終端 20影像擷取裝置 30警報模組 40遙控滅火模組 6〇視訊影像 62火焰 65紅色葉盆栽 681火災特徵可能範圍 682火災特徵 [S] 19The alpha mode holds ten and traces the twins in the flame and smoke images. Therefore, the CAMSH|FT and ·^ methods use the color histogram to make a difference. The probability distribution of the color in the shirt image can be CAMSH丨FT algorithm. Handling dynamic color distribution changes, the specific steps include · ^ Step 1. Set the entire image as the search area. =Step 2. Initialize the position and size of the tracking image frame window. Area ΓΓ:· Calculate the color probability distribution in the tracking image frame window. This 〇〇 ' is larger than the tracking image frame window. /Step 4. Operation Run Mean Training (1) The new position and size of the frame window. In order to get the image, step 5 y- -T- 3 to get the value of the initial servant:! Like the video image of the frame 6", using the step °, the position and size of the image frame window f #steps 3'4 and 5, the actual: magic, and repeat the aforementioned flute two solid, feature witness (flame Tracking with smoke. — As an example, after the CAMSH|F Ding algorithm 201140505 video image 60, the fire feature 6 8 2 can be found in the video image, and the video image 60 is marked and tracked. In combination with the foregoing, in this embodiment, the effective region R〇丨(Regi〇n of Interest) divided by the moving history state image algorithm (Μ Η |) is the aforementioned fire feature possible range 681, Then, using the correlation calculation of the color spectral correlation value and the turbulence ratio in the space, the time domain analysis of the smoke and the smoke are used to eliminate the objects that may be confused in the video image 60 (such as wearing red clothes everywhere). The moving person or car, etc.) finally uses the CAMSHIFT algorithm to track the image motion area of the flame and the smoke. Further, in this embodiment, in addition to the position of the flame and the smoke for the video image. In addition to the eye-catching indication, a warning signal can be issued after the fire feature found after step (57) or (59) (by receiving the video image computer to issue a warning signal by voice or wireless signal), so that not only can the need be made Persons who continue to monitor are warned 'to prevent the disaster from continuing to expand. This example develops a video visual algorithm that uses machine vision algorithms to process the input shirt color image, and develops a flame and smoke detection algorithm based on color characteristics and space. Features, time domain characteristics to detect fires in a timely manner, and alarms when flame and smoke signals are detected. Remote monitoring can also be achieved if visual servo technology is implemented with the hardware and software of a single-chip system. Or even remote monitoring and control of the technical effect of the fire extinguishing. Through the testing of different video images 60, this embodiment can quickly and effectively detect and trace the location of fire features in the video image 60. The present invention develops a use Machine vision algorithm to process the video data of the input color image, using algorithm based Color characteristics, space special 18 201140505 Sex, time domain characteristics to timely fire I ', j fire, and prevent, and detect the flame and smoke signal inside the ice _V- MA 5X alarm. At the same time, through the cooperation For example, the soft ^ ^ ^ ^ ^ of the internal immersive early wafer system is more visually responsive to the visual servo technology, so that it can be used as a remote control fire-extinguishing module to capture the device 20 channels 5! The 妲 妲 b wind and fire 杈 group 40 fire extinguishing, the test results show that the calculus, # hair, and versatile can effectively and reliably detect the flame and smoke & and can continue the image of fire and smoke [Brief Description] The figure is a block diagram of a system according to a preferred embodiment of the present invention. The first figure is a flow chart of a preferred embodiment of the present invention. The present invention is a video image representation of a preferred embodiment of the present invention. The fourth figure is a schematic diagram of a fuzzy logic calculus block in accordance with a preferred embodiment of the present invention. [Main component symbol description] 1 0 processing control terminal 20 image capturing device 30 alarm module 40 remote fire extinguishing module 6〇 video image 62 flame 65 red leaf potted plant 681 fire feature possible range 682 fire feature [S] 19

Claims (1)

201140505 七、申睛專利範圍: 严理:二:機器視覺火災制及自動滅火系統,其包含-處理終端、_影像絲 滅火模組,其中: H组以及-遙控 =理控制終端由該影像操取裝置持續讀取一視訊影 像中—視覺火災伯測方法判斷所擷取的視訊影 像中疋否存在一火災特徵; 4處理控制終端判定該視訊影像存 ==:組發出,,該處理控制終端二二 見々偵測方法持續追縱該火災特徵在持續讀入之士亥 視訊影像的位置與狀態;以及 ' ^ 至杏制終端透過無線訊號控制該遙控滅火模組移 二:’中與該視訊影像產生火哭特徵位置對應之鄰近 ”1對庳位:判斷控制或遙控的方式對該火災特徵之實體 二間對應位置執行一滅火手段。 自勤^、二巾4專利範111第1項所述的機11視覺火災積測及 0、糸統’該遙控滅火模組是—遙控載 滅3置切料㈣行㈣火手段,料㈣火模=生 7授訊號予該處理控制模組,使該 火模组之二之位置關係,以計算該遙控滅 、’ 向量與旋轉向量,而逼近該火災特徵。 3_如申凊專利範圍第2項所述的機器視 自動滅火系統,該迴授訊號為—光源訊號。U測及 ( ★申叫專利範圍第1或2或3項所述的機器視詈火 尺偵測及自動滅火系統’該機器視覺火災偵測方法之步驟 20 201140505 包含: 分割該視訊影像中火災特徵的的可能範圍:對該視訊 〜像以移動物體判斷手段掏取分割出該視訊影像中之一 火火特徵可能範圍,其中,該移動物體判斷手段係判別該 視。凡衫像中具備移動及抖動現象的標的物作為該火災特徵 可能範圍; 色彩轉換及火災特徵相關性比對:將該火災特徵可能201140505 VII, Shenming patent scope: Yan Li: 2: machine vision fire system and automatic fire extinguishing system, including - processing terminal, _ image silk fire extinguishing module, wherein: H group and - remote control = control terminal by the image operation The device continuously reads a video image—the visual fire test method determines whether there is a fire feature in the captured video image; 4 the processing control terminal determines that the video image is stored==: the group is sent, and the processing control terminal The second and second detection methods continue to track the location and status of the fire image in the continuous reading of the Shih Hing video; and the ^ ^ to the apricot terminal controls the remote fire extinguishing module through the wireless signal: The video image generates a fire-frozen feature position corresponding to the proximity "1 pair of positions: the judgment control or remote control mode performs a fire-fighting means on the corresponding positions of the physical features of the fire feature. Self-service ^, 2 towel 4 patent model 111 item 1 The machine 11 visual fire accumulation test and 0, the system of the remote control fire extinguishing module is - remote control load 3 cut material (four) line (four) fire means, material (four) fire mode = raw 7 signal number to the treatment The module is configured to calculate the positional relationship of the fire module to calculate the remote control, the vector and the rotation vector, and approximate the fire feature. 3_ The machine is automatically fire extinguished as described in claim 2 The system, the feedback signal is - the light source signal. U measurement and (the application of the scope of the device as described in the scope of the first or second or third item of the device fire detection and automatic fire extinguishing system 'the machine visual fire detection method Step 20 201140505 includes: dividing a possible range of the fire feature in the video image: capturing, by the moving object determining means, a possible range of the fire feature in the video image, wherein the moving object determining means Determine the view. The target object with movement and jitter in the shirt image as the possible range of the fire feature; color conversion and fire feature correlation comparison: the fire feature may 範圍先、二色彩轉換,並依據色彩轉換後之結果與一比對 樣板進仃比較分析,並產生一顏色光譜相關係比對值; 刀析火炎特徵的動態行為:判斷該火災特徵可能範圍 是否:備-幾何拓撲形狀不規則性及一突然移動的特性, 並°十,4火炎特徵可能範mt*,將該顏色光譜相 ,性比對值及該紊流比經過—模_輯演算取得—可能性 :私之後將具有最高可能性指標的—火災特徵可能範圍 ::域:分析以及空間位置分析,找出火災特徵在視訊 ’5V像_的存在性與位置;及 火尺特徵影像區域追蹤:以一運動 ^ , 影像追蹤該火災特徵在視訊影像之變化與位置^法對視訊 如申請專利範圍第4項所述的機 自動滅火系統,其中: 八尺1貝列汉 該分割視訊影像中火災特的 一牛w —銪名士厂古w J J此辜已圍步驟中’進 乂 ^ 一顏色框直接在視訊影像中標 可能範圍;及 拽出的该火災特徵 對找出的該 [S1 完成該分析火災特徵的動態行為步驟後 火災特徵於該視訊影像中直接標示之。 21 201140505 自動專:範圍第5項所述的機器視覺火災偵測及 自動滅火系統,其令,該移動物體 狀態影像的背景分割演算法。 奴為一移動歷史 7.如申請專利範 自動滅火系統,該運 夂述的機器視覺火災偵測及 追蹤演算法。 、法為—連續適應性的均值 8_如申請專利範 自動蜮火& μ 弟6項所述M a, 違蹤、〜系統,該運動追蹤、呔的機器視覺火災偵測及 成演算法。 演算法為一*立 馬〜連續適應性的均值 、圖式:如次頁The range is first and second color conversion, and the result of the color conversion is compared with a comparison template, and a color spectrum correlation relationship is generated; the dynamic behavior of the flame characteristic is determined: whether the possible range of the fire feature is determined :Preparation - geometric topology shape irregularity and a sudden movement characteristic, and ° ten, 4 flame characteristics may be the norm mt*, the color spectral phase, the sexual comparison value and the turbulence ratio obtained through the simulation - Possibility: After the private will have the highest probability index - fire feature possible range:: domain: analysis and spatial position analysis, find out the presence and location of the fire feature in the video '5V image _; and the fire rule feature image area Tracking: Tracking the change and position of the fire feature in the video image with a motion ^, image to the video. For example, the automatic fire extinguishing system described in the fourth application of the patent scope, wherein: the eight-foot 1 Belehan video segmentation video In the fire, a special cow w — 铕 铕 厂 古 古 古 J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J J Fire characteristic in the video image directly after the labeling of the fire characteristic [Sl identified to complete the analysis of the dynamic behavior of the fire characteristic step. 21 201140505 Automatic: The machine vision fire detection and automatic fire extinguishing system described in the fifth item, which makes the background segmentation algorithm of the moving object state image. Slave is a history of movement 7. If you apply for a patented automatic fire extinguishing system, the machine vision fire detection and tracking algorithm described in this article. , the law is - the average value of continuous adaptation 8_ such as the patent application automatic bonfire & μ brother 6 said Ma, the violation, ~ system, the motion tracking, 机器 machine vision fire detection and algorithm . The algorithm is a * immediate ~ continuous adaptive mean, schema: such as the next page m 22m 22
TW99114742A 2010-05-10 2010-05-10 Surveillance video fire detecting and extinguishing system TWI427562B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW99114742A TWI427562B (en) 2010-05-10 2010-05-10 Surveillance video fire detecting and extinguishing system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW99114742A TWI427562B (en) 2010-05-10 2010-05-10 Surveillance video fire detecting and extinguishing system

Publications (2)

Publication Number Publication Date
TW201140505A true TW201140505A (en) 2011-11-16
TWI427562B TWI427562B (en) 2014-02-21

Family

ID=46760329

Family Applications (1)

Application Number Title Priority Date Filing Date
TW99114742A TWI427562B (en) 2010-05-10 2010-05-10 Surveillance video fire detecting and extinguishing system

Country Status (1)

Country Link
TW (1) TWI427562B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI571697B (en) * 2015-04-28 2017-02-21 Chaoyang Univ Of Tech Processing of Shrinking Photography Services
TWI610701B (en) * 2016-09-12 2018-01-11 Fire extinguishing robot control method
TWI645885B (en) * 2017-10-27 2019-01-01 趙鋼 Movable intelligent fire extinguishing device
CN111955213A (en) * 2020-08-11 2020-11-20 袁文莹 Self-closing fireproof gardening modeling flowerpot
TWI723879B (en) * 2020-05-19 2021-04-01 高樹萍 Fire extinguisher having automatic detection function

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100567098C (en) * 2003-05-21 2009-12-09 松下电器产业株式会社 Articla management system and article control server
TW200603858A (en) * 2005-03-14 2006-02-01 Richard Kao Remote-controllable rail-guided removable fire fighter
TW200922647A (en) * 2007-11-26 2009-06-01 Ind Tech Res Inst Mechanical arm module and with capability of frightening and extinguishing fire and robot using the same

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI571697B (en) * 2015-04-28 2017-02-21 Chaoyang Univ Of Tech Processing of Shrinking Photography Services
TWI610701B (en) * 2016-09-12 2018-01-11 Fire extinguishing robot control method
TWI645885B (en) * 2017-10-27 2019-01-01 趙鋼 Movable intelligent fire extinguishing device
TWI723879B (en) * 2020-05-19 2021-04-01 高樹萍 Fire extinguisher having automatic detection function
CN111955213A (en) * 2020-08-11 2020-11-20 袁文莹 Self-closing fireproof gardening modeling flowerpot

Also Published As

Publication number Publication date
TWI427562B (en) 2014-02-21

Similar Documents

Publication Publication Date Title
Kim et al. Real-time probabilistic classification of fire and smoke using thermal imagery for intelligent firefighting robot
Ho Machine vision-based real-time early flame and smoke detection
CN108389359B (en) Deep learning-based urban fire alarm method
CN109637068A (en) Intelligent pyrotechnics identifying system
CN110569772A (en) Method for detecting state of personnel in swimming pool
TW201140505A (en) Surveillance video fire detecting and extinguishing system
CN109740411A (en) Intelligent monitor system, monitoring method based on recognition of face and quickly go out alarm method
CN111222493B (en) Video processing method and device
Salehi et al. An automatic video-based drowning detection system for swimming pools using active contours
CN112396658A (en) Indoor personnel positioning method and positioning system based on video
CN109741565B (en) Coal mine fire disaster recognition system and method
KR102580434B1 (en) Dangerous situation detection device and dangerous situation detection method
Ho et al. Real-time video-based fire smoke detection system
US11972671B2 (en) System and method for pre-drowning and drowning detection
Umoh et al. Support vector machine-based fire outbreak detection system
TWI713368B (en) Image device and method for detecting a thief
Surantha et al. An IoT based house intruder detection and alert system using histogram of oriented gradients
Ho Nighttime fire/smoke detection system based on a support vector machine
CN113392706A (en) Device and method for detecting smoking and using mobile phone behaviors
TWI732392B (en) Factory management system and control system
Jakovčević et al. Notice of Violation of IEEE Publication Principles: Review of wildfire smoke detection techniques based on visible spectrum video analysis
TWI427563B (en) Surveillance video fire detecting method and product thereof
Jiayun Real-time visual detection of early manmade fire
CN210895500U (en) Dangerous behavior action recognition system
Song et al. The research of real-time forest fire alarm algorithm based on video

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees