TWI421795B - System and method of image processing based on color information, and method for image categorization using the same - Google Patents

System and method of image processing based on color information, and method for image categorization using the same Download PDF

Info

Publication number
TWI421795B
TWI421795B TW98141221A TW98141221A TWI421795B TW I421795 B TWI421795 B TW I421795B TW 98141221 A TW98141221 A TW 98141221A TW 98141221 A TW98141221 A TW 98141221A TW I421795 B TWI421795 B TW I421795B
Authority
TW
Taiwan
Prior art keywords
image
color
information
color information
processing
Prior art date
Application number
TW98141221A
Other languages
Chinese (zh)
Other versions
TW201120817A (en
Original Assignee
Shinsoft Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shinsoft Co Ltd filed Critical Shinsoft Co Ltd
Priority to TW98141221A priority Critical patent/TWI421795B/en
Publication of TW201120817A publication Critical patent/TW201120817A/en
Application granted granted Critical
Publication of TWI421795B publication Critical patent/TWI421795B/en

Links

Landscapes

  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Closed-Circuit Television Systems (AREA)

Description

使用影像色彩資訊之處理系統、處理方法與影像分類方法Processing system, processing method and image classification method using image color information

本發明揭露一種使用影像色彩資訊之比對處理系統與方法,特別是利用色度空間轉換,並僅保留色彩資訊作為影像比對的基礎,以排除可能產生錯誤辨識的問題。The present invention discloses a comparison processing system and method using image color information, in particular, using chromaticity space conversion, and retaining only color information as a basis for image comparison to eliminate the problem that may cause erroneous recognition.

智能視頻監控(Intelligent Video Surveillance,IVS)系統是一種由閉路電視(CCTV)網絡、主控台的監視器和安全人員構成。在積極發展中的智能視頻監控系統,能夠透過數位影像分析,將所拍攝的影像進行影像特徵化、差異比對等影像處理流程,找出移動影像或是分析出有意義的資訊,進而達成自動追蹤、判斷,輔助安全人員找出可疑對象。The Intelligent Video Surveillance (IVS) system is a closed circuit television (CCTV) network, a console monitor and security personnel. In the active development of intelligent video surveillance systems, digital image analysis can be used to image the images, compare and compare image processing processes, find moving images or analyze meaningful information, and then achieve automatic tracking. Judging, assisting security personnel to identify suspicious objects.

在習知技術中,有使用閉路電視錄影配合安全人員的監控模式,此類監控模式除了安全人員現場可以判斷出可疑對象,通常是在特定事件發生後,透過檢視錄影內容,倚靠監視器上的畫面找出有用的資訊。In the prior art, there is a monitoring mode in which a closed-circuit television video is used in conjunction with a security personnel. In addition to the security personnel, the security personnel can determine suspicious objects on the spot, usually after viewing a video event, relying on the monitor. Find useful information on the screen.

接著,經數位化後,傳統閉路電視改成了數位攝影機,使得容易透過數位控制實現自動偵測、判斷的功能,並且節省了影像儲存的空間與成本。Then, after digitalization, the traditional closed-circuit television is changed into a digital camera, which makes it easy to realize automatic detection and judgment through digital control, and saves space and cost of image storage.

目前,安全監控的技術進一步實現了智能視頻監控,除了產生了多種的監控應用外,更應用到網路傳輸的技術,包括執行目標物件偵測、追蹤、異常事件判斷,並進而觸發警報,讓監控的工作更強大而無遠弗屆。At present, the technology of security monitoring further realizes intelligent video surveillance. In addition to generating a variety of monitoring applications, it also applies to network transmission technologies, including performing target object detection, tracking, abnormal event judgment, and then triggering alarms. The monitoring work is more powerful and far-reaching.

在進行安全監控的狀況下,最重要之一的事情是對移動物件的偵測,由於在數位攝影機的拍攝下,連續的影像訊號是由複數幀(frame)的圖像組成,先建立參考背景,再連續比對複數幀影像,藉以得出在特定時間內產生的變化,能因此分析出發生於被監控區域的事件,接著透過警報機制告知相關保全人員。In the case of security monitoring, one of the most important things is the detection of moving objects. Because the digital video camera is composed of multiple frames, the reference background is established first. Then, the multiple frames of images are continuously compared to obtain the changes generated within a certain time period, so that the events occurring in the monitored area can be analyzed, and then the relevant security personnel are notified through the alarm mechanism.

因此,影像之間的畫素差異就變成影像分析的基礎,可參考美國專利公開第2008/0031493號(公開於2008年2月7日)所揭露用於監控攝影機上的物件特徵辨識方法,其中即如第一圖顯示透過色彩圖表進行物件特徵辨識的方法。Therefore, the pixel difference between the images becomes the basis of the image analysis, and the method for identifying the feature of the object for monitoring the camera disclosed in US Patent Publication No. 2008/0031493 (published on Feb. 7, 2008) is incorporated by reference. That is, as shown in the first figure, a method of object feature recognition through a color chart is shown.

如步驟S101,先由一連串變動中的影像中辨識出其中的物件,再透過彩色圖表產生器,根據每幀中物件的顏色與亮度的資訊產生出色彩圖表(color histogram,步驟S103)。再如步驟S105,根據色彩圖表中的色彩分佈,將場景與物件區分為不同的類型(步驟S105),之後可以為了能夠凸顯物件特徵,進行特定色彩空間的座標轉換(步驟S107),再計算出各種類型中色彩分佈中的參數(步驟S109),以利得出物件特徵(步驟S111)。In step S101, an object is identified from a series of images in a series of changes, and then a color chart generator is used to generate a color histogram according to the color and brightness information of the object in each frame (step S103). Further, in step S105, the scene and the object are divided into different types according to the color distribution in the color chart (step S105), and then coordinate conversion of the specific color space may be performed in order to highlight the object feature (step S107), and then calculated. The parameters in the color distribution in the various types (step S109) to derive the object features (step S111).

此例中,係透過色彩分佈的分析得出連續場景的變化得出監控場景中物件的特徵,之後,監控攝影機可以根據物件特徵進行追蹤,或是其他分析。In this example, the change of the continuous scene is obtained through the analysis of the color distribution to obtain the characteristics of the objects in the monitoring scene. After that, the surveillance camera can track according to the characteristics of the object, or other analysis.

由於一般智能視頻監控的技術常是透過過濾背景得出參考影像,再以數值分析來找到變動狀況,但一般透過彩色影像的變化來找出移動的變動,可能會被環境影響而產生誤報。另有習知技術提出能夠透過簡化彩色影像來降低各種可能產生誤報的問題,包括利用灰階影像將不必要的色彩排除,利用其中黑與白的變化找出變動的物體。但灰階影像仍有可能被光線亮度的變動影響而產生誤報。Since the technology of general intelligent video surveillance often obtains a reference image by filtering the background, and then uses numerical analysis to find the change situation, generally the change of the color image is used to find out the movement change, which may be caused by the environment and cause a false alarm. Other conventional techniques have been proposed to reduce various possible false positives by simplifying color images, including the use of grayscale images to exclude unwanted colors, and the use of black and white variations to find moving objects. However, grayscale images may still be affected by variations in light brightness and false positives.

習知技術中,經過攝影機錄製的影像可能會因為環境光線、亮度對比產生錯誤判斷的問題,本發明所揭露的使用影像色彩資訊之處理系統、處理方法與影像分類方法僅擷取前後影像中的色度空間中的色彩資訊,特別是將原來影像所處的色度空間轉換為色彩-飽和度-亮度之色度空間(Hue,Saturation,Intensity,HSI space),並僅擷取其中色彩資訊,以排除其他可能造成誤判的資訊。以此增加判斷的準確性,以產生正確且有效的訊息。In the prior art, the image recorded by the camera may be misjudged due to ambient light and brightness contrast. The processing system, processing method and image classification method using image color information disclosed in the present invention only capture images in the before and after images. The color information in the chromaticity space, especially the chromaticity space in which the original image is located is converted into the color-saturation-intensity chromaticity space (Hue, Saturation, Intensity, HSI space), and only the color information is captured. To exclude other information that may cause misjudgment. This increases the accuracy of the judgment to produce a correct and effective message.

根據較佳實施例,發明揭露一種使用影像色彩資訊之處理方法,其中步驟係先擷取一連續影像,並設定一參考影像,實際實施可以開始運作時的初始幀為參考影像,再執行色度空間轉換,特別是將原來影像所處之色度空間轉換為色彩-飽和度-亮度之色度空間。接著,擷取參考影像中一物件之色彩資訊,排除飽和度與亮度的資訊,建立參考資訊。According to a preferred embodiment, the invention discloses a processing method for using image color information, wherein the step is to first capture a continuous image and set a reference image, and actually implement an initial frame that can be started as a reference image, and then perform chroma. Spatial conversion, in particular, transforms the chromaticity space in which the original image is located into a color-saturation-luminance chromaticity space. Then, the color information of an object in the reference image is extracted, the information of saturation and brightness is excluded, and reference information is established.

之後,步驟繼續擷取後續影像,並對後續影像中各幀進行色度空間轉換,同樣轉換為色彩-飽和度-亮度之色度空間,再擷取後續影像中物件的色彩資訊。根據參考影像與後續影像中物件的色彩資訊的匹配運算判斷是否符合物件變動的判斷標準。其中,經執行匹配運算後,若判斷為匹配,則繼續擷取後續影像;但若判斷不匹配(表示有變動),則發出一訊息。After that, the step continues to capture subsequent images, and performs chroma space conversion on each frame in the subsequent image, and also converts into a color-saturation-luminance chromaticity space, and then captures color information of the objects in the subsequent images. According to the matching operation between the reference image and the color information of the object in the subsequent image, it is judged whether the criterion for the change of the object is met. After the matching operation is performed, if it is determined to be a match, the subsequent image is continuously captured; but if the judgment is not matched (indicating a change), a message is sent.

上述步驟中,可透過比對是否匹配來判斷特定事件,比如,不匹配可能表示物件正在移動,可根據後續影像中物件的色彩資訊的不匹配資訊描繪出物件之移動路徑。不匹配可能表示攝影機拍攝的位置與角度被改變,或是攝影機被外物遮蔽。In the above steps, the specific event can be judged by whether the comparison is matched. For example, the mismatch may indicate that the object is moving, and the moving path of the object may be drawn according to the mismatch information of the color information of the object in the subsequent image. A mismatch may indicate that the position and angle of the camera was changed, or that the camera was obscured by foreign objects.

或是,可針對特定空間中的特定物件進行偵測,判斷是否遺失,或是特定空間是否新增不明其他物件。另一實施例是可透過不匹配的判斷發出觸發訊息,以觸發攝影機開始錄製影像,或是進行其他動作,更包括停止錄製等功能。另有實施例更透過判斷物件前後不匹配,而判斷有進出的事件,進而啟動計數。Or, you can detect specific objects in a specific space to determine whether they are missing, or whether other objects are added to a specific space. In another embodiment, a trigger message may be sent through a mismatch determination to trigger the camera to start recording an image, or perform other actions, including stopping recording. In another embodiment, by judging that the objects do not match before and after, the event is determined to be in and out, and then the counting is started.

根據另一較佳實施例,發明所揭露的使用影像色彩資訊之處理系統包括有擷取連續影像的取像單元,並透過暫存記憶體暫存連續影像,再由處理單元處理連續影像,擷取出一參考影像與後續影像。另用儲存單元儲存上述參考影像與一段時間內擷取的後續影像,之後透過一影像處理模組進行處理。According to another preferred embodiment, the processing system for using image color information disclosed in the present invention includes an image capturing unit that captures a continuous image, and temporarily stores the continuous image through the temporary memory, and then processes the continuous image by the processing unit. Take out a reference image and subsequent images. The storage unit stores the reference image and the subsequent image captured in a period of time, and then processes the image through an image processing module.

而影像處理模組由儲存單元中存取其中的影像資訊,透過色度空間轉換單元將連續影像中各幀原本所處的色度空間轉換為一色彩-飽和度-亮度之色度空間(HSI空間),透過色彩特徵擷取單元排除其中的飽和度與亮度的特徵,僅擷取出當中特定物件的色彩特徵。透過色彩特徵的匹配運算判斷物件的變化,利用匹配運算判斷參考影像中物件與連續影像中的物件的色彩特徵是否匹配。The image processing module accesses the image information in the storage unit, and converts the chromaticity space originally in each frame of the continuous image into a color-saturation-luminance chromaticity space (HSI) through the chromaticity space conversion unit. Space), the color feature extraction unit is used to exclude the characteristics of saturation and brightness, and only the color features of the specific object are extracted. The change of the object is judged by the matching operation of the color feature, and the matching operation is used to determine whether the color feature of the object in the reference image and the object in the continuous image match.

最後,透過匹配判斷物件的變化,以決定是否要發出訊息,比如判斷出物件有異常,即發出警報訊息。Finally, the matching is used to determine the change of the object to determine whether to send a message, such as determining that the object is abnormal, that is, issuing an alert message.

由於監控中的影像往往會因為各種不確定的因子產生錯誤警報的問題,比如利用監控攝影機對特定空間進行入侵監測,當空間有任何改變時,攝影機所擷取的畫面就會有改變,因而產生警報訊息,但是卻難避免因為光影、亮度的變化而被誤判為可疑事件的問題。本發明揭露一種使用影像色彩資訊之比對處理系統與方法,並包括一影像分類方法,特別是利用色度空間轉換(Color Space Transformation),轉換原本影像所處的色度空間,且透過僅保留色彩資訊作為影像比對的基礎,以排除可能產生錯誤辨識的問題。Since the images in the surveillance often cause false alarms due to various uncertain factors, such as using surveillance cameras to monitor the intrusion of specific spaces, when the space changes, the images captured by the camera will change, resulting in Alarm message, but it is difficult to avoid the problem of being misidentified as a suspicious event due to changes in light and shadow. The present invention discloses a comparison processing system and method using image color information, and includes an image classification method, in particular, using a color space transformation (Color Space Transformation) to convert the chromaticity space in which the original image is located, and only retains Color information is used as the basis for image comparison to eliminate problems that may cause misidentification.

其中,影像原本所處的色度空間可為一紅-綠-藍色度空間(RGB color space),但其中隱含有因為亮度、光影(如太陽光變化)改變的色彩值,且相關門檻值設定困難。但若僅將其轉化成灰階表達,仍是以亮度為參考基準。因此,本發明特別是將原來影像所處的色度空間轉換為一色彩-飽和度-亮度之色度空間(Hue,Saturation,Intensity,HSI space),並僅擷取其中色彩(Hue)資訊,而排除其中飽和度與強度(亮度)的變數,為的是排除其他可能造成誤判的資訊,以色彩資訊增加判斷影像變化的準確性,以產生正確且有效的訊息。Wherein, the chromaticity space in which the image is originally located may be a RGB color space, but the color value changed due to brightness, light and shadow (such as sunlight change) is hidden, and the relevant threshold is The value setting is difficult. However, if only converted to grayscale expression, it is still based on brightness. Therefore, in particular, the present invention converts the chromaticity space in which the original image is located into a Hue (Saturation, Intensity, HSI space), and only captures the Hue information. The variables in which saturation and intensity (brightness) are excluded are used to exclude other information that may cause misjudgment, and the color information is used to increase the accuracy of the image change to produce a correct and effective message.

若將本發明應用於保全監控的領域,即可參考第二圖使用影像色彩資訊之處理系統之應用實施例示意圖。於建築物21設置有一或多數個攝影機23,攝影機23所擷取的影像可透過無線或有線的通訊方式傳遞至遠端監控中心27,此例以無線基地台25進行影像傳輸。If the present invention is applied to the field of security monitoring, a schematic diagram of an application embodiment of a processing system using image color information in the second drawing can be referred to. One or more cameras 23 are provided in the building 21. The images captured by the camera 23 can be transmitted to the remote monitoring center 27 through wireless or wired communication. In this example, the wireless base station 25 performs image transmission.

透過本發明所擷取的現場影像將傳遞至監控中心27,監控中心27具有影像處理的電腦系統,透過物件判斷、色度空間轉換,並擷取色彩(Hue)資訊,以此作為監控的基礎。The live image captured by the present invention will be transmitted to the monitoring center 27, which has a computer system for image processing, through object judgment, chromaticity space conversion, and capturing color (Hue) information as a basis for monitoring. .

除了於上述監控中心27中實施影像處理外,另一實施例更可於攝影機23本機上設置具有物件判斷、色度空間轉換與色彩資訊擷取功能的電腦系統,再將處理過的資訊傳遞至監控中心27。In addition to performing image processing in the above-mentioned monitoring center 27, another embodiment can further set a computer system with object judgment, chromaticity space conversion and color information capture function on the camera 23, and then transfer the processed information. To the monitoring center 27.

而監控的應用可包括:鏡頭位移偵測,係偵測攝影機鏡頭被不正常移動;鏡頭遮蔽偵測,係由拍攝的畫面消失判斷是否有異物遮蔽;遺失物偵測,針對特定空間中特定物件進行監控,判斷是否遺失物件,或是影像暫時被遮住等情況;入侵偵測,針對影像中新增不明物件(比如人、動物、車輛)進行監控;遺留物偵測,即針對所監控的空間是否有新增不明固定的物件進行偵測;觸發偵測,透過偵測到影像變動來觸發特定程序,比如有入侵的狀況,則啟動錄製影像、通知保全、啟動特定開關,而忽略影像不動時的畫面;電子圍籬、警戒區域,透過監控特定空間進行保全,即針對一特定範圍進行偵測不明事件,並觸發特定保全程序;物件計數,透過影像變動的偵測,計算進出人員或是物體的數量;物件偵測,可以鎖定空間中特定物件進行監控;物件追蹤,偵測出影像變動,由連續影像判斷移動中的物件,並描繪出移動軌跡,攝影機即能對此物件進行追蹤;物件分類,可透過儲存於一資料庫的影像色彩資訊與相對物件的資訊,經影像特徵比對後,分類各物件。The monitoring applications may include: lens displacement detection, which detects that the camera lens is not moving normally; lens shadow detection is determined by the disappearance of the captured image to determine whether there is foreign matter obscuration; the lost object detection is for a specific object in a specific space. Monitor and determine whether objects are lost, or images are temporarily blocked; intrusion detection, monitoring of new unknown objects (such as people, animals, vehicles) in the image; detection of remnants, that is, for monitoring Whether the space has newly added fixed objects for detection; trigger detection, triggering specific programs by detecting image changes, such as intrusion conditions, start recording images, notify security, activate specific switches, and ignore images. The screen of the time; the electronic fence and the warning area are preserved by monitoring the specific space, that is, detecting an unknown event for a specific range, and triggering a specific security procedure; object counting, detecting the movement of the image, calculating the entry and exit personnel or The number of objects; object detection, can lock specific objects in the space for monitoring; object tracking, The image change is detected, the moving object is judged by the continuous image, and the moving track is drawn, and the camera can track the object; the object classification can be through the image color information and the relative object information stored in a database. After the image features are compared, the objects are classified.

以上各種應用係依據本發明擷取之影像色彩(Hue)資訊作為判斷標準,排除可能誤判的光影的因素後,再透過匹配運算判斷匹配程度,能提高偵測的準確度。The above various applications are based on the image color (Hue) information captured by the present invention as a criterion for judging the factors of light and shadow that may be misjudged, and then determining the degree of matching through matching operations, thereby improving the accuracy of detection.

如第三圖敘述的本發明使用影像色彩資訊之處理方法中計算匹配的步驟。The step of calculating the matching in the processing method using the image color information of the present invention as described in the third figure.

步驟開始時,如步驟S301,由一攝影機進行取像,經數位化後,擷取出影像中特定物件的紅-綠-藍(RGB)資訊,此例中,影像原處於紅-綠-藍色度空間,影像資訊即由紅、綠、藍顏色表達,經過色度空間轉換(步驟S305),轉換為色彩-飽和度-亮度之色度空間(步驟S307),並擷取當中物件色彩(Hue)資訊,以此為參考,如步驟S309,進行參考影像與擷取影像間色彩資訊的特定匹配運算(correlation operation),判斷匹配程度(步驟S311)。其中匹配運算可應用習知各種計算匹配的方程式,在此並不贅述。At the beginning of the step, in step S301, the image is taken by a camera, and after digitizing, the red-green-blue (RGB) information of the specific object in the image is extracted, in this case, the image is originally in red-green-blue. In the degree space, the image information is expressed by red, green and blue colors, converted into a color-saturation-luminance chromaticity space by chromaticity space conversion (step S305) (step S307), and the object color is captured (Hue The information is used as a reference. In step S309, a specific matching operation of the color information between the reference image and the captured image is performed to determine the degree of matching (step S311). The matching operation can apply various conventional equations for calculating matching, and is not described here.

接著,第四圖係為本發明所利用之色彩-飽和度-亮度之色度空間示意圖。Next, the fourth figure is a chromaticity space diagram of the color-saturation-luminance utilized by the present invention.

第四圖顯示色彩-飽和度-亮度色度空間的座標形式之一,此例之色彩-飽和度-亮度色度空間顯示為一由色彩、顏色飽和度與亮度等資訊表達的圓錐體的立體座標,其中縱向表示由最暗的黑到最亮的白,以亮度(Intensity)i表達。而其中切面圓座標顯示在圖式右方,圓半徑表示飽和度(Saturation)s,圓心為飽和度最低0,而接近圓周的部份則表示最大飽和度;而圓周由0度到360度則表示色彩(Hue)h,顏色依序由紅(Red)、黃(Yellow)、綠(Green)、青綠(Cyan)、藍(Blue)到洋紅(Magenta)。The fourth figure shows one of the coordinate forms of the color-saturation-luminance chromaticity space. In this example, the color-saturation-luminance chromaticity space is displayed as a cone of cones expressed by information such as color, color saturation and brightness. Coordinates, where the longitudinal direction is represented by the darkest black to the brightest white, expressed in terms of intensity (intensity) i. Where the circular coordinates of the facet are shown on the right side of the figure, the radius of the circle represents the saturation (Saturation) s, the center of the circle is the lowest saturation of 0, and the part close to the circumference represents the maximum saturation; and the circumference is from 0 to 360 degrees. Indicates the color (Hue) h, and the color is sequentially composed of red, yellow, green, Cyan, blue, and magenta.

以上僅列舉色彩-飽和度-亮度色度空間的表達型式,實際實施則不以這種為限制。Only the expression patterns of the color-saturation-luminance chromaticity space are listed above, and the actual implementation is not limited by this.

本發明所利用的影像資訊係需將所擷取到的原始由紅-綠-藍色度空間表達的色彩,轉換至色彩-飽和度-亮度之色度空間上,並排除飽和度與亮度的變數,僅以色彩(Hue)為變數進行影像差異辨識。此處的色彩值可以角度表示,由0度到360度,每種角度表示一種顏色。The image information utilized by the present invention is required to convert the original color expressed by the red-green-blue degree space into the color-saturation-luminance chromaticity space, and exclude the saturation and brightness. Variables, image difference recognition is performed only with color (Hue) as a variable. The color values here can be expressed in degrees from 0 degrees to 360 degrees, each angle representing a color.

轉換方式如下,此例僅為實施例之一,但實際實施並不限制於此。比如,亮度以i=1/3(R+G+B)表示,為紅、綠、藍的平均值;飽和度以s=1-(3/(R+G+B))*a表示,其中a為紅、綠、藍中的最小值;色彩則可以h=cos^(-1)((0.5*((R-G)+(R-B)))/((R-G)^2+(R-B)*(G-B))^(0.5))表達。The conversion method is as follows, and this example is only one of the embodiments, but the actual implementation is not limited thereto. For example, the brightness is expressed as i=1/3 (R+G+B), which is the average value of red, green, and blue; the saturation is represented by s=1-(3/(R+G+B))*a, Where a is the minimum of red, green, and blue; color can be h=cos^(-1)((0.5*((RG)+(RB))))/((RG)^2+(RB)* (GB)) ^ (0.5)) expression.

另有習知技術(可參考美國專利第6,665,439號)以下列數學式進行色度空間,如方程式(1)所示:Another conventional technique (refer to U.S. Patent No. 6,665,439) performs a chromaticity space in the following mathematical formula, as shown in equation (1):

imax=max(r,g,b)Imax=max(r,g,b)

imin=min(r,g,b)Imin=min(r,g,b)

亮度i=(imax+imin)/2Brightness i=(imax+imin)/2

當imax=iminWhen imax=imin

飽和度s=0Saturation s=0

當i<=(max_value)/2When i<=(max_value)/2

飽和度s=(imax-imin)/(imax+imin)*max_valueSaturation s=(imax-imin)/(imax+imin)*max_value

當i>(max_value)/2When i>(max_value)/2

飽和度s=(imax-imin)/(max_value-imax-imin)*max_valueSaturation s=(imax-imin)/(max_value-imax-imin)*max_value

r1=(imax-r)/(imax-imin)R1=(imax-r)/(imax-imin)

g1=(imax-g)/(imax-imin)G1=(imax-g)/(imax-imin)

b1=(imax-b)/(imax-imin)B1=(imax-b)/(imax-imin)

當imax=imin,則色彩h並無定義When imax=imin, the color h is not defined.

當r=imax,則色彩h=((b1-g1)π/3When r=imax, the color h=((b1-g1)π/3

當g=imax,則色彩h=((2+rl-b1)π/3When g=imax, the color h=((2+rl-b1)π/3

當b=imax,則色彩h=((4+g1-r1)π/3When b=imax, the color h=((4+g1-r1)π/3

其中r,g,b為各畫素的原始色彩值,imax為r,g,b的最大值,imin為r,g,b的最小值,包括亮度i與飽和度s,範圍都是由0到最大值,若以8位元的記錄方式,最大值為255,也就是方程式(1)中的變數max_value。而色彩則以角度表示,由0到2π。Where r, g, b are the original color values of each pixel, imax is the maximum value of r, g, b, and imin is the minimum value of r, g, b, including the brightness i and the saturation s, the range is from 0 To the maximum value, if the recording mode is 8 bits, the maximum value is 255, which is the variable max_value in equation (1). The color is represented by an angle from 0 to 2π.

利用上述方程式(1),將每個畫素(r(x,y),g(x,y),b(x,y))分別轉換為h(x,y),s(x,y)與i(x,y)。Using the above equation (1), each pixel (r(x, y), g(x, y), b(x, y)) is converted to h(x, y), s(x, y), respectively. With i(x,y).

第五圖係為本發明使用影像色彩資訊之處理方法實施例流程圖,此實施例流程主要是擷取出影像色彩(Hue)資訊作為影像變動偵測的參考,之後透過量化,比如計算匹配,由匹配程度判斷影像變動,能應用於各種智能視頻監控(IVS)系統中。The fifth figure is a flowchart of an embodiment of a method for processing image color information according to the present invention. The flow of this embodiment is mainly to extract image color (Hue) information as a reference for image motion detection, and then perform quantization, such as calculation matching, by The degree of matching determines the image change and can be applied to various intelligent video surveillance (IVS) systems.

此處理方法步驟一開始,如步驟S501,由一攝影機進行拍攝,特別是記錄(儲存至記憶體或是特定暫存區)連續的影像,接著,如步驟S503,透過影像處理單元執行色度空間轉換,如上述實施例,特別是將影像原處的色度空間轉換為本方法實施例所應用的色彩-飽和度-亮度之色度空間。At the beginning of the processing method step, in step S501, a camera performs shooting, in particular, recording (storing to a memory or a specific temporary storage area) successive images, and then, in step S503, performing a chroma space through the image processing unit. Conversion, as in the above embodiment, in particular, converts the chrominance space of the original image into the color-saturation-luminance chromaticity space applied by the method embodiment.

利用上述色彩-飽和度-亮度之色度空間所描述的影像包括有色彩(Hue)、飽和度(Saturation)與強度或亮度(Intensity)等參數,如步驟S505,實施例僅擷取影像中特定物件的色彩(Hue)資訊,而排除飽和度與強度的特徵。其中影像中的物件可為使用者所選取,或是透過自動偵測變動的內容而判斷出。再如S507,由最初在原始條件下的影像色彩資訊中建立參考資訊,作為比對的基礎。The image described by the color-saturation-luminance chromaticity space includes parameters such as Hue, Saturation, and Intensity. In step S505, the embodiment only captures specific images. The color (Hue) information of the object, excluding the characteristics of saturation and intensity. The objects in the image can be selected by the user or can be judged by automatically detecting the changed content. Another example is S507, which establishes reference information from the image color information originally under the original conditions as the basis for comparison.

在實際實施上,連續影像有複數個幀(frame)所組成,故所謂色度空間轉換或是擷取的色彩資訊皆以幀為基礎單位。In practical implementation, the continuous image is composed of a plurality of frames, so the so-called chroma space conversion or the captured color information are all based on the frame.

接著,此方法實施例繼續擷取後續影像(步驟S509),同樣於步驟S511中進行色度空間轉換,於本發明實施例即由影像原處的色度空間轉換為上述色彩-飽和度-亮度之色度空間。之後,如步驟S513,擷取後續影像中特定物件的色彩(Hue)資訊,並與之前設定的參考資訊執行匹配運算,由匹配程度判斷參考資訊與後續影像的色彩資訊是否匹配(步驟S515)。Then, the method embodiment continues to capture the subsequent image (step S509), and also performs the chrominance space conversion in step S511. In the embodiment of the present invention, the chromaticity space at the original image is converted into the color-saturation-luminance. The chromaticity space. Then, in step S513, the color (Hue) information of the specific object in the subsequent image is captured, and a matching operation is performed with the previously set reference information, and the matching degree determines whether the reference information matches the color information of the subsequent image (step S515).

於此判斷步驟中,主要是透過計算參考影像與後續擷取的影像的色彩資訊間的匹配得出關聯的程度,而匹配運算則可參考其他習知技術,主要的目的是用以適當地量化參考資訊與後續色彩資訊間的差異。In this judging step, the degree of association is mainly obtained by calculating the matching between the reference image and the color information of the subsequently captured image, and the matching operation can refer to other conventional techniques, and the main purpose is to properly quantize The difference between the reference information and subsequent color information.

上述透過匹配運算判斷關聯的程度,可透過設定另一門檻值來決定匹配程度是否符合一特定判斷標準,此門檻值可用以調整判斷標準,可解釋為敏感度。舉例來說,若匹配門檻值低(接近最小匹配程度),容易判斷為匹配,表示敏感度低;若門檻值高(接近最大匹配程度),表示判斷匹配的可能較低,則敏感度較高。The above determining the degree of association by the matching operation can determine whether the matching degree meets a specific judgment standard by setting another threshold value, and the threshold value can be used to adjust the judgment criterion, which can be interpreted as sensitivity. For example, if the matching threshold is low (close to the minimum matching degree), it is easy to judge that the matching is low, indicating that the sensitivity is low; if the threshold is high (close to the maximum matching degree), indicating that the matching is likely to be lower, the sensitivity is higher. .

步驟中,若判斷為匹配,則繼續擷取後續影像(步驟S509),但若判斷不匹配,可再引入一延遲時間作為判斷的條件之一,藉以判斷參考影像與後續影像間的關聯程度,也就如步驟S517,判斷是否超過一延遲時間。在此延遲時間的判斷步驟中,主要是判斷參考影像與後續影像間的關聯程度,也是就判斷影像不匹配的情況是否維持一延遲時間,此延遲時間是要用於避免突然事件造成誤判的可能,比如偵測過程中有特定被允許的人員進入,此為暫時的事件,以此延遲時間作為排除暫時被允許的事件。若不匹配(影像有變動)的情況維持了延遲時間或以上,則發出訊息(步驟S519),否則,若不匹配的情況並無維持此延遲時間,判斷排除此暫時事件,則繼續進行擷取後續影像的步驟(步驟S509)。In the step, if it is determined to be a match, the subsequent image is continuously captured (step S509). However, if the determination is not matched, a delay time may be further introduced as one of the conditions for determining, so as to determine the degree of association between the reference image and the subsequent image. In other words, as in step S517, it is judged whether or not a delay time is exceeded. In the determining step of the delay time, it is mainly to determine the degree of association between the reference image and the subsequent image, and also to determine whether the image mismatching condition maintains a delay time, which is used to avoid the possibility of a false positive event. For example, if a specific allowed person enters during the detection process, this is a temporary event, and the delay time is used as an event to exclude the temporary permission. If the delay (or the image is changed) is maintained for a delay time or longer, a message is sent (step S519). Otherwise, if the delay is not maintained, the delay is not maintained, and the temporary event is judged to be excluded. The step of subsequent image (step S509).

當發出訊息後,相關人員將進行處理,此為後續處理過程,在此並不贅述。之後,將解除此訊息相關資訊,比如解除警報(步驟S521),則回到最初步驟S501,重新執行取像、色度空間轉換、擷取色彩資訊、建立參考資訊,並後續擷取影像與計算匹配等步驟。After the message is sent, the relevant personnel will process it. This is the subsequent processing and will not be described here. After that, the information related to the message will be released, such as releasing the alarm (step S521), then returning to the initial step S501, re-executing the image capturing, chroma space conversion, capturing color information, establishing reference information, and subsequently capturing images and calculations. Match and other steps.

特別的是,若經上述參考影像與後續影像間的匹配運算與延遲時間的判斷,若判斷為關聯程度較低,可能表示攝影機拍攝的位置與角度被改變,或是攝影機被外物遮蔽。In particular, if the matching operation between the reference image and the subsequent image and the delay time are judged, if it is determined that the degree of association is low, it may indicate that the position and angle of the camera shooting are changed, or the camera is blocked by the foreign object.

或是,可針對特定空間中的特定物件進行偵測,若有物件遺失,此影像間關聯程度(參考匹配程度與時間延遲)將表現出來,包括色彩資訊產生差異,並且維持了一段時間。或是利用不匹配與維持了一段時間的資訊判斷特定空間是否新增不明其他物件。Or, it can detect specific objects in a specific space. If an object is lost, the degree of association between the images (reference matching and time delay) will be displayed, including the difference in color information, and it will be maintained for a while. Or use the information that does not match and maintain for a period of time to determine whether additional objects are added to the specific space.

另一實施例是,若上述影像間關聯程度較低,則發出觸發訊息,比如觸發攝影機開始錄製影像,或是進行其他程序,如停止錄製、發出特定警報等功能。另有實施例更透過判斷物件前後關聯程度較低,而判斷有進出的事件,進而啟動計數程序。In another embodiment, if the degree of association between the images is low, a trigger message is sent, such as triggering the camera to start recording an image, or performing other programs, such as stopping recording, issuing a specific alarm, and the like. In another embodiment, the number of contexts of the object is determined to be low, and the event of entering and exiting is judged, thereby starting the counting process.

另有實施例如第六圖所示本發明使用影像色彩資訊之處理方法的物件分類實施例流程圖。此例主要是應用上述第五圖所描述利用影像中色彩資訊作為比對判斷的計數,此例則應用於物件分類。Further, a flow chart of an object classification embodiment using the image color information processing method of the present invention shown in FIG. 6 is also implemented. This example mainly uses the color information in the image as the comparison judgment as described in the fifth figure above, and this example is applied to the object classification.

開始如步驟S601,進行取像,接著針對影像中特定物件或是空間擷取出物件色彩(Hue)資訊(步驟S603)。接著,如步驟S605,引入一資料庫,此資料庫中記載有各種影像物件的色彩特徵,特別是經過轉換至色彩-飽和度-亮度之色度空間的影像的色彩特徵,透過比對(步驟S607),能夠將所擷取的影像中的物件進行分類(步驟S609),如流程圖所示,將物件分類為類別一(步驟S611)、類別二(步驟S613)與類別三(步驟S615),或是更多類別。First, in step S601, image capturing is performed, and then the object color (Hue) information is extracted for a specific object or space in the image (step S603). Next, in step S605, a database is introduced, in which the color features of various image objects are recorded, in particular, the color characteristics of the image converted to the color-saturation-luminance chromaticity space, through the comparison (step S607), the objects in the captured images can be classified (step S609), and the objects are classified into category one (step S611), category two (step S613), and category three (step S615) as shown in the flowchart. , or more categories.

應用上述影像處理方法的系統可參考第七圖顯示的應用本發明使用影像色彩資訊之處理系統實施例示意圖。The system for applying the above image processing method can refer to the schematic diagram of the embodiment of the processing system using the image color information according to the seventh embodiment.

如圖所示,此系統之較佳實施例至少包括能擷取連續畫面的取像單元701,有一電性連接取像單元701的類比數位轉換單元703,通常透過鏡頭擷取的畫面為類比訊號,將透過類比數位轉換單元703數位化,並暫存於相互電性連接的暫存記憶體705。暫存記憶體705通常為設置於系統前端的快閃記憶體(flash)或是動態隨機記憶體(RAM),或可應用硬碟的中特定區塊。As shown in the figure, the preferred embodiment of the system includes at least an image capturing unit 701 capable of capturing a continuous picture, and an analog digital conversion unit 703 electrically connected to the image capturing unit 701. The image captured by the lens is analogous. It will be digitized by the analog digital conversion unit 703 and temporarily stored in the temporary storage memory 705 electrically connected to each other. The temporary storage memory 705 is usually a flash memory or a dynamic random access memory (RAM) disposed at the front end of the system, or a specific block in the hard disk.

系統中處理核心為處理單元707,其電性連結各電路,如圖所示,包括有暫存記憶體705、儲存單元709、通訊單元713與影像處理模組715。處理單元707用以處理所擷取的連續影像,並由其中擷取出參考影像與後續影像。其中儲存單元709用於儲存參考影像與一段時間內擷取的後續影像,可連接或是內建一資料庫711,根據上述實施例,資料庫711特別記載有各中影像、物件的資訊,記錄複數個物件類別的影像資訊,包括影像物件中經過色度空間轉換後擷取的色彩(Hue)特徵。The processing core in the system is a processing unit 707 electrically connected to each circuit. As shown, the system includes a temporary storage memory 705, a storage unit 709, a communication unit 713, and an image processing module 715. The processing unit 707 is configured to process the captured continuous image, and extract the reference image and the subsequent image therefrom. The storage unit 709 is configured to store the reference image and the subsequent image captured in a period of time, and may be connected or built into a database 711. According to the above embodiment, the database 711 specifically records information about each image and object, and records Image information of a plurality of object categories, including color (Hue) features captured in the image object after chroma space conversion.

另有通訊單元713,能以有線或無線通訊手段連接遠端控制機房70,控制機房70能遠端控制此使用影像色彩資訊之處理系統,並接收由該系統所傳遞的訊息,如應用於智能視頻監控系統上,透過控制機房70的監控,可即時收到各地保全系統傳遞的訊息。Another communication unit 713 can connect to the remote control room 70 by wired or wireless communication means, and the control room 70 can remotely control the processing system using the image color information, and receive the message transmitted by the system, such as applied to the smart. On the video surveillance system, by monitoring the control of the computer room 70, the information transmitted by the security system can be immediately received.

影像處理模組715由上述儲存單元709得到影像資訊,系統主要透過影像處理模組715中的色度空間轉換單元71執行色度空間轉換,於較佳實施例中,將連續影像中各幀原本所處的色度空間轉換為一色彩-飽和度-亮度之色度空間。The image processing module 715 obtains image information from the storage unit 709, and the system performs color space conversion through the chromaticity space conversion unit 71 in the image processing module 715. In the preferred embodiment, the frames in the continuous image are originally The chromaticity space is converted into a color-saturation-luminance chromaticity space.

透過其中色彩特徵擷取單元72擷取經色度空間轉換後的色彩(Hue)特徵(可針對特定物件),並排除其中飽和度與亮度的特徵。Through the color feature extraction unit 72, the chromaticity space-converted color (Hue) feature (which can be targeted to a specific object) is extracted, and the characteristics of saturation and brightness therein are excluded.

透過匹配運算單元73,運算參考影像與後續影像中各幀的色彩特徵間的的匹配值,藉此匹配運算判斷參考影像與各後續影像是否匹配,且根據其匹配程度判斷影像變動的情形。最後,透過門檻比對判斷物件的變化,以決定是否要發出訊息,比如判斷出物件有異常,即發出警報訊息。Through the matching operation unit 73, the matching value between the reference image and the color features of each frame in the subsequent image is calculated, thereby determining whether the reference image matches each subsequent image by the matching operation, and determining the image variation according to the matching degree. Finally, the threshold is compared to determine the change of the object to determine whether to send a message, such as determining that the object is abnormal, that is, issuing an alert message.

接著,第八圖至第十一圖顯示為應用本發明之各種實施例,但實際實施並不限於此。Next, the eighth to eleventh drawings show various embodiments to which the present invention is applied, but the actual implementation is not limited thereto.

如第八圖所示之遺失監控實施例。The lost monitoring embodiment as shown in the eighth figure.

攝影機80固定監控特定空間82,實施例中除了固定擷取特定空間外,更可定時轉動動態掃描一特定空間82,而由此空間82設定出一初始條件下的參考影像801,並由後續影像擷取比對影像802,經比對參考影像801與比對影像802的色彩(Hue)資訊,能夠判斷出被監控的空間中發生遺失的事件。此可能觸發保全系統。The camera 80 fixedly monitors the specific space 82. In addition to the fixed capture of the specific space, the embodiment can also periodically rotate the dynamic scan of a specific space 82, and thus the space 82 sets the reference image 801 under an initial condition, and the subsequent image is used. By comparing the comparison image 802, by comparing the color information (Hue) information of the reference image 801 and the comparison image 802, it is possible to determine that a lost event occurs in the monitored space. This may trigger a security system.

第九圖顯示遺留物監控之實施例。The ninth diagram shows an embodiment of the legacy monitoring.

攝影機90同樣針對一空間92或是動態掃描一固定的方向,由初始環境設定參考影像901,再透過後續影像得出比對影像902,經擷取色彩資訊、比對後,能夠得出有新增不明的物品。此同樣可觸發保全系統。The camera 90 also sets a reference direction for the space 92 or dynamic scanning. The reference image 901 is set by the initial environment, and the comparison image 902 is obtained through the subsequent image. After capturing the color information and comparing, the new image can be obtained. Unknown items. This also triggers the security system.

同理,如第十圖顯示為偵測鏡頭被移動之實施例,其中攝影機10先產生原本環境中的參考影像101,再比對影像102中不同的影像,可以發現攝影機被移動的事件,此可能觸發保全系統,作進一步處理。Similarly, as shown in the tenth embodiment, the embodiment in which the detecting lens is moved is performed, wherein the camera 10 first generates the reference image 101 in the original environment, and then compares the different images in the image 102 to find an event in which the camera is moved. The security system may be triggered for further processing.

比對上述參考影像與連續變動的比對影像,可以得到連續改變的影像,整合連續變動的畫面,可以描繪出一移動軌跡,如第十一圖所示,可透過具有魚眼鏡頭的攝影機11全程監控,並判斷出有連續移動的物件,如圖中所示的移動物112與移動物112’。Comparing the above reference image with the continuously changing contrast image, a continuously changed image can be obtained, and a continuously changing picture can be integrated, and a moving track can be drawn. As shown in FIG. 11, the camera 11 with a fisheye lens can be transmitted. The whole process is monitored and it is judged that there is a continuously moving object, such as the moving object 112 and the moving object 112' as shown in the figure.

綜上所述,本發明訊使用影像色彩資訊之處理系統、處理方法與影像分類方法,主要是透過將擷取之影像進行色度空間轉換,再擷取其中不被環境光影、亮暗影像判斷的色彩(Hue)資訊,之後經過匹配運算判斷匹配程度,以判斷出異常事件,其中具有較高的判斷率。In summary, the processing system, the processing method and the image classification method using the image color information of the present invention mainly perform the chromaticity space conversion by capturing the captured image, and then extracting the image without being judged by the ambient light and the bright and dark image. The color (Hue) information is then judged by the matching operation to determine the abnormality, which has a high judgment rate.

惟以上所述僅為本發明之較佳可行實施例,非因此即侷限本發明之專利範圍,故舉凡運用本發明說明書及圖示內容所為之等效結構變化,均同理包含於本發明之範圍內,合予陳明。However, the above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Therefore, equivalent structural changes that are made by using the specification and the contents of the present invention are equally included in the present invention. Within the scope, it is combined with Chen Ming.

21‧‧‧建築物21‧‧‧ buildings

23‧‧‧攝影機23‧‧‧ camera

25‧‧‧無線基地台25‧‧‧Wireless base station

27‧‧‧監控中心27‧‧‧Monitoring Center

701‧‧‧取像單元701‧‧‧Image capture unit

703‧‧‧類比數位轉換單元703‧‧‧ analog digital conversion unit

705‧‧‧暫存記憶體705‧‧‧ temporary memory

707‧‧‧處理單元707‧‧‧Processing unit

709‧‧‧儲存單元709‧‧‧ storage unit

711‧‧‧資料庫711‧‧‧Database

713‧‧‧通訊單元713‧‧‧Communication unit

70‧‧‧控制機房70‧‧‧Control room

715‧‧‧影像處理模組715‧‧‧Image Processing Module

71‧‧‧色度空間轉換單元71‧‧‧Chroma space conversion unit

72‧‧‧色彩特徵擷取單元72‧‧‧Color feature extraction unit

73‧‧‧匹配運算單元73‧‧‧Matching unit

80,90,10,11‧‧‧攝影機80, 90, 10, 11 ‧ ‧ camera

82,92,‧‧‧空間82,92,‧‧‧ space

801,901,101‧‧‧參考影像801,901,101‧‧‧Reference image

802,902,102‧‧‧比對影像802,902,102‧‧‧ alignment images

112,112’‧‧‧移動物112,112’‧‧‧moving objects

第一圖係為習知技術透過色彩圖表進行物件特徵辨識的方法;The first figure is a method for identifying the feature of an object through a color chart by a conventional technique;

第二圖係為本發明使用影像色彩資訊之處理系統之應用實施例示意圖;The second figure is a schematic diagram of an application embodiment of a processing system using image color information according to the present invention;

第三圖係為本發明使用影像色彩資訊之處理方法中計算匹配的步驟;The third figure is a step of calculating matching in the processing method of using image color information according to the present invention;

第四圖係為本發明所利用之色彩-飽和度-亮度之色度空間示意圖;The fourth figure is a chromaticity space diagram of color-saturation-luminance utilized by the present invention;

第五圖係為本發明使用影像色彩資訊之處理方法實施例流程圖;The fifth figure is a flow chart of an embodiment of a method for processing image color information according to the present invention;

第六圖係為本發明使用影像色彩資訊之處理方法的物件分類實施例流程圖;第七圖係為本發明使用影像色彩資訊之處理系統實施例示意圖;第八圖係為應用本發明之實施例之一;第九圖係為應用本發明之實施例之二;第十圖係為應用本發明之實施例之三;第十一圖係為應用本發明之實施例之四。The sixth figure is a flow chart of an object classification embodiment using the image color information processing method of the present invention; the seventh figure is a schematic diagram of an embodiment of a processing system using image color information according to the present invention; and the eighth figure is an application of the application of the present invention. The ninth embodiment is the third embodiment of the present invention; the eleventh embodiment is the third embodiment of the present invention;

S501...取像S501. . . Image capture

S503...進行色度空間轉換S503. . . Chroma space conversion

S505...擷取物件色彩資訊S505. . . Capture object color information

S507...建立參考資訊S507. . . Establish reference information

S509...取像S509. . . Image capture

S511...進行色度空間轉換S511. . . Chroma space conversion

S513...擷取物件色彩資訊S513. . . Capture object color information

S515...是否匹配S515. . . Whether it matches

S517...是否超過延遲時間S517. . . Whether the delay time is exceeded

S519...發出訊息S519. . . Send a message

S521...解除警報S521. . . All clear

Claims (22)

一種使用影像色彩資訊之處理方法,包括有:擷取一連續影像,並設定一參考影像;進行該參考影像中各幀的一色度空間轉換,係將該參考影像原來所處之色度空間轉換為一色彩-飽和度-亮度之色度空間;擷取該參考影像中一物件之色彩資訊,排除該參考影像之該物件於該色彩-飽和度-亮度之色度空間中的飽和度與亮度的資訊,以建立一參考資訊;擷取一後續影像;該後續影像中各幀進行該色度空間轉換,將該後續影像原來所處之色度空間轉換為該色彩-飽和度-亮度之色度空間;擷取該後續影像中該物件的色彩資訊,排除該後續影像之該物件於該色彩-飽和度-亮度之色度空間中的飽和度與亮度的資訊;透過一匹配門檻值所定義之範圍判斷該參考資訊與該後續影像中該物件的色彩資訊是否匹配;若判斷為匹配,則繼續擷取後續影像;以及若判斷不匹配,並維持一延遲時間,表示非誤判,則發出一訊息;若該不匹配的情況並無維持該延遲時間,表示為誤判,則進行擷取後續影像以使用影像色彩資訊處理的步驟。 A method for processing image color information includes: capturing a continuous image and setting a reference image; performing a chromaticity space conversion of each frame in the reference image, converting the chromaticity space in which the reference image is originally located a color-saturation-luminance chromaticity space; extracting color information of an object in the reference image, excluding saturation and brightness of the object in the color-saturation-luminance chromaticity space of the reference image Information to establish a reference information; capture a subsequent image; the chrominance space conversion is performed on each frame in the subsequent image, and the chromaticity space in which the subsequent image is originally converted is converted into the color-saturation-luminance color a color space; extracting color information of the object in the subsequent image, excluding the saturation and brightness information of the object in the color-saturation-luminance chromaticity space; defining by a matching threshold value The range determines whether the reference information matches the color information of the object in the subsequent image; if it is determined to be a match, the subsequent image is continuously captured; and if the judgment does not match And maintain a delay time, represents a non-false, issuing a message; if the mismatching is not maintaining the delay time is expressed as false, the step of capturing successive images using color image information processing is performed. 如申請專利範圍第1項所述之使用影像色彩資訊之處理方法,其中該參考影像或該後續影像原本所處之色度空 間為一紅-綠-藍色度空間,而影像資訊由紅、綠、藍顏色表達。 The method for processing image color information according to the first aspect of the patent application, wherein the reference image or the subsequent image is originally in a chromaticity space The space is a red-green-blue space, and the image information is expressed by red, green, and blue colors. 如申請專利範圍第1項所述之使用影像色彩資訊之處理方法,其中係透過該參考資訊與該色彩資訊之差異是否落於該匹配門檻值內來判斷是否匹配。 The method for processing image color information as described in claim 1 is to determine whether a match is made by whether the difference between the reference information and the color information falls within the matching threshold. 如申請專利範圍第3項所述之使用影像色彩資訊之處理方法,其中若判斷不匹配,則接著判斷不匹配的程度是否到達該匹配門檻值,更包括:若不匹配的程度並未到達該匹配門檻值,則繼續擷取後續影像;以及若不匹配的程度已達到或是超過該匹配門檻值,則發出該訊息。 The method for processing image color information according to claim 3, wherein if the judgment does not match, then it is determined whether the degree of the mismatch reaches the matching threshold, and further includes: if the degree of mismatch does not reach the Matching the threshold value continues to capture subsequent images; and if the degree of mismatch has reached or exceeded the matching threshold, the message is sent. 如申請專利範圍第1項所述之使用影像色彩資訊之處理方法,其中判斷不匹配時,根據該後續影像中該物件的色彩資訊的不匹配資訊描繪出該物件之移動路徑。 For example, in the method for processing image color information according to the first aspect of the patent application, wherein the mismatch is judged, the moving path of the object is drawn according to the mismatch information of the color information of the object in the subsequent image. 如申請專利範圍第1項所述之使用影像色彩資訊之處理方法,其中判斷不匹配時,根據該後續影像中該物件的色彩資訊的不匹配資訊判斷擷取該參考影像或是該後續影像的一攝影機被移動。 The method for processing image color information according to the first aspect of the patent application, wherein when the determination is not matched, determining whether to capture the reference image or the subsequent image according to the mismatch information of the color information of the object in the subsequent image A camera is moved. 如申請專利範圍第1項所述之使用影像色彩資訊之處理方法,其中判斷不匹配時,根據該後續影像中該物件的色彩資訊的不匹配資訊判斷擷取該參考影像或是該後續影像的一攝影機被遮蔽。 The method for processing image color information according to the first aspect of the patent application, wherein when the determination is not matched, determining whether to capture the reference image or the subsequent image according to the mismatch information of the color information of the object in the subsequent image A camera is shaded. 如申請專利範圍第1項所述之使用影像色彩資訊之處理方法,其中判斷不匹配時,根據該後續影像中該物件的 色彩資訊的不匹配資訊偵測到該物件遺失。 The method for processing image color information according to item 1 of the patent application, wherein when the determination is not matched, according to the object in the subsequent image The mismatch information of the color information detects that the object is missing. 如申請專利範圍第1項所述之使用影像色彩資訊之處理方法,其中判斷不匹配時,根據該後續影像中該物件的色彩資訊的不匹配資訊判斷有新增其他物件。 For example, in the processing method of using image color information according to the first aspect of the patent application, when the mismatch is judged, it is determined that other objects are added according to the mismatch information of the color information of the object in the subsequent image. 如申請專利範圍第1項所述之使用影像色彩資訊之處理方法,其中判斷不匹配時,該訊息為一觸發訊息,根據該後續影像中該物件的色彩資訊的不匹配資訊觸發擷取該參考影像或是該後續影像的一攝影機開始錄製影像。 The method for processing image color information according to the first aspect of the patent application, wherein when the determination is not matched, the message is a trigger message, and the reference is triggered according to the mismatch information of the color information of the object in the subsequent image. The image or a camera of the subsequent image begins recording the image. 如申請專利範圍第10項所述之使用影像色彩資訊之處理方法,其中判斷匹配時,即停止該攝影機錄製影像。 For example, in the processing method of using image color information as described in claim 10, in which the matching is judged, the camera is stopped to record an image. 如申請專利範圍第1項所述之使用影像色彩資訊之處理方法,其中判斷不匹配時,根據該後續影像中該物件的色彩資訊的不匹配資訊進行一計數程序。 For example, in the processing method of using image color information as described in claim 1, wherein the judging is not matched, a counting procedure is performed according to the mismatch information of the color information of the object in the subsequent image. 一種使用影像色彩資訊之影像分類方法,包括有:擷取一影像;進行一色度空間轉換,將該影像由原來所處之色度空間轉換為一色彩-飽和度-亮度之色度空間;擷取該影像中一物件之色彩資訊,排除該影像中該物件於該色彩-飽和度-亮度之色度空間中的飽和度與亮度的資訊;引入一資料庫,其中該資料庫記載有各種影像物件的色彩資訊;比對該物件之色彩資訊與儲存於該資料庫中的影像色彩資訊;以及根據比對,分類所擷取的影像中的該物件。 An image classification method using image color information, comprising: capturing an image; performing a chromaticity space conversion, converting the image from the original chromaticity space to a color-saturation-luminance chromaticity space; Taking the color information of an object in the image, excluding the information of the saturation and brightness of the object in the color-saturation-luminance chromaticity space of the image; introducing a database, wherein the database records various images The color information of the object; the color information of the object and the color information of the image stored in the database; and sorting the object in the captured image according to the comparison. 如申請專利範圍第13項所述之影像分類方法,其中該色度空間轉換為將該影像原來所處之色度空間轉換為一色彩-飽和度-亮度之色度空間。 The image classification method according to claim 13, wherein the chromaticity space is converted into a chromaticity space in which the original chromaticity space of the image is converted into a color-saturation-luminance. 如申請專利範圍第14項所述之影像分類方法,其中於擷取該影像中物件之色彩資訊的步驟時,即排除該物件於該色彩-飽和度-亮度之色度空間中的飽和度與亮度的資訊。 The image classification method according to claim 14, wherein the step of extracting the color information of the object in the image excludes the saturation of the object in the color-saturation-luminance chromaticity space. Brightness information. 如申請專利範圍第14項所述之影像分類方法,其中該影像原本所處之色度空間為一紅-綠-藍色度空間,而影像資訊由紅、綠、藍顏色表達。 The image classification method according to claim 14, wherein the original chromaticity space of the image is a red-green-blue space, and the image information is expressed by red, green and blue colors. 一種使用影像色彩資訊之處理系統,包括有:一取像單元,用於擷取一連續影像;一暫存記憶體,電性連接該取像單元,用於暫存該連續影像;一處理單元,電性連接該暫存記憶體與該取像單元,用以處理該連續影像,並由該連續影像中擷取出一參考影像與後續影像;一儲存單元,電性連接該處理單元,用以儲存該參考影像與一段時間內擷取的該後續影像;一影像處理模組,電性連接該處理單元,包括:一色度空間轉換單元,將該連續影像中各幀原本所處的色度空間轉換為一色彩-飽和度-亮度之色度空間;一色彩特徵擷取單元,將經該色度空間轉換的影像中擷取出一物件的色彩特徵,排除該飽和度與該亮度 的特徵;以及一匹配運算單元,係執行該參考影像中該物件與該連續影像中的物件間的匹配運算,並判斷其中色彩特徵是否匹配,其中:若根據各物件之色彩特徵判斷為匹配,則繼續擷取後續影像;以及若根據各物件之色彩特徵判斷為不匹配,並維持一延遲時間,表示非誤判;若該匹配的情況並無維持該延遲時間,表示為誤判,則繼續進行擷取後續影像以使用影像色彩資訊處理的步驟。 A processing system for using image color information, comprising: an image capturing unit for capturing a continuous image; a temporary memory, electrically connecting the image capturing unit for temporarily storing the continuous image; and a processing unit The storage unit and the image capturing unit are electrically connected to the continuous image, and a reference image and a subsequent image are extracted from the continuous image; a storage unit is electrically connected to the processing unit for Storing the reference image and the subsequent image captured during a period of time; an image processing module electrically connected to the processing unit, comprising: a chrominance space conversion unit, the chromaticity space in which each frame in the continuous image is originally located Converting to a color-saturation-luminance chromaticity space; a color feature capture unit that extracts the color feature of an object from the image converted by the chromaticity space, excluding the saturation and the brightness And a matching operation unit, performing a matching operation between the object in the reference image and an object in the continuous image, and determining whether the color features match, wherein: if the color feature is determined to be a match according to the color feature of each object, Then continue to capture subsequent images; and if it is judged as a mismatch according to the color characteristics of each object, and maintains a delay time, indicating that the delay is not misjudged; if the matching situation does not maintain the delay time, indicating that the error is judged, the process continues. Take subsequent images to use the steps of image color information processing. 如申請專利範圍第17項所述之使用影像色彩資訊之處理系統,更包括一類比數位轉換單元,電性連接該取像單元,將該影像進行類比數位轉換。 The processing system for using image color information as described in claim 17 further includes an analog-to-digital conversion unit electrically connected to the image capturing unit to perform analog-to-digital conversion of the image. 如申請專利範圍第17項所述之使用影像色彩資訊之處理系統,更包括一資料庫,電性連接該儲存單元,用以記錄複數個物件類別的影像資訊。 The processing system for using image color information as described in claim 17 further includes a database electrically connected to the storage unit for recording image information of a plurality of object categories. 如申請專利範圍第17項所述之使用影像色彩資訊之處理系統,更包括一通訊單元,一遠端控制中心可透過無線或有線通訊手段控制該使用影像色彩資訊之處理系統,並接收由該系統所傳遞的訊息。 The processing system for using image color information as described in claim 17 further includes a communication unit, and a remote control center can control the processing system using the image color information through wireless or wired communication means, and receive the The message passed by the system. 如申請專利範圍第20項所述之使用影像色彩資訊之處理系統,其中該訊息為一警報訊息。 A processing system using image color information as described in claim 20, wherein the message is an alert message. 如申請專利範圍第17項所述之使用影像色彩資訊之處理系統,其中該連續影像中各幀原本所處的色度空間為一紅-綠-藍色度空間。 The processing system for using image color information according to claim 17, wherein the chromaticity space in which each frame in the continuous image is originally is a red-green-blue space.
TW98141221A 2009-12-02 2009-12-02 System and method of image processing based on color information, and method for image categorization using the same TWI421795B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW98141221A TWI421795B (en) 2009-12-02 2009-12-02 System and method of image processing based on color information, and method for image categorization using the same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW98141221A TWI421795B (en) 2009-12-02 2009-12-02 System and method of image processing based on color information, and method for image categorization using the same

Publications (2)

Publication Number Publication Date
TW201120817A TW201120817A (en) 2011-06-16
TWI421795B true TWI421795B (en) 2014-01-01

Family

ID=45045320

Family Applications (1)

Application Number Title Priority Date Filing Date
TW98141221A TWI421795B (en) 2009-12-02 2009-12-02 System and method of image processing based on color information, and method for image categorization using the same

Country Status (1)

Country Link
TW (1) TWI421795B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9633432B2 (en) 2015-08-05 2017-04-25 National Tsing Hua University Image analysis method and apparatus for assessment of peritoneal dialysis complication in peritoneal dialysis

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI448976B (en) * 2011-08-05 2014-08-11 Shinsoft Co Ltd Ultra-wide-angle imaging method and system using the same
TWI575956B (en) * 2015-04-21 2017-03-21 神達電腦股份有限公司 Video recording method by dynamically adjusting the picture frame rate and video recording device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030142209A1 (en) * 2002-01-25 2003-07-31 Sadahiko Yamazaki Moving object monitoring surveillance apparatus
EP0967584B1 (en) * 1998-04-30 2004-10-20 Texas Instruments Incorporated Automatic video monitoring system
TW200941404A (en) * 2008-03-26 2009-10-01 You-Guang Deng Image auto-analysis and naming system and its classification and recognition method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0967584B1 (en) * 1998-04-30 2004-10-20 Texas Instruments Incorporated Automatic video monitoring system
US20030142209A1 (en) * 2002-01-25 2003-07-31 Sadahiko Yamazaki Moving object monitoring surveillance apparatus
TW200941404A (en) * 2008-03-26 2009-10-01 You-Guang Deng Image auto-analysis and naming system and its classification and recognition method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Jeehoon Park, YoungSu Park and Sang Woo Kim, "AGV Parrking System using Artificial Visual Landmark", International Conference on Control, Automation and Systems 2008. *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9633432B2 (en) 2015-08-05 2017-04-25 National Tsing Hua University Image analysis method and apparatus for assessment of peritoneal dialysis complication in peritoneal dialysis

Also Published As

Publication number Publication date
TW201120817A (en) 2011-06-16

Similar Documents

Publication Publication Date Title
CN102117484B (en) Processing system, processing method and image classification method using image color information
US11842564B2 (en) Imaging apparatus and imaging system
CN112560657B (en) Method, device, computer device and storage medium for identifying smoke and fire
US11100350B2 (en) Method and system for object classification using visible and invisible light images
CN107944359B (en) Flame detecting method based on video
EP3648448B1 (en) Target feature extraction method and device, and application system
KR100922784B1 (en) Image base fire sensing method and system of crime prevention and disaster prevention applying method thereof
KR101215948B1 (en) Image information masking method of monitoring system based on face recognition and body information
JP4803376B2 (en) Camera tampering detection method
US6411209B1 (en) Method and apparatus to select the best video frame to transmit to a remote station for CCTV based residential security monitoring
US8922674B2 (en) Method and system for facilitating color balance synchronization between a plurality of video cameras and for obtaining object tracking between two or more video cameras
CN201726494U (en) Device and system which utilize image color information to conduct image comparison
KR101442669B1 (en) Method and apparatus for criminal acts distinction using intelligent object sensing
KR20230036024A (en) Electric vehicle charger fire detection and charger condition prediction system
JP3486229B2 (en) Image change detection device
JP2004219277A (en) Method and system, program, and recording medium for detection of human body
CN107688793A (en) A kind of outside transformer substation fire automatic monitoring method for early warning
TWI421795B (en) System and method of image processing based on color information, and method for image categorization using the same
Celik et al. Computer vision based fire detection in color images
CN102999994A (en) Flame detection device based on video image analysis
WO2022044369A1 (en) Machine learning device and image processing device
KR102046591B1 (en) Image Monitoring System and Method for Monitoring Image
US20210142101A1 (en) System and method for preprocessing sequential video images for fire detection based on deep learning and method of training deep learning network for fire detection
JP2020171057A (en) Imaging device
KR20140109671A (en) Flame dete ction method based on gray imaging signal of a cameras