TWI777620B - Automated traffic steering quantitative survey report output system and method - Google Patents

Automated traffic steering quantitative survey report output system and method Download PDF

Info

Publication number
TWI777620B
TWI777620B TW110122015A TW110122015A TWI777620B TW I777620 B TWI777620 B TW I777620B TW 110122015 A TW110122015 A TW 110122015A TW 110122015 A TW110122015 A TW 110122015A TW I777620 B TWI777620 B TW I777620B
Authority
TW
Taiwan
Prior art keywords
vehicle
deep learning
module
learning model
steering
Prior art date
Application number
TW110122015A
Other languages
Chinese (zh)
Other versions
TW202301291A (en
Inventor
王宏生
高郁承
溫基信
林宗
Original Assignee
訊力科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 訊力科技股份有限公司 filed Critical 訊力科技股份有限公司
Priority to TW110122015A priority Critical patent/TWI777620B/en
Application granted granted Critical
Publication of TWI777620B publication Critical patent/TWI777620B/en
Publication of TW202301291A publication Critical patent/TW202301291A/en

Links

Images

Landscapes

  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

一種自動化交通轉向量化調查報告產出系統及其方法,包括至少一影像擷取裝置及至少一主機。影像擷取裝置擷取一量測區域之路口影像後,傳送到主機進行分析,主機在該量測區域設定路口之判定線及進階判定區,接著訓練一深度學習模型以分析車輛的類別及位置;主機計算車輛之軌跡資訊後,利用判定線判斷車輛之行進方向,當軌跡資訊出現連續斷幀時,更利用進階判定區修正車輛的進出方向,並將此進出方向及軌跡資訊進行資料處理,產生轉向量報表。藉由本發明可即時產生報表,並提高物件追蹤的精準度。An automated traffic steering quantitative investigation report generating system and method thereof, comprising at least one image capturing device and at least one host. After the image capture device captures an intersection image in a measurement area, it is sent to the host for analysis. The host sets the intersection determination line and advanced determination area in the measurement area, and then trains a deep learning model to analyze the types of vehicles and Position; after the host computer calculates the trajectory information of the vehicle, it uses the judgment line to determine the traveling direction of the vehicle. When the trajectory information is continuously broken, the advanced judgment area is used to correct the vehicle's inbound and outbound direction, and the inbound and outbound direction and trajectory information are used for data. Processing to generate a diversion report. By means of the present invention, a report can be generated in real time, and the accuracy of object tracking can be improved.

Description

自動化交通轉向量化調查報告產出系統及其方法Automated traffic steering quantitative survey report output system and method

本發明係有關一種交通狀態分析,特別是指一種自動化交通轉向量化調查報告產出系統及其方法。 The invention relates to a traffic state analysis, in particular to an automatic traffic steering quantitative investigation report output system and method thereof.

道路路口因為車流交會、車輛轉彎、機車待轉等情況,容易發生各種意外狀況,因此政府交通單位需針對各大路口進行交通轉向量調查。然而,傳統人工調查因人工極限,只做短時間交通調查,無法全面提供整體性資料蒐集,且物件分類只侷限幾項,如大型車、小型車、機車,無法提供細節總類分類。 Road intersections are prone to various unexpected situations due to traffic meeting, vehicle turning, and locomotive waiting to turn. Therefore, government traffic units need to conduct traffic steering volume surveys at major intersections. However, traditional manual surveys only do short-term traffic surveys due to labor limitations, and cannot provide comprehensive data collection, and the classification of objects is limited to a few items, such as large cars, small cars, and locomotives, and cannot provide detailed general classification.

另有一種利用攝影機擷取道路影像進行分析的方法,但目前是採用魚眼攝影機,其雖可拍攝360度影像視角,但因魚眼攝影機採用之魚眼鏡頭其光學成像之限制,在影像的邊緣區域容易產生變形及成像品質不佳等問題,難以進行完整車輛行越路口行為分析之影像辨識與追蹤。且魚眼攝影機無法涵蓋大型交岔路口所有物件行為,特別是機車兩段式左轉偵測便可能超出影像範圍而無法偵測。 There is another method that uses a camera to capture road images for analysis, but currently a fisheye camera is used. Although it can shoot a 360-degree image angle of view, due to the limitation of the optical imaging of the fisheye lens used by the fisheye camera, the image is limited. The edge area is prone to problems such as deformation and poor imaging quality, and it is difficult to perform image recognition and tracking for complete vehicle crossing behavior analysis. Moreover, fisheye cameras cannot cover the behavior of all objects at large intersections, especially the two-stage left-turn detection of locomotives may exceed the image range and cannot be detected.

有鑑於此,本發明針對上述習知技術之缺失及未來之需求,提出一種自動化交通轉向量化調查報告產出系統及其方法,以有效解決上述該等問題,具體架構及其實施方式將詳述於下: In view of this, the present invention proposes an automated traffic steering quantitative survey report output system and method to effectively solve the above-mentioned problems in view of the above-mentioned deficiencies and future needs of the prior art. The specific structure and its implementation will be described in detail. Below:

本發明之主要目的在提供一種自動化交通轉向量化調查報告產出系統及其方法,其在路口設置判定線及進階判定區,解決判定線被大型物件遮擋或物件偵測失效等問題。 The main purpose of the present invention is to provide an automatic traffic steering quantitative survey report output system and method, which set up a judgment line and an advanced judgment area at the intersection to solve the problems of the judgment line being blocked by large objects or the failure of object detection.

本發明之另一目的在提供一種自動化交通轉向量化調查報告產出系統及其方法,其搭配深度學習模型及軌跡演算法,可使分析效果更好,達到準確度高、速度快的優點。 Another object of the present invention is to provide an automated traffic steering quantitative survey report generation system and method thereof, which, combined with a deep learning model and a trajectory algorithm, can improve the analysis effect and achieve the advantages of high accuracy and high speed.

本發明之再一目的在提供一種自動化交通轉向量化調查報告產出系統及其方法,其在路口採用超廣角攝影機擷取影像,可看到路口全貌之位置,解決過往不易觀測完整車輛行越路口之行為。 Yet another object of the present invention is to provide an automated traffic steering quantitative survey report output system and method, which use an ultra-wide-angle camera to capture images at intersections, and can see the entire position of the intersection, which solves the problem that it is difficult to observe complete vehicles crossing the intersection in the past. behavior.

為達上述目的,本發明提供一種自動化交通轉向量化調查報告產出系統,包括:至少一影像擷取裝置,擷取一量測區域之複數路口影像;以及至少一主機,訊號連接影像擷取裝置,接收路口影像並進行分析,以產生一轉向量報表,主機中包括:一深度學習模型模組,利用一深度學習模型資料訓練出一深度學習模型,再將路口影像輸入到深度學習模型中,分析至少一車輛的類別及位置;一軌跡運算模組,連接深度學習模型模組,依照時序從深度學習學習模組讀取車輛之類別及位置,並計算出車輛之軌跡資訊,包括識別序號、類別及位置;一車輛轉向分析模組,連接軌跡運算模組,利用車輛之軌跡資訊及判定線判斷車輛之行進方向,當軌跡資訊出現連續斷幀時,利用進階判定區修正車輛進出進階判定區之方向,車輛轉向分析模組並 輸出車輛之進出方向及軌跡資訊;以及一報表產出模組,連接車輛轉向分析模組,對車輛之進出方向及軌跡資訊進行資料處理,產生轉向量報表。 In order to achieve the above object, the present invention provides an automated traffic steering quantitative survey report generation system, comprising: at least one image capture device for capturing images of a plurality of intersections in a measurement area; and at least one host computer for signal connection to the image capture device , receives the intersection image and analyzes it to generate a steering volume report. The host includes: a deep learning model module, which uses a deep learning model data to train a deep learning model, and then inputs the intersection image into the deep learning model. Analyze the type and position of at least one vehicle; a trajectory computing module, connected to the deep learning model module, reads the type and position of the vehicle from the deep learning learning module according to the time sequence, and calculates the trajectory information of the vehicle, including the identification serial number, Type and position; a vehicle steering analysis module, connected to the trajectory calculation module, uses the vehicle's trajectory information and the judgment line to determine the vehicle's travel direction, and when the trajectory information has continuous frame breaks, the advanced judgment area is used to correct the vehicle's entry and exit. To determine the direction of the area, the vehicle turns to the analysis module and Output the vehicle's inbound and outbound direction and trajectory information; and a report output module, which is connected to the vehicle steering analysis module to process data on the vehicle's inbound and outbound direction and trajectory information to generate a steering volume report.

依據本發明之實施例,更包括一初始化模組,連接該深度學習模型模組及該車輛轉向分析模組,提供該深度學習模型資料、該至少一判定線及該至少一進階判定區。 According to an embodiment of the present invention, an initialization module is further included, which is connected to the deep learning model module and the vehicle steering analysis module, and provides the deep learning model data, the at least one determination line and the at least one advanced determination area.

依據本發明之實施例,初始化模組係利用cv2函數連接影像擷取裝置的輸出,讀取路口影像。 According to an embodiment of the present invention, the initialization module uses the cv2 function to connect the output of the image capture device to read the intersection image.

依據本發明之實施例,初始化模組載入之深度學習模型資料包括深度學習模型之參數及相關演算法。 According to an embodiment of the present invention, the deep learning model data loaded by the initialization module includes parameters of the deep learning model and related algorithms.

依據本發明之實施例,深度學習模型模組訓練深度學習模型之步驟包括:收集不同種類之車輛的至少一公開資料集;收集路口之複數需求資料;利用一影像標註工具對需求資料進行資料標註,及利用公開資料集定義車輛之類別;將已標註的需求資料輸入一深度學習神經網路中進行模型訓練,輸出一深度學習初始模型;以及針對不同路口之特徵進行模型優化,產生深度學習模型。 According to an embodiment of the present invention, the steps of training the deep learning model by the deep learning model module include: collecting at least one public data set of different types of vehicles; collecting plural demand data of intersections; and using an image labeling tool to mark the demand data. , and use the public data set to define the type of vehicle; input the marked demand data into a deep learning neural network for model training, and output an initial deep learning model; and optimize the model according to the characteristics of different intersections to generate a deep learning model .

依據本發明之實施例,軌跡運算模組讀取車輛之類別及位置後,更包括下列步驟:利用一線性速度模型及一卡爾曼濾波器對第n個時間點的車輛之類別及位置進行預測,預測第n+1個時間點的車輛之類別及位置;利用一匈牙利演算法對第n個時間點及第n+1個時間點的車輛進行關聯連結;以及計算出關聯連結後的車輛之軌跡資訊,包括識別序號、類別及位置。 According to an embodiment of the present invention, after the trajectory computing module reads the type and position of the vehicle, it further includes the following steps: using a linear velocity model and a Kalman filter to predict the type and position of the vehicle at the nth time point , predict the type and location of the vehicle at the n+1th time point; use a Hungarian algorithm to associate the nth time point and the n+1th time point with the vehicle; Track information, including identification number, category, and location.

依據本發明之實施例,車輛轉向分析模組讀取軌跡運算模組所傳送的車輛之軌跡資訊後,更包括下列步驟:判斷是否有車輛之軌跡資訊中之 任一者出現連續斷幀超過一預設值,若是,則判定出現連續斷幀的車輛為異常軌跡且已離開量測區域,並產生車輛進出量測區域的一起點資訊及一終點資訊,若否,則繼續偵測;利用判定線結合起點資訊及終點資訊,判斷出現連續斷幀的車輛的行進方向;以及利用進階判定區對出現連續斷幀的車輛之進出方向進行修正,再輸出出現連續斷幀的車輛之進出方向及軌跡資訊。 According to an embodiment of the present invention, after the vehicle steering analysis module reads the trajectory information of the vehicle transmitted by the trajectory calculation module, it further includes the following steps: judging whether there is any part of the trajectory information of the vehicle; The continuous frame break in any one of them exceeds a preset value. If so, it is determined that the vehicle with the continuous frame break has an abnormal trajectory and has left the measurement area, and the first point information and the end point information of the vehicle entering and leaving the measurement area are generated. No, continue to detect; use the judgment line to combine the starting point information and the ending point information to judge the traveling direction of the vehicle with continuous frame breakage; and use the advanced judgment area to correct the entry and exit directions of the vehicle with continuous frame breakage, and then output the The entry and exit directions and trajectory information of vehicles with continuous frame breaks.

依據本發明之實施例,報表產出模組根據不同量測區域,對車輛之進出方向及軌跡資訊做不同種類的數據處理。 According to the embodiment of the present invention, the report generating module performs different types of data processing on the in-out direction and trajectory information of the vehicle according to different measurement areas.

依據本發明之實施例,報表產出模組根據需求對輸出轉向量報表的輸出格式做客製化調整,包括調整輸出轉向量報表中的小客車當量(passenger car unit,PCU)、類別參數。 According to an embodiment of the present invention, the report output module makes customized adjustments to the output format of the output steering amount report according to requirements, including adjusting the passenger car unit (PCU) and category parameters in the output steering amount report.

本發明更提供一種自動化交通轉向量化調查報告產出方法,包括下列步驟:利用至少一影像擷取裝置擷取一量測區域之複數路口影像;路口影像被傳送到一主機進行分析,主機中之一深度學習模型模組利用一深度學習模型資料訓練出一深度學習模型,再將路口影像輸入到深度學習模型中,分析至少一車輛的類別及位置;主機中之一軌跡運算模組依照時序從深度學習學習模組讀取車輛之類別及位置,並計算出車輛之軌跡資訊,包括識別序號、類別及位置;主機中之一車輛轉向分析模組利用車輛之軌跡資訊及判定線判斷車輛之行進方向,當軌跡資訊出現連續斷幀時,利用進階判定區修正車輛進出進階判定區之方向,車輛轉向分析模組並輸出車輛之進出方向及軌跡資訊;以及主機中之一報表產出模組對車輛之進出方向及軌跡資訊進行資料處理,產生轉向量報表。 The present invention further provides a method for producing an automated traffic steering quantitative survey report, comprising the following steps: capturing a plurality of intersection images in a measurement area by using at least one image capture device; A deep learning model module uses a deep learning model data to train a deep learning model, and then inputs the intersection image into the deep learning model to analyze the type and position of at least one vehicle; The deep learning learning module reads the type and position of the vehicle, and calculates the trajectory information of the vehicle, including the identification serial number, type and position; a vehicle steering analysis module in the host uses the trajectory information and judgment line of the vehicle to determine the vehicle's travel. Direction, when there are continuous frame breaks in the trajectory information, the advanced judgment area is used to correct the direction of the vehicle entering and exiting the advanced judgment area, the vehicle steering analysis module and output the vehicle's entry and exit direction and trajectory information; and a report output module in the host. The group performs data processing on the vehicle's inbound and outbound direction and trajectory information, and generates a steering amount report.

10:自動化交通轉向量化調查報告產出系統 10: Automated Traffic Steering Quantitative Survey Report Output System

12:影像擷取裝置 12: Image capture device

20:主機 20: Host

202:初始化模組 202: Initialize the module

204:深度學習模型模組 204: Deep Learning Model Module

206:軌跡運算模組 206: Trajectory operation module

208:車輛轉向分析模組 208: Vehicle Steering Analysis Module

209:報表產出模組 209: Report output module

28:大型車輛 28: Large Vehicles

30、31:判定線 30, 31: Judgment line

34:進階判定區 34: Advanced Judgment Area

36:進階判定區 36: Advanced Judgment Area

第1圖為本發明自動化交通轉向量化調查報告產出系統之方塊圖。 Fig. 1 is a block diagram of the automatic traffic steering quantitative survey report output system of the present invention.

第2圖為本發明自動化交通轉向量化調查報告產出系統中初始化模組之流程圖。 Fig. 2 is a flow chart of the initialization module in the automatic traffic steering quantitative survey report output system of the present invention.

第3圖為本發明自動化交通轉向量化調查報告產出系統中深度學習模型模組之流程圖。 FIG. 3 is a flowchart of the deep learning model module in the automated traffic steering quantitative survey report output system of the present invention.

第4圖為本發明自動化交通轉向量化調查報告產出系統中深度學習模型模組的前置作業之訓練流程圖。 FIG. 4 is a training flow chart of the pre-operation of the deep learning model module in the automated traffic steering quantitative survey report output system of the present invention.

第5圖為本發明自動化交通轉向量化調查報告產出系統中軌跡運算模組之流程圖。 FIG. 5 is a flow chart of the trajectory calculation module in the automatic traffic steering quantitative survey report output system of the present invention.

第6圖為本發明自動化交通轉向量化調查報告產出系統中車輛轉向分析模組之流程圖。 FIG. 6 is a flow chart of the vehicle steering analysis module in the automatic traffic steering quantitative survey report output system of the present invention.

第7圖為本發明自動化交通轉向量化調查報告產出系統中報表產出模組之流程圖。 FIG. 7 is a flow chart of the report output module in the automatic traffic diversion quantitative survey report output system of the present invention.

第8A圖及第8B圖為本發明中設置判定線及進階判定區之示意圖。 FIG. 8A and FIG. 8B are schematic diagrams of setting the determination line and the advanced determination area in the present invention.

本發明提供一種自動化交通轉向量化調查報告產出系統及其方法,用以即時、快速處理大數據的路口影像,並產出高精準度的交通轉向量報表,達到即時大數據分析的目的。 The invention provides an automatic traffic steering quantitative investigation report generating system and method thereof, which are used for real-time and rapid processing of big data intersection images, and outputting high-precision traffic steering quantity reports, so as to achieve the purpose of real-time big data analysis.

請參考第1圖,其為本發明自動化交通轉向量化調查報告產出系統之方塊圖。本發明之自動化交通轉向量化調查報告產出系統10包括至少一影像擷取裝置12及至少一主機20,此主機20設在路燈、交通號誌或路口的其他裝置上,可近距離與影像擷取裝置12連線。在一實施例中,主機20為小體 積的機盒,可進行影像處理及資料運算。影像擷取裝置12可為攝影機或其它可連續擷取影像畫面的機器,擷取道路路口一量測區域之複數路口影像,在一最佳實施例中,本發明採用的影像擷取裝置12是超廣角攝影機,單一個超廣角攝影機中就包括至少兩個鏡頭,故可達到超廣角度擷取影像畫面的目的。在一實施例中,若為大型路口,可同時使用兩個影像擷取裝置12對立拍攝,以確保整個路口都有拍攝到;主機20與影像擷取裝置12訊號連接,接收路口影像並進行分析,以產生一轉向量報表。主機20中包括一初始化模組202、一深度學習模型模組204、一軌跡運算模組206、一車輛轉向分析模組208及一報表產出模組209。深度學習模型模組204連接初始化模組202,軌跡運算模組206連接深度學習模型模組204,車輛轉向分析模組208連接初始化模組202及軌跡運算模組206,報表產出模組209連接車輛轉向分析模組208。以下藉由第2圖至第7圖詳細說明該些模組之做動流程。 Please refer to FIG. 1 , which is a block diagram of an automated traffic steering quantitative survey report output system of the present invention. The automated traffic steering quantification survey report generating system 10 of the present invention includes at least one image capture device 12 and at least one host 20. The host 20 is installed on street lights, traffic signs or other devices at intersections, and can capture images at close distances. Take the device 12 and connect it. In one embodiment, the host 20 is a small body The integrated chassis can perform image processing and data calculation. The image capture device 12 can be a camera or other machine that can continuously capture image frames to capture multiple intersection images in a measurement area of a road intersection. In a preferred embodiment, the image capture device 12 used in the present invention is For an ultra-wide-angle camera, a single ultra-wide-angle camera includes at least two lenses, so the purpose of capturing images at an ultra-wide angle can be achieved. In one embodiment, if it is a large-scale intersection, two image capture devices 12 can be used to shoot oppositely at the same time to ensure that the entire intersection is captured; the host 20 is connected to the image capture device 12 for signal connection to receive and analyze the image of the intersection. , to generate a vector report. The host 20 includes an initialization module 202 , a deep learning model module 204 , a trajectory calculation module 206 , a vehicle steering analysis module 208 and a report generation module 209 . The deep learning model module 204 is connected to the initialization module 202, the trajectory calculation module 206 is connected to the deep learning model module 204, the vehicle steering analysis module 208 is connected to the initialization module 202 and the trajectory calculation module 206, and the report generation module 209 is connected to Vehicle steering analysis module 208 . The operation flow of these modules will be described in detail below with reference to FIG. 2 to FIG. 7 .

請同時參考第2圖,其為本發明自動化交通轉向量化調查報告產出系統10中初始化模組202之流程圖。首先,於步驟S10中,初始化模組202連接影像擷取裝置12的輸出,讀取路口影像,特別的是,本發明係利用cv2函數連接影像擷取裝置12的輸出,以利於未來讀取影像的速度快速方便。接著步驟S12中,初始化模組202載入系統所需的預設值,如一深度學習模型資料,其中包括深度學習模型之參數及相關演算法。接著步驟S14中,針對路口方向的量測區域設定至少一判定線,以方便偵測車流進出位置及計數。再於步驟S16中,針對路口方向的量測區域設定至少一進階判定區,例如斑馬線後的區塊、十字路口中央平分成四等分區域等等,以優化判定線的判定結 果。步驟S14的判定線及步驟S16的進階判定區亦可由外部設定完成後再匯入初始化模型202中。 Please also refer to FIG. 2 , which is a flowchart of the initialization module 202 in the automated traffic steering quantitative survey report generation system 10 of the present invention. First, in step S10, the initialization module 202 connects the output of the image capture device 12 to read the image of the intersection. In particular, the present invention uses the cv2 function to connect the output of the image capture device 12 to facilitate future image reading The speed is fast and convenient. Next, in step S12, the initialization module 202 loads the default values required by the system, such as a deep learning model data, which includes parameters of the deep learning model and related algorithms. Next, in step S14, at least one determination line is set for the measurement area in the direction of the intersection, so as to facilitate the detection and counting of the incoming and outgoing positions of the traffic flow. In step S16, at least one advanced determination area is set for the measurement area in the direction of the intersection, such as the block behind the zebra crossing, the area divided into four equal parts at the center of the intersection, etc., so as to optimize the determination result of the determination line. fruit. The determination line in step S14 and the advanced determination area in step S16 can also be set externally and then imported into the initialization model 202 .

接著進入深度學習模型模組204的流程,請同時參考第3、4圖,其分別為本發明自動化交通轉向量化調查報告產出系統10中深度學習模型模組204之流程圖及訓練深度學習模型模組204之前置作業流程圖,且此前置作業是在一後端伺服器(圖中未示)中進行,當前置作業完成後,後端伺服器再將訓練好的深度學習模型提供給主機20中的深度學習模型模組204。首先於步驟S20先訓練一深度學習模型模組204,訓練方法請參考第4圖。第4圖之步驟S202中,收集不同種類之車輛的至少一公開資料集;接著於步驟S204中進一步收集路口之複數需求資料。步驟S206中,利用一影像標註工具(如Labelimage)對需求資料進行資料標註,及利用公開資料集定義車輛之類別,如卡車、小卡車、小客車、公車等;步驟208中,將已標註的需求資料輸入一深度學習神經網路中進行模型訓練,訓練後輸出一深度學習初始模型;最後於步驟S209,因應不同路口之特徵進行客製化的模型優化,例如三叉路口、停車場、雪地路口等特殊情況會有特殊的特徵,有別於一般的路口特徵,因此客製化的模型可提高精準度或提高運算速度,產生自動化交通轉向量化調查報告產出系統10所需要的深度學習模型,並將此優化後的深度學習模型佈署到主機20。 Then enter the process of the deep learning model module 204, please refer to Figures 3 and 4 at the same time, which are the flow chart of the deep learning model module 204 and the training deep learning model in the automatic traffic steering quantitative survey report output system 10 of the present invention, respectively. The flow chart of the pre-operation of the module 204, and this pre-operation is performed in a back-end server (not shown in the figure), after the pre-operation is completed, the back-end server provides the trained deep learning model To the deep learning model module 204 in the host 20 . First, in step S20, a deep learning model module 204 is trained. Please refer to FIG. 4 for the training method. In step S202 of FIG. 4, at least one public data set of different types of vehicles is collected; then, in step S204, plural demand data of intersections are further collected. In step S206, an image labeling tool (such as Labelimage) is used to label the required data, and a public data set is used to define the types of vehicles, such as trucks, small trucks, passenger cars, buses, etc.; The required data is input into a deep learning neural network for model training, and an initial deep learning model is output after training; finally, in step S209, customized model optimization is performed according to the characteristics of different intersections, such as three-way intersections, parking lots, and snow intersections. In special cases such as traffic jams, there will be special characteristics, which are different from general intersection characteristics. Therefore, the customized model can improve the accuracy or increase the calculation speed, and generate the deep learning model required by the automatic traffic steering quantitative investigation report output system 10. And deploy the optimized deep learning model to the host 20 .

當深度學習模型的前置作業步驟S20完成後,請回到第3圖之步驟S22,深度學習模型模組204讀取路口影像,接著於步驟S24中將路口影像輸入到深度學習模型中,分析至少一車輛的類別及位置,如步驟S26所述。特別是步驟S26還採用了邊緣運算,將路口影像的資料運算成統計資料,不但 可提供即時分析數據,更無須使用大量網路頻寬將高畫質影像傳輸回後端伺服器運算分析,使資料傳輸量大幅減小。 When the pre-operation step S20 of the deep learning model is completed, please go back to step S22 in FIG. 3, where the deep learning model module 204 reads the intersection image, and then inputs the intersection image into the deep learning model in step S24 for analysis. The type and location of at least one vehicle are as described in step S26. In particular, step S26 also adopts edge calculation, which calculates the data of the intersection image into statistical data, not only It can provide real-time analysis data, and it does not need to use a lot of network bandwidth to transmit high-quality images back to the back-end server for calculation and analysis, which greatly reduces the amount of data transmission.

第5圖為本發明自動化交通轉向量化調查報告產出系統10中軌跡運算模組206之流程圖。步驟S30中,軌跡運算模組206依照時序從深度學習學習模組204讀取車輛之類別及位置。接著步驟S32中,利用包含一線性速度模型及一卡爾曼濾波器的模型對第n個時間點的車輛之類別及位置進行預測,預測第n+1個時間點的車輛之類別及位置。步驟S34中,再利用一種關於多目標追蹤(Multiple Object Tracking,MOT)的演算法對第n個時間點及第n+1個時間點的車輛進行關聯連結,較佳實施例為匈牙利演算法,雖然還有比匈牙利演算法精準度更好的其他演算法,但由於本發明的系統裝設在小體積精簡式的主機20中,所以相較於大型主機來說,運算能力較為受限。因此,採用匈牙利演算法能夠在追蹤的效率和準確率兩者上可取得平衡,是多目標追蹤演算法中的較佳選擇。最後於步驟S36中,將關聯連結後的車輛之軌跡資訊進行整理,得到包括車輛的識別序號、類別及位置等資訊,其中,每一時間點取得的路口影像為一幀,會得到一個車輛的識別序號,連續軌跡就會有連續的識別序號。若有障礙物遮擋導致軌跡中斷,例如大型車擋住了目標車輛,則就會發生斷幀的情況。 FIG. 5 is a flow chart of the trajectory calculation module 206 in the automated traffic steering quantitative survey report generation system 10 of the present invention. In step S30, the trajectory calculation module 206 reads the type and position of the vehicle from the deep learning module 204 according to the time sequence. Next, in step S32, a model including a linear velocity model and a Kalman filter is used to predict the type and position of the vehicle at the nth time point, and the type and position of the vehicle at the n+1th time point are predicted. In step S34, a kind of algorithm about multi-object tracking (Multiple Object Tracking, MOT) is used to associate and link the vehicles at the nth time point and the n+1th time point, the preferred embodiment is the Hungarian algorithm, Although there are other algorithms with better accuracy than the Hungarian algorithm, since the system of the present invention is installed in a compact and compact mainframe 20, the computing power is relatively limited compared to a mainframe. Therefore, using the Hungarian algorithm can achieve a balance between the tracking efficiency and accuracy, and is a better choice in the multi-target tracking algorithm. Finally, in step S36, the track information of the linked vehicles is sorted to obtain information including the identification number, category and location of the vehicle, wherein the intersection image obtained at each time point is a frame, and the information of a vehicle will be obtained. Identification number, continuous track will have continuous identification number. If there is an obstacle blocking the trajectory, such as a large car blocking the target vehicle, a broken frame will occur.

接著請參考第6圖,其為本發明自動化交通轉向量化調查報告產出系統10中車輛轉向分析模組208之流程圖。首先於步驟S40中,車輛轉向分析模組208讀取軌跡運算模組206所傳送的車輛之軌跡資訊,接著於步驟S41判斷是否有車輛之軌跡資訊中之任一者出現連續斷幀超過一預設值,例如是否有哪一台車輛的識別序號連續中斷30個號碼,等於連續斷幀達到30幀。若 有,則判定出現連續斷幀的車輛為異常軌跡且已離開量測區域,產生車輛進出量測區域的一起點資訊及一終點資訊並進入步驟S42;若否,則回到步驟S40繼續偵測。步驟S42中利用判定線結合起點資訊及終點資訊,判斷出現連續斷幀的車輛的行進方向;接著,步驟S44中分析連續斷幀的該車輛穿過了哪些進階判定區,再於步驟S46利用進階判定區演算法對出現連續斷幀的車輛進出方向進行修正。最後,便可於步驟S48輸出出現連續斷幀的該車輛之進出方向及軌跡資訊。 Next, please refer to FIG. 6 , which is a flowchart of the vehicle steering analysis module 208 in the automated traffic steering quantitative survey report generating system 10 of the present invention. First, in step S40, the vehicle steering analysis module 208 reads the trajectory information of the vehicle transmitted by the trajectory calculation module 206, and then in step S41, it is determined whether any of the trajectory information of the vehicle has a continuous frame break for more than a predetermined time. Set the value, such as whether there is any vehicle whose identification serial number is interrupted by 30 consecutive numbers, which is equal to the number of consecutive interrupted frames reaching 30 frames. like If yes, then it is determined that the vehicle with continuous frame breaks is an abnormal track and has left the measurement area, and the first point information and an end point information of the vehicle entering and leaving the measurement area are generated, and then go to step S42; if not, go back to step S40 to continue detecting . In step S42, the determination line is used to combine the starting point information and the end point information to determine the direction of travel of the vehicle with continuous frame breakage; then, in step S44, the advanced judgment area that the vehicle with the continuous frame breakage has passed through is analyzed, and then in step S46, using The advanced decision area algorithm corrects the in and out directions of vehicles with continuous frame breaks. Finally, in step S48, the entry and exit direction and track information of the vehicle with continuous frame breakage can be output.

接著請參考第7圖,其為本發明自動化交通轉向量化調查報告產出系統10中報表產出模組209之流程圖。步驟S50中報表產出模組209從車輛轉向分析模組208接收對車輛之進出方向及軌跡資訊,接著於步驟S52根據不同量測區域,對車輛之進出方向及軌跡資訊做不同種類的數據處理,舉例而言,大型路口需要兩個影像擷取裝置12對立拍攝,其中一台影像擷取裝置12需做鏡像處理,影像的方向才會一致。接著步驟S54依據使用者的需求對輸出轉向量報表的輸出格式做客製化調整,包括調整輸出轉向量報表中的小客車當量(Passenger Car Unit,PCU)、類別參數等。最後步驟S56輸出轉向量報表。 Next, please refer to FIG. 7 , which is a flow chart of the report generating module 209 in the automatic traffic steering quantitative survey report generating system 10 of the present invention. In step S50, the report generating module 209 receives the information on the in-out direction and trajectory of the vehicle from the vehicle steering analysis module 208, and then in step S52, according to different measurement areas, different types of data processing are performed on the in-out direction and trajectory information of the vehicle. For example, a large intersection requires two image capture devices 12 to be photographed oppositely, and one of the image capture devices 12 needs to be mirrored so that the directions of the images are consistent. Next, step S54 customizes the adjustment of the output format of the output steering amount report according to the user's needs, including adjusting the passenger car unit (PCU) and category parameters in the output steering amount report. The final step S56 outputs the steering amount report.

第8A圖及第8B圖分別為本發明中設置判定線及輔助設置進階判定區之示意圖。一般而言,十字路口的上、右、下、左四個路口會分別以A、B、C、D代表,如第8A圖所示。在車輛進出路口的位置設置合適的感應線段做為判定線,例如D方向的判定線30和C方向的判定線31。圖中雖未標出A方向和B方向的判定線,但仍可有判定線存在A、B方向的二路口。判定線的判斷方法是,只要車輛通過二條判定線,系統10便可以依照線段的位置來判 斷車輛的進出路口方向。舉例而言,假設車輛通過一判定線30後,若再通過另一判定線,便可判斷車輛不是直走,並進一步判斷車輛是右轉或左轉。例如若車輛通過判定線30後,接著通過判定線31,便可判定車輛是從D方向向右轉到C方向。此方法相當直觀,但當面對斷軌的目標物,例如目標車輛被大型車輛28遮擋或物件偵測失效時,需要依照距離去尋找距離最接近的判定線。此做法會因為2D畫面角度的問題導致目標物位置偏移,使距離有誤差,進而影響判斷。 8A and 8B are schematic diagrams of setting a determination line and an auxiliary setting of an advanced determination area in the present invention, respectively. Generally speaking, the upper, right, lower, and left intersections of the intersection are represented by A, B, C, and D, respectively, as shown in Figure 8A. Appropriate sensing line segments are set at the position of the vehicle entering and exiting the intersection as the judgment line, for example, the judgment line 30 in the D direction and the judgment line 31 in the C direction. Although the judgment lines in the A and B directions are not marked in the figure, there may still be a judgment line at the two intersections in the A and B directions. The judging method of the judgment line is that as long as the vehicle passes through the two judgment lines, the system 10 can judge according to the position of the line segment. Cut off the direction of the vehicle entering and exiting the intersection. For example, if the vehicle passes through a determination line 30, if it passes another determination line, it can be determined that the vehicle is not going straight, and it is further determined whether the vehicle is turning right or left. For example, if the vehicle passes the determination line 30 and then passes the determination line 31, it can be determined that the vehicle is turning from the D direction to the right direction C. This method is quite intuitive, but when facing a target object with a broken track, for example, when the target vehicle is blocked by a large vehicle 28 or the object detection fails, it is necessary to find the closest determination line according to the distance. This method will cause the position of the target object to shift due to the problem of the 2D picture angle, which will cause errors in the distance, which will affect the judgment.

因此,在第8B圖中另外設置進階判定區34、36,在判定線判斷的基礎上,輔助預測結果。當目標車輛的軌跡線被大型物件遮擋(如第8A圖所示之大型車輛28)而使軌跡中斷時,面對斷軌的軌跡線,本發明藉由特別的對應矩陣,達到仿人的智慧來做到精確判斷斷軌的目標車輛。如第8B圖所示,假設目標車輛由D往B方向移動,因為被大型車輛28遮擋而導致起始點在點S而終點在點E。若單純只使用判定線的方式判斷車輛轉向,起點會因為角度問題而導致距離A方位的判定線較近,起點會被判定為A,但事實上目標車輛的起點為D。若增加進階判定區34、36輔助判斷,可以事先讓電腦學習當點S在進階判定區34、點E在進階判定區36時的目標車輛移動軌跡為何,間接輔助電腦判斷結果。增加進階判定區輔助判斷的準確度較好、速度較快。單純使用判定線與增加進階判定區輔助判斷的效能分析如下表一:

Figure 110122015-A0305-02-0011-1
Therefore, in Fig. 8B, advanced judgment areas 34 and 36 are additionally provided to assist the prediction result based on the judgment of the judgment line. When the trajectory of the target vehicle is blocked by a large object (such as the large vehicle 28 shown in FIG. 8A ) and the trajectory is interrupted, in the face of the trajectory of the broken track, the present invention uses a special corresponding matrix to achieve human-like wisdom To accurately determine the target vehicle that has broken the track. As shown in FIG. 8B , it is assumed that the target vehicle moves from D to B direction, and the starting point is at point S and the end point is at point E because it is blocked by the large vehicle 28 . If only the determination line is used to determine the steering of the vehicle, the starting point will be closer to the determination line of the A azimuth due to the angle problem, and the starting point will be determined as A, but in fact the starting point of the target vehicle is D. If the advanced judgment areas 34 and 36 are added to assist judgment, the computer can learn in advance what the target vehicle's trajectory is when point S is in the advanced judgment area 34 and point E is in the advanced judgment area 36, and indirectly assist the computer to judge the result. Increase the accuracy and speed of the auxiliary judgment in the advanced judgment area. The efficacy analysis of simply using the judgment line and adding the advanced judgment area to assist judgment is shown in Table 1:
Figure 110122015-A0305-02-0011-1

從實驗結果可知,使用進階判定區輔助的判斷效能是較好的,僅有卡車、小卡車(pickup-truck)在準確率上有下降情況。但因為卡車與小卡車在訓練集與測試集中占比非常少(0.63%、2.06%),訓練樣本不足導致偵測錯誤。在僅使用判定線的情況下,卻意料之外將判斷錯誤的結果對應到了正確的方向,並非判定線的準確率較高所致。其餘車種的表現都有不錯的提升,占比很高(39.60%)的機車更是有接近20%的準確率提升。由於機車體積小,在畫面上常會因為被體積較大的車種(如公車、卡車、小客車等)遮擋導致軌跡演算法追蹤失敗,而使軌跡線斷軌,若僅使用判定線判斷車輛軌跡會造成判斷錯誤。而使用進階判定區輔助,會讓電腦事先學習有關斷軌的判斷方法,從而解決這個問題。藉由效能評估可得出進階判定區對於輔助電腦判斷轉向量有很大的功用。雖然表一中計程車的提升幅度有限,僅提升2.89%,但那是受限於系統本身偵測效能的準確率還有待調整。若系統的樣本數增加,深度學習模型經過更多訓練,將使偵測效能提升,從而使進階判定區對於準確率的影響漸趨明顯。 From the experimental results, it can be seen that the judgment performance of using the advanced judgment area assistance is better, and only trucks and pickup trucks (pickup-truck) have a decrease in the accuracy rate. However, because trucks and small trucks account for very little in the training set and test set (0.63%, 2.06%), insufficient training samples lead to detection errors. When only the judgment line is used, the result of the judgment error is unexpectedly mapped to the correct direction, which is not due to the high accuracy of the judgment line. The performance of the rest of the vehicles has improved well, and the locomotives with a high proportion (39.60%) have an accuracy improvement of nearly 20%. Due to the small size of the locomotive, the trajectory algorithm will fail to track due to being blocked by larger vehicles (such as buses, trucks, passenger cars, etc.) on the screen, and the trajectory line will be broken. cause errors in judgment. Using the Advanced Judgment Area as an aid will allow the computer to learn in advance how to judge the track break, so as to solve this problem. Through the performance evaluation, it can be concluded that the advanced judgment area has a great function in assisting the computer in judging the steering amount. Although the improvement of taxis in Table 1 is limited, only 2.89%, but it is limited by the accuracy of the detection performance of the system itself and needs to be adjusted. If the number of samples in the system increases, the deep learning model will undergo more training, which will improve the detection performance, so that the impact of the advanced judgment area on the accuracy will gradually become more obvious.

本發明另具有一去識別化模組(圖中未示)。去識別化的目的是為了隱藏路口影像中的個人資訊,例如臉孔、車牌等,本發明之系統會使用定界框(bounding box)框出目標物體,對定界框內部的圖像進行馬賽克之類的模糊處理,達到去識別化的功能。本發明之系統所產出的結果只針對目標物的類別,例如車種、行人、腳踏車等,做相關數據分析,最終輸出的轉向量報表不會留下有關個資的數據。 The present invention also has a de-identification module (not shown in the figure). The purpose of de-identification is to hide personal information in the intersection image, such as faces, license plates, etc. The system of the present invention will use a bounding box to frame the target object, and mosaic the image inside the bounding box. Such fuzzy processing to achieve the function of de-identification. The results produced by the system of the present invention are only for the types of the target objects, such as vehicle types, pedestrians, bicycles, etc., to do relevant data analysis, and the final output steering amount report will not leave data related to personal information.

本發明還具有一天候分析因子模組(圖中未示)。天氣分析系統將分為兩階段進行。第一階段會致力於區分出晴天與雨天,使用方法為將雨 滴物件投入深度學習模型中進行訓練與建立模型,對路口影像進行雨滴的物件偵測,若偵測超過一定閥值,則判斷天氣為雨天。在一實施例中,深度學習模型可間隔N分鐘(N=30)進行一次雨滴偵測,以降低偵測時間來降低對原轉向量系統的影響。第二階段則針對陰天的部分,需要擷取到天空中的畫面,並不適用於所有路口的情況,且陰天在交通上影響的情況較小,所以優先度放在較後的階段。陰天的判別方法在一實施例中使用自動偵測路口影像中的天空部分,對天空的區塊進行RGB分析或者直接投入深度學習模型中,判斷天氣是否為陰天。 The present invention also has a weather analysis factor module (not shown in the figure). The weather analysis system will be carried out in two phases. The first stage will focus on distinguishing between sunny days and rainy days. The drop object is put into the deep learning model for training and model building, and the object detection of raindrops is carried out on the intersection image. If the detection exceeds a certain threshold, the weather is judged to be rainy. In one embodiment, the deep learning model may perform raindrop detection at intervals of N minutes (N=30) to reduce the detection time and reduce the impact on the original steering system. The second stage is for the cloudy part, which needs to capture the picture in the sky, which is not suitable for all intersections, and the cloudy day has less impact on the traffic, so the priority is placed in the later stage. In one embodiment, the method for discriminating cloudy days uses automatic detection of the sky part in the intersection image, performs RGB analysis on the sky block or directly inputs it into the deep learning model to determine whether the weather is cloudy or not.

綜上所述,本發明所提供之一種自動化交通轉向量化調查報告產出系統及其方法,採用超廣角攝影機,外接即時分析AI主機,搭配深度學習模型、軌跡演算法等分析工具,提供全自動輸出交通轉向量報表,並具有去識別化功能與天候分析因子功能。因此,較之先前技術不論是人工調查或利用判定線分析,本發明進一步結合了進階判定區的設置,可使分析效果更好,達到準確度高、速度快的優點。 To sum up, the present invention provides an automatic traffic steering quantitative survey report production system and method, which adopts an ultra-wide-angle camera, an external real-time analysis AI host, and is equipped with analysis tools such as a deep learning model and a trajectory algorithm to provide a fully automatic Output traffic diversion report, and has the function of de-identification and weather analysis factor. Therefore, compared with the prior art, whether it is manual investigation or analysis using the judgment line, the present invention further combines the setting of the advanced judgment area, which can make the analysis effect better, and achieve the advantages of high accuracy and fast speed.

唯以上所述者,僅為本發明之較佳實施例而已,並非用來限定本發明實施之範圍。故即凡依本發明申請範圍所述之特徵及精神所為之均等變化或修飾,均應包括於本發明之申請專利範圍內。 Only the above descriptions are only preferred embodiments of the present invention, and are not intended to limit the scope of the present invention. Therefore, all equivalent changes or modifications made according to the features and spirits described in the scope of the application of the present invention shall be included in the scope of the application for patent of the present invention.

10:自動化交通轉向量化調查報告產出系統 10: Automated Traffic Steering Quantitative Survey Report Output System

12:影像擷取裝置 12: Image capture device

20:主機 20: Host

202:初始化模組 202: Initialize the module

204:深度學習模型模組 204: Deep Learning Model Module

206:軌跡運算模組 206: Trajectory operation module

208:車輛轉向分析模組 208: Vehicle Steering Analysis Module

209:報表產出模組 209: Report output module

Claims (18)

一種自動化交通轉向量化調查報告產出系統,包括:至少一影像擷取裝置,擷取一量測區域之複數路口影像;以及至少一主機,訊號連接該至少一影像擷取裝置,接收該等路口影像並進行分析,以產生一轉向量報表,該至少一主機中包括:一深度學習模型模組,接收一深度學習模型資料以訓練出一深度學習模型,再將該等路口影像輸入到該深度學習模型中,分析至少一車輛的類別及位置;一軌跡運算模組,連接該深度學習模型模組,依照時序從該深度學習學習模組讀取該至少一車輛之類別及位置,並計算出該至少一車輛之軌跡資訊,包括車輛之識別序號、類別及位置;一車輛轉向分析模組,連接該軌跡運算模組,利用該車輛之軌跡資訊及至少一判定線判斷該至少一車輛之行進方向,並在當該軌跡資訊出現連續斷幀時,再利用至少一進階判定區修正該至少一車輛進出該至少一進階判定區之方向,該車輛轉向分析模組並輸出該至少一車輛之進出方向及軌跡資訊;以及一報表產出模組,連接該車輛轉向分析模組,對該至少一車輛之進出方向及軌跡資訊進行資料處理,產生該轉向量報表。 An automated traffic steering quantification investigation report output system, comprising: at least one image capture device for capturing images of a plurality of intersections in a measurement area; and at least one host for signal connection to the at least one image capture device to receive the intersections The image is analyzed to generate a steering report. The at least one host includes: a deep learning model module, receiving a deep learning model data to train a deep learning model, and then inputting the intersection images into the depth In the learning model, the type and position of at least one vehicle are analyzed; a trajectory calculation module is connected to the deep learning model module, reads the type and position of the at least one vehicle from the deep learning learning module according to the time sequence, and calculates The trajectory information of the at least one vehicle includes the identification number, type and location of the vehicle; a vehicle steering analysis module is connected to the trajectory computing module, and uses the trajectory information of the vehicle and at least one determination line to determine the travel of the at least one vehicle direction, and when the trajectory information has continuous frame breaks, at least one advanced determination area is used to correct the direction of the at least one vehicle entering and exiting the at least one advanced determination area, the vehicle turns to the analysis module and outputs the at least one vehicle and a report output module, which is connected to the vehicle steering analysis module, and performs data processing on the inbound and outbound direction and trajectory information of the at least one vehicle to generate the steering amount report. 如請求項1所述之自動化交通轉向量化調查報告產出系統,更包括一初始化模組,連接該深度學習模型模組及該車輛轉向分析模組,提供該深度學習模型資料、該至少一判定線及該至少一進階判定區。 The automated traffic steering quantitative investigation report generating system as described in claim 1, further comprising an initialization module, connecting the deep learning model module and the vehicle steering analysis module, and providing the deep learning model data, the at least one judgment line and the at least one advanced determination area. 如請求項2所述之自動化交通轉向量化調查報告產出系統,其中該初始化模組係利用cv2函數連接該至少一影像擷取裝置的輸出,讀取該等路口影像。 The automatic traffic steering quantification survey report generating system according to claim 2, wherein the initialization module uses the cv2 function to connect the output of the at least one image capturing device to read the intersection images. 如請求項2所述之自動化交通轉向量化調查報告產出系統,其中該初始化模組載入之該深度學習模型資料包括該深度學習模型之參數及相關演算法。 The automatic traffic steering quantitative survey report generating system according to claim 2, wherein the deep learning model data loaded by the initialization module includes parameters of the deep learning model and related algorithms. 如請求項1所述之自動化交通轉向量化調查報告產出系統,其中該深度學習模型模組訓練該深度學習模型之步驟包括:收集不同種類之車輛的至少一公開資料集;收集該路口之複數需求資料;利用一影像標註工具對該等需求資料進行資料標註,及利用該至少一公開資料集定義車輛之類別;將已標註的該等需求資料輸入一深度學習神經網路中進行模型訓練,輸出一深度學習初始模型;以及針對不同路口之特徵進行模型優化,產生該深度學習模型。 The automatic traffic steering quantitative survey report output system as claimed in claim 1, wherein the step of training the deep learning model by the deep learning model module comprises: collecting at least one public data set of different types of vehicles; collecting plural numbers of the intersections demand data; use an image labeling tool to mark the demand data, and use the at least one public data set to define the type of vehicle; input the marked demand data into a deep learning neural network for model training, Output an initial deep learning model; and optimize the model according to the characteristics of different intersections to generate the deep learning model. 如請求項1所述之自動化交通轉向量化調查報告產出系統,其中該軌跡運算模組讀取該至少一車輛之類別及位置後,更包括下列步驟:利用一線性速度模型及一卡爾曼濾波器對第n個時間點的該至少一車輛之類別及位置進行預測,預測第n+1個時間點的該至少一車輛之類別及位置; 利用一匈牙利演算法對第n個時間點及第n+1個時間點的該至少一車輛進行關聯連結;以及計算出關聯連結後的該至少一車輛之軌跡資訊。 The automated traffic steering quantification investigation report generating system as claimed in claim 1, wherein after the trajectory computing module reads the type and position of the at least one vehicle, the following steps are further included: using a linear velocity model and a Kalman filter predicting the type and position of the at least one vehicle at the nth time point, and predicting the type and position of the at least one vehicle at the n+1th time point; Using a Hungarian algorithm to associate and link the at least one vehicle at the n th time point and the n+1 th time point; and calculate the track information of the at least one vehicle after the association link. 如請求項1所述之自動化交通轉向量化調查報告產出系統,其中該車輛轉向分析模組讀取該軌跡運算模組所傳送的該至少一車輛之軌跡資訊後,更包括下列步驟:判斷是否有該至少一車輛之軌跡資訊中之任一者出現連續斷幀超過一預設值,若是,則判定出現連續斷幀的該車輛為異常軌跡且已離開該量測區域,並產生該車輛進出該量測區域的一起點資訊及一終點資訊,若否,則繼續偵測;利用該至少一判定線結合該起點資訊及該終點資訊,判斷出現連續斷幀的該車輛的行進方向;以及利用該至少一進階判定區對出現連續斷幀的該車輛之進出方向進行修正,再輸出出現連續斷幀的該車輛之進出方向及軌跡資訊。 The automated traffic steering quantification investigation report generating system according to claim 1, wherein after the vehicle steering analysis module reads the trajectory information of the at least one vehicle transmitted by the trajectory computing module, it further comprises the following steps: judging whether Any one of the trajectory information of the at least one vehicle has a continuous frame break exceeding a predetermined value, if so, it is determined that the vehicle with the continuous frame break is an abnormal track and has left the measurement area, and the vehicle enters and exits The starting point information and the ending point information of the measurement area, if not, continue to detect; use the at least one determination line to combine the starting point information and the ending point information to determine the traveling direction of the vehicle with continuous frame breaks; and use the The at least one advanced judging area corrects the entry and exit directions of the vehicle with continuous frame breakage, and then outputs the entry and exit direction and track information of the vehicle with continuous frame breakage. 如請求項1所述之自動化交通轉向量化調查報告產出系統,其中該報表產出模組根據不同量測區域,對該至少一車輛之進出方向及軌跡資訊做不同種類的數據處理。 The automatic traffic steering quantitative survey report output system as claimed in claim 1, wherein the report output module performs different types of data processing on the inbound and outbound direction and trajectory information of the at least one vehicle according to different measurement areas. 如請求項1所述之自動化交通轉向量化調查報告產出系統,其中該報表產出模組根據需求對該輸出轉向量報表的輸出格式做客製化調整,包括調整該輸出轉向量報表中的小客車當量(passenger car unit,PCU)、類別參數。 The automatic traffic steering quantitative survey report output system according to claim 1, wherein the report output module makes customized adjustments to the output format of the output steering volume report according to requirements, including adjusting the small value in the output steering volume report. Passenger car equivalent (passenger car unit, PCU), category parameters. 一種自動化交通轉向量化調查報告產出方法,包括下列步驟:利用至少一影像擷取裝置擷取一量測區域之複數路口影像;該等路口影像被傳送到一主機進行分析;該主機中之一深度學習模型模組利用一深度學習模型資料訓練出一深度學習模型,再將該等路口影像輸入到該深度學習模型中,分析至少一車輛的類別及位置;該主機中之一軌跡運算模組依照時序從該深度學習學習模組讀取該至少一車輛之類別及位置,並計算出該至少一車輛之軌跡資訊,包括識別序號、類別及位置;該主機中之一車輛轉向分析模組利用該車輛之軌跡資訊及至少一判定線判斷該至少一車輛之行進方向,當該軌跡資訊出現連續斷幀時,利用該至少一進階判定區修正該至少一車輛進出至少一進階判定區之方向,該車輛轉向分析模組並輸出該至少一車輛之進出方向及軌跡資訊;以及該主機中之一報表產出模組對該至少一車輛之進出方向及軌跡資訊進行資料處理,產生該轉向量報表。 A method for producing an automated traffic steering quantitative investigation report, comprising the following steps: capturing a plurality of intersection images in a measurement area by using at least one image capture device; the intersection images are transmitted to a host for analysis; one of the hosts The deep learning model module uses a deep learning model data to train a deep learning model, and then inputs the intersection images into the deep learning model to analyze the type and position of at least one vehicle; a trajectory calculation module in the host Read the type and position of the at least one vehicle from the deep learning learning module according to the time series, and calculate the trajectory information of the at least one vehicle, including the identification number, type and position; a vehicle steering analysis module in the host uses The trajectory information of the vehicle and the at least one determination line determine the traveling direction of the at least one vehicle, and when the trajectory information has continuous frame breaks, the at least one advanced determination area is used to correct the at least one vehicle entering and exiting the at least one advanced determination area. direction, the vehicle steering analysis module and output the inbound and outbound direction and trajectory information of the at least one vehicle; and a report output module in the host performs data processing on the inbound and outbound direction and trajectory information of the at least one vehicle to generate the steering volume report. 如請求項10所述之自動化交通轉向量化調查報告產出方法,更包括利用一初始化模組提供該深度學習模型資料給該深度學習模型模組,及提供該路口之該至少一判定線及該至少一進階判定區給該車輛轉向分析模組。 The method for producing an automated traffic steering quantification survey report as claimed in claim 10, further comprising using an initialization module to provide the deep learning model data to the deep learning model module, and providing the at least one determination line of the intersection and the At least one advanced determination area is assigned to the vehicle steering analysis module. 如請求項11所述之自動化交通轉向量化調查報告產出方法,其中該初始化模組係利用cv2函數連接該至少一影像擷取裝置的輸出,讀取該等路口影像。 The method for producing an automated traffic steering quantitative survey report as claimed in claim 11, wherein the initialization module uses the cv2 function to connect the output of the at least one image capture device to read the intersection images. 如請求項11所述之自動化交通轉向量化調查報告產出方法,其中該初始化模組載入之該深度學習模型資料包括該深度學習模型之參數及相關演算法。 The method for producing an automated traffic steering quantitative survey report according to claim 11, wherein the deep learning model data loaded by the initialization module includes parameters of the deep learning model and related algorithms. 如請求項10所述之自動化交通轉向量化調查報告產出方法,其中該深度學習模型模組訓練該深度學習模型之步驟包括:收集不同種類之車輛的至少一公開資料集;收集該路口之複數需求資料;利用一影像標註工具對該等需求資料進行資料標註,及利用該至少一公開資料集定義車輛之類別;將已標註的該等需求資料輸入一深度學習神經網路中進行模型訓練,輸出一深度學習初始模型;以及針對不同路口之特徵進行模型優化,產生該深度學習模型。 The method for producing an automated traffic steering quantification survey report according to claim 10, wherein the step of training the deep learning model by the deep learning model module comprises: collecting at least one public data set of different types of vehicles; collecting the plural numbers of the intersection. demand data; use an image labeling tool to mark the demand data, and use the at least one public data set to define the type of vehicle; input the marked demand data into a deep learning neural network for model training, Output an initial deep learning model; and optimize the model according to the characteristics of different intersections to generate the deep learning model. 如請求項10所述之自動化交通轉向量化調查報告產出方法,其中該軌跡運算模組讀取該至少一車輛之類別及位置後,更包括下列步驟:利用一線性速度模型及一卡爾曼濾波器對第n個時間點的該至少一車輛之類別及位置進行預測,預測第n+1個時間點的該至少一車輛之類別及位置; 利用一匈牙利演算法對第n個時間點及第n+1個時間點的該至少一車輛進行關聯連結;以及計算出關聯連結後的該至少一車輛之軌跡資訊。 The method for generating an automated traffic steering quantification survey report as claimed in claim 10, wherein after the trajectory computing module reads the type and position of the at least one vehicle, it further comprises the following steps: using a linear velocity model and a Kalman filter predicting the type and position of the at least one vehicle at the nth time point, and predicting the type and position of the at least one vehicle at the n+1th time point; Using a Hungarian algorithm to associate and link the at least one vehicle at the n th time point and the n+1 th time point; and calculate the track information of the at least one vehicle after the association link. 如請求項10所述之自動化交通轉向量化調查報告產出方法,其中該車輛轉向分析模組讀取該軌跡運算模組所傳送的該至少一車輛之軌跡資訊後,更包括下列步驟:判斷是否有該至少一車輛之軌跡資訊中之任一者出現連續斷幀超過一預設值,若是,則判定出現連續斷幀的該車輛為異常軌跡且已離開該量測區域,並產生該車輛進出該量測區域的一起點資訊及一終點資訊,若否,則繼續偵測;利用該至少一判定線結合該起點資訊及該終點資訊,判斷出現連續斷幀的該車輛的行進方向;以及利用該至少一進階判定區對出現連續斷幀的該車輛之進出方向進行修正,再輸出出現連續斷幀的該車輛之進出方向及軌跡資訊。 The method for generating an automated traffic steering quantification survey report according to claim 10, wherein after the vehicle steering analysis module reads the trajectory information of the at least one vehicle transmitted by the trajectory calculation module, it further comprises the following steps: judging whether Any one of the trajectory information of the at least one vehicle has a continuous frame break exceeding a predetermined value, if so, it is determined that the vehicle with the continuous frame break is an abnormal track and has left the measurement area, and the vehicle enters and exits The starting point information and the ending point information of the measurement area, if not, continue to detect; use the at least one determination line to combine the starting point information and the ending point information to determine the traveling direction of the vehicle with continuous frame breaks; and use the The at least one advanced judging area corrects the entry and exit directions of the vehicle with continuous frame breakage, and then outputs the entry and exit direction and track information of the vehicle with continuous frame breakage. 如請求項10所述之自動化交通轉向量化調查報告產出方法,其中該報表產出模組根據不同量測區域,對該至少一車輛之進出方向及軌跡資訊做不同種類的數據處理。 The method for generating an automated traffic steering quantitative survey report according to claim 10, wherein the report generating module performs different types of data processing on the inbound and outbound direction and trajectory information of the at least one vehicle according to different measurement areas. 如請求項10所述之自動化交通轉向量化調查報告產出方法,其中該報表產出模組根據需求對該輸出轉向量報表的輸出格式做客製化調整,包括調整該輸出轉向量報表中的小客車當量(passenger car unit,PCU)、類別參數。 The method for producing an automated traffic steering quantitative survey report according to claim 10, wherein the report output module makes customized adjustments to the output format of the output steering quantity report according to requirements, including adjusting the small value in the output steering quantity report. Passenger car equivalent (passenger car unit, PCU), category parameters.
TW110122015A 2021-06-17 2021-06-17 Automated traffic steering quantitative survey report output system and method TWI777620B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW110122015A TWI777620B (en) 2021-06-17 2021-06-17 Automated traffic steering quantitative survey report output system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW110122015A TWI777620B (en) 2021-06-17 2021-06-17 Automated traffic steering quantitative survey report output system and method

Publications (2)

Publication Number Publication Date
TWI777620B true TWI777620B (en) 2022-09-11
TW202301291A TW202301291A (en) 2023-01-01

Family

ID=84958042

Family Applications (1)

Application Number Title Priority Date Filing Date
TW110122015A TWI777620B (en) 2021-06-17 2021-06-17 Automated traffic steering quantitative survey report output system and method

Country Status (1)

Country Link
TW (1) TWI777620B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170169705A1 (en) * 2015-12-15 2017-06-15 Nissan North America, Inc. Traffic signal timing estimation using an artificial neural network model
CN108364466A (en) * 2018-02-11 2018-08-03 金陵科技学院 A kind of statistical method of traffic flow based on unmanned plane traffic video
TW202004702A (en) * 2018-06-04 2020-01-16 義碩智能股份有限公司 Artificial intelligence traffic detection system
CN112767687A (en) * 2020-12-24 2021-05-07 重庆中信科信息技术有限公司 Intersection congestion prediction method based on commuting path selection behavior analysis

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170169705A1 (en) * 2015-12-15 2017-06-15 Nissan North America, Inc. Traffic signal timing estimation using an artificial neural network model
CN108364466A (en) * 2018-02-11 2018-08-03 金陵科技学院 A kind of statistical method of traffic flow based on unmanned plane traffic video
TW202004702A (en) * 2018-06-04 2020-01-16 義碩智能股份有限公司 Artificial intelligence traffic detection system
CN112767687A (en) * 2020-12-24 2021-05-07 重庆中信科信息技术有限公司 Intersection congestion prediction method based on commuting path selection behavior analysis

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
網路文獻 雲海先進科技股份有限公司 即時車流種類計數系統 Youtube 2019年6月3日 https://www.youtube.com/watch?v=iWZyBeen3bo *

Also Published As

Publication number Publication date
TW202301291A (en) 2023-01-01

Similar Documents

Publication Publication Date Title
CN109977812B (en) Vehicle-mounted video target detection method based on deep learning
CA2945452C (en) Intelligent automatic license plate recognition for electronic tolling environments
WO2023109099A1 (en) Charging load probability prediction system and method based on non-intrusive detection
CN114170580B (en) Expressway-oriented abnormal event detection method
Chebrolu et al. Deep learning based pedestrian detection at all light conditions
AU2017261601B2 (en) Intelligent automatic license plate recognition for electronic tolling environments
CN112614373B (en) BiLSTM-based weekly vehicle lane change intention prediction method
CN107985189A (en) Towards driver's lane change Deep Early Warning method under scorch environment
CN115601717B (en) Deep learning-based traffic offence behavior classification detection method and SoC chip
CN116434159A (en) Traffic flow statistics method based on improved YOLO V7 and Deep-Sort
CN112381101B (en) Infrared road scene segmentation method based on category prototype regression
KR20220153808A (en) Control system of traffic flow with sensing of vehicle based on deep learning
CN112084928A (en) Road traffic accident detection method based on visual attention mechanism and ConvLSTM network
CN103164697A (en) Processing time and recognition precision self-adaption plate number recognition method
Gothankar et al. Circular hough transform assisted cnn based vehicle axle detection and classification
CN112085018A (en) License plate recognition system based on neural network
CN114037834B (en) Semantic segmentation method and device based on fusion of vibration signal and RGB image
Ali et al. IRUVD: a new still-image based dataset for automatic vehicle detection
TWM618607U (en) Automated traffic steering quantitative survey report production system
TWI777620B (en) Automated traffic steering quantitative survey report output system and method
Vellaidurai et al. A novel oyolov5 model for vehicle detection and classification in adverse weather conditions
CN115092178B (en) End-to-end automatic driving behavior decision method of multi-view attention mechanism
Bi et al. Real-time traffic flow statistics based on dual-granularity classification
TWI712012B (en) Artificial intelligence traffic detection system
Ghosh An improved you only look once based intelligent system for moving vehicle detection

Legal Events

Date Code Title Description
GD4A Issue of patent certificate for granted invention patent