KR101263894B1 - Apparatus and method for tracking wanted vehicle - Google Patents

Abstract

PURPOSE: An apparatus and method for tracking wanted vehicles are provided to easily check a vehicle by detecting a vehicle identification number from the image data of a camera module. CONSTITUTION: A camera module(210) is installed in a vehicle. The camera module moves to photograph adjacent vehicles. A display module(240) displays image data and a set interest region. A communication module(250) receives information about wanted vehicles. A control unit sets the wanted vehicle as the interest region and displays the wanted vehicle in the display module. [Reference numerals] (210) Camera module; (220) Warning module; (230) Key signal input module; (240) Display module; (250) Communication module; (260) Memory; (270) Control unit

Description

Apparatus and method for tracking wanted vehicle}

The present invention automatically recognizes and retrieves a vehicle number from photographed image data of a camera mounted on a vehicle while driving and stopping on a road, and the display panel is arranged on a display panel in the case of a wanted vehicle for committing illegal or crime as a result of the inquiry. The present invention relates to a tracking device and method for tracking the wanted area on the basis of the region where the license plate of the wanted vehicle is displayed in the captured image data of the displayed camera.

The license plate of the vehicle is installed on the front and rear of the vehicle and can be identified by others as the registration number of the vehicle. At night, when the tail light of the vehicle is turned on, the lamp of the license plate is turned on together to facilitate identification of the license plate.

The license plate of such a vehicle provides information for identifying whether the wanted vehicle is a wanted vehicle for illegal or crime.

However, it is difficult to identify whether or not the number of the wanted vehicle is in advance if the number of the wanted vehicle is not known in advance, and thus the arrest rate for the wanted vehicle is very low.

Recently, a vehicle photographing a vehicle traveling on a road is recognized by a camera, and a vehicle number is recognized, and the number of recognized vehicles is inquired to determine whether the vehicle is a wanted vehicle (see Korean Patent Publication No. 10-2004-0071479). .

However, the above-described prior art photographs a vehicle by installing a camera on the road, and only recognizes whether the vehicle is a wanted vehicle by recognizing the number of the vehicle from the captured image data, and cannot track and arrest the confirmed wanted vehicle. .

As described above, a method of inquiring and confirming a wanted vehicle by using a CCTV camera fixedly installed on a road or highway toll gate does not immediately follow the scene because the wanted vehicle can be moved to another place even if the wanted vehicle is checked. The arrest of the abnormally wanted vehicle is likely to fail, and even if the tracking is made by using a patrol vehicle adjacent to the wanted vehicle, not only the tracking is easy but also the probability of arrest is low.

In addition, after confirming that the arrangement of vehicles using fixed CCTV cameras is an arrangement, the network monitoring system using the Geographic Information System (GIS) has to be established. Since there is no system that automatically tracks and displays the arrangement on the monitor of the vehicle, the arrest efficiency of the arrangement becomes low.

Republic of Korea Patent Publication No. 10-2004-0071479 (published Aug. 12, 2004)

The present invention has been made in view of the above-described problems of the prior art, and the problem to be solved by the present invention is to recognize and query the number of the vehicle from the image data of the camera module mounted on the driving vehicle, the query result is illegal or The present invention provides an apparatus and method for tracking a wanted vehicle that can easily track the wanted vehicle in the field when it is inquired as a wanted vehicle for committing a crime.

Another problem to be solved by the present invention is that can be operated in the state that the tracking device of the arrangement of the vehicle is mounted on the vehicle can be made in real time and the inquiry of the arrangement and the inquiry results while driving on the road or stopped site The present invention provides a tracking device and a method for arranging a vehicle, which can immediately track a wanted vehicle when it is inquired as a wanted vehicle and can dramatically increase the probability of arrest.

Another problem to be solved by the present invention is to find a matching area that matches the received image feature point in the captured image data of the camera module when the image feature point of the wanted vehicle is received by the arrangement of the arrangement and set as the region of interest In addition, the present invention provides a tracking device and a method for arranging a vehicle for tracking the region of interest in the captured image data of the camera module and displaying it on a display module.

Another problem to be solved by the present invention is to look up the wanted vehicle, and if the image feature point of the wanted vehicle is not received, the license plate area of the wanted vehicle is detected in the image data of the camera module and set as the region of interest, the camera The present invention provides a tracking device and method for tracking a multiple-vehicle vehicle that tracks a region of interest in a captured image data of a module and displays it on a display module.

The problems to be solved by the present invention are not limited to the above-mentioned technical problems, and other technical problems not mentioned above may be clearly understood by those skilled in the art from the following description. There will be.

According to the tracking device and method of the arrangement of the present invention, the license plate area is extracted from the image data photographed by the camera module, and the number of the vehicle is detected from the extracted license plate area to inquire whether it is an arrangement.

In addition, when the inquiry result is a wanted vehicle, the receiver receives inquiry result information on the wanted vehicle, detects a wanted vehicle according to the inquiry result information from the image data photographed by the camera module, sets the interested area, and sets the interested area. Tracks the video along with the image data captured by the camera module.

Therefore, the tracking device of the arrangement of the present invention, the camera module is installed in the vehicle while photographing the surrounding vehicle while moving; A display module for displaying the captured image data of the camera module and the set ROI; A communication module configured to perform communication with the outside to receive information about the arrangement; And extracting the vehicle number from the photographed image data of the camera module and inquiring the extracted vehicle number to the outside through the communication module to receive information on the arrangement, and the camera module according to the received arrangement. And a control unit configured to control the display area while tracking the set ROI from the photographed image data of the camera module as the ROI in the photographed image data of the camera module.

In addition, the tracking device of the arrangement of the present invention further comprises an alarm module for generating an alarm sound, wherein the control unit may control the alarm module to generate an alarm sound while displaying the region of interest on the display module. .

In addition, the tracking device of the arrangement of the present invention, the control unit may further include a memory for storing the number of the vehicle inquired and the information about the arrangement.

The controller is configured to convert the captured image data of the camera module into gray image data to remove a noise signal, extract a vehicle number from gray image data from which the noise signal is removed, and when the extracted vehicle number is not stored in the memory. The extracted vehicle number may be stored in the memory.

The control unit may extract edge image data from gray image data from which noise signals are removed, extract the license plate region by scanning the extracted edge image data, and process the image data labeling process by performing adaptive image binarization on the extracted license plate region. Characters in the license plate area are separated, and the characters can be sessionized to separate the characters in the license plate and extract the number of the vehicle.

Further, when the image feature point information of the arrangement is received as the information on the arrangement, the control unit scans the photographing image data of the camera module to detect an area matching the image characteristic point information, and detects the matching area. The vertex is extracted and set as a region of interest and displayed on the display module. The previous image data and the current image data captured by the camera module are compared to grasp the movement route and flow of the arrangement and the interest according to the movement route and flow. The area can be reset to track and display the arrangement.

The controller may determine whether the vehicle is a wanted vehicle by detecting a vehicle number from the photographed image data of the camera module when information on the wanted vehicle is not received. Set a region of interest centered on the license plate area of the wanted vehicle and display it on the display module, and compare the previous image data and the current image data photographed by the camera module to identify the movement route and flow of the wanted vehicle, and the movement route and flow. In accordance with the present invention, the ROI may be tracked and displayed by resetting the ROI.

In accordance with an aspect of the present invention, there is provided a method for tracking a wanted vehicle, the control unit comprising: a first step of extracting a vehicle number from photographed image data of a camera module mounted on a vehicle; A second step of receiving, by the controller, inquiry result information when the number of the vehicle is inquired to the outside and inquired by an arrangement vehicle; And setting, by the controller, the arrangement of interest according to the inquiry result information from the photographing image data of the camera module, setting the region of interest, and displaying the set region of interest on the display module together with the imaging image data of the camera module. And resetting the region of interest according to the movement path and the flow of the vehicle and displaying and tracking the display module on the display module.

In the second step, the control unit communicates with an external response server through a communication module to transmit a number of the vehicle and requests an inquiry, and when the number of the vehicle is an arrangement vehicle, the response server Receiving the inquiry result information for the provided arrangement vehicle, and storing the received inquiry result information in a memory.

The third step may include scanning image data of the camera module to match image feature point information of an arrangement of vehicles included in the inquiry result information, detecting a matching region, extracting vertices of the matching region, and extracting a region of interest. And displaying the ROI on the display module together with the captured image data of the camera module, resetting the ROI according to the movement path and flow of the arrangement, and resetting the ROI. And displaying the image on the display module together with the captured image data.

In the third step, the control unit extracts a vehicle number from the photographed image data of the camera module, detects an arranging vehicle through the extracted number of the vehicle, and sets a license plate area of the detected arranging vehicle as the region of interest. And displaying the ROI on the display module together with the photographing image data of the camera module, and resetting the ROI according to the movement path and flow of the arrangement. And displaying on the display module along with the image data to track the image.

The first step includes converting captured image data of the camera module into gray image data, removing a noise signal from the gray image data, and extracting a vehicle number from the gray image data from which the noise signal is removed. It may include the step.

In addition, the tracking method of the arrangement of the present invention determines whether the number of the extracted vehicle is stored in the memory, and if the number of the extracted vehicle is not stored in the memory the number of the extracted vehicle to the memory It may further comprise the step of storing in.

The extracting of the vehicle number from the gray image data from which the noise signal is removed may include extracting edge image data from the gray image data from which the noise signal is removed, extracting a license plate area by scanning the edge image data; And separating the license plate area by each image by performing adaptive image binarization and labeling of image data, and performing sessionization of the separated characters to recognize characters in the license plate area. Can be.

Resetting the ROI according to the movement path and flow of the arrangement vehicle and displaying and resetting the ROI on the display module along with the image image data of the camera module may include: previous image data captured by the camera module; Comparing and comparing current image data to identify and learn a changed movement route and flow of the arrangement, resetting the ROI according to the changed movement route and flow, and learning about the changed movement route and flow. Adding the existing data, and matching the region of interest to the photographed image data of the camera module based on the learned data and display and track on the display module.

As described above, the present invention detects the vehicle number from the photographed image data of the camera module and inquires whether the vehicle is an arranging vehicle, and receives the inquiry result information in the case of the arranging vehicle.

In addition, the photographing image of the camera module is detected by setting the arrangement of interest according to the inquiry result information from the captured image data of the camera module and resetting the region of interest according to the movement path and flow of the arrangement. The region of interest along with the data is displayed on the display module for tracking.

Therefore, when an arranging vehicle is inquired, the arranging vehicle can be easily tracked and arrested, thereby improving the arrest efficiency of the arranging vehicle.

In addition, the present invention can be operated in the state that the tracking device of the wanted vehicle is mounted on the vehicle can be made in real time, the inquiry of the wanted vehicle and the reception of the inquiry result on the road or stopped at the site, In the case of inquiry, the relevant arrangement is displayed on the display panel as the region of interest, so that the probability of arrest can be dramatically increased because it can be immediately traced.

In addition, according to the present invention, the arrangement is automatically displayed while resetting the ROI according to the movement route and flow of the arrangement, and the arrangement, attachments, etc. of the vehicle may be changed even when the lane changes or passes through the tunnel hole. Features can be tracked by learning through automatic repetition, which can dramatically increase the probability of arrest.

Hereinafter, the present invention will be described in more detail with reference to the accompanying drawings, which do not limit the present invention, and like reference numerals designate like elements in some drawings.
1 is a block diagram schematically showing the configuration of the entire system to which the tracking device of the arrangement according to the present invention is applied,
Figure 2 is a block diagram showing the configuration of an embodiment of an arrangement vehicle tracking device of the present invention,
3 is a signal flow diagram showing the overall operation of the control unit according to the arrangement of the vehicle tracking method of the present invention,
4 is a signal flow diagram illustrating an operation of the control unit extracting the vehicle number from the photographed image data of the camera in the arrangement vehicle tracking method of the present invention,
FIG. 5 is a signal flow diagram illustrating an operation of extracting a vehicle number by a controller in an arrangement vehicle tracking method of the present invention; FIG.
FIG. 6 is a signal flow diagram illustrating an operation of inquiring a vehicle number by a controller in an arrangement vehicle tracking method of the present invention;
7 is a signal flow diagram showing an operation of the control unit to track the arrangement in the arrangement of tracking arrangement of the present invention, and
8 is a view for explaining an operation of displaying a region of interest on a display panel by a controller in an arrangement tracking method of the present invention;
9A to 9C illustrate an edge image data screen obtained by extracting edges from gray image data, an image data screen showing a result of adaptive image binarization of a license plate region among the extracted edge image data, and a labeling processing screen of image data.

The following detailed description is only illustrative, and merely illustrates embodiments of the present invention. In addition, the principles and concepts of the present invention are provided for the purpose of explanation and most useful.

Accordingly, it is not intended to provide a more detailed structure than is necessary for a basic understanding of the present invention, but it should be understood by those skilled in the art that various forms that can be practiced in the present invention are illustrated in the drawings.

1 is a block diagram schematically showing the configuration of an entire system to which an arrangement tracking apparatus according to the present invention is applied.

In FIG. 1, reference numeral 110 denotes an arrangement vehicle tracking device of the present invention. For example, the tracking device 110 may include a camera module in a police vehicle (not shown) to photograph surrounding vehicles at road driving or at a stopped site, and the image data captured by the camera module. Is displayed on the display panel.

In addition, the tracking device 110 analyzes the license plate area of the vehicle from the image data captured by the camera module, extracts the vehicle number, and communicates with the response server 130 through the communication network 120. The number of the extracted vehicle is transmitted to inquire whether it is a wanted vehicle.

The response server 130, the processing server 140 and the database server 150, for example, is provided in a traffic control center installed inside the police office to build a system server, preferably driving the road through a wireless communication network Together with a plurality of arrangement vehicle tracking device 110 installed in a plurality of vehicles constitute an arrangement vehicle tracking system.

The response server 130 may be configured, for example, as a web server, and transmits the number of the vehicle transmitted by the tracking device 110 to the processing server 140, and the processing server 140 is a database. The server 150 asks whether the number of the vehicle is a wanted vehicle.

The database server 150 includes, for example, an arrangement information database 152 and an arrangement image database 152. The database server 150 searches the arrangement information database 152 and the number of the vehicle is defined as arrangement. It is detected whether or not it is stored, and if the image information of the wanted vehicle is stored in the wanted vehicle image database 154 when it is stored in the wanted vehicle.

As a result of the search, when the number of the vehicle is an arranging vehicle, the database server 150 displays arranging vehicle information indicating an arranging vehicle and arranging vehicle image information stored in the arranging vehicle image database 154. Provided at 140. Here, when the image information of the wanted vehicle is not stored in the wanted image database 154, the image information of the wanted vehicle may not be provided.

The processing server 140 includes, for example, an arrangement encryption processing unit 142 and an arrangement image feature point encryption processing unit 144, which is received when arrangement information is received from the database server 150. The wanted vehicle information is encrypted by the wanted vehicle encryption processing unit 142.

In addition, when processing vehicle image information is received from the database server 150, the processing server 140 processes the arrangement image information received by the arrangement image feature point encryption processing unit 144 to encrypt image feature point information. .

In this case, the processing server 140 receives the arrangement image information and the image feature point information through an administrator terminal connected by wire / wireless to a system server installed in a traffic control center inside the police station in addition to the database server 150. Can also be encrypted.

The processing server 140 transmits the encrypted arrangement information and the encrypted image feature point information to the tracking device 110 through the response server 130 and the communication network 120.

The tracking device 110 analyzes the information transmitted by the processing server 140 to determine whether the number of the inquired vehicle is an arrangement of vehicles, and the image captured by the camera module 210 when the arrangement of vehicles is arrangement. Detecting a region matching the image feature point information of the wanted vehicle in the data, setting the detected matching region as the ROI, tracking the set ROI from the image data photographed by the camera module and displaying it on the display panel. An alarm sounds to alert you that there is an arrangement.

In addition, the tracking device 110 of the camera module when the image feature point information for the wanted vehicle is not received or a region matching the image feature point information for the wanted vehicle is not detected in the captured image data of the camera module. Determining whether there is an arrangement by detecting the number of vehicles in the photographed image data, and sets an ROI based on the license plate area of the arrangement if there is an arrangement, and sets the region of interest to be set by the camera module. It tracks from the captured image data and displays it on the display panel. It generates an alarm sound to alert you that there is an arrangement.

Figure 2 is a block diagram showing the configuration of an embodiment of an arrangement vehicle tracking apparatus according to the present invention.

Referring to FIG. 2, the arrangement tracking apparatus 110 of the present invention includes a camera module 210, an alarm module 220, a key signal input module 230, a display module 240, and a communication module ( 250, a memory 260, and a controller 270 may be included.

The camera module 210 is provided with a camera to be installed outside or inside the vehicle to shoot other vehicles located in the vicinity, and outputs the captured image data. As the camera, for example, a camera having various types of image sensors may be used, including a camera having a charge coupled device (CCD) and a camera having a CMOS image sensor.

The alarm module 220 generates an alarm signal such as an alarm. For example, the alarm module 220 may generate an alarm sound using a buzzer or the like, or may generate an alarm sound using a speaker.

The key signal input module 230 generates various input data according to a user's operation and outputs it to the controller 270. The key signal input module 230 includes a key pad and a dome switch. switch), a touch pad (static pressure type / capacitive type), a jog wheel, a jog switch, or a touch screen.

The display module 240 may include a display panel and display the captured image data and the ROI of the camera module 210 on the display panel. The display panel may be an STN liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), or a flexible display. ) And 3D displays.

The communication module 250 communicates with the response server 130 through the communication network 120 to interface various data. Preferably, the communication module 250 performs a wireless communication with the wireless communication network.

The memory 260 may store the operation program of the controller 270 in advance, and may also temporarily store various types of information, including information about the inquired arrangement. The memory 260 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory). Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory At least one type of storage medium may be included among the magnetic disk and the optical disk.

The controller 270 controls the overall operation of the tracking device of the present invention. In addition, the controller 270 controls the display module 240 to display the image data photographed by the camera module 210 on the display panel. In addition, the controller 270 extracts the vehicle number by separating the license plate area of the vehicle from the photographed image data of the camera module 210, and performs communication with the response server 130 through the communication network 120. Control whether to inquire whether or not the vehicle is arranged by transmitting the extracted vehicle number.

In addition, the controller 270 controls to store the information about the inquired arrangement in the memory 260. The controller 270 detects whether there is an arrangement in the photographed image data of the camera module 210, sets an area of the arrangement as an interested region when there is an arrangement, and sets the interested region. The display module 240 controls the display on the display panel by tracking the captured image data of the camera module 210.

3 is a signal flow diagram showing the overall operation of the control unit according to the tracking method of the present invention.

Referring to FIG. 3, the controller 270 extracts the license plate area of the vehicle from the image data captured by the camera module 210 and extracts the vehicle number from the extracted license plate area (S300). Here, the operation of extracting the license plate area of the vehicle from the captured image data of the camera module 210 and extracting the vehicle number from the extracted license plate area will be described in more detail with reference to FIGS. 4 and 5.

The controller 270 performs communication with the response server 130 through the communication network 120 to inquire whether the number of the vehicle extracted in the step S300 is an arrangement vehicle, and the inquiry result information according to the inquiry request. Received and stored in the memory 260 (S302). Here, the operation of inquiring whether the vehicle number is an arrangement vehicle will be described in more detail with reference to FIG. 6.

In addition, the controller 270 analyzes the inquiry result information to determine whether the vehicle is a wanted vehicle, detects a wanted vehicle in the photographed image data of the camera module 210 in the case of a wanted vehicle, and detects the arranged wanted vehicle. Set the region of interest as the region of interest and track the set region of interest in the captured image data of the camera module 210 to display the display module 240 on the display panel (S304). Here, the operation of tracking the wanted vehicle will be described in more detail with reference to FIGS. 7 and 8.

The operations of the steps S300, S302, and S304 may be performed in parallel by the controller 270.

However, in the practice of the present invention, the operations of the above-described steps S300, S302, and S304 may be performed in series, not necessarily in parallel, or may be modified in various ways.

4 is a signal flow diagram illustrating an operation of the control unit extracting the vehicle number from the captured image data of the camera in the tracking method of the present invention.

Referring to FIG. 4, the controller 270 obtains image data captured by the camera module 210 in units of frames (S400). The controller 270 converts the obtained captured image data into gray image data (S402), removes a noise signal from the gray image data (S404), and extracts a vehicle number from the gray image data from which the noise signal has been removed. It is extracted (S406).

As shown in FIG. 5, the control unit 270 extracts the vehicle number from the gray image data from which the noise signal is removed, for example, in the Canny Edge method as shown in FIG. 9A. Extract (S500), and extract the extracted edge image data as a license plate region in which the number of edge images is in a predetermined range (S502).

Subsequently, the controller 270 changes the image data of the license plate area to “0” or “1” based on a specific threshold value in the image data of the license plate area, so that the controller 270 can be converted into an object to generate an object. And numbers and the like are converted into identifiable blacks and whites (S504), and then, an image can be separated from the image data of the binarized number plate area as shown in FIG. Data labeling processing, that is, numbering (S506).

In this state, the control unit 270 separates the vehicle number in the labeling area, that is, the license plate area, for each character (S508), and processes the separated characters into session lines. In operation S510, each characterized session is recognized using template matching or a well-known neural network algorithm, that is, the number of the vehicle described in the license plate of the vehicle is recognized (S512).

When the vehicle number is recognized in this manner, the controller 270 determines whether the extracted vehicle number is stored in the memory 260 (S408), and when the vehicle number is not stored in the memory 260, The vehicle number is stored in the memory 260 (S410).

The reason for storing the extracted vehicle number in the memory 260 is to prevent an operation of repeatedly inquiring the same vehicle number to the system server.

6 is a signal flow diagram illustrating an operation of inquiring a vehicle number by a controller in the tracking method of the present invention.

Referring to FIG. 6, the controller 270 searches the memory 260 to read the newly stored vehicle number (S600). That is, the controller 270 reads the vehicle number stored in the memory 260 in step S410. Here, to read the number of the vehicle, it is possible to read only the number of one vehicle or to read the number of a plurality of vehicles at once.

In addition, the controller 270 controls the communication module 250 to perform wireless communication with the response server 130 through the communication network 120 (S602), and whether the response server 130 is connected by communication. Determine (S604).

When the response server 130 is connected by communication, the control unit 270 transmits the number of the read vehicle to the response server 130 and requests an inquiry of whether the response vehicle 130 is an arrangement vehicle (S606).

In this state, the controller 270 receives the inquiry result information from the response server 130 through the communication module 250 (S608), and stores the received inquiry result information in the memory 260 (S610). ).

7 is a signal flow diagram showing the operation of the control unit tracking the arrangement in the tracking method of the present invention.

Referring to FIG. 7, the control unit 270 retrieves inquiry result information of the arranging vehicle from the memory 260 (S700), and determines whether image feature point information of the arranging result of the search result is received (S702). The image feature point information is data obtained by processing a template or an image of a vertex of a vehicle type as numerical data.

When it is determined that the image feature point information of the arrangement is received, the controller 270 scans the captured image data of the camera module 210 and performs matching with the image characteristic point information of the arrangement (S704). It is determined whether or not it is detected (S706).

When a region matching the image feature point information of the arrangement is detected, the controller 270 extracts vertices of the matching region and sets a rectangular region composed of vertices as the region of interest (S708).

On the other hand, when the image feature point information of the arrangement vehicle is not received as a result of the determination, the controller 270 detects the vehicle number from the captured image data of the camera module 210 (S710). Here, the operation of detecting the number of the vehicle by the controller 270 is the same except for the operation of storing the vehicle number in the memory 260 in FIG.

The controller 270 determines whether the number of the detected vehicle is identical to the arrangement of vehicles (S712), and when the vehicle numbers match, the controller 270 determines horizontal and vertical edges (contours) based on the license plate area of the vehicle. Obtain and set the rectangular frame of the entire vehicle as the region of interest (S714).

For example, as illustrated in FIG. 8, when it is assumed that the license plate area 802 of the order vehicle is displayed on the display panel 800 of the display module 240, the controller 270 may control the license plate area 802. ) The left and right sides of the license plate area 802 by one times the horizontal width of the license plate area 802, the upper part of the license plate area 802 by twice the vertical height of the license plate area 802, The furnace sets an area of interest 804 that is extended by one times the vertical height of license plate area 802.

As such, when the ROI 804 for the arrangement is set on the display panel 800, the controller 270 controls the alarm module 220 to output an alarm sound and simultaneously displays the alarm sound on the display module 240. The region of interest 804 is displayed so that the user can immediately visually check (S716).

Thereafter, when the ROI is set, the controller 270 compares the previous image data captured by the camera module 210 with the current image data to identify the changed movement path and flow of the arrangement, and the identified movement path and flow. Learn (S718), reset the region of interest 804 according to the changed movement path and flow (S720), add learning about the changed movement path and flow to existing data (S722), and Based on the region of interest matched with the captured image data of the camera module 210 and displayed on the display module 240 (S724).

Accordingly, the user, that is, the police officer, recognizes and tracks and arrests a vehicle that is driving in front of the vehicle displayed on the display module 240 as the interested area 804 is displayed as a wanted vehicle.

In the present invention described above, but the tracking device is installed in the driving vehicle to receive the inquiry and the result of the arrangement by the wireless communication system with the system server to illustrate the arrangement of the arrangement, but the tracking device such as toll gates or checkpoints It is also possible to install and operate in a fixed CCTV.

As described above, according to the present invention, the vehicle number is automatically arranged by recognizing and retrieving the number of the vehicle from the photographed image data of the camera mounted on the vehicle in the state of driving and stopping on the road. In this case, the wanted area can be easily tracked in the field by tracking and displaying a region of interest based on the area where the license plate of the wanted vehicle is displayed in the photographed image data of the camera displayed on the display panel.

In addition, the present invention can be operated in the state that the tracking device of the wanted vehicle is mounted on the vehicle can be made in real time, the inquiry of the wanted vehicle and the reception of the inquiry result on the road or stopped at the site, In the case of inquiry, the relevant arrangement is displayed on the display panel as the region of interest, so that the probability of arrest can be dramatically increased because it can be immediately traced.

The present invention has been described in detail with reference to exemplary embodiments, but those skilled in the art to which the present invention pertains can make various modifications without departing from the scope of the present invention. Will understand.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be defined by the claims below and equivalents thereof.

110: tracking device 120: communication network
130: response server 140: processing server
142: wanted vehicle encryption processing unit
144: image feature point encryption processing unit
150: database server 152: arrangement information database
154: Wanted Vehicle Image Database
210: camera module 220: alarm module
230: key signal input module 240: display module
250: communication module 260: memory
270:

Claims (15)

A camera module installed in the vehicle and moving around to photograph the surrounding vehicle;
A display module for displaying the captured image data of the camera module and the set ROI;
A communication module configured to perform communication with the outside to receive information about the arrangement;
Extract the vehicle number from the photographed image data of the camera module and query the extracted vehicle number to the outside through the communication module to receive information on the arrangement, and according to the received arrangement information of the camera module And a controller configured to control the display module while setting a wanted vehicle in the captured image data as the region of interest and tracking the set region of interest in the captured image data of the camera module.
The controller scans the photographing image data of the camera module when the image feature point information of the arrangement is received as the information on the arrangement, detects an area matching the image feature point information, and extracts a vertex of the detected matching area. Set to a region of interest and display it on the display module, and compare the previous image data and the current image data photographed by the camera module to grasp the movement route and flow of the arrangement vehicle, and then follow the movement route and flow. Reset tracking device for tracking the wanted arrangement by displaying the arrangement. The method of claim 1,
Further comprising an alarm module for generating an alarm sound,
The control unit,
And the alarm module controls the alarm module to generate an alarm sound while displaying the region of interest on the display module. The method of claim 1,
And a memory for storing the number of the vehicle inquired by the controller and information on the arrangement. The method of claim 3, wherein
The control unit,
Convert the captured image data of the camera module to gray image data to remove the noise signal, extract the vehicle number from the gray image data from which the noise signal has been removed, and if the extracted vehicle number is not stored in the memory, the extracted vehicle Storing the number of the wanted arrangement. The method of claim 4, wherein
The control unit,
Extract the edge image data from gray image data without noise signal, extract the license plate region by scanning the extracted edge image data, separate the characters of the license plate region by adaptive image binarization and then image data labeling And sessionize the separated characters to separate the characters of the license plate and extract the number of the vehicle. delete A camera module installed in the vehicle and moving around to photograph the surrounding vehicle;
A display module for displaying the captured image data of the camera module and the set ROI;
A communication module configured to perform communication with the outside to receive information about the arrangement;
Extract the vehicle number from the photographed image data of the camera module and query the extracted vehicle number to the outside through the communication module to receive information on the arrangement, and according to the received arrangement information of the camera module And a controller configured to control the display module while setting a wanted vehicle in the captured image data as the region of interest and tracking the set region of interest in the captured image data of the camera module.
The control unit,
If the image feature point information of the wanted vehicle is not received as the information on the wanted vehicle, the vehicle number is detected again from the photographed image data of the camera module to determine whether the wanted vehicle is a wanted vehicle, and the license plate area of the wanted vehicle Set the ROI to be displayed on the display module, and compare the previous image data and the current image data photographed by the camera module to grasp the movement route and flow of the arrangement, and according to the movement route and flow, Arrangement tracking apparatus for resetting the region of interest to track the display of the arrangement. A first step of the control unit extracting a vehicle number from the captured image data of the camera module mounted on the vehicle;
A second step of receiving, by the controller, inquiry result information when the number of the vehicle is inquired to the outside and inquired by an arrangement vehicle; And
The controller detects an arrangement amount according to the inquiry result information from the photographing image data of the camera module, sets a region of interest, and displays the set region of interest on the display module together with the imaging image data of the camera module. And resetting the region of interest according to the movement path and flow of the display to display and track the display on the display module.
In the third step, when the image feature point information of the wanted vehicle is received as the information on the wanted vehicle,
Scanning captured image data of the camera module to match image feature point information of an arrangement of vehicles included in the inquiry result information and detect a matching area;
Extracting vertices of the matching region and setting the vertices as regions of interest;
Displaying the ROI on the display module together with the captured image data of the camera module; And
And resetting the region of interest according to the movement path and flow of the arrangement and displaying the reset region of interest on the display module together with the captured image data of the camera module. The method of claim 8,
Wherein the control unit, the second step,
The control unit communicating with an external response server through a communication module to transmit the number of the vehicle and request an inquiry;
Receiving inquiry result information on the arrangement of vehicles provided by the response server when the number of the vehicle is arrangement of vehicles; And
And storing the received inquiry result information in a memory. delete A first step of the control unit extracting a vehicle number from the captured image data of the camera module mounted on the vehicle;
A second step of receiving, by the controller, inquiry result information when the number of the vehicle is inquired to the outside and inquired by an arrangement vehicle; And
The controller detects an arrangement amount according to the inquiry result information from the photographing image data of the camera module, sets a region of interest, and displays the set region of interest on the display module together with the imaging image data of the camera module. And resetting the region of interest according to the movement path and flow of the display to display and track the display on the display module.
In the third step, when the image feature point information of the wanted vehicle is not received as the information about the wanted vehicle,
Re-extracting the vehicle number from the captured image data of the camera module by the controller;
Detecting a wanted vehicle through the number of the re-extracted vehicles and setting a license plate area of the detected wanted vehicle as a region of interest;
Displaying the ROI on the display module together with the captured image data of the camera module; And
And resetting the region of interest according to the movement path and flow of the arrangement and displaying the reset region of interest on the display module together with the captured image data of the camera module. The method of claim 8,
In the first step,
Converting captured image data of the camera module into gray image data;
Removing a noise signal from the gray image data; And
And extracting a number of a vehicle from gray image data from which the noise signal is removed. 13. The method of claim 12,
Determining whether the extracted vehicle number is stored in a memory in the first step; And
And storing the number of the extracted vehicle in the memory when the number of the extracted vehicle is not stored in the memory. 13. The method of claim 12,
Extracting the vehicle number from the gray image data from which the noise signal is removed,
Extracting edge image data from gray image data from which the noise signal is removed;
Extracting a license plate area by scanning the edge image data;
Dividing the license plate area by adaptive image binarization and labeling the image data to separate the character plates; And
Recognizing characters in the license plate area by performing sessionization of separated characters. The method of claim 11,
Resetting the region of interest according to the movement path and flow of the arrangement vehicle and displaying the reset region of interest along with the captured image data of the camera module on the display module to track the reset region of interest;
Comparing the previous image data and the current image data photographed by the camera module to identify and learn the changed movement path and flow of the arrangement;
Resetting the region of interest according to the changed movement path and flow;
Adding learning about the changed movement path and flow to existing data; And
And matching the region of interest with the photographed image data of the camera module based on the learned data and displaying the trace on the display module for tracking.

Images