WO2014081129A1 - Lane violation detection device using multiple cameras, lane violation detection method using same, and lane violation enforcement system using lane violation detection device with multiple cameras - Google Patents

Lane violation detection device using multiple cameras, lane violation detection method using same, and lane violation enforcement system using lane violation detection device with multiple cameras Download PDF

Info

Publication number
WO2014081129A1
WO2014081129A1 PCT/KR2013/009684 KR2013009684W WO2014081129A1 WO 2014081129 A1 WO2014081129 A1 WO 2014081129A1 KR 2013009684 W KR2013009684 W KR 2013009684W WO 2014081129 A1 WO2014081129 A1 WO 2014081129A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
lane
violation
image data
camera
Prior art date
Application number
PCT/KR2013/009684
Other languages
French (fr)
Korean (ko)
Inventor
임철규
송영도
박태원
Original Assignee
주식회사 토페스
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 토페스 filed Critical 주식회사 토페스
Publication of WO2014081129A1 publication Critical patent/WO2014081129A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/01—Detecting movement of traffic to be counted or controlled
    • G08G1/017—Detecting movement of traffic to be counted or controlled identifying vehicles
    • G08G1/0175—Detecting movement of traffic to be counted or controlled identifying vehicles by photographing vehicles, e.g. when violating traffic rules
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G06V20/54—Surveillance or monitoring of activities, e.g. for recognising suspicious objects of traffic, e.g. cars on the road, trains or boats
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/01—Detecting movement of traffic to be counted or controlled
    • G08G1/017—Detecting movement of traffic to be counted or controlled identifying vehicles

Definitions

  • the present invention provides multiple cameras in the lane change prohibition section to prevent the vehicle from violating the lane and at the same time controls the vehicle in violation of the lane to prevent accidents in advance, thereby reducing life and property damage and implementing an advanced traffic culture.
  • the number of domestic tunnels is about 1382 and the number of bridges is about 27381. And in view of the continued construction of additional roads, tunnels and bridges are also expected to increase.
  • the tunnel and the bridge section has a higher risk of accident than the other sections of the automobile road, and therefore, a certain distance from before the entry to the tunnel and the bridge section of the automobile road is designated as the lane change prohibition section. It is indicated by a solid line.
  • a certain section is designated as a lane change prohibition section, and the lane is indicated by a solid line.
  • the shoulder of a highway is indicated as an entry prohibition section of a general vehicle and thus corresponds to a lane change prohibition section.
  • the drivers of automobiles are not seriously aware of the high accident rate in the lane change prohibition section as described above, or frequently change lanes in the lane change prohibition section forgotten. In other words, the majority of drivers do not comply with the lane change ban on lane change bans.
  • the present invention has been proposed to solve the above problems, by installing multiple cameras in the lane change prohibition section to prevent the vehicle from violating the lane and at the same time crack down on the lane violation vehicle to prevent accidents in advance It is an object of the present invention to provide a lane violation detection device using multiple cameras and a lane violation detection method using the same, which can reduce life and property damage and implement an advanced traffic culture.
  • a plurality of vehicle tracking cameras installed along a driving direction of a vehicle in a lane change prohibition section are arranged to have a photographing overlapping area between two adjacent cameras, and the vehicle tracking camera of the rear vehicle tracking camera is based on the vehicle driving direction.
  • the present invention is a lane violation using a multi-camera determination process for the determination of each lane of the lane change prohibited section includes converting a RGB (Red, Green, Blue) coordinate system into a HSI (Hue, Saturation, Intensity) coordinate system
  • RGB Red, Green, Blue
  • HSI Human, Saturation, Intensity
  • the present invention can remotely control the crackdown on the lane change vehicle through the lane violation detection device and lane violation detection method and the communication network and information communication devices, such as the Internet and mobile communication network, and at the same time the lane in the lane change prohibited section It is an object of the present invention to provide a lane violation control system using a lane violation detection apparatus using multiple cameras that can transmit online penalty notices online to cracked down vehicle owners.
  • a lane violation detection apparatus using a multiple camera includes at least one vehicle tracking camera for photographing a predetermined road section and a lane in a lane change prohibition section of a road; A detection area for automatically generating a vehicle detection area for each lane by receiving a lane information detection unit for determining a lane from the image data photographed by the vehicle tracking camera and a lane determination signal of the vehicle tracking camera and the lane determination signal of the lane information detection unit A generation unit and a control unit which receives a vehicle detection area signal generated by the detection area generation unit and image data of a vehicle running in the vehicle detection area and tracks a driving state of a vehicle running along the lane change prohibition section;
  • the at least one vehicle tracking camera is the It is installed at a predetermined arrangement interval along the vehicle driving direction of the lane change prohibition section of the road, wherein the arrangement interval is an interval in which a preset photographing overlapping section is formed between the photographing regions of each camera, and the vehicle detecting
  • the lane information detection unit may receive image data photographed by the vehicle tracking camera, extract an outline of a lane having a color component from the image data, and then convert the color space of the extracted lane into RGB (Red, Green). And a color space conversion unit for converting a HUE (Hue, Saturation, Intensity) coordinate system from the coordinate system and an HSI coordinate value input from the color space conversion unit with a preset HIS reference value for each lane area of the lane change prohibition section. And a lane discrimination unit for discriminating lanes.
  • HUE Human, Saturation, Intensity
  • the image data photographed through the rear vehicle tracking camera based on the driving direction of the vehicle is input to the controller, and the controller tracks the vehicle behind the vehicle.
  • the tracking of the vehicle through the camera is stopped, and the vehicle is subsequently tracked through the vehicle tracking camera.
  • the detection area generating unit is configured to perform the tracking data from the starting point of the vehicle to the ending point of the tracking in the image data of the vehicle tracking camera.
  • the vehicle detection area for each lane is automatically generated according to the pixel size of the vehicle image data by comparing the frame number with a preset reference frame number.
  • the controller tracks the movement of the vehicle in the lane-specific detection zones generated by the detection zone generation unit, and ends the tracking of the vehicle in the corresponding lane when the vehicle leaves the current lane. Continue tracking the vehicle in the, characterized in that for storing and transmitting the lane change image of the vehicle.
  • the detection area generation unit forms the vehicle detection area in a long trapezoidal shape as the pixel size of the vehicle obtained by the vehicle tracking camera decreases as the distance between the vehicle tracking camera and the vehicle increases. It is characterized by.
  • a lane violation detection method using multiple cameras may include obtaining image data of a driving vehicle through at least one vehicle tracking camera installed along a vehicle driving direction of a lane change prohibition section, and tracking the vehicle.
  • the image data acquired by the camera is input to the lane information detection unit, and the lane information detection unit determines a lane from the image data, and the detection area generation unit detects the image data of the vehicle tracking camera and the lane determination signal of the lane information detection unit.
  • Automatically generating a vehicle detection area for each lane by receiving the input signal, and receiving a vehicle detection area signal generated by the detection area generation unit and image data of a vehicle running in the vehicle detection area according to the lane change prohibition section.
  • the detection area generation unit individually generates a vehicle detection area for a photographing section for each vehicle tracking camera of each lane included in the lane change prohibition section, and the vehicle detection area includes the lane determination signal and image data. It is generated based on the pixel size of the vehicle image data included in the, the image data received by the control unit is characterized in that the image data including a photographing overlap section between the vehicle tracking camera.
  • lane determination of the lane change prohibition section through the lane information detection unit may include color from image data inputted by the color space conversion unit to which image data photographed through the vehicle tracking camera is input to the color space conversion unit. After extracting the contour of the lane with components, converting the extracted color space from the RGB (Red, Green, Blue) coordinate system to HSI (Hue, Saturation, Intensity) coordinate system, and the HSI converted by the color space converter And a coordinate value is input to the lane discrimination unit to determine the lane by comparing the HSI coordinate value input by the lane discrimination unit with a preset HIS reference value for each lane area of the lane change prohibition section.
  • RGB Red, Green, Blue
  • HSI Human, Saturation, Intensity
  • the tracking of the vehicle through the control unit, the image data captured by the rear vehicle tracking camera on the basis of the driving direction of the vehicle when the vehicle enters the shooting overlap section between the vehicle tracking camera is input to the control unit
  • the control unit is characterized in that it comprises a process of stopping the tracking of the vehicle through the vehicle tracking camera in the rear and at the same time following the vehicle tracking through the vehicle tracking camera in front.
  • a lane violation vehicle control system using a multiple camera lane detection apparatus includes: at least one vehicle tracking camera for photographing a predetermined road section and a lane at a lane change prohibition section of a road; A lane information detection unit for determining a lane from the image data captured by the vehicle tracking camera and a lane detection signal for automatically generating a vehicle detection area for each lane by receiving the image data of the vehicle tracking camera and the lane determination signal of the lane information detection unit. And a control unit which receives a vehicle detection area signal generated by the detection area generation unit and image data of a vehicle running in the vehicle detection area and tracks a driving state of a vehicle traveling along the lane change prohibition section.
  • a lane violation detection device for detecting a vehicle that has changed lanes and a control provided at a front side from an end of the lane change prohibited section based on a driving direction of the vehicle with respect to the lane change prohibited section and received from the lane violation detection device
  • the vehicle number recognition camera extracting the vehicle number data of the vehicle and the lane change vehicle transmitted from the vehicle number recognition camera are received to receive vehicle information corresponding to the vehicle number.
  • a lane violation management server for detecting from an information database, wherein the at least one vehicle tracking camera is installed at a predetermined arrangement interval along a vehicle driving direction of the lane change prohibition section of the road, wherein the arrangement interval is photographed by each camera. Preset overlapping section is formed between regions The vehicle detection area is generated based on the pixel size of the vehicle image data included in the lane determination signal and the image data.
  • control unit of the lane violation detection device and the vehicle number recognition camera is connected to the lane violation management server through a communication network, the image data of the vehicle tracking camera input to the control unit and the related information
  • the vehicle is transmitted to the lane violation management server through the communication network and updated in a vehicle driving information database connected to the lane violation management server for storing the corresponding information.
  • the lane violation management server the online fine payment notice for providing a lane change prohibition violation vehicle by combining the vehicle information detected from the vehicle information database and the lane change violation information detected from the vehicle driving information database It characterized in that it comprises an online bill generating unit for generating a.
  • the lane violation management server for transmitting the online penalty payment invoice generated through the online bill generation unit and the fact that the issue to a portable communication terminal having a computing function of the vehicle driver; Characterized in that it comprises a.
  • the vehicle tracking camera located at the foremost of the vehicle tracking cameras of the lane violation detection apparatus with respect to the vehicle driving direction and the vehicle number recognition camera are installed to have an overlapping shooting area, and the front vehicle tracking camera is And a trigger signal transmitted to the vehicle number recognition camera when the vehicle enters a lane change violation in the overlapping photographing area with the vehicle number recognition camera.
  • the vehicle identification camera is provided with a speed sensor to determine whether or not the vehicle is overspeed through the vehicle speed signal detected by the speed sensor.
  • the present invention by installing multiple cameras in the lane change prohibition section to prevent the vehicle from violating the lane and at the same time controlling the vehicle in violation of the lane, preventing accidents in advance, thereby reducing life and property damage and implementing an advanced traffic culture. It becomes possible.
  • multiple vehicle tracking cameras installed along the driving direction of the vehicle in the lane change prohibition section are arranged to have a photographing overlapping area between two adjacent cameras, and the vehicle tracking operation of the rear vehicle tracking camera is forward based on the vehicle driving direction.
  • the determination process for each lane of the lane change prohibition section includes converting an RGB (Red, Green, Blue) coordinate system into a HSI (Hue, Saturation, Intensity) coordinate system.
  • FIG. 1 is a block diagram conceptually showing a lane violation detection apparatus using multiple cameras according to an embodiment of the present invention
  • FIG. 2 is a block diagram showing the configuration of a lane violation detection apparatus using multiple cameras according to an embodiment of the present invention.
  • 3A and 3B are flowcharts illustrating a lane violation detection method using multiple cameras according to an embodiment of the present invention.
  • FIG. 4 is a block diagram conceptually showing a lane violation vehicle enforcement system using a lane violation detection apparatus using multiple cameras according to an embodiment of the present invention
  • FIG. 5 is a block diagram showing the configuration of a lane violation vehicle enforcement system using a lane violation detection apparatus using multiple cameras according to an embodiment of the present invention.
  • FIG. 6 is a flowchart illustrating a lane change prohibition violation control process through a lane violation vehicle enforcement system using a lane violation detection apparatus using multiple cameras according to an exemplary embodiment of the present invention.
  • FIG. 1 to 3b are views illustrating a lane violation detection apparatus and method using multiple cameras according to an embodiment of the present invention. Referring to this, lane violation detection using multiple cameras according to an embodiment of the present invention is referred to. Describe the apparatus and method.
  • FIG. 1 is a block diagram conceptually illustrating an apparatus for detecting a lane violation using multiple cameras according to an exemplary embodiment of the present invention.
  • a lane violation detection apparatus (hereinafter referred to as a “lane violation detection apparatus") using multiple cameras according to an embodiment of the present invention is a plurality of lane change prohibition section 10 of the road along the driving direction of the vehicle Vehicle tracking cameras 111 to 113 of the vehicle, but overlapping sections of the recording area between two adjacent vehicle tracking cameras based on the lane 11 (hereinafter referred to as “shooting overlapping sections”) (or image tracking takeover areas) This is the configuration to be formed.
  • the rear vehicle tracking camera When the vehicle 20 tracked through the rear vehicle tracking camera enters the photographing overlap section A with the front vehicle tracking camera based on the driving direction of the vehicle 20, the rear vehicle tracking camera The information tracked through is transmitted to the control unit of the lane violation detection apparatus (not shown, see FIGS. 2 and 4), and the tracking operation for the vehicle 20 proceeds without interruption through the front vehicle tracking camera.
  • FIG. 2 is a block diagram showing the configuration of a lane violation detection apparatus according to an embodiment of the present invention.
  • the lane violation detection apparatus 100 is at least one vehicle tracking camera 110, the lane information detection unit 120, the detection area generation unit 130, the controller 140 It includes.
  • the lane change prohibition section, the vehicle driving the same, the photographing tracking camera, and the like are in accordance with the embodiment of FIG.
  • the vehicle tracking camera 110 is installed at a lane change prohibition section 10 of a road keeping a gap along a driving direction of the vehicle.
  • the vehicle tracking camera 110 is disposed in a state where an overlapping section (hereinafter referred to as “shooting overlapping section”) is formed between the capturing areas of two adjacent vehicle tracking cameras 111, 112, 112, and 113, and includes a multiple lane and The road is photographed for each section.
  • shooting overlapping section an overlapping section
  • the vehicle tracking camera 110 is provided with three 111-113 along the lane change prohibition section 10, but this is only one embodiment. Therefore, the present invention is not limited thereto, and the vehicle tracking camera may be installed in an appropriate number with reference to the total length of the lane change prohibition section and the average number of vehicles traveling therethrough.
  • the lane information detection unit 120 receives the image data photographed by the vehicle tracking camera 110 to determine the lane 11 from the image data.
  • the lane information detection unit 120 may include a color space conversion unit 121 and a lane determination unit 122.
  • the color space converter 121 receives the image data captured by the vehicle tracking camera 110, extracts the contour of the lane 11 having the color component from the image data, and then converts the color space of the extracted lane 11 into RGB ( Convert from Red, Green, Blue) coordinate system to HSI (Hue, Saturation, Intensity) coordinate system.
  • the lane determination unit 122 determines the lane 11 by comparing the HSI coordinate value input from the color space conversion unit 121 with a preset HIS reference value for each lane area of the lane change prohibition section 10.
  • the detection area generation unit 130 receives the image data of the vehicle tracking camera 110 and the lane determination signal of the lane information detection unit 120, and then detects each of the lane change prohibition sections 10 through the input data and signals.
  • the vehicle detection area (or vehicle tracking detection area) 131 is automatically generated for each lane 11 according to the pixel size of the vehicle image data included in the lane determination signal and the image data.
  • the detection area generator 130 may detect one of the at least one vehicle tracking camera 110.
  • the vehicle detection area 131 for each lane 11 is compared with the number of frames from the starting point of tracking of the vehicle 20 to the ending point of the tracking with a preset reference frame number. Automatically generated according to the pixel size of the.
  • the vehicle detection area 131 generated through the detection area generation unit 130 has a corresponding vehicle tracking camera 110 as the distance between the vehicle tracking camera 110 and the vehicle 20 increases.
  • the pixel size of the vehicle 20 obtained through the reduction is reduced, it may be formed in a long trapezoidal shape.
  • the controller 140 uses the vehicle detection area signal generated by the detection area generation unit 130 and the vehicle tracking camera 110 of the vehicle 20 traveling in the vehicle detection area 131.
  • Image data is input.
  • the controller 140 tracks the driving state of the vehicle 20 traveling along the lane change prohibition section 10 without interruption through at least one vehicle tracking camera 110 according to the input data and signal. That is, the controller 140 is an image captured by the rear vehicle tracking camera 110 on the basis of the driving direction of the vehicle 20 when entering the vehicle 20 in the overlapping section (A) between the vehicle tracking camera 110.
  • the data is received, and thus the tracking of the vehicle 20 through the rear vehicle tracking camera 110 is stopped and the vehicle 20 is subsequently tracked through the front vehicle tracking camera 110.
  • the controller 140 tracks the movement of the vehicle in the vehicle detection area 131 for each lane generated by the detection area generation unit 130, and when the vehicle is out of the lane, ends the vehicle tracking in the corresponding lane and tracks in the changed lane. Continue to save and transmit the lane change image of the vehicle
  • FIGS. 3A and 3B are flowcharts illustrating a lane violation detection method using multiple cameras according to an exemplary embodiment of the present invention.
  • a configuration of a lane violation detection apparatus including a vehicle tracking camera in the following description will be described with reference to FIGS. According to the embodiment 2, it is therefore noted that the sign of the configuration is also according to FIGS. 1 and 2.
  • the lane 11 is photographed separately through.
  • step S120 the image data photographed through the vehicle tracking camera 110 in step S120 is input to the color space converter 121 and the controller 140 of the lane information detector 120.
  • step S130 the color space converter 121 detects or extracts the outline of the lane 11 from the input image data.
  • step S140 the color space converter 121 converts the extracted RGB (Red, Green, Blue) color space of the lane 11 into a HSI (Hue, Saturation, Intensity) coordinate system.
  • RGB Red, Green, Blue
  • HSI Human, Saturation, Intensity
  • the HSI coordinate value converted through the color space conversion unit 121 is input to the lane determination unit 122 of the lane information detection unit 120 in step S150.
  • the lane determination unit 122 determines the lane 11 by comparing the HSI coordinate value input through the color space conversion unit 121 and the preset HSI reference value.
  • the image data of the vehicle tracking camera 110 and the lane determination signal of the lane information detection unit 120 are input to the detection area generation unit 130, and the detection area generation unit 130 is configured for each lane.
  • the vehicle detection area is automatically generated based on the pixel size of the lane discrimination signal and the vehicle image data included in the image data.
  • a signal of the vehicle detection area is input to the controller in step S170.
  • step S180 the controller 140 determines whether there is a vehicle 20 that is driving between the lanes determined by the lane determination unit 122.
  • step S190 the controller 140 tracks the vehicle 20 when it is determined that there is a driving vehicle 20 between the lanes 11 through step S180.
  • step S200 the controller 140 checks whether the vehicle 20 being tracked has changed the lane 11.
  • step S210 when it is determined in step S210 that there is no lane change of the vehicle 20 through step S200, the control unit 140 is connected to the photographing overlapping sections of two adjacent vehicle tracking cameras 110. Check whether you entered.
  • step S220 when it is determined that the vehicle 20 being tracked enters the photographing overlap section A between two adjacent vehicle tracking cameras 110, the rear vehicle based on the vehicle driving direction is determined.
  • the vehicle tracking through the tracking camera 110 is stopped and the tracking of the vehicle 20 is continued through the front vehicle tracking camera 110.
  • the controller 140 may track the first vehicle when the vehicle 20 being tracked enters the photographing overlap section A between the first and second vehicle tracking cameras 111 and 112. While tracking the vehicle 20 through the camera 111 is stopped, the tracking operation of the vehicle 20 is continued through the second vehicle tracking camera 112.
  • step S230 the controller 140 performs the tracking operation.
  • the vehicle 20 being tracked through the second vehicle tracking camera 112 checks whether the lane has been changed.
  • the vehicle 20 may determine that the second vehicle tracking camera 112 and the third vehicle tracking camera are correct. It is checked whether the inter-photographing overlapping section A has entered.
  • step S250 the controller 140 determines that the vehicle being tracked has entered the photographing overlap section A between the second vehicle tracking camera 112 and the third vehicle tracking camera 113.
  • the vehicle tracking through the tracking camera 112 is stopped and the tracking operation for the vehicle 20 is continued through the third vehicle tracking camera 113.
  • step S200 determines whether the vehicle 20 being tracked has changed the lane 11 in step S200.
  • the control unit 140 continues tracking the vehicle 20 in the changed lane in step S205.
  • the controller 140 may determine whether the lane of the vehicle 20 being tracked is changed based on the pixel change of the vehicle image data among the image data through the vehicle tracking camera 110.
  • step S205 proceeds in the same manner in step S235.
  • the lane violation detecting apparatus travels in the lane change prohibition section 10 through the controller 140 and at least one vehicle tracking camera 110 for each lane controlled by the controller 140. Multiple lanes in progress can be tracked without interruption to detect lane violations.
  • FIG. 4 is a schematic view showing a lane violation vehicle enforcement system using a lane violation detection apparatus by multiple cameras according to an embodiment of the present invention
  • FIG. 5 is a lane by multiple cameras according to an embodiment of the present invention. It is a block diagram which shows the structure of the lane violation vehicle control system using a violation detection apparatus.
  • a lane violation vehicle enforcement system (hereinafter referred to as a "lane violation vehicle enforcement system") using a lane violation detection apparatus by multiple cameras according to an embodiment of the present invention is a lane violation detection apparatus 100, Vehicle number recognition camera 200, lane violation management server 300 is included.
  • the lane violation detection apparatus 100 has the same configuration as the lane violation detection apparatus 100 described with reference to FIGS. 1 and 2, and accordingly, the vehicle number recognition camera 200 and the lane violation management server 300 are described below. Explain the center.
  • the vehicle number recognition camera 200 is installed on the front side from the end of the lane change prohibition section 10 based on the driving direction of the vehicle 20 with respect to the lane change prohibition section 10 and received from the lane violation detecting apparatus 100.
  • the lane change vehicle is photographed according to the control signal.
  • the vehicle number recognition camera 200 is installed to have a photographing area overlapping with the vehicle tracking camera located at the foremost of the vehicle tracking cameras 110 of the lane violation detection apparatus 100 based on the vehicle driving direction,
  • the vehicle tracking camera 110 transmits a trigger signal to the vehicle number recognition camera 200 when entering a lane change violation vehicle in an overlapping photographing area with the vehicle number recognition camera 200.
  • the vehicle number recognition camera 200 that receives the trigger signal photographs a vehicle that violates the lane change prohibition law, detects the vehicle number of the violation vehicle, and transmits the vehicle number to the lane violation management server 300. That is, the vehicle number recognition camera 200 includes a number recognition controller 220 for extracting a vehicle number from the vehicle image data photographed according to the lane change prohibition law.
  • the lane violation management server 300 receives image data photographed by the vehicle number recognition camera 200, detects a vehicle number of the vehicle, and detects vehicle information corresponding to the detected vehicle number from the vehicle information database 311. .
  • the lane violation management server 300 is connected to the control unit 140 and the vehicle number recognition camera 200 of the lane violation detection device 100 through a communication network, the vehicle tracking camera (transmitted from the lane violation detection device 100 ( The image data of 110 and its related information are updated in the vehicle driving information database 312.
  • the lane violation management server 300 includes a vehicle information database 311, a vehicle driving information database 312, an online bill generation unit 320, a mail server 330, a text message server 340, and the like.
  • the vehicle information database 311 and the vehicle driving information database 312 are included in the database server 310 connected to the lane violation management server 300, that is, the database server 310 is a lane violation management server 300. It stores various data and signals transmitted and received and processed through.
  • the vehicle information database 311 stores vehicle information and other vehicle-related information of the vehicles
  • the vehicle driving information database 312 includes vehicle driving information of the lane change prohibition section 10 transmitted from the lane violation detecting apparatus 100. Save it.
  • the data transmitted from the lane violation detecting apparatus 100 is stored in the vehicle driving information database 312 in such a manner that the data is continuously updated.
  • the online bill generation unit 320 combines the vehicle information detected from the vehicle information database 311 and the lane change violation information detected from the vehicle driving information database 312 to generate an online penalty payment notice.
  • the payment notice is sent to the smartphone 400 of the user who owns the vehicle.
  • the lane violation management server 300 includes a mail server 330 and a text message server 340.
  • the mail server 330 generates a corresponding mail to transmit the online penalty payment notice generated through the online bill generation unit 320 and its issuance to the smartphone owner 400 of the vehicle owner.
  • the text message server 340 generates a corresponding text message to transmit the fact of issuing an online penalty payment notice to the vehicle owner's smartphone (400).
  • the online penalty payment notice and related mail and text messages are sent to the smart phone 400 of the user who owns the vehicle as an example, but the present invention is not limited thereto.
  • portable communication terminals with computing functions can be used.
  • the vehicle number recognition camera 200 of the lane violation vehicle control system includes a speed sensor 210, and may determine whether the vehicle is speeding through a vehicle driving speed signal detected by the speed sensor 210. have.
  • the lane violation vehicle control system may have the function of controlling the speeding vehicle.
  • FIG. 6 is a flowchart illustrating an operation state of a lane violation vehicle control system according to an exemplary embodiment of the present invention, wherein a lane change prohibition violation and a speeding vehicle in a lane violation prohibition section are controlled through the lane violation vehicle enforcement system with reference to this FIG. Explain the process.
  • step S110 notification information about a vehicle that violates the lane change prohibition rule is transmitted from the lane violation detecting apparatus 100 to the vehicle number recognition camera 200.
  • step S120 the vehicle number recognition camera 200 extracts the vehicle number of the vehicle after photographing a violation of the corresponding lane change prohibition rule according to the signal in step S110.
  • the image data photographed from the vehicle number recognition camera 200 in step S130 is transmitted to the lane violation management server 300.
  • step S140 the lane violation management server 300 extracts the relevant data of the vehicle in violation of the lane change prohibition rule from the image data received from the vehicle number recognition camera 200.
  • step S150 the lane violation management server 300 detects vehicle information of the vehicle from the database server 310 in the extracted violation vehicle data.
  • step S160 the lane violation management server 300 records the violation data of the vehicle in violation of the lane change prohibition regulation transmitted from the vehicle number recognition camera 200 in the vehicle driving information database 312 of the database server 310.
  • the online bill generation unit 320 of the lane violation management server 300 may detect lane change violation information detected from the vehicle information database 311 and lane change violation information detected from the vehicle driving information database 312. Combine to generate an online penalty payment statement for the vehicle.
  • the lane violation management server 300 may combine the speed violation information through the speed sensor 210 to generate an online penalty payment notice for the vehicle.
  • step S180 the lane violation management server 300 transmits the online penalty payment notice generated in step S170 to the mail server 330, and in step S190, the lane violation management server 300 In step S170, the information on the fact that the online penalty payment statement is issued is transmitted to the text message server 340.
  • step S200 the mail server 330 generates an e-mail to which the online penalty payment statement is attached and transmits it to the smartphone 400 of the user who owns the vehicle, and also in step S210, the text message server. 340 generates a text message for notifying the fact that the online penalty payment notice and the mail attached to it and transmits it to the smartphone 400 of the user who owns the vehicle.
  • the speed sensor 210 transmits a detection signal of the vehicle speed to the vehicle number recognition camera 200.
  • step S225 the vehicle number recognition camera 200 determines whether the vehicle is speeded based on the signal received from the speed sensor 210, and in step S230, the vehicle number recognition camera 200 determines the speed of the vehicle.
  • Speed-related data is transmitted to the lane violation management server 300 through a communication network.
  • step S250 the lane violation management server 300 generates an online fine payment notice through the online bill generation unit 320.
  • step 250 is transmitted to the smartphone 400 of the user who owns the vehicle through step S290 in step S260, which is step S210 in step S180. Since it is the same method as in), detailed description thereof will be omitted.
  • the lane violation detection apparatus using the multiple cameras according to the present invention the lane violation detection method using the same, and the lane violation vehicle using the lane violation detection apparatus using the multiple cameras according to the present invention.
  • the system installs multiple cameras in the lane change prohibition section to prevent the vehicle from violating the lane, and prevents accidents by cracking down on the lane violation vehicle, thereby reducing life and property damage and implementing an advanced traffic culture. .
  • multiple vehicle tracking cameras installed along the driving direction of the vehicle in the lane change prohibition section are arranged to have a photographing overlapping area between two adjacent cameras, and the vehicle tracking operation of the rear vehicle tracking camera is forward based on the vehicle driving direction.
  • the determination process for each lane of the lane change prohibition section may include converting an RGB (Red, Green, Blue) coordinate system into a HSI (Hue, Saturation, Intensity) coordinate system.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Traffic Control Systems (AREA)

Abstract

The present invention relates to a lane violation detection device using multiple cameras, a lane violation detection method using the same, and a lane violation enforcement system using the lane violation detection device with multiple cameras, wherein multiple cameras are mounted along a lane change prohibited section in order to guide vehicles so as to prevent lane violations and to control lane-violation vehicles, thereby preventing accidents and accordingly reducing human casualties and property damages and implementing an advanced traffic safety culture.

Description

다중 카메라를 이용한 차선 위반 검출 장치 및 이를 이용한 차선 위반 검출 방법, 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속시스템Lane violation detection device using multiple cameras, lane violation detection method using same, lane violation vehicle control system using lane violation detection device using multiple cameras
본 발명은 차선변경 금지구간에 다중으로 카메라를 설치하여 차량이 차선을 위반하지 않도록 계도하는 동시에 차선 위반 차량을 단속하여 사고를 미연에 예방하고 그에 따른 인명과 재산피해 축소 및 교통 선진 문화 구현을 가능케 하는 다중카메라를 이용한 차선 위반 검출 장치 및 이를 이용한 차선 위반 검출 방법, 그리고 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속시스템에 관한 것이다.The present invention provides multiple cameras in the lane change prohibition section to prevent the vehicle from violating the lane and at the same time controls the vehicle in violation of the lane to prevent accidents in advance, thereby reducing life and property damage and implementing an advanced traffic culture. A lane violation detection apparatus using multiple cameras, a lane violation detection method using the same, and a lane violation vehicle enforcement system using a lane violation detection apparatus using multiple cameras.
2010년 국토해양부 통계자료에 의하면, 국내 터널의 수는 대략 1382개이고 교량 수는 대략 27381개인 것으로 조사되었다. 그리고 도로가 지속적으로 추가 건설되는 것에 비춰볼 때, 터널과 교량 역시 지속적으로 증가할 것으로 예상된다.According to the 2010 Ministry of Land, Transport and Maritime Affairs statistics, the number of domestic tunnels is about 1382 and the number of bridges is about 27381. And in view of the continued construction of additional roads, tunnels and bridges are also expected to increase.
여기서, 자동차 도로를 예로 터널 및 교량 구간이 다른 일반구간에 비해 사고 위험이 높은 것으로 조사되며, 따라서 자동차 도로의 터널 및 교량 구간에 대한 진입 전부터 진입 후 까지의 일정 거리가 차선변경 금지구간으로 지정되어 실선으로 표시된다.Here, for example, the tunnel and the bridge section has a higher risk of accident than the other sections of the automobile road, and therefore, a certain distance from before the entry to the tunnel and the bridge section of the automobile road is designated as the lane change prohibition section. It is indicated by a solid line.
또한 인터체인지의 경우에도 일정 구간이 차선변경 금지구간으로 지정되어 그 차선이 실선으로 표시되며, 이밖에 고속도로의 갓길은 일반차량의 진입 금지 구간으로 표시되어 넓은 의미에서 차선변경 금지구간에 해당된다.Also, in the case of interchange, a certain section is designated as a lane change prohibition section, and the lane is indicated by a solid line. In addition, the shoulder of a highway is indicated as an entry prohibition section of a general vehicle and thus corresponds to a lane change prohibition section.
그러나, 현재 자동차의 운전자들은 상기와 같은 차선변경 금지구간에서의 높은 사고 발생률을 심각하게 인지하지 않거나 망각한체 차선변경 금지구간에서도 빈번하게 차선 변경을 하고 있다. 다시 말해 대다수의 운전자들이 차선변경 금지구간에서의 차선 변경 금지 규정을 잘 지키지 않고 있다.However, at present, the drivers of automobiles are not seriously aware of the high accident rate in the lane change prohibition section as described above, or frequently change lanes in the lane change prohibition section forgotten. In other words, the majority of drivers do not comply with the lane change ban on lane change bans.
화물 차량을 예로 부연 설명하면, 화물 차량의 차선변경 금지 위반으로 뒤따르던 승용차가 이의 추월을 위해 재차 차선을 위반하는 사례가 빈번히 발생하여 사고 발생의 위험을 한층 높이고 있으며, 이에 따른 사고로 인해 많은 인명과 재산피해 등 사회적 손실이 발생되고 있다.In the case of a freight vehicle, a case in which a passenger car following a lane change violation of a freight vehicle has been repeatedly violated again for the purpose of overtaking it increases the risk of an accident, further increasing the risk of an accident. Social losses such as property damage and property damage are occurring.
또한 터널의 경우 한국도로공사에서는 2차 사고를 예방하기 위해 사고자동감지 시스템을 도입하여 운영하고 있으나, 이는 1차 사고를 예방하는 근본적인 수단이 되지 못한다. 이밖에 일부 터널과 교량의 진입 전과 진출 후 구간에 해당 구간의 속도위반을 단속하기 위한 구간단속 시스템이 설치되어 운영되고 있으나, 이는 차선위반으로 발생되는 사고의 예방 기능과는 무관하다.In the case of tunnels, Korea Expressway Corporation has introduced and operated an automatic accident detection system to prevent secondary accidents, but this is not a fundamental means of preventing primary accidents. In addition, a section crackdown system has been installed and operated to crack down on speed violations in some tunnels and bridges before and after entering, but this has nothing to do with the prevention of accidents caused by lane violations.
본 발명의 배경기술은 한국등록특허 제10-0444762호(2004.08.06.등록, 도로 차선위반 감시, 추적시스템 및 그 방법) 및 한국등록특허 제10-0553447호(2006.02.11.등록, 차선변경 단속 시스템 및 그 방법)에 개시되어 있다.Background art of the present invention is Korean Patent No. 10-0444762 (2004.08.06. Registration, road lane violation monitoring, tracking system and method) and Korean Patent No. 10-0553447 (February 11, 2006, lane change Intermittent system and method).
따라서, 본 발명은 상기와 같은 문제점을 해결하기 위해 제안된 것으로서, 차선변경 금지구간에 다중으로 카메라를 설치하여 차량이 차선을 위반하지 않도록 계도하는 동시에 차선 위반 차량을 단속하여 사고를 미연에 예방하고 그에 따른 인명과 재산피해 축소 및 교통 선진 문화 구현을 가능케 하는 다중 카메라를 이용한 차선 위반 검출 장치 및 이를 이용한 차선 위반 검출 방법을 제공하는데 목적이 있다.Accordingly, the present invention has been proposed to solve the above problems, by installing multiple cameras in the lane change prohibition section to prevent the vehicle from violating the lane and at the same time crack down on the lane violation vehicle to prevent accidents in advance It is an object of the present invention to provide a lane violation detection device using multiple cameras and a lane violation detection method using the same, which can reduce life and property damage and implement an advanced traffic culture.
또한, 본 발명은 차선변경 금지구간에 차량의 주행 방향을 따라 설치되는 다중의 차량 추적 카메라가 인접한 두 카메라 간에 촬영 중첩 영역을 갖도록 배치되고, 차량 주행 방향을 기준으로 후방 쪽 차량 추적 카메라의 차량 추적 동작이 전방 쪽 카메라와의 촬영 중첩 영역에서 전방 쪽 차량 추적 카메라로 인계되는 방식을 취해 차선별로 다중 차량에 대해 추적 과정의 중단 없이 추적 가능한 다중 카메라를 이용한 차선 위반 검출 장치 및 이를 이용한 차선 위반 검출 방법을 제공하는데 목적이 있다.In addition, according to the present invention, a plurality of vehicle tracking cameras installed along a driving direction of a vehicle in a lane change prohibition section are arranged to have a photographing overlapping area between two adjacent cameras, and the vehicle tracking camera of the rear vehicle tracking camera is based on the vehicle driving direction. Lane violation detection device using multiple cameras and lane violation detection method using multiple cameras that can be tracked without interruption of the tracking process for each vehicle by taking a method in which the motion is taken over by the front vehicle tracking camera in the overlapping area with the front camera The purpose is to provide.
또한, 본 발명은 차선변경 금지구간의 각 차선에 대한 판별 과정이 RGB(Red, Green, Blue) 좌표계를 HSI(Hue, Saturation, Intensity) 좌표계로 변환하는 과정을 포함하여 이루어지는 다중 카메라를 이용한 차선 위반 검출 장치 및 이를 이용한 차선 위반 검출 방법을 제공하는데 목적이 있다.In addition, the present invention is a lane violation using a multi-camera determination process for the determination of each lane of the lane change prohibited section includes converting a RGB (Red, Green, Blue) coordinate system into a HSI (Hue, Saturation, Intensity) coordinate system An object of the present invention is to provide a detection apparatus and a lane violation detection method using the same.
또한, 본 발명은 상기 차선 위반 검출 장치 및 차선 위반 검출 방법 그리고 인터넷과 이동통신망 등의 통신망 및 정보통신기기를 통해 차선 변경 차량에 대한 단속을 원격제어 할 수 있고, 이와 동시에 차선변경 금지구간에서 차선을 변경하여 단속된 차량 소유주들에게 온라인 과태료 고지서를 온라인으로 전송할 수 있는 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속 시스템을 제공하는데 목적이 있다.In addition, the present invention can remotely control the crackdown on the lane change vehicle through the lane violation detection device and lane violation detection method and the communication network and information communication devices, such as the Internet and mobile communication network, and at the same time the lane in the lane change prohibited section It is an object of the present invention to provide a lane violation control system using a lane violation detection apparatus using multiple cameras that can transmit online penalty notices online to cracked down vehicle owners.
상기와 같은 목적을 달성하기 위해 본 발명의 일 측면에 따른 다중 카메라를 이용한 차선 위반 검출장치는, 도로의 차선변경 금지구간에서 미리 설정된 도로 구간과 차선을 각기 촬영하는 적어도 하나 이상의 차량 추적 카메라와, 상기 차량 추적 카메라에서 촬영된 영상데이터로부터 차선을 판별하는 차선 정보 검출부와, 상기 차량 추적 카메라의 영상데이터 및 상기 차선 정보 검출부의 차선 판별신호를 입력받아 각 차선별로 차량 검지영역을 자동 생성하는 검지영역 생성부와, 상기 검지영역 생성부를 통해 생성되는 차량 검지영역 신호 및 해당 차량 검지영역에서 주행하는 차량의 영상데이터를 입력받아 상기 차선변경 금지구간을 따라 주행하는 차량의 주행 상태를 추적하는 제어부를 포함하며, 상기 적어도 하나 이상의 차량 추적 카메라는 상기 도로의 차선변경 금지구간의 차량 주행 방향을 따라 기 설정된 배치 간격으로 설치하되, 상기 배치 간격은 각 카메라의 촬영 영역 간에 기 설정된 촬영 중첩 구간이 형성되게 설정된 간격이며, 상기 차량 검지영역은 상기 차선 판별신호 및 영상데이터에 포함된 차량 영상데이터의 픽셀 크기를 기준으로 생성되는 것을 특징으로 한다.In order to achieve the above object, a lane violation detection apparatus using a multiple camera according to an aspect of the present invention includes at least one vehicle tracking camera for photographing a predetermined road section and a lane in a lane change prohibition section of a road; A detection area for automatically generating a vehicle detection area for each lane by receiving a lane information detection unit for determining a lane from the image data photographed by the vehicle tracking camera and a lane determination signal of the vehicle tracking camera and the lane determination signal of the lane information detection unit A generation unit and a control unit which receives a vehicle detection area signal generated by the detection area generation unit and image data of a vehicle running in the vehicle detection area and tracks a driving state of a vehicle running along the lane change prohibition section; The at least one vehicle tracking camera is the It is installed at a predetermined arrangement interval along the vehicle driving direction of the lane change prohibition section of the road, wherein the arrangement interval is an interval in which a preset photographing overlapping section is formed between the photographing regions of each camera, and the vehicle detecting region is the lane discrimination. And the pixel size of the vehicle image data included in the signal and the image data.
본 발명에 있어서, 상기 차선 정보 검출부는, 상기 차량 추적 카메라에서 촬영되는 영상데이터를 수신하여 상기 영상데이터로부터 색상 성분이 있는 차선의 윤곽선을 추출한 후 상기 추출된 차선의 색 공간을 RGB(Red, Green, Blue) 좌표계에서 HSI(Hue, Saturation, Intensity) 좌표계로 변환하는 색공간 변환부 및 상기 색 공간 변환부에서 입력되는 HSI 좌표값을 상기 차선변경 금지구간의 각 차선 영역별로 사전 설정된 HIS 기준값과 비교하여 차선을 판별하는 차선 판별부를 포함하는 것을 특징으로 한다.The lane information detection unit may receive image data photographed by the vehicle tracking camera, extract an outline of a lane having a color component from the image data, and then convert the color space of the extracted lane into RGB (Red, Green). And a color space conversion unit for converting a HUE (Hue, Saturation, Intensity) coordinate system from the coordinate system and an HSI coordinate value input from the color space conversion unit with a preset HIS reference value for each lane area of the lane change prohibition section. And a lane discrimination unit for discriminating lanes.
본 발명에 있어서, 상기 차량 추적 카메라 간의 촬영 중첩 구간에 차량 진입 시 해당 차량의 주행 방향을 기준으로 후방의 차량 추적 카메라를 통해 촬영된 영상데이터가 상기 제어부에 입력되고, 상기 제어부는 후방의 차량 추적 카메라를 통한 해당 차량의 추적을 중지하는 동시에 전방의 차량 추적 카메라를 통해 해당 차량을 이어서 추적하는 것을 특징으로 한다.In the present invention, when the vehicle enters the photographing overlap section between the vehicle tracking camera, the image data photographed through the rear vehicle tracking camera based on the driving direction of the vehicle is input to the controller, and the controller tracks the vehicle behind the vehicle. The tracking of the vehicle through the camera is stopped, and the vehicle is subsequently tracked through the vehicle tracking camera.
본 발명에 있어서, 상기 검지영역 생성부는, 상기 차선 정보 검출부의 차선 판별 신호에 따라 차선과 차선 사이에서 차량 주행이 시작되면 상기 차량추적 카메라의 영상데이터에서 차량의 추적 시작 시점부터 추적 종료 시점까지의 프레임 수를 사전 설정된 기준 프레임 수와 비교하여 차선 별 차량 검지영역을 차량 영상데이터의 픽셀 크기에 따라 자동 생성하는 것을 특징으로 한다.In the present invention, when the vehicle starts to drive between the lane and the lane according to the lane discrimination signal of the lane information detection unit, the detection area generating unit is configured to perform the tracking data from the starting point of the vehicle to the ending point of the tracking in the image data of the vehicle tracking camera. The vehicle detection area for each lane is automatically generated according to the pixel size of the vehicle image data by comparing the frame number with a preset reference frame number.
본 발명에 있어서, 상기 제어부는, 상기 검지영역 생성부를 통해 생성된 상기 차선별 검지영역에서 차량의 움직임을 추적하고, 차량이 현재 주행 중인 차선을 벗어나면 해당 차선에서의 차량 추적을 종료하고 변경된 차선에서의 해당 차량에 대한 추적을 계속하며, 차량의 차선 변경 영상을 저장하여 전송하는 것을 특징으로 한다.In the present invention, the controller tracks the movement of the vehicle in the lane-specific detection zones generated by the detection zone generation unit, and ends the tracking of the vehicle in the corresponding lane when the vehicle leaves the current lane. Continue tracking the vehicle in the, characterized in that for storing and transmitting the lane change image of the vehicle.
본 발명에 있어서, 상기 검지영역 생성부는, 상기 차량 추적 카메라와 차량 간의 간격이 벌어질수록 해당 차량 추적 카메라를 통해 획득되는 해당 차량의 픽셀 크기가 축소됨에 따라 상기 차량 검지영역을 긴 사다리꼴 형상으로 형성시키는 것을 특징으로 한다.In the present invention, the detection area generation unit forms the vehicle detection area in a long trapezoidal shape as the pixel size of the vehicle obtained by the vehicle tracking camera decreases as the distance between the vehicle tracking camera and the vehicle increases. It is characterized by.
본 발명의 다른 측면에 따른 다중 카메라를 이용한 차선 위반 검출 방법은, 차선변경 금지구간의 차량 주행 방향을 따라 설치된 적어도 하나 이상의 차량 추적 카메라를 통해 주행 차량의 영상데이터를 획득하는 단계와, 상기 차량 추적 카메라에서 획득한 영상데이터가 차선 정보 검출부에 입력되어 상기 차선 정보 검출부가 상기 영상데이터로부터 차선을 판별하는 단계와, 상기 차량 추적 카메라의 영상데이터 및 상기 차선 정보 검출부의 차선 판별신호를 검지영역 생성부가 입력받아 각 차선별로 차량 검지영역을 자동 생성하는 단계 및 상기 검지영역 생성부를 통해 생성되는 차량 검지영역 신호 및 해당 차량 검지영역에서 주행하는 차량의 영상데이터를 제어부가 입력받아 상기 차선변경 금지구간을 따라 주행하는 차량의 주행 상태를 추적하는 단계를 포함하며, 상기 검지영역 생성부는 상기 차선변경 금지구간에 포함된 각 차선의 차량 추적 카메라별 촬영 구간에 대한 차량 검지영역을 개별적으로 생성하며, 상기 차량 검지영역은 상기 차선 판별신호 및 영상데이터에 포함된 차량 영상데이터의 픽셀 크기를 기준으로 생성되며, 상기 제어부가 입력받는 영상데이터는 상기 차량 추적 카메라간의 촬영 중첩 구간이 포함된 영상데이터인 것을 특징으로 한다.According to another aspect of the present invention, a lane violation detection method using multiple cameras may include obtaining image data of a driving vehicle through at least one vehicle tracking camera installed along a vehicle driving direction of a lane change prohibition section, and tracking the vehicle. The image data acquired by the camera is input to the lane information detection unit, and the lane information detection unit determines a lane from the image data, and the detection area generation unit detects the image data of the vehicle tracking camera and the lane determination signal of the lane information detection unit. Automatically generating a vehicle detection area for each lane by receiving the input signal, and receiving a vehicle detection area signal generated by the detection area generation unit and image data of a vehicle running in the vehicle detection area according to the lane change prohibition section. To track the driving conditions of the vehicle And the detection area generation unit individually generates a vehicle detection area for a photographing section for each vehicle tracking camera of each lane included in the lane change prohibition section, and the vehicle detection area includes the lane determination signal and image data. It is generated based on the pixel size of the vehicle image data included in the, the image data received by the control unit is characterized in that the image data including a photographing overlap section between the vehicle tracking camera.
본 발명에 있어서, 상기 차선 정보 검출부를 통한 상기 차선변경 금지구간의 차선 판별은, 상기 차량 추적 카메라를 통해 촬영되는 영상데이터가 색 공간 변환부에 입력되어 상기 색 공간 변환부가 입력되는 영상데이터로부터 색상 성분이 있는 차선의 윤곽선을 추출한 후 추출된 차선의 색 공간을 RGB(Red, Green, Blue) 좌표계에서HSI(Hue, Saturation, Intensity) 좌표계로 변환하는 과정, 그리고 상기 색 공간 변환부에서 변환된 HSI 좌표값이 차선 판별부에 입력되어 상기 차선 판별부가 입력된 HSI 좌표값을 상기 차선변경 금지구간의 각 차선 영역별로 사전 설정된 HIS 기준값과 비교하여 차선을 판별하는 과정을 포함하여 이루어지는 것을 특징으로 한다.In the present invention, lane determination of the lane change prohibition section through the lane information detection unit may include color from image data inputted by the color space conversion unit to which image data photographed through the vehicle tracking camera is input to the color space conversion unit. After extracting the contour of the lane with components, converting the extracted color space from the RGB (Red, Green, Blue) coordinate system to HSI (Hue, Saturation, Intensity) coordinate system, and the HSI converted by the color space converter And a coordinate value is input to the lane discrimination unit to determine the lane by comparing the HSI coordinate value input by the lane discrimination unit with a preset HIS reference value for each lane area of the lane change prohibition section.
본 발명에 있어서, 상기 제어부를 통한 차량의 추적은, 상기 차량 추적 카메라간의 촬영 중첩 구간에 차량 진입 시 해당 차량의 주행 방향을 기준으로 후방의 차량 추적 카메라를 통해 촬영된 영상데이터가 상기 제어부에 입력되면서 상기 제어부는 후방의 차량 추적 카메라를 통한 해당 차량의 추적을 중지하는 동시에 전방의 차량 추적 카메라를 통해 해당 차량을 이어서 추적하는 과정을 포함하여 이루어지는 것을 특징으로 한다.In the present invention, the tracking of the vehicle through the control unit, the image data captured by the rear vehicle tracking camera on the basis of the driving direction of the vehicle when the vehicle enters the shooting overlap section between the vehicle tracking camera is input to the control unit The control unit is characterized in that it comprises a process of stopping the tracking of the vehicle through the vehicle tracking camera in the rear and at the same time following the vehicle tracking through the vehicle tracking camera in front.
본 발명의 다른 측면에 따른 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속 시스템은, 도로의 차선변경 금지구간에서 미리 설정된 도로 구간과 차선을 각기 촬영하는 적어도 하나 이상의 차량 추적 카메라와, 상기 차량 추적 카메라에서 촬영된 영상데이터로부터 차선을 판별하는 차선 정보 검출부와, 상기 차량 추적 카메라의 영상데이터 및 상기 차선 정보 검출부의 차선 판별신호를 입력받아 각 차선별로 차량 검지영역을 자동 생성하는 검지영역 생성부와, 상기 검지영역 생성부를 통해 생성되는 차량 검지영역 신호 및 해당 차량 검지영역에서 주행하는 차량의 영상데이터를 입력받아 상기 차선변경 금지구간을 따라 주행하는 차량의 주행 상태를 추적하는 제어부;를 포함하여 상기 차선변경 금지구간에서 주행하는 차량 중 차선을 변경한 차량을 검출하는 차선 위반 검출 장치와, 상기 차선변경 금지구간에 대한 차량의 주행 방향을 기준으로 상기 차선변경 금지구간의 종단으로부터 전방 쪽에 설치되어 상기 차선 위반 검출 장치로부터 수신되는 제어 신호에 따라 차선 변경 차량을 촬영 후 해당 차량의 차량번호 데이터를 추출하는 차량번호인식 카메라 및 기 차량번호인식 카메라에서 전송되는 차선 변경 차량의 위반 데이터를 수신하여 해당 차량번호에 해당하는 차적 정보를 차량정보 데이터베이스로부터 검출하는 차선위반 관리서버를 포함하며, 상기 적어도 하나 이상의 차량 추적 카메라는 상기 도로의 차선변경 금지구간의 차량 주행 방향을 따라 기 설정된 배치 간격으로 설치하되, 상기 배치 간격은 각 카메라의 촬영 영역 간에 기 설정된 촬영 중첩 구간이 형성되게 설정된 간격이며, 상기 차량 검지영역은 상기 차선 판별신호 및 영상데이터에 포함된 차량 영상데이터의 픽셀 크기를 기준으로 생성되는 것을 특징으로 한다.According to another aspect of the present invention, a lane violation vehicle control system using a multiple camera lane detection apparatus includes: at least one vehicle tracking camera for photographing a predetermined road section and a lane at a lane change prohibition section of a road; A lane information detection unit for determining a lane from the image data captured by the vehicle tracking camera and a lane detection signal for automatically generating a vehicle detection area for each lane by receiving the image data of the vehicle tracking camera and the lane determination signal of the lane information detection unit. And a control unit which receives a vehicle detection area signal generated by the detection area generation unit and image data of a vehicle running in the vehicle detection area and tracks a driving state of a vehicle traveling along the lane change prohibition section. The vehicle traveling in the lane change prohibition section A lane violation detection device for detecting a vehicle that has changed lanes and a control provided at a front side from an end of the lane change prohibited section based on a driving direction of the vehicle with respect to the lane change prohibited section and received from the lane violation detection device After taking a lane change vehicle according to a signal, the vehicle number recognition camera extracting the vehicle number data of the vehicle and the lane change vehicle transmitted from the vehicle number recognition camera are received to receive vehicle information corresponding to the vehicle number. And a lane violation management server for detecting from an information database, wherein the at least one vehicle tracking camera is installed at a predetermined arrangement interval along a vehicle driving direction of the lane change prohibition section of the road, wherein the arrangement interval is photographed by each camera. Preset overlapping section is formed between regions The vehicle detection area is generated based on the pixel size of the vehicle image data included in the lane determination signal and the image data.
본 발명에 있어서, 상기 차선 위반 검출 장치의 제어부 및 상기 차량번호 인식 카메라는, 각각 상기 차선위반 관리서버와 통신망을 통해 접속되며, 상기 제어부에 입력되는 상기 차량 추적 카메라의 영상데이터 및 그 관련 정보는 상기 통신망을 통해 상기 차선 위반 관리서버에 전송되어 해당 정보의 저장을 위해 상기 차선위반 관리서버에 접속된 차량 주행정보 데이터베이스에 업데이트되는 것을 특징으로 한다.In the present invention, the control unit of the lane violation detection device and the vehicle number recognition camera, respectively, is connected to the lane violation management server through a communication network, the image data of the vehicle tracking camera input to the control unit and the related information The vehicle is transmitted to the lane violation management server through the communication network and updated in a vehicle driving information database connected to the lane violation management server for storing the corresponding information.
본 발명에 있어서, 상기 차선위반 관리서버는, 상기 차량정보 데이터베이스로부터 검출된 차적정보 및 상기 차량 주행정보 데이터베이스로부터 검출된 차선변경 위반 정보를 조합하여 차선변경 금지 위반 차량에 제공하기 위한 온라인 과태료 납부고지서를 생성하는 온라인 고지서 생성부를 포함하는 것을 특징으로 한다.In the present invention, the lane violation management server, the online fine payment notice for providing a lane change prohibition violation vehicle by combining the vehicle information detected from the vehicle information database and the lane change violation information detected from the vehicle driving information database It characterized in that it comprises an online bill generating unit for generating a.
본 발명에 있어서, 상기 차선위반 관리서버는, 온라인 고지서 생성부를 통해 생성된 온라인 과태료 납부고지서 및 그 발급 사실을 해당 차량 운전자의 컴퓨팅 기능이 있는 휴대용 통신단말기에 전송하기 위한 메일서버 및 문자메시지 서버;를 포함하는 것을 특징으로 한다.In the present invention, the lane violation management server, a mail server and a text message server for transmitting the online penalty payment invoice generated through the online bill generation unit and the fact that the issue to a portable communication terminal having a computing function of the vehicle driver; Characterized in that it comprises a.
본 발명에 있어서, 상기 차선 위반 검출 장치의 차량 추적 카메라 중 차량 주행 방향을 기준으로 최전방에 위치한 차량 추적 카메라와 상기 차량번호인식 카메라는 중첩되는 촬영 영역을 갖도록 설치되고, 상기 최전방의 차량 추적 카메라는 상기 차량번호인식 카메라와의 중첩 촬영 영역에 차선변경 위반 차량 진입 시 트리거신호를 상기 차량번호인식 카메라에 전송하는 것을 특징으로 한다.In the present invention, the vehicle tracking camera located at the foremost of the vehicle tracking cameras of the lane violation detection apparatus with respect to the vehicle driving direction and the vehicle number recognition camera are installed to have an overlapping shooting area, and the front vehicle tracking camera is And a trigger signal transmitted to the vehicle number recognition camera when the vehicle enters a lane change violation in the overlapping photographing area with the vehicle number recognition camera.
본 발명에 있어서, 상기 차량번호인식 카메라는 속도 센서를 구비하여 상기 속도 센서에서 감지되는 차량 주행 속도 신호를 통해 해당 차량의 과속 여부를 판별하는 것을 특징으로 한다.In the present invention, the vehicle identification camera is provided with a speed sensor to determine whether or not the vehicle is overspeed through the vehicle speed signal detected by the speed sensor.
본 발명에 따르면, 차선변경 금지구간에 다중으로 카메라를 설치하여 차량이 차선을 위반하지 않도록 계도하는 동시에 차선 위반 차량을 단속하여 사고를 미연 에 예방함으로써, 인명과 재산피해 축소 및 교통 선진 문화 구현이 가능해진다.According to the present invention, by installing multiple cameras in the lane change prohibition section to prevent the vehicle from violating the lane and at the same time controlling the vehicle in violation of the lane, preventing accidents in advance, thereby reducing life and property damage and implementing an advanced traffic culture. It becomes possible.
또한, 차선변경 금지구간에 차량의 주행 방향을 따라 설치되는 다중의 차량추적 카메라가 인접한 두 카메라 간에 촬영 중첩 영역을 갖도록 배치되고, 차량 주행 방향을 기준으로 후방 쪽 차량 추적 카메라의 차량 추적 동작이 전방 쪽 카메라와의 촬영 중첩 영역에서 전방 쪽 차량 추적 카메라로 인계되는 방식을 취해 하나의 차량을 기준으로 해당 차량에 대해 추적 과정의 중단 없이 추적이 가능해진다.In addition, multiple vehicle tracking cameras installed along the driving direction of the vehicle in the lane change prohibition section are arranged to have a photographing overlapping area between two adjacent cameras, and the vehicle tracking operation of the rear vehicle tracking camera is forward based on the vehicle driving direction. By taking the method of taking over with the front camera tracking camera in the overlapping area with the camera, the vehicle can be tracked without interruption of the tracking process based on one vehicle.
또한, 차선변경 금지구간의 각 차선에 대한 판별 과정이 RGB(Red, Green, Blue) 좌표계를 HSI(Hue, Saturation, Intensity) 좌표계로 변환하는 과정을 포함하여 이루어진다.In addition, the determination process for each lane of the lane change prohibition section includes converting an RGB (Red, Green, Blue) coordinate system into a HSI (Hue, Saturation, Intensity) coordinate system.
또한, 차선 위반 검출 장치 및 차선 위반 검출 방법 그리고 인터넷과 이동통신망 등의 통신망 및 정보통신기기를 통해 차선 변경 차량에 대한 단속을 원격제어할 수 있고, 이와 동시에 차선변경 금지구간에서 차선을 변경하여 단속된 차량의 소유주들에게 온라인 과태료 고지서를 온라인으로 전송할 수 있어 차선 위반 차량의 단속을 효율적으로 진행할 수 있다.In addition, it is possible to remotely control crackdowns on lane-changing vehicles through a lane violation detection device, a lane violation detection method, and communication networks and information and communication devices such as the Internet and mobile communication networks. Online penalty notices can be sent online to owners of licensed vehicles, enabling efficient enforcement of lane violations.
도 1은 본 발명의 일 실시예에 따른 다중 카메라를 이용한 차선 위반 검출 장치를 개념적으로 보인 구성도1 is a block diagram conceptually showing a lane violation detection apparatus using multiple cameras according to an embodiment of the present invention;
도 2는 본 발명의 일 실시예에 따른 다중 카메라를 이용한 차선 위반 검출 장치의 구성을 보인 블록도2 is a block diagram showing the configuration of a lane violation detection apparatus using multiple cameras according to an embodiment of the present invention.
도 3a 및 도 3b는 본 발명의 일 실시예에 따른 다중 카메라를 이용한 차선 위반 검출 방법의 흐름도3A and 3B are flowcharts illustrating a lane violation detection method using multiple cameras according to an embodiment of the present invention.
도 4는 본 발명의 일 실시예에 따른 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속 시스템을 개념적으로 보인 구성도4 is a block diagram conceptually showing a lane violation vehicle enforcement system using a lane violation detection apparatus using multiple cameras according to an embodiment of the present invention;
도 5는 본 발명의 일 실시예에 따른 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속 시스템의 구성을 보인 블록도5 is a block diagram showing the configuration of a lane violation vehicle enforcement system using a lane violation detection apparatus using multiple cameras according to an embodiment of the present invention.
도 6은 본 발명의 일 실시예에 따른 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속 시스템을 통한 차선변경 금지 위반 차량 단속과정을 보인 흐름도6 is a flowchart illustrating a lane change prohibition violation control process through a lane violation vehicle enforcement system using a lane violation detection apparatus using multiple cameras according to an exemplary embodiment of the present invention.
이하에서는, 첨부된 도면을 참조하여 본 발명의 일 실시예에 따른 다중 카메라를 이용한 차선 위반 검출 장치 및 이를 이용한 차선 위반 검출 방법 그리고 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속시스템을 상세하게 설명한다.Hereinafter, a lane violation detecting apparatus using a multiple camera, a lane violation detecting method using the same, and a lane violation detecting apparatus using a multiple camera according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings. Explain.
도 1 내지 도 3b는 본 발명의 일 실시예에 따른 다중 카메라를 이용한 차선 위반 검출 장치와 방법을 설명하기 위하여 보인 도면으로서, 이를 참조하여 본 발명의 일 실시예에 따른 다중 카메라를 이용한 차선 위반 검출 장치와 방법을 설명한다.1 to 3b are views illustrating a lane violation detection apparatus and method using multiple cameras according to an embodiment of the present invention. Referring to this, lane violation detection using multiple cameras according to an embodiment of the present invention is referred to. Describe the apparatus and method.
도 1은 본 발명의 일 실시예에 따른 다중 카메라를 이용한 차선 위반 검출 장치를 개념적으로 보인 구성도이다.1 is a block diagram conceptually illustrating an apparatus for detecting a lane violation using multiple cameras according to an exemplary embodiment of the present invention.
도시된 바와 같이, 본 발명의 일 실시예에 따른 다중 카메라를 이용한 차선 위반 검출 장치(이하 “차선 위반 검출 장치”라 함)는 도로의 차선변경 금지구간(10)에 차량의 주행 방향을 따라 복수의 차량 추적 카메라(111~113)를 설치하되, 차선(11)을 기준으로 인접한 두 차량 추적 카메라 간에 촬영 영역의 중첩 구간(A :이하 “촬영 중첩 구간”이라 함)(또는 영상추적 인계영역)이 형성되는 구성이다.As shown, a lane violation detection apparatus (hereinafter referred to as a "lane violation detection apparatus") using multiple cameras according to an embodiment of the present invention is a plurality of lane change prohibition section 10 of the road along the driving direction of the vehicle Vehicle tracking cameras 111 to 113 of the vehicle, but overlapping sections of the recording area between two adjacent vehicle tracking cameras based on the lane 11 (hereinafter referred to as “shooting overlapping sections”) (or image tracking takeover areas) This is the configuration to be formed.
이에 따라, 차량(20)의 주행 방향을 기준으로, 후방 쪽 차량 추적 카메라를 통해 추적되던 차량(20)이 전방 쪽 차량 추적 카메라와의 촬영 중첩 구간(A)에 진입하면, 후방 쪽 차량 추적 카메라를 통해 추적되던 정보가 차선 위반 검출 장치의 제어부(미도시, 도 2, 도4 참조)에 전송되는 동시에 해당 차량(20)에 대한 추적 동작이 전방 쪽 차량 추적 카메라를 통해 중단 없이 진행된다.Accordingly, when the vehicle 20 tracked through the rear vehicle tracking camera enters the photographing overlap section A with the front vehicle tracking camera based on the driving direction of the vehicle 20, the rear vehicle tracking camera The information tracked through is transmitted to the control unit of the lane violation detection apparatus (not shown, see FIGS. 2 and 4), and the tracking operation for the vehicle 20 proceeds without interruption through the front vehicle tracking camera.
다음은 도 2를 참조하여 차선 위반 검출 장치의 전체 구성에 대해 설명한다.Next, an overall configuration of the lane violation detection apparatus will be described with reference to FIG. 2.
도 2는 본 발명의 일 실시예에 따른 차선 위반 검출 장치의 구성을 보인 블록도이다.2 is a block diagram showing the configuration of a lane violation detection apparatus according to an embodiment of the present invention.
도시된 바와 같이, 본 발명의 일 실시예에 따른 차선 위반 검출 장치(100)는 적어도 하나 이상의 차량 추적 카메라(110), 차선 정보 검출부(120), 검지영역 생성부(130), 제어부(140)를 포함한다. 그리고 이하의 설명에서 차선변경 금지구간 및 그를 주행하는 차량 그리고 촬영 추적 카메라 등은 도 1의 실시예에 따르며, 따라서 해당 구성의 부호 역시 도 1에 따른다.As shown, the lane violation detection apparatus 100 according to an embodiment of the present invention is at least one vehicle tracking camera 110, the lane information detection unit 120, the detection area generation unit 130, the controller 140 It includes. In the following description, the lane change prohibition section, the vehicle driving the same, the photographing tracking camera, and the like are in accordance with the embodiment of FIG.
차량 추적 카메라(110)는 도로의 차선변경 금지구간(10)에 차량의 주행 방향을 따라 간격을 유지하며 설치된다. 여기서 차량 추적 카메라(110)는 인접한 두 차량 추적 카메라(111과 112 및 112와 113)의 촬영 영역 간에 중첩 구간(A: 이하 “촬영 중첩 구간”이라 함)이 형성되는 상태로 배치되어 다중 차선과 그 도로를 구간 별로 각각 촬영한다. 도 1을 참조하면, 본 실시예에서는 차량 추적 카메라(110)가 차선변경 금지구간(10)을 따라 3개(111~113)가 설치되는 구성이나, 이는 하나의실시예에 불과하다. 따라서 본 발명이 이에 한정되는 것은 아닌바, 차량 추적 카메라는 차선변경 금지구간의 전체 길이 및 그를 통해 주행하는 차량의 평균적인 대수 등을 참조하여 적정 개수로 설치될 수 있다.The vehicle tracking camera 110 is installed at a lane change prohibition section 10 of a road keeping a gap along a driving direction of the vehicle. Here, the vehicle tracking camera 110 is disposed in a state where an overlapping section (hereinafter referred to as “shooting overlapping section”) is formed between the capturing areas of two adjacent vehicle tracking cameras 111, 112, 112, and 113, and includes a multiple lane and The road is photographed for each section. Referring to FIG. 1, in the present embodiment, the vehicle tracking camera 110 is provided with three 111-113 along the lane change prohibition section 10, but this is only one embodiment. Therefore, the present invention is not limited thereto, and the vehicle tracking camera may be installed in an appropriate number with reference to the total length of the lane change prohibition section and the average number of vehicles traveling therethrough.
다시 도 2로 돌아가서, 차선 정보 검출부(120)는 차량 추적 카메라(110)에서 촬영되는 영상데이터를 수신하여 영상데이터로부터 차선(11)을 판별한다. 그리고 이와 같은 차선 정보 검출부(120)는 색 공간 변환부(121) 및 차선 판별부(122)를 포함하여 구성될 수 있다. 색 공간 변환부(121)는 차량 추적 카메라(110)에서 촬영되는 영상데이터를 수신하여 영상데이터로부터 색상 성분이 있는 차선(11)의 윤곽선을 추출 후 추출된 차선(11)의 색 공간을 RGB(Red, Green, Blue) 좌표계에서 HSI(Hue, Saturation, Intensity) 좌표계로 변환한다. 그리고 차선 판별부(122)는 색 공간 변환부(121)에서 입력되는 HSI 좌표값을 차선변경 금지구간(10)의 각 차선 영역별 사전 설정된 HIS 기준값과 비교하여 차선(11)을 판별한다.2, the lane information detection unit 120 receives the image data photographed by the vehicle tracking camera 110 to determine the lane 11 from the image data. The lane information detection unit 120 may include a color space conversion unit 121 and a lane determination unit 122. The color space converter 121 receives the image data captured by the vehicle tracking camera 110, extracts the contour of the lane 11 having the color component from the image data, and then converts the color space of the extracted lane 11 into RGB ( Convert from Red, Green, Blue) coordinate system to HSI (Hue, Saturation, Intensity) coordinate system. The lane determination unit 122 determines the lane 11 by comparing the HSI coordinate value input from the color space conversion unit 121 with a preset HIS reference value for each lane area of the lane change prohibition section 10.
검지영역 생성부(130)는 차량 추적 카메라(110)의 영상데이터 및 차선 정보 검출부(120)의 차선 판별 신호를 입력받은 후, 이렇게 입력되는 데이터 및 신호를 통해 차선변경 금지구간(10)의 각 차선(11) 별로 차선 판별 신호 및 영상데이터에 포함된 차량 영상데이터의 픽셀 크기에 따라 차량 검지영역(또는 차량추적 검지영역)(131)을 자동 생성한다.The detection area generation unit 130 receives the image data of the vehicle tracking camera 110 and the lane determination signal of the lane information detection unit 120, and then detects each of the lane change prohibition sections 10 through the input data and signals. The vehicle detection area (or vehicle tracking detection area) 131 is automatically generated for each lane 11 according to the pixel size of the vehicle image data included in the lane determination signal and the image data.
즉, 검지영역 생성부(130)는 차선 정보 검출부(120)의 차선 판별 신호에 따른 차선과 차선 사이에서 차량 주행이 시작되면, 적어도 하나 이상의 차량 추적 카메라(110) 중 어느 하나의 차량 추적 카메라를 기준으로 그 차량 추적 카메라의 영상데이터에서 차량(20)의 추적 시작 시점부터 추적 종료 시점까지의 프레임 수를 사전 설정된 기준 프레임 수와 비교하여 차선(11) 별 차량 검지영역(131)을 차량 영상데이터의 픽셀 크기에 따라 자동 생성한다.That is, when the vehicle starts to travel between the lane and the lane according to the lane determination signal of the lane information detection unit 120, the detection area generator 130 may detect one of the at least one vehicle tracking camera 110. As a reference, in the image data of the vehicle tracking camera, the vehicle detection area 131 for each lane 11 is compared with the number of frames from the starting point of tracking of the vehicle 20 to the ending point of the tracking with a preset reference frame number. Automatically generated according to the pixel size of the.
또한, 도 1을 참조하면, 검지영역 생성부(130)를 통해 생성되는 차량 검지영역(131)은 차량 추적 카메라(110)와 차량(20) 간의 간격이 벌어질수록 해당 차량 추적 카메라(110)를 통해 획득되는 해당 차량(20)의 픽셀 크기가 축소됨에 따라 긴 사다리꼴 형상으로 형성되는 것일 수 있다.In addition, referring to FIG. 1, the vehicle detection area 131 generated through the detection area generation unit 130 has a corresponding vehicle tracking camera 110 as the distance between the vehicle tracking camera 110 and the vehicle 20 increases. As the pixel size of the vehicle 20 obtained through the reduction is reduced, it may be formed in a long trapezoidal shape.
다시 도 2로 돌아가서, 제어부(140)는 검지영역 생성부(130)를 통해 생성되는 차량 검지영역 신호 및 해당 차량 검지영역(131)에서 주행하는 차량(20)의 차량 추적 카메라(110)를 통한 영상데이터가 입력된다. 그리고 제어부(140)는 이렇게 입력되는 데이터 및 신호에 따라, 차선변경 금지구간(10)을 따라 주행하는 차량(20)의 주행 상태를 적어도 하나 이상의 차량 추적 카메라(110)를 통해 중단 없이 추적한다. 즉, 제어부(140)는 차량 추적 카메라(110) 간의 촬영 중첩 구간(A)에 차량(20) 진입 시 해당 차량(20)의 주행 방향을 기준으로 후방 차량 추적 카메라(110)를 통해 촬영된 영상데이터를 입력받고, 이에 따라 후방 차량 추적 카메라(110)를 통한 해당 차량(20)의 추적을 중지하는 동시에 전방 차량 추적 카메라(110)를 통해 해당 차량(20)을 이어서 추적한다.2, the controller 140 uses the vehicle detection area signal generated by the detection area generation unit 130 and the vehicle tracking camera 110 of the vehicle 20 traveling in the vehicle detection area 131. Image data is input. The controller 140 tracks the driving state of the vehicle 20 traveling along the lane change prohibition section 10 without interruption through at least one vehicle tracking camera 110 according to the input data and signal. That is, the controller 140 is an image captured by the rear vehicle tracking camera 110 on the basis of the driving direction of the vehicle 20 when entering the vehicle 20 in the overlapping section (A) between the vehicle tracking camera 110. The data is received, and thus the tracking of the vehicle 20 through the rear vehicle tracking camera 110 is stopped and the vehicle 20 is subsequently tracked through the front vehicle tracking camera 110.
또한 제어부(140)는 검지영역 생성부(130)에서 생성된 차선별 차량 검지영역(131)에서 차량의 움직임을 추적하고, 해당차선을 벗어나면 해당 차선에서는 차량 추적을 종료하고 변경된 차선에서 추적을 계속 진행하며, 차량의 차선 변경 영상을 저장하여 전송한다In addition, the controller 140 tracks the movement of the vehicle in the vehicle detection area 131 for each lane generated by the detection area generation unit 130, and when the vehicle is out of the lane, ends the vehicle tracking in the corresponding lane and tracks in the changed lane. Continue to save and transmit the lane change image of the vehicle
다음은 도 3a 및 도 3b를 참조하여 본 발명의 일 실시예에 따른 다중 카메라를 이용한 차선 위반 검출 방법에 대해 설명한다.Next, a lane violation detection method using multiple cameras according to an embodiment of the present invention will be described with reference to FIGS. 3A and 3B.
도 3a 및 도 3b는 본 발명의 일 실시예에 따른 다중 카메라를 이용한 차선 위반 검출 방법의 흐름도이며, 설명에 앞서, 이하의 설명에서 차량 추적 카메라를 포함한 차선 위반 검출 장치의 구성은 도 1 및 도 2의 실시예를 따르며, 따라서 해당 구성의 부호 역시 도 1 및 도 2에 따른 것임을 밝혀 둔다.3A and 3B are flowcharts illustrating a lane violation detection method using multiple cameras according to an exemplary embodiment of the present invention. Prior to the description, a configuration of a lane violation detection apparatus including a vehicle tracking camera in the following description will be described with reference to FIGS. According to the embodiment 2, it is therefore noted that the sign of the configuration is also according to FIGS. 1 and 2.
먼저, 단계(S110)에서 차선변경 금지구간(10)을 따라 설치되는 적어도 하나 이상의 차량 추적 카메라(110), 다시 말해 도 1 및 도 2 기준의 제1 내지 제3 차량 추적 카메라(111~113)를 통해 해당 차선(11)이 개별 촬영된다.First, at least one vehicle tracking camera 110 installed along the lane change prohibition section 10 in step S110, that is, the first to third vehicle tracking cameras 111 to 113 based on FIGS. 1 and 2. The lane 11 is photographed separately through.
이어서, 단계(S120)에서 차량 추적 카메라(110)를 통해 촬영된 영상데이터가 차선 정보 검출부(120)의 색 공간 변환부(121) 및 제어부(140)에 입력된다.Subsequently, the image data photographed through the vehicle tracking camera 110 in step S120 is input to the color space converter 121 and the controller 140 of the lane information detector 120.
이어서, 단계(S130)에서 색 공간 변환부(121)는 입력된 영상데이터로부터 차선(11)의 윤곽선을 검출하거나 추출한다.Subsequently, in step S130, the color space converter 121 detects or extracts the outline of the lane 11 from the input image data.
이어서, 단계(S140)에서 색 공간 변환부(121)는 추출된 차선(11)의 RGB(Red, Green, Blue) 색 공간을 HSI(Hue, Saturation, Intensity) 좌표계로 변환한다.Subsequently, in step S140, the color space converter 121 converts the extracted RGB (Red, Green, Blue) color space of the lane 11 into a HSI (Hue, Saturation, Intensity) coordinate system.
이어서, 단계(S150)에서 색 공간 변환부(121)를 통해 변환된 HSI 좌표값이 차선 정보 검출부(120)의 차선 판별부(122)에 입력된다.Subsequently, the HSI coordinate value converted through the color space conversion unit 121 is input to the lane determination unit 122 of the lane information detection unit 120 in step S150.
이어서, 단계(S160)에서 차선 판별부(122)는 색 공간 변환부(121)를 통해 입력된 HSI 좌표값 및 사전 설정된 HSI 기준값을 비교하여 차선(11)을 판별한다.Subsequently, in operation S160, the lane determination unit 122 determines the lane 11 by comparing the HSI coordinate value input through the color space conversion unit 121 and the preset HSI reference value.
이어서, 단계(S165)에서 차량 추적 카메라(110)의 영상데이터 및 차선 정보 검출부(120)의 차선 판별 신호가 검지 영역 생성부(130)에 입력되고, 검지 영역 생성부(130)는 각 차선 별로 차선 판별 신호 및 영상데이터에 포함된 차량 영상 데이터의 픽셀 크기를 기준으로 차량 검지영역을 자동 생성한다.In operation S165, the image data of the vehicle tracking camera 110 and the lane determination signal of the lane information detection unit 120 are input to the detection area generation unit 130, and the detection area generation unit 130 is configured for each lane. The vehicle detection area is automatically generated based on the pixel size of the lane discrimination signal and the vehicle image data included in the image data.
이어서, 단계(S170)에서 차량 검지 영역의 신호가 제어부에 입력된다.Subsequently, a signal of the vehicle detection area is input to the controller in step S170.
이어서, 단계(S180)에서 제어부(140)는 차선 판별부(122)를 통해 판별된 차선 사이에서 주행 중인 차량(20)이 존재하는지 확인한다.Subsequently, in step S180, the controller 140 determines whether there is a vehicle 20 that is driving between the lanes determined by the lane determination unit 122.
이어서, 단계(S190)에서 제어부(140)는 단계(S180)을 통해 차선(11) 사이의 주행 차량(20)이 있는 것으로 확인 시 해당 차량(20)을 추적한다.Subsequently, in step S190, the controller 140 tracks the vehicle 20 when it is determined that there is a driving vehicle 20 between the lanes 11 through step S180.
이어서, 단계(S200)에서 제어부(140)는 추적 중인 차량(20)이 차선(11)을 변경 하였는지 여부를 확인한다.Subsequently, in step S200, the controller 140 checks whether the vehicle 20 being tracked has changed the lane 11.
이어서, 단계(S210)에서 제어부(140)는 단계(S200)을 통해 차량(20)의 차선 변경이 없는 것으로 확인되면, 해당 차량(20)이 인접한 두 차량 추적 카메라(110)의 촬영 중첩 구간에 진입하였는지 여부를 확인한다.Subsequently, when it is determined in step S210 that there is no lane change of the vehicle 20 through step S200, the control unit 140 is connected to the photographing overlapping sections of two adjacent vehicle tracking cameras 110. Check whether you entered.
이어서, 단계(S220)에서 제어부(140)는 추적 중인 차량(20)이 인접한 두 차량 추적 카메라(110) 간의 촬영 중첩 구간(A)에 진입한 것으로 확인되면, 차량 주행 방향을 기준으로 후방 쪽 차량 추적 카메라(110)를 통한 차량 추적을 중지하는 동시에 전방 쪽 차량 추적 카메라(110)를 통해 해당 차량(20)의 추적을 계속한다. 도 1 및 도 2를 기준으로 부연 설명하면, 제어부(140)는 추적 중인 차량(20)이 제1 및 제2 차량 추적 카메라(111,112) 간의 촬영 중첩 구간(A)에 진입하면, 제1 차량 추적 카메라(111)를 통한 차량(20) 추적을 중지하는 동시에 제2 차량 추적 카메라(112)를 통해 해당 차량(20)에 대한 추적 동작을 계속한다.이어서, 단계(S230)에서 제어부(140)는 제2 차량 추적 카메라(112)를 통해 추적 중인 차량(20)이 차선을 변경 하였는지 여부를 확인한다.Subsequently, in step S220, when it is determined that the vehicle 20 being tracked enters the photographing overlap section A between two adjacent vehicle tracking cameras 110, the rear vehicle based on the vehicle driving direction is determined. The vehicle tracking through the tracking camera 110 is stopped and the tracking of the vehicle 20 is continued through the front vehicle tracking camera 110. 1 and 2, the controller 140 may track the first vehicle when the vehicle 20 being tracked enters the photographing overlap section A between the first and second vehicle tracking cameras 111 and 112. While tracking the vehicle 20 through the camera 111 is stopped, the tracking operation of the vehicle 20 is continued through the second vehicle tracking camera 112. Next, in step S230, the controller 140 performs the tracking operation. The vehicle 20 being tracked through the second vehicle tracking camera 112 checks whether the lane has been changed.
이어서, 단계(S240)에서 제어부(140)는 단계(S230)에서 차량(20)의 차선 변경이 없는 것으로 확인되면, 해당 차량(20)이 제2 차량 추적 카메라(112) 및 제3 차량 추적 카메라(113) 간 촬영 중첩 구간(A)에 진입하였는지 여부를 확인한다.Subsequently, if it is determined in step S240 that there is no lane change of the vehicle 20 in step S230, the vehicle 20 may determine that the second vehicle tracking camera 112 and the third vehicle tracking camera are correct. It is checked whether the inter-photographing overlapping section A has entered.
이어서, 단계(S250)에서 제어부(140)는 추적 중인 차량이 제2 차량 추적 카메라(112) 및 제3 차량 추적 카메라(113) 간의 촬영 중첩 구간(A)에 진입한 것으로 확인되면, 제2 차량 추적 카메라(112)를 통한 차량 추적을 중지하는 동시에 제3 차량 추적 카메라(113)를 통해 해당 차량(20)에 대한 추적 동작을 계속한다.Subsequently, in step S250, the controller 140 determines that the vehicle being tracked has entered the photographing overlap section A between the second vehicle tracking camera 112 and the third vehicle tracking camera 113. The vehicle tracking through the tracking camera 112 is stopped and the tracking operation for the vehicle 20 is continued through the third vehicle tracking camera 113.
한편, 단계(S200)에서 제어부(140)는 추적 중인 차량(20)이 차선(11)을 변경한 것으로 확인되면, 단계(S205)에서 변경 차선에서 해당 차량(20)의 추적을 계속한다. 이때, 제어부(140)는 추적 중인 차량(20)의 차선 변경 여부를 차량 추적 카메라(110)를 통한 영상데이터 중 차량 영상데이터의 픽셀 변화를 기준으로 판단하는 것일 수 있다. 또한 이와 같은 단계(S205)의 동작은 단계(S235)에서도 동일한 형태로 진행된다.On the other hand, if it is determined in step S200 that the vehicle 20 being tracked has changed the lane 11 in step S200, the control unit 140 continues tracking the vehicle 20 in the changed lane in step S205. In this case, the controller 140 may determine whether the lane of the vehicle 20 being tracked is changed based on the pixel change of the vehicle image data among the image data through the vehicle tracking camera 110. In addition, the operation of step S205 proceeds in the same manner in step S235.
상기와 같은 일련의 과정에 의해서, 차선 위반 검출 장치는 제어부(140) 및 상기 제어부(140)를 통해 제어되는 차선 별 적어도 하나 이상의 차량 추적 카메라(110)를 통해 차선변경 금지구간(10)에서 주행 중인 다중 차량들을 중단 없이 추적하면서 차선 위반 여부를 검출할 수 있다.By the above-described series of processes, the lane violation detecting apparatus travels in the lane change prohibition section 10 through the controller 140 and at least one vehicle tracking camera 110 for each lane controlled by the controller 140. Multiple lanes in progress can be tracked without interruption to detect lane violations.
다음은 도 4 내지 도 6을 참조하여 본 발명의 일 실시예에 따른 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속 시스템에 대해 설명한다.Next, a lane violation control system using a lane violation detection apparatus using multiple cameras according to an embodiment of the present invention will be described with reference to FIGS. 4 to 6.
도 4는 본 발명의 일 실시예에 따른 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속 시스템을 개념적으로 보인 구성도이고, 도 5는 본 발명의 일 실시예에 따른 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속 시스템의 구성을 보인 블록도이다.FIG. 4 is a schematic view showing a lane violation vehicle enforcement system using a lane violation detection apparatus by multiple cameras according to an embodiment of the present invention, and FIG. 5 is a lane by multiple cameras according to an embodiment of the present invention. It is a block diagram which shows the structure of the lane violation vehicle control system using a violation detection apparatus.
도시된 바와 같이, 본 발명의 일 실시예에 따른 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속 시스템(이하, “차선 위반 차량 단속 시스템”이라 함)은 차선위반 검출장치(100), 차량번호인식 카메라(200), 차선 위반 관리서버(300)를 포함한다. 여기서, 차선위반 검출장치(100)는 도 1 및 2를 참조하여 설명한 차선위반 검출장치(100)와 동일한 구성이며, 따라서 이하의 설명에서 차량번호인식 카메라(200) 및 차선위반 관리서버(300)를 중심으로 설명한다.As shown, a lane violation vehicle enforcement system (hereinafter referred to as a "lane violation vehicle enforcement system") using a lane violation detection apparatus by multiple cameras according to an embodiment of the present invention is a lane violation detection apparatus 100, Vehicle number recognition camera 200, lane violation management server 300 is included. Here, the lane violation detection apparatus 100 has the same configuration as the lane violation detection apparatus 100 described with reference to FIGS. 1 and 2, and accordingly, the vehicle number recognition camera 200 and the lane violation management server 300 are described below. Explain the center.
차량번호인식 카메라(200)는 차선변경 금지구간(10)에 대한 차량(20)의 주행방향을 기준으로 차선변경 금지구간(10)의 종단으로부터 전방 쪽에 설치되어 차선 위반 검출 장치(100)로부터 수신되는 제어 신호에 따라 차선 변경 차량을 촬영한다. 여기서, 차량번호인식 카메라(200)는 차선 위반 검출 장치(100)의 차량 추적 카메라(110) 중 차량 주행 방향을 기준으로 최전방에 위치한 차량 추적 카메라와 중첩되는 촬영 영역을 갖도록 설치되고, 상기 최전방의 차량 추적 카메라(110)는 차량번호인식 카메라(200)와의 중첩 촬영 영역에 차선변경 위반 차량 진입 시 트리거신호를 차량번호인식 카메라(200)에 전송한다.The vehicle number recognition camera 200 is installed on the front side from the end of the lane change prohibition section 10 based on the driving direction of the vehicle 20 with respect to the lane change prohibition section 10 and received from the lane violation detecting apparatus 100. The lane change vehicle is photographed according to the control signal. Here, the vehicle number recognition camera 200 is installed to have a photographing area overlapping with the vehicle tracking camera located at the foremost of the vehicle tracking cameras 110 of the lane violation detection apparatus 100 based on the vehicle driving direction, The vehicle tracking camera 110 transmits a trigger signal to the vehicle number recognition camera 200 when entering a lane change violation vehicle in an overlapping photographing area with the vehicle number recognition camera 200.
그리고 이와 같이 트리거 신호를 수신한 차량번호인식 카메라(200)는 차선 변경 금지 법규를 위반한 차량을 촬영하여 해당 위반 차량의 차량번호를 검출 후 이를 차선위반 관리서버(300)에 전송한다. 즉, 차량번호인식 카메라(200)는 차선 변경 금지 법규를 위반함에 따라 촬영된 차량 영상데이터로부터 차량번호를 추출하는 번호인식 제어기(220)를 포함한다.In addition, the vehicle number recognition camera 200 that receives the trigger signal photographs a vehicle that violates the lane change prohibition law, detects the vehicle number of the violation vehicle, and transmits the vehicle number to the lane violation management server 300. That is, the vehicle number recognition camera 200 includes a number recognition controller 220 for extracting a vehicle number from the vehicle image data photographed according to the lane change prohibition law.
차선위반 관리서버(300)는 차량번호인식 카메라(200)에서 촬영된 영상데이터를 수신하여 해당 차량의 차량번호를 검출 후 검출된 차량번호에 해당하는 차적 정보를 차량정보 데이터베이스(311)로부터 검출한다. 여기서 차선위반 관리서버(300)는 차선 위반 검출 장치(100)의 제어부(140) 및 차량번호인식 카메라(200)와 통신망을 통해 접속되며, 차선 위반 검출 장치(100)로부터 전송되는 차량 추적 카메라(110)의 영상데이터 및 그 관련 정보는 차량 주행정보 데이터베이스(312)에 업데이트된다.The lane violation management server 300 receives image data photographed by the vehicle number recognition camera 200, detects a vehicle number of the vehicle, and detects vehicle information corresponding to the detected vehicle number from the vehicle information database 311. . Here, the lane violation management server 300 is connected to the control unit 140 and the vehicle number recognition camera 200 of the lane violation detection device 100 through a communication network, the vehicle tracking camera (transmitted from the lane violation detection device 100 ( The image data of 110 and its related information are updated in the vehicle driving information database 312.
즉, 차선위반 관리서버(300)는 차량정보 데이터베이스(311), 차량 주행정보 데이터베이스(312), 온라인 고지서 생성부(320), 메일 서버(330), 문자메시지 서버(340) 등을 포함한다.That is, the lane violation management server 300 includes a vehicle information database 311, a vehicle driving information database 312, an online bill generation unit 320, a mail server 330, a text message server 340, and the like.
차량정보 데이터베이스(311)와 차량 주행정보 데이터베이스(312)는 차선위반 관리서버(300)와 접속된 데이터베이스 서버(310)에 포함된 것으로서, 즉 데이터베이스 서버(310)는 차선위반 관리서버(300)를 통해 송수신 및 처리되는 다양한 데이터 및 신호를 저장한다. 그리고 차량정보 데이터베이스(311)는 차량들의 차적정보및 기타 차량 관련 정보들을 저장하고, 차량 주행정보 데이터베이스(312)는 차선 위반 검출 장치(100)로부터 전송된 차선변경 금지구간(10)의 차량 주행 정보를 저장한다. 여기서 차선 위반 검출 장치(100)로부터 전송되는 데이터들은 차량 주행정보 데이터베이스(312)에 계속 업데이트 되는 방식으로 저장된다.The vehicle information database 311 and the vehicle driving information database 312 are included in the database server 310 connected to the lane violation management server 300, that is, the database server 310 is a lane violation management server 300. It stores various data and signals transmitted and received and processed through. The vehicle information database 311 stores vehicle information and other vehicle-related information of the vehicles, and the vehicle driving information database 312 includes vehicle driving information of the lane change prohibition section 10 transmitted from the lane violation detecting apparatus 100. Save it. The data transmitted from the lane violation detecting apparatus 100 is stored in the vehicle driving information database 312 in such a manner that the data is continuously updated.
온라인 고지서 생성부(320)는 차량정보 데이터베이스(311)로부터 검출된 차적정보 및 차량 주행정보 데이터베이스(312)로부터 검출된 차선변경 위반 정보를 조합하여 온라인 과태료 납부고지서를 생성하며, 이렇게 생성된 온라인 과태료 납부고지서는 해당 차량을 소유한 사용자의 스마트폰(400)에 전송된다. 그리고 이를 위해 차선위반 관리서버(300)는 메일 서버(330) 및 문자메시지 서버(340)를 구비한다.The online bill generation unit 320 combines the vehicle information detected from the vehicle information database 311 and the lane change violation information detected from the vehicle driving information database 312 to generate an online penalty payment notice. The payment notice is sent to the smartphone 400 of the user who owns the vehicle. For this purpose, the lane violation management server 300 includes a mail server 330 and a text message server 340.
메일 서버(330)는 온라인 고지서 생성부(320)를 통해 생성된 온라인 과태료 납부고지서 및 그 발급 사실을 해당 차량 소유주의 스마트폰(400)에 전송하기 위해 해당 메일을 생성한다. 또한 문자메시지 서버(340)는 온라인 과태료 납부고지서의 발급 사실을 해당 차량 소유주의 스마트폰(400)에 전송하기 위해 해당 문자메시지를 생성한다. The mail server 330 generates a corresponding mail to transmit the online penalty payment notice generated through the online bill generation unit 320 and its issuance to the smartphone owner 400 of the vehicle owner. In addition, the text message server 340 generates a corresponding text message to transmit the fact of issuing an online penalty payment notice to the vehicle owner's smartphone (400).
여기서 본 실시예에서는 온라인 과태료 납부고지서 및 그와 관련된 메일과 문자메시지가 해당 차량을 소유한 사용자의 스마트폰(400)에 전송되는 것을 예로 하였으나, 본 발명이 이에 한정되는 것은 아니며, 태블릿 PC나 기타 컴퓨팅 기능이 있는 다양한 종류의 휴대용 통신단말기들이 사용될 수 있다.In this embodiment, the online penalty payment notice and related mail and text messages are sent to the smart phone 400 of the user who owns the vehicle as an example, but the present invention is not limited thereto. Various kinds of portable communication terminals with computing functions can be used.
한편, 차선 위반 차량 단속 시스템의 차량번호인식 카메라(200)는 속도 센서(210)를 구비하며, 상기 속도 센서(210)에서 감지되는 차량 주행 속도 신호를 통해 해당 차량의 과속 여부를 판별하는 것일 수 있다. 다시 말해 차선 위반 차량 단속 시스템이 과속 차량을 단속하는 기능을 함께 가질 수 있다.Meanwhile, the vehicle number recognition camera 200 of the lane violation vehicle control system includes a speed sensor 210, and may determine whether the vehicle is speeding through a vehicle driving speed signal detected by the speed sensor 210. have. In other words, the lane violation vehicle control system may have the function of controlling the speeding vehicle.
도 6은 본 발명의 일 실시예에 따른 차선 위반 차량 단속 시스템의 동작 상태를 보인 흐름도로서, 이를 참조하여 차선 위반 차량 단속 시스템을 통해 차선위반 금지구간에서의 차선 변경 금지 위반 및 과속 차량을 단속하는 과정을 설명한다.FIG. 6 is a flowchart illustrating an operation state of a lane violation vehicle control system according to an exemplary embodiment of the present invention, wherein a lane change prohibition violation and a speeding vehicle in a lane violation prohibition section are controlled through the lane violation vehicle enforcement system with reference to this FIG. Explain the process.
먼저, 단계(S110)에서 차선위반 검출장치(100)로부터 차량번호인식 카메라(200)에 차선 변경 금지 규정을 위반한 차량에 대한 알림정보가 전송된다.First, in step S110, notification information about a vehicle that violates the lane change prohibition rule is transmitted from the lane violation detecting apparatus 100 to the vehicle number recognition camera 200.
이어서, 단계(S120)에서 차량번호인식 카메라(200)는 단계(S110)에서의 신호에 따라 해당되는 차선 변경 금지 규정의 위반 차량을 촬영 후 해당 차량의 차량번호를 추출한다.Subsequently, in step S120, the vehicle number recognition camera 200 extracts the vehicle number of the vehicle after photographing a violation of the corresponding lane change prohibition rule according to the signal in step S110.
이어서, 단계(S130)에서 차량번호인식 카메라(200)로부터 촬영된 영상데이터가 차선위반 관리서버(300)에 전송된다.Subsequently, the image data photographed from the vehicle number recognition camera 200 in step S130 is transmitted to the lane violation management server 300.
이어서, 단계(S140)에서 차선위반 관리서버(300)는 차량번호인식 카메라(200)로부터 수신된 영상데이터로부터 차선 변경 금지 규정을 위반한 차량의 관련 데이터를 추출한다.Subsequently, in step S140, the lane violation management server 300 extracts the relevant data of the vehicle in violation of the lane change prohibition rule from the image data received from the vehicle number recognition camera 200.
이어서, 단계(S150)에서 차선위반 관리서버(300)는 추출된 위반 차량의 데이터에 해당 차량의 차적 정보를 데이터베이스 서버(310)로부터 검출한다.Subsequently, in step S150, the lane violation management server 300 detects vehicle information of the vehicle from the database server 310 in the extracted violation vehicle data.
이어서, 단계(S160)에서 차선위반 관리서버(300)는 차량번호인식 카메라(200)로부터 전송된 차선 변경 금지 규정을 위반한 차량의 위반데이터를 데이터베이스 서버(310)의 차량 주행정보 데이터베이스(312)에 저장한다.Subsequently, in step S160, the lane violation management server 300 records the violation data of the vehicle in violation of the lane change prohibition regulation transmitted from the vehicle number recognition camera 200 in the vehicle driving information database 312 of the database server 310. Store in
이어서, 단계(S170)에서 차선위반 관리서버(300)의 온라인 고지서 생성부(320)는 차량정보 데이터베이스(311)로부터 검출된 차적정보 및 차량 주행정보 데이터베이스(312)로부터 검출된 차선변경 위반 정보를 조합하여 해당 차량에 대한 온라인 과태료 납부고지서를 생성한다. 이때 차선위반 관리서버(300)는 속도 센서(210)를 통한 속도위반 정보를 함께 조합하여 해당 차량에 대한 온라인 과태료 납부고지서를 생성하는 것일 수도 있다.Subsequently, in step S170, the online bill generation unit 320 of the lane violation management server 300 may detect lane change violation information detected from the vehicle information database 311 and lane change violation information detected from the vehicle driving information database 312. Combine to generate an online penalty payment statement for the vehicle. In this case, the lane violation management server 300 may combine the speed violation information through the speed sensor 210 to generate an online penalty payment notice for the vehicle.
이어서, 단계(S180)에서 차선위반 관리서버(300)는 단계(S170)에서 생성된 온라인 과태료 납부고지서를 메일 서버(330)에 전송하며, 또한 단계(S190)에서 차선위반 관리서버(300)는 단계(S170)를 통해 온라인 과태료 납부고지서가 발행된 사실에 대한 정보를 문자메시지 서버(340)에 전송한다.Subsequently, in step S180, the lane violation management server 300 transmits the online penalty payment notice generated in step S170 to the mail server 330, and in step S190, the lane violation management server 300 In step S170, the information on the fact that the online penalty payment statement is issued is transmitted to the text message server 340.
이어서, 단계(S200)에서 메일 서버(330)는 온라인 과태료 납부고지서가 첨부된 메일을 생성하여 이를 해당 차량을 소유한 사용자의 스마트폰(400)에 전송하며, 또한 단계(S210)에서 문자메시지 서버(340)는 온라인 과태료 납부고지서 및 그를 첨부한 메일의 발송 사실을 알리기 위한 문자메시지를 생성 후 이를 해당 차량을 소유한 사용자의 스마트폰(400)에 전송한다.Subsequently, in step S200, the mail server 330 generates an e-mail to which the online penalty payment statement is attached and transmits it to the smartphone 400 of the user who owns the vehicle, and also in step S210, the text message server. 340 generates a text message for notifying the fact that the online penalty payment notice and the mail attached to it and transmits it to the smartphone 400 of the user who owns the vehicle.
또한, 단계(S220)에서 속도 센서(210)는 차량 속도의 감지신호를 차량번호인식 카메라(200)에 전송한다.In operation S220, the speed sensor 210 transmits a detection signal of the vehicle speed to the vehicle number recognition camera 200.
이어서, 단계(S225)에서 차량번호인식 카메라(200)는 속도 센서(210)로부터 수신한 신호를 통해 차량의 과속 여부를 판단 후, 단계(S230)에서 차량번호 인식카메라(200)는 과속 차량의 과속 관련 데이터를 통신망을 통해 차선위반 관리서버(300)에 전송한다.Subsequently, in step S225, the vehicle number recognition camera 200 determines whether the vehicle is speeded based on the signal received from the speed sensor 210, and in step S230, the vehicle number recognition camera 200 determines the speed of the vehicle. Speed-related data is transmitted to the lane violation management server 300 through a communication network.
이어서, 단계(S250)에서 차선위반 관리서버(300)는 그 온라인 고지서 생성부(320)를 통해 온라인 과태료 납부고지서를 생성한다.Subsequently, in step S250, the lane violation management server 300 generates an online fine payment notice through the online bill generation unit 320.
그리고 단계(250)를 통해 생성된 온라인 과태료 납부고지서는 단계(S260)에서 단계(S290)를 통해 해당 차량을 소유한 사용자의 스마트폰(400)에 전송되며, 이는 단계(S180)에서 단계(S210)의 과정과 동일한 방식이므로 이에 대한 상세 설명은 생략한다.And the online penalty payment statement generated through step 250 is transmitted to the smartphone 400 of the user who owns the vehicle through step S290 in step S260, which is step S210 in step S180. Since it is the same method as in), detailed description thereof will be omitted.
상술한 도 1 내지 도 6을 통하여 알 수 있는 바와 같이, 본 발명에 따른 다중 카메라를 이용한 차선 위반 검출 장치 및 이를 이용한 차선 위반 검출 방법, 그리고 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속시스템은, 차선변경 금지구간에 다중으로 카메라를 설치하여 차량이 차선을 위반하지 않도록 계도하는 동시에 차선 위반 차량을 단속하여 사고를 미연에 예방함으로써, 인명과 재산피해 축소 및 교통 선진 문화 구현을 가능케 한다.1 to 6, the lane violation detection apparatus using the multiple cameras according to the present invention, the lane violation detection method using the same, and the lane violation vehicle using the lane violation detection apparatus using the multiple cameras according to the present invention. The system installs multiple cameras in the lane change prohibition section to prevent the vehicle from violating the lane, and prevents accidents by cracking down on the lane violation vehicle, thereby reducing life and property damage and implementing an advanced traffic culture. .
또한, 차선변경 금지구간에 차량의 주행 방향을 따라 설치되는 다중의 차량추적 카메라가 인접한 두 카메라 간에 촬영 중첩 영역을 갖도록 배치되고, 차량 주행 방향을 기준으로 후방 쪽 차량 추적 카메라의 차량 추적 동작이 전방 쪽 카메라와의 촬영 중첩 영역에서 전방 쪽 차량 추적 카메라로 인계되는 방식을 취함으로써, 다중 차량에 대해 추적 과정의 중단 없이 진행될 수 있게 하며, 이는 차선변경 금지구간에서 주행 중인 모든 차량에 해당된다.또한, 차선변경 금지구간의 각 차선에 대한 판별 과정이 RGB(Red, Green, Blue) 좌표계를 HSI(Hue, Saturation, Intensity) 좌표계로 변환하는 과정을 포함할 수 있게 한다.In addition, multiple vehicle tracking cameras installed along the driving direction of the vehicle in the lane change prohibition section are arranged to have a photographing overlapping area between two adjacent cameras, and the vehicle tracking operation of the rear vehicle tracking camera is forward based on the vehicle driving direction. By taking over the front camera tracking camera in the shooting overlap area with the camera, it is possible to proceed without interrupting the tracking process for multiple vehicles, which is applicable to all vehicles driving in the lane change prohibition section. In addition, the determination process for each lane of the lane change prohibition section may include converting an RGB (Red, Green, Blue) coordinate system into a HSI (Hue, Saturation, Intensity) coordinate system.
또한, 차선 위반 검출 장치 및 차선 위반 검출 방법 그리고 인터넷과 이동통신망 등의 통신망 및 정보통신기기를 통해 차선 변경 차량에 대한 단속을 원격제어할 수 있고, 이와 동시에 차선변경 금지구간에서 차선을 변경하여 단속된 차량 운전자들에게 온라인 과태료 고지서를 온라인으로 전송할 수 있어 차선 위반 차량의 단속을 효율적으로 진행할 수 있게 한다.In addition, it is possible to remotely control crackdowns on lane-changing vehicles through a lane violation detection device, a lane violation detection method, and communication networks and information and communication devices such as the Internet and mobile communication networks. Online fines can be sent online to motor vehicle drivers, enabling efficient enforcement of lane violations.
이상에서 설명한 것은 본 발명에 따른 다중 카메라를 이용한 차선 위반 검출 장치 및 이를 이용한 차선 위반 검출 방법 그리고 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속시스템을 실시하기 위한 하나의 실시예에 불과한 것으로서, 본 발명은 상기한 실시 예에 한정되지 않고, 이하의 특허청구범위에서 청구하는 바와 같이 본 발명의 요지를 벗어남이 없이 당해 발명이 속하는 분야에서 통상의 지식을 가진 자라면 누구든지 다양한 변경 실시가 가능한 범위까지 본 발명의 기술적 정신이 있다고 할 것이다.What has been described above is only one embodiment for implementing a lane violation detection apparatus using a multi-camera according to the present invention, a lane violation detection method using the same, and a lane violation vehicle enforcement system using a lane violation detection apparatus using a multi-camera. However, the present invention is not limited to the above-described embodiments, and various changes can be made by any person having ordinary skill in the art without departing from the gist of the present invention as claimed in the following claims. It will be said that the technical spirit of this invention is to the extent possible.

Claims (15)

  1. 도로의 차선변경 금지구간에서 미리 설정된 도로 구간과 차선을 각기 촬영하는 적어도 하나 이상의 차량 추적 카메라;At least one vehicle tracking camera for respectively photographing a predetermined road section and a lane in a lane change prohibition section of the road;
    상기 차량 추적 카메라에서 촬영된 영상데이터로부터 차선을 판별하는 차선 정보 검출부;A lane information detection unit for determining a lane from image data captured by the vehicle tracking camera;
    상기 차량 추적 카메라의 영상데이터 및 상기 차선 정보 검출부의 차선 판별신호를 입력받아 각 차선별로 차량 검지영역을 자동 생성하는 검지영역 생성부; 및A detection area generation unit which receives the image data of the vehicle tracking camera and the lane determination signal of the lane information detection unit and automatically generates a vehicle detection area for each lane; And
    상기 검지영역 생성부를 통해 생성되는 차량 검지영역 신호 및 해당 차량 검지영역에서 주행하는 차량의 영상데이터를 입력받아 상기 차선변경 금지구간을 따라 주행하는 차량의 주행 상태를 추적하는 제어부;를 포함하며,And a controller configured to receive a vehicle detection area signal generated by the detection area generation unit and image data of a vehicle running in the vehicle detection area and track a driving state of a vehicle traveling along the lane change prohibition section.
    상기 적어도 하나 이상의 차량 추적 카메라는 상기 도로의 차선변경 금지구간의 차량 주행 방향을 따라 기 설정된 배치 간격으로 설치하되, 상기 배치 간격은 각 카메라의 촬영 영역 간에 기 설정된 촬영 중첩 구간이 형성되게 설정된 간격이며, The at least one vehicle tracking camera is installed at a predetermined arrangement interval along a vehicle driving direction of the lane change prohibition section of the road, wherein the arrangement interval is a interval at which a preset photographing overlap section is formed between photographing regions of each camera. ,
    상기 차량 검지영역은 상기 차선 판별신호 및 영상데이터에 포함된 차량 영상데이터의 픽셀 크기를 기준으로 생성되는 것을 특징으로 하는 다중 카메라를 이용한 차선 위반 검출 장치.And the vehicle detecting area is generated based on the pixel size of the vehicle image data included in the lane determination signal and the image data.
  2. 제 1 항에 있어서, 상기 차선 정보 검출부는,The method of claim 1, wherein the lane information detection unit,
    상기 차량 추적 카메라에서 촬영되는 영상데이터를 수신하여 상기 영상데이터로부터 색상 성분이 있는 차선의 윤곽선을 추출한 후 상기 추출된 차선의 색 공간을 RGB(Red, Green, Blue) 좌표계에서 HSI(Hue, Saturation, Intensity) 좌표계로 변환하는 색공간 변환부; 및After receiving the image data photographed by the vehicle tracking camera and extracting the contour of the lane with the color component from the image data, the color space of the extracted lane is HSI (Hue, Saturation, Intensity) Color space conversion unit for converting the coordinate system; And
    상기 색 공간 변환부에서 입력되는 HSI 좌표값을 상기 차선변경 금지구간의 각 차선 영역별로 사전 설정된 HIS 기준값과 비교하여 차선을 판별하는 차선 판별부;를 포함하는 것을 특징으로 하는 다중 카메라를 이용한 차선 위반 검출 장치.A lane discrimination unit configured to determine a lane by comparing the HSI coordinate value input from the color space conversion unit with a preset HIS reference value for each lane area of the lane change prohibition section; and a lane violation using multiple cameras. Detection device.
  3. 제 1 항에 있어서,The method of claim 1,
    상기 차량 추적 카메라 간의 촬영 중첩 구간에 차량 진입 시 해당 차량의 주행 방향을 기준으로 후방의 차량 추적 카메라를 통해 촬영된 영상데이터가 상기 제어부에 입력되고, 상기 제어부는 후방의 차량 추적 카메라를 통한 해당 차량의 추적을 중지하는 동시에 전방의 차량 추적 카메라를 통해 해당 차량을 이어서 추적하는 것을 특징으로 하는 다중 카메라를 이용한 차선 위반 검출 장치.When the vehicle enters the photographing overlapping section between the vehicle tracking cameras, image data captured by the rear vehicle tracking camera based on the driving direction of the vehicle is input to the controller, and the controller controls the vehicle through the rear vehicle tracking camera. A lane violation detection apparatus using multiple cameras, wherein the vehicle is subsequently tracked through a vehicle tracking camera in front of the vehicle while stopping tracking of the vehicle.
  4. 제 1 항에 있어서, 상기 검지영역 생성부는, The method of claim 1, wherein the detection area generation unit,
    상기 차선 정보 검출부의 차선 판별 신호에 따라 차선과 차선 사이에서 차량 주행이 시작되면 상기 차량추적 카메라의 영상데이터에서 차량의 추적 시작 시점부터 추적 종료 시점까지의 프레임 수를 사전 설정된 기준 프레임 수와 비교하여 차선 별 차량 검지영역을 차량 영상데이터의 픽셀 크기에 따라 자동 생성하는 것을 특징으로 하는 다중 카메라를 이용한 차선 위반 검출 장치.According to the lane determination signal of the lane information detector, when the vehicle starts to travel between the lane and the lane, the number of frames from the starting point of tracking of the vehicle to the ending point of tracking is compared with the preset reference frame number in the image data of the vehicle tracking camera. A lane violation detection apparatus using multiple cameras, which automatically generates a vehicle detection area for each lane according to pixel size of vehicle image data.
  5. 제 4 항에 있어서, 상기 제어부는, The method of claim 4, wherein the control unit,
    상기 검지영역 생성부를 통해 생성된 상기 차선별 검지영역에서 차량의 움직임을 추적하고, 차량이 현재 주행 중인 차선을 벗어나면 해당 차선에서의 차량 추적을 종료하고 변경된 차선에서의 해당 차량에 대한 추적을 계속하며, 차량의 차선 변경 영상을 저장하여 전송하는 것을 특징으로 하는 다중 카메라를 이용한 차선 위반 검출 장치.The movement of the vehicle is tracked in the lane-specific detection zones generated by the detection zone generation unit, and when the vehicle leaves the currently traveling lane, the vehicle tracking is terminated in the corresponding lane and the tracking of the vehicle in the changed lane is continued. And storing and transmitting a lane change image of the vehicle.
  6. 제 1 항에 있어서, 상기 검지영역 생성부는, The method of claim 1, wherein the detection area generation unit,
    상기 차량 추적 카메라와 차량 간의 간격이 벌어질수록 해당 차량 추적 카메라를 통해 획득되는 해당 차량의 픽셀 크기가 축소됨에 따라 상기 차량 검지영역을 긴 사다리꼴 형상으로 형성시키는 것을 특징으로 하는 다중 카메라를 이용한 차선 위반 검출 장치.Lane violation using multiple cameras as the distance between the vehicle tracking camera and the vehicle increases, the vehicle detection area is formed into a long trapezoidal shape as the pixel size of the vehicle obtained through the vehicle tracking camera is reduced. Detection device.
  7. 차선변경 금지구간의 차량 주행 방향을 따라 설치된 적어도 하나 이상의 차량 추적 카메라를 통해 주행 차량의 영상데이터를 획득하는 단계;Obtaining image data of the driving vehicle through at least one vehicle tracking camera installed along the vehicle driving direction of the lane change prohibition section;
    상기 차량 추적 카메라에서 획득한 영상데이터가 차선 정보 검출부에 입력되어 상기 차선 정보 검출부가 상기 영상데이터로부터 차선을 판별하는 단계;Image data acquired by the vehicle tracking camera is input to a lane information detection unit, and the lane information detection unit determines a lane from the image data;
    상기 차량 추적 카메라의 영상데이터 및 상기 차선 정보 검출부의 차선 판별신호를 검지영역 생성부가 입력받아 각 차선별로 차량 검지영역을 자동 생성하는 단계; 및Automatically generating a vehicle detection area for each lane by receiving the image data of the vehicle tracking camera and the lane determination signal of the lane information detection unit; And
    상기 검지영역 생성부를 통해 생성되는 차량 검지영역 신호 및 해당 차량 검지영역에서 주행하는 차량의 영상데이터를 제어부가 입력받아 상기 차선변경 금지구간을 따라 주행하는 차량의 주행 상태를 중단 없이 추적하는 단계;를 포함하며,Receiving a vehicle detection area signal generated through the detection area generation unit and image data of a vehicle running in the vehicle detection area and tracking a driving state of the vehicle running along the lane change prohibition section without interruption; Include,
    상기 검지영역 생성부는 상기 차선변경 금지구간에 포함된 각 차선의 차량 추적 카메라별 촬영 구간에 대한 차량 검지영역을 개별적으로 생성하며, 상기 차량 검지영역은 상기 차선 판별신호 및 영상데이터에 포함된 차량 영상데이터의 픽셀 크기를 기준으로 생성되며,The detection area generation unit individually generates a vehicle detection area for a photographing section for each vehicle tracking camera of each lane included in the lane change prohibition section, and the vehicle detection area is a vehicle image included in the lane determination signal and image data. Based on the pixel size of the data,
    상기 제어부가 입력받는 영상데이터는 상기 차량 추적 카메라간의 촬영 중첩 구간이 포함된 영상데이터인 것을 특징으로 하는 다중 카메라를 이용한 차선 위반 검출 방법.And the image data input by the controller is image data including a photographing overlapping section between the vehicle tracking cameras.
  8. 제 7 항에 있어서,The method of claim 7, wherein
    상기 차선 정보 검출부를 통한 상기 차선변경 금지구간의 차선 판별은, Lane determination of the lane change prohibition section by the lane information detection unit,
    상기 차량 추적 카메라를 통해 촬영되는 영상데이터가 색 공간 변환부에 입력되어 상기 색 공간 변환부가 입력되는 영상데이터로부터 색상 성분이 있는 차선의 윤곽선을 추출한 후 추출된 차선의 색 공간을 RGB(Red, Green, Blue) 좌표계에서HSI(Hue, Saturation, Intensity) 좌표계로 변환하는 과정, 그리고 상기 색 공간 변환부에서 변환된 HSI 좌표값이 차선 판별부에 입력되어 상기 차선 판별부가 입력된 HSI 좌표값을 상기 차선변경 금지구간의 각 차선 영역별로 사전 설정된 HIS 기준값과 비교하여 차선을 판별하는 과정을 포함하여 이루어지는 것을 특징으로 하는 다중 카메라를 이용한 차선 위반 검출 방법.The image data captured by the vehicle tracking camera is input to the color space conversion unit, and the contour of the lane having color components is extracted from the image data input to the color space conversion unit. And converting the HSI (Hue, Saturation, Intensity) coordinate system from the coordinate system, and the HSI coordinate value converted by the color space conversion unit is input to the lane determination unit so that the lane determination unit inputs the HSI coordinate value. A lane violation detection method using multiple cameras, comprising: determining a lane by comparing a preset HIS reference value for each lane area of a change prohibition section.
  9. 제 7 항에 있어서, 상기 제어부를 통한 차량의 추적은, The method of claim 7, wherein the tracking of the vehicle through the control unit,
    상기 차량 추적 카메라간의 촬영 중첩 구간에 차량 진입 시 해당 차량의 주행 방향을 기준으로 후방의 차량 추적 카메라를 통해 촬영된 영상데이터가 상기 제어부에 입력되면서 상기 제어부는 후방의 차량 추적 카메라를 통한 해당 차량의 추적을 중지하는 동시에 전방의 차량 추적 카메라를 통해 해당 차량을 이어서 추적하는 과정을 포함하여 이루어지는 것을 특징으로 하는 다중 카메라를 이용한 차선 위반 검출 방법.When the vehicle enters the photographing overlapping section between the vehicle tracking cameras, the image data photographed through the rear vehicle tracking camera based on the driving direction of the vehicle is input to the controller, and the controller controls the vehicle through the rear vehicle tracking camera. A method for detecting lane violations using multiple cameras, comprising: stopping the tracking and subsequently tracking the vehicle through the front vehicle tracking camera.
  10. 도로의 차선변경 금지구간에서 미리 설정된 도로 구간과 차선을 각기 촬영하는 적어도 하나 이상의 차량 추적 카메라와, 상기 차량 추적 카메라에서 촬영된 영상데이터로부터 차선을 판별하는 차선 정보 검출부와, 상기 차량 추적 카메라의 영상데이터 및 상기 차선 정보 검출부의 차선 판별신호를 입력받아 각 차선별로 차량 검지영역을 자동 생성하는 검지영역 생성부와, 상기 검지영역 생성부를 통해 생성되는 차량 검지영역 신호 및 해당 차량 검지영역에서 주행하는 차량의 영상데이터를 입력받아 상기 차선변경 금지구간을 따라 주행하는 차량의 주행 상태를 추적하는 제어부;를 포함하여 상기 차선변경 금지구간에서 주행하는 차량 중 차선을 변경한 차량을 검출하는 차선 위반 검출 장치;At least one vehicle tracking camera for respectively photographing a predetermined road section and a lane in a lane change prohibition section of a road, a lane information detection unit for determining a lane from image data captured by the vehicle tracking camera, and an image of the vehicle tracking camera A detection area generation unit for automatically generating a vehicle detection area for each lane by receiving data and a lane determination signal of the lane information detection unit, a vehicle detection area signal generated by the detection area generation unit, and a vehicle running in the vehicle detection area A lane violation detection device configured to detect a vehicle in which the lane is changed among vehicles running in the lane change prohibition section, including a control unit configured to receive the image data of the vehicle and to track a driving state of the vehicle traveling along the lane change prohibition section;
    상기 차선변경 금지구간에 대한 차량의 주행 방향을 기준으로 상기 차선변경 금지구간의 종단으로부터 전방 쪽에 설치되어 상기 차선 위반 검출 장치로부터 수신되는 제어 신호에 따라 차선 변경 차량을 촬영 후 해당 차량의 차량번호 데이터를 추출하는 차량번호인식 카메라; 및Vehicle number data of the vehicle after photographing the lane change vehicle according to a control signal received from the lane violation detection device installed at the front side from the end of the lane change prohibition section based on the driving direction of the vehicle for the lane change prohibition section. Vehicle number recognition camera to extract the; And
    상기 차량번호인식 카메라에서 전송되는 차선 변경 차량의 위반 데이터를 수신하여 해당 차량번호에 해당하는 차적 정보를 차량정보 데이터베이스로부터 검출하는 차선위반 관리서버;를 포함하며, And a lane violation management server configured to receive violation data of a lane change vehicle transmitted from the vehicle number recognition camera and detect vehicle information corresponding to the vehicle number from a vehicle information database.
    상기 적어도 하나 이상의 차량 추적 카메라는 상기 도로의 차선변경 금지구간의 차량 주행 방향을 따라 기 설정된 배치 간격으로 설치하되, 상기 배치 간격은 각 카메라의 촬영 영역 간에 기 설정된 촬영 중첩 구간이 형성되게 설정된 간격이며, 상기 차량 검지영역은 상기 차선 판별신호 및 영상데이터에 포함된 차량 영상데이터의 픽셀 크기를 기준으로 생성되는 것을 특징으로 하는 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속 시스템.The at least one vehicle tracking camera is installed at a predetermined arrangement interval along a vehicle driving direction of the lane change prohibition section of the road, wherein the arrangement interval is a interval at which a preset photographing overlap section is formed between photographing regions of each camera. And the vehicle detecting area is generated based on the pixel size of the vehicle image data included in the lane determination signal and the image data.
  11. 제 10 항에 있어서,The method of claim 10,
    상기 차선 위반 검출 장치의 제어부 및 상기 차량번호 인식 카메라는 각각 상기 차선위반 관리서버와 통신망을 통해 접속되며, 상기 제어부에 입력되는 상기 차량 추적 카메라의 영상데이터 및 그 관련 정보는 상기 통신망을 통해 상기 차선 위반 관리서버에 전송되어 해당 정보의 저장을 위해 상기 차선위반 관리서버에 접속된 차량 주행정보 데이터베이스에 업데이트되는 것을 특징으로 하는 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속 시스템.The control unit and the vehicle number recognition camera of the lane violation detection apparatus are respectively connected to the lane violation management server through a communication network, and the image data and related information of the vehicle tracking camera input to the control unit are connected to the lane through the communication network. And a lane violation detecting apparatus using multiple cameras, wherein the lane violation detection apparatus is updated in a vehicle driving information database connected to the lane violation management server to store the information.
  12. 제 11 항에 있어서, 상기 차선위반 관리서버는,The method of claim 11, wherein the lane violation management server,
    상기 차량정보 데이터베이스로부터 검출된 차적정보 및 상기 차량 주행정보 데이터베이스로부터 검출된 차선변경 위반 정보를 조합하여 차선변경 금지 위반 차량에 제공하기 위한 온라인 과태료 납부고지서를 생성하는 온라인 고지서 생성부;를 포함하는 것을 특징으로 하는 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차선 위반 차량 단속 시스템.And an online bill generation unit for generating an on-line fine payment notice for providing a lane change prohibition violation vehicle by combining the vehicle information detected from the vehicle information database and the lane change violation information detected from the vehicle driving information database. A lane violation vehicle enforcement system using a lane violation detection device using multiple cameras.
  13. 제 12 항에 있어서, 상기 차선위반 관리서버는,The method of claim 12, wherein the lane violation management server,
    온라인 고지서 생성부를 통해 생성된 온라인 과태료 납부고지서 및 그 발급 사실을 해당 차량 운전자의 컴퓨팅 기능이 있는 휴대용 통신단말기에 전송하기 위한 메일서버 및 문자메시지 서버;를 포함하는 것을 특징으로 하는 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 차량 단속 시스템.Lanes by multiple cameras, comprising: a mail server and a text message server for transmitting the online penalty payment statement generated through the online bill generation unit and the issuance thereof to a portable communication terminal having a computing function of the vehicle driver; Vehicle enforcement system using a violation detection device.
  14. 제 10 항에 있어서,The method of claim 10,
    상기 차선 위반 검출 장치의 차량 추적 카메라 중 차량 주행 방향을 기준으로 최전방에 위치한 차량 추적 카메라와 상기 차량번호인식 카메라는 중첩되는 촬영 영역을 갖도록 설치되고, 상기 최전방의 차량 추적 카메라는 상기 차량번호인식 카메라와의 중첩 촬영 영역에 차선변경 위반 차량 진입 시 트리거신호를 상기 차량번호인식 카메라에 전송하는 것을 특징으로 하는 다중 카메라의 의한 차선 위반 검출 장치를 이용하는 위반 차량 단속 시스템.Among the vehicle tracking cameras of the lane violation detection apparatus, the vehicle tracking camera located at the forefront with respect to the vehicle driving direction and the vehicle number recognition camera are installed to have an overlapping shooting area, and the front vehicle tracking camera is the vehicle number recognition camera. And a violation signal detecting apparatus for a lane violation by a multiple camera, wherein a trigger signal is transmitted to the vehicle number recognition camera when a lane change violation vehicle enters an overlapping photographing area.
  15. 제 10 항에 있어서,The method of claim 10,
    상기 차량번호인식 카메라는 속도 센서를 구비하여 상기 속도 센서에서 감지되는 차량 주행 속도 신호를 통해 해당 차량의 과속 여부를 판별하는 것을 특징으로 하는 다중 카메라에 의한 차선 위반 검출 장치를 이용하는 위반 차량 단속 시스템.And the vehicle number recognition camera has a speed sensor to determine whether the vehicle is overspeed based on the vehicle driving speed signal detected by the speed sensor.
PCT/KR2013/009684 2012-11-26 2013-10-29 Lane violation detection device using multiple cameras, lane violation detection method using same, and lane violation enforcement system using lane violation detection device with multiple cameras WO2014081129A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020120134773A KR101354057B1 (en) 2012-11-26 2012-11-26 Device and method for detection violation of lane using multi-camera and crackdown system for lane violation therefor
KR10-2012-0134773 2012-11-26

Publications (1)

Publication Number Publication Date
WO2014081129A1 true WO2014081129A1 (en) 2014-05-30

Family

ID=50146133

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2013/009684 WO2014081129A1 (en) 2012-11-26 2013-10-29 Lane violation detection device using multiple cameras, lane violation detection method using same, and lane violation enforcement system using lane violation detection device with multiple cameras

Country Status (2)

Country Link
KR (1) KR101354057B1 (en)
WO (1) WO2014081129A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105890610A (en) * 2016-06-24 2016-08-24 维沃移动通信有限公司 Method and device for tracking and navigating vehicle
CN107038864A (en) * 2017-05-28 2017-08-11 浙江大学 A kind of crossing inlet guided vehicle road sets reasonability to sentence method for distinguishing
CN107067726A (en) * 2017-05-28 2017-08-18 浙江大学 It is a kind of to recognize the method that the variable guided vehicle road of crossing inlet sets suitability
CN110674766A (en) * 2019-09-28 2020-01-10 武汉飞创交通工程有限公司 Vehicle detection system of ETC lane
CN112509334A (en) * 2020-12-03 2021-03-16 深圳杰睿联科技有限公司 Vehicle violation management system, method and storage medium
CN113569666A (en) * 2021-07-09 2021-10-29 东风汽车集团股份有限公司 Method for detecting continuous illegal lane change of vehicle and computer equipment
CN114241765A (en) * 2021-12-15 2022-03-25 重庆中信科信息技术有限公司 Space-time logic-based method and device for analyzing traffic violation of directional lane and storage medium

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103956055B (en) * 2014-05-15 2016-06-08 山西中创伟业科技有限公司 A kind of method for snap control captured for vehicle image
KR20160038944A (en) * 2014-09-30 2016-04-08 주식회사 디아이랩 traffic monitoring system
KR101895011B1 (en) * 2016-01-14 2018-09-05 (주)삼성정보통신 System for checking traffic violation with detecting traffic road line
US9595192B1 (en) 2016-04-14 2017-03-14 Ahmad Abdulaziz Alrashid Traffic violation detection system
US10762358B2 (en) * 2016-07-20 2020-09-01 Ford Global Technologies, Llc Rear camera lane detection
KR102032828B1 (en) 2016-12-13 2019-10-16 홍익대학교 산학협력단 System and method of blackbox video sequence analysis for gathering information of crime scene or car accident
KR101963353B1 (en) 2017-09-04 2019-03-28 한국도로공사 An enforcing system for smart traffic violation
KR101859402B1 (en) * 2017-12-14 2018-05-18 주식회사 딥스 The object tracking and lane changing vehicles detection method between linked cameras in tunnel
CN110070722B (en) * 2018-01-23 2022-07-26 睿鑫科技（天津）有限公司 Vehicle violation judgment law enforcement system, method and device
KR101870229B1 (en) 2018-02-12 2018-06-22 주식회사 사라다 System and method for determinig lane road position of vehicle
KR101891130B1 (en) 2018-05-14 2018-09-28 주식회사 사라다 System and method for detecting lane change
KR102082082B1 (en) * 2019-08-21 2020-02-26 주식회사 싸이토피아 Camera system for multi-lane recognizing number of vehicles
CN112767702A (en) * 2019-10-21 2021-05-07 中移物联网有限公司 Vehicle violation shooting and identifying system and identifying method
CN111754786A (en) * 2020-07-15 2020-10-09 遵义同望智能科技有限公司 System for identifying traffic vehicle passing events on highway
CN111899521A (en) * 2020-07-17 2020-11-06 南京师范大学泰州学院 Method for detecting vehicle violation behaviors on expressway
CN114677841B (en) * 2022-02-10 2023-12-29 浙江大华技术股份有限公司 Vehicle lane change detection method and vehicle lane change detection system
KR102605790B1 (en) 2023-07-21 2023-11-29 주식회사 아이티코어스 System of notifying multi-directional pedestrian and enforce traffic violation using a single camera

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100444762B1 (en) * 2004-03-10 2004-08-18 주식회사 비츠로시스 Lane Violation Detection, Tracking System and the Method
KR20050091595A (en) * 2004-03-12 2005-09-15 건아정보기술 주식회사 A lane change regulation system and a method using thereof
KR20120090471A (en) * 2011-02-08 2012-08-17 경북대학교 산학협력단 System for crackdown on traffic signal violation
KR20120124953A (en) * 2011-05-06 2012-11-14 주식회사 비츠로시스 Auto Transportation Information Extraction System and Thereby Method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100444762B1 (en) * 2004-03-10 2004-08-18 주식회사 비츠로시스 Lane Violation Detection, Tracking System and the Method
KR20050091595A (en) * 2004-03-12 2005-09-15 건아정보기술 주식회사 A lane change regulation system and a method using thereof
KR20120090471A (en) * 2011-02-08 2012-08-17 경북대학교 산학협력단 System for crackdown on traffic signal violation
KR20120124953A (en) * 2011-05-06 2012-11-14 주식회사 비츠로시스 Auto Transportation Information Extraction System and Thereby Method

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105890610A (en) * 2016-06-24 2016-08-24 维沃移动通信有限公司 Method and device for tracking and navigating vehicle
CN105890610B (en) * 2016-06-24 2018-10-16 维沃移动通信有限公司 Vehicle tracking air navigation aid and device
CN107038864A (en) * 2017-05-28 2017-08-11 浙江大学 A kind of crossing inlet guided vehicle road sets reasonability to sentence method for distinguishing
CN107067726A (en) * 2017-05-28 2017-08-18 浙江大学 It is a kind of to recognize the method that the variable guided vehicle road of crossing inlet sets suitability
CN107038864B (en) * 2017-05-28 2019-10-15 浙江大学 A kind of crossing inlet guided vehicle road setting reasonability sentences method for distinguishing
CN107067726B (en) * 2017-05-28 2019-11-08 浙江大学 A method of identification crossing inlet can be changed guided vehicle road and suitability be arranged
CN110674766A (en) * 2019-09-28 2020-01-10 武汉飞创交通工程有限公司 Vehicle detection system of ETC lane
CN112509334A (en) * 2020-12-03 2021-03-16 深圳杰睿联科技有限公司 Vehicle violation management system, method and storage medium
CN113569666A (en) * 2021-07-09 2021-10-29 东风汽车集团股份有限公司 Method for detecting continuous illegal lane change of vehicle and computer equipment
CN113569666B (en) * 2021-07-09 2023-12-15 东风汽车集团股份有限公司 Method for detecting continuous illegal lane change of vehicle and computer equipment
CN114241765A (en) * 2021-12-15 2022-03-25 重庆中信科信息技术有限公司 Space-time logic-based method and device for analyzing traffic violation of directional lane and storage medium
CN114241765B (en) * 2021-12-15 2023-01-03 重庆中信科信息技术有限公司 Space-time logic-based method and device for analyzing traffic violation of directional lane and storage medium

Also Published As

Publication number Publication date
KR101354057B1 (en) 2014-01-22

Similar Documents

Publication Publication Date Title
WO2014081129A1 (en) Lane violation detection device using multiple cameras, lane violation detection method using same, and lane violation enforcement system using lane violation detection device with multiple cameras
CN112837560B (en) Novel intelligent public parking lot intelligent management method based on 5G
WO2020141683A1 (en) Image-based traffic information providing system and method thereof
KR101742490B1 (en) System for inspecting vehicle in violation by intervention and the method thereof
CN106327863A (en) Method, device and system for detection and early warning of vehicle congestion
CN106960587A (en) A kind of identification of traffic lights and zebra stripes and control system based on camera device
CN104361753B (en) Method and device for obtaining evidences of rule and regulation breaking of vehicles not running in alternating mode
US20160347323A1 (en) Driving assistance device and driving assistance method
CN104575000A (en) Method and system for recording illegal behaviors of motor vehicles entering jamming intersection
CN104680794A (en) Vehicle-mounted monitoring terminal as well as bus lane monitoring method and system based on terminal
KR101584105B1 (en) Vehicle photographing apparatus based multilane and control method thereof
CN103366407A (en) Method capable of giving function of automatically charging by using vehicle owner mobile phone to highway vehicle overspeed camera shooting monitoring system
WO2021251562A1 (en) Unmanned enforcement system for law-violating vehicles near pedestrian traffic light
WO2016208870A1 (en) Device for reading vehicle license plate number and method therefor
WO2014084594A1 (en) Apparatus and method for monitoring traffic violations
WO2019168296A1 (en) Premium insurance rate offering system with high reliability
KR101418533B1 (en) Vehicle Supervising Method
CN104299411A (en) Device for monitoring jaywalking of pedestrians at intersections
KR20200028081A (en) System for smart traffic lights with camera
KR20060102889A (en) System and method for regulating violation of exclusive auto road
KR20220081853A (en) How to measure the speed of a motorcycle and how to distinguish an Indian car, and an unmanned motorcycle control camera using it.
KR102316700B1 (en) Automated control system of bicycle
JP2018173925A (en) Parking lot usage status management system by vehicle number recognition system
JP2007188353A (en) Traffic control system
KR20120090471A (en) System for crackdown on traffic signal violation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13857035

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13857035

Country of ref document: EP

Kind code of ref document: A1