WO2020086026A2 - Monitoring, controlling and reporting driver actions by automatically following traffic rules - Google Patents
Monitoring, controlling and reporting driver actions by automatically following traffic rules Download PDFInfo
- Publication number
- WO2020086026A2 WO2020086026A2 PCT/TR2019/050623 TR2019050623W WO2020086026A2 WO 2020086026 A2 WO2020086026 A2 WO 2020086026A2 TR 2019050623 W TR2019050623 W TR 2019050623W WO 2020086026 A2 WO2020086026 A2 WO 2020086026A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- driver
- vehicle
- actions
- data
- violations
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
- G07C5/085—Registering performance data using electronic data carriers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V20/582—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of traffic signs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
- G08G1/0108—Measuring and analyzing of parameters relative to traffic conditions based on the source of data
- G08G1/0112—Measuring and analyzing of parameters relative to traffic conditions based on the source of data from the vehicle, e.g. floating car data [FCD]
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
- G08G1/0137—Measuring and analyzing of parameters relative to traffic conditions for specific applications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/09623—Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
- G07C5/085—Registering performance data using electronic data carriers
- G07C5/0866—Registering performance data using electronic data carriers the electronic data carrier being a digital video recorder in combination with video camera
Definitions
- the invention is related to a method which enables the addition of data obtained by image processing in addition to present data in the tachometer and the transferring of said data to a central server via connections (GSM, Satellite etc) which provide access to wide area networks (WAN) connected to the tachometer directly or via a gateway located at the locations visited, by adding modules that support data transfer to tachographs available in every vehicle by wireless (wi-fi, bluetooth, Satellite, GSM (GPRS, 3G, 4G, 5G), RF, NFC etc) devices, in order to automatically obtain all data from tachometers and which also enables said data to be monitored and controlled via the internet or intranet network from a single centre.
- the invention is particularly related to a method which enables to monitor from a single centre, the activities carried out and the result obtained following the comparison of the actions of the vehicle and the information obtained by means of the image processing performed on the images obtained from traffic signs and signals at the side of the road via the camera that is to be installed onto the vehicle and information obtained from said images.
- Two cameras are used in the invention. One camera is positioned such that it observes the driver inside the vehicle and the other camera is positioned to see the environment outside of the vehicle. Not only will there be interaction between two cameras but also, information obtained from the controller area network (CAN) line that is located in the vehicle, is compared.
- CAN controller area network
- a digital tachograph is disclosed.
- the data recorded by the tachograph can be transferred to a data centre wirelessly.
- a camera has been provided in the vehicle and it warns the driver to follow traffic rules according to the location information of the driver and if the driver does not follow the traffic rules, a penalty point is given to the driver.
- a digital tachograph apparatus which is installed onto digital tachographs and enables data that is obtained from the digital tachograph is disclosed.
- a data management system which enables to transfer wireless data over servers between digital tachographs and ATS modems via apparatuses such as an ATS modem apparatus installed onto ATS modems which is a GSM/GPS modem used on vehicle tracking systems which are presently being used by vehicle owner companies.
- connection is used for transferring the related information to tachographs.
- a tachograph that is used for transferring information regarding the establishment of connection is determined by using the vehicle ID information in order to determine the user account in the tachograph service unit.
- the user account can be reached by means of remote user means.
- the transferring of the information related to the tachograph to a database is carried out via a tachograph service unit.
- the information can be transferred wirelessly.
- the detection, warning and penalizing system for violating traffic rules subject to the invention operates by determining the position and motion information of the vehicle generally by using a global positioning system (GPS), correlating information obtained on the map provided in the device and sending a visual or audio warning to the driver in case the driver is violating traffic rules such as parking , red light, and overspeed prohibition, etc, and submitting information to the control centre for penalization to be carried out if the driver continues to violate the traffic rules.
- GPS global positioning system
- the invention aims to provide a method which enables to monitor the activities carried out from a single centre, and the comparison of the real time actions of the vehicle through the information obtained by means of the image processing performed with the camera installed inside and outside of the vehicle.
- Another aim of the invention is to provide a method which minimizes traffic rule violations of the driver due to the perception that he/she is being observed at all time and thereby which reduces traffic accidents.
- the invention is a method which enables to control traffic rule violations from a single centre by automatically monitoring traffic rules and recording driver violations into a tachograph, comprising the process steps of; following warning signs and lights at the side of the road or in the vicinity by using the internal and external camera installed on the vehicle and the image processing technique,
- CAN controller area network
- WAN connections by adding modules which support wireless (wi-fi, Bluetooth etc) data transfer and transferring said data to a central server, monitoring and controlling the data obtained from the tachograph from a single centre via an internet or an intranet network,
- the vehicle’s internal camera shall automatically perceive if the vehicle is moving or not when the driver is talking on the phone, the standing/sitting position of the driver when driving the vehicle, and other erroneous actions of the driver such as conversing with the passengers, conversing excessively with people nearby and smoking (especially intercity busses), and the information shall be compared with the information received by the CAN message list and the erroneous/violating actions shall be recorded into the tachograph.
- the driver should not drive through a red light. If the driver drives through a red light, this information shall be recorded as traffic rule violation into the tachograph.
- the external camera can perceive the no right turn sign at the side of the road. Despite this, if the driver is perceived to turn right via the CAN message line, this shall be perceived as traffic rule violation and the related image captured at that moment shall be recorded by the tachograph.
- the speed information of the vehicle at said locations are obtained from the centre network and the speed shall be compared with the sign and the related traffic rule violation shall be recorded into the tachograph.
- the safety of the community shall be enabled by automatically perceiving all traffic rule violation information that can be detected from the side of the roads or from other interfaces (GPS etc) and recording such information into the archive at locations that are visited (controlling stations, bus stations etc).
Abstract
The invention is related to a method which enables to monitor from a single centre for tracking the driver actions taken and to compare actions of the vehicle by means of the information obtained from the images captured by the image processing feature provided with the internal and external camera to be installed on the vehicle.
Description
MONITORING, CONTROLLING AND REPORTING DRIVER ACTIONS BY AUTOMATICALLY FOLLOWING TRAFFIC RULES
Technical Field The invention is related to a method which enables the addition of data obtained by image processing in addition to present data in the tachometer and the transferring of said data to a central server via connections (GSM, Satellite etc) which provide access to wide area networks (WAN) connected to the tachometer directly or via a gateway located at the locations visited, by adding modules that support data transfer to tachographs available in every vehicle by wireless (wi-fi, bluetooth, Satellite, GSM (GPRS, 3G, 4G, 5G), RF, NFC etc) devices, in order to automatically obtain all data from tachometers and which also enables said data to be monitored and controlled via the internet or intranet network from a single centre. The invention is particularly related to a method which enables to monitor from a single centre, the activities carried out and the result obtained following the comparison of the actions of the vehicle and the information obtained by means of the image processing performed on the images obtained from traffic signs and signals at the side of the road via the camera that is to be installed onto the vehicle and information obtained from said images.
Two cameras are used in the invention. One camera is positioned such that it observes the driver inside the vehicle and the other camera is positioned to see the environment outside of the vehicle. Not only will there be interaction between two cameras but also, information obtained from the controller area network (CAN) line that is located in the vehicle, is compared.
Prior Art
The data recorded by the tachograph devices of the prior art are manually collected and are controlled by the authorized officers. In such cases controls take time and they are difficult. Moreover, as the sanctions related to the violation of traffic rules cannot be applied on time, such violations have been increasing. Due to this reason, the safety of life and property of the community is at risk. In the methods developed in the art, there should be a perception that there is a traffic police observing each driver at all times, so that the driver does not violate any rule even in places where there is no traffic control.
In the International patent document numbered W02017006214 in prior art, a digital tachograph is disclosed. The data recorded by the tachograph can be transferred to a data centre wirelessly. Additionally, a camera has been provided in the vehicle and it warns the driver to follow traffic rules according to the location information of the driver and if the driver does not follow the traffic rules, a penalty point is given to the driver. In the Turkish Patent document numbered 2015/04277 in prior art, a digital tachograph apparatus which is installed onto digital tachographs and enables data that is obtained from the digital tachograph is disclosed. A data management system which enables to transfer wireless data over servers between digital tachographs and ATS modems via apparatuses such as an ATS modem apparatus installed onto ATS modems which is a GSM/GPS modem used on vehicle tracking systems which are presently being used by vehicle owner companies.
In the International patent document numbered WO2011043715 in prior art a method and a system that has been developed in order to establish connection between the vehicle and the database is disclosed. The connection is used for transferring the related information to tachographs. According to the present invention a tachograph that is used for transferring information regarding the establishment of connection is determined by using the vehicle ID information in order to determine the user account in the tachograph service unit. The user account can be reached by means of remote user means. Moreover after a connection is
established the transferring of the information related to the tachograph to a database, is carried out via a tachograph service unit. The information can be transferred wirelessly.
In the United States Patent document numbered US2010273476 in prior art, a communication control unit has been developed in order to transfer data via a communication line between the tachograph and the data processing module. The data in the tachograph are transferred to a data processing centre wirelessly.
In the Turkish Patent document numbered 2011/08751 in prior art, a system for detecting, warning and penalizing traffic rule violations is disclosed. The detection, warning and penalizing system for violating traffic rules subject to the invention operates by determining the position and motion information of the vehicle generally by using a global positioning system (GPS), correlating information obtained on the map provided in the device and sending a visual or audio warning to the driver in case the driver is violating traffic rules such as parking , red light, and overspeed prohibition, etc, and submitting information to the control centre for penalization to be carried out if the driver continues to violate the traffic rules.
However, in the referenced patent documents; speed limits are determined by comparing GPS signals with the map data. Correct information may not be able to be obtained if a GPS signal can't be received, or is delayed or if the map data are not up-to-date. But it is quite important to determine, traffic violations with real time images obtained from inside and outside the vehicle. Therefore, the necessity of developing the method subject to the invention has risen.
Aims of the Invention
The invention aims to provide a method which enables to monitor the activities carried out from a single centre, and the comparison of the real time actions of the vehicle through the information obtained by means of the image processing performed with the camera installed inside and outside of the vehicle.
Another aim of the invention is to provide a method which minimizes traffic rule violations of the driver due to the perception that he/she is being observed at all time and thereby which reduces traffic accidents.
Detailed Description of the Invention The invention is a method which enables to control traffic rule violations from a single centre by automatically monitoring traffic rules and recording driver violations into a tachograph, comprising the process steps of; following warning signs and lights at the side of the road or in the vicinity by using the internal and external camera installed on the vehicle and the image processing technique,
determining violations by comparing the controller area network (CAN) message list and the driver actions captured with the camera located inside the vehicle,
determining the action(s) that the driver has to take by means of the traffic signs that are perceived and monitored by the vehicle’s external camera, comparing the actions that have to be taken by the driver according to the traffic signs and the actual actions of the driver,
recording the traffic violations of the driver determined as a result of the compared actions into a tachograph,
- obtaining data via locations that have been visited or via wide area network
(WAN) connections by adding modules which support wireless (wi-fi, Bluetooth etc) data transfer and transferring said data to a central server, monitoring and controlling the data obtained from the tachograph from a single centre via an internet or an intranet network,
- recording vehicle actions using if necessary, acceleration, gyroscope sensor information besides the controller area network (CAN) message list, in order to learn the status of the vehicle from the vehicle itself.
The warning signs and lights at the side of the road or in the vicinity are followed by using the external camera installed on the vehicle and the action(s) anticipated to be carried out are determined after perceiving the related signs or lights.
For example the vehicle’s internal camera shall automatically perceive if the vehicle is moving or not when the driver is talking on the phone, the standing/sitting position of the driver when driving the vehicle, and other erroneous actions of the driver such as conversing with the passengers, conversing excessively with people nearby and smoking (especially intercity busses), and the information shall be compared with the information received by the CAN message list and the erroneous/violating actions shall be recorded into the tachograph.
For example; the driver should not drive through a red light. If the driver drives through a red light, this information shall be recorded as traffic rule violation into the tachograph.
According to another example, the external camera can perceive the no right turn sign at the side of the road. Despite this, if the driver is perceived to turn right via the CAN message line, this shall be perceived as traffic rule violation and the related image captured at that moment shall be recorded by the tachograph.
For example; if a speed limit sign is observed, the speed information of the vehicle at said locations are obtained from the centre network and the speed shall be compared with the sign and the related traffic rule violation shall be recorded into the tachograph.
By means of the reliable, verifiable and controllable method of the invention the safety of the community shall be enabled by automatically perceiving all traffic rule violation information that can be detected from the side of the roads or from other interfaces (GPS etc) and recording such information into the archive at locations that are visited (controlling stations, bus stations etc).
Claims
1. The invention is a method which enables to control traffic rule violations from a single centre by automatically monitoring traffic rules and recording driver violations into a tachograph, characterized by comprising the process steps of; determining violations by comparing the CAN message list and the driver actions captured with the camera located inside the vehicle, following warning signs and lights at the side of the road or the external environment by using the external camera installed on the vehicle and the image processing technique, comparing the data between the external environment, internal environment and CAN message list and determining violations if any are available, determining the action(s) that the driver needs to take by means of the traffic signs that are perceived and monitored, - comparing the actions that need to be taken by the driver according to the traffic signs and the actual actions of the driver, recording the traffic violations of the driver determined as a result of the compared actions into a tachograph, obtaining data via locations that have been visited by adding modules which support wireless (wi-fi, Bluetooth etc) data transfer and transferring said data to a central server, monitoring and controlling the data obtained from the tachograph from a single centre via an internet or an intranet network.
2. A method according to claim 1 ; characterized by comprising the step of recording vehicle actions using acceleration, gyroscope sensor information besides the controller area network (CAN) message list, in order to learn the status of the vehicle from the vehicle itself.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP19876474.8A EP3827419A4 (en) | 2018-07-26 | 2019-07-25 | Monitoring, controlling and reporting driver actions by automatically following traffic rules |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TR2018/10774 | 2018-07-26 | ||
| TR201810774 | 2018-07-26 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2020086026A2 true WO2020086026A2 (en) | 2020-04-30 |
| WO2020086026A3 WO2020086026A3 (en) | 2020-08-13 |
Family
ID=70331074
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/TR2019/050623 WO2020086026A2 (en) | 2018-07-26 | 2019-07-25 | Monitoring, controlling and reporting driver actions by automatically following traffic rules |
Country Status (2)
| Country | Link |
|---|---|
| EP (1) | EP3827419A4 (en) |
| WO (1) | WO2020086026A2 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114202914A (en) * | 2021-11-24 | 2022-03-18 | 黑龙江工程学院 | Close-range image traffic violation and road condition photogrammetry system based on Wifi signal |
| US20220238014A1 (en) * | 2021-01-25 | 2022-07-28 | Panasonic Automotive Systems Company Of America, Division Of Panasonic Corporation Of North America | Vehicle Itself To Report Traffic Violations To The Traffic Police Department |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| SE534787C2 (en) * | 2009-10-06 | 2011-12-20 | Scania Cv Ab | Transmission of tachograph related information |
| JP5416307B1 (en) * | 2013-07-08 | 2014-02-12 | アサヒリサーチ株式会社 | Vehicle operation management device and computer program |
| US9111453B1 (en) * | 2013-08-01 | 2015-08-18 | Mohammad A. Alselimi | Traffic management server and a traffic recording apparatus |
| US20180108252A1 (en) * | 2015-07-03 | 2018-04-19 | Marcelo Pividori | Device known as real time total control digital tachograph (tcdt) for vehicle and other nearby vehicles by means of cameras and mobile connections |
| JP2017138694A (en) * | 2016-02-02 | 2017-08-10 | ソニー株式会社 | Picture processing device and picture processing method |
| JP6625932B2 (en) * | 2016-05-31 | 2019-12-25 | 株式会社東芝 | Monitoring device and monitoring system |
-
2019
- 2019-07-25 WO PCT/TR2019/050623 patent/WO2020086026A2/en active Application Filing
- 2019-07-25 EP EP19876474.8A patent/EP3827419A4/en not_active Withdrawn
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20220238014A1 (en) * | 2021-01-25 | 2022-07-28 | Panasonic Automotive Systems Company Of America, Division Of Panasonic Corporation Of North America | Vehicle Itself To Report Traffic Violations To The Traffic Police Department |
| CN114202914A (en) * | 2021-11-24 | 2022-03-18 | 黑龙江工程学院 | Close-range image traffic violation and road condition photogrammetry system based on Wifi signal |
Also Published As
| Publication number | Publication date |
|---|---|
| EP3827419A2 (en) | 2021-06-02 |
| WO2020086026A3 (en) | 2020-08-13 |
| EP3827419A4 (en) | 2022-04-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107608388B (en) | Autonomous police vehicle | |
| US9786171B2 (en) | Systems and methods for detecting and distributing hazard data by a vehicle | |
| CN103544820B (en) | The safety monitoring system of taxi and method thereof | |
| JP4752836B2 (en) | Road environment information notification device and road environment information notification program | |
| US20220297644A1 (en) | Safe driving support system based on mobile iot agent and method for processing thereof | |
| CN104408941A (en) | System and method of vehicle management based on Beidou satellite navigation | |
| CN110341594B (en) | Passenger safety situation monitoring system and method for passenger car | |
| JP4093026B2 (en) | Road environment information notification device, in-vehicle notification device, information center device, and road environment information notification program | |
| DK2940673T3 (en) | System and method for detecting potential accident situations with a car | |
| US11186257B2 (en) | Automobile driver biometric authentication and GPS services | |
| JP7227577B2 (en) | Traffic risk information output system and traffic risk information output program | |
| CN111818160A (en) | Vehicle-mounted machine equipment | |
| EP3827419A2 (en) | Monitoring, controlling and reporting driver actions by automatically following traffic rules | |
| US20220212631A1 (en) | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program | |
| CN112289036A (en) | Scene type violation attribute identification system and method based on traffic semantics | |
| TWI419087B (en) | Security monitoring system for taxi and method thereof | |
| JP4969108B2 (en) | Traffic management system | |
| RU127504U1 (en) | DEVICE FOR AUTOMATED CONTROL OF COMPLIANCE WITH RULES OF ROAD VEHICLES | |
| KR20180023369A (en) | Fleet management system and method for safety driving | |
| KR100962414B1 (en) | System and method of state information transmittion for car | |
| JP2023065222A (en) | Information collection system | |
| KR20140062900A (en) | Portable car number plate recognition system | |
| KR102245850B1 (en) | Method and apparatus for providing integrated control service using black box images | |
| KR20200002178A (en) | Automobile-specific highway management system using autonomous vehicles | |
| US20220238014A1 (en) | Vehicle Itself To Report Traffic Violations To The Traffic Police Department |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19876474 Country of ref document: EP Kind code of ref document: A2 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2019876474 Country of ref document: EP |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19876474 Country of ref document: EP Kind code of ref document: A2 |