AU2015101831A4 - A vehicle driver monitoring method, arrangement, system, software and mobile application - Google Patents

A vehicle driver monitoring method, arrangement, system, software and mobile application Download PDF

Info

Publication number
AU2015101831A4
AU2015101831A4 AU2015101831A AU2015101831A AU2015101831A4 AU 2015101831 A4 AU2015101831 A4 AU 2015101831A4 AU 2015101831 A AU2015101831 A AU 2015101831A AU 2015101831 A AU2015101831 A AU 2015101831A AU 2015101831 A4 AU2015101831 A4 AU 2015101831A4
Authority
AU
Australia
Prior art keywords
driver
data
arrangement
driving
vehicle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
AU2015101831A
Inventor
Phyllis Fisher
O'reilly Sharon Lorraine
Donald John Smart
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sharon Lorraine O'reilly Ms
Smart Donald John Mr
Original Assignee
Fisher Phyllis Ms
Sharon Lorraine Oreilly Ms
Smart Donald John Mr
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fisher Phyllis Ms, Sharon Lorraine Oreilly Ms, Smart Donald John Mr filed Critical Fisher Phyllis Ms
Application granted granted Critical
Publication of AU2015101831A4 publication Critical patent/AU2015101831A4/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Landscapes

  • Traffic Control Systems (AREA)

Abstract

The invention relates to a driver monitoring system which is used in, mountable or positionable in or on a vehicle and which may be integrated with mobile device which is a wireless communication module and or with a navigation system which have video camera, imagery recording hardware and systems, and includes an identification module which is configured to receive and capture identification information from a driver, and at least one driver behaviour detection module which is configured to detect and record driver behaviour and driving -related imagery in real-time. The wireless communication module is configured to send information on the detected driver behaviour factor or imagery wirelessly to a remote location. The identification module may include a biometric voice recorder, reader or scanner which is configured to capture and analyse biometric identification information of a driver. The arrangement may include at least one monitoring arrangement which is configured to monitor a physiological, psychometric or mental capacity requirement of a driver and transmit this to a remote station. -Ti =Cn Lc-f i t IQ N:; I !

Description

1 TITLE: A VEHICLE DRIVER MONITORING METHOD, ARRANGEMENT, SYSTEM, SOFTWARE AND MOBILE APPLICATION REFERENCE TO RELATED APPLICATIONS: [0001] This application claims the benefit of ZA Application 2015/05971 (filed on 18 August 2015) and also claims the benefit and priority of ZA Provisional Application 2015/0691 (filed in 1 February 2015); and AU Application 2105271971 (filed 19 December 2015) and the relevant aspects and claims of ZA Application 2015/05971, Provisional Application ZA 2015/0691 and AU Application 2105271971 as are incorporated herein and may relate hereto. FIELD OF THE INVENTION [0002] The application relates to a mobile vehicle driver identification and monitoring method, system and software, for the monitoring and recording of driving and driver behaviour, competency and compliance using mobile data capture and image recordings and mobile transmission devices, and which data is transmitted to a centralised storage and analysis station by wireless communication networks for the creation of a historical data and driving record (logbook) and driver profile, and more specifically the use of smartphone and navigation hardware and integration of software therefore. [0003] The application relates further to mobile Application software commonly known as Apps, and related integrated software and systems for the capturing and transmission of driver identification, driving information and related data and imagery for transmission by wireless communication networks to a centralised storage and analysis station, for the creation of a historical data and driving record (logbook) and a driver profile relative to the identified driver, for auditing, evidencing and management of the data.
2 BACKGROUND OF THE INVENTION [0004] This application relates to a driver identification and monitoring method, arrangement, software and systems for recording data of vehicle drivers. In addition, the invention also relates to a mobile software Application for use in mobile and similar computer devices such as smartphones and navigation instruments for the identification of a driver and the monitoring, recording and analysis of driving data and imagery of a driver of a vehicle and driver behaviour. [0005] The innovation of the invention is the improvement of use of smartphone, navigation or similar technology, applications or systems and using global mobile communications systems (GSM) / networks, by a vehicle driver by: i) the recording, detection, evidencing and verification of biometric and physical / physiological identification data and imagery of an identifiable driver; and ii) the recording, transmission and use in real-time of video imagery and data of the identified driver's biometric, physiological, and also psychometric and mental data and information for driver competency, capacity and driving behaviour; and iii) the recording in real-time of video imagery and data relative to the identified driver's driving or behaviour, and transmission of defined event imagery and data that is related to imprinted audit trail video imagery of non-compliance with traffic rules, standards or defined criteria; iv) the use of digital camera or video recording imagery with optical character recognition for detection and analysis of regulatory traffic signs and also use of related Global Position Systems and mapping data to identify the position, speed and direction and route of travel of the 3 vehicle, driver behaviour and regulatory or safety compliance, source of data relative to such events, and for GSM or wireless transmission thereof to a central data system; v) the use of the secured video event imagery and data by imprinting, overlaying or embedding an audit trail or mark that is transmitted to a centralised data and management system (such as a digital logbook) to verify competency and compliance of driving and driver behaviour within defined parameters, standards and traffic rules; and vi) the use of driving real-time imagery and data recordings on centralised data storage systems or logbook and historical driver profile for certification and evidencing of the identifiable driver's profile, compliance and competency. vii) The integration of smartphone or similar system technology and the use of GSM with alcohol breathalyser devices or modules and technology, but which system or module uses simultaneous biometrical, physical and identification imagery and data of the user of the breathalyser module; and viii) The use of smartphone technology integrated with the system and software to carry out psychometric and other mental testing to analyse and test the driver's mental alertness, capacity and state of competency to drive a vehicle (as identifying possible effects of substances that cause intoxication or have narcotic effects). [0006] Current driving management, competency and behaviour systems (such as graduate driver competence and compliance) do not allow for the identification of a driver or driver's behaviour in real time and or for the audit, evidencing or verification of critical information or data by traffic agencies or authorities or 4 related entities and that is evidenced to relate to a legally accepted process to identify a vehicle driver or driver supervisor. (e.g. in countries where such systems are implemented either statutorily such as graduate driver "logbooks", penalty demerit point "good behaviour bond" systems, or commercially by fleet owners, management companies or insurers). [0007] There is also no control or systems for the accurate authentication, verification or audit processes of captured, transmitted or stored driving or driver information data as it relates to a specific and identified driver and driver's behaviour, conduct, physiological and mental condition or compliancy. [0008] Current driver data or systems cannot typically be verified, authenticated or evidenced and are not securely distinct to a specific identified or identifiable driver. The data is also generally not detailed or secured for analysis, authentication and verification purposes. [0009] Vehicle telematics and similar systems that exist monitor erratic or abnormal vehicle movement or motions of a vehicle as typified to driving (and other vehicle mobility, function or motion data) and relate or interpret this as and to profile an unidentified driver's supposed driving pattern or driving behaviour. [0010] These existing systems do not address the need to obtain appropriate secure real-time visual driving, or driver biometric, psychometric, physiological and biological information, or driving imagery data, and to transmit this imagery or data to a secured centralised system that stores, analyses and manages the driver and driving data, and relates this data in a secure traceable and auditable manner in order to record and analyse accurate real-time data for an identified driver of a vehicle. [0011] The Inventors wish to address at least some of the above-identified problems and inadequacies to provide a secure system for industry improved standards and for computer based systems of identified driver and driver behaviour 5 control, documentation, certification, authentication and evidencing to improve and provide a reliable, evidenced monitoring, management and certification system of identified drivers to increase levels of competency and compliance. [0012] In contrast to current systems that monitor vehicle motion and unidentified source data, the Inventors address the evidencing of an identified person as driver and specifically the analysis of various forms of biometric, physiological, psychometric, mental and biological information, driver and driving imagery and data of an identified driver, and the analysis thereof, by using software systems and algorithms that can be used in conjunction with GPS, telematics and smartphone software and hardware technology, the latter that will be known to persons who are skilled in the art of GPS, telematics and smartphone computer software and hardware systems. SUMMARY OF THE INVENTION [0013] In accordance with a first aspect of the invention there is provided a vehicle driver monitoring or management method, software and systems that operate with a smartphone or similar wireless transmission system, which includes: i) receiving driver biometric identification information, specifically but not limited to voice analysis systems, and imagery of physical features, from a mobile monitoring arrangement which is to be used, mounted/ positioned in/on a vehicle, ii) transmitting such driver data and driving imagery and information via a wireless communication network to a central data base in order to identify a particular driver of the vehicle; iii) receiving information on driver behaviour of the identified driver from the driver monitoring arrangement via a wireless communication network; 6 iv) comparing, by using a processor, at least part of the received driver behaviour information by means of video imagery and GPS data, and related to predetermined driving-related rules such as regulatory road traffic signs, which is stored on a database in order to determine whether the driver is in compliance with the rules or standards; v) storing data of all driving information of the identified driver as identified in this arrangement on a central data base (such as a digital logbook) for the comparison of the specific driver information and certification of competency and compliance. vi) capturing, recording and receiving ongoing and intermittent or event driving imagery and data or information from a driver monitoring arrangement and hardware and software systems, which may be mobile and used or mounted/positioned in/on a vehicle for application, and vii) transmission of continuous and event data from the arrangement through a wireless communication network or data transmission system (GSM) to a remote server system computer processing and storage systems in order to verify, analyse and evidence the identification and behaviour, condition or conduct of a particular driver of a vehicle; viii) receiving and analysing by algorithms, the date, time and position of recorded and evidenced data or imagery on the identified driver's behaviour, and biometrical data of the specific identified driver, transmitted from the driver monitoring arrangement. ix) transmitting data through or from a wireless communication network, (such as the Global System for Mobile Communications Network (GSM) or Code Division Multiple Access systems (CDMA), UMTS (Universal Mobile Telephone System), 3 or 4G GSM or Wideband CDMA or similar systems which Data Transmission Communication technology is known 7 to persons skilled in the art of wireless data transmission or communications systems. x) comparing, analysing and profiling, by using a computer processor, or processors, at least part of the received identified driver's behaviour information within, and to predetermined and defined driving related rules which are stored on a database, and by means of algorithms to determine whether the driver is competent and driving in compliance with the defined rules, standards and set driving requirements; and xi) storing and retrieving an identified driver's data or information for record and historical purposes for the comparison or analysis of information on the specific identifiable driver on a central database and also by individual data memory storage card or system. [0014] The step of receiving information on driver behaviour may more specifically include receiving in real-time, information, video imagery or data on current driver information or behaviour and biometric, psychometric, mental, physiological or biological data or information of the identified driver from the driver monitoring arrangement through a wireless communication network or data transmission system. [0015] The driving-related rules may include traffic rules/laws/standards or safety rules for vehicle drivers of a group, region, state or country. [0016] The method may include receiving in real-time, data, information and visual video imagery recordings, information and data of the current geographic location of the vehicle, traffic, environment and regulatory driving data, together with information on current driver behaviour and mental or physiological data of the driver via a wireless communication or data transmission network. [0017] In addition to receiving data and information on current driving behaviour, the method may also include receiving and computing/ analysing information on 8 physiological, biological, psychometric and/or mental capacity or status of a driver, via data transmission through a wireless communication network. [0018] The method may include the capture, transmission and data processing and analysis of event data, time and position related data and the geographical co ordinates of the position of the identified driver, through the systems, arrangement, hardware and software. [0019] The identification information may include biometric, physiological, physical or biological identification information of the driver. [0020] The term "biometric identification information" should be interpreted to incorporate, but not limited to, voice, physical, facial or biological identification information. [0021] The method may include, when an identification match of such biometric identification information data is found by the software analysis system, sending an authorisation message to the driver monitoring arrangement via a wireless communication network which authorises the particular identified driver to use or activate the monitoring and management arrangement for use in a vehicle. [0022] The method may include when a violation, deviation or non-compliance of the driving related rules or of a standard or norm is determined by the software systems, the "event" recording is transmitted to the central system and also sending an audible message to the driver monitoring arrangement ( such as smartphone). [0023] The method, software, arrangement or systems may include: i) creating, updating, recording and processing on data storage software and processing systems for comparison, profiling, analysis, assessment and event recording and retrieval, by means a computer processor and 9 software, a driver profile of a particular identified or identifiable driver; and ii) storing the data and profile on a database, wherein the profile includes driver behaviour, psychometric, mental, physiological or biological data or information for the particular identifiable driver received from the driver monitoring arrangement, software and systems; and iii) creating, recording and analysis, from a video or imagery capture system, to data storage software and processing systems, for comparison, analysis, assessment and event recording and retrieval, the driving and physiological, mental or biological information and data of a particular identified or identifiable driver and storing that data or information on a system and database; and iv) creating a profile of driver behaviour, psychometric, physiological or biometric data or information for the particular identifiable driver; and v) updating the identifiable driver's driving profile when new driving behaviour information for the identified driver is received from the mobile device such as a smartphone sent to the central remote computer systems; and vi) monitoring the data of the driver against set criteria required for competency, aptitude and capacity, and the analysis of that data against the identified driver physiological, psychometric, mental or biological profile and current and historical data. [0024] The method may include, in addition to receiving identification and physiological information of a particular identified driver, also receiving biometrical or other physical identification information of a driver supervisor and determining whether or not the driver supervisor identification information matches identification information of a particular driver supervisor which has been captured and saved on a central database 10 [0025] In accordance with a second aspect of the invention there is provided a driver monitoring method and software system which may include: i) authenticating and evidencing the captured real time data and imagery, by means of embedding in the video or similar imagery or recorded data, or on the "event" sections of the data and captured or stored video or similar imagery, or on the various data or image storage systems, an embedded, imprinted, or encrypted audit data trail marking and data sequence identification, that may include the arrangement unit number, event and data recording with data of date and time in fractions, specific geographical coordinates of the position of the arrangement or unit when the transmission was made, as well as the identity of the driver as determined and verified by the biometric and identification software systems of the arrangement and system; ii) the term "event" in this application means part, sections or defined portions of data and imagery that is programmed to be transmitted by GSM or captured as essential data or imagery of a specific nature, that requires to be actioned, audited, documented or logged in the central data base or designated storage retrieval systems. [0026] The software systems of the arrangement may include an Application Programming Interface (API) with software protocols and routines for the integration of and enhancement of other systems, hardware and software such as those of a smartphone or similar mobile computer and transmission device, navigation mapping software and related hardware systems such as digital video recorders, Global Positioning Systems (GPS), or for software systems of, or for other applications. [0027] The method may include determining, by using a processor, the intermittent or continuous trip or journey details of the identified driver and related geographic 11 location of the vehicle and transmitting and receiving information on the geographic location and journey of the vehicle via a communication link/network, satellite positioning or the transmission of a signal from the vehicle and positioning by a ground/ land based system. [0028] The method may include by using a processor or software systems, determining the ongoing geographic coordinates and location and direction of motion of the vehicle, sending or transmitting information on the determined geographical location together with the captured driver behaviour information to the remote station. [0029] The capturing of data may include the continuous recording on video or similar imagery of the arrangement or unit, indicating the direction of motion or travel, geographical and environmental or traffic data relative to the GPS co-ordinates of the vehicle. [0030] The method may include, after sending the captured driver identification and driver information, receiving a message via a wireless communication network which confirms that the driver is identified by the system or arrangement. [0031] The step or event processes of capturing driving or driver behaviour may include: i) determining the speed of the vehicle by using GPS data or vehicle motion data and a processor; ii) recording by video optical imagery of driving events, and identification by optical character recognition of defined traffic regulatory signs or markings; 12 iii) determining the visibility of traffic and road conditions by means of video imagery, and also in another method by laser or infra-red light measurement; iv) recording video imagery of the driver inside and/or driving information outside the vehicle; v) receiving, recording and analysing biometric, biological data of a person activating and using the arrangement unit or system; vi) receiving, recording, analysing and monitoring the psychometric, mental and physiological factors of the identified driver. vii) determining if the driver is using a mobile phone or similar device for texting messages while driving. [0032] The step of determining the psychometric, mental and physiological state may more specifically include comparing/correlating such information of the driver measured by the monitoring device/apparatus with previously recorded information stored on a database under controlled circumstances. [0033] In accordance with a third aspect of the invention there is provided a driver monitoring arrangement such as a smartphone or similar device which is mountable/positioned in/on a vehicle, wherein the arrangement includes or may include: i) an identification module which is configured to receive/capture identification information from a driver; and ii) a wireless communication module which is configured to send the identification information to a remote location; and iii) a location detection module which is configured to detect the geographic location of the arrangement in real-time; 13 iv) at least one driver behaviour detection module which is configured to detect at least one driver behaviour factor in real time, ii) at least one module that is configured to receive and or analyse biometrical or biological data or information of the driver; iii) an imagery capturing system, or video recording system module that may have an optical character recognition analysis software system; iv) an integrated module, or separate modules that use wireless or universal serial bus connectivity technology to connect with the main monitoring arrangement and that records GPS, mapping data, or mental, physiological or biological factors of the identified driver; and v) wherein the wireless communication module is configured to receive and or transmit information and data from such modules on the detected geographical location, environment, vehicle and traffic data or information and the detected or determined driver behaviour, mental, biological data or information, wirelessly to a remote location. [0034] A "module", in the context of the specification, includes an identifiable portion of code, computational or executable instructions, or a computational object to achieve a particular function, operation, processing, or procedure. [0035]A module may be implemented in software, hardware or a combination of software and hardware. Furthermore, modules need not necessarily be consolidated into one device.
14 [0036] The arrangement may include a data base or other storage means (e.g. a memory card), and the identification module may be configured to store the received/captured identification information on the data base/storage means. [0037] The wireless communication module may be configured to send or transmit the information, imagery or data on the detected location and the detected driver behaviour factors or information, wirelessly to a remote computer storage and analysis location in real-time and to store such data or defined event data. [0038] The arrangement may include regulatory sign and road marking detection functions or module by digital video recorders, camera or a similar digital recording module. [0039] The video or camera recording module of the arrangement may be configured to detect/determine record imagery and data related to the driving, speed, direction, motion, or stopping of the vehicle, in/on which vehicle the arrangement is mounted/positioned when in use, and [00040] to determine by computation of an algorithm if the driver does not comply with any of the programmed regulatory traffic rules as set by the system. Such data may be captured continuously and stored and transmitted to the central storage and analysis station by defined "events", times or by continuous transmission of data. [0041] The arrangement, attachment or module that may include a breathalyser module or apparatus which is configured to detect the amount of, or any, alcohol in a driver's breath and simultaneously capture and relate such data or function to the biometrics of the driver and an identifiable person by simultaneous voice analysis and breath alcohol analysis of the person inputting the required biological and biometric data.
15 [0042] The arrangement and breathalyser apparatus or related module may record simultaneously a facial image of the person activating the arrangement and breathalyser module and may measure the volume of breath relative to the speech input, and by means of an algorithm determine the origin of the speech and air or breath against which the analysis of voice input and alcohol detection or measurement is made to verify the source and identity of the biological input data. [0043] The arrangement or a module may include an integrated or separate camera or video module that monitors the identifiable driver's eye or eyelid movement and by means of computer algorithms, comparisons and analysis of the eye or eyelid movement, whether the identifiable driver may be in a state of physiological, biological, mental or functional incapacity that is not compliant with a condition or state required of a driver by the driving rules or safety standards for vehicle driving. [0044] The arrangement or module may include a camera or video recording component or may receive such imagery from a separate or integrated device or module such as a smartphone that includes optical character recognition software of recorded video or camera imagery. [0045] The arrangement may include a module or system for monitoring the use of mobile cellular phone text data and voice transmission during driving using the GSM and GPS functionality and systems; [0046] The driver behaviour detection module of the arrangement may include a software system, laser, infra-red light system, video imagery, or optical distance measuring arrangement which is configured and used in conjunction with a computer processor, software and set algorithms to determine both distance and speed as well as an algorithm to determine the projected stopping distance required to bring the vehicle to a stop and may give the driver an audible message or alarm of the detected potential safety or driving danger or risk.
16 [0047] In accordance with a fourth aspect of the invention there is provided a driver monitoring system and arrangement which includes: i) a computer hardware and software analysis station/centre which includes a database on which driver identification information and data for at least one particular driver is stored; ii) at least one driver monitoring arrangement which is mountable in/on a vehicle and which is configured to communicate with the computerised analysis station via a wireless communication or data network, and iii) wherein the arrangement is configured to capture/receive driver identification information and send it to the analysis station in order to identify a particular driver, iv) the arrangement is configured to capture, in real-time, information on driver behaviour or driving rules by using a driver behaviour detection module of the arrangement and to send the captured identified driver or driving information to the analysis station via a wireless data communication or transmission network; and v) wherein the analysis station software is configured to identify a particular driver from the database by using the received driver identification information; and vi) to compare at least part of the received driver behaviour or driving information for the identified driver with predetermined driving related rules or standards stored on a database, in order to determine whether the identified driver data or information received, captured or transmitted to the central analysis station is in compliance with the rules, standards or requirements, and 17 vii) to store information and the comparison information or data on a database. [0048] The driving-related rules may include traffic rules for vehicle drivers or rules for specific classes of drivers or rules for specific drivers and may also include traffic laws and/or driver/driving standards or safety procedures. [0049] In accordance with a fifth aspect of the invention there is provided a mobile application for monitoring a driver of a vehicle, wherein the application includes: i) an identification module which is configured to receive/capture identification information from a driver by using a mobile communication device or module on which the application is installed; ii) a wireless communication module which is configured to send the driver identification information wirelessly to a remote location by using a communication unit of the mobile communication device; iii) a location module which is configured to detect the geographic location that may be visually captured and determined by video or may be by determined by a Global Positioning System (GPS) which locates the exact position, direction of travel of the vehicle in which the mobile communication device is being used or to obtain the said geographic location from a geographic location module of the mobile communication device; iv) at least one driver behaviour detection module which is configured to detect at least one driver behaviour factor in real time, 18 v) an identification module which is configured to receive/capture identification information from a driver and may be configured to receive/capture identification information from a supervisor driver; vi) a wireless communication module which is configured to send the identification information to a remote location; vii) a location detection module which is configured to detect the geographic location of the arrangement in real-time; viii) at least one driver behaviour detection module which is configured to detect at least one driver behaviour factor in real time, ix) at least one module that is configured to receive and or analyse biological data or information of the driver; x) an imagery capturing system, or video recording system module that may have an optical character recognition analysis software system; xi) an integrated module, or separate modules that use wireless or universal serial bus connectivity technology to connect with the main monitoring arrangement and that record initial, intermittent or on-going psychometric, mental, physiological or biological factors of the identified driver; xii) may include a mental agility, responsiveness testing module that evaluates by means of computer algorithms the identified drivers mental and physiological condition using the touchscreen of the mobile device, and may also use the camera or scanning components to evaluate the physiological including mental capacity of the identified driver, 19 xiii) by means of computer programmes used on a smartphone test physiological, psychometric and mental capacity or state, responses, condition to capture and record data that would be used to evaluate the driver's physiological, psychometric or mental state or condition, and may relate the input data to the stored historical and current data of the identified driver; and xiv) the wireless communication smartphone or module is configured to send information on the detected location with the detected driver behaviour or physiological, biological or mental factors wirelessly to a remote computer hardware and software location. [0050] The wireless communication module may be configured to send or transmit the data or information on the detected location and the detected identifiable driver behaviour, driving or recorded driving imagery or environmental or visual traffic imagery data wirelessly by a wireless transmission system to the remote location in real-time and may also store the data or information in a storage retrieval data system on the module or a specified storage unit. [0051] The identification information or data may be biometric, physiological or biological identification information or data, or may include imagery and tangible information, or data embedded in a physical object, such as a driver's licence bar code or driver's signature or other embedded security or identification data on a driver's licence. BRIEF DESCRIPTION OF THE DRAWINGS [0052] The invention will now be described, by way of example, with reference to the accompanying diagrammatic drawings. In the drawings: Figure 1 shows a simplified schematic layout of a driver monitoring system in accordance with the invention; 20 Figure 2 shows a simplified flow diagram of the operation of the system of Figure 1; and Figure 3 shows a schematic layout of the driver monitoring arrangement of figure 1. DESCRIPTION OF PREFERRED EMBODIMENTS [0053] This invention relates to a driver identification and monitoring system using smartphone, GPS navigation, video recording or similar technology (monitoring arrangement) 10 which includes a mobile GSM or similar transmission device 12 which is positioned, installed or used in one or more vehicles 100 of an identified driver that needs to be monitored. [0054] These arrangements 12 are configured to further obtain biometric, physiological identification information of a driver, driver and driving data and send it to a remote analysis station 14 via a wireless communication network (GSM) 108. [0055] In the drawings, reference numeral 10 refers generally to a driver monitoring system in accordance with the invention. The system 10 includes at least one mobile driver monitoring arrangement 12; a remote centralised computer system which is hereinafter referred to as the analysis station 14; and a backup server 23 and 15 for providing backup storage. The backup server 15 is typically cloud-based. [0056] The analysis station 14 systems and software analyses the received identification data or information of the driver/s by matching the received biometric, physiological or biological identification and other information with biometric identification, physiological or biological information of the driver/s which is stored on a centralised database. If a match is found, then an authorisation message is sent back to the particular arrangement which then 21 allows the user to use the arrangement for the driving of a vehicle and recordal and monitoring of driver activities and behaviour. [0057] Although GSM technology is used in the system for the transmission of digital data, it will be appreciated that other digital wireless communication networks may also be used, such as TDMA digital cellular communication (Time Division Multiple Access) or CDMA (Code Division Multiple Access) or other such digital wireless, satellite or radio transmission technology. Analogue communications may also be used in certain instances. [0058] GPS (global positioning satellite) technology is well known and can be used in navigational as well as non-navigation applications by using both satellites and ground monitor stations. This technology is widely used in vehicle tracking, telematics and similar systems in vehicle management. In the present invention GPS technology is used for determining vehicle location, routes, speed, movement, as well as relative environmental road traffic, mapping and other data pertaining to the real-time position of a vehicle but using video imagery and biometric identification systems. [0059] The analysis station 14 checks the authenticity and competency of the received driver data by matching the received identification information with historical identification information of registered users which is stored on a database 60, 67, 23 of the analysis station 14. [0060] If a match is found by the system software and the driver identified as the registered driver and to be competent (discussed below as regards alcohol and drugs) within defined rules, then an authorisation message/code is sent back to the particular arrangement 12 which then allows the user to activate and use the monitoring arrangement 12. [0061] The monitoring arrangement 12 is also configured to detect various driver behaviour or driving related information, such as the vehicle speed, the 22 geographic location, the following distance behind other traffic, compliance with road traffic regulatory signs, capacity of the driver, time and duration of a specific journey and the physiological condition and competency of the identified driver at the time. [0062] Driving and driver behaviour data is then sent back to the analysis station 14 in real-time, which data and information is then used in order to compare and analyse it by means of software systems 65 with certain driving-related rules, standards or criteria which is stored on a database 60, 40, 67, 23, and by means of algorithms to determine compliancy with the rules, standards or set criteria, and with application programming interfacing to manage and monitor the driving of the identified driver. [0063] An important function of the arrangement 12 is the use of voice analysis and biometric systems as well as video imagery to identify and monitor a specific identified driver that is required to be monitored for legal compliancy reasons, safety risks, or driver management, such as learner drivers, provisional driver licenses, professional drivers and for persons who are a risk for reasons such as having recorded driver violations (high demerit points) or the authority deems the driver to be a potential risk (previous convictions for dangerous or drunken driving). [0064] the distinguishing aspect from other systems is the use of voice and biometrical information to identify the driver and then relate that to recoded event imagery of driver behaviour or specified driving events as well as the use of integrated technology to process digital imagery using optical character recognition systems and software to identify regulatory road traffic signs and using mapping data, GPS and video to monitor compliance as related to the specific identified driver. [0065] Further important functions of the system 10 are specific industry safety and risk management functions, primarily focusing on physiological and behavioural 23 data, that allows an entity to manage a driver who, for example, is subject to driver fatigue or intoxicated, by monitoring both the duration of driving as well as physiological factors adverse to driver fatigue by means of psychometric testing and eyelid movements. [0066] Where legal rules are set for maximum driving hours, the system may monitor the time and journey duration as well as specific driving times. [0067] The driver or driving information is also saved on a database 60, 23, should it ever be required for analysis at a later stage (e.g. for auditing or certification purposes). The data is also saved (60, 23) as a historical record for the driver for compliancy, competency and training as well as certification procedures that require to be evidenced. [0068] More specifically, the system 10 includes a database 60 on which a plurality of identified driver profiles that are stored 60, 23 and are continuously updated with new driver behaviour information from identified drivers providing an auditable and evidenced record of driver behaviour and events. [0069] Should the arrangement indicate a violation or non-compliance of the driving related rules or standards be detected 12, then that specified "event" is recorded and stored, 65 and 21. [0070] The violation, non-compliance "event" data and imagery is also recorded and logged by saving it on a database 60, 23 with related imprinted or embedded data on the imagery, giving the date, time (in units and fractions), geographical coordinates, and the driver's details or identity that functions as an audit trail and is imprinted or embedded on each real time frame, typically 25 frames per second or more. [0071] In a specific embodiment, at least some or all of the required functions of the monitoring arrangement 12 may be implemented by way of a mobile application 24 which can be downloaded onto a mobile communication device (e.g. a smartphone or navigation system with mobile transmission capability) or by means of Application Programming Interface (API) software, integrate or facilitate the functioning of any of the arrangement applications, module and any smartphone applications, software or hardware with those of the monitoring arrangement 12 and system 10. [0072] In this case, the mobile communication device (such as a smartphone / navigation system) may then be used as a component or central system or module of the arrangement 12, or any of the software applications of the mobile device integrated to the system 10 by means of Application Programming Interface (API), or the functional hardware of the smartphone used, such as the speaker or microphone, VCR, camera or scanning device or any of the smartphone applications integrated with the monitoring arrangement or of a navigation system 12 or software applications, by using the smartphone or mobile computer processing and wireless telephony technology. [0073] The system 10 is configured to monitor driver behaviour, biometric, physiological or mental data, of only a single driver of a vehicle 100 or a number of drivers of a group, class or a whole fleet of vehicles. The system 10 can therefore include a driver monitoring arrangement 12 for each driver of a vehicle 100 that needs to be monitored. The arrangement 12 is typically mounted, positioned or may be installed or attached inside the vehicle 100. [0074] The arrangement 12 may include a number of integrated or separate modules which are configured to implement various functions of the arrangement 12. More specifically, the arrangement 12 includes an identification module 16, a wireless communication module 18, location detection module 20 such as a GPS or navigation system, and at least one driver behaviour detection module 22 (see Figure 3) which may include a video camera and recording module. [0075] The wireless communication module 18 is configured to communicate with the analysis station 14 via a wireless communication network 108, such as a mobile 25 communication network (e.g. GSM) (generally indicated by reference numeral 108), satellite communication or GPS. [0076] Typically, when driver information, behaviour or driving information is sent to the analysis station 14, it is sent together with a unique identification number/code (e.g. a serial, system generated unique personal identity number or sequence number) which is associated with that particular identified driver arrangement 12. In other words, each identified driver arrangement 12 has a personal unique identification number which is sent together with the driver behaviour, driving information in order for the analysis station 14 to identify the particular driver arrangement 12. [0077] The identification module 16, in this case the smartphone or similar device, includes at least one, preferably two, biometric voice recorder/readers/scanners 61, 63 (e.g. a microphone, camera, laser or fingerprint and/or iris scanner) which can be used by a driver (and/or an authorised co-driver or supervisor (which will be described later on in the specification) in order to capture biometric or physiological identification information to thereby identify the particular driver. [0078] The captured biometric identification information of the driver is typically sent to the analysis station 14 by making use of the wireless communication module 18, for verification purposes which will be described later on below. [0079] The location detection module 20, which may also be the wireless communication module 18 (such as a smartphone), includes a GPS unit which is configured to detect the geographical location of the arrangement 12 (and therefore also the vehicle 100 in which it is positioned/ installed/ mounted). [0080] The smartphone or similar device 12 may be operatively connected to an existing GPS navigation unit 18, 20 in a vehicle 100 or a wireless communication module 18 being the smartphone or similar device. Most 26 smartphones having GPS functionality, mapping or similar software. In this case, the module 18 can obtain geographic location and thus time and distance travelled, or speed information (time and distance travelled) of the vehicle 100, from the GPS unit 20 that may be an application of the smartphone or mobile device or application 12. [0081] The driver behaviour, driving detection module 22, is typically configured to detect one or more driver behaviour, driver or driving factors in real-time by video of the smartphone or similar camera / video device and send the information to the analysis station 14 by making use of the wireless communication module 18. [0082] The driver behaviour, driving detection module 22, may also include a distance measuring arrangement 26 that may be a software application of the smartphone or similar device, having a video and or a navigation device or software, and which is configured to measure or estimate the distance between the vehicle 100 and a particular object relative to speed and stopping distance algorithms, such as another vehicle. [0083] More specifically, the distance measuring arrangement 26 can be configured to measure the distance between the vehicle 100 and another vehicle directly in front of it to thereby determine the following distance of the vehicle 100 (for safe stopping distance). The arrangement 26 can typically use laser or infra-red light, imagery or similar transmissions for measuring/detecting the distance, and also use digital graphic imagery and software graphic analysis algorithms for distance estimation or determination on imagery display modules. [0084] Furthermore, the driver behaviour, driving detection module 22 also includes a video camera 29 (e.g. a digital video camera (DVC) or digital video recorder (DVR) or similar image capturing device) for capturing digital video imagery outside the vehicle 100, or the arrangement may receive the video recording 27 from another device such as a smartphone or separate recorder and either in digital or may be in analogue format. [0085] The camera (DVC) 29 should be arranged to capture video imagery in the driver's line of sight (i.e. generally in front of the vehicle 100) and which includes an important feature of the arrangement OCR (Optical Character Recognition) software that detects regulatory road traffic signs (including traffic lights) and regulatory road markings from the images captured/recorded by the camera 29. [0086] The module 22 may also include a video camera 31 for capturing video of the actual driver while driving the vehicle 100. The images captured by the video camera 31 can then be used for biometric purposes (e.g. facial recognition) or for detecting driver fatigue (e.g. when a driver's eye movements indicate fatigue or sleep). [0087] Video imaging recorded by the camera(s) 29, 31 may either be transmitted in real-time to the analysis station 14, or specific time periods or "events" may be recorded based on an instruction received from the module 22, the system 10 or from the analysis station 14. [0088] The system 10 may also require the external driving environment and traffic conditions to be recorded by using the camera 29 for certain time or event periods and real-time transmission. [0089] The arrangement 12 may also include an alcohol testing breathalyser module or apparatus 35 which is configured to detect any alcohol, or in another embodiment the percentage concentration of alcohol in an identified driver's breath at a given point in time and display the result to the driver on a display screen 37 of the arrangement 12.
28 [0090] The arrangement 12 requires the breath generated by the person speaking into the arrangement 12 or module/ apparatus 35 for the alcohol measurement process, and the simultaneous analysis of speech, voice and may use air volume / intensity relative to the speech, to identify the source of the breath being analysed, thus identifying the person speaking and the breath being analysed and measured being from the same person as the identified driver. [0091] The alcohol measurement processor may be that of a smartphone, mobile computer, or smartphone or computer and combination of modules or functional devices such as videos and GPS or navigation systems. [0092] The alcohol measurement smartphone or module may have a camera or video recorder, and in a further aspect of the breath measurement process the biometrical physical facial features of the person giving the breath sample may also be used to identify the person as further biometrical identification. [0093] In one embodiment, the breathalyser apparatus 35 may also be configured to detect other chemicals or substances which might affect the driving behaviour of a driver. [0094] The alcohol detection process typically utilises vapour or moisture in the breath of a user while identifying the user's (e.g. driver) voice (described further below). The importance of this aspect is that while the person speaks, it takes a breath measurement and simultaneously analyses the voice or biometrics and also the breath of the speaker, thus not allowing someone else to blow air into the breathalyser apparatus 35. [0095] The arrangement 12 may more specifically be configured to require a driver to face a camera (e.g. the camera can be within a few inches of the person's face) of the arrangement 12 while speaking and breathing into the apparatus 35.
29 [0096] In another aspect the arrangement may use the camera or video recorder to measure the identified driver's responses to a digital display on a touch screen 37 of the module (smartphone) 12 by requiring the driver to respond to images on the touch screen by placing their finger on randomly displayed objects on the screen, and through an algorithm measure the person's time taken to respond to the prompted image and also the accuracy of placing their finger on the randomly displayed objects or questions. [0097] The computed result analysed by the algorithm is related to generally tolerant or normal response times, and also the personal data recorded of the driver as recorded by the analysing station 14 under previous controlled circumstances and stored under that driver's profile. [0098] If there is a marked deviation, inaccuracy, delay or inability to perform the testing, the arrangement 12 and module will record the result and may transmit the outcome to the analysing station 14 and an audible and written message will be given to advise the identified driver not to drive the vehicle. [0099] Once the driver is detected as being not fit, or apparently not in a state, to drive a vehicle and being warned by the arrangement notification function 12, the system 10 will monitor the movement or position of the arrangement and also of a registered smartphone or mobile phone of the driver through GPS and GSM data received by the analysing station 14. The system may further be configured to transmit a courtesy alert to a designated person of the identified driver by GSM text message and indicate the driver's geographic position and relative mapping data for personal assistance. [0100] The arrangement 12 is typically configured, by way of software, to detect physiological and/or mental factors that indicate that the driver is under the influence of alcohol, a substance, or drugs that have a narcotic effect as described below.
30 [0101] This configuration on a mobile arrangement (such as a smartphone) may be typically implemented through appropriate software installed on the arrangement 12 which allows a driver to use the arrangement 12 in order to measure for example the driver's physical balance against a stored sequence of similar data of that person previously recorded and stored in a controlled environment (e.g. by using for example the so-called Romberg medical test system for balance) and also the testing of physical and mental reaction or coordination responses and a programmed test on the screen of a hand held mobile phone device (if the arrangement 12 is implemented on a mobile phone). [0102] The driver is for example required to press his/her finger on objects (created by appropriate software) appearing in random places on a display screen 37 (which may be a mobile phone) within very short periods to which the identified person must respond. The software typically identifies the driver's finger or print when pressed onto the screen and position and receives that response as data input. [0103] In another embodiment the driver may be given questions related to driving situations and required to touch one of 3 or more multiple answers and within a given period. The software typically identifies the driver's finger or print when pressed onto the screen. [0104] The accuracy of carrying out these tasks on a touch screen relative to historical previous testing recorded data done under controlled environments is correlated and a result computed that determines the identified driver's assumed or computed mental alertness or agility. [0105] In respect of the typical so-called "Romberg medical test" the driver may for example be required to hold a mobile smartphone and walk in a straight line over a defined distance and is monitored using the smartphone GPS and/or an internally installed software algorithm on the phone that monitors vertical and horizontal positioning of the phone.
31 [0106] The person's ability to perform these stability or balance tasks is correlated with similar tests done under controlled environments that are stored on historical data for that specific person. [0107] Inability to perform such software programed standard tasks, based on historical data of the person (previously recorded and stored under a controlled environment), is analysed and potential incapacity of the driver is signalled to the analysis station 14 and the driver required to call the analysis station/ for verification of their condition and reasons for deviation. [0108] If the identified driver fails to follow the arrangement's 12 procedure and instructions after being detected as potentially incapacitated for driving a vehicle, the arrangement 12 will indicate a potential violation and will not operate. The system may further be configured to transmit a courtesy alert to a designated person of the identified driver by GSM text message and indicate the driver's geographic position and relative mapping data for personal assistance. [0109] All data held by the analysis station 14 is typically managed by a management control centre 17 with online computer operating staff 19 who can only access the secured system 10 by means of secured access passwords and auditing systems that ensure that all processes carried out by the operating staff 19 are read-only functions and related to the monitoring of information received from the arrangement 12. They are therefore not capable of amending or altering any data 60, 67, 40, 23 that has been received from the arrangement 12 and the security and privacy of data is maintained. [0110] Software of the analysis station 14 is configured to allow only notations and extractions of data/information for analysis by the authorised operators 19 of a monitoring authority or entity of the management centre 17. All data/information obtained and derived at the analysis station 14 is also sent to an off-site backup 32 computer system service 23 or as well as to a so-called data cloud backup storage server 15. [0111] The data held by the backup server 15, or the data storage system or memory card of the module 22 is typically used only for situations where communication between the arrangement 12 and the analysis station is lost for some reason, so that when communication is re-established, the data stored on the backup server 15 or module memory card or data storage system 12, 41 can be sent to the analysis station 14 which then saves it and also sends it to the backup computer system service 19 and backup storage or cloud server 15. [0112] The arrangement 12 includes a storage means, such as a memory card or computer chip 41, for storing specified or event real time data captured/recorded by the arrangement 12. The real time data sent to the station 14 is therefore also simultaneously saved on the memory card 41. [0113] The real time data held by the memory card 41 is typically used only for situations where communication between the arrangement 12 and the analysis station is lost for some reason, so that when communication is re-established, the real time data stored on the memory card 41 can be sent to the analysis station 14, which then saves it and also sends it to the backup computer system service 19 and backup storage server 23. [0114] Where the time period between the last transmitted data or information to the station 14 and resumption of transmission to the station 14 does not correspond with transmission records of the relevant GSM service or outside the allowable time, the arrangement 12 may flag all such data and information as an error transmission and this data can accordingly be audited. [0115] The system 10 or cloud back-up 15 does not accept data after a predetermined specified allowable time lapse where transmission by the arrangement 12 of 33 real-time data to the station 14 ceases and the resumption of transmission thereof. [0116] As the analysis station 14 identifies the geographic position of the transmission of the arrangement 12, any real time data received from a position located by the GPS and arrangement 12 as being from another source/position is flagged as corrupt/rejected data for auditing. [0117] The arrangement 14 identifies continuous receipt of positional data from the specific position monitored by the GPS positioning of the vehicle in which the arrangement 12 is placed. With both GSM and GPS being position and time based, the input of real-time data is logged accordingly and any deviation from a source that does not correspond with these two factors is rejected by the system and flagged as corrupt/potential hacking/data tampering. [0118] Reference is now specifically made to Figure 2. [0119] The driver monitoring arrangement 12 such as a smartphone or navigation system and video data capturing module or device may be operatively connected/connectable to the particular vehicle 100 but the arrangement is preferably portable. [0120] More specifically, the arrangement 12 typically positioned in the front of the vehicle 100 in a position where it is relatively close to the driver in order to receive voice instructions or data and capture biometric identification information from the driver, and to capture the relevant data in front of the vehicle 100, such as visual imagery, data on the following distance etc. (as described above). [0121] During an initial registration phase in controlled environments of the monitoring authority/entity or analysis station 14 (at block 196), biometrical, physiological, biological or other identification information of a driver is captured and stored 34 on a database 40 of the analysis station 14 under supervised management of a data input operator of the system 10. [0122] This initial profile data input is also loaded onto the arrangement 12 that is to be used in a vehicle 100 by the specific identified driver, and the initial data and further data received from the arrangement 12 is secured by both the input operator and the driver by a personal identification control password and also using specific biometrical data of the identifiable driver to protect security of the input data (at block 198) and personal information of the driver. [0123] The initial input biometrical identification information can accordingly only be changed, altered, amended or varied by the simultaneous access and input of the required passwords and biometrical identification information by the driver, and carried out with a data input operator of the system 10. The specific file (referred to hereinafter as the "driver profile") of each driver also has a unique identification file number which is used to identify the particular user and the arrangement. [0124] When a driver wants to use the arrangement 12 for driving a vehicle 100, she/he firstly needs to use her/his voice for voice identification purposes (at block 199) by speaking into a microphone of the arrangement 12. [0125] After a particular driver has been identified, the breathalyser apparatus 35 is used (at block 200) so that the arrangement 12 can determine if the driver has consumed any alcohol and is competent to drive by carrying out some of the coordination tests such as utilisation of the screen test reaction and ability to carry out those tasks relative to stored historical data. [0126] If no alcohol is detected by the apparatus 35 and the person successfully carries out the initial tests for coordination and reaction successfully on the arrangement 12 or module such as a smartphone, the arrangement will prompt the identified driver to use the biometric scanners 61, 63 so that the 35 arrangement 12 can capture further biometric/biological information (e.g. by capturing two biometric traits, such as a person's voice, facial features, fingerprint and/or iris) (at block 204). [0127] If, however, any alcohol is detected, then the arrangement 12 will carry out further physiological mental, psychological and/or neurological tests and if positive indications of potential intoxication is detected it will switch off, thereby preventing the driver from using the arrangement 12. [0128] The identified driver is then deemed to be not competent to drive a vehicle. Other physiological and psychometric testing may include testing the driver's reaction to screen touch pad tests, such as using fingerprint identification as initial identification and thereafter allowing touching of the screen within set times at computerised objects such as a moving dot on the apparatus' display screen 37. [0129] Various other biological, physical, psychometric, mental and other tests may also be carried out by the arrangement 12 to determine the potential state of intoxication or effects of narcotic drugs such as the use of a mobile phone application which when held in the hand of the identified driver would indicate horizontal irregular movement or inability to stand in a stable position. [0130] If the breath alcohol content is above the legal limit or the arrangement 12 determines apparent incapacity of the driver then the arrangement 12 will switch off and not allow use of the system 10 giving an audible message and notice to the driver, and preventing the driver from using the arrangement 12. [0131] The captured biometric identification and physiological or biological information is then sent via the wireless communication network 108 to the analysis station 14 (at block 206) together with the unique identification number/code of the arrangement 12 and simultaneously transmit a courtesy message to a person 36 nominated by the driver with the driver's location and request for personal assistance. [0132] The analysis station 14 software system analyses the biometric, physiological, psychometric or biological data and checks and verifies the data or information against that stored on the database 40 for the identified driver and on which related data or information of all drivers which are registered with the system 10 are stored, and in order to identify whether the received biometric identification information matches that recorded on the system (if information on two biometric traits are received, then both should match that of a particular stored driver before a positive match is initiated). [0133] In another aspect the driver file unique number or that of the module 22 may be used to access a specific file on which the biometrical data or information of that driver is stored and the result of the biometric analysis checked by the software of the analysis station 14 on that driver's file against the stored initial biometric, physiological or biological data. [0134] If an identification match is not found (at block 208), then an error message is sent back to the arrangement 12 (at block 209) and the arrangement 12 will again ask for biometric identification information and the access process repeated. [0135] If a match is found by the system 14 after a second attempt (at block 208) then an authorisation message is sent back to the arrangement 12 (at block 210) and the identification number for the particular arrangement 12 is activated to operate and the data receipt of the arrangement 12 linked to the particular driver such that when driver behaviour information is received from the arrangement 12, it will be linked to the particular identified driver.
37 [0136] Upon receiving the authorisation message, the arrangement 12 activates the arrangement to allow the identified driver to use the arrangement and thus operate a vehicle 100 (at block 212). [0137] The driver will not be able to use the arrangement 12 to record, log, capture or transmit any driving information until the arrangement can be activated by the set procedure and protocols for driver identification and capacity to drive. [0138] The arrangement may monitor various GPS or GSM signals received from the module 12 to monitor any movement of the module 12 that is linked to apparent traffic movement and activate a notification that is sent to the analysis station 14. [0139] In another aspect if the driver required to use the arrangement 12, does not use the arrangement or the arrangement is not activated during designated or specified driving times or periods (such as an employed or professional driver during operational times, or a graduate driver within certain periods or anticipated periods) then a notification will be sent to the analysis station for monitoring or investigation and a message sent to the driver's designated mobile phone. [0140] After the arrangement 12 has been activated, the arrangement 12 typically prompts the driver to use one (or both) of the biometric readers 61, 63 or a smartphone or arrangement 12 microphone, at certain intervals while the driver is driving the vehicle 100 but preferably stationary. For example, every time the vehicle is stationary, the driver may be prompted to use a biometric reader 61, 63 predominantly a voice recorder analysis system, so that confirmatory biometric identification information of the driver can be retrieved and sent to the analysis station 14. [0141] The identification process is an "event" process and is recorded and the data or voice recording is stored every time this procedure is carried out for audit 38 and verification management. Typically this procedure would be carried out at a minimum at the commencement and end of a monitored journey. [0142] During operation of the vehicle 100, the driver behaviour detection module 22 detects various driver behaviour, driving related factors (at block 214) and sends information thereon (i.e. driver behaviour, driver, driving information) in real-time to the analysis station 14 for further processing, together with the current time, date and coordinates overlaid or embedded in video recorded "events" that are transmitted according to an algorithm that identifies events that are not compliant or deviate from the set protocols or instructions of the driving rules requiring evidencing on that identified drivers file. [0143] In addition, the location detection module 20 sends the GPS location and recorded imagery of the vehicle 100 in real-time to the analysis station 14. [0144] "events" as used in this invention refers to designated sections of recorded data or imagery that is transmitted to and stored by the arrangement (smartphone) 12 to the analysis station 14, as being driver or driving data or information, such as that required for verification of identification, driving or driver violations, specified times of travel, deviations from set rules or standards, incapacity, criteria required for competence verification or evidencing of specified driving requirements. [0145] All the defined event driving or driver behaviour related information received from the arrangement 12 is saved (at block 216) to the driver profile of the identified driver on the database 40. In other words, the driver profile of the identified driver is continuously updated with new driver behaviour, competency and driving information. [0146] From the above, it should be clear that the terms "driver behaviour related factors" and "driver behaviour information" not only relate to the actual behaviour of a driver but also to certain environmental and/or other surrounding 39 traffic and road conditions/factors which would be taken into account when the software systems monitor, analyse and assess the driver behaviour, compliancy or competence. [0147] The analysis station 14 includes a database 60 on which predetermined driving related rules are stored. These rules typically include traffic rules such as speeding limits in respect of signs, general limits or specific driver limits, stop signs, yield signs, one way traffic, traffic light signals, no entry zones, restricted left or right turns or U turns, school speed and time zone areas, overtaking rules and rights of way. [0148] The arrangement 12 for uses the regulatory signs in the data base and defined event recorded imagery information by means of Optical Character Recognition (OCR) video camera recording of regulatory road traffic signs, or GPS and mapping data speed limit information, or imagery of related traffic conditions. [0149] The processor of the arrangement 12 and or the analysis station 14 may utilise the GPS information to determine the current position of the vehicle 100 and mapping data to locate the vehicle 100 on a particular stretch of road that will typically have an associated list of traffic rules (stored on the database 60), and the information received by the arrangement 12 will then be used to analyse the driver behaviour against the specific traffic rules in order to detect whether or not a violation has taken place (at block 218). [0150] The arrangement 12 may also be configured to warn a driver of the actual current local speed limit using the OCR imagery of regulatory signs and also mapping data as against the actual speed of the vehicle using the GPS or other speed calculation process. The benefit of the OCR image recording of regulatory signs, apart from limiting mapping data error, will record temporary regulatory signs (mostly these are indicative of a temporary risk or danger) that would not appear on navigation or digital mapping data.
40 [0151] If a violation or deviation from set driving standards has taken place (at block 220), then details thereof (e.g. the driver behaviour information relevant to the violation or event) is transmitted to the analysis station 14 and saved to a driver violation profile (at block 222) of the identified driver, and also saved on a database 67. [0152] The driver violation profile data is also recorded separately from the normal driver profile data which is continuously updated, since it only includes the detected violations which required to be evidenced by the recorded GPS transmitted data and imagery. [0153] For safety reasons, drivers are required to keep a safe following distance from the vehicle directly in front of them during driving (the so-called "three second" rule is well known). As mentioned above, the distance measuring arrangement 26 is used to detect this following distance, warn the driver of unsafe following and send the event data to the analysis station 14. [0154] The driving related rules can also relate to the driving related information detected by the arrangement 12, such as: i) vehicle positioning and movements (e.g. the positioning of the vehicle on the road) using a combination of GPS and video imagery); ii) if the vehicle stops, using GPS and video imagery and Optical Character Recognition of regulatory signs on the data base, as well as mapping data of regulatory signs; iii) tracing and lane movement using GPS and video imagery; iv) dangerous, reckless or unsafe driving using GPS, video imagery and infra-red or laser light measurements v) driving at unsafe speeds in critical risk areas such as past schools or areas marked as high risk by related digital mapping data and confirmed by video imagery and GPS data (speed and location) under a recorded transmitted event.
41 [0155] A certain amount of night driving may be required for compliancy of graduate drivers for provisional and learner drivers. Information on night driving is recorded using both the GPS and GSM time and position data of the arrangement 12. Since the data is time logged, the arrangement 12 and analysis station 14 is able to determine, by using the processor 65, whether the data was captured at night or day light. [0156] In a particular embodiment, the arrangement 12 may include a laser, or may be configured, by way of software, to use optical character recognition (OCR) on video captured by the outside camera 29, or a combination of both to identify regulatory road traffic signals and road markings against a known database of regulatory signs and markings. [0157] The regulatory signs in the database that are recognised by the OCR may include stop streets, speed limits, traffic lights, barrier lines, stop lines, yield signs or other regulatory signs or markings under the relevant road traffic laws that are within the driving field of the driver, and to identify by means of programed protocols actions required of the driver the arrangement 12. [0158]The arrangement 12 and system 10 will use GPS and imagery within set algorithms to identify any deviation or non-compliance from the set protocols, standards or driving requirements required of the identified driver as an event, and also to send this information to the analysis station 14. [0159] The analysis station 14 is accordingly configured, by way of software, to check the received information against information that is held in respect of the OCR images and also confirm regulatory data on specific road mapping data stored on a database and the imagery transmitted by the arrangement 12. [0160] The system maps may include maps of existing mapping information/data (e.g. the mapping information provided by Google, Apple or other mapping data 42 which is either in electronic format or stored on a database of the arrangement 12 or analysis station 14). [0161] The arrangement software 12 and processor 65 is then accordingly configured, by way of software, to log a violation in the event data if it detects that any of the identified road traffic signals have been violated in the same manner as described above. [0162] A report can be drawn at a later stage, either on demand of a duly authorised person of the system 10 or at specified interval(s) as set by a controlling body of the system 10. The accuracy and authentication of the violation or non compliance information can then be verified by auditing/analysing visual and real time data recorded and stored by the system 10 against known traffic regulatory signs or markings. [0163] Auditing can be implemented by the system to help ensure that there is a continuous stream of data from the specific source without any interference or manipulation using the positioning and time elements of both the GPS and GSM processes of the arrangement logged with the event data and imagery. [0164] The data and imagery sent to the station 14 by the arrangement 12 can also be checked against the data or imagery stored on the memory card 41 of the arrangement 12, by using an audit software programme (e.g. in order to identify possible external interference). Auditing can be done on a need-to-check basis or where there is a flagged event or data breach. [0165] All data transmitted by the arrangement 12 should preferably be encrypted by the arrangement 12 before sending it to the station 14, and there is further an ongoing backup of data onto the backup server 21 and the backup computer system database 23 that keeps files separate from the data stored on the databases 40, 60, 67 of the station 14 and the memory card 41, until deleted. There is no internet or intranet access to the backup computer system service 43 21 or storage 23, which requires at least two administrators in order to unlock any data file. [0166] It should be noted that the system 10 may be configured to allow some identified drivers to drive a particular vehicle 100 only when a duly authorised supervisory driver is also present in the vehicle 100 (e.g. when the driver only has a learner's licence). These details may be also saved on the database 40 as part of the driver profile of the particular driver. [0167] Alternatively the supervisory driver may be identified by the arrangement image and scanning systems by recording their driver's licence on the scanner and a photo transmitted that is filed with the scanned licence. The driver's licence data may be verified against the state, territory or authority drivers' licence database. In this case, the system 10 may also require the same biometric identification from the supervisory driver before the driver is authorised to drive the vehicle 100. [0168] The arrangement 12 may also include an optical reading device or may be configured to use one of its cameras 29, 31 to scan/record the unique bar code of a driver's licence and the licence photograph of the driver to be identified by the system 10. [0169] The optical reading device/camera 29, 31 may also be used to record/capture the fingerprint or signature data on a driver's licence of the identified or identifiable person driving the vehicle 100, as well as the supervisory driver (if required). The capturing of the licence details serves as an additional identification step to the biometrical identification in the auditing or verification process. [0170] Since almost all smartphones have GPS modules, these modules can be used for tracking purposes, speed detection, VCR imagery recording and GSM functions.
44 [0171]A specialised housing can be used to mount the smartphone / mobile phone inside a vehicle 100 so that a camera or video or other lenses thereof face forward in the vehicle's direction of travel (thereby operating as the camera 29 or laser 26) and to allow a microphone of the mobile phone to be used by the driver for the functions where voice input is required such as biometric voice identification and verification. [0172] The speaker and display screen of the phone may function as the display screen 37 to display any instructions or notifications given by the mobile application as be used for the testing of a driver's eye reaction or responses and mental alertness. [0173] The smartphone touch screen may function as the screen 37 for psychometric, mental and alertness tests designed to detect reaction or response times, accuracy of finger to screen tests, agility or responses to mental tests relative to driving capacity and mental competence to supplement alcohol screening and also assist drug detection. [0174] The camera of most smart phones/tablets have a scanning and digital video recording device and that also transmits a laser light. These are some of the applications and hardware required to do measurements, and can be programmed with an API to integrate with the software of the system 10. [0175] Likewise, the microphone and a light / scanner or processor of the smartphone could be able to carry out most if not all of the functions used to check alcohol use or intoxication in the moisture or breath of the user either as a unit on its own or with an attached device to integrate with the biometric and facial recognition criteria of the system 10.
45 [0176] It should be noted that spectrophotometer technology can be used to measure alcohol levels in a driver's breath that may also be combined in either the arrangement 12 or mobile smartphone. [0177] When the driver profile of a driver is updated with new driving behaviour information on the system 10, the actual time when the information is recorded in the data 65 can be used to identify whether the driver is driving during certain high risk periods (such as public holidays, Friday and Saturdays) or peak hour traffic. The date and time is also logged with the geographic co-ordinates of the arrangement 12 when the transmitted data is transmitted to the analysis station 14 thus making the source and place of input data verifiable also against event imagery and the identification data logged on the system 10 by the identifiable driver. [0178] The system 10 may also specifically be used for parental monitoring or control of a young driver's behaviour (e.g. a minor), whereby the arrangement 12 (e.g. a mobile smartphone in this case) is configured, by way of software, to transmit a message and real-time driver behaviour data to the parent's mobile phone, tablet or personal computer. [0179] In this case, the parent's computing unit (e.g. a personal computer/ tablet and mobile smartphone) may act as the analysis station 14 in respect of critical specified data. [0180] The arrangement 12 or smartphone can be configured to notify the monitoring parent (i.e. by transmitting a message to the parent's mobile phone) when a risk, violation, deviation from set standards, criteria or other safety factor is detected. [0181] The system 10 can also in this case be configured to allow a parent to access the arrangement 12 remotely in order to monitor the user driver's actions and locality for supervision of driving.
46 [0182] The Inventors believe that one of the key features of the invention is that it identifies a specific driver (not just a vehicle and its movement) and uses digital imagery and GPS systems in an auditable manner that is secure and evidenced. This therefore makes the system 10 useful in respect of: i) graduate or learner drivers; ii) employed professional drivers; iii) drivers who have serious traffic violations, such as Driving under the influence of alcohol or drugs (prohibited substances) / reckless or aggressive driving offences; i) drivers with high penalty demerit points who may want to drive under management such as "good behaviour bonds" under demerit driving systems; ii) fleet management; iii) high risk vehicle management (such as dangerous and high value cargo); iv) parent and child driving supervision, control or management; and v) insurance risk purposes. [0183] Since the information received from the arrangement(s) 12 and the details on the analysis of the driving behaviour are saved in real-time (i.e. directly into data storage) and with imagery that has an audit trail and cannot be altered, the system 10 provides a secure and reliable audit trail with a visual image of events that has time in unit fractions, date and exact geographic positioning embedded in the data and imagery [0184] The embedded audit trail and markings help to prevent and exclude the information from being manipulated and provide evidenced data that would be legally acceptable and admissible if required under most legal systems.
47 [0185] The system 10 provides a secure process in terms of which drivers are identified and verified at the commencement and activation of the arrangement 12 (e.g. by using biometrics) as well as during travelling at specified intervals and at the end of the trip or journey, and which voice analysis and biometric data can be checked and verified from the stored data on the systems data storage 67, 60 and 23. [0186] The arrangement 12 allows for the ongoing monitoring of the use of mobile phones by drivers, with emphasis on text messaging while the vehicle is in motion. More specifically text message transmission and receipt to and from the driver's vehicle, which may distract a driver's attention may be managed by the software to restrict this while the vehicle 100 is in motion. The station 14, by using appropriate software, addresses this in critical risk areas of age / experience (young and learner drivers) and repetitive offenders. The recording of all such data on the system 10 allows for violation monitoring and potential post collision reconstruction and analysis. [0187] As the arrangement 12 is configured to distinguish between voice and text data and determine whether the vehicle is in motion or not, the arrangement 12 software uses GPS data and GSM data knowledge to identify and log as an "event" the transmission of text data from a motor vehicle while in motion. [0188] Manual deactivation of a mobile phone or tablet text messaging facility on the arrangement can only be done from a monitored vehicle if the arrangement 12 allows for a specific phone or tablet that is identified by the arrangement 12 to transmit text data while the vehicle is in motion. [0189] For example, a person can take a vehicle to the monitoring authority in order to verify that a regulatory mobile phone "Car Kit" in terms of the rules/law is installed in the vehicle and can be used for voice transmission or voice activated text "hands free" messaging only. As text and voice can be distinguished, and 48 GPS is used to detect motion, all text transmission from a moving vehicle is logged as an "event" unless this is deactivated by the system 10. [0190] As each mobile phone has a unique identification number and the software on the arrangement 12 in the vehicle can recognise a specific, or a range of numbers, which would be monitored by the system 10 unless deactivated by the system 10. The arrangement 12 uses vehicle motion to activate this function of the arrangement 12 and text data transmissions other than from the arrangement 12 are blocked while the vehicle is in motion. [0191] The Inventors believe that this function of the arrangement 12 will assist in overall management of the high fatality and collision risk of handheld mobile phones used in a motor vehicle for text messaging. Any person wanting to use a mobile phone in a vehicle would only be able to send or receive voice transmissions in a legal manner and not text data on a hand held device while the vehicle is motion. Any system that uses a separate text or data transmission that is safe and would not interfere with normal driving functions would be activated for use by the system 10 administrators and not event logged. [0192] In respect of the text monitoring function of the arrangement 12 and system 10, it is noted that the system 10 is implemented for specific groups or classes of drivers, such as graduate / learner or provisional drivers, with safety, training and legal compliance as a monitoring and management processes and as general risk awareness. Dated this 19th day of December 2015 Applicants: Fisher, Phyllis O'Reilly, Sharon Lorraine Smart, Donald John

Claims (4)

  1. 2. A method of claim 1 involving the receiving, capturing, processing and transmitting data or imagery by mobile wireless networks of the identified driver and driving data, in real-time and compare data to driving and driving-related rules, standards or set criteria for driving and safety for vehicle drivers, by using GPS technology and optical character recognition software that computes driver / driving compliance and competence;
  2. 3. A method as claimed in claims 1 and 2 which includes creating a driver logbook or profile of an identified driver and storing the profile and data on a remote secure database with embedded audit data trail on the driver's historical data and imagery, as transmitted by a mobile communication device to a central database of a remote storage and analysis location via a wireless communication network.
  3. 4. A method as claimed in claims 1 to 3 that may contain an integrated or separate alcohol breathalyser system wherein the system or arrangement can identify the person providing the breath sample by means as in claim 1 by a simultaneous biometrical, voice analysis, or physical identification process. 2
  4. 5. A method as claimed in claims 1 to 4 for testing a driver's capacity or incapacity to drive a motor vehicle using software psychometric, mental agility, and response testing and analysis and methods on a computer touchscreen or module of a smartphone or similar computer device or software to carry out an analysis to determine the potential mental capacity of the driver to drive a vehicle, and transmit this by wireless communication network to a central computer system for analysis against stored historical data of the identified driver. Dated this 19th day of December 2015 Applicants Fisher, Phyllis O'Reilly, Sharon Lorraine Smart, Donald John
AU2015101831A 2015-02-01 2015-12-22 A vehicle driver monitoring method, arrangement, system, software and mobile application Ceased AU2015101831A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
ZAZA2015/0691 2015-02-01
ZA201500691 2015-02-01

Publications (1)

Publication Number Publication Date
AU2015101831A4 true AU2015101831A4 (en) 2016-02-18

Family

ID=55306630

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2015101831A Ceased AU2015101831A4 (en) 2015-02-01 2015-12-22 A vehicle driver monitoring method, arrangement, system, software and mobile application

Country Status (1)

Country Link
AU (1) AU2015101831A4 (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106889990A (en) * 2017-01-10 2017-06-27 闽南师范大学 A kind of driver fatigue state detecting system and method based on Bluetooth transmission
CN107161104A (en) * 2017-05-15 2017-09-15 成都中技智慧企业管理咨询有限公司 A kind of vehicle drive assist system
CN108171038A (en) * 2018-02-07 2018-06-15 广州星唯信息科技有限公司 A kind of authentication of vehicle-mounted driving training intelligence system based on video image identification and process supervision method
WO2019009798A1 (en) * 2017-07-07 2019-01-10 Hök Instrument Ab Distributed system for access control and sobriety testing
CN109523450A (en) * 2018-12-10 2019-03-26 鄂尔多斯市普渡科技有限公司 A kind of bus driving monitoring system
CN110154954A (en) * 2017-05-15 2019-08-23 成都中技智慧企业管理咨询有限公司 A kind of autonomous driving vehicle judges the intelligence system of passenger identity
CN111694875A (en) * 2019-03-14 2020-09-22 百度在线网络技术(北京)有限公司 Method and apparatus for outputting information
CN112132540A (en) * 2020-09-21 2020-12-25 任燕文 Management method and system for information and safety precaution of commercial vehicle driver
CN112837528A (en) * 2019-11-22 2021-05-25 顺丰科技有限公司 Method, device and storage medium for detecting red light running event
CN112927564A (en) * 2021-03-08 2021-06-08 中国电子科技集团公司第二十研究所 Radio altitude abnormity detection and reconstruction method in ground proximity alarm system
US11468534B2 (en) 2019-07-31 2022-10-11 Honda Motor Co., Ltd. System and method for recommending shared transportation
CN116307586A (en) * 2023-03-21 2023-06-23 无锡尚米企业管理发展有限公司 Designated driving management system for distribution based on online order information

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106889990A (en) * 2017-01-10 2017-06-27 闽南师范大学 A kind of driver fatigue state detecting system and method based on Bluetooth transmission
CN110154954A (en) * 2017-05-15 2019-08-23 成都中技智慧企业管理咨询有限公司 A kind of autonomous driving vehicle judges the intelligence system of passenger identity
CN107161104A (en) * 2017-05-15 2017-09-15 成都中技智慧企业管理咨询有限公司 A kind of vehicle drive assist system
CN113401076A (en) * 2017-05-15 2021-09-17 成都中技智慧企业管理咨询有限公司 System and method for testing manual driving permission of automatic driving automobile
CN107161104B (en) * 2017-05-15 2019-02-19 嘉兴智驾科技有限公司 A kind of vehicle drive assist system
US11062544B2 (en) 2017-07-07 2021-07-13 Senseair Ab Distributed system for access control and sobriety testing
WO2019009798A1 (en) * 2017-07-07 2019-01-10 Hök Instrument Ab Distributed system for access control and sobriety testing
CN110869232A (en) * 2017-07-07 2020-03-06 森谢尔公司 Distributed system for access control and wake test
CN110869232B (en) * 2017-07-07 2024-09-10 森谢尔公司 Distributed system for access control and awake testing
CN108171038A (en) * 2018-02-07 2018-06-15 广州星唯信息科技有限公司 A kind of authentication of vehicle-mounted driving training intelligence system based on video image identification and process supervision method
CN109523450A (en) * 2018-12-10 2019-03-26 鄂尔多斯市普渡科技有限公司 A kind of bus driving monitoring system
CN111694875B (en) * 2019-03-14 2023-04-25 百度在线网络技术(北京)有限公司 Method and device for outputting information
CN111694875A (en) * 2019-03-14 2020-09-22 百度在线网络技术(北京)有限公司 Method and apparatus for outputting information
US11468534B2 (en) 2019-07-31 2022-10-11 Honda Motor Co., Ltd. System and method for recommending shared transportation
CN112837528A (en) * 2019-11-22 2021-05-25 顺丰科技有限公司 Method, device and storage medium for detecting red light running event
CN112132540A (en) * 2020-09-21 2020-12-25 任燕文 Management method and system for information and safety precaution of commercial vehicle driver
CN112927564A (en) * 2021-03-08 2021-06-08 中国电子科技集团公司第二十研究所 Radio altitude abnormity detection and reconstruction method in ground proximity alarm system
CN116307586A (en) * 2023-03-21 2023-06-23 无锡尚米企业管理发展有限公司 Designated driving management system for distribution based on online order information
CN116307586B (en) * 2023-03-21 2023-09-29 无锡尚米企业管理发展有限公司 Designated driving management system for distribution based on online order information

Similar Documents

Publication Publication Date Title
AU2015101831A4 (en) A vehicle driver monitoring method, arrangement, system, software and mobile application
US12033446B2 (en) Safety for vehicle users
US12062287B2 (en) Tracking and analysis of drivers within a fleet of vehicles
US11042619B2 (en) Vehicle occupant tracking and trust
US9965819B1 (en) Real-time school bus and student tracking
US20120112879A1 (en) Apparatus and method for improved vehicle safety
US20210390869A1 (en) Unmanned aerial vehicle delivery system for delivery of medical or emergency supplies
US20240249306A1 (en) Biometric sensor system and method for monitoring a driver of a vehicle
US20110304465A1 (en) System and method for driver reaction impairment vehicle exclusion via systematic measurement for assurance of reaction time
US20100157061A1 (en) Device and method for handheld device based vehicle monitoring and driver assistance
US10809248B2 (en) System for certifying a detection of a gaseous substance exhaled by an individual, and method using the system
US20140125502A1 (en) Systems and methods for tracking vehicle occupants
GB2524869A (en) Monitoring system and method
WO2016028228A1 (en) System, method and apparatus for determining driving risk
JP2007094935A (en) Information processing device, method, system, and program, and recording medium
US20160005332A1 (en) Method for administering a driving test
AU2015271971A1 (en) A vehicle driver monitoring method, arrangement, system, software and application
WO2015181835A1 (en) Mobile device with biometric, extra gps and alcohol sensor
US20200171944A1 (en) Interlock system for a vehicle
JP2019049875A (en) Operation permission authentication device
CN115225661A (en) Designated driver management system based on biological feature recognition technology
AU2017200943A1 (en) A System for Measuring and Managing Driver Performance
JP7244354B2 (en) In-vehicle device and operation management system
US20230339428A1 (en) System and method for hazardous driving prevention
US11724702B2 (en) System and method for hazardous driving prevention

Legal Events

Date Code Title Description
FGI Letters patent sealed or granted (innovation patent)
MK22 Patent ceased section 143a(d), or expired - non payment of renewal fee or expiry