WO2015124939A1 - Determining the status of a vehicle - Google Patents

Determining the status of a vehicle Download PDF

Info

Publication number
WO2015124939A1
WO2015124939A1 PCT/GB2015/050489 GB2015050489W WO2015124939A1 WO 2015124939 A1 WO2015124939 A1 WO 2015124939A1 GB 2015050489 W GB2015050489 W GB 2015050489W WO 2015124939 A1 WO2015124939 A1 WO 2015124939A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
status
telemetry signals
visual image
camera
Prior art date
Application number
PCT/GB2015/050489
Other languages
French (fr)
Inventor
Wayne Gilbert
Steve COWPER
Original Assignee
Risk Telematics Uk Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Risk Telematics Uk Limited filed Critical Risk Telematics Uk Limited
Publication of WO2015124939A1 publication Critical patent/WO2015124939A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/174Segmentation; Edge detection involving the use of two or more images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/02Recognising information on displays, dials, clocks
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00Registering or indicating the working of vehicles
    • G07C5/008Registering or indicating the working of vehicles communicating information to a remotely located station
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00Registering or indicating the working of vehicles
    • G07C5/08Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
    • G07C5/0841Registering performance data
    • G07C5/085Registering performance data using electronic data carriers
    • G07C5/0866Registering performance data using electronic data carriers the electronic data carrier being a digital video recorder in combination with video camera

Definitions

  • the invention relates to an apparatus and method for determining the status of a vehicle.
  • Automotive telematics involves the collection and analysis of vehicle telemetry signals in order to monitor vehicle operation and driver performance.
  • Fleet management is one common application for vehicle telematics.
  • data concerning the condition of the vehicle such as the odometer reading and the status of the oil and battery, may be required.
  • Another application of automotive telematics is in driver behaviour analysis for the insurance industry. Knowledge of the status of vehicle systems, such as acceleration and braking systems may be advantageous in driver behaviour analysis in addition to data concerning the condition of the vehicle.
  • OBD-II on- board diagnostics
  • ECU engine control unit
  • CAN controller area network
  • Vehicle telemetry signals can therefore be obtained directly from the vehicle's system bus using the OBD port.
  • Modern OBD systems provide a standardised series of diagnostic trouble codes (DTCs) which each identify a status of a particular vehicle system.
  • DTCs diagnostic trouble codes
  • the OBD port may be provided using a proprietary connector in some vehicles and so different hardware may be required in order to interface with different types of vehicle.
  • the arrangement of the OBD port may also depend on the communications standard used in the OBD implementation of the vehicle.
  • An alternative approach is to provide an additional controller to interface with the ECU (and other vehicle controllers) via a system bus.
  • a difficulty experienced with both of these approaches is that some information can only be safely retrieved from the ECU on an infrequent basis while the vehicle is in motion because active polling of the vehicle's system bus is required in order to obtain that information.
  • Over-polling the system bus may present a safety concern because the proportion of system time available to deal with essential tasks is reduced. For example, a few tens or even hundreds of milliseconds of additional delay in activation of a vehicle system such as the anti-lock braking system (ABS) may unacceptable.
  • polling of essential vehicle systems by auxiliary or non-essential vehicle systems may be the subject of regulation or legislation in some territories.
  • an apparatus for determining the status of a vehicle comprising:
  • a receiver configured to receive a visual image of a vehicle status display
  • an image processor configured to:
  • a dashboard is a common type of vehicle status display that provides the driver with information regarding a wide variety of different vehicle systems. Much, if not all, of the data available from an on-board diagnostics (OBD) port of the vehicle will also be displayed, in some form, on its dashboard. By identifying one or more vehicle telemetry signals from a visual image of the vehicle status display, directly interfacing with the system bus of the vehicle using the OBD can be avoided. All of the information on the dashboard can be obtained by the system without any additional work for the vehicle's processing systems. As such, safety concerns regarding the use of the OBD are obviated. The apparatus may therefore provide a safer method for monitoring vehicle telemetry signals. In addition, some information presented on the dashboard is not available from the OBD.
  • OBD on-board diagnostics
  • the apparatus may therefore provide additional vehicle telemetry signals compared to a solution that relies on interrogating an OBD port.
  • the apparatus may be calibrated to operate with a number of different types of vehicle and is not dependent on a proprietary OBD connection interface. An instance of the apparatus may therefore be suitable for an improved range of vehicles.
  • the receiver may comprise a camera.
  • the camera may be a video camera.
  • the image processor may be configured to identify a position of the camera relative to the vehicle status display based on the visual image.
  • the image processor may be configured to identify a type of the vehicle based on one or more features of the vehicle status display.
  • the image processor may be configured to identify the type of the vehicle based on a comparison between the one or more vehicle telemetry signals and one or more vehicle status display templates.
  • the one or more vehicle telemetry signals may comprise one or more of: a shape, a symbol, a location of a symbol, an orientation of a feature, an intensity of illumination of a symbol, or text.
  • the one or more vehicle telemetry signals may be indicative of one or more of: a fuel level, battery status, total odometer reading, trip odometer reading, speed, turn signal light status, warning light status, head light status, fog light status, side light status, gear selection, brake status, acceleration/deceleration status, engine status, engine revolutions per unit time, time, date, oil level, air conditioning status, media centre status or service status of the vehicle.
  • the apparatus may comprise a communication unit.
  • the communication unit may be configured to relay the output to a device that is remote from the vehicle.
  • the apparatus may comprise a vehicle location determining unit.
  • the output may further comprise a location stamp associated with the vehicle telemetry signals.
  • the vehicle location determining unit may be configured to generate the location stamp in accordance with a position of the vehicle.
  • the output may further comprise a time stamp associated with the vehicle telemetry signals.
  • the image processor may be configured to sample a first type of vehicle telemetry signal in the visual image with a first sampling rate.
  • the image processor may be configured to sample a second type of vehicle telemetry signal in the visual image with a second sampling rate.
  • the first sampling rate may be different to the second sampling rate.
  • a vehicle comprising the above apparatus.
  • the camera may be integrated with the vehicle.
  • an automated method for determining the status of a vehicle comprising:
  • Figure 1 illustrates a vehicle status display and an apparatus for determining the status of the vehicle from the vehicle status display
  • Figure 2a illustrates a dashboard of a vehicle at ignition
  • Figure 2b illustrates the processed visual image based on figure 2a
  • Figure 3 illustrates output from an apparatus for determining the status of the vehicle based on the visual image of figure 2a or 2b;
  • Figure 4 illustrates a processed visual image of a dashboard following ignition;
  • Figure 5 illustrates output from an apparatus for determining the status of the vehicle based on the visual image of figure 4;
  • Figure 6 illustrates a processed visual image of a dashboard of the vehicle when indicating to turn left
  • Figure 7 illustrates output from an apparatus for determining the status of the vehicle based on the visual image of figure 6.
  • FIG. 1 illustrates a vehicle status display 100 and an apparatus 150 for determining the status of the vehicle from the vehicle status display 100.
  • a dashboard is a common type of vehicle status display 100 that provides the driver with information regarding a wide variety of different vehicle systems. Much, if not all, of the data available from an on-board diagnostics (OBD) port of the vehicle will also be displayed, in some form, on the vehicle's dashboard.
  • OBD on-board diagnostics
  • a dashboard such as the vehicle status display 100, may have indicators for a seatbelt 102, an airbag fault 104, electronic stability program (ESP) activation, a check engine warning 106, a left turn signal 108, a hazard warning light 110, a right turn signal 112, dipped headlights 114, a fuel level 116, a low fuel warning 118, battery status, a total odometer reading 120, a trip odometer reading, a fog light, a side light, low engine temperature 122, an engine temperature level 124.
  • a dashboard may also have a speedometer 126 (from which acceleration/deceleration can be determined), an engine revolutions per minute counter 128, and one or more data displays DATA1 , DATA2.
  • the one or more data displays DATA1 , DATA2 can provide other information to the driver or occupant of the vehicle, such as gear selection status, brake status, time, date, oil level, air conditioning status, media centre status or a service status of the vehicle.
  • the indicators and displays on the dashboard are each indicative of one or more vehicle telemetry signals. These signals are often displayed as a shape, as a symbol, as a location of a symbol, as an intensity of illumination of the symbol, or as text.
  • the apparatus 150 comprises a receiver 152 and an image processor 154.
  • the receiver 152 is configured to receive a visual image of the vehicle status display 150.
  • the receiver 152 comprises one or more ports for receiving data from a camera 156.
  • the visual image is received in electronic form from the camera 156. That is, the visual image is represented by data in this example.
  • the visual image comprises a plurality of picture elements (pixels).
  • the camera 156 may be provided by any device that is configured to provide a representation of a plurality of pixels.
  • the camera 156 may be a video camera in which case the visual image may relate to a frame of a video image.
  • the video camera may have a high frame rate, such as 25 or 30 frames per second.
  • a plurality of cameras 16 may be provided in order to monitor distributed vehicle status displays.
  • a first camera may be provided to receive a visual image of a dashboard and a second camera may be provided to receive a visual image of a central console of the vehicle.
  • the camera 156 may be comprised within, or provided externally to, the apparatus 150.
  • the receiver itself 152 may comprise the camera 156, in which case the visual image may be received optically by the apparatus 150.
  • the camera 156 may be wirelessly connected to the receiver 152 of the apparatus 150 using a communications standard such as Bluetooth.
  • the camera 156 is mounted on or within, or integrated with, the vehicle such that the dashboard is within a field of view 158 of the camera 156.
  • the camera 156 can be mounted on or in a steering column directly in front of the dashboard so that an unimpeded view of the dashboard is obtained.
  • the camera 156 can also be sited so that it does not obscure the driver's view.
  • the image processor 154 is configured to identify one or more vehicle telemetry signals from the visual image.
  • the image processor 154 can apply one or more processing operations. For example, the image processor may amend properties of the visual image in order to maximise the contrast between features and their surroundings.
  • the image processor 154 may apply a template that corresponds to a layout of a known vehicle status display 100 in order to identify one or more indicators that are associated with each of the vehicle telemetry signals. The template may be downloaded to the vehicle on demand or pre-installed in the apparatus 150. Identifying the one or more vehicle telemetry signals may comprise determining the locations of the one or more indicators on the vehicle status display 100.
  • the image processor 154 may assess an intensity of illumination at the location of an indicator (e.g. 108) on the vehicle status display in order to determine a status of a vehicle telemetry signal. The level of illumination of an indicator is typically related to the status of the vehicle telemetry signal associated with that indicator. Examples of such analysis are discussed further with reference to figures 2 to 7.
  • the image processor 154 may perform colour recognition in order to determine a status of a vehicle telemetry signal.
  • a single headlight status indicator 114 provides an indication whether the headlights are on a low beam or a full beam.
  • the headlight status indicator changes colour, typically from green, when the headlights are on low beam, to blue, when the headlights are on full beam.
  • the image processor 154 may perform optical character recognition (OCR) in order to identify a particular symbol (e.g. 102) on the vehicle status display 100. OCR may be used to determine a symbol or text that relates to a particular vehicle telemetry signal.
  • OCR optical character recognition
  • the image processor 154 may perform shape and/or angular position recognition in order to identify the status of a particular vehicle telemetry signal, such as the speed indicated by the speedometer 126 or any other analogue dial pointer.
  • the angular position of a dial relates to the orientation of a pointer feature of the dial.
  • the one or more identified vehicle telemetry signals are provided as an output of the apparatus 150. That is, the output may comprise the status of the one or more vehicle telemetry signals.
  • the apparatus 150 avoids the need for interfacing with the system bus of the vehicle (either using an OBD port or by direct communication with the bus). As such, safety concerns regarding use of the system bus are obviated.
  • the apparatus 150 may therefore provide a safer method of providing vehicle telemetry signals.
  • Some information presented on the dashboard is not available from the OBD, which is primarily intended for use when the vehicle is stationary while servicing.
  • the apparatus 150 may therefore provide additional vehicle telemetry signals compared to a system that retrieves data from an OBD port. For example, a telemetry signal (such as the speed of the vehicle) can be monitored continuously by the apparatus 150. A high sampling rate such as 25 or 30 samples per second may be taken by the camera 156 without affecting the vehicle's systems.
  • the apparatus 150 may be calibrated to operate with a number of different types of vehicle. The apparatus 150 may therefore be suitable for a larger range of vehicles than a system that is dependent on using a particular proprietary OBD connection interface.
  • the image processor 154 may be configured to identify a vehicle type (for example a model or manufacturer) based on the received visual image of the vehicle status display 100. One or more features of the vehicle status display can be compared with a template of a vehicle status display of a known vehicle type. In many vehicles, all or most of the indicators on the dashboard are illuminated by ODB systems at ignition in order to demonstrate that the lighting units for each indicator are functioning.
  • the vehicle type may therefore be identified during or shortly after (for example, within 2 seconds of) vehicle ignition.
  • a single element photo-sensor such as a photodiode, may be provided in order for the illumination level to be monitored whilst the apparatus is in a sleep mode.
  • the image processor 154 may be configured to recognise ignition by monitoring an illumination level of the vehicle status display obtained from either the camera or the single element photo-sensor.
  • the image processor 154 may 'wake' on recognising ignition in response to the illumination level increasing above a pre-set threshold or in response to a rate of change in the illumination.
  • Compared features may include an indicator light (e.g. 1 18, 114) for a vehicle telemetry signal, the position of a sub-display, a user interface feature or a fiducial marker.
  • the template may contain information corresponding to one or more of the possible types of feature for a known vehicle type. Specifically, the template may contain a description of the location and/or appearance of a feature on a vehicle status display associated with a particular type of vehicle. For a particular type of vehicle, the dashboard layout is typically the same on each instance of the vehicle irrespective of any differences between subcomponents of the vehicle.
  • the features of the visual image may be compared to a plurality of templates in order to determine the vehicle type. In the case where the type of vehicle is known but the absolute position 156 of the camera is not, the visual image obtained by the camera 156 may be compared with a template of the known vehicle type in order to determine the position of the camera 156 relative to the vehicle status display 100.
  • Data and/or computer program code relating to the operation of the apparatus 150 can be stored in a memory 160.
  • the steps performed by the image processor 154 can be considered to be performed by the image processor 154 in combination with the memory 160 and computer program code.
  • One or more templates and/or a determined vehicle type can be stored in the memory 160.
  • an instance of the apparatus 150 may be used with a single vehicle or be infrequently moved between vehicles. In these situations, it may be assumed on start-up that the vehicle status display 100 is associated with the same vehicle that the apparatus 150 was situated in when it was last active.
  • the use of a memory 160 that persists when the vehicle is not in use may be advantageous because the determined vehicle type from the last session can be recalled and so the processing that is required when the apparatus 150 is initiated is reduced.
  • the apparatus can be provided with a user selectable installation mode in which the vehicle type is identified (or re-identified) based on a comparison between an obtained visual image of the vehicle status display 100 and one or more templates.
  • a communication unit 162 may be provided in order to relay the output of the apparatus 150 to a location remote from the vehicle for subsequent storage and/or analysis.
  • the communication unit may be provided using a close range or long range telecommunications system, such as a WiFi, 2G, 3G or 4G cellular communication device.
  • the output may be buffered or stored locally in the memory 160.
  • the memory 160 may be interrogatable by an external device in order to remove data from the apparatus 150.
  • the communication unit 162 may also be used to download new vehicle templates to the apparatus 150. Downloading may be initiated by the image processor 154 in response to ignition of the vehicle or in response to a user command. Alternatively, new templates may be 'pushed' to the apparatus 152 by a central server when they are available.
  • Raw visual image data from the camera 156 may also be stored in the memory 160. However, by saving and/or transmitting the vehicle telemetry signals derived from the visual images, rather than the visual images themselves, the storage/bandwidth requirements of the system can be reduced. Vehicle telemetry signals may be saved in the memory with an associated time and date stamp. The sampling rate of the different types of vehicle telemetry signals stored in the memory can be varied depending on the requirements for each particular type of data. For example, the fuel level is a slowly varying signal and so a lower sampling rate may be required compared to a system that produces transient data, such as the anti-lock braking system (ABS). The vehicle telemetry signals can be stored/transmitted in a variety of formats.
  • ABS anti-lock braking system
  • the data may be retained as a function of time, or as a record of events when a status of a vehicle telemetry signal changes (for example: [ABS ON 17 Feb 2014 15:42:26.05 GMT; ABS OFF 17 Feb 2014 15:42:26.83]).
  • a status of a vehicle telemetry signal changes for example: [ABS ON 17 Feb 2014 15:42:26.05 GMT; ABS OFF 17 Feb 2014 15:42:26.83].
  • the amount of data produced for transient or intermittent signals for example, those which typically last less than one or ten seconds or those that may be expected to occur less than once every hour when the vehicle is in use) can be reduced.
  • the apparatus 150 may be provided remote from the vehicle and receive a visual image from a camera 156 installed in the vehicle via a telecommunications system.
  • a satellite-based vehicle location determining unit 164 may be provided, either within the apparatus of separately, using the Global Positioning System (GPS) or Galileo.
  • GPS Global Positioning System
  • the location determining unit 164 enables location data to be stored with associated vehicle telemetry signals. Correlated vehicle telemetry signals and location data can be particularly valuable in determining the cause of, and attributing the fault in, a vehicle accident. For example, the operator of a vehicle can provide firm evidence whether the indicator light of their vehicle was in use when approaching a junction. Disagreements between parties following an accident may therefore be more easily and justly resolved.
  • the vehicle telemetry signals may be saved and/or transmitted with corresponding time/date and/or location data.
  • the apparatus 150 provides numerous advantages over other approaches of obtaining vehicle telemetry data, these include: ⁇
  • the apparatus 150 can be reconfigured to operate with any type of vehicle by receiving a software update containing a template of the vehicle status display for that type of vehicle.
  • a generic implementation of the apparatus 150 can be provided for all vehicles types without modifying the hardware of the apparatus 150.
  • the apparatus may be easily retrofitted to a vehicle by attaching a camera to the vehicle and positioning it to monitor the vehicle status display. The apparatus is therefore backwards compatible with existing vehicles. Alternatively, the apparatus may be installed during manufacture of the vehicle.
  • Figures 2 to 7 illustrate a practical example with visual images of a dashboard captured at three instances in time together with output profiles from an apparatus that is similar to that described with reference to figure 1 as a function of time.
  • Figure 2a illustrates a frame of a video taken of a dashboard 200 of a vehicle around 1 second after vehicle ignition.
  • Figure 2b illustrates a processed visual image based on the frame of video in figure 2a. Such image processing can be performed by the apparatus prior to image recognition in order to improve output quality in some instances.
  • the locations of a number of indicators 202-218 on the dashboard 200 are marked in figure 2b. These locations correspond to the respective positions of seatbelt not on 202, airbag fault 204, ESP active 206, check engine 208, low fuel warning 210, left turn signal 212, hazard warning light 214, right turn signal 216 and dipped headlights 218 indicators on the dashboard 200.
  • FIG. 2b illustrates output profiles 302-318 from the apparatus for determining the status of the vehicle.
  • the output profiles 302-318 are based on the frame of a video of figure 2a, but could equally have been determined from the processed image of figure 2b.
  • the output profiles 302-318 are shown as illumination intensity (or a related value) against time (in seconds).
  • the apparatus is configured to apply a template that monitors the level of illumination at nine discrete positions corresponding to the positions of the indicators 202-218 on the dashboard 200 in figure 2b.
  • the illumination of the profiles relates directly to the status of the dashboard indicators 202-218 for respective discrete telemetry signals.
  • the seatbelt not on 302, airbag fault 304, ESP active 306, check engine 308 and low fuel warning 310 profiles are at a constant positive illumination value between zero seconds and about one second (when the profiles 302-318 were captured) because the corresponding indicators 202-210 on the dashboard 200 are illuminated.
  • the left turn signal 312, hazard warning light 314, right turn signal 316 and dipped headlights 318 profiles are at a zero level between zero seconds and about one second because the corresponding indicator lights 212-218 on the dashboard 200 are not illuminated.
  • the relative illumination can be monitored so that changes in the ambient light level can be compensated for.
  • a point of the dashboard that does not correspond to the position of an indicator can be monitored in order to give a background level of illumination that can be used to compensate for the ambient light level.
  • the profiles are calibrated such that an illumination intensity of zero indicates that a particular indicator light is off.
  • An illumination intensity higher than a predetermined threshold indicates, in this example, that the particular indicator light is on.
  • the constant positive value of the profiles 302-310 related to the illuminated signals 202-210 is higher than the predetermined threshold.
  • the zero value of the profiles 312-318 related to the illuminated signals 212-218 is not higher than the predetermined threshold.
  • Figure 4 illustrates a processed visual image of a dashboard taken about seven seconds after ignition.
  • the seatbelt not on 402, low fuel warning 410 and dipped headlights 418 indicators are illuminated.
  • the airbag fault 404, ESP active 406, check engine 408, left turn signal 412, hazard warning light 414 and right turn signal 416 indicators are not illuminated.
  • Figure 5 illustrates output profiles 502-518 from an apparatus for determining the status of the vehicle based on the visual image of figure 4 and proceeding video images of the dashboard 400.
  • the seatbelt not on profile 502 and low fuel warning profile 510 are at a constant positive value between zero seconds and about seven seconds (when the profiles 502-518 were captured).
  • the left turn signal profile 512, hazard warning light profile 514 and right turn signal profile 516 are at a zero level between zero seconds and about seven seconds.
  • the airbag fault profile 504, ESP active profile 506 and check engine profile 508 transition from a constant positive illumination value to a zero illumination value at about six seconds when the associated indicators 404-408 on the dashboard are turned off.
  • the dipped headlights profile 518 transitions from a zero illumination value to a constant positive illumination value at about six seconds when the dipped headlights indicator 518 is turned on.
  • Figure 6 illustrates a processed visual image of a dashboard taken about seventeen seconds after ignition.
  • the seatbelt not on 602, low fuel warning 610, left turn signal 612 and dipped headlights 618 indicators are illuminated.
  • the airbag fault 604, ESP active 606, check engine 608, hazard warning light 614 and right turn signal616 indicators are not illuminated.
  • Figure 7 illustrates output profiles 712-718 from the apparatus for determining the status of the vehicle based on the visual image of figure 6 and preceding video images.
  • the left turn signal profile 712 is at zero between zero and about sixteen seconds after ignition. Between about sixteen seconds and about seventeen seconds the left turn signal profile 712 is a square waveform that reflects the illumination level of the left turn signal indicator light 612.
  • the seatbelt not on profile 702 and low fuel warning profile 710 are at a constant positive illumination value between zero seconds and about seventeen seconds (when the profiles 702-718 were captured).
  • the hazard warning light profile 714 and right turn signal profile 716 are at a zero illumination level between zero seconds and about seventeen seconds.
  • the airbag fault profile 704, ESP active profile 706 and check engine profile 708 remains at a zero illumination value after about six seconds from ignition.
  • the dipped headlights profile 718 transition remains at a constant positive illumination value after about six seconds from ignition.
  • the profiles shown in figures 3, 5 and 7 may be provided as an output of the apparatus, either in the format shown in the figures or suitably encoded.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Traffic Control Systems (AREA)

Abstract

The disclosure relates to an apparatus (150) for determining the status of a vehicle, comprising a receiver (152) configured to receive a visual image of a vehicle status display (100) and an image processor (154) configured to identify one or more vehicle telemetry signals from the image and provide an output in accordance with the one or more vehicle telemetry signals.

Description

Determining the Status of a Vehicle
The invention relates to an apparatus and method for determining the status of a vehicle. Automotive telematics involves the collection and analysis of vehicle telemetry signals in order to monitor vehicle operation and driver performance. Fleet management is one common application for vehicle telematics. For effective fleet management, data concerning the condition of the vehicle, such as the odometer reading and the status of the oil and battery, may be required. Another application of automotive telematics is in driver behaviour analysis for the insurance industry. Knowledge of the status of vehicle systems, such as acceleration and braking systems may be advantageous in driver behaviour analysis in addition to data concerning the condition of the vehicle.
Some vehicle telemetry information can be obtained by interfacing directly with an on- board diagnostics (OBD) port of the vehicle. The OBD-II standard, for example, provides access to data from the engine control unit (ECU), along with other control units of the vehicle, via a system bus, which is usually implemented using a controller area network (CAN) bus. Vehicle telemetry signals can therefore be obtained directly from the vehicle's system bus using the OBD port. Modern OBD systems provide a standardised series of diagnostic trouble codes (DTCs) which each identify a status of a particular vehicle system.
The OBD port may be provided using a proprietary connector in some vehicles and so different hardware may be required in order to interface with different types of vehicle. In addition, the arrangement of the OBD port may also depend on the communications standard used in the OBD implementation of the vehicle.
Some vehicle manufacturers restrict the type of information that can be obtained from the OBD, which is intended primarily for use in servicing when the vehicle is stationary rather than in use. An alternative approach is to provide an additional controller to interface with the ECU (and other vehicle controllers) via a system bus. A difficulty experienced with both of these approaches is that some information can only be safely retrieved from the ECU on an infrequent basis while the vehicle is in motion because active polling of the vehicle's system bus is required in order to obtain that information. Over-polling the system bus may present a safety concern because the proportion of system time available to deal with essential tasks is reduced. For example, a few tens or even hundreds of milliseconds of additional delay in activation of a vehicle system such as the anti-lock braking system (ABS) may unacceptable. In future, polling of essential vehicle systems by auxiliary or non-essential vehicle systems may be the subject of regulation or legislation in some territories.
According to a first aspect of the invention there is provided an apparatus for determining the status of a vehicle, comprising:
a receiver configured to receive a visual image of a vehicle status display; and an image processor configured to:
identify one or more vehicle telemetry signals from the image; and provide an output in accordance with the one or more vehicle telemetry signals.
A dashboard is a common type of vehicle status display that provides the driver with information regarding a wide variety of different vehicle systems. Much, if not all, of the data available from an on-board diagnostics (OBD) port of the vehicle will also be displayed, in some form, on its dashboard. By identifying one or more vehicle telemetry signals from a visual image of the vehicle status display, directly interfacing with the system bus of the vehicle using the OBD can be avoided. All of the information on the dashboard can be obtained by the system without any additional work for the vehicle's processing systems. As such, safety concerns regarding the use of the OBD are obviated. The apparatus may therefore provide a safer method for monitoring vehicle telemetry signals. In addition, some information presented on the dashboard is not available from the OBD. The apparatus may therefore provide additional vehicle telemetry signals compared to a solution that relies on interrogating an OBD port. The apparatus may be calibrated to operate with a number of different types of vehicle and is not dependent on a proprietary OBD connection interface. An instance of the apparatus may therefore be suitable for an improved range of vehicles.
The receiver may comprise a camera. The camera may be a video camera. The image processor may be configured to identify a position of the camera relative to the vehicle status display based on the visual image. The image processor may be configured to identify a type of the vehicle based on one or more features of the vehicle status display. The image processor may be configured to identify the type of the vehicle based on a comparison between the one or more vehicle telemetry signals and one or more vehicle status display templates.
The one or more vehicle telemetry signals may comprise one or more of: a shape, a symbol, a location of a symbol, an orientation of a feature, an intensity of illumination of a symbol, or text. The one or more vehicle telemetry signals may be indicative of one or more of: a fuel level, battery status, total odometer reading, trip odometer reading, speed, turn signal light status, warning light status, head light status, fog light status, side light status, gear selection, brake status, acceleration/deceleration status, engine status, engine revolutions per unit time, time, date, oil level, air conditioning status, media centre status or service status of the vehicle. The apparatus may comprise a communication unit. The communication unit may be configured to relay the output to a device that is remote from the vehicle.
The apparatus may comprise a vehicle location determining unit. The output may further comprise a location stamp associated with the vehicle telemetry signals. The vehicle location determining unit may be configured to generate the location stamp in accordance with a position of the vehicle. The output may further comprise a time stamp associated with the vehicle telemetry signals.
The image processor may be configured to sample a first type of vehicle telemetry signal in the visual image with a first sampling rate. The image processor may be configured to sample a second type of vehicle telemetry signal in the visual image with a second sampling rate. The first sampling rate may be different to the second sampling rate.
According to a further aspect of the invention there is provided a vehicle comprising the above apparatus. The camera may be integrated with the vehicle.
According to a further aspect of the invention there is provided an automated method for determining the status of a vehicle, comprising:
receiving a visual image of a vehicle status display;
identifying one or more vehicle telemetry signals from the image; and
providing an output in accordance with the one or more vehicle telemetry signals. Embodiments of the invention will now be described, by way of example, with reference to the following figures, in which:
Figure 1 illustrates a vehicle status display and an apparatus for determining the status of the vehicle from the vehicle status display;
Figure 2a illustrates a dashboard of a vehicle at ignition;
Figure 2b illustrates the processed visual image based on figure 2a;
Figure 3 illustrates output from an apparatus for determining the status of the vehicle based on the visual image of figure 2a or 2b; Figure 4 illustrates a processed visual image of a dashboard following ignition;
Figure 5 illustrates output from an apparatus for determining the status of the vehicle based on the visual image of figure 4;
Figure 6 illustrates a processed visual image of a dashboard of the vehicle when indicating to turn left; and
Figure 7 illustrates output from an apparatus for determining the status of the vehicle based on the visual image of figure 6.
Figure 1 illustrates a vehicle status display 100 and an apparatus 150 for determining the status of the vehicle from the vehicle status display 100. A dashboard is a common type of vehicle status display 100 that provides the driver with information regarding a wide variety of different vehicle systems. Much, if not all, of the data available from an on-board diagnostics (OBD) port of the vehicle will also be displayed, in some form, on the vehicle's dashboard.
A dashboard, such as the vehicle status display 100, may have indicators for a seatbelt 102, an airbag fault 104, electronic stability program (ESP) activation, a check engine warning 106, a left turn signal 108, a hazard warning light 110, a right turn signal 112, dipped headlights 114, a fuel level 116, a low fuel warning 118, battery status, a total odometer reading 120, a trip odometer reading, a fog light, a side light, low engine temperature 122, an engine temperature level 124. A dashboard may also have a speedometer 126 (from which acceleration/deceleration can be determined), an engine revolutions per minute counter 128, and one or more data displays DATA1 , DATA2. The one or more data displays DATA1 , DATA2 can provide other information to the driver or occupant of the vehicle, such as gear selection status, brake status, time, date, oil level, air conditioning status, media centre status or a service status of the vehicle.
In general, the indicators and displays on the dashboard are each indicative of one or more vehicle telemetry signals. These signals are often displayed as a shape, as a symbol, as a location of a symbol, as an intensity of illumination of the symbol, or as text.
The apparatus 150 comprises a receiver 152 and an image processor 154. The receiver 152 is configured to receive a visual image of the vehicle status display 150. The receiver 152 comprises one or more ports for receiving data from a camera 156. As such, the visual image is received in electronic form from the camera 156. That is, the visual image is represented by data in this example. The visual image comprises a plurality of picture elements (pixels). The camera 156 may be provided by any device that is configured to provide a representation of a plurality of pixels. The camera 156 may be a video camera in which case the visual image may relate to a frame of a video image. The video camera may have a high frame rate, such as 25 or 30 frames per second. A plurality of cameras 16 may be provided in order to monitor distributed vehicle status displays. For example, a first camera may be provided to receive a visual image of a dashboard and a second camera may be provided to receive a visual image of a central console of the vehicle. The camera 156 may be comprised within, or provided externally to, the apparatus 150. For example, the receiver itself 152 may comprise the camera 156, in which case the visual image may be received optically by the apparatus 150. Alternatively, the camera 156 may be wirelessly connected to the receiver 152 of the apparatus 150 using a communications standard such as Bluetooth.
Typically, the camera 156 is mounted on or within, or integrated with, the vehicle such that the dashboard is within a field of view 158 of the camera 156. For example, the camera 156 can be mounted on or in a steering column directly in front of the dashboard so that an unimpeded view of the dashboard is obtained. The camera 156 can also be sited so that it does not obscure the driver's view.
The image processor 154 is configured to identify one or more vehicle telemetry signals from the visual image. The image processor 154 can apply one or more processing operations. For example, the image processor may amend properties of the visual image in order to maximise the contrast between features and their surroundings. The image processor 154 may apply a template that corresponds to a layout of a known vehicle status display 100 in order to identify one or more indicators that are associated with each of the vehicle telemetry signals. The template may be downloaded to the vehicle on demand or pre-installed in the apparatus 150. Identifying the one or more vehicle telemetry signals may comprise determining the locations of the one or more indicators on the vehicle status display 100. The image processor 154 may assess an intensity of illumination at the location of an indicator (e.g. 108) on the vehicle status display in order to determine a status of a vehicle telemetry signal. The level of illumination of an indicator is typically related to the status of the vehicle telemetry signal associated with that indicator. Examples of such analysis are discussed further with reference to figures 2 to 7.
The image processor 154 may perform colour recognition in order to determine a status of a vehicle telemetry signal. For example, in some cars, a single headlight status indicator 114 provides an indication whether the headlights are on a low beam or a full beam. In such an indicator 114, the headlight status indicator changes colour, typically from green, when the headlights are on low beam, to blue, when the headlights are on full beam.
The image processor 154 may perform optical character recognition (OCR) in order to identify a particular symbol (e.g. 102) on the vehicle status display 100. OCR may be used to determine a symbol or text that relates to a particular vehicle telemetry signal. The image processor 154 may perform shape and/or angular position recognition in order to identify the status of a particular vehicle telemetry signal, such as the speed indicated by the speedometer 126 or any other analogue dial pointer. The angular position of a dial relates to the orientation of a pointer feature of the dial.
The one or more identified vehicle telemetry signals are provided as an output of the apparatus 150. That is, the output may comprise the status of the one or more vehicle telemetry signals. By identifying one or more vehicle telemetry signals from the visual image, the apparatus 150 avoids the need for interfacing with the system bus of the vehicle (either using an OBD port or by direct communication with the bus). As such, safety concerns regarding use of the system bus are obviated. The apparatus 150 may therefore provide a safer method of providing vehicle telemetry signals. Some information presented on the dashboard is not available from the OBD, which is primarily intended for use when the vehicle is stationary while servicing. The apparatus 150 may therefore provide additional vehicle telemetry signals compared to a system that retrieves data from an OBD port. For example, a telemetry signal (such as the speed of the vehicle) can be monitored continuously by the apparatus 150. A high sampling rate such as 25 or 30 samples per second may be taken by the camera 156 without affecting the vehicle's systems.
Different types of vehicle, or vehicles produced by different manufacturers, typically have different dashboard layouts. The apparatus 150 may be calibrated to operate with a number of different types of vehicle. The apparatus 150 may therefore be suitable for a larger range of vehicles than a system that is dependent on using a particular proprietary OBD connection interface. For example, the image processor 154 may be configured to identify a vehicle type (for example a model or manufacturer) based on the received visual image of the vehicle status display 100. One or more features of the vehicle status display can be compared with a template of a vehicle status display of a known vehicle type. In many vehicles, all or most of the indicators on the dashboard are illuminated by ODB systems at ignition in order to demonstrate that the lighting units for each indicator are functioning. The vehicle type may therefore be identified during or shortly after (for example, within 2 seconds of) vehicle ignition. A single element photo-sensor, such as a photodiode, may be provided in order for the illumination level to be monitored whilst the apparatus is in a sleep mode. The image processor 154 may be configured to recognise ignition by monitoring an illumination level of the vehicle status display obtained from either the camera or the single element photo-sensor. The image processor 154 may 'wake' on recognising ignition in response to the illumination level increasing above a pre-set threshold or in response to a rate of change in the illumination. Compared features may include an indicator light (e.g. 1 18, 114) for a vehicle telemetry signal, the position of a sub-display, a user interface feature or a fiducial marker. The template may contain information corresponding to one or more of the possible types of feature for a known vehicle type. Specifically, the template may contain a description of the location and/or appearance of a feature on a vehicle status display associated with a particular type of vehicle. For a particular type of vehicle, the dashboard layout is typically the same on each instance of the vehicle irrespective of any differences between subcomponents of the vehicle. The features of the visual image may be compared to a plurality of templates in order to determine the vehicle type. In the case where the type of vehicle is known but the absolute position 156 of the camera is not, the visual image obtained by the camera 156 may be compared with a template of the known vehicle type in order to determine the position of the camera 156 relative to the vehicle status display 100. Data and/or computer program code relating to the operation of the apparatus 150 can be stored in a memory 160. The steps performed by the image processor 154 can be considered to be performed by the image processor 154 in combination with the memory 160 and computer program code. One or more templates and/or a determined vehicle type can be stored in the memory 160.
In some cases, it is possible that an instance of the apparatus 150 may be used with a single vehicle or be infrequently moved between vehicles. In these situations, it may be assumed on start-up that the vehicle status display 100 is associated with the same vehicle that the apparatus 150 was situated in when it was last active. The use of a memory 160 that persists when the vehicle is not in use may be advantageous because the determined vehicle type from the last session can be recalled and so the processing that is required when the apparatus 150 is initiated is reduced. The apparatus can be provided with a user selectable installation mode in which the vehicle type is identified (or re-identified) based on a comparison between an obtained visual image of the vehicle status display 100 and one or more templates. A communication unit 162 may be provided in order to relay the output of the apparatus 150 to a location remote from the vehicle for subsequent storage and/or analysis. The communication unit may be provided using a close range or long range telecommunications system, such as a WiFi, 2G, 3G or 4G cellular communication device. In addition or alternatively, the output may be buffered or stored locally in the memory 160. The memory 160 may be interrogatable by an external device in order to remove data from the apparatus 150.
The communication unit 162 may also be used to download new vehicle templates to the apparatus 150. Downloading may be initiated by the image processor 154 in response to ignition of the vehicle or in response to a user command. Alternatively, new templates may be 'pushed' to the apparatus 152 by a central server when they are available.
Raw visual image data from the camera 156 may also be stored in the memory 160. However, by saving and/or transmitting the vehicle telemetry signals derived from the visual images, rather than the visual images themselves, the storage/bandwidth requirements of the system can be reduced. Vehicle telemetry signals may be saved in the memory with an associated time and date stamp. The sampling rate of the different types of vehicle telemetry signals stored in the memory can be varied depending on the requirements for each particular type of data. For example, the fuel level is a slowly varying signal and so a lower sampling rate may be required compared to a system that produces transient data, such as the anti-lock braking system (ABS). The vehicle telemetry signals can be stored/transmitted in a variety of formats. For example, the data may be retained as a function of time, or as a record of events when a status of a vehicle telemetry signal changes (for example: [ABS ON 17 Feb 2014 15:42:26.05 GMT; ABS OFF 17 Feb 2014 15:42:26.83]). In this way, the amount of data produced for transient or intermittent signals (for example, those which typically last less than one or ten seconds or those that may be expected to occur less than once every hour when the vehicle is in use) can be reduced.
Alternatively, the apparatus 150 may be provided remote from the vehicle and receive a visual image from a camera 156 installed in the vehicle via a telecommunications system. A satellite-based vehicle location determining unit 164 may be provided, either within the apparatus of separately, using the Global Positioning System (GPS) or Galileo. The location determining unit 164 enables location data to be stored with associated vehicle telemetry signals. Correlated vehicle telemetry signals and location data can be particularly valuable in determining the cause of, and attributing the fault in, a vehicle accident. For example, the operator of a vehicle can provide firm evidence whether the indicator light of their vehicle was in use when approaching a junction. Disagreements between parties following an accident may therefore be more easily and justly resolved. The vehicle telemetry signals may be saved and/or transmitted with corresponding time/date and/or location data.
In summary, the apparatus 150 provides numerous advantages over other approaches of obtaining vehicle telemetry data, these include: · The apparatus 150 can be reconfigured to operate with any type of vehicle by receiving a software update containing a template of the vehicle status display for that type of vehicle. In principle, a generic implementation of the apparatus 150 can be provided for all vehicles types without modifying the hardware of the apparatus 150.
• No electronic interfacing with the control systems of the vehicle is required and therefore the risk of interfering with, or compromising the integrity of, the vehicle control systems is eliminated. · The apparatus may be easily retrofitted to a vehicle by attaching a camera to the vehicle and positioning it to monitor the vehicle status display. The apparatus is therefore backwards compatible with existing vehicles. Alternatively, the apparatus may be installed during manufacture of the vehicle. Figures 2 to 7 illustrate a practical example with visual images of a dashboard captured at three instances in time together with output profiles from an apparatus that is similar to that described with reference to figure 1 as a function of time.
Figure 2a illustrates a frame of a video taken of a dashboard 200 of a vehicle around 1 second after vehicle ignition. Figure 2b illustrates a processed visual image based on the frame of video in figure 2a. Such image processing can be performed by the apparatus prior to image recognition in order to improve output quality in some instances. The locations of a number of indicators 202-218 on the dashboard 200 are marked in figure 2b. These locations correspond to the respective positions of seatbelt not on 202, airbag fault 204, ESP active 206, check engine 208, low fuel warning 210, left turn signal 212, hazard warning light 214, right turn signal 216 and dipped headlights 218 indicators on the dashboard 200.
The seatbelt not on 202, airbag fault 204, ESP active 206, check engine 208 and low fuel warning 210 indicators are illuminated. The left turn signal 212, hazard warning light 214, right turn signal 216 and dipped headlights 218 indicators are not illuminated. Several other lights and data displays are also shown on the dashboard 200 in figure 2b and the apparatus could also be configured to determine information related to these telemetry signals, as discussed above with reference to figure 1. However, these additional signals are not discussed further with regard to the simplified illustrative example of figures 2 to 7. Figure 3 illustrates output profiles 302-318 from the apparatus for determining the status of the vehicle. The output profiles 302-318 are based on the frame of a video of figure 2a, but could equally have been determined from the processed image of figure 2b. The output profiles 302-318 are shown as illumination intensity (or a related value) against time (in seconds). In this example, the apparatus is configured to apply a template that monitors the level of illumination at nine discrete positions corresponding to the positions of the indicators 202-218 on the dashboard 200 in figure 2b. The illumination of the profiles relates directly to the status of the dashboard indicators 202-218 for respective discrete telemetry signals. The seatbelt not on 302, airbag fault 304, ESP active 306, check engine 308 and low fuel warning 310 profiles are at a constant positive illumination value between zero seconds and about one second (when the profiles 302-318 were captured) because the corresponding indicators 202-210 on the dashboard 200 are illuminated. The left turn signal 312, hazard warning light 314, right turn signal 316 and dipped headlights 318 profiles are at a zero level between zero seconds and about one second because the corresponding indicator lights 212-218 on the dashboard 200 are not illuminated.
The relative illumination can be monitored so that changes in the ambient light level can be compensated for. For example, a point of the dashboard that does not correspond to the position of an indicator can be monitored in order to give a background level of illumination that can be used to compensate for the ambient light level. In the present case, the profiles are calibrated such that an illumination intensity of zero indicates that a particular indicator light is off. An illumination intensity higher than a predetermined threshold indicates, in this example, that the particular indicator light is on. The constant positive value of the profiles 302-310 related to the illuminated signals 202-210 is higher than the predetermined threshold. The zero value of the profiles 312-318 related to the illuminated signals 212-218 is not higher than the predetermined threshold.
A corresponding series of reference numerals is used in each of the figures 2 to 7 in reference to same indicator light positions and illumination profiles. Figure 4 illustrates a processed visual image of a dashboard taken about seven seconds after ignition. The seatbelt not on 402, low fuel warning 410 and dipped headlights 418 indicators are illuminated. The airbag fault 404, ESP active 406, check engine 408, left turn signal 412, hazard warning light 414 and right turn signal 416 indicators are not illuminated.
Figure 5 illustrates output profiles 502-518 from an apparatus for determining the status of the vehicle based on the visual image of figure 4 and proceeding video images of the dashboard 400. The seatbelt not on profile 502 and low fuel warning profile 510 are at a constant positive value between zero seconds and about seven seconds (when the profiles 502-518 were captured). The left turn signal profile 512, hazard warning light profile 514 and right turn signal profile 516 are at a zero level between zero seconds and about seven seconds. The airbag fault profile 504, ESP active profile 506 and check engine profile 508 transition from a constant positive illumination value to a zero illumination value at about six seconds when the associated indicators 404-408 on the dashboard are turned off. The dipped headlights profile 518 transitions from a zero illumination value to a constant positive illumination value at about six seconds when the dipped headlights indicator 518 is turned on.
Figure 6 illustrates a processed visual image of a dashboard taken about seventeen seconds after ignition. The seatbelt not on 602, low fuel warning 610, left turn signal 612 and dipped headlights 618 indicators are illuminated. The airbag fault 604, ESP active 606, check engine 608, hazard warning light 614 and right turn signal616 indicators are not illuminated. Figure 7 illustrates output profiles 712-718 from the apparatus for determining the status of the vehicle based on the visual image of figure 6 and preceding video images.
The left turn signal profile 712 is at zero between zero and about sixteen seconds after ignition. Between about sixteen seconds and about seventeen seconds the left turn signal profile 712 is a square waveform that reflects the illumination level of the left turn signal indicator light 612.
The seatbelt not on profile 702 and low fuel warning profile 710 are at a constant positive illumination value between zero seconds and about seventeen seconds (when the profiles 702-718 were captured). The hazard warning light profile 714 and right turn signal profile 716 are at a zero illumination level between zero seconds and about seventeen seconds. The airbag fault profile 704, ESP active profile 706 and check engine profile 708 remains at a zero illumination value after about six seconds from ignition. The dipped headlights profile 718 transition remains at a constant positive illumination value after about six seconds from ignition.
The profiles shown in figures 3, 5 and 7 may be provided as an output of the apparatus, either in the format shown in the figures or suitably encoded.

Claims

Claims
1. An apparatus for determining the status of a vehicle, comprising:
a receiver configured to receive a visual image of a vehicle status display; and an image processor configured to:
identify one or more vehicle telemetry signals from the visual image; and provide an output in accordance with the one or more vehicle telemetry signals.
2. The apparatus of claim 1 wherein the image processor is configured to identify a type of the vehicle based on one or more features of the vehicle status display.
3. The apparatus of claim 2 wherein the image processor is configured to identify the type of the vehicle based on a comparison between the one or more vehicle telemetry signals and one or more vehicle status display templates.
4. The apparatus of any preceding claim wherein the image processor is configured to sample:
a first type of vehicle telemetry signal in the visual image with a first sampling rate; and
a second type of vehicle telemetry signal in the visual image with a second sampling rate, wherein the first sampling rate is different to the second sampling rate.
5. The apparatus of any preceding claim wherein the receiver comprises a camera.
6. The apparatus of claim 5 wherein the camera is a video camera.
7. The apparatus of claim 5 or 6 wherein the image processor is configured to identify a position of the camera relative to the vehicle status display based on the visual image.
8. The apparatus of any preceding claim wherein the one or more vehicle telemetry signals comprises one or more of: a shape, a symbol, a location of a symbol, an orientation of a feature, an intensity of illumination of a symbol, or text.
9. The apparatus of any preceding claim wherein each of the one or more vehicle telemetry signals is indicative of one of: a fuel level, battery status, total odometer reading, trip odometer reading, speed, turn signal light status, warning light status, head light status, fog light status, side light status, gear selection, brake status, acceleration/deceleration status, engine status, engine revolutions per unit time, time, date, oil level, air conditioning status, media centre status or service status of the vehicle.
10. The apparatus of any preceding claim comprising a communication unit configured to relay the output to a device that is remote from the vehicle.
11. The apparatus of any preceding claim comprising a vehicle location determining unit and wherein the output further comprises a location stamp associated with the vehicle telemetry signals.
12. The apparatus of any preceding claim wherein the output further comprises a time stamp associated with the vehicle telemetry signals.
13. A vehicle comprising the apparatus of any preceding claim.
14. The vehicle of claim 13 when dependent on claim 5 wherein the camera is integrated with the vehicle.
15. An automated method for determining the status of a vehicle, comprising:
receiving a visual image of a vehicle status display;
identifying one or more vehicle telemetry signals from the image; and
providing an output in accordance with the one or more vehicle telemetry signals.
16. An apparatus as described herein with reference to the accompanying figures.
17. A method as described herein with reference to the accompanying figures.
PCT/GB2015/050489 2014-02-21 2015-02-19 Determining the status of a vehicle WO2015124939A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB1403100.9A GB2523359B (en) 2014-02-21 2014-02-21 Determining the status of a vehicle
GB1403100.9 2014-02-21

Publications (1)

Publication Number Publication Date
WO2015124939A1 true WO2015124939A1 (en) 2015-08-27

Family

ID=50482601

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2015/050489 WO2015124939A1 (en) 2014-02-21 2015-02-19 Determining the status of a vehicle

Country Status (2)

Country Link
GB (1) GB2523359B (en)
WO (1) WO2015124939A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106846549A (en) * 2017-03-03 2017-06-13 安徽大鸿智能科技有限公司 Automobile oil mass record system
CN107358237A (en) * 2017-07-21 2017-11-17 东南大学 A kind of more instrument board automatic reading methods for going environmental disturbances
EP3313067A1 (en) 2016-10-21 2018-04-25 Bombardier Transportation GmbH Method of monitoring a human-machine interface on a rail vehicle and associated human-machine interface and monitoring installation
CN108116395A (en) * 2017-12-22 2018-06-05 北京汽车研究总院有限公司 A kind of vehicle and its vehicle-state reminding method
US10152641B2 (en) 2017-01-20 2018-12-11 Jack Cooper Logistics, LLC Artificial intelligence based vehicle dashboard analysis
FR3074319A1 (en) * 2017-11-30 2019-05-31 Sncf Mobilites METHOD AND DEVICE FOR CONTROLLING A CONDUCTIVE-MACHINE INTERFACE
WO2020006003A1 (en) * 2018-06-25 2020-01-02 Nottingham Spirk Design Associates User-provided automotive data collection
US11928812B2 (en) 2021-09-03 2024-03-12 Caterpillar Inc. Systems and methods for inspecting multi-mode asset status in communication-denied environments

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019008584A1 (en) 2017-07-05 2019-01-10 Hod Gibso A vehicle refueling authentication system
NL2019682B1 (en) * 2017-10-06 2019-04-15 Beijer Invest B V Vehicle data unlocking device for unlocking vehicle data in a vehicle.
EP3739550A4 (en) * 2018-01-11 2021-09-29 Pioneer Corporation Information recording device, information recording method, and program for recording information
CN113295253B (en) * 2020-02-24 2023-04-25 上海华位物联网科技有限公司 Method and system for monitoring weighing data abnormality of non-perception wagon balance vehicle
US20230057340A1 (en) * 2021-08-19 2023-02-23 Yokogawa Electric Corporation Systems, methods, and devices for automated meter reading for smart field patrol

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006011141A2 (en) * 2004-07-25 2006-02-02 Israel Aerospace Industries Ltd. Method and system for the acquisition of data and for the display of data
WO2009026156A1 (en) * 2007-08-17 2009-02-26 Bell Helicopter Textron, Inc. System for optical recognition, interpretation, and digitization of human readable instruments, annunciators, and controls
US20100214130A1 (en) * 2009-02-20 2010-08-26 Weinmann Robert V Adaptive instrument and operator control recognition

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003065812A (en) * 2001-08-21 2003-03-05 National Aerospace Laboratory Of Japan System for forming numeral data based on image information in measuring instrument display
US7242806B2 (en) * 2002-01-23 2007-07-10 Honeywell International Inc. Methods, functional Data, and Systems for image feature translation
KR100902491B1 (en) * 2007-04-27 2009-06-10 금오공과대학교 산학협력단 System for processing digit image, and method thereof
CN102628854A (en) * 2012-03-29 2012-08-08 赵宝明 Automobile instrument board detection system and method
CN103164692B (en) * 2012-12-03 2015-11-25 北京科技大学 A kind of special vehicle instrument automatic identification system based on computer vision and method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006011141A2 (en) * 2004-07-25 2006-02-02 Israel Aerospace Industries Ltd. Method and system for the acquisition of data and for the display of data
WO2009026156A1 (en) * 2007-08-17 2009-02-26 Bell Helicopter Textron, Inc. System for optical recognition, interpretation, and digitization of human readable instruments, annunciators, and controls
US20100214130A1 (en) * 2009-02-20 2010-08-26 Weinmann Robert V Adaptive instrument and operator control recognition

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3313067A1 (en) 2016-10-21 2018-04-25 Bombardier Transportation GmbH Method of monitoring a human-machine interface on a rail vehicle and associated human-machine interface and monitoring installation
US10152641B2 (en) 2017-01-20 2018-12-11 Jack Cooper Logistics, LLC Artificial intelligence based vehicle dashboard analysis
CN106846549A (en) * 2017-03-03 2017-06-13 安徽大鸿智能科技有限公司 Automobile oil mass record system
CN107358237A (en) * 2017-07-21 2017-11-17 东南大学 A kind of more instrument board automatic reading methods for going environmental disturbances
FR3074319A1 (en) * 2017-11-30 2019-05-31 Sncf Mobilites METHOD AND DEVICE FOR CONTROLLING A CONDUCTIVE-MACHINE INTERFACE
EP3492337A1 (en) * 2017-11-30 2019-06-05 SNCF Mobilités Method and device for monitoring a driver-machine interface
CN108116395A (en) * 2017-12-22 2018-06-05 北京汽车研究总院有限公司 A kind of vehicle and its vehicle-state reminding method
CN108116395B (en) * 2017-12-22 2024-01-30 北京汽车集团越野车有限公司 Vehicle and vehicle state prompting method thereof
WO2020006003A1 (en) * 2018-06-25 2020-01-02 Nottingham Spirk Design Associates User-provided automotive data collection
US11928812B2 (en) 2021-09-03 2024-03-12 Caterpillar Inc. Systems and methods for inspecting multi-mode asset status in communication-denied environments

Also Published As

Publication number Publication date
GB2523359A (en) 2015-08-26
GB201403100D0 (en) 2014-04-09
GB2523359B (en) 2016-01-06

Similar Documents

Publication Publication Date Title
WO2015124939A1 (en) Determining the status of a vehicle
US10614639B2 (en) In-vehicle control device and in-vehicle recording system
US8339254B2 (en) User configured display system for motor vehicle
US7786851B2 (en) Data acquisition and display system for motor vehicle
US10431089B1 (en) Crowdsourced vehicle history
US8000843B2 (en) Critical event reporting
US7928837B2 (en) Data acquisition and display system for motor vehicles
EP1723612B1 (en) Vehicle telematics system
DE102017123406A1 (en) TELEMATICS-BASED VEHICLE REPORTS
US20080015748A1 (en) System for monitoring, controlling, and reporting vehicle operation through onboard diagnostic port
US20080082221A1 (en) System for monitoring, controlling, and reporting vehicle operation through onboard diagnostic port
US20180293446A1 (en) Vehicle event detection and classification using contextual vehicle information
KR100987319B1 (en) Active Database based Total Management System and Method for Diagnostic Information and Positioning Information of Vehicle
EP2930697A1 (en) Method and device for processing vehicle condition data
WO2015002025A1 (en) Method for generating index for evaluating driving, information processing apparatus, vehicle-mounted device, and control method and control program therefor
DE102007049761A1 (en) Method for operating a mobile navigation device in a vehicle
KR20070031559A (en) A hadware in the loop simulation apparatus and a test method thereof for lane departure warning system
DE102012008284A1 (en) Method for outputting information with respect to object of vehicle over mobile communication terminal, involves arranging communication connection between mobile communication terminal and computing unit of vehicle
KR100732402B1 (en) Vehicle Information Displaying System Using Mobile Communication device
US20200082710A1 (en) Method for data collection
DE102018220002A1 (en) Device for determining information on the driving style of a driver and system for determining an individual accident risk based thereon
EP4256502A1 (en) Electronic system for forward-looking measurements of frequencies and/or probabilities of accident occurrences based on localized automotive device measurements, and corresponding method thereof
EP1216888B1 (en) Standard interface for vehicles
EP4060629A1 (en) Systems and methods for training image processing models for vehicle data collection
KR20010085265A (en) Automobile remote diagnostic system and managing method using the same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15710847

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15710847

Country of ref document: EP

Kind code of ref document: A1