WO2016202586A1 - Vehicle dimensions and position broadcasting for optical distance measurements - Google Patents

Vehicle dimensions and position broadcasting for optical distance measurements Download PDF

Info

Publication number
WO2016202586A1
WO2016202586A1 PCT/EP2016/062356 EP2016062356W WO2016202586A1 WO 2016202586 A1 WO2016202586 A1 WO 2016202586A1 EP 2016062356 W EP2016062356 W EP 2016062356W WO 2016202586 A1 WO2016202586 A1 WO 2016202586A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
distance
data
neighbouring
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2016/062356
Other languages
French (fr)
Inventor
Nicolae PAHONTU
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aumovio Germany GmbH
Original Assignee
Continental Automotive Technologies GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Continental Automotive Technologies GmbH filed Critical Continental Automotive Technologies GmbH
Publication of WO2016202586A1 publication Critical patent/WO2016202586A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/584Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights

Definitions

  • V2V Vehicle-to-vehicle communications
  • ADAS Ad ⁇ vanced Driver Assistant System
  • ADAS can be used to trigger actions of the present vehicle for avoiding dangerous situations, or for mitigating the impact of an inevitable collision.
  • ADAS usually contains an environment perception subsystem that delivers positions and speed of other traffic participants in the closer environment of the ego vehicle.
  • an ADAS usually contains a subsystem for warning and/or generating action, which includes some kind of inference and decision making process.
  • the present specification relates to a distance estimation method and system for use in an advanced driver assistant system (ADAS) .
  • ADAS advanced driver assistant system
  • the distance estimation method is used for in ⁇ creasing the accuracy of measuring a distance between vehicles using mono camera sensors like ADAS Mono Camera Sensors, Surround View cameras etc.
  • the distance estimation system makes use of broadcast data about the dimensions of a
  • the distance estimation method according to the present specification is applicable to vehicles situated in front in the back or on the lateral traffic lanes on highways.
  • the ve ⁇ hicle in the front, the vehicle behind and the laterally ad- jacent vehicle are also referred to as the neighbouring vehi ⁇ cles.
  • the vehicle that performs the distance measurement is also referred to as the present vehicle or the ego-vehicle.
  • the neighbouring vehicles are captured in image frames of ve ⁇ hicle cameras.
  • the image data is combined with further infor ⁇ mation relating to the outer dimensions and the operating state of a neighbouring vehicle to derive a distance measure ⁇ ment .
  • a distance estimation method may comprise the following steps:
  • vehicles are provided with a sender device.
  • the sender device broadcasts in periodic intervals the dimen ⁇ sions of the vehicle and its current position on the road.
  • the vehicle dimensions may comprise the distance between the two backlights, the distance between the front lights, the length of the vehicle, the height of the vehicle etc.
  • the sending power, directionality and encoding method of the sender device is adjusted such that any vehicle situated in the vicinity within a pre-determined distance can receive the broadcast information.
  • the measurement system is designed such that a vehicle that receives the broadcast information can identify the vehicle, which has transmitted the broadcast data.
  • the broadcasted data may comprise identification information, for example an identification number such as the number on the number plate.
  • the receiving vehicle may use in- formation about the signal strength and the directionality of the signal to identify the source of the signal.
  • the receiving vehicle forwards the received information to an image processing unit.
  • the image processing unit uses data from a camera a sensor, such as advanced driving assistance (ADAS) mono camera sensors, surround View Camera sensors etc., to measure the distances to the sending vehicles.
  • ADAS advanced driving assistance
  • the term "mono camera” is used to indicate that the vehicle cam ⁇ era is not a stereo camera, although a stereo camera may be used if available.
  • the broadcasted vehicle recognition data comprises further information such as the vehicle colour, information about the type, positioning, size and shape of the vehicle lights.
  • the information may indicate whether an additional brake light is present or not .
  • the vehicle recognition data is used to facilitate the recog- nition of the vehicle.
  • the broadcasted information may also include the actual driving parameters such as the steering angle, the yaw, the turning rate, the driving speed, the braking deceleration, the braking intensity etc. With such information, the receiving vehicles in the vicinity are not only able to measure the distance to the sending vehicle but also to predict with high accuracy the future position of the vehicle.
  • Public channels include, among others, the dedicated short range communication (DSRC) channels that are allocated for road safety and traffic effi ⁇ ciency.
  • DSRC is defined, among others in the European stan ⁇ dards EN 12253:2004, EN 12795:2002, EN 12834:2002, EN
  • IEEE 802. lip which is chosen in IEEE 1609 as protocol for the MAC and physical layer, are related to DSRC. According to IEEE 802. lip, a frequency band between 5.85 and 5.925 GHz is used.
  • the sender devices may use a time division mul ⁇ tiple access (TDMA) procedure.
  • the sender devices may also use received broadcasted signals from other vehicle to adjust sending time slots in order to avoid data collisions.
  • the time slots of the TDMA procedure may be chosen according to a random number or according to a pre-determined pattern of time intervals.
  • the sender device uses a code division multiple access (CDMA) procedure.
  • CDMA code division multiple access
  • the orthogo ⁇ nal codes of the CDMA procedure may be chosen according to a random number, or they may be alternated according to a pre- determined sequence. Similar to the TDMA procedure, the vehi ⁇ cles may use the received information to choose a suitable CDMA code.
  • Further multiplexing procedures which may be used for broad ⁇ casting vehicle related information, include frequency divi ⁇ sion multiple access (FDMA) , orthogonal frequency division multiple access (OFDMA) and spatial division multiple access (SDMA) .
  • FDMA frequency divi ⁇ sion multiple access
  • OFDMA orthogonal frequency division multiple access
  • SDMA spatial division multiple access
  • an OFDM procedure is defined in the 802. lip standard.
  • all vehicles that are equipped with receivers are capable of receiving and decoding the in ⁇ formation.
  • all vehicles that send the in- formation are situated in the visible area of camera sensors can be identified.
  • a method uses standard elements with known dimensions that belong to a vehicle in order to calculate with sufficient accuracy the distance to the object on the basis of image frames from an "intelligent" mono camera.
  • An image processing unit which is provided as part of the mono camera or which is connected to the mono camera, evaluates the dimension data of the observed vehicle and interprets the image data accordingly.
  • Vehicles that broadcast their dimensions, position, and op- tional additional information for vehicle identification and with actual moving parameters • Vehicles that are equipped with receivers and camera sen ⁇ sors, which are able to decode and to use the information broadcasted by other vehicles for measuring distances
  • D the total number of pixels on the horizontal direction of the image
  • Nph the total number of pixels on the horizontal direction of the image
  • d 2 * D * tan (cp/2)
  • is the opti ⁇ cal angle of the camera.
  • a preceding vehicle has visible markings that indicate the distance between the center of the two back light, for example 1.9 m. This dimension is re ⁇ ferred to as VBLD (Vehicle Back Lights Distance) .
  • VBLD Vehicle Back Lights Distance
  • NpVBLD(D) the number of Pixels that measure the VBLD at distance D.
  • m is a counter which numbers the neighbouring vehicles d (m) is the distance to the m-th vehicle and VBLD (m) is the backlight difference of the m-th vehicle.
  • the present specification discloses a computer implemented method for estimating a distance from a present vehicle to a neighbouring vehicle, which is equipped with a broadcasting unit for broadcasting vehicle related data.
  • the neighbouring vehicle can be a vehicle driving ahead but also any other vehicle in the surroundings of the present vehicle.
  • the present vehicle receives broadcast data from the vehicle
  • the broadcast data comprises distance data, which relates to a visual feature of the neighbouring vehicle, such as the lights, the bumper, the vehicle height etc. Furthermore, the broadcast data may comprise an identifier of the neighbouring vehicle. The distance data and the identifier are stored in a computer readable memory for further use.
  • the present vehicle receives image data from a vehicle camera of the present vehicle.
  • the vehicle camera may be provided by a compact mono camera.
  • the image data com- prises a vehicle image of the neighbouring vehicle.
  • the vehi ⁇ cle image can also refer to just a portion of the vehicle, as long as the portion comprises the visual feature.
  • the neighbouring vehicle is in the surroundings of the pre ⁇ sent vehicle and there is a line of sight between the present vehicle and the neighbouring vehicle at the time of capturing the image data of the neighbouring vehicle.
  • the neighbouring vehicle may be ob- structed from site as long as it is within a pre-determined broadcasting range.
  • An image portion of the vehicle image is identified that cor ⁇ responds to the visual feature of the neighbouring vehicle by using an image recognition procedure.
  • the image recognition pro ⁇ cedure can be based on an approximate size range of the rear lights and an approximate colour range.
  • the image recognition may use a brightness value and a colour range as input.
  • a position of the visual feature may be tracked with a suitable tracking algorithm such as a Kalman filter or a Kanade-Lucas-Tomasi (KLT) feature tracker.
  • Fur- ther motion data which is broadcast from the neighbouring vehicle to the present vehicle, can be used as an input to the tracking algorithm.
  • the directionality of the received broadcast signal can be used as an input to the tracking algorithm.
  • the image of the vehicle may be tracked with a suitable tracking algorithm in order to reduce the need for a computationally expensive feature detec ⁇ tion process.
  • a vehicle distance from the present vehicle to the neighbour ⁇ ing vehicle, or from a sensor of a vehicle camera of the pre ⁇ sent vehicle to the neighbouring vehicle, is estimated by correlating the received distance information with the identified image portion.
  • a number of pixels is de ⁇ termined, which corresponds to an extension of the visual feature in a pre-determined direction on the sensor plane of the vehicle camera.
  • the number of pixels may be determined by counting pixels between on a straight line between a first pixel and a second pixel, wherein the first pixel and the second pixel correspond to pre-determined loca- tions of the identified image portion, such as an outer boundary, or to respective locations or centre points of im ⁇ age features etc.
  • a feature distance is extracted from the received broadcast data of the neighbouring vehicle, for example by reading out a corresponding data field.
  • the feature distance is extracted or derived from the received distance data.
  • the vehicle distance is derived from the distance data as a quotient, wherein a denominator of the quotient com- prises the previously determined number of pixels and a nu ⁇ merator of the quotient comprises the feature distance, which has been received in a broadcast signal of the neighbouring vehicle .
  • the visual feature com ⁇ prises a first rear light and a second rear light of the neighbouring vehicle
  • the feature distance is a distance between the first rear light and the second rear light.
  • the neighbouring vehicle is a vehicle driving ahead of the present vehicle. This embodiment is particularly useful for collision avoidance applications.
  • a relative alignment of the neighbouring vehicle relative to the present vehicle is derived and it is determined whether the vehicles are aligned in parallel. If an orientation of the neighbouring vehicle is tilted or not parallel with respect to the present vehicle, a correction factor is computed from the derived relative alignment and the correction factor is used in the estimation of the distance. This could also mean discarding the vehicle distance estimate if the tilt angle is larger than a pre- determined value.
  • the broadcast information comprises motion data of the neighbouring vehicle such as data derived from a GPS system or another type of positioning system of the neighbouring vehicle and/or further data derived from vehicle motion sensors.
  • motion data may comprises vehicle position and also vehicle motion state, such as velocity, yaw rate etc.
  • a future position of the neighbouring vehicle is derived from the distance data and the motion data.
  • this may comprise the use of a suitable tracking algorithm.
  • a future position of an image portion that corresponds to the visual feature is derived based on the derived future position of the neighbouring car, for example, by deriving the future position of the car in a top down projection, applying an inverse of the top down projection and an inverse of a lens distortion function.
  • the motion data is derived from GPS data of a GPS system of the neighbouring vehicle, wherein GPS refers to any kind of satellite based positioning system, in ⁇ cluding Galileo and GLONASS, for example.
  • GPS refers to any kind of satellite based positioning system, in ⁇ cluding Galileo and GLONASS, for example.
  • the GPS system may also use other data such as broadcasted position information or information of vehicle sensors if satellite data is not available.
  • the motion data comprises a steering angle, a steering wheel turning rate, a driving speed, a braking deceleration, a braking intensity or a com- bination thereof.
  • the current specification discloses a computer program product for executing the aforementioned method, which computer readable memory with computer readable in- structions for executing the abovementioned method, such as a magnetic memory, a solid state memory, or an optic memory.
  • a computing unit such as a processor, an ASIC or another type of integrated circuit with the computer readable memory.
  • the present specification discloses a computing unit, which comprises a first connection for receiving broadcast data and a second connection for re ⁇ ceiving image data.
  • the first connection and the second con- nection may be identical, e.g. when both types of data are received via the CAN bus or another type of automotive data bus .
  • the computing unit is operative to receive broadcast data over the first connection, the broadcast data comprising dis ⁇ tance data, which relates to a visual feature of a neighbour- ing or a sending vehicle.
  • the computing unit is operative to receive image data over the second connection, wherein the image data comprises a vehicle image of the neighbouring vehicle.
  • the vehicle image can also refer to just a portion of the vehicle, as long as the portion com- prises the visual feature.
  • the computation unit is operative to identify an image portion of the vehicle image that corresponds to the visual feature of the neighbouring or sending vehicle and to estimate a distance between the present vehicle to the neighbouring vehicle, or a vehicle camera of the present ve ⁇ hicle to the neighbouring vehicle, by correlating the re ⁇ ceived distance information with the identified image por ⁇ tion.
  • the computing unit is operative to derive a future position of the neighbouring vehicle, or a position of the vehicle image or a position of an image of the visual feature.
  • the computing unit is op ⁇ erative to broadcast distance data, which relates to a visual feature of a vehicle in which the computing unit is in ⁇ stalled .
  • the current specification discloses a vehicle with the aforementioned computing unit, which comprises a receiver antenna and a vehicle camera, wherein the receiver antenna is connected to the first connection the vehicle camera is con ⁇ nected to the second connection.
  • the current specification discloses a broadcast ⁇ ing unit, which is operative to read out distance data, that relates to a visual feature of a sending vehicle and to read out vehicle identification data of the sending vehicle, in particular to read out the data from a computer readable memory. Furthermore, the broadcasting unit is operative to transmit broadcast data at pre-determined times, for example in pre-determined intervals or periodically.
  • the broadcast data comprises the distance information and the identifier.
  • the current specification discloses a vehicle with the aforementioned broadcasting unit, wherein the vehicle is provided with an antenna and a signal output of the broadcasting unit is connected to the antenna.
  • Figure 1 shows a distance estimation system according to the present specification
  • Figure 2 shows a data frame of the distance estimation sys ⁇ tem
  • Figure 3 shows a distance estimation method according to the present specification
  • Figure 4 shows a flow diagram of the distance estimation
  • Fig. 1 shows an embodiment of a distance estimation system.
  • a first vehicle 10 comprises an antenna 11, which is connected to a transceiver. Furthermore, the first vehicle 10 comprises a mono camera 12, which is directed towards a front area of the vehicle 10. The mono camera 12 has an angle of aperture ⁇ . The mono camera 12 and the transceiver are connected to a processing unit of the vehicle 10, which is not shown in Fig. 1.
  • a second vehicle 20, which is driving in front of the first vehicle 10, comprises an antenna 21, which is connected to a transceiver. For illustration purposes, the second vehicle 20 is also shown in a rear view, as viewed from the camera 12. In the example of Fig. 1, both vehicles 10, 20 are driving on a right lane 5, which is adjacent to a left lane 6.
  • the vehi ⁇ cle has a height h and a back light distance VBLD. For exam ⁇ ple, the height h may be 1.5 m and the back light distance VBLD may be 1.9 m.
  • the vehicle 20 in front transmits vehicle related data, which comprises in particular the back light distance VBLD, via the antenna 21 and the pre ⁇ sent vehicle 10 receives the vehicle related information via the antenna 11.
  • the computation unit of the present vehicle uses the received data and the image data to provide an esti ⁇ mate of the distance D to the vehicle 20 ahead and to predict a future position of the vehicle 20.
  • the distance estimation is explained in more detail with respect to the Figures 3 and 4.
  • Fig. 2 shows an exemplary embodiment of a data frame 30 for use in the broadcasting of vehicle related information in the system of Fig. 1.
  • the data structure is provided by way of example. In an actual implementation, the data structure may have different elements or it may have more or less elements. Some of the elements may also be optional and are only trans ⁇ mitted for vehicles with corresponding settings and capabili ⁇ ties. For example, the information about the presence of a third braking light may not be transmitted if the vehicle does not have a third braking light.
  • the data frame 30 comprises an identification field 31, a data protocol field 32, a vehicle dimensions field 33, a ve ⁇ hicle position field 34 and a vehicle status field 35.
  • the protocol field 32 is subdivided into a first field 36 specifying the multiplexing method, a second field 37 speci ⁇ fying a data collision avoidance method and a third field 38 specifying protocol parameters, such as an algorithm for alternating the code or time slots.
  • the dimension field 33 is subdivided into a first field 39 specifying the back light distance, a second field 41 speci ⁇ fying further light position data, a third field 42 specify ⁇ ing further specifications of the lights, such as dimensions and brightness, a fourth field 43 indicating whether a third brake light is present, and a fifth field 44 indicating whether a braking light has an emergency braking indication mode .
  • the positional data field 34 is subdivided into a coordinate field 45 specifying the vehicle coordinates, for example as longitude and latitude, a time stamp field 46 specifying a time of data capture or an expiry time of the data, and an accuracy field 47 which specifies an estimated data accuracy.
  • the vehicle status field 35 is subdivided into a first field 48 specifying a current deceleration, a second field 49 specifying a current yaw rate, a third field 50 specifying a current steering angle, and fourth field 51 specifying a current vehicle speed.
  • Fig. 3 illustrates a distance estimation method according to the current specification.
  • a region between the rear lights of the car 20 ahead is projected onto a region of a sensor surface 53 of the mono camera 12 which comprises a number of NpVBLD(D) sensors 54, or sensor pixels 54, in a horizontal direction of a vehicle coordinate system.
  • the sensor plane 53 comprises a total number of Nph sensors in the horizontal di ⁇ rection .
  • the distance between the vehicle 20 and the opening 55 of the equivalent pin-hole camera is denoted by D and the extension of the horizontal region which is captured by the aperture angle ⁇ of the camera 12 at distance D is denoted by d.
  • a broadcast real distance between the rear lights 22, 23 of the vehicle 20 is denoted by VBLD (m) .
  • the distance D of the vehicle can be computed according to the abovementioned formula (2) .
  • Fig. 4 illustrate a method for estimate a distance between the present vehicle and a vehicle in the surroundings of the present vehicle 10, which is captured by one of the vehicle cameras of the present vehicle 10.
  • the present vehicle receives vehicle related data, such as the information contained in the data frame 30 of Fig. 2.
  • vehicle related data such as the information contained in the data frame 30 of Fig. 2.
  • the data frame 30 is derived from a signal of the antenna 11, for example by converting a quadrature amplitude modulated (QAM) signal into a digital signal and extracting the data frame from the digital signal.
  • QAM quadrature amplitude modulated
  • a step 61 the received data is stored in a computer read ⁇ able memory of the present vehicle 10.
  • a step 62 an image frame, or a video sequence, is received from a vehicle camera 12 of the present vehicle.
  • an image processing unit identifies pixels which belong to a captured vehicle.
  • the image processing unit relates the identified image pixels to the received vehicle data. For example, the image processing unit may correlate a received or estimated location of the vehicle with a direction that correspond to the identified the image pixels .
  • the estimated location of the sending vehicle can also be used to tune the receiving antenna 11 into the direction of a sending antenna of the sending vehicle.
  • a step 65 dimensional information is extracted from the received vehicle related data, for example by extracting the data fields 39, 40 and 41 of Fig. 2.
  • the dimen ⁇ sional information is used to derive a distance D to the sending vehicle from the identified image pixels.
  • the distance estimation method according to formula (2) may be used, which was explained with reference to Fig. 3.
  • a decision step 67 it is decided whether the vehicle re ⁇ lated data comprises positional data, for example by checking for the presence of the data field 34 of Fig. 2.
  • the positional data of the sending vehicle is used in a step 68 to derive a future position of the sending vehi ⁇ cle.
  • the predicted or derived future position can be used to predict an area of pixels in an image frame which corresponds to the sending vehicle.
  • it can be used to predict a future position of vehicle features, such as the rear lights or the head light and the position of corresponding pixel areas of the camera sensor.
  • the predicted pixel areas can be used to accelerate the image recognition.
  • step 66 further processing steps are performed which use further information of the vehicle data or the processing loops back to step 60.
  • the further processing depends on various conditions, for example on whether a new image frame is available, or whether there is further vehicle data of the sending vehicle available.
  • the distance estimation of step 66 may also use further broadcast information as input, such as the position of a third braking light, the height of the car etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)

Abstract

A method for estimating a distance from a present vehicle to a neighbouring vehicle. Broadcast data is received from the neighbouring vehicle and image data is received from a vehicle camera of the present vehicle. An image portion of the vehicle image is identified that corresponds to the visual feature of the neighbouring vehicle. A distance between the present vehicle and the neighbouring vehicle is estimated by correlating the received distance information with the identified image portion.

Description

VEHICLE DIMENSIONS AND POSITION BROADCASTING FOR OPTICAL DIS¬ TANCE MEASUREMENTS Vehicle-to-vehicle communications (V2V) is a promising tech¬ nique for Advanced Driver Assistance Systems to increase traffic safety and efficiency. One of the functions of an Ad¬ vanced Driver Assistant System (ADAS) is to warn the driver of the vehicle about dangerous situations involving other traffic participants. In particular, ADAS can be used to trigger actions of the present vehicle for avoiding dangerous situations, or for mitigating the impact of an inevitable collision. ADAS usually contains an environment perception subsystem that delivers positions and speed of other traffic participants in the closer environment of the ego vehicle. Further, an ADAS usually contains a subsystem for warning and/or generating action, which includes some kind of inference and decision making process. The present specification relates to a distance estimation method and system for use in an advanced driver assistant system (ADAS) . The distance estimation method is used for in¬ creasing the accuracy of measuring a distance between vehicles using mono camera sensors like ADAS Mono Camera Sensors, Surround View cameras etc. The distance estimation system makes use of broadcast data about the dimensions of a
neighbouring vehicle.
The distance estimation method according to the present specification is applicable to vehicles situated in front in the back or on the lateral traffic lanes on highways. The ve¬ hicle in the front, the vehicle behind and the laterally ad- jacent vehicle are also referred to as the neighbouring vehi¬ cles. The vehicle that performs the distance measurement is also referred to as the present vehicle or the ego-vehicle.
The neighbouring vehicles are captured in image frames of ve¬ hicle cameras. The image data is combined with further infor¬ mation relating to the outer dimensions and the operating state of a neighbouring vehicle to derive a distance measure¬ ment .
In particular, a distance estimation method according to the present specification may comprise the following steps:
1. Measuring the distance from the vehicle to the pre¬ ceding vehicles.
2. Measuring the distance from the vehicle to the fol¬ lowing vehicles.
3. Measuring the distance from the vehicle to the ve¬ hicles on the lateral lanes highways.
4. Calculate a final velocity for the vehicles in a surround area based on tracking the distance in successive images captured at pre-determined mo¬ ments in time.
In a distance measurement system according to the present specification, vehicles are provided with a sender device. The sender device broadcasts in periodic intervals the dimen¬ sions of the vehicle and its current position on the road. For example, the vehicle dimensions may comprise the distance between the two backlights, the distance between the front lights, the length of the vehicle, the height of the vehicle etc. The sending power, directionality and encoding method of the sender device is adjusted such that any vehicle situated in the vicinity within a pre-determined distance can receive the broadcast information.
The measurement system is designed such that a vehicle that receives the broadcast information can identify the vehicle, which has transmitted the broadcast data. For example, the broadcasted data may comprise identification information, for example an identification number such as the number on the number plate. Furthermore, the receiving vehicle may use in- formation about the signal strength and the directionality of the signal to identify the source of the signal.
The receiving vehicle forwards the received information to an image processing unit. The image processing unit uses data from a camera a sensor, such as advanced driving assistance (ADAS) mono camera sensors, surround View Camera sensors etc., to measure the distances to the sending vehicles. The term "mono camera" is used to indicate that the vehicle cam¬ era is not a stereo camera, although a stereo camera may be used if available.
According to further embodiments, the broadcasted vehicle recognition data comprises further information such as the vehicle colour, information about the type, positioning, size and shape of the vehicle lights. For example, the information may indicate whether an additional brake light is present or not .
The vehicle recognition data is used to facilitate the recog- nition of the vehicle. The broadcasted information may also include the actual driving parameters such as the steering angle, the yaw, the turning rate, the driving speed, the braking deceleration, the braking intensity etc. With such information, the receiving vehicles in the vicinity are not only able to measure the distance to the sending vehicle but also to predict with high accuracy the future position of the vehicle.
The information is sent on public channels in a way that al¬ lows multiple vehicles in the same area of the road to send similar information without overlapping and corrupting the broadcasted information from others. Public channels include, among others, the dedicated short range communication (DSRC) channels that are allocated for road safety and traffic effi¬ ciency. DSRC is defined, among others in the European stan¬ dards EN 12253:2004, EN 12795:2002, EN 12834:2002, EN
13372:2004 and EN ISO 14906:2004. Furthermore, the IEEE family of standards IEEE 1609 and the IEEE standard IEEE
802. lip, which is chosen in IEEE 1609 as protocol for the MAC and physical layer, are related to DSRC. According to IEEE 802. lip, a frequency band between 5.85 and 5.925 GHz is used.
For example, the sender devices may use a time division mul¬ tiple access (TDMA) procedure. The sender devices may also use received broadcasted signals from other vehicle to adjust sending time slots in order to avoid data collisions. Alter- natively or in addition, the time slots of the TDMA procedure may be chosen according to a random number or according to a pre-determined pattern of time intervals.
According to a further embodiment, the sender device uses a code division multiple access (CDMA) procedure. The orthogo¬ nal codes of the CDMA procedure may be chosen according to a random number, or they may be alternated according to a pre- determined sequence. Similar to the TDMA procedure, the vehi¬ cles may use the received information to choose a suitable CDMA code. Further multiplexing procedures, which may be used for broad¬ casting vehicle related information, include frequency divi¬ sion multiple access (FDMA) , orthogonal frequency division multiple access (OFDMA) and spatial division multiple access (SDMA) . In particular, an OFDM procedure is defined in the 802. lip standard.
According to one scenario, all vehicles that are equipped with receivers are capable of receiving and decoding the in¬ formation. In this scenario, all vehicles that send the in- formation are situated in the visible area of camera sensors can be identified.
A method according to the present specification uses standard elements with known dimensions that belong to a vehicle in order to calculate with sufficient accuracy the distance to the object on the basis of image frames from an "intelligent" mono camera. An image processing unit, which is provided as part of the mono camera or which is connected to the mono camera, evaluates the dimension data of the observed vehicle and interprets the image data accordingly.
The method and the system according to the present specifica¬ tion are based on the following features:
• Vehicles that broadcast their dimensions, position, and op- tional additional information for vehicle identification and with actual moving parameters • Vehicles that are equipped with receivers and camera sen¬ sors, which are able to decode and to use the information broadcasted by other vehicles for measuring distances
• a method to calculate the distances and the closing veloc- ity
• a method to predict the future position of the vehicles that broadcast also their moving parameters.
The method takes into consideration that at a given distance from the mono camera, called D, the total number of pixels on the horizontal direction of the image (Nph) covers a horizon¬ tal distance d = 2 * D * tan (cp/2), wherein φ is the opti¬ cal angle of the camera. This calculation is based on image data which is already corrected for lens distortions and/or in which the lens distortions can be neglected, such that the image can be effectively treated as an image of an idealized pinhole camera.
According to one embodiment, a preceding vehicle has visible markings that indicate the distance between the center of the two back light, for example 1.9 m. This dimension is re¬ ferred to as VBLD (Vehicle Back Lights Distance) .
In this case, at distance D, it can be calculated how many pixels will be in a captured image between the center of the two back lights of the vehicle. This number is referred to as NpVBLD(D), the number of Pixels that measure the VBLD at distance D.
VBLD(m) VBLD(m)
NpVBLD(D) = Nph X = Nph x
d(m) (1)
2 x D x tan In the captured image the number of pixels NpVBLD can be counted. Then the distance D is calculated as:
VBLD(m)
2 x NpVBLD (D) X tan(f)
Herein, m is a counter which numbers the neighbouring vehicles d (m) is the distance to the m-th vehicle and VBLD (m) is the backlight difference of the m-th vehicle.
Among others, the present specification discloses a computer implemented method for estimating a distance from a present vehicle to a neighbouring vehicle, which is equipped with a broadcasting unit for broadcasting vehicle related data. In particular, the neighbouring vehicle can be a vehicle driving ahead but also any other vehicle in the surroundings of the present vehicle.
The present vehicle receives broadcast data from the
neighbouring vehicle over an antenna of the present vehicle. The broadcast data comprises distance data, which relates to a visual feature of the neighbouring vehicle, such as the lights, the bumper, the vehicle height etc. Furthermore, the broadcast data may comprise an identifier of the neighbouring vehicle. The distance data and the identifier are stored in a computer readable memory for further use.
Furthermore, the present vehicle receives image data from a vehicle camera of the present vehicle. The vehicle camera may be provided by a compact mono camera. The image data com- prises a vehicle image of the neighbouring vehicle. The vehi¬ cle image can also refer to just a portion of the vehicle, as long as the portion comprises the visual feature. The neighbouring vehicle is in the surroundings of the pre¬ sent vehicle and there is a line of sight between the present vehicle and the neighbouring vehicle at the time of capturing the image data of the neighbouring vehicle. At the time of broadcasting the data, the neighbouring vehicle may be ob- structed from site as long as it is within a pre-determined broadcasting range.
An image portion of the vehicle image is identified that cor¬ responds to the visual feature of the neighbouring vehicle by using an image recognition procedure. For example for recog¬ nizing the rear lights at daytime, the image recognition pro¬ cedure can be based on an approximate size range of the rear lights and an approximate colour range. At night-time, the image recognition may use a brightness value and a colour range as input.
By way of example, a position of the visual feature may be tracked with a suitable tracking algorithm such as a Kalman filter or a Kanade-Lucas-Tomasi (KLT) feature tracker. Fur- ther motion data, which is broadcast from the neighbouring vehicle to the present vehicle, can be used as an input to the tracking algorithm. Furthermore, the directionality of the received broadcast signal can be used as an input to the tracking algorithm. Similarly, the image of the vehicle may be tracked with a suitable tracking algorithm in order to reduce the need for a computationally expensive feature detec¬ tion process. A vehicle distance from the present vehicle to the neighbour¬ ing vehicle, or from a sensor of a vehicle camera of the pre¬ sent vehicle to the neighbouring vehicle, is estimated by correlating the received distance information with the identified image portion.
According to a specific embodiment, a number of pixels is de¬ termined, which corresponds to an extension of the visual feature in a pre-determined direction on the sensor plane of the vehicle camera. In particular, the number of pixels may be determined by counting pixels between on a straight line between a first pixel and a second pixel, wherein the first pixel and the second pixel correspond to pre-determined loca- tions of the identified image portion, such as an outer boundary, or to respective locations or centre points of im¬ age features etc.
A feature distance is extracted from the received broadcast data of the neighbouring vehicle, for example by reading out a corresponding data field. In particular, the feature distance is extracted or derived from the received distance data. The vehicle distance is derived from the distance data as a quotient, wherein a denominator of the quotient com- prises the previously determined number of pixels and a nu¬ merator of the quotient comprises the feature distance, which has been received in a broadcast signal of the neighbouring vehicle . According to one specific embodiment, the visual feature com¬ prises a first rear light and a second rear light of the neighbouring vehicle, and the feature distance is a distance between the first rear light and the second rear light. In this case, the neighbouring vehicle is a vehicle driving ahead of the present vehicle. This embodiment is particularly useful for collision avoidance applications.
According to a further modification, a relative alignment of the neighbouring vehicle relative to the present vehicle is derived and it is determined whether the vehicles are aligned in parallel. If an orientation of the neighbouring vehicle is tilted or not parallel with respect to the present vehicle, a correction factor is computed from the derived relative alignment and the correction factor is used in the estimation of the distance. This could also mean discarding the vehicle distance estimate if the tilt angle is larger than a pre- determined value.
According to a further embodiment the broadcast information comprises motion data of the neighbouring vehicle such as data derived from a GPS system or another type of positioning system of the neighbouring vehicle and/or further data derived from vehicle motion sensors. Herein, motion data may comprises vehicle position and also vehicle motion state, such as velocity, yaw rate etc. A future position of the neighbouring vehicle is derived from the distance data and the motion data. In particular, this may comprise the use of a suitable tracking algorithm.
In a particular embodiment, a future position of an image portion that corresponds to the visual feature is derived based on the derived future position of the neighbouring car, for example, by deriving the future position of the car in a top down projection, applying an inverse of the top down projection and an inverse of a lens distortion function.
In a further embodiment, the motion data is derived from GPS data of a GPS system of the neighbouring vehicle, wherein GPS refers to any kind of satellite based positioning system, in¬ cluding Galileo and GLONASS, for example. The GPS system may also use other data such as broadcasted position information or information of vehicle sensors if satellite data is not available.
According to a further embodiment, the motion data comprises a steering angle, a steering wheel turning rate, a driving speed, a braking deceleration, a braking intensity or a com- bination thereof.
Furthermore, the current specification discloses a computer program product for executing the aforementioned method, which computer readable memory with computer readable in- structions for executing the abovementioned method, such as a magnetic memory, a solid state memory, or an optic memory. Furthermore, the specification discloses a computing unit, such as a processor, an ASIC or another type of integrated circuit with the computer readable memory.
According to a further aspect, the present specification discloses a computing unit, which comprises a first connection for receiving broadcast data and a second connection for re¬ ceiving image data. The first connection and the second con- nection may be identical, e.g. when both types of data are received via the CAN bus or another type of automotive data bus . The computing unit is operative to receive broadcast data over the first connection, the broadcast data comprising dis¬ tance data, which relates to a visual feature of a neighbour- ing or a sending vehicle. Furthermore, the computing unit is operative to receive image data over the second connection, wherein the image data comprises a vehicle image of the neighbouring vehicle. The vehicle image can also refer to just a portion of the vehicle, as long as the portion com- prises the visual feature.
Furthermore, the computation unit is operative to identify an image portion of the vehicle image that corresponds to the visual feature of the neighbouring or sending vehicle and to estimate a distance between the present vehicle to the neighbouring vehicle, or a vehicle camera of the present ve¬ hicle to the neighbouring vehicle, by correlating the re¬ ceived distance information with the identified image por¬ tion.
In a further embodiment, the computing unit is operative to derive a future position of the neighbouring vehicle, or a position of the vehicle image or a position of an image of the visual feature.
According to a further embodiment, the computing unit is op¬ erative to broadcast distance data, which relates to a visual feature of a vehicle in which the computing unit is in¬ stalled .
Moreover, the current specification discloses a vehicle with the aforementioned computing unit, which comprises a receiver antenna and a vehicle camera, wherein the receiver antenna is connected to the first connection the vehicle camera is con¬ nected to the second connection.
Furthermore, the current specification discloses a broadcast¬ ing unit, which is operative to read out distance data, that relates to a visual feature of a sending vehicle and to read out vehicle identification data of the sending vehicle, in particular to read out the data from a computer readable memory. Furthermore, the broadcasting unit is operative to transmit broadcast data at pre-determined times, for example in pre-determined intervals or periodically. The broadcast data comprises the distance information and the identifier.
In a further aspect, the current specification discloses a vehicle with the aforementioned broadcasting unit, wherein the vehicle is provided with an antenna and a signal output of the broadcasting unit is connected to the antenna.
The subject matter of the present application is now ex¬ plained in further detail with respect to the following Figures in which
Figure 1 shows a distance estimation system according to the present specification,
Figure 2 shows a data frame of the distance estimation sys¬ tem,
Figure 3 shows a distance estimation method according to the present specification, and
Figure 4 shows a flow diagram of the distance estimation
method . In the following description, details are provided to de¬ scribe the embodiments of the specification. It shall be ap¬ parent to one skilled in the art, however, that the embodi¬ ments may be practised without such details.
Fig. 1 shows an embodiment of a distance estimation system. A first vehicle 10 comprises an antenna 11, which is connected to a transceiver. Furthermore, the first vehicle 10 comprises a mono camera 12, which is directed towards a front area of the vehicle 10. The mono camera 12 has an angle of aperture φ. The mono camera 12 and the transceiver are connected to a processing unit of the vehicle 10, which is not shown in Fig. 1. A second vehicle 20, which is driving in front of the first vehicle 10, comprises an antenna 21, which is connected to a transceiver. For illustration purposes, the second vehicle 20 is also shown in a rear view, as viewed from the camera 12. In the example of Fig. 1, both vehicles 10, 20 are driving on a right lane 5, which is adjacent to a left lane 6. The vehi¬ cle has a height h and a back light distance VBLD. For exam¬ ple, the height h may be 1.5 m and the back light distance VBLD may be 1.9 m.
In the use case according to Fig. 1, the vehicle 20 in front transmits vehicle related data, which comprises in particular the back light distance VBLD, via the antenna 21 and the pre¬ sent vehicle 10 receives the vehicle related information via the antenna 11. The computation unit of the present vehicle uses the received data and the image data to provide an esti¬ mate of the distance D to the vehicle 20 ahead and to predict a future position of the vehicle 20. The distance estimation is explained in more detail with respect to the Figures 3 and 4. Fig. 2 shows an exemplary embodiment of a data frame 30 for use in the broadcasting of vehicle related information in the system of Fig. 1. The data structure is provided by way of example. In an actual implementation, the data structure may have different elements or it may have more or less elements. Some of the elements may also be optional and are only trans¬ mitted for vehicles with corresponding settings and capabili¬ ties. For example, the information about the presence of a third braking light may not be transmitted if the vehicle does not have a third braking light.
The data frame 30 comprises an identification field 31, a data protocol field 32, a vehicle dimensions field 33, a ve¬ hicle position field 34 and a vehicle status field 35. The protocol field 32 is subdivided into a first field 36 specifying the multiplexing method, a second field 37 speci¬ fying a data collision avoidance method and a third field 38 specifying protocol parameters, such as an algorithm for alternating the code or time slots.
The dimension field 33 is subdivided into a first field 39 specifying the back light distance, a second field 41 speci¬ fying further light position data, a third field 42 specify¬ ing further specifications of the lights, such as dimensions and brightness, a fourth field 43 indicating whether a third brake light is present, and a fifth field 44 indicating whether a braking light has an emergency braking indication mode .
The positional data field 34 is subdivided into a coordinate field 45 specifying the vehicle coordinates, for example as longitude and latitude, a time stamp field 46 specifying a time of data capture or an expiry time of the data, and an accuracy field 47 which specifies an estimated data accuracy. The vehicle status field 35 is subdivided into a first field 48 specifying a current deceleration, a second field 49 specifying a current yaw rate, a third field 50 specifying a current steering angle, and fourth field 51 specifying a current vehicle speed.
Fig. 3 illustrates a distance estimation method according to the current specification. A region between the rear lights of the car 20 ahead is projected onto a region of a sensor surface 53 of the mono camera 12 which comprises a number of NpVBLD(D) sensors 54, or sensor pixels 54, in a horizontal direction of a vehicle coordinate system. The sensor plane 53 comprises a total number of Nph sensors in the horizontal di¬ rection . The distance between the vehicle 20 and the opening 55 of the equivalent pin-hole camera is denoted by D and the extension of the horizontal region which is captured by the aperture angle φ of the camera 12 at distance D is denoted by d. A broadcast real distance between the rear lights 22, 23 of the vehicle 20 is denoted by VBLD (m) . With these definitions, the distance D of the vehicle can be computed according to the abovementioned formula (2) .
Fig. 4 illustrate a method for estimate a distance between the present vehicle and a vehicle in the surroundings of the present vehicle 10, which is captured by one of the vehicle cameras of the present vehicle 10.
In a step 60, the present vehicle receives vehicle related data, such as the information contained in the data frame 30 of Fig. 2. The data frame 30 is derived from a signal of the antenna 11, for example by converting a quadrature amplitude modulated (QAM) signal into a digital signal and extracting the data frame from the digital signal.
In a step 61, the received data is stored in a computer read¬ able memory of the present vehicle 10. In a step 62, an image frame, or a video sequence, is received from a vehicle camera 12 of the present vehicle.
In a step 63, an image processing unit identifies pixels which belong to a captured vehicle. In a step 64, the image processing unit relates the identified image pixels to the received vehicle data. For example, the image processing unit may correlate a received or estimated location of the vehicle with a direction that correspond to the identified the image pixels .
If the receiving antenna 11 is a directional antenna for which the directionality can be adjusted automatically, the estimated location of the sending vehicle can also be used to tune the receiving antenna 11 into the direction of a sending antenna of the sending vehicle.
In a step 65, dimensional information is extracted from the received vehicle related data, for example by extracting the data fields 39, 40 and 41 of Fig. 2. In a step 66, the dimen¬ sional information is used to derive a distance D to the sending vehicle from the identified image pixels. In particu¬ lar, the distance estimation method according to formula (2) may be used, which was explained with reference to Fig. 3.
In a decision step 67, it is decided whether the vehicle re¬ lated data comprises positional data, for example by checking for the presence of the data field 34 of Fig. 2.
If the vehicle data comprises positional data of the sending vehicle, the positional data of the sending vehicle is used in a step 68 to derive a future position of the sending vehi¬ cle. In particular, the predicted or derived future position can be used to predict an area of pixels in an image frame which corresponds to the sending vehicle. Furthermore, it can be used to predict a future position of vehicle features, such as the rear lights or the head light and the position of corresponding pixel areas of the camera sensor. The predicted pixel areas can be used to accelerate the image recognition.
Else the processing ends, further processing steps are performed which use further information of the vehicle data or the processing loops back to step 60. The further processing depends on various conditions, for example on whether a new image frame is available, or whether there is further vehicle data of the sending vehicle available. The distance estimation of step 66 may also use further broadcast information as input, such as the position of a third braking light, the height of the car etc.

Claims

1. A method for estimating a distance from a present vehicle (10) to a neighbouring vehicle (20) comprising
- receiving broadcast data (30) from the neighbouring vehicle (20), the broadcast data (30) comprising size- related data, the size-related data relating to a visual feature (22, 23) of the neighbouring vehicle (20), and an identifier of the neighbouring vehicle,
- receiving image data from a vehicle camera (12) of the present vehicle (10), the image data comprising a vehi¬ cle image of the neighbouring vehicle (10),
- identifying an image portion of the vehicle image that corresponds to the visual feature (22, 23) of the neighbouring vehicle (20),
- estimating a vehicle distance from the present vehicle (10) to the neighbouring vehicle (20) by correlating the received size-related data with the identified image portion, the estimating a vehicle distance comprising determining a number of pixels (54), wherein the number of pixels (54) corresponds to an extension of the visual feature (22, 23) in a pre-determined direction,
extracting a feature distance from the size-related data,
deriving the vehicle distance as a quotient, wherein a denominator of the quotient comprises the number of pix¬ els (54) and a numerator of the quotient comprises the feature distance.
2. The method of claim 1, wherein the visual feature com¬ prises (22, 23) a first rear light (22) and a second rear light (23) of the neighbouring vehicle (20), and wherein the feature distance is a distance between the first rear light (22) and the second rear light (23) .
3. The method according to one of claims 1 to 2, comprising deriving a relative alignment of the neighbouring vehicle (20) relative to the present vehicle (10),
if an orientation of the neighbouring vehicle (20) is tilted with respect to the present vehicle (10), computing a correction factor from the derived relative alignment,
using the correction factor in the estimation of the distance .
4. The method according to one of the claims 1 to 3,
wherein the broadcast data (30) comprises motion data of the neighbouring vehicle (20),
deriving a future position of the neighbouring vehicle (20) from the size-related data and the motion data.
5. The method according to claim 4, comprising
deriving a future position of an image portion that corresponds to the visual feature (22, 23) based on the de¬ rived future position of the neighbouring car (20) .
6. The method according to claim 4 or claim 6 wherein the motion data is derived from GPS data of a GPS system of the neighbouring vehicle (20) .
7. The method according to one of the claims 4 to 6,
wherein the motion data comprises a steering angle, a steering wheel turning rate, a driving speed, a braking deceleration, a braking intensity or a combination thereof .
A computer program product for executing a method according to one of the preceding claims.
A computing unit, the computing unit comprising
a first connection for receiving broadcast data, a second connection for receiving image data,
wherein the computing unit is operative to
receive broadcast data over the first connection, the broadcast data comprising size-related data, the size- related data relating to a visual feature (22, 23) of a neighbouring vehicle (20), and an identifier of the neighbouring vehicle,
receive image data over the second connection, the image data comprising a vehicle image of the neighbouring ve¬ hicle (20),
identify an image portion of the vehicle image that cor¬ responds to the visual feature (22, 23) of the
neighbouring vehicle (20),
estimate a distance from a present vehicle (10) to the neighbouring vehicle (20) by correlating the received distance information with the identified image portion, the estimating a vehicle distance comprising determining a number of pixels (54), wherein the number of pixels
(54) corresponds to an extension of the visual feature
(22, 23) in a pre-determined direction,
extracting a feature distance from the size-related data,
deriving the vehicle distance as a quotient, wherein a denominator of the quotient comprises the number of pix- els (54) and a numerator of the quotient comprises the feature distance.
10. The computing unit according to claim 9, wherein the
computing unit is operative to derive a future position of the neighbouring vehicle (20) .
11. The computing unit according to claim 9 or 10, wherein the computing unit is operative to broadcast size- related data, the size-related data relating to a visual feature of a vehicle (10, 20) in which the computing unit is installed.
12. A vehicle (10) with a computing unit according to one of the claims 9 to 11, the vehicle comprising a receiver antenna (11) and a vehicle camera (12), wherein the re¬ ceiver antenna (11) is connected to the first connection and the vehicle camera (12) is connected to the second connection .
PCT/EP2016/062356 2015-06-15 2016-06-01 Vehicle dimensions and position broadcasting for optical distance measurements Ceased WO2016202586A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP15465523.7 2015-06-15
EP15465523.7A EP3107033A1 (en) 2015-06-15 2015-06-15 Vehicle dimensions and position broadcasting for optical distance measurements

Publications (1)

Publication Number Publication Date
WO2016202586A1 true WO2016202586A1 (en) 2016-12-22

Family

ID=53761314

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2016/062356 Ceased WO2016202586A1 (en) 2015-06-15 2016-06-01 Vehicle dimensions and position broadcasting for optical distance measurements

Country Status (2)

Country Link
EP (1) EP3107033A1 (en)
WO (1) WO2016202586A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090240432A1 (en) * 2008-03-18 2009-09-24 Denso Corporation Vehicle-installation obstacle detection apparatus
US20140085428A1 (en) * 2011-05-11 2014-03-27 Continental Teves Ag & Co. Ohg Distance Measurement by Means of a Camera Sensor

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090240432A1 (en) * 2008-03-18 2009-09-24 Denso Corporation Vehicle-installation obstacle detection apparatus
US20140085428A1 (en) * 2011-05-11 2014-03-27 Continental Teves Ag & Co. Ohg Distance Measurement by Means of a Camera Sensor

Also Published As

Publication number Publication date
EP3107033A1 (en) 2016-12-21

Similar Documents

Publication Publication Date Title
US11222219B2 (en) Proximate vehicle localization and identification
US11544940B2 (en) Hybrid lane estimation using both deep learning and computer vision
CN103847735B (en) The driving support control apparatus of vehicle
US10520949B2 (en) Method and device for localizing a vehicle in its surroundings
CN107993487B (en) Method and device for avoiding emergency vehicle
US8180561B2 (en) Vehicle-installation obstacle detection apparatus
JP4434224B2 (en) In-vehicle device for driving support
US10096244B2 (en) Roadside detection system, roadside unit and roadside communication method thereof
US8204678B2 (en) Vehicle drive assist system
CN113989766B (en) Road edge detection method and road edge detection device applied to vehicle
US11978261B2 (en) Information processing apparatus and information processing method
US20140044311A1 (en) Neighboring vehicle detecting apparatus
CN110942038B (en) Traffic scene recognition method and device based on vision, medium and electronic equipment
US20140149013A1 (en) Vehicle driving support control apparatus
US20200020121A1 (en) Dimension estimating system and method for estimating dimension of target vehicle
US20170091565A1 (en) Object detection apparatus, object detection method, and program
EP2447928A1 (en) Method and apparatus for generating infrastructure-based basic safety message data
JP2017162204A (en) Object detection apparatus, object detection method, and object detection program
WO2023036032A1 (en) Lane line detection method and apparatus
US11715273B2 (en) Method for displaying AR navigation screen, and AR navigation system
CN119207161A (en) A blind spot pedestrian warning method and system based on V2X and machine vision
Schiegg et al. Object Detection Probability for Highly Automated Vehicles: An Analytical Sensor Model.
JP2020113225A (en) Server, system, method and program for managing traffic information, and communication device and mobile object capable of communicating with server
JP7325296B2 (en) Object recognition method and object recognition system
WO2016202586A1 (en) Vehicle dimensions and position broadcasting for optical distance measurements

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16727442

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16727442

Country of ref document: EP

Kind code of ref document: A1