WO2012172580A1 - Améliorations de la détection d'obstacles pour véhicules - Google Patents

Améliorations de la détection d'obstacles pour véhicules Download PDF

Info

Publication number
WO2012172580A1
WO2012172580A1 PCT/IT2012/000138 IT2012000138W WO2012172580A1 WO 2012172580 A1 WO2012172580 A1 WO 2012172580A1 IT 2012000138 W IT2012000138 W IT 2012000138W WO 2012172580 A1 WO2012172580 A1 WO 2012172580A1
Authority
WO
WIPO (PCT)
Prior art keywords
sensor
vehicle
sensor system
control means
response
Prior art date
Application number
PCT/IT2012/000138
Other languages
English (en)
Other versions
WO2012172580A8 (fr
Inventor
Elia CASALE
Original Assignee
Engimec S.R.L.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from GB201109815A external-priority patent/GB201109815D0/en
Priority claimed from GB201111691A external-priority patent/GB201111691D0/en
Application filed by Engimec S.R.L. filed Critical Engimec S.R.L.
Priority to EP12728131.9A priority Critical patent/EP2588881A1/fr
Publication of WO2012172580A1 publication Critical patent/WO2012172580A1/fr
Publication of WO2012172580A8 publication Critical patent/WO2012172580A8/fr

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88Sonar systems specially adapted for specific applications
    • G01S15/93Sonar systems specially adapted for specific applications for anti-collision purposes
    • G01S15/931Sonar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/93Lidar systems specially adapted for specific applications for anti-collision purposes
    • G01S17/931Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9314Parking operations
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/93185Controlling the brakes
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/932Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles using own vehicle data, e.g. ground speed, steering wheel direction
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9322Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles using additional data, e.g. driver condition, road state or weather data
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9327Sensor installation details
    • G01S2013/93271Sensor installation details in the front of the vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9327Sensor installation details
    • G01S2013/93272Sensor installation details in the back of the vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9327Sensor installation details
    • G01S2013/93273Sensor installation details on the top of the vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9327Sensor installation details
    • G01S2013/93275Sensor installation details in the bumper area

Definitions

  • This invention relates to an improvements in obstacle detection for vehicles, and more particularly, but not exclusively the invention relates to sensors and accident prevention systems for vehicles, and particularly ' relates to sensors and systems to prevent collision with obstacles at a low level - that is close to the ground and/or collision with an obstacle at a high level.
  • An example of an obstacle at a low level is uneven or sloping ground, holes or sudden drops.
  • An example of an obstacle at a high level is a garage roof, door or ceiling that is close to the roof of the vehicle.
  • sensors, accident prevention and drive control systems for vehicles are known, operating on a variety of physical sensing principles, for warning and prevention of collisions with obstacles, other vehicles, pedestrians or animals.
  • the sensors or accident prevention systems are linked to a vehicle control so as to for example cut power, apply brakes, steer to avoid an obstacle, or to moderate a vehicle's speed so that it matches another vehicles.
  • the aforementioned sensors and systems are adapted to detect and respond to obstacles, vehicles or people that are present as projections above a surface such as the ground in such a way that a portion of the vehicle is liable to collide with them.
  • Such sensors comprise capacitive sensors, that respond to capacitive coupling between a pair of plates arising from proximity of an object; vision systems in which the content of a scene is analysed to derive information about the position of obstacles relative to the vehicle; radar sensors and ultrasonic acoustic reflection-based sensors, which may have a Doppler sensing capability for example to detect speed of the vehicle relative to the ground or another vehicle.
  • sensors are adapted to look primarily parallel to the ground, and may be mounted for example on the bumper of the car, in many cases one sensor being provided at each corner.
  • Ground sensors for vehicles are also known, that detect the presence of the ground under or in the immediate surroundings of a vehicle, for purposes of measuring the speed of a vehicle over the ground - ultrasonic Doppler sensors are used for this purpose, for example, detecting acoustic signals scattered by the rough surface below the vehicle.
  • Ground sensing is also known as a means for compensating certain types of obstacle sensors, for example those that have a relatively wide field of sensitivity such as capacitive sensors, against transient change in height of a vehicle above the ground, for example through roughness of the surface or action of the vehicle's suspension.
  • the prior art lacks sensors and accident prevention systems adapted to detect another common cause of vehicle mishap: the vehicle running into a ditch, a deep pothole, or over the edge of a drop, such as for example the edge of a roadway or raised area of ground, or a quayside.
  • Such sensors and systems in contrast to those of the prior art described above need to be adapted to observe the ground immediately behind (and optionally in front of) the vehicle, and detect the presence of a change in ground elevation that threatens an accident. The system may then issue a warning, activate a further sensing system, or apply a control to the vehicle (e.g. the brake).
  • the prior art further lacks sensors and accident prevention systems for small, ground level obstacles that may seriously damage a vehicle in motion, such as for example anti-reverse equipment as used in traffic management, protruding rocks or low kerbs that may damage the wheels or underside of the car. Further, hazards exist to children, animals and small valuable items that may be out of sight of a driver, especially in large or high vehicles, and improved devices for detection of such situations, warning and optionally automatic halting of the vehicles are needed.
  • the present invention aims to provide sensors and accident prevention systems that address the above deficiency.
  • a sensor system to detect changes in ground level or profile, comprising: one or more sensor means, each having a response axis at which its response is maximal, the or each sensor being mounted on a vehicle, so that each sensor response axis is at an angle with respect to the vertical; a control means that receives signals from the one or more sensors and which acts to analyse a series of one or more components of the signals, and issues a warning when the result of the correlation indicates a change of ground elevation.
  • the axis of response is directed to intersect the ground at a distance behind or in front of the vehicle, so that the system may give warning before the vehicle reaches the obstacle.
  • control means samples the detector signal at a series of time points as the vehicle moves, and looks for a correlation in the samples that indicates a change in ground level, for example a depression or drop-off, or a raised obstacle or rising slope.
  • the sensor system comprises a position sensor that measures the distance moved by the vehicle, from which the control means receives signals and produces a correlation of signals from the one or more sensor means with information from the distance sensor.
  • the position sensor may be provided as part of the vehicle, the sensor system being adapted to receive information from the position sensor. In other embodiments the position sensor may be provided as part of the sensor system itself.
  • the sensor means may include: radar distance measuring sensors; optical sensors for example based on the detection of back-scattered light from a light source provided as part of the system; ultrasonic sensors based on echo timing; capacitance sensors, in which the degree of capacitive coupling between two plates is determined by the distance to a solid surface, such as the ground or an obstacle.
  • the sensor system comprises an operating program and a memory means in communication with the control means, the operating program providing instructions to the control means to carry out functions that include one or more of: analysing the signal from an individual sensor to separate distance information from noise; comparing the signal from a number of sensors to determine correlations between sensor responses; comparing the sequence of signals over time from a given sensor or number of sensors to determine correlations in time for a given sensor or number of sensors taken together; using information from a vehicle speed sensor or a vehicle position sensor to determine the obstacle sensor output(s) as a function of position of the vehicle; determining the probability that a detected correlation indicates an obstacle; determining the likely location and nature of the obstacle; giving warning to a driver of the vehicle that an obstacle is present; optionally, taking control of an aspect of the vehicle's operation, such as cutting power and applying the brake.
  • the sensor system comprises sensor means having a plurality of different response axes.
  • the control means uses the responses from each of the plurality of response axes in an algorithm to determine the position of the vehicle relative to the obstacle.
  • the system comprises scanning means associated with one or more sensors that act in use to control the direction of the axis of response relative to a reference direction on the vehicle, for example to move the axis of response through an angle relative to the reference direction.
  • the scanning means is adapted to position the axis as a number of pre-set angles with respect to the reference direction.
  • the control means uses information derived from the sensor when the response axis is at a plurality of pre-set angles in an algorithm to determine the position of the vehicle relative to the obstacle.
  • the scanning means is controlled and the angle is set by the control means.
  • the system comprises a sensor array means having plurality of sensors, each having a response axis, the response axes being offset from one another by one or more chosen angles, so providing a plurality of response axes at different angles with respect to a reference direction on the vehicle, so producing a fan-like pattern of response axes.
  • the response axes may be offset by a uniform angle, or may be offset by a variety of angles.
  • the sensor system preferably comprises more than one sensor means or sensor array means, for example at corners of the vehicle, mounted at a known height above the mean position of the ground. Sensors are advantageously provided at the rear corners of the vehicle, but may also be at the front corners, and any location is within the scope of the invention.
  • the system comprises sensor means positioned at more than one height on the vehicle, for example at more than one height at a corner of the vehicle.
  • at least one sensor is located at a low position on the vehicle, for example at around the height of the vehicle bumper.
  • at least one sensor is located near the top of the vehicle, for example near the rear corners of the roof, in order to detect obstacles that may foul the roof, such as a partly closed garage door, a height barrier, or an overhang on a building.
  • an accident warning and prevention system comprising one or more sensor means as above, a control means, an operating program, and a vehicle control means operable by the control means to control or halt operation of the vehicle.
  • the vehicle control means acts to cut power and/or apply a brake to the vehicle, for example to bring it to a halt or to check its operation so as to prompt the user to halt or to avoid the obstacle.
  • the system comprises means to alert the driver to the existence of an obstacle, and optionally to its location and/or nature.
  • the system of the invention exchanges information with one or more components of the vehicle management system so as to effect control over the vehicle.
  • the system exchanges information with a vehicle display system, for example a parking guidance system, in order to give guidance and/or warning regarding obstacles of the kind the system is adapted to detect, and which are not readily detected by sensor systems of the prior art.
  • the system is preferably adapted to detect, warn against and optionally to act to control vehicle movement and protect against risk posed by hazards including for a typical road vehicle: quaysides, drop-offs, ditches, road edges, holes in the road, downward facing kerbs; raised kerbs, anti-back-up devices, obstacles close to the ground such as rocks or debris in the road; items in the vehicle's path such as childrens' toys, tools etc.; persons such as children or persons lying in the road, animals such as pets.
  • the system may be adapted to any type of vehicle, including cars, trucks, construction and production plant, with number, location and type of sensor chosen accordingly. For larger vehicles, the type of hazard against which the system is adapted to protect may differ, and the system may be adapted to protect against larger items than those above.
  • the operating program comprises a means to analyse the sensor data to provide information on the nature and seriousness of the hazard, for example in a preferred embodiment the system is able to interpret the height of a sudden drop-off from the roadway, as being either a kerb over which a vehicle may pass with care, or a quayside, and to warn the driver and optionally to exert control of the vehicle, accordingly. Such warning and control may be exercised at a greater distance from a quayside than from a kerb.
  • the system may comprise means to identify the nature of the hazard and inform a driver, for example by means of comparing sensor signals or a quantity derived from them with values in a look-up table that are characteristic of a hazard type.
  • the operating program further comprises an algorithm to assess the risk posed by the obstacle or hazard identified by the control means using the sensor information.
  • an algorithm may have as inputs information comprising one or more of: sensor information regarding the location of a hazard relative to the vehicle; location relative to one or more wheels or components of the vehicle close to the ground; the speed and direction of the vehicle; the nature of the hazard: drop, raised, how deep/high, does the hazard have a component of movement relative to the vehicle's movement and to the ground, indicating a moving hazard such as a child; the attitude or orientation of the vehicle (for example, is it on an uphill or downhill slope towards the hazard); is the vehicle under power or braking.
  • the system may comprise a look-up table comprising data patterns against which sensor data patterns, or patterns of sensor data as correlated by the control means, are compared in order to identify the risk posed by the hazard.
  • the system may use probabilistic estimation or interpolation to determine an optimum course of action if no pattern corresponds precisely to the pattern of information from the sensors.
  • the system may apply coefficients to weight the various forms of information gathered by the control means in order to assess the risk posed by the hazard.
  • the algorithm preferably then sends signals to the control means in order to carry out a chosen program of actions.
  • the actions may be in sequence of severity and may be chosen according to the degree of risk. For example, on approaching a hazard such as a drop-off the system may give an initial warning to the driver; optionally a statement of the nature of the hazard, distance etc.; a final warning; then an emergency stop. For a more immediate hazard close to the vehicle, or for a moving hazard such as a child, the system may impose an immediate emergency stop. Warnings may be by a variety of means, for example visual, audible, physical (e.g. a temporary brake application).
  • Figure 1a is a diagrammatic side view of a vehicle equipped with a sensor and/or a sensor system according to a first embodiment of the invention, reversing towards a hazard.
  • Figure 1b shows an example of a response from a sensor in the situation shown in figure a.
  • Figure 1c is a diagrammatic side view of a vehicle equipped with a sensor system according to a further embodiment of the invention having a plurality of sensors, reversing towards a hazard.
  • Figure 1 d shows an example of a response from a number of sensors in the situation shown in figure 1 c.
  • Figure 2a is a diagrammatic side view of a vehicle equipped with a sensor system according to a further embodiment of the invention, reversing towards a hazard.
  • Figure 2b shows an example of a typical response from a sensor in the situation shown in figure 2a.
  • Figure 3a is a diagrammatic side view of a vehicle equipped with a sensor system according to a further embodiment of the invention, reversing towards a hazard.
  • Figure 3b shows an example of a typical response from a sensor in the situation shown in figure 2a.
  • Figure 4a is a diagrammatic top view of a vehicle equipped with a sensor system according to an embodiment of the invention, reversing towards a hazard.
  • Figure 4b is a diagrammatic side view of a vehicle equipped with a sensor and system as shown in figure 4a.
  • Figure 4c shows an example of a typical response from a sensor in the situation shown in figures 4a and 4b.
  • Figure 5a is a diagrammatic side view of a vehicle equipped with a sensor system according to an embodiment of the invention, reversing towards a hazard at the roof level of the vehicle.
  • Figure 5b is a diagrammatic side view of a vehicle equipped with a sensor system according to an embodiment of the invention, reversing towards a further configuration of hazard at the roof level of the vehicle.
  • Figure 5c is a diagrammatic side view of a vehicle equipped with a sensor system according to a preferred embodiment of the invention, reversing towards a hazard at the roof level of the vehicle, with optional addition of a further sensor in a different location from the first.
  • FIG. 6 is a block diagram of an apparatus and system according to the invention.
  • Figure 7 is a flow diagram illustrating a mode of operation of an embodiment of the system of the invention.
  • Figure 1a shows a diagram of a vehicle 10 on a ground surface 12 having a first portion 14 and a second portion 16 separated by a hazard in the form of a step 18.
  • a sensor 20 is provided, mounted on the rear of the vehicle, the sensor having an axis of response shown as 22.
  • the sensor may be responsive to signals only along this axis, or may be responsive to a signals in a distribution of directions, preferably centred on this axis, with a sensitivity function centred on the axis.
  • a sensor might be uniformly sensitive about the axis up to a given angle from the axis, and then insensitive; alternatively a sensor may have a continuously varying sensitivity with angle from the axis.
  • the sensor measures distance along the axis of response from the sensor to a point where the axis intersects a surface.
  • the sensor is a radar-based distance monitor that measures distance in terms of time of flight to a back-scatter point, for example by means of phase shift of pulses or interferometry, as known in the art for such sensors.
  • different sensor principles and types may be used, for example optical backscattering sensors.
  • Sensors will in general have significant sensitivity off-axis and will measure distance accurate only to within a range of distance; the following discussion will assume that the on-axis distance measurement is accurate and that allowance for the range of accuracy is incorporated into the sensor system, for example forming part of the operating program of the invention.
  • the axis of response 22 is set at an angle to a reference direction on the vehicle, in figure 1a shown as the vertical at the rear of the vehicle, the angle shown as ⁇ .
  • the distance r along the axis of response as measured by the sensor to the point of backscatter is initially substantially uniform, being backscattering from portion 14 as shown in figure 1b, then goes through a step change at position X2 to a new higher value, being backscattering from portion 16, then remains constant as the vehicle reaches position X3.
  • step 18 is in fact a rising step as shown as 24, then r shows a fall from X2 to X3, as shown in figure 1b.
  • a single sensor allows a drop or rising step to be detected and distinguished.
  • the distance of the step from the sensor can be found from the height h of the sensor above the mean ground level below the car and the angle ⁇ .
  • the profile of the portion 16 may be inferred from the change in r as the vehicle moves from X2 to X3.
  • a ground height sensor 26 is provided to give a measured value of h.
  • the sensor system comprises a control means (not shown) adapted to make repeated measurements of r as the vehicle moves, for example as a function of time or vehicle position, and to interpret the measurements in terms of the nature of the step or hazard 18, as will be described later.
  • Figure 1c shows a diagram of a further embodiment in which two or more sensors are provided, mounted on a vehicle at different heights above the mean ground level, either at a common angle ⁇ with respect to vertical or at differing angles.
  • Three sensors are shown: 20, 30 and 40, with corresponding axes of response 22, 32, 42.
  • the measured distances r to the ground along the axes will increase in the order r(20) ⁇ r(30) ⁇ r(40).
  • the sensors will detect a step change in r at different positions x of the vehicle, or at different elapsed times during movement, as shown in figure 1d.
  • sensor 40 gives warning initially while the vehicle is distant from the step, sensor 30 gives warning at a closer distance, and sensor 20 closer still.
  • the sequence of sensor responses is used by a control means to control a sequence of actions, including warning the driver and optionally halting the vehicle.
  • the information about r from the sensors may be used by the control means to interpret the profiles of the step and of the portions 14 and 16, so as to assess the risk associated with the hazard 18.
  • the angle ⁇ of one or more sensors' axis of response may be set differently from that of others, so as to give a chosen profile of response to a step from the sensors, for example with one sensor giving early warning and two giving a more precise warning when the vehicle is close to the obstacle. It will be appreciated that any number from two sensors upwards may be used in this embodiment.
  • Figure 2a shows a further embodiment in which a sensor 20 is adapted to have more than one axis of response, shown as (a), (b) and (c), each axis being at a different angle ⁇ from vertical.
  • the distances r measured along each axis will be different and will respond to a step 18 at different positions of the vehicle, and at different times as a vehicle approaches the step, in a similar manner to that described above.
  • Figure 2b illustrates a typical pattern of measured r values as the vehicle moves towards the step, with the r value along axis (a) remaining unchanged, the r value along axis (c) undergoing a step change first and that long axis (b) second as the vehicle moves from X1 to X2.
  • the difference in measured r values may be tracked and stored in memory to build up a profile of the ground before and beyond the step.
  • Multiple axes of response may be provided in a preferred embodiment by means of multiple individual sensor components within a common sensor device, or by means of a single sensor component with means that allows one of a number of axis directions to be selected.
  • Figure 3a shows a further embodiment of a sensor system according to the invention, in which a sensor means 20 is mounted on a vehicle and is moveable by a scanning means 26 such that the axis of response is positioned with a controllable angle ⁇ relative to the vertical, for example in positions 22, 32 and 42, at angles D 1 , 02 and D3 to the vertical respectively.
  • a sensor means 20 is mounted on a vehicle and is moveable by a scanning means 26 such that the axis of response is positioned with a controllable angle ⁇ relative to the vertical, for example in positions 22, 32 and 42, at angles D 1 , 02 and D3 to the vertical respectively.
  • Scanning means 26 may comprise means as known in the art, for example a motor means coupled such that the sensor axis direction is moved by the motor, or a solenoid mechanism that acts to set two or more positions of the axis depending on the state of energisation of one or more solenoids.
  • Such scanning means may move the sensor itself, or a response-directing element associated with the sensor, for example a mirror, lens, slit, screen or component of a transducer that controls a signal entry direction.
  • r h/cos(D)
  • For flat ground with no step r increases continuously with ⁇ as shown at 34.
  • r increases step-wise with ⁇ as shown, then increases continuously with ⁇ (resulting from the distance r to a flat profile at a lower level as shown as 16).
  • r increases slowly with ⁇ , then plateaus as the axis scans over the vertical face of the obstacle, then rises suddenly as the axis scans over the top of the obstacle.
  • r will vary with ⁇ in a way that depends on the profile of the ground in portions 14 and 16 before and after the step, and that in all the embodiments above the system is also capable of responding to gradual slopes rather than steps.
  • the invention is particularly well suited for use in mountainous or hilly areas.
  • the profile of the step is interpreted by a control means on the basis of difference in values of r derived from signals from the one or sensor axes, or functions of r(D), the system, and that this information may be gathered as a function of distance of the vehicle from the obstacle, and/or of time, as the vehicle approaches it.
  • the apparatus of the invention also comprises means to detect and interpret obstacles in an x-y position relative to the vehicle. This is useful for example if one wheel of a vehicle is approaching a drop or a hole, but others are not, and so may allow a decision to proceed over the obstacle under certain circumstances.
  • Figure 4a shows a top view of a vehicle 10 having sensors 50 and 60 mounted on its rear corners, approaching a pit 58 behind one wheel. Sensor 50 is adapted to provide three response axes vertically, indicated in figure 4b as (1), (2) and (3). These measure distances r as described previously. In preferred embodiments, and for many sensor types in general, the axis of response will have a lateral extent or spread, as shown in figure 4a as 54 and 56, around a principal axis 52.
  • the response axis is in the form of a circular cone, though this may be an elliptical cone or a rectangular based pyramid.
  • the response of the sensor for response axes (1), (2) and (3) is shown in figure 4c as a function of the position of the pit 58 in the y-direction.
  • the extent of the lateral response lies within the pit 58, and the r values are closely defined as shown.
  • sensor axis (2) has a lateral extent that overlaps the edge of the pit, as shown by the ellipse at (2) in figure 4a.
  • the signal returned from the sensor along axis (2) may then have a range of values, which may be interpreted as a fluctuation in r values as shown as 62 in figure 4c, with an variation in general between values r2 and r2' as shown in figure 4b.
  • Figures 5a - 5c illustrate an embodiment of the invention having sensor positions to achieve detection of a hazard behind a vehicle at a height above the ground, such as a height barrier, low bridge or a low roof or projection from a building.
  • a sensor 70 having a central axis of response 72 and further axes such as 74 to 76 is mounted such that the central axis is parallel to the ground.
  • the differential response from the sensor along the three axes shown does not change greatly as the vehicle approaches an obstacle at close to the height of the vehicle.
  • the sensor system may still detect the front edge of the obstacle by means of axis 72, but other axes will not detect it.
  • Figure 5b for a generalised object such as a partly open garage door, in this embodiment, the object may not be detected efficiently.
  • Figure 5c shows a preferred embodiment in which a sensor 70 has a central axis inclined upwards from the horizontal. In position X1 , only axis 74 intersects the obstacle. In position X2 axis 74 does not intersect, but axis 72 now does.
  • the changing pattern of values of r measured along the axes may be interpreted in preferred embodiments by a control means to identify the hazard 90 and its position.
  • one or more further sensors 80 may be provided as a different height above ground to give a different view of the obstacle, with improvement in detection and interpretation.
  • Figure 6 shows a block diagram of a system 100 according to the invention.
  • a control means 110 receives signals from a number of sensors 102, 104, 106, 108 as described above along signalling connections 114.
  • the four sensors 102-108 are provided at the rear corners of the vehicle: two at a low level, two at a high level, each sensor adapted to measure a distance r to the ground.
  • one or more sensors are adapted to measure r at two or more response axis angles ⁇ .
  • control means controls the axis of response for one or more sensors by signalling along control lines 116.
  • the sensors comprise control subsystems such that communication between the sensor(s) and the control means is by means of data links.
  • Further sensors for example one or more ground position or ground speed sensors 1 12 may be provided as part of the system to provide additional data, for example data on the height of the sensors 102-108 above ground level, to the control means, for example to provide height compensation data.
  • control means is in communication with a source of data 126 associated with the vehicle, for example information on: vehicle speed, whether powered or under braking, suspension conditions (for example, whether the vehicle is on a slope or the mass inside the vehicle).
  • the control means preferably comprises or is in communication with memory means 118, and the system preferably comprises an operating program 120, a look-up table 122 comprising pre-set data on expected sensor response patterns associated with known types of hazard, and optionally a risk- assessment algorithm 124 that in use operates to assess degrees of risk using for example information on the nature and location of the hazard and information about the vehicle conditions (e.g. speed, loading, position on a slope).
  • the control means outputs control signals to a driver audible warning means comprising a sound (e.g. speech) synthesiser 128 and a sound generator 130 and optionally a visible warning means 132, for example coupled to an in-vehicle display.
  • the control means outputs signals to a vehicle control system 134, optionally part of the vehicle operating system that may act in use to slow or halt the vehicle.
  • Figure 7 shows a flow chart for operation of an embodiment of the invention, for example describing part of an operating program forming part of the system of the invention. It will be appreciated that this is an outline only, and that subsystems and subroutines will be included to control operation of portions of the system as will be apparent to the skilled person.
  • the system samples pairs of values rO at time to and r1 at a later time t1 , for one or all sensors, for each of the response axes or a subset of them as may be appropriate. These pairs are stored in a memory means and tracked over time.
  • the set of values of dr with distances moved in the x and optionally the y direction may then be interpreted as a profile of the surface (including potential obstacles) behind the vehicle.
  • the system comprises means to interpret the presence of obstacles in the surface profile. In preferred embodiments this is done by means of comparing a matrix (the 'detection matrix) of values describing the surface profile, for example value of r or of a quantity derived from r, such as the height of the surface, with pre-set 'hazard matrices' stored in a look-up table in memory means forming part of the system, such matrices representing typical values that are associated with obstacles.
  • a matrix the 'detection matrix
  • Such matrices may be an x, y, z or a 3D matrix of the surface topography, or they may be a 2D or 3D matrix for r, x (and optionally y) values as would be encountered by a vehicle approaching an obstacle.
  • the system may comprise models of typical hazards that can be compared with the information about the vehicle's surroundings gathered by the system in use, in order to identify hazards.
  • the system may also comprise models of typical non-hazard situations, and compare information about the vehicle's surroundings with these, in order more positively to exclude the likelihood of a hazard existing.
  • the detection matrix may be compared with the stored matrices to detect a match, allowing the system to recognise a likely hazard and its position relative to the vehicle. If a match is found, the control means may then determine how serious is the risk presented by the hazard. In an emergency it may stop the vehicle.
  • the system may then give an initial warning and then continue to observe values of dr(x, y, t) as the vehicle moves. If there is no match, or no exact match, the system may be adapted to give a warning of an unidentified hazard, The system may later give a second warning, and await a driver response. According to the response and assessment of risk the system may allow progress towards to hazard, may limit the speed of progress, or may halt the vehicle. Warning to a driver may take known forms, such as audible, speech, visual, or a temporary checking of the vehicle to alert attention.
  • Various sensor principles are useable in the system. For example, radar distance sensors, optical sensors based on backscatter from the surface of the ground, ultrasonic sensors based on pulse time of travel or interference principles. Capacitive sensors, or other sensors that do not give distance information to a point on a surface directly, may be used together with appropriate signal processing means forming part of the system to extract distance information. In a preferred embodiment optical sensors based on time-modulated illumination may be used.
  • An optical sensor may comprise a light source and a detector. A light source may be built in to a sensor device or subassembly and may by modulated, for example using LED or laser diode illumination modulated electronically.
  • the light source preferably has an illumination axis and pattern, for example a cone, analogous to the response axis of the sensor as described above.
  • Modulation may be by mechanical means, for example shutter or actuated mirrors, as known in the art.
  • phase sensitive detection is used with a known modulation pattern in order to achieve improved signal to noise ratio.
  • the axis of response may be set or controlled by the inherent response characteristics of the sensor elements used, for example the entry cone angle of a photo detector.
  • the axis may also be set in preferred embodiments by design of a housing in which the detector element is housed.
  • the response axis of the sensor system is controlled by the angular response of the detector element, as mounted and housed within the sensor device.
  • the illumination may be non-directional, or partly so, for example if a light source is used with a wide cone of illumination, such as a LED.
  • the response of the sensor system may be less directional, for example having a broad cone of response, in which case the illumination may be directional, for example as produced by a laser diode, and so the axis of response of the sensor system, comprising illumination and detection means, may be determined primarily by the illumination direction.
  • a probe beam may be provided at one or more known heights from the ground and angles ⁇ to a reference direction, so as to define the axis of response partly by means of an axis of illumination.
  • Means to vary and control the probe beam direction, and means to interpret the resulting sensor responses, are provided and may function in a manner substantially as described above.
  • Devices suitable for use in the sensor system of the invention comprise light sources such as visible and IR LEDs or laser diodes; visible and IR photodetectors such as photodiodes; steerable mirror devices or mountings for detectors, light sources or both to control the angle and direction of a response axis of a detector or an illumination axis of a light source.
  • light sources such as visible and IR LEDs or laser diodes
  • visible and IR photodetectors such as photodiodes
  • the device and system may be modified for use in building (diggers) or construction (cranes) equipment or military vehicles, such as tanks.
  • the invention may be provided in the form of a kit which is able to be retrofitted onto cars, trucks and other ancillary vehicles, such as trailers or caravans or truck semi-trailers.
  • Such systems are adapted to be retro-fitted to a trailer and an alarm provided in a car or cab of a vehicle that is towing the trailer or vehicle.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Acoustics & Sound (AREA)
  • Traffic Control Systems (AREA)
  • Radar Systems Or Details Thereof (AREA)

Abstract

La présente invention concerne un système de détection qui détecte les changements de niveau ou de profil du sol et qui permet à un véhicule d'éviter de se renverser dans un obstacle, tel qu'un caniveau, une bordure de trottoir, un fossé ou une toiture inclinée. Le système comprend un ou plusieurs moyens de détection, chacun ayant un axe de réponse où sa réponse est maximale, le ou les capteurs étant montés sur un véhicule. En fonctionnement, l'axe ou chaque axe de réponse de détection forme un angle par rapport à la verticale et un moyen de contrôle reçoit des signaux provenant du ou des capteurs, analyse une série d'un ou de plusieurs composants des signaux et produit une alerte quand un changement du niveau du sol est détecté. Un freinage peut être éventuellement appliqué automatiquement pour éviter que le véhicule se déplace vers l'obstacle.
PCT/IT2012/000138 2011-06-11 2012-05-14 Améliorations de la détection d'obstacles pour véhicules WO2012172580A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP12728131.9A EP2588881A1 (fr) 2011-06-11 2012-05-14 Améliorations de la détection d'obstacles pour véhicules

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
GB1109815.9 2011-06-11
GB201109815A GB201109815D0 (en) 2011-06-11 2011-06-11 A parking sensor
GB201111691A GB201111691D0 (en) 2011-07-07 2011-07-07 A parking sensor
GB1111691.0 2011-07-07

Publications (2)

Publication Number Publication Date
WO2012172580A1 true WO2012172580A1 (fr) 2012-12-20
WO2012172580A8 WO2012172580A8 (fr) 2013-03-07

Family

ID=46319171

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IT2012/000138 WO2012172580A1 (fr) 2011-06-11 2012-05-14 Améliorations de la détection d'obstacles pour véhicules

Country Status (2)

Country Link
EP (1) EP2588881A1 (fr)
WO (1) WO2012172580A1 (fr)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105164548A (zh) * 2013-04-30 2015-12-16 株式会社电装 障碍物检测装置
CN106671923A (zh) * 2016-12-31 2017-05-17 青岛翰兴知识产权运营管理有限公司 一种车辆辅助驾驶预警方法
US9725040B2 (en) 2014-10-28 2017-08-08 Nissan North America, Inc. Vehicle object detection system
US9834141B2 (en) 2014-10-28 2017-12-05 Nissan North America, Inc. Vehicle object detection system
US9880263B2 (en) 2015-04-06 2018-01-30 Waymo Llc Long range steerable LIDAR system
US9880253B2 (en) 2014-10-28 2018-01-30 Nissan North America, Inc. Vehicle object monitoring system
US9989636B2 (en) 2015-03-26 2018-06-05 Deere & Company Multi-use detection system for work vehicle
CN108919275A (zh) * 2018-05-15 2018-11-30 浙江吉利控股集团有限公司 一种用于防止车辆倒车陷坑的雷达装置
CN110422132A (zh) * 2019-07-31 2019-11-08 南宁学院 一种汽车倒车雷达系统
WO2020064576A1 (fr) * 2018-09-28 2020-04-02 Robert Bosch Gmbh Procédé pour évaluer un effet d'un objet dans l'environnement d'un moyen de transport sur une manœuvre de conduite du moyen de transport
US20220113732A1 (en) * 2018-09-25 2022-04-14 Chiba Institute Of Technology Information processing device and mobile robot
US20220227366A1 (en) * 2021-01-19 2022-07-21 Magna Electronics Inc. Vehicular sensing system with upper and lower sensors and with reconfigurable alert triggers

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10001838A1 (de) * 1998-09-30 2001-07-19 Ericsson Telefon Ab L M Verfahren und System zur Veränderung von Teilnehmerdaten
DE10347980A1 (de) * 2003-08-19 2005-03-17 Volkswagen Ag Steuerung für ein Kraftfahrzeug
US7397351B1 (en) * 2005-07-20 2008-07-08 Bae Systems Information And Electronic Systems Integration Inc. Use of E-field sensors for situation awareness/collision avoidance
US20100302069A1 (en) * 2007-09-05 2010-12-02 Michael Frank Object classification method, parking assistance method, and parking assistance system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3738221A1 (de) * 1987-11-11 1989-06-08 Bayerische Motoren Werke Ag Verfahren und einrichtung zum erkennen des zustandes einer strasse
FR2834914B1 (fr) * 2002-01-18 2006-09-08 Berchet Groupe Soc Vehicule pour enfant muni d'un systeme de detection d'obstacles

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10001838A1 (de) * 1998-09-30 2001-07-19 Ericsson Telefon Ab L M Verfahren und System zur Veränderung von Teilnehmerdaten
DE10347980A1 (de) * 2003-08-19 2005-03-17 Volkswagen Ag Steuerung für ein Kraftfahrzeug
US7397351B1 (en) * 2005-07-20 2008-07-08 Bae Systems Information And Electronic Systems Integration Inc. Use of E-field sensors for situation awareness/collision avoidance
US20100302069A1 (en) * 2007-09-05 2010-12-02 Michael Frank Object classification method, parking assistance method, and parking assistance system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2588881A1 *

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105164548A (zh) * 2013-04-30 2015-12-16 株式会社电装 障碍物检测装置
US10377310B2 (en) 2014-10-28 2019-08-13 Nissan North America, Inc. Vehicle object detection system
US9725040B2 (en) 2014-10-28 2017-08-08 Nissan North America, Inc. Vehicle object detection system
US9834141B2 (en) 2014-10-28 2017-12-05 Nissan North America, Inc. Vehicle object detection system
US9880253B2 (en) 2014-10-28 2018-01-30 Nissan North America, Inc. Vehicle object monitoring system
US9989636B2 (en) 2015-03-26 2018-06-05 Deere & Company Multi-use detection system for work vehicle
US9880263B2 (en) 2015-04-06 2018-01-30 Waymo Llc Long range steerable LIDAR system
US11054505B2 (en) 2015-04-06 2021-07-06 Waymo Llc Long range steerable LIDAR system
CN106671923A (zh) * 2016-12-31 2017-05-17 青岛翰兴知识产权运营管理有限公司 一种车辆辅助驾驶预警方法
CN108919275A (zh) * 2018-05-15 2018-11-30 浙江吉利控股集团有限公司 一种用于防止车辆倒车陷坑的雷达装置
US20220113732A1 (en) * 2018-09-25 2022-04-14 Chiba Institute Of Technology Information processing device and mobile robot
EP3859475A4 (fr) * 2018-09-25 2022-05-04 Chiba Institute of Technology Dispositif de traitement d'informations et robot mobile
WO2020064576A1 (fr) * 2018-09-28 2020-04-02 Robert Bosch Gmbh Procédé pour évaluer un effet d'un objet dans l'environnement d'un moyen de transport sur une manœuvre de conduite du moyen de transport
JP2022502642A (ja) * 2018-09-28 2022-01-11 ロベルト・ボッシュ・ゲゼルシャフト・ミト・ベシュレンクテル・ハフツングRobert Bosch Gmbh 移動手段周辺の物体が移動手段の運転操作に及ぼす影響を評価する方法
CN110422132A (zh) * 2019-07-31 2019-11-08 南宁学院 一种汽车倒车雷达系统
US20220227366A1 (en) * 2021-01-19 2022-07-21 Magna Electronics Inc. Vehicular sensing system with upper and lower sensors and with reconfigurable alert triggers

Also Published As

Publication number Publication date
EP2588881A1 (fr) 2013-05-08
WO2012172580A8 (fr) 2013-03-07

Similar Documents

Publication Publication Date Title
EP2588881A1 (fr) Améliorations de la détection d'obstacles pour véhicules
US8473171B2 (en) Apparatus and method for optimizing a vehicle collision preparation response
US7411486B2 (en) Lane-departure warning system with differentiation between an edge-of-lane marking and a structural boundary of the edge of the lane
US10302760B2 (en) Vehicle water detection system
US9947227B1 (en) Method of warning a driver of blind angles and a device for implementing the method
US6680689B1 (en) Method for determining object classification from side-looking sensor data
US7197388B2 (en) Roll stability control system for an automotive vehicle using an external environmental sensing system
JP5322937B2 (ja) 運動する対象物を検出する装置
KR101328016B1 (ko) 레이저센서와 초음파센서를 기반으로 하는 차량용 충돌방지장치 및 방법
US10059343B2 (en) Apparatus and method for use in a vehicle
AU2007201110A1 (en) Systems and methods for determining threshold warning distances for collision avoidance
CN102963361A (zh) 操作车辆安全系统的方法
US9981667B2 (en) Apparatus and method for use in a vehicle
US20130116905A1 (en) Monitoring System for Monitoring the Surrounding Area, in Particular the Area Behind Motor Vehicles
GB2494020A (en) Directional sensor system for detecting ground profile changes so as to prevent a vehicle from reversing into an obstacle
US8903616B2 (en) Method for increasing the safety of a vehicle and central processing unit for a driver assistance system
WO2015121260A1 (fr) Appareil et procédé destinés à être utilisés dans un véhicule
CN112896135A (zh) 车辆的控制方法、装置、车辆以及存储介质
Kibbel et al. Lane estimation and departure warning using multilayer laserscanner
KR102654008B1 (ko) 검출 장치를 사용하여 모니터링 영역에서 적어도 입자 조성물을 캡처하는 방법 및 광학 검출 장치
KR101328018B1 (ko) 저속 근거리에서의 차량용 충돌방지방법 및 장치
CN113573965A (zh) 用于为运输工具求取由潮湿引起的事故风险的方法
DE112014002961B4 (de) Überschlag-Warnung für Fahrzeuge
KR20220058894A (ko) 터닝 보조 시스템의 작동 방법, 터닝 보조 시스템, 및 이러한 터닝 보조 시스템을 구비한 자동차
US11965991B1 (en) Surface fouling detection

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2012728131

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12728131

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE