EP3124360B1 - Parkhilfevorrichtung - Google Patents

Parkhilfevorrichtung Download PDF

Info

Publication number
EP3124360B1
EP3124360B1 EP16181839.8A EP16181839A EP3124360B1 EP 3124360 B1 EP3124360 B1 EP 3124360B1 EP 16181839 A EP16181839 A EP 16181839A EP 3124360 B1 EP3124360 B1 EP 3124360B1
Authority
EP
European Patent Office
Prior art keywords
obstacle
vehicle
route
virtual
determination unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP16181839.8A
Other languages
English (en)
French (fr)
Other versions
EP3124360A1 (de
Inventor
Yusuke Kiyokawa
Motokatsu Tomozawa
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aisin Corp
Original Assignee
Aisin Seiki Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aisin Seiki Co Ltd filed Critical Aisin Seiki Co Ltd
Publication of EP3124360A1 publication Critical patent/EP3124360A1/de
Application granted granted Critical
Publication of EP3124360B1 publication Critical patent/EP3124360B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • B60Q9/002—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for parking purposes, e.g. for warning the driver that his vehicle has contacted or is about to contact an obstacle
    • B60Q9/004—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for parking purposes, e.g. for warning the driver that his vehicle has contacted or is about to contact an obstacle using wave sensors
    • B60Q9/005—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for parking purposes, e.g. for warning the driver that his vehicle has contacted or is about to contact an obstacle using wave sensors using a video camera
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62D—MOTOR VEHICLES; TRAILERS
    • B62D15/00—Steering not otherwise provided for
    • B62D15/02—Steering position indicators ; Steering position determination; Steering aids
    • B62D15/027—Parking aids, e.g. instruction means
    • B62D15/028—Guided parking by providing commands to the driver, e.g. acoustically or optically
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • B60Q9/002—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for parking purposes, e.g. for warning the driver that his vehicle has contacted or is about to contact an obstacle
    • B60Q9/004—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for parking purposes, e.g. for warning the driver that his vehicle has contacted or is about to contact an obstacle using wave sensors
    • B60Q9/006—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for parking purposes, e.g. for warning the driver that his vehicle has contacted or is about to contact an obstacle using wave sensors using a distance sensor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62D—MOTOR VEHICLES; TRAILERS
    • B62D15/00—Steering not otherwise provided for
    • B62D15/02—Steering position indicators ; Steering position determination; Steering aids
    • B62D15/027—Parking aids, e.g. instruction means
    • B62D15/0285—Parking performed automatically
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/3407—Route searching; Route guidance specially adapted for specific applications
    • G01C21/3415—Dynamic re-routing, e.g. recalculating the route when the user deviates from calculated route or after detecting real-time traffic data or accidents
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3626—Details of the output of route guidance instructions
    • G01C21/3629—Guidance using speech or audio output, e.g. text-to-speech
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3626—Details of the output of route guidance instructions
    • G01C21/365—Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G08G1/168—Driving aids for parking, e.g. acoustic or visual feedback on parking space

Definitions

  • An embodiment of this disclosure relates to a parking assistance device.
  • a parking assistance device may be mounted on a vehicle to assist a driver in parking the vehicle.
  • the parking assistance device detects obstacles such as other stopped vehicles, and determines a route along which the vehicle is capable of avoiding the obstacles and reaching a target parking position.
  • the parking assistance device assists the driver in parking the vehicle based on the route.
  • the document DE 10 2010 061904 A1 is seen as the closest prior art according to the preamble of claim 1 and discloses a parking aid device with at least one sensor, which carries out continuous measurement of a parking space during a fully automatic or semiautomatic parking process and independently corrects the originally calculated parking process when an obstacle is detected.
  • a further example of related art includes JP 2006-193014A .
  • the parking assistance device detects obstacles via various sensors.
  • the sensors may not be able to detect the position of an obstacle in advance depending on the position, size, and shape of the obstacle. If the vehicle moves along a route determined by the parking assistance device in this state, there is a possibility that the vehicle approaches the obstacle.
  • a parking assistance device includes an obstacle detection unit; a target position determination unit; and a route determination unit.
  • the obstacle detection unit detects an obstacle.
  • the target position determination unit determines a target position between a first virtual obstacle, which is based on a first obstacle detected by the obstacle detection unit, and a second virtual obstacle which is based on a second obstacle that is detected by the obstacle detection unit and is lined up with the first obstacle in a row in a first direction.
  • the route determination unit determines a first route from the position of a vehicle to the target position when assisting a driver in parking the vehicle in a parking area, and in a case where while the vehicle travels along the determined first route, the obstacle detection unit has detected a third obstacle which is positioned between the first obstacle and the second obstacle and is closer to the first obstacle than the second obstacle, the route determination unit enlarges the first virtual obstacle toward the target position in the first direction, and determines a second route that avoids the enlarged first virtual obstacle and is set from the position of the vehicle to the target position.
  • the vehicle since the vehicle travels along the second route that is positioned further away from a third obstacle than the first route, the vehicle is capable of traveling toward the target position while avoiding the third obstacle.
  • the route determination unit may determine the second route, and in a case where the distance between the first obstacle and the second obstacle in the first direction is less than the threshold value, the route determination unit may determine a third route which avoids a detected portion of the third obstacle and is set from the position of the vehicle to the target position.
  • the first virtual obstacle is not enlarged. Accordingly, it is possible to prevent interference between the vehicle and the second obstacle.
  • the route determination unit may enlarge the first virtual obstacle in the first direction from a detected portion of the third obstacle toward the target position, and determine the second route which avoids the enlarged first virtual obstacle and is set from the position of the vehicle to the target position.
  • the vehicle since the vehicle moves around the third obstacle along a large curve, even if an undetected portion of the third obstacle is larger than a detected portion of the third obstacle in the first direction, the vehicle is capable of traveling toward the target position while avoiding the third obstacle. Even if the second route interferes with the third obstacle, the number of times of turning the vehicle rightward and leftward is reduced compared to that in a case where the second route is set to not avoid the enlarged first virtual obstacle but only the detected portion of the third obstacle.
  • the route determination unit may enlarge the first virtual obstacle by a predetermined distance toward the target position in the first direction, and determine the second route that avoids the enlarged first virtual obstacle.
  • an enlarged distance of the first virtual obstacle is a constant, and does not change. Accordingly, it is possible to prevent interference between the second route and the second obstacle by increasing the enlarged distance of the first virtual obstacle. Even if the enlarged distance of the first virtual obstacle is smaller than the undetected portion of the third obstacle, the number of times of turning the vehicle rightward and leftward is reduced.
  • the route determination unit may cancel enlargement of the first virtual obstacle.
  • the first virtual obstacle which has been enlarged to a size different from the actual size of the third obstacle, is prevented from affecting parking assistance.
  • a vehicle 1 in the embodiment may be a vehicle equipped with an internal combustion engine (not illustrated) as a drive source, that is, may be an internal combustion engine vehicle.
  • the vehicle 1 may be a vehicle equipped with an electric motor (not illustrated) as a drive source, that is, may be an electric vehicle, a fuel cell vehicle, or the like.
  • the vehicle 1 may be a hybrid vehicle equipped with both an internal combustion engine and an electric motor as drive sources.
  • the vehicle 1 may be a vehicle equipped with another drive source.
  • Various transmissions can be mounted on the vehicle 1.
  • Various devices such as systems or components required to drive an internal combustion engine or an electric motor can be mounted on the vehicle 1.
  • the type, number, and layout of devices relating to driving vehicle wheels 3 of the vehicle 1 can be set in various forms.
  • Fig. 1 is an exemplary perspective view in which a portion of a passenger compartment 2a of the vehicle 1 in the embodiment is seen in perspective.
  • Fig. 2 is an exemplary plan view (bird's-eye view) of the vehicle 1 in the embodiment.
  • a vehicle body 2 forms the passenger compartment 2a in which occupants (not illustrated) are seated.
  • a steering section 4, an acceleration operation section 5, a brake operation section 6, a shift operation section 7, and the like are provided inside the passenger compartment 2a in a state where these sections are disposed in the vicinity of a seat 2b of a driver who is an occupant.
  • the steering section 4 is a steering wheel that protrudes from a dashboard 24.
  • the acceleration operation section 5 is an accelerator pedal positioned under the feet of the driver.
  • the brake operation section 6 is a brake pedal positioned under the feet of the driver.
  • the shift operation section 7 is a shift lever that protrudes from a center console.
  • the steering section 4, the acceleration operation section 5, the brake operation section 6, and the shift operation section 7 are not limited to those components described above.
  • a display device 8 which is a display output unit and a voice output device 9 which is a voice output unit are provided inside the passenger compartment 2a.
  • the display device 8 is a liquid crystal display (LCD), an organic electroluminescence display (OELD), or the like.
  • the voice output device 9 is a speaker or the like.
  • the display device 8 is covered with a transparent operation input unit 10 such as a touch panel.
  • An occupant can observe an image displayed on a display screen of the display device 8 via the operation input unit 10.
  • An occupant can execute an input operation by touching, pressing or moving a portion of the operation input unit 10, which is positioned to correspond to an image displayed on the display screen of the display device 8, with a finger.
  • the display device 8, the voice output device 9, the operation input unit 10, and the like are provided in a monitor device 11 that is positioned in a central portion of the dashboard 24 in a lateral direction of the vehicle, that is, a rightward and leftward direction.
  • the monitor device 11 may include operation input units (not illustrated) such as switches, dials, joysticks, and pressable buttons.
  • a voice output device (not illustrated) may be provided inside the passenger compartment 2a at a position different from the position of the monitor device 11.
  • the voice output device different from the voice output device 9 of the monitor device 11 may output voices.
  • the monitor device 11 can be also used as a navigation system, an audio system, or the like.
  • a display device 12 which is different from the display device 8 is provided inside the passenger compartment 2a.
  • Fig. 3 is a view illustrating an example of the dashboard 24 of the vehicle 1 in the embodiment which is seen from the rear side of the vehicle 1.
  • the display device 12 is provided in an instrument panel section 25 of the dashboard 24, and is positioned between a speed display section 25a and a rotational speed display section 25b at substantially the center of the instrument panel section 25.
  • the size of a screen 12a of the display device 12 is smaller than the size of a screen 8a of the display device 8.
  • the display device 12 is capable of displaying images indicating information mainly regarding assisting the driver in parking the vehicle 1.
  • the amount of information displayed on the display device 12 may be less than the amount of information displayed on the display device 8.
  • the display device 12 is a LCD, an OELD, or the like.
  • the display device 8 may display information that has been displayed on the display device 12.
  • the vehicle 1 is a four wheel drive vehicle, and includes two right and left front wheels 3F, and two right and left rear wheels 3R.
  • the four vehicle wheels 3 are configured such that any one of the four vehicle wheels 3 can be turned.
  • Fig. 4 is an exemplary block diagram of the configuration of a parking assistance system 100 in the embodiment. As illustrated in Fig. 4 , the vehicle 1 includes the parking assistance system 100.
  • the parking assistance system 100 is an example of a parking assistance device.
  • the vehicle 1 includes a steering system 13 that steers at least two vehicle wheels 3.
  • the steering system 13 includes an actuator 13a and a torque sensor 13b.
  • the steering system 13 is electrically controlled by an electronic control unit (ECU) 14 or the like such that the actuator 13a is operated.
  • the steering system 13 is an electric power steering system, a steer by wire (SBW) system, or the like.
  • the steering system 13 complements a steering force by adding torque, that is, assisted torque to the steering section 4 using the actuator 13a, or turns the vehicle wheels 3 using the actuator 13a.
  • the actuator 13a may turn one vehicle wheel 3, or may steer a plurality of the vehicle wheels 3.
  • the torque sensor 13b detects torque that is applied to the steering section 4 by the driver.
  • each of the imaging units 15 is a digital camera with a built-in imaging element such as a charge coupled device (CCD) or a CMOS image sensor (CIS).
  • CCD charge coupled device
  • CIS CMOS image sensor
  • Each of the imaging units 15 is capable of outputting moving image data at a predetermined frame rate.
  • Each of the imaging units 15 includes a wide-angle lens and a fish-eye lens, and for example, is capable of capturing an image of a surrounding area in a range of 140° to 190° in a horizontal direction.
  • the optical axis of each of the imaging units 15 is set to extend obliquely downward. Accordingly, each of the imaging units 15 sequentially captures images of an external environment around the vehicle body 2, which contains road surfaces on which the vehicle 1 is capable of moving, or areas where the vehicle 1 can be parked, and each of the imaging units 15 outputs captured image data.
  • the imaging unit 15a is positioned at a rear end portion 2e of the vehicle body 2, and is provided on a lower wall portion of a door 2h of a rear trunk.
  • the imaging unit 15b is positioned at a right end portion 2f of the vehicle body 2, and is provided on a right rear view mirror 2g.
  • the imaging unit 15c is positioned at an end portion 2c on the front side of the vehicle body 2, that is, the front side of the vehicle body 2 in a forward and rearward direction of the vehicle, and is provided on a front bumper or the like.
  • the imaging unit 15d is positioned at an end portion 2d on the left side of the vehicle body 2, that is, the left side of the vehicle body 2 in the lateral direction of the vehicle, and is provided on a left rear view mirror 2g which is a protrusion.
  • the ECU 14 is capable of generating a wider angle image, or generating a virtual bird's-eye view image of the vehicle 1, which is viewed from the top, by executing computational processes or image processing of image data obtained by the plurality of imaging units 15.
  • a bird's-eye view image is referred to as a planar image.
  • the ECU 14 identifies stall lines or the like, which are marked on road surfaces around the vehicle 1, in images captured by the imaging units 15, and detects (extracts) parking stalls marked by stall lines.
  • the distance measuring units 16 and 17 are sonars that emit ultrasonic waves and capture reflected waves.
  • a sonar is also referred to as a sonar sensor or an ultrasonic detector.
  • the ECU 14 is capable of identifying the presence of an object such as an obstacle positioned around the vehicle 1, and measuring the distance from the vehicle 1 to the object, based on results of detection by the distance measuring units 16 and 17. That is, the distance measuring units 16 and 17 are examples of a detection unit that detects objects.
  • each of the distance measuring units 17 is used to detect an object positioned a relatively short distance away therefrom.
  • each of the distance measuring units 16 is used to detect an object positioned far away therefrom, that is, positioned a relatively long distance therefrom.
  • the distance measuring units 17 are used to detect objects in front and back of the vehicle 1.
  • the distance measuring units 16 are used to detect objects besides the vehicle 1.
  • a brake system 18 In addition to the ECU 14, the monitor device 11, the steering system 13, the distance measuring units 16 and 17, and the like, a brake system 18, a steering angle sensor 19, an accelerator sensor 20, a shift sensor 21, and a vehicle wheel speed sensor 22 are electrically connected to each other via an in-vehicle network 23 which is a telecommunication line.
  • the in-vehicle network 23 is configured as a controller area network (CAN).
  • the ECU 14 is capable of controlling the steering system 13, the brake system 18, or the like by sending control signals via the in-vehicle network 23 thereto.
  • the ECU 14 is capable of receiving results of detection by the torque sensor 13b, the brake sensor 18b, the steering angle sensor 19, the distance measuring units 16, the distance measuring units 17, the accelerator sensor 20, the shift sensor 21, the vehicle wheel speed sensor 22, and the like, or operation signals from the operation input unit 10 and the like.
  • the ECU 14 includes a central processing unit (CPU) 14a; a read only memory (ROM) 14b; a random access memory (RAM) 14c; a display control unit 14d; a voice control unit 14e; a solid state drive (SSD) (flash memory) 14f; and the like.
  • CPU central processing unit
  • ROM read only memory
  • RAM random access memory
  • SD solid state drive
  • the CPU 14a is capable of executing various computational processes and controls such as the processing of images displayed on the display devices 8 and 12, the determination of a movement target position of the vehicle 1, the computing of a movement route of the vehicle 1, a determination as to whether or not the vehicle 1 interferes with an object, automatic control of the vehicle 1, and the releasing of automatic control.
  • the CPU 14a is capable of reading a program installed and stored in a non-volatile storage device such as the ROM 14b, and executing calculations according to the program.
  • the RAM 14c temporarily stores various data which is used in computations performed by the CPU 14a.
  • the display control unit 14d mainly executes image processing of image data obtained by the imaging units 15, and the composition of image data to be displayed on the display device 8.
  • the voice control unit 14e mainly executes processing of voice data output from the voice output device 9.
  • the SSD 14f is a rewritable non-volatile storage unit, and is capable of storing data even if a power supply of the ECU 14 is turned off.
  • the CPU 14a, the ROM 14b, the RAM 14c, and the like are integrated into one package.
  • the ECU 14 may be configured to include another logical processor such as a digital signal processor (DSP), or a logic circuit.
  • DSP digital signal processor
  • a hard disk drive (HDD) may be provided instead of the SSD 14f.
  • the SSD 14f and a HDD may be provided separately from the ECU 14.
  • the brake system 18 is an anti-lock brake system (ABS) that prevents locking of the brakes, an electronic stability control (ESC) that prevents skidding of the vehicle 1 during cornering, an electric brake system that enhances braking force (executes braking assist), a brake by wire (BBW), or the like.
  • ABS anti-lock brake system
  • ESC electronic stability control
  • BBW brake by wire
  • the brake system 18 applies braking force to the vehicle wheels 3, and eventually to the vehicle 1 via an actuator 18a.
  • the brake system 18 is capable of detecting locking of the brakes, slipping of the vehicle wheels 3, or signs of skidding from a difference between the rotational speeds of the right and left vehicle wheels 3, and executing various controls.
  • the brake sensor 18b is a sensor that detects the position of a movable portion of the brake operation section 6.
  • the brake sensor 18b is capable of detecting the position of the brake pedal which is a movable portion of the brake operation section 6.
  • the brake sensor 18b includes a displacement sensor.
  • the steering angle sensor 19 is a sensor that detects the amount of steering of the steering section 4 such as a steering wheel.
  • the steering angle sensor 19 is configured to include a hall element or the like.
  • the ECU 14 acquires the amount of steering of the steering section 4 performed by the driver, or the amount of steering of each vehicle wheel 3 during automatic steering from the steering angle sensor 19, and executes various controls.
  • the steering angle sensor 19 detects the rotational angle of a rotating part of the steering section 4.
  • the steering angle sensor 19 is an example of an angle sensor.
  • the accelerator sensor 20 is a sensor that detects the position of a movable portion of the acceleration operation section 5.
  • the accelerator sensor 20 is capable of detecting the position of the accelerator pedal which is a movable portion.
  • the accelerator sensor 20 includes a displacement sensor.
  • the shift sensor 21 is a sensor that detects the position of a movable portion of the shift operation section 7.
  • the shift sensor 21 is capable of detecting the position of a lever, an arm, a button, or the like which is a movable portion of the shift operation section 7.
  • the shift sensor 21 may include a displacement sensor, or may be configured as a switch.
  • the vehicle wheel speed sensor 22 is a sensor that detects the amount of rotation, or revolutions per unit time of the vehicle wheel 3.
  • the vehicle wheel speed sensor 22 outputs the number of wheel speed pulses as a sensor value which indicates the detected revolutions.
  • the vehicle wheel speed sensor 22 is configured to include a hall element or the like.
  • the ECU 14 computes the amount of movement of the vehicle 1 based on the sensor value acquired from the vehicle wheel speed sensor 22, and executes various controls. In some cases, the vehicle wheel speed sensor 22 may be provided in the brake system 18. In this case, the ECU 14 acquires results of detection by the vehicle wheel speed sensor 22 via the brake system 18.
  • the ECU 14 realizes at least a portion of functions of the parking assistance device via collaboration between hardware and software (control program).
  • Fig. 5 is a block diagram of the functional configuration of the ECU in the embodiment.
  • the ECU 14 serves as a detection unit 141, an operation receiving unit 142, a target position determination unit 143, a movement route determination unit (route determination unit) 144, a movement control unit 145, an output information determination unit 146, and a storage unit 147.
  • the detection unit 141 is an example of an obstacle detection unit.
  • the movement route determination unit 144 is an example of a route determination unit.
  • the detection unit 141 detects obstacles such as other vehicles and pillars, border lines such as parking stall lines, and the like.
  • the operation receiving unit 142 acquires operation signals generated by an input operation of an operation unit 14g.
  • the operation unit 14g is a pressable button, a switch, or the like, and outputs operation signals.
  • the target position determination unit 143 determines a movement target position (target parking position) of the vehicle 1.
  • the movement route determination unit 144 determines a movement route of the vehicle 1 to a movement target position.
  • the movement control unit 145 controls each part of the vehicle 1 such that the vehicle 1 moves to a movement target position (target parking position) along a movement route.
  • the output information determination unit 146 determines information output from the display devices 12 and 8, the voice output device 9, and the like, and the output form of each information.
  • the storage unit 147 stores data that is to be used in computations performed by the ECU 14, or has been calculated in computations performed by the ECU 14.
  • Fig. 6 is a flowchart outlining a process in the embodiment.
  • Fig. 6 first, the ECU 14 detects available parking areas (detects obstacles) (S11).
  • Fig. 7 is a plan view illustrating the detection of available parking areas in the embodiment.
  • the distance measuring units 16a to 16d calculate the distances to obstacles such as other vehicles 301 and 302 at predetermined sampling timings, and output the calculated distances as data that corresponds to reflective portions S (each of which is an aggregation of reflection points Ps at which sound waves or the like are reflected) of the obstacles.
  • the RAM 14c stores the output data at output intervals.
  • the other vehicle 301 is an example of a first obstacle
  • the other vehicle 302 is an example of a second obstacle.
  • the ECU 14 serves as the detection unit 141 to independently detect available parking areas 201 positioned on both the right and the left sides of the vehicle 1, based on the output data of the distance measuring units 16a to 16d.
  • a method of detecting an available parking area 201 on the left side of the vehicle 1 will be described.
  • the detection unit 141 determines that the available parking area 201 is present.
  • the detection unit 141 may detect parking stall lines such as white lines which are provided on a traveling surface such as the ground or a road surface, based on captured image data output from the imaging unit 15a that captures images of the rear side of the vehicle 1. For example, the detection unit 141 detects parking stall lines by performing edge extraction on captured image data that is output from the imaging units 15a to 15d during backward movement, forward movement, or stopping of the vehicle 1.
  • parking stall lines such as white lines which are provided on a traveling surface such as the ground or a road surface
  • the detection of available parking areas will be specifically exemplified with reference to Fig. 7 .
  • the vehicle 1 passes in front of the other vehicles 301 and 302 which are perpendicularly parked.
  • sound waves or the like emitted by the distance measuring units 16a and 16d are reflected by a plurality of the reflection points P of each of the other vehicles 301 and 302.
  • the distance measuring units 16a to 16d calculate the distances to the other vehicles 301 and 302 based on the sound waves or the like reflected by the reflection points Ps.
  • the ECU 14 serving as the detection unit 141 detects the other vehicles 301 and 302 based on data output from the distance measuring units 16a and 16d. If described in detail, the detection unit 141 detects the other vehicle 301 based on data corresponding to the reflective portion S which is an aggregation of the plurality of reflection points Ps on the other vehicle 301. In addition, the detection unit 141 detects the other vehicle 302 based on data corresponding to the reflective portion S which is an aggregation of the plurality of reflection points Ps on the other vehicle 302.
  • the detection unit 141 sets a first virtual obstacle 311 based on the detected other vehicle 301.
  • the detection unit 141 sets a second virtual obstacle 312 based on the detected other vehicle 302.
  • the first virtual obstacle 311 and the second virtual obstacle 312 are illustrated by alternate one long and two short dashes lines.
  • the first virtual obstacle 311 and the second virtual obstacle 312 are data of the obstacles (the other vehicles 301 and 302) detected by the detection unit 141.
  • the positions and sizes of the first virtual obstacle 311 and the second virtual obstacle 312 may be different from the positions and sizes of the other vehicles 301 and 302.
  • the other vehicles 301 and 302 are perpendicularly parked while being spaced away from each other in a lateral direction X.
  • the lateral direction X is an example of a first direction, and rightward and leftward direction of the other vehicles 301 and 302.
  • the other vehicles 301 and 302 are parked in a row in the lateral direction X.
  • the first virtual obstacle 311 and the second virtual obstacle 312 set by the detection unit 141 are also positioned in a row in the lateral direction X while being spaced away from each other.
  • the available parking area 201 is an area between the first virtual obstacle 311 and the second virtual obstacle 312 in the lateral direction X.
  • the ECU 14 serves as the operation receiving unit 142 to determine whether an instruction on transition to a parking assistance mode has been issued via the operation unit 14g (S12). In a case where an instruction on transition to the parking assistance mode has not yet been issued via the operation unit 14g (S12: No), the operation receiving unit 142 enters a standby mode.
  • the ECU 14 serves as the target position determination unit 143 to determine a movement target area (target parking area) 200 of the vehicle 1 (S13).
  • the movement target area 200 is an example of a parking area.
  • the movement target area 200 is disposed inside the available parking area 201.
  • the movement target area 200 is determined such that the movement target area 200 is positioned between the first virtual obstacle 311 and the second virtual obstacle 312 (between the other vehicles 301 and 302).
  • the movement target area 200 is an area in which the vehicle 1 is accommodated when parking is complete.
  • the size of the movement target area 200 is substantially the same as the occupancy space of the vehicle 1.
  • Fig. 8 is a plan view illustrating an example of the setting of a movement route in the embodiment.
  • a movement route is not limited to that case.
  • a movement route may not contain any reverse turning position, or may contain a plurality of reverse turning positions.
  • the movement route determination unit 144 determines a first movement route RTP1 from an initial position P1 when a parking assistance control process of the vehicle 1 is started, to a target parking position P3 via a reverse turning position P2.
  • the initial position P1 is an example of the position of the vehicle.
  • the target parking position P3 is an example of a target position, and for example, is the position of the central point of the vehicle 1 when the parking of the vehicle 1 in the movement target area 200 is complete. If the target position determination unit 143 determines the movement target area 200, the target parking position P3 is determined.
  • the vehicle 1 positioned at the initial position P1 is illustrated by an alternate one long and two short dashes line
  • the vehicle 1 positioned at the reverse turning position P2 is illustrated by a solid line.
  • the first movement route RTP1 is formed such that a driver drives the vehicle 1 forward toward the reverse turning position P2 of the steering wheel (the steering section 4) while turning the steering wheel (the steering section 4) right by a predetermined amount, stops the vehicle 1 by pressing the brakes (the brake operation section 6) at the reverse turning position P2, changes a gear position to a reverse position, and turns the steering wheel (the steering section 4) left toward the target parking position P3.
  • the first movement route RTP1 is a route that contains an arc, a clothoid curve, and a straight line.
  • Fig. 9 is a process flowchart illustrating the parking assistance control process in the embodiment.
  • the ECU 14 serves as the movement control unit 145 to start an automatic steering mode in which automatic steering is performed, so as to control each part of the vehicle 1 such that the vehicle 1 moves to the target parking position P3 of the movement target area 200 along the first movement route RTP1 (S111).
  • a forward movement drive force and a rearward movement drive force of the vehicle 1 in the parking assistance control process are generated by creeping that allows a drive force of an engine to be transmitted to the vehicle 1 even if the driver does not press the accelerator pedal, that is, does not operate the acceleration operation section 5.
  • the driver merely operates the brake pedal (the brake operation section 6) and the shift lever (the shift operation section 7) according to display on the display device 12.
  • the brake pedal (the brake operation section 6) and the shift lever (the shift operation section 7) may be automatically operated.
  • the ECU 14 serving as the movement control unit 145 detects the position of the host vehicle (S112). Specifically, the ECU 14 detects the position of the host vehicle by calculating the distance of the vehicle 1, which is the amount of movement from the initial position P1, and the direction of the vehicle 1 based on the amount of steering of the steering section 4 detected by the steering angle sensor 19, and a vehicle speed detected by the vehicle wheel speed sensor 22.
  • the ECU 14 compares the set route with the position of the host vehicle (S113).
  • the ECU 14 serves as the output information determination unit 146 to determine information regarding the state of the vehicle and an operation instruction to the driver, and to display the state information and the operation instruction on the display device 12 (S114).
  • the ECU 14 serves as the movement control unit 145 to determine whether the position of the host vehicle has reached the target parking position P3 (S115). In a case where the position of the host vehicle has not yet reached the target parking position P3 (S115: No), the ECU 14 serving as the movement control unit 145 determines whether an enlargement process (to be described later) has been performed (S116). In the embodiment, the enlargement process has not yet been performed (S116: No), and thus, the ECU 14 serves as the detection unit 141 to determine whether an undetected obstacle has been detected (S117).
  • Fig. 10 is a plan view illustrating the detection of an undetected obstacle in the embodiment.
  • an obstacle 303 is present between the other vehicles 301 and 302.
  • the obstacle 303 is an example of a third obstacle.
  • the obstacle 303 is an obstacle that has not initially been detected by the detection unit 141 (S11).
  • the obstacle 303 is a pillar which is thin in the lateral direction X.
  • An end portion of the obstacle 303 in a forward and rearward direction Z is positioned further away from the vehicle 1 than end portions of the other vehicles 301 and 302 in the forward and rearward direction Z.
  • the forward and rearward direction Z is an example of a second direction, and is a direction perpendicular to the lateral direction X.
  • the distance measuring units 16a and 16d may have difficulty detecting a relatively small obstacle and an obstacle positioned far away therefrom. For this reason, the obstacle 303 has not been detected during the detection of available parking areas in S11.
  • the obstacle 303 is positioned closer to the other vehicle 301 from the other vehicle 302. In addition, the obstacle 303 is positioned between the other vehicle 301 and the movement target area 200. The other vehicle 301 is closer to the initial position P1 of the vehicle 1 than the other vehicle 302. The obstacle 303 is positioned inside of (positioned close to the center) the first movement route RTP1 containing an arc and clothoid curve.
  • the vehicle 1 If parking assistance is activated, and the vehicle 1 travels along the first movement route RTP1 determined by the movement route determination unit 144, the vehicle 1 approaches the obstacle 303. If the vehicle 1 approaches the obstacle 303, the distance measuring units 16 and 17 of the vehicle 1 output data corresponding to the reflective portion S (the reflection points Ps) of the obstacle 303.
  • the reflection points Ps of the obstacle 303 reflect sound waves or the like which are emitted by one of the distance measuring units 17a and 17b disposed at the rear end portion 2e of the vehicle 1.
  • the distance measuring units 17a and 17b calculate the distance to the obstacle 303 based on the sound waves or the like.
  • the detection unit 141 detects the presence and the position of the obstacle 303 based on the distances to the obstacle 303 calculated by the distance measuring units 17a and 17b. Specifically, the detection unit 141 detects the position of the obstacle 303 via triangulation based on the distance to the obstacle 303 detected by the distance measuring unit 17a, and the distance to the obstacle 303 detected by the distance measuring unit 17b.
  • Fig. 11 is a process flowchart illustrating an enlargement process for a virtual obstacle in the embodiment.
  • the ECU 14 serves as the target position determination unit 143 to determine whether a width distance D (refer to Fig. 10 ) between the first virtual obstacle 311 and the second virtual obstacle 312 (between the other vehicles 301 and 302) in the lateral direction X is greater than a predetermined threshold value (S211).
  • the threshold value is a value obtained by adding a predetermined margin to the width of the vehicle 1.
  • the ECU 14 serves as the detection unit 141 to determine whether the obstacle 303 is positioned inside of the first movement route RTP1 (S212). As described above, in the embodiment illustrated in Fig. 10 , the obstacle 303 is positioned inside (positioned closer to the center) of the first movement route RTP1 (S212: Yes). In this case, the ECU 14 serves as the detection unit 141 to determine whether the position of the obstacle 303 has been detected (S213).
  • the detection unit 141 in the embodiment detects the position of the obstacle 303 via the distance measuring units 17a and 17b (S213: Yes). In this case, the detection unit 141 combines together the first virtual obstacle 311 and the obstacle 303, the position of which has been detected (S214).
  • Fig. 12 is a plan view illustrating the enlargement process for the virtual obstacle in the embodiment. In Fig. 12 , the first virtual obstacle 311 and the obstacle 303 which have been combined together are illustrated by an alternate one long and two short dashes line that passes through the reflection point Ps on the obstacle 303. As illustrated in Fig.
  • the detection unit 141 assumes that the first virtual obstacle 311 also occupies an area (for example, an area up to the reflection point Ps) in the lateral direction X in which the obstacle 303 has been detected.
  • the ECU 14 serves as the movement route determination unit 144 to enlarge the first virtual obstacle 311 toward the target parking position P3 (S215).
  • the movement route determination unit 144 temporarily enlarges the first virtual obstacle 311 toward the target parking position P3 in the lateral direction X.
  • the movement route determination unit 144 enlarges the first virtual obstacle 311 toward the target parking position P3 from the area (end portion of the combined first virtual obstacle 311) in which the obstacle 303 has been detected.
  • the movement route determination unit 144 enlarges the first virtual obstacle 311 a predetermined distance De.
  • the value of an enlargement distance of the first virtual obstacle 311 is a constant. If the first virtual obstacle 311 has been enlarged, the enlargement process for the virtual obstacle is terminated.
  • Fig. 13 is a plan view illustrating an example of the resetting of a movement route in the embodiment.
  • the movement route determination unit 144 determines a second movement route RTP2 which avoids the enlarged first virtual obstacle 311 and is set from a current position P4 of the vehicle 1 to the target parking position P3 via a reverse turning position P5.
  • the position P4 is a position at which the ECU 14 serving as the detection unit 141 has detected the obstacle 303.
  • the position P4 is a position at which the ECU 14 serving as the movement route determination unit 144 has set a reverse turning point to trace the second movement route RTP2.
  • the position P4 is an example of the position of the vehicle.
  • the second movement route RTP2 is formed such that the driver drives the vehicle 1 forward toward the reverse turning position P5 of the steering wheel (the steering section 4) while slightly turning the steering wheel (the steering section 4) left, stops the vehicle 1 by pressing the brakes (the brake operation section 6) at the reverse turning position P5, changes a gear position to a reverse position, and turns the steering wheel (the steering section 4) left toward the target parking position P3.
  • the second movement route RTP2 passes outside of (between the first movement route RTP1 and the second virtual obstacle 312) the first movement route RTP1.
  • the second movement route RTP2 is a route that further curves around the other vehicle 301 than the first movement route RTP1.
  • the ECU 14 causes the process to transit to S112, and then repeats the same process. That is, in an automatic steering mode, the movement control unit 145 controls each part of the vehicle 1 such that the vehicle 1 travels along the second movement route RTP2 according to various controls.
  • Fig. 14 is a plan view illustrating an advancing distance in the embodiment. As illustrated in Fig. 14 , if the vehicle 1 travels along the second movement route RTP2, a portion of the vehicle 1 enters the movement target area 200. In other words, a portion of the vehicle 1 is positioned between the other vehicles 301 and 302.
  • the ECU 14 serves as the movement route determination unit 144, and determines whether the vehicle 1 has advanced a predetermined distance or longer from the position P4 at which the steering wheel has been reversely turned (S120).
  • the ECU 14 serves as the movement control unit 145 to calculate the advancing distance of the vehicle 1 from the position P4, based on the detected position of the host vehicle.
  • the ECU 14 serving as the movement control unit 145 calculates a distance Di which is an advancing distance of the vehicle 1 from the position P4 in the forward and rearward direction Z.
  • the distance Di is a distance between the position of the vehicle 1 and the position P4 at which the obstacle 303 has been detected by the ECU 14 serving as the detection unit 141.
  • the ECU 14 serves as the movement route determination unit 144 to compare a predetermined threshold value with the advancing distance Di of the vehicle 1 from the position P4, and to determine whether the vehicle 1 has advanced a predetermined distance or longer from the position P4. In a case where the distance Di is greater than the threshold value (S120: Yes), the ECU 14 serving as the movement route determination unit 144 cancels enlargement of the first virtual obstacle 311 or the second virtual obstacle 312 (S121). If the first virtual obstacle 311 and the second virtual obstacle 312 have not been enlarged (S120: No), the ECU 14 serves as the movement route determination unit 144, and transits to the recalculation of a movement route (S119).
  • the ECU 14 serves as the movement route determination unit 144, and transits to the recalculation of a movement route (S119).
  • the vehicle 1 does not necessarily move along a set movement route. For this reason, a movement route more optimized for actual situations is maintained by recalculating and resetting a movement route (S119).
  • the ECU 14 serves as the movement control unit 145 to cancel the automatic steering mode (S122).
  • the ECU 14 serves as the output information determination unit 146 to cause the display device 12 to display a message indicating that parking assistance is complete, and to terminate the parking assistance.
  • the position of the obstacle 303 may be uncertain (S213: No).
  • the movement route determination unit 144 temporarily enlarges the first virtual obstacle 311 toward the target parking position P3 in the lateral direction X without combining together the first virtual obstacle 311 and the obstacle 303 (S215).
  • the obstacle 303 may be positioned outside of (outer circumferential side) the first movement route RTP1 (S212: No).
  • the ECU 14 serves as the detection unit 141 to determine whether the position of the obstacle 303 has been detected (S216).
  • the other vehicle 302 is an example of the first obstacle
  • the other vehicle 301 is an example of the second obstacle
  • the second virtual obstacle 312 is an example of the first virtual obstacle
  • the first virtual obstacle 311 is an example of the second virtual obstacle.
  • the ECU 14 serving as the detection unit 141 In a case where the ECU 14 serving as the detection unit 141 has detected the position of the obstacle 303 (S216: Yes), the ECU 14 combines together the second virtual obstacle 312 and the obstacle 303, the position of which has been detected (S217). Since the second virtual obstacle 312 and the obstacle 303 have been combined together, the ECU 14 serving as the detection unit 141 assumes that the second virtual obstacle 312 also occupies an area in the lateral direction X in which the obstacle 303 has been detected.
  • the ECU 14 serves as the movement route determination unit 144 to enlarge the second virtual obstacle 312 toward the target parking position P3 (S218).
  • the ECU 14 serving as the movement route determination unit 144 virtually enlarges the second virtual obstacle 312 toward the target parking position P3 in the lateral direction X.
  • the ECU 14 serving as the movement route determination unit 144 temporarily enlarges the second virtual obstacle 312 toward the target parking position P3 in the lateral direction X without combining together the second virtual obstacle 312 and the obstacle 303 (S218). If the second virtual obstacle 312 has been enlarged, the process of enlarging the virtual obstacle is terminated.
  • Fig. 15 is a plan view illustrating another example of the resetting of a movement route in the embodiment. As illustrated in Fig. 15 , in a case where the obstacle 303 has been detected, but the first virtual obstacle 311 and the second virtual obstacle 312 have not been enlarged, the ECU 14 serves as the movement route determination unit 144 to determine a third movement route RTP3.
  • the third movement route RTP3 is an example of a third route.
  • the third movement route RTP3 is a route which avoids a detected portion of the obstacle 303 and is set from the current position of the vehicle 1 to the target parking position P3. That is, the ECU 14 serves as the movement route determination unit 144 to determine the third movement route RTP3 that avoids the newly detected obstacle 303.
  • the movement route determination unit 144 enlarges the first virtual obstacle 311 toward the target parking position P3 in the lateral direction X in which the other vehicles 301 and 302 are parked in a row, and determines the second movement route RTP2 which avoids the enlarged first virtual obstacle 311 and leads to the target parking position P3. Since the vehicle 1 travels along the second movement route RTP2 that is positioned further away from the obstacle 303 than the first movement route RTP1, the vehicle 1 is capable of traveling toward the target parking position P3 while avoiding the obstacle 303.
  • the detection unit 141 detects the distance between the vehicle 1 and the obstacle 303, but may not be able to detect the position of the obstacle 303. Since the second movement route RTP2 determined by the movement route determination unit 144 is positioned further away from the other vehicle 301 than the first movement route RTP1, even if the position of the obstacle 303 is uncertain, the vehicle 1 is capable of traveling toward the target parking position P3 via reverse turning of the steering wheel while avoiding the obstacle 303.
  • the movement route determination unit 144 enlarges the first virtual obstacle 311 from the detected portion of the obstacle 303 toward the target parking position P3, and determines the second movement route RTP2 which avoids the enlarged first virtual obstacle 311 and leads to the target parking position P3. Since the vehicle 1 moves around the obstacle 303 along a large curve, even if an undetected portion of the obstacle 303 is larger than a detected portion of the obstacle 303 in the lateral direction X, the vehicle 1 is capable of traveling toward the target parking position P3 while avoiding the obstacle 303.
  • the movement route determination unit 144 enlarges the first virtual obstacle 311 the predetermined distance De.
  • the enlarged distance De of the first virtual obstacle 311 is a constant, and does not change. Accordingly, it is possible to prevent interference between the second movement route RTP2 and the other vehicle 302 by increasing the enlarged distance of the first virtual obstacle 311. Even if the enlarged distance De of the first virtual obstacle 311 is smaller than the undetected portion of the obstacle 303, the number of times of turning the vehicle 1 rightward and leftward is reduced.
  • the movement route determination unit 144 determines the third movement route RTP3 which avoids the detected portion of the obstacle 303 and leads to the target parking position P3. In other words, in a case where the distance between the other vehicles 301 and 302 is short, the first virtual obstacle 311 is not enlarged. Accordingly, it is possible to prevent interference between the vehicle 1 and the other vehicle 302.
  • the movement route determination unit 144 cancels the enlargement of the first virtual obstacle 311. Accordingly, the first virtual obstacle 311, which has been enlarged to a size different from the actual size of the obstacle 303, is prevented from affecting parking assistance. If at least a portion of the vehicle 1 enters an area between the other vehicles 301 and 302, the detection unit 141 more accurately detects the positions of the other vehicles 301 and 302 and the obstacle 303. For this reason, parking assistance is more accurately performed compared to a case in which parking assistance is performed based on the enlarged first virtual obstacle 311.
  • a route determination unit enlarges a first virtual obstacle toward a target position, and determines a second route that avoids the enlarged first virtual obstacle. Accordingly, a vehicle is capable of traveling toward the target position while avoiding a third obstacle.
  • a parking assistance device includes: an obstacle detection unit (141) detecting an obstacle (303); a target position determination unit (143) determining a target position (P3) between a first virtual obstacle (311), based on a first obstacle, and a second virtual obstacle (312) based on a second obstacle being lined up with the first obstacle in a first direction; and a route determination unit (144) determining a first route (RTP1) from the position of a vehicle (1) to the target position, and that, when while the vehicle travels along the determined first route, the obstacle detection unit has detected a third obstacle positioned between the first and second obstacles and closer to the first obstacle than the second obstacle, enlarges the first virtual obstacle, and determines a second route (RTP2) that avoids the enlarged first virtual obstacle and is set from the position of the vehicle to the target position.
  • RTP1 first route
  • RTP2 second route

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
  • Traffic Control Systems (AREA)
  • Steering Control In Accordance With Driving Conditions (AREA)

Claims (4)

  1. Parkassistenzvorrichtung, mit:
    einer Hinderniserfassungseinheit (141), die ein Hindernis (303) erfasst;
    einer Zielpositionsbestimmungseinheit (143), die eine Zielposition (P3) zwischen einem ersten virtuellen Hindernis (311), das auf einem von der Hinderniserfassungseinheit erfassten ersten Hindernis basiert, und einem zweiten virtuellen Hindernis (312), das auf einem zweiten Hindernis basiert, das von der Hinderniserfassungseinheit erfasst und mit dem ersten Hindernis in einer Reihe in einer ersten Richtung ausgerichtet ist, bestimmt; und
    einer Routenbestimmungseinheit (144), die eine erste Route (RTP1) von der Position eines Fahrzeugs (1) zu der Zielposition bestimmt, wenn ein Fahrer bei dem Parken des Fahrzeugs auf einem Parkplatz assistiert wird, und die in einem Fall, in dem, während das Fahrzeug entlang der bestimmten ersten Route fährt, die Hinderniserfassungseinheit ein drittes Hindernis erfasst hat, das sich zwischen dem ersten Hindernis und dem zweiten Hindernis befindet und näher am ersten Hindernis als am zweiten Hindernis liegt, das erste virtuelle Hindernis zu der Zielposition hin in die erste Richtung vergrößert, und eine zweite Route (RTP2) bestimmt, die das vergrößerte erste virtuelle Hindernis umgeht und von der Fahrzeugposition zu der Zielposition eingestellt ist,
    dadurch gekennzeichnet, dass
    in einem Fall, in dem ein Abstand (D) zwischen dem ersten Hindernis und dem zweiten Hindernis in der ersten Richtung größer als ein Schwellenwert ist, die Routenbestimmungseinheit die zweite Route bestimmt, und in einem Fall, in dem der Abstand zwischen dem ersten Hindernis und dem zweiten Hindernis in der ersten Richtung kleiner als der Schwellenwert ist, die Routenbestimmungseinheit eine dritte Route bestimmt, die einen erfassten Abschnitt des dritten Hindernisses umgeht und von der Fahrzeugposition zu der Zielposition eingestellt ist.
  2. Parkassistenzvorrichtung gemäß Anspruch 1,
    wobei in einem Fall, in dem die Hinderniserfassungseinheit das dritte Hindernis erfasst hat, während das Fahrzeug entlang der ersten Route fährt, die Routenbestimmungseinheit das erste virtuelle Hindernis in der ersten Richtung von einem erfassten Abschnitt des dritten Hindernisses zu der Zielposition hin vergrößert, und die zweite Route bestimmt, die das vergrößerte erste virtuelle Hindernis umgeht und von der Fahrzeugposition zu der Zielposition eingestellt ist.
  3. Parkassistenzvorrichtung gemäß Anspruch 1 oder 2,
    wobei die Routenbestimmungseinheit das erste virtuelle Hindernis um eine vorbestimmte Distanz zu der Zielposition hin in der ersten Richtung vergrößert, und die zweite Route bestimmt, die das vergrößerte erste virtuelle Hindernis umgeht.
  4. Parkassistenzvorrichtung gemäß einem der Ansprüche 1 bis 3,
    wobei in einem Fall, in dem sich mindestens ein Teil des Fahrzeugs zwischen dem ersten Hindernis und dem zweiten Hindernis befindet, und ein Abstand zwischen einer Position, an der die Hinderniserfassungseinheit das dritte Hindernis erfasst hat, und der Position des Fahrzeugs in einer zweiten Richtung, die die erste Richtung schneidet, größer als ein Schwellenwert ist, die Routenbestimmungseinheit eine Vergrößerung des virtuellen ersten Hindernisses aufhebt.
EP16181839.8A 2015-07-31 2016-07-29 Parkhilfevorrichtung Active EP3124360B1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2015152792A JP6547495B2 (ja) 2015-07-31 2015-07-31 駐車支援装置

Publications (2)

Publication Number Publication Date
EP3124360A1 EP3124360A1 (de) 2017-02-01
EP3124360B1 true EP3124360B1 (de) 2019-02-27

Family

ID=56896321

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16181839.8A Active EP3124360B1 (de) 2015-07-31 2016-07-29 Parkhilfevorrichtung

Country Status (3)

Country Link
US (1) US9925919B2 (de)
EP (1) EP3124360B1 (de)
JP (1) JP6547495B2 (de)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017030569A (ja) * 2015-07-31 2017-02-09 アイシン精機株式会社 駐車支援装置
US10480157B2 (en) * 2016-09-07 2019-11-19 Caterpillar Inc. Control system for a machine
JP6969124B2 (ja) * 2017-03-22 2021-11-24 株式会社アイシン 運転制御装置
JP6724853B2 (ja) * 2017-04-24 2020-07-15 アイシン精機株式会社 駐車支援装置
JP6930213B2 (ja) * 2017-05-23 2021-09-01 株式会社アイシン 駐車支援システム及び駐車支援方法
JP7095968B2 (ja) 2017-10-02 2022-07-05 トヨタ自動車株式会社 管理装置
CN111867893B (zh) * 2018-03-22 2022-09-09 日立安斯泰莫株式会社 驻车辅助装置
JP7013996B2 (ja) * 2018-03-27 2022-02-01 トヨタ自動車株式会社 車両制御装置
DE102018109478A1 (de) * 2018-04-20 2019-10-24 Valeo Schalter Und Sensoren Gmbh Ermitteln einer Parkposition
CN108437892B (zh) * 2018-05-14 2020-01-31 北京长城华冠汽车技术开发有限公司 泊车辅助告警系统、告警方法及汽车
CN112313128B (zh) * 2018-06-22 2024-09-27 日立安斯泰莫株式会社 车辆控制装置
KR102452556B1 (ko) * 2018-08-28 2022-10-07 현대자동차주식회사 차량 주차 제어 장치, 그를 포함한 시스템 및 그 방법
JP7107125B2 (ja) * 2018-09-19 2022-07-27 トヨタ自動車株式会社 車両制御装置
DE112018008050T5 (de) * 2018-10-03 2021-06-24 Mitsubishi Electric Corporation Einparkhilfevorrichtung und Einparkhilfeverfahren
US11079760B2 (en) * 2018-11-28 2021-08-03 The Boeing Company Methods for maintaining difficult-to-access structures using unmanned aerial vehicles
JP7212556B2 (ja) * 2019-03-15 2023-01-25 日立Astemo株式会社 車両制御装置
WO2020196676A1 (ja) * 2019-03-26 2020-10-01 ソニーセミコンダクタソリューションズ株式会社 画像処理装置、車両制御装置、および方法、並びにプログラム
JP7346129B2 (ja) * 2019-07-29 2023-09-19 フォルシアクラリオン・エレクトロニクス株式会社 駐車支援装置及び駐車支援装置の制御方法
JP7147728B2 (ja) * 2019-10-11 2022-10-05 トヨタ自動車株式会社 駐車支援装置
JP7247849B2 (ja) * 2019-10-11 2023-03-29 トヨタ自動車株式会社 駐車支援装置
JP7448404B2 (ja) * 2020-03-31 2024-03-12 本田技研工業株式会社 駐車支援システム
CN113734152A (zh) * 2020-05-27 2021-12-03 佛吉亚歌乐电子有限公司 驻车支援装置、以及驻车支援装置的控制方法
JP7445515B2 (ja) * 2020-05-27 2024-03-07 フォルシアクラリオン・エレクトロニクス株式会社 駐車支援装置、及び駐車支援装置の制御方法
JP7559473B2 (ja) 2020-09-29 2024-10-02 株式会社アイシン 駐車支援システム、駐車支援方法、及びプログラム
CN112744214B (zh) * 2021-01-19 2022-12-09 广州橙行智动汽车科技有限公司 用于车辆远程遥控泊车的控制系统、控制方法和车辆
US20220379882A1 (en) * 2021-05-28 2022-12-01 Jaguar Land Rover Limited Apparatus and method for controlling vehicle movement
CN113516852B (zh) * 2021-07-22 2022-09-09 珠海小可乐科技有限公司 一种多车位多目标车辆停车识别方法及其系统
JP7478123B2 (ja) 2021-09-29 2024-05-02 株式会社アイシン 運転支援装置および車両

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3575364B2 (ja) * 1999-12-28 2004-10-13 株式会社豊田自動織機 操舵支援装置
DE102004027640A1 (de) * 2004-06-05 2006-06-08 Robert Bosch Gmbh Verfahren und Vorrichtung zum unterstützten Einparken eines Kraftfahrzeuges
JP4179285B2 (ja) 2005-01-12 2008-11-12 トヨタ自動車株式会社 駐車支援装置
JP4760272B2 (ja) * 2005-09-30 2011-08-31 アイシン精機株式会社 車両周辺監視装置及びセンサユニット
JP4697230B2 (ja) * 2005-11-17 2011-06-08 アイシン精機株式会社 駐車支援装置及び駐車支援方法
US7375620B2 (en) * 2005-12-08 2008-05-20 Gm Global Technology Operations, Inc. Speed-sensitive rear obstacle detection and avoidance system
JP4769625B2 (ja) * 2006-04-25 2011-09-07 トヨタ自動車株式会社 駐車支援装置及び駐車支援方法
JP4380655B2 (ja) * 2006-04-25 2009-12-09 トヨタ自動車株式会社 駐車支援装置及び駐車支援方法
DE102008027779A1 (de) * 2008-06-11 2009-12-17 Valeo Schalter Und Sensoren Gmbh Verfahren zur Unterstützung eines Fahrers eines Fahrzeugs beim Einparken in eine Parklücke
DE102008028763A1 (de) * 2008-06-17 2009-12-24 Valeo Schalter Und Sensoren Gmbh Verfahren und Vorrichtung zur Unterstützung eines Einparkvorgangs eines Fahrzeugs
JP5403330B2 (ja) * 2009-02-25 2014-01-29 アイシン精機株式会社 駐車支援装置
JP5376223B2 (ja) * 2009-05-18 2013-12-25 アイシン精機株式会社 運転支援装置
DE102009028251A1 (de) * 2009-08-05 2011-02-10 Robert Bosch Gmbh Verfahren zum unterstützen Einparken in eine Parklücke und Vorrichtung hierzu
DE102010002105A1 (de) * 2010-02-18 2011-08-18 Robert Bosch GmbH, 70469 Verfahren zur Unterstützung eines Fahrers eines Fahrzeugs bei einem Fahrmanöver
DE102010023162A1 (de) * 2010-06-09 2011-12-15 Valeo Schalter Und Sensoren Gmbh Verfahren zum Unterstützen eines Fahrers eines Kraftfahrzeugs beim Einparken in eine Parklücke, Fahrerassistenzeinrichtung und Kraftfahrzeug
DE102010047161A1 (de) * 2010-09-30 2012-04-05 Valeo Schalter Und Sensoren Gmbh Verfahren und Vorrichtung zur Unterstützung eines Parkvorgangs eines Fahrzeugs
DE102010061904A1 (de) * 2010-11-24 2012-05-24 Robert Bosch Gmbh Verfahren zur Unterstützung eines Einparkvorgangs
JP5857900B2 (ja) * 2012-07-18 2016-02-10 アイシン精機株式会社 駐車支援装置
DE102013002283A1 (de) * 2013-02-08 2014-08-14 Volkswagen Ag Verfahren und Vorrichtung zum Vorwärtseinparken eines Kraftfahrzeugs in eine Querparklücke
JP5890788B2 (ja) * 2013-02-15 2016-03-22 株式会社日本自動車部品総合研究所 駐車空間検知装置
JP5937980B2 (ja) 2013-02-15 2016-06-22 株式会社日本自動車部品総合研究所 障害物検知装置
KR101498976B1 (ko) * 2013-12-19 2015-03-05 현대모비스(주) 차량용 주차지원시스템 및 주차지원방법
JP6326241B2 (ja) 2014-02-17 2018-05-16 槌屋ティスコ株式会社 紛体シール部材
US10328932B2 (en) * 2014-06-02 2019-06-25 Magna Electronics Inc. Parking assist system with annotated map generation
DE102015204129B4 (de) * 2015-03-08 2019-07-04 Bayerische Motoren Werke Aktiengesellschaft Ausrichtung der Fahrzeugerstreckung in Richtung Fahrbahn in einer Parkendposition bei einem Parkassistenzsystem zum Quereinparken
JP6278920B2 (ja) * 2015-03-23 2018-02-14 三菱電機株式会社 駐車支援装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
US9925919B2 (en) 2018-03-27
EP3124360A1 (de) 2017-02-01
JP6547495B2 (ja) 2019-07-24
US20170028914A1 (en) 2017-02-02
JP2017030568A (ja) 2017-02-09

Similar Documents

Publication Publication Date Title
EP3124360B1 (de) Parkhilfevorrichtung
EP3135565B1 (de) Parkhilfevorrichtung
JP5995931B2 (ja) 駐車支援装置、駐車支援方法及び制御プログラム
US9886859B2 (en) Parking assistance device
JP6015314B2 (ja) 駐車目標位置を算出する装置、駐車目標位置を算出する方法およびプログラム
JP6067634B2 (ja) 駐車支援装置および経路決定方法
US10018473B2 (en) Vehicle position detecting device
US10239520B2 (en) Parking assistance device and parking assistance method
JP6275006B2 (ja) 駐車支援装置
JP6110349B2 (ja) 駐車支援装置
US10150486B2 (en) Driving assistance device and driving assistance system
US10055994B2 (en) Parking assistance device
US10377416B2 (en) Driving assistance device
EP3124361A1 (de) Einparkassistenzvorrichtung, einparkassistenzverfahren und nichtflüchtiges computerlesbares medium zum speichern eines programms
WO2018198530A1 (ja) 駐車支援装置
JP2016060226A (ja) 駐車支援装置、駐車支援方法及び制御プログラム
EP3378720B1 (de) Antriebssteuerungsvorrichtung
WO2018198531A1 (ja) 駐車支援装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20170724

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20180110

RIC1 Information provided on ipc code assigned before grant

Ipc: G08G 1/16 20060101ALI20180718BHEP

Ipc: G01C 21/34 20060101ALI20180718BHEP

Ipc: B62D 15/02 20060101AFI20180718BHEP

Ipc: G01C 21/36 20060101ALI20180718BHEP

Ipc: B60Q 9/00 20060101ALI20180718BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20180911

RIN1 Information on inventor provided before grant (corrected)

Inventor name: TOMOZAWA, MOTOKATSU

Inventor name: KIYOKAWA, YUSUKE

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1100903

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190315

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602016010276

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20190227

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190527

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190627

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190527

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190528

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190627

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1100903

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602016010276

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20191128

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190731

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190731

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190729

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190729

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20200729

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200729

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20160729

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240604

Year of fee payment: 9