EP3480065A1 - Parking assistance device - Google Patents

Parking assistance device Download PDF

Info

Publication number
EP3480065A1
EP3480065A1 EP17819776.0A EP17819776A EP3480065A1 EP 3480065 A1 EP3480065 A1 EP 3480065A1 EP 17819776 A EP17819776 A EP 17819776A EP 3480065 A1 EP3480065 A1 EP 3480065A1
Authority
EP
European Patent Office
Prior art keywords
route
vehicle
parking
calculation unit
backward movement
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP17819776.0A
Other languages
German (de)
French (fr)
Other versions
EP3480065A4 (en
EP3480065B1 (en
Inventor
Noriyasu HASEJIMA
Shinya Tagawa
Takehito Ogata
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Faurecia Clarion Electronics Co Ltd
Original Assignee
Clarion Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Clarion Co Ltd filed Critical Clarion Co Ltd
Publication of EP3480065A1 publication Critical patent/EP3480065A1/en
Publication of EP3480065A4 publication Critical patent/EP3480065A4/en
Application granted granted Critical
Publication of EP3480065B1 publication Critical patent/EP3480065B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B62LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62DMOTOR VEHICLES; TRAILERS
    • B62D15/00Steering not otherwise provided for
    • B62D15/02Steering position indicators ; Steering position determination; Steering aids
    • B62D15/027Parking aids, e.g. instruction means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B62LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62DMOTOR VEHICLES; TRAILERS
    • B62D15/00Steering not otherwise provided for
    • B62D15/02Steering position indicators ; Steering position determination; Steering aids
    • B62D15/027Parking aids, e.g. instruction means
    • B62D15/028Guided parking by providing commands to the driver, e.g. acoustically or optically
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/06Automatic manoeuvring for parking
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/12Limiting control by the driver depending on vehicle state, e.g. interlocking means for the control input for preventing unsafe operation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/586Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of parking space
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems

Definitions

  • the present invention relates to a parking assist apparatus that assists parallel parking of an own vehicle.
  • PTL 1 discloses a technique of a parking assist apparatus that calculates a guide route including turning back for parking a vehicle and assists the vehicle to reach a target position along the guide route.
  • the guide route is calculated based on a positional relationship and a relationship of a vehicle orientation between an initial position where the parking assistance is started and a target parking position. Therefore, parking assistance cannot be performed, for example, when the initial position of the vehicle is in a place from which guidance to the target parking position cannot be performed.
  • the present invention has been made in view of the above point, and it is an object of the invention to provide a parking assist apparatus that can calculate a parking route for guiding an own vehicle to a target parking position and park the own vehicle in parallel in a correct vehicle orientation at a position intended by a driver, without depending on an initial position where parking assistance is started or a vehicle orientation.
  • a parking assist apparatus of the present invention for solving the above problem is a parking assist apparatus that assists parallel parking of an own vehicle.
  • the parking assist apparatus includes; a first route calculation unit configured to calculate a first route for moving the own vehicle from a target parking position to a virtual departure position based on a parking space and a constraint condition of own vehicle behavior; a second route calculation unit configured to calculate a second route for moving the own vehicle from an initial position where parking assistance is started to the virtual departure position; and a parking route setting unit configured to set a parking route of the own vehicle with use of the first route and the second route.
  • the second route calculation unit include: a forward/backward movement determination unit configured to determine whether the initial position is on a front side or a rear side with respect to a first reference line extending along a longitudinal direction of the own vehicle at the virtual departure position; a backward movement starting route calculation unit configured to calculate a backward movement starting route that connects from the initial position to the virtual departure position by a backward movement of the own vehicle as the second route when the initial position is on a front side from the first reference line; and a forward movement starting route calculation unit configured to calculate a forward movement starting route that connects from the initial position to the virtual departure position by forward and backward movements of the own vehicle as the second route when the initial position is on a rear side from the first reference line or when it is impossible to calculate the backward movement starting route by the backward movement starting route calculation unit.
  • a parking route including turning back for guiding a vehicle to a target parking position and park the vehicle in parallel in a correct vehicle orientation at a position intended by a driver, without depending on an initial position where parking assistance is started and a vehicle orientation.
  • FIG. 1 is a functional block diagram of a parking assist apparatus according to an embodiment of the present invention
  • FIG. 2 is a view for explaining a movement of the own vehicle in parallel parking.
  • the own vehicle 21 is inserted from a rear portion thereof into between a front obstacle 22 and a rear obstacle 23 ( FIG. 2(2) ) by moving backward and turning to the left. Then, turning back is performed at least once or more, or a plurality of times as required, to arrange the own vehicle 21 with a direction thereof aligned with a parking direction at the target parking position P1 ( FIG. 2(3) ).
  • the front obstacle 22 and the rear obstacle 23 are other vehicles
  • a side obstacle 24 is, for example, a curb or a wall.
  • whether or not the own vehicle 21 is arranged at each position of the initial position P0, the target parking position P1, a turning-back end position P2 to be described later, and the virtual departure position P3, is determined based on a reference point that is an intermediate position between the left and right rear wheels of the own vehicle 21. Further, it is assumed that turning is performed along, for example, a clothoid curve.
  • a parking assist apparatus 1 of the present invention assists parallel parking of the own vehicle 21 from the initial position P0 to the target parking position P1, and the parking assist apparatus 1 is suitable to assist an operation of parallel parking such that at least one or more times of turning back are required, for example.
  • the parking assist apparatus 1 can calculate a parking route for guiding the own vehicle 21 and can perform parallel parking by moving the own vehicle 21 along the calculated parking route.
  • a system may be adopted in which information on the parking route is outputted from the parking assist apparatus 1, and the own vehicle 21 is parked in parallel at the target parking position P1 automatically or semi-automatically. In a semiautomatic operation, for example, a steering wheel operation is performed by automatic control, while an accelerator operation and a brake operation are performed by a driver.
  • the parking assist apparatus 1 is mounted on the own vehicle and realized by cooperation of hardware such as a microcomputer and a software program. As shown in FIG. 1 , the parking assist apparatus 1 includes a first route calculation unit 11, a second route calculation unit 12, and a parking route setting unit 13.
  • the first route calculation unit 11 calculates a first route for moving the own vehicle from the target parking position P1 to the virtual departure position based on a parking space and a constraint condition of own vehicle behavior.
  • the second route calculation unit 12 calculates a second route for moving the own vehicle 21 from the initial position P0 to the virtual departure position.
  • the parking route setting unit 13 sets a parking route of the own vehicle 21 with use of the first route and the second route.
  • the parking assist apparatus 1 is inputted with target parking space information 141, target parking position information 142, own vehicle information 143, and own vehicle position information 144.
  • the target parking space information 141 includes information that is to be a constraint condition of the parking space, such as a distance to surrounding walls and other vehicles.
  • the target parking position information 142 includes information such as a shape of the target parking position P1 and a relative position with respect to the own vehicle 21.
  • the own vehicle information 143 includes information that is to be a constraint condition of own vehicle behavior such as a turning radius of the own vehicle.
  • the own vehicle position information 144 there may be used a dead reckoning calculated in accordance with a vehicle model from a steering angle and a speed of the vehicle and a rotation amount of the wheel, and there may also be used position information obtained by a sensor such as a GPS or the like, or vehicle position information obtained by road-to-vehicle communication or inter-vehicle communication.
  • An operation input unit 15 inputs, for example, information and the like on the target parking position selected by a user into the parking assist apparatus 1.
  • a route display unit 16 is an onboard monitor that can be seen by the driver in the vehicle, and can display a turning back position of the target parking route by superimposing on an image from the camera. Further, not only the turning back position but also the entire parking route may be displayed. The driver can look at and confirm the turning back position and the parking route displayed on the onboard monitor.
  • the first route calculation unit 11 calculates the first route based on the target parking space information 141 such as an obstacle and the like in front and rear of the target parking position P1 where parallel parking is performed, the target parking position information 142 such as a shape and a position of the target parking position P1, and the own vehicle information 143 of vehicle specification such as a size of the own vehicle, a minimum rotation radius.
  • the target parking space information 141 can be obtained from, for example, a detection signal of an ultrasonic sensor mounted on the own vehicle or an image from an onboard camera. Alternatively, the target parking space information 141 may be obtained by road-to-vehicle communication or inter-vehicle communication.
  • the first route is a virtual moving route obtained by estimating a route in a departure direction from a state where the own vehicle 21 is parked at the target parking position P1 to the virtual departure position P3, and the first route includes at least one or more times of turning back by the own vehicle 21.
  • the first route is calculated based on a parking space and a constraint condition of own vehicle behavior.
  • the first route is not bound by the initial position of the own vehicle 21 but is calculated irrelevant at all.
  • FIG. 3 is a view for explaining a calculation method of the first route
  • FIG. 4 is a view for explaining a position where switching between a forward movement and a backward movement of the first route is performed
  • FIG. 5 is a view for explaining a moving amount during a forward movement
  • FIG. 6 is a view for explaining a moving amount during a backward movement.
  • the first route calculation unit 11 straightly moves back the own vehicle 21 ( FIG. 3(2) ) from the target parking position P1 shown in FIG. 3(1) , turns back at a backward movement possible limit position, and turns to the right while moving forward ( FIG. 3(3) ). Then, if the own vehicle cannot be brought out, the first route calculation unit 11 turns back at a forward movement possible limit position and turns to the left while moving backward ( FIG. 3(4) ), and alternately repeats the turning back shown in FIG. 3(3) and FIG. 3(4) until reaching a turning-back end position. Then, furthermore, a path when moving from a turning-back end position P2 shown in FIGS. 7(1a) and 7(1b) to the virtual departure position P3 shown in FIG. 7(2) is calculated as the first route.
  • the first route calculation unit 11 sets, as the forward movement possible limit position, a position where a front portion of the own vehicle 21 approaches the front obstacle 22 by a limit distance. Then, out of a position where the rear portion of the own vehicle 21 approaches the side obstacle 24 by a limit distance as indicated by reference numeral 32 in FIG. 4(2a) , or a position where the rear portion of the own vehicle 21 approaches the rear obstacle 23 by a limit distance as indicated by reference numeral 33 in FIG. 4(2b) , either one with a shorter moving distance from the forward movement possible limit position is adopted as the backward movement limit position.
  • the forward movement possible limit position is located before a position where the front portion of the own vehicle 21 comes into contact with the front obstacle 22 by a forward movement, for example, at a position separated by a predetermined gap ⁇ 1 of about 1 cm to 50 cm.
  • the backward movement possible limit position is located before a position where the rear portion of the own vehicle 21 comes into contact with the side obstacle 24 or the rear obstacle 23 by a backward movement, for example, at a position separated by predetermined gaps ⁇ 2 and 53 of about 5 cm to 10 cm.
  • FIG. 7 is a view for explaining the turning-back end position and the virtual departure position.
  • the first route calculation unit 11 calculates the turning-back end position P2 and the virtual departure position P3.
  • the turning-back end position P2 is a position where the own vehicle 21 can move to the right side from the front obstacle 22 in the parking direction without a left front portion of the own vehicle 21 contacting the front obstacle 22 in the first route.
  • the turning-back end position P2 have two patterns of: the backward movement possible limit position where the own vehicle 21 can pass through a passing point 34 having a gap ⁇ 4 between with the front obstacle 22 when the own vehicle turns to the right while moving forward; or the backward movement possible limit position where the own vehicle 21 can pass through the passing point 34 when the own vehicle straightly moves forward.
  • the gap 54 has a margin in consideration of an error or the like to prevent contact with the front obstacle 22, and is preferably as small as possible, for example, set to about 1 cm to 50 cm.
  • the virtual departure position P3 is a position where the own vehicle 21 can pass through a passing point 35 having a predetermined gap ⁇ 5 between with the front obstacle 22 and be arranged in parallel in the same direction as the parking direction when the own vehicle 21 is moved forward from the turning-back end position P2 and turned to the left.
  • the gap ⁇ 5 has a margin in consideration of an error or the like to prevent contact with the front obstacle 22, and is preferably as small as possible, for example, set to about 1 cm to 50 cm.
  • the second route calculated by the second route calculation unit 12 is a virtual moving route obtained by estimating a route in an entry direction on which the own vehicle 21 reaches the virtual departure position P3 from the initial position P0.
  • One of the backward movement starting route and the forward movement starting route is selected as the second route in accordance with the initial position P0 of the own vehicle 21.
  • the second route calculation unit 12 includes a forward/backward movement determination unit 121, a backward movement starting route calculation unit 122, and a forward movement starting route calculation unit 123.
  • FIG. 8 is a view for explaining a determination method with the forward/backward movement determination unit.
  • the forward/backward movement determination unit 121 determines whether the initial position P0 is on a front side or a rear side in the parking direction with respect to a first reference line 41 extending along a longitudinal direction of the own vehicle 21 at the virtual departure position P3.
  • the backward movement starting route calculation unit 122 calculates the backward movement starting route that connects from the initial position P0 to the virtual departure position P3 by a backward movement of the own vehicle 21.
  • calculation of the backward movement starting route may not be possible due to a constraint of own vehicle behavior.
  • the forward movement starting route calculation unit 123 calculates the forward movement starting route that connects from the initial position P0 to the virtual departure position P3 by a forward movement and a backward movement of the own vehicle 21.
  • the second route calculation unit 12 selects the backward movement starting route as the second route when the backward movement starting route is calculated by the backward movement starting route calculation unit 122, and selects the forward movement starting route as the second route when the forward movement starting route is calculated by the forward movement starting route calculation unit 123.
  • FIG. 9 is a view for explaining a calculation method of the backward movement starting route.
  • the backward movement starting route calculation unit 122 determines that a backward movement can be started.
  • Rmin is a minimum rotation radius of the own vehicle 21.
  • a coordinate of the initial position P0 is defined as V (Xv, Yv, ⁇ v)
  • a coordinate of the virtual departure position P3 is defined as P (Xp, Yp, ⁇ p)
  • an included angle between the first reference line 41 and a second reference line 42 is defined as ⁇ vp.
  • the own vehicle 21 can start a backward movement from the initial position P0 to be connected to the virtual departure position P3 only by moving backward, that is, it is determined that a backward movement can be started.
  • the own vehicle 21 can be connected to the virtual departure position P3 by moving backward with a radius R from the initial position P0, turning to the left, being connected to the first reference line 41, and straightly moving backward along the first reference line 41. That is, a direction of the own vehicle 21 can be arranged along the first reference line 41 at the virtual departure position P3.
  • the backward movement starting route calculation unit 122 sets a route consisted of a circular arc portion by the turning and a straight portion by the straight backward movement, as a backward movement starting route.
  • the forward movement starting route calculation unit 123 calculates the forward movement starting route, the own vehicle 21 is moved forward from the initial position P0 to move to a connection candidate position, and a route from the connection candidate position to the virtual departure position P3 is calculated.
  • the forward movement starting route calculation unit 123 sets a connection candidate position P5 on the second reference line 42 passing through the initial position P0 and extending parallel to the parking direction (connection candidate position setting unit). Then, the forward movement starting route calculation unit 123 calculates a forward movement route that connects from the initial position P0 to the connection candidate position P5 by a forward movement of the own vehicle 21, and a backward movement route that connects from the connection candidate position P5 to the virtual departure position P3 by a backward movement of the own vehicle 21, and the forward movement starting route calculation unit 123 connects the forward movement route and the backward movement route to form a forward movement starting route.
  • FIG. 10 is a view for explaining a calculation method of the forward movement starting route.
  • the forward movement starting route calculation unit 123 calculates a position P4 in which the direction of the own vehicle 21 becomes parallel to the parking direction by moving forward and turning from the virtual departure position P3.
  • the position P4 can be set, for example, on a route passing with a predetermined interval ⁇ 5 (see FIG. 7(2) ) between with the front obstacle 22. Then, the position P4 is moved in parallel along the first reference line 41, and a position where the position P4 is placed on the second reference line 42 is set as the connection candidate position P5 as shown in FIG. 10(2) .
  • the own vehicle 21 can move backward from the connection candidate position P5 and is connected to the first reference line 41 by turning, and can be connected to the virtual departure position P3 by moving straight back along the first reference line 41.
  • the forward movement starting route calculation unit 123 calculates a route of the own vehicle 21 from the connection candidate position P5 to the virtual departure position P3 as a backward movement route. Then, the forward movement starting route calculation unit 123 calculates a forward movement route that connects from the initial position P0 to the connection candidate position P5 by a forward movement of the own vehicle 21. When the forward movement route that connects from the initial position P0 to the connection candidate position P5 can be calculated, the forward movement route from the initial position P0 to the connection candidate position P5 and the backward movement route from the connection candidate position P5 to the virtual departure position P3 are connected to form the forward movement starting route.
  • connection candidate position P5 when the forward movement route that connects to the connection candidate position P5 cannot be calculated, calculation is performed on the forward movement route to be connected from the initial position P0 by a forward movement of the own vehicle 2, by selecting any one of a plurality of other connection candidate positions P6, P7,..., Pn.
  • the plurality of other connection candidate positions P6, P7,..., Pn are located on the second reference line 42 with a predetermined interval (e.g., an interval of 1 m), and are arranged so as to be separated toward a front side in the parking direction with the connection candidate position P5 as a reference.
  • connection candidate positions P6, P7,..., Pn are set such that a priority of selection is lowered as the position is away from the connection candidate position P5, a determination is made as to whether or not connection is possible from the one closer to the initial position P0, and the one that is as close as possible to the initial position P0 is to be selected in order to shorten a time required for parking as much as possible.
  • FIG..11 is a processing flow of connectability determination for determining whether it is possible to connect from the initial position to the connection candidate position by a forward movement of the own vehicle.
  • connection candidate position connectable to the initial position P0 is found, and it is determined sequentially from the connection candidate position P5 (S111).
  • connection candidate position P5 it is determined whether or not it is possible to connect from the initial position P0 to the connection candidate position P5 by a straight movement only (S112). For example, as shown in FIG. 10(2) , when the direction of the own vehicle 21 is parallel to the parking direction, it is determined that the vehicle can be connected only by a straight movement.
  • the route of the own vehicle 21 from the initial position P0 to the connection candidate position P5 is set as the forward movement route (S113).
  • connection candidate position P5 when the direction of the own vehicle 21 is inclined with respect to the parking direction, and it is determined that it is impossible to connect to the connection candidate position P5 only by a straight movement, it is determined whether or not it is possible to connect to the connection candidate position P5 by one-side steering or S-shaped steering (S116).
  • the one-side steering is an operation to steer a steering wheel only to one of the left and right sides
  • the S-shaped steering is an operation to steer a steering wheel to the left and right sides both.
  • connection candidate position P5 when it is determined that it is possible to connect to the connection candidate position P5 by the one-side steering or the S-shaped steering, such the connection candidate position P5 is selected, and a route of the own vehicle 21 from the initial position P0 to the connection candidate position P5 is set as the forward movement route (S113). Further, when it is determined that it is impossible to connect to the connection candidate position P5, it is determined whether or not it is possible to connect to another connection candidate position P6 by one-side steering or S-shaped steering. Then, the determination is sequentially made in accordance with the priority, a connectable candidate position is selected, and a route to the connection candidate position is set as the forward movement route.
  • FIGS. 12A to 12C are views for explaining an example of connectability determination by one-side steering
  • FIGS. 12D and 12E are views for explaining an example of connectability determination by S-shaped steering.
  • connection is determined to be possible when all the following conditions (a1) to (a3) are satisfied (also limited by an angular difference and a position).
  • the turning circle is a circular arc (minimum rotation path) on a turning side in consideration of clothoid.
  • connection is determined to be possible when the following condition (a4) is satisfied (also limited by an angular difference and a position). (a4) The turning circle A1 at the initial position A and the turning circle E1 at the connectable position E do not intersect.
  • FIG. 13 is a view for explaining a generation method of a forward route by one-side steering.
  • a distance Ls between the initial position A and an intersection point K of the axis A2 and the axis E2, and a distance Le between the intersection point K and the connectable position E are respectively calculated, and a shorter distance is selected (in the example shown in the figure, the distance Le is selected).
  • FIG. 14 is a view for explaining a generation method of a forward route by S-shaped steering, and is a view for explaining a generation method in a case where the axis E2 does not intersect with an X axis, which is the axis E2 of the initial position A, on a rear side from the connectable position E.
  • a radius R of a common circle having the same radius for drawing an S-shape is calculated. If a contact point of the circle is obtained, a forward route of S-shape can be generated by combining a circular arc of the turning circle A1 and a circular arc of the turning circle E1.
  • the radius of the common circle is obtained from a distance between center coordinates since the center coordinate of each circle is obtained.
  • [Mathematical Formula 2] 2 ⁇ R X e ⁇ R sin ⁇ 2 + Y e + R cos ⁇ + R 2
  • [Mathematical Formula 3] R X e sin ⁇ ⁇ ⁇ Y e 1 + cos ⁇ ⁇ X e sin ⁇ ⁇ Y e 1 + cos ⁇ 2 ⁇ 2 cos ⁇ ⁇ 1 X e 2 + Y e 2 2 cos ⁇ ⁇ 1
  • the above calculation formula can calculate from a state shown in FIG. 14(a) to a position of an intersection point F7 shown in FIG. 14(b) .
  • respective turning angles ⁇ 1 and ⁇ 2 and arc lengths b1 and b2 of the S-shape can be obtained by the following calculation formula.
  • ⁇ 1 2 sin ⁇ 1 X m 2 + Y m 2 2 ⁇ R
  • b 1 2 ⁇ R sin ⁇ 1 X m 2 + Y m 2 2 ⁇ R
  • ⁇ 2 2 sin ⁇ 1 X m ⁇ X e 2 + Y m ⁇ Y e 2 2 ⁇ R
  • [Mathematical Formula 8] b 2 2 ⁇ R sin ⁇ 1 X m ⁇ X e 2 + Y m ⁇ Y e 2 2 ⁇ R
  • FIG. 15 is a view for explaining a generation method of a forward route by S-shaped steering, and is a view for explaining a generation method in a case where the axis E2 intersects with the X axis, which is the axis A2 of the initial position A, on a rear side from the connectable position E.
  • a radius R of the common turning circles E1 and A1 having the same radius for drawing the S-shape is calculated. Then, if a contact point of the circle is obtained, a forward route of S-shape can be generated by combining a circular arc of the turning circle A1 and a circular arc of the turning circle E1.
  • the radius of the common circle is obtained from a distance between center coordinates since the center coordinate of each circle is obtained.
  • R X e ⁇ R sin ⁇ 2 + Y e + R cos ⁇ + R 2
  • R X e sin ⁇ ⁇ ⁇ Y e 1 + cos ⁇ ⁇ X e sin ⁇ ⁇ Y e 1 + cos ⁇ 2 ⁇ 2 cos ⁇ ⁇ 1 X e 2 + Y e 2 2 cos ⁇ ⁇ 1
  • FIG. 16 is a view for explaining a generation method of a forward route by S-shaped steering, and is a view for explaining a generation method in a case where the axis E2 intersects with the X axis, which is the axis A2 of the initial position A, on a rear side from the connectable position E.
  • a radius R of the common circles E1 and A1 having the same radius for drawing the S-shape is calculated. Then, if a contact point of the circle is obtained, a forward route of S-shape can be generated by combining a circular arc of the turning circle A1 and a circular arc of the turning circle E1.
  • the radius of the common circle is obtained from a distance between center coordinates since the center coordinate of each circle is obtained.
  • [Mathematical Formula 15] 2 ⁇ R X e ⁇ R sin ⁇ 2 + Y e + R cos ⁇ + R 2
  • [Mathematical Formula 16] R X e sin ⁇ ⁇ ⁇ Y e 1 + cos ⁇ ⁇ X e sin ⁇ ⁇ Y e 1 + cos ⁇ 2 ⁇ 2 cos ⁇ ⁇ 1 X e 2 + Y e 2 2 cos ⁇ ⁇ 1
  • the parking route setting unit 13 sets a parking route by using information on the first route from the target parking position P1 to the virtual departure position P3 and information on the second route from the initial position P0 to the virtual departure position P3.
  • the parking route is a combination of the second route from the initial position P0 to the virtual departure position P3 and a route of reverse running of the first route from the virtual departure position P3 to the target parking position P1.
  • a parking route including turning back for guiding the own vehicle 21 to the target parking position P1 and park the vehicle in parallel in a correct vehicle orientation at a position intended by a driver, without depending on a start position where parking assistance is started and a vehicle orientation.
  • the present invention is not limited to the above embodiment, and various modifications of design may be made without departing from the spirit of the present invention described in claims.
  • the embodiment described above has been illustrated in detail to facilitate description for easy understanding of the present invention, and is not necessarily limited to the embodiment that includes all the configurations.
  • a part of a configuration of an embodiment may be replaced with a configuration of another embodiment, and a configuration of an embodiment may be added with a configuration of another embodiment.
  • a part of a configuration of each embodiment may be deleted, replaced, or added with another configuration.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Automation & Control Theory (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Steering Control In Accordance With Driving Conditions (AREA)
  • Traffic Control Systems (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

A parking assist apparatus 1 of the present invention assists parallel parking of an own vehicle 21. The parking assist apparatus 1 includes: a first route calculation unit 11 configured to calculate a first route for moving the own vehicle 21 from a target parking position P1 to a virtual departure position P3 based on a parking space and a constraint condition of own vehicle behavior; a second route calculation unit 12 configured to calculate a second route for moving the own vehicle 21 from an initial position P0 where parking assistance is started to the virtual departure position P3; and a parking route setting unit 13 configured to set a parking route of the own vehicle 21 with use of the first route and the second route.

Description

    Technical Field
  • The present invention relates to a parking assist apparatus that assists parallel parking of an own vehicle.
  • Background Art
  • PTL 1 discloses a technique of a parking assist apparatus that calculates a guide route including turning back for parking a vehicle and assists the vehicle to reach a target position along the guide route.
  • Citation List Patent Literature
  • PTL 1: JP2010-208392 A
  • Summary of Invention Technical Problem
  • In the technique disclosed in PTL 1, the guide route is calculated based on a positional relationship and a relationship of a vehicle orientation between an initial position where the parking assistance is started and a target parking position. Therefore, parking assistance cannot be performed, for example, when the initial position of the vehicle is in a place from which guidance to the target parking position cannot be performed.
  • The present invention has been made in view of the above point, and it is an object of the invention to provide a parking assist apparatus that can calculate a parking route for guiding an own vehicle to a target parking position and park the own vehicle in parallel in a correct vehicle orientation at a position intended by a driver, without depending on an initial position where parking assistance is started or a vehicle orientation.
  • Solution to Problem
  • A parking assist apparatus of the present invention for solving the above problem is a parking assist apparatus that assists parallel parking of an own vehicle. The parking assist apparatus includes; a first route calculation unit configured to calculate a first route for moving the own vehicle from a target parking position to a virtual departure position based on a parking space and a constraint condition of own vehicle behavior; a second route calculation unit configured to calculate a second route for moving the own vehicle from an initial position where parking assistance is started to the virtual departure position; and a parking route setting unit configured to set a parking route of the own vehicle with use of the first route and the second route. The second route calculation unit include: a forward/backward movement determination unit configured to determine whether the initial position is on a front side or a rear side with respect to a first reference line extending along a longitudinal direction of the own vehicle at the virtual departure position; a backward movement starting route calculation unit configured to calculate a backward movement starting route that connects from the initial position to the virtual departure position by a backward movement of the own vehicle as the second route when the initial position is on a front side from the first reference line; and a forward movement starting route calculation unit configured to calculate a forward movement starting route that connects from the initial position to the virtual departure position by forward and backward movements of the own vehicle as the second route when the initial position is on a rear side from the first reference line or when it is impossible to calculate the backward movement starting route by the backward movement starting route calculation unit.
  • Advantageous Effects of Invention
  • According to the present invention, it is possible to calculate a parking route including turning back for guiding a vehicle to a target parking position and park the vehicle in parallel in a correct vehicle orientation at a position intended by a driver, without depending on an initial position where parking assistance is started and a vehicle orientation. Meanwhile, the problems, configurations, and effects other than those described above will be clarified by the description of the embodiment below.
  • Brief Description of Drawings
    • FIG. 1 is a functional block diagram of a parking assist apparatus according to an embodiment of the present invention.
    • FIG. 2 is a view for explaining a movement of an own vehicle in parallel parking.
    • FIG. 3 is a view for explaining a calculation method of a first route.
    • FIG. 4 is a view for explaining a position where switching between a forward movement and a backward movement of the first route is performed.
    • FIG. 5 is a view for explaining a moving amount during a forward movement.
    • FIG. 6 is a view for explaining a moving amount during a backward movement.
    • FIG. 7 is a view for explaining a turning-back end position and a virtual departure position.
    • FIG. 8 is a view for explaining a determination method with a forward/backward movement determination unit.
    • FIG. 9 is a view for explaining a calculation method of a second route in a case where a start of a backward movement is possible.
    • FIG. 10 is a view for explaining a calculation method of the second route in a case of starting a forward movement.
    • FIG. 11 is a processing flow of connectability determination.
    • FIG. 12A is a view for explaining an example of connectability determination by one-side steering.
    • FIG. 12B is a view for explaining an example of connectability determination by one-side steering.
    • FIG. 12C is a view for explaining an example of connectability determination by one-side steering.
    • FIG. 12D is a view for explaining an example of connectability determination by S-shaped steering.
    • FIG. 12E is a view for explaining an example of connectability determination by S-shaped steering.
    • FIG. 13 is a view for explaining a generation method of a forward route by one-side steering.
    • FIG. 14 is a view for explaining a generation method of a forward route by S-shaped steering.
    • FIG. 15 is a view for explaining a generation method of a forward route by S-shaped steering.
    • FIG. 16 is a view for explaining a generation method of a forward route by S-shaped steering.
    Description of Embodiments
  • Hereinafter, an embodiment of the present invention will be described with reference to the drawings. It should be noted that, in the following description, a case where an own vehicle is parked in parallel on a left side from an initial position will be described as an example. However, the present invention can also be similarly applied to a case where the own vehicle is parked in parallel on a right side from the initial position.
  • FIG. 1 is a functional block diagram of a parking assist apparatus according to an embodiment of the present invention, and FIG. 2 is a view for explaining a movement of the own vehicle in parallel parking.
  • In parallel parking, as shown in FIG. 2, for example, from a state where an own vehicle 21 is stopped at an initial position P0 ahead of a target parking position P1 (FIG. 2(1)), the own vehicle 21 is inserted from a rear portion thereof into between a front obstacle 22 and a rear obstacle 23 (FIG. 2(2)) by moving backward and turning to the left. Then, turning back is performed at least once or more, or a plurality of times as required, to arrange the own vehicle 21 with a direction thereof aligned with a parking direction at the target parking position P1 (FIG. 2(3)). For example, the front obstacle 22 and the rear obstacle 23 are other vehicles, and a side obstacle 24 is, for example, a curb or a wall. It should be noted that, in this embodiment, whether or not the own vehicle 21 is arranged at each position of the initial position P0, the target parking position P1, a turning-back end position P2 to be described later, and the virtual departure position P3, is determined based on a reference point that is an intermediate position between the left and right rear wheels of the own vehicle 21. Further, it is assumed that turning is performed along, for example, a clothoid curve.
  • A parking assist apparatus 1 of the present invention assists parallel parking of the own vehicle 21 from the initial position P0 to the target parking position P1, and the parking assist apparatus 1 is suitable to assist an operation of parallel parking such that at least one or more times of turning back are required, for example. The parking assist apparatus 1 can calculate a parking route for guiding the own vehicle 21 and can perform parallel parking by moving the own vehicle 21 along the calculated parking route. A system may be adopted in which information on the parking route is outputted from the parking assist apparatus 1, and the own vehicle 21 is parked in parallel at the target parking position P1 automatically or semi-automatically. In a semiautomatic operation, for example, a steering wheel operation is performed by automatic control, while an accelerator operation and a brake operation are performed by a driver.
  • The parking assist apparatus 1 is mounted on the own vehicle and realized by cooperation of hardware such as a microcomputer and a software program. As shown in FIG. 1, the parking assist apparatus 1 includes a first route calculation unit 11, a second route calculation unit 12, and a parking route setting unit 13.
  • The first route calculation unit 11 calculates a first route for moving the own vehicle from the target parking position P1 to the virtual departure position based on a parking space and a constraint condition of own vehicle behavior. The second route calculation unit 12 calculates a second route for moving the own vehicle 21 from the initial position P0 to the virtual departure position. The parking route setting unit 13 sets a parking route of the own vehicle 21 with use of the first route and the second route.
  • As shown in FIG. 1, the parking assist apparatus 1 is inputted with target parking space information 141, target parking position information 142, own vehicle information 143, and own vehicle position information 144. The target parking space information 141 includes information that is to be a constraint condition of the parking space, such as a distance to surrounding walls and other vehicles. The target parking position information 142 includes information such as a shape of the target parking position P1 and a relative position with respect to the own vehicle 21. The own vehicle information 143 includes information that is to be a constraint condition of own vehicle behavior such as a turning radius of the own vehicle. Then, as the own vehicle position information 144, there may be used a dead reckoning calculated in accordance with a vehicle model from a steering angle and a speed of the vehicle and a rotation amount of the wheel, and there may also be used position information obtained by a sensor such as a GPS or the like, or vehicle position information obtained by road-to-vehicle communication or inter-vehicle communication.
  • An operation input unit 15 inputs, for example, information and the like on the target parking position selected by a user into the parking assist apparatus 1. A route display unit 16 is an onboard monitor that can be seen by the driver in the vehicle, and can display a turning back position of the target parking route by superimposing on an image from the camera. Further, not only the turning back position but also the entire parking route may be displayed. The driver can look at and confirm the turning back position and the parking route displayed on the onboard monitor.
  • <First route calculation unit>
  • The first route calculation unit 11 calculates the first route based on the target parking space information 141 such as an obstacle and the like in front and rear of the target parking position P1 where parallel parking is performed, the target parking position information 142 such as a shape and a position of the target parking position P1, and the own vehicle information 143 of vehicle specification such as a size of the own vehicle, a minimum rotation radius. The target parking space information 141 can be obtained from, for example, a detection signal of an ultrasonic sensor mounted on the own vehicle or an image from an onboard camera. Alternatively, the target parking space information 141 may be obtained by road-to-vehicle communication or inter-vehicle communication.
  • The first route is a virtual moving route obtained by estimating a route in a departure direction from a state where the own vehicle 21 is parked at the target parking position P1 to the virtual departure position P3, and the first route includes at least one or more times of turning back by the own vehicle 21. The first route is calculated based on a parking space and a constraint condition of own vehicle behavior. The first route is not bound by the initial position of the own vehicle 21 but is calculated irrelevant at all.
  • FIG. 3 is a view for explaining a calculation method of the first route, FIG. 4 is a view for explaining a position where switching between a forward movement and a backward movement of the first route is performed, FIG. 5 is a view for explaining a moving amount during a forward movement, and FIG. 6 is a view for explaining a moving amount during a backward movement.
  • The first route calculation unit 11 straightly moves back the own vehicle 21 (FIG. 3(2)) from the target parking position P1 shown in FIG. 3(1), turns back at a backward movement possible limit position, and turns to the right while moving forward (FIG. 3(3)). Then, if the own vehicle cannot be brought out, the first route calculation unit 11 turns back at a forward movement possible limit position and turns to the left while moving backward (FIG. 3(4)), and alternately repeats the turning back shown in FIG. 3(3) and FIG. 3(4) until reaching a turning-back end position. Then, furthermore, a path when moving from a turning-back end position P2 shown in FIGS. 7(1a) and 7(1b) to the virtual departure position P3 shown in FIG. 7(2) is calculated as the first route.
  • As indicated by reference numeral 31 in FIG. 4(1), the first route calculation unit 11 sets, as the forward movement possible limit position, a position where a front portion of the own vehicle 21 approaches the front obstacle 22 by a limit distance. Then, out of a position where the rear portion of the own vehicle 21 approaches the side obstacle 24 by a limit distance as indicated by reference numeral 32 in FIG. 4(2a), or a position where the rear portion of the own vehicle 21 approaches the rear obstacle 23 by a limit distance as indicated by reference numeral 33 in FIG. 4(2b), either one with a shorter moving distance from the forward movement possible limit position is adopted as the backward movement limit position.
  • As shown in FIG. 5, the forward movement possible limit position is located before a position where the front portion of the own vehicle 21 comes into contact with the front obstacle 22 by a forward movement, for example, at a position separated by a predetermined gap δ1 of about 1 cm to 50 cm. Then, as shown in FIGS. 6(1) and 6(2), the backward movement possible limit position is located before a position where the rear portion of the own vehicle 21 comes into contact with the side obstacle 24 or the rear obstacle 23 by a backward movement, for example, at a position separated by predetermined gaps δ2 and 53 of about 5 cm to 10 cm.
  • FIG. 7 is a view for explaining the turning-back end position and the virtual departure position.
  • The first route calculation unit 11 calculates the turning-back end position P2 and the virtual departure position P3. The turning-back end position P2 is a position where the own vehicle 21 can move to the right side from the front obstacle 22 in the parking direction without a left front portion of the own vehicle 21 contacting the front obstacle 22 in the first route.
  • As shown in FIGS. 7(1a) and 7(1b), the turning-back end position P2 have two patterns of: the backward movement possible limit position where the own vehicle 21 can pass through a passing point 34 having a gap δ4 between with the front obstacle 22 when the own vehicle turns to the right while moving forward; or the backward movement possible limit position where the own vehicle 21 can pass through the passing point 34 when the own vehicle straightly moves forward. The gap 54 has a margin in consideration of an error or the like to prevent contact with the front obstacle 22, and is preferably as small as possible, for example, set to about 1 cm to 50 cm.
  • As shown in FIG. 7(2), the virtual departure position P3 is a position where the own vehicle 21 can pass through a passing point 35 having a predetermined gap δ5 between with the front obstacle 22 and be arranged in parallel in the same direction as the parking direction when the own vehicle 21 is moved forward from the turning-back end position P2 and turned to the left. The gap δ5 has a margin in consideration of an error or the like to prevent contact with the front obstacle 22, and is preferably as small as possible, for example, set to about 1 cm to 50 cm.
  • <Second route calculation unit>
  • The second route calculated by the second route calculation unit 12 is a virtual moving route obtained by estimating a route in an entry direction on which the own vehicle 21 reaches the virtual departure position P3 from the initial position P0. One of the backward movement starting route and the forward movement starting route is selected as the second route in accordance with the initial position P0 of the own vehicle 21.
  • As shown in FIG. 1, the second route calculation unit 12 includes a forward/backward movement determination unit 121, a backward movement starting route calculation unit 122, and a forward movement starting route calculation unit 123.
  • FIG. 8 is a view for explaining a determination method with the forward/backward movement determination unit.
  • The forward/backward movement determination unit 121 determines whether the initial position P0 is on a front side or a rear side in the parking direction with respect to a first reference line 41 extending along a longitudinal direction of the own vehicle 21 at the virtual departure position P3.
  • As shown in FIG. 8(1), when the initial position P0 is on a front side in the parking direction with respect to the first reference line 41, the backward movement starting route calculation unit 122 calculates the backward movement starting route that connects from the initial position P0 to the virtual departure position P3 by a backward movement of the own vehicle 21. However, calculation of the backward movement starting route may not be possible due to a constraint of own vehicle behavior.
  • When the initial position P0 is on a rear side in the parking direction with respect to the first reference line 41 as shown in FIG. 8(2), or when calculation of the backward movement starting route is not possible with the backward movement starting route calculation unit 122, the forward movement starting route calculation unit 123 calculates the forward movement starting route that connects from the initial position P0 to the virtual departure position P3 by a forward movement and a backward movement of the own vehicle 21. The second route calculation unit 12 selects the backward movement starting route as the second route when the backward movement starting route is calculated by the backward movement starting route calculation unit 122, and selects the forward movement starting route as the second route when the forward movement starting route is calculated by the forward movement starting route calculation unit 123.
  • FIG. 9 is a view for explaining a calculation method of the backward movement starting route.
  • When a relationship between the initial position P0 and the virtual departure position P3 satisfies both of the following two conditions (A) and (B), the backward movement starting route calculation unit 122 determines that a backward movement can be started.
  • CONDITION (A)
  • R min R = P y sin θ vp tan θ vp 2
    Figure imgb0001
  • CONDITION (B)
  • P x P rx = R 2 R P y 2
    Figure imgb0002
  • Here, Rmin is a minimum rotation radius of the own vehicle 21. A coordinate of the initial position P0 is defined as V (Xv, Yv, θv), a coordinate of the virtual departure position P3 is defined as P (Xp, Yp, θp), and an included angle between the first reference line 41 and a second reference line 42 is defined as θvp.
  • When both of the above conditions (A) and (B) are satisfied, the own vehicle 21 can start a backward movement from the initial position P0 to be connected to the virtual departure position P3 only by moving backward, that is, it is determined that a backward movement can be started. When it is determined that a backward movement can be started, for example, as shown in FIG. 9, the own vehicle 21 can be connected to the virtual departure position P3 by moving backward with a radius R from the initial position P0, turning to the left, being connected to the first reference line 41, and straightly moving backward along the first reference line 41. That is, a direction of the own vehicle 21 can be arranged along the first reference line 41 at the virtual departure position P3. In such a case, the backward movement starting route calculation unit 122 sets a route consisted of a circular arc portion by the turning and a straight portion by the straight backward movement, as a backward movement starting route.
  • Whereas, when at least one of the above conditions (A) or (B) is not satisfied, the own vehicle 21 cannot be connected to the virtual departure position P3 only by moving backward, and it is determined that a backward movement cannot be started. In such a case, the forward movement starting route calculation unit 123 calculates the forward movement starting route, the own vehicle 21 is moved forward from the initial position P0 to move to a connection candidate position, and a route from the connection candidate position to the virtual departure position P3 is calculated.
  • The forward movement starting route calculation unit 123 sets a connection candidate position P5 on the second reference line 42 passing through the initial position P0 and extending parallel to the parking direction (connection candidate position setting unit). Then, the forward movement starting route calculation unit 123 calculates a forward movement route that connects from the initial position P0 to the connection candidate position P5 by a forward movement of the own vehicle 21, and a backward movement route that connects from the connection candidate position P5 to the virtual departure position P3 by a backward movement of the own vehicle 21, and the forward movement starting route calculation unit 123 connects the forward movement route and the backward movement route to form a forward movement starting route.
  • FIG. 10 is a view for explaining a calculation method of the forward movement starting route.
  • As shown in FIG. 10(1), the forward movement starting route calculation unit 123 calculates a position P4 in which the direction of the own vehicle 21 becomes parallel to the parking direction by moving forward and turning from the virtual departure position P3. The position P4 can be set, for example, on a route passing with a predetermined interval δ5 (see FIG. 7(2)) between with the front obstacle 22. Then, the position P4 is moved in parallel along the first reference line 41, and a position where the position P4 is placed on the second reference line 42 is set as the connection candidate position P5 as shown in FIG. 10(2). The own vehicle 21 can move backward from the connection candidate position P5 and is connected to the first reference line 41 by turning, and can be connected to the virtual departure position P3 by moving straight back along the first reference line 41.
  • The forward movement starting route calculation unit 123 calculates a route of the own vehicle 21 from the connection candidate position P5 to the virtual departure position P3 as a backward movement route. Then, the forward movement starting route calculation unit 123 calculates a forward movement route that connects from the initial position P0 to the connection candidate position P5 by a forward movement of the own vehicle 21. When the forward movement route that connects from the initial position P0 to the connection candidate position P5 can be calculated, the forward movement route from the initial position P0 to the connection candidate position P5 and the backward movement route from the connection candidate position P5 to the virtual departure position P3 are connected to form the forward movement starting route.
  • Whereas, for example, when the direction of the own vehicle 21 at the initial position P0 is greatly inclined with respect to the parking direction, or when a distance between the initial position P0 and the connection candidate position P5 is too short, there is a possibility that the forward movement route that connects from the initial position P0 to the connection candidate position P5 cannot be calculated due to a constraint of the own vehicle behavior.
  • In this way, when the forward movement route that connects to the connection candidate position P5 cannot be calculated, calculation is performed on the forward movement route to be connected from the initial position P0 by a forward movement of the own vehicle 2, by selecting any one of a plurality of other connection candidate positions P6, P7,..., Pn. The plurality of other connection candidate positions P6, P7,..., Pn are located on the second reference line 42 with a predetermined interval (e.g., an interval of 1 m), and are arranged so as to be separated toward a front side in the parking direction with the connection candidate position P5 as a reference. The plurality of other connection candidate positions P6, P7,..., Pn are set such that a priority of selection is lowered as the position is away from the connection candidate position P5, a determination is made as to whether or not connection is possible from the one closer to the initial position P0, and the one that is as close as possible to the initial position P0 is to be selected in order to shorten a time required for parking as much as possible.
  • FIG..11 is a processing flow of connectability determination for determining whether it is possible to connect from the initial position to the connection candidate position by a forward movement of the own vehicle.
  • This processing flow is looped until the connection candidate position connectable to the initial position P0 is found, and it is determined sequentially from the connection candidate position P5 (S111). First, it is determined whether or not it is possible to connect from the initial position P0 to the connection candidate position P5 by a straight movement only (S112). For example, as shown in FIG. 10(2), when the direction of the own vehicle 21 is parallel to the parking direction, it is determined that the vehicle can be connected only by a straight movement. When it is determined that the vehicle can be connected only by a straight movement, the route of the own vehicle 21 from the initial position P0 to the connection candidate position P5 is set as the forward movement route (S113).
  • Whereas, when the direction of the own vehicle 21 is inclined with respect to the parking direction, and it is determined that it is impossible to connect to the connection candidate position P5 only by a straight movement, it is determined whether or not it is possible to connect to the connection candidate position P5 by one-side steering or S-shaped steering (S116). The one-side steering is an operation to steer a steering wheel only to one of the left and right sides, and the S-shaped steering is an operation to steer a steering wheel to the left and right sides both.
  • Then, when it is determined that it is possible to connect to the connection candidate position P5 by the one-side steering or the S-shaped steering, such the connection candidate position P5 is selected, and a route of the own vehicle 21 from the initial position P0 to the connection candidate position P5 is set as the forward movement route (S113). Further, when it is determined that it is impossible to connect to the connection candidate position P5, it is determined whether or not it is possible to connect to another connection candidate position P6 by one-side steering or S-shaped steering. Then, the determination is sequentially made in accordance with the priority, a connectable candidate position is selected, and a route to the connection candidate position is set as the forward movement route.
  • FIGS. 12A to 12C are views for explaining an example of connectability determination by one-side steering, and FIGS. 12D and 12E are views for explaining an example of connectability determination by S-shaped steering.
  • In the connectability determination by one-side steering in S112, connection is determined to be possible when all the following conditions (a1) to (a3) are satisfied (also limited by an angular difference and a position).
    • (a1) A longitudinal axis A2 of the own vehicle 21 at an initial position A of the own vehicle 21 and a longitudinal axis E2 of the own vehicle 21 at a connectable position E intersect.
    • (a2) A turning circle A1 at the initial position A and the axis E2 at the connectable position E do not intersect.
    • (a3) A turning circle E1 at the connectable position E and the axis A2 of the initial position A do not intersect.
  • It should be noted that the turning circle is a circular arc (minimum rotation path) on a turning side in consideration of clothoid.
  • In the example shown in FIG. 12A, since the axes A2 and E2 intersect at an intersecting position F1, the condition of (a1) above is satisfied. Therefore, it is determined that connection by one-side steering is possible. Whereas, in FIG. 12B, since the turning circle E1 and the axis A2 at the initial position intersect, the condition of (a3) above is not satisfied. Then, in the example shown in FIG. 12C, since the turning circle A1 at the initial position and the axis E2 at the connectable position E intersect, the condition of (a2) above is not satisfied. Therefore, in the examples shown in FIG. 12B and FIG. 12C, connection is determined to be impossible by one-side steering, and the process proceeds to determination as to whether or not S-shaped steering can be used.
  • In the connectability determination by S-shaped steering in S116, connection is determined to be possible when the following condition (a4) is satisfied (also limited by an angular difference and a position).
    (a4) The turning circle A1 at the initial position A and the turning circle E1 at the connectable position E do not intersect.
  • In the example shown in FIG. 12D, since the turning circle A1 and the turning circle E1 do not intersect, the condition is satisfied. Therefore, it is determined that connection is possible by S-shaped steering. Whereas, in the example shown in FIG. 12E, since the turning circle A1 and the turning circle E1 intersect, the condition is not satisfied, and connection by the S-shaped steering is determined to be impossible.
  • FIG. 13 is a view for explaining a generation method of a forward route by one-side steering.
  • In order to generate a route by one-side steering from the initial position A to the connectable position E, first, as shown in FIG. 13(a), a distance Ls between the initial position A and an intersection point K of the axis A2 and the axis E2, and a distance Le between the intersection point K and the connectable position E are respectively calculated, and a shorter distance is selected (in the example shown in the figure, the distance Le is selected). Then, as shown in FIG. 13(b), a radius R is calculated from geometric calculation with the following Expression (1) by drawing a circle having two axes A2 and E2 as a common tangent line and passing through a position separated by a shorter distance from the intersection point K.
    [Mathematical Formula 1] R = L e tan θ 2
    Figure imgb0003
  • As a result of the above, it is possible to generate a forward route combining a straight line and an arc.
  • FIG. 14 is a view for explaining a generation method of a forward route by S-shaped steering, and is a view for explaining a generation method in a case where the axis E2 does not intersect with an X axis, which is the axis E2 of the initial position A, on a rear side from the connectable position E.
  • Here, a radius R of a common circle having the same radius for drawing an S-shape is calculated. If a contact point of the circle is obtained, a forward route of S-shape can be generated by combining a circular arc of the turning circle A1 and a circular arc of the turning circle E1.
  • The radius of the common circle is obtained from a distance between center coordinates since the center coordinate of each circle is obtained.
    [Mathematical Formula 2] 2 R = X e R sin θ 2 + Y e + R cos θ + R 2
    Figure imgb0004

    [Mathematical Formula 3] R = X e sin θ Y e 1 + cos θ X e sin θ Y e 1 + cos θ 2 2 cos θ 1 X e 2 + Y e 2 2 cos θ 1
    Figure imgb0005
  • However, when θ = 0,
    [Mathematical Formula 4] R = X e 2 + Y e 2 4 Y e
    Figure imgb0006
  • The above calculation formula can calculate from a state shown in FIG. 14(a) to a position of an intersection point F7 shown in FIG. 14(b).
  • From the formula shown in FIG. 14(c), respective turning angles ϕ1 and ϕ2 and arc lengths b1 and b2 of the S-shape can be obtained by the following calculation formula.
    [Mathematical Formula 5] ϕ 1 = 2 sin 1 X m 2 + Y m 2 2 R
    Figure imgb0007

    [Mathematical Formula 6] b 1 = 2 R sin 1 X m 2 + Y m 2 2 R
    Figure imgb0008

    [Mathematical Formula 7] ϕ 2 = 2 sin 1 X m X e 2 + Y m Y e 2 2 R
    Figure imgb0009

    [Mathematical Formula 8] b 2 = 2 R sin 1 X m X e 2 + Y m Y e 2 2 R
    Figure imgb0010
  • FIG. 15 is a view for explaining a generation method of a forward route by S-shaped steering, and is a view for explaining a generation method in a case where the axis E2 intersects with the X axis, which is the axis A2 of the initial position A, on a rear side from the connectable position E.
  • Here, a radius R of the common turning circles E1 and A1 having the same radius for drawing the S-shape is calculated. Then, if a contact point of the circle is obtained, a forward route of S-shape can be generated by combining a circular arc of the turning circle A1 and a circular arc of the turning circle E1.
  • The radius of the common circle is obtained from a distance between center coordinates since the center coordinate of each circle is obtained.
    [Mathematical Formula 9] 2 R = X e R sin θ 2 + Y e + R cos θ + R 2
    Figure imgb0011

    [Mathematical Formula 10] R = X e sin θ Y e 1 + cos θ X e sin θ Y e 1 + cos θ 2 2 cos θ 1 X e 2 + Y e 2 2 cos θ 1
    Figure imgb0012
  • From the formula shown in FIG. 14(c), the respective turning angles ϕ1 and ϕ2 and the arc lengths b1 and b2 of the S-shape can be obtained by the following calculation formula.
    [Mathematical Formula 11] ϕ 1 = 2 sin 1 X m 2 + Y m 2 2 R
    Figure imgb0013

    [Mathematical Formula 12] b 1 = 2 R sin 1 X m 2 + Y m 2 2 R
    Figure imgb0014

    [Mathematical Formula 13] ϕ 2 = 2 sin 1 X m X e 2 + Y m Y e 2 2 R
    Figure imgb0015

    [Mathematical Formula 14] b 2 = 2 R sin 1 X m X e 2 + Y m Y e 2 2 R
    Figure imgb0016
  • FIG. 16 is a view for explaining a generation method of a forward route by S-shaped steering, and is a view for explaining a generation method in a case where the axis E2 intersects with the X axis, which is the axis A2 of the initial position A, on a rear side from the connectable position E.
  • Here, a radius R of the common circles E1 and A1 having the same radius for drawing the S-shape is calculated. Then, if a contact point of the circle is obtained, a forward route of S-shape can be generated by combining a circular arc of the turning circle A1 and a circular arc of the turning circle E1.
  • The radius of the common circle is obtained from a distance between center coordinates since the center coordinate of each circle is obtained.
    [Mathematical Formula 15] 2 R = X e R sin θ 2 + Y e + R cos θ + R 2
    Figure imgb0017

    [Mathematical Formula 16] R = X e sin θ Y e 1 + cos θ X e sin θ Y e 1 + cos θ 2 2 cos θ 1 X e 2 + Y e 2 2 cos θ 1
    Figure imgb0018
  • From the formula shown in FIG. 14(c), the respective turning angles ϕ1 and ϕ2 and the arc lengths b1 and b2 of the S-shape can be obtained by the following calculation formula.
    [Mathematical Formula 17] ϕ 1 = 2 sin 1 X m 2 + Y m 2 2 R
    Figure imgb0019

    [Mathematical Formula 18] b 1 = 2 R sin 1 X m 2 + Y m 2 2 R
    Figure imgb0020

    [Mathematical Formula 19] ϕ 2 = 2 sin 1 X m X e 2 + Y m Y e 2 2 R
    Figure imgb0021

    [Mathematical Formula 20] b 2 = 2 R sin 1 X m X e 2 + Y m Y e 2 2 R
    Figure imgb0022
  • <Parking route setting unit>
  • The parking route setting unit 13 sets a parking route by using information on the first route from the target parking position P1 to the virtual departure position P3 and information on the second route from the initial position P0 to the virtual departure position P3. The parking route is a combination of the second route from the initial position P0 to the virtual departure position P3 and a route of reverse running of the first route from the virtual departure position P3 to the target parking position P1.
  • According to the present invention, it is possible to calculate a parking route including turning back for guiding the own vehicle 21 to the target parking position P1 and park the vehicle in parallel in a correct vehicle orientation at a position intended by a driver, without depending on a start position where parking assistance is started and a vehicle orientation.
  • Although the embodiment of the present invention has been described in detail above, the present invention is not limited to the above embodiment, and various modifications of design may be made without departing from the spirit of the present invention described in claims. For example, the embodiment described above has been illustrated in detail to facilitate description for easy understanding of the present invention, and is not necessarily limited to the embodiment that includes all the configurations. Additionally, a part of a configuration of an embodiment may be replaced with a configuration of another embodiment, and a configuration of an embodiment may be added with a configuration of another embodiment. Moreover, a part of a configuration of each embodiment may be deleted, replaced, or added with another configuration.
  • Reference Signs List
  • 1
    parking assist apparatus
    11
    first route calculation unit
    12
    second route calculation unit
    13
    parking route setting unit
    15
    operation input unit
    16
    route display unit
    21
    own vehicle
    22
    front obstacle
    23
    rear obstacle
    24
    side obstacle
    121
    forward/backward movement determination unit
    122
    backward movement starting route calculation unit
    123
    forward movement starting route calculation unit

Claims (4)

  1. A parking assist apparatus for assisting parallel parking of an own vehicle, the parking assist apparatus comprising:
    a first route calculation unit configured to calculate a first route for moving the own vehicle from a target parking position to a virtual departure position based on a parking space and a constraint condition of own vehicle behavior;
    a second route calculation unit configured to calculate a second route for moving the own vehicle from an initial position where parking assistance is started to the virtual departure position; and
    a parking route setting unit configured to set a parking route of the own vehicle with use of the first route and the second route,
    wherein the second route calculation unit comprises:
    a forward/backward movement determination unit configured to determine whether the initial position is on a front side or a rear side with respect to a first reference line extending along a longitudinal direction of the own vehicle at the virtual departure position;
    a backward movement starting route calculation unit configured to calculate a backward movement starting route that connects from the initial position to the virtual departure position by a backward movement of the own vehicle as the second route when the initial position is on a front side from the first reference line; and
    a forward movement starting route calculation unit configured to calculate a forward movement starting route that connects from the initial position to the virtual departure position by forward and backward movements of the own vehicle as the second route when the initial position is on a rear side from the first reference line or when it is impossible to calculate the backward movement starting route by the backward movement starting route calculation unit.
  2. The parking assist apparatus according to claim 1, further comprising a connection candidate position setting unit configured to set a connection candidate position on a second reference line passing through the initial position and extending parallel to a parking direction,
    wherein the forward movement starting route calculation unit calculates a forward movement route that connects from the initial position to the connection candidate position by a forward movement of the own vehicle, and a backward movement route that connects from the connection candidate position to the virtual departure position by a backward movement of the own vehicle, and the forward movement starting route calculation unit connects the forward movement route and the backward movement route to form the forward movement starting route.
  3. The parking assist apparatus according to claim 2, wherein the connection candidate position setting unit calculates a position where a direction of the own vehicle becomes parallel to a parking direction by turning from the virtual departure position, and sets, as the connection candidate position, a position where the calculated position is moved in parallel along the first reference line and placed on the second reference line.
  4. The parking assist apparatus according to claim 3, wherein the connection candidate position setting unit sets a plurality of other connection candidate positions with a predetermined interval on the second reference line from the connection candidate position.
EP17819776.0A 2016-07-01 2017-06-05 Parking assistance device Active EP3480065B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016132088A JP6854095B2 (en) 2016-07-01 2016-07-01 Parking support device
PCT/JP2017/020776 WO2018003411A1 (en) 2016-07-01 2017-06-05 Parking assistance device

Publications (3)

Publication Number Publication Date
EP3480065A1 true EP3480065A1 (en) 2019-05-08
EP3480065A4 EP3480065A4 (en) 2020-02-19
EP3480065B1 EP3480065B1 (en) 2022-07-06

Family

ID=60787011

Family Applications (1)

Application Number Title Priority Date Filing Date
EP17819776.0A Active EP3480065B1 (en) 2016-07-01 2017-06-05 Parking assistance device

Country Status (5)

Country Link
US (1) US10836432B2 (en)
EP (1) EP3480065B1 (en)
JP (1) JP6854095B2 (en)
CN (1) CN109311443B (en)
WO (1) WO2018003411A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113799768A (en) * 2021-09-27 2021-12-17 惠州华阳通用智慧车载系统开发有限公司 Automatic parking method based on vertical parking spaces
EP3990331A4 (en) * 2019-08-09 2023-07-05 Waymo LLC Parking behaviors for autonomous vehicles

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7002210B2 (en) 2017-04-07 2022-01-20 フォルシアクラリオン・エレクトロニクス株式会社 Parking support device
DE102017113663A1 (en) * 2017-06-21 2018-12-27 Valeo Schalter Und Sensoren Gmbh Automatic parking after a canceled manual parking procedure
WO2019188241A1 (en) * 2018-03-30 2019-10-03 クラリオン株式会社 Parking assistance device
JP7133336B2 (en) * 2018-04-06 2022-09-08 日立Astemo株式会社 parking assist device
JP6963687B2 (en) * 2018-05-23 2021-11-10 日立Astemo株式会社 Parking management system
DE102018209865A1 (en) * 2018-06-19 2019-12-19 Bayerische Motoren Werke Aktiengesellschaft Parking assistance system for automated parking out of a parallel parking space with a reverse pull as the last parking pull
KR20200103464A (en) * 2019-02-25 2020-09-02 현대자동차주식회사 Vehicle control apparatus and method
CN111746517A (en) * 2020-05-25 2020-10-09 中国第一汽车股份有限公司 Vehicle parking-out control method and device
CN112092810B (en) * 2020-09-24 2022-06-14 上海汽车集团股份有限公司 Vehicle parking-out method and device and electronic equipment

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3183284B2 (en) * 1999-01-19 2001-07-09 株式会社豊田自動織機製作所 Steering support device for reversing a vehicle
JP4096445B2 (en) * 1999-03-31 2008-06-04 アイシン精機株式会社 Parking assistance device
JP3624769B2 (en) * 1999-09-30 2005-03-02 株式会社豊田自動織機 Image conversion device for vehicle rear monitoring device
JP3911492B2 (en) * 2003-06-26 2007-05-09 トヨタ自動車株式会社 Vehicle travel support device
JP3938559B2 (en) * 2003-08-28 2007-06-27 アイシン精機株式会社 Vehicle reverse support device
EP1743808A4 (en) * 2004-05-06 2010-01-20 Panasonic Corp Parking assisting apparatus
JP4020128B2 (en) * 2005-04-22 2007-12-12 トヨタ自動車株式会社 Target position setting device and parking support device having the same
DE102006026092A1 (en) * 2006-06-03 2007-12-06 Bayerische Motoren Werke Ag Method for controlling a parking operation
JP5429514B2 (en) * 2008-06-03 2014-02-26 アイシン精機株式会社 Parking assistance device
DE102008002699A1 (en) * 2008-06-27 2009-12-31 Robert Bosch Gmbh An apparatus and method for controlling automatic steering of a vehicle, and apparatus and method for checking a feasibility of a predetermined target heading for a vehicle
JP4661917B2 (en) * 2008-07-25 2011-03-30 日産自動車株式会社 Parking assistance device and parking assistance method
JP5262855B2 (en) * 2009-03-09 2013-08-14 日産自動車株式会社 Parking assistance device and parking assistance method
ATE530404T1 (en) * 2009-04-30 2011-11-15 Magneti Marelli Spa PARKING ASSISTANCE SYSTEM
JP5445852B2 (en) * 2010-03-01 2014-03-19 アイシン精機株式会社 Parking assistance device
RU2525597C1 (en) * 2010-06-11 2014-08-20 Ниссан Мотор Ко., Лтд. Device and method for parking assistance
JP5472026B2 (en) * 2010-06-29 2014-04-16 トヨタ自動車株式会社 Parking assistance device
US9393869B2 (en) * 2012-11-27 2016-07-19 Nissan Motor Co., Ltd. Vehicle acceleration suppression device and vehicle acceleration suppression method
EP2927078B1 (en) * 2012-11-27 2017-12-20 Nissan Motor Co., Ltd Vehicle acceleration restriction device and vehicle acceleration restriction method
JP2015003565A (en) * 2013-06-19 2015-01-08 トヨタ自動車株式会社 Parking assist system
DE102013212318A1 (en) * 2013-06-26 2014-12-31 Bayerische Motoren Werke Aktiengesellschaft Automated parking procedure with additional correction train
JP6025063B2 (en) 2013-10-04 2016-11-16 アイシン精機株式会社 Parking assistance device
US9384662B2 (en) * 2014-04-17 2016-07-05 Ford Global Technologies, Llc Parking assistance for a vehicle
DE102014108949A1 (en) * 2014-06-26 2015-12-31 Valeo Schalter Und Sensoren Gmbh A method for assisting a driver of a motor vehicle when parking, driver assistance system and motor vehicle
JP6251940B2 (en) * 2014-06-30 2017-12-27 日立オートモティブシステムズ株式会社 Parking locus calculation apparatus and parking locus calculation method
US10435074B2 (en) * 2015-12-17 2019-10-08 Nissan Motor Co., Ltd. Parking support method and device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3990331A4 (en) * 2019-08-09 2023-07-05 Waymo LLC Parking behaviors for autonomous vehicles
US11720102B2 (en) 2019-08-09 2023-08-08 Waymo Llc Parking behaviors for autonomous vehicles
CN113799768A (en) * 2021-09-27 2021-12-17 惠州华阳通用智慧车载系统开发有限公司 Automatic parking method based on vertical parking spaces

Also Published As

Publication number Publication date
CN109311443A (en) 2019-02-05
WO2018003411A1 (en) 2018-01-04
JP2018001979A (en) 2018-01-11
US10836432B2 (en) 2020-11-17
EP3480065A4 (en) 2020-02-19
EP3480065B1 (en) 2022-07-06
JP6854095B2 (en) 2021-04-07
US20190322318A1 (en) 2019-10-24
CN109311443B (en) 2021-11-12

Similar Documents

Publication Publication Date Title
EP3480065B1 (en) Parking assistance device
EP3608188B1 (en) Parking assistance device
EP3608204B1 (en) Parking assistance device
US11293764B2 (en) Parking assistance device
US10562525B2 (en) Parking assistance device
EP3689687B1 (en) Parking assistant device
EP3608187B1 (en) Parking assistance device
EP3778315B1 (en) Parking assistance device

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20190201

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20200122

RIC1 Information provided on ipc code assigned before grant

Ipc: B62D 15/02 20060101ALI20200116BHEP

Ipc: B60R 21/00 20060101AFI20200116BHEP

Ipc: G08G 1/16 20060101ALI20200116BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20220223

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1502657

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220715

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602017059314

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20220706

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221107

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221006

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1502657

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220706

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221106

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221007

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602017059314

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

26N No opposition filed

Effective date: 20230411

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220706

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20230630

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20230605

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230605

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230605

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230605

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230605

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230605

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230630

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240521

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240522

Year of fee payment: 8