EP3433150A1 - Method and system for facilitating automatic driving of a vehicle to a certain position - Google Patents
Method and system for facilitating automatic driving of a vehicle to a certain positionInfo
- Publication number
- EP3433150A1 EP3433150A1 EP17770706.4A EP17770706A EP3433150A1 EP 3433150 A1 EP3433150 A1 EP 3433150A1 EP 17770706 A EP17770706 A EP 17770706A EP 3433150 A1 EP3433150 A1 EP 3433150A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- vehicle
- certain position
- image
- configuration
- surroundings
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
- B60W30/06—Automatic manoeuvring for parking
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
- G05D1/0246—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D15/00—Steering not otherwise provided for
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D15/00—Steering not otherwise provided for
- B62D15/02—Steering position indicators ; Steering position determination; Steering aids
- B62D15/027—Parking aids, e.g. instruction means
- B62D15/0285—Parking performed automatically
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0212—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
- G05D1/0225—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory involving docking at a fixed facility, e.g. base station or loading bay
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/40—Control within particular dimensions
- G05D1/43—Control of position or course in two dimensions [2D]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
- G06V20/54—Surveillance or monitoring of activities, e.g. for recognising suspicious objects of traffic, e.g. cars on the road, trains or boats
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/168—Driving aids for parking, e.g. acoustic or visual feedback on parking space
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60T—VEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL; ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES
- B60T2201/00—Particular use of vehicle brake systems; Special systems using also the brakes; Special software modules within the brake system controller
- B60T2201/10—Automatic or semi-automatic parking aid systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
- B60W60/001—Planning or execution of driving tasks
- B60W60/0025—Planning or execution of driving tasks specially adapted for specific operations
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2109/00—Types of controlled vehicles
- G05D2109/10—Land vehicles
Definitions
- the invention relates to a method for facilitating automatic driving of a vehicle to a certain position according to the preamble of claim 1 .
- the invention also relates to a system for facilitating automatic driving of a vehicle to a certain position.
- the invention also relates to a vehicle.
- the invention in addition relates to a computer program and a computer program product.
- Heavy vehicles such as trucks require relatively skilled drivers in order to manually drive and position the vehicle at certain positions such as loading and/or unloading stations for loading and/or unloading said vehicle.
- Such loading/unloading stations may require certain positioning such as docking of the vehicle.
- a less skilled driver may in such situations cause damages to the vehicle and/or the loading station in connection to driving and positioning the vehicle.
- US2014058613 and US2015127208 disclose systems for automatic parking wherein positioning of the vehicle is based upon a specification comprising an image of the surroundings of in connection to the location where the vehicle is intended to park. There is however a need for improving automatic driving of a vehicle to a certain position.
- An object of the present invention is to provide a method for facilitating automatic driving of a vehicle to a certain position which provides safe and efficient automatic driving and positioning of a vehicle at positions requiring good driving skills in order to avoid damage of vehicle and/or position by the driver if the driving and positioning would be carried out manually.
- Another object of the present invention is to provide a system for facilitating automatic driving of a vehicle to a certain position for facilitating automatic driving of a vehicle to a certain position which provides safe and efficient automatic driving and positioning of a vehicle at positions requiring good driving skills by the driver in order to avoid damage of vehicle and/or position if the driving and positioning would be carried out manually.
- an object of the invention is achieved by a method for facilitating automatic driving of a vehicle to a certain position. Positioning of said vehicle is based upon a specification comprising an image of the surroundings of said certain position.
- the method comprises the steps of: determining the current position of said vehicle; prior to automatically driving said vehicle to said certain position, providing an image of said vehicle in said certain position in said image of the surroundings; and automatically driving said vehicle to the position of said image of said vehicle.
- the step of determining the current position of the vehicle comprises according to an embodiment using a Global Navigation satellite System, GNSS, e.g. a global positioning system, GPS, for continuously determining the position of the vehicle.
- GNSS Global Navigation satellite System
- the specification comprising an image of the surroundings of said certain position is according to an embodiment obtained by means of extracting map information about the surroundings comprising the position, e.g. a loading/unloading station, at which the vehicle is intended to position itself.
- the method comprises the step of extracting map information about the surrounding comprising map information about said certain position such that an image of the surroundings of said certain position is obtained.
- the specification comprising an image of the surroundings of said certain position is a view generally from above.
- the image of the surroundings of said certain position may be a map view or an earth view.
- the image of said vehicle may be accessible from any suitable storage means such as an external storage means such as a server unit, a tablet, a laptop and/or a smartphone or the like, and/or an internal storage means for storing image data arranged in the vehicle, such an internal storage means being comprised in or connected to an electronic control unit of the vehicle.
- an external storage means such as a server unit, a tablet, a laptop and/or a smartphone or the like
- an internal storage means for storing image data arranged in the vehicle, such an internal storage means being comprised in or connected to an electronic control unit of the vehicle.
- the step of providing an image of said vehicle in said certain position in said image of the surroundings may be performed by means of dragging and dropping and positioning the image at the certain position.
- Providing the image of said vehicle in said certain position in said image of the surroundings may be performed by an operator of the vehicle or externally or automatically.
- the method comprises the step of determining an image of the configuration of said certain position as a basis for driving said vehicle to said certain position.
- the step of determining an image of the configuration of said certain position comprises the step of creating a current image of said configuration of said certain position and/or providing a stored image of the configuration of said certain position.
- Such an image is an image viewed generally from the ground in an essentially horizontal direction, i.e. an image taken from a ground position by a person standing on the ground in front of the position, e.g. loading/unloading station, or by means of said vehicle or other vehicle taken in front of the of the position, e.g. loading/unloading station.
- the step of creating a current image of said configuration of said certain position may be obtained by means of any suitable image detection unit comprising one or more camera units arranged on the vehicle and/or one or more external camera units such as a camera unit comprised in a smart phone used by an operator of the vehicle.
- Said one or more camera units arranged on the vehicle may be arranged in connection to the back of the vehicle, in connection to the front of the vehicle, in connection to one or both sides of the vehicle and/or in connection to the roof of the vehicle.
- the configuration of said certain position may comprise the dimensions of the certain position such as possible walls between which the vehicle is intended to be positioned, the height of and distance between such possible walls, possible end wall constituting a stop at which the vehicle is intended to be positioned a certain distance from, a possible platform and the height of such a possible platform, a possible roof portion and the height of the roof portion, i.e. the distance from the ground to the sealing of the roof portion.
- the method comprises the step of adapting positioning of said vehicle based upon the thus determined image of the configuration of said certain position and the configuration of said vehicle.
- the configuration of said vehicle comprises any information relevant for positioning the vehicle in said certain position comprising the dimensions, e.g. height, width and length, of the vehicle, if the vehicle comprises a tractor and a trailer the dimensions comprises dimensions of tractor and trailer, possible tail lift, and the like.
- the vehicle may be an autonomous vehicle.
- the vehicle may be a vehicle in a platoon, wherein the vehicle is intended to be position at a certain position and other vehicles in the platoon are intended to be positioned in other certain positions of a specified surrounding, the different positions according to an embodiment being different loading/unloading stations.
- the vehicle may be a leading vehicle in a platoon having a driver, wherein the rest of the vehicles are autonomous vehicles intended to trail the leading vehicle, wherein the driver of the leading vehicle of the platoon may provide images of the respective vehicles in the platoon in positions in said image intended for the respective vehicle including the leading vehicle.
- an object of the invention is achieved by a system for facilitating automatic driving of a vehicle to a certain position. Positioning of said vehicle is arranged to be based upon a specification comprising an image of the surroundings of said certain position.
- the system comprises means for determining the current position of said vehicle; means for providing an image of said vehicle in said certain position in said image of the surroundings prior to automatically driving said vehicle to said certain position; and means for automatically driving said vehicle to the position of said image of said vehicle.
- the system comprises means for determining an image of the configuration of said certain position as a basis for driving said vehicle to said certain position.
- the means for determining an image of the configuration of said certain position comprises means for creating a current image of said configuration of said certain position and/or means for providing a stored image of the configuration of said certain position.
- system comprises means for adapting positioning of said vehicle based upon the thus determined image of the configuration of said certain position and the configuration of said vehicle.
- said vehicle is a distribution vehicle and wherein said certain position comprises a loading and/or unloading station for loading and/or unloading said vehicle.
- the system for facilitating automatic driving of a vehicle to a certain position is adapted to perform the method as set out herein.
- the system according to the invention has the advantages according to the corresponding method.
- an object of the invention is achieved by a vehicle comprising a system according to the invention as set out herein.
- a computer program for facilitating automatic driving of a vehicle to a certain position said computer program comprising program code which, when run on an electronic control unit or another computer connected to the electronic control unit, causes the electronic control unit to perform the method according to the invention.
- a computer program product comprising a digital storage medium storing the computer program.
- Fig. 1 schematically illustrates a side view of a vehicle according to the present invention
- Fig. 4 schematically illustrates a system for facilitating automatic driving of a vehicle to a certain position according to an embodiment of the present invention
- Fig. 3a schematically illustrates a plan view of the position of the vehicle in a surrounding, an image of the surroundings, and an image of said vehicle provided in a certain position in said image of the surroundings according to an embodiment of the present invention
- Fig. 3b schematically illustrates a side view of a configuration of a certain position and the vehicle positioned at said certain position
- Fig. 3c schematically illustrates a front view of the configuration certain position
- Fig. 4 schematically illustrates a block diagram of a method for facilitating automatic driving of a vehicle to a certain position according to an embodiment of the present invention
- Fig. 5 schematically illustrates a computer according to an embodiment of the present invention.
- link refers to a communication link which may be a physical connector, such as an optoelectronic communication wire, or a non- physical connector such as a wireless connection, for example a radio or microwave link.
- facilitating automatic driving of a vehicle to a certain position refers to automatically operating the vehicle from a position to the certain position by propelling and steering the vehicle so as to correctly approach the certain position and positioning the vehicle at the certain position in a safe and efficient manner avoiding damage to the vehicle and configuration of the certain position.
- certain position refers to any location at which a vehicle such as a truck may be positioned.
- the term “certain position” may comprise the area of the ground on which the vehicle is intended to be positioned and certain additional area of the ground around the vehicle when positioned on the certain position.
- the term “certain position” may comprise the space of the around the vehicle in which the vehicle is intended to be positioned and certain additional space of the ground around the vehicle when positioned on the certain position.
- the term “certain position” may comprise a loading/unloading station intended for a distribution vehicle for loading and/or unloading.
- certain position may comprise a fuel station intended for a fuel truck to be filled with fuel or deliver fuel.
- configuration of the certain position refers to any construction of the certain position being relevant when driving the vehicle to the certain position and positioning the vehicle in connection to the certain position.
- configuration of the certain position may refer to the dimensions of the certain position such as possible walls between which the vehicle is intended to be positioned, the height of and distance between such possible walls, possible end wall constituting a stop at which the vehicle is intended to be positioned a certain distance from, a possible platform and the height of such a possible platform, a possible roof portion and the height of the roof portion, i.e. the distance from the ground to the sealing of the roof portion.
- configuration of the vehicle refers to any information regarding the vehicle relevant for positioning the vehicle in said certain position.
- the term “configuration of the vehicle” may the dimensions, e.g. height, width and length, of the vehicle, if the vehicle comprises a tractor and a trailer the dimensions comprises dimensions of tractor and trailer, possible tail lift and the extension of such a tail lift from the back of the vehicle in a lowered position and level of the tail lift in a lowered position, possible back doors and their extension in an open state, possible side door/doors which may be sliding doors, the level of the vehicle body and hence level of loading/unloading surfaces at the back of the vehicle and/or side of the vehicle.
- the term "providing an image of said vehicle in said certain position in said image of the surroundings” refers to providing an image of the vehicle in the image of the certain position of the surroundings where the image of the vehicle and the image of the surroundings are the made to the same scale.
- the image of said vehicle and image of the surroundings of said certain position are according to an embodiment viewed generally from above.
- the image of the surroundings of said certain position may be a map view or an earth view.
- the image of said vehicle and image of the surroundings of said certain position are according to an embodiment 3D-views.
- Fig. 1 schematically illustrates a side view of a vehicle 1 according to the present invention.
- the exemplified vehicle 1 is a heavy vehicle in the shape of a truck.
- the vehicle according to the present invention could be any suitable vehicle such as a bus or a car.
- the vehicle according to the present invention could be an autonomous vehicle.
- the vehicle comprises a system I for facilitating automatic driving of a vehicle to a certain position.
- Fig. 2 schematically illustrates a system I for facilitating automatic driving of a vehicle to a certain position according to an embodiment of the present invention.
- the vehicle is according to an embodiment a distribution vehicle and the certain position comprises according to an embodiment a loading and/or unloading station for loading and/or unloading said vehicle.
- the system I comprises an electronic control unit 100.
- the system I comprises means 1 10 for determining a specification comprising an image of the surroundings of said certain position.
- the means 1 10 for determining a specification comprising an image of the surroundings of said certain position comprises means 1 12 for extracting map information of a specification comprising an image of the surroundings of said certain position.
- the means 1 12 for extracting map information specification comprising an image of the surroundings comprises according to an embodiment a map information unit comprising map data comprising information about the surroundings of said certain position and possible specification of the certain position.
- the specification comprising an image of the surroundings of said certain position is a view generally from above.
- the image of the surroundings of said certain position may be a map view or an earth view.
- the system I comprises means 120 for determining the current position of said vehicle.
- the means 120 for determining the current position of said vehicle comprises according to an embodiment a Global Navigation satellite System, GNSS, e.g. a global positioning system, GPS, for continuously determining the position of the vehicle.
- GNSS Global Navigation satellite System
- GPS global positioning system
- the system I comprises according to an embodiment storage means 130 for storing data of said vehicle.
- the data of said vehicle comprises data of an image of said vehicle.
- the storage means 130 is according to an embodiment configured to store data of an image of said vehicle viewed from above. Such stored of an image of said vehicle is accessible for providing, e.g. copying, moving, dragging and dropping, to another image such as an image of the surrounding in the form of a map view/earth view.
- the data of said vehicle comprises data of the configuration of the vehicle comprising data of information relevant for positioning the vehicle in said certain position comprising the dimensions, e.g. height, width and length, of the vehicle, and, where applicable the dimensions of tractor and trailer, data of possible tail lift and the like.
- the storage means 130 comprises internal storage means 132 on board the vehicle.
- the internal storage means 132 may be any suitable means for storing information such as a control unit, a computer or the like.
- the internal storage means 132 is according to an embodiment comprised in the electronic control unit 100.
- the storage means comprises external storage means 134 external to the vehicle.
- the external storage means 134 may be any suitable external storage means such as a server unit, a personal computer, a tablet, a laptop, a smartphone and/or a so called storage-cloud or the like.
- the system I comprises means 140 means for providing an image of said vehicle in said certain position in said image of the surroundings prior to automatically driving said vehicle to said certain position.
- the means 140 means for providing an image of said vehicle in said certain position in said image of the surroundings comprises means for facilitating dragging and dropping and positioning the image at the certain position such as a smartphone, a table, a laptop or computer having a display arranged to display the image of the vehicle at said certain position.
- the means 140 means for providing the image of said vehicle in said certain position in said image of the surroundings may be manually operated by an operator of the vehicle or externally or automatically operated.
- the system I comprises means 150 for automatically driving said vehicle to the position of said image of said vehicle.
- the means 150 for automatically driving said vehicle to the position of said image of said vehicle may comprise any suitable drive means for driving the vehicle comprising propelling the vehicle, steering the vehicle, braking the vehicle and controlling drive of the vehicle.
- the drive means may comprise any suitable drive member such as an internal combustion engine for driving the vehicle, electric drive member comprising an electric motor for electric drive of the vehicle, or a hybrid drive arrangement for hybrid drive of vehicle.
- the system I thus comprises means 152 for adapting positioning of said vehicle based upon the thus determined image of the configuration of said certain position and the configuration of said vehicle.
- the system I comprises means 160 for determining an image of the configuration of said certain position as a basis for driving said vehicle to said certain position.
- the means 1 60 for determining an image of the configuration of said certain position comprises means 162 for creating a current image of said configuration of said certain position.
- the means 162 for creating a current image of said configuration of said certain position may comprise any suitable image detection unit comprising one or more camera units arranged on the vehicle and/or one or more external camera units such as a camera unit comprised in a smart phone used by an operator of the vehicle. Said one or more camera units arranged on the vehicle may be arranged in connection to the back of the vehicle, in connection to the front of the vehicle, in connection to one or both sides of the vehicle and/or in connection to the roof of the vehicle.
- the means 160 for determining an image of the configuration of said certain position comprises means 164 for providing a stored image of the configuration of said certain position.
- the system I comprises means 170 for determining the distance from the vehicle to the configuration of the certain position.
- the means 170 for determining the distance from the vehicle to the configuration of the certain position may comprise one or more detector units arranged on in connection to the back of the vehicle, in connection to the front of the vehicle, in connection to one or both sides of the vehicle and/or in connection to the roof of the vehicle and/or the certain position, e.g. loading/unloading station.
- the means 170 for determining the distance from the vehicle to the configuration of the certain position may comprise one or more radar units, one or more camera units and/or one or more Lidar units.
- the configuration of said certain position may comprise the dimensions of the certain position such as possible walls between which the vehicle is intended to be positioned, the height of and distance between such possible walls, possible end wall constituting a stop at which the vehicle is intended to be positioned a certain distance from, a possible platform and the height of such a possible platform, a possible roof portion and the height of the roof portion, i.e. the distance from the ground to the sealing of the roof portion.
- the means 170 for determining the distance from the vehicle to the configuration of the certain position hereby is configured to determine such distances.
- the electronic control unit 100 is operably connected to the means 1 10 for determining a specification comprising an image of the surroundings of said certain position via a link 10.
- the electronic control unit 100 is via the link 10 arranged to receive a signal from said means 1 10 representing data for specification comprising an image of the surroundings of said certain position.
- the electronic control unit 100 is operably connected to the means 1 12 for extracting map information specification comprising an image of the surroundings comprises according to an embodiment a map information unit comprising map data comprising information about the surroundings of said certain position and possible specification of the certain position via a link 12.
- the electronic control unit 100 is via the link 12 arranged to receive a signal from said means 1 12 representing map data for map information specification comprising an image of the surroundings of said certain position.
- the electronic control unit 100 is operably connected to the means 120 for determining the current position of said vehicle via a link 20.
- the electronic control unit 100 is via the link 20 arranged to receive a signal from said means 120 representing data for current position of said vehicle.
- the electronic control unit 100 is operably connected to the storage means 130 for storing data of said vehicle via a link 30.
- the electronic control unit 100 is via the link 30 arranged to receive a signal from said storage means 130 representing storage data for said vehicle comprising data of an image of said vehicle and data of information relevant for positioning the vehicle in said certain position comprising data of the dimensions of the vehicle.
- the electronic control unit 100 is operably connected to the internal storage means 132 on board the vehicle via a link 32.
- the electronic control unit 100 is via the link 32 arranged to receive a signal from said internal storage means 132 representing storage data for said vehicle comprising data of an image of said vehicle and data of information relevant for positioning the vehicle in said certain position comprising data of the dimensions of the vehicle.
- the electronic control unit 100 is operably connected to the external storage means 134 on board the vehicle via a link 34.
- the electronic control unit 100 is via the link 34 arranged to receive a signal from said external storage means 134 representing storage data for said vehicle comprising data of an image of said vehicle and data of information relevant for positioning the vehicle in said certain position comprising data of the dimensions of the vehicle.
- the electronic control unit 100 is operably connected to the means 140 means for providing an image of said vehicle in said certain position in said image of the surroundings prior to automatically driving said vehicle to said certain position via a link 40a.
- the electronic control unit 100 is via the link 40a arranged to send a signal to said means 140 representing data for an image of the surroundings of said certain position.
- the electronic control unit 100 is operably connected to the means 140 means for providing an image of said vehicle in said certain position in said image of the surroundings prior to automatically driving said vehicle to said certain position via a link 40b.
- the electronic control unit 100 is via the link 40b arranged to send a signal to said means 140 representing data for an image of the vehicle.
- the electronic control unit 100 is operably connected to the means 140 means for providing an image of said vehicle in said certain position in said image of the surroundings prior to automatically driving said vehicle to said certain position via a link 40c.
- the electronic control unit 100 is via the link 40c arranged to receive a signal from said means 140 representing data for the image of said vehicle in said certain position in said image of the surroundings.
- the electronic control unit 100 is operably connected to means 150 for automatically driving said vehicle to the position of said image of said vehicle via a link 50a.
- the electronic control unit 100 is via the link 50a arranged to send a signal to said means 150 representing data for the image of said vehicle in said certain position in said image of the surroundings.
- the electronic control unit 100 is operably connected to means 150 for automatically driving said vehicle to the position of said image of said vehicle via a link 50b.
- the electronic control unit 100 is via the link 50b arranged to send a signal to said means 150 representing data for an image of the configuration of said certain position.
- the electronic control unit 100 is operably connected to means 150 for automatically driving said vehicle to the position of said image of said vehicle via a link 50c.
- the electronic control unit 100 is via the link 50c arranged to send a signal to said means 150 representing data for the configuration of said vehicle.
- the electronic control unit 100 is operably connected to means 150 for automatically driving said vehicle to the position of said image of said vehicle via a link 50d.
- the electronic control unit 100 is via the link 50d arranged to send a signal to said means 150 representing data for distance/distances between the vehicle and the configuration of the certain position.
- the electronic control unit 100 is operably connected to the means 160 for determining an image of the configuration of said certain position via a link 60.
- the electronic control unit 100 is via the link 60 arranged to receive a signal from said means 160 representing data for image of the configuration of said certain position.
- the electronic control unit 100 is operably connected to the means 162 for creating a current image of said configuration of said certain position via a link 62.
- the electronic control unit 100 is via the link 62 arranged to receive a signal from said means 162 representing data for image of the configuration of said certain position.
- the electronic control unit 100 is operably connected to the means 164 for providing a stored image of the configuration of said certain position via a link 64.
- the electronic control unit 100 is via the link 64 arranged to receive a signal from said means 164 representing data for image of the configuration of said certain position.
- the electronic control unit 100 is operably connected to the means 170 for determining the distance from the vehicle to the configuration of the certain position via a link 70.
- the electronic control unit 100 is via the link 70 arranged to receive a signal from said means 170 representing data for distance from the vehicle to the configuration of the certain position.
- Fig. 3a schematically illustrates a plan view of the position of the vehicle 1 in a surrounding L, an image of the surroundings L, and an image 1 i of said vehicle provided in a certain position P4 in said image of the surroundings L according to an embodiment of the present invention.
- the surroundings L is a location where distribution vehicles are intended to drive to certain positions P1 , P2, P3, P4, P5, P6 for loading and/or unloading.
- the certain positions P1 , P2, P3, P4, P5, P6 thus comprises loading and/or unloading stations for loading and/or unloading said vehicle 1 .
- the loading and/or unloading stations are here part of a loading and/or unloading site LS.
- the vehicle 1 is shown, the vehicle according to this example being a distribution vehicle in the form of a truck.
- the vehicle 1 may be an autonomous vehicle.
- the vehicle 1 may according to an embodiment not shown be a vehicle in a platoon, wherein the vehicle is intended to be positioned at any of the certain positions P1 , P2, P3, P4, P5, P6 and other vehicles in the platoon are intended to be positioned any of the remaining certain positions P1 , P2, P3, P4, P5, P6 in the surrounding L.
- the vehicle arrives to the surroundings L with the intention to drive to a certain position P4, here a loading/unloading station.
- the current position of the vehicle 1 is determined e.g.
- GNSS Global Navigation satellite System
- An image of the surrounding is determined, the image according to an embodiment being extracted by means of map information.
- an image of the surrounding of the certain position P4 the image being illustrated by the surroundings L in fig. 3a.
- the image is thus a view from above of the surrounding L of the certain position P4, i.e. loading/unloading station.
- the image is in the form of a map or an earth view with a desired scale so as to cover the loading site LS and the current position of the vehicle 1 .
- the vehicle is intended to be automatically driven to the certain position P4, i.e. loading/unloading station.
- the certain position P4 i.e. loading/unloading station.
- an image 1 a of said vehicle 1 is provided in the certain position P4 in said image of the surroundings L.
- an image of the configuration of said certain position P4 is determined as a basis for driving said vehicle to said certain position.
- the image of the configuration of said certain position P4 may be obtained by means of any suitable image detection unit comprising one or more camera units arranged on the vehicle and/or one or more external camera units such as a camera unit comprised in a smart phone used by an operator O of the vehicle.
- Such an operator O may thus take images of the certain position P4.
- the operator may take images of other certain positions P1 , P2, P3, P5, P6 for storage and use for other vehicles, e.g. vehicles in a platoon.
- Determining an image of the configuration of said certain position P4 may thus be obtained by creating a current image of said configuration of said certain position by means of an image detection unit arranged on the vehicle 1 and/or by the operator O. Determining an image of the configuration of the certain position P4 may also be obtained by providing a stored image of the configuration of said certain position P4. The stored information may be based upon images created by another vehicle and/or another operator having performed driving and positioning at the certain position P4. The vehicle 1 is then automatically driven to the position of the image 1 i of the vehicle, the image of the configuration of the position P4 being used in addition as a basis for driving the vehicle to the certain position. The automatic driving of the vehicle 1 may be initiated by the operator O of the vehicle, e.g. via a smartphone or the like.
- the automatic driving of the vehicle 1 may be initiated externally, e.g. by a person not at the surrounding L but located at any desired location such
- the automatic driving of the vehicle 1 may be initiated automatically, e.g. for an autonomous vehicle, when the above information has been retrieved.
- Fig. 3b schematically illustrates a side view of a configuration of the certain position P4 and the vehicle 1 positioned at said certain position P4, and
- fig. 3c schematically illustrates a front view of the configuration certain position P4.
- the configuration of said certain position P4, here loading/unloading station, comprises the dimensions of the certain position P4.
- the configuration of the certain position P4 comprises walls P4a, P4b between which the vehicle is intended to be positioned providing a width W and a roof portion P4c at a height H, the height H constituting the distance from the ground G to the sealing of the roof portion P4c.
- the configuration of the certain position P4 comprises a platform Pd and the height of such a possible platform.
- the configuration of the certain position P4 comprises an end wall P4e constituting a stop at which the vehicle 1 is intended to be positioned a certain distance D1 from.
- Means 170 for determining the distance from the vehicle 1 to the configuration of the certain position P4 is provided.
- the means 170 for determining the distance from the vehicle to the configuration of the certain position may comprise one or more detector units arranged on in connection to the back of the vehicle, in connection to the front of the vehicle, in connection to one or both sides of the vehicle and/or in connection to the roof of the vehicle and/or the certain position, e.g. loading/unloading station.
- the configuration of the vehicle 1 comprises any information relevant for positioning the vehicle in said certain position comprising the dimensions, e.g.
- the vehicle 1 in this example comprises a tail lift TL as illustrated in fig. 3b where the tail lift TL is in a lowered position for loading/unloading the vehicle 1 .
- the distance from the tail lift TL to the end wall P4e and distance and height of the platform P4d is information received from image of configuration of the certain position P4 and is taken into consideration together with information about the configuration of the vehicle 1 comprising information about the tail lift TL and the extension of the tail lift TL from the back of the vehicle 1 in the lowered position and possible height adjustment of the tail lift with regard to the ramp P4d.
- the configuration of the vehicle comprises the level of the vehicle 1 , i.e. the level of the vehicle body of the vehicle 1 relative to the ground, wherein the level of the vehicle 1 may be adjusted with regard to e.g. the platform P4d of the configuration of the certain position P4.
- the positioning at the certain position P4 may be denoted docking.
- the vehicle 1 is according to an embodiment intended to be docked at the certain position P4.
- a loading/unloading station comprises docking the vehicle 1 at said loading/unloading station.
- Fig. 4 schematically illustrates a block diagram of a method for facilitating automatic driving of a vehicle to a certain position. Positioning of said vehicle is based upon a specification comprising an image of the surroundings of said certain position.
- the method for facilitating automatic driving of a vehicle to a certain position comprises a step S1 . In this step the current position of said vehicle is determined.
- the method for facilitating automatic driving of a vehicle to a certain position comprises a step S2.
- a step S2 prior to automatically driving said vehicle to said certain position, an image of said vehicle in said certain position in said image of the surroundings is provided.
- the method for facilitating automatic driving of a vehicle to a certain position comprises a step S3.
- the vehicle is automatically driven to the position of said image of said vehicle.
- the step of determining the current position of the vehicle comprises according to an embodiment using a Global Navigation satellite System, GNSS, e.g. a global positioning system, GPS, for continuously determining the position of the vehicle.
- GNSS Global Navigation satellite System
- the specification comprising an image of the surroundings of said certain position is according to an embodiment obtained by means of extracting map information about the surroundings comprising the position, e.g. a loading/unloading station, at which the vehicle is intended to position itself.
- the method comprises the step of extracting map information about the surrounding comprising map information about said certain position such that an image of the surroundings of said certain position is obtained.
- the specification comprising an image of the surroundings of said certain position is a view generally from above.
- the image of the surroundings of said certain position may be a map view or an earth view.
- the image of said vehicle may be accessible from any suitable storage means such as an external storage means such as a server unit, a tablet, a laptop and/or a smartphone or the like, and/or an internal storage means for storing image data arranged in the vehicle, such an internal storage means being comprised in or connected to an electronic control unit of the vehicle.
- the step of providing an image of said vehicle in said certain position in said image of the surroundings may be performed by means of dragging and dropping and positioning the image at the certain position.
- Providing the image of said vehicle in said certain position in said image of the surroundings may be performed by an operator of the vehicle or externally or automatically.
- said position can be a position such as a loading/unloading station which would have required good driving skills by the driver in order to avoid damage of vehicle and/or position if the driving and positioning would be carried out manually.
- the method comprises the step of determining an image of the configuration of said certain position as a basis for driving said vehicle to said certain position.
- the step of determining an image of the configuration of said certain position comprises the step of creating a current image of said configuration of said certain position and/or providing a stored image of the configuration of said certain position.
- Such an image is an image viewed generally from the ground in an essentially horizontal direction, i.e. an image taken from a ground position by a person standing on the ground in front of the position, e.g. loading/unloading station, or by means of said vehicle or other vehicle taken in front of the of the position, e.g. loading/unloading station.
- the step of creating a current image of said configuration of said certain position may be obtained by means of any suitable image detection unit comprising one or more camera units arranged on the vehicle and/or one or more external camera units such as a camera unit comprised in a smart phone used by an operator of the vehicle.
- Said one or more camera units arranged on the vehicle may be arranged in connection to the back of the vehicle, in connection to the front of the vehicle, in connection to one or both sides of the vehicle and/or in connection to the roof of the vehicle.
- the configuration of said certain position may comprise the dimensions of the certain position such as possible walls between which the vehicle is intended to be positioned, the height of and distance between such possible walls, possible end wall constituting a stop at which the vehicle is intended to be positioned a certain distance from, a possible platform and the height of such a possible platform, a possible roof portion and the height of the roof portion, i.e. the distance from the ground to the sealing of the roof portion.
- the method comprises the step of adapting positioning of said vehicle based upon the thus determined image of the configuration of said certain position and the configuration of said vehicle.
- the configuration of said vehicle comprises any information relevant for positioning the vehicle in said certain position comprising the dimensions, e.g. height, width and length, of the vehicle, if the vehicle comprises a tractor and a trailer the dimensions comprises dimensions of tractor and trailer, possible tail lift, and the like.
- the automatic positioning of said vehicle is further improved in that more detailed information is taken into consideration including the configuration of the position, and the configuration of the vehicle.
- said vehicle is a distribution vehicle and wherein said certain position comprises a loading and/or unloading station for loading and/or unloading said vehicle.
- the vehicle may be an autonomous vehicle.
- the vehicle may be a vehicle in a platoon, wherein the vehicle is intended to be position at a certain position and other vehicles in the platoon are intended to be positioned in other certain positions of a specified surrounding, the different positions according to an embodiment being different loading/unloading stations.
- the vehicle may be a leading vehicle in a platoon having a driver, wherein the rest of the vehicles are autonomous vehicles intended to trail the leading vehicle, wherein the driver of the leading vehicle of the platoon may provide images of the respective vehicles in the platoon in positions in said image intended for the respective vehicle including the leading vehicle.
- Apparatus 500 comprises a non-volatile memory 520, a data processing device 510 and a read/write memory 550.
- Nonvolatile memory 520 has a first memory portion 530 wherein a computer program, such as an operating system, is stored for controlling the function of apparatus 500.
- apparatus 500 comprises a bus controller, a serial communication port, l/O-means, an A/D-converter, a time date entry and transmission unit, an event counter and an interrupt controller (not shown).
- Non-volatile memory 520 also has a second memory portion 540.
- a computer program P comprising routines for facilitating automatic driving of a vehicle to a certain position, positioning of said vehicle being based upon a specification comprising an image of the surroundings of said certain position.
- the vehicle is a distribution vehicle and wherein said certain position comprises a loading and/or unloading station for loading and/or unloading said vehicle.
- the program P comprises routines for determining the current position of said vehicle.
- the program P comprises routines for prior to automatically driving said vehicle to said certain position, providing an image of said vehicle in said certain position in said image of the surroundings.
- the program P comprises routines for automatically driving said vehicle to the position of said image of said vehicle.
- the program P comprises routines for determining an image of the configuration of said certain position as a basis for driving said vehicle to said certain position.
- the routines for determining an image of the configuration of said certain position comprises routines for creating a current image of said configuration of said certain position and/or providing a stored image of the configuration of said certain position.
- the program P comprises routines for adapting positioning of said vehicle based upon the thus determined image of the configuration of said certain position and the configuration of said vehicle.
- the computer program P may be stored in an executable manner or in a compressed condition in a separate memory 560 and/or in read/write memory 550.
- Data processing device 510 may communicate with a data communications port 599 by means of a data bus 515.
- Non-volatile memory 520 is adapted for communication with data processing device 510 via a data bus 512.
- Separate memory 560 is adapted for communication with data processing device 510 via a data bus 51 1 .
- Read/write memory 550 is adapted for communication with data processing device 510 via a data bus 514. To the data communications port 599 e.g. the links connected to the control units 100 may be connected.
- data processing device 510 When data is received on data port 599 it is temporarily stored in second memory portion 540. When the received input data has been temporarily stored, data processing device 510 is set up to perform execution of code in a manner described above.
- the signals received on data port 599 can be used by apparatus 500 determining the current position of said vehicle.
- the signals received on data port 599 can be used by apparatus 500 for, prior to automatically driving said vehicle to said certain position, providing an image of said vehicle in said certain position in said image of the surroundings.
- the signals received on data port 599 can be used by apparatus 500 for automatically driving said vehicle to the position of said image of said vehicle.
- the signals received on data port 599 can be used by apparatus 500 for determining an image of the configuration of said certain position as a basis for driving said vehicle to said certain position.
- the signals received on data port 599 can be used by apparatus 500 for adapting positioning of said vehicle based upon the thus determined image of the configuration of said certain position and the configuration of said vehicle.
- the signals used by apparatus 500 for determining an image of the configuration of said certain position comprises signals used by apparatus 500 for creating a current image of said configuration of said certain position and/or providing a stored image of the configuration of said certain position.
- Parts of the methods described herein can be performed by apparatus 500 by means of data processing device 510 running the program stored in separate memory 560 or read/write memory 550. When apparatus 500 runs the program, parts of the methods described herein are executed.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Radar, Positioning & Navigation (AREA)
- Mechanical Engineering (AREA)
- Transportation (AREA)
- Aviation & Aerospace Engineering (AREA)
- Remote Sensing (AREA)
- Multimedia (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Electromagnetism (AREA)
- Traffic Control Systems (AREA)
- Navigation (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| SE1650382A SE540315C2 (en) | 2016-03-22 | 2016-03-22 | Method and system for facilitating automatic driving of a vehicle to a certain position |
| PCT/SE2017/050228 WO2017164793A1 (en) | 2016-03-22 | 2017-03-09 | Method and system for facilitating automatic driving of a vehicle to a certain position |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP3433150A1 true EP3433150A1 (en) | 2019-01-30 |
| EP3433150A4 EP3433150A4 (en) | 2019-10-09 |
Family
ID=59899662
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP17770706.4A Withdrawn EP3433150A4 (en) | 2016-03-22 | 2017-03-09 | Method and system for facilitating automatic driving of a vehicle to a certain position |
Country Status (4)
| Country | Link |
|---|---|
| EP (1) | EP3433150A4 (en) |
| CN (1) | CN109070878A (en) |
| SE (1) | SE540315C2 (en) |
| WO (1) | WO2017164793A1 (en) |
Family Cites Families (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3927512B2 (en) * | 2003-03-27 | 2007-06-13 | トヨタ自動車株式会社 | Parking assistance device |
| DE102004028763A1 (en) * | 2004-06-16 | 2006-01-19 | Daimlerchrysler Ag | Andockassistent |
| DE102005023177A1 (en) * | 2005-05-19 | 2006-11-30 | Robert Bosch Gmbh | Method for driver assistance |
| US8035531B2 (en) * | 2005-10-31 | 2011-10-11 | Toyota Jidosha Kabushiki Kaisha | Parking support device |
| JP4432930B2 (en) * | 2006-04-25 | 2010-03-17 | トヨタ自動車株式会社 | Parking assistance device and parking assistance method |
| EP2181892B1 (en) * | 2008-10-28 | 2011-12-14 | Volkswagen AG | Parking assistance system and method for operating a parking assistance system for a motor vehicle |
| DE102009041587A1 (en) * | 2009-09-15 | 2011-03-17 | Valeo Schalter Und Sensoren Gmbh | A driver assistance device for a motor vehicle and method for assisting a driver in monitoring an autonomous parking operation of a motor vehicle |
| JP2012076483A (en) * | 2010-09-30 | 2012-04-19 | Aisin Seiki Co Ltd | Parking support device |
| JP5516992B2 (en) * | 2010-11-30 | 2014-06-11 | アイシン精機株式会社 | Parking position adjustment device |
| DE102011086215A1 (en) * | 2011-11-11 | 2013-05-16 | Robert Bosch Gmbh | Method for assisting driver of motor car, involves determining trajectory for reaching end position e.g. parking space and maneuvering statements to follow around trajectory or automatic maneuver along trajectory into end position |
| US8831831B2 (en) * | 2011-12-20 | 2014-09-09 | Continental Automotive Systems, Inc. | Trailer backing aid using GPS mapping and camera image display |
| US8700258B2 (en) * | 2012-09-12 | 2014-04-15 | GM Global Technology Operations LLC | Park assist system |
| KR101487161B1 (en) * | 2013-01-21 | 2015-01-28 | 아진산업(주) | parking assist method for vehicle through drag and drop |
| US9274522B2 (en) * | 2014-01-14 | 2016-03-01 | Robert Bosch Automotive Steering Gmbh | Method for controlling the driving of a big rig and drive control system |
| DE102014200611A1 (en) * | 2014-01-15 | 2015-07-16 | Robert Bosch Gmbh | Method for the autonomous parking of a vehicle, driver assistance device for carrying out the method, and vehicle with the driver assistance device |
| CN105015419B (en) * | 2015-07-17 | 2017-09-22 | 中山大学 | Automatic parking method with building figure is positioned based on stereoscopic vision |
| CN105094132A (en) * | 2015-08-20 | 2015-11-25 | 遵义坤冰科技有限公司 | Intelligent parking system |
-
2016
- 2016-03-22 SE SE1650382A patent/SE540315C2/en unknown
-
2017
- 2017-03-09 WO PCT/SE2017/050228 patent/WO2017164793A1/en not_active Ceased
- 2017-03-09 EP EP17770706.4A patent/EP3433150A4/en not_active Withdrawn
- 2017-03-09 CN CN201780017386.9A patent/CN109070878A/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| SE540315C2 (en) | 2018-06-12 |
| EP3433150A4 (en) | 2019-10-09 |
| WO2017164793A1 (en) | 2017-09-28 |
| CN109070878A (en) | 2018-12-21 |
| SE1650382A1 (en) | 2017-09-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10759428B2 (en) | Use of laser scanner for autonomous truck operation | |
| US11400977B2 (en) | Vehicle guidance system | |
| EP3905215B1 (en) | Precise truck parking method, device, and system in quayside container crane area | |
| US10761534B2 (en) | Fused sensor view for self-driving truck | |
| US9828748B2 (en) | Mine management system and mine managing method | |
| CN113282090A (en) | Unmanned control method and device for engineering vehicle, engineering vehicle and electronic equipment | |
| US9898011B2 (en) | Driving assistance system and program for driving according to operations management | |
| CN111443705A (en) | In-vehicle processing device and control method for in-vehicle processing device | |
| CN109606292B (en) | Autonomous vehicle maintenance and self-charging | |
| CN107003672A (en) | Method for loading and unloading vehicle | |
| EP3617829A1 (en) | Roadway transport system | |
| US20240228163A1 (en) | Conveyance system, conveyance method, and conveyance vehicle used in conveyance system | |
| US10628687B1 (en) | Parking spot identification for vehicle park-assist | |
| CN114296461A (en) | Unmanned control method for dump truck | |
| US11687081B2 (en) | Motor controller and method for loading and unloading tractors on flatbed trailers | |
| EP3433150A1 (en) | Method and system for facilitating automatic driving of a vehicle to a certain position | |
| JP7373573B2 (en) | Method and control unit for stopping a vehicle when stopping at different types of stopping positions | |
| CN113823110A (en) | Parking aids, servers or systems and methods, computer equipment and media | |
| JP7360634B2 (en) | Vehicle control system and cargo handling control system | |
| CN117184085A (en) | Reverse steering control system and vehicle for driverless vehicles | |
| CN110502002B (en) | Vehicle guidance system, loading and unloading equipment control system and vehicle control system | |
| CN108700881A (en) | The control device and method mobile for the automation of automobile | |
| US12377876B2 (en) | Method for planning a driving trajectory defining a travelling path for a vehicle | |
| US20240094030A1 (en) | A computer-implemented method for initializing a localization system for a vehicle | |
| US20250257592A1 (en) | Trailer door status detection from tractor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20181022 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| A4 | Supplementary search report drawn up and despatched |
Effective date: 20190905 |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: B60W 30/06 20060101AFI20190830BHEP Ipc: G08G 1/16 20060101ALI20190830BHEP Ipc: G05D 1/02 20060101ALI20190830BHEP Ipc: G06K 9/00 20060101ALI20190830BHEP Ipc: B62D 15/00 20060101ALI20190830BHEP Ipc: B62D 15/02 20060101ALI20190830BHEP |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN |
|
| 18W | Application withdrawn |
Effective date: 20200130 |