EP4244648A2 - Sensorsystem für traktoranhänger - Google Patents

Sensorsystem für traktoranhänger

Info

Publication number
EP4244648A2
EP4244648A2 EP21893031.1A EP21893031A EP4244648A2 EP 4244648 A2 EP4244648 A2 EP 4244648A2 EP 21893031 A EP21893031 A EP 21893031A EP 4244648 A2 EP4244648 A2 EP 4244648A2
Authority
EP
European Patent Office
Prior art keywords
tractor
trailer
conveyance
sensors
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP21893031.1A
Other languages
English (en)
French (fr)
Inventor
Frederick M. MOORE
Yibiao ZHAO
Ripudaman Singh ARORA
Hung-Jui HUANG
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Isee Inc
Original Assignee
Isee Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Isee Inc filed Critical Isee Inc
Publication of EP4244648A2 publication Critical patent/EP4244648A2/de
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/93Lidar systems specially adapted for specific applications for anti-collision purposes
    • G01S17/931Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/86Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/87Combinations of systems using electromagnetic waves other than radio waves
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88Sonar systems specially adapted for specific applications
    • G01S15/93Sonar systems specially adapted for specific applications for anti-collision purposes
    • G01S15/931Sonar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9315Monitoring blind spots
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9318Controlling the steering
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/93185Controlling the brakes
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9319Controlling the accelerator
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9323Alternative operation using light waves
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9324Alternative operation using ultrasonic waves
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9327Sensor installation details
    • G01S2013/93271Sensor installation details in the front of the vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9327Sensor installation details
    • G01S2013/93272Sensor installation details in the back of the vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9327Sensor installation details
    • G01S2013/93273Sensor installation details on the top of the vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9327Sensor installation details
    • G01S2013/93274Sensor installation details on the side of the vehicles

Definitions

  • This disclosure relates to the navigation of a tractor-trailer combination.
  • Trailers and other wheeled conveyances are coupled to tractors and then autonomously moved through locations such as cargo yards, warehouse facilities, and intermodal facilities. Navigation and object avoidance need to be carried out in real time.
  • a system for imaging at least one of a trailer or other conveyance that is connected to a tractor and an environment proximate the tractor, wherein the trailer or other conveyance has two opposed lateral sides (the left and right sides), includes a plurality of sensors mounted to the tractor. The sensors together have an active sensing area that encompasses at least the two opposed lateral sides of the trailer or other conveyance.
  • the trailer or other conveyance has a width between the two opposed lateral sides and the plurality of sensors comprises a left sensor mounted to a left side of the tractor and a right sensor mounted to a right side of the tractor, wherein the left and right sensors are spaced apart by a distance that is greater than the width of the trailer or other conveyance.
  • the tractor has a left side and a right side, and the plurality of sensors comprises a left sensor mounted such that it extends outwardly away from the left side of the tractor and a right sensor mounted such that it extends outwardly away from the right side of the tractor.
  • the left and right sensors are spaced apart by more than 102 inches.
  • the tractor has a front, a rear, and a top
  • the plurality of sensors further comprises at least one of a front sensor mounted to the front of the tractor, a rear sensor mounted to the rear of the tractor, and a top sensor mounted to the top of the tractor.
  • the left and right sensors are spaced apart sufficiently such that they can obtain sufficient data along the entire side of the trailer or other conveyance when misalignment between the tractor and the trailer or other conveyance is about 3 degrees.
  • the plurality of sensors comprises at least one distance ranging sensor
  • the at least one distance ranging sensor comprises at least one of a LIDAR-based sensor, a radar-based sensor, and an ultrasonic-based sensor.
  • the left and right sensors are distance ranging sensors.
  • the trailer or other conveyance has a bottom height, and the left and right sensors are mounted below the bottom height of the trailer or other conveyance.
  • the left and right distance ranging sensors are spaced apart laterally such that a resolution on a determination of a length of the trailer or other conveyance, and a maximum allowable spacing of the data points returned from left and right sides of the trailer or other conveyance, is in the range of from about 1cm to about 50cm.
  • the system further includes a processor that is configured to process data from the plurality of sensors to develop position data for the trailer or other conveyance.
  • the processor is further configured to fit a predetermined shape representing the trailer or other conveyance to the position data.
  • the position data for the trailer or other conveyance comprises at least one of a trailer or other conveyance length, a trailer or other conveyance width, a trailer or other conveyance height, a location of a rear axle of the trailer or other conveyance, a location of a kingpin, and an angle between the tractor and the trailer or other conveyance.
  • the left and right sensors are spaced apart sufficiently such that they can obtain position data along the entire sides of the trailer or other conveyance when misalignment between the tractor and the trailer or other conveyance is up to about 3 degrees.
  • the left and right sensors are displaced laterally away from the tractor a sufficient distance such that the portion of the sensor field of view (FoV) filled by the trailer or other conveyance side wall is at least about 0.3 degrees, when the tractor and the trailer or other conveyance are misaligned by up to about +/- 3.0 degrees.
  • Some examples include one of the above and/or below features, or any combination thereof.
  • the tractor has a left side, a right side, a front, a rear, and a top
  • the plurality of sensors comprise at least one of a front camera mounted proximate the front of the tractor, a rear camera mounted proximate the rear of the tractor, a right side camera mounted proximate the right side of the tractor and configured to image at least the right side of the trailer or other conveyance, a left side camera mounted proximate the left side of the tractor and configured to image at least the left side of the trailer or other conveyance, and a top camera mounted proximate the top of the tractor and configured to image at least the front of the trailer or other conveyance.
  • At least one camera is oriented with a field of view proximate (e.g., away from) a side of the tractor, and the system further comprises an illumination system configured to provide light to the at least one camera field of view.
  • the trailer or other conveyance has a front side, and a camera is oriented with a field of view that includes the front side of the trailer or other conveyance.
  • the at least one camera is configured to be used for at least one of: static object detection, dynamic object detection, lane marking, safety identification, dock door identification, trailer or other conveyance identification, inspection for damage to the trailer or other conveyance, and robotic connection of the air hoses and electrical connections of the tractor to the trailer or other conveyance.
  • the system further comprises a global positioning system (GPS) carried at least in part by the tractor.
  • GPS global positioning system
  • the GPS comprises two GPS antennas mounted to a roof of the tractor, such that a position and attitude of the tractor can be determined using the two GPS antennas without the need for the tractor to be in motion.
  • the GPS comprises a third antenna located externally of the tractor in a fixed, non-moving location, and serving as a reference point for the GPS.
  • a method for calibrating sensors for a system for spatially imaging at least one of a trailer or other conveyance that is connectable to a tractor when the trailer or other conveyance is connected to the tractor and an environment proximate the tractor includes identifying an axis of rotation between the tractor and the connectable trailer or other conveyance when the trailer or other conveyance is connected to the tractor, mounting a calibration sensor to the tractor when the connectable trailer or other conveyance is not connected to the tractor at an intersection point between the axis of rotation and the tractor, obtaining spatial data of objects displaced about the tractor with the calibration sensor and with one or more sensors of the spatial imaging system that are mounted to the tractor, and processing the spatial data to calibrate the one or more sensors of the spatial imaging system relative to the mounting location of the calibration sensor.
  • Fig 1 A is a top view of a tractor-trailer combination and Fig. IB is a side view thereof.
  • Fig 1C is a schematic representation of a tractor chassis.
  • Fig 2 is a schematic block diagram of a tractor-trailer imaging and navigation system.
  • Fig 3 is a model of a tractor-trailer combination useful in understanding aspects of the present disclosure.
  • Fig 4 is a flowchart of a trailer state estimation method.
  • Fig 5 is a top view of a tractor maneuvering to pick up a trailer.
  • Fig 6 is a top view of a tractor-trailer maneuvering to drop off the trailer.
  • sensors are coupled to the tractor.
  • the sensors can be used for distance ranging and/or imaging.
  • the distance ranging sensors include one or more of LiDAR, radar and ultrasonic-based sensors.
  • the imaging sensors include optical imaging sensors such as cameras. Lights may be provided to light the field of view (FoV) of any one or more of the cameras.
  • radar with Doppler effect can be used to detect motion of the tractor, the trailer, or their combination. For example motion of trailer wheels can be detected. This may be used as an indication that the trailer is in motion.
  • the sensors are used to determine the angle between the tractor and the trailer. In some examples the sensors are used to determine the dimensions of the trailer.
  • the sensing system is used to assist with one or more of navigation of the tractortrailer, detection of objects, avoidance of objects, the identification of the trailer connected to the tractor, and/or the identification of other nearby trailers.
  • one or more optical sensors mounted on the tractor can be configured to image the bottom of the trailer. In an example this imaging can be used to estimate the angle of the trailer relative to the tractor and/or the relative motion between the tractor and the trailer.
  • the imaging field of view can include the trailer kingpin; the kingpin image can be used to assist with necessary alignment of the tractor and trailer during the trailer capture or docking operation.
  • the subject sensing system can be used as part of an autonomous vehicle control system.
  • Trailers and other wheeled conveyances (such as a chassis used to carry a shipping container) are commonly coupled to tractors using a “fifth wheel” coupling system that allows the trailer/conveyance to pivot relative to the tractor about a vertical kingpin axis.
  • the navigation system needs to have real-time information regarding the angle between the trailer/conveyance and the tractor, as well as the location and heading of the tractor. Such real-time information can be based on data gathered by the sensor system.
  • the sensor system includes a number of sensors that are coupled to the tractor.
  • the sensors include a plurality of distance ranging sensors and a plurality of optical imaging sensors.
  • the distance ranging sensors are LiDAR sensors. LiDAR sensors are known in the field. They return a set of data points that represent the position of objects from which the laser light is reflected in the viewed area that is scanned by the energy source.
  • the optical imaging sensors are digital cameras that return digital images of their field of view (FoV).
  • the sensor system includes sensors mounted on the left and right sides of the tractor.
  • the mounting is as rigid as possible, which can be accomplished by mounting the sensors (either directly or indirectly) to the unsprung chassis of the tractor rather than the sprung cab portion of the tractor.
  • sprung and unsprung as the terms are used here refer to the relationship of the cab to the chassis, where the cab is sprung relative to the chassis.
  • An advantage of mounting distance ranging sensors such as LiDAR on the chassis is it is independent of the cab movement (mainly pitch) with respect to the chassis.
  • a disadvantage can be that there might be some shock, but this can be addressed with additional shock absorption mechanisms.
  • a vibration isolation mount can be used to mount the LiDAR sensors to the unsprung chassis.
  • vibration isolation mounts are passive, which would include at least a spring and a damper coupling the LiDAR to the chassis, or to a mounting plate to which the LiDAR is rigidly fixed.
  • the vibration isolation mounts are active, where an actuator is coupled between the LiDAR (or mounting plate) and the chassis, sensors for measuring vibration of the LiDAR and possibly the frame of the chassis at the location the active isolation mount is coupled to the frame, and an active controller to cancel vibration of the mounting plate.
  • active vibration isolation mounts are well known in technical field.
  • sensor mounting can be standardized by mounting the sensors on a cab -protective frame that is a common add-on to yard trucks operating around a crane in a port use case.
  • the frame is a rigid steel structure that is rigidly mounted to the chassis and located just behind the cab, with vertical frame members near the left and right rear comers of the cab, and a horizontal frame member connecting the vertical members and located just above the height of the cab.
  • This frame is in some cases required for protection of drivers in the cab.
  • the left and right sensors are located such that their viewed area/FoV includes the left or right side of the trailer, respectively.
  • the left and right sensors are spaced apart farther than the width of the trailer, so that the two lateral sides of the trailer are within the viewed area/FoV of the two sensors.
  • the fields of view of the left and right sensors encompass the locations of open trailer rear doors; this allows the system to detect when the rear doors are open when they should not be.
  • Many trailers and other towed structures such as containers carried by a chassis are mandated to be no more than 8.5 feet wide, although other widths are used. When these sensors are LiDAR sensors, each sensor returns a set of data points multiple times per second.
  • These data points will include the position of the left and right side of the trailer. Since most trailers are essentially rectangular prisms or cuboids, their projection in a two-dimensional plane is a rectangle.
  • the joint angle of the trailer can be determined by continuously fitting a rectangle (or three contiguous sides of a rectangle) of the size of the trailer to the data in the plane returned by the distance ranging sensors.
  • the fitted shape may comprise three contiguous sides of a rectangle rather than all four sides.
  • one or more additional distance ranging sensors are located at the top of the tractor cab, at the rear of the cab, and/or at another location on the tractor facing the front of the conveyance, and with its viewing area/FoV including the front face of the trailer/conveyance. Data from this sensor can be used at least to initially estimate (initialize) the trailer/conveyance angle. In some examples the initialization of the trailer/conveyance angle is based on the kingpin position and a prior joint angle. The kingpin position can be determined algorithmically or set manually. For an estimate of the prior joint angle, a distance ranging sensor that has the front of the trailer in its viewing area can be used.
  • front wall lidar points are used as data points to fit the initial joint angle of the trailer.
  • data points from the LiDAR sensors are sorted into four classes, namely front wall, left wall, right wall, and other points.
  • the data points are iteratively classified around the prior estimate into these classes by solving for a joint regression for the three walls.
  • another distance ranging sensor is located at the front of the tractor with its viewed area facing forward, and used at least for static and dynamic object detection. In some examples another distance ranging sensor is located at the rear bottom of the tractor, where it will end up underneath a towed trailer (or other towed conveyance) and can be used to help view blind-spots behind the conveyance, to assist with estimating the conveyance joint angle, for object detection, and for conveyance state estimation.
  • an optical imaging sensor e.g., a camera
  • the LiDAR viewing area encompasses all of the camera FOV.
  • the camera data can be used for static and dynamic object detection and/or for lane detection.
  • image data for lane detection is disclosed in U.S. Patent Application Publication 2020/0327338 published on October 15, 2020, the entire disclosure of which is incorporated by reference herein for all purposes.
  • the subject sensing system can be used to detect at least the left and right sides of: a trailer coupled to the tractor, a container carried by a chassis coupled to the tractor, and/or a chassis or other towed wheeled vehicle/conveyance coupled to the tractor.
  • trailers, containers, and chassis have different shapes, they each have opposed left and right sides that can be detected by the distance ranging sensor(s), and/or imaging sensor(s), with the sensor data used to determine at least the angle relative to the tractor.
  • the sensing system also includes GPS sensing.
  • GPS sensing In an example two GPS antennas are mounted to the top of the tractor, and spaced apart as far as possible. These two antennas can be used to determine the position and attitude of the tractor.
  • a third GPS antenna is included in the sensor system, located in a fixed position externally of the tractor and serving as a reference point for the GPS system. The reference point can be used to calibrate the GPS system that uses the antennas carried by the tractor.
  • the imaging system is calibrated using a calibration sensor mounted to the fifth wheel of the tractor.
  • the calibration sensor can be mounted on a kingpin-like structure that is placed into the fifth wheel, which is the axis of rotation between the tractor and the connectable conveyance (e.g., a trailer or a chassis).
  • the sensors carried by the tractor can be calibrated by obtaining spatial data of one or more objects displaced about the tractor with the calibration sensor and with the sensors mounted to the tractor and used in the active sensing system. These data can be processed to calibrate the sensors of the sensing system relative to the mounting location of the calibration sensor.
  • the calibration sensor can be mounted at any location of the tractor that is fixed and known relative to the active sensors carried by the tractor.
  • Mounting to the fifth wheel is in some cases preferred because this location provides a mounting position that is rigid, measurable and transformable to a vehicle representation point that at least in some tractors is close to the center of gravity of the tractor. Representing a vehicle as the center of the rear-wheel axis is close to the vehicle center of gravity. Also this location is measurable compared to the true center of gravity. In some examples calibration accuracy requirements are high, requiring centimeter-level precision, thus having a point that is measurable is best. In some examples the location where the fifth wheel couples to the trailer kingpin is above the center of the real-wheel axis with a forward longitudinal shift of about 15.5 cm and vertical displacement of about 85 cm. These values are measurable and are near constant over most tractors, given manufacturing tolerances. If another location on the tractor is used for mounting of the calibration sensor, measurements from that location to the vehicle representation point could be made.
  • the relative positions of the sensors Due to manufacturing tolerances in both the original construction of the vehicle and in the addition of the subject sensor systems, the relative positions of the sensors (LIDARS, cameras, GPS antennas, etc.) to each other is either unknown or inaccurate. To best plot the motion of the vehicle relative to the environment that it is detecting and responding to, the relative position of the sensors must be accurately determined, especially in the case where two sensors see the same object but due to poor calibration will offer conflicting locations of it.
  • a solution to this problem is to temporarily install a new sensor (e.g., LIDAR, GPS, or camera) on the hitch (5 th wheel) of the tractor, which is the center of rotation for the trailer relative to the tractor.
  • This location can serve as the origin axis of the vehicle and tractor in a simulated environment, and by having a sensor here and detecting various generic objects (walls, cones, cylinders, etc.) with it, the sensors can be calibrated around the vehicle to assume the same location of these generic objects. This in turn provides sensor-to- sensor calibration equal to the inherent accuracy of these systems, and prevents "seeing double" that might occur with a miscalibration.
  • Another means for sensor calibration of LIDARS to cameras is to use a large generic object (not shown) of known shape and size with a predetermined pattern (such as a 'checkerboard' pattern) on it, including 3D shapes of a known size.
  • the LIDAR system will detect the overall shape and the shape of the cutouts or protrusions on it, and the cameras will use the checkerboard to correct for perspective warping that is inherent in camera systems.
  • the left and right distance ranging sensors are each located outwardly of the respective side of the tractor.
  • their distance from the side of the tractor is such that the sensor is able to detect the entirety of the left or right side, respectively, of an attached trailer, chassis, container, or other wheeled conveyance that is coupled to the tractor’s fifth wheel.
  • the ranging sensor is able to detect the sidewall from its front edge to its rear edge.
  • the ranging sensors are configured to accurately determine the location in space of the rear comers of the trailer, which also locates the hinge points of the rear trailer doors. To do so, there must be a sufficient amount of reliable data to provide accurate locations of these rear corners. Since the front of the trailer is also detected (e.g., by the distance ranging sensor mounted to the rear of the tractor), the sensing system is configured to locate the front, left, and right sides of the rectangular shape, thus locating the trailer in the 2D plane.
  • the subject tractor and its structure being towed will be autonomously moved through locations that include obstacles, such as parked trailers, moving vehicles, fixed infrastructure, and the like.
  • the left and right distance ranging sensors are mounted to the tractor such that they are below (i.e., closer to the ground than) the undersides of other tractors and trailers.
  • the tractor moves through the location, if the left or right sensor path intersects another trailer or tractor, it will pass below the vehicle and thus is more likely not to be damaged or destroyed.
  • a particular non-limiting example is when the trailer is being parked next to one or two other trailers and the left and right sensors may need to pass underneath an adjacent trailer during the parking maneuver.
  • the heights of the left and right sensors above the ground is established such that the sensors are able to image a two-foot high traffic cone from one meter away. This metric was selected based on assessing what the smallest, common, and dynamic obstacle in a yard would be, and in the case of the many yards this is a traffic cone.
  • various potential viewpoints around the vehicle can be simulated.
  • a 3D shape can be simulated to show all possible locations where the sensor can perceive useful data.
  • the position can be tuned to image all small obstacles without sacrificing range of the sensor.
  • the heights of the left and right sensors is established such that they are able to image support posts that are sometimes located close to loading docks and meant to support the underside of a docked trailer; these support posts are commonly about 40 inches high.
  • the optical imaging sensors can be used for dynamic and static object detection, lane marking, safety identification, identification of other equipment, and the like.
  • the system can also include illumination source(s) to help illuminate the FoV of the camera(s).
  • illumination source(s) to help illuminate the FoV of the camera(s).
  • lights are packaged together with each camera and oriented such that they illuminate some or all of the FoV of the camera.
  • the cameras are used to identify structures that are within their FoV, a non-limiting example being the identity of other trailers in the location. For example, in a cargo yard there are typically many trailers parked at loading docks and in other parking spots.
  • the cameras can be used to pick-up trailer identifying information (such as ID numbers located on a side of a trailer) as the tractor with the subject sensing system moves through the yard.
  • trailer identifying information such as ID numbers located on a side of a trailer
  • the cameras are side-looking sensors (looking outward from the left and right sides of the tractor) and the lights illuminate their FoV. Such information can be reported back to a yard central control system, to help better manage the yard.
  • Fig 1 A is a top view of a tractor-trailer combination 10, and Fig. IB is a side view thereof.
  • Trailer 14 is coupled to tractor 12 via the fifth wheel coupling 16 of a type known in the field.
  • Trailer 14 is able to rotate relative to tractor 12 about kingpin axis 18.
  • Trailer 14 has front wall (side) 14c, left side wall 14a, right side wall 14b, rear wall (side) 14d, top 14e, and bottom 14f.
  • Trailers are generally cuboid shaped, as are other structures that are conveyed by tractors, such as shipping containers (that are typically carried by a chassis that is coupled to the tractor).
  • Tractor 12 comprises cab 50 and fifth wheel 16 both carried on wheeled chassis 52.
  • Cab 50 has front wall 50a, rear wall 50b, top 50c, left sidewall 50d, right sidewall 50e, and bottom 50g.
  • Imaging system 20 is in part or in whole carried by tractor 12.
  • Imaging system 20 includes distance ranging sensors, which are preferably but not necessarily LiDAR-based sensors of a type known in the field. Alternatives include but are not limited to radar-based sensors and ultrasonic-based sensors.
  • imaging system 20 is configured to image at least one of a trailer or other conveyance that is connected to a tractor and an environment proximate the tractor.
  • Imaging system 20 includes a plurality of sensors mounted to the tractor, wherein the sensors together have an active sensing area that encompasses at least the two opposed lateral sides of the trailer/conveyance.
  • imaging system 20 includes sensors (or groups of sensors) 22, 24, 26, 28, and 30.
  • each of these sensors is a LiDAR sensor, a radar sensor and/or a camera.
  • one or more (or each) of these sensors is a group including a LiDAR sensor and a camera, generally configured to have the same viewed area/FoV or at least overlapping viewing areas/FoVs.
  • cameras or other imaging sensors can be mounted separately from the distance ranging sensors.
  • the system also includes one or more sources of visible light and oriented to light the field of view of one or more of the cameras.
  • At least some of the cameras and their associated lights can be pointed outboard of the tractor-trailer (e.g., outwardly of the left and right sides and/or front and rear of the tractor) so that the system can image the surrounding environment and other vehicles, hazards, pavement/ground/environment markings and the like, all of which can be used to help autonomously navigate the tractor and the tractor- trailer/conveyance combination.
  • the camera(s) can be configured to be used for at least one of static object detection, dynamic object detection, lane marking identification, safety identification, dock door identification, trailer identification, inspection for damage to the trailer, and robotic connection of the air hoses and electrical connections of the tractor to the trailer.
  • Imaging system 20 includes at least a left sensor 22 mounted to the left side 50d of the tractor and a right sensor 24 mounted to the right side 50e of the tractor.
  • the trailer has a width between the two opposed lateral sides 14a and 14b, and the left and right sensors are spaced apart by a distance that is greater than the width of the trailer.
  • left sensor 22 is mounted such that it extends outwardly away from the left side 50d of the tractor and right sensor 24 is mounted such that it extends outwardly away from the right side 50e of the tractor.
  • the left and right sensors are spaced apart by at least eight feet, for example at least about 8.5 feet (e.g., more than 102 inches).
  • imaging system 20 also includes one or more of front sensor 26 mounted to the front 50a of the tractor, rear sensor 30 mounted to the rear 50f of the tractor, and top sensor 28 mounted to the top 50c of the tractor.
  • Top sensor 28 can be used to locate trailer front wall 14c.
  • Rear sensor 30 can be used to image the underside 14f of the trailer, and also to image locations behind the trailer that might otherwise comprise blind spots that are not visible to other sensors mounted to the tractor.
  • rear sensor 30 is on the back of the tractor, farther to the rear of the tractor than the location where the kingpin couples to the tractor fifth wheel coupling.
  • the senor can be mounted below the beaver tail or it could be mounted directly to the underside of the beaver tail.
  • the sensor is thus farther behind the tractor and so may have an improved FoV.
  • the sensor located here is more protected from impact by the overlying beaver tail hitch. When the tractor/trailer is making a sharp turn this location at the back of the tractor will be exposed outside of the trailer, allowing the imaging of an otherwise blind location. Locating sensors here thus enhances the ability to visualize when making sharp turns, including when back up.
  • a sensor (not shown) could also or alternatively be located on rear 50b of the cab to image the front 14c of the trailer.
  • Sensors 22 and 24 are preferably rigidly mounted to an unsprung portion of the tractor, for example to its chassis 52, rather than to the sprung cab 50.
  • Such a rigid mounting helps the sensors to maintain a constant, known spatial relationship to the tractor (e.g., to the location of the fifth wheel that is used in sensor calibration as described elsewhere herein), thus assisting with using the distance ranging sensors to determine the position and attitude of the tractor and its trailer, as the tractor-trailer is moved through the yard.
  • the trailer bottom 14f has a height off the surface on which the wheels sit, and the left and right sensors are mounted below the bottom height of the trailer.
  • the system further comprises a global positioning system (GPS) 40 carried at least in part by the tractor.
  • GPS global positioning system
  • the GPS comprises two GPS antennas 42 and 44 mounted to the roof/top 50c of the tractor, such that a position and attitude of the tractor can be determined using the two GPS antennas without the need for the tractor to be in motion.
  • the GPS 40 comprises a third antenna 46 located externally of the tractor in a fixed, non-moving location and serving as a reference point for the GPS.
  • the length of the trailer/conveyance is estimated based on data from at least the left and right distance ranging sensors.
  • Estimation of the location of the rear end of the trailer/conveyance is an aspect of length estimation. Accuracy of the rear end estimation is useful when backing a trailer to a dock door; over-estimating its length can lead to a gap between the trailer and the loading dock that the forklifts used to load the trailer may not be able to cross, while underestimation can lead to a collision with the dock door, potentially damaging the trailer or the dock.
  • LiDAR-based sensors are used for the ranging sensors, they may have a fixed horizontal angular resolution.
  • the intersection point of their rays with the trailer will change.
  • the gap between rays will be reduced as a function of how far outwardly of the vehicle the sensors are mounted.
  • this gap should be relatively small, thus leading to an optimal mounting location outboard of the vehicle body. While higher angular resolution sensors are available and can help to alleviate this issue, they would be applying that higher resolution to the entire imaging sweep, vastly increasing the amount of data generated and also vastly increasing the computational requirements of the image processing systems.
  • the left and right sensors are mounted to the tractor chassis about 10cm behind the rear cabin and exhaust system, but forward of the side staircases by about 5cm. This is about 60cm behind the front axle and about 230 cm in front of the rear axle.
  • Latitudinal location i.e. the distances of the sensors from the cab, or from the centerline of the tractor
  • the sensor system needs to sense structures such as dock doors and walls behind the trailer. This information is important for accurate parking of a trailer the correct distance from a dock door longitudinally.
  • this information can only be gathered from outside of (i.e., to the left and right of) the trailer’s area. It is therefore necessary to extend the sensors outside of the pertinent legal width of the trailer, which in the U.S. is 102”.
  • the left and right sensors can be spaced apart by more than this 102” limit.
  • the left and right distance ranging sensors can be used to detect the trailer attitude and position relative to the tractor, which can be important in precision jobs like parking. By detecting either side of the trailer as well as the rear corners, an estimated model for its position and attitude can be determined. The more of a trailer’s sides that can be seen, the higher the accuracy of this measurement. The further out the left and right sensors are, the more of the sides can be seen.
  • LiDAR sensors have a generally conical viewing area of about 30 degrees. If such sensors are located 2” outside of the 102” trailer width (i.e., 106 inches apart) there is about a 4.6 degree angle between the sensor and the closest front comer of the trailer, meaning that the trailer side encompasses only about 4.6 degrees of the sensor viewing area, which will return relatively few data points from the side, making sensing of the entire side and its rear comer difficult. If the sensors are moved out to 10” outside of the trailer width this angle increases to about 21.6 degrees.
  • the lateral distance between the left and right sensors is selected such that for the particular LiDAR sensors used, the trailer side encompasses enough of the sensor viewing area such that the sensor is likely to return enough data to reliably sense the sidewall.
  • the LiDAR sensors and their lateral locations are selected such that a resolution on the determination of the trailer length, and the maximum allowable spacing of the data points returned from the sides of the trailer, is in the range of from about 1cm to about 50cm, with a preferred resolution of no more than about 10cm. This resolution will allow the system to reliably determine the sidewall location.
  • the left and right sensors are located about 145 cm from the vehicle centerline, and potentially up to about 155 cm, which equates to a distance between sensors of about 114 inches.
  • a drawback to having sensors excessively outside of the width of the tractor and trailer is that it increases the risk of collision of a sensor with other vehicles and trailers in the yard, and can make parking a much more difficult task. Therefore, it is advantageous to place the sensor as close to the tractor as possible while still perceiving the minimum amount of trailer side necessary for functionality.
  • the more of the sides that are detected by the left and right sensors the more accurate a picture of them can be obtained.
  • the lateral placement is such that the angle to the front comers of the sides is at least 0.3 degrees in order to accurately characterize the position of the trailer.
  • left and right LiDAR sensors are displaced laterally away from tractor a sufficient distance such that the portion of the sensor FoV filled by the truck side wall is at least about 0.3 degrees, when the tractor and trailer are misaligned by up to about +/- 3.0 degrees.
  • Another factor that can have an effect on lateral sensor placement is that when a tractor backs into and couples with a trailer, often the tractor is left at some angle relative to the trailer. This angular misalignment can partially or fully occlude one of the two sensors.
  • the effect of the angle on the sensor viewing area is quantifiable, allowing the sensors to be placed at least far enough apart such that they can visualize the minimum of the trailer sides at peak misalignment.
  • this angular misalignment is +/- 3 degrees and the sensor locations are set accordingly.
  • the sensors are spaced wide enough to obtain sufficient data along the entire side of the trailer when misalignment is 3 degrees.
  • Selfocclusion refers to the ability of the vehicle in question to hide in the blind-spot of the sensor and increase the seen area around it. Due to the preferred horizontal mounting locations (greater than 102” distance between the left and right sensors), self-occlusion is likely not a problem. Multiobject occlusion refers to the ability of sensors to see behind objects shorter than the vertical mounting position, with higher viewpoints being more effective at seeing through crowds of objects.
  • Ground plane data falloff refers to the percentage of data detected by a sensor with a limited vertical field of view being used to sense useful objects in the distance versus detecting the ground
  • Table 1 (below) identifies the ranging and imaging sensors of a preferred embodiment of the system, considerations regarding sensors, and uses of the sensors.
  • Fig 1C schematically depicts tractor chassis 61 that defines front area 62 where the cab (not shown) would typically be located, and rear area 63 where the fifth wheel (not shown) would typically be located. Other features of the chassis are not shown for the sake of clarity of illustration.
  • the figure illustrates cab -protective frame 64 that is rigidly mounted to chassis 61 and, as described above, can carry sensors (not shown).
  • Sensor package 65 is depicted coupled to the back of the chassis and includes LiDAR sensor 66 that is coupled to the chassis by passive or active vibration isolation mount 67. The same arrangement can be used to mount sensors such as the left and right side LiDAR sensors to frame 64.
  • Fig 2 is a schematic block diagram of a tractor-trailer/conveyance imaging and navigation system 80.
  • Processor 88 is configured to process data from the plurality of sensors (e.g., one or more of LiDAR sensor set 82, camera sensor set 84, and GPS sensor set 86) to develop position data for the trailer/conveyance that can comprise part of its outputs 90, and can be developed from further processing of the output data.
  • sensors can be rigidly mounted to the chassis (or protection frame/rails including the top rail for top sensors), or the sensors can be mounted via suspensions (passive or active).
  • Fig 2 is a schematic block diagram of a tractor-trailer/conveyance imaging and navigation system 80.
  • Processor 88 is configured to process data from the plurality of sensors (e.g., one or more of LiDAR sensor set 82, camera sensor set 84, and GPS sensor set 86) to develop position data for the trailer/conveyance that can comprise part of its outputs 90, and can be
  • Fig 3 is a model 102 of a tractor 104-trailer 106 combination useful in understanding aspects of the present disclosure.
  • Tractor 104 is pointed along axis 105 that lies at an angle 0uto horizontal axis 110, which is parallel to arbitrary horizontal axis 108.
  • Trailer 106 which is configured to pivot relative to tractor 104 about vertical kingpin axis 112, lies at an angle ⁇ to axis 108.
  • Trailer 106 includes rear doors 113 and 115 which are depicted as open rather than closed.
  • the joint angle 6 is the angle between the tractor and its trailer and equals 0T-0H. Dimension d is the length of the trailer from its kingpin to its rear wheels. As the tractor-trailer moves, the joint angle can be computed from the prior joint angle and the change in the tractor heading over the time since the prior joint angle was determined.
  • each sensor When the distance ranging sensors are LiDAR sensors, each sensor typically periodically returns a set of data comprising the received reflectances.
  • the data received from all of the LiDAR sensors can be synchronized, or not.
  • the entire data set may be referred to as a point cloud.
  • the angle of the trailer relative to the tractor can be determined. Since the location and attitude of the tractor is known via the GPS system, and since the size of the trailer is known, knowing the joint angle fully defines the present location and attitude of the trailer. This information can be used by a navigation system (not shown) to autonomously navigate the tractor/trailer.
  • a rectangle is fit to a subset of the point cloud data rather than to all of the point cloud data.
  • the system processor is configured to fit a predetermined shape representing the trailer (e.g., three contiguous sides of a rectangle) to the trailer position data as determined by the distance ranging sensors.
  • the position data for the trailer comprises at least one of a trailer length, a trailer width, a trailer height, a location of a rear axle of the trailer, a location of a kingpin, and an angle between the tractor and the trailer.
  • Fig. 4 is a flowchart of a trailer state (i.e., joint angle) estimation method 120. Brute force rectangle fitting determines an approximate joint angle by fitting a rectangle of the size of the trailer to the point cloud.
  • this is accomplished by counting the number of point cloud data points that lie within the neighborhood of the three sides of the rectangle.
  • the best rectangle i.e., the best joint angle fit
  • An updated trailer state is determined based on this joint angle, the prior updated trailer state, and inputs from GPS and any other motion sensors (i.e., speed and heading).
  • a least square fit to a synchronized point cloud around the last iteration of the fitted rectangle is iterated until it converges.
  • the trailer state is updated using this fitted rectangle.
  • the rectangle fitting on the synchronized point cloud can provide a frame-by- frame trailer state estimation.
  • the left side and right side distance ranging sensors can be used to detect if the trailer rear doors are open, such as depicted in Fig. 3.
  • the distance ranging sensors e.g., LiDAR sensors
  • the hinge points of each of the two rear trailer doors is known, and it is also known that trailer doors should be about one-half the width of the trailer, where trailer width will be known from measurement of trailer side locations by the lidars sensors already.
  • the system can look to see if an object is located in the vicinity of the hinge point with a width dimension approximating one-half the trailer width.
  • a use case is that when a trailer is pulled away from dock doors by the tractor, currently the tractor is supposed to stop once the trailer is pulled out far enough to allow the doors to be closed and latched. If the doors are not latched they can swing around when the trailer starts being moved again.
  • the system can sense the swinging doors and send an exception halt to the autonomous system so that someone can secure the doors. This avoids damaging the doors (e.g., keeping them from hitting nearby trailers).
  • Fig 5 is a top view of tractor 12 maneuvering to pick up a parked trailer 204 that has front wall 204a, right side 204b, and left side 204c.
  • Distance ranging sensors can be used in this scenario.
  • a desire is to reduce the uncertainty of estimating the target trailer.
  • At least one side of the trailer is used for the estimation.
  • One or more other sides can be used based on the estimation confidence and uncertainty using one side.
  • the tractor is stopped in front of the target trailer and the target trailer pose is estimated using the front wall 204a (in this case using one or both of distance ranging sensors 24 and 26).
  • the tractor is moved so as to observe an additional side (204b or 204c), typically the left or right, using any sensor(s), such as one or more of sensors 22, 24, and 26, and re-estimate the target trailer position using the same. If there still is not a high confidence and low uncertainty, the tractor is moved again so as to observe the other of the left and right sidewalls and another estimation is performed, to converge to the best estimation of the trailer location and angle. In some examples the tractor then proceeds to align itself with the target trailer before proceeding to couple to the target trailer for transport thereof.
  • Fig 6 is a top view of a tractor-trailer 10 maneuvering to drop off the trailer 14 in empty parking space 213 located between parked trailer 212 with side 212a facing space 213 and parked trailer 214 with side 214a facing space 213. Note that there could be two, one, or no trailers adjacent to parking space 213. A desire is to reduce the uncertainty in the designated parking area and its vicinity with no blind spots.
  • the first step is to check if there are trailers in adjacent parking spots. If there is a trailer in the right parking spot (trailer 212), the system estimates the location of its left wall surface 212a. If there is a trailer in the left parking spot (trailer 214), the system estimates its right wall surface 214a.
  • a method for calibrating sensors for a system for spatially imaging at least one of a trailer that is connectable to a tractor when the trailer is connected to the tractor and an environment proximate the tractor includes identifying an axis of rotation between the tractor and the connectable trailer when the trailer is connected to the tractor.
  • a calibration sensor (e.g., a LiDAR sensor) is mounted to the tractor when the connectable trailer is not connected to the tractor, at the kingpin axis 18, Fig. 1. This sensor is then used to obtain spatial data of fixed objects displaced about the tractor. At the same time, the other distance ranging sensors of the tractor’s sensing system are used to obtain spatial data of these same objects. The collected spatial data is then processed, to calibrate the one or more sensors of the spatial imaging system relative to the mounting location of the calibration sensor (i.e., the kingpin location). Once calibrated, and until they are moved or otherwise altered, the system sensors can be used to accurately determine the joint angle.
  • a LiDAR sensor e.g., a LiDAR sensor
  • the steps may be performed by one element or a plurality of elements. The steps may be performed together or at different times.
  • the elements that perform the activities may be physically the same or proximate one another, or may be physically separate.
  • One element may perform the actions of more than one block.
  • Examples of the systems and methods described herein comprise computer components and computer-implemented steps that will be apparent to those skilled in the art.
  • the computer-implemented steps may be stored as computer-executable instructions on a computer-readable medium such as, for example, floppy disks, hard disks, optical disks, Flash ROMS, nonvolatile ROM, and RAM.
  • the computer-executable instructions may be executed on a variety of processors such as, for example, microprocessors, digital signal processors, gate arrays, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Traffic Control Systems (AREA)
  • Geophysics And Detection Of Objects (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Measurement Of Optical Distance (AREA)
EP21893031.1A 2020-11-16 2021-11-16 Sensorsystem für traktoranhänger Pending EP4244648A2 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202063114237P 2020-11-16 2020-11-16
PCT/US2021/059547 WO2022104276A2 (en) 2020-11-16 2021-11-16 Tractor trailer sensing system

Publications (1)

Publication Number Publication Date
EP4244648A2 true EP4244648A2 (de) 2023-09-20

Family

ID=81602647

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21893031.1A Pending EP4244648A2 (de) 2020-11-16 2021-11-16 Sensorsystem für traktoranhänger

Country Status (2)

Country Link
EP (1) EP4244648A2 (de)
WO (1) WO2022104276A2 (de)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240051521A1 (en) * 2022-08-15 2024-02-15 Outrider Technologies, Inc. Autonomous Path Variation to Distribute Weight and Wear

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE20105153U1 (de) * 2001-03-25 2001-07-26 Dominik Hans Rückfahrhilfe für Lkw (Sattelzugfahrzeuge)
US7784707B2 (en) * 2006-05-18 2010-08-31 Xata Corporation Environmental condition monitoring of a container
US9914392B2 (en) * 2014-10-30 2018-03-13 Cross Road Centers, Llc Methods, apparatuses, and systems for monitoring state of a transportation system
NL2016753B1 (en) * 2016-05-10 2017-11-16 Daf Trucks Nv Platooning method for application in heavy trucks
US10721859B2 (en) * 2017-01-08 2020-07-28 Dolly Y. Wu PLLC Monitoring and control implement for crop improvement
US20180372875A1 (en) * 2017-06-27 2018-12-27 Uber Technologies, Inc. Sensor configuration for an autonomous semi-truck
CN109991971A (zh) * 2017-12-29 2019-07-09 长城汽车股份有限公司 无人驾驶车辆及无人驾驶车辆管理系统
US20220136823A1 (en) * 2018-07-12 2022-05-05 Wabco Gmbh Estimation of the trailer position relative to truck position and articulation angle between truck and trailer using an electromagnetic or optical sensor
US20220153345A1 (en) * 2019-03-25 2022-05-19 Volvo Truck Corporation Vehicle comprising a trailer angle determining system

Also Published As

Publication number Publication date
WO2022104276A2 (en) 2022-05-19
WO2022104276A3 (en) 2022-06-23

Similar Documents

Publication Publication Date Title
US11693422B2 (en) Sensor array for an autonomously operated utility vehicle and method for surround-view image acquisition
EP3867118B1 (de) Lidar-basierte anhängerverfolgung
US9279882B2 (en) Machine sensor calibration system
CA2989995C (en) Use of laser scanner for autonomous truck operation
US8862423B2 (en) Machine sensor calibration system
US20100076709A1 (en) Machine sensor calibration system
US11721043B2 (en) Automatic extrinsic calibration using sensed data as a target
US11822011B2 (en) Mirrors to extend sensor field of view in self-driving vehicles
WO2022104276A2 (en) Tractor trailer sensing system
US11932173B2 (en) Mirror pod environmental sensor arrangement for autonomous vehicle enabling compensation for uneven road camber
CN114590333B (zh) 一种自动驾驶多节拖车及其位姿确定方法
JP7180777B2 (ja) 運転制御システム
US20230184933A1 (en) Radar systems and method for backing a trailer
JP2020067702A (ja) 姿勢検出装置及び運搬システム
CN218949346U (zh) 一种无人驾驶牵引车
CN114072314B (zh) 驾驶控制系统
US11433943B2 (en) Hitch angle detection using automotive radar
EP4375142A1 (de) Computer-system und verfahren zur bestimmung der länge eines fahrzeugs und zugehöriges fahrzeug, computerprogramm, steuerungssystem und computerspeichermedium
US20240116531A1 (en) Systems and methods of calibrating sensors for an autonomous vehicle
US20230184953A1 (en) Systems and methods to detect trailer angle
CA3217280A1 (en) Aligning a grain cart to another vehicle

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20230531

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)