EP3913328A1 - Vehicle positioning apparatus, system and method, and vehicle - Google Patents

Vehicle positioning apparatus, system and method, and vehicle Download PDF

Info

Publication number
EP3913328A1
EP3913328A1 EP20744572.7A EP20744572A EP3913328A1 EP 3913328 A1 EP3913328 A1 EP 3913328A1 EP 20744572 A EP20744572 A EP 20744572A EP 3913328 A1 EP3913328 A1 EP 3913328A1
Authority
EP
European Patent Office
Prior art keywords
vehicle
signal transmitting
heading angle
units
coordinates
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP20744572.7A
Other languages
German (de)
French (fr)
Other versions
EP3913328B1 (en
EP3913328A4 (en
Inventor
Chonggui GAO
Shumiao AN
Kai Zhang
Ying Zhang
Kang DU
ZhaoQiang Zhang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Great Wall Motor Co Ltd
Original Assignee
Great Wall Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Great Wall Motor Co Ltd filed Critical Great Wall Motor Co Ltd
Publication of EP3913328A1 publication Critical patent/EP3913328A1/en
Publication of EP3913328A4 publication Critical patent/EP3913328A4/en
Application granted granted Critical
Publication of EP3913328B1 publication Critical patent/EP3913328B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/02Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
    • G01S5/0247Determining attitude
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/10Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
    • G01C21/12Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
    • G01C21/16Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
    • G01C21/165Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
    • G01C21/1656Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments with passive imaging devices, e.g. cameras
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/28Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network with correlation of data from several navigational instruments
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/0009Transmission of position information to remote stations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/021Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/025Services making use of location information using location based information parameters
    • H04W4/026Services making use of location information using location based information parameters using orientation information, e.g. compass
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30Services specially adapted for particular environments, situations or purposes
    • H04W4/40Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W64/00Locating users or terminals or network equipment for network management purposes, e.g. mobility management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W64/00Locating users or terminals or network equipment for network management purposes, e.g. mobility management
    • H04W64/006Locating users or terminals or network equipment for network management purposes, e.g. mobility management with additional information processing, e.g. for direction or speed determination
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/02Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
    • G01S5/14Determining absolute distances from a plurality of spaced points of known location

Definitions

  • the present application relates to the technical field of automatic control, and in particular to a vehicle positioning device, a vehicle positioning system and a vehicle positioning method, and a vehicle.
  • a vehicle positioning device is provided according to the present disclosure to perform accurate measurement on a heading angle.
  • a vehicle positioning device operating based on multiple signal transmitting units, is provided.
  • the vehicle positioning device includes two or more communication units and a processing unit.
  • the communication units are arranged on a vehicle and configured to receive signals from the multiple signal transmitting units.
  • the two or more communication units are spaced apart.
  • the processing unit is configured to determine, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units, and determine a heading angle of the vehicle based on the coordinates of each of the communication units.
  • the determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units is performed by: for each of the communication units, determining distances between the communication unit and the signal transmitting units based on the time instants at which the communication unit receives the signals from the signal transmitting units, and determining the coordinates of the communication unit based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units.
  • the vehicle positioning device further includes a gyroscope.
  • the gyroscope is configured to detect a heading angle of the vehicle as a first heading angle.
  • the processing unit is further configured to calculate, based on a driving curve of the vehicle, a heading angle of the vehicle as a second heading angle; and determine a final heading angle of the vehicle using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices.
  • each of the communication units includes a communication tag and an antenna.
  • processing unit is further configured to calculate coordinates of the vehicle to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle.
  • the signals from the multiple signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
  • the vehicle positioning device Compared with the conventional technology, the vehicle positioning device according to the present disclosure has the following advantages.
  • two or more communication units receive signals from the multiple signal transmitting units; for each of the communication units, coordinates of the communication unit is determined based on time instants at which the communication unit receives the signals from the signal transmitting units; and a heading angle of the vehicle is determined based on the coordinates of each of the communication units.
  • a heading angle can be accurately measured indoors or in a region where GPS signals cannot be obtained.
  • a vehicle positioning system is provided to perform accurate measurement on a heading angle in a whole process.
  • a vehicle positioning system includes: the vehicle positioning device, a vehicle-mounted positioning device, and a master control device.
  • the vehicle-mounted positioning device is configured to collect information of a position and/or a heading angle of a vehicle.
  • the master control device is configured to: calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device in a case that two or more communication units have received signals from multiple signal transmitting devices, and calculate the position and/or the heading angle of the vehicle based on the information related to the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device in a case that any one of two or more communication units has not received a signal from any one of multiple signal transmitting devices.
  • the vehicle positioning device is further configured to capture a current scene image.
  • the master control device is further configured to: determine whether a pixel gray value of the current scene image is within a predetermined range before the two or more communication units receive the signals from the multiple signal transmitting devices; in a case that the pixel gray value of the current scene image is not within the predetermined range, control the two or more communication units to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device; and in a case that the pixel gray value of the current scene image is within the predetermined range, calculate the position and/or the heading angle of the vehicle based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device.
  • the vehicle-mounted positioning device includes at least one of a camera, a lidar, a millimeter wave radar, an ultrasonic radar, a vehicle speed sensor, a wheel angular velocity sensor and an inertial sensor.
  • the vehicle positioning system according to the present disclosure has the following advantages.
  • the vehicle positioning system includes the vehicle positioning device described above and a vehicle-mounted positioning device.
  • the vehicle positioning device receives signals from multiple signal transmitting devices
  • the position and/or the heading angle of the vehicle is calculated by using the vehicle positioning device.
  • the vehicle positioning device does not completely receive signals from multiple signal transmitting devices
  • the position and/or the heading angle of the vehicle is calculated by using the vehicle-mounted positioning device.
  • the position and/or the heading angle of the vehicle can be calculated in a case of a failure of the vehicle positioning device or in a region without multiple signal transmitting devices, and the position and/or the heading angle of the vehicle can be determined by the vehicle positioning device in a case that the position and/or the heading angle of the vehicle cannot be accurately determined by the vehicle-mounted positioning device, thereby performing accurate measurement on the heading angle in a whole process.
  • a vehicle positioning method is provided to perform accurate measurement on a heading angle in a whole process.
  • a vehicle positioning method performed based on multiple signal transmitting units and two or more communication units.
  • the vehicle positioning method includes: receiving, by the two or more communication units, signals from the multiple signal transmitting units, where the two or more communication units are spaced apart; determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units; and determining a heading angle of the vehicle based on the coordinates of the each of the communication units.
  • the determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the multiple signal transmitting units and coordinates of the signal transmitting units includes: for each of the two or more communication units, determining distances between the communication unit and the signal transmitting units based on the time instants at which the communication unit receives the signals from the signal transmitting units; and determining the coordinates of the communication unit based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units.
  • the vehicle positioning method is performed based on a gyroscope.
  • the vehicle positioning method includes: detecting, by the gyroscope, a heading angle of the vehicle as a first heading angle; calculating, based on a driving curve of the vehicle, a heading angle of the vehicle as a second heading angle; and determining a final heading angle of the vehicle using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices.
  • the vehicle positioning method further includes: calculating coordinates of the vehicle to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle.
  • the signals from the multiple signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
  • the vehicle positioning method has the same advantages as the vehicle positioning device, which are not repeated herein.
  • a vehicle is provided to perform accurate measurement on a heading angle.
  • a vehicle is provided.
  • the vehicle includes the vehicle positioning device or the vehicle positioning system.
  • the vehicle has the same advantages as the vehicle positioning device or the vehicle positioning system, which are not repeated herein.
  • Other features and advantages of the present disclosure are to be described in detail in the following embodiments.
  • FIG 1 is a schematic structural diagram of a vehicle positioning device according to an embodiment of the present disclosure.
  • the vehicle positioning device operates based on multiple signal transmitting units.
  • the vehicle positioning device includes two or more communication units 1 and a processing unit 2.
  • the communication units 1 are arranged on a vehicle, and configured to receive signals from the multiple signal transmitting units.
  • the two or more communication units 1 are spaced apart.
  • the processing unit 2 is configured to determine, for each of the two or more communication units 1, coordinates of the communication unit 1 based on time instants at which the communication unit 1 receives the signals from the signal transmitting units and coordinates of the signal transmitting units; and determine a heading angle of the vehicle based on the coordinates of each of the communication units 1.
  • the multiple signal transmitting units may be base stations. In order to accurately determine the position and/or the heading angle of the vehicle, four signal transmitting units are arranged. The four signal transmitting units may form a square region.
  • the two or more communication units 1 receive signals from the multiple signal transmitting units.
  • the processing unit 2 may determine distances between the communication unit 1 and the multiple signal transmitting units based on time instants at which the communication unit 1 receives the signals from the signal transmitting units. Then, the processing unit 2 may determine coordinates of each of the communication units 1 based on the coordinates of the signal transmitting units. Since the communication units 1 are spaced apart, the distances between the communication units 1 are predetermined, and the positions at which the communication units 1 are arranged are predetermined, it is easy to obtain the orientation of the vehicle and thereby obtain the heading angle of the vehicle.
  • coordinates of a midpoint of a rear axle of the vehicle is generally determined as coordinates of the vehicle. Therefore, a distance between any one of the communication units 1 and the midpoint of the rear axle of the vehicle may be obtained based on the position at which the communication unit 1 is arranged on the vehicle, and the coordinates of the midpoint of the rear axle of the vehicle is calculated based on the coordinates of the communication unit 1, thereby obtaining the coordinates of the vehicle.
  • FIG. 2 is a schematic diagram of an operation process of a vehicle positioning device according to an embodiment of the present disclosure.
  • the communication units receive signals from the multiple signal transmitting units.
  • distances between the communication unit 1 and the signal transmitting units are determined based on the time instants at which the communication unit receives the signals from the signal transmitting units, and then the coordinates of the communication unit 1 is determined based on the coordinates of the signal transmitting units and the distances between the communication unit 1 and the signal transmitting units.
  • the heading angle of the vehicle is determined based on the coordinates of each of the communication units 1.
  • the heading angle of the vehicle calculated above may be not accurate enough since the heading angle is obtained in one manner. Based on a large number of actual operations and experiments, it is found that the heading angle has a deviation roughly ranging from 1.53° to 3.82 °.
  • the heading angle of the vehicle may be calculated in the above manner with a preset very high refresh rate, then multiple heading angles of the vehicle are obtained in a same state (position and heading angle) of the vehicle, and then an accurate heading angle is obtained by performing an average calculation on the multiple heading angles.
  • a gyroscope is arranged to detect the heading angle of the vehicle as a first heading angle. With the gyroscope, a relative heading angle with an accuracy of up to 0.1° is obtained, and a cumulative error is generated.
  • the processing unit 2 fits a driving curve equation based on a driving curve of the vehicle, and performs a deviation calculation to obtain a heading angle of the vehicle as a second heading angle. Based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices (or the heading angle after average calculation), a final heading angle of the vehicle is determined using an autoregressive algorithm, such as Kalman filtering. The final heading angle of the vehicle is accurate without generating a cumulative error, thereby calibrating the problem of the cumulative error generated by using the gyroscope.
  • a message format for final output is provided.
  • frame 1 0000 0000, where first four bytes represents an x-coordinate and last four bytes represents a ⁇ -coordinate (a positioning result); and frame 2: 0000 0000, where first four bytes represents a horizontal angle, and last four bytes represents a pitch angle (a result of the heading angle), which is not limited to this.
  • FIG. 3 is a schematic diagram showing an arrangement of a vehicle positioning device according to an embodiment of the present disclosure.
  • a UWB technology is taken as an example for description.
  • the Bluetooth technology, the WIFI technology, or other wireless technologies may be used instead of the UWB technology.
  • UWB is a carrier-free communication technology.
  • data is transmitted using nanosecond to picosecond non-sinusoidal narrow pulses.
  • signals with extremely low powers are transmitted based on a wide frequency spectrum, thus a data transmission rate of hundreds of Mbits/s to several Gbits/s can be achieved in a region having a radius of about 10 meters.
  • the positioning performed indoor with the UWB technology has the following features: 1 having a frequency ranging from 3.1Ghz to 10.6GHz and a bandwidth greater than 500MHz; 2 expressed as extremely short (less than 2nS) pulses in the time domain; 3 having good coexistence with other wireless devices; 4 having a low power consumption and a low emission duty cycle; 5 insensitive to Rayleigh fading; and 6 having strong penetrability and having a high positioning accuracy.
  • each of the communication units 1 may include a communication tag and an antenna.
  • a tag-side solving solution may be used. After the antenna receives the signals from the signal transmitting units, the signals are transmitted to the tag to perform a synchronization algorithm to obtain time information. The time information is transmitted via a serial port or a CAN to a solving unit (not shown in Figure 3 ) to determine coordinates, and then the coordinates are transmitted to the processing unit 2 via the CAN or a serial port or by using other wired or wireless transmission technology.
  • the solving unit may be integrated with the processing unit 2 to perform the calculation in the processing unit 2.
  • the antenna and the tag may be integrated together or arranged separately.
  • Antenna 1 and antenna 2 may be arranged in one structure or be arranged separately, and the two antennas are required to be spaced apart.
  • the heading angle of the vehicle may be calculated based on the coordinates of the antennas, thereby controlling a wire control system, such as a steering angle, of the vehicle.
  • FIG. 4 is a schematic structural diagram of a vehicle positioning system according to an embodiment of the present disclosure.
  • the vehicle positioning system includes: the vehicle positioning device 4 described above, a vehicle-mounted positioning device 5 and a master control device 6.
  • the vehicle-mounted positioning device 5 is configured to collect information of a position and/or a heading angle of a vehicle.
  • the master control device 6 is configured to: calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device 4 in a case that two or more communication units 1 have received signals from multiple signal transmitting devices; and calculate the position and/or the heading angle of the vehicle based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device 5 in a case that any one of two or more communication units 1 has not received a signal from any one of multiple signal transmitting devices.
  • the vehicle-mounted positioning device 5 is arranged to perform vision positioning.
  • positioning is mainly performed by the vehicle positioning device 4, and the vehicle-mounted positioning device 5 is configured to perform positioning and operations in a case of the failure of the vehicle positioning device 4, obstacle identification, and obstacle avoidance.
  • a base station is arranged in the parking lot, and dual tags are arranged on the vehicle.
  • the solution is applied in a scenario in which all vehicles in the parking lot are arranged with tags and communicate with the base station in the parking lot, and information are transmitted back to a parking lot management system and other vehicles through a wireless network. That is, the environment is simple.
  • the parking lot management system performs unified dispatch and route planning for the vehicles. Based on the UWB positioning technology, information of the heading angle, and vehicle control models, the vehicle is parked.
  • obstacle avoidance and local path planning are performed based on a solution of vision and radar in the travelling of the vehicle.
  • FIG. 5A is a schematic structural diagram of a vehicle-mounted positioning device according to an embodiment of the present disclosure.
  • the vehicle-mounted positioning device 5 includes at least one of a camera 31, a lidar 32, a millimeter wave radar 33, an ultrasonic radar 34, a vehicle speed sensor 35, a wheel angular velocity sensor 36 and an inertial sensor 37.
  • the millimeter wave radar 33 is used for obstacle avoidance.
  • the ultrasonic radar 34 parking of vehicles is performed based on the solution of vision and radar.
  • various states such as a vehicle speed, a wheel speed, an acceleration, a tilt, a shock, a vibration, a rotation, and a multi-degree-of-freedom motion, of the vehicle may be obtained.
  • FIG. 5B is a schematic diagram showing arrangement positions of vehicle-mounted cameras according to an embodiment of the present disclosure.
  • the vehicle-mounted cameras 31 may include a surround view camera 311, a front view camera 312 and the like to completely capture images around the vehicle.
  • the master control unit 2 uses a high-precision map and/or a semantic map collected by a vehicle sensor, the surround view camera 311 and the front view camera 312.
  • VSLAM vision synchronous localization and mapping
  • IMU inertial sensor 37
  • multiple signal transmitting units may be arranged in certain regions to save costs to control the signals transmitted from the multiple signal transmitting units to cover a region around a turn, a region around a corner, a region around a transparent glass, or a region having feature points not sufficient for the vehicle-mounted positioning device 5 to correctly position the vehicle.
  • FIG. 6 is a schematic diagram of an operation process of a vehicle positioning system according to an embodiment of the present disclosure.
  • the vehicle positioning system operates as follows.
  • a current scene image is captured. It is determined whether a pixel gray value of the current scene image is within a predetermined range.
  • the two or more communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device 4.
  • the position and/or the heading angle of the vehicle is calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device 5.
  • FIG. 7 is a schematic diagram of an operation process of a vehicle positioning system according to another embodiment of the present disclosure.
  • the vehicle positioning system operates as follows.
  • a current scene image is captured, and a drivable region is determined based on the current scene image. It is determined whether the drivable region changes alternately in size in the driving of the vehicle.
  • the two or more communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device 4.
  • the position and/or the heading angle of the vehicle is calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device 5.
  • FIG 8 is a schematic diagram of an operation process of a vehicle positioning system according to another embodiment of the present disclosure. As shown in Figure 8 , for a region having feature points not sufficient for the vehicle-mounted positioning device 5 to correctly position the vehicle, the vehicle positioning system according to the embodiment of the present disclosure operates as follows. The vehicle positioning device 5 generates and outputs vehicle-side positioning information. Then, one of the following steps 1 and 2 is performed.
  • step 1 expected positioning information is obtained based on a direction of the vehicle, a speed of the vehicle, and initial positioning information. It is determined whether a deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to a predetermined value in the driving of the vehicle. In a case that the deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to the predetermined value, that is, the vehicle has entered the region having insufficient feature points, the two or more communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device 4.
  • the position and/or the heading angle of the vehicle may be calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device 5.
  • step 2 it is determined in the driving of the vehicle whether an update frequency of the vehicle-side positioning information in a predetermined time period is less than or equal to a predetermined frequency.
  • the two or more communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device 4.
  • the position and/or the heading angle of the vehicle may be calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device 5.
  • Figure 9 is a block diagram showing an operation of a vehicle positioning system according to an embodiment of the present disclosure.
  • the antenna receives a signal from a base station
  • the signal is transmitted to a tag to perform a synchronization algorithm to obtain time information.
  • the time information is transmitted via a serial port or a CAN to a solving unit to determine position coordinates.
  • the coordinates are transmitted to the master control unit via a serial port, a CAN, a network cable, an optical fiber, or the like.
  • the vehicle-side positioning solution based on VSLAM, high-precision map and lidar
  • precise positioning with a positioning error of 10cm and a yaw angle error of 0.2°
  • the final coordinates and heading angle of the vehicle are outputted in a way of evaluating confidence.
  • the UWB positioning solution is less affected by the environment, and the vision positioning solution is easily interfered by light. Therefore, the vision positioning solution is mainly applied in scenarios with good light, and the UWB positioning solution is mainly applied in scenarios with poor light.
  • the vision positioning solution is performed based on a high-precision map, an ultrasonic radar, a surround-view fisheye camera, a front view camera, a millimeter wave radar, sensors (such as a speed sensor and a wheel angular velocity sensor) arranged on the vehicle, an IMU and multiple low-cost sensors.
  • the vision positioning solution is based on a high-precision map and a semantic map generated based on VSLAM
  • a low-cost vehicle-side positioning solution and a low-cost field-side positioning solution are combined, overcoming the shortcomings of the vision positioning solution easily affected by light, and thereby ensuring reliability. Furthermore, with the vehicle-side positioning solution and the field-side positioning solution according to the embodiment of the present disclosure, it is ensured that there is a redundant backup solution in a case that one of the solutions fails, thereby improving the safety of the entire system.
  • a vehicle positioning method is further provided according to an embodiment of the present disclosure.
  • the vehicle positioning method is performed based on multiple signal transmitting units and two or more communication units.
  • the vehicle positioning method includes the following operations.
  • the two or more communication units receive signals from the multiple signal transmitting units.
  • the two or more communication units are spaced apart.
  • coordinates of the communication unit are determined based on time instants at which the communication unit receives the signals from the multiple signal transmitting units and coordinates of the signal transmitting units.
  • a heading angle of the vehicle is determined based on the coordinates of each of the communication units.
  • determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the multiple signal transmitting units and coordinates of the signal transmitting units following operations are performed. For each of the communication units, distances between the communication unit and the signal transmitting units are determined based on the time instants at which the communication unit receives the signals from the signal transmitting units. The coordinates of the communication unit are determined based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units.
  • the vehicle positioning method is performed based on a gyroscope.
  • the vehicle positioning method includes the following operations.
  • the gyroscope detects a heading angle of the vehicle as a first heading angle.
  • a heading angle of the vehicle is calculated as a second heading angle.
  • a final heading angle of the vehicle is and determined using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices.
  • each of the communication units includes a communication tag and an antenna.
  • the method includes the following operation. Coordinates of the vehicle are calculated to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle.
  • the signals from the multiple signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
  • a machine-readable storage medium is further provided according to an embodiment of the present disclosure.
  • the machine-readable storage medium stores instructions.
  • the instructions when executed by a machine, cause the machine to perform the vehicle positioning method.
  • a processor is further provided according to an embodiment of the present disclosure.
  • the processor is configured to execute a program.
  • the program when executed by the processor, causes the processor to perform the vehicle positioning method.
  • a vehicle is further provided according to an embodiment of the present disclosure.
  • the vehicle includes the vehicle positioning device or the vehicle positioning system.
  • Embodiments of the vehicle positioning method, the machine-readable storage medium, the processor and the vehicle are similar to the embodiments of the vehicle positioning device and the vehicle positioning system, which are not repeated herein.

Abstract

The present invention relates to the technical field of automatic control. Provided are a vehicle positioning apparatus, system and method, and a vehicle. The vehicle positioning apparatus in the present invention is operated based on a plurality of signal transmitting units. The vehicle positioning apparatus comprises: at least two communication units arranged on a vehicle and used for receiving signals from the plurality of signal transmitting units, wherein there is a spacing between the at least two communication units; and a processing unit for determining, according to the time when each communication unit from among the at least two communication units receives a signal from each signal transmitting unit from among the plurality of signal transmitting units and coordinates of each signal transmitting unit, coordinates of each communication unit, and for determining, according to the coordinates of each communication unit, a heading angle of the vehicle. The present invention can realize the precise measurement of a heading angle.

Description

    FIELD
  • The present application relates to the technical field of automatic control, and in particular to a vehicle positioning device, a vehicle positioning system and a vehicle positioning method, and a vehicle.
  • BACKGROUND
  • Nowadays, positioning of automatic driving outdoors may be performed based on a real time dynamic kinematic (RTK) method, a global navigation positioning system (GNSS), and the like. However, in an indoor parking lot, accurate positioning cannot be performed based on the methods performed outdoors due to the loss of GPS signals. According to the conventional indoor positioning solution, only coordinates can be determined, and the heading angle cannot be measured. However, the heading angle is important for the positioning and control of automatic driving.
  • SUMMARY
  • In view of this, a vehicle positioning device is provided according to the present disclosure to perform accurate measurement on a heading angle.
  • In order to achieve the above objective, the following technical solutions are provided according to the present disclosure.
  • A vehicle positioning device, operating based on multiple signal transmitting units, is provided. The vehicle positioning device includes two or more communication units and a processing unit. The communication units are arranged on a vehicle and configured to receive signals from the multiple signal transmitting units. The two or more communication units are spaced apart. The processing unit is configured to determine, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units, and determine a heading angle of the vehicle based on the coordinates of each of the communication units.
  • Further, the determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units is performed by: for each of the communication units, determining distances between the communication unit and the signal transmitting units based on the time instants at which the communication unit receives the signals from the signal transmitting units, and determining the coordinates of the communication unit based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units.
  • Further, the vehicle positioning device further includes a gyroscope. The gyroscope is configured to detect a heading angle of the vehicle as a first heading angle. The processing unit is further configured to calculate, based on a driving curve of the vehicle, a heading angle of the vehicle as a second heading angle; and determine a final heading angle of the vehicle using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices.
  • Further, each of the communication units includes a communication tag and an antenna.
  • Further, the processing unit is further configured to calculate coordinates of the vehicle to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle.
  • Further, the signals from the multiple signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
  • Compared with the conventional technology, the vehicle positioning device according to the present disclosure has the following advantages.
  • In the vehicle positioning device operating based on multiple signal transmitting units according to the present disclosure, two or more communication units receive signals from the multiple signal transmitting units; for each of the communication units, coordinates of the communication unit is determined based on time instants at which the communication unit receives the signals from the signal transmitting units; and a heading angle of the vehicle is determined based on the coordinates of each of the communication units. With the vehicle positioning device operating based on multiple signal transmitting units according to the present disclosure, a heading angle can be accurately measured indoors or in a region where GPS signals cannot be obtained.
  • According to the present disclosure, a vehicle positioning system is provided to perform accurate measurement on a heading angle in a whole process.
  • In order to achieve the above objective, the following technical solutions are provided according to the present disclosure.
  • A vehicle positioning system is provided. The vehicle positioning system includes: the vehicle positioning device, a vehicle-mounted positioning device, and a master control device. The vehicle-mounted positioning device is configured to collect information of a position and/or a heading angle of a vehicle. The master control device is configured to: calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device in a case that two or more communication units have received signals from multiple signal transmitting devices, and calculate the position and/or the heading angle of the vehicle based on the information related to the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device in a case that any one of two or more communication units has not received a signal from any one of multiple signal transmitting devices.
  • Further, the vehicle positioning device is further configured to capture a current scene image. The master control device is further configured to: determine whether a pixel gray value of the current scene image is within a predetermined range before the two or more communication units receive the signals from the multiple signal transmitting devices; in a case that the pixel gray value of the current scene image is not within the predetermined range, control the two or more communication units to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device; and in a case that the pixel gray value of the current scene image is within the predetermined range, calculate the position and/or the heading angle of the vehicle based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device.
  • Further, the vehicle-mounted positioning device includes at least one of a camera, a lidar, a millimeter wave radar, an ultrasonic radar, a vehicle speed sensor, a wheel angular velocity sensor and an inertial sensor.
  • Compared with the conventional technology, the vehicle positioning system according to the present disclosure has the following advantages.
  • The vehicle positioning system according to the present disclosure includes the vehicle positioning device described above and a vehicle-mounted positioning device. In a case that the vehicle positioning device receives signals from multiple signal transmitting devices, the position and/or the heading angle of the vehicle is calculated by using the vehicle positioning device. In a case that the vehicle positioning device does not completely receive signals from multiple signal transmitting devices, the position and/or the heading angle of the vehicle is calculated by using the vehicle-mounted positioning device. With the vehicle positioning system according to the present disclosure, it can be ensured that the position and/or the heading angle of the vehicle can be calculated in a case of a failure of the vehicle positioning device or in a region without multiple signal transmitting devices, and the position and/or the heading angle of the vehicle can be determined by the vehicle positioning device in a case that the position and/or the heading angle of the vehicle cannot be accurately determined by the vehicle-mounted positioning device, thereby performing accurate measurement on the heading angle in a whole process.
  • According to the present disclosure, a vehicle positioning method is provided to perform accurate measurement on a heading angle in a whole process.
  • In order to achieve the above objective, the following technical solutions are provided according to the present disclosure.
  • A vehicle positioning method, performed based on multiple signal transmitting units and two or more communication units, is provided. The vehicle positioning method includes: receiving, by the two or more communication units, signals from the multiple signal transmitting units, where the two or more communication units are spaced apart; determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units; and determining a heading angle of the vehicle based on the coordinates of the each of the communication units.
  • Further, the determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the multiple signal transmitting units and coordinates of the signal transmitting units includes: for each of the two or more communication units, determining distances between the communication unit and the signal transmitting units based on the time instants at which the communication unit receives the signals from the signal transmitting units; and determining the coordinates of the communication unit based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units.
  • Further, the vehicle positioning method is performed based on a gyroscope. The vehicle positioning method includes: detecting, by the gyroscope, a heading angle of the vehicle as a first heading angle; calculating, based on a driving curve of the vehicle, a heading angle of the vehicle as a second heading angle; and determining a final heading angle of the vehicle using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices.
  • Further, the vehicle positioning method further includes: calculating coordinates of the vehicle to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle.
  • Further, the signals from the multiple signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
  • Compared with the conventional technology, the vehicle positioning method has the same advantages as the vehicle positioning device, which are not repeated herein.
  • According to the present disclosure, a vehicle is provided to perform accurate measurement on a heading angle.
  • In order to achieve the above objective, the following technical solutions are provided according to the present disclosure.
  • A vehicle is provided. The vehicle includes the vehicle positioning device or the vehicle positioning system.
  • Compared with the conventional technology, the vehicle has the same advantages as the vehicle positioning device or the vehicle positioning system, which are not repeated herein. Other features and advantages of the present disclosure are to be described in detail in the following embodiments.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The accompanying drawings forming a part of the present disclosure are used to provide a further understanding of the present disclosure. Exemplary embodiments of the present disclosure and descriptions thereof are used to explain the present disclosure rather than constitute an undue limitation on the present disclosure. In the drawings:
    • Figure 1 is a schematic structural diagram of a vehicle positioning device according to an embodiment of the present disclosure;
    • Figure 2 is a schematic diagram of an operation process of a vehicle positioning device according to an embodiment of the present disclosure;
    • Figure 3 is a schematic diagram showing an arrangement of a vehicle positioning device according to an embodiment of the present disclosure;
    • Figure 4 is a schematic structural diagram of a vehicle positioning system according to an embodiment of the present disclosure;
    • Figure 5A is a schematic structural diagram of a vehicle-mounted positioning device according to an embodiment of the present disclosure;
    • Figure 5B is a schematic diagram showing arrangement positions of vehicle-mounted cameras according to an embodiment of the present disclosure;
    • Figure 6 is a schematic diagram of an operation process of a vehicle positioning system according to an embodiment of the present disclosure;
    • Figure 7 is a schematic diagram of an operation process of a vehicle positioning system according to another embodiment of the present disclosure;
    • Figure 8 is a schematic diagram of an operation process of a vehicle positioning system according to another embodiment of the present disclosure; and
    • Figure 9 is a block diagram showing an operation of a vehicle positioning system according to an embodiment of the present disclosure.
  • Reference numerals are listed as follows:
    1 Communication unit 2 Processing unit
    31 Camera 32 Lidar
    33 Millimeter wave radar 34 Ultrasonic radar
    35 Vehicle speed sensor 36 Wheel angular velocity sensor
    37 Inertial sensor 311 Surround view camera
    312 Front view camera 4 Vehicle positioning device
    5 Vehicle-mounted positioning device 6 Master control device
  • DETAILED DESCRIPTION OF EMBODIMENTS
  • It should be noted that embodiments of the present disclosure and the features in the embodiments may be in combination with each other as long as there is no conflict.
  • The present disclosure is described in detail below with reference to the drawings and in conjunction with the embodiments.
  • Figure 1 is a schematic structural diagram of a vehicle positioning device according to an embodiment of the present disclosure. As shown in Figure 1, the vehicle positioning device operates based on multiple signal transmitting units. The vehicle positioning device includes two or more communication units 1 and a processing unit 2. The communication units 1 are arranged on a vehicle, and configured to receive signals from the multiple signal transmitting units. The two or more communication units 1 are spaced apart. The processing unit 2 is configured to determine, for each of the two or more communication units 1, coordinates of the communication unit 1 based on time instants at which the communication unit 1 receives the signals from the signal transmitting units and coordinates of the signal transmitting units; and determine a heading angle of the vehicle based on the coordinates of each of the communication units 1.
  • In the embodiment of the present disclosure, the multiple signal transmitting units (not shown in Figure 1) may be base stations. In order to accurately determine the position and/or the heading angle of the vehicle, four signal transmitting units are arranged. The four signal transmitting units may form a square region. The two or more communication units 1 receive signals from the multiple signal transmitting units. For each of the communication units1, the processing unit 2 may determine distances between the communication unit 1 and the multiple signal transmitting units based on time instants at which the communication unit 1 receives the signals from the signal transmitting units. Then, the processing unit 2 may determine coordinates of each of the communication units 1 based on the coordinates of the signal transmitting units. Since the communication units 1 are spaced apart, the distances between the communication units 1 are predetermined, and the positions at which the communication units 1 are arranged are predetermined, it is easy to obtain the orientation of the vehicle and thereby obtain the heading angle of the vehicle.
  • For the position of the vehicle, coordinates of a midpoint of a rear axle of the vehicle is generally determined as coordinates of the vehicle. Therefore, a distance between any one of the communication units 1 and the midpoint of the rear axle of the vehicle may be obtained based on the position at which the communication unit 1 is arranged on the vehicle, and the coordinates of the midpoint of the rear axle of the vehicle is calculated based on the coordinates of the communication unit 1, thereby obtaining the coordinates of the vehicle.
  • Figure 2 is a schematic diagram of an operation process of a vehicle positioning device according to an embodiment of the present disclosure. As shown in Figure 2, the communication units receive signals from the multiple signal transmitting units. For each of the communication units 1, distances between the communication unit 1 and the signal transmitting units are determined based on the time instants at which the communication unit receives the signals from the signal transmitting units, and then the coordinates of the communication unit 1 is determined based on the coordinates of the signal transmitting units and the distances between the communication unit 1 and the signal transmitting units. Finally, the heading angle of the vehicle is determined based on the coordinates of each of the communication units 1.
  • The heading angle of the vehicle calculated above may be not accurate enough since the heading angle is obtained in one manner. Based on a large number of actual operations and experiments, it is found that the heading angle has a deviation roughly ranging from 1.53° to 3.82 °. In this regard, in the present disclosure, the heading angle of the vehicle may be calculated in the above manner with a preset very high refresh rate, then multiple heading angles of the vehicle are obtained in a same state (position and heading angle) of the vehicle, and then an accurate heading angle is obtained by performing an average calculation on the multiple heading angles.
  • In addition, in an embodiment of the present disclosure, a gyroscope is arranged to detect the heading angle of the vehicle as a first heading angle. With the gyroscope, a relative heading angle with an accuracy of up to 0.1° is obtained, and a cumulative error is generated. The processing unit 2 fits a driving curve equation based on a driving curve of the vehicle, and performs a deviation calculation to obtain a heading angle of the vehicle as a second heading angle. Based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices (or the heading angle after average calculation), a final heading angle of the vehicle is determined using an autoregressive algorithm, such as Kalman filtering. The final heading angle of the vehicle is accurate without generating a cumulative error, thereby calibrating the problem of the cumulative error generated by using the gyroscope.
  • In addition, after the coordinates of the vehicle and the heading angle of the vehicle are calculated, it is required to output the coordinates of the vehicle and the heading angle of the vehicle. According to an embodiment of the present disclosure, a message format for final output is provided. For example, frame 1: 0000 0000, where first four bytes represents an x-coordinate and last four bytes represents a γ-coordinate (a positioning result); and frame 2: 0000 0000, where first four bytes represents a horizontal angle, and last four bytes represents a pitch angle (a result of the heading angle), which is not limited to this.
  • Figure 3 is a schematic diagram showing an arrangement of a vehicle positioning device according to an embodiment of the present disclosure. In an embodiment of the present disclosure, a UWB technology is taken as an example for description. In practice, the Bluetooth technology, the WIFI technology, or other wireless technologies may be used instead of the UWB technology. UWB is a carrier-free communication technology. With the UWB technology, data is transmitted using nanosecond to picosecond non-sinusoidal narrow pulses. With the UWB technology, signals with extremely low powers are transmitted based on a wide frequency spectrum, thus a data transmission rate of hundreds of Mbits/s to several Gbits/s can be achieved in a region having a radius of about 10 meters. With the UWB technology, a positioning accuracy of up to 10cm can be achieved. The positioning performed indoor with the UWB technology has the following features: 1 having a frequency ranging from 3.1Ghz to 10.6GHz and a bandwidth greater than 500MHz; 2 expressed as extremely short (less than 2nS) pulses in the time domain; 3 having good coexistence with other wireless devices; 4 having a low power consumption and a low emission duty cycle; 5 insensitive to Rayleigh fading; and 6 having strong penetrability and having a high positioning accuracy.
  • As shown in Figure 3, each of the communication units 1 may include a communication tag and an antenna. In the vehicle positioning device, a tag-side solving solution may be used. After the antenna receives the signals from the signal transmitting units, the signals are transmitted to the tag to perform a synchronization algorithm to obtain time information. The time information is transmitted via a serial port or a CAN to a solving unit (not shown in Figure 3) to determine coordinates, and then the coordinates are transmitted to the processing unit 2 via the CAN or a serial port or by using other wired or wireless transmission technology. Alternatively, the solving unit may be integrated with the processing unit 2 to perform the calculation in the processing unit 2. The antenna and the tag may be integrated together or arranged separately. Antenna 1 and antenna 2 may be arranged in one structure or be arranged separately, and the two antennas are required to be spaced apart. The heading angle of the vehicle may be calculated based on the coordinates of the antennas, thereby controlling a wire control system, such as a steering angle, of the vehicle.
  • A vehicle positioning system is further provided according to an embodiment of the present disclosure. Figure 4 is a schematic structural diagram of a vehicle positioning system according to an embodiment of the present disclosure. As shown in Figure 4, the vehicle positioning system includes: the vehicle positioning device 4 described above, a vehicle-mounted positioning device 5 and a master control device 6. The vehicle-mounted positioning device 5 is configured to collect information of a position and/or a heading angle of a vehicle. The master control device 6 is configured to: calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device 4 in a case that two or more communication units 1 have received signals from multiple signal transmitting devices; and calculate the position and/or the heading angle of the vehicle based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device 5 in a case that any one of two or more communication units 1 has not received a signal from any one of multiple signal transmitting devices.
  • In the embodiment of the present disclosure, the vehicle-mounted positioning device 5 is arranged to perform vision positioning. In the vehicle positioning system according to the embodiment, positioning is mainly performed by the vehicle positioning device 4, and the vehicle-mounted positioning device 5 is configured to perform positioning and operations in a case of the failure of the vehicle positioning device 4, obstacle identification, and obstacle avoidance. In this solution, a base station is arranged in the parking lot, and dual tags are arranged on the vehicle. The solution is applied in a scenario in which all vehicles in the parking lot are arranged with tags and communicate with the base station in the parking lot, and information are transmitted back to a parking lot management system and other vehicles through a wireless network. That is, the environment is simple. The parking lot management system performs unified dispatch and route planning for the vehicles. Based on the UWB positioning technology, information of the heading angle, and vehicle control models, the vehicle is parked. In addition, obstacle avoidance and local path planning are performed based on a solution of vision and radar in the travelling of the vehicle.
  • Figure 5A is a schematic structural diagram of a vehicle-mounted positioning device according to an embodiment of the present disclosure. As shown in Figure 5A, the vehicle-mounted positioning device 5 includes at least one of a camera 31, a lidar 32, a millimeter wave radar 33, an ultrasonic radar 34, a vehicle speed sensor 35, a wheel angular velocity sensor 36 and an inertial sensor 37. The millimeter wave radar 33 is used for obstacle avoidance. With the ultrasonic radar 34, parking of vehicles is performed based on the solution of vision and radar. With the vehicle speed sensor 35, the wheel angular velocity sensor 36, and the inertial sensor 37, various states, such as a vehicle speed, a wheel speed, an acceleration, a tilt, a shock, a vibration, a rotation, and a multi-degree-of-freedom motion, of the vehicle may be obtained.
  • Figure 5B is a schematic diagram showing arrangement positions of vehicle-mounted cameras according to an embodiment of the present disclosure. As shown in Figure 5B, the vehicle-mounted cameras 31 may include a surround view camera 311, a front view camera 312 and the like to completely capture images around the vehicle. The master control unit 2 uses a high-precision map and/or a semantic map collected by a vehicle sensor, the surround view camera 311 and the front view camera 312. In the solution of vision positioning, based on a semantic map generated based on a vision synchronous localization and mapping (VSLAM) and the high-precision map, VSLAM feature points identified and collected by the vehicle-mounted camera 31 are matched, then the vehicle is positioned based on information of the inertial sensor 37 (IMU), thereby obtaining vehicle-side positioning information. SLAM (simultaneous localization and mapping) is a process of constructing an environmental map while calculating a position based on information of a sensor, thereby solving the problem of positioning and map construction when moving in an unknown environment. VSLAM is a vision SLAM, which is advanced. In the VSLAM, positioning and map construction is performed based on vision, which is accurate and rapid.
  • In addition, in an embodiment of the present disclosure, multiple signal transmitting units may be arranged in certain regions to save costs to control the signals transmitted from the multiple signal transmitting units to cover a region around a turn, a region around a corner, a region around a transparent glass, or a region having feature points not sufficient for the vehicle-mounted positioning device 5 to correctly position the vehicle.
  • Figure 6 is a schematic diagram of an operation process of a vehicle positioning system according to an embodiment of the present disclosure. As shown in Figure 6, for regions with bright or dark light, such as a region around a corner and a region around a transparent glass, the vehicle positioning system according to the embodiment of the present disclosure operates as follows. A current scene image is captured. It is determined whether a pixel gray value of the current scene image is within a predetermined range. In a case that the pixel gray value of the current scene image is not within the predetermined range, the two or more communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device 4. In a case that the pixel gray value of the current scene image is within the predetermined range, the position and/or the heading angle of the vehicle is calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device 5.
  • Figure 7 is a schematic diagram of an operation process of a vehicle positioning system according to another embodiment of the present disclosure. As shown in Figure 7, for a region around a turn, the vehicle positioning system according to the embodiment of the present disclosure operates as follows. A current scene image is captured, and a drivable region is determined based on the current scene image. It is determined whether the drivable region changes alternately in size in the driving of the vehicle. In a case that the drivable region changes alternately in size, the two or more communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device 4. In a case that the drivable region does not change alternately in size, the position and/or the heading angle of the vehicle is calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device 5.
  • Figure 8 is a schematic diagram of an operation process of a vehicle positioning system according to another embodiment of the present disclosure. As shown in Figure 8, for a region having feature points not sufficient for the vehicle-mounted positioning device 5 to correctly position the vehicle, the vehicle positioning system according to the embodiment of the present disclosure operates as follows. The vehicle positioning device 5 generates and outputs vehicle-side positioning information. Then, one of the following steps 1 and 2 is performed.
  • In step 1, expected positioning information is obtained based on a direction of the vehicle, a speed of the vehicle, and initial positioning information. It is determined whether a deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to a predetermined value in the driving of the vehicle. In a case that the deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to the predetermined value, that is, the vehicle has entered the region having insufficient feature points, the two or more communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device 4. In a case that the deviation between the vehicle-side positioning information and the expected positioning information is less than a predetermined value, that is, the vehicle has not entered the region having insufficient feature points, the position and/or the heading angle of the vehicle may be calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device 5.
  • In step 2, it is determined in the driving of the vehicle whether an update frequency of the vehicle-side positioning information in a predetermined time period is less than or equal to a predetermined frequency. In a case that the update frequency of the vehicle-side positioning information in the predetermined period is less than or equal to the predetermined frequency, that is, the vehicle has entered the region having insufficient feature points, the two or more communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device 4. In a case that the update frequency of the vehicle-side positioning information in the predetermined period is greater than the predetermined frequency, that is, the vehicle has not entered the region having insufficient feature points, the position and/or the heading angle of the vehicle may be calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device 5.
  • Figure 9 is a block diagram showing an operation of a vehicle positioning system according to an embodiment of the present disclosure. As shown in Figure 9, after the antenna receives a signal from a base station, the signal is transmitted to a tag to perform a synchronization algorithm to obtain time information. The time information is transmitted via a serial port or a CAN to a solving unit to determine position coordinates. Then, the coordinates are transmitted to the master control unit via a serial port, a CAN, a network cable, an optical fiber, or the like.
  • Based on the vehicle-side positioning solution (based on VSLAM, high-precision map and lidar) and the field-side high-precision UWB positioning solution, precise positioning (with a positioning error of 10cm and a yaw angle error of 0.2°) is performed. Based on the above two positioning solutions and the Kalman filtering, the final coordinates and heading angle of the vehicle are outputted in a way of evaluating confidence. The UWB positioning solution is less affected by the environment, and the vision positioning solution is easily interfered by light. Therefore, the vision positioning solution is mainly applied in scenarios with good light, and the UWB positioning solution is mainly applied in scenarios with poor light. The vision positioning solution is performed based on a high-precision map, an ultrasonic radar, a surround-view fisheye camera, a front view camera, a millimeter wave radar, sensors (such as a speed sensor and a wheel angular velocity sensor) arranged on the vehicle, an IMU and multiple low-cost sensors. The vision positioning solution is based on a high-precision map and a semantic map generated based on VSLAM
  • In the embodiment of the present disclosure, a low-cost vehicle-side positioning solution and a low-cost field-side positioning solution are combined, overcoming the shortcomings of the vision positioning solution easily affected by light, and thereby ensuring reliability. Furthermore, with the vehicle-side positioning solution and the field-side positioning solution according to the embodiment of the present disclosure, it is ensured that there is a redundant backup solution in a case that one of the solutions fails, thereby improving the safety of the entire system.
  • A vehicle positioning method is further provided according to an embodiment of the present disclosure. The vehicle positioning method is performed based on multiple signal transmitting units and two or more communication units. The vehicle positioning method includes the following operations. The two or more communication units receive signals from the multiple signal transmitting units. The two or more communication units are spaced apart. For each of the two or more communication units, coordinates of the communication unit are determined based on time instants at which the communication unit receives the signals from the multiple signal transmitting units and coordinates of the signal transmitting units. A heading angle of the vehicle is determined based on the coordinates of each of the communication units.
  • Further, in determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the multiple signal transmitting units and coordinates of the signal transmitting units, following operations are performed. For each of the communication units, distances between the communication unit and the signal transmitting units are determined based on the time instants at which the communication unit receives the signals from the signal transmitting units. The coordinates of the communication unit are determined based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units.
  • Further, the vehicle positioning method is performed based on a gyroscope. The vehicle positioning method includes the following operations. The gyroscope detects a heading angle of the vehicle as a first heading angle. Based on a driving curve of the vehicle, a heading angle of the vehicle is calculated as a second heading angle. A final heading angle of the vehicle is and determined using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices.
  • Further, each of the communication units includes a communication tag and an antenna.
  • Further, the method includes the following operation. Coordinates of the vehicle are calculated to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle.
  • Further, the signals from the multiple signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
  • A machine-readable storage medium is further provided according to an embodiment of the present disclosure. The machine-readable storage medium stores instructions. The instructions, when executed by a machine, cause the machine to perform the vehicle positioning method.
  • A processor is further provided according to an embodiment of the present disclosure. The processor is configured to execute a program. The program, when executed by the processor, causes the processor to perform the vehicle positioning method.
  • A vehicle is further provided according to an embodiment of the present disclosure. The vehicle includes the vehicle positioning device or the vehicle positioning system.
  • Embodiments of the vehicle positioning method, the machine-readable storage medium, the processor and the vehicle are similar to the embodiments of the vehicle positioning device and the vehicle positioning system, which are not repeated herein.
  • The foregoing embodiments are merely preferred embodiments of the present disclosure and are not intended to limit the present disclosure. Any modification, equivalent substitutions and improvement made within the spirit and principle of the present disclosure shall fall within the protection scope of the present disclosure.

Claims (15)

  1. A vehicle positioning device, operating based on a plurality of signal transmitting units, wherein the vehicle positioning device comprises:
    two or more communication units, arranged on a vehicle and configured to receive signals from the plurality of signal transmitting units, wherein the two or more communication units are spaced apart; and
    a processing unit, configured to:
    determine, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units, and
    determine a heading angle of the vehicle based on the coordinates of each of the communication units.
  2. The vehicle positioning device according to claim 1, wherein determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units is performed by:
    for each of the two or more communication units,
    determining distances between the communication unit and the signal transmitting units based on the time instants at which the communication unit receives the signals from the signal transmitting units; and
    determining the coordinates of the communication unit based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units.
  3. The vehicle positioning device according to claim 1, further comprising a gyroscope configured to detect a heading angle of the vehicle as a first heading angle, wherein
    the processing unit is further configured to:
    calculate, based on a driving curve of the vehicle, a heading angle of the vehicle as a second heading angle; and
    determine a final heading angle of the vehicle using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices.
  4. The vehicle positioning device according to claim 1, wherein each of the communication units comprises a communication tag and an antenna.
  5. The vehicle positioning device according to claim 1, wherein the processing unit is further configured to:
    calculate coordinates of the vehicle to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle.
  6. The vehicle positioning device according to claim 1, wherein the signals from the plurality of signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
  7. A vehicle positioning system, comprising:
    the vehicle positioning device according to any one of claims 1 to 6;
    a vehicle-mounted positioning device, configured to collect information of a position and/or a heading angle of a vehicle; and
    a master control device, configured to:
    in a case that two or more communication units have received signals from a plurality of signal transmitting devices, calculate, by the vehicle positioning device, the position and/or the heading angle of the vehicle; and
    in a case that any one of two or more communication units has not received a signal from any one of a plurality of signal transmitting devices, calculate the position and/or the heading angle of the vehicle based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device.
  8. The vehicle positioning system according to claim 7, wherein
    the vehicle-mounted positioning device is further configured to capture a current scene image; and
    the master control device is further configured to:
    determine whether a pixel gray value of the current scene image is within a predetermined range before the two or more communication units receive the signals from the plurality of signal transmitting devices;
    in a case that the pixel gray value of the current scene image is not within the predetermined range, control the two or more communication units to receive the signals from the plurality of signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device; and
    in a case that the pixel gray value of the current scene image is within the predetermined range, calculate the position and/or the heading angle of the vehicle based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device.
  9. The vehicle positioning system according to claim 7, wherein the vehicle-mounted positioning device comprises at least one of a camera, a lidar, a millimeter wave radar, an ultrasonic radar, a vehicle speed sensor, a wheel angular velocity sensor and an inertial sensor.
  10. A vehicle positioning method, performed based on a plurality of signal transmitting units and two or more communication units, wherein the vehicle positioning method comprises:
    receiving, by the two or more communication units, signals from the plurality of signal transmitting units, wherein the two or more communication units are spaced apart;
    determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units; and
    determining a heading angle of the vehicle based on the coordinates of each of the communication units.
  11. The vehicle positioning method according to claim 10, wherein the determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units comprises:
    for each of the two or more communication units,
    determining distances between the communication unit and the signal transmitting units based on the time instants at which the communication unit receives the signals from the signal transmitting units; and
    determining the coordinates of the communication unit based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units.
  12. The vehicle positioning method according to claim 10, performed based on a gyroscope, wherein the vehicle positioning method comprises:
    detecting, by the gyroscope, a heading angle of the vehicle as a first heading angle;
    calculating, based on a driving curve of the vehicle, a heading angle of the vehicle as a second heading angle; and
    determining a final heading angle of the vehicle using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices.
  13. The vehicle positioning method according to claim 10, further comprising:
    calculating coordinates of the vehicle to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle.
  14. The vehicle positioning method according to claim 10, wherein the signals from the plurality of signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
  15. A vehicle, comprising the vehicle positioning device according to any one of claims 1 to 6 or the vehicle positioning system according to any one of claims 7 to 9.
EP20744572.7A 2019-01-25 2020-01-20 Vehicle positioning system and method, and vehicle Active EP3913328B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910073979.8A CN110798792B (en) 2019-01-25 2019-01-25 Vehicle positioning device, vehicle positioning system and vehicle
PCT/CN2020/073241 WO2020151663A1 (en) 2019-01-25 2020-01-20 Vehicle positioning apparatus, system and method, and vehicle

Publications (3)

Publication Number Publication Date
EP3913328A1 true EP3913328A1 (en) 2021-11-24
EP3913328A4 EP3913328A4 (en) 2022-03-16
EP3913328B1 EP3913328B1 (en) 2023-12-20

Family

ID=69426807

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20744572.7A Active EP3913328B1 (en) 2019-01-25 2020-01-20 Vehicle positioning system and method, and vehicle

Country Status (3)

Country Link
EP (1) EP3913328B1 (en)
CN (1) CN110798792B (en)
WO (1) WO2020151663A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111572551B (en) * 2020-05-19 2021-07-20 安徽江淮汽车集团股份有限公司 Course angle calculation method, device, equipment and storage medium under parking condition
CN111988737B (en) * 2020-07-28 2022-08-09 中国铁道科学研究院集团有限公司电子计算技术研究所 Railway operator absolute position determination method and device and electronic equipment
CN112034858B (en) * 2020-09-14 2022-04-29 哈尔滨工程大学 Model-free adaptive heading control method fusing weak observation high-order output data
CN112040446B (en) * 2020-09-16 2023-08-22 上海振华重工(集团)股份有限公司 Positioning method and positioning system
CN113099529A (en) * 2021-03-29 2021-07-09 千寻位置网络(浙江)有限公司 Indoor vehicle navigation method, vehicle-mounted terminal, field terminal server and system
CN113720343A (en) * 2021-08-16 2021-11-30 中国科学院上海微系统与信息技术研究所 Course prediction method based on dynamic data real-time adaptation
CN114684198A (en) * 2022-04-02 2022-07-01 合众新能源汽车有限公司 Course angle determining method and device, controller and vehicle

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8594879B2 (en) * 2003-03-20 2013-11-26 Agjunction Llc GNSS guidance and machine control
KR100941271B1 (en) * 2007-03-30 2010-02-11 현대자동차주식회사 Prevention method of lane departure for vehicle
CN104613982B (en) * 2015-01-28 2017-09-22 齐鲁工业大学 A kind of indoor integrated navigation simulation checking system
KR102350199B1 (en) * 2016-01-05 2022-01-14 삼성전자주식회사 Method and apparatus for estimating position in terminal
CN105953798B (en) * 2016-04-19 2018-09-18 深圳市神州云海智能科技有限公司 The pose of mobile robot determines method and apparatus
CN108036784A (en) * 2017-11-10 2018-05-15 云保(佛山)智控科技有限公司 A kind of indoor orientation method, navigation methods and systems
CN107976195B (en) * 2017-11-30 2019-02-15 达闼科技(北京)有限公司 Position Fixing Navigation System and method, storage medium, the robot of robot
CN108613671A (en) * 2018-04-25 2018-10-02 东南大学 A kind of intelligent grass-removing positioning device and method based on UWB positioning and flight path positioning
CN109000660A (en) * 2018-06-26 2018-12-14 苏州路特工智能科技有限公司 Full-automatic road roller construction paths planning method based on ultra wide band positioning
CN109115211B (en) * 2018-08-01 2021-01-05 南京科远智慧科技集团股份有限公司 High-precision personnel positioning method and positioning system for factory
CN109143305A (en) * 2018-09-30 2019-01-04 百度在线网络技术(北京)有限公司 Automobile navigation method and device

Also Published As

Publication number Publication date
EP3913328B1 (en) 2023-12-20
CN110798792A (en) 2020-02-14
WO2020151663A1 (en) 2020-07-30
CN110798792B (en) 2021-04-13
EP3913328A4 (en) 2022-03-16

Similar Documents

Publication Publication Date Title
EP3913328A1 (en) Vehicle positioning apparatus, system and method, and vehicle
CN109920246B (en) Collaborative local path planning method based on V2X communication and binocular vision
JP7160040B2 (en) Signal processing device, signal processing method, program, moving object, and signal processing system
EP3540464B1 (en) Ranging method based on laser radar system, device and readable storage medium
KR101755944B1 (en) Autonomous driving method and system for determing position of car graft on gps, uwb and v2x
CN108303720B (en) Vehicle positioning method and device and terminal equipment
WO2019108579A2 (en) Radar aided visual inertial odometry initialization
AU2018282302A1 (en) Integrated sensor calibration in natural scenes
US10514456B2 (en) Radar aided visual inertial odometry outlier removal
GB2545098A (en) Vehicle navigation system having location assistance from neighboring vehicles
US20190114911A1 (en) Method and system for determining the location of a vehicle
Thomaidis et al. Target tracking and fusion in vehicular networks
CN109781120B (en) Vehicle combination positioning method based on synchronous positioning composition
CN110962744A (en) Vehicle blind area detection method and vehicle blind area detection system
US11677931B2 (en) Automated real-time calibration
CN110766761A (en) Method, device, equipment and storage medium for camera calibration
EP4148385A1 (en) Vehicle navigation positioning method and apparatus, and base station, system and readable storage medium
Zhang et al. Review on UWB-based and multi-sensor fusion positioning algorithms in indoor environment
CN109029418A (en) A method of vehicle is positioned in closed area
CN113758482B (en) Vehicle navigation positioning method, device, base station, system and readable storage medium
CN112689241B (en) Vehicle positioning calibration method and device
US20230251095A1 (en) Vehicle positioning method and apparatus
KR20180011989A (en) Vehicle and controlling method for the same
CN111753901B (en) Data fusion method, device, system and computer equipment
CN114562997A (en) Vehicle positioning system and closed area navigation system comprising same

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210818

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

A4 Supplementary search report drawn up and despatched

Effective date: 20220215

RIC1 Information provided on ipc code assigned before grant

Ipc: G01C 21/20 20060101ALI20220209BHEP

Ipc: G01C 21/16 20060101ALI20220209BHEP

Ipc: G01C 21/00 20060101AFI20220209BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20221109

RIC1 Information provided on ipc code assigned before grant

Ipc: G01S 5/14 20060101ALI20230530BHEP

Ipc: G01S 5/02 20100101ALI20230530BHEP

Ipc: G01S 5/00 20060101ALI20230530BHEP

Ipc: G01C 21/28 20060101ALI20230530BHEP

Ipc: G01C 21/20 20060101ALI20230530BHEP

Ipc: G01C 21/16 20060101ALI20230530BHEP

Ipc: G01C 21/00 20060101AFI20230530BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20230712

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230926

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602020023096

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240321

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231220