EP3913328A1 - Vehicle positioning apparatus, system and method, and vehicle - Google Patents
Vehicle positioning apparatus, system and method, and vehicle Download PDFInfo
- Publication number
- EP3913328A1 EP3913328A1 EP20744572.7A EP20744572A EP3913328A1 EP 3913328 A1 EP3913328 A1 EP 3913328A1 EP 20744572 A EP20744572 A EP 20744572A EP 3913328 A1 EP3913328 A1 EP 3913328A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- vehicle
- signal transmitting
- heading angle
- units
- coordinates
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000004891 communication Methods 0.000 claims abstract description 150
- 238000012545 processing Methods 0.000 claims abstract description 17
- 239000011521 glass Substances 0.000 claims description 7
- 238000005259 measurement Methods 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 20
- 238000005516 engineering process Methods 0.000 description 16
- 230000008569 process Effects 0.000 description 12
- 238000004364 calculation method Methods 0.000 description 4
- 230000001186 cumulative effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000004807 localization Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000005562 fading Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000035939 shock Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/02—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
- G01S5/0247—Determining attitude
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
- G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
- G01C21/165—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
- G01C21/1656—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments with passive imaging devices, e.g. cameras
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/28—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network with correlation of data from several navigational instruments
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/0009—Transmission of position information to remote stations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/021—Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/025—Services making use of location information using location based information parameters
- H04W4/026—Services making use of location information using location based information parameters using orientation information, e.g. compass
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W64/00—Locating users or terminals or network equipment for network management purposes, e.g. mobility management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W64/00—Locating users or terminals or network equipment for network management purposes, e.g. mobility management
- H04W64/006—Locating users or terminals or network equipment for network management purposes, e.g. mobility management with additional information processing, e.g. for direction or speed determination
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/02—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
- G01S5/14—Determining absolute distances from a plurality of spaced points of known location
Definitions
- the present application relates to the technical field of automatic control, and in particular to a vehicle positioning device, a vehicle positioning system and a vehicle positioning method, and a vehicle.
- a vehicle positioning device is provided according to the present disclosure to perform accurate measurement on a heading angle.
- a vehicle positioning device operating based on multiple signal transmitting units, is provided.
- the vehicle positioning device includes two or more communication units and a processing unit.
- the communication units are arranged on a vehicle and configured to receive signals from the multiple signal transmitting units.
- the two or more communication units are spaced apart.
- the processing unit is configured to determine, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units, and determine a heading angle of the vehicle based on the coordinates of each of the communication units.
- the determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units is performed by: for each of the communication units, determining distances between the communication unit and the signal transmitting units based on the time instants at which the communication unit receives the signals from the signal transmitting units, and determining the coordinates of the communication unit based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units.
- the vehicle positioning device further includes a gyroscope.
- the gyroscope is configured to detect a heading angle of the vehicle as a first heading angle.
- the processing unit is further configured to calculate, based on a driving curve of the vehicle, a heading angle of the vehicle as a second heading angle; and determine a final heading angle of the vehicle using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices.
- each of the communication units includes a communication tag and an antenna.
- processing unit is further configured to calculate coordinates of the vehicle to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle.
- the signals from the multiple signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
- the vehicle positioning device Compared with the conventional technology, the vehicle positioning device according to the present disclosure has the following advantages.
- two or more communication units receive signals from the multiple signal transmitting units; for each of the communication units, coordinates of the communication unit is determined based on time instants at which the communication unit receives the signals from the signal transmitting units; and a heading angle of the vehicle is determined based on the coordinates of each of the communication units.
- a heading angle can be accurately measured indoors or in a region where GPS signals cannot be obtained.
- a vehicle positioning system is provided to perform accurate measurement on a heading angle in a whole process.
- a vehicle positioning system includes: the vehicle positioning device, a vehicle-mounted positioning device, and a master control device.
- the vehicle-mounted positioning device is configured to collect information of a position and/or a heading angle of a vehicle.
- the master control device is configured to: calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device in a case that two or more communication units have received signals from multiple signal transmitting devices, and calculate the position and/or the heading angle of the vehicle based on the information related to the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device in a case that any one of two or more communication units has not received a signal from any one of multiple signal transmitting devices.
- the vehicle positioning device is further configured to capture a current scene image.
- the master control device is further configured to: determine whether a pixel gray value of the current scene image is within a predetermined range before the two or more communication units receive the signals from the multiple signal transmitting devices; in a case that the pixel gray value of the current scene image is not within the predetermined range, control the two or more communication units to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device; and in a case that the pixel gray value of the current scene image is within the predetermined range, calculate the position and/or the heading angle of the vehicle based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device.
- the vehicle-mounted positioning device includes at least one of a camera, a lidar, a millimeter wave radar, an ultrasonic radar, a vehicle speed sensor, a wheel angular velocity sensor and an inertial sensor.
- the vehicle positioning system according to the present disclosure has the following advantages.
- the vehicle positioning system includes the vehicle positioning device described above and a vehicle-mounted positioning device.
- the vehicle positioning device receives signals from multiple signal transmitting devices
- the position and/or the heading angle of the vehicle is calculated by using the vehicle positioning device.
- the vehicle positioning device does not completely receive signals from multiple signal transmitting devices
- the position and/or the heading angle of the vehicle is calculated by using the vehicle-mounted positioning device.
- the position and/or the heading angle of the vehicle can be calculated in a case of a failure of the vehicle positioning device or in a region without multiple signal transmitting devices, and the position and/or the heading angle of the vehicle can be determined by the vehicle positioning device in a case that the position and/or the heading angle of the vehicle cannot be accurately determined by the vehicle-mounted positioning device, thereby performing accurate measurement on the heading angle in a whole process.
- a vehicle positioning method is provided to perform accurate measurement on a heading angle in a whole process.
- a vehicle positioning method performed based on multiple signal transmitting units and two or more communication units.
- the vehicle positioning method includes: receiving, by the two or more communication units, signals from the multiple signal transmitting units, where the two or more communication units are spaced apart; determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units; and determining a heading angle of the vehicle based on the coordinates of the each of the communication units.
- the determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the multiple signal transmitting units and coordinates of the signal transmitting units includes: for each of the two or more communication units, determining distances between the communication unit and the signal transmitting units based on the time instants at which the communication unit receives the signals from the signal transmitting units; and determining the coordinates of the communication unit based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units.
- the vehicle positioning method is performed based on a gyroscope.
- the vehicle positioning method includes: detecting, by the gyroscope, a heading angle of the vehicle as a first heading angle; calculating, based on a driving curve of the vehicle, a heading angle of the vehicle as a second heading angle; and determining a final heading angle of the vehicle using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices.
- the vehicle positioning method further includes: calculating coordinates of the vehicle to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle.
- the signals from the multiple signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
- the vehicle positioning method has the same advantages as the vehicle positioning device, which are not repeated herein.
- a vehicle is provided to perform accurate measurement on a heading angle.
- a vehicle is provided.
- the vehicle includes the vehicle positioning device or the vehicle positioning system.
- the vehicle has the same advantages as the vehicle positioning device or the vehicle positioning system, which are not repeated herein.
- Other features and advantages of the present disclosure are to be described in detail in the following embodiments.
- FIG 1 is a schematic structural diagram of a vehicle positioning device according to an embodiment of the present disclosure.
- the vehicle positioning device operates based on multiple signal transmitting units.
- the vehicle positioning device includes two or more communication units 1 and a processing unit 2.
- the communication units 1 are arranged on a vehicle, and configured to receive signals from the multiple signal transmitting units.
- the two or more communication units 1 are spaced apart.
- the processing unit 2 is configured to determine, for each of the two or more communication units 1, coordinates of the communication unit 1 based on time instants at which the communication unit 1 receives the signals from the signal transmitting units and coordinates of the signal transmitting units; and determine a heading angle of the vehicle based on the coordinates of each of the communication units 1.
- the multiple signal transmitting units may be base stations. In order to accurately determine the position and/or the heading angle of the vehicle, four signal transmitting units are arranged. The four signal transmitting units may form a square region.
- the two or more communication units 1 receive signals from the multiple signal transmitting units.
- the processing unit 2 may determine distances between the communication unit 1 and the multiple signal transmitting units based on time instants at which the communication unit 1 receives the signals from the signal transmitting units. Then, the processing unit 2 may determine coordinates of each of the communication units 1 based on the coordinates of the signal transmitting units. Since the communication units 1 are spaced apart, the distances between the communication units 1 are predetermined, and the positions at which the communication units 1 are arranged are predetermined, it is easy to obtain the orientation of the vehicle and thereby obtain the heading angle of the vehicle.
- coordinates of a midpoint of a rear axle of the vehicle is generally determined as coordinates of the vehicle. Therefore, a distance between any one of the communication units 1 and the midpoint of the rear axle of the vehicle may be obtained based on the position at which the communication unit 1 is arranged on the vehicle, and the coordinates of the midpoint of the rear axle of the vehicle is calculated based on the coordinates of the communication unit 1, thereby obtaining the coordinates of the vehicle.
- FIG. 2 is a schematic diagram of an operation process of a vehicle positioning device according to an embodiment of the present disclosure.
- the communication units receive signals from the multiple signal transmitting units.
- distances between the communication unit 1 and the signal transmitting units are determined based on the time instants at which the communication unit receives the signals from the signal transmitting units, and then the coordinates of the communication unit 1 is determined based on the coordinates of the signal transmitting units and the distances between the communication unit 1 and the signal transmitting units.
- the heading angle of the vehicle is determined based on the coordinates of each of the communication units 1.
- the heading angle of the vehicle calculated above may be not accurate enough since the heading angle is obtained in one manner. Based on a large number of actual operations and experiments, it is found that the heading angle has a deviation roughly ranging from 1.53° to 3.82 °.
- the heading angle of the vehicle may be calculated in the above manner with a preset very high refresh rate, then multiple heading angles of the vehicle are obtained in a same state (position and heading angle) of the vehicle, and then an accurate heading angle is obtained by performing an average calculation on the multiple heading angles.
- a gyroscope is arranged to detect the heading angle of the vehicle as a first heading angle. With the gyroscope, a relative heading angle with an accuracy of up to 0.1° is obtained, and a cumulative error is generated.
- the processing unit 2 fits a driving curve equation based on a driving curve of the vehicle, and performs a deviation calculation to obtain a heading angle of the vehicle as a second heading angle. Based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices (or the heading angle after average calculation), a final heading angle of the vehicle is determined using an autoregressive algorithm, such as Kalman filtering. The final heading angle of the vehicle is accurate without generating a cumulative error, thereby calibrating the problem of the cumulative error generated by using the gyroscope.
- a message format for final output is provided.
- frame 1 0000 0000, where first four bytes represents an x-coordinate and last four bytes represents a ⁇ -coordinate (a positioning result); and frame 2: 0000 0000, where first four bytes represents a horizontal angle, and last four bytes represents a pitch angle (a result of the heading angle), which is not limited to this.
- FIG. 3 is a schematic diagram showing an arrangement of a vehicle positioning device according to an embodiment of the present disclosure.
- a UWB technology is taken as an example for description.
- the Bluetooth technology, the WIFI technology, or other wireless technologies may be used instead of the UWB technology.
- UWB is a carrier-free communication technology.
- data is transmitted using nanosecond to picosecond non-sinusoidal narrow pulses.
- signals with extremely low powers are transmitted based on a wide frequency spectrum, thus a data transmission rate of hundreds of Mbits/s to several Gbits/s can be achieved in a region having a radius of about 10 meters.
- the positioning performed indoor with the UWB technology has the following features: 1 having a frequency ranging from 3.1Ghz to 10.6GHz and a bandwidth greater than 500MHz; 2 expressed as extremely short (less than 2nS) pulses in the time domain; 3 having good coexistence with other wireless devices; 4 having a low power consumption and a low emission duty cycle; 5 insensitive to Rayleigh fading; and 6 having strong penetrability and having a high positioning accuracy.
- each of the communication units 1 may include a communication tag and an antenna.
- a tag-side solving solution may be used. After the antenna receives the signals from the signal transmitting units, the signals are transmitted to the tag to perform a synchronization algorithm to obtain time information. The time information is transmitted via a serial port or a CAN to a solving unit (not shown in Figure 3 ) to determine coordinates, and then the coordinates are transmitted to the processing unit 2 via the CAN or a serial port or by using other wired or wireless transmission technology.
- the solving unit may be integrated with the processing unit 2 to perform the calculation in the processing unit 2.
- the antenna and the tag may be integrated together or arranged separately.
- Antenna 1 and antenna 2 may be arranged in one structure or be arranged separately, and the two antennas are required to be spaced apart.
- the heading angle of the vehicle may be calculated based on the coordinates of the antennas, thereby controlling a wire control system, such as a steering angle, of the vehicle.
- FIG. 4 is a schematic structural diagram of a vehicle positioning system according to an embodiment of the present disclosure.
- the vehicle positioning system includes: the vehicle positioning device 4 described above, a vehicle-mounted positioning device 5 and a master control device 6.
- the vehicle-mounted positioning device 5 is configured to collect information of a position and/or a heading angle of a vehicle.
- the master control device 6 is configured to: calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device 4 in a case that two or more communication units 1 have received signals from multiple signal transmitting devices; and calculate the position and/or the heading angle of the vehicle based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device 5 in a case that any one of two or more communication units 1 has not received a signal from any one of multiple signal transmitting devices.
- the vehicle-mounted positioning device 5 is arranged to perform vision positioning.
- positioning is mainly performed by the vehicle positioning device 4, and the vehicle-mounted positioning device 5 is configured to perform positioning and operations in a case of the failure of the vehicle positioning device 4, obstacle identification, and obstacle avoidance.
- a base station is arranged in the parking lot, and dual tags are arranged on the vehicle.
- the solution is applied in a scenario in which all vehicles in the parking lot are arranged with tags and communicate with the base station in the parking lot, and information are transmitted back to a parking lot management system and other vehicles through a wireless network. That is, the environment is simple.
- the parking lot management system performs unified dispatch and route planning for the vehicles. Based on the UWB positioning technology, information of the heading angle, and vehicle control models, the vehicle is parked.
- obstacle avoidance and local path planning are performed based on a solution of vision and radar in the travelling of the vehicle.
- FIG. 5A is a schematic structural diagram of a vehicle-mounted positioning device according to an embodiment of the present disclosure.
- the vehicle-mounted positioning device 5 includes at least one of a camera 31, a lidar 32, a millimeter wave radar 33, an ultrasonic radar 34, a vehicle speed sensor 35, a wheel angular velocity sensor 36 and an inertial sensor 37.
- the millimeter wave radar 33 is used for obstacle avoidance.
- the ultrasonic radar 34 parking of vehicles is performed based on the solution of vision and radar.
- various states such as a vehicle speed, a wheel speed, an acceleration, a tilt, a shock, a vibration, a rotation, and a multi-degree-of-freedom motion, of the vehicle may be obtained.
- FIG. 5B is a schematic diagram showing arrangement positions of vehicle-mounted cameras according to an embodiment of the present disclosure.
- the vehicle-mounted cameras 31 may include a surround view camera 311, a front view camera 312 and the like to completely capture images around the vehicle.
- the master control unit 2 uses a high-precision map and/or a semantic map collected by a vehicle sensor, the surround view camera 311 and the front view camera 312.
- VSLAM vision synchronous localization and mapping
- IMU inertial sensor 37
- multiple signal transmitting units may be arranged in certain regions to save costs to control the signals transmitted from the multiple signal transmitting units to cover a region around a turn, a region around a corner, a region around a transparent glass, or a region having feature points not sufficient for the vehicle-mounted positioning device 5 to correctly position the vehicle.
- FIG. 6 is a schematic diagram of an operation process of a vehicle positioning system according to an embodiment of the present disclosure.
- the vehicle positioning system operates as follows.
- a current scene image is captured. It is determined whether a pixel gray value of the current scene image is within a predetermined range.
- the two or more communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device 4.
- the position and/or the heading angle of the vehicle is calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device 5.
- FIG. 7 is a schematic diagram of an operation process of a vehicle positioning system according to another embodiment of the present disclosure.
- the vehicle positioning system operates as follows.
- a current scene image is captured, and a drivable region is determined based on the current scene image. It is determined whether the drivable region changes alternately in size in the driving of the vehicle.
- the two or more communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device 4.
- the position and/or the heading angle of the vehicle is calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device 5.
- FIG 8 is a schematic diagram of an operation process of a vehicle positioning system according to another embodiment of the present disclosure. As shown in Figure 8 , for a region having feature points not sufficient for the vehicle-mounted positioning device 5 to correctly position the vehicle, the vehicle positioning system according to the embodiment of the present disclosure operates as follows. The vehicle positioning device 5 generates and outputs vehicle-side positioning information. Then, one of the following steps 1 and 2 is performed.
- step 1 expected positioning information is obtained based on a direction of the vehicle, a speed of the vehicle, and initial positioning information. It is determined whether a deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to a predetermined value in the driving of the vehicle. In a case that the deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to the predetermined value, that is, the vehicle has entered the region having insufficient feature points, the two or more communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device 4.
- the position and/or the heading angle of the vehicle may be calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device 5.
- step 2 it is determined in the driving of the vehicle whether an update frequency of the vehicle-side positioning information in a predetermined time period is less than or equal to a predetermined frequency.
- the two or more communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device 4.
- the position and/or the heading angle of the vehicle may be calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device 5.
- Figure 9 is a block diagram showing an operation of a vehicle positioning system according to an embodiment of the present disclosure.
- the antenna receives a signal from a base station
- the signal is transmitted to a tag to perform a synchronization algorithm to obtain time information.
- the time information is transmitted via a serial port or a CAN to a solving unit to determine position coordinates.
- the coordinates are transmitted to the master control unit via a serial port, a CAN, a network cable, an optical fiber, or the like.
- the vehicle-side positioning solution based on VSLAM, high-precision map and lidar
- precise positioning with a positioning error of 10cm and a yaw angle error of 0.2°
- the final coordinates and heading angle of the vehicle are outputted in a way of evaluating confidence.
- the UWB positioning solution is less affected by the environment, and the vision positioning solution is easily interfered by light. Therefore, the vision positioning solution is mainly applied in scenarios with good light, and the UWB positioning solution is mainly applied in scenarios with poor light.
- the vision positioning solution is performed based on a high-precision map, an ultrasonic radar, a surround-view fisheye camera, a front view camera, a millimeter wave radar, sensors (such as a speed sensor and a wheel angular velocity sensor) arranged on the vehicle, an IMU and multiple low-cost sensors.
- the vision positioning solution is based on a high-precision map and a semantic map generated based on VSLAM
- a low-cost vehicle-side positioning solution and a low-cost field-side positioning solution are combined, overcoming the shortcomings of the vision positioning solution easily affected by light, and thereby ensuring reliability. Furthermore, with the vehicle-side positioning solution and the field-side positioning solution according to the embodiment of the present disclosure, it is ensured that there is a redundant backup solution in a case that one of the solutions fails, thereby improving the safety of the entire system.
- a vehicle positioning method is further provided according to an embodiment of the present disclosure.
- the vehicle positioning method is performed based on multiple signal transmitting units and two or more communication units.
- the vehicle positioning method includes the following operations.
- the two or more communication units receive signals from the multiple signal transmitting units.
- the two or more communication units are spaced apart.
- coordinates of the communication unit are determined based on time instants at which the communication unit receives the signals from the multiple signal transmitting units and coordinates of the signal transmitting units.
- a heading angle of the vehicle is determined based on the coordinates of each of the communication units.
- determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the multiple signal transmitting units and coordinates of the signal transmitting units following operations are performed. For each of the communication units, distances between the communication unit and the signal transmitting units are determined based on the time instants at which the communication unit receives the signals from the signal transmitting units. The coordinates of the communication unit are determined based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units.
- the vehicle positioning method is performed based on a gyroscope.
- the vehicle positioning method includes the following operations.
- the gyroscope detects a heading angle of the vehicle as a first heading angle.
- a heading angle of the vehicle is calculated as a second heading angle.
- a final heading angle of the vehicle is and determined using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices.
- each of the communication units includes a communication tag and an antenna.
- the method includes the following operation. Coordinates of the vehicle are calculated to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle.
- the signals from the multiple signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
- a machine-readable storage medium is further provided according to an embodiment of the present disclosure.
- the machine-readable storage medium stores instructions.
- the instructions when executed by a machine, cause the machine to perform the vehicle positioning method.
- a processor is further provided according to an embodiment of the present disclosure.
- the processor is configured to execute a program.
- the program when executed by the processor, causes the processor to perform the vehicle positioning method.
- a vehicle is further provided according to an embodiment of the present disclosure.
- the vehicle includes the vehicle positioning device or the vehicle positioning system.
- Embodiments of the vehicle positioning method, the machine-readable storage medium, the processor and the vehicle are similar to the embodiments of the vehicle positioning device and the vehicle positioning system, which are not repeated herein.
Abstract
Description
- The present application relates to the technical field of automatic control, and in particular to a vehicle positioning device, a vehicle positioning system and a vehicle positioning method, and a vehicle.
- Nowadays, positioning of automatic driving outdoors may be performed based on a real time dynamic kinematic (RTK) method, a global navigation positioning system (GNSS), and the like. However, in an indoor parking lot, accurate positioning cannot be performed based on the methods performed outdoors due to the loss of GPS signals. According to the conventional indoor positioning solution, only coordinates can be determined, and the heading angle cannot be measured. However, the heading angle is important for the positioning and control of automatic driving.
- In view of this, a vehicle positioning device is provided according to the present disclosure to perform accurate measurement on a heading angle.
- In order to achieve the above objective, the following technical solutions are provided according to the present disclosure.
- A vehicle positioning device, operating based on multiple signal transmitting units, is provided. The vehicle positioning device includes two or more communication units and a processing unit. The communication units are arranged on a vehicle and configured to receive signals from the multiple signal transmitting units. The two or more communication units are spaced apart. The processing unit is configured to determine, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units, and determine a heading angle of the vehicle based on the coordinates of each of the communication units.
- Further, the determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units is performed by: for each of the communication units, determining distances between the communication unit and the signal transmitting units based on the time instants at which the communication unit receives the signals from the signal transmitting units, and determining the coordinates of the communication unit based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units.
- Further, the vehicle positioning device further includes a gyroscope. The gyroscope is configured to detect a heading angle of the vehicle as a first heading angle. The processing unit is further configured to calculate, based on a driving curve of the vehicle, a heading angle of the vehicle as a second heading angle; and determine a final heading angle of the vehicle using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices.
- Further, each of the communication units includes a communication tag and an antenna.
- Further, the processing unit is further configured to calculate coordinates of the vehicle to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle.
- Further, the signals from the multiple signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
- Compared with the conventional technology, the vehicle positioning device according to the present disclosure has the following advantages.
- In the vehicle positioning device operating based on multiple signal transmitting units according to the present disclosure, two or more communication units receive signals from the multiple signal transmitting units; for each of the communication units, coordinates of the communication unit is determined based on time instants at which the communication unit receives the signals from the signal transmitting units; and a heading angle of the vehicle is determined based on the coordinates of each of the communication units. With the vehicle positioning device operating based on multiple signal transmitting units according to the present disclosure, a heading angle can be accurately measured indoors or in a region where GPS signals cannot be obtained.
- According to the present disclosure, a vehicle positioning system is provided to perform accurate measurement on a heading angle in a whole process.
- In order to achieve the above objective, the following technical solutions are provided according to the present disclosure.
- A vehicle positioning system is provided. The vehicle positioning system includes: the vehicle positioning device, a vehicle-mounted positioning device, and a master control device. The vehicle-mounted positioning device is configured to collect information of a position and/or a heading angle of a vehicle. The master control device is configured to: calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device in a case that two or more communication units have received signals from multiple signal transmitting devices, and calculate the position and/or the heading angle of the vehicle based on the information related to the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device in a case that any one of two or more communication units has not received a signal from any one of multiple signal transmitting devices.
- Further, the vehicle positioning device is further configured to capture a current scene image. The master control device is further configured to: determine whether a pixel gray value of the current scene image is within a predetermined range before the two or more communication units receive the signals from the multiple signal transmitting devices; in a case that the pixel gray value of the current scene image is not within the predetermined range, control the two or more communication units to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device; and in a case that the pixel gray value of the current scene image is within the predetermined range, calculate the position and/or the heading angle of the vehicle based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device.
- Further, the vehicle-mounted positioning device includes at least one of a camera, a lidar, a millimeter wave radar, an ultrasonic radar, a vehicle speed sensor, a wheel angular velocity sensor and an inertial sensor.
- Compared with the conventional technology, the vehicle positioning system according to the present disclosure has the following advantages.
- The vehicle positioning system according to the present disclosure includes the vehicle positioning device described above and a vehicle-mounted positioning device. In a case that the vehicle positioning device receives signals from multiple signal transmitting devices, the position and/or the heading angle of the vehicle is calculated by using the vehicle positioning device. In a case that the vehicle positioning device does not completely receive signals from multiple signal transmitting devices, the position and/or the heading angle of the vehicle is calculated by using the vehicle-mounted positioning device. With the vehicle positioning system according to the present disclosure, it can be ensured that the position and/or the heading angle of the vehicle can be calculated in a case of a failure of the vehicle positioning device or in a region without multiple signal transmitting devices, and the position and/or the heading angle of the vehicle can be determined by the vehicle positioning device in a case that the position and/or the heading angle of the vehicle cannot be accurately determined by the vehicle-mounted positioning device, thereby performing accurate measurement on the heading angle in a whole process.
- According to the present disclosure, a vehicle positioning method is provided to perform accurate measurement on a heading angle in a whole process.
- In order to achieve the above objective, the following technical solutions are provided according to the present disclosure.
- A vehicle positioning method, performed based on multiple signal transmitting units and two or more communication units, is provided. The vehicle positioning method includes: receiving, by the two or more communication units, signals from the multiple signal transmitting units, where the two or more communication units are spaced apart; determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units; and determining a heading angle of the vehicle based on the coordinates of the each of the communication units.
- Further, the determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the multiple signal transmitting units and coordinates of the signal transmitting units includes: for each of the two or more communication units, determining distances between the communication unit and the signal transmitting units based on the time instants at which the communication unit receives the signals from the signal transmitting units; and determining the coordinates of the communication unit based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units.
- Further, the vehicle positioning method is performed based on a gyroscope. The vehicle positioning method includes: detecting, by the gyroscope, a heading angle of the vehicle as a first heading angle; calculating, based on a driving curve of the vehicle, a heading angle of the vehicle as a second heading angle; and determining a final heading angle of the vehicle using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices.
- Further, the vehicle positioning method further includes: calculating coordinates of the vehicle to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle.
- Further, the signals from the multiple signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
- Compared with the conventional technology, the vehicle positioning method has the same advantages as the vehicle positioning device, which are not repeated herein.
- According to the present disclosure, a vehicle is provided to perform accurate measurement on a heading angle.
- In order to achieve the above objective, the following technical solutions are provided according to the present disclosure.
- A vehicle is provided. The vehicle includes the vehicle positioning device or the vehicle positioning system.
- Compared with the conventional technology, the vehicle has the same advantages as the vehicle positioning device or the vehicle positioning system, which are not repeated herein. Other features and advantages of the present disclosure are to be described in detail in the following embodiments.
- The accompanying drawings forming a part of the present disclosure are used to provide a further understanding of the present disclosure. Exemplary embodiments of the present disclosure and descriptions thereof are used to explain the present disclosure rather than constitute an undue limitation on the present disclosure. In the drawings:
-
Figure 1 is a schematic structural diagram of a vehicle positioning device according to an embodiment of the present disclosure; -
Figure 2 is a schematic diagram of an operation process of a vehicle positioning device according to an embodiment of the present disclosure; -
Figure 3 is a schematic diagram showing an arrangement of a vehicle positioning device according to an embodiment of the present disclosure; -
Figure 4 is a schematic structural diagram of a vehicle positioning system according to an embodiment of the present disclosure; -
Figure 5A is a schematic structural diagram of a vehicle-mounted positioning device according to an embodiment of the present disclosure; -
Figure 5B is a schematic diagram showing arrangement positions of vehicle-mounted cameras according to an embodiment of the present disclosure; -
Figure 6 is a schematic diagram of an operation process of a vehicle positioning system according to an embodiment of the present disclosure; -
Figure 7 is a schematic diagram of an operation process of a vehicle positioning system according to another embodiment of the present disclosure; -
Figure 8 is a schematic diagram of an operation process of a vehicle positioning system according to another embodiment of the present disclosure; and -
Figure 9 is a block diagram showing an operation of a vehicle positioning system according to an embodiment of the present disclosure. - Reference numerals are listed as follows:
1 Communication unit 2 Processing unit 31 Camera 32 Lidar 33 Millimeter wave radar 34 Ultrasonic radar 35 Vehicle speed sensor 36 Wheel angular velocity sensor 37 Inertial sensor 311 Surround view camera 312 Front view camera 4 Vehicle positioning device 5 Vehicle-mounted positioning device 6 Master control device - It should be noted that embodiments of the present disclosure and the features in the embodiments may be in combination with each other as long as there is no conflict.
- The present disclosure is described in detail below with reference to the drawings and in conjunction with the embodiments.
-
Figure 1 is a schematic structural diagram of a vehicle positioning device according to an embodiment of the present disclosure. As shown inFigure 1 , the vehicle positioning device operates based on multiple signal transmitting units. The vehicle positioning device includes two ormore communication units 1 and aprocessing unit 2. Thecommunication units 1 are arranged on a vehicle, and configured to receive signals from the multiple signal transmitting units. The two ormore communication units 1 are spaced apart. Theprocessing unit 2 is configured to determine, for each of the two ormore communication units 1, coordinates of thecommunication unit 1 based on time instants at which thecommunication unit 1 receives the signals from the signal transmitting units and coordinates of the signal transmitting units; and determine a heading angle of the vehicle based on the coordinates of each of thecommunication units 1. - In the embodiment of the present disclosure, the multiple signal transmitting units (not shown in
Figure 1 ) may be base stations. In order to accurately determine the position and/or the heading angle of the vehicle, four signal transmitting units are arranged. The four signal transmitting units may form a square region. The two ormore communication units 1 receive signals from the multiple signal transmitting units. For each of the communication units1, theprocessing unit 2 may determine distances between thecommunication unit 1 and the multiple signal transmitting units based on time instants at which thecommunication unit 1 receives the signals from the signal transmitting units. Then, theprocessing unit 2 may determine coordinates of each of thecommunication units 1 based on the coordinates of the signal transmitting units. Since thecommunication units 1 are spaced apart, the distances between thecommunication units 1 are predetermined, and the positions at which thecommunication units 1 are arranged are predetermined, it is easy to obtain the orientation of the vehicle and thereby obtain the heading angle of the vehicle. - For the position of the vehicle, coordinates of a midpoint of a rear axle of the vehicle is generally determined as coordinates of the vehicle. Therefore, a distance between any one of the
communication units 1 and the midpoint of the rear axle of the vehicle may be obtained based on the position at which thecommunication unit 1 is arranged on the vehicle, and the coordinates of the midpoint of the rear axle of the vehicle is calculated based on the coordinates of thecommunication unit 1, thereby obtaining the coordinates of the vehicle. -
Figure 2 is a schematic diagram of an operation process of a vehicle positioning device according to an embodiment of the present disclosure. As shown inFigure 2 , the communication units receive signals from the multiple signal transmitting units. For each of thecommunication units 1, distances between thecommunication unit 1 and the signal transmitting units are determined based on the time instants at which the communication unit receives the signals from the signal transmitting units, and then the coordinates of thecommunication unit 1 is determined based on the coordinates of the signal transmitting units and the distances between thecommunication unit 1 and the signal transmitting units. Finally, the heading angle of the vehicle is determined based on the coordinates of each of thecommunication units 1. - The heading angle of the vehicle calculated above may be not accurate enough since the heading angle is obtained in one manner. Based on a large number of actual operations and experiments, it is found that the heading angle has a deviation roughly ranging from 1.53° to 3.82 °. In this regard, in the present disclosure, the heading angle of the vehicle may be calculated in the above manner with a preset very high refresh rate, then multiple heading angles of the vehicle are obtained in a same state (position and heading angle) of the vehicle, and then an accurate heading angle is obtained by performing an average calculation on the multiple heading angles.
- In addition, in an embodiment of the present disclosure, a gyroscope is arranged to detect the heading angle of the vehicle as a first heading angle. With the gyroscope, a relative heading angle with an accuracy of up to 0.1° is obtained, and a cumulative error is generated. The
processing unit 2 fits a driving curve equation based on a driving curve of the vehicle, and performs a deviation calculation to obtain a heading angle of the vehicle as a second heading angle. Based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices (or the heading angle after average calculation), a final heading angle of the vehicle is determined using an autoregressive algorithm, such as Kalman filtering. The final heading angle of the vehicle is accurate without generating a cumulative error, thereby calibrating the problem of the cumulative error generated by using the gyroscope. - In addition, after the coordinates of the vehicle and the heading angle of the vehicle are calculated, it is required to output the coordinates of the vehicle and the heading angle of the vehicle. According to an embodiment of the present disclosure, a message format for final output is provided. For example, frame 1: 0000 0000, where first four bytes represents an x-coordinate and last four bytes represents a γ-coordinate (a positioning result); and frame 2: 0000 0000, where first four bytes represents a horizontal angle, and last four bytes represents a pitch angle (a result of the heading angle), which is not limited to this.
-
Figure 3 is a schematic diagram showing an arrangement of a vehicle positioning device according to an embodiment of the present disclosure. In an embodiment of the present disclosure, a UWB technology is taken as an example for description. In practice, the Bluetooth technology, the WIFI technology, or other wireless technologies may be used instead of the UWB technology. UWB is a carrier-free communication technology. With the UWB technology, data is transmitted using nanosecond to picosecond non-sinusoidal narrow pulses. With the UWB technology, signals with extremely low powers are transmitted based on a wide frequency spectrum, thus a data transmission rate of hundreds of Mbits/s to several Gbits/s can be achieved in a region having a radius of about 10 meters. With the UWB technology, a positioning accuracy of up to 10cm can be achieved. The positioning performed indoor with the UWB technology has the following features: 1 having a frequency ranging from 3.1Ghz to 10.6GHz and a bandwidth greater than 500MHz; 2 expressed as extremely short (less than 2nS) pulses in the time domain; 3 having good coexistence with other wireless devices; 4 having a low power consumption and a low emission duty cycle; 5 insensitive to Rayleigh fading; and 6 having strong penetrability and having a high positioning accuracy. - As shown in
Figure 3 , each of thecommunication units 1 may include a communication tag and an antenna. In the vehicle positioning device, a tag-side solving solution may be used. After the antenna receives the signals from the signal transmitting units, the signals are transmitted to the tag to perform a synchronization algorithm to obtain time information. The time information is transmitted via a serial port or a CAN to a solving unit (not shown inFigure 3 ) to determine coordinates, and then the coordinates are transmitted to theprocessing unit 2 via the CAN or a serial port or by using other wired or wireless transmission technology. Alternatively, the solving unit may be integrated with theprocessing unit 2 to perform the calculation in theprocessing unit 2. The antenna and the tag may be integrated together or arranged separately.Antenna 1 andantenna 2 may be arranged in one structure or be arranged separately, and the two antennas are required to be spaced apart. The heading angle of the vehicle may be calculated based on the coordinates of the antennas, thereby controlling a wire control system, such as a steering angle, of the vehicle. - A vehicle positioning system is further provided according to an embodiment of the present disclosure.
Figure 4 is a schematic structural diagram of a vehicle positioning system according to an embodiment of the present disclosure. As shown inFigure 4 , the vehicle positioning system includes: thevehicle positioning device 4 described above, a vehicle-mountedpositioning device 5 and amaster control device 6. The vehicle-mountedpositioning device 5 is configured to collect information of a position and/or a heading angle of a vehicle. Themaster control device 6 is configured to: calculate the position and/or the heading angle of the vehicle by using thevehicle positioning device 4 in a case that two ormore communication units 1 have received signals from multiple signal transmitting devices; and calculate the position and/or the heading angle of the vehicle based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mountedpositioning device 5 in a case that any one of two ormore communication units 1 has not received a signal from any one of multiple signal transmitting devices. - In the embodiment of the present disclosure, the vehicle-mounted
positioning device 5 is arranged to perform vision positioning. In the vehicle positioning system according to the embodiment, positioning is mainly performed by thevehicle positioning device 4, and the vehicle-mountedpositioning device 5 is configured to perform positioning and operations in a case of the failure of thevehicle positioning device 4, obstacle identification, and obstacle avoidance. In this solution, a base station is arranged in the parking lot, and dual tags are arranged on the vehicle. The solution is applied in a scenario in which all vehicles in the parking lot are arranged with tags and communicate with the base station in the parking lot, and information are transmitted back to a parking lot management system and other vehicles through a wireless network. That is, the environment is simple. The parking lot management system performs unified dispatch and route planning for the vehicles. Based on the UWB positioning technology, information of the heading angle, and vehicle control models, the vehicle is parked. In addition, obstacle avoidance and local path planning are performed based on a solution of vision and radar in the travelling of the vehicle. -
Figure 5A is a schematic structural diagram of a vehicle-mounted positioning device according to an embodiment of the present disclosure. As shown inFigure 5A , the vehicle-mountedpositioning device 5 includes at least one of acamera 31, alidar 32, amillimeter wave radar 33, anultrasonic radar 34, avehicle speed sensor 35, a wheelangular velocity sensor 36 and aninertial sensor 37. Themillimeter wave radar 33 is used for obstacle avoidance. With theultrasonic radar 34, parking of vehicles is performed based on the solution of vision and radar. With thevehicle speed sensor 35, the wheelangular velocity sensor 36, and theinertial sensor 37, various states, such as a vehicle speed, a wheel speed, an acceleration, a tilt, a shock, a vibration, a rotation, and a multi-degree-of-freedom motion, of the vehicle may be obtained. -
Figure 5B is a schematic diagram showing arrangement positions of vehicle-mounted cameras according to an embodiment of the present disclosure. As shown inFigure 5B , the vehicle-mountedcameras 31 may include asurround view camera 311, afront view camera 312 and the like to completely capture images around the vehicle. Themaster control unit 2 uses a high-precision map and/or a semantic map collected by a vehicle sensor, thesurround view camera 311 and thefront view camera 312. In the solution of vision positioning, based on a semantic map generated based on a vision synchronous localization and mapping (VSLAM) and the high-precision map, VSLAM feature points identified and collected by the vehicle-mountedcamera 31 are matched, then the vehicle is positioned based on information of the inertial sensor 37 (IMU), thereby obtaining vehicle-side positioning information. SLAM (simultaneous localization and mapping) is a process of constructing an environmental map while calculating a position based on information of a sensor, thereby solving the problem of positioning and map construction when moving in an unknown environment. VSLAM is a vision SLAM, which is advanced. In the VSLAM, positioning and map construction is performed based on vision, which is accurate and rapid. - In addition, in an embodiment of the present disclosure, multiple signal transmitting units may be arranged in certain regions to save costs to control the signals transmitted from the multiple signal transmitting units to cover a region around a turn, a region around a corner, a region around a transparent glass, or a region having feature points not sufficient for the vehicle-mounted
positioning device 5 to correctly position the vehicle. -
Figure 6 is a schematic diagram of an operation process of a vehicle positioning system according to an embodiment of the present disclosure. As shown inFigure 6 , for regions with bright or dark light, such as a region around a corner and a region around a transparent glass, the vehicle positioning system according to the embodiment of the present disclosure operates as follows. A current scene image is captured. It is determined whether a pixel gray value of the current scene image is within a predetermined range. In a case that the pixel gray value of the current scene image is not within the predetermined range, the two ormore communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using thevehicle positioning device 4. In a case that the pixel gray value of the current scene image is within the predetermined range, the position and/or the heading angle of the vehicle is calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mountedpositioning device 5. -
Figure 7 is a schematic diagram of an operation process of a vehicle positioning system according to another embodiment of the present disclosure. As shown inFigure 7 , for a region around a turn, the vehicle positioning system according to the embodiment of the present disclosure operates as follows. A current scene image is captured, and a drivable region is determined based on the current scene image. It is determined whether the drivable region changes alternately in size in the driving of the vehicle. In a case that the drivable region changes alternately in size, the two ormore communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using thevehicle positioning device 4. In a case that the drivable region does not change alternately in size, the position and/or the heading angle of the vehicle is calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mountedpositioning device 5. -
Figure 8 is a schematic diagram of an operation process of a vehicle positioning system according to another embodiment of the present disclosure. As shown inFigure 8 , for a region having feature points not sufficient for the vehicle-mountedpositioning device 5 to correctly position the vehicle, the vehicle positioning system according to the embodiment of the present disclosure operates as follows. Thevehicle positioning device 5 generates and outputs vehicle-side positioning information. Then, one of the followingsteps - In
step 1, expected positioning information is obtained based on a direction of the vehicle, a speed of the vehicle, and initial positioning information. It is determined whether a deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to a predetermined value in the driving of the vehicle. In a case that the deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to the predetermined value, that is, the vehicle has entered the region having insufficient feature points, the two ormore communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using thevehicle positioning device 4. In a case that the deviation between the vehicle-side positioning information and the expected positioning information is less than a predetermined value, that is, the vehicle has not entered the region having insufficient feature points, the position and/or the heading angle of the vehicle may be calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mountedpositioning device 5. - In
step 2, it is determined in the driving of the vehicle whether an update frequency of the vehicle-side positioning information in a predetermined time period is less than or equal to a predetermined frequency. In a case that the update frequency of the vehicle-side positioning information in the predetermined period is less than or equal to the predetermined frequency, that is, the vehicle has entered the region having insufficient feature points, the two ormore communication units 1 are controlled to receive the signals from the multiple signal transmitting units to calculate the position and/or the heading angle of the vehicle by using thevehicle positioning device 4. In a case that the update frequency of the vehicle-side positioning information in the predetermined period is greater than the predetermined frequency, that is, the vehicle has not entered the region having insufficient feature points, the position and/or the heading angle of the vehicle may be calculated based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mountedpositioning device 5. -
Figure 9 is a block diagram showing an operation of a vehicle positioning system according to an embodiment of the present disclosure. As shown inFigure 9 , after the antenna receives a signal from a base station, the signal is transmitted to a tag to perform a synchronization algorithm to obtain time information. The time information is transmitted via a serial port or a CAN to a solving unit to determine position coordinates. Then, the coordinates are transmitted to the master control unit via a serial port, a CAN, a network cable, an optical fiber, or the like. - Based on the vehicle-side positioning solution (based on VSLAM, high-precision map and lidar) and the field-side high-precision UWB positioning solution, precise positioning (with a positioning error of 10cm and a yaw angle error of 0.2°) is performed. Based on the above two positioning solutions and the Kalman filtering, the final coordinates and heading angle of the vehicle are outputted in a way of evaluating confidence. The UWB positioning solution is less affected by the environment, and the vision positioning solution is easily interfered by light. Therefore, the vision positioning solution is mainly applied in scenarios with good light, and the UWB positioning solution is mainly applied in scenarios with poor light. The vision positioning solution is performed based on a high-precision map, an ultrasonic radar, a surround-view fisheye camera, a front view camera, a millimeter wave radar, sensors (such as a speed sensor and a wheel angular velocity sensor) arranged on the vehicle, an IMU and multiple low-cost sensors. The vision positioning solution is based on a high-precision map and a semantic map generated based on VSLAM
- In the embodiment of the present disclosure, a low-cost vehicle-side positioning solution and a low-cost field-side positioning solution are combined, overcoming the shortcomings of the vision positioning solution easily affected by light, and thereby ensuring reliability. Furthermore, with the vehicle-side positioning solution and the field-side positioning solution according to the embodiment of the present disclosure, it is ensured that there is a redundant backup solution in a case that one of the solutions fails, thereby improving the safety of the entire system.
- A vehicle positioning method is further provided according to an embodiment of the present disclosure. The vehicle positioning method is performed based on multiple signal transmitting units and two or more communication units. The vehicle positioning method includes the following operations. The two or more communication units receive signals from the multiple signal transmitting units. The two or more communication units are spaced apart. For each of the two or more communication units, coordinates of the communication unit are determined based on time instants at which the communication unit receives the signals from the multiple signal transmitting units and coordinates of the signal transmitting units. A heading angle of the vehicle is determined based on the coordinates of each of the communication units.
- Further, in determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the multiple signal transmitting units and coordinates of the signal transmitting units, following operations are performed. For each of the communication units, distances between the communication unit and the signal transmitting units are determined based on the time instants at which the communication unit receives the signals from the signal transmitting units. The coordinates of the communication unit are determined based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units.
- Further, the vehicle positioning method is performed based on a gyroscope. The vehicle positioning method includes the following operations. The gyroscope detects a heading angle of the vehicle as a first heading angle. Based on a driving curve of the vehicle, a heading angle of the vehicle is calculated as a second heading angle. A final heading angle of the vehicle is and determined using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices.
- Further, each of the communication units includes a communication tag and an antenna.
- Further, the method includes the following operation. Coordinates of the vehicle are calculated to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle.
- Further, the signals from the multiple signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
- A machine-readable storage medium is further provided according to an embodiment of the present disclosure. The machine-readable storage medium stores instructions. The instructions, when executed by a machine, cause the machine to perform the vehicle positioning method.
- A processor is further provided according to an embodiment of the present disclosure. The processor is configured to execute a program. The program, when executed by the processor, causes the processor to perform the vehicle positioning method.
- A vehicle is further provided according to an embodiment of the present disclosure. The vehicle includes the vehicle positioning device or the vehicle positioning system.
- Embodiments of the vehicle positioning method, the machine-readable storage medium, the processor and the vehicle are similar to the embodiments of the vehicle positioning device and the vehicle positioning system, which are not repeated herein.
- The foregoing embodiments are merely preferred embodiments of the present disclosure and are not intended to limit the present disclosure. Any modification, equivalent substitutions and improvement made within the spirit and principle of the present disclosure shall fall within the protection scope of the present disclosure.
Claims (15)
- A vehicle positioning device, operating based on a plurality of signal transmitting units, wherein the vehicle positioning device comprises:two or more communication units, arranged on a vehicle and configured to receive signals from the plurality of signal transmitting units, wherein the two or more communication units are spaced apart; anda processing unit, configured to:determine, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units, anddetermine a heading angle of the vehicle based on the coordinates of each of the communication units.
- The vehicle positioning device according to claim 1, wherein determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units is performed by:
for each of the two or more communication units,determining distances between the communication unit and the signal transmitting units based on the time instants at which the communication unit receives the signals from the signal transmitting units; anddetermining the coordinates of the communication unit based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units. - The vehicle positioning device according to claim 1, further comprising a gyroscope configured to detect a heading angle of the vehicle as a first heading angle, wherein
the processing unit is further configured to:calculate, based on a driving curve of the vehicle, a heading angle of the vehicle as a second heading angle; anddetermine a final heading angle of the vehicle using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices. - The vehicle positioning device according to claim 1, wherein each of the communication units comprises a communication tag and an antenna.
- The vehicle positioning device according to claim 1, wherein the processing unit is further configured to:
calculate coordinates of the vehicle to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle. - The vehicle positioning device according to claim 1, wherein the signals from the plurality of signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
- A vehicle positioning system, comprising:the vehicle positioning device according to any one of claims 1 to 6;a vehicle-mounted positioning device, configured to collect information of a position and/or a heading angle of a vehicle; anda master control device, configured to:in a case that two or more communication units have received signals from a plurality of signal transmitting devices, calculate, by the vehicle positioning device, the position and/or the heading angle of the vehicle; andin a case that any one of two or more communication units has not received a signal from any one of a plurality of signal transmitting devices, calculate the position and/or the heading angle of the vehicle based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device.
- The vehicle positioning system according to claim 7, whereinthe vehicle-mounted positioning device is further configured to capture a current scene image; andthe master control device is further configured to:determine whether a pixel gray value of the current scene image is within a predetermined range before the two or more communication units receive the signals from the plurality of signal transmitting devices;in a case that the pixel gray value of the current scene image is not within the predetermined range, control the two or more communication units to receive the signals from the plurality of signal transmitting units to calculate the position and/or the heading angle of the vehicle by using the vehicle positioning device; andin a case that the pixel gray value of the current scene image is within the predetermined range, calculate the position and/or the heading angle of the vehicle based on the information of the position and/or the heading angle of the vehicle collected by the vehicle-mounted positioning device.
- The vehicle positioning system according to claim 7, wherein the vehicle-mounted positioning device comprises at least one of a camera, a lidar, a millimeter wave radar, an ultrasonic radar, a vehicle speed sensor, a wheel angular velocity sensor and an inertial sensor.
- A vehicle positioning method, performed based on a plurality of signal transmitting units and two or more communication units, wherein the vehicle positioning method comprises:receiving, by the two or more communication units, signals from the plurality of signal transmitting units, wherein the two or more communication units are spaced apart;determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units; anddetermining a heading angle of the vehicle based on the coordinates of each of the communication units.
- The vehicle positioning method according to claim 10, wherein the determining, for each of the two or more communication units, coordinates of the communication unit based on time instants at which the communication unit receives the signals from the signal transmitting units and coordinates of the signal transmitting units comprises:
for each of the two or more communication units,determining distances between the communication unit and the signal transmitting units based on the time instants at which the communication unit receives the signals from the signal transmitting units; anddetermining the coordinates of the communication unit based on the coordinates of the signal transmitting units and the distances between the communication unit and the signal transmitting units. - The vehicle positioning method according to claim 10, performed based on a gyroscope, wherein the vehicle positioning method comprises:detecting, by the gyroscope, a heading angle of the vehicle as a first heading angle;calculating, based on a driving curve of the vehicle, a heading angle of the vehicle as a second heading angle; anddetermining a final heading angle of the vehicle using an autoregressive algorithm based on the first heading angle, the second heading angle, and the heading angle of the vehicle determined based on the coordinates of each of the communication devices.
- The vehicle positioning method according to claim 10, further comprising:
calculating coordinates of the vehicle to obtain a position of the vehicle based on coordinates of any one of the two or more communication units and a position at which the communication unit is arranged on the vehicle. - The vehicle positioning method according to claim 10, wherein the signals from the plurality of signal transmitting units cover at least one of a region around a turn, a region around a corner, a region around a transparent glass, and a region having feature points not sufficient for a vehicle-mounted positioning device to correctly position the vehicle.
- A vehicle, comprising the vehicle positioning device according to any one of claims 1 to 6 or the vehicle positioning system according to any one of claims 7 to 9.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910073979.8A CN110798792B (en) | 2019-01-25 | 2019-01-25 | Vehicle positioning device, vehicle positioning system and vehicle |
PCT/CN2020/073241 WO2020151663A1 (en) | 2019-01-25 | 2020-01-20 | Vehicle positioning apparatus, system and method, and vehicle |
Publications (3)
Publication Number | Publication Date |
---|---|
EP3913328A1 true EP3913328A1 (en) | 2021-11-24 |
EP3913328A4 EP3913328A4 (en) | 2022-03-16 |
EP3913328B1 EP3913328B1 (en) | 2023-12-20 |
Family
ID=69426807
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP20744572.7A Active EP3913328B1 (en) | 2019-01-25 | 2020-01-20 | Vehicle positioning system and method, and vehicle |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP3913328B1 (en) |
CN (1) | CN110798792B (en) |
WO (1) | WO2020151663A1 (en) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111572551B (en) * | 2020-05-19 | 2021-07-20 | 安徽江淮汽车集团股份有限公司 | Course angle calculation method, device, equipment and storage medium under parking condition |
CN111988737B (en) * | 2020-07-28 | 2022-08-09 | 中国铁道科学研究院集团有限公司电子计算技术研究所 | Railway operator absolute position determination method and device and electronic equipment |
CN112034858B (en) * | 2020-09-14 | 2022-04-29 | 哈尔滨工程大学 | Model-free adaptive heading control method fusing weak observation high-order output data |
CN112040446B (en) * | 2020-09-16 | 2023-08-22 | 上海振华重工(集团)股份有限公司 | Positioning method and positioning system |
CN113099529A (en) * | 2021-03-29 | 2021-07-09 | 千寻位置网络(浙江)有限公司 | Indoor vehicle navigation method, vehicle-mounted terminal, field terminal server and system |
CN113720343A (en) * | 2021-08-16 | 2021-11-30 | 中国科学院上海微系统与信息技术研究所 | Course prediction method based on dynamic data real-time adaptation |
CN114684198A (en) * | 2022-04-02 | 2022-07-01 | 合众新能源汽车有限公司 | Course angle determining method and device, controller and vehicle |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8594879B2 (en) * | 2003-03-20 | 2013-11-26 | Agjunction Llc | GNSS guidance and machine control |
KR100941271B1 (en) * | 2007-03-30 | 2010-02-11 | 현대자동차주식회사 | Prevention method of lane departure for vehicle |
CN104613982B (en) * | 2015-01-28 | 2017-09-22 | 齐鲁工业大学 | A kind of indoor integrated navigation simulation checking system |
KR102350199B1 (en) * | 2016-01-05 | 2022-01-14 | 삼성전자주식회사 | Method and apparatus for estimating position in terminal |
CN105953798B (en) * | 2016-04-19 | 2018-09-18 | 深圳市神州云海智能科技有限公司 | The pose of mobile robot determines method and apparatus |
CN108036784A (en) * | 2017-11-10 | 2018-05-15 | 云保(佛山)智控科技有限公司 | A kind of indoor orientation method, navigation methods and systems |
CN107976195B (en) * | 2017-11-30 | 2019-02-15 | 达闼科技(北京)有限公司 | Position Fixing Navigation System and method, storage medium, the robot of robot |
CN108613671A (en) * | 2018-04-25 | 2018-10-02 | 东南大学 | A kind of intelligent grass-removing positioning device and method based on UWB positioning and flight path positioning |
CN109000660A (en) * | 2018-06-26 | 2018-12-14 | 苏州路特工智能科技有限公司 | Full-automatic road roller construction paths planning method based on ultra wide band positioning |
CN109115211B (en) * | 2018-08-01 | 2021-01-05 | 南京科远智慧科技集团股份有限公司 | High-precision personnel positioning method and positioning system for factory |
CN109143305A (en) * | 2018-09-30 | 2019-01-04 | 百度在线网络技术(北京)有限公司 | Automobile navigation method and device |
-
2019
- 2019-01-25 CN CN201910073979.8A patent/CN110798792B/en active Active
-
2020
- 2020-01-20 EP EP20744572.7A patent/EP3913328B1/en active Active
- 2020-01-20 WO PCT/CN2020/073241 patent/WO2020151663A1/en unknown
Also Published As
Publication number | Publication date |
---|---|
EP3913328B1 (en) | 2023-12-20 |
CN110798792A (en) | 2020-02-14 |
WO2020151663A1 (en) | 2020-07-30 |
CN110798792B (en) | 2021-04-13 |
EP3913328A4 (en) | 2022-03-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3913328A1 (en) | Vehicle positioning apparatus, system and method, and vehicle | |
CN109920246B (en) | Collaborative local path planning method based on V2X communication and binocular vision | |
JP7160040B2 (en) | Signal processing device, signal processing method, program, moving object, and signal processing system | |
EP3540464B1 (en) | Ranging method based on laser radar system, device and readable storage medium | |
KR101755944B1 (en) | Autonomous driving method and system for determing position of car graft on gps, uwb and v2x | |
CN108303720B (en) | Vehicle positioning method and device and terminal equipment | |
WO2019108579A2 (en) | Radar aided visual inertial odometry initialization | |
AU2018282302A1 (en) | Integrated sensor calibration in natural scenes | |
US10514456B2 (en) | Radar aided visual inertial odometry outlier removal | |
GB2545098A (en) | Vehicle navigation system having location assistance from neighboring vehicles | |
US20190114911A1 (en) | Method and system for determining the location of a vehicle | |
Thomaidis et al. | Target tracking and fusion in vehicular networks | |
CN109781120B (en) | Vehicle combination positioning method based on synchronous positioning composition | |
CN110962744A (en) | Vehicle blind area detection method and vehicle blind area detection system | |
US11677931B2 (en) | Automated real-time calibration | |
CN110766761A (en) | Method, device, equipment and storage medium for camera calibration | |
EP4148385A1 (en) | Vehicle navigation positioning method and apparatus, and base station, system and readable storage medium | |
Zhang et al. | Review on UWB-based and multi-sensor fusion positioning algorithms in indoor environment | |
CN109029418A (en) | A method of vehicle is positioned in closed area | |
CN113758482B (en) | Vehicle navigation positioning method, device, base station, system and readable storage medium | |
CN112689241B (en) | Vehicle positioning calibration method and device | |
US20230251095A1 (en) | Vehicle positioning method and apparatus | |
KR20180011989A (en) | Vehicle and controlling method for the same | |
CN111753901B (en) | Data fusion method, device, system and computer equipment | |
CN114562997A (en) | Vehicle positioning system and closed area navigation system comprising same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20210818 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
A4 | Supplementary search report drawn up and despatched |
Effective date: 20220215 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G01C 21/20 20060101ALI20220209BHEP Ipc: G01C 21/16 20060101ALI20220209BHEP Ipc: G01C 21/00 20060101AFI20220209BHEP |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20221109 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G01S 5/14 20060101ALI20230530BHEP Ipc: G01S 5/02 20100101ALI20230530BHEP Ipc: G01S 5/00 20060101ALI20230530BHEP Ipc: G01C 21/28 20060101ALI20230530BHEP Ipc: G01C 21/20 20060101ALI20230530BHEP Ipc: G01C 21/16 20060101ALI20230530BHEP Ipc: G01C 21/00 20060101AFI20230530BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20230712 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230926 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602020023096 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240321 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231220 |