WO2024031655A1 - Digital car key positioning method, device and system - Google Patents

Digital car key positioning method, device and system Download PDF

Info

Publication number
WO2024031655A1
WO2024031655A1 PCT/CN2022/112172 CN2022112172W WO2024031655A1 WO 2024031655 A1 WO2024031655 A1 WO 2024031655A1 CN 2022112172 W CN2022112172 W CN 2022112172W WO 2024031655 A1 WO2024031655 A1 WO 2024031655A1
Authority
WO
WIPO (PCT)
Prior art keywords
car key
uwb
positioning
car
data
Prior art date
Application number
PCT/CN2022/112172
Other languages
French (fr)
Chinese (zh)
Inventor
吴代军
周才发
曾丹丹
李威
虞靖靓
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2022/112172 priority Critical patent/WO2024031655A1/en
Publication of WO2024031655A1 publication Critical patent/WO2024031655A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/029Location-based management or tracking services

Definitions

  • the embodiments of the present application relate to the field of positioning technology, and in particular, to a positioning method, device and system for a digital car key.
  • This application provides a digital car key positioning method, equipment and system, which can provide stable, consistent and accurate digital car key positioning, thereby providing more intelligent car control services.
  • a method for locating a digital car key includes: obtaining a first distance data set between a digital car key located in the car and multiple ultra-wideband (UWB) modules in the car,
  • the first distance data group includes ranging values between the digital car key and multiple UWB modules respectively; the positioning data with the highest matching degree with the first distance data group is determined from the positioning database, where the positioning data in the positioning database is used Characterizing the ranging values between multiple positions in the car and multiple UWB modules; determining the position of the digital car key in the car to be the position indicated by the position tag corresponding to the positioning data with the highest matching degree of the first distance data group.
  • the above-mentioned solution for determining the specific location of the digital car key located in the car may be called an "enhanced identification strategy" (also called an “enhanced identification algorithm”).
  • the above method can be applied to a digital car key locating device.
  • the above-mentioned digital car key may be a UWB car key.
  • the digital car key positioning device can determine the specific position of the digital car key in the car by comparing the ranging data with the positioning data in the positioning database, that is, the positioning data with the highest degree of matching with the ranging data. The location indicated by the corresponding location tag to achieve precise positioning of the digital car key in the car.
  • the positioning error of a digital car key can reach centimeter level. Based on this, the digital car key can be positioned at the seat granularity in the car, thereby providing intelligent control based on specific seats. For example, when it is recognized that the digital car key is located in the driver's seat area, the vehicle will start, play music, activate the central control screen and display the preset application interface on the central control screen, turn on the air conditioner, etc. according to the preset intelligent control mechanism. control. Or, when it recognizes that the digital car key is located in the passenger seat area, the vehicle will decide to play music, turn on the air conditioner, activate the passenger screen, and display the preset application interface on the passenger screen according to the preset intelligent control mechanism.
  • the above method also includes: respectively obtaining multiple second distance data groups between the digital car key and multiple UWB modules when the user carries the digital car key and is located at multiple locations in the car, and obtains samples. data; train the above sample data to obtain a positioning database, in which the positioning database includes multiple positioning data, one of which includes ranging values between a position in the car and multiple UWB modules; one positioning data and one Location tags are associated.
  • the positioning database includes multiple positioning data, one of which includes ranging values between a position in the car and multiple UWB modules; one positioning data and one Location tags are associated.
  • the above-mentioned determination of the positioning data with the highest matching degree with the first distance data group from the positioning database includes: respectively calculating the similarity between the first distance data group and the plurality of positioning data. It is related to the spatial distance between multiple ranging values in the first distance data group and the corresponding ranging values in the positioning data; it is determined that the positioning data with the highest similarity to the first distance data group is the matching degree with the first distance data group. Highest positioning data. As an example, the similarity between the first distance data set and the positioning data may be negatively correlated with the spatial distance between the first distance data set and the positioning data.
  • the above method further includes: if it is determined that the position of the digital car key in the car is the first position, performing a first preset operation; if it is determined that the position of the digital car key in the car is the second position , perform the second preset operation.
  • a first preset operation is performed; when it is recognized that the digital car key is located at the second position, a second preset operation is performed.
  • the first position is the main driving position
  • the first preset operation includes one or more of the following: starting the vehicle, playing music, starting the central control screen and displaying it on the central control screen Default application interface and turn on the air conditioner.
  • the first preset operations such as starting the vehicle, playing music, starting the central control screen and displaying the preset application interface on the central control screen, and turning on the air conditioner are performed.
  • the positioning data in the above-mentioned positioning database that has the highest matching degree with the first distance data group is associated with the main driving position.
  • the above-mentioned second position is the passenger seat or the rear seat
  • the above-mentioned first preset operation includes one or more of the following: playing music, activating the display screen at the second position, and Display the preset application interface on the corresponding display screen and turn on the air conditioner.
  • intelligent control based on specific seats can be provided. For example, when it is recognized that the digital car key is located in the passenger seat or the rear seat, second preset operations such as playing music, starting and displaying a preset application interface on the corresponding display screen, and turning on the air conditioner are performed.
  • the positioning data in the above-mentioned positioning database that has the highest matching degree with the first distance data group is associated with the passenger seat.
  • the above method also includes: tracking the digital car key when the digital car key is outside the car; and when it is recognized that the digital car key enters the car from outside the car, switching to the position inside the car. Identification strategy to identify the location of the digital car key within the vehicle. By tracking the motion trajectory of the digital car key outside the car, when it is recognized that the digital car key enters the car from outside the car, the strategy for positioning the digital car key can be switched to an enhanced recognition strategy to achieve digital car key positioning. The precise positioning of the key in the car.
  • trajectory tracking of the digital car key can also facilitate the precise positioning of the digital car key outside the car, and then when the relative position of the digital car key and the vehicle meets the preset conditions , providing intelligent functions such as welcoming guests, unlocking doors, unlocking the trunk, locking the trunk, locking doors, and turning off lights.
  • the above-mentioned trajectory tracking of the digital car key includes: when the user carries the digital car key and is outside the car, continuously obtaining the third position of the digital car key relative to multiple UWB modules. Three distance data groups, as well as the motion data of the digital car key; establishing constraints based on the third distance data group and the motion data to obtain the preliminary motion trajectory of the digital car key; adjusting multiple elements of the preliminary motion trajectory according to the data characteristics of the third distance data group The weight of the constraint conditions; optimize the preliminary motion trajectory according to the weights of multiple constraints in the preliminary motion trajectory to obtain the motion trajectory of the digital car key.
  • the motion data of the digital car key can be used to make up for the lack of ranging data when it is in the non-line of sight (NLOS) area.
  • NLOS non-line of sight
  • the positioning strategy that integrates motion data and ranging data can also obtain more accurate positioning results than based on a single category of data. Therefore, regardless of whether the digital car key is located in the NLOS area or the LOS area outside the car, the fusion pose strategy can provide stable, consistent, and accurate digital car key positioning capabilities in the outdoor scene.
  • the plurality of UWB modules include a first UWB module and a second UWB module, and the distance measurement value between the digital car key and the first UWB module is smaller than that between the digital car key and the second UWB module.
  • ranging values after adjusting multiple constraints, the weight of the constraint corresponding to the digital car key and the first UWB module is greater than the weight of the constraint corresponding to the digital car key and the second UWB module.
  • a vehicle control method is provided, which method is applied to a vehicle control device.
  • the method includes: obtaining the position of a digital car key located in the car; and performing corresponding actions on the vehicle according to the position of the digital car key in the car. Control of the vehicle, where the digital car key has different control authority over the vehicle depending on its location in the car.
  • the method provided in the second aspect above can realize corresponding intelligent control when the digital car key is in different positions by positioning the digital car key in the car.
  • the positioning error of a digital car key can reach centimeter level. Based on this, the digital car key can be positioned at the seat granularity in the car, thereby providing intelligent control based on specific seats. For example, when it is recognized that the digital car key is located in the driver's seat area, the vehicle will start, play music, activate the central control screen and display the preset application interface on the central control screen, turn on the air conditioner, etc. according to the preset intelligent control mechanism. control. Or, when it recognizes that the digital car key is located in the passenger seat area, the vehicle will decide to play music, turn on the air conditioner, activate the passenger screen, and display the preset application interface on the passenger screen according to the preset intelligent control mechanism.
  • the position of the digital car key in the car is the main driving position.
  • the above-mentioned execution of corresponding intelligent control of the vehicle based on the specific position of the digital car key in the car includes: performing one or more of the following Types: start the vehicle, play music, start the central control screen and display the preset application interface on the central control screen, and turn on the air conditioner.
  • intelligent control based on specific seats can be provided. For example, when it is recognized that the digital car key is in the main driving position, preset operations such as starting the vehicle, playing music, starting the central control screen and displaying the preset application interface on the central control screen, and turning on the air conditioner are performed.
  • the above determination of the position of the digital car key in the car includes: obtaining a first distance data set between the digital car key and multiple UWB modules in the car, where the first distance The data set includes the ranging values between the digital car key and the UWB module respectively; the positioning data with the highest matching degree with the first distance data set is determined from the positioning database; the positioning data in the positioning database is used to characterize multiple locations in the car. ranging values between a position and multiple UWB modules; determining the position of the digital car key in the car to be the position indicated by the position tag corresponding to the positioning data with the highest matching degree of the first distance data group.
  • the specific position of the digital car key in the car is determined, that is, the position indicated by the position tag corresponding to the positioning data with the highest matching degree of the ranging data, in order to realize the digital car key Precise positioning in the car, thereby achieving corresponding intelligent control when the digital car key is in different positions.
  • a vehicle-mounted system in a third aspect, includes a digital car key positioning device.
  • the digital car key positioning device includes: a storage unit for storing a positioning database, wherein the positioning database includes multiple positioning data.
  • the data is used to represent the ranging values between multiple locations in the car and multiple UWB modules in the car; the first data collection unit is used to collect the first distance between the digital car key located in the car and the multiple UWB modules.
  • a data group wherein the first distance data group includes distance measurement values between the digital car key and multiple UWB modules respectively; a processing unit is used to determine the positioning data with the highest matching degree to the first distance data group from the positioning database, and then Determine the position of the digital car key in the car; wherein the position of the digital car key in the car is the position indicated by the position tag corresponding to the positioning data with the highest matching degree of the first distance data group.
  • the digital car key positioning device can determine the specific position of the digital car key in the car by comparing the ranging data with the positioning data in the positioning database, that is, the positioning data with the highest degree of matching with the ranging data. The location indicated by the corresponding location tag to achieve precise positioning of the digital car key in the car.
  • the above-mentioned first data collection unit is also used to: respectively obtain a plurality of third data between the digital car key and the plurality of UWB modules when the user carries the digital car key and is located at multiple locations in the car.
  • Two distance data sets are used to obtain sample data;
  • the above-mentioned digital car key positioning device also includes: a model training unit for training the sample data to obtain a positioning database, where the positioning database includes multiple positioning data, and one positioning data includes information in the car A location is associated with the ranging values between multiple UWB modules; a positioning data is associated with a location tag.
  • a positioning database including a large amount of positioning data is obtained, and then the stability, consistency and accuracy of the specific position of the digital car key in the car can be determined by comparing the ranging data with the positioning data in the positioning database. .
  • the above-mentioned processing unit determines the positioning data with the highest matching degree with the first distance data group from the positioning database, including: the processing unit calculates the distance between the first distance data group and the plurality of positioning data respectively. similarity, and determining that the positioning data with the highest similarity to the first distance data group is the positioning data with the highest matching degree to the first distance data group.
  • the similarity between the first distance data set and the positioning data may be negatively correlated with the spatial distance between the first distance data set and the positioning data. For example, the smaller the spatial distance between the first distance data group and the positioning data, the greater the similarity between the first distance data group and the positioning data; the smaller the spatial distance between the first distance data group and the positioning data.
  • the similarity between the first distance data group and the positioning data is smaller. Based on this, by calculating the spatial distance between the multiple ranging values in the first distance data group and the corresponding ranging values in the positioning data, the similarity between the first distance data group and the multiple positioning data can be determined, and then Determine the positioning data that best matches the ranging data of the digital car key in the car.
  • the above-mentioned vehicle system further includes: a vehicle control device; the vehicle control device is configured to: when the digital car key positioning device determines that the position of the digital car key in the car is the first position, execute the first preset Assume the operation; when the digital car key positioning device determines that the position of the digital car key in the car is the second position, the second preset operation is performed.
  • a vehicle control device is configured to: when the digital car key positioning device determines that the position of the digital car key in the car is the first position, execute the first preset Assume the operation; when the digital car key positioning device determines that the position of the digital car key in the car is the second position, the second preset operation is performed.
  • the first position is the main driving position
  • the first preset operation includes one or more of the following: starting the vehicle, playing music, starting the central control screen and displaying it on the central control screen Default application interface and turn on the air conditioner.
  • the first preset operations such as starting the vehicle, playing music, starting the central control screen and displaying the preset application interface on the central control screen, and turning on the air conditioner are performed.
  • the positioning data in the above-mentioned positioning database that has the highest matching degree with the first distance data group is associated with the main driving position.
  • the above-mentioned second position is the passenger seat or the rear seat
  • the above-mentioned first preset operation includes one or more of the following: playing music, activating the display screen at the second position, and Display the preset application interface on the corresponding display screen and turn on the air conditioner.
  • intelligent control based on specific seats can be provided. For example, when it is recognized that the digital car key is located in the passenger seat or the rear seat, second preset operations such as playing music, starting and displaying a preset application interface on the corresponding display screen, and turning on the air conditioner are performed.
  • the positioning data in the above-mentioned positioning database that has the highest matching degree with the first distance data group is associated with the passenger seat.
  • the above-mentioned digital car key positioning device is also used to: track the digital car key when the digital car key is located outside the car; and, when it is recognized that the digital car key enters from outside the car.
  • the strategy for positioning the digital car key can be switched to an enhanced recognition strategy to achieve digital car key positioning. The precise positioning of the key in the car.
  • trajectory tracking of the digital car key can also facilitate the precise positioning of the digital car key outside the car, and then when the relative position of the digital car key and the vehicle meets the preset conditions , providing intelligent functions such as welcoming guests, unlocking doors, unlocking the trunk, locking the trunk, locking doors, and turning off lights.
  • the above-mentioned first data acquisition unit is also used to: when the user carries the digital car key and is outside the car, continuously obtain the third distance data group of the digital car key relative to the multiple UWB modules; the above-mentioned number
  • the car key positioning device also includes: a second data collection unit, used to obtain the movement data of the digital car key when the user carries the digital car key outside the car; the above-mentioned digital car key positioning device tracks the digital car key, including: The processing unit establishes constraints based on the third distance data group and the motion data to obtain the preliminary motion trajectory of the digital car key; adjusts the weights of multiple constraints on the preliminary motion trajectory according to the data characteristics of the third distance data group; and, based on the preliminary The weights of multiple positions in the motion trajectory optimize the preliminary motion trajectory to obtain the motion trajectory of the digital car key.
  • the motion data of the digital car key can be used to make up for the shortcomings of the missing ranging data when it is in the NLOS area, and the ranging data can be used to make up for the shortcomings of the digital car key based solely on the NLOS area.
  • the movement data of the digital car key cannot determine the relative positional relationship between the digital car key and the vehicle.
  • the positioning strategy that integrates motion data and ranging data can also obtain more accurate positioning results than based on a single category of data. Therefore, regardless of whether the digital car key is located in the NLOS area or the LOS area outside the car, the fusion pose strategy can provide stable, consistent, and accurate digital car key positioning capabilities in the outdoor scene.
  • a computer-readable storage medium is provided.
  • Computer-readable instructions are stored on the computer-readable storage medium.
  • any one of the possibilities of the first aspect or the second aspect can be realized. method in the implementation.
  • a chip system in a fifth aspect, includes a processor and a memory, and instructions are stored in the memory; when the instructions are executed by the processor, any of the possible methods of the first aspect or the second aspect are implemented. Methods in the implementation.
  • the chip system can be composed of chips or include chips and other discrete devices.
  • a computer program product which includes computer-readable instructions.
  • the computer-readable instructions When the computer-readable instructions are run on a computer, the method in any possible implementation manner of the first aspect or the second aspect is implemented.
  • Figure 1 is a schematic diagram of a car control service area in an off-car scene provided by an embodiment of the present application
  • Figure 2 is a schematic diagram of the car control service area in two in-car scenarios provided by the embodiment of the present application;
  • Figure 3 is a schematic diagram of the hardware structure of an intelligent device provided by an embodiment of the present application.
  • Figure 4 is a schematic structural diagram of a digital car key positioning system provided by an embodiment of the present application.
  • FIG. 5 is a schematic diagram of an ultra-wideband (UWB) car key positioning logic process provided by an embodiment of the present application
  • Figure 6 is a schematic diagram of ranging data of a UWB car key in an off-car scenario provided by an embodiment of the present application
  • Figure 7 is a schematic diagram of ranging data of a UWB car key in an in-car scenario provided by an embodiment of the present application.
  • Figure 8 is a schematic diagram of an example of a three-dimensional coordinate system provided by an embodiment of the present application.
  • Figure 9 is a schematic diagram of location tag distribution corresponding to positioning data provided by an embodiment of the present application.
  • Figure 10 is a schematic diagram of the movement of a UWB car key provided by an embodiment of the present application.
  • Figure 11 is a flow chart of a UWB car key positioning method provided by an embodiment of the present application.
  • Figure 12 is a schematic diagram of the calculation process of a fusion pose strategy provided by an embodiment of the present application.
  • Figure 13 is a schematic diagram of the calculation process of another fusion pose strategy provided by an embodiment of the present application.
  • Figure 14 is a schematic diagram of an exterior scene provided by an embodiment of the present application.
  • Figure 15 is a schematic diagram of inertial navigation constraints and UWB ranging constraints in an off-vehicle scenario provided by the embodiment of the present application;
  • Figure 16 is a schematic diagram of the preliminary movement trajectory provided by the embodiment of the present application and the movement trajectory of the UWB car key outside the vehicle determined based on the preliminary movement trajectory and different weight constraints;
  • Figure 17 is a schematic diagram of the movement trajectory of a UWB car key in an exterior scene provided by an embodiment of the present application.
  • Figure 18 is a box diagram of the ranging value distribution when the UWB car key is located on different seats according to the embodiment of the present application.
  • first and second are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of indicated technical features. Therefore, features defined as “first” and “second” may explicitly or implicitly include one or more of these features. In the description of this embodiment, unless otherwise specified, “plurality” means two or more.
  • Embodiments of the present application provide a method for positioning a digital car key.
  • This method can be used to accurately position a digital car key, including positioning the digital car key in an exterior scene and accurately positioning a digital car key in an interior scene.
  • various intelligent car control services can be realized in the outdoor scene and the indoor scene. Among them, the location of the digital car key outside/in the car is different, and the control authority over the vehicle is different.
  • an embodiment of the present application provides a positioning method for a digital car key, which can provide continuous tracking of the movement trajectory of the digital car key outside the car, so as to accurately position the digital car key. , and then when the relative position of the digital car key and the vehicle meets the preset conditions, it will provide intelligent functions such as welcoming guests, unlocking the door, unlocking the trunk, locking the trunk, locking the door, turning off the lights, etc. For example, when the relative position of the digital car key and the vehicle meets preset conditions, the vehicle can provide corresponding intelligent control through the vehicle control device.
  • FIG. 1 shows a schematic diagram of a car control service area in an off-car scene provided by an embodiment of the present application.
  • area 1 shown in Figure 1 is the locked door area
  • area 2 is the welcome area
  • area 3 is the unlocked door area
  • area 4 is the unlocked trunk area.
  • the positioning method of the digital car key provided by the embodiment of the present application can be used to determine whether the digital car key is outside the car.
  • the movement trajectory is continuously tracked.
  • the vehicle will enter welcome-related controls according to the preset intelligent control mechanism, such as turning on the welcome lights, turning on the air conditioner, opening the sunroof, etc.
  • the vehicle determines preset controls such as unlocking the door and adjusting the seat according to the preset intelligent control mechanism.
  • the vehicle decides to unlock the trunk according to the preset intelligent control mechanism.
  • the location of the digital car key outside the car can be determined based on a positioning method of the digital car key provided by the embodiment of the present application. Movement trajectories are continuously tracked. Among them, when it is recognized that the digital car key enters area 3 from the car, the vehicle will make preset controls such as turning off the engine according to the preset intelligent control mechanism. Further optionally, when it is recognized that the digital car key enters area 2 from area 3, the vehicle determines preset controls such as turning off the lights, turning off the air conditioner, and closing the sunroof according to the preset intelligent control mechanism.
  • the vehicle decides to lock the door and other preset controls according to the preset intelligent control mechanism.
  • the vehicle decides to lock the trunk according to the preset intelligent control mechanism.
  • the locked door area, welcome area, unlocked door area and unlocked trunk area shown in Figure 1 are only examples.
  • the embodiments of this application It is not limited to scenes outside the vehicle.
  • the intelligent control mechanism settings of the vehicle and the division of the exterior areas corresponding to the intelligent control mechanism depend on the specific functions and specific settings of the vehicle.
  • an embodiment of the present application provides a positioning method for a digital car key, which can provide precise positioning of the digital car key in the car.
  • the positioning error of a digital car key can reach centimeter level.
  • the digital car key can be positioned at the seat granularity in the car, thereby providing intelligent control based on specific seats.
  • the vehicle can provide seat-specific intelligent control through the vehicle control device.
  • FIG. 2 shows a schematic diagram of the car control service area in two in-car scenarios provided by embodiments of the present application.
  • Figure 2 shows a service area division method for the main driver's seat area, the passenger seat area and the rear seat area in a car scene
  • Figure 2 shows a way of dividing the service area in the car scene.
  • the vehicle can be controlled according to the preset intelligent control mechanism by locating the area where the digital car key is located.
  • the vehicle when it is recognized that the digital car key is located in the driver's seat area, the vehicle will start, play music, activate the central control screen and display the preset application interface on the central control screen, turn on the air conditioner, etc. according to the preset intelligent control mechanism. control. Or, when it recognizes that the digital car key is located in the passenger seat area, the vehicle will decide to play music, turn on the air conditioner, activate the passenger screen, and display the preset application interface on the passenger screen according to the preset intelligent control mechanism.
  • the main driver's seat area, the passenger's seat area, the rear seat area, the left rear seat area and the right rear seat area shown in Figure 2, as well as the examples of intelligent control performed in the corresponding areas described in the above embodiments are only As an example, the embodiments of this application are not limited to in-car scenarios.
  • the settings of the vehicle's intelligent control mechanism and the division of in-vehicle location areas corresponding to the intelligent control mechanism depend on the specific functions and specific settings of the vehicle.
  • the carrier of the digital car key may be a smart device (such as a smart phone, tablet computer, smart speaker, remote control, etc.).
  • a digital car key can be installed in the smart device carried by the user in the form of software to realize the digital version of the car key-related functions.
  • digital car keys can not only realize keyless entry and start, remote key authorization, personalized vehicle settings and other functions, but can also realize locking, unlocking, starting, opening and closing of windows and air conditioning, and sharing through smart devices Vehicle, vehicle status checking (such as checking whether it is locked, checking the vehicle location, etc.) and other functions.
  • the carrier of the digital car key may be a physical key.
  • the physical key not only has the vehicle unlocking and locking functions of a traditional car key, but also has keyless entry and starting of the digital car key, remote key authorization, personalized vehicle settings, starting, opening and closing of windows and air conditioning.
  • the smart device may include but is not limited to a mobile phone (such as a folding screen mobile phone, including an inward-folding folding screen mobile phone and an outward-folding folding screen mobile phone).
  • a mobile phone such as a folding screen mobile phone, including an inward-folding folding screen mobile phone and an outward-folding folding screen mobile phone.
  • netbooks tablets, wearable devices (such as smart watches, smart bracelets, smart glasses, etc.), cameras (such as SLR cameras, card cameras, etc.), PCs (including desktop computers or laptops), PDAs, personal digital cameras Assistant (personal digital assistant, PDA), portable multimedia player (PMP), projection equipment, smart screen equipment, augmented reality (AR)/virtual reality (VR) equipment, mixed reality ( mixed reality (MR) equipment or somatosensory game consoles in human-computer interaction scenarios, etc.
  • PDA personal digital cameras Assistant
  • PMP portable multimedia player
  • projection equipment smart screen equipment
  • AR augmented reality
  • VR virtual reality
  • MR mixed reality
  • somatosensory game consoles in human-computer interaction scenarios, etc.
  • This application does not limit the specific functions and structures of smart devices.
  • FIG. 3 shows a schematic diagram of the hardware structure of an intelligent device provided by an embodiment of the present application.
  • the smart device may include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a charging management module 340, a power management module 341, and a battery 342.
  • Antenna 1 antenna 2, mobile communication module 350, wireless communication module 360, audio module 370, speaker 370A, receiver 370B, microphone 370C, headphone interface 370D, sensor module 380, button 390, motor 391, indicator 392, camera 393, Display 394 etc.
  • the sensor module 380 may include a pressure sensor 380A, a gyro sensor 380B, an air pressure sensor 380C, a magnetic sensor 380D, an acceleration sensor 380E (or an accelerometer), a distance sensor 380F, a proximity light sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor.
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the smart device.
  • the smart device may include more or less components than shown in the figures, or combine some components, or split some components, or arrange different components.
  • the components illustrated may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 310 may include one or more processing units.
  • the processor 310 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor ( image signal processor (ISP), audio processor/digital processor (the audio processor), controller, memory, video codec, audio codec, digital signal processor (digital signal processor, DSP), baseband processor processor, and/or neural network processing unit (NPU), etc.
  • application processor application processor
  • AP graphics processor
  • ISP image signal processor
  • audio processor/digital processor the audio processor
  • controller memory
  • video codec audio codec
  • digital signal processor digital signal processor
  • NPU neural network processing unit
  • different processing units can be independent devices or integrated in one or more processors.
  • the controller can be the nerve center and command center of the smart device.
  • the controller can generate operation control signals based on the operation codes and timing signals of the user's operation instructions to complete the control of fetching and executing instructions.
  • the processor 310 may also be provided with a memory for storing instructions and data.
  • the memory in processor 310 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 310 . If processor 310 needs to use the instructions or data again, it can be called directly from the memory. Repeated accesses are avoided and waiting events of the processor 310 are reduced, thus improving the efficiency of the system.
  • processor 310 may include one or more interfaces. Interfaces may include integrated circuit (inter-intergrated circuit, I2C) interface, integrated circuit built-in audio (inter-intergrated circuit sound, I2S) interface, pulse code modulation (pluse code modulation, PCM) interface, universal asynchronous receiver and transmitter (universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO), user identification module interface, and/or universal serial bus interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • UART universal asynchronous receiver and transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • user identification module interface and/or universal serial bus interface, etc.
  • the power management module 341 is used to power the processor 310, internal memory 321, display screen 394, camera 393, wireless communication module 360, etc.
  • the wireless communication function of the smart device can be implemented through antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, modem processor and baseband processor, etc.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in a smart device can be used to cover a single or multiple communication bands. Different antennas can also be reused to improve antenna utilization.
  • the mobile communication module 350 can provide wireless communication solutions including 2G/3G/4G/5G applied to smart devices.
  • a modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal.
  • the wireless communication module 360 can provide applications on smart devices including wireless local area networks (WLAN) (such as wireless fidelity (wireless fidelity, WI-FI) network), Bluetooth (bluetooth, BT), Beidou satellite navigation system (BeiDou navigation satellite system, BDS), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) , ultra-wideband (UWB) and other wireless communication solutions.
  • WLAN wireless local area networks
  • WLAN such as wireless fidelity (wireless fidelity, WI-FI) network
  • Bluetooth bluetooth, BT
  • Beidou satellite navigation system Beidou satellite navigation system (BeiDou navigation satellite system, BDS)
  • global navigation satellite system global navigation satellite system
  • FM frequency modulation
  • NFC near field communication technology
  • IR infrared technology
  • UWB ultra-wideband
  • the smart device serves as a digital car key and supports UWB communication technology. Therefore, the digital car key in the embodiment of the present application is also called a UWB car key.
  • UWB communication technology is a carrier-less communication technology. Due to the advantages of UWB, such as long coverage distance, strong penetration ability, and strong resistance to multipath attenuation, the solution provided by the embodiment of the present application can use UWB to achieve high-precision measurement. distance.
  • a UWB chip can be integrated into the smart device, and the smart device can support UWB communication technology through the UWB chip.
  • GPU graphics processing unit
  • the GPU is an image processing microprocessor and is connected to the display screen 394 and the application processor. GPUs are used to perform data and geometric calculations for graphics rendering.
  • Processor 310 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the display screen 394 is used to display images, videos, etc.
  • Display 394 includes a display panel.
  • the display panel can use liquid crystal display (LCD), organic light-emitting diode (OLED), active-matrix organic light-emitting diode (AMOLED), flexible light-emitting diode Diode (flex light-emitting diode, FLED), quantum dot light emitting diode (quantum dot light emitting diode, QLED), etc.
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • AMOLED active-matrix organic light-emitting diode
  • FLED flexible light-emitting diode Diode
  • quantum dot light emitting diode quantum dot light emitting diode
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when a smart device selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
  • Video codecs are used to compress or decompress digital video.
  • Smart devices can support one or more video codecs. In this way, smart devices can play or record videos in multiple encoding formats, such as moving picture experts group (MPEG)1, MPEG2, MPEG3, MPEG4, etc.
  • MPEG moving picture experts group
  • NPU is a neural network (NN) computing processor.
  • NN neural network
  • the external memory interface 320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the smart device.
  • the external memory card communicates with the processor 310 through the external memory interface 320 to implement the data storage function. For example, save audio, video, pictures and other files in an external memory card.
  • Internal memory 321 may be used to store executable program code for computer programs.
  • computer programs may include operating system programs and application programs.
  • the executable program code includes instructions.
  • the processor 310 executes instructions stored in the internal memory 321 to execute various functional applications and data processing of the smart device.
  • the internal memory 321 may include a program storage area and a storage data area.
  • the stored program area can store the operating system, at least one application program required for the function, etc.
  • the storage data area can store data created during the use of smart devices (such as task cards, etc.).
  • the internal memory 321 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, a flash memory device, universal flash storage (UFS), etc.
  • UFS universal flash storage
  • the smart device can implement audio functions through the audio module 370, speaker 370A, receiver 370B, microphone 370C, headphone interface 370D, and application processor. For example, audio playback, recording, etc.
  • Touch sensor 380K also called “touch panel”.
  • the touch sensor 380K can be disposed on the display screen 394.
  • the touch sensor 380K and the display screen 394 form a touch screen, which is also called a "touch screen”.
  • Touch sensor 380K is used to detect a touch operation on or near it.
  • the touch sensor can pass the detected touch operation (including information such as touch location, touch strength, contact area, and touch duration) to the processor to determine the touch event type.
  • Visual output related to the touch operation may be provided through display screen 394.
  • the touch sensor 380K may also be disposed on the surface of the smart device at a different location from the display screen 394 .
  • the gyro sensor 380B may be used to determine the posture of the smart device during movement.
  • the rate of rotation (ie, angular velocity) of the smart device about three axes (ie, x, y, and z axes) may be determined by gyro sensor 380B.
  • Magnetic sensor 380D includes a Hall sensor.
  • physical parameters such as current, position, and direction can be measured by sensing magnetic field strength through smart devices.
  • the acceleration sensor 380E can detect the acceleration of the smart device in all directions (generally three axes). When the smart device is stationary, it can detect the magnitude and direction of gravity, and can also be used to identify the posture of the smart device.
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the smart device.
  • the smart device may include more or less components than shown in the figures, or combine some components, or split some components, or arrange different components.
  • the components illustrated may be implemented in hardware, software, or a combination of software and hardware.
  • vehicle does not specifically refer to a certain type of vehicle.
  • the vehicle may be a ground-based vehicle, such as a car, a bus, a subway, a high-speed rail, etc.
  • the vehicle may also be a water-based vehicle, such as a boat, hovercraft, submarine, etc.
  • the vehicle may also be an air vehicle, such as an airplane, a helicopter, etc.
  • the vehicle described in the embodiment of the present application is equipped with a vehicle-mounted system, and the vehicle-mounted system may include a digital car key positioning system.
  • the vehicle-mounted system may include a digital car key positioning system.
  • FIG. 4 shows a schematic structural diagram of a digital car key positioning system provided by an embodiment of the present application.
  • the digital car key positioning system 400 may include multiple ultra-wideband (UWB) modules 401 , a digital car key positioning device 402 and a motion data acquisition module 403 .
  • UWB ultra-wideband
  • the UWB module 401 has the function of receiving and transmitting UWB signals (such as 6.5GHz frequency band UWB signals).
  • the UWB module 401 can communicate with the digital car key based on UWB technology.
  • a UWB car key can send and receive UWB signals to each other through the UWB chip and the UWB module 401.
  • the carrier of the UWB car key is a smart device (such as a smartphone, a smart bracelet), and the UWB chip is integrated in the smart device.
  • the smart device can send and receive UWB signals to each other through the UWB chip integrated therein and the UWB module 401 deployed on the vehicle.
  • the carrier of the UWB car key is a physical key, and the UWB chip is integrated into the physical key.
  • the UWB car key can send and receive UWB signals to each other through the UWB chip integrated in the physical key and the UWB module 401 deployed on the vehicle.
  • the motion data acquisition module 403 is used to acquire motion data of the smart device carried by the user.
  • the movement data of the smart device is also called pedestrian dead reckoning (pedestrian dead reckoning, PDR) data.
  • the motion data of the smart device can be understood as the motion data of the UWB car key.
  • the motion data of the smart device can be understood as the motion data of the physical key, that is, the motion data of the UWB car key.
  • the motion data of the UWB car key is used to represent the coordinate offset and angle change of the UWB car key.
  • the digital car key positioning device 402 can, when the UWB car key is outside the car, use the motion data of the smart device carried by the user and the ranging data of the UWB car key (also called the “ranging value")
  • the fused algorithm (hereinafter referred to as “fusion pose strategy” (also called “fusion pose algorithm”)) continuously tracks the movement trajectory of the UWB car key.
  • fusion pose strategy also called “fusion pose algorithm”
  • the in-car location recognition strategy hereinafter referred to as the "enhanced recognition strategy” (also known as the “enhanced recognition algorithm”)
  • searches for similar ranging data from the positioning database searches for similar ranging data from the positioning database.
  • the highest accuracy positioning data can determine the specific location of the UWB car key in the car with a very small error.
  • the position of the UWB car key in the car is the position corresponding to the positioning data with the highest similarity to the ranging data in the positioning database.
  • the ranging data of the UWB car key is the distance between the UWB module 401 and the UWB car key calculated by the digital car key positioning device 402 based on the communication between the UWB module 401 and the UWB chip based on UWB technology.
  • the scene outside the vehicle described in the embodiment of the present application refers to the scene in which the UWB car key is located in an area beyond the preset distance (such as 20 cm) outside the outer contour of the vehicle; correspondingly, the scene in the car refers to the scene in which the UWB car key is located in the area outside the outer contour of the vehicle.
  • the outside of the vehicle refers to the area beyond the preset distance (such as 20 cm) from the outer contour of the vehicle; the inside of the vehicle refers to the area within the preset distance (such as 20 cm) from the outer contour of the vehicle.
  • the position of the UWB car key outside the car or the position of the UWB car key inside the car determined by the digital car key positioning device may be the position relative to a preset coordinate system (such as an inertial reference coordinate system) .
  • the inertial reference coordinate system may have its origin located on the vehicle (such as the center position of the vehicle, the left position of the vehicle front, the right position of the vehicle front, etc., which are not limited in this embodiment), and the x-axis points in the transverse direction of the vehicle.
  • the y-axis points to the longitudinal direction of the vehicle.
  • the embodiment of this application does not limit it.
  • FIG. 5 shows a schematic diagram of a UWB car key positioning logic process provided by an embodiment of the present application.
  • the digital car key positioning device can use the fusion pose strategy to track the movement trajectory of the UWB car key outside the car and identify the UWB car key inside and outside the car.
  • the fusion pose strategy is continued to be used to track the movement trajectory of the UWB car key outside the car and identify the UWB car key inside and outside the car.
  • an enhanced recognition strategy is used to locate the UWB car key in the car.
  • the digital car key positioning device also continues to identify the UWB car key inside and outside the car while the UWB car key is located in the car.
  • the UWB car key moves from inside the car to outside the car, it switches to the fusion pose strategy to track the movement trajectory of the UWB car key outside the car.
  • the UWB module can be a network node such as a UWB base station.
  • the number of UWB modules deployed on a vehicle is at least 3.
  • the number of UWB modules deployed on the vehicle may be 5-6.
  • the multiple UWB modules in order to ensure that the UWB signal is not blocked, can be installed in a location on the vehicle with relatively little metal and an open radiation surface.
  • the plurality of UWB modules may be disposed at the front, rear, roof, etc. of the vehicle.
  • the embodiments of this application do not limit the specific placement locations of the multiple UWB modules.
  • Figures 6 and 7 show a schematic distribution diagram of the UWB module on the vehicle ( Figures 6 and 7 take the UWB base station as an example).
  • UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 are respectively located on the left side of the front of the car, the right side of the front of the car, and the front side of the roof. The position on the left side of the rear of the car, the right position of the rear of the car, and the position on the rear side of the roof.
  • the digital car key positioning device 402 can be used to communicate with UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, respectively through the UWB chip according to the UWB car key located outside the car.
  • Communication between UWB base station 5 and UWB base station 6, calculate the distances L1, L2, L3, L4 between the UWB car key and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 respectively. , L5 and L6.
  • the digital car key positioning device 402 can be used to communicate with UWB base station 1, UWB base station 2, UWB base station 3, and UWB base station respectively through the UWB chip according to the UWB car key located in the car. 4. Communication between UWB base station 5 and UWB base station 6, calculate the distances L1, L2, and L3 between the UWB car key and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5, and UWB base station 6 respectively. , L4, L5 and L6, and then calculate the specific position of the UWB car key based on L1, L2, L3, L4, L5 and L6 to achieve precise positioning of the UWB car key in the car.
  • the digital car key positioning device 402 in the embodiment of the present application calculates the distance (i.e., ranging value) between the UWB module 401 and the UWB car key based on UWB communication, it can use time of flight (TOF). ) algorithm (also called the time difference method) determines the distance between the UWB module 401 and the UWB car key based on the time it takes for the UWB signal to be transmitted.
  • the digital car key positioning device 402 can also determine the angle between the UWB car key and the multi-antenna array by setting up a multi-antenna array, and determine the distance between the UWB module 401 and the UWB car key based on each angle.
  • the embodiments of this application do not specifically limit the specific method and process of calculating the distance between the UWB module 401 and the UWB car key.
  • the digital car key positioning device 402 in the embodiment of the present application locates the UWB car key according to the distance between the UWB module 401 and the UWB car key, it can be based on the time of arrival (TOA) method or the arrival time difference positioning. (time difference of arrival, TDOA) method and other methods, or based on any positioning module such as circular/spherical positioning model, hyperbola/surface positioning model or angle positioning model.
  • TOA time of arrival
  • TDOA time difference of arrival
  • any positioning module such as circular/spherical positioning model, hyperbola/surface positioning model or angle positioning model.
  • the embodiments of this application are not specifically limited.
  • the UWB module 401 and the digital car key positioning device 402 shown in Figure 4 can be used when positioning the UWB car key in both the exterior and interior scenes. Based on this, the cost of hardware deployment and maintenance can be reduced while simplifying the vehicle system.
  • the motion data acquisition module 403 can be based on an inertial measurement unit (IMU), a visual inertial odometer (VIO), an inertial navigation system (INS), and wheel speed in a smart device.
  • IMU inertial measurement unit
  • VIO visual inertial odometer
  • INS inertial navigation system
  • Ji et al. obtain the movement data of the smart device from the data collected during the movement of the smart device.
  • IMU is a sensor combination (such as a combination of acceleration sensor and gyroscope sensor).
  • the IMU can be used to obtain acceleration data such as motion acceleration and motion direction of the smart device (i.e., UWB car key), as well as gyroscope data such as rotation rate and rotation direction.
  • VIO is also called visual-inertial system (VINS).
  • VIO can integrate acceleration data and gyroscope data collected by cameras and IMUs to achieve instant positioning and map construction or concurrent mapping and positioning (simultaneous localization and mapping, SLAM).
  • Inertial navigation is a system that uses gyroscope sensors and acceleration sensors to determine the position of its carrier (i.e., smart device). Inertial navigation can determine the position of its carrier (that is, smart device) in the inertial reference coordinate system based on the acceleration data and gyroscope data of its carrier (that is, smart device) measured by the gyroscope sensor and acceleration sensor.
  • the origin of the inertial reference coordinate system can be the location of the armrest box of the vehicle.
  • the x-axis and y-axis are parallel to the ground and perpendicular to each other.
  • the positive direction of the x-axis is pointing from the origin to the starboard side of the vehicle, and the positive direction of the y-axis is from the origin. Point in the direction of the front of the car.
  • the embodiment of the present application does not limit the specific definition of the inertial reference coordinate system.
  • the working principle of the acceleration sensor is to determine the motion acceleration and motion direction of the smart device by measuring the force on the component in a certain axial direction.
  • the working principle of the gyro sensor is to determine the movement posture of the smart device in the three-dimensional space (i.e. the movement posture of the UWB car key) by measuring the rotation rate (i.e. angular velocity) between the vertical axis of the gyro rotor and the smart device in the three-dimensional coordinate system.
  • the data collected by the acceleration sensor and the gyroscope sensor can be represented by the three-axis angular velocity ⁇ x, ⁇ y, ⁇ z and the three-axis acceleration ax, ay, az.
  • the three-axis angular velocity can be understood as the angular velocity of the smart device around the three axes x, y, and z
  • the three-axis acceleration can be understood as the acceleration of the smart device on the three axes x, y, and z.
  • the movement of the smart device in the x, y, z three-dimensional coordinate system may include three translational movements and three rotational movements, where the three translational movements include the movement of the smart device on the x-axis.
  • the three rotational motions include the rotational motion of the smart device around the x-axis (the angle of rotation is also called the pitch angle), the rotational motion around the y-axis (the angle of rotation is also called the yaw angle Yaw), and the rotational motion around the z-axis (the angle of rotation is also called the yaw angle).
  • the angle is also called the roll angle (Roll).
  • the position and attitude changes of the smart device during driving can be represented by the three-axis angular velocity ⁇ x, ⁇ y, ⁇ z and the three-axis acceleration ax, ay, az of the smart device on the three axes of x, y, and z.
  • the data collected by the acceleration sensor and gyroscope sensor are used to characterize the three translational movements and three rotational movements of the smart device in the x, y, z three-dimensional coordinate system, it is also called six degrees of freedom. Therefore, in some embodiments, the data collected by the acceleration sensor and the gyroscope sensor may also be referred to as degree-of-freedom data.
  • the vehicle-mounted system may also include an intelligent control module for providing intelligent control for users, such as vehicle control, welcome, unlocking doors, unlocking the trunk, locking the trunk, Lock the door, turn off the lights, start the vehicle, play music, display the preset application interface on the display, turn on the air conditioner, etc.
  • an intelligent control module for providing intelligent control for users, such as vehicle control, welcome, unlocking doors, unlocking the trunk, locking the trunk, Lock the door, turn off the lights, start the vehicle, play music, display the preset application interface on the display, turn on the air conditioner, etc.
  • the vehicle-mounted system may also include a vehicle-mounted terminal.
  • the vehicle-mounted terminal is a terminal device installed on the vehicle.
  • the vehicle-mounted terminal may be integrated on the vehicle.
  • the vehicle-mounted terminal can also be installed on the vehicle independently of the vehicle.
  • the vehicle-mounted terminal may include multiple display screens located at multiple locations in the vehicle, such as a central control screen (also called a main driving screen), a passenger screen, a left rear screen, and a right rear screen.
  • a central control screen also called a main driving screen
  • passenger screen a left rear screen
  • a right rear screen a right rear screen
  • the continuous tracking of the movement trajectory of the UWB car key is used to accurately identify the position of the UWB car key outside the car, so that when it is determined that the UWB car key is close to the vehicle, corresponding intelligent functions such as welcoming guests, unlocking the door, and unlocking the trunk can be provided.
  • Car control services and, when it is determined that the UWB car key is far away from the vehicle, corresponding intelligent car control services such as locking the trunk, locking the doors, and turning off the lights are provided.
  • determining the specific location of the UWB car key in the car is used to provide personalized and intelligent car control services based on the precise location of the UWB car key in the car. For example, when it is determined that the UWB car key is in the driver's seat, functions such as keyless starting of the vehicle, starting the central control screen and displaying the preset application interface on the central control screen, and turning on the air conditioner are provided. For another example, when it is determined that the UWB car key is located in the passenger seat, functions such as starting the passenger screen and displaying a preset application interface on the passenger screen are provided.
  • the UWB car key when locating the UWB car key outside the car, if you rely solely on ranging data, the UWB car key may be located in the non-line of sight (NLOS) area of the UWB module outside the car (such as When the NLOS blind zone cannot communicate due to occlusion and other reasons), the ranging data is missing or even the ranging data acquisition fails due to the inability of the UWB car key and the UWB module to communicate.
  • the lack of ranging data will greatly affect the accuracy of UWB car key positioning in off-car scenarios. The failure to obtain ranging data will directly lead to the failure of UWB car key positioning in the scene outside the car.
  • the solution provided by the embodiments of this application uses a positioning strategy that integrates motion data and ranging data in the off-car scene.
  • This solution can use the motion data of the UWB car key to compensate for the lack of ranging data or the failure to obtain ranging data when it is in the NLOS zone.
  • the positioning strategy that integrates motion data and ranging data can also obtain more accurate positioning results than based on a single category of data. Therefore, regardless of whether the UWB car key is located in the NLOS area or LOS area outside the car, the fusion pose strategy can provide stable, consistent, and accurate UWB car key positioning capabilities in the outside scene.
  • the solution provided by the embodiment of the present application adopts an enhanced recognition strategy in the car scene and determines the position of the UWB car key in the car by matching with a large amount of positioning data in the positioning database.
  • This method can provide stable and reliable identification in the car scene. Consistent and accurate UWB car key positioning capabilities, such as identifying whether the UWB car key is located in the main driver's seat, passenger seat or rear seat, or further identifying whether the UWB car key is located in the left rear seat or right rear seat of the rear row.
  • the digital car key positioning device may pre-store a positioning database used to assist in positioning the UWB car key in the car.
  • the digital car key positioning system (as shown in FIG. 4 as the digital car key positioning system 400 ) further includes a storage unit for storing the positioning database.
  • the positioning database includes a large amount of positioning data.
  • the positioning data is used to represent the ranging values between multiple locations in the car and multiple UWB modules installed in the car.
  • the multiple locations in the car may include locations where multiple seats are located in the vehicle, or may include any other location except where the seats are located, which is not limited in the embodiments of this application.
  • the digital car key positioning system may also include a positioning data training module.
  • the digital car key positioning system can use the positioning data training module to train the ranging data of the UWB car key (that is, the sample data based on subsequent positioning data training) when the user carries the UWB car key at multiple locations in the car, and then obtains the positioning database.
  • the digital car key positioning system can send the ranging data of the UWB car key obtained by the positioning data training module when the user carries the UWB car key at multiple locations in the car to the cloud, and the cloud will process the ranging data. Conduct training to obtain the positioning database and send the positioning database to the digital car key positioning system.
  • a piece of positioning data in the positioning database includes a set of ranging values between a position in the car and multiple UWB modules in the car.
  • a location data is associated with a location tag.
  • One positioning data is a distance data set (denoted as a second distance data set).
  • positioning data can be express.
  • p i is the label of position i
  • O ij is used to represent the ranging value between position i and the jth UWB module
  • N is the number of UWB modules in the car.
  • the distance measurement value between position i and the j-th UWB module is the distance measurement value between the UWB car key and the j-th UWB module measured by the digital car key positioning device when the user carries the UWB car key at position i.
  • the positioning data in the positioning database are respectively associated with the position tags of positions 901, 902, 903, 904, 905, 906, ... shown in Figure 9.
  • the UWB shown in Figure 9 is installed in the car. Taking base station (i.e. UWB module) 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 as an example, the positioning database may include positioning data 1, positioning data 2, positioning data 3, positioning data 4, Positioning data 5, positioning data 6, positioning data 7, ... and other positioning data.
  • positioning data 1 includes a set of ranging values between the in-vehicle position 901 and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 respectively.
  • Positioning data 2 includes a set of ranging values between the in-vehicle position 902 and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 respectively.
  • the positioning data 3 includes a set of ranging values between the in-vehicle position 903 and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 respectively.
  • the positioning data 4 includes a set of ranging values between the in-vehicle position 904 and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 respectively.
  • the positioning data 5 includes a set of ranging values between the in-vehicle position 905 and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 respectively.
  • the positioning data 6 includes a set of ranging values between the in-vehicle position 906 and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 respectively. And so on.
  • positioning data 1 can be represented by ⁇ (label of position 901, O 11 ), (label of position 901, O 12 ), (label of position 901, O 13 ), (label of position 901, O 14 ), (position The label of 901, O 15 ), (the label of position 901, O 16 ) ⁇ means.
  • O 11 , O 12 , O 13 , O 14 , O 15 and O 16 respectively represent the UWB car key and UWB base station 1, UWB base station 2, UWB base station 3, and UWB base station 4 when the user carries the UWB car key at position 901. , the ranging value between UWB base station 5 and UWB base station 6.
  • positioning data 2 can be used ⁇ (label of position 902, O 21 ), (label of position 902, O 22 ), (label of position 902, O 23 ), (label of position 902, O 24 ), ( Label at position 902, O 25 ), (label at position 902, O 26 ) ⁇ is represented.
  • Positioning data 3 can be used ⁇ (label of position 903, O 31 ), (label of position 903, O 32 ), (label of position 903, O 33 ), (label of position 903, O 34 ), (label of position 903 Label, O 35 ), (label at position 903, O 36 ) ⁇ is represented.
  • Positioning data 4 can be used ⁇ (label of position 904, O 41 ), (label of position 904, O 42 ), (label of position 904, O 43 ), (label of position 904, O 44 ), (label of position 904 Label, O 45 ), (label at position 904, O 46 ) ⁇ is represented.
  • Positioning data 5 can be used ⁇ (label of position 905, O 51 ), (label of position 905, O 52 ), (label of position 905, O 53 ), (label of position 905, O 54 ), (label of position 905 Label, O 55 ), (label at position 905, O 56 ) ⁇ is represented.
  • the positioning data 6 can be represented by ⁇ (label of position 906, O 61 ), (label of position 906, O 62 ), (label of position 906, O 63 ), (label of position 906, O 64 ), (label of position 906 Label, O 65 ), (label at position 906, O 66 ) ⁇ is represented. And so on.
  • a digital car key positioning method provided by the embodiment of the present application is used.
  • the digital car key positioning device recognizes that the UWB car key is located outside the car, and uses a fusion pose strategy to perform UWB car key positioning. Tracking of movement outside the car and identification of UWB car keys inside and outside the car.
  • the digital car key positioning device switches the positioning strategy to the enhanced recognition strategy.
  • the digital car key positioning device determines the specific location of the UWB car key in the car by comparing the ranging data with the positioning data in the positioning database ( That is, the position corresponding to the positioning data with the highest similarity to the ranging data).
  • the digital car key positioning device will also perform identification inside and outside the vehicle.
  • the digital car key positioning device switches the positioning strategy to the fusion posture strategy.
  • the digital car key positioning device uses a fusion pose strategy to track the movement trajectory of the UWB car key outside the vehicle.
  • Figure 11 uses the digital car key as the UWB car key.
  • the movement process of the UWB car key is shown in Figure 10, gradually moving towards the vehicle (denoted as stage 1) ⁇ entering the vehicle ⁇ located in the car (denoted as stage 2) Taking the process as an example, a flow chart of a UWB car key positioning method provided by an embodiment of the present application is shown.
  • a UWB car key positioning method provided by an embodiment of the present application may include the following S1101-S1109:
  • the digital car key positioning system can continuously (such as periodically) acquire the acceleration data of the smart device through the acceleration sensor when the user carries the UWB car key outside the car, and the gyroscope of the smart device acquired through the gyro sensor.
  • the movement data of the UWB car key can be obtained from the instrument data.
  • the UWB car key can communicate with multiple UWB modules (shown as 401 in Figure 4) deployed on the vehicle based on UWB technology.
  • a UWB car key can realize UWB technology-based communication with multiple UWB modules through a UWB chip.
  • the digital car key positioning system can calculate the ranging values between the UWB car key and multiple UWB modules based on the UWB signal, and obtain the UWB car key and multiple UWB modules. Ranging data between UWB modules (denoted as the third distance data group).
  • the third distance data group can be used (O t (i), 1 , O t(i),2 , O t(i),3 , O t(i),4 , O t(i),5 , O t(i),6 ).
  • O t(i),1 , O t(i),2 , O t(i),3 , O t(i),4 , O t(i),5 and O t(i),6 respectively is the ranging value between the UWB car key and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 at time t(i).
  • the motion data of the UWB car key can be expressed by (x t(i) , y t(i) , ⁇ t(i) .
  • x t(i) and y t(i) are the UWB at time t(i) respectively.
  • ⁇ t(i) is the angle of the UWB car key at time t(i).
  • ⁇ t(i) is calculated based on the gyroscope data collected by the gyro sensor and the acceleration data collected by the acceleration sensor.
  • the UWB car key positioning unit establishes constraints based on the distance measurement data of the UWB car key outside the car and the motion data of the UWB car key, and obtains the preliminary motion trajectory of the UWB car key.
  • the UWB car key positioning unit establishing constraint conditions based on the distance measurement data of the UWB car key outside the car may include: the UWB car key positioning unit based on the continuously acquired UWB car key in The ranging data outside the vehicle establishes multiple UWB ranging constraints.
  • the UWB ranging constraint conditions are used to constrain the positional relationship between the UWB car key and multiple UWB base stations during movement outside the vehicle.
  • the UWB car key positioning unit establishing constraints based on the motion data of the UWB car key may include: the UWB car key positioning unit calculates the movement data of the UWB car key during the movement based on the motion data of the UWB car key obtained in real time. position; and establishing inertial navigation constraints based on the relationship between adjacent positions.
  • the inertial navigation constraints are used to constrain the motion route between adjacent spatial poses determined by the UWB car key during its movement outside the vehicle.
  • the UWB car key positioning unit can obtain the corresponding movement route (ie, the first movement route) based on the calculated multiple positions of the UWB car key during its movement outside the vehicle through methods such as double integration.
  • double integration the general idea of the method based on double integration is: integrate the acceleration obtained based on the data collected by the sensor to obtain the movement speed, and further integrate the obtained movement speed to obtain the cumulative coordinates of the initial position, and then obtain the movement route.
  • the embodiments of this application do not limit the specific methods, and conventional techniques can be referred to.
  • Figure 12 and Figure 13 respectively show a schematic diagram of the calculation process of the fusion pose strategy provided by the embodiment of the present application.
  • the digital car key positioning system can continuously collect acceleration data based on the acceleration sensor and the gyroscope sensor. Gyroscope data determines the UWB car key's multiple positions during movement. Further, the digital car key positioning system establishes multiple inertial navigation constraints based on the determined multiple positions of the UWB car key during movement.
  • the digital car key positioning system can continuously establish multiple UWB ranging constraints based on the ranging data continuously obtained by the UWB car key during movement.
  • the UWB car key positioning unit establishes multiple inertial navigation constraints based on the motion data of the UWB car key. Specifically, the UWB car key positioning unit determines the UWB based on the continuously acquired motion data of multiple UWB car keys. Multiple positions of the car key; the UWB car key positioning unit establishes distance constraints and angle constraints between two adjacent positions.
  • the UWB car key positioning unit determines the movement data of the UWB car key at Pi and Pi +1 (x t
  • the adjacent positions determined by (i) , y t(i) ) and (x t(i+1) , y t(i+1) ) correspond to the adjacent points Pi and P i shown in (a) in Figure 15 Pi +1 .
  • the distance constraint condition between Pi and Pi +1 is L
  • the angle constraint condition is ⁇ .
  • L can be the distance between Pi and Pi +1 , for example, L can be expressed by the following calculation formula 1; ⁇ can be the angle change between Pi and Pi +1 , for example, ⁇ can be expressed by the following Calculation formula 2 means:
  • the points filled with white indicate that only the motion data of the UWB car key was obtained at that position; the points filled with black diagonal lines indicate that only the motion data of the UWB car key was obtained at that position.
  • the ranging data of the UWB car key has been obtained; the point filled half with white and half with black diagonal lines indicates that both the movement data of the UWB car key and the ranging data of the UWB car key have been obtained at that position.
  • the distance constraint L is used to constrain the edge relationship between adjacent points Pi and Pi +1 shown in (a) in Figure 15.
  • the angle constraint condition ⁇ is used to constrain the angle between adjacent points Pi and Pi +1 shown in (a) in Figure 15 .
  • the combination of L and ⁇ can be used to constrain the motion route between adjacent points Pi and Pi +1 shown in (a) in Figure 15.
  • the white-filled points described in (a) in Figure 15 are all locations where the motion data of the UWB car key is obtained.
  • the UWB car key positioning unit will establish corresponding inertial navigation constraints ((a) in Figure 15 are not shown one by one), such as distance constraints and angle constraints.
  • the UWB car key positioning unit establishes UWB ranging constraints based on the UWB car key's ranging data outside the car (i.e., the third distance data group). Specifically, the UWB car key positioning unit establishes UWB ranging constraints according to the continuous acquisition The ranging values between the UWB car key and multiple UWB modules establish multiple ranging constraints corresponding to the location and multiple UWB modules.
  • the ranging constraint conditions of the position Pi +1 include the ranging constraint conditions K1, K2 shown in (b) in Figure 15, K3, K4, K5 and K6.
  • the ranging constraint K1 shown in (b) in Figure 15 is used to constrain the ranging edge between the UWB car key located at Pi +1 and the UWB base station 1
  • the ranging constraint K2 is used to constrain the ranging edge located at P
  • the ranging constraint K3 is used to constrain the ranging edge between the UWB car key at P i+1 and UWB base station 3
  • ranging Constraint condition K4 is used to constrain the ranging edge between the UWB car key located at Pi +1 and UWB base station 4
  • ranging constraint condition 5 is used to constrain the distance between the UWB car key located at Pi +1 and UWB base station 5.
  • the ranging constraint condition 6 is used to constrain the ranging edge between the UWB car key located at Pi +1 and the UWB base station 6 .
  • the digital car key positioning system can perform nonlinear fusion pose optimization by integrating inertial navigation constraints and UWB ranging constraints to obtain the optimal solution, which is the motion trajectory of the UWB car key. .
  • the digital car key positioning system can use nonlinear optimization algorithms such as Gauss-Newton iteration method, general graphic optimization (g2o), Ceres, quasi-Newton method (BFGS), etc., based on comprehensive inertial navigation constraints and UWB measurements.
  • nonlinear optimization algorithms such as Gauss-Newton iteration method, general graphic optimization (g2o), Ceres, quasi-Newton method (BFGS), etc.
  • g2o general graphic optimization
  • Ceres Ceres
  • BFGS quasi-Newton method
  • the digital car key positioning system can continue to execute the following S1105-S1109.
  • the digital car key positioning system may continue to execute the following S1103-S1109.
  • the preliminary movement trajectory obtained by the digital car key positioning system can be as shown in Figure 16 (a).
  • the points filled with black diagonal lines in the preliminary movement trajectory as shown in Figure 16 (a) It is the position determined based on the ranging data of the UWB car key outside the car;
  • the white filled point in the preliminary motion trajectory shown in (a) in Figure 16 is the position determined based on the motion data of the UWB car key outside the car.
  • the position determined based on the ranging data of the UWB car key outside the car shown in (a) of FIG. 16 has a corresponding relationship with the position determined based on the movement data of the UWB car key outside the car.
  • the position determined based on the ranging data of the UWB car key outside the car may correspond to the closest position among the positions determined based on the motion data of the UWB car key outside the car.
  • O1 shown in (a) in FIG. 16 corresponds to P1
  • O2 corresponds to P3
  • O3 corresponds to P7
  • O4 corresponds to P9.
  • the preliminary motion trajectory shown in (a) in Figure 16 is also constrained by multiple constraints, including the inertial navigation constraints and UWB ranging constraints determined above.
  • O1, O2 and O3 shown in (a) in Figure 16 are also constrained by their corresponding UWB ranging constraint conditions. For the convenience of viewing, (a) in Figure 16 is not shown.
  • the position determined based on the ranging data of the UWB car key outside the car may also correspond to an interpolation value, wherein the interpolation value may be the position between two adjacent positions determined based on the movement data of the UWB car key outside the car. , this interpolation satisfies a linear relationship with the two adjacent positions mentioned above.
  • the digital car key positioning system determines the weights of multiple constraints based on the data characteristics of the UWB car key's ranging data outside the car.
  • the digital car key positioning system can determine the weight of the inertial navigation constraint and the UWB ranging constraint based on a preset confidence level, experience value, etc.
  • the weights of the inertial navigation constraint conditions and the UWB ranging constraint conditions may be different.
  • the weight of the constraint condition is used to indicate the reference degree of the corresponding constraint condition when performing UWB car key positioning. The greater the weight of the constraint, the greater the reference degree of the constraint when locating the UWB car key; conversely, the smaller the weight of the constraint, the greater the reference degree of the constraint when locating the UWB car key. The smaller the reference level.
  • the weight of the inertial navigation constraint may be constant C1.
  • the weight of the UWB ranging constraint can be a constant C2.
  • C2 may satisfy C2 ⁇ [0,1].
  • C1 and C2 may be preset confidence values or experience values, etc., which are not limited in the embodiment of this application.
  • the digital car key positioning system can also perform weight optimization on one or more UWB ranging constraint conditions.
  • the weight of a UWB ranging constraint is used to indicate the reference degree of the UWB ranging constraint when performing UWB car key positioning.
  • the digital car key positioning system can use the short range enhancement method to perform weight optimization on one or more UWB ranging constraint conditions.
  • the digital car key positioning system uses a short-range enhancement method to optimize the weight of one or more UWB ranging constraints, which may include: the digital car key positioning system based on the ranging values between the UWB car key and multiple UWB modules. Different, adjust the weights of multiple ranging constraints used to constrain ranging edges.
  • the digital car key positioning system can determine the weight x w of multiple ranging constraints at time t(i+1) according to the following calculation formula 3:
  • the digital car key positioning system performs positioning of the UWB car key in the scene outside the car so that it can promptly and accurately identify the UWB car key when it is close to the vehicle until it enters the vehicle. Therefore, if it is determined When the ranging value between the UWB car key and a certain UWB base station is small, in order to avoid missing the identification of the approaching event of the UWB car key or the event of entering the vehicle, you can focus on the smaller ranging value.
  • the UWB car key is in the NLOS area of a certain UWB base station, the UWB signal will take longer to transmit between the UWB car key and the UWB base station because the UWB signal is blocked. Therefore, the obtained ranging value is usually greater than the actual distance. Therefore, compared with a smaller ranging value, the UWB base station corresponding to a larger ranging value has a greater probability of being blocked. Based on these considerations, in the embodiment of the present application, for a short ranging edge (for example, smaller than the average ranging value), a greater weight can be given to its corresponding UWB ranging constraint condition.
  • UWB ranging constraint condition of Pi +1 shown in (b) in Figure 15 Take the UWB ranging constraint condition of Pi +1 shown in (b) in Figure 15 as an example. Since the ranging edge corresponding to UWB ranging constraint condition 1 is the shortest, it must be smaller than the average ranging corresponding to Pi +1. value; and, since the ranging edge corresponding to UWB ranging constraint 4 is the longest, it must be greater than the average ranging value corresponding to P i+1 . Therefore, when performing short-range enhancement, the digital car key positioning system can give UWB ranging constraint 1 has a greater weight than UWB ranging constraint 4. Similarly, for UWB ranging constraint 2, UWB ranging constraint 3 and UWB ranging constraint 5, corresponding weights can also be given according to preset rules.
  • the digital car key positioning system can determine the weight of the inertial navigation constraint and the UWB ranging constraint based on the preset confidence level, experience value, etc., and then determine the weight of one or more Perform weight optimization based on UWB ranging constraints (such as using the above-mentioned short-range enhancement method for weight optimization).
  • S1104 The digital car key positioning system optimizes the preliminary movement trajectory based on the determined weights of multiple constraints, and obtains the movement trajectory of the UWB car key outside the car.
  • the digital car key positioning system can adjust the position of one or more points on the preliminary movement trajectory based on the optimized weights of multiple constraints to obtain the movement trajectory of the UWB car key outside the vehicle.
  • the motion trajectory of the UWB car key outside the car is being carried out.
  • the position at P9 better satisfies the K1 constraint.
  • the motion trajectory shown in (b) in Figure 16 can be obtained, which is the UWB car key in the car. external motion trajectory.
  • the points half filled with white and half filled with black diagonal lines in the motion trajectory shown in (b) of Figure 16 are the positions where the measurement step points of the ranging data coincide with the measurement step points of the motion data.
  • (b) in FIG. 16 only takes as an example that the measurement step points of the ranging data and the measurement step points of the motion data can overlap.
  • the ranging data can be fitted to the movement trajectory of the UWB car key outside the car through linear interpolation. middle.
  • S1105 The digital car key positioning system tracks the movement trajectory of the UWB car key outside the car.
  • the digital car key positioning system tracks the movement trajectory of the UWB car key outside the car to provide preset intelligent control when the relative position of the digital car key and the vehicle meets preset conditions.
  • the digital car key positioning system can share the specific location of the UWB car key outside the car with the intelligent control module, so that the intelligent control module can provide the preset location when the relative position of the digital car key and the vehicle meets preset conditions. Intelligent control.
  • the preset conditions include entering the locked door area, entering the welcome area, entering the unlocked door area, entering the unlocked trunk area, leaving the unlocked trunk area, leaving the unlocked door area, etc.
  • Intelligent controls include greeting guests, unlocking doors, unlocking the trunk, locking the trunk, locking doors, turning off lights, etc. The embodiments of this application are not specifically limited.
  • the preset condition is such as entering the car
  • the intelligent control is such as switching to the enhanced recognition strategy.
  • the digital car key positioning system may be preset with a judgment condition for judging whether the UWB car key enters the car from outside the car.
  • the judgment condition is, for example, that the nearest distance measurement value between the UWB car key and the vehicle is less than a preset threshold, and the preset threshold can be a centimeter-level value.
  • the enhanced recognition strategy is used to achieve precise positioning of UWB car keys in the car scene.
  • the specific idea of the enhanced identification strategy is: during the process of being in the car (shown in stage 2 in Figure 10), the digital car key positioning system compares the ranging data collected while in the car with the positioning in the positioning database. Data to determine the specific location of the UWB car key in the car.
  • the distance measurement data of the UWB car key in the car includes the distance measurement data (such as distance measurement values) between the UWB car key and multiple UWB modules respectively.
  • the UWB car key can communicate with multiple UWB modules (shown as 401 in Figure 4) deployed on the vehicle based on UWB technology.
  • a UWB car key can communicate with multiple UWB modules based on UWB technology through a UWB chip.
  • the digital car key positioning system can calculate the ranging values between the UWB car key and multiple UWB modules based on the UWB signal, and obtain the UWB car key and multiple UWB modules. Ranging data between UWB modules (denoted as the first distance data group).
  • the first distance data group can be used (O' t(j), 1 , O' t(j),2 , O' t(j),3 , O' t(j),4 , O' t(j),5 , O' t(j),6 ).
  • O' t(j),1 , O' t(j),2 , O' t(j),3 , O' t(j),4 , O' t(j),5 and O' t (j), 6 are the ranging values between the UWB car key and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 at time t(j) respectively.
  • the digital car key positioning system determines the positioning data with the highest degree of matching with the ranging data of the UWB car key in the car from the positioning database.
  • the digital car key positioning system can determine the matching degree with the ranging data of the UWB car key in the car by separately calculating the similarity between the first distance data group and multiple positioning data in the positioning database. Highest positioning data. Among them, the positioning data that has the highest matching degree with the ranging data of the UWB car key in the car is the positioning data that has the greatest similarity with the first distance data group in the positioning database.
  • the digital car key positioning system may use a classification algorithm to calculate the similarity between the first distance data group and multiple positioning data in the positioning database.
  • the classification algorithm may include but is not limited to one or more of the following: Naive Bayes classification algorithm, logistic regression algorithm, decision tree algorithm, support vector machine algorithm, K-nearest neighbor (KNN) Algorithms, artificial neural network algorithms.
  • the similarity between the first distance data group and the positioning data is related to the spatial distance between the multiple ranging values in the first distance data group and the corresponding ranging values in the positioning data.
  • the similarity between the first distance data set and the positioning data may be negatively correlated with the spatial distance between the first distance data set and the positioning data. For example, the smaller the spatial distance between the first distance data group and the positioning data, the greater the similarity between the first distance data group and the positioning data; the smaller the spatial distance between the first distance data group and the positioning data. If it is large, it means that the similarity between the first distance data group and the positioning data is smaller.
  • the spatial distance Bj between the first distance data group and the positioning data can be calculated based on the following calculation formula 4:
  • O is the positioning data
  • O' j is the first distance data group
  • COUNT(O ⁇ O' j ) is the number of UWB base stations in the positioning data that correspond to the same ranging value in the first distance data group
  • COUNT(O ⁇ O' j ) is the sum of the number of non-overlapping UWB base stations corresponding to the positioning data and the ranging value in the first distance data group.
  • the digital car key positioning system can calculate the spatial distance between it and the first distance data group. Based on this, the digital car key positioning system can determine the positioning data that best matches the ranging data of the UWB car key in the car. For example, the positioning data with the highest matching degree to the ranging data of the UWB car key in the car is the positioning data with the smallest space between the first distance data group and the positioning database.
  • the spatial distance between the first distance data group and the positioning data can be represented by the sum of spatial distances between multiple ranging values in the first distance data group and the corresponding ranging value of the positioning data center.
  • the first distance data group is represented by (O' t(j),1 , O' t(j),2 ,..., O' t(j),n )
  • the spatial distance between the first distance data group and the positioning data may be represented by an average of the spatial distances between multiple ranging values in the first distance data group and the corresponding ranging value of the center of the positioning data.
  • the first distance data group is represented by (O' t(j),1 , O' t(j),2 ,..., O' t(j),n )
  • the digital car key positioning system can calculate the spatial distance between it and the ranging value in the first distance data group. Based on this, the digital car key positioning system can determine the positioning data that best matches the ranging data of the UWB car key in the car. For example, the positioning data with the highest matching degree to the ranging data of the UWB car key in the car is the positioning data with the smallest spatial distance between the ranging value in the first distance data group in the positioning database.
  • the digital car key positioning system can also use other methods to calculate the spatial distance between each positioning data in the positioning database and the first distance data group, which is not specifically limited in the embodiment of the present application.
  • the digital car key positioning system can also extract the distance features of each positioning data in the positioning database and the distance features of multiple ranging values in the first distance data group, and then calculate the similarity of the distance features to determine the positioning data and the third distance data.
  • a distance is the spatial distance between data sets.
  • the digital car key positioning system determines that the position of the UWB car key in the car is the position indicated by the position tag corresponding to the positioning data that has the highest matching degree with the ranging data of the UWB car key in the car.
  • the positioning data determined by the digital car key positioning system to have the highest matching degree with the distance measurement data of the UWB car key in the car may be the distance measurement value in the first distance data group as described in the above embodiment. positioning data with the smallest spatial distance between them.
  • the digital car key positioning system can determine the position of the UWB car key in the car as the position indicated by the position tag corresponding to the positioning data with the smallest spatial distance between the ranging values in the first distance data group.
  • the positioning data with the smallest spatial distance from the ranging value in the first distance data group is ⁇ (label at position 901, O 11 ), (label at position 901, O 12 ), (label at position 901, O 13 ), (label of position 901, O 14 ), (label of position 901, O 15 ) ⁇
  • the digital car key positioning system can determine that the position of the UWB car key in the car is position 901.
  • the positioning data determined by the digital car key positioning system to have the highest matching degree with the distance measurement data of the UWB car key in the car can be the space between the distance measurement value in the first distance data group as described in the above embodiment. Positioning data with the smallest sum of distances. For this situation, the digital car key positioning system can determine the position of the UWB car key in the car as the position indicated by the position tag corresponding to the positioning data with the smallest sum of spatial distances between the ranging values in the first distance data group. .
  • the positioning data with the smallest sum of spatial distances from the ranging values in the first distance data group is ⁇ (label at position 901, O 11 ), (label at position 901, O 12 ), (label at position 901, O 13 ), (label at position 901, O 14 ), (label at position 901, O 15 ) ⁇
  • the digital car key positioning system can determine the position of the UWB car key in the car as position 901.
  • the positioning data determined by the digital car key positioning system to have the highest matching degree with the distance measurement data of the UWB car key in the car can be the space between the distance measurement value in the first distance data group as described in the above embodiment.
  • Location data with the smallest average distance For this situation, the digital car key positioning system may determine that the position of the UWB car key in the car is indicated by the position tag corresponding to the positioning data with the smallest average of the spatial distances between the ranging values in the first distance data group. Location.
  • the positioning data with the smallest average spatial distance between the ranging values in the first distance data group is ⁇ (label of position 901, O 11 ), (label of position 901, O 12 ), (label of position 901 , O 13 ), (label of position 901 , O 14 ), (label of position 901 , O 15 ) ⁇
  • the digital car key positioning system can determine the position of the UWB car key in the car as position 901.
  • the digital car key positioning system can also determine multiple ( For example, there are M (M is a positive integer greater than or equal to 3) candidate positioning data, and then by counting the location tags corresponding to the multiple candidate positioning data, it is determined that the position of the UWB car key in the car is the location corresponding to the multiple candidate positioning data.
  • M is a positive integer greater than or equal to 3
  • the digital car key positioning system can also determine multiple ( For example, there are M (M is a positive integer greater than or equal to 3) candidate positioning data, and then by counting the location tags corresponding to the multiple candidate positioning data, it is determined that the position of the UWB car key in the car is the location corresponding to the multiple candidate positioning data.
  • M is a positive integer greater than or equal to 3
  • the digital car key positioning system can determine that the UWB car key is in the car.
  • the position within is position 902.
  • the digital car key positioning system can share the specific location of the UWB car key in the car with the intelligent control module, so that the intelligent control module can detect when the UWB car key is in the car.
  • the position is the preset position, it provides preset intelligent control. For example, when the position of the UWB car key in the car is determined to be the first position, the first preset operation is performed; or when the position of the UWB car key in the car is determined to be the second position, the second preset operation is performed.
  • the above-mentioned first preset operation may include but is not limited to one or more of the following: starting the vehicle, playing music, starting the central control screen and displaying it on the central control screen Default application interface and turn on the air conditioner.
  • the second preset operation may include but is not limited to one or more of the following: playing music, activating the display screen at the second position. And display the preset application interface on the corresponding display screen and turn on the air conditioner.
  • the digital car key positioning system uses a positioning strategy that integrates motion data and ranging data to position the UWB car key.
  • This solution can use the motion data of the UWB car key to make up for the shortcomings of the lack of ranging data when it is in the NLOS zone, and use the ranging data to make up for the inability to determine the relative position between the UWB car key and the vehicle based solely on the motion data of the UWB car key.
  • Disadvantages Moreover, in the LOS area outside the vehicle, the positioning strategy that fuses motion data and ranging data can also obtain more accurate positioning results than based on a single category of data. Therefore, regardless of whether the UWB car key is located in the NLOS area or the LOS area outside the car, the fusion pose strategy can provide stable, consistent, and accurate UWB car key positioning capabilities in the outside scene.
  • Figure 17 shows the digital car key positioning system in an outdoor scene based on the solution provided by the embodiment of the present application.
  • the digital car key positioning system The resulting high-precision motion trajectory tracking rendering.
  • the embodiments of this application provide an enhanced recognition strategy in the car scene to determine the location of the UWB car key in the car by matching with a large amount of positioning data in the positioning database.
  • This method can provide stable and coherent identification in the car scene. , Accurate UWB car key positioning capabilities, such as identifying whether the UWB car key is located in the main driver's seat, passenger seat, or rear seat, or it can further identify whether the UWB car key is located in the left rear seat or the right rear seat of the rear row.
  • the box plot of the ranging value distribution when the UWB car key is located on different seats As shown in Figure 18, the box plot of the ranging value distribution when the UWB car key is located on different seats. Among them, as shown in Figure 18 (a), Figure 18 (b), Figure 18 (c) and Figure 18 (d), no matter the UWB car key is located in the main driver's seat, passenger seat, Whether it is the left rear seat or the right rear seat, the ranging value of the UWB car key has different distribution characteristics depending on the location of the UWB car key. Based on this, it can be determined by comparing the ranging data with the positioning data in the positioning database. The location of UWB in the car.
  • the ranging value between the UWB car key and the UWB base station 1 cannot be obtained due to the obstruction of the seat and other reasons, based on the solution provided by the embodiment of the present application, it can still be compared
  • the ranging value between the UWB car key and other UWB base stations including UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6) and the positioning data in the positioning database determine the UWB position in the car . Therefore, based on the embodiments of this application, a strategy for enhanced identification is provided in the in-car scene. By matching the existing ranging data with a large amount of positioning data in the positioning database, stable and coherent UWB in the in-car scene can still be achieved. Car key locating capability.
  • Table 1 shows the positioning accuracy of the UWB car key in the car that can be achieved based on the method provided by the embodiment of the present application. As shown in Table 1, based on the method provided by the embodiment of the present application, the position recognition accuracy in the in-car scene is greater than 94%, and the recall rate is greater than 95%. This indicator can usually meet the needs of multiple businesses (such as intelligent control functions).
  • the above embodiment only takes the process of gradually walking towards the vehicle (denoted as stage 1) ⁇ entering the vehicle ⁇ locating in the car (denoted as stage 2) as shown in Figure 10 as an example to illustrate a UWB car key provided by the embodiment of the present application. positioning method.
  • stage 2 For the process shown in Figure 10 of being in the car (denoted as stage 2) ⁇ walking out of the vehicle ⁇ gradually moving away from the vehicle (denoted as phase 3), a similar method can also be used to switch from in-car scene positioning to scene positioning outside the car.
  • the embodiments of this application will not be repeatedly introduced.
  • the digital car key positioning system can use the collected UWB in the in-car scene
  • the ranging data of the car key in the car is determined from the positioning database to the positioning data that best matches the ranging data of the UWB car key in the car, so as to realize the positioning of the UWB car key in the car (refer to S1107 and S1108 above) .
  • the digital car key positioning system can switch the strategy used for UWB car key positioning to the fusion posture strategy, and the UWB car key can be continuously obtained outside the car through the positioning strategy.
  • the ranging data and the motion data of the UWB car key establish constraint conditions, obtain the preliminary motion trajectory of the UWB car key, determine the weights of multiple constraints, and optimize the preliminary motion trajectory based on the determined weights of the multiple constraints to realize the UWB car key. Positioning outside the vehicle (refer to S1101 and S1104 above).
  • the size of the sequence numbers of the above-mentioned processes does not mean the order of execution.
  • the execution order of each process should be determined by its functions and internal logic, and should not be implemented in this application.
  • the implementation of the examples does not constitute any limitations.
  • the digital car key positioning device includes corresponding hardware structures and/or software modules to perform each function.
  • the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving the hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered beyond the scope of this application.
  • Embodiments of the present application can divide the digital car key positioning device into functional modules.
  • each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module.
  • the above integrated modules can be implemented in the form of hardware or software function modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. In actual implementation, there may be other division methods.
  • each module in the digital car key positioning device can be implemented in the form of software and/or hardware, and there is no specific limitation on this.
  • the digital car key positioning device is presented in the form of a functional module.
  • Module here may refer to an application specific integrated circuit (ASIC), a circuit, a processor and memory that executes one or more software or firmware programs, an integrated logic circuit, and/or other devices that can provide the above functions.
  • ASIC application specific integrated circuit
  • the computer program product includes one or more computer instructions.
  • the computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device.
  • the computer instructions may be stored in or transmitted from one computer-readable storage medium to another, e.g., the computer instructions may be transferred from a website, computer, server, or data center Transmission to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means.
  • the computer-readable storage medium may be any available media that can be accessed by a computer or a data storage device such as a server or data center integrated with one or more available media.
  • the available media may be magnetic media, (such as floppy disks, hard disks, etc. , tape), optical media (such as digital video disk (DVD)), or semiconductor media (such as solid state disk (SSD)), etc.
  • the steps of the methods or algorithms described in conjunction with the embodiments of the present application can be implemented in hardware, or can be implemented in a processor executing software instructions.
  • Software instructions can be composed of corresponding software modules, and the software modules can be stored in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disks, mobile hard disks, CD-ROM or any other form of storage well known in the art. in the medium.
  • An exemplary storage medium is coupled to the processor such that the processor can read information from the storage medium and write information to the storage medium.
  • the storage medium can also be an integral part of the processor.
  • the processor and storage media may be located in an ASIC.
  • the ASIC can be located in the digital car key locating device.
  • the processor and the storage medium may also exist as discrete components in the digital car key locating device.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Lock And Its Accessories (AREA)

Abstract

The present application relates to the technical field of positioning and discloses a digital car key positioning method, device and system, for use in providing stable, coherent, and accurate digital car key positioning, thereby providing more intelligent automobile control service. In the present application, a vehicle-mounted system can provide different digital car key positioning strategies for an external scenario and an internal scenario. In the external scenario, the vehicle-mounted system uses a motion data and ranging data fused positioning strategy to obtain a more accurate positioning result than a result based on single-category data. In the internal scenario, the vehicle-mounted system determines the specific position of a digital car key in a vehicle by means of matching a large amount of positioning data in a positioning database. On this basis, stable, coherent, and accurate digital vehicle key positioning capability can be achieved without considering that a digital vehicle key is located in a non-line-of-sight (NLOS) area or a line-of-sight (LOS) area.

Description

一种数字车钥匙的定位方法、设备及系统A positioning method, equipment and system for digital car keys 技术领域Technical field
本申请实施例涉及定位技术领域,尤其涉及一种数字车钥匙的定位方法、设备及系统。The embodiments of the present application relate to the field of positioning technology, and in particular, to a positioning method, device and system for a digital car key.
背景技术Background technique
随着移动终端、汽车、物联网技术的飞速发展,车辆解锁已逐渐从传统的机械钥匙的解锁方式,转变为数字车钥匙的解锁方式。通过数字车钥匙,可以在不使用机械钥匙的情况下解锁和启动汽车。当用户携带数字车钥匙进入车内,汽车通常会检测到数字车钥匙,进而激活汽车启动按钮。With the rapid development of mobile terminals, automobiles, and Internet of Things technology, vehicle unlocking has gradually changed from the traditional mechanical key unlocking method to the digital car key unlocking method. With a digital car key, the car can be unlocked and started without using a mechanical key. When a user enters the car with a digital car key, the car usually detects the digital car key and activates the car start button.
但是,现有的汽车在进行车内数字车钥匙定位时,通常无法准确定位携带有数字车钥匙的用户位于主驾驶座位、副驾驶座位、左后座位还是右后座位。因此,经常会出现用户不在主驾驶座位,但是其汽车误启动的问题。However, when existing cars locate digital car keys in the car, they are usually unable to accurately determine whether the user carrying the digital car key is in the main driver's seat, the passenger seat, the left rear seat, or the right rear seat. Therefore, there is often a problem that the user's car starts accidentally when he is not in the main driving seat.
发明内容Contents of the invention
本申请提供一种数字车钥匙的定位方法、设备及系统,能够提供稳定、连贯、精确的数字车钥匙定位,从而提供更加智能化的汽车控制服务。This application provides a digital car key positioning method, equipment and system, which can provide stable, consistent and accurate digital car key positioning, thereby providing more intelligent car control services.
为达到上述目的,本申请实施例采用如下技术方案:In order to achieve the above objectives, the embodiments of this application adopt the following technical solutions:
第一方面,提供一种数字车钥匙的定位方法,该方法包括:获取位于车内的数字车钥匙和车内多个超宽带(ultra-wideband,UWB)模块之间的第一距离数据组,其中第一距离数据组包括数字车钥匙分别与多个UWB模块之间的测距值;从定位数据库中确定与第一距离数据组匹配度最高的定位数据,其中定位数据库中的定位数据用于表征车内多个位置与多个UWB模块之间的测距值;确定数字车钥匙在车内的位置为与第一距离数据组匹配度最高的定位数据对应的位置标签所指示的位置。In a first aspect, a method for locating a digital car key is provided. The method includes: obtaining a first distance data set between a digital car key located in the car and multiple ultra-wideband (UWB) modules in the car, The first distance data group includes ranging values between the digital car key and multiple UWB modules respectively; the positioning data with the highest matching degree with the first distance data group is determined from the positioning database, where the positioning data in the positioning database is used Characterizing the ranging values between multiple positions in the car and multiple UWB modules; determining the position of the digital car key in the car to be the position indicated by the position tag corresponding to the positioning data with the highest matching degree of the first distance data group.
示例性地,上述确定位于车内的数字车钥匙的具体位置的方案可以称为“增强识别策略”(也称“增强识别算法”)。For example, the above-mentioned solution for determining the specific location of the digital car key located in the car may be called an "enhanced identification strategy" (also called an "enhanced identification algorithm").
示例性地,上述方法可以应用于数字车钥匙定位装置。For example, the above method can be applied to a digital car key locating device.
示例性地,上述数字车钥匙可以是UWB车钥匙。For example, the above-mentioned digital car key may be a UWB car key.
上述第一方面提供的方法,数字车钥匙定位装置可以通过比对测距数据与定位数据库中的定位数据,确定数字车钥匙在车内的具体位置,即与测距数据匹配度最高的定位数据对应的位置标签所指示的位置,以实现数字车钥匙在车内的精确定位。According to the method provided in the first aspect, the digital car key positioning device can determine the specific position of the digital car key in the car by comparing the ranging data with the positioning data in the positioning database, that is, the positioning data with the highest degree of matching with the ranging data. The location indicated by the corresponding location tag to achieve precise positioning of the digital car key in the car.
示例性地,在车内场景中,对数字车钥匙的定位误差可以达到厘米级别。基于此,可以实现对数字车钥匙在车内座位粒度的定位,进而提供基于具体座位的智能化的控制。例如,在识别到数字车钥匙位于主驾座位区域时,车辆根据预设的智能化控制机制决策启动、播放音乐、启动中控屏并在中控屏显示预设应用界面、打开空调等预设控制。或者,在识别到数字车钥匙位于副驾座位区域时,车辆根据预设的智能化控制机制决策播放音乐、打开空调、启动副驾屏并在副驾屏显示预设应用界面等预设控制。或者,在识别到数字车钥匙位于左后座位区域/右后座位区域时,播放音乐、打开空调、启动左后座显示屏(简称“左后屏”)/右后座显示屏(简称“右后屏”)并显示预设应用界面等预设控制。For example, in an in-car scene, the positioning error of a digital car key can reach centimeter level. Based on this, the digital car key can be positioned at the seat granularity in the car, thereby providing intelligent control based on specific seats. For example, when it is recognized that the digital car key is located in the driver's seat area, the vehicle will start, play music, activate the central control screen and display the preset application interface on the central control screen, turn on the air conditioner, etc. according to the preset intelligent control mechanism. control. Or, when it recognizes that the digital car key is located in the passenger seat area, the vehicle will decide to play music, turn on the air conditioner, activate the passenger screen, and display the preset application interface on the passenger screen according to the preset intelligent control mechanism. Or, when it is recognized that the digital car key is located in the left rear seat area/right rear seat area, play music, turn on the air conditioner, and activate the left rear seat display screen (referred to as "left rear screen")/right rear seat display screen (referred to as "right rear seat screen"). "Back Screen") and displays preset controls such as the preset application interface.
在一种可能的实现方式中,上述方法还包括:分别获取用户携带数字车钥匙位于车内多个位置时,数字车钥匙与多个UWB模块之间的多个第二距离数据组,得到样本数据;对上述样本数据进行训练,得到定位数据库,其中定位数据库中包括多个定位数据,其中一个定位数据包括车内一个位置分别与多个UWB模块之间的测距值;一个定位数据与一个位置标签相关联。通过对大量样本数据进行训练得到包括大量定位数据的定位数据库,进而实现通过比对测距数据与定位数据库中的定位数据,确定的数字车钥匙在车内的具体位置的稳定、连贯和精确性。In a possible implementation, the above method also includes: respectively obtaining multiple second distance data groups between the digital car key and multiple UWB modules when the user carries the digital car key and is located at multiple locations in the car, and obtains samples. data; train the above sample data to obtain a positioning database, in which the positioning database includes multiple positioning data, one of which includes ranging values between a position in the car and multiple UWB modules; one positioning data and one Location tags are associated. By training a large number of sample data, a positioning database including a large amount of positioning data is obtained, and then the stability, consistency and accuracy of the specific position of the digital car key in the car can be determined by comparing the ranging data with the positioning data in the positioning database. .
在一种可能的实现方式中,上述从定位数据库中确定与第一距离数据组匹配度最高的定位数据,包括:分别计算第一距离数据组与多个定位数据之间的相似度,相似度与第一距离数据组中的多个测距值与定位数据中对应测距值之间的空间距离相关;确定与第一距离数据组相似度最高的定位数据是与第一距离数据组匹配度最高的定位数据。作为一种示例,第一距离数据组与定位数据之间的相似度可以与第一距离数据组与定位数据之间的空间距离负相关。例如,第一距离数据组与定位数据之间的空间距离越小,则说明第一距离数据组与定位数据之间的相似度越大;第一距离数据组与定位数据之间的空间距离越大,则说明第一距离数据组与定位数据之间的相似度越小。基于此,通过计算第一距离数据组中的多个测距值与定位数据中对应测距值之间的空间距离,可以确定第一距离数据组与多个定位数据之间的相似度,进而确定与数字车钥匙在车内的测距数据匹配度最高的定位数据。In a possible implementation, the above-mentioned determination of the positioning data with the highest matching degree with the first distance data group from the positioning database includes: respectively calculating the similarity between the first distance data group and the plurality of positioning data. It is related to the spatial distance between multiple ranging values in the first distance data group and the corresponding ranging values in the positioning data; it is determined that the positioning data with the highest similarity to the first distance data group is the matching degree with the first distance data group. Highest positioning data. As an example, the similarity between the first distance data set and the positioning data may be negatively correlated with the spatial distance between the first distance data set and the positioning data. For example, the smaller the spatial distance between the first distance data group and the positioning data, the greater the similarity between the first distance data group and the positioning data; the smaller the spatial distance between the first distance data group and the positioning data. If it is large, it means that the similarity between the first distance data group and the positioning data is smaller. Based on this, by calculating the spatial distance between the multiple ranging values in the first distance data group and the corresponding ranging values in the positioning data, the similarity between the first distance data group and the multiple positioning data can be determined, and then Determine the positioning data that best matches the ranging data of the digital car key in the car.
在一种可能的实现方式中,上述方法还包括:若确定数字车钥匙在车内的位置为第一位置,执行第一预设操作;若确定数字车钥匙在车内的位置为第二位置,执行第二预设操作。基于本申请提供的基于增强识别策略确定数字车钥匙在车内的具体位置的方案,可以提供基于具体座位的智能化的控制。例如,在识别到数字车钥匙位于第一位置时,执行第一预设操作;在识别到数字车钥匙位于第二位置时,执行第二预设操作。In a possible implementation, the above method further includes: if it is determined that the position of the digital car key in the car is the first position, performing a first preset operation; if it is determined that the position of the digital car key in the car is the second position , perform the second preset operation. Based on the solution provided by this application for determining the specific location of the digital car key in the car based on the enhanced recognition strategy, intelligent control based on specific seats can be provided. For example, when it is recognized that the digital car key is located at the first position, a first preset operation is performed; when it is recognized that the digital car key is located at the second position, a second preset operation is performed.
在一种可能的实现方式中,上述第一位置是主驾驶位,上述第一预设操作包括以下中的一种或多种:启动车辆、播放音乐、启动中控屏并在中控屏显示预设应用界面、打开空调。基于本申请提供的基于增强识别策略确定数字车钥匙在车内的具体位置的方案,可以提供基于具体座位的智能化的控制。例如,在识别到数字车钥匙位于主驾驶位时,执行启动车辆、播放音乐、启动中控屏并在中控屏显示预设应用界面、打开空调等第一预设操作。In a possible implementation, the first position is the main driving position, and the first preset operation includes one or more of the following: starting the vehicle, playing music, starting the central control screen and displaying it on the central control screen Default application interface and turn on the air conditioner. Based on the solution provided by this application for determining the specific location of the digital car key in the car based on the enhanced recognition strategy, intelligent control based on specific seats can be provided. For example, when it is recognized that the digital car key is located in the main driving position, the first preset operations such as starting the vehicle, playing music, starting the central control screen and displaying the preset application interface on the central control screen, and turning on the air conditioner are performed.
示例性地,上述定位数据库中与第一距离数据组匹配度最高的定位数据与主驾驶位相关联。Illustratively, the positioning data in the above-mentioned positioning database that has the highest matching degree with the first distance data group is associated with the main driving position.
在一种可能的实现方式中,上述第二位置是副驾驶位或者后排座位,上述第一预设操作包括以下中的一种或多种:播放音乐、启动第二位置处的显示屏并在对应显示屏显示预设应用界面、打开空调。基于本申请提供的基于增强识别策略确定数字车钥匙在车内的具体位置的方案,可以提供基于具体座位的智能化的控制。例如,在识别到数字车钥匙位于副驾驶位或者后排座位时,执行播放音乐、启动并在对应显示屏显示预设应用界面、打开空调等第二预设操作。In a possible implementation, the above-mentioned second position is the passenger seat or the rear seat, and the above-mentioned first preset operation includes one or more of the following: playing music, activating the display screen at the second position, and Display the preset application interface on the corresponding display screen and turn on the air conditioner. Based on the solution provided by this application for determining the specific location of the digital car key in the car based on the enhanced recognition strategy, intelligent control based on specific seats can be provided. For example, when it is recognized that the digital car key is located in the passenger seat or the rear seat, second preset operations such as playing music, starting and displaying a preset application interface on the corresponding display screen, and turning on the air conditioner are performed.
示例性地,上述定位数据库中与第一距离数据组匹配度最高的定位数据与副驾驶位相关联。Illustratively, the positioning data in the above-mentioned positioning database that has the highest matching degree with the first distance data group is associated with the passenger seat.
在一种可能的实现方式中,上述方法还包括:在数字车钥匙位于车外时,对数字车钥匙进行轨迹跟踪;在识别到数字车钥匙从车外进入车内时,切换为车内位置识别策略,以识别所述数字车钥匙在车内的位置。通过对数字车钥匙在车外的运动轨迹进行轨迹跟踪,可以在识别到数字车钥匙从车外进入车内时,将用于数字车钥匙定位的策略切换为增强识别策略,以实现对数字车钥匙在车内的精确定位。In a possible implementation, the above method also includes: tracking the digital car key when the digital car key is outside the car; and when it is recognized that the digital car key enters the car from outside the car, switching to the position inside the car. Identification strategy to identify the location of the digital car key within the vehicle. By tracking the motion trajectory of the digital car key outside the car, when it is recognized that the digital car key enters the car from outside the car, the strategy for positioning the digital car key can be switched to an enhanced recognition strategy to achieve digital car key positioning. The precise positioning of the key in the car.
可选的,在数字车钥匙位于车外时,通过对数字车钥匙进行轨迹跟踪还可以便于对数字车钥匙在车外的精确定位,进而在数字车钥匙与车辆的相对位置满足预设条件时,提供智能化的迎宾、解锁车门、解锁后备箱、闭锁后备箱、闭锁车门、关闭车灯等功能。Optionally, when the digital car key is located outside the car, trajectory tracking of the digital car key can also facilitate the precise positioning of the digital car key outside the car, and then when the relative position of the digital car key and the vehicle meets the preset conditions , providing intelligent functions such as welcoming guests, unlocking doors, unlocking the trunk, locking the trunk, locking doors, and turning off lights.
在一种可能的实现方式中,上述对所述数字车钥匙进行轨迹跟踪,包括:在用户携带所述数字车钥匙位于车外时,不断获取所述数字车钥匙相对于多个UWB模块的第三距离数据组,以及数字车钥匙的运动数据;根据第三距离数据组和运动数据建立约束,获取数字车钥匙的初步运动轨迹;根据第三距离数据组的数据特征调整初步运动轨迹的多个约束条件的权重;根据初步运动轨迹中多个约束条件的权重优化初步运动轨迹,得到数字车钥匙的运动轨迹。通过采用运动数据和测距数据融合的定位策略进行数字车钥匙在车外的定位,可以通过数字车钥匙的运动数据弥补处于非视距(non line of sight,NLOS)区时测距数据缺失的弊端,以及通过测距数据弥补单纯基于数字车钥匙的运动数据无法确定数字车钥匙与车辆之间的相对位置关系的弊端。并且,在车外的视距(line of sight,LOS)区,运动数据和测距数据融合的定位策略也可以得到比基于单一类别数据更加精确的定位结果。因此,无论数字车钥匙位于车外的NLOS区还是LOS区,基于融合位姿策略均可以提供车外场景下稳定、连贯、精确的数字车钥匙定位能力。In a possible implementation, the above-mentioned trajectory tracking of the digital car key includes: when the user carries the digital car key and is outside the car, continuously obtaining the third position of the digital car key relative to multiple UWB modules. Three distance data groups, as well as the motion data of the digital car key; establishing constraints based on the third distance data group and the motion data to obtain the preliminary motion trajectory of the digital car key; adjusting multiple elements of the preliminary motion trajectory according to the data characteristics of the third distance data group The weight of the constraint conditions; optimize the preliminary motion trajectory according to the weights of multiple constraints in the preliminary motion trajectory to obtain the motion trajectory of the digital car key. By using a positioning strategy that integrates motion data and ranging data to position the digital car key outside the car, the motion data of the digital car key can be used to make up for the lack of ranging data when it is in the non-line of sight (NLOS) area. Disadvantages, and using ranging data to make up for the shortcomings of being unable to determine the relative positional relationship between the digital car key and the vehicle based solely on the motion data of the digital car key. Moreover, in the line of sight (LOS) area outside the vehicle, the positioning strategy that integrates motion data and ranging data can also obtain more accurate positioning results than based on a single category of data. Therefore, regardless of whether the digital car key is located in the NLOS area or the LOS area outside the car, the fusion pose strategy can provide stable, consistent, and accurate digital car key positioning capabilities in the outdoor scene.
在一种可能的实现方式中,上述多个UWB模块包括第一UWB模块和第二UWB模块,上数字车钥匙与第一UWB模块之间的测距值小于数字车钥匙与第二UWB模块之间的测距值;在调整多个约束条件之后,数字车钥匙与第一UWB模块对应的约束条件的权重大于数字车钥匙与第二UWB模块对应的约束条件。通过采用近距加强的方法对一个或多个UWB测距约束条件进行权重优化,侧重于重点关注该较小的测距值,可以避免漏识别数字车钥匙的靠近事件或者进入车辆事件。In a possible implementation, the plurality of UWB modules include a first UWB module and a second UWB module, and the distance measurement value between the digital car key and the first UWB module is smaller than that between the digital car key and the second UWB module. ranging values; after adjusting multiple constraints, the weight of the constraint corresponding to the digital car key and the first UWB module is greater than the weight of the constraint corresponding to the digital car key and the second UWB module. By using the short range enhancement method to optimize the weight of one or more UWB ranging constraints, focusing on the smaller ranging value, it is possible to avoid missing recognition of approaching events of digital car keys or vehicle entry events.
第二方面,提供一种车辆控制方法,该方法应用于车辆控制装置,该方法包括:获取位于车内的数字车钥匙在车内的位置;根据数字车钥匙在车内的位置对车辆执行相应的控制,其中,数字车钥匙在车内的位置不同,则对车辆的控制权限不同。In a second aspect, a vehicle control method is provided, which method is applied to a vehicle control device. The method includes: obtaining the position of a digital car key located in the car; and performing corresponding actions on the vehicle according to the position of the digital car key in the car. Control of the vehicle, where the digital car key has different control authority over the vehicle depending on its location in the car.
上述第二方面提供的方法,通过对数字车钥匙在车内的定位,可以在数字车钥匙处于不同位置时实现对应的智能化控制。The method provided in the second aspect above can realize corresponding intelligent control when the digital car key is in different positions by positioning the digital car key in the car.
示例性地,在车内场景中,对数字车钥匙的定位误差可以达到厘米级别。基于此,可以实现对数字车钥匙在车内座位粒度的定位,进而提供基于具体座位的智能化的控制。例如,在识别到数字车钥匙位于主驾座位区域时,车辆根据预设的智能化控制机制决策启动、播放音乐、启动中控屏并在中控屏显示预设应用界面、打开空调等预设控制。或者,在识别到数字车钥匙位于副驾座位区域时,车辆根据预设的智能化控制机制决策播放音乐、打开空调、启动副驾屏并在副驾屏显示预设应用界面等预设控制。或者,在识别到数字车钥匙位于左后座位区域/右后座位区域时,播放音乐、打开空调、启动左后座显示屏(简称“左后屏”)/右后座显示屏(简称“右后屏”)并显示预设应用界面等预设控制。For example, in an in-car scene, the positioning error of a digital car key can reach centimeter level. Based on this, the digital car key can be positioned at the seat granularity in the car, thereby providing intelligent control based on specific seats. For example, when it is recognized that the digital car key is located in the driver's seat area, the vehicle will start, play music, activate the central control screen and display the preset application interface on the central control screen, turn on the air conditioner, etc. according to the preset intelligent control mechanism. control. Or, when it recognizes that the digital car key is located in the passenger seat area, the vehicle will decide to play music, turn on the air conditioner, activate the passenger screen, and display the preset application interface on the passenger screen according to the preset intelligent control mechanism. Or, when it is recognized that the digital car key is located in the left rear seat area/right rear seat area, play music, turn on the air conditioner, and activate the left rear seat display screen (referred to as "left rear screen")/right rear seat display screen (referred to as "right rear seat screen"). "Back Screen") and displays preset controls such as the preset application interface.
在一种可能的实现方式中,数字车钥匙在车内的位置为主驾驶位,上述根据数字车钥匙在车内的具体位置对车辆执行对应智能化控制包括:执行以下中的一种或多种:启动车辆、播放音乐、启动中控屏并在中控屏显示预设应用界面、打开空调。基于本申请提供的方法,可以提供基于具体座位的智能化的控制。例如,在识别到数字车钥匙位于主驾驶位时,执行启动车辆、播放音乐、启动中控屏并在中控屏显示预设应用界面、打开空调等预设操作。In one possible implementation, the position of the digital car key in the car is the main driving position. The above-mentioned execution of corresponding intelligent control of the vehicle based on the specific position of the digital car key in the car includes: performing one or more of the following Types: start the vehicle, play music, start the central control screen and display the preset application interface on the central control screen, and turn on the air conditioner. Based on the method provided by this application, intelligent control based on specific seats can be provided. For example, when it is recognized that the digital car key is in the main driving position, preset operations such as starting the vehicle, playing music, starting the central control screen and displaying the preset application interface on the central control screen, and turning on the air conditioner are performed.
在一种可能的实现方式中,上述确定位于车内的数字车钥匙在车内的位置,包括:获取数字车钥匙和车内多个UWB模块之间的第一距离数据组,其中第一距离数据组包括数字车钥匙分别与所述UWB模块之间的测距值;从定位数据库中确定与第一距离数据组匹配度最高的定位数据;其中定位数据库中的定位数据用于表征车内多个位置与多个UWB模块之间的测距值;确定数字车钥匙在车内的位置为与第一距离数据组匹配度最高的定位数据对应的位置标签所指示的位置。通过比对测距数据与定位数据库中的定位数据,确定数字车钥匙在车内的具体位置,即与测距数据匹配度最高的定位数据对应的位置标签所指示的位置,以实现数字车钥匙在车内的精确定位,进而在数字车钥匙处于不同位置时实现对应的智能化控制。In a possible implementation, the above determination of the position of the digital car key in the car includes: obtaining a first distance data set between the digital car key and multiple UWB modules in the car, where the first distance The data set includes the ranging values between the digital car key and the UWB module respectively; the positioning data with the highest matching degree with the first distance data set is determined from the positioning database; the positioning data in the positioning database is used to characterize multiple locations in the car. ranging values between a position and multiple UWB modules; determining the position of the digital car key in the car to be the position indicated by the position tag corresponding to the positioning data with the highest matching degree of the first distance data group. By comparing the ranging data with the positioning data in the positioning database, the specific position of the digital car key in the car is determined, that is, the position indicated by the position tag corresponding to the positioning data with the highest matching degree of the ranging data, in order to realize the digital car key Precise positioning in the car, thereby achieving corresponding intelligent control when the digital car key is in different positions.
第三方面,提供一种车载系统,该车载系统包括数字车钥匙定位装置,该数字车钥匙定位装置包括:存储单元,用于存储定位数据库,其中定位数据库中包括多个定位数据,多个定位数据用于表征车内多个位置与车内多个UWB模块之间的测距值;第一数据采集单元,用于采集位于车内的数字车钥匙与多个UWB模块之间的第一距离数据组,其中第一距离数据组包括数字车钥匙分别与多个UWB模块之间的测距值;处理单元,用于从定位数据库中确定与第一距离数据组匹配度最高的定位数据,进而确定数字车钥匙在车内的位置;其中,数字车钥匙在车内的位置为与第一距离数据组匹配度最高的定位数据对应的位置标签所指示的位置。In a third aspect, a vehicle-mounted system is provided. The vehicle-mounted system includes a digital car key positioning device. The digital car key positioning device includes: a storage unit for storing a positioning database, wherein the positioning database includes multiple positioning data. The data is used to represent the ranging values between multiple locations in the car and multiple UWB modules in the car; the first data collection unit is used to collect the first distance between the digital car key located in the car and the multiple UWB modules. A data group, wherein the first distance data group includes distance measurement values between the digital car key and multiple UWB modules respectively; a processing unit is used to determine the positioning data with the highest matching degree to the first distance data group from the positioning database, and then Determine the position of the digital car key in the car; wherein the position of the digital car key in the car is the position indicated by the position tag corresponding to the positioning data with the highest matching degree of the first distance data group.
上述第三方面提供的方法,数字车钥匙定位装置可以通过比对测距数据与定位数据库中的定位数据,确定数字车钥匙在车内的具体位置,即与测距数据匹配度最高的定位数据对应的位置标签所指示的位置,以实现数字车钥匙在车内的精确定位。According to the method provided in the third aspect, the digital car key positioning device can determine the specific position of the digital car key in the car by comparing the ranging data with the positioning data in the positioning database, that is, the positioning data with the highest degree of matching with the ranging data. The location indicated by the corresponding location tag to achieve precise positioning of the digital car key in the car.
在一种可能的实现方式中,上述第一数据采集单元还用于:分别获取用户携带数字车钥匙位于车内多个位置时,数字车钥匙与所述多个UWB模块之间的多个第二距离数据组,得到样本数据;上述数字车钥匙定位装置还包括:模型训练单元,用于对样本数据进行训练,得到定位数据库,其中定位数据库中包括多个定位数据,一个定位数据包括车内一个位置分别与多个UWB模块之间的测距值;一个定位数据与一个位置标签相关联。通过对大量样本数据进行训练得到包括大量定位数据的定位数据库,进而实现通过比对测距数据与定位数据库中的定位数据,确定的数字车钥匙在车内的具体位置的稳定、连贯和精确性。In a possible implementation manner, the above-mentioned first data collection unit is also used to: respectively obtain a plurality of third data between the digital car key and the plurality of UWB modules when the user carries the digital car key and is located at multiple locations in the car. Two distance data sets are used to obtain sample data; the above-mentioned digital car key positioning device also includes: a model training unit for training the sample data to obtain a positioning database, where the positioning database includes multiple positioning data, and one positioning data includes information in the car A location is associated with the ranging values between multiple UWB modules; a positioning data is associated with a location tag. By training a large number of sample data, a positioning database including a large amount of positioning data is obtained, and then the stability, consistency and accuracy of the specific position of the digital car key in the car can be determined by comparing the ranging data with the positioning data in the positioning database. .
在一种可能的实现方式中,上述处理单元从定位数据库中确定与第一距离数据组匹配度最高的定位数据,包括:处理单元采用分别计算第一距离数据组与多个定位数据之间的相似度,以及确定与第一距离数据组相似度最高的定位数据是与第一距离数据组匹配度最高的定位数据。作为一种示例,第一距离数据组与定位数据之间的相似度可以与第一距离数据组与定位数据之间的空间距离负相关。例如,第一距离数据组 与定位数据之间的空间距离越小,则说明第一距离数据组与定位数据之间的相似度越大;第一距离数据组与定位数据之间的空间距离越大,则说明第一距离数据组与定位数据之间的相似度越小。基于此,通过计算第一距离数据组中的多个测距值与定位数据中对应测距值之间的空间距离,可以确定第一距离数据组与多个定位数据之间的相似度,进而确定与数字车钥匙在车内的测距数据匹配度最高的定位数据。In a possible implementation, the above-mentioned processing unit determines the positioning data with the highest matching degree with the first distance data group from the positioning database, including: the processing unit calculates the distance between the first distance data group and the plurality of positioning data respectively. similarity, and determining that the positioning data with the highest similarity to the first distance data group is the positioning data with the highest matching degree to the first distance data group. As an example, the similarity between the first distance data set and the positioning data may be negatively correlated with the spatial distance between the first distance data set and the positioning data. For example, the smaller the spatial distance between the first distance data group and the positioning data, the greater the similarity between the first distance data group and the positioning data; the smaller the spatial distance between the first distance data group and the positioning data. If it is large, it means that the similarity between the first distance data group and the positioning data is smaller. Based on this, by calculating the spatial distance between the multiple ranging values in the first distance data group and the corresponding ranging values in the positioning data, the similarity between the first distance data group and the multiple positioning data can be determined, and then Determine the positioning data that best matches the ranging data of the digital car key in the car.
在一种可能的实现方式中,上述车载系统还包括:车辆控制装置;车辆控制装置用于:在数字车钥匙定位装置确定数字车钥匙在车内的位置为第一位置时,执行第一预设操作;在数字车钥匙定位装置确定数字车钥匙在车内的位置为第二位置时,执行第二预设操作。基于本申请提供的基于增强识别策略确定数字车钥匙在车内的具体位置的方案,可以提供基于具体座位的智能化的控制。例如,在识别到数字车钥匙位于第一位置时,执行第一预设操作;在识别到数字车钥匙位于第二位置时,执行第二预设操作。In a possible implementation, the above-mentioned vehicle system further includes: a vehicle control device; the vehicle control device is configured to: when the digital car key positioning device determines that the position of the digital car key in the car is the first position, execute the first preset Assume the operation; when the digital car key positioning device determines that the position of the digital car key in the car is the second position, the second preset operation is performed. Based on the solution provided by this application for determining the specific location of the digital car key in the car based on the enhanced recognition strategy, intelligent control based on specific seats can be provided. For example, when it is recognized that the digital car key is located at the first position, a first preset operation is performed; when it is recognized that the digital car key is located at the second position, a second preset operation is performed.
在一种可能的实现方式中,上述第一位置是主驾驶位,上述第一预设操作包括以下中的一种或多种:启动车辆、播放音乐、启动中控屏并在中控屏显示预设应用界面、打开空调。基于本申请提供的基于增强识别策略确定数字车钥匙在车内的具体位置的方案,可以提供基于具体座位的智能化的控制。例如,在识别到数字车钥匙位于主驾驶位时,执行启动车辆、播放音乐、启动中控屏并在中控屏显示预设应用界面、打开空调等第一预设操作。示例性地,上述定位数据库中与第一距离数据组匹配度最高的定位数据与主驾驶位相关联。In a possible implementation, the first position is the main driving position, and the first preset operation includes one or more of the following: starting the vehicle, playing music, starting the central control screen and displaying it on the central control screen Default application interface and turn on the air conditioner. Based on the solution provided by this application for determining the specific location of the digital car key in the car based on the enhanced recognition strategy, intelligent control based on specific seats can be provided. For example, when it is recognized that the digital car key is located in the main driving position, the first preset operations such as starting the vehicle, playing music, starting the central control screen and displaying the preset application interface on the central control screen, and turning on the air conditioner are performed. Illustratively, the positioning data in the above-mentioned positioning database that has the highest matching degree with the first distance data group is associated with the main driving position.
在一种可能的实现方式中,上述第二位置是副驾驶位或者后排座位,上述第一预设操作包括以下中的一种或多种:播放音乐、启动第二位置处的显示屏并在对应显示屏显示预设应用界面、打开空调。基于本申请提供的基于增强识别策略确定数字车钥匙在车内的具体位置的方案,可以提供基于具体座位的智能化的控制。例如,在识别到数字车钥匙位于副驾驶位或者后排座位时,执行播放音乐、启动并在对应显示屏显示预设应用界面、打开空调等第二预设操作。示例性地,上述定位数据库中与第一距离数据组匹配度最高的定位数据与副驾驶位相关联。In a possible implementation, the above-mentioned second position is the passenger seat or the rear seat, and the above-mentioned first preset operation includes one or more of the following: playing music, activating the display screen at the second position, and Display the preset application interface on the corresponding display screen and turn on the air conditioner. Based on the solution provided by this application for determining the specific location of the digital car key in the car based on the enhanced recognition strategy, intelligent control based on specific seats can be provided. For example, when it is recognized that the digital car key is located in the passenger seat or the rear seat, second preset operations such as playing music, starting and displaying a preset application interface on the corresponding display screen, and turning on the air conditioner are performed. Illustratively, the positioning data in the above-mentioned positioning database that has the highest matching degree with the first distance data group is associated with the passenger seat.
在一种可能的实现方式中,上述数字车钥匙定位装置还用于:在数字车钥匙位于车外时,对数字车钥匙进行轨迹跟踪;以及,在识别到所述数字车钥匙从车外进入车内时,切换为车内位置识别策略,以识别数字车钥匙在车内的位置。通过对数字车钥匙在车外的运动轨迹进行轨迹跟踪,可以在识别到数字车钥匙从车外进入车内时,将用于数字车钥匙定位的策略切换为增强识别策略,以实现对数字车钥匙在车内的精确定位。In a possible implementation, the above-mentioned digital car key positioning device is also used to: track the digital car key when the digital car key is located outside the car; and, when it is recognized that the digital car key enters from outside the car. When in the car, switch to the in-car location recognition strategy to identify the location of the digital car key in the car. By tracking the motion trajectory of the digital car key outside the car, when it is recognized that the digital car key enters the car from outside the car, the strategy for positioning the digital car key can be switched to an enhanced recognition strategy to achieve digital car key positioning. The precise positioning of the key in the car.
可选的,在数字车钥匙位于车外时,通过对数字车钥匙进行轨迹跟踪还可以便于对数字车钥匙在车外的精确定位,进而在数字车钥匙与车辆的相对位置满足预设条件时,提供智能化的迎宾、解锁车门、解锁后备箱、闭锁后备箱、闭锁车门、关闭车灯等功能。Optionally, when the digital car key is located outside the car, trajectory tracking of the digital car key can also facilitate the precise positioning of the digital car key outside the car, and then when the relative position of the digital car key and the vehicle meets the preset conditions , providing intelligent functions such as welcoming guests, unlocking doors, unlocking the trunk, locking the trunk, locking doors, and turning off lights.
在一种可能的实现方式中,上述第一数据采集单元还用于:在用户携带数字车钥匙位于车外时,不断获取数字车钥匙相对于多个UWB模块的第三距离数据组;上述数字车钥匙定位装置还包括:第二数据采集单元,用于在用户携带数字车钥匙位于车外时,获取数字车钥匙的运动数据;上述数字车钥匙定位装置对数字车钥匙进行轨迹跟踪,包括:处理单元根据第三距离数据组和运动数据建立约束,获取数字车钥匙的 初步运动轨迹;根据第三距离数据组的数据特征调整所述初步运动轨迹的多个约束条件的权重;以及,根据初步运动轨迹中多个位置的权重优化初步运动轨迹,得到数字车钥匙的运动轨迹。通过采用运动数据和测距数据融合的定位策略进行数字车钥匙在车外的定位,可以通过数字车钥匙的运动数据弥补处于NLOS区时测距数据缺失的弊端,以及通过测距数据弥补单纯基于数字车钥匙的运动数据无法确定数字车钥匙与车辆之间的相对位置关系的弊端。并且,在车外的LOS区,运动数据和测距数据融合的定位策略也可以得到比基于单一类别数据更加精确的定位结果。因此,无论数字车钥匙位于车外的NLOS区还是LOS区,基于融合位姿策略均可以提供车外场景下稳定、连贯、精确的数字车钥匙定位能力。In a possible implementation, the above-mentioned first data acquisition unit is also used to: when the user carries the digital car key and is outside the car, continuously obtain the third distance data group of the digital car key relative to the multiple UWB modules; the above-mentioned number The car key positioning device also includes: a second data collection unit, used to obtain the movement data of the digital car key when the user carries the digital car key outside the car; the above-mentioned digital car key positioning device tracks the digital car key, including: The processing unit establishes constraints based on the third distance data group and the motion data to obtain the preliminary motion trajectory of the digital car key; adjusts the weights of multiple constraints on the preliminary motion trajectory according to the data characteristics of the third distance data group; and, based on the preliminary The weights of multiple positions in the motion trajectory optimize the preliminary motion trajectory to obtain the motion trajectory of the digital car key. By using a positioning strategy that integrates motion data and ranging data to position the digital car key outside the car, the motion data of the digital car key can be used to make up for the shortcomings of the missing ranging data when it is in the NLOS area, and the ranging data can be used to make up for the shortcomings of the digital car key based solely on the NLOS area. The movement data of the digital car key cannot determine the relative positional relationship between the digital car key and the vehicle. Moreover, in the LOS area outside the vehicle, the positioning strategy that integrates motion data and ranging data can also obtain more accurate positioning results than based on a single category of data. Therefore, regardless of whether the digital car key is located in the NLOS area or the LOS area outside the car, the fusion pose strategy can provide stable, consistent, and accurate digital car key positioning capabilities in the outdoor scene.
第四方面,提供一种计算机可读存储介质,该计算机可读存储介质上存储有计算机可读指令,该计算机可读指令被处理器执行时实现如第一方面或第二方面任一种可能的实现方式中的方法。In a fourth aspect, a computer-readable storage medium is provided. Computer-readable instructions are stored on the computer-readable storage medium. When the computer-readable instructions are executed by a processor, any one of the possibilities of the first aspect or the second aspect can be realized. method in the implementation.
第五方面,提供一种芯片系统,该芯片系统包括处理器、存储器,存储器中存储有指令;所述指令被所述处理器执行时,实现如第一方面或第二方面任一种可能的实现方式中的方法。该芯片系统可以由芯片构成,也可以包含芯片和其他分立器件。In a fifth aspect, a chip system is provided. The chip system includes a processor and a memory, and instructions are stored in the memory; when the instructions are executed by the processor, any of the possible methods of the first aspect or the second aspect are implemented. Methods in the implementation. The chip system can be composed of chips or include chips and other discrete devices.
第六方面,提供一种计算机程序产品,包括计算机可读指令,当该计算机可读指令在计算机上运行时,使得实现如第一方面或第二方面任一种可能的实现方式中的方法。In a sixth aspect, a computer program product is provided, which includes computer-readable instructions. When the computer-readable instructions are run on a computer, the method in any possible implementation manner of the first aspect or the second aspect is implemented.
附图说明Description of drawings
图1为本申请实施例提供的一种车外场景中的汽车控制服务区域示意图;Figure 1 is a schematic diagram of a car control service area in an off-car scene provided by an embodiment of the present application;
图2为本申请实施例提供的两种车内场景中的汽车控制服务区域示意图;Figure 2 is a schematic diagram of the car control service area in two in-car scenarios provided by the embodiment of the present application;
图3为本申请实施例提供的一种智能设备的硬件结构示意图;Figure 3 is a schematic diagram of the hardware structure of an intelligent device provided by an embodiment of the present application;
图4为本申请实施例提供的一种数字车钥匙定位系统结构示意图;Figure 4 is a schematic structural diagram of a digital car key positioning system provided by an embodiment of the present application;
图5为本申请实施例提供的一种超宽带(ultra-wideband,UWB)车钥匙定位逻辑过程示意图;Figure 5 is a schematic diagram of an ultra-wideband (UWB) car key positioning logic process provided by an embodiment of the present application;
图6为本申请实施例提供的一种车外场景下UWB车钥匙的测距数据示意图;Figure 6 is a schematic diagram of ranging data of a UWB car key in an off-car scenario provided by an embodiment of the present application;
图7为本申请实施例提供的一种车内场景下UWB车钥匙的测距数据示意图;Figure 7 is a schematic diagram of ranging data of a UWB car key in an in-car scenario provided by an embodiment of the present application;
图8为本申请实施例提供的一种三维坐标系的实例示意图;Figure 8 is a schematic diagram of an example of a three-dimensional coordinate system provided by an embodiment of the present application;
图9为本申请实施例提供的一种定位数据对应的位置标签分布示意图;Figure 9 is a schematic diagram of location tag distribution corresponding to positioning data provided by an embodiment of the present application;
图10为本申请实施例提供的一种UWB车钥匙的运动情况示意图;Figure 10 is a schematic diagram of the movement of a UWB car key provided by an embodiment of the present application;
图11为本申请实施例提供的一种UWB车钥匙的定位方法流程图;Figure 11 is a flow chart of a UWB car key positioning method provided by an embodiment of the present application;
图12为本申请实施例提供的一种融合位姿策略的计算过程示意图;Figure 12 is a schematic diagram of the calculation process of a fusion pose strategy provided by an embodiment of the present application;
图13为本申请实施例提供的另一种融合位姿策略的计算过程示意图;Figure 13 is a schematic diagram of the calculation process of another fusion pose strategy provided by an embodiment of the present application;
图14为本申请实施例提供的一种车外场景示意图;Figure 14 is a schematic diagram of an exterior scene provided by an embodiment of the present application;
图15为本申请实施例提供的车外场景下的惯性导航约束条件和UWB测距约束条件示意图;Figure 15 is a schematic diagram of inertial navigation constraints and UWB ranging constraints in an off-vehicle scenario provided by the embodiment of the present application;
图16为本申请实施例提供的初步运动轨迹以及基于初步运动轨迹和不同权重约束条件确定的UWB车钥匙在车外的运动轨迹示意图;Figure 16 is a schematic diagram of the preliminary movement trajectory provided by the embodiment of the present application and the movement trajectory of the UWB car key outside the vehicle determined based on the preliminary movement trajectory and different weight constraints;
图17为本申请实施例提供的一种车外场景下UWB车钥匙的运动轨迹示意图;Figure 17 is a schematic diagram of the movement trajectory of a UWB car key in an exterior scene provided by an embodiment of the present application;
图18为本申请实施例提供的UWB车钥匙位于不同座位上时的测距值分布箱体图。Figure 18 is a box diagram of the ranging value distribution when the UWB car key is located on different seats according to the embodiment of the present application.
具体实施方式Detailed ways
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行描述。其中,在本申请实施例的描述中,除非另有说明,“/”表示或的意思,例如,A/B可以表示A或B;本文中的“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,在本申请实施例的描述中,“多个”是指两个或多于两个。The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. Among them, in the description of the embodiments of this application, unless otherwise stated, "/" means or, for example, A/B can mean A or B; "and/or" in this article is only a way to describe related objects. The association relationship means that there can be three relationships. For example, A and/or B can mean: A alone exists, A and B exist simultaneously, and B alone exists. In addition, in the description of the embodiments of this application, "plurality" refers to two or more than two.
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。Hereinafter, the terms “first” and “second” are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of indicated technical features. Therefore, features defined as "first" and "second" may explicitly or implicitly include one or more of these features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.
本申请实施例提供一种数字车钥匙的定位方法,该方法可以用于进行数字车钥匙的精确定位,包括数字车钥匙在车外场景中的定位和数字车钥匙在车内场景中的精确定位。基于在车外场景和车内场景中的精确定位,可以实现在车外场景和车内场景中的各种智能化的汽车控制服务。其中,数字车钥匙在车外/车内的位置不同,则对车辆的控制权限不同。Embodiments of the present application provide a method for positioning a digital car key. This method can be used to accurately position a digital car key, including positioning the digital car key in an exterior scene and accurately positioning a digital car key in an interior scene. . Based on the precise positioning in the outdoor scene and the indoor scene, various intelligent car control services can be realized in the outdoor scene and the indoor scene. Among them, the location of the digital car key outside/in the car is different, and the control authority over the vehicle is different.
作为一种示例,在车外场景中,基于本申请实施例提供一种数字车钥匙的定位方法,可以提供对数字车钥匙在车外的运动轨迹进行持续跟踪,以便对数字车钥匙的精确定位,进而在数字车钥匙与车辆的相对位置满足预设条件时,提供智能化的迎宾、解锁车门、解锁后备箱、闭锁后备箱、闭锁车门、关闭车灯等功能。例如,车辆可以在数字车钥匙与车辆的相对位置满足预设条件时,通过车辆控制装置提供相应的智能化的控制。As an example, in an outside-the-car scenario, an embodiment of the present application provides a positioning method for a digital car key, which can provide continuous tracking of the movement trajectory of the digital car key outside the car, so as to accurately position the digital car key. , and then when the relative position of the digital car key and the vehicle meets the preset conditions, it will provide intelligent functions such as welcoming guests, unlocking the door, unlocking the trunk, locking the trunk, locking the door, turning off the lights, etc. For example, when the relative position of the digital car key and the vehicle meets preset conditions, the vehicle can provide corresponding intelligent control through the vehicle control device.
示例性地,请参考图1,图1示出了本申请实施例提供的一种车外场景中的汽车控制服务区域示意图。其中,图1所示区域1为闭锁车门区域、区域2为迎宾区域、区域3为解锁车门区域、区域4为解锁后备箱区域。For example, please refer to FIG. 1 , which shows a schematic diagram of a car control service area in an off-car scene provided by an embodiment of the present application. Among them, area 1 shown in Figure 1 is the locked door area, area 2 is the welcome area, area 3 is the unlocked door area, and area 4 is the unlocked trunk area.
基于图1所示汽车控制服务区域分布,在用户携带数字车钥匙从远处向车辆靠近的过程中,可以基于本申请实施例提供的一种数字车钥匙的定位方法对数字车钥匙在车外的运动轨迹进行持续跟踪。其中,在识别到数字车钥匙由区域1进入区域2时,车辆根据预设的智能化控制机制决策进入迎宾相关控制,如打开迎宾灯、打开空调、打开天窗等。进一步可选地,在识别到数字车钥匙进入区域2和区域3时,车辆根据预设的智能化控制机制决策解锁车门、调整座椅等预设控制。或者可选地,在识别到数字车钥匙进入区域4时,车辆根据预设的智能化控制机制决策解锁后备箱。Based on the distribution of car control service areas shown in Figure 1, when the user brings the digital car key and approaches the vehicle from a distance, the positioning method of the digital car key provided by the embodiment of the present application can be used to determine whether the digital car key is outside the car. The movement trajectory is continuously tracked. Among them, when the digital car key is recognized to enter area 2 from area 1, the vehicle will enter welcome-related controls according to the preset intelligent control mechanism, such as turning on the welcome lights, turning on the air conditioner, opening the sunroof, etc. Further optionally, when the digital car key is recognized to enter area 2 and area 3, the vehicle determines preset controls such as unlocking the door and adjusting the seat according to the preset intelligent control mechanism. Or alternatively, when the digital car key is recognized to enter area 4, the vehicle decides to unlock the trunk according to the preset intelligent control mechanism.
相反地,基于图1所示汽车控制服务区域分布,在用户携带数字车钥匙远离车辆的过程中,可以基于本申请实施例提供的一种数字车钥匙的定位方法对数字车钥匙在车外的运动轨迹进行持续跟踪。其中,在识别到数字车钥匙由车内进入区域3时,车辆根据预设的智能化控制机制决策熄火等预设控制。进一步可选地,在识别到数字车钥匙由区域3进入区域2时,车辆根据预设的智能化控制机制决策关闭车灯、关闭空调、关闭天窗等预设控制。进一步可选地,在识别到数字车钥匙由区域2进入区域1时,车辆根据预设的智能化控制机制决策锁住车门等预设控制。或者可选地,在识别到数字车钥匙从区域4内移动至区域4外时,车辆根据预设的智能化控制机制决策锁住后备箱。On the contrary, based on the car control service area distribution shown in Figure 1, when the user carries the digital car key away from the vehicle, the location of the digital car key outside the car can be determined based on a positioning method of the digital car key provided by the embodiment of the present application. Movement trajectories are continuously tracked. Among them, when it is recognized that the digital car key enters area 3 from the car, the vehicle will make preset controls such as turning off the engine according to the preset intelligent control mechanism. Further optionally, when it is recognized that the digital car key enters area 2 from area 3, the vehicle determines preset controls such as turning off the lights, turning off the air conditioner, and closing the sunroof according to the preset intelligent control mechanism. Further optionally, when it is recognized that the digital car key enters area 1 from area 2, the vehicle decides to lock the door and other preset controls according to the preset intelligent control mechanism. Or alternatively, when it is recognized that the digital car key moves from area 4 to outside area 4, the vehicle decides to lock the trunk according to the preset intelligent control mechanism.
需要说明的是,图1所示闭锁车门区域、迎宾区域、解锁车门区域和解锁后备箱区域,以及上述实施例所述在相应区域所进行的智能化控制示例仅作为示例,本申请实施例不限定在车外场景中,车辆的智能化控制机制设置以及智能化控制机制对应的车外区域划分,视车辆的具体功能和具体设置而定。It should be noted that the locked door area, welcome area, unlocked door area and unlocked trunk area shown in Figure 1, as well as the intelligent control examples performed in the corresponding areas described in the above embodiments are only examples. The embodiments of this application It is not limited to scenes outside the vehicle. The intelligent control mechanism settings of the vehicle and the division of the exterior areas corresponding to the intelligent control mechanism depend on the specific functions and specific settings of the vehicle.
作为一种示例,在车内场景中,基于本申请实施例提供一种数字车钥匙的定位方法,可以提供对数字车钥匙在车内的精确定位。示例性地,在车内场景中,对数字车钥匙的定位误差可以达到厘米级别。基于此,可以实现对数字车钥匙在车内座位粒度的定位,进而提供基于具体座位的智能化的控制。例如,车辆可以通过车辆控制装置提供基于具体座位的智能化的控制。As an example, in an in-car scenario, an embodiment of the present application provides a positioning method for a digital car key, which can provide precise positioning of the digital car key in the car. For example, in an in-car scene, the positioning error of a digital car key can reach centimeter level. Based on this, the digital car key can be positioned at the seat granularity in the car, thereby providing intelligent control based on specific seats. For example, the vehicle can provide seat-specific intelligent control through the vehicle control device.
示例性地,请参考图2,图2示出了本申请实施例提供的两种车内场景中的汽车控制服务区域示意图。其中,图2中的(a)示出了一种车内场景中主驾座位区域、副驾座位区域和后排座位区域的服务区域划分方式,图2中的(b)示出了一种车内场景中主驾座位区域、副驾座位区域、左后座位区域和右后座位区域的服务区域划分方式。车辆可以通过定位数字车钥匙位于哪一个区域,以根据预设的智能化控制机制进行相应的控制。例如,在识别到数字车钥匙位于主驾座位区域时,车辆根据预设的智能化控制机制决策启动、播放音乐、启动中控屏并在中控屏显示预设应用界面、打开空调等预设控制。或者,在识别到数字车钥匙位于副驾座位区域时,车辆根据预设的智能化控制机制决策播放音乐、打开空调、启动副驾屏并在副驾屏显示预设应用界面等预设控制。或者,在识别到数字车钥匙位于左后座位区域/右后座位区域时,播放音乐、打开空调、启动左后座显示屏(简称“左后屏”)/右后座显示屏(简称“右后屏”)并显示预设应用界面等预设控制。For example, please refer to FIG. 2 , which shows a schematic diagram of the car control service area in two in-car scenarios provided by embodiments of the present application. Among them, (a) in Figure 2 shows a service area division method for the main driver's seat area, the passenger seat area and the rear seat area in a car scene, and (b) in Figure 2 shows a way of dividing the service area in the car scene. The service area division method of the main driver's seat area, passenger seat area, left rear seat area and right rear seat area in the interior scene. The vehicle can be controlled according to the preset intelligent control mechanism by locating the area where the digital car key is located. For example, when it is recognized that the digital car key is located in the driver's seat area, the vehicle will start, play music, activate the central control screen and display the preset application interface on the central control screen, turn on the air conditioner, etc. according to the preset intelligent control mechanism. control. Or, when it recognizes that the digital car key is located in the passenger seat area, the vehicle will decide to play music, turn on the air conditioner, activate the passenger screen, and display the preset application interface on the passenger screen according to the preset intelligent control mechanism. Or, when it is recognized that the digital car key is located in the left rear seat area/right rear seat area, play music, turn on the air conditioner, and activate the left rear seat display screen (referred to as "left rear screen")/right rear seat display screen (referred to as "right rear seat screen"). "Back Screen") and displays preset controls such as the preset application interface.
需要说明的是,图2所示主驾座位区域、副驾座位区域、后排座位区域、左后座位区域和右后座位区域,以及上述实施例所述在相应区域所进行的智能化控制示例仅作为示例,本申请实施例不限定在车内场景中,车辆的智能化控制机制设置以及智能化控制机制对应的车内位置区域划分,视车辆的具体功能和具体设置而定。It should be noted that the main driver's seat area, the passenger's seat area, the rear seat area, the left rear seat area and the right rear seat area shown in Figure 2, as well as the examples of intelligent control performed in the corresponding areas described in the above embodiments are only As an example, the embodiments of this application are not limited to in-car scenarios. The settings of the vehicle's intelligent control mechanism and the division of in-vehicle location areas corresponding to the intelligent control mechanism depend on the specific functions and specific settings of the vehicle.
在本申请一些实施例中,数字车钥匙的载体可以是智能设备(如智能手机、平板电脑、智能音箱、遥控器等)。例如,数字车钥匙可以以软件形式安装在用户随身携带的智能设备中,用于实现车钥匙相关功能的数字版车钥匙。数字车钥匙相比于传统遥控车钥匙不仅可以实现无钥匙进入和启动、远程钥匙授权、个性化的车辆设置等功能,还可以通过智能设备实现锁定、解锁、启动、开关车窗和空调、共享车辆、车辆状态查看(如查看是否上锁、查看车辆位置等)等功能。In some embodiments of the present application, the carrier of the digital car key may be a smart device (such as a smart phone, tablet computer, smart speaker, remote control, etc.). For example, a digital car key can be installed in the smart device carried by the user in the form of software to realize the digital version of the car key-related functions. Compared with traditional remote control car keys, digital car keys can not only realize keyless entry and start, remote key authorization, personalized vehicle settings and other functions, but can also realize locking, unlocking, starting, opening and closing of windows and air conditioning, and sharing through smart devices Vehicle, vehicle status checking (such as checking whether it is locked, checking the vehicle location, etc.) and other functions.
在本申请另一些实施例中,数字车钥匙的载体可以为实体钥匙。该实体钥匙不仅具备传统车钥匙的车辆解锁、锁定功能,还具备数字车钥匙的无钥匙进入和启动、远程钥匙授权、个性化的车辆设置等功能、启动、开关车窗和空调等功能。In other embodiments of the present application, the carrier of the digital car key may be a physical key. The physical key not only has the vehicle unlocking and locking functions of a traditional car key, but also has keyless entry and starting of the digital car key, remote key authorization, personalized vehicle settings, starting, opening and closing of windows and air conditioning.
示例性地,以本申请实施例所述数字车钥匙的载体为智能设备为例,该智能设备可以包括但不限于手机(如折叠屏手机,包括内折折叠屏手机和外折折叠屏手机)、上网本、平板电脑、可穿戴设备(如智能手表、智能手环、智能眼镜等)、相机(如单反相机、卡片式相机等)、PC(包括台式电脑或者笔记本电脑)、掌上电脑、个人数字助理(personal digital assistant,PDA)、便携式多媒体播放器(portable multimedia player,PMP)、投影设备、智慧屏设备、增强现实(augmented reality,AR)/虚拟现实(virtual  reality,VR)设备、混合现实(mixed reality,MR)设备或人机交互场景中的体感游戏机等。本申请对智能设备的具体功能和结构不做限定。For example, taking the carrier of the digital car key described in the embodiment of the present application as a smart device, the smart device may include but is not limited to a mobile phone (such as a folding screen mobile phone, including an inward-folding folding screen mobile phone and an outward-folding folding screen mobile phone). , netbooks, tablets, wearable devices (such as smart watches, smart bracelets, smart glasses, etc.), cameras (such as SLR cameras, card cameras, etc.), PCs (including desktop computers or laptops), PDAs, personal digital cameras Assistant (personal digital assistant, PDA), portable multimedia player (PMP), projection equipment, smart screen equipment, augmented reality (AR)/virtual reality (VR) equipment, mixed reality ( mixed reality (MR) equipment or somatosensory game consoles in human-computer interaction scenarios, etc. This application does not limit the specific functions and structures of smart devices.
作为一种示例,请参考图3,图3示出了本申请实施例提供的一种智能设备的硬件结构示意图。As an example, please refer to FIG. 3 , which shows a schematic diagram of the hardware structure of an intelligent device provided by an embodiment of the present application.
如图3所示,智能设备可以包括处理器310,外部存储器接口320,内部存储器321,通用串行总线(universal serial bus,USB)接口330,充电管理模块340,电源管理模块341,电池342,天线1,天线2,移动通信模块350,无线通信模块360,音频模块370,扬声器370A,受话器370B,麦克风370C,耳机接口370D,传感器模块380,按键390,马达391,指示器392,摄像头393,显示屏394等。其中传感器模块380可以包括压力传感器380A,陀螺仪传感器380B,气压传感器380C,磁传感器380D,加速度传感器380E(或者加速度计),距离传感器380F,接近光传感器380G,指纹传感器380H,温度传感器380J,触摸传感器380K,环境光传感器380L,骨传导传感器380M等。As shown in Figure 3, the smart device may include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a charging management module 340, a power management module 341, and a battery 342. Antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, audio module 370, speaker 370A, receiver 370B, microphone 370C, headphone interface 370D, sensor module 380, button 390, motor 391, indicator 392, camera 393, Display 394 etc. The sensor module 380 may include a pressure sensor 380A, a gyro sensor 380B, an air pressure sensor 380C, a magnetic sensor 380D, an acceleration sensor 380E (or an accelerometer), a distance sensor 380F, a proximity light sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor. Sensor 380K, ambient light sensor 380L, bone conduction sensor 380M, etc.
可以理解的是,本申请实施例示意的结构并不构成对智能设备的具体限定。在本申请另一些实施例中,智能设备可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件、软件或软件和硬件的组合实现。It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the smart device. In other embodiments of the present application, the smart device may include more or less components than shown in the figures, or combine some components, or split some components, or arrange different components. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.
处理器310可以包括一个或多个处理单元,例如:处理器310可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processiong,GPU),图像信号处理器(image signal processor,ISP),音频处理器/数字处理器(the audio processor),控制器、存储器、视频编解码器、音频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器器,和/或神经网络出合理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。The processor 310 may include one or more processing units. For example, the processor 310 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor ( image signal processor (ISP), audio processor/digital processor (the audio processor), controller, memory, video codec, audio codec, digital signal processor (digital signal processor, DSP), baseband processor processor, and/or neural network processing unit (NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors.
其中,控制器可以是智能设备的神经中枢和指挥中心。控制器可以根据用户操作指令的操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。例如,处理器310中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器310中的存储器为高速缓冲存储器。该存储器可以保存处理器310刚用过或循环使用的指令或数据。如果处理器310需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器310的等待事件,因而提高了系统的效率。Among them, the controller can be the nerve center and command center of the smart device. The controller can generate operation control signals based on the operation codes and timing signals of the user's operation instructions to complete the control of fetching and executing instructions. For example, the processor 310 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 310 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 310 . If processor 310 needs to use the instructions or data again, it can be called directly from the memory. Repeated accesses are avoided and waiting events of the processor 310 are reduced, thus improving the efficiency of the system.
在一些实施例中,处理器310可以包括一个或多个接口。接口可以包括集成电路(inter-intergrated circuit,I2C)接口,集成电路内置音频(inter-intergrated circuit sound,I2S)接口,脉冲编码调制(pluse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO),用户标识模块接口,和/或通用串行总线接口等。In some embodiments, processor 310 may include one or more interfaces. Interfaces may include integrated circuit (inter-intergrated circuit, I2C) interface, integrated circuit built-in audio (inter-intergrated circuit sound, I2S) interface, pulse code modulation (pluse code modulation, PCM) interface, universal asynchronous receiver and transmitter (universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO), user identification module interface, and/or universal serial bus interface, etc. .
电源管理模块341用于为处理器310,内部存储器321,显示屏394,摄像头393和无线通信模块360等供电。The power management module 341 is used to power the processor 310, internal memory 321, display screen 394, camera 393, wireless communication module 360, etc.
智能设备的无线通信功能可以通过天线1,天线2,移动通信模块350,无线通信 模块360,调制解调处理器以及基带处理器等实现。The wireless communication function of the smart device can be implemented through antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, modem processor and baseband processor, etc.
天线1和天线2用于发射和接收电磁波信号。智能设备中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。移动通信模块350可以提供应用在智能设备上的包括2G/3G/4G/5G等无线通信的解决方案。 Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in a smart device can be used to cover a single or multiple communication bands. Different antennas can also be reused to improve antenna utilization. The mobile communication module 350 can provide wireless communication solutions including 2G/3G/4G/5G applied to smart devices.
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接受的电磁波信号解调为低频基带信号。无线通信模块360可以提供应用在智能设备上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,WI-FI)网络),蓝牙(bluetooth,BT),北斗卫星导航系统(BeiDou navigation satellite system,BDS),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR),超宽带(ultra-wideband,UWB)等无线通信的解决方案。A modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The wireless communication module 360 can provide applications on smart devices including wireless local area networks (WLAN) (such as wireless fidelity (wireless fidelity, WI-FI) network), Bluetooth (bluetooth, BT), Beidou satellite navigation system (BeiDou navigation satellite system, BDS), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) , ultra-wideband (UWB) and other wireless communication solutions.
在本申请实施例中,智能设备作为数字车钥匙,支持UWB通信技术,因此本申请实施例所述数字车钥匙也称UWB车钥匙。其中,UWB通信技术是一种无载波通信技术,由于UWB的覆盖距离远、穿透能力强、抗多径衰减能力强等优点,本申请实施例提供的方案,可以利用UWB实现高精度的测距。In the embodiment of the present application, the smart device serves as a digital car key and supports UWB communication technology. Therefore, the digital car key in the embodiment of the present application is also called a UWB car key. Among them, UWB communication technology is a carrier-less communication technology. Due to the advantages of UWB, such as long coverage distance, strong penetration ability, and strong resistance to multipath attenuation, the solution provided by the embodiment of the present application can use UWB to achieve high-precision measurement. distance.
在本申请实施例中,智能设备中可以集成有UWB芯片,智能设备可以通过该UWB芯片支持UWB通信技术。In this embodiment of the present application, a UWB chip can be integrated into the smart device, and the smart device can support UWB communication technology through the UWB chip.
智能设备通过图形处理器(graphics processing unit,GPU),显示屏394,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏394和应用处理器。GPU用于执行数据和几何计算,用于图形渲染。处理器310可以包括一个或多个GPU,其执行程序指令以生成或改变显示信息。Smart devices implement display functions through a graphics processor (graphics processing unit, GPU), display screen 394, and application processor. The GPU is an image processing microprocessor and is connected to the display screen 394 and the application processor. GPUs are used to perform data and geometric calculations for graphics rendering. Processor 310 may include one or more GPUs that execute program instructions to generate or alter display information.
显示屏394用于显示图像,视频等。显示屏394包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体(active-matrix organic light emitting diode,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),量子点发光二极管(quantum dot light emitting diodes,QLED)等。The display screen 394 is used to display images, videos, etc. Display 394 includes a display panel. The display panel can use liquid crystal display (LCD), organic light-emitting diode (OLED), active-matrix organic light-emitting diode (AMOLED), flexible light-emitting diode Diode (flex light-emitting diode, FLED), quantum dot light emitting diode (quantum dot light emitting diode, QLED), etc.
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其它数字信号。例如,当智能设备在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when a smart device selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
视频编解码器用于对数字视频压缩或解压缩。智能设备可以支持一种或多种视频编解码器。这样,智能设备可以播放或录制多种编码格式的视频,例如,动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。Video codecs are used to compress or decompress digital video. Smart devices can support one or more video codecs. In this way, smart devices can play or record videos in multiple encoding formats, such as moving picture experts group (MPEG)1, MPEG2, MPEG3, MPEG4, etc.
NPU为神经网络(neural-network,NN)计算处理器,通过借鉴生物神经网络结构,例如借鉴人脑神经元之间传递模式,对输入信息快速处理,还可以不断的自学习。NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can continuously learn by itself.
外部存储器接口320可以用于连接外部存储卡,例如Micro SD卡,实现扩展智能设备的存储能力。外部存储卡通过外部存储器接口320与处理器310通信,实现数据存储功能。例如将音频、视频、图片等文件保存在外部存储卡中。The external memory interface 320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the smart device. The external memory card communicates with the processor 310 through the external memory interface 320 to implement the data storage function. For example, save audio, video, pictures and other files in an external memory card.
内部存储器321可以用于存储计算机程序的可执行程序代码。示例性地,计算机 程序可以包括操作系统程序和应用程序。其中,可执行程序代码包括指令。处理器310通过运行存储在内部存储器321的指令,从而执行智能设备的各种功能应用以及数据处理。内部存储器321可以包括存储程序区和存储数据。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序等。存储数据区可存储智能设备使用过程中所创建的数据(比如任务卡片等)等。此外,内部存储器321可以包括高速随机存取存储器,还可以包括非易失性存储器,例如,至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。Internal memory 321 may be used to store executable program code for computer programs. By way of example, computer programs may include operating system programs and application programs. Among them, the executable program code includes instructions. The processor 310 executes instructions stored in the internal memory 321 to execute various functional applications and data processing of the smart device. The internal memory 321 may include a program storage area and a storage data area. Among them, the stored program area can store the operating system, at least one application program required for the function, etc. The storage data area can store data created during the use of smart devices (such as task cards, etc.). In addition, the internal memory 321 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, a flash memory device, universal flash storage (UFS), etc.
智能设备可以通过音频模块370,扬声器370A,受话器370B,麦克风370C,耳机接口370D,以及应用处理器等实现音频功能。例如,音频播放,录音等。The smart device can implement audio functions through the audio module 370, speaker 370A, receiver 370B, microphone 370C, headphone interface 370D, and application processor. For example, audio playback, recording, etc.
触摸传感器380K,也称“触控面板”。触摸传感器380K可以设置于显示屏394,由触摸传感器380K与显示屏394组成触摸屏,也称“触控屏”。触摸传感器380K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作(包括触摸位置、触摸力度、接触面积和触摸时长等信息)传递给处理器,以确定触摸事件类型。可以通过显示屏394提供与触摸操作相关的视觉输出。在另一些实施例中,触摸传感器380K也可以设置于智能设备的表面,与显示屏394所处的位置不同。Touch sensor 380K, also called "touch panel". The touch sensor 380K can be disposed on the display screen 394. The touch sensor 380K and the display screen 394 form a touch screen, which is also called a "touch screen". Touch sensor 380K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation (including information such as touch location, touch strength, contact area, and touch duration) to the processor to determine the touch event type. Visual output related to the touch operation may be provided through display screen 394. In other embodiments, the touch sensor 380K may also be disposed on the surface of the smart device at a different location from the display screen 394 .
陀螺仪传感器380B可以用于确定智能设备的运动过程中的姿态。在一些实施例中,可以通过陀螺仪传感器380B确定智能设备围绕三个轴(即,x,y和z轴)的旋转速率(即角速度)。The gyro sensor 380B may be used to determine the posture of the smart device during movement. In some embodiments, the rate of rotation (ie, angular velocity) of the smart device about three axes (ie, x, y, and z axes) may be determined by gyro sensor 380B.
磁传感器380D包括霍尔传感器。在一些实施例中,可以通过智能设备感应磁场强度来测量电流、位置、方向等物理参数。Magnetic sensor 380D includes a Hall sensor. In some embodiments, physical parameters such as current, position, and direction can be measured by sensing magnetic field strength through smart devices.
加速度传感器380E可检测智能设备在各个方向上(一般为三轴)加速度的大小。当智能设备静止时可检测出重力的大小及方向,还可以用于识别智能设备的姿态等。The acceleration sensor 380E can detect the acceleration of the smart device in all directions (generally three axes). When the smart device is stationary, it can detect the magnitude and direction of gravity, and can also be used to identify the posture of the smart device.
可以理解的是,本申请实施例示意的结构并不构成对智能设备的具体限定。在本申请另一些实施例中,智能设备可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the smart device. In other embodiments of the present application, the smart device may include more or less components than shown in the figures, or combine some components, or split some components, or arrange different components. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.
需要说明的是,在本申请实施例中,车辆并不具体指代某一种交通工具。可选地,车辆可以是基于地面的交通工具,例如轿车、公共汽车、地铁、高铁等。可选地,车辆也可以是基于水面的交通工具,例如船、气垫船、潜水艇等。可选地,车辆还可以是空中交通工具,例如飞机、直升机等。It should be noted that in the embodiment of this application, vehicle does not specifically refer to a certain type of vehicle. Alternatively, the vehicle may be a ground-based vehicle, such as a car, a bus, a subway, a high-speed rail, etc. Alternatively, the vehicle may also be a water-based vehicle, such as a boat, hovercraft, submarine, etc. Optionally, the vehicle may also be an air vehicle, such as an airplane, a helicopter, etc.
其中,本申请实施例所述车辆上设置有车载系统,该车载系统可以包括数字车钥匙定位系统。请参考图4,图4示出了本申请实施例提供的一种数字车钥匙定位系统结构示意图。如图4所示,数字车钥匙定位系统400可以包括多个超宽带(ultra-wideband,UWB)模块401、数字车钥匙定位装置402和运动数据获取模块403。Among them, the vehicle described in the embodiment of the present application is equipped with a vehicle-mounted system, and the vehicle-mounted system may include a digital car key positioning system. Please refer to FIG. 4 , which shows a schematic structural diagram of a digital car key positioning system provided by an embodiment of the present application. As shown in FIG. 4 , the digital car key positioning system 400 may include multiple ultra-wideband (UWB) modules 401 , a digital car key positioning device 402 and a motion data acquisition module 403 .
其中,UWB模块401具备UWB信号(如6.5GHz频段UWB信号)的接收和发送功能。在本申请实施例中,UWB模块401可以与数字车钥匙之间基于UWB技术进行通信。例如,UWB车钥匙可以通过UWB芯片与UWB模块401之间相互发送和接收UWB信号。Among them, the UWB module 401 has the function of receiving and transmitting UWB signals (such as 6.5GHz frequency band UWB signals). In this embodiment of the present application, the UWB module 401 can communicate with the digital car key based on UWB technology. For example, a UWB car key can send and receive UWB signals to each other through the UWB chip and the UWB module 401.
作为一种可能的情况,UWB车钥匙的载体为智能设备(如智能手机、智能手环), UWB芯片集成在智能设备中。对于这种情况,智能设备可以通过其中集成的UWB芯片与车辆上部署的UWB模块401之间相互发送和接收UWB信号。As a possible situation, the carrier of the UWB car key is a smart device (such as a smartphone, a smart bracelet), and the UWB chip is integrated in the smart device. For this case, the smart device can send and receive UWB signals to each other through the UWB chip integrated therein and the UWB module 401 deployed on the vehicle.
作为另一种可能的情况,UWB车钥匙的载体为实体钥匙,UWB芯片集成在该实体钥匙中。对于这种情况,UWB车钥匙可以通过该实体钥匙中集成的UWB芯片与车辆上部署的UWB模块401之间相互发送和接收UWB信号。运动数据获取模块403用于获取用户携带的智能设备的运动数据。在本申请实施例中,智能设备的运动数据也称行人航位推算(pedestrian dead reckoning,PDR)数据。As another possible situation, the carrier of the UWB car key is a physical key, and the UWB chip is integrated into the physical key. For this situation, the UWB car key can send and receive UWB signals to each other through the UWB chip integrated in the physical key and the UWB module 401 deployed on the vehicle. The motion data acquisition module 403 is used to acquire motion data of the smart device carried by the user. In the embodiment of this application, the movement data of the smart device is also called pedestrian dead reckoning (pedestrian dead reckoning, PDR) data.
可以理解,对于数字车钥匙的载体是智能设备的情况,由于UWB车钥匙以软件形式安装在智能设备中,因此智能设备的运动数据便可以理解为UWB车钥匙的运动数据。对于数字车钥匙的载体是实体钥匙的情况,由于智能设备和实体钥匙均被用户随身携带,因此智能设备的运动数据便可以理解为实体钥匙的运动数据,即为UWB车钥匙的运动数据。UWB车钥匙的运动数据用于表示UWB车钥匙的坐标偏移和角度变化。It can be understood that when the carrier of the digital car key is a smart device, since the UWB car key is installed in the smart device in the form of software, the motion data of the smart device can be understood as the motion data of the UWB car key. For the case where the carrier of the digital car key is a physical key, since both the smart device and the physical key are carried by the user, the motion data of the smart device can be understood as the motion data of the physical key, that is, the motion data of the UWB car key. The motion data of the UWB car key is used to represent the coordinate offset and angle change of the UWB car key.
在本申请实施例中,数字车钥匙定位装置402可以在UWB车钥匙位于车外时,根据用户随身携带的智能设备的运动数据和UWB车钥匙的测距数据(也称“测距值”)融合的算法(以下简称“融合位姿策略”(也称“融合位姿算法”))对UWB车钥匙的运动轨迹进行持续跟踪。在识别到UWB车钥匙由车外进入车内时,切换为车内位置识别策略(以下简称“增强识别策略”(也称“增强识别算法”)),从定位数据库中查找与测距数据相似度最高的定位数据,以非常小的误差确定UWB车钥匙在车内的具体位置。其中,UWB车钥匙在车内的位置即定位数据库中与测距数据相似度最高的定位数据所对应的位置。In the embodiment of the present application, the digital car key positioning device 402 can, when the UWB car key is outside the car, use the motion data of the smart device carried by the user and the ranging data of the UWB car key (also called the "ranging value") The fused algorithm (hereinafter referred to as "fusion pose strategy" (also called "fusion pose algorithm")) continuously tracks the movement trajectory of the UWB car key. When it is recognized that the UWB car key enters the car from outside the car, it switches to the in-car location recognition strategy (hereinafter referred to as the "enhanced recognition strategy" (also known as the "enhanced recognition algorithm")), and searches for similar ranging data from the positioning database. The highest accuracy positioning data can determine the specific location of the UWB car key in the car with a very small error. Among them, the position of the UWB car key in the car is the position corresponding to the positioning data with the highest similarity to the ranging data in the positioning database.
其中,UWB车钥匙的测距数据是数字车钥匙定位装置402根据UWB模块401和UWB芯片之间基于UWB技术的通信,计算得到的UWB模块401和UWB车钥匙之间的距离。Among them, the ranging data of the UWB car key is the distance between the UWB module 401 and the UWB car key calculated by the digital car key positioning device 402 based on the communication between the UWB module 401 and the UWB chip based on UWB technology.
需要说明的是,本申请实施例所述车外场景是指UWB车钥匙位于车辆外轮廓外扩预设距离(如20厘米)以外区域的场景;相应的,车内场景是指UWB车钥匙位于车辆外轮廓外扩预设距离(如20厘米)以内区域的场景。同样地道理,车外是指车辆外轮廓外扩预设距离(如20厘米)以外区域;车内是指车辆外轮廓外扩预设距离(如20厘米)以内区域。It should be noted that the scene outside the vehicle described in the embodiment of the present application refers to the scene in which the UWB car key is located in an area beyond the preset distance (such as 20 cm) outside the outer contour of the vehicle; correspondingly, the scene in the car refers to the scene in which the UWB car key is located in the area outside the outer contour of the vehicle. Scenes in which the outer contour of the vehicle extends to an area within a preset distance (such as 20 cm). In the same way, the outside of the vehicle refers to the area beyond the preset distance (such as 20 cm) from the outer contour of the vehicle; the inside of the vehicle refers to the area within the preset distance (such as 20 cm) from the outer contour of the vehicle.
另外,在本申请实施例中,数字车钥匙定位装置确定的UWB车钥匙在车外的位置或者UWB车钥匙在车内的位置可以是相对于预设坐标系(如惯性参考坐标系)的位置。示例性地,惯性参考坐标系可以是原点位于车辆上(如车辆中心位置、车头左侧位置、车头右侧位置等,本申请实施例不做限定),x轴指向车辆横向方向。y轴指向车辆纵向方向。关于惯性参考坐标系的具体定义,本申请实施例不做限定。In addition, in the embodiment of the present application, the position of the UWB car key outside the car or the position of the UWB car key inside the car determined by the digital car key positioning device may be the position relative to a preset coordinate system (such as an inertial reference coordinate system) . For example, the inertial reference coordinate system may have its origin located on the vehicle (such as the center position of the vehicle, the left position of the vehicle front, the right position of the vehicle front, etc., which are not limited in this embodiment), and the x-axis points in the transverse direction of the vehicle. The y-axis points to the longitudinal direction of the vehicle. Regarding the specific definition of the inertial reference coordinate system, the embodiment of this application does not limit it.
示例性地,请参考图5,图5示出了本申请实施例提供的一种UWB车钥匙定位逻辑过程示意图。如图5所示,数字车钥匙定位装置可以采用融合位姿策略进行UWB车钥匙的车外运动轨迹跟踪和进行UWB车钥匙的车内外识别。在识别到UWB车钥匙仍然位于车外(即从车外进入车内)时,继续采用融合位姿策略进行UWB车钥匙的车外运动轨迹跟踪和进行UWB车钥匙的车内外识别。相反地,在识别到UWB车钥匙位于车内时,采用增强识别策略进行UWB车钥匙在车内的定位。进一步地,数字车钥匙定位装置在UWB车钥匙位于车内的过程中也持续进行UWB车钥匙的车内外识别。在识别到UWB车钥匙从车内到车外时,切换为融合位姿策略进行UWB车钥匙的车外运动轨迹跟踪。For example, please refer to FIG. 5 , which shows a schematic diagram of a UWB car key positioning logic process provided by an embodiment of the present application. As shown in Figure 5, the digital car key positioning device can use the fusion pose strategy to track the movement trajectory of the UWB car key outside the car and identify the UWB car key inside and outside the car. When it is recognized that the UWB car key is still outside the car (that is, entering the car from outside the car), the fusion pose strategy is continued to be used to track the movement trajectory of the UWB car key outside the car and identify the UWB car key inside and outside the car. On the contrary, when it is recognized that the UWB car key is located in the car, an enhanced recognition strategy is used to locate the UWB car key in the car. Furthermore, the digital car key positioning device also continues to identify the UWB car key inside and outside the car while the UWB car key is located in the car. When it is recognized that the UWB car key moves from inside the car to outside the car, it switches to the fusion pose strategy to track the movement trajectory of the UWB car key outside the car.
其中,在本申请实施例中,车辆上可以部署有多个UWB模块。UWB模块可以是UWB基站等网络节点。通常,车辆上部署的UWB模块的数量至少为3个。示例性地,车辆上部署的UWB模块的数量可以为5-6个。In this embodiment of the present application, multiple UWB modules may be deployed on the vehicle. The UWB module can be a network node such as a UWB base station. Typically, the number of UWB modules deployed on a vehicle is at least 3. For example, the number of UWB modules deployed on the vehicle may be 5-6.
在一些实施例中,为了保证UWB信号不被遮挡,该多个UWB模块可以设置于车辆上金属比较少、辐射面开阔的位置。示例性地,该多个UWB模块可以设置于车辆的车头处、车尾处、车顶位置处等。本申请实施例对多个UWB模块的具体设置位置不做限定。In some embodiments, in order to ensure that the UWB signal is not blocked, the multiple UWB modules can be installed in a location on the vehicle with relatively little metal and an open radiation surface. For example, the plurality of UWB modules may be disposed at the front, rear, roof, etc. of the vehicle. The embodiments of this application do not limit the specific placement locations of the multiple UWB modules.
示例性地,以UWB模块为UWB基站为例,请参考图6或图7,图6和图7示出了车辆上UWB模块(图6和图7以UWB基站作为示例)的分布示意图。图6或图7所示车辆上部署有6个UWB基站,分别为UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6。如图6或图7所示,UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6分别位于车头左侧位置、车头右侧位置、车顶前侧位置、车尾左侧位置、车尾右侧位置、车顶后侧位置。For example, taking the UWB module as a UWB base station as an example, please refer to Figure 6 or Figure 7 . Figures 6 and 7 show a schematic distribution diagram of the UWB module on the vehicle (Figures 6 and 7 take the UWB base station as an example). There are six UWB base stations deployed on the vehicle shown in Figure 6 or Figure 7, namely UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6. As shown in Figure 6 or Figure 7, UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 are respectively located on the left side of the front of the car, the right side of the front of the car, and the front side of the roof. The position on the left side of the rear of the car, the right position of the rear of the car, and the position on the rear side of the roof.
以图6所示UWB模块分布示意图为例,数字车钥匙定位装置402可以用于根据位于车外的UWB车钥匙通过UWB芯片分别与UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6的通信,计算UWB车钥匙分别与UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6之间的距离L1、L2、L3、L4、L5和L6。Taking the schematic diagram of UWB module distribution shown in Figure 6 as an example, the digital car key positioning device 402 can be used to communicate with UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, respectively through the UWB chip according to the UWB car key located outside the car. Communication between UWB base station 5 and UWB base station 6, calculate the distances L1, L2, L3, L4 between the UWB car key and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 respectively. , L5 and L6.
或者,以图7所示UWB模块分布示意图为例,数字车钥匙定位装置402可以用于根据位于车内的UWB车钥匙通过UWB芯片分别与UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6的通信,计算UWB车钥匙分别与UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6之间的距离L1、L2、L3、L4、L5和L6,进而通过根据L1、L2、L3、L4、L5和L6计算得到UWB车钥匙的具体位置,实现对UWB车钥匙在车内的精确定位。Or, taking the UWB module distribution diagram shown in Figure 7 as an example, the digital car key positioning device 402 can be used to communicate with UWB base station 1, UWB base station 2, UWB base station 3, and UWB base station respectively through the UWB chip according to the UWB car key located in the car. 4. Communication between UWB base station 5 and UWB base station 6, calculate the distances L1, L2, and L3 between the UWB car key and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5, and UWB base station 6 respectively. , L4, L5 and L6, and then calculate the specific position of the UWB car key based on L1, L2, L3, L4, L5 and L6 to achieve precise positioning of the UWB car key in the car.
示例性地,本申请实施例所述数字车钥匙定位装置402在基于UWB通信计算UWB模块401和UWB车钥匙之间的距离(即测距值)时,可以采用飞行时间(time of flight,TOF)算法(也称时差法),根据UWB信号在传输过程中所耗费的时间,确定UWB模块401和UWB车钥匙之间的距离。可选地,数字车钥匙定位装置402还可以通过设置多天线阵列,确定UWB车钥匙与多天线阵列之间的角度,并基于各角度确定UWB模块401和UWB车钥匙之间的距离。对于计算UWB模块401和UWB车钥匙之间距离的具体方法和过程,本申请实施例不做具体限定。Illustratively, when the digital car key positioning device 402 in the embodiment of the present application calculates the distance (i.e., ranging value) between the UWB module 401 and the UWB car key based on UWB communication, it can use time of flight (TOF). ) algorithm (also called the time difference method) determines the distance between the UWB module 401 and the UWB car key based on the time it takes for the UWB signal to be transmitted. Optionally, the digital car key positioning device 402 can also determine the angle between the UWB car key and the multi-antenna array by setting up a multi-antenna array, and determine the distance between the UWB module 401 and the UWB car key based on each angle. The embodiments of this application do not specifically limit the specific method and process of calculating the distance between the UWB module 401 and the UWB car key.
其中,本申请实施例所述数字车钥匙定位装置402根据UWB模块401和UWB车钥匙之间的距离对UWB车钥匙进行定位时可以基于到达时间定位(time of arrival,TOA)法或者到达时间差定位(time difference of arrival,TDOA)法等方法,或者基于圆形/球形定位模型、双曲线/面定位模型或者角度定位模型等任意定位模块实现,本申请实施例不做具体限定。Among them, when the digital car key positioning device 402 in the embodiment of the present application locates the UWB car key according to the distance between the UWB module 401 and the UWB car key, it can be based on the time of arrival (TOA) method or the arrival time difference positioning. (time difference of arrival, TDOA) method and other methods, or based on any positioning module such as circular/spherical positioning model, hyperbola/surface positioning model or angle positioning model. The embodiments of this application are not specifically limited.
可选地,在本申请实施例中,在进行车外场景与车内场景下的UWB车钥匙定位时,均可以使用图4所示UWB模块401和数字车钥匙定位装置402。基于此,可以在简化车载系统的前提下,减小硬件部署和维护上的花费。Optionally, in this embodiment of the present application, the UWB module 401 and the digital car key positioning device 402 shown in Figure 4 can be used when positioning the UWB car key in both the exterior and interior scenes. Based on this, the cost of hardware deployment and maintenance can be reduced while simplifying the vehicle system.
示例性地,运动数据获取模块403可以基于智能设备中的惯性测量单元(inertial  measurement unit,IMU)、视觉惯性里程计(visual inertial odometer,VIO)、惯性导航(inertial navigation system,INS)、轮速计等在智能设备运动的过程中采集的数据获取智能设备的运动数据。For example, the motion data acquisition module 403 can be based on an inertial measurement unit (IMU), a visual inertial odometer (VIO), an inertial navigation system (INS), and wheel speed in a smart device. Ji et al. obtain the movement data of the smart device from the data collected during the movement of the smart device.
其中,IMU是一种传感器组合(如加速度传感器和陀螺仪传感器的组合)。在本申请实施例中,IMU可以用于获取智能设备(即UWB车钥匙)的运动加速度、运动方向等加速度数据,以及旋转速率、旋转方向等陀螺仪数据。Among them, IMU is a sensor combination (such as a combination of acceleration sensor and gyroscope sensor). In the embodiment of this application, the IMU can be used to obtain acceleration data such as motion acceleration and motion direction of the smart device (i.e., UWB car key), as well as gyroscope data such as rotation rate and rotation direction.
VIO也称视觉惯性系统(visual-inertial system,VINS)。VIO可以融合相机和IMU采集的加速度数据和陀螺仪数据等数据,实现即时定位与地图构建或并发建图与定位(simultaneous localization and mapping,SLAM)。VIO is also called visual-inertial system (VINS). VIO can integrate acceleration data and gyroscope data collected by cameras and IMUs to achieve instant positioning and map construction or concurrent mapping and positioning (simultaneous localization and mapping, SLAM).
惯性导航是一种利用陀螺仪传感器和加速度传感器来确定其运载体(即智能设备)位置的一个系统。惯性导航可以根据陀螺仪传感器和加速度传感器测量的其运载体(即智能设备)加速度数据和陀螺仪数据,确定其运载体(即智能设备)在惯性参考坐标系中的位置。Inertial navigation is a system that uses gyroscope sensors and acceleration sensors to determine the position of its carrier (i.e., smart device). Inertial navigation can determine the position of its carrier (that is, smart device) in the inertial reference coordinate system based on the acceleration data and gyroscope data of its carrier (that is, smart device) measured by the gyroscope sensor and acceleration sensor.
示例性地,惯性参考坐标系的原点可以为车辆扶手箱所在位置,x轴和y轴平行于地面且互相垂直,x轴正方向为由原点指向车辆右舷的方向,y轴正方向为由原点指向车头的方向。但是,本申请实施例并不限定惯性参考坐标系的具体定义。For example, the origin of the inertial reference coordinate system can be the location of the armrest box of the vehicle. The x-axis and y-axis are parallel to the ground and perpendicular to each other. The positive direction of the x-axis is pointing from the origin to the starboard side of the vehicle, and the positive direction of the y-axis is from the origin. Point in the direction of the front of the car. However, the embodiment of the present application does not limit the specific definition of the inertial reference coordinate system.
在本申请实施例中,加速度传感器的工作原理是通过测量组件在某个轴向的受力情况判断智能设备的运动加速度和运动方向。陀螺仪传感器的工作原理是通过测量三维坐标系内陀螺转子的垂直轴与智能设备之间的旋转速率(即角速度)来判别智能设备在三维空间的运动姿态(即UWB车钥匙的运动姿态)。In the embodiment of this application, the working principle of the acceleration sensor is to determine the motion acceleration and motion direction of the smart device by measuring the force on the component in a certain axial direction. The working principle of the gyro sensor is to determine the movement posture of the smart device in the three-dimensional space (i.e. the movement posture of the UWB car key) by measuring the rotation rate (i.e. angular velocity) between the vertical axis of the gyro rotor and the smart device in the three-dimensional coordinate system.
本申请实施例中,加速度传感器和陀螺仪传感器采集的数据可以用三轴角速度ωx,ωy,ωz和三轴加速度ax,ay,az来表示。其中,三轴角速度可以理解为智能设备围绕x,y,z三个轴的角速度,三轴加速度可以理解为智能设备在x,y,z三个轴上的加速度。In the embodiment of the present application, the data collected by the acceleration sensor and the gyroscope sensor can be represented by the three-axis angular velocity ωx, ωy, ωz and the three-axis acceleration ax, ay, az. Among them, the three-axis angular velocity can be understood as the angular velocity of the smart device around the three axes x, y, and z, and the three-axis acceleration can be understood as the acceleration of the smart device on the three axes x, y, and z.
示例性,如图8所示,智能设备在x,y,z三维坐标系中的运动可以包括三个平移运动和三个旋转运动,其中,三个平移运动包括智能设备在x轴上进行的向左、向右平移运动,在y轴上进行的向前、向后平移运动以及在z轴上进行的向上、向下平移运动。三个旋转运动包括智能设备围绕x轴的旋转运动(旋转的角度也称俯仰角Pitch),围绕y轴的旋转运动(旋转的角度也称偏航角Yaw),围绕z轴的旋转运动(旋转的角度也称横滚角Roll)。For example, as shown in Figure 8, the movement of the smart device in the x, y, z three-dimensional coordinate system may include three translational movements and three rotational movements, where the three translational movements include the movement of the smart device on the x-axis. Translational motion to the left and right, forward and backward translational motion on the y-axis, and upward and downward translational motion on the z-axis. The three rotational motions include the rotational motion of the smart device around the x-axis (the angle of rotation is also called the pitch angle), the rotational motion around the y-axis (the angle of rotation is also called the yaw angle Yaw), and the rotational motion around the z-axis (the angle of rotation is also called the yaw angle). The angle is also called the roll angle (Roll).
可以理解,智能设备的运动包括在x,y,z三个轴上各自的平移运动时,在x,y,z三个轴上各自会对应一个加速度即ax,ay,az。智能设备的运动包括围绕x,y,z三个轴上各自的旋转运动时,在x,y,z三个轴上各自会对应一个角速度即ωx,ωy,ωz。由于智能设备在三维空间中的运动可以分解为在x,y,z三个轴上的平移和/或运动。因此,智能设备在行驶过程中产生的位置和姿态变化,可以通过智能设备在x,y,z三个轴上的三轴角速度ωx,ωy,ωz和三轴加速度ax,ay,az来表示。It can be understood that when the motion of a smart device includes translational motion on the three axes of x, y, and z, there will be an acceleration corresponding to ax, ay, and az on the three axes of x, y, and z. When the motion of a smart device includes rotational motion around the three axes of x, y, and z, each of the three axes of x, y, and z will correspond to an angular velocity, namely ωx, ωy, and ωz. Because the movement of smart devices in three-dimensional space can be decomposed into translation and/or movement on the three axes of x, y, and z. Therefore, the position and attitude changes of the smart device during driving can be represented by the three-axis angular velocity ωx, ωy, ωz and the three-axis acceleration ax, ay, az of the smart device on the three axes of x, y, and z.
由于加速度传感器和陀螺仪传感器采集的数据用于表征智能设备在x,y,z三维坐标系中的三个平移运动和三个旋转运动,因此也称为六个自由度。因此,在一些实施方式中,加速度传感器和陀螺仪传感器采集的数据也可以称作自由度数据。Since the data collected by the acceleration sensor and gyroscope sensor are used to characterize the three translational movements and three rotational movements of the smart device in the x, y, z three-dimensional coordinate system, it is also called six degrees of freedom. Therefore, in some embodiments, the data collected by the acceleration sensor and the gyroscope sensor may also be referred to as degree-of-freedom data.
进一步可选地,在本申请实施例中,车载系统还可以包括智能化控制模块,用于为用户提供智能化的控制,如车辆控制、迎宾、解锁车门、解锁后备箱、闭锁后备箱、闭锁车 门、关闭车灯、启动车辆、播放音乐、在显示屏显示预设应用界面、打开空调等。Further optionally, in the embodiment of the present application, the vehicle-mounted system may also include an intelligent control module for providing intelligent control for users, such as vehicle control, welcome, unlocking doors, unlocking the trunk, locking the trunk, Lock the door, turn off the lights, start the vehicle, play music, display the preset application interface on the display, turn on the air conditioner, etc.
进一步可选地,在本申请实施例中,车载系统还可以包括车载终端。其中,车载终端是设置在车辆上的终端设备。示例性地,车载终端可以集成在车辆上。可选地,车载终端也可以独立于车辆,安装在车辆上。车载终端可以包括位于车内多个位置的多个显示屏,如中控屏(也称主驾屏)、副驾屏、左后屏和右后屏。关于车载系统中的其它功能模块,可以参考常规技术,本申请实施例不做具体限定。Further optionally, in this embodiment of the present application, the vehicle-mounted system may also include a vehicle-mounted terminal. Among them, the vehicle-mounted terminal is a terminal device installed on the vehicle. For example, the vehicle-mounted terminal may be integrated on the vehicle. Optionally, the vehicle-mounted terminal can also be installed on the vehicle independently of the vehicle. The vehicle-mounted terminal may include multiple display screens located at multiple locations in the vehicle, such as a central control screen (also called a main driving screen), a passenger screen, a left rear screen, and a right rear screen. Regarding other functional modules in the vehicle system, conventional technologies may be referred to, and are not specifically limited in the embodiments of this application.
其中,对UWB车钥匙的运动轨迹进行持续跟踪用于精确识别UWB车钥匙在车外的位置,以便在确定UWB车钥匙靠近车辆时提供迎宾、解锁车门、解锁后备箱等相应的智能化的汽车控制服务;以及,在确定UWB车钥匙远离车辆时提供闭锁后备箱、闭锁车门、关闭车灯等相应的智能化的汽车控制服务。Among them, the continuous tracking of the movement trajectory of the UWB car key is used to accurately identify the position of the UWB car key outside the car, so that when it is determined that the UWB car key is close to the vehicle, corresponding intelligent functions such as welcoming guests, unlocking the door, and unlocking the trunk can be provided. Car control services; and, when it is determined that the UWB car key is far away from the vehicle, corresponding intelligent car control services such as locking the trunk, locking the doors, and turning off the lights are provided.
以及,确定UWB车钥匙在车内的具体位置用于根据UWB车钥匙在车内的精确位置提供个性化、智能化的汽车控制服务。例如,在确定UWB车钥匙位于主驾座位时,提供无钥匙启动车辆、启动中控屏并在中控屏显示预设应用界面、打开空调等功能。又如,在确定UWB车钥匙位于副驾座位时,提供启动副驾屏并在副驾屏显示预设应用界面等功能。And, determining the specific location of the UWB car key in the car is used to provide personalized and intelligent car control services based on the precise location of the UWB car key in the car. For example, when it is determined that the UWB car key is in the driver's seat, functions such as keyless starting of the vehicle, starting the central control screen and displaying the preset application interface on the central control screen, and turning on the air conditioner are provided. For another example, when it is determined that the UWB car key is located in the passenger seat, functions such as starting the passenger screen and displaying a preset application interface on the passenger screen are provided.
可以理解,在对处于车外的UWB车钥匙进行定位时,若单纯依靠测距数据,可能会在UWB车钥匙位于UWB模块在车外的非视距(non line of sight,NLOS)区(如由于遮挡等原因造成的无法通信的NLOS盲区)时,由于UWB车钥匙和UWB模块无法通信而导致的测距数据缺失甚至测距数据获取失败。测距数据的缺失会大大影响车外场景下UWB车钥匙定位的准确性。而测距数据获取失败会直接导致车外场景下UWB车钥匙定位的失败。It can be understood that when locating the UWB car key outside the car, if you rely solely on ranging data, the UWB car key may be located in the non-line of sight (NLOS) area of the UWB module outside the car (such as When the NLOS blind zone cannot communicate due to occlusion and other reasons), the ranging data is missing or even the ranging data acquisition fails due to the inability of the UWB car key and the UWB module to communicate. The lack of ranging data will greatly affect the accuracy of UWB car key positioning in off-car scenarios. The failure to obtain ranging data will directly lead to the failure of UWB car key positioning in the scene outside the car.
以及,在对处于车外的UWB车钥匙进行定位时,若单纯依靠UWB车钥匙的运动数据,虽然可以确定UWB车钥匙的位置变化,但是无法确定UWB车钥匙与车辆之间的相对位置关系。Also, when locating the UWB car key outside the car, if you rely solely on the movement data of the UWB car key, although the position change of the UWB car key can be determined, the relative positional relationship between the UWB car key and the vehicle cannot be determined.
而本申请实施例提供的方案在车外场景中采用运动数据和测距数据融合的定位策略,该方案可以通过UWB车钥匙的运动数据弥补处于NLOS区时测距数据缺失或者测距数据获取失败的弊端,以及通过测距数据弥补单纯基于UWB车钥匙的运动数据无法确定UWB车钥匙与车辆之间的相对位置关系的弊端。并且,在车外的视距(line of sight,LOS)区,运动数据和测距数据融合的定位策略也可以得到比基于单一类别数据更加精确的定位结果。因此,无论UWB车钥匙位于车外的NLOS区还是LOS区,基于融合位姿策略均可以提供车外场景下稳定、连贯、精确的UWB车钥匙定位能力。The solution provided by the embodiments of this application uses a positioning strategy that integrates motion data and ranging data in the off-car scene. This solution can use the motion data of the UWB car key to compensate for the lack of ranging data or the failure to obtain ranging data when it is in the NLOS zone. The disadvantages of using ranging data to compensate for the inability to determine the relative positional relationship between the UWB car key and the vehicle based solely on the motion data of the UWB car key. Moreover, in the line of sight (LOS) area outside the vehicle, the positioning strategy that integrates motion data and ranging data can also obtain more accurate positioning results than based on a single category of data. Therefore, regardless of whether the UWB car key is located in the NLOS area or LOS area outside the car, the fusion pose strategy can provide stable, consistent, and accurate UWB car key positioning capabilities in the outside scene.
另外,可以理解,在对处于车内的UWB车钥匙进行定位时,由于基于UWB车钥匙的运动数据仅能确定UWB车钥匙相的位置变化,而无法确定UWB车钥匙在车辆内的具体位置,因此无法基于UWB车钥匙的运动数据实现对UWB车钥匙的定位。并且,车内场景下,由于座位的遮挡等原因,若采用传统的依据测距数据进行UWB车钥匙位置计算的方法,会由于测距数据缺失甚至测距数据获取失败或者测距不准确等原因导致定位结果不准确的问题。而本申请实施例提供的方案在车内场景中采用增强识别的策略,通过与定位数据库中大量定位数据匹配的方式确定UWB车钥匙在车内的位置,该方法可以提供车内场景下稳定、连贯、精确的UWB车钥匙定位能力,例如识别UWB车钥匙位于主驾驶 位、副驾驶位还是后排位,或者还可以进一步识别UWB车钥匙位于后排的左后座位还是右后座位。In addition, it can be understood that when locating the UWB car key in the car, since the motion data of the UWB car key can only determine the position change of the UWB car key phase, but cannot determine the specific position of the UWB car key in the vehicle. Therefore, it is impossible to position the UWB car key based on the motion data of the UWB car key. Moreover, in the car scene, due to the occlusion of seats and other reasons, if the traditional method of calculating the UWB car key position based on ranging data is used, the ranging data may be missing or even the ranging data may fail to be obtained or the ranging may be inaccurate. Problems that lead to inaccurate positioning results. The solution provided by the embodiment of the present application adopts an enhanced recognition strategy in the car scene and determines the position of the UWB car key in the car by matching with a large amount of positioning data in the positioning database. This method can provide stable and reliable identification in the car scene. Consistent and accurate UWB car key positioning capabilities, such as identifying whether the UWB car key is located in the main driver's seat, passenger seat or rear seat, or further identifying whether the UWB car key is located in the left rear seat or right rear seat of the rear row.
其中,在本申请实施例中,数字车钥匙定位装置中可以预先保存有用于辅助进行车内UWB车钥匙定位的定位数据库。或者,数字车钥匙定位系统(如图4所示数字车钥匙定位系统400)还包括用于存储定位数据库的存储单元。定位数据库中包括大量定位数据。定位数据用于表征车内多个位置与车内设置的多个UWB模块之间的测距值。其中,车内多个位置可以包括车内多个座位所在的位置,也可以包括除座位所在位置以外的其它任意位置,本申请实施例不做限定。Among them, in the embodiment of the present application, the digital car key positioning device may pre-store a positioning database used to assist in positioning the UWB car key in the car. Alternatively, the digital car key positioning system (as shown in FIG. 4 as the digital car key positioning system 400 ) further includes a storage unit for storing the positioning database. The positioning database includes a large amount of positioning data. The positioning data is used to represent the ranging values between multiple locations in the car and multiple UWB modules installed in the car. The multiple locations in the car may include locations where multiple seats are located in the vehicle, or may include any other location except where the seats are located, which is not limited in the embodiments of this application.
在一些实施例中,数字车钥匙定位系统还可以包括定位数据训练模块。数字车钥匙定位系统可以通过定位数据训练模块对用户携带UWB车钥匙位于车内多个位置时,UWB车钥匙的测距数据(即后续定位数据训练所依据的样本数据)进行训练,进而得到定位数据库。In some embodiments, the digital car key positioning system may also include a positioning data training module. The digital car key positioning system can use the positioning data training module to train the ranging data of the UWB car key (that is, the sample data based on subsequent positioning data training) when the user carries the UWB car key at multiple locations in the car, and then obtains the positioning database.
在另一些实施例中,数字车钥匙定位系统可以将定位数据训练模块获取的用户携带UWB车钥匙位于车内多个位置时,UWB车钥匙的测距数据发送至云端,由云端对测距数据进行训练,得到定位数据库并将定位数据库下发给数字车钥匙定位系统。In other embodiments, the digital car key positioning system can send the ranging data of the UWB car key obtained by the positioning data training module when the user carries the UWB car key at multiple locations in the car to the cloud, and the cloud will process the ranging data. Conduct training to obtain the positioning database and send the positioning database to the digital car key positioning system.
其中,定位数据库中的一个定位数据包括车内一个位置分别与车内多个UWB模块之间的测距值的集合。一个定位数据与一个位置标签相关联。一个定位数据是一个距离数据组(记作第二距离数据组)。Wherein, a piece of positioning data in the positioning database includes a set of ranging values between a position in the car and multiple UWB modules in the car. A location data is associated with a location tag. One positioning data is a distance data set (denoted as a second distance data set).
示例性地,定位数据可以用
Figure PCTCN2022112172-appb-000001
表示。其中,p i为位置i的标签;O ij用于表示位置i和第j个UWB模块之间的测距值;N为车内UWB模块的数量。位置i和第j个UWB模块之间的测距值即在用户携带UWB车钥匙位于位置i时,数字车钥匙定位装置测量得到的UWB车钥匙和第j个UWB模块之间的测距值。
For example, positioning data can be
Figure PCTCN2022112172-appb-000001
express. Among them, p i is the label of position i; O ij is used to represent the ranging value between position i and the jth UWB module; N is the number of UWB modules in the car. The distance measurement value between position i and the j-th UWB module is the distance measurement value between the UWB car key and the j-th UWB module measured by the digital car key positioning device when the user carries the UWB car key at position i.
以定位数据库中的定位数据分别与图9所示位置901、位置902、位置903、位置904、位置905、位置906、……等位置的位置标签相关联,车内设置有图9所示UWB基站(即UWB模块)1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6为例,定位数据库可以包括定位数据1、定位数据2、定位数据3、定位数据4、定位数据5、定位数据6、定位数据7、……等定位数据。其中,定位数据1包括车内位置901分别与UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6之间的测距值的集合。定位数据2包括车内位置902分别与UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6之间的测距值的集合。定位数据3包括车内位置903分别与UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6之间的测距值的集合。定位数据4包括车内位置904分别与UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6之间的测距值的集合。定位数据5包括车内位置905分别与UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6之间的测距值的集合。定位数据6包括车内位置906分别与UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6之间的测距值的集合。以此类推。The positioning data in the positioning database are respectively associated with the position tags of positions 901, 902, 903, 904, 905, 906, ... shown in Figure 9. The UWB shown in Figure 9 is installed in the car. Taking base station (i.e. UWB module) 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 as an example, the positioning database may include positioning data 1, positioning data 2, positioning data 3, positioning data 4, Positioning data 5, positioning data 6, positioning data 7, ... and other positioning data. Wherein, positioning data 1 includes a set of ranging values between the in-vehicle position 901 and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 respectively. Positioning data 2 includes a set of ranging values between the in-vehicle position 902 and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 respectively. The positioning data 3 includes a set of ranging values between the in-vehicle position 903 and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 respectively. The positioning data 4 includes a set of ranging values between the in-vehicle position 904 and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 respectively. The positioning data 5 includes a set of ranging values between the in-vehicle position 905 and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 respectively. The positioning data 6 includes a set of ranging values between the in-vehicle position 906 and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 respectively. And so on.
例如,定位数据1可以用{(位置901的标签,O 11),(位置901的标签,O 12),(位置901的标签,O 13),(位置901的标签,O 14),(位置901的标签,O 15),(位置901的标签, O 16)}表示。其中,O 11、O 12、O 13、O 14、O 15和O 16分别为用户携带UWB车钥匙位于位置901时,UWB车钥匙与UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6之间的测距值。 For example, positioning data 1 can be represented by {(label of position 901, O 11 ), (label of position 901, O 12 ), (label of position 901, O 13 ), (label of position 901, O 14 ), (position The label of 901, O 15 ), (the label of position 901, O 16 )} means. Among them, O 11 , O 12 , O 13 , O 14 , O 15 and O 16 respectively represent the UWB car key and UWB base station 1, UWB base station 2, UWB base station 3, and UWB base station 4 when the user carries the UWB car key at position 901. , the ranging value between UWB base station 5 and UWB base station 6.
同样地,定位数据2可以用{(位置902的标签,O 21),(位置902的标签,O 22),(位置902的标签,O 23),(位置902的标签,O 24),(位置902的标签,O 25),(位置902的标签,O 26)}表示。定位数据3可以用{(位置903的标签,O 31),(位置903的标签,O 32),(位置903的标签,O 33),(位置903的标签,O 34),(位置903的标签,O 35),(位置903的标签,O 36)}表示。定位数据4可以用{(位置904的标签,O 41),(位置904的标签,O 42),(位置904的标签,O 43),(位置904的标签,O 44),(位置904的标签,O 45),(位置904的标签,O 46)}表示。定位数据5可以用{(位置905的标签,O 51),(位置905的标签,O 52),(位置905的标签,O 53),(位置905的标签,O 54),(位置905的标签,O 55),(位置905的标签,O 56)}表示。定位数据6可以用{(位置906的标签,O 61),(位置906的标签,O 62),(位置906的标签,O 63),(位置906的标签,O 64),(位置906的标签,O 65),(位置906的标签,O 66)}表示。以此类推。 Similarly, positioning data 2 can be used {(label of position 902, O 21 ), (label of position 902, O 22 ), (label of position 902, O 23 ), (label of position 902, O 24 ), ( Label at position 902, O 25 ), (label at position 902, O 26 )} is represented. Positioning data 3 can be used {(label of position 903, O 31 ), (label of position 903, O 32 ), (label of position 903, O 33 ), (label of position 903, O 34 ), (label of position 903 Label, O 35 ), (label at position 903, O 36 )} is represented. Positioning data 4 can be used {(label of position 904, O 41 ), (label of position 904, O 42 ), (label of position 904, O 43 ), (label of position 904, O 44 ), (label of position 904 Label, O 45 ), (label at position 904, O 46 )} is represented. Positioning data 5 can be used {(label of position 905, O 51 ), (label of position 905, O 52 ), (label of position 905, O 53 ), (label of position 905, O 54 ), (label of position 905 Label, O 55 ), (label at position 905, O 56 )} is represented. The positioning data 6 can be represented by {(label of position 906, O 61 ), (label of position 906, O 62 ), (label of position 906, O 63 ), (label of position 906, O 64 ), (label of position 906 Label, O 65 ), (label at position 906, O 66 )} is represented. And so on.
以下将结合附图,以UWB车钥匙的载体为手机、用户携带手机由图10所示逐渐走向车辆(记作阶段1)→进入车辆→位于车内(记作阶段2)→走出车辆→逐渐远离车辆(记作阶段3)的过程为例,对本申请实施例提供的一种数字车钥匙的定位方法进行具体介绍。The following will be combined with the accompanying drawings. Taking the carrier of the UWB car key as the mobile phone, the user carries the mobile phone and gradually walks towards the vehicle as shown in Figure 10 (denoted as stage 1) → enters the vehicle → is in the car (denoted as phase 2) → walks out of the vehicle → gradually Taking the process of moving away from the vehicle (denoted as stage 3) as an example, a method for locating a digital car key provided by an embodiment of the present application will be introduced in detail.
其中,采用本申请实施例提供的一种数字车钥匙的定位方法,在图10所示阶段1,数字车钥匙定位装置识别出UWB车钥匙位于车外,采用融合位姿策略进行UWB车钥匙的车外运动轨迹跟踪和UWB车钥匙的车内外识别。在识别到UWB车钥匙由车外进入车内时,数字车钥匙定位装置切换定位策略为增强识别策略。进一步地,在处于车内的过程中(即图10所示阶段2),数字车钥匙定位装置通过比对测距数据与定位数据库中的定位数据,确定UWB车钥匙在车内的具体位置(即与测距数据相似度最高的定位数据所对应的位置)。Among them, a digital car key positioning method provided by the embodiment of the present application is used. In stage 1 shown in Figure 10, the digital car key positioning device recognizes that the UWB car key is located outside the car, and uses a fusion pose strategy to perform UWB car key positioning. Tracking of movement outside the car and identification of UWB car keys inside and outside the car. When it is recognized that the UWB car key enters the car from outside the car, the digital car key positioning device switches the positioning strategy to the enhanced recognition strategy. Further, while in the car (i.e., stage 2 shown in Figure 10), the digital car key positioning device determines the specific location of the UWB car key in the car by comparing the ranging data with the positioning data in the positioning database ( That is, the position corresponding to the positioning data with the highest similarity to the ranging data).
进一步地,在图10所示阶段2,数字车钥匙定位装置也会进行车内外识别。在识别到UWB车钥匙离开车内时,数字车钥匙定位装置切换定位策略为融合位姿策略。进一步地,在UWB车钥匙远离车辆的过程中(即图10所示阶段3),数字车钥匙定位装置采用融合位姿策略进行UWB车钥匙的车外运动轨迹跟踪。Further, in stage 2 shown in Figure 10, the digital car key positioning device will also perform identification inside and outside the vehicle. When it is recognized that the UWB car key leaves the car, the digital car key positioning device switches the positioning strategy to the fusion posture strategy. Furthermore, when the UWB car key moves away from the vehicle (i.e., stage 3 shown in Figure 10), the digital car key positioning device uses a fusion pose strategy to track the movement trajectory of the UWB car key outside the vehicle.
请参考图11,图11以数字车钥匙为UWB车钥匙,UWB车钥匙的运动过程如图10所示逐渐走向车辆(记作阶段1)→进入车辆→位于车内(记作阶段2)的过程为例,示出了本申请实施例提供的一种UWB车钥匙的定位方法流程图。如图11所示,本申请实施例提供的一种UWB车钥匙的定位方法可以包括以下S1101-S1109:Please refer to Figure 11. Figure 11 uses the digital car key as the UWB car key. The movement process of the UWB car key is shown in Figure 10, gradually moving towards the vehicle (denoted as stage 1) → entering the vehicle → located in the car (denoted as stage 2) Taking the process as an example, a flow chart of a UWB car key positioning method provided by an embodiment of the present application is shown. As shown in Figure 11, a UWB car key positioning method provided by an embodiment of the present application may include the following S1101-S1109:
S1101:在UWB车钥匙位于车外时,数字车钥匙定位系统持续获取UWB车钥匙在车外的测距数据和UWB车钥匙的运动数据。S1101: When the UWB car key is outside the car, the digital car key positioning system continues to obtain the ranging data of the UWB car key outside the car and the movement data of the UWB car key.
示例性地,数字车钥匙定位系统可以根据在用户携带UWB车钥匙位于车外时,持续(如周期性)通过加速度传感器获取的智能设备的加速度数据,以及通过陀螺仪传感器获取的智能设备的陀螺仪数据得到UWB车钥匙的运动数据。For example, the digital car key positioning system can continuously (such as periodically) acquire the acceleration data of the smart device through the acceleration sensor when the user carries the UWB car key outside the car, and the gyroscope of the smart device acquired through the gyro sensor. The movement data of the UWB car key can be obtained from the instrument data.
以及,在用户携带UWB车钥匙位于车外时,UWB车钥匙可以与车辆上部署的多个UWB模块(如图4所示401)之间基于UWB技术通信。示例性地,UWB车钥匙可以通 过UWB芯片实现与多个UWB模块之间基于UWB技术的通信。在UWB车钥匙与车辆上部署的多个UWB模块通信的过程中,数字车钥匙定位系统可以基于UWB信号计算UWB车钥匙和多个UWB模块之间的测距值,得到UWB车钥匙和多个UWB模块之间的测距数据(记作第三距离数据组)。And, when the user carries the UWB car key outside the car, the UWB car key can communicate with multiple UWB modules (shown as 401 in Figure 4) deployed on the vehicle based on UWB technology. For example, a UWB car key can realize UWB technology-based communication with multiple UWB modules through a UWB chip. During the communication process between the UWB car key and multiple UWB modules deployed on the vehicle, the digital car key positioning system can calculate the ranging values between the UWB car key and multiple UWB modules based on the UWB signal, and obtain the UWB car key and multiple UWB modules. Ranging data between UWB modules (denoted as the third distance data group).
以车辆上部署有图10所示UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6为例,第三距离数据组可以用(O t(i),1,O t(i),2,O t(i),3,O t(i),4,O t(i),5,O t(i),6)表示。其中,O t(i),1、O t(i),2、O t(i),3、O t(i),4、O t(i),5和O t(i),6分别为t(i)时刻时UWB车钥匙与UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6之间的测距值。UWB车钥匙的运动数据可以用(x t(i),y t(i),θ t(i)表示。其中,x t(i)和y t(i)分别为t(i)时刻时UWB车钥匙的坐标。θ t(i)为t(i)时刻时UWB车钥匙的角度。θ t(i)是基于陀螺仪传感器采集的陀螺仪数据和加速度传感器采集的加速度数据计算得到的。 Taking the UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 as shown in Figure 10 deployed on the vehicle as an example, the third distance data group can be used (O t (i), 1 , O t(i),2 , O t(i),3 , O t(i),4 , O t(i),5 , O t(i),6 ). Among them, O t(i),1 , O t(i),2 , O t(i),3 , O t(i),4 , O t(i),5 and O t(i),6 respectively is the ranging value between the UWB car key and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 at time t(i). The motion data of the UWB car key can be expressed by (x t(i) , y t(i) , θ t(i) . Among them, x t(i) and y t(i) are the UWB at time t(i) respectively. The coordinates of the car key. θ t(i) is the angle of the UWB car key at time t(i). θ t(i) is calculated based on the gyroscope data collected by the gyro sensor and the acceleration data collected by the acceleration sensor.
S1102:UWB车钥匙定位单元分别根据UWB车钥匙在车外的测距数据和UWB车钥匙的运动数据建立约束条件,获取UWB车钥匙的初步运动轨迹。S1102: The UWB car key positioning unit establishes constraints based on the distance measurement data of the UWB car key outside the car and the motion data of the UWB car key, and obtains the preliminary motion trajectory of the UWB car key.
在本申请实施例中,UWB车钥匙定位单元根据UWB车钥匙在车外的测距数据(即第三距离数据组)建立约束条件可以包括:UWB车钥匙定位单元根据持续获取的UWB车钥匙在车外的测距数据建立多个UWB测距约束条件。其中,UWB测距约束条件用于约束UWB车钥匙在车外移动过程中与多个UWB基站之间的位置关系。In the embodiment of the present application, the UWB car key positioning unit establishing constraint conditions based on the distance measurement data of the UWB car key outside the car (ie, the third distance data group) may include: the UWB car key positioning unit based on the continuously acquired UWB car key in The ranging data outside the vehicle establishes multiple UWB ranging constraints. Among them, the UWB ranging constraint conditions are used to constrain the positional relationship between the UWB car key and multiple UWB base stations during movement outside the vehicle.
在本申请实施例中,UWB车钥匙定位单元根据UWB车钥匙的运动数据建立约束条件可以包括:UWB车钥匙定位单元根据实时获取的UWB车钥匙的运动数据,计算UWB车钥匙在移动过程中的位置;以及基于相邻位置之间的关系建立惯性导航约束条件。其中,惯性导航约束条件用于约束UWB车钥匙在车外移动过程中确定的相邻空间位姿之间的运动路线。In the embodiment of the present application, the UWB car key positioning unit establishing constraints based on the motion data of the UWB car key may include: the UWB car key positioning unit calculates the movement data of the UWB car key during the movement based on the motion data of the UWB car key obtained in real time. position; and establishing inertial navigation constraints based on the relationship between adjacent positions. Among them, the inertial navigation constraints are used to constrain the motion route between adjacent spatial poses determined by the UWB car key during its movement outside the vehicle.
示例性地,UWB车钥匙定位单元可以通过双积分等方法,根据计算得到的UWB车钥匙在车外移动过程中的多个位置得到对应运动路线(即第一运动路线)。其中,基于双积分的方法的总体思路是:对根据传感器采集的数据得到的加速度进行积分,得到运动速度,进一步对得到的运动速度进行积分得到对初始位置的累计坐标,进而得到运动路线。本申请实施例对具体方法不做限定,可以参考常规技术。For example, the UWB car key positioning unit can obtain the corresponding movement route (ie, the first movement route) based on the calculated multiple positions of the UWB car key during its movement outside the vehicle through methods such as double integration. Among them, the general idea of the method based on double integration is: integrate the acceleration obtained based on the data collected by the sensor to obtain the movement speed, and further integrate the obtained movement speed to obtain the cumulative coordinates of the initial position, and then obtain the movement route. The embodiments of this application do not limit the specific methods, and conventional techniques can be referred to.
作为一种示例,请参考图12或图13,图12和图13分别示出了本申请实施例提供的融合位姿策略的计算过程示意图。如图12或图13所示,在采用融合位姿策略进行UWB车钥匙的车外运动轨迹跟踪时,数字车钥匙定位系统可以不断基于加速度传感器持续采集的加速度数据,以及陀螺仪传感器持续采集的陀螺仪数据确定UWB车钥匙在移动过程中的多个位置。进一步地,数字车钥匙定位系统根据确定的UWB车钥匙在移动过程中的多个位置建立多个惯性导航约束条件。As an example, please refer to Figure 12 or Figure 13. Figure 12 and Figure 13 respectively show a schematic diagram of the calculation process of the fusion pose strategy provided by the embodiment of the present application. As shown in Figure 12 or Figure 13, when using the fusion pose strategy to track the out-of-car motion trajectory of the UWB car key, the digital car key positioning system can continuously collect acceleration data based on the acceleration sensor and the gyroscope sensor. Gyroscope data determines the UWB car key's multiple positions during movement. Further, the digital car key positioning system establishes multiple inertial navigation constraints based on the determined multiple positions of the UWB car key during movement.
与建立惯性导航约束条件同步地,如图12或图13所示,数字车钥匙定位系统可以不断基于UWB车钥匙在移动过程中的持续获取的测距数据建立多个UWB测距约束条件。Synchronously with the establishment of inertial navigation constraints, as shown in Figure 12 or Figure 13, the digital car key positioning system can continuously establish multiple UWB ranging constraints based on the ranging data continuously obtained by the UWB car key during movement.
作为一种可能的实现方式,UWB车钥匙定位单元根据UWB车钥匙的运动数据建立多个惯性导航约束条件具体可以包括:UWB车钥匙定位单元根据持续获取的多个UWB车钥匙的运动数据确定UWB车钥匙的多个位置;UWB车钥匙定位单元建立相邻两个位置 的距离约束条件和角度约束条件。As a possible implementation, the UWB car key positioning unit establishes multiple inertial navigation constraints based on the motion data of the UWB car key. Specifically, the UWB car key positioning unit determines the UWB based on the continuously acquired motion data of multiple UWB car keys. Multiple positions of the car key; the UWB car key positioning unit establishes distance constraints and angle constraints between two adjacent positions.
示例性地,假设用户携带UWB车钥匙从图14所述位置P i运动到P i+1,UWB车钥匙定位单元根据在P i和P i+1处的UWB车钥匙的运动数据(x t(i),y t(i))和(x t(i+1),y t(i+1))确定的相邻位置对应于图15中的(a)所示相邻点P i和P i+1。其中,P i和P i+1的距离约束条件为L,角度约束条件为Δθ。 For example, assuming that the user carries the UWB car key and moves from the position Pi to Pi +1 described in Figure 14, the UWB car key positioning unit determines the movement data of the UWB car key at Pi and Pi +1 (x t The adjacent positions determined by (i) , y t(i) ) and (x t(i+1) , y t(i+1) ) correspond to the adjacent points Pi and P i shown in (a) in Figure 15 Pi +1 . Among them, the distance constraint condition between Pi and Pi +1 is L, and the angle constraint condition is Δθ.
示例性地,L可以为P i和P i+1之间的距离,例如L可以用以下计算式1表示;Δθ可以为P i和P i+1之间的角度变化,例如Δθ可以用以下计算式2表示: For example, L can be the distance between Pi and Pi +1 , for example, L can be expressed by the following calculation formula 1; Δθ can be the angle change between Pi and Pi +1 , for example, Δθ can be expressed by the following Calculation formula 2 means:
L=|(x t(i),y t(i))-(x t(i+1),y t(i+1))|。      (计算式1) L=|(x t(i) , y t(i) )-(x t(i+1) , y t(i+1) )|. (Calculation formula 1)
Δθ=θ t(i+1)t(i)。      (计算式2) Δθ=θ t(i+1)t(i) . (Calculation formula 2)
其中,图14所示运动场景中,运动过程中经过的各个位置中,填充白色的点表示在该位置处仅获取了UWB车钥匙的运动数据;填充黑色斜线的点表示在该位置处仅获取了UWB车钥匙的测距数据;一半填充白色一半填充黑色斜线的点表示在该位置处既获取了UWB车钥匙的运动数据,也获取了UWB车钥匙的测距数据。Among them, in the sports scene shown in Figure 14, among the various positions passed during the motion, the points filled with white indicate that only the motion data of the UWB car key was obtained at that position; the points filled with black diagonal lines indicate that only the motion data of the UWB car key was obtained at that position. The ranging data of the UWB car key has been obtained; the point filled half with white and half with black diagonal lines indicates that both the movement data of the UWB car key and the ranging data of the UWB car key have been obtained at that position.
以图14所示运动场景为例,距离约束条件L用于约束图15中的(a)所示相邻点P i和P i+1之间的边关系。角度约束条件Δθ用于约束图15中的(a)所示相邻点P i和P i+1之间的角度。L和Δθ的结合可以用于约束图15中的(a)所示相邻点P i和P i+1之间的运动路线。 Taking the sports scene shown in Figure 14 as an example, the distance constraint L is used to constrain the edge relationship between adjacent points Pi and Pi +1 shown in (a) in Figure 15. The angle constraint condition Δθ is used to constrain the angle between adjacent points Pi and Pi +1 shown in (a) in Figure 15 . The combination of L and Δθ can be used to constrain the motion route between adjacent points Pi and Pi +1 shown in (a) in Figure 15.
需要说明的是,图15中的(a)所述填充白色的点均为获取了UWB车钥匙的运动数据的位置。对于每一个点,UWB车钥匙定位单元均会为其建立对应的惯性导航约束条件(图15中的(a)未逐一示出),如距离约束条件和角度约束条件。It should be noted that the white-filled points described in (a) in Figure 15 are all locations where the motion data of the UWB car key is obtained. For each point, the UWB car key positioning unit will establish corresponding inertial navigation constraints ((a) in Figure 15 are not shown one by one), such as distance constraints and angle constraints.
作为一种可能的实现方式,UWB车钥匙定位单元根据UWB车钥匙在车外的测距数据(即第三距离数据组)建立UWB测距约束条件具体可以包括:UWB车钥匙定位单元根据持续获取的UWB车钥匙与多个UWB模块之间的测距值建立该位置与多个UWB模块之间对应的多个测距约束条件。As a possible implementation method, the UWB car key positioning unit establishes UWB ranging constraints based on the UWB car key's ranging data outside the car (i.e., the third distance data group). Specifically, the UWB car key positioning unit establishes UWB ranging constraints according to the continuous acquisition The ranging values between the UWB car key and multiple UWB modules establish multiple ranging constraints corresponding to the location and multiple UWB modules.
示例性地,假设用户携带UWB车钥匙位于图14所述位置P i+1时,位置P i+1的测距约束条件包括图15中的(b)所示测距约束条件K1、K2、K3、K4、K5和K6。其中,图15中的(b)所示测距约束条件K1用于约束位于P i+1处的UWB车钥匙与UWB基站1之间的测距边,测距约束条件K2用于约束位于P i+1处的UWB车钥匙与UWB基站2之间的测距边,测距约束条件K3用于约束位于P i+1处的UWB车钥匙与UWB基站3之间的测距边,测距约束条件K4用于约束位于P i+1处的UWB车钥匙与UWB基站4之间的测距边,测距约束条件5用于约束位于P i+1处的UWB车钥匙与UWB基站5之间的测距边。测距约束条件6用于约束位于P i+1处的UWB车钥匙与UWB基站6之间的测距边。 For example, assuming that the user carries the UWB car key and is located at the position Pi +1 shown in Figure 14, the ranging constraint conditions of the position Pi +1 include the ranging constraint conditions K1, K2 shown in (b) in Figure 15, K3, K4, K5 and K6. Among them, the ranging constraint K1 shown in (b) in Figure 15 is used to constrain the ranging edge between the UWB car key located at Pi +1 and the UWB base station 1, and the ranging constraint K2 is used to constrain the ranging edge located at P The ranging edge between the UWB car key at i+1 and UWB base station 2, the ranging constraint K3 is used to constrain the ranging edge between the UWB car key at P i+1 and UWB base station 3, ranging Constraint condition K4 is used to constrain the ranging edge between the UWB car key located at Pi +1 and UWB base station 4, and ranging constraint condition 5 is used to constrain the distance between the UWB car key located at Pi +1 and UWB base station 5. distance measuring edge between. The ranging constraint condition 6 is used to constrain the ranging edge between the UWB car key located at Pi +1 and the UWB base station 6 .
需要说明的是,图15中的(b)所述填充黑色斜线的点均为获取了UWB车钥匙测距数据的位置。对于每一个点,UWB车钥匙定位单元均会为其建立对应的测距约束条件(图15中的(b)未逐一示出)。It should be noted that the points filled with black diagonal lines in (b) in Figure 15 are all locations where UWB car key ranging data is obtained. For each point, the UWB car key positioning unit will establish corresponding ranging constraints ((b) in Figure 15 are not shown one by one).
在一些实施例中,如图12所示,数字车钥匙定位系统可以综合惯性导航约束条件和UWB测距约束条件进行非线性融合位姿优化,得到最优解,即为UWB车钥匙的运动轨迹。In some embodiments, as shown in Figure 12, the digital car key positioning system can perform nonlinear fusion pose optimization by integrating inertial navigation constraints and UWB ranging constraints to obtain the optimal solution, which is the motion trajectory of the UWB car key. .
示例性地,数字车钥匙定位系统可以采用高斯牛顿迭代法、通用图形优化(general graphic optimization,g2o)、Ceres、拟牛顿法(BFGS)等非线性优化算法,根据综合惯性导航约束条件和UWB测距约束条件进行非线性融合位姿优化,得到UWB车钥匙的运动轨迹。本申请实施例对所使用的具体的非线性优化算法以及非线性融合位姿优化的具体过程不做限定,可以参考常规技术。For example, the digital car key positioning system can use nonlinear optimization algorithms such as Gauss-Newton iteration method, general graphic optimization (g2o), Ceres, quasi-Newton method (BFGS), etc., based on comprehensive inertial navigation constraints and UWB measurements. Perform nonlinear fusion pose optimization based on distance constraints to obtain the motion trajectory of the UWB car key. The embodiments of this application do not limit the specific nonlinear optimization algorithm used and the specific process of nonlinear fusion pose optimization, and conventional techniques can be referred to.
其中,对于数字车钥匙定位系统直接根据惯性导航约束条件和UWB测距约束条件得到UWB车钥匙的运动轨迹的情况,进一步地,数字车钥匙定位系统可以继续执行以下S1105-S1109。Among them, for the situation where the digital car key positioning system directly obtains the motion trajectory of the UWB car key based on the inertial navigation constraints and UWB ranging constraints, further, the digital car key positioning system can continue to execute the following S1105-S1109.
在另一些实施例中,为了提供更加精确的车外UWB车钥匙定位结果,如图11所示,在执行完S1102之后,数字车钥匙定位系统可以继续执行以下S1103-S1109。In other embodiments, in order to provide more accurate out-of-vehicle UWB car key positioning results, as shown in Figure 11, after executing S1102, the digital car key positioning system may continue to execute the following S1103-S1109.
示例性地,在本申请实施例中,数字车钥匙定位系统获取的初步运动轨迹可以如图16中的(a),图16中的(a)所示初步运动轨迹中填充黑色斜线的点是基于UWB车钥匙在车外的测距数据确定的位置;图16中的(a)所示初步运动轨迹中填充白色的点是基于UWB车钥匙在车外的运动数据确定的位置。Illustratively, in the embodiment of the present application, the preliminary movement trajectory obtained by the digital car key positioning system can be as shown in Figure 16 (a). The points filled with black diagonal lines in the preliminary movement trajectory as shown in Figure 16 (a) It is the position determined based on the ranging data of the UWB car key outside the car; the white filled point in the preliminary motion trajectory shown in (a) in Figure 16 is the position determined based on the motion data of the UWB car key outside the car.
其中,图16中的(a)所示基于UWB车钥匙在车外的测距数据确定的位置与基于UWB车钥匙在车外的运动数据确定的位置具有对应关系。例如,基于UWB车钥匙在车外的测距数据确定的位置可以与基于UWB车钥匙在车外的运动数据确定的位置中最近的位置相对应。示例性地,图16中的(a)所示O1与P1对应,O2与P3对应,O3与P7对应,O4与P9对应。图16中的(a)所示初步运动轨迹还被多个约束条件约束,该多个约束条件包括上述确定的惯性导航约束条件和UWB测距约束条件。其中,图16中的(a)所示O1、O2和O3也被各自对应的UWB测距约束条件约束,为方便查看,图16中的(a)未示出。Among them, the position determined based on the ranging data of the UWB car key outside the car shown in (a) of FIG. 16 has a corresponding relationship with the position determined based on the movement data of the UWB car key outside the car. For example, the position determined based on the ranging data of the UWB car key outside the car may correspond to the closest position among the positions determined based on the motion data of the UWB car key outside the car. For example, O1 shown in (a) in FIG. 16 corresponds to P1, O2 corresponds to P3, O3 corresponds to P7, and O4 corresponds to P9. The preliminary motion trajectory shown in (a) in Figure 16 is also constrained by multiple constraints, including the inertial navigation constraints and UWB ranging constraints determined above. Among them, O1, O2 and O3 shown in (a) in Figure 16 are also constrained by their corresponding UWB ranging constraint conditions. For the convenience of viewing, (a) in Figure 16 is not shown.
可选地,基于UWB车钥匙在车外的测距数据确定的位置还可以与插值对应,其中,插值可以是基于UWB车钥匙在车外的运动数据确定的相邻两个位置之间的位置,该插值与上述相邻两个位置满足线性关系。Optionally, the position determined based on the ranging data of the UWB car key outside the car may also correspond to an interpolation value, wherein the interpolation value may be the position between two adjacent positions determined based on the movement data of the UWB car key outside the car. , this interpolation satisfies a linear relationship with the two adjacent positions mentioned above.
S1103:数字车钥匙定位系统根据UWB车钥匙在车外的测距数据的数据特征确定多个约束条件的权重。S1103: The digital car key positioning system determines the weights of multiple constraints based on the data characteristics of the UWB car key's ranging data outside the car.
作为一种示例,在本申请实施例中,数字车钥匙定位系统可以基于预设的置信度、经验值等确定惯性导航约束条件和UWB测距约束条件的权重。As an example, in the embodiment of the present application, the digital car key positioning system can determine the weight of the inertial navigation constraint and the UWB ranging constraint based on a preset confidence level, experience value, etc.
示例性地,在本申请实施例中,在UWB车钥匙在车外时,惯性导航约束条件和UWB测距约束条件的权重可以不同。其中,约束条件的权重用于表示在进行UWB车钥匙定位时对应约束条件的可参考程度。约束条件的权重越大,则说明该约束条件在进行UWB车钥匙定位时的可参考程度越大;相反地,约束条件的权重越小,则说明该约束条件在进行UWB车钥匙定位时的可参考程度越小。For example, in the embodiment of the present application, when the UWB car key is outside the car, the weights of the inertial navigation constraint conditions and the UWB ranging constraint conditions may be different. Among them, the weight of the constraint condition is used to indicate the reference degree of the corresponding constraint condition when performing UWB car key positioning. The greater the weight of the constraint, the greater the reference degree of the constraint when locating the UWB car key; conversely, the smaller the weight of the constraint, the greater the reference degree of the constraint when locating the UWB car key. The smaller the reference level.
例如,在本申请实施例中,惯性导航约束条件的权重可以为常数C1。UWB测距约束条件的权重可以为常数C2。示例性地,C2可以满足C2∈[0,1]。其中,C1和C2可以是预设的置信度值或者经验值等,本申请实施例不做限定。For example, in this embodiment of the present application, the weight of the inertial navigation constraint may be constant C1. The weight of the UWB ranging constraint can be a constant C2. For example, C2 may satisfy C2∈[0,1]. Wherein, C1 and C2 may be preset confidence values or experience values, etc., which are not limited in the embodiment of this application.
作为另一种示例,在本申请实施例中,为了提供更加精确的车外UWB车钥匙定位结果,数字车钥匙定位系统还可以对一个或多个UWB测距约束条件进行权重优化。As another example, in the embodiment of the present application, in order to provide more accurate off-vehicle UWB car key positioning results, the digital car key positioning system can also perform weight optimization on one or more UWB ranging constraint conditions.
其中,一个UWB测距约束条件的权重用于表示该UWB测距约束条件在进行UWB车钥匙定位时的可参考程度。UWB测距约束条件的权重越大,则说明该UWB测距约束条件在进行UWB车钥匙定位时的可参考程度越大;相反地,UWB测距约束条件的权重越小,则说明该UWB测距约束条件在进行UWB车钥匙定位时的可参考程度越小。Among them, the weight of a UWB ranging constraint is used to indicate the reference degree of the UWB ranging constraint when performing UWB car key positioning. The greater the weight of the UWB ranging constraint, the greater the reference degree of the UWB ranging constraint in UWB car key positioning; conversely, the smaller the weight of the UWB ranging constraint, it means that the UWB ranging constraint The smaller the distance constraint can be used as a reference when positioning UWB car keys.
示例性地,如图13所示,在建立UWB测距约束条件之后,数字车钥匙定位系统可以采用近距加强的方法对一个或多个UWB测距约束条件进行权重优化。其中,数字车钥匙定位系统采用近距加强的方法对一个或多个UWB测距约束条件进行权重优化可以包括:数字车钥匙定位系统根据UWB车钥匙与多个UWB模块之间的测距值的不同,调整用于约束测距边的多个测距约束条件的权重。For example, as shown in Figure 13, after establishing the UWB ranging constraint conditions, the digital car key positioning system can use the short range enhancement method to perform weight optimization on one or more UWB ranging constraint conditions. Among them, the digital car key positioning system uses a short-range enhancement method to optimize the weight of one or more UWB ranging constraints, which may include: the digital car key positioning system based on the ranging values between the UWB car key and multiple UWB modules. Different, adjust the weights of multiple ranging constraints used to constrain ranging edges.
例如,数字车钥匙定位系统可以根据以下计算式3确定t(i+1)时刻多个测距约束条件的权重x wFor example, the digital car key positioning system can determine the weight x w of multiple ranging constraints at time t(i+1) according to the following calculation formula 3:
Figure PCTCN2022112172-appb-000002
Figure PCTCN2022112172-appb-000002
其中,在上述计算式3中,若
Figure PCTCN2022112172-appb-000003
Figure PCTCN2022112172-appb-000004
w i+1’=0;
Figure PCTCN2022112172-appb-000005
为在t(i+1)时刻计算得到的UWB车钥匙与多个UWB模块之间的测距值的平均值,C3常数。或者,若
Figure PCTCN2022112172-appb-000006
w i+1’还可以为其它小常数(如小于
Figure PCTCN2022112172-appb-000007
),本申请不做限定。
Among them, in the above calculation formula 3, if
Figure PCTCN2022112172-appb-000003
like
Figure PCTCN2022112172-appb-000004
w i+1 '=0;
Figure PCTCN2022112172-appb-000005
It is the average value of the ranging values between the UWB car key and multiple UWB modules calculated at time t(i+1), C3 constant. or if
Figure PCTCN2022112172-appb-000006
w i+1 'can also be other small constants (such as less than
Figure PCTCN2022112172-appb-000007
), this application is not limited.
可以理解,在本申请实施例中,数字车钥匙定位系统进行UWB车钥匙在车外场景下的定位用于在UWB车钥匙靠近车辆直至进入车辆时能够及时、准确地识别出,因此,若确定UWB车钥匙与某一UWB基站的测距值较小时,为了避免漏识别UWB车钥匙的靠近事件或者进入车辆事件,可以侧重于重点关注该较小的测距值。另外,在实际应用中,我们发现,若UWB车钥匙处于某一UWB基站的NLOS区,由于UWB信号被遮挡的原因会导致UWB信号在UWB车钥匙和该UWB基站之间的传输时间更长,因此得到的测距值通常会大于实际距离。因此,相比于较小测距值,较大测距值对应的UWB基站被遮挡的概率更大。基于这些考虑,在本申请实施例中,对于较短(如小于平均测距值)的测距边,可以给予其对应的UWB测距约束条件较大的权重。It can be understood that in the embodiment of the present application, the digital car key positioning system performs positioning of the UWB car key in the scene outside the car so that it can promptly and accurately identify the UWB car key when it is close to the vehicle until it enters the vehicle. Therefore, if it is determined When the ranging value between the UWB car key and a certain UWB base station is small, in order to avoid missing the identification of the approaching event of the UWB car key or the event of entering the vehicle, you can focus on the smaller ranging value. In addition, in practical applications, we found that if the UWB car key is in the NLOS area of a certain UWB base station, the UWB signal will take longer to transmit between the UWB car key and the UWB base station because the UWB signal is blocked. Therefore, the obtained ranging value is usually greater than the actual distance. Therefore, compared with a smaller ranging value, the UWB base station corresponding to a larger ranging value has a greater probability of being blocked. Based on these considerations, in the embodiment of the present application, for a short ranging edge (for example, smaller than the average ranging value), a greater weight can be given to its corresponding UWB ranging constraint condition.
以图15中的(b)所示P i+1的UWB测距约束条件为例,由于UWB测距约束条件1对应的测距边最短,因此其必然小于P i+1对应的平均测距值;以及,由于UWB测距约束条件4对应的测距边最长,因此其必然大于P i+1对应的平均测距值,因此,在进行近距加强时,数字车钥匙定位系统可以给予UWB测距约束条件1大于UWB测距约束条件4的权重。同样地,对于UWB测距约束条件2、UWB测距约束条件3和UWB测距约束条件5,也可以根据预设的规则给予其对应的权重。 Take the UWB ranging constraint condition of Pi +1 shown in (b) in Figure 15 as an example. Since the ranging edge corresponding to UWB ranging constraint condition 1 is the shortest, it must be smaller than the average ranging corresponding to Pi +1. value; and, since the ranging edge corresponding to UWB ranging constraint 4 is the longest, it must be greater than the average ranging value corresponding to P i+1 . Therefore, when performing short-range enhancement, the digital car key positioning system can give UWB ranging constraint 1 has a greater weight than UWB ranging constraint 4. Similarly, for UWB ranging constraint 2, UWB ranging constraint 3 and UWB ranging constraint 5, corresponding weights can also be given according to preset rules.
作为另一种示例,在本申请实施例中,数字车钥匙定位系统可以在基于预设的置信度、经验值等确定惯性导航约束条件和UWB测距约束条件的权重之后,再对一个或多个UWB测距约束条件进行权重优化(如采用上述近距加强的方法进行权重优化)。As another example, in the embodiment of the present application, the digital car key positioning system can determine the weight of the inertial navigation constraint and the UWB ranging constraint based on the preset confidence level, experience value, etc., and then determine the weight of one or more Perform weight optimization based on UWB ranging constraints (such as using the above-mentioned short-range enhancement method for weight optimization).
S1104:数字车钥匙定位系统根据确定的多个约束条件的权重优化初步运动轨迹,得到UWB车钥匙在车外的运动轨迹。S1104: The digital car key positioning system optimizes the preliminary movement trajectory based on the determined weights of multiple constraints, and obtains the movement trajectory of the UWB car key outside the car.
示例性地,数字车钥匙定位系统可以基于优化后的多个约束条件的权重,调整初步 运动轨迹上的一个或多个点的位置,得到UWB车钥匙在车外的运动轨迹。For example, the digital car key positioning system can adjust the position of one or more points on the preliminary movement trajectory based on the optimized weights of multiple constraints to obtain the movement trajectory of the UWB car key outside the vehicle.
以图16中的(a)所示初步运动轨迹为例,假设约束条件K1的权重均大于约束条件K2、K3、K4、K5和K6的权重,则在进行UWB车钥匙在车外的运动轨迹确定时,可以更倾向于K1约束条件对应的测距值,最终确定的UWB车钥匙在车外的运动轨迹中,P9处的位置更加满足K1约束条件。示例性地,在根据确定的多个约束条件的权重优化图16中的(a)所示初步运动轨迹之后,可以得到图16中的(b)所示运动轨迹,即为UWB车钥匙在车外的运动轨迹。其中,图16中的(b)所示运动轨迹中一半填充白色一半填充黑色斜线的点是测距数据的测量步点与运动数据的测量步点重合的位置。Taking the preliminary motion trajectory shown in (a) in Figure 16 as an example, assuming that the weight of constraint K1 is greater than the weight of constraint conditions K2, K3, K4, K5 and K6, then the motion trajectory of the UWB car key outside the car is being carried out. When determining, you can prefer the ranging value corresponding to the K1 constraint. In the final movement trajectory of the UWB car key outside the car, the position at P9 better satisfies the K1 constraint. For example, after optimizing the preliminary motion trajectory shown in (a) in Figure 16 according to the determined weights of multiple constraints, the motion trajectory shown in (b) in Figure 16 can be obtained, which is the UWB car key in the car. external motion trajectory. Among them, the points half filled with white and half filled with black diagonal lines in the motion trajectory shown in (b) of Figure 16 are the positions where the measurement step points of the ranging data coincide with the measurement step points of the motion data.
需要说明的是,图16中的(b)仅以测距数据的测量步点与运动数据的测量步点能够重合作为示例。在另一些实施例中,对于测量步点与运动数据的测量步点不重合的测距数据而言,可以通过线性插值的方式将该测距数据拟合进UWB车钥匙在车外的运动轨迹中。It should be noted that (b) in FIG. 16 only takes as an example that the measurement step points of the ranging data and the measurement step points of the motion data can overlap. In other embodiments, for ranging data whose measurement step points do not coincide with the measurement step points of the motion data, the ranging data can be fitted to the movement trajectory of the UWB car key outside the car through linear interpolation. middle.
S1105:数字车钥匙定位系统对UWB车钥匙在车外的运动轨迹进行轨迹跟踪。S1105: The digital car key positioning system tracks the movement trajectory of the UWB car key outside the car.
其中,数字车钥匙定位系统对UWB车钥匙在车外的运动轨迹进行轨迹跟踪用于在数字车钥匙与车辆的相对位置满足预设条件时,提供预设的智能化的控制。Among them, the digital car key positioning system tracks the movement trajectory of the UWB car key outside the car to provide preset intelligent control when the relative position of the digital car key and the vehicle meets preset conditions.
示例性地,数字车钥匙定位系统可以向智能化控制模块共享UWB车钥匙在车外的具体位置,以便智能化控制模块在数字车钥匙与车辆的相对位置满足预设条件时,提供预设的智能化的控制。For example, the digital car key positioning system can share the specific location of the UWB car key outside the car with the intelligent control module, so that the intelligent control module can provide the preset location when the relative position of the digital car key and the vehicle meets preset conditions. Intelligent control.
示例性地,预设条件如进入闭锁车门区域、进入迎宾区域、进入解锁车门区域、进入解锁后备箱区域、离开解锁后备箱区域、离开解锁车门区域等。智能化的控制如迎宾、解锁车门、解锁后备箱、闭锁后备箱、闭锁车门、关闭车灯等。本申请实施例不做具体限定。For example, the preset conditions include entering the locked door area, entering the welcome area, entering the unlocked door area, entering the unlocked trunk area, leaving the unlocked trunk area, leaving the unlocked door area, etc. Intelligent controls include greeting guests, unlocking doors, unlocking the trunk, locking the trunk, locking doors, turning off lights, etc. The embodiments of this application are not specifically limited.
或者,示例性地,预设条件如进入车内,智能化的控制如切换为增强识别策略,具体见以下S1106:Or, for example, the preset condition is such as entering the car, and the intelligent control is such as switching to the enhanced recognition strategy. For details, see the following S1106:
S1106:数字车钥匙定位系统在识别到UWB车钥匙从车外进入车内时,将用于UWB车钥匙定位的策略切换为增强识别策略。S1106: When the digital car key positioning system recognizes that the UWB car key enters the car from outside the car, it switches the strategy used for UWB car key positioning to the enhanced recognition strategy.
示例性地,数字车钥匙定位系统中可以预先设置有用于判断UWB车钥匙是否从车外进入车内的判断条件。该判断条件如UWB车钥匙与车辆的最近测距值小于预设阈值,该预设阈值可以为厘米级别的数值。For example, the digital car key positioning system may be preset with a judgment condition for judging whether the UWB car key enters the car from outside the car. The judgment condition is, for example, that the nearest distance measurement value between the UWB car key and the vehicle is less than a preset threshold, and the preset threshold can be a centimeter-level value.
其中,增强识别策略用于实现车内场景下UWB车钥匙的精确定位。增强识别策略的具体思路是:在处于车内的过程中(如图10所示阶段2),数字车钥匙定位系统通过比对在处于车内时采集到的测距数据与定位数据库中的定位数据,确定UWB车钥匙在车内的具体位置。Among them, the enhanced recognition strategy is used to achieve precise positioning of UWB car keys in the car scene. The specific idea of the enhanced identification strategy is: during the process of being in the car (shown in stage 2 in Figure 10), the digital car key positioning system compares the ranging data collected while in the car with the positioning in the positioning database. Data to determine the specific location of the UWB car key in the car.
S1107:在UWB车钥匙位于车内时,数字车钥匙定位系统获取UWB车钥匙在车内的测距数据。S1107: When the UWB car key is located in the car, the digital car key positioning system obtains the ranging data of the UWB car key in the car.
其中,UWB车钥匙在车内的测距数据(记作第一距离数据组)包括UWB车钥匙分别与多个UWB模块之间的测距数据(如测距值)。Among them, the distance measurement data of the UWB car key in the car (denoted as the first distance data group) includes the distance measurement data (such as distance measurement values) between the UWB car key and multiple UWB modules respectively.
示例性地,在用户携带UWB车钥匙位于车内时,UWB车钥匙可以与车辆上部署的多个UWB模块(如图4所示401)之间基于UWB技术通信。示例性地,UWB车钥匙可以通过UWB芯片实现与多个UWB模块之间基于UWB技术的通信。在UWB车钥匙与车 辆上部署的多个UWB模块通信的过程中,数字车钥匙定位系统可以基于UWB信号计算UWB车钥匙和多个UWB模块之间的测距值,得到UWB车钥匙和多个UWB模块之间的测距数据(记作第一距离数据组)。For example, when the user carries the UWB car key and is in the car, the UWB car key can communicate with multiple UWB modules (shown as 401 in Figure 4) deployed on the vehicle based on UWB technology. For example, a UWB car key can communicate with multiple UWB modules based on UWB technology through a UWB chip. During the communication process between the UWB car key and multiple UWB modules deployed on the vehicle, the digital car key positioning system can calculate the ranging values between the UWB car key and multiple UWB modules based on the UWB signal, and obtain the UWB car key and multiple UWB modules. Ranging data between UWB modules (denoted as the first distance data group).
以车辆上部署有图10所示UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6为例,第一距离数据组可以用(O' t(j),1,O’ t(j),2,O' t(j),3,O' t(j),4,O' t(j),5,O' t(j),6)表示。其中,O' t(j),1、O’ t(j),2、O' t(j),3、O' t(j),4、O' t(j),5和O' t(j),6分别为t(j)时刻时UWB车钥匙与UWB基站1、UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6之间的测距值。 Taking the UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 as shown in Figure 10 deployed on the vehicle as an example, the first distance data group can be used (O' t(j), 1 , O' t(j),2 , O' t(j),3 , O' t(j),4 , O' t(j),5 , O' t(j),6 ). Among them, O' t(j),1 , O' t(j),2 , O' t(j),3 , O' t(j),4 , O' t(j),5 and O' t (j), 6 are the ranging values between the UWB car key and UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6 at time t(j) respectively.
S1108:数字车钥匙定位系统从定位数据库中确定与UWB车钥匙在车内的测距数据匹配度最高的定位数据。S1108: The digital car key positioning system determines the positioning data with the highest degree of matching with the ranging data of the UWB car key in the car from the positioning database.
作为一种可能的实现方式,数字车钥匙定位系统可以通过分别计算第一距离数据组与定位数据库中多个定位数据之间的相似度,确定与UWB车钥匙在车内的测距数据匹配度最高的定位数据。其中,与UWB车钥匙在车内的测距数据匹配度最高的定位数据是定位数据库中与第一距离数据组相似度最大的定位数据。As a possible implementation method, the digital car key positioning system can determine the matching degree with the ranging data of the UWB car key in the car by separately calculating the similarity between the first distance data group and multiple positioning data in the positioning database. Highest positioning data. Among them, the positioning data that has the highest matching degree with the ranging data of the UWB car key in the car is the positioning data that has the greatest similarity with the first distance data group in the positioning database.
可选地,数字车钥匙定位系统可以采用分类算法,计算第一距离数据组与定位数据库中多个定位数据之间的相似度。示例性地,分类算法可以包括但不限于以下中的一种或多种:朴素贝叶斯分类算法、逻辑回归算法、决策树算法、支持向量机算法、K邻近(K-nearest neighbor,KNN)算法、人工神经网络算法。Optionally, the digital car key positioning system may use a classification algorithm to calculate the similarity between the first distance data group and multiple positioning data in the positioning database. Exemplarily, the classification algorithm may include but is not limited to one or more of the following: Naive Bayes classification algorithm, logistic regression algorithm, decision tree algorithm, support vector machine algorithm, K-nearest neighbor (KNN) Algorithms, artificial neural network algorithms.
其中,在本申请实施例中,第一距离数据组与定位数据之间的相似度与第一距离数据组中的多个测距值和定位数据中对应测距值之间的空间距离相关。In this embodiment of the present application, the similarity between the first distance data group and the positioning data is related to the spatial distance between the multiple ranging values in the first distance data group and the corresponding ranging values in the positioning data.
作为一种示例,第一距离数据组与定位数据之间的相似度可以与第一距离数据组与定位数据之间的空间距离负相关。例如,第一距离数据组与定位数据之间的空间距离越小,则说明第一距离数据组与定位数据之间的相似度越大;第一距离数据组与定位数据之间的空间距离越大,则说明第一距离数据组与定位数据之间的相似度越小。As an example, the similarity between the first distance data set and the positioning data may be negatively correlated with the spatial distance between the first distance data set and the positioning data. For example, the smaller the spatial distance between the first distance data group and the positioning data, the greater the similarity between the first distance data group and the positioning data; the smaller the spatial distance between the first distance data group and the positioning data. If it is large, it means that the similarity between the first distance data group and the positioning data is smaller.
示例性地,第一距离数据组与定位数据之间的空间距离Bj可以基于以下计算式4计算得到:For example, the spatial distance Bj between the first distance data group and the positioning data can be calculated based on the following calculation formula 4:
B j=(1-A j)*||O-O' j|| 2。    (计算式4) B j =(1-A j )*||OO' j || 2 . (Calculation formula 4)
上述计算式4中,O是定位数据,O' j是第一距离数据组,
Figure PCTCN2022112172-appb-000008
COUNT(O∩O' j)是定位数据中与第一距离数据组中测距值对应相同UWB基站的数量。COUNT(O∪O' j)是定位数据与第一距离数据组中测距值对应的、不重复的UWB基站的数量之和。
In the above calculation formula 4, O is the positioning data, O' j is the first distance data group,
Figure PCTCN2022112172-appb-000008
COUNT(O∩O' j ) is the number of UWB base stations in the positioning data that correspond to the same ranging value in the first distance data group. COUNT(O∪O' j ) is the sum of the number of non-overlapping UWB base stations corresponding to the positioning data and the ranging value in the first distance data group.
可以理解,对于定位数据库中的每一个定位数据,数字车钥匙定位系统均可以计算得到其与第一距离数据组之间的空间距离。基于此,数字车钥匙定位系统便可以从中确定与UWB车钥匙在车内的测距数据匹配度最高的定位数据。例如,与UWB车钥匙在车内的测距数据匹配度最高的定位数据是定位数据库中与第一距离数据组之间的空间最小的定位数据。It can be understood that for each positioning data in the positioning database, the digital car key positioning system can calculate the spatial distance between it and the first distance data group. Based on this, the digital car key positioning system can determine the positioning data that best matches the ranging data of the UWB car key in the car. For example, the positioning data with the highest matching degree to the ranging data of the UWB car key in the car is the positioning data with the smallest space between the first distance data group and the positioning database.
作为一种示例,第一距离数据组与定位数据之间的空间距离可以用第一距离数据组 中多个测距值与定位数据中心对应测距值之间的空间距离之和表示。以第一距离数据组用(O' t(j),1,O’ t(j),2,……,O’ t(j),n)表示,定位数据用{(位置901的标签,O 11),(位置901的标签,O 12),……,(位置901的标签,O 1n)}表示为例,第一距离数据组与该定位数据之间的空间距离=|O' t(j),1-O 11|+|O’ t(j),2-O 12|+……+|O' t(j),n-O 1n|。 As an example, the spatial distance between the first distance data group and the positioning data can be represented by the sum of spatial distances between multiple ranging values in the first distance data group and the corresponding ranging value of the positioning data center. The first distance data group is represented by (O' t(j),1 , O' t(j),2 ,..., O' t(j),n ), and the positioning data is represented by {(label of position 901, O 11 ), (label at position 901, O 12 ), ..., (label at position 901, O 1n )} are expressed as an example, the spatial distance between the first distance data group and the positioning data = |O' t (j),1 -O 11 |+|O' t(j),2 -O 12 |+...+|O' t(j),n -O 1n |.
作为另一种示例,第一距离数据组与定位数据之间的空间距离可以用第一距离数据组中多个测距值与定位数据中心对应测距值之间的空间距离的平均值表示。以第一距离数据组用(O' t(j),1,O’ t(j),2,……,O’ t(j),n)表示,定位数据用{(位置901的标签,O 11),(位置901的标签,O 12),……,(位置901的标签,O 1n)}表示为例,第一距离数据组与该定位数据之间的空间距离=(|O' t(j),1-O 11|+|O’ t(j),2-O 12|+……+|O' t(j),n-O 1n|)/n。 As another example, the spatial distance between the first distance data group and the positioning data may be represented by an average of the spatial distances between multiple ranging values in the first distance data group and the corresponding ranging value of the center of the positioning data. The first distance data group is represented by (O' t(j),1 , O' t(j),2 ,..., O' t(j),n ), and the positioning data is represented by {(label of position 901, O 11 ), (label at position 901, O 12 ), ..., (label at position 901, O 1n )} are expressed as an example, the spatial distance between the first distance data group and the positioning data = (|O' t(j),1 -O 11 |+|O' t(j),2 -O 12 |+...+|O' t(j),n -O 1n |)/n.
可以理解,对于定位数据库中的每一个定位数据,数字车钥匙定位系统均可以计算得到其与第一距离数据组中测距值之间的空间距离。基于此,数字车钥匙定位系统便可以从中确定与UWB车钥匙在车内的测距数据匹配度最高的定位数据。例如,与UWB车钥匙在车内的测距数据匹配度最高的定位数据是定位数据库中与第一距离数据组中测距值之间的空间距离最小的定位数据。It can be understood that for each positioning data in the positioning database, the digital car key positioning system can calculate the spatial distance between it and the ranging value in the first distance data group. Based on this, the digital car key positioning system can determine the positioning data that best matches the ranging data of the UWB car key in the car. For example, the positioning data with the highest matching degree to the ranging data of the UWB car key in the car is the positioning data with the smallest spatial distance between the ranging value in the first distance data group in the positioning database.
或者,在本申请实施例中,数字车钥匙定位系统还可以使用其它方法计算得到定位数据库中每一个定位数据与第一距离数据组之间的空间距离,本申请实施例不做具体限定。例如,数字车钥匙定位系统还可以提取定位数据库中每一个定位数据的距离特征以及第一距离数据组中多个测距值的距离特征,然后通过计算距离特征的相似度以确定定位数据与第一距离数据组之间的空间距离。Alternatively, in the embodiment of the present application, the digital car key positioning system can also use other methods to calculate the spatial distance between each positioning data in the positioning database and the first distance data group, which is not specifically limited in the embodiment of the present application. For example, the digital car key positioning system can also extract the distance features of each positioning data in the positioning database and the distance features of multiple ranging values in the first distance data group, and then calculate the similarity of the distance features to determine the positioning data and the third distance data. A distance is the spatial distance between data sets.
S1109:数字车钥匙定位系统确定UWB车钥匙在车内的位置为与UWB车钥匙在车内的测距数据匹配度最高的定位数据对应的位置标签所指示的位置。S1109: The digital car key positioning system determines that the position of the UWB car key in the car is the position indicated by the position tag corresponding to the positioning data that has the highest matching degree with the ranging data of the UWB car key in the car.
示例性地,如上文所述,数字车钥匙定位系统确定的与UWB车钥匙在车内的测距数据匹配度最高的定位数据可以是上述实施例所述与第一距离数据组中测距值之间的空间距离最小的定位数据。对于这种情况,数字车钥匙定位系统可以确定UWB车钥匙在车内的位置为与第一距离数据组中测距值之间的空间距离最小的定位数据对应的位置标签所指示的位置。For example, as mentioned above, the positioning data determined by the digital car key positioning system to have the highest matching degree with the distance measurement data of the UWB car key in the car may be the distance measurement value in the first distance data group as described in the above embodiment. positioning data with the smallest spatial distance between them. For this situation, the digital car key positioning system can determine the position of the UWB car key in the car as the position indicated by the position tag corresponding to the positioning data with the smallest spatial distance between the ranging values in the first distance data group.
以与第一距离数据组中测距值之间的空间距离最小的定位数据为{(位置901的标签,O 11),(位置901的标签,O 12),(位置901的标签,O 13),(位置901的标签,O 14),(位置901的标签,O 15)}为例,数字车钥匙定位系统可以确定UWB车钥匙在车内的位置为位置901。 The positioning data with the smallest spatial distance from the ranging value in the first distance data group is {(label at position 901, O 11 ), (label at position 901, O 12 ), (label at position 901, O 13 ), (label of position 901, O 14 ), (label of position 901, O 15 )} For example, the digital car key positioning system can determine that the position of the UWB car key in the car is position 901.
或者可选地,数字车钥匙定位系统确定的与UWB车钥匙在车内的测距数据匹配度最高的定位数据可以是上述实施例所述与第一距离数据组中测距值之间的空间距离之和最小的定位数据。对于这种情况,数字车钥匙定位系统可以确定UWB车钥匙在车内的位置为与第一距离数据组中测距值之间的空间距离之和最小的定位数据对应的位置标签所指示的位置。Or alternatively, the positioning data determined by the digital car key positioning system to have the highest matching degree with the distance measurement data of the UWB car key in the car can be the space between the distance measurement value in the first distance data group as described in the above embodiment. Positioning data with the smallest sum of distances. For this situation, the digital car key positioning system can determine the position of the UWB car key in the car as the position indicated by the position tag corresponding to the positioning data with the smallest sum of spatial distances between the ranging values in the first distance data group. .
以与第一距离数据组中测距值之间的空间距离之和最小的定位数据为{(位置901的标签,O 11),(位置901的标签,O 12),(位置901的标签,O 13),(位置901的标签,O 14),(位置901的标签,O 15)}为例,数字车钥匙定位系统可以确定UWB车钥匙在车内的位置 为位置901。 The positioning data with the smallest sum of spatial distances from the ranging values in the first distance data group is {(label at position 901, O 11 ), (label at position 901, O 12 ), (label at position 901, O 13 ), (label at position 901, O 14 ), (label at position 901, O 15 )} For example, the digital car key positioning system can determine the position of the UWB car key in the car as position 901.
或者可选地,数字车钥匙定位系统确定的与UWB车钥匙在车内的测距数据匹配度最高的定位数据可以是上述实施例所述与第一距离数据组中测距值之间的空间距离的平均值最小的定位数据。对于这种情况,数字车钥匙定位系统可以确定UWB车钥匙在车内的位置为与第一距离数据组中测距值之间的空间距离的平均值最小的定位数据对应的位置标签所指示的位置。Or alternatively, the positioning data determined by the digital car key positioning system to have the highest matching degree with the distance measurement data of the UWB car key in the car can be the space between the distance measurement value in the first distance data group as described in the above embodiment. Location data with the smallest average distance. For this situation, the digital car key positioning system may determine that the position of the UWB car key in the car is indicated by the position tag corresponding to the positioning data with the smallest average of the spatial distances between the ranging values in the first distance data group. Location.
以与第一距离数据组中测距值之间的空间距离的平均值最小的定位数据为{(位置901的标签,O 11),(位置901的标签,O 12),(位置901的标签,O 13),(位置901的标签,O 14),(位置901的标签,O 15)}为例,数字车钥匙定位系统可以确定UWB车钥匙在车内的位置为位置901。 The positioning data with the smallest average spatial distance between the ranging values in the first distance data group is {(label of position 901, O 11 ), (label of position 901, O 12 ), (label of position 901 , O 13 ), (label of position 901 , O 14 ), (label of position 901 , O 15 )} For example, the digital car key positioning system can determine the position of the UWB car key in the car as position 901.
需要说明的是,在本申请另一些实施例中,数字车钥匙定位系统也可以根据定位数据库中每一个定位数据与第一距离数据组中测距值之间的空间距离,从中确定多个(如M个,M为大于等于3的正整数)候选定位数据,然后通过统计多个候选定位数据所对应的位置标签的,确定UWB车钥匙在车内的位置为多个候选定位数据所对应的位置标签中,统计次数最多的位置标签所指示的位置。It should be noted that in other embodiments of the present application, the digital car key positioning system can also determine multiple ( For example, there are M (M is a positive integer greater than or equal to 3) candidate positioning data, and then by counting the location tags corresponding to the multiple candidate positioning data, it is determined that the position of the UWB car key in the car is the location corresponding to the multiple candidate positioning data. Among the location tags, the location indicated by the location tag with the most statistics.
以数字车钥匙定位系统确定3个候选定位数据,该3个候选定位数据分别对应位置901的标签、位置902的标签、位置902的标签为例,数字车钥匙定位系统可以确定UWB车钥匙在车内的位置为位置902。Taking the digital car key positioning system to determine three candidate positioning data, which respectively correspond to the label at position 901, the label at position 902, and the label at position 902, the digital car key positioning system can determine that the UWB car key is in the car. The position within is position 902.
在确定UWB车钥匙在车内的具体位置之后,进一步地,数字车钥匙定位系统可以向智能化控制模块共享UWB车钥匙在车内的具体位置,以便智能化控制模块在UWB车钥匙在车内的位置为预设位置时,提供预设的智能化的控制。例如,在确定UWB车钥匙在车内的位置为第一位置时,执行第一预设操作;或者在确定UWB车钥匙在车内的位置为第二位置时,执行第二预设操作。After determining the specific location of the UWB car key in the car, further, the digital car key positioning system can share the specific location of the UWB car key in the car with the intelligent control module, so that the intelligent control module can detect when the UWB car key is in the car. When the position is the preset position, it provides preset intelligent control. For example, when the position of the UWB car key in the car is determined to be the first position, the first preset operation is performed; or when the position of the UWB car key in the car is determined to be the second position, the second preset operation is performed.
作为一种示例,若第一位置为主驾驶位,上述第一预设操作可以包括但不限于以下中的一种或多种:启动车辆、播放音乐、启动中控屏并在中控屏显示预设应用界面、打开空调。As an example, if the first position is the main driving position, the above-mentioned first preset operation may include but is not limited to one or more of the following: starting the vehicle, playing music, starting the central control screen and displaying it on the central control screen Default application interface and turn on the air conditioner.
作为另一种示例,若第二位置为副驾驶位或者后排座位,上述第二预设操作可以包括但不限于以下中的一种或多种:播放音乐、启动第二位置处的显示屏并在对应显示屏显示预设应用界面、打开空调。As another example, if the second position is the passenger seat or the rear seat, the second preset operation may include but is not limited to one or more of the following: playing music, activating the display screen at the second position. And display the preset application interface on the corresponding display screen and turn on the air conditioner.
可以理解,在车外场景中,基于本申请实施例提供的方案,数字车钥匙定位系统通过采用运动数据和测距数据融合的定位策略进行UWB车钥匙的定位。该方案可以通过UWB车钥匙的运动数据弥补处于NLOS区时测距数据缺失的弊端,以及通过测距数据弥补单纯基于UWB车钥匙的运动数据无法确定UWB车钥匙与车辆之间的相对位置关系的弊端。并且,在车外的LOS区,运动数据和测距数据融合的定位策略也可以得到比基于单一类别数据更加精确的定位结果。因此,无论UWB车钥匙位于车外的NLOS区还是LOS区,基于融合位姿策略均可以提供车外场景下稳定、连贯、精确的UWB车钥匙定位能力。It can be understood that in the off-car scene, based on the solution provided by the embodiment of the present application, the digital car key positioning system uses a positioning strategy that integrates motion data and ranging data to position the UWB car key. This solution can use the motion data of the UWB car key to make up for the shortcomings of the lack of ranging data when it is in the NLOS zone, and use the ranging data to make up for the inability to determine the relative position between the UWB car key and the vehicle based solely on the motion data of the UWB car key. Disadvantages. Moreover, in the LOS area outside the vehicle, the positioning strategy that fuses motion data and ranging data can also obtain more accurate positioning results than based on a single category of data. Therefore, regardless of whether the UWB car key is located in the NLOS area or the LOS area outside the car, the fusion pose strategy can provide stable, consistent, and accurate UWB car key positioning capabilities in the outside scene.
示例性地,图17示出了基于本申请实施例提供的方案得到的车外场景下,在用户携带UWB车钥匙绕着车辆外约1.5米左右走一圈的过程中,数字车钥匙定位系统得到的高精度的运动轨迹跟踪效果图。Illustratively, Figure 17 shows the digital car key positioning system in an outdoor scene based on the solution provided by the embodiment of the present application. When the user carries the UWB car key and walks about 1.5 meters outside the vehicle, the digital car key positioning system The resulting high-precision motion trajectory tracking rendering.
另外,可以理解,在对处于车内的UWB车钥匙进行定位时,由于基于UWB车钥匙的运动数据仅能确定UWB车钥匙的位置变化,而无法确定UWB车钥匙在车辆内的具体位置,因此无法基于UWB车钥匙的运动数据实现对UWB车钥匙的定位。并且,车内场景下,由于座位的遮挡等原因,若采用传统的依据测距数据进行UWB车钥匙位置计算的方法,会由于测距数据缺失甚至测距数据获取失败或者测距不准确等原因导致定位结果不准确的问题。而本申请实施例提供的在车内场景中采用增强识别的策略,通过与定位数据库中大量定位数据匹配的方式确定UWB车钥匙在车内的位置,该方法可以提供车内场景下稳定、连贯、精确的UWB车钥匙定位能力,例如识别UWB车钥匙位于主驾驶位、副驾驶位还是后排位,或者还可以进一步识别UWB车钥匙位于后排的左后座位还是右后座位。In addition, it can be understood that when locating the UWB car key in the car, since the motion data of the UWB car key can only determine the position change of the UWB car key, but cannot determine the specific position of the UWB car key in the vehicle, therefore The positioning of the UWB car key cannot be achieved based on the motion data of the UWB car key. Moreover, in the car scene, due to the occlusion of seats and other reasons, if the traditional method of calculating the UWB car key position based on ranging data is used, the ranging data may be missing or even the ranging data may fail to be obtained or the ranging may be inaccurate. Problems that lead to inaccurate positioning results. The embodiments of this application provide an enhanced recognition strategy in the car scene to determine the location of the UWB car key in the car by matching with a large amount of positioning data in the positioning database. This method can provide stable and coherent identification in the car scene. , Accurate UWB car key positioning capabilities, such as identifying whether the UWB car key is located in the main driver's seat, passenger seat, or rear seat, or it can further identify whether the UWB car key is located in the left rear seat or the right rear seat of the rear row.
示例性地,如图18所示,UWB车钥匙位于不同座位上时的测距值分布箱体图。其中,如图18中的(a)、图18中的(b)、图18中的(c)和图18中的(d)所示,不管UWB车钥匙位于主驾驶位、副驾驶位、左后座位还是右后座位,UWB车钥匙的测距值因UWB车钥匙所处的位置的不同具有不同的分布特性,基于此,通过将测距数据与定位数据库中定位数据比较的方式可以确定UWB在车内的位置。另外,如图18中的(c)所示,尽管由于座位的遮挡等原因导致无法获取UWB车钥匙与UWB基站4之间的测距值,基于本申请实施例提供的方案,仍然可以通过比较UWB车钥匙和其它UWB基站(包括UWB基站1、UWB基站2、UWB基站3、UWB基站5和UWB基站6)之间的测距值与定位数据库中的定位数据,确定UWB在车内的位置。以及,如图18中的(d)所示,尽管由于座位的遮挡等原因导致无法获取UWB车钥匙与UWB基站1之间的测距值,基于本申请实施例提供的方案,仍然可以通过比较UWB车钥匙和其它UWB基站(包括UWB基站2、UWB基站3、UWB基站4、UWB基站5和UWB基站6)之间的测距值与定位数据库中的定位数据,确定UWB在车内的位置。因此,基于本申请实施例提供在车内场景中采用增强识别的策略,通过将已有的测距数据与定位数据库中大量定位数据匹配的方式,依然可以实现车内场景下稳定、连贯的UWB车钥匙定位能力。For example, as shown in Figure 18, the box plot of the ranging value distribution when the UWB car key is located on different seats. Among them, as shown in Figure 18 (a), Figure 18 (b), Figure 18 (c) and Figure 18 (d), no matter the UWB car key is located in the main driver's seat, passenger seat, Whether it is the left rear seat or the right rear seat, the ranging value of the UWB car key has different distribution characteristics depending on the location of the UWB car key. Based on this, it can be determined by comparing the ranging data with the positioning data in the positioning database. The location of UWB in the car. In addition, as shown in (c) of Figure 18 , although the distance measurement value between the UWB car key and the UWB base station 4 cannot be obtained due to the obstruction of the seat or other reasons, based on the solution provided by the embodiment of the present application, it is still possible to obtain the distance measurement value through comparison The ranging value between the UWB car key and other UWB base stations (including UWB base station 1, UWB base station 2, UWB base station 3, UWB base station 5 and UWB base station 6) and the positioning data in the positioning database determine the UWB position in the car . And, as shown in (d) in Figure 18, although the ranging value between the UWB car key and the UWB base station 1 cannot be obtained due to the obstruction of the seat and other reasons, based on the solution provided by the embodiment of the present application, it can still be compared The ranging value between the UWB car key and other UWB base stations (including UWB base station 2, UWB base station 3, UWB base station 4, UWB base station 5 and UWB base station 6) and the positioning data in the positioning database determine the UWB position in the car . Therefore, based on the embodiments of this application, a strategy for enhanced identification is provided in the in-car scene. By matching the existing ranging data with a large amount of positioning data in the positioning database, stable and coherent UWB in the in-car scene can still be achieved. Car key locating capability.
又如,请参考以下表1,表1示出了基于本申请实施例提供的方法可以实现的UWB车钥匙在车内的定位精度。如表1所示,基于本申请实施例提供的方法可以达到车内场景下的位置识别精度大于94%,召回率大于95%的效果。该指标通常可以满足多种业务(如智能化控制功能)的需求。For another example, please refer to the following Table 1. Table 1 shows the positioning accuracy of the UWB car key in the car that can be achieved based on the method provided by the embodiment of the present application. As shown in Table 1, based on the method provided by the embodiment of the present application, the position recognition accuracy in the in-car scene is greater than 94%, and the recall rate is greater than 95%. This indicator can usually meet the needs of multiple businesses (such as intelligent control functions).
表1Table 1
Figure PCTCN2022112172-appb-000009
Figure PCTCN2022112172-appb-000009
上述实施例仅以图10所示逐渐走向车辆(记作阶段1)→进入车辆→位于车内(记作阶段2)的过程为例,示出了本申请实施例提供的一种UWB车钥匙的定位方法。对于图 10所示位于车内(记作阶段2)→走出车辆→逐渐远离车辆(记作阶段3)的过程,也可以采用类似的方法进行车内场景定位到车外场景定位的切换。本申请实施例不作重复介绍。The above embodiment only takes the process of gradually walking towards the vehicle (denoted as stage 1)→entering the vehicle→locating in the car (denoted as stage 2) as shown in Figure 10 as an example to illustrate a UWB car key provided by the embodiment of the present application. positioning method. For the process shown in Figure 10 of being in the car (denoted as stage 2) → walking out of the vehicle → gradually moving away from the vehicle (denoted as phase 3), a similar method can also be used to switch from in-car scene positioning to scene positioning outside the car. The embodiments of this application will not be repeatedly introduced.
示例性地,对于图10所示位于车内(记作阶段2)→走出车辆→逐渐远离车辆(记作阶段3)的过程,数字车钥匙定位系统可以在车内场景下通过采集到的UWB车钥匙在车内的测距数据从定位数据库中确定与UWB车钥匙在车内的测距数据匹配度最高的定位数据,以实现UWB车钥匙在车内的定位(可参考上述S1107和S1108)。进一步地,在识别到UWB车钥匙从车内到车外时,数字车钥匙定位系统可以将用于UWB车钥匙定位的策略切换为融合位姿策略,通过持续获取的UWB车钥匙在车外的测距数据和UWB车钥匙的运动数据建立约束条件、获取UWB车钥匙的初步运动轨迹、确定多个约束条件的权重、根据确定的多个约束条件的权重优化初步运动轨迹以实现UWB车钥匙在车外的定位(可参考上述S1101和S1104)。For example, for the process of being in the car (denoted as stage 2) → walking out of the vehicle → gradually moving away from the vehicle (denoted as phase 3) shown in Figure 10, the digital car key positioning system can use the collected UWB in the in-car scene The ranging data of the car key in the car is determined from the positioning database to the positioning data that best matches the ranging data of the UWB car key in the car, so as to realize the positioning of the UWB car key in the car (refer to S1107 and S1108 above) . Further, when it is recognized that the UWB car key moves from inside the car to outside the car, the digital car key positioning system can switch the strategy used for UWB car key positioning to the fusion posture strategy, and the UWB car key can be continuously obtained outside the car through the positioning strategy. The ranging data and the motion data of the UWB car key establish constraint conditions, obtain the preliminary motion trajectory of the UWB car key, determine the weights of multiple constraints, and optimize the preliminary motion trajectory based on the determined weights of the multiple constraints to realize the UWB car key. Positioning outside the vehicle (refer to S1101 and S1104 above).
应理解,本申请实施例的各个方案可以进行合理的组合使用,并且实施例中出现的各个术语的解释或说明可以在各个实施例中互相参考或解释,对此不作限定。It should be understood that the various solutions in the embodiments of the present application can be used in reasonable combinations, and the explanations or explanations of various terms appearing in the embodiments can be referred to or explained in each embodiment, without limitation.
还应理解,在本申请的各种实施例中,上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。It should also be understood that in various embodiments of the present application, the size of the sequence numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its functions and internal logic, and should not be implemented in this application. The implementation of the examples does not constitute any limitations.
可以理解的是,数字车钥匙定位装置为了实现上述任一个实施例的功能,其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。It can be understood that, in order to realize the functions of any of the above embodiments, the digital car key positioning device includes corresponding hardware structures and/or software modules to perform each function. Persons skilled in the art should easily realize that, with the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving the hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered beyond the scope of this application.
本申请实施例可以对数字车钥匙定位装置进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。需要说明的是,本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。Embodiments of the present application can divide the digital car key positioning device into functional modules. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware or software function modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. In actual implementation, there may be other division methods.
还应理解,数字车钥匙定位装置中的各个模块可以通过软件和/或硬件形式实现,对此不作具体限定。换言之,数字车钥匙定位装置是以功能模块的形式来呈现。这里的“模块”可以指特定应用集成电路ASIC、电路、执行一个或多个软件或固件程序的处理器和存储器、集成逻辑电路,和/或其它可以提供上述功能的器件。It should also be understood that each module in the digital car key positioning device can be implemented in the form of software and/or hardware, and there is no specific limitation on this. In other words, the digital car key positioning device is presented in the form of a functional module. "Module" here may refer to an application specific integrated circuit (ASIC), a circuit, a processor and memory that executes one or more software or firmware programs, an integrated logic circuit, and/or other devices that can provide the above functions.
在一种可选的方式中,当使用软件实现数据传输时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地实现本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其它可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线((digital subscriber  line,DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如软盘、硬盘、磁带)、光介质(例如数字化视频光盘(digital video disk,DVD))、或者半导体介质(例如固态硬盘solid state disk(SSD))等。In an optional manner, when software is used to implement data transmission, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of this application are implemented in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, e.g., the computer instructions may be transferred from a website, computer, server, or data center Transmission to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available media that can be accessed by a computer or a data storage device such as a server or data center integrated with one or more available media. The available media may be magnetic media, (such as floppy disks, hard disks, etc. , tape), optical media (such as digital video disk (DVD)), or semiconductor media (such as solid state disk (SSD)), etc.
结合本申请实施例所描述的方法或者算法的步骤可以硬件的方式来实现,也可以是由处理器执行软件指令的方式来实现。软件指令可以由相应的软件模块组成,软件模块可以被存放于RAM存储器、闪存、ROM存储器、EPROM存储器、EEPROM存储器、寄存器、硬盘、移动硬盘、CD-ROM或者本领域熟知的任何其它形式的存储介质中。一种示例性地存储介质耦合至处理器,从而使处理器能够从该存储介质读取信息,且可向该存储介质写入信息。当然,存储介质也可以是处理器的组成部分。处理器和存储介质可以位于ASIC中。另外,该ASIC可以位于数字车钥匙定位装置中。当然,处理器和存储介质也可以作为分立组件存在于数字车钥匙定位装置中。The steps of the methods or algorithms described in conjunction with the embodiments of the present application can be implemented in hardware, or can be implemented in a processor executing software instructions. Software instructions can be composed of corresponding software modules, and the software modules can be stored in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disks, mobile hard disks, CD-ROM or any other form of storage well known in the art. in the medium. An exemplary storage medium is coupled to the processor such that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and storage media may be located in an ASIC. In addition, the ASIC can be located in the digital car key locating device. Of course, the processor and the storage medium may also exist as discrete components in the digital car key locating device.
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。Through the above description of the embodiments, those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be allocated as needed. It is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

Claims (26)

  1. 一种数字车钥匙的定位方法,其特征在于,所述方法包括:A method for locating a digital car key, characterized in that the method includes:
    获取位于车内的数字车钥匙和车内多个UWB模块之间的第一距离数据组,所述第一距离数据组包括所述数字车钥匙分别与所述多个UWB模块之间的测距值;Obtaining a first distance data set between a digital car key located in the car and multiple UWB modules in the car, where the first distance data set includes ranging between the digital car key and the multiple UWB modules respectively. value;
    从定位数据库中确定与所述第一距离数据组匹配度最高的定位数据,其中所述定位数据库中的所述定位数据用于表征车内多个位置与所述多个UWB模块之间的测距值;Determine the positioning data that has the highest matching degree with the first distance data set from a positioning database, where the positioning data in the positioning database is used to represent the measurement distance between multiple locations in the vehicle and the multiple UWB modules. distance value;
    确定所述数字车钥匙在车内的位置为与所述第一距离数据组匹配度最高的定位数据对应的位置标签所指示的位置。The position of the digital car key in the car is determined to be the position indicated by the position tag corresponding to the positioning data with the highest matching degree of the first distance data set.
  2. 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method of claim 1, further comprising:
    分别获取用户携带所述数字车钥匙位于车内多个位置时,所述数字车钥匙与所述多个UWB模块之间的多个第二距离数据组,得到样本数据;Obtain multiple second distance data groups between the digital car key and the plurality of UWB modules when the user carries the digital car key and is located at multiple locations in the car, respectively, to obtain sample data;
    对所述样本数据进行训练,得到所述定位数据库,所述定位数据库中包括多个定位数据,其中一个定位数据包括车内一个位置分别与所述多个UWB模块之间的测距值;一个定位数据与一个位置标签相关联。The sample data is trained to obtain the positioning database. The positioning database includes a plurality of positioning data, one of which includes ranging values between a position in the vehicle and the plurality of UWB modules; Location data is associated with a location tag.
  3. 根据权利要求1或2所述的方法,其特征在于,所述从定位数据库中确定与所述第一距离数据组匹配度最高的定位数据,包括:The method according to claim 1 or 2, wherein determining the positioning data with the highest matching degree to the first distance data group from the positioning database includes:
    分别计算所述第一距离数据组与所述多个定位数据之间的相似度,所述相似度与所述第一距离数据组中的多个测距值与定位数据中对应测距值之间的空间距离相关;Calculate the similarity between the first distance data group and the plurality of positioning data respectively, and the similarity is the sum of the plurality of ranging values in the first distance data group and the corresponding ranging value in the positioning data. related to the spatial distance between;
    确定与所述第一距离数据组相似度最高的定位数据是与所述第一距离数据组匹配度最高的定位数据。It is determined that the positioning data with the highest similarity to the first distance data group is the positioning data with the highest matching degree to the first distance data group.
  4. 根据权利要求1-3中任一项所述的方法,其特征在于,所述方法还包括:The method according to any one of claims 1-3, characterized in that the method further includes:
    若确定所述数字车钥匙在车内的位置为第一位置,执行第一预设操作;If it is determined that the position of the digital car key in the car is the first position, perform the first preset operation;
    若确定所述数字车钥匙在车内的位置为第二位置,执行第二预设操作。If it is determined that the position of the digital car key in the car is the second position, a second preset operation is performed.
  5. 根据权利要求4所述的方法,其特征在于,所述第一位置是主驾驶位,所述第一预设操作包括以下中的一种或多种:启动车辆、播放音乐、启动中控屏并在所述中控屏显示预设应用界面、打开空调。The method according to claim 4, characterized in that the first position is the main driving position, and the first preset operation includes one or more of the following: starting the vehicle, playing music, starting the central control screen The preset application interface is displayed on the central control screen and the air conditioner is turned on.
  6. 根据权利要求5所述的方法,其特征在于,所述定位数据库中与所述第一距离数据组匹配度最高的定位数据与主驾驶位相关联。The method according to claim 5, characterized in that the positioning data in the positioning database that has the highest matching degree with the first distance data group is associated with the main driving position.
  7. 根据权利要求4所述的方法,其特征在于,所述第二位置是副驾驶位或者后排座位,所述第二预设操作包括以下中的一种或多种:播放音乐、启动所述第二位置处的显示屏并在对应显示屏显示预设应用界面、打开空调。The method of claim 4, wherein the second position is a passenger seat or a rear seat, and the second preset operation includes one or more of the following: playing music, starting the The display screen at the second position displays the preset application interface on the corresponding display screen and turns on the air conditioner.
  8. 根据权利要求7所述的方法,其特征在于,所述定位数据库中与所述第一距离数据组匹配度最高的定位数据与副驾驶位相关联。The method according to claim 7, characterized in that the positioning data in the positioning database that has the highest matching degree with the first distance data group is associated with the passenger seat.
  9. 根据权利要求1-6中任一项所述的方法,其特征在于,所述方法还包括:The method according to any one of claims 1-6, characterized in that the method further includes:
    在所述数字车钥匙位于车外时,对所述数字车钥匙进行轨迹跟踪;When the digital car key is located outside the car, track the digital car key;
    在识别到所述数字车钥匙从车外进入车内时,切换为车内位置识别策略,以识别所述数字车钥匙在车内的位置。When it is recognized that the digital car key enters the car from outside the car, the strategy is switched to an in-car location identification strategy to identify the location of the digital car key in the car.
  10. 根据权利要求9所述的方法,其特征在于,所述对所述数字车钥匙进行轨迹 跟踪,包括:The method according to claim 9, wherein tracking the digital car key includes:
    在用户携带所述数字车钥匙位于车外时,不断获取所述数字车钥匙相对于所述多个UWB模块的第三距离数据组,以及数字车钥匙的运动数据;When the user is outside the car with the digital car key, continuously obtain the third distance data group of the digital car key relative to the plurality of UWB modules, and the movement data of the digital car key;
    根据所述第三距离数据组和所述运动数据建立约束,获取所述数字车钥匙的初步运动轨迹;Establish constraints according to the third distance data group and the motion data, and obtain the preliminary motion trajectory of the digital car key;
    根据所述第三距离数据组的数据特征调整所述初步运动轨迹的多个约束条件的权重;Adjust the weights of the multiple constraints of the preliminary motion trajectory according to the data characteristics of the third distance data group;
    根据所述初步运动轨迹中所述多个约束条件的权重优化所述初步运动轨迹,得到所述数字车钥匙的运动轨迹。The preliminary movement trajectory is optimized according to the weights of the plurality of constraints in the preliminary movement trajectory to obtain the movement trajectory of the digital car key.
  11. 根据权利要求10所述的方法,其特征在于,所述多个UWB模块包括第一UWB模块和第二UWB模块,所述数字车钥匙与所述第一UWB模块之间的测距值小于所述数字车钥匙与所述第二UWB模块之间的测距值;The method of claim 10, wherein the plurality of UWB modules include a first UWB module and a second UWB module, and the ranging value between the digital car key and the first UWB module is less than The ranging value between the digital car key and the second UWB module;
    在调整所述多个约束条件之后,所述数字车钥匙与所述第一UWB模块对应的约束条件的权重大于所述数字车钥匙与所述第二UWB模块对应的约束条件。After adjusting the plurality of constraints, the weight of the constraint corresponding to the digital car key and the first UWB module is greater than the weight of the constraint corresponding to the digital car key and the second UWB module.
  12. 一种车辆控制方法,其特征在于,所述方法应用于车辆控制装置,所述方法包括:A vehicle control method, characterized in that the method is applied to a vehicle control device, and the method includes:
    获取位于车内的数字车钥匙在车内的位置;Obtain the location of the digital car key located in the car;
    根据所述数字车钥匙在车内的位置对车辆执行相应的控制,其中,所述数字车钥匙在车内的位置不同,则对车辆的控制权限不同。Corresponding control is performed on the vehicle according to the position of the digital car key in the car. Where the position of the digital car key in the car is different, the control authority for the vehicle is different.
  13. 根据权利要求12所述的方法,其特征在于,所述数字车钥匙在车内的位置为主驾驶位,所述根据所述数字车钥匙在车内的具体位置对车辆执行对应智能化控制包括:The method according to claim 12, characterized in that the position of the digital car key in the car is the main driving position, and performing corresponding intelligent control on the vehicle according to the specific position of the digital car key in the car includes: :
    执行以下中的一种或多种:启动车辆、播放音乐、启动中控屏并在所述中控屏显示预设应用界面、打开空调。Perform one or more of the following: start the vehicle, play music, start the central control screen and display the preset application interface on the central control screen, and turn on the air conditioner.
  14. 根据权利要求12所述的方法,其特征在于,所述数字车钥匙在车内的位置为副驾驶位,所述根据所述数字车钥匙在车内的具体位置对车辆执行对应智能化控制包括:The method according to claim 12, characterized in that the position of the digital car key in the car is the passenger seat, and performing corresponding intelligent control on the vehicle according to the specific position of the digital car key in the car includes :
    执行以下中的一种或多种:播放音乐、启动副驾屏并在所述副驾屏显示预设应用界面、打开空调。Perform one or more of the following: playing music, starting the passenger screen and displaying a preset application interface on the passenger screen, and turning on the air conditioner.
  15. 根据权利要求12-14中任一项所述的方法,其特征在于,所述确定位于车内的数字车钥匙在车内的位置,包括:The method according to any one of claims 12-14, wherein determining the location of the digital car key located in the car includes:
    获取所述数字车钥匙和车内多个UWB模块之间的第一距离数据组,所述第一距离数据组包括所述数字车钥匙分别与所述多个UWB模块之间的测距值;Obtaining a first distance data set between the digital car key and multiple UWB modules in the car, where the first distance data set includes ranging values between the digital car key and the multiple UWB modules respectively;
    从定位数据库中确定与所述第一距离数据组匹配度最高的定位数据;其中所述定位数据库中的所述定位数据用于表征车内多个位置与所述多个UWB模块之间的测距值;Determine the positioning data that has the highest matching degree with the first distance data set from the positioning database; wherein the positioning data in the positioning database is used to represent the measurement distance between multiple locations in the vehicle and the multiple UWB modules. distance value;
    确定所述数字车钥匙在车内的位置为与所述第一距离数据组匹配度最高的定位数据对应的位置标签所指示的位置。The position of the digital car key in the car is determined to be the position indicated by the position tag corresponding to the positioning data with the highest matching degree of the first distance data set.
  16. 一种车载系统,其特征在于,所述车载系统包括数字车钥匙定位装置,所述 数字车钥匙定位装置包括:A vehicle-mounted system, characterized in that the vehicle-mounted system includes a digital car key positioning device, and the digital car key positioning device includes:
    存储单元,用于存储定位数据库,所述定位数据库中包括多个定位数据,所述多个定位数据用于表征车内多个位置与车内多个UWB模块之间的测距值;A storage unit configured to store a positioning database, the positioning database including a plurality of positioning data, the plurality of positioning data being used to represent ranging values between multiple locations in the vehicle and multiple UWB modules in the vehicle;
    第一数据采集单元,用于采集位于车内的数字车钥匙与所述多个UWB模块之间的第一距离数据组,所述第一距离数据组包括所述数字车钥匙分别与所述多个UWB模块之间的测距值;The first data acquisition unit is used to collect the first distance data set between the digital car key located in the car and the plurality of UWB modules. The first distance data set includes the digital car key and the plurality of UWB modules respectively. Ranging value between UWB modules;
    处理单元,用于从所述定位数据库中确定与所述第一距离数据组匹配度最高的定位数据,进而确定所述数字车钥匙在车内的位置;其中,所述数字车钥匙在车内的位置为与所述第一距离数据组匹配度最高的定位数据对应的位置标签所指示的位置。A processing unit, configured to determine the positioning data with the highest matching degree to the first distance data group from the positioning database, and then determine the position of the digital car key in the car; wherein the digital car key is in the car The position of is the position indicated by the position tag corresponding to the positioning data with the highest matching degree of the first distance data group.
  17. 根据权利要求16所述的车载系统,其特征在于,The vehicle-mounted system according to claim 16, characterized in that:
    所述第一数据采集单元还用于:分别获取用户携带所述数字车钥匙位于车内多个位置时,所述数字车钥匙与所述多个UWB模块之间的多个第二距离数据组,得到样本数据;The first data collection unit is also configured to obtain a plurality of second distance data sets between the digital car key and the plurality of UWB modules when the user carries the digital car key and is located at multiple locations in the car. , get sample data;
    所述数字车钥匙定位装置还包括:The digital car key positioning device also includes:
    模型训练单元,用于对所述样本数据进行训练,得到所述定位数据库,所述定位数据库中包括多个定位数据,其中一个定位数据包括车内一个位置分别与所述多个UWB模块之间的测距值;一个定位数据与一个位置标签相关联。A model training unit, used to train the sample data to obtain the positioning database. The positioning database includes a plurality of positioning data, one of which includes the distance between a position in the vehicle and the plurality of UWB modules. ranging value; a positioning data is associated with a location label.
  18. 根据权利要求16或17所述的车载系统,其特征在于,所述处理单元从所述定位数据库中确定与所述第一距离数据组匹配度最高的定位数据,包括:The vehicle-mounted system according to claim 16 or 17, characterized in that the processing unit determines the positioning data with the highest matching degree with the first distance data group from the positioning database, including:
    所述处理单元采用分别计算所述第一距离数据组与所述多个定位数据之间的相似度,以及确定与所述第一距离数据组相似度最高的定位数据是与所述第一距离数据组匹配度最高的定位数据。The processing unit calculates the similarity between the first distance data group and the plurality of positioning data respectively, and determines that the positioning data with the highest similarity to the first distance data group is the same as the first distance data group. The positioning data with the highest matching degree of the data group.
  19. 根据权利要求16-18中任一项所述的车载系统,其特征在于,所述车载系统还包括:车辆控制装置;The vehicle-mounted system according to any one of claims 16-18, characterized in that the vehicle-mounted system further includes: a vehicle control device;
    所述车辆控制装置用于:The vehicle control device is used for:
    在所述数字车钥匙定位装置确定所述数字车钥匙在车内的位置为第一位置时,执行第一预设操作;When the digital car key positioning device determines that the position of the digital car key in the car is the first position, perform a first preset operation;
    在所述数字车钥匙定位装置确定所述数字车钥匙在车内的位置为第二位置时,执行第二预设操作。When the digital car key positioning device determines that the position of the digital car key in the car is the second position, a second preset operation is performed.
  20. 根据权利要求19所述的车载系统,其特征在于,所述第一位置是主驾驶位,所述第一预设操作包括以下中的一种或多种:启动车辆、播放音乐、启动中控屏并在中控屏显示预设应用界面、打开空调。The vehicle system according to claim 19, characterized in that the first position is the main driving position, and the first preset operation includes one or more of the following: starting the vehicle, playing music, starting the central control screen and display the preset application interface on the central control screen and turn on the air conditioner.
  21. 根据权利要求19所述的车载系统,其特征在于,所述第二位置是副驾驶位,所述第二预设操作包括以下中的一种或多种:播放音乐、启动副驾屏并在所述副驾屏显示预设应用界面、打开空调。The vehicle system according to claim 19, characterized in that the second position is the passenger seat, and the second preset operation includes one or more of the following: playing music, starting the passenger screen and clicking on the passenger seat. The passenger screen displays the preset application interface and turns on the air conditioner.
  22. 根据权利要求16-21中任一项所述的车载系统,其特征在于,所述数字车钥匙定位装置还用于:The vehicle system according to any one of claims 16-21, characterized in that the digital car key positioning device is also used for:
    在所述数字车钥匙位于车外时,对所述数字车钥匙进行轨迹跟踪;以及,When the digital car key is outside the car, track the digital car key; and,
    在识别到所述数字车钥匙从车外进入车内时,切换为车内位置识别策略,以识别 所述数字车钥匙在车内的位置。When it is recognized that the digital car key enters the car from outside the car, it switches to the in-car location identification strategy to identify the location of the digital car key in the car.
  23. 根据权利要求22所述的车载系统,其特征在于,所述第一数据采集单元还用于:在用户携带所述数字车钥匙位于车外时,不断获取所述数字车钥匙相对于所述多个UWB模块的第三距离数据组;The vehicle-mounted system according to claim 22, wherein the first data collection unit is further configured to: when the user carries the digital car key and is outside the vehicle, continuously obtain the relative information of the digital car key relative to the multiple The third distance data group of the UWB module;
    所述数字车钥匙定位装置还包括:第二数据采集单元,用于在用户携带所述数字车钥匙位于车外时,获取所述数字车钥匙的运动数据;The digital car key locating device further includes: a second data acquisition unit, configured to obtain movement data of the digital car key when the user is outside the car carrying the digital car key;
    所述数字车钥匙定位装置对所述数字车钥匙进行轨迹跟踪,包括:The digital car key positioning device performs trajectory tracking on the digital car key, including:
    所述处理单元根据所述第三距离数据组和所述运动数据建立约束,获取所述数字车钥匙的初步运动轨迹;根据所述第三距离数据组的数据特征调整所述初步运动轨迹的多个约束条件的权重;以及,根据所述初步运动轨迹中多个位置的权重优化所述初步运动轨迹,得到所述数字车钥匙的运动轨迹。The processing unit establishes constraints based on the third distance data group and the motion data to obtain the preliminary motion trajectory of the digital car key; adjusts the multiple parameters of the preliminary motion trajectory according to the data characteristics of the third distance data group. The weight of each constraint condition; and, optimizing the preliminary movement trajectory according to the weights of multiple positions in the preliminary movement trajectory to obtain the movement trajectory of the digital car key.
  24. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有计算机执行指令,所述计算机执行指令被处理电路执行时实现如权利要求1-11或12-15中任一项所述的方法。A computer-readable storage medium, characterized in that computer-executable instructions are stored on the computer-readable storage medium. When the computer-executable instructions are executed by a processing circuit, the computer-executable instructions implement any one of claims 1-11 or 12-15. method described in the item.
  25. 一种芯片系统,其特征在于,所述芯片系统包括处理电路、存储介质,所述存储介质中存储有指令;所述指令被所述处理电路执行时,实现如权利要求1-11或12-15中任一项所述的方法。A chip system, characterized in that the chip system includes a processing circuit and a storage medium, and instructions are stored in the storage medium; when the instructions are executed by the processing circuit, the implementation of claims 1-11 or 12- The method described in any one of 15.
  26. 一种计算机程序产品,其特征在于,所述计算机程序产品包括程序指令,所述程序指令被执行时,以实现如权利要求1-11或12-15中任一项所述的方法。A computer program product, characterized in that the computer program product includes program instructions, and when the program instructions are executed, the method as described in any one of claims 1-11 or 12-15 is implemented.
PCT/CN2022/112172 2022-08-12 2022-08-12 Digital car key positioning method, device and system WO2024031655A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/112172 WO2024031655A1 (en) 2022-08-12 2022-08-12 Digital car key positioning method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/112172 WO2024031655A1 (en) 2022-08-12 2022-08-12 Digital car key positioning method, device and system

Publications (1)

Publication Number Publication Date
WO2024031655A1 true WO2024031655A1 (en) 2024-02-15

Family

ID=89850445

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/112172 WO2024031655A1 (en) 2022-08-12 2022-08-12 Digital car key positioning method, device and system

Country Status (1)

Country Link
WO (1) WO2024031655A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080117098A1 (en) * 2006-11-22 2008-05-22 Zimmerman Associates, Inc. Vehicle-mounted ultra-wideband radar systems and methods
CN112896094A (en) * 2021-04-01 2021-06-04 上海科世达-华阳汽车电器有限公司 Operation control method, system and device and vehicle
CN114019943A (en) * 2021-11-05 2022-02-08 浙江吉利控股集团有限公司 Energy consumption control method and system for automobile key
CN114401471A (en) * 2022-03-23 2022-04-26 远峰科技股份有限公司 Intelligent cabin domain sound field adjusting method and device based on digital key

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080117098A1 (en) * 2006-11-22 2008-05-22 Zimmerman Associates, Inc. Vehicle-mounted ultra-wideband radar systems and methods
CN112896094A (en) * 2021-04-01 2021-06-04 上海科世达-华阳汽车电器有限公司 Operation control method, system and device and vehicle
CN114019943A (en) * 2021-11-05 2022-02-08 浙江吉利控股集团有限公司 Energy consumption control method and system for automobile key
CN114401471A (en) * 2022-03-23 2022-04-26 远峰科技股份有限公司 Intelligent cabin domain sound field adjusting method and device based on digital key

Similar Documents

Publication Publication Date Title
US10935978B2 (en) Vehicle self-localization using particle filters and visual odometry
El-Sheimy et al. Indoor navigation: State of the art and future trends
US10906549B2 (en) Systems and methods of autonomously controlling vehicle lane change maneuver
WO2021128777A1 (en) Method, apparatus, device, and storage medium for detecting travelable region
KR102315335B1 (en) Perceptions of assigned passengers for autonomous vehicles
US20190129431A1 (en) Visual place recognition based self-localization for autonomous vehicles
US20190301886A1 (en) Sensor fusion methods for augmented reality navigation
US11875519B2 (en) Method and system for positioning using optical sensor and motion sensors
CN111670419A (en) Active supplemental exposure settings for autonomous navigation
CN105916750A (en) Vehicle driving aid device and vehicle having same
US11276226B2 (en) Artificial intelligence apparatus and method for synthesizing images
KR101711797B1 (en) Automatic parking system for autonomous vehicle and method for controlling thereof
CN106371446A (en) Navigation and positioning system of indoor robot
CN105229490A (en) Use the positional accuracy of satellite visibility data for promoting
US11312375B2 (en) Vehicle anti-collision forewarning method, system and in-vehicle computer device
US10560253B2 (en) Systems and methods of controlling synchronicity of communication within a network of devices
CN113807470B (en) Vehicle driving state determination method and related device
US20220080976A1 (en) Mobile device and system for identifying and/or classifying occupants of a vehicle and corresponding method thereof
CN111192341A (en) Method and device for generating high-precision map, automatic driving equipment and storage medium
US20220049961A1 (en) Method and system for radar-based odometry
CN112307642A (en) Data processing method, device, system, computer equipment and storage medium
CN206209407U (en) A kind of Indoor Robot navigation positioning system
US20190296833A1 (en) Terminal apparatus and apparatus system
US10891048B2 (en) Method and system for user interface layer invocation
CN112269939B (en) Automatic driving scene searching method, device, terminal, server and medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22954614

Country of ref document: EP

Kind code of ref document: A1