WO2023225811A1 - 辅助驾驶的方法、装置和车辆 - Google Patents
辅助驾驶的方法、装置和车辆 Download PDFInfo
- Publication number
- WO2023225811A1 WO2023225811A1 PCT/CN2022/094524 CN2022094524W WO2023225811A1 WO 2023225811 A1 WO2023225811 A1 WO 2023225811A1 CN 2022094524 W CN2022094524 W CN 2022094524W WO 2023225811 A1 WO2023225811 A1 WO 2023225811A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- driving
- vehicle
- driver
- information
- reminder information
- Prior art date
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W40/09—Driving style or behaviour
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/18—Information management
- B60K2360/186—Displaying information according to relevancy
- B60K2360/1868—Displaying information according to relevancy according to driving situations
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/146—Display means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2520/00—Input parameters relating to overall vehicle dynamics
- B60W2520/10—Longitudinal speed
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/30—Driving style
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2554/00—Input parameters relating to objects
- B60W2554/80—Spatial relation or speed relative to objects
- B60W2554/802—Longitudinal distance
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2555/00—Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
- B60W2555/60—Traffic rules, e.g. speed limits or right of way
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2556/00—Input parameters relating to data
- B60W2556/10—Historical data
Definitions
- the present application relates to the field of intelligent driving, and more specifically, to a method, device and vehicle for assisted driving.
- This application provides a driving assistance method, device and vehicle that can identify drivers with different driving habits and provide adaptive reminders based on the driver's driving habits, thereby improving the driver's driving experience and driving safety.
- the vehicle (sometimes referred to as a vehicle) in this application is a vehicle in a broad sense, which can be a means of transportation (such as a car, a truck, a motorcycle, a train, an airplane, a ship, etc.), an industrial vehicle (such as a forklift, a trailer, a tractor, etc.) vehicles, etc.), engineering vehicles (such as excavators, bulldozers, cranes, etc.), agricultural equipment (such as lawn mowers, harvesters, etc.), amusement equipment, toy vehicles, etc.
- This application does not limit the types of vehicles.
- the first aspect provides a method of assisting driving, which can be executed by a vehicle; or it can also be executed by a vehicle-mounted terminal such as a vehicle machine; or it can also be executed by a chip or circuit for the vehicle.
- This method There are no restrictions on this application.
- device execution is taken as an example for description below. It should be understood that the device can be provided in a vehicle-mounted terminal or in other hardware equipment, which is not specifically limited in this application.
- the method may include: obtaining the real-time driving parameters of the driver when driving the vehicle and the surrounding environment information of the vehicle; determining the driver's driving habits based on the real-time driving parameters and the surrounding environment information; and when the driving habits satisfy the first preset When conditions are met, driving reminder information is prompted to the driver.
- the driver's driving habits can be determined based on the vehicle driving parameters and the vehicle's surrounding environment data obtained in real time when the driver drives the vehicle. It should be understood that the driving habits refer to the driver's driving activities during long periods of time. Driving behavior or driving tendency that is gradually developed and cannot be easily changed for a while. Furthermore, it can be determined based on the driver's driving habits whether to provide driving reminders while the vehicle is driving, which helps drivers with poor driving habits improve their driving behavior. Especially in the field of shared cars, the driver may be different every time he or she uses the vehicle, and the driving habits of the drivers may also vary.
- real-time acquisition of driving data and determination of the driver's driving habits can help drivers with poor driving habits learn and/or consolidate what they need to pay attention to during driving by prompting driving reminder information to drivers with poor driving habits. It helps drivers develop good driving habits and improves driving safety.
- the real-time driving data may include driving data obtained from the time the driver starts the vehicle during the current trip of the vehicle, or may also include driving data obtained from the first time, which is the current time.
- the time is moved forward by a preset duration.
- the preset duration may be 20 minutes, or it may be 40 minutes, or it may be other durations.
- real-time driving parameters include but are not limited to: vehicle speed, vehicle acceleration, accelerator opening during acceleration, vehicle deceleration, brake opening during deceleration, steering wheel angle and turning rate during turning, and parking time.
- Surrounding environment information includes but is not limited to: road information (such as congestion, pedestrians around, curves, traffic signs, etc.), surrounding vehicle information (such as the distance to the vehicle in front).
- the driver's driving habits can be characterized according to the driving habit scores.
- Score (Driving Habits) a 1+ a 2+ a 3+ a 4+ a 5 .
- a 1 to a 5 respectively represent the weight of vehicle speed, yield, vehicle distance, temporary parking, and traffic regulations.
- the value of a 1 to a 5 can be any real number between 0 and 1. The higher the Score (Driving Habits) The smaller the value, the worse the driving habits.
- "driving habits satisfy the first preset condition” may include: Score (Driving Habits) is less than a first preset threshold, which represents a good driving habit score, such as 3 or 4.
- the driving habit score Score (Driving Habits) a 1+ a 2+ a 3+ a 4+ a 5+ a 6 .
- a 6 represents the weight of other driving behaviors, such as forward collision warning (FCW) and forced ADAS disengagement.
- FCW forward collision warning
- the value of a 6 can be from 0 to 1 any real number in between.
- "driving habits satisfy the first preset condition" may include: Score (Driving Habits) is less than a second preset threshold, which represents a good driving habit score, such as 4 or 5.
- the method further includes: determining the driver's driving experience according to the real-time driving parameters; wherein, when the driving habit satisfies the first preset condition, the method further includes: Prompting driving reminder information to the driver includes: prompting the driver with the driving reminder information when the driving habit satisfies the first preset condition and the driving experience satisfies the second preset condition.
- driving experience is used to characterize the driver's proficiency in driving a vehicle and/or the length of driving experience.
- the driver's driving experience is determined based on at least one of acceleration data, deceleration data, and steering data when the driver drives the vehicle.
- “driving experience satisfies the second preset condition” may include at least one of the following: the deceleration data of the driver while driving the vehicle falls within the range representing insufficient driving experience in the deceleration Gaussian model; The acceleration data falls within the range that represents insufficient driving experience in the acceleration Gaussian model, and the steering data during the driver's driving process falls within the range that represents insufficient driving experience in the steering Gaussian model.
- the driver's driving experience can also be determined based on real-time driving parameters and surrounding environment data.
- the driver's driving experience is determined based on the parking space type in the surrounding environment data and the driver's parking time while driving the vehicle. "The driving experience satisfies the second preset condition" may include the parking time in this type of parking space.
- the last x% of the required duration interval, x can be 50, 60, or other values.
- the braking smoothness of the vehicle on a certain road section can be determined based on the brake opening and braking action duration in the real-time driving parameters.
- the driver's driving experience can be determined based on the road information and braking smoothness in the surrounding environment data.
- "driving experience meets the second preset condition" may include that if the deceleration smoothness of the own vehicle during this driving trip is at the bottom y% of the deceleration smoothness value interval on the current road segment, x may take the value of 50, or 60, or It can also be other values.
- the method further includes: when detecting that the vehicle speed exceeds the preset speed, prompting the driver with vehicle speed reminder information, and the vehicle speed reminder information is used to remind to slow down. and/or the recommended vehicle speed; and/or when the other road user is detected, prompt the driver with yield indication information, which is used to remind the driver to give way to the other road user; and/or when the other road user is detected, the yield indication information is prompted to the driver.
- the driver is prompted with the distance reminder information.
- the distance reminder information is used to remind the driver to maintain the distance between vehicles and/or the recommended distance between vehicles; and/or during detection When the vehicle enters the restricted parking area, temporary parking reminder information is prompted to the driver.
- the temporary parking reminder information is used to remind the restricted parking area and/or parking duration; and/or when the vehicle is detected to change lanes, slow down, or When there is at least one of other vehicles behind the vehicle and obstacles on the driving road, a driving observation reminder message is prompted to the driver.
- the driving observation reminder information is used to prompt the driver to observe illegal and violation reminder information around the vehicle.
- the speed allowed by the road or the speed required for safe driving is different, then it is possible to determine whether the vehicle is overspeeding according to the road scenario, and when it is determined that the vehicle is overspeeding, a speed reminder is prompted to the driver. information.
- the driver will be prompted to slow down and/or the recommended speed on the road; or if there are pedestrians and/or around the road
- the driver will be prompted to slow down and/or the recommended speed on the road will be prompted; or, when the vehicle is detected to change lanes and merge into the main road, the vehicle will be detected to be exceeding the preset speed. If the preset speed is set, the driver will be prompted to slow down and/or the driver will be prompted for the recommended speed on the road.
- the driver can also be prompted with information such as the throttle amplitude and frequency, as well as the braking amplitude and frequency recommended by the driver.
- the above-mentioned other road users may include vulnerable road users (VRU), such as pedestrians, bicycles, electric vehicles, etc.; or may also include special vehicles, such as police cars, fire trucks, ambulances, etc. vehicles, engineering rescue vehicles, school buses, etc.; or, it may also include other road users other than the own vehicle in certain scenarios.
- VRU vulnerable road users
- special vehicles such as police cars, fire trucks, ambulances, etc. vehicles, engineering rescue vehicles, school buses, etc.
- a yield prompt message is prompted. For example, at an intersection with no traffic lights, no traffic signs, and no markings, when a vehicle is detected traveling from the right to the left of the own vehicle on the road perpendicular to the own vehicle, the driver is reminded to be aware of other road users. Give way.
- the driver can be prompted with the above information through one or more of a vehicle screen, a human machine interface (HMI), a head-up display, an audio-visual system, and other devices.
- HMI human machine interface
- obstacles on the driving road include objects that affect the driver's judgment of the road conditions, including but not limited to: one or more vehicles parked on both sides of the road, other vehicles on the congested road, and other objects that affect the driver's vision. object.
- the driver is reminded of different driving reminder information based on different driving scenarios, which helps the driver accumulate driving experience and/or improve driving habits for different scenarios. In addition, it also helps improve driving safety.
- the method further includes: at the end of the current trip, prompting the data of irregular driving that occurred in the current trip, and/or prompting the data of irregular driving that occurred in the current trip. Comparative results of irregular driving data and irregular driving data that occurred in historical trips.
- the data on irregular driving includes behaviors and/or times of irregular driving.
- the driver can be prompted with the above information through one or more devices such as a vehicle screen, vehicle audio and video equipment, and a head-up display.
- devices such as a vehicle screen, vehicle audio and video equipment, and a head-up display.
- only the trip route can be displayed, and/or the number of times the driver has completed the standard driving trip can be displayed to encourage the driver to continue to maintain good driving habits.
- the irregular driving includes the distance between the vehicle and the vehicle in front being less than or equal to the preset distance, failure to give way to other road users, illegal parking, and speeding. Driving or violating at least one of traffic rules.
- the method when the vehicle travels to the first road section and the first road section supports intelligent driving, the method further includes: prompting the driver to switch the vehicle to intelligent driving. driving mode.
- the intelligent driving mode of the vehicle can be a mode in which the vehicle completes driving behaviors such as lane keeping, overtaking and merging, stopping at red lights and running at green lights, and interacting with lights and flutes under the control of an intelligent system (rather than manual); or,
- the intelligent driving mode can also be a mode in which the vehicle's driving behavior is mainly controlled by the intelligent system. It should be understood that in the latter case, manual intervention in driving behavior is allowed, that is, the driver can respond accordingly to the actual road situation under a series of prompts from the intelligent system.
- the driver is promptly prompted to take over the vehicle when he is about to travel to a road section that does not support intelligent driving.
- the driver is supported to switch the vehicle from manual control mode to intelligent driving mode, which helps to reduce the driver's driving burden.
- the method before prompting the driver with the driving reminder information, the method further includes: determining the driving reminder information based on the surrounding environment information.
- the real-time driving parameters include a yielding parameter
- the yielding parameter is used to characterize the vehicle's behavior of yielding to other road users during the current trip.
- a device for assisting driving includes: an acquisition unit for acquiring real-time driving parameters when the driver drives the vehicle and the surrounding environment information of the vehicle; and a processing unit for obtaining the real-time driving parameters according to the real-time driving parameters. and the surrounding environment information to determine the driver's driving habits; a prompt unit is used to prompt the driver with driving reminder information when the driving habits meet the first preset condition.
- the processing unit is further configured to: determine the driver's driving experience based on the real-time driving parameters; the prompting unit is specifically configured to determine when the driving habit satisfies the first preset conditions, and when the driving experience satisfies the second preset condition, the driving reminder information is prompted to the driver.
- the prompt unit is also used to: when detecting that the vehicle speed exceeds the preset speed, prompt the driver with vehicle speed reminder information, and the vehicle speed reminder information is used to Reminders to slow down and/or recommended vehicle speeds; and/or prompt the driver with yield indication information when the other road user is detected, and the yield indication information is used to remind the driver to yield to other road users; and/or When the distance between the vehicle and the vehicle in front is less than or equal to the preset distance, the driver is prompted with a distance reminder message.
- the distance reminder message is used to remind the driver to maintain the distance between vehicles and/or the recommended distance between vehicles; and/or When it is detected that the vehicle enters the restricted parking area, a temporary parking reminder message is prompted to the driver.
- the temporary parking reminder message is used to remind the restricted parking area and/or parking duration; and/or when the vehicle is detected to change lanes or slow down.
- the driving observation reminder information is prompted to the driver.
- the driving observation reminder information is used to prompt the driver to observe illegal and violation reminder information around the vehicle.
- the prompt unit is also used to: at the end of the current trip, prompt the data of irregular driving that occurred in the current trip, and/or prompt the data in the current trip. Comparative results of the data on irregular driving that occurred and the data on irregular driving that occurred in historical trips.
- the irregular driving includes the distance between the vehicle and the vehicle in front being less than or equal to the preset distance, failure to give way to other road users, illegal parking, and speeding. Driving or violating at least one of traffic rules.
- the prompt unit when the vehicle travels to the first road section and the first road section supports intelligent driving, the prompt unit is also used to prompt the driver to switch the vehicle to smart driving mode.
- the processing unit is further configured to: determine the driving reminder information based on the surrounding environment information before prompting the driver with the driving reminder information.
- the real-time driving parameters include a yielding parameter
- the yielding parameter is used to characterize the vehicle's behavior of yielding to other road users during the current trip.
- a device for assisting driving includes: a memory for storing a program; a processor for executing the program stored in the memory.
- the processor is configured to execute the above-mentioned third program.
- the fourth aspect provides a driving assistant, which includes one of a virtual image and a physical image.
- the driving assistant includes at least one processor for executing the method in any possible implementation manner of the first aspect. ;
- the driving assistant can be carried on at least one of a vehicle screen, a head-up display HUD, a vehicle voice device, and a cockpit.
- the driving assistant in the embodiment of the present application may include a virtual image or a physical product.
- the virtual image may include a virtual digital person or other virtual image carried on the vehicle screen or head-up display HUD, or a virtual voice assistant carried on the vehicle voice device;
- the physical product may include a vehicle-mounted small robot carried in the cockpit, etc.
- a system for assisting driving includes the device in any of the possible implementations of the second aspect or the third aspect, or the driving assistant in any of the implementations of the fourth aspect.
- the sixth aspect provides an intelligent vehicle, which includes the device in any possible implementation of the second aspect or the third aspect, or the driving assistant in any implementation of the fourth aspect, or The system in any implementation manner of the fifth aspect.
- a computer program product includes: computer program code.
- the computer program code When the computer program code is run on a computer, it causes the computer to execute the method in any of the possible implementation modes of the first aspect. .
- the above computer program code may be stored in whole or in part on the first storage medium, where the first storage medium may be packaged together with the processor, or may be packaged separately from the processor. This is not the case in the embodiments of this application. Specific limitations.
- a computer-readable medium stores program code.
- the computer program code When the computer program code is run on a computer, it causes the computer to execute any of the possible implementation methods of the first aspect. method.
- a ninth aspect provides a chip, which includes a processor for calling a computer program or computer instructions stored in a memory, so that the processor executes the method in any of the possible implementations of the first aspect.
- the processor is coupled with the memory through an interface.
- the chip system further includes a memory, and a computer program or computer instructions are stored in the memory.
- Figure 1 is a schematic functional block diagram of a vehicle provided by an embodiment of the present application.
- FIG. 2 is a schematic diagram of the system architecture required for the implementation of an assisted driving method provided by an embodiment of the present application.
- FIG. 3 is a schematic flow chart of a driving assistance method provided by an embodiment of the present application.
- Figure 4 is a schematic diagram of the deceleration Gaussian model provided by the embodiment of the present application.
- FIG. 5 is a schematic diagram of an application scenario of a driving assistance method provided by an embodiment of the present application.
- FIG. 6 is another schematic diagram of an application scenario of a driving assistance method provided by an embodiment of the present application.
- FIG. 7 is another schematic diagram of an application scenario of a driving assistance method provided by an embodiment of the present application.
- FIG. 8 is another schematic flow chart of a driving assistance method provided by an embodiment of the present application.
- FIG. 9 is a schematic block diagram of a driving assistance device provided by an embodiment of the present application.
- Figure 10 is another schematic block diagram of a driving assistance device provided by an embodiment of the present application.
- Prefixes such as “first” and “second” are used in the embodiments of this application only to distinguish different description objects, and have no limiting effect on the position, order, priority, quantity or content of the described objects.
- the use of ordinal words and other prefixes used to distinguish the described objects does not limit the described objects.
- Words constitute redundant restrictions.
- plural means two or more.
- FIG. 1 is a functional block diagram of a vehicle 100 provided by an embodiment of the present application.
- the vehicle 100 may include a perception system 120 , a display device 130 , and a computing platform 150 , where the perception system 120 may include several types of sensors that sense information about the environment surrounding the vehicle 100 .
- the sensing system 120 may include a positioning system.
- the positioning system may be a global positioning system (GPS), a Beidou system or other positioning systems, an inertial measurement unit (IMU), a lidar, a millimeter One or more of wave radar, ultrasonic radar and camera device.
- GPS global positioning system
- IMU inertial measurement unit
- lidar a millimeter One or more of wave radar, ultrasonic radar and camera device.
- the computing platform 150 may include processors 151 to 15n (n is a positive integer).
- the processor is a circuit with signal processing capabilities.
- the processor may be a circuit with instruction reading and execution capabilities.
- CPU central processing unit
- microprocessor microprocessor
- GPU graphics processing unit
- DSP digital signal processor
- the processor can realize certain functions through the logical relationship of the hardware circuit. The logical relationship of the hardware circuit is fixed or can be reconstructed.
- the processor is an application-specific integrated circuit (application-specific integrated circuit).
- the process of the processor loading the configuration file and realizing the hardware circuit configuration can be understood as the process of the processor loading instructions to realize the functions of some or all of the above units.
- it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), tensor processing unit (TPU), deep learning processing Unit (deep learning processing unit, DPU), etc.
- the computing platform 150 may also include a memory, which is used to store instructions. Some or all of the processors 151 to 15n may call instructions in the memory and execute the instructions to implement corresponding functions.
- the display device 130 in the cockpit is mainly divided into two categories.
- the first category is a vehicle-mounted display screen;
- the second category is a projection display screen, such as a head-up display (HUD).
- the vehicle display screen is a physical display screen and an important part of the vehicle infotainment system.
- There can be multiple displays in the cockpit such as digital instrument display, central control screen, passenger in the co-pilot seat (also known as The display in front of the front passenger), the display in front of the left rear passenger, the display in front of the right rear passenger, and even the car window can be used as a display.
- Head-up display also known as head-up display system. It is mainly used to display driving information such as speed and navigation on the display device in front of the driver (such as the windshield).
- HUD includes, for example, combined head-up display (combiner-HUD, C-HUD) system, windshield-type head-up display (windshield-HUD, W-HUD) system, and augmented reality head-up display system (augmented reality HUD, AR-HUD).
- the vehicle display screen may include an HMI.
- embodiments of the present application provide a driving assistance method, device and vehicle, which can obtain the driver's driving data in real time, and determine whether to perform driving reminders based on the driving data, combined with vehicle surrounding environment information and/or vehicle driving status data. Determining the content of the reminder can help drivers with poor driving habits and/or insufficient driving experience learn and/or consolidate their driving experience, improve the driver's driving experience, and also help improve driving safety.
- the assisted driving system includes a driving virtual assistant unit, which includes a learning unit, a user interaction module, a control module, a data management module and a data acquisition module.
- the data acquisition module may include one or more camera devices in the sensing system 120 shown in Figure 1, and one or more sensors;
- the data management module may include one of the computing platforms 150 shown in Figure 1 or multiple memories;
- the user interaction module may include one or more of the display devices 130 in Figure 1 , and the user interaction module may also include a voice system;
- the control module may include one or more of the computing platforms 150 shown in Figure 1 processor;
- the learning unit may include one or more processors in the computing platform 150 shown in FIG.
- the learning unit may include a learning application unit and a learning method unit.
- the data acquisition module can obtain the driver's driving data, including acceleration data (such as acceleration rate, gas pedal position, number of acceleration adjustments), deceleration data (such as deceleration rate, brake opening) brake pedal position), steering data (such as steering wheel angle, turning rate), manual parking time, etc.
- the data management module can process driving data, such as calculating the driver's average manual parking time, etc.
- the data management module can also store the data obtained by the data acquisition module.
- the learning application unit can determine the driver's driving experience and driving habits based on the driving data, the data processed by the data management module, and the algorithm stored in the learning method unit.
- the data acquisition module can also obtain the vehicle's surrounding environment information, where the vehicle's surrounding environment information includes but is not limited to: road information (such as congestion, pedestrians around, curves, traffic signs, etc.), surrounding vehicle information (such as the relationship with the vehicle in front) distance).
- the learning unit can determine whether to provide a driving reminder and the content of the driving reminder based on the vehicle surrounding environment information and/or vehicle driving status data in the data acquisition module, combined with the driver's driving experience and driving habits.
- driving reminders include at least one of the following: speed reminders, road right reminders, driving observation reminders, vehicle distance reminders, temporary/prohibited parking reminders, and other illegal and illegal driving behavior reminders.
- the assisted driving system also includes an automatic driving (advanced driver assistance system, ADAS) unit, which is connected to one or more sensors in the perception system shown in Figure 1.
- ADAS automatic driving
- the driving virtual assistant The unit can obtain driving data and vehicle surrounding environment information from the autonomous driving unit.
- control instructions can also be sent to the automatic driving unit through the control module in the driving virtual assistant unit, so that the automatic driving unit can provide driving reminders.
- the above modules and systems are only examples. In actual applications, the above modules and systems may be added or deleted according to actual needs.
- the data management module and the data processing module can be combined into one module, or the learning unit and the control module can also be combined into one module.
- FIG. 3 shows a schematic flowchart of a driving assistance method provided by an embodiment of the present application.
- the method 300 may be applied to the vehicle shown in FIG. 1 , or may be executed by the system shown in FIG. 2 . It should be understood that the steps or operations of the assisted driving method shown in FIG. 3 are only exemplary, and the embodiments of the present application may also perform other operations or modifications of each operation in FIG. 3 .
- the method 300 includes:
- acceleration data such as acceleration, throttle opening, etc.
- deceleration data such as deceleration, brake opening, etc.
- steering data such as steering wheel angle, turning rate, etc.
- manual parking time and other data are obtained.
- the moment when the driver's driving data is started to be acquired may be the moment when the driver starts the vehicle.
- the driving data may include driving data of the current trip. More specifically, the driving data may include driving data obtained from the time the driver starts the vehicle during the current trip, or may also include driving data from the first moment of the trip.
- the first time is the time when the current time is moved forward by a preset time.
- the preset time can be 20 minutes (minutes, min), or it can be 40 minutes, or it can also be Other durations.
- S302 determine the driver's driving experience and driving habits.
- driving experience and driving habits are used to characterize the driver's driving behavior.
- driving experience represents the driver's proficiency in driving a vehicle and/or the length of driving experience
- driving habits are used to represent the driving behavior or driving tendency that the driver has gradually developed during long-term driving activities and is not easy to change for a while. It should be understood that a driver with rich driving experience may not necessarily have good driving habits, and a driver with excellent driving habits may not necessarily have rich driving experience.
- the driver's driving experience and driving habits can be determined based on the driver's driving data and the surrounding environment information during vehicle driving.
- the driver's driving experience can be determined based on the duration of manual parking. For example, according to the parking space type, the time interval required for parking in this type of parking space is determined. Furthermore, if the parking time in the current trip is within the first x% of the time interval required for parking in this type of parking space, it is determined that the driver has rich driving experience; otherwise, it is determined that the driver has insufficient driving experience.
- x can be 50, or it can be 60, or it can be any real number between 0 and 100.
- the deceleration, acceleration and steering data in the driving data are compared with the corresponding Gaussian model to determine the driver's driving experience.
- the driver's driving experience can be determined based on the deceleration and braking duration.
- the Gaussian distribution of deceleration data can be determined according to the following formula:
- ⁇ is the standard deviation and ⁇ 2 is the variance.
- a deceleration Gaussian model as shown in Figure 4 can be established, where the upper ellipse in Figure 4 represents a driver who lacks driving experience (such as a novice driver), and the lower ellipse represents a driver with rich driving experience. Then compare the deceleration data in the driving data with the Gaussian model shown in Figure 4. If the deceleration data falls within the upper ellipse, it means that the driver lacks driving experience. If the deceleration data falls within the lower ellipse, it means that the driver is driving. More experienced.
- each set of deceleration data in the multiple sets of deceleration data will be judged separately, and then the judgment results of each set of deceleration data will be combined to determine the driving driver’s driving experience. For example, if more than 80% of the deceleration data falls within the upper ellipse, the driver is deemed to have insufficient driving experience; if more than 80% of the deceleration data falls within the lower ellipse, the driver is deemed to have insufficient driving experience. relatively rich.
- acceleration Gaussian model can also be used in combination with acceleration data to determine the driver's driving experience
- steering Gaussian model can be used in combination with steering data to determine the driver's driving experience
- the driving data of the current trip includes acceleration data, deceleration data and steering data at the same time
- the result A judged based on the acceleration data, the result D judged based on the deceleration data and the result D judged based on the steering data can be
- the judgment result T is combined to determine the driver's driving experience.
- A, D, and T can take 0 or 1 respectively. When taking 1, it means that the judgment result is "the driver has rich driving experience", and when taking 0, it means "the driver has insufficient driving experience”.
- the final result of the driving experience E 1 a*A+b*D+c*T, where a, b, and c are respectively the result A judged based on the acceleration data, the result D judged based on the deceleration data, and the result D judged based on the deceleration data.
- the weight of the result T of data judgment For example, a, b, and c can be 0.4, 0.3, and 0.3 respectively.
- E 1 is greater than or equal to 0.6, it is determined that the driver has rich driving experience.
- a, b, and c can also take other real numbers, and the judgment conditions can also change with the value of the weight, which is not specifically limited in this application.
- the final result of driving experience E 2 a*A+b*D+c*T+d*P, where P is the result judged based on the parking duration, and P can be respectively 0 or 1.
- P the result judged based on the parking duration
- P can be respectively 0 or 1.
- d is the weight of the result judged based on the parking time.
- a, b, c, and d can be 0.4, 0.3, 0.2, and 0.1 respectively.
- E 2 is greater than or equal to 0.5, it is determined that the driver has rich driving experience.
- the driver's driving experience can also be determined based on at least one of acceleration smoothness (acceleration smoothness), deceleration smoothness (deceleration smoothness), and turning smoothness (turning smoothness). For example, the value range of the acceleration smoothness (or deceleration smoothness, or steering smoothness) of historical passing vehicles on the road segment that the vehicle is currently traveling on is determined. Furthermore, if the acceleration smoothness (or deceleration smoothness, or steering smoothness) of the own vehicle during this trip is within the first y% of the value range of the acceleration smoothness on the current road section, it is determined that the driver has rich driving experience. Otherwise, it is determined that the driver has insufficient driving experience.
- acceleration smoothness acceleration smoothness
- deceleration smoothness deceleration smoothness
- turning smoothness turning smoothness
- x can be 50, or it can be 60, or it can be any real number between 0 and 100.
- the driver's driving experience can also be determined based on the acceleration smoothness, deceleration smoothness and steering smoothness.
- the current driver's driving habits can be characterized by a driving habit score Score (Driving Habits) .
- Score (Driving Habits) a 1+ a 2+ a 3+ a 4+ a 5 .
- a 1 to a 5 respectively represent the weight of vehicle speed, yield, distance between vehicles, temporary parking, and traffic regulations, as shown in Table 1.
- the values of a 1 to a 5 can be any real number between 0 and 1.
- a 1 takes 0, otherwise a 1 takes 1; when a specific event occurs in the current trip When the road section does not give way, a 2 takes 0, otherwise a 2 takes 1; when the proportion of following cars too close is greater than 0.5 in the current trip, a 3 takes 0, otherwise a 3 takes 1; in the current trip, if If a temporary parking occurs and blocks road traffic, a 4 will be taken as 0, otherwise a 4 will be taken as 1; during the current trip, if a violation of traffic regulations occurs, such as failure to follow lane lines, knowledge lights and signs, etc., then a 5 will be taken as 0, Otherwise a 5 takes 1.
- Score (Driving Habits) is greater than A, the driver's driving habits are good; when Score (Driving Habits) is less than or equal to A, the driver's driving habits need to be improved, where A is the good driving habit score.
- A may be 3 or 4, or may be other values from 0 to 5.
- the driver's driving experience and driving habits can also be determined in combination with driver profiles.
- the irregular driving behavior of each driver can also be counted separately within the preset trip.
- the preset stroke may be 500km, or 1000km, or other values.
- S304 is executed; otherwise, S305 is executed.
- the driver has rich driving experience and good driving habits includes: the driver has rich driving experience but poor driving habits; the driver has good driving habits but lacks driving experience; the driver has insufficient driving experience and Poor driving habits.
- S304 perform driving reminders and/or driving recommendations.
- vehicle surrounding environment information is obtained, and the content and timing of driving reminders and/or driving recommendations are determined based on the vehicle surrounding environment information.
- speed reminders and/or recommendations, right-of-way reminders and/or recommendations, driving observation reminders and/or recommendations, vehicle distance reminders and/or recommendations, temporary/prohibited parking reminders and/or recommendations can be performed. , reminders of other illegal driving behaviors.
- driving reminders and/or driving recommendations can be made through display devices such as central control screens, or driving reminders and/or driving recommendations can be made through voice broadcasts, or through human-computer interaction interfaces such as HMI. etc. to perform driving reminders and/or driving recommendations, which are not specifically limited in the embodiments of this application.
- One example is to remind the driver of driving observations and/or recommended vehicle speeds based on road risk and braking distance.
- driving reminders and/or driving recommendations are provided, such as reminding the driver to reduce the speed, or reminding the driver of the recommended vehicle speed, such as broadcasting reminders through display devices and/or voice.
- the driver can also be prompted to turn on intelligent driving.
- the driver can also be reminded of the recommended throttle amplitude and frequency, as well as braking amplitude and frequency and other information through the display device and/or voice broadcast.
- the current driving speed of the vehicle is 40km/h.
- the central control unit can The screen prompts "Please control the speed and pay attention to the vehicle on the left to prevent pedestrians from crossing."
- the recommended speed can also be prompted on the central control screen
- it can be displayed by flashing Increase the visibility of recommended speeds.
- driving suggestions can also be provided by combining vibrations of steering wheels, seat belts, seats and other equipment, and/or flashing of breathing lights (or ambient lights) in the car, to make driving suggestions more attractive to the driver. attention.
- the driver when it is determined that the driver has insufficient driving experience and/or has poor driving habits, the driver can also be advised to turn on smart driving through the central control screen.
- the central control screen displays "The current road section supports smart driving, is it enabled?". The driver can confirm that smart driving is enabled by clicking the "Yes” button on the screen, or, alternatively, You can click the "No” button on the screen to not enable smart driving.
- the vehicle's automatic driving module takes over the vehicle, controls the vehicle's driving speed to drop to 20km/h, and prompts the driver through the screen that "smart driving has been turned on", as shown in the figure. As shown in (c) in 5.
- the above recommended vehicle speed can be sensed and controlled by the autonomous driving system, or it can be received through vehicle to roadside infrastructure (V2I) communication, or it can also be received through other means.
- V2I vehicle to roadside infrastructure
- the accelerator amplitude and frequency of the reminder, as well as the braking amplitude and frequency, etc. can be calculated based on the recommended vehicle speed, or can also be determined through other methods.
- Another example prompting the driver to yield on a specific road section.
- give way to pedestrians in schools, residential areas and villages give way to pedestrians, bicycles and motorcycles in rainy and snowy days, turn right to left at intersections, give way at intersections without signal lights, give way at roundabouts, give way when entering the main road, give way on ramps, follow the traffic rules
- give way to signs and markings give way to overtaken vehicles, and give way to special vehicles (police cars, fire trucks, ambulances, engineering rescue vehicles and school buses).
- the location of other road users can be obtained through the vehicle sensing system, or can be determined through information received by V2I, or it can also be through vehicle-to-vehicle communication (V2V). ) is determined by the information received, or it can be determined by other means.
- V2I vehicle-to-vehicle communication
- V2V vehicle-to-vehicle communication
- Another example is that in restricted parking areas, such as railway stations and airport terminal curbs, the parking duration is prompted. If the lane is blocked, a reminder is given and an automatic adjustment option is given; when parking on a slope, turn the front wheels to prevent slipping. vehicles; no parking areas (according to traffic laws), reminders and suggestions for surrounding parking lots and parking spaces.
- information such as parking duration, recommended surrounding parking length and parking spaces can be determined through information received by V2I, or it can also be determined through vehicle to everything (V2X) information exchange.
- the information received may be determined by other means.
- low visibility weather such as rain, snow and fog, congestion, pedestrians around, and curves
- it is recommended to keep distance between vehicles when encountering other road users, such as large vehicles, parked vehicles, and bicycles , motorcycles, school buses and pedestrians, etc., please keep a distance between vehicles.
- the recommended distance between vehicles can be preset by the system.
- the recommended distance between vehicles can be set separately for different scenarios such as rain, snow, fog, low visibility weather, congestion, pedestrians around, curves, etc.; or , the recommended distance between vehicles can also be determined based on other methods.
- personalized reminders can also be provided for different drivers.
- driver A is a driver with inexperience and/or poor driving behavior, but within the preset trip (such as 1000km, or other), driver A has never failed to give way on a specific road section, then There is no need to remind you on the road sections where you need to give way.
- driving reminders may not be provided during driving to save energy consumption.
- the assisted driving method provided by the embodiments of the present application can also count the types and/or occurrence times of irregular driving behaviors during each trip, and provide a trip summary and reminder. For example, during a trip, poor driving behaviors include "failure to yield at intersections", “failure to keep a distance from large vehicles", and “illegal parking”, and the number of times the above behaviors occurred were 3, 4, and 4 times respectively. 3 times.
- the reminder information shown in (a) in Figure 7 is displayed to help the driver understand his driving performance and deepen his impression.
- the driver can also be compared with the number of bad driving behaviors recorded in the historical itinerary, and then the driver can be reminded of the changes in irregular driving behavior compared with the historical itinerary (such as "5 items have been improved compared to the last time") , to promote the development of good driving habits and maintain vigilance for safe driving.
- irregular driving behavior such as "5 items have been improved compared to the last time”
- the driver can be reminded of the changes in irregular driving behavior compared with the historical itinerary (such as "5 items have been improved compared to the last time") , to promote the development of good driving habits and maintain vigilance for safe driving.
- the content shown in (b) in Figure 7 can be displayed, "A very smooth trip, 0 risk events and 10 safe trips have been completed in a row, please keep it up!”. It should be understood that the above information can also be prompted to the driver through voice broadcast or other means.
- the driving assistance method provided by the embodiment of the present application can obtain the driver's driving data in real time, determine whether to provide a driving reminder based on the driving data, and determine the content of the reminder based on the vehicle's surrounding environment information and/or vehicle driving status data.
- the drivers who use a certain vehicle may be different each time, and their driving experience and driving habits are also uneven.
- obtaining driving data in real time and determining the driver's driving experience and driving habits, and then providing driving reminders can help improve driving safety.
- FIG. 8 shows a schematic flowchart of a driving assistance method 800 provided by an embodiment of the present application.
- the method 800 may be applied to the vehicle shown in FIG. 1 , or may be executed by the system shown in FIG. 2 . It should be understood that the steps or operations of the assisted driving method shown in FIG. 8 are only exemplary, and the embodiment of the present application may also perform other operations or modifications of each operation in FIG. 8 .
- the method 800 includes:
- S801 Obtain the real-time driving parameters of the driver when driving the vehicle and the surrounding environment information of the vehicle.
- the vehicle may be the vehicle 100 in the above embodiment, or may be another vehicle;
- the real-time driving data may include the driving data in the above embodiment, or may include the vehicle driving status data in the above embodiment, or It may also include vehicle driving parameters when other drivers drive the vehicle;
- the surrounding environment information may be the vehicle surrounding environment information in the above embodiment, or may also include other environment information around the vehicle during vehicle driving.
- S802 Determine the driver's driving habits based on the real-time driving parameters and the surrounding environment information.
- the driving habits may include the driving habits described in the above embodiments.
- the method of determining the driver's driving habits based on the real-time driving parameters and the surrounding environment information may refer to the description in the above embodiments, which will not be described here. Repeat.
- the first preset condition may include that the driving habit score Score (Driving Habits) in the above embodiment is less than the good driving habit score, or may be other conditions that can characterize the driver's poor driving habits.
- the driving habit score Score Driving Habits
- the good driving habit score or may be other conditions that can characterize the driver's poor driving habits.
- the driving reminder information may include the driving reminder and/or driving recommendation in the above embodiment, or may also include the speed reminder, road right reminder, driving observation reminder, vehicle distance reminder, temporary/prohibited parking reminder, and other illegal violations in the above embodiment. At least one of the driving violation reminders. More specifically, for the method of prompting the driver with driving reminder information, reference may be made to the description in the above embodiments, which will not be described again here.
- the driver's driving habits can be determined based on the vehicle driving parameters and the vehicle's surrounding environment information obtained in real time when the driver drives the vehicle. Furthermore, it can be determined based on the driver's driving habits whether the vehicle is driving. Driving reminders can help drivers with poor driving habits learn and/or consolidate what they need to pay attention to during driving, help drivers develop good driving habits, and also help improve driving safety.
- the method provided by the embodiment of the present application is described in detail above with reference to FIGS. 3 to 8 .
- the device provided by the embodiment of the present application will be described in detail below with reference to Figures 9 and 10.
- the description of the device embodiments corresponds to the description of the method embodiments. Therefore, for content that is not described in detail, please refer to the above method embodiments. For the sake of brevity, they will not be described again here.
- FIG. 9 shows a schematic block diagram of a driving assistance device 2000 provided by an embodiment of the present application.
- the device 2000 includes an acquisition unit 2010, a processing unit 2020, and a prompting unit 2030.
- the acquisition unit 2010 can implement corresponding communication functions, the processing unit 2020 is used for data processing, and the prompting unit 2030 is used to prompt driving reminder information to the driver.
- the device 2000 may also include a storage unit, which may be used to store instructions and/or data, and the processing unit 2020 may read the instructions and/or data in the storage unit, so that the device implements the foregoing method embodiments. .
- the apparatus 2000 may include units for performing the method in FIG. 3 or FIG. 8 . Moreover, each unit in the device 2000 and the above-mentioned other operations and/or functions are respectively intended to implement the corresponding processes of the method embodiment of FIG. 3 or FIG. 8 .
- the acquisition unit 2010 can be used to execute S801 in the method 800
- the processing unit 2020 can be used to execute S802 in the method 800
- the prompting unit 2030 can be used to execute the method 800. S803.
- the device 2000 includes: an acquisition unit 2010, used to acquire the real-time driving parameters when the driver drives the vehicle and the surrounding environment information of the vehicle; and a processing unit 2020, used to determine the real-time driving parameters and the surrounding environment information based on the real-time driving parameters and the surrounding environment information.
- the driver's driving habits; the prompt unit 2030 is used to prompt the driver with driving reminder information when the driving habits meet the first preset condition.
- the processing unit 2020 is also configured to: determine the driver's driving experience according to the real-time driving parameters; the prompting unit 2030 is specifically configured to: when the driving habit satisfies the first preset condition, and when When the driving experience meets the second preset condition, the driving reminder information is prompted to the driver.
- the prompt unit 2030 is also configured to: when detecting that the vehicle speed exceeds the preset speed, prompt the driver with vehicle speed reminder information, and the vehicle speed reminder information is used to remind the driver to decelerate and/or recommend vehicle speed; and/or when detecting other road users, prompt the driver with yield indication information, which is used to remind the driver to give way to other road users; and/or between the vehicle and the vehicle in front
- a vehicle distance reminder message is prompted to the driver.
- the vehicle distance reminder message is used to remind the driver to maintain the vehicle distance and/or the recommended vehicle distance; and/or when the vehicle is detected to enter the restriction.
- a temporary parking reminder message is prompted to the driver.
- the temporary parking reminder message is used to remind the restricted parking area and/or parking duration; and/or when the vehicle is detected to change lanes, slow down, or there are other vehicles behind the vehicle.
- a driving observation reminder message is prompted to the driver.
- the driving observation reminder information is used to prompt the driver to observe the violation reminder information around the vehicle.
- the prompt unit 2030 is also configured to: at the end of the current trip, prompt the data of irregular driving that occurred in the current trip, and/or prompt the data of irregular driving that occurred in the current trip. Comparison results with data on irregular driving that occurred during historical trips.
- the irregular driving includes the distance between the vehicle and the vehicle in front being less than or equal to the preset distance, failure to give way to other road users, illegal parking, speeding, and violating at least one of the traffic rules.
- the distance between the vehicle and the vehicle in front being less than or equal to the preset distance, failure to give way to other road users, illegal parking, speeding, and violating at least one of the traffic rules.
- the prompt unit 2030 when the vehicle travels to the first road section and the first road section supports intelligent driving, the prompt unit 2030 is also used to prompt the driver to switch the vehicle to the intelligent driving mode.
- the processing unit 2020 is also configured to determine the driving reminder information based on the surrounding environment information before the prompting unit 2030 prompts the driver with the driving reminder information.
- the real-time driving parameters include a yielding parameter, which is used to characterize the vehicle's behavior of yielding to other road users during the current trip.
- each unit in the above device is only a division of logical functions.
- the units may be fully or partially integrated into a physical entity, or may be physically separated.
- the unit in the device can be implemented in the form of a processor calling software; for example, the device includes a processor, the processor is connected to a memory, instructions are stored in the memory, and the processor calls the instructions stored in the memory to implement any of the above methods.
- the processor is, for example, a general-purpose processor, such as a CPU or a microprocessor
- the memory is a memory within the device or a memory outside the device.
- the units in the device can be implemented in the form of hardware circuits, and some or all of the functions of the units can be implemented through the design of the hardware circuits, which can be understood as one or more processors; for example, in one implementation,
- the hardware circuit is an ASIC, which realizes the functions of some or all of the above units through the design of the logical relationship of the components in the circuit; for another example, in another implementation, the hardware circuit can be implemented through PLD, taking FPGA as an example. It can include a large number of logic gate circuits, and the connection relationships between the logic gate circuits can be configured through configuration files to realize the functions of some or all of the above units. All units of the above device may be fully realized by the processor calling software, or may be fully realized by hardware circuits, or part of the units may be realized by the processor calling software, and the remaining part may be realized by hardware circuits.
- the processor is a circuit with signal processing capabilities.
- the processor may be a circuit with instruction reading and execution capabilities, such as a CPU, a microprocessor, a GPU, or DSP, etc.; in another implementation, the processor can realize certain functions through the logical relationship of the hardware circuit. The logical relationship of the hardware circuit is fixed or can be reconstructed.
- the processor is a hardware circuit implemented by ASIC or PLD. For example, FPGA.
- the process of the processor loading the configuration file and realizing the hardware circuit configuration can be understood as the process of the processor loading instructions to realize the functions of some or all of the above units.
- it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as NPU, TPU, DPU, etc.
- each unit in the above device can be one or more processors (or processing circuits) configured to implement the above method, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA , or a combination of at least two of these processor forms.
- processors or processing circuits
- each unit in the above device may be integrated together in whole or in part, or may be implemented independently. In one implementation, these units are integrated together and implemented as a system-on-a-chip (SOC).
- SOC may include at least one processor for implementing any of the above methods or implementing the functions of each unit of the device.
- the at least one processor may be of different types, such as a CPU and an FPGA, or a CPU and an artificial intelligence processor. CPU and GPU etc.
- FIG. 10 is a schematic block diagram of a driving assistance device according to an embodiment of the present application.
- the driving assistance device 2100 shown in FIG. 10 may include: a processor 2110, a transceiver 2120, and a memory 2130.
- the processor 2110, the transceiver 2120 and the memory 2130 are connected through an internal connection path.
- the memory 2130 is used to store instructions.
- the processor 2110 is used to execute the instructions stored in the memory 2130, and the transceiver 2120 receives/sends some parameters.
- the memory 2130 can be coupled with the processor 2110 through an interface or integrated with the processor 2110 .
- transceiver 2120 may include but is not limited to a transceiver device such as an input/output interface to realize communication between the device 2100 and other devices or communication networks.
- each step of the above method can be completed by instructions in the form of hardware integrated logic circuits or software in the processor 2110 .
- the methods disclosed in conjunction with the embodiments of the present application can be directly implemented as executed by a hardware processor, or executed using a combination of hardware and software modules in the processor.
- the software module can be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other mature storage media in this field.
- the storage medium is located in the memory 2130.
- the processor 2110 reads the information in the memory 2130 and completes the steps of the above method in combination with its hardware. To avoid repetition, it will not be described in detail here.
- the processor 2110 may use a general-purpose CPU, microprocessor, ASIC, GPU or one or more integrated circuits to execute relevant programs to implement the assisted driving method of the method embodiment of the present application.
- the processor 2110 may also be an integrated circuit chip with signal processing capabilities.
- each step of the assisted driving method of the present application can be completed by instructions in the form of hardware integrated logic circuits or software in the processor 2110 .
- the above-mentioned processor 2110 can also be a general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component.
- Each method, step and logical block diagram disclosed in the embodiment of this application can be implemented or executed.
- a general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.
- the steps of the method disclosed in conjunction with the embodiments of the present application can be directly implemented by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor.
- the software module can be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other mature storage media in this field.
- the storage medium is located in the memory 2130.
- the processor 2110 reads the information in the memory 2130 and executes the assisted driving method of the method embodiment of the present application in conjunction with its hardware.
- the memory 2130 may be a read-only memory (ROM), a static storage device, a dynamic storage device or a random access memory (RAM).
- ROM read-only memory
- RAM random access memory
- the transceiver 2120 uses a transceiver device such as but not limited to a transceiver to implement communication between the device 2100 and other devices or communication networks.
- Embodiments of the present application also provide a driving assistant, which includes at least one of a virtual image and a physical image.
- the driving assistant includes at least one processor for executing a computer program stored in a memory, so that the driving The assistant performs the method in Figure 3 or Figure 8; the driving assistant can be carried on at least one of a vehicle screen, a head-up display HUD, a cockpit, and a vehicle voice device.
- An embodiment of the present application also provides a driving assistance system, which includes the above device 2000 or the above device 2100.
- An embodiment of the present application also provides an intelligent vehicle, which may include the above device 2000 or the above device 2100.
- Embodiments of the present application also provide a computer-readable medium.
- the computer-readable medium stores program code.
- the computer program code When the computer program code is run on a computer, it causes the computer to execute the method in Figure 3 or Figure 8. .
- An embodiment of the present application further provides a chip, including: at least one processor and a memory, the at least one processor being coupled to the memory and configured to read and execute instructions in the memory to execute the above-mentioned Figure 3 or Method in Figure 8.
- the size of the sequence numbers of the above-mentioned processes does not mean the order of execution.
- the execution order of each process should be determined by its functions and internal logic, and should not be used in the embodiments of the present application.
- the implementation process constitutes any limitation.
- the disclosed systems, devices and methods can be implemented in other ways.
- the device embodiments described above are only illustrative.
- the division of the units is only a logical function division. In actual implementation, there may be other division methods.
- multiple units or components may be combined or can be integrated into another system, or some features can be ignored, or not implemented.
- the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.
- the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
- each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit.
- the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium.
- the technical solution of the present application is essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product.
- the computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of this application.
- the aforementioned storage media include: U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk and other media that can store program codes.
Landscapes
- Engineering & Computer Science (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Automation & Control Theory (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Traffic Control Systems (AREA)
- Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
Abstract
Description
Claims (14)
- 一种辅助驾驶的方法,其特征在于,包括:获取驾驶员驾驶车辆时的实时行驶参数和所述车辆的周围环境信息;根据所述实时行驶参数和所述周围环境信息确定所述驾驶员的驾驶习惯;在所述驾驶习惯满足第一预设条件时,向所述驾驶员提示驾驶提醒信息。
- 如权利要求1所述的方法,其特征在于,所述方法还包括:根据所述实时行驶参数确定所述驾驶员的驾驶经验;其中,所述在所述驾驶习惯满足第一预设条件时,向所述驾驶员提示驾驶提醒信息,包括:在所述驾驶习惯满足所述第一预设条件,且在所述驾驶经验满足第二预设条件时,向所述驾驶员提示所述驾驶提醒信息。
- 如权利要求1或2所述的方法,其特征在于,所述向所述驾驶员提示驾驶提醒信息,包括:在检测到所述车辆车速超出预设车速时,向所述驾驶员提示车速提醒信息,所述车速提醒信息用于提醒减速和/或建议的车速;和/或检测到所述其他道路使用者时,向所述驾驶员提示让行指示信息,所述让行指示信息用于提醒为其他道路使用者让行;和/或在所述车辆与前车之间的距离小于或等于预设距离时,向所述驾驶员提示车距提醒信息,所述车距提醒信息用于提醒保持车距和/或建议的车距;和/或在检测到所述车辆进入限制停车区域时,向所述驾驶员提示临时停车提醒信息,所述临时停车提醒信息用于提醒限制停车区域和/或停车时长;和/或在检测到所述车辆变道、减速、所述车辆的后方有其他车辆以及行驶道路有障碍物中的至少一项时,向所述驾驶员提示行车观察提醒信息,所述行车观察提醒信息用于提示观察所述车辆周围违法违规提醒信息。
- 如权利要求1至3中任一项所述的方法,其特征在于,所述方法还包括:在当前行程结束时,提示所述当前行程中发生的不规范驾驶的数据,和/或提示所述当前行程中发生的不规范驾驶的数据与历史行程中发生的不规范驾驶的数据的对比结果。
- 如权利要求4所述的方法,其特征在于,所述不规范驾驶包括所述车辆与前车之间的距离小于或等于预设距离、未给其他道路使用者让行、违规停车、超速行驶、违反交通规则中的至少一项。
- 如权利要求1至5中任一项所述的方法,其特征在于,在所述车辆行驶至第一路段,且所述第一路段支持智能驾驶时,所述方法还包括:提示所述驾驶员将所述车辆切换至智能驾驶模式。
- 如权利要求1至6中任一项所述的方法,其特征在于,所述向所述驾驶员提示驾驶提醒信息之前,所述方法还包括:根据所述周围环境信息确定所述驾驶提醒信息。
- 如权利要求1至7中任一项所述的方法,其特征在于,所述实时行驶参数包括让行参数,所述让行参数用于表征所述车辆在当前行程中为其他道路使用者让行的行为。
- 一种辅助驾驶的装置,其特征在于,包括:获取单元,用于获取驾驶员驾驶车辆时的实时行驶参数和所述车辆的周围环境信息;处理单元,用于根据所述实时行驶参数和所述周围环境信息确定所述驾驶员的驾驶习惯;提示单元,用于在所述驾驶习惯满足第一预设条件时,向所述驾驶员提示驾驶提醒信息。
- 一种辅助驾驶的装置,其特征在于,包括:存储器,用于存储计算机程序;处理器,用于执行所述存储器中存储的计算机程序,以使得所述装置执行如权利要求1至9中任一项所述的方法。
- 一种驾驶助理,其特征在于,所述驾驶助理包括虚拟形象和实体形象中的至少一种,所述驾驶助理包括:处理器,用于执行存储器中存储的计算机程序,以使得所述驾驶助理执行如权利要求1至9中任一项所述的方法;所述驾驶助理可以承载于车载屏幕、抬头显示HUD、车载语音装置、座舱中的至少一项。
- 一种智能车辆,其特征在于,包括如权利要求9或10所述的装置,或者,如权利要求11所述的驾驶助理。
- 一种计算机可读存储介质,其特征在于,其上存储有计算机程序,所述计算机程序被计算机执行时,以使得实现如权利要求1至9中任一项所述的方法。
- 一种芯片,其特征在于,所述芯片包括处理器与数据接口,所述处理器通过所述数据接口读取存储器上存储的指令,以执行如权利要求1至9中任一项所述的方法。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2024569258A JP2025517994A (ja) | 2022-05-23 | 2022-05-23 | 運転支援方法及び装置並びに乗り物 |
CN202280050013.2A CN117651669A (zh) | 2022-05-23 | 2022-05-23 | 辅助驾驶的方法、装置和车辆 |
EP22943018.6A EP4530142A1 (en) | 2022-05-23 | 2022-05-23 | Method and apparatus for assisting with driving, and vehicle |
PCT/CN2022/094524 WO2023225811A1 (zh) | 2022-05-23 | 2022-05-23 | 辅助驾驶的方法、装置和车辆 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2022/094524 WO2023225811A1 (zh) | 2022-05-23 | 2022-05-23 | 辅助驾驶的方法、装置和车辆 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023225811A1 true WO2023225811A1 (zh) | 2023-11-30 |
Family
ID=88918173
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/094524 WO2023225811A1 (zh) | 2022-05-23 | 2022-05-23 | 辅助驾驶的方法、装置和车辆 |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP4530142A1 (zh) |
JP (1) | JP2025517994A (zh) |
CN (1) | CN117651669A (zh) |
WO (1) | WO2023225811A1 (zh) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117755332A (zh) * | 2024-02-22 | 2024-03-26 | 深圳腾信百纳科技有限公司 | 汽车行驶安全监控方法、系统及存储介质 |
CN118545068A (zh) * | 2024-07-09 | 2024-08-27 | 北京易诚高科科技发展有限公司 | 一种基于图像采集的驾驶习惯分析方法、系统及存储介质 |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2009115717A (ja) * | 2007-11-08 | 2009-05-28 | Pioneer Electronic Corp | ナビゲーション装置、ナビゲーション方法、ナビゲーションプログラム、および記録媒体 |
CN104590274A (zh) * | 2014-11-26 | 2015-05-06 | 浙江吉利汽车研究院有限公司 | 一种驾驶行为自适应系统及驾驶行为自适应方法 |
CN106128099A (zh) * | 2016-07-01 | 2016-11-16 | 斑马信息科技有限公司 | 驾驶员识别方法和装置 |
CN108137059A (zh) * | 2015-10-29 | 2018-06-08 | 三菱电机株式会社 | 驾驶辅助装置 |
CN109050520A (zh) * | 2018-08-16 | 2018-12-21 | 上海小蚁科技有限公司 | 车辆驾驶状态提醒方法及装置、计算机可读存储介质 |
CN111231973A (zh) * | 2020-01-19 | 2020-06-05 | 北京四维智联科技有限公司 | 一种坡道驾驶方法、装置、电子设备及存储介质 |
CN112918472A (zh) * | 2019-12-05 | 2021-06-08 | 奥迪股份公司 | 车辆驾驶辅助系统、利用其的车辆及相应的方法和介质 |
CN113619588A (zh) * | 2020-05-09 | 2021-11-09 | 北京地平线机器人技术研发有限公司 | 驾驶行为的提醒方法和装置、存储介质、电子设备 |
CN114516340A (zh) * | 2022-02-27 | 2022-05-20 | 重庆长安汽车股份有限公司 | 基于用户驾驶习惯的驾驶员失能判定方法 |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102336163B (zh) * | 2011-08-31 | 2014-06-25 | 同济大学 | 车辆偏航检测装置 |
CN109147368A (zh) * | 2018-08-22 | 2019-01-04 | 北京市商汤科技开发有限公司 | 基于车道线的智能驾驶控制方法装置与电子设备 |
CN111103871A (zh) * | 2020-01-03 | 2020-05-05 | 圣点世纪科技股份有限公司 | 一种基于指静脉识别的汽车辅助驾驶控制方法 |
CN111231831B (zh) * | 2020-03-09 | 2021-08-13 | 威马智慧出行科技(上海)有限公司 | 车辆窄路通行检测方法、电子设备及汽车 |
-
2022
- 2022-05-23 CN CN202280050013.2A patent/CN117651669A/zh active Pending
- 2022-05-23 WO PCT/CN2022/094524 patent/WO2023225811A1/zh active Application Filing
- 2022-05-23 JP JP2024569258A patent/JP2025517994A/ja active Pending
- 2022-05-23 EP EP22943018.6A patent/EP4530142A1/en active Pending
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2009115717A (ja) * | 2007-11-08 | 2009-05-28 | Pioneer Electronic Corp | ナビゲーション装置、ナビゲーション方法、ナビゲーションプログラム、および記録媒体 |
CN104590274A (zh) * | 2014-11-26 | 2015-05-06 | 浙江吉利汽车研究院有限公司 | 一种驾驶行为自适应系统及驾驶行为自适应方法 |
CN108137059A (zh) * | 2015-10-29 | 2018-06-08 | 三菱电机株式会社 | 驾驶辅助装置 |
CN106128099A (zh) * | 2016-07-01 | 2016-11-16 | 斑马信息科技有限公司 | 驾驶员识别方法和装置 |
CN109050520A (zh) * | 2018-08-16 | 2018-12-21 | 上海小蚁科技有限公司 | 车辆驾驶状态提醒方法及装置、计算机可读存储介质 |
CN112918472A (zh) * | 2019-12-05 | 2021-06-08 | 奥迪股份公司 | 车辆驾驶辅助系统、利用其的车辆及相应的方法和介质 |
CN111231973A (zh) * | 2020-01-19 | 2020-06-05 | 北京四维智联科技有限公司 | 一种坡道驾驶方法、装置、电子设备及存储介质 |
CN113619588A (zh) * | 2020-05-09 | 2021-11-09 | 北京地平线机器人技术研发有限公司 | 驾驶行为的提醒方法和装置、存储介质、电子设备 |
CN114516340A (zh) * | 2022-02-27 | 2022-05-20 | 重庆长安汽车股份有限公司 | 基于用户驾驶习惯的驾驶员失能判定方法 |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117755332A (zh) * | 2024-02-22 | 2024-03-26 | 深圳腾信百纳科技有限公司 | 汽车行驶安全监控方法、系统及存储介质 |
CN117755332B (zh) * | 2024-02-22 | 2024-05-14 | 深圳腾信百纳科技有限公司 | 汽车行驶安全监控方法、系统及存储介质 |
CN118545068A (zh) * | 2024-07-09 | 2024-08-27 | 北京易诚高科科技发展有限公司 | 一种基于图像采集的驾驶习惯分析方法、系统及存储介质 |
Also Published As
Publication number | Publication date |
---|---|
EP4530142A1 (en) | 2025-04-02 |
CN117651669A (zh) | 2024-03-05 |
JP2025517994A (ja) | 2025-06-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20240109542A1 (en) | Exhaustive Driving Analytical Systems and Modelers | |
US20220147041A1 (en) | Supervisory control of vehicles | |
US20190333380A1 (en) | Information processing apparatus, information processing method, and program | |
JP7494974B2 (ja) | Hmi制御装置およびhmi制御プログラム | |
US20200377126A1 (en) | Information output control device and information output control method | |
WO2023225811A1 (zh) | 辅助驾驶的方法、装置和车辆 | |
SE1450193A1 (sv) | Förarstöd | |
JP7429498B2 (ja) | 運転支援方法及び運転支援装置 | |
KR20190034825A (ko) | 소셜 네트워크 서비스와 연동되는 안전 운전 모니터링 방법 및 이를 위한 컴퓨터 프로그램 | |
CN115257813B (zh) | 通过施工障碍物的智能驾驶控制方法及车辆 | |
Kim et al. | An ecological interface design approach for developing integrated and advanced in-vehicle information system | |
CN115782914A (zh) | 一种驾驶员提醒方法、装置、系统和移动载体 | |
WO2024199065A1 (zh) | 一种车道选择的方法、装置和车辆 | |
JP2022129044A (ja) | 運転マナー判定装置及び運転支援装置 | |
WO2021166508A1 (ja) | Hmi制御装置、hmi制御方法、およびhmi制御プログラム | |
JP2018097479A (ja) | 運転支援装置、運転支援方法、運転支援プログラム、及び運転支援システム | |
CN117842019A (zh) | 超车辅助方法、装置、设备及存储介质 | |
WO2024032148A1 (zh) | 一种窄道通行的方法、装置和车辆 | |
JP2018097485A (ja) | 運転支援装置、運転支援方法、運転支援プログラム、及び運転支援システム | |
WO2025026244A1 (zh) | 车辆驾驶意图表示方法、装置及车辆 | |
WO2024250969A1 (zh) | 控制方法、装置和车辆 | |
CN119037460A (zh) | 控制方法、装置和车辆 | |
CN119078866A (zh) | 控制方法、装置和车辆 | |
WO2024082701A1 (zh) | 换道方法、装置和智能驾驶设备 | |
WO2025025799A1 (zh) | 控制方法、装置和智能驾驶设备 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22943018 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202280050013.2 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2024569258 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2022943018 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2022943018 Country of ref document: EP Effective date: 20241223 |
|
WWP | Wipo information: published in national office |
Ref document number: 2022943018 Country of ref document: EP |