WO2024255003A1 - 一种智能驾驶辅助系统的前方车辆显示方法、装置及计算机系统 - Google Patents
一种智能驾驶辅助系统的前方车辆显示方法、装置及计算机系统 Download PDFInfo
- Publication number
- WO2024255003A1 WO2024255003A1 PCT/CN2023/118296 CN2023118296W WO2024255003A1 WO 2024255003 A1 WO2024255003 A1 WO 2024255003A1 CN 2023118296 W CN2023118296 W CN 2023118296W WO 2024255003 A1 WO2024255003 A1 WO 2024255003A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- vehicle
- lane
- display
- ahead
- lane line
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/22—Display screens
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/29—Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/80—Arrangements for controlling instruments
- B60K35/81—Arrangements for controlling instruments for controlling displays
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/166—Navigation
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/167—Vehicle dynamics information
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/171—Vehicle or relevant part thereof displayed
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/175—Autonomous driving
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/177—Augmented reality
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/178—Warnings
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/179—Distances to obstacles or vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/18—Information management
- B60K2360/186—Displaying information according to relevancy
- B60K2360/1868—Displaying information according to relevancy according to driving situations
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/10—Internal combustion engine [ICE] based vehicles
- Y02T10/40—Engine management systems
Definitions
- the present invention relates to intelligent driving technology, and in particular to a method, device and computer system for displaying a vehicle ahead of an intelligent driving assistance system.
- ADAS/AD intelligent driving functions
- HMI human-machine interaction module
- the instrument display of the car is an important part of the car cockpit HMI module.
- the instrument of traditional models often only displays conventional vehicle status information such as speed and speed, while vehicles equipped with ADAS functions tend to map the actual road conditions to the instrument on this basis to show customers more ADAS-related functional schematic information.
- the vehicle is an important part of the driving road conditions, and its display on the instrument is an important part of the HMI.
- the instrument display of some models on the market currently has problems such as inaccurate position of the vehicle in front or inconsistent size ratio, resulting in a poor user experience.
- the processing unit 14 transmits the acquired road user, road surface information, and road sign information to the instrument unit 16 for real-time display.
- the processing unit 14 only plays the role of sending the actual road conditions to the instrument for display as realistically and accurately as possible, but does not separate the display module and does not take into account the functional requirements of the instrument display (comfort, etc.).
- the purpose of the present invention is to overcome the shortcomings of the above-mentioned background technology and provide a method, device and computer system for displaying the vehicle ahead of an intelligent driving assistance system, so that it can solve the following technical problems:
- This method can reduce the computing power problem of the instrument itself
- This patent can effectively improve the human-computer interaction experience of low-cost vehicle models that are limited by hardware such as sensors and instruments.
- the present invention provides a method for displaying a vehicle ahead of an intelligent driving assistance system, which utilizes an intelligent driving assistance system and includes the following steps: extracting parameters: during the driving process of the own vehicle, based on the information collected in real time by the vehicle sensor and in combination with an algorithm, outputting the lateral vector distance and longitudinal vector distance of the vehicle ahead relative to the own vehicle, and outputting parameter information of the left and right lane lines of the lane where the own vehicle is driving; the information collected in real time by the vehicle sensor includes the position, speed, vehicle head direction and lane line information of the vehicle ahead; determining the screen display position: based on the parameter information, respectively calculating from the lateral position of the vehicle ahead, the relative position relationship between the vehicle ahead and the lane line, and the longitudinal position relationship between each vehicle ahead, respectively obtaining the lateral position display and longitudinal position display of the vehicle ahead on the display screen, and then transmitting the parameter signals of the lateral position display and the longitudinal position display to the display screen for display, wherein it is assumed that the lane widths of the same-
- the specific process of the screen position determination step is as follows: Display the lateral position of the front vehicle: calculate the lane to which the front vehicle belongs, obtain the ratio of the lateral distance parameter of the front vehicle to the lane width of the vehicle, and compare the lane to which the front vehicle belongs with the obtained ratio. Transmitted to the display screen to display the lateral position of the vehicle in front; display of the longitudinal position of the vehicle in front: a segmented longitudinal vehicle position display method is used to divide the longitudinal position of the screen into two areas, area 1 displays nearby vehicles, and area 2 displays distant vehicles. The size of the vehicle model in the area is set linearly according to the distance from the vehicle.
- the specific process of the step of displaying the lateral position of the vehicle in front is as follows: lane judgment: according to the parameter information, the lateral vector distance between the own vehicle and the vehicle in front is first combined with the lane line algorithm to judge the lane to which the vehicle in front belongs; left and right lane line position ratio calculation: after judging the lane to which the vehicle in front belongs, the vector distance from the front vehicle to the left lane line or the right lane line of the own vehicle lane in each lane is calculated, and then the percentage of the vector distance to the lane width at the vehicle is obtained; screen lateral position display: the calculated percentage signal of the vector distance of each vehicle in front from the left lane line or the right lane line of the own vehicle lane to the lane width at the vehicle is transmitted to the display screen together with the lane signal to which the vehicle in front belongs, so that the screen display module can display the lateral position of the vehicle in front.
- the specific process of the step of displaying the longitudinal position of the front vehicle is as follows: Area partitioning: the longitudinal display area of the instrument is divided into two parts, area one and area two, area one accounts for X% of the longitudinal display area, and area two accounts for 1-X% of the longitudinal display area; the position relationship of each area: area one displays the end position Lgt_Lim of the near vehicle display, and area two is used to display the vehicle between the end position Lgt_Lim of the near vehicle display and the farthest position Lgt_Max of the far vehicle display; static model of the front vehicle in area one: only one front vehicle model is displayed on each lane of the instrument in area one, which is the front vehicle closest to the vehicle in each lane, and the model size Size_min of the front vehicle is ( 1-X%)*L, L is the longitudinal size of the instrument display area, and the longitudinal position of the front vehicle is always maintained at the X% position of the instrument; dynamic model of the front vehicle in area 1: when the front vehicle is running in area 1, its
- the coordinate system used by the ADAS visualization module takes the ground corresponding to the intersection of the vehicle's central axis and the camera's horizontal line as the origin of the vehicle coordinate system, with the forward direction as X, forward as positive, and the side as Y, left as positive; wherein the collected position information and lane line parameters are as follows: Py: the vector distance between the center of the rear axle of the self-vehicle and the center of the rear axle of the front vehicle in the Y direction; Px: the vector distance between the center of the front guardrail of the self-vehicle and the center of the rear guardrail of the front vehicle in the X direction; C0_L0: the left lane line distance from the self-vehicle The lateral vector distance from the center of the rear axle of the vehicle; C0_RO: The lateral vector distance from the right lane line to the center of the rear axle of the vehicle; C1_L0: The angle between the tangent line of the left lane line at
- the present invention further provides a front vehicle display device of an intelligent driving assistance system, including an intelligent driving assistance system, wherein the intelligent driving assistance system includes the following parts: a perception fusion module: during the driving process of the self-vehicle, based on the information collected in real time by the vehicle sensor and combined with the algorithm, the lateral vector distance and longitudinal vector distance of the front vehicle relative to the self-vehicle are output, and the parameter information of the left and right lane lines of the lane where the self-vehicle is driving is output at the same time; the information collected in real time by the vehicle sensor includes the position, speed, front direction and lane line information of the front vehicle; an ADAS visualization module: based on the parameter information, calculations are performed respectively from the lateral position of the front vehicle, the relative position relationship between the front vehicle and the lane line, and the longitudinal position relationship between each front vehicle, and the lateral position display and longitudinal position display of the front vehicle on the display screen are obtained respectively, and then the parameter signals of the lateral position display and the longitudinal position display are transmitted
- the present invention also provides a computer system, which includes a front vehicle display device of an intelligent driving assistance system.
- This solution introduces the lane line function method. By comparing the lateral position of the front vehicle and the lane line, it can provide the screen with the lane of the front vehicle and its lateral position parameter information in the lane, thereby solving the problem of inaccurate lateral display of the vehicle or even displaying the wrong lane.
- This solution uses a segmented vehicle longitudinal position display method to optimize vehicle overlap, vehicle models that are too small, or the limited display of the number of vehicles in front, so as to restore the actual road conditions as much as possible and provide customers with a better visual experience.
- FIG1 is a hardware logic block diagram of a solution provided by a related manufacturer in the prior art
- FIG2 is a schematic diagram of a real road condition targeted by a solution provided by a relevant manufacturer in the prior art
- FIG3 is a schematic diagram of the overall process of a method for displaying a vehicle ahead of an intelligent driving assistance system according to the present invention
- FIG. 4 is a flow chart of the lateral position display of the vehicle ahead in the screen display position determination step in the method for displaying the vehicle ahead in the intelligent driving assistance system of the present invention
- FIG. 5 is a schematic diagram of a road surface real scene of a lane determination step belonging to a front vehicle lateral position display step belonging to a screen display position determination step in a front vehicle display method of an intelligent driving assistance system of the present invention
- FIG6 is a schematic diagram of a real-life example of a road surface of a vector distance DL from a front vehicle to a left lane line or a right lane line of a lane of a self-vehicle in each lane in a left and right lane line position ratio calculation step belonging to a front vehicle lateral position display step belonging to a screen display position determination step in a front vehicle display method of an intelligent driving assistance system of the present invention (taking the front vehicle being located in the left lane of the self-vehicle as an example);
- FIG. 7 is a diagram showing the screen display position in the method for displaying a vehicle ahead of the intelligent driving assistance system of the present invention.
- a flowchart showing the longitudinal position of the vehicle ahead in the step of determining the position;
- FIG. 8 is a schematic diagram of a real-scene display of a display screen showing the longitudinal position of a vehicle ahead in the step of determining the screen position in the method for displaying a vehicle ahead in an intelligent driving assistance system of the present invention
- FIG. 9 is a schematic diagram showing the relationship between the size of the front vehicle model and its longitudinal proportion in the instrument panel, which embodies a specific technical effect in the front vehicle longitudinal position display step belonging to the screen display position determination step in the front vehicle display method of the intelligent driving assistance system of the present invention
- FIG10 is a schematic diagram of the structure of a front vehicle display device of an intelligent driving assistance system according to the present invention.
- FIG. 11 is a schematic diagram of the structure of the computer system of the present invention.
- FIG. 1 to FIG. 2 The technical contents disclosed in FIG. 1 to FIG. 2 have been described in detail in the background technology and will not be repeated here.
- the method for displaying a vehicle ahead of the intelligent driving assistance system of the present invention comprises the following steps:
- the vehicle sensors collect information such as the position, speed, vehicle head direction and lane lines of the vehicle in front in real time, and transmit this information to the ADAS perception fusion module;
- the perception fusion module Based on this information and combined with the algorithm, the perception fusion module outputs the lateral vector distance (Py) and longitudinal vector distance (Px) of the vehicle in front relative to the vehicle, and also outputs the parameter information of the left and right lane lines of the vehicle's driving lane.
- the coordinate system used by the ADAS visualization module uses the ground corresponding to the intersection of the vehicle's central axis and the camera's horizontal line as the origin of the vehicle coordinate system, with the forward direction as X, the forward direction as positive, and the side direction as Y, the left direction as positive;
- Px The vector distance in the X direction from the front protection center of the vehicle to the rear protection center of the vehicle in front
- C0_L0 The lateral vector distance from the left lane line to the center of the rear axle of the vehicle
- C0_RO The lateral vector distance from the right lane line to the center of the rear axle of the vehicle
- C1_L0 The angle between the tangent line of the left lane line at the turn and the straight line of the left lane line
- C1_R0 The angle between the tangent line of the right lane line at the turn and the straight line of the right lane line
- the ADAS visualization module Based on the information provided by the perception fusion module, the ADAS visualization module optimizes the lateral position of the front vehicle, the relative position relationship between the front vehicle and the lane line, and the longitudinal position, and obtains the lateral position display and longitudinal position display of the front vehicle on the display screen, and then outputs the parameter signals of the lateral position display and the longitudinal position display to the screen for display.
- the ADAS visualization module assumes that the lane width of the same-direction lane as the ego vehicle is the same and the lane width of the ego vehicle is W.
- the specific process of the screen display position determination step is as follows:
- lane determination Based on the information output by the perception fusion, the ADAS visualization module first compares the lateral vector distance between the vehicle and the vehicle ahead with the lane line algorithm to determine the lane to which the vehicle ahead belongs;
- the determination method is specifically as follows:
- the distance between the vehicle and the left and right lane lines is solved by substituting the longitudinal position Px of the vehicle in front into the lane line function of the left and right lane lines of the vehicle.
- Lane determination Compare the lateral vector distance Py between the vehicle and the vehicle in front with YL and YR according to Table 1 below to determine the left, middle, and right lanes where the vehicle in front is located (the above situations assume that the vehicle is driving in the middle lane):
- the ADAS visualization module transmits the calculated vector distance DL of each front vehicle from the left lane line or the right lane line of the own vehicle's lane to the lane percentage signal DL_Pct of the lane width W at the own vehicle, as well as the lane signal to which the front vehicle belongs to the screen display module for it to display the lateral position of the front vehicle.
- the vehicle ahead is displayed according to the actual distance that can be displayed, which can restore the real-time road conditions to the greatest extent.
- the display of distant vehicles may be inaccurate or jittery.
- the vehicle displayed on the instrument may be The problem is that the vehicle model is smaller.
- ADAS function may be activated but the corresponding vehicle is not displayed on the instrument panel, causing discomfort to customers.
- the present invention proposes a segmented method for displaying the longitudinal position of the vehicle, so as to provide customers with a better visual experience while restoring the actual road conditions as much as possible.
- the specific process of the step of displaying the longitudinal position of the vehicle ahead of the vehicle is as follows:
- Area partitioning The instrument's vertical display area is divided into two parts: Area 1 and Area 2. Area 1 occupies X% of the vertical display area (which can be calibrated to occupy the vast majority of the screen, such as 90%), and Area 2 occupies 1-X% of the vertical display area, generally set to 50 ⁇ X ⁇ 100;
- Area 1 is used to display the end position Lgt_Lim of the nearby vehicle display (calibrated according to the display effect), and Area 2 is used to display the vehicles between the end position Lgt_Lim of the nearby vehicle display and the farthest position Lgt_Max (calibrable) of the distant vehicle display;
- Size_zone1 -(Size_base-Size_min)/X%*P X _Pct+Size_base,
- Figure 9 shows the relationship between the size of the front vehicle model and its longitudinal proportion in the instrument panel.
- the front vehicle display device of the intelligent driving assistance system of the present invention includes an intelligent driving assistance system, and the intelligent driving assistance system includes the following parts:
- Perception fusion module During the driving process of the vehicle, based on the information collected in real time by the vehicle sensors and combined with the algorithm, the lateral vector distance and longitudinal vector distance of the vehicle in front relative to the vehicle are output, and the parameter information of the left and right lane lines of the lane where the vehicle is driving is output; the information collected in real time by the vehicle sensors includes the position, speed, vehicle head direction and lane line information of the vehicle in front;
- ADAS visualization module Based on the parameter information, calculations are performed respectively from the lateral position of the front vehicle, the relative position relationship between the front vehicle and the lane line, and the longitudinal position relationship between each front vehicle, to obtain the lateral position display and longitudinal position display of the front vehicle on the display screen, and then the parameter signals of the lateral position display and the longitudinal position display are transmitted to the display screen for display, wherein it is assumed that the lane widths of the lanes in the same direction as the vehicle are the same.
- the computer system of the present invention includes a front vehicle display device of an intelligent driving assistance system.
- the sensor accuracy can be improved and laser radar can be introduced, while the screen computing power can be upgraded and the screen display area can be increased, which will provide better display effects when displaying real-time road conditions information.
- the lane line equation is introduced as a reference benchmark.
- the percentage of the vehicle in front of the vehicle in the lane is obtained, so that the screen can display the lane horizontally according to the percentage of each lane, instead of directly using the lateral distance of the vehicle in front relative to the vehicle as is commonly done.
- HMI Human Machine Interface
- ADAS visualization module used to display the front vehicles and lane lines on the road conditions of the ADAS vehicle in real time to provide users with a good interactive experience
- Front vehicle In addition to the vehicle itself, the vehicle ahead that needs to be displayed on the instrument
Landscapes
- Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
Px_Pct=(Px*X%)/Lgt_Lim;
Size_zone1=-(Size_base-Size_min)/X%*PX_Pct+Size_base,
Claims (10)
- 一种智能驾驶辅助系统的前方车辆显示方法,其特征在于:利用智能驾驶辅助系统,包括如下步骤:提取参数:在自车行驶过程中,基于车辆传感器实时采集的信息并结合算法输出前方车辆相对于自车的横向矢量距离和纵向矢量距离,同时输出自车行驶车道左右车道线的参数信息;所述车辆传感器实时采集的信息包括前方车辆的位置、速度、车头朝向及车道线信息;屏显位置确定:基于所述参数信息,分别从前方车辆的横向位置、前方车辆与车道线的相对位置关系以及各个前方车辆之间纵向位置关系进行计算,分别得到前方车辆在显示屏幕中的横向位置显示和纵向位置显示,再将横向位置显示和纵向位置显示的参数信号输送给显示屏供其显示,其中,默认自车行驶的同向车道车道宽相同。
- 根据权利要求1所述的智能驾驶辅助系统的前方车辆显示方法,其特征在于:所述屏显位置确定步骤的具体过程如下:前方车辆横向位置显示:计算前方车辆所属车道,求取前方车辆横向距离参数与自车处车道宽的比值,并将前方车辆所属车道与求得的比值传送给显示屏,以便显示前方车辆横向位置;前方车辆纵向位置显示:采用分段式纵向车辆位置显示方法,将屏幕纵向位置分成两块,区域一显示近处车辆,区域二显示远处车辆,区域内车辆模型大小按离自车距离远近线性设置。
- 根据权利要求2所述的智能驾驶辅助系统的前方车辆显示方法,其特征在于:所述前方车辆横向位置显示步骤的具体过程如下:判断车道:根据所述参数信息,先将自车和前方车辆的横向矢量距离与车道线算法结合起来判断前方车辆所属车道;左右车道线位置占比计算:判断出前方车辆所属车道后,计算各 个车道中前方车辆距离自车车道左车道线或右车道线的矢量距离,进而求得矢量距离占自车处车道宽的百分比;屏显横向位置显示:将计算得出的各前方车辆距离自车车道左车道线或右车道线的矢量距离占自车处车道宽的百分比信号与前方车辆所属车道信号传输给显示屏,供屏显模块对前方车辆的横向位置进行显示。
- 根据权利要求3所述的智能驾驶辅助系统的前方车辆显示方法,其特征在于:所述判断车道步骤中,判断前方车辆所属车道的具体过程如下:自车距左右车道线距离求解:通过将前方车辆的纵向矢量距离Px代入自车左右车道线的车道线函数中,分别求出自车距离自车左右车道线的横向矢量距离值YL与YR,其中,车道线函数为Y=C0+C1*x+C2*x2+C3*x3;车道判定:再将自车与前方车辆的横向矢量距离Py与分别YL和YR对比,判断前方车辆所在的左中右车道情况:1)当Py>YL时,前方车辆位于左车道;2)当YL≥Py≥YR时,前方车辆位于自车所在的中间车道;3)当YR>Py时,前方车辆位于右车道;以上三种情况均默认自车行驶在中间车道。
- 根据权利要求4所述的智能驾驶辅助系统的前方车辆显示方法,其特征在于:所述左右车道线位置占比计算步骤中,各个车道中前方车辆距离自车车道左车道线或右车道线的矢量距离DL的计算过程如下:1)当前方车辆位于左车道时,DL=Py-YL;2)当前方车辆位于自车所在的中间车道时,DL=YL-Py;3)当前方车辆位于右车道时,DL=YR-Py。
- 根据权利要求5所述的智能驾驶辅助系统的前方车辆显示方法,其特征在于:所述左右车道线位置占比计算步骤中,前方车辆距离自车车道左车道线或右车道线的矢量距离DL占自车处车道宽W的百分比DL_Pct的计算过程如下:1)自车处车道宽W=YL-YR;2)当前方车辆位于左车道时,DL_Pct=(Py-YL)/(YL-YR);3)当前方车辆位于自车所在的中间车道时,DL_Pct=(YL-Py)/(YL-YR);4)当前方车辆位于右车道时,DL_Pct=(YR-Py)/(YL-YR)。
- 根据权利要求6所述的智能驾驶辅助系统的前方车辆显示方法,其特征在于:所述前方车辆纵向位置显示步骤的具体过程如下:区域分区:将仪表纵向显示区域分为区域一和区域二两个部分,区域一占纵向显示区域的X%,区域二占纵向显示区域的1-X%;各区域位置关系:区域一显示近处车辆显示终点位置Lgt_Lim,区域二用于显示近处车辆显示终点位置Lgt_Lim与远处车辆显示最远位置Lgt_Max之间的车辆;区域一前方车辆静态模型:区域一内仪表每个车道上只显示一个前方车辆模型,为每车道离自车最近的前方车辆,该前方车辆的模型大小Size_min=(1-X%)*L,L为仪表显示区域的纵向尺寸,该前方车辆的纵向位置一直保持在仪表的X%位置处;区域一前方车辆动态模型:当前方车辆在区域一内运行时,其模型大小及纵向位置根据纵向位置Px按线性比例Px_Pct调节,其中Px_Pct计算逻辑如下所示:
Px_Pct=(Px*X%)/Lgt_Lim;各个前方车辆位置排布:前方车辆在屏显上的纵向显示位置为屏显显示区域自下而上的Px_Pct处,前方车辆的模型大小为:
Size_zone1=-(Size_base-Size_min)/X%*PX_Pct+Size_base,其中,Size_base为基准模型大小,为前方车辆在Px=0处的模型大小。 - 根据权利要求7所述的智能驾驶辅助系统的前方车辆显示方法,其特征在于:所述提取参数步骤中,ADAS可视化模块所用坐标系以车辆中轴线与相机水平线交点所对应的地面为车辆坐标系原点,前向为X,向前为正,侧向为Y,向左为正;其中,采集的位置信息及车道线参数如下:Py:自车后轴中心与前方车辆后轴中心在Y方向的矢量距离;Px:自车前保中心到前方车辆后保中心的在X方向的矢量距离;C0_L0:左车道线距离自车后轴中心的横向矢量距离;C0_RO:右车道线距离自车后轴中心的横向矢量距离;C1_L0:左车道线转弯处的切线与左车道线直道直线的夹角;C1_R0:右车道线转弯处的切线与右车道线直道直线的夹角;C2_L0:左车道线转弯处的曲率;C2_R0:右车道线转弯处的曲率;C3_L0:左车道线转弯处的曲率变化率;C3_R0:右车道线转弯处的曲率变化率。
- 一种智能驾驶辅助系统的前方车辆显示装置,包括智能驾驶辅助系统,其特征在于:所述智能驾驶辅助系统包括如下部分:感知融合模块:在自车行驶过程中,基于车辆传感器实时采集的信息并结合算法输出前方车辆相对于自车的横向矢量距离和纵向矢量距离,同时输出自车行驶车道左右车道线的参数信息;所述车辆传 感器实时采集的信息包括前方车辆的位置、速度、车头朝向及车道线信息;ADAS可视化模块:基于所述参数信息,分别从前方车辆的横向位置、前方车辆与车道线的相对位置关系以及各个前方车辆之间纵向位置关系进行计算,分别得到前方车辆在显示屏幕中的横向位置显示和纵向位置显示,再将横向位置显示和纵向位置显示的参数信号输送给显示屏供其显示,其中,默认自车行驶的同向车道车道宽相同。
- 一种计算机系统,其特征在于:该计算机系统包括如权利要求9所述的智能驾驶辅助系统的前方车辆显示装置。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP23941228.1A EP4714710A1 (en) | 2023-06-14 | 2023-09-12 | Front vehicle display method and apparatus for intelligent driving assistance system, and computer system |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310707740.8 | 2023-06-14 | ||
| CN202310707740.8A CN116587853B (zh) | 2023-06-14 | 2023-06-14 | 一种智能驾驶辅助系统的前方车辆显示方法、装置及计算机系统 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024255003A1 true WO2024255003A1 (zh) | 2024-12-19 |
Family
ID=87600917
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2023/118296 Ceased WO2024255003A1 (zh) | 2023-06-14 | 2023-09-12 | 一种智能驾驶辅助系统的前方车辆显示方法、装置及计算机系统 |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP4714710A1 (zh) |
| CN (1) | CN116587853B (zh) |
| WO (1) | WO2024255003A1 (zh) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116587853B (zh) * | 2023-06-14 | 2026-04-28 | 东风汽车集团股份有限公司 | 一种智能驾驶辅助系统的前方车辆显示方法、装置及计算机系统 |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH11264868A (ja) * | 1998-03-17 | 1999-09-28 | Hitachi Ltd | 車両用表示装置 |
| CN109866764A (zh) * | 2019-01-10 | 2019-06-11 | 苏州工业园区职业技术学院 | 一种汽车纵向智能辅助驾驶系统 |
| CN111942395A (zh) * | 2019-05-14 | 2020-11-17 | 现代自动车株式会社 | 车辆以及用于控制车辆的方法 |
| CN112824186A (zh) * | 2019-11-20 | 2021-05-21 | 现代自动车株式会社 | 用于在队列行驶时显示虚拟车道的装置及方法 |
| CN113954634A (zh) * | 2021-10-20 | 2022-01-21 | 武汉光庭信息技术股份有限公司 | 一种全液晶仪表盘路况仿真显示方法及显示系统 |
| CN114655222A (zh) * | 2022-04-18 | 2022-06-24 | 重庆长安汽车股份有限公司 | 一种目标车辆实时显示的方法及系统 |
| CN116587853A (zh) * | 2023-06-14 | 2023-08-15 | 东风汽车集团股份有限公司 | 一种智能驾驶辅助系统的前方车辆显示方法、装置及计算机系统 |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4082931B2 (ja) * | 2002-05-27 | 2008-04-30 | 株式会社日立製作所 | 車両速度制御装置、及びその動作プログラム |
| CN111880533B (zh) * | 2020-07-16 | 2023-03-24 | 华人运通(上海)自动驾驶科技有限公司 | 驾驶场景重构方法、装置、系统、车辆、设备及存储介质 |
| JP7400688B2 (ja) * | 2020-10-19 | 2023-12-19 | トヨタ自動車株式会社 | 表示装置及び表示方法 |
| DE102021202036A1 (de) * | 2021-03-03 | 2022-09-08 | Robert Bosch Gesellschaft mit beschränkter Haftung | Verfahren und Vorrichtung zur Ermittlung eines die Querposition eines Kraftfahrzeugs in einer Fahrspur anzeigenden Querpositionswertes |
| CN113954856B (zh) * | 2021-10-29 | 2023-07-28 | 惠州华阳通用电子有限公司 | 一种自动驾驶信息显示方法 |
-
2023
- 2023-06-14 CN CN202310707740.8A patent/CN116587853B/zh active Active
- 2023-09-12 WO PCT/CN2023/118296 patent/WO2024255003A1/zh not_active Ceased
- 2023-09-12 EP EP23941228.1A patent/EP4714710A1/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH11264868A (ja) * | 1998-03-17 | 1999-09-28 | Hitachi Ltd | 車両用表示装置 |
| CN109866764A (zh) * | 2019-01-10 | 2019-06-11 | 苏州工业园区职业技术学院 | 一种汽车纵向智能辅助驾驶系统 |
| CN111942395A (zh) * | 2019-05-14 | 2020-11-17 | 现代自动车株式会社 | 车辆以及用于控制车辆的方法 |
| CN112824186A (zh) * | 2019-11-20 | 2021-05-21 | 现代自动车株式会社 | 用于在队列行驶时显示虚拟车道的装置及方法 |
| CN113954634A (zh) * | 2021-10-20 | 2022-01-21 | 武汉光庭信息技术股份有限公司 | 一种全液晶仪表盘路况仿真显示方法及显示系统 |
| CN114655222A (zh) * | 2022-04-18 | 2022-06-24 | 重庆长安汽车股份有限公司 | 一种目标车辆实时显示的方法及系统 |
| CN116587853A (zh) * | 2023-06-14 | 2023-08-15 | 东风汽车集团股份有限公司 | 一种智能驾驶辅助系统的前方车辆显示方法、装置及计算机系统 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116587853B (zh) | 2026-04-28 |
| CN116587853A (zh) | 2023-08-15 |
| EP4714710A1 (en) | 2026-03-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107856667B (zh) | 辅助泊车系统和方法 | |
| KR102836547B1 (ko) | 조기 경보 정보를 출력하는 방법, 기기, 저장매체 및 프로그램 제품 | |
| CN105333883B (zh) | 一种用于抬头显示器的导航路径轨迹显示方法和装置 | |
| WO2021197189A1 (zh) | 基于增强现实的信息显示方法、系统、装置及投影设备 | |
| WO2021197190A1 (zh) | 基于增强现实的信息显示方法、系统、装置及投影设备 | |
| CN116564116A (zh) | 数字孪生驱动的智能辅助驾驶引导系统与方法 | |
| CN107784864A (zh) | 车辆辅助驾驶方法及系统 | |
| CN108177524B (zh) | Arhud系统及其车道线绘制方法 | |
| KR20160025313A (ko) | 차량정보 표시장치 및 그 표시방법 | |
| CN106379237A (zh) | 基于增强现实的车辆换道全过程辅助驾驶系统 | |
| CN204915670U (zh) | 一种基于弯道纵向曲率的车辆行驶航向预测装置 | |
| CN107097794A (zh) | 道路车道线的侦测系统及其方法 | |
| WO2024255003A1 (zh) | 一种智能驾驶辅助系统的前方车辆显示方法、装置及计算机系统 | |
| CN114291077B (zh) | 一种车辆防撞预警方法及装置 | |
| CN115097632A (zh) | 一种ar-hud转向辅助显示方法及系统 | |
| WO2024104023A9 (zh) | 一种信息显示方法及相关装置 | |
| CN117804464A (zh) | 地图导航方法、装置、计算机设备和存储介质 | |
| CN109305171A (zh) | 一种前方车辆行驶姿态观测装置及其方法 | |
| WO2024139319A1 (zh) | 窄路通行方法、装置、车辆及存储介质 | |
| CN108256487B (zh) | 一种基于反向双目的驾驶状态检测装置和方法 | |
| CN116572837A (zh) | 一种信息显示控制方法及装置、电子设备、存储介质 | |
| CN105222801A (zh) | 导航提示方法及导航提示系统 | |
| CN116620168B (zh) | 一种障碍物预警方法、装置、电子设备及存储介质 | |
| CN116543032B (zh) | 冲击物测距方法、装置、测距设备及存储介质 | |
| KR20210056351A (ko) | 카메라의 이미지 처리 장치의 거짓-양성을 검출하는 방법 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23941228 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023941228 Country of ref document: EP |
|
| ENP | Entry into the national phase |
Ref document number: 2023941228 Country of ref document: EP Effective date: 20251215 |
|
| ENP | Entry into the national phase |
Ref document number: 2023941228 Country of ref document: EP Effective date: 20251215 |
|
| ENP | Entry into the national phase |
Ref document number: 2023941228 Country of ref document: EP Effective date: 20251215 |
|
| ENP | Entry into the national phase |
Ref document number: 2023941228 Country of ref document: EP Effective date: 20251215 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2023941228 Country of ref document: EP Effective date: 20251215 |
|
| ENP | Entry into the national phase |
Ref document number: 2023941228 Country of ref document: EP Effective date: 20251215 |
|
| ENP | Entry into the national phase |
Ref document number: 2023941228 Country of ref document: EP Effective date: 20251215 |
|
| ENP | Entry into the national phase |
Ref document number: 2023941228 Country of ref document: EP Effective date: 20251215 |
|
| WWP | Wipo information: published in national office |
Ref document number: 2023941228 Country of ref document: EP |