WO2023201485A1 - 一种提示方法、装置及车辆 - Google Patents

一种提示方法、装置及车辆 Download PDF

Info

Publication number
WO2023201485A1
WO2023201485A1 PCT/CN2022/087488 CN2022087488W WO2023201485A1 WO 2023201485 A1 WO2023201485 A1 WO 2023201485A1 CN 2022087488 W CN2022087488 W CN 2022087488W WO 2023201485 A1 WO2023201485 A1 WO 2023201485A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
event
information
image
layer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2022/087488
Other languages
English (en)
French (fr)
Inventor
杨中云
邓宇
王海军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN202280092778.2A priority Critical patent/CN118804864A/zh
Priority to PCT/CN2022/087488 priority patent/WO2023201485A1/zh
Publication of WO2023201485A1 publication Critical patent/WO2023201485A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/02Ensuring safety in case of control system failures, e.g. by diagnosing, circumventing or fixing failures
    • B60W50/029Adapting to failures or work around with other constraints, e.g. circumvention by avoiding use of failed parts
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W50/16Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00Drive control systems specially adapted for autonomous road vehicles

Definitions

  • This application relates to the field of intelligent driving technology, and in particular to a prompting method, device and vehicle.
  • IVI in-vehicle infotainment
  • prompt information for prompting the vehicle status is output through the IVI system.
  • the IVI system may experience delays in outputting prompt information or failure to output prompt information, resulting in users being unable to obtain vehicle status information in a timely manner, which may pose certain safety risks.
  • the industry has proposed grading standards for autonomous vehicles.
  • the driving automation grading standards proposed by the Society of Automotive Engineers International (SAE International) include six levels, including L0-L5.
  • the driver support system of the vehicle can provide some support functions for the driver.
  • the support functions of L1 level include at least one of steering, braking or acceleration.
  • Level 2 support functions include at least one of steering, braking, acceleration, full-speed adaptive cruise, active lane keeping, or speed limit recognition.
  • Vehicles with a driving automation level of L3 can achieve semi-autonomous driving.
  • the vehicle's autonomous driving system can complete certain driving tasks and monitor the driving environment under certain circumstances, but the driver needs to be ready to regain driving control at any time.
  • Embodiments of the present application provide a prompting method, device and vehicle, which are used to present prompt information associated with the vehicle status to the user immediately and without interruption when the IVI system is in an overload state, so that the user can learn the vehicle status in a timely manner and facilitate Users can understand and deal with various emergencies in a timely manner, thereby improving the user's driving experience and vehicle driving safety.
  • the prompting method provided by the embodiment of the present application can be executed by a prompting device.
  • the prompting device can be abstracted as a computer system.
  • the prompting device may be a complete machine or a part of the device in the complete machine, such as a system chip or a processing chip.
  • the prompting device may be a terminal device or vehicle-mounted equipment such as a vehicle-mounted computing platform, a vehicle-mounted controller, a vehicle machine, etc., or it may be a system chip that can be provided in a computer system in a vehicle or vehicle-mounted equipment. Decision processing chips or other types of chips, etc.
  • embodiments of the present application provide a prompting method, which method includes: detecting a first event, the first event including an event used to indicate a vehicle status; if the vehicle system is in an overload state, controlling the output of the first device First prompt information, the first prompt information is used to prompt the first event to the user; wherein the first device includes a vehicle-mounted prompt device and/or a non-vehicle prompt device.
  • the vehicle-mounted system may be an IVI system.
  • the overload state of the vehicle system can be understood to mean that the memory resources or computing resources of the IVI system are insufficient, or that the IVI system processes many tasks in parallel, resulting in an overloaded state of the IVI system. It should be understood that when the IVI system is in an overloaded state, there will be at least one of the following situations: image display freezes or cannot be displayed, voice playback freezes or cannot be played, vibration information output is poor or cannot be output, or lighting information cannot be output.
  • the first prompt information corresponding to the first event can be output immediately and without interruption, so that the user can be informed of the first event in time, thereby effectively improving the user's driving experience and vehicle driving safety.
  • the first event includes an event used to indicate the vehicle status.
  • the vehicle status may include the driving status of the vehicle.
  • the driving status may include at least one of an automatic driving status, a user takeover status, or a user takeover status.
  • the autonomous driving state can be understood as the state in which the vehicle is driving automatically under the control of the intelligent driving system;
  • the user-to-takeover state can be understood as the state in which the current vehicle requires user control;
  • the user-takeover state can be understood as the vehicle in the intelligent driving system and The state of driving under the control of the user. Therefore, the first event may be, for example, that the driving state of the vehicle is switched from the automatic driving state to the state waiting for the user to take over, and the user needs to be reminded to take over the vehicle.
  • the first device when the first event is detected, even if the vehicle system is in an overload state, the first device can still be controlled to output the first prompt information, and the first prompt information can be used to prompt the user for the first event, This allows users to know the vehicle status in time and handle various emergencies, thereby effectively improving the user's driving experience and vehicle driving safety.
  • controlling the first device to output the first prompt information includes: if the overload state indicates that the vehicle-mounted system stops playing voice, controlling the first device to output the The first voice information corresponding to the first event, the first voice information is pre-stored voice information.
  • the vehicle-mounted system stops playing voice can mean that the voice system in the IVI system is in a frozen or unresponsive state.
  • the pre-stored voice information corresponding to the first event is output as the first prompt information, thereby omitting the voice processing flow of the voice system (such as voice decoding, resampling, or Mixing and other processes), so that the first prompt information can be output in time, so that the user can be informed of the first event in time.
  • the voice processing flow of the voice system such as voice decoding, resampling, or Mixing and other processes
  • controlling the first device to output the first prompt information includes: if the overload state indicates that the vehicle-mounted system displays image freezes, the candidate image corresponding to the first event is located according to the location of the image.
  • the layer and the layer where the background image of the candidate image is located control the first device to output the first prompt information; wherein the stuck display image means that the time taken to display one frame of image is longer than the first preset time.
  • "vehicle system display image freezes" can be understood as insufficient memory resources of the image system in the IVI system, causing the image system to display one frame of image for longer than the first preset time period (i.e. image display time). The delay is larger).
  • the “candidate image corresponding to the first event” is the candidate image corresponding to the first prompt information.
  • the first device can be controlled to output the first prompt information based on the layer where the candidate image corresponding to the first event is located and the layer where the background image carrying the candidate image is located, This enables users to be informed of the first event in time.
  • the first prompt information is output based on the layer where the candidate image is located and the layer where the background image carrying the candidate image is located, which may include but is not limited to the following situations:
  • Case 1 if the layer where the candidate image is located and the layer where the background image is located are different layers, adjust the parameters of the layer where the background image is located, and based on the adjusted parameters, control the first device to perform the processing of the background image on the layer where the candidate image is located.
  • the parameters of the layer where the background image is located may include but are not limited to at least one of the following: drawing rate, display rate, or refresh frequency.
  • the parameters of the layer where the background image is located are adjusted, and the first device is controlled to display the background image on the layer where the background image is located based on the adjusted parameters.
  • the vehicle-mounted system can have enough memory resources to ensure that the candidate images are displayed, so that the user can be informed in time. The first event.
  • the layer where the candidate image is located and the layer where the background image is located are the same layer (the second layer), then create a third layer and control the first device to be in the third layer.
  • Layer displays candidate images.
  • the candidate image ie, the first prompt information
  • the candidate image can be displayed, so that the user can perceive the first event.
  • the parameters of the third layer used in controlling the third layer of the first device to display candidate images may be default parameters or adjusted parameters.
  • the adjusted parameters of the third layer may include, but are not limited to, at least one of the following: drawing rate, composition rate, display rate, refresh frequency, or stacking order between the third layer and the second layer.
  • controlling the first device to output the first prompt information includes: if the overload state indicates that the vehicle-mounted system stops displaying images, controlling the first device to output the first prompt information in a fourth
  • the layers display candidate images corresponding to the first event, where the fourth layer carries information about the candidate images.
  • the vehicle-mounted system stops displaying images can be understood as a state in which the image system in the IVI system has insufficient memory resources, causing the image system to be unable to display images.
  • the image processing process of the image system (such as the drawing process and/or the synthesis process can be omitted by outputting the pre-stored fourth layer corresponding to the first event as the first prompt information ), so that the first prompt information can be output in time, so that the user can learn the first event in time.
  • controlling the first device to output the first prompt information includes: if the overload state indicates that the vehicle-mounted system stops outputting vibration information, based on the first vibration instruction, controlling the first device to output the first prompt information.
  • a device outputs first vibration information, and the first vibration command is a pre-stored vibration command.
  • the vehicle system stops outputting vibration information can be understood as a state in which the memory resources used to control the vibration components in the vehicle system are insufficient, causing the vibration components to be unable to output vibration information.
  • the corresponding vibration component can be controlled to output the first vibration information based on the pre-stored first vibration instruction, so that the user can be informed of the first event in time.
  • controlling the first device to output the first prompt information includes: if the above-mentioned overload state indicates that the vehicle-mounted system displays images that are stuck or stops displaying images, controlling the first device The device outputs one or more of second vibration information, second voice information or photoelectric information.
  • the overload state indicates that the vehicle-mounted system stops outputting voice information
  • the first device is controlled to output one or more of second vibration information, second image information or photoelectric information.
  • the overload state indicates that the vehicle system stops outputting vibration information
  • the first device is controlled to output one or more of second voice information, second image information or photoelectric information.
  • controlling the first device to output the first prompt information includes: determining one or more prompt methods according to the first event and the mapping relationship, and the mapping relationship is the first Correspondence between events and preset prompting methods; determine a first prompting method from one or more prompting methods according to the current overload status of the vehicle system, and control the first device to output a first prompt corresponding to the first prompting method information.
  • the first prompting method for the first event can be determined based on the correspondence between the first event and the preset prompting method and the overload state of the vehicle system, and the first device can be controlled to output the corresponding first prompting method. the first prompt message. In this way, the prompting method of the first event is more consistent with the status of the vehicle system, thereby further improving the timeliness of outputting the first prompt information corresponding to the first event, so that the user can learn the first event in time.
  • the method further includes: obtaining a historical prompt mode of the first event; and updating the mapping relationship based on the historical prompt mode.
  • the above mapping relationship can be dynamically updated based on the historical prompt mode of the first event, making the mapping relationship more complete.
  • the method further includes: sending the first prompt to the first device. information.
  • the non-vehicle prompt device may include a mobile phone, a tablet computer, or a smart wearable device, etc., and the embodiment of the present application does not impose any specific limitations.
  • the non-vehicle prompt device can output the first prompt information, thereby further improving the probability that the user perceives the first event.
  • embodiments of the present application also provide a prompt device, which prompt device includes modules/units that perform the above-mentioned first aspect and any possible design method of the first aspect; these modules/units can It is implemented through hardware, and the corresponding software implementation can also be executed through hardware.
  • the prompt device includes:
  • a first processing module configured to detect a first event, where the first event includes an event indicating vehicle status
  • the second processing module is configured to control the first device to output first prompt information when the first processing module detects the first event and the vehicle system is in an overload state.
  • the first prompt information is used to prompt the first event; wherein the first device includes a vehicle-mounted prompting device and/or a non-vehicle-mounted prompting device.
  • the second processing module is specifically configured to: when the overload state instructs the vehicle system to stop playing voice, control the first device to output the first voice information corresponding to the first event,
  • the first voice information is pre-stored voice information.
  • the second processing module is specifically configured to: when the overload state indicates that the vehicle system displays an image that is stuck, the layer where the candidate image corresponding to the first event is located and the layer that carries the candidate image are The layer where the background image of the image is located controls the first device to output the first prompt information; wherein the stuck display image means that the time taken to display one frame of image is longer than the first preset time.
  • the second processing module controls the first device to output the first prompt information according to the layer where the candidate image is located and the layer where the background image carrying the candidate image is located, including but not Limited to the following situations:
  • Case 1 if the layer where the candidate image is located and the layer where the background image is located are different layers, the processing module is also used to adjust the parameters of the layer where the background image is located, and the second processing module controls the second layer based on the adjusted parameters.
  • a device displays the background image on the same layer as the background image.
  • the processing module is also used to create a third layer, and the second processing module is also used to control the first device in the third layer.
  • the layer displays the candidate images.
  • the parameters of the layer where the background image is located may include but are not limited to at least one of the following: drawing rate, composition rate, display rate, or refresh frequency.
  • the second processing module can also control the first device to display the candidate image corresponding to the first event on the fourth layer.
  • the fourth figure The layer carries the information of the candidate image.
  • the second processing module can control the first device to output the first vibration information based on the first vibration instruction.
  • a vibration instruction is a pre-stored vibration instruction.
  • the second processing module when the overload state indicates that the vehicle system freezes or stops displaying images, the second processing module can control the first device to output second vibration information, second voice information or photoelectric information. one or more of them.
  • the second processing module when the overload state instructs the vehicle-mounted system to stop outputting voice information, the second processing module may control the first device to output one or more of second vibration information, second image information or photoelectric information.
  • the second processing module may control the first device to output one or more of second voice information, second image information or photoelectric information. .
  • the first processing module is further configured to determine one or more prompt methods based on the first event and a mapping relationship, where the mapping relationship is the relationship between the first event and a preset prompt method. Corresponding relationship; and determine the first prompting mode from the one or more prompting modes according to the current overload status of the vehicle system; the second processing module can be used to control the first device to output all the corresponding prompting modes corresponding to the first prompting mode. Describe the first prompt message.
  • the first processing module is further configured to: obtain a historical prompting mode of the first event; and update the mapping relationship based on the historical prompting mode.
  • the prompt device further includes a communication module.
  • the communication module uses and sending the first prompt information to the first device.
  • embodiments of the present application also provide a vehicle, including the device described in the second aspect and any possible design of the second aspect, to realize the above-mentioned first aspect or any possible design of the first aspect. methods in design.
  • the present application provides a computing device, including a processor.
  • the processor is connected to a memory.
  • the memory stores computer programs or instructions.
  • the processor is used to execute the computer programs or instructions stored in the memory, so that the computing device executes the above-mentioned first step. aspect and the method described in any possible design of the first aspect.
  • the present application provides a computer-readable storage medium on which a computer program or instructions are stored.
  • the computer program or instructions When the computer program or instructions are executed, the computer performs the above-mentioned first aspect and any of the possibilities of the first aspect. The method described in the design.
  • the present application provides a computer program product, which when a computer executes the computer program product, causes the computer to execute the method described in the above-mentioned first aspect and any possible design of the first aspect.
  • the present application provides a chip, which is connected to a memory and used to read and execute computer programs or instructions stored in the memory to implement the above-mentioned first aspect and any possible design of the first aspect. method described.
  • Figure 1A exemplarily shows a schematic diagram of a possible scenario applicable to the embodiment of the present application
  • Figure 1B is a schematic diagram illustrating a possible first prompt information provided by an embodiment of the present application.
  • Figure 2 exemplarily shows a schematic flowchart of a prompting method provided by an embodiment of the present application
  • Figure 3 exemplarily shows one of the schematic diagrams of the first prompt information provided by the embodiment of the present application
  • Figure 4 exemplarily shows the second schematic diagram of the first prompt information provided by the embodiment of the present application
  • Figure 5 exemplarily shows the third schematic diagram of the first prompt information provided by the embodiment of the present application.
  • Figure 6 exemplarily shows the fourth schematic diagram of the first prompt information provided by the embodiment of the present application.
  • Figure 7 exemplarily shows one of the schematic diagrams of the mapping relationship provided by the embodiment of the present application.
  • Figure 8 exemplarily shows the second schematic diagram of the mapping relationship provided by the embodiment of the present application.
  • Figure 9 exemplarily shows a schematic diagram of another possible scenario applicable to the embodiment of the present application.
  • Figure 10 is a schematic diagram illustrating the prompt method provided by the embodiment of the present application.
  • FIG 11 is a schematic structural diagram of a control device provided by an embodiment of the present application.
  • Figure 12 is a schematic structural diagram of a chip system provided by an embodiment of the present application.
  • the prompting device in this application can be used to implement the prompting method provided by the embodiment of this application.
  • the prompting method can be applied to vehicles or vehicle-mounted components or vehicle-mounted chips. The method includes: detecting a first event, the first event including an event used to indicate vehicle status; if the vehicle system is in an overload state, controlling the first device to output first prompt information, the first prompt information being used to prompt the user The first event; wherein the first device includes a vehicle-mounted prompting device and/or a non-vehicle-mounted prompting device.
  • the first device can be controlled to output the first prompt information for prompting the first event, so that the user can promptly learn the first prompt information. Events are processed accordingly, effectively improving the user's driving experience and vehicle driving safety.
  • the industry has proposed grading standards for autonomous vehicles.
  • the driving automation grading standard proposed by the Society of Automotive Engineers International includes six levels, including L0-L5.
  • the driver support system can provide some support functions for the driver, but regardless of whether the driver support function of the vehicle has been turned on, the driver must drive the vehicle himself, and the driver These support functions provided by the driver support system need to be monitored at all times, and the driver needs to control the vehicle to steer, brake, or accelerate according to the driving conditions of the vehicle to ensure the safety of the vehicle.
  • L0 level support functions are limited to providing warning and instant assistance
  • L1 level support functions are at least one of steering, braking, or acceleration
  • L2 level support functions are steering, braking, or acceleration.
  • Vehicles with a driving automation level of L3 can achieve semi-autonomous driving.
  • the vehicle's autonomous driving system can complete certain driving tasks and monitor the driving environment under certain circumstances, but the driver needs to be ready to regain driving control at any time. For example, when the driving state of the vehicle switches from the automatic driving state to the state waiting for the user to take over, the driver must drive the vehicle.
  • Vehicles with a driving automation level of L4 can achieve a high degree of autonomous driving.
  • the vehicle's autonomous driving system can complete driving tasks and monitor the driving environment under certain environments and specific conditions.
  • Vehicles with a driving automation level of L5 can achieve fully autonomous driving, and the vehicle's autonomous driving system can complete all driving tasks under all conditions.
  • the solution of the embodiment of the present application when the solution provided by the embodiment of the present application is used to prompt the vehicle's route planning information or alarm information, the solution of the embodiment of the present application may be applicable to vehicles with driving automation levels of L0-L5. In other embodiments, when the solution provided by the embodiment of the present application is used to prompt the vehicle to switch from the autonomous driving state to the state of requesting the user to take over, the solution of the embodiment of the present application may be applicable to driving automation levels of L2 and above. vehicles, which will not be described in detail later.
  • the vehicle system is an integrated vehicle information processing system based on the body bus system and Internet services. It can also be called in-vehicle infotainment (IVI) system.
  • the IVI system can implement one or more applications in information display (for example, display of navigation information, real-time traffic conditions, vehicle status, etc.), human-computer interaction, assisted driving, fault detection, body control, wireless communication, or online entertainment functions. It has greatly improved the electronic, networked and intelligent level of vehicles.
  • the IVI system may include at least one of an image system, a voice system, a vibration management system, or a light control system.
  • the IVI system may be used to output first prompt information corresponding to the first event.
  • the first event may include events used to indicate vehicle status.
  • the vehicle status may include the driving status of the vehicle.
  • the driving status may include at least one of an automatic driving status, a user takeover status, or a user takeover status.
  • the autonomous driving state can be understood as the state in which the vehicle is driving automatically under the control of the intelligent driving system;
  • the user-to-takeover state can be understood as the state in which the current vehicle requires user control;
  • the user-takeover state can be understood as the vehicle in the intelligent driving system. and the state of driving under the control of the user. Therefore, the first event may be, for example, that the driving state of the vehicle is switched from the automatic driving state to the state waiting for the user to take over, and the user needs to be reminded to take over the vehicle.
  • the first event may be that the vehicle is at risk of collision with a faulty object on the road it is currently traveling on, and the user needs to be reminded to slow down.
  • the first event may be a vehicle getting off a ramp from a highway, and the user needs to be reminded not to miss the ramp.
  • the first event may also include an event indicating a decrease in reliability of the vehicle-mounted system.
  • the first event may be that the reminder function of the vehicle system itself fails, and the user needs to be reminded of the vehicle status through other devices.
  • the first prompt information can be understood as prompt information used to prompt the user of the first event. It should be understood that the first prompt information may include but is not limited to at least one of image information, voice information, vibration information or photoelectric information.
  • the image information may include text information and/or icon information
  • the voice information may include ringtone information and/or voice entry information
  • the vibration information may include the identification and vibration frequency of the vibrating component
  • the photoelectric information may include light information.
  • the overload state can be understood as a state in which the IVI system's memory resources or computing resources are insufficient, or the IVI system processes many tasks in parallel, resulting in an overloaded IVI system. It should be understood that when the IVI system is in an overloaded state, at least one of the following situations will occur: the image display is stuck, the image cannot be displayed, the voice playback is stuck, the voice cannot be played, the vibration information cannot be output, or the lighting information cannot be output.
  • the first prompt information corresponding to the first event can be output immediately and without interruption, so that the user can be informed of the first event in time, thereby effectively improving the user's driving experience and vehicle driving safety.
  • FIG. 1A shows a schematic diagram of a scenario applicable to the embodiment of the present application.
  • the vehicle 100 includes a control device 101, a vehicle prompt device 102, and a vehicle sensing device 103. It can be understood that the control device 101, the vehicle prompt device 102 and the vehicle sensing device 103 may be sub-parts of the vehicle system.
  • the electrical/electronic architecture (EEA) applicable to the vehicle 100 may be any of the distributed ECU architecture, domain controller EEA, or centralized EEA.
  • the control device 101 has different implementations in different electronic and electrical architectures. Different electronic and electrical architectures will be described below.
  • each function of the vehicle is controlled by a specific electronic control unit (ECU); accordingly, if the electronic and electrical architecture of the vehicle 100 is a distributed ECU architecture, the control device 101 can be used for For controlling the ECU of the vehicle-mounted prompt device 102.
  • ECU electronice control unit
  • domain controller EEA some manufacturers integrate the functions of the vehicle controller based on different domain divisions, and then divide the vehicle controller into intelligent driving domain controller, power domain controller, chassis domain controller, and body domain controller and cockpit domain controller; other manufacturers further integrate the power domain, chassis domain and body domain into the vehicle control domain, and then divide the vehicle controller into the vehicle domain controller, intelligent driving domain controller and intelligent cockpit domain controller ; And, other manufacturers integrate the smart cockpit domain with the smart driving domain to achieve smart driving and control of the smart cockpit through a single on-board chip.
  • the intelligent driving domain controller usually needs to connect to the vehicle-mounted sensing device 103, process the information (such as road surface information) sensed by the vehicle-mounted sensing device 103, and perform target positioning, path planning, decision-making control, or wireless communication.
  • the power domain controller can provide a power source for the vehicle to achieve the purpose of driving the vehicle.
  • the chassis domain controller is used to control vehicle functions such as braking, steering, or suspension.
  • the body domain controller can be used to control the front parts of the car (such as front indicators), the middle parts of the car (such as doors, windows, etc.) and the rear parts of the car (such as rear brake lights, rear position lights, tailgate locks, Even double struts).
  • the smart cockpit domain controller can be used to control its associated components, which can be, for example, at least one of a smart seat, a head up display (HUD), an instrument panel (cockpit), and an IVI system.
  • the vehicle domain controller can collect accelerator pedal signals, brake pedal signals and other component signals, and after making corresponding judgments, it can perform driving torque control, optimal control of braking energy, vehicle energy management, and controller area network ( At least one of controller area network (CAN) maintenance and management, fault diagnosis and processing, or vehicle status monitoring.
  • CAN controller area network
  • the control device 101 can be a smart cockpit domain controller, or the control device 101 can be a vehicle-mounted chip that integrates the smart driving domain controller and the smart cockpit domain. Controller functions.
  • a vehicle-mounted computing platform is set up, which can realize the control of relevant components in the intelligent driving domain, intelligent cockpit domain, body domain, power domain and chassis domain.
  • the control device 101 can be an on-board computing platform.
  • the vehicle-mounted prompt device 102 is a vehicle-mounted device used to output prompt information.
  • the vehicle-mounted prompt device 102 may output first prompt information, and the first prompt information is used to prompt the user of the first event.
  • the vehicle prompt device 102 may be one or more vehicle devices, such as a vehicle speaker, a vehicle display screen (also referred to as a "vehicle central control screen"), a vehicle prompt light, a HUD, a vehicle seat, or a steering wheel. of at least one.
  • the vehicle-mounted sensing device 103 can be used to obtain information about the road on which the vehicle 100 is currently traveling.
  • the road information may be, for example, at least one of road parameters, image information corresponding to infrastructure facilities on the road or obstacles on the road, distance information between obstacles on the road and the vehicle 100 , or weather information corresponding to the road.
  • the vehicle-mounted sensing device 103 may be at least one of a camera, a lidar, or a millimeter-wave radar.
  • the control device 101 is a vehicle-mounted chip that integrates the intelligent driving domain controller function and the intelligent cockpit domain controller function
  • the vehicle-mounted sensing device 103 obtains information about the road the vehicle 100 is currently traveling on, and The road information is sent to the control device 101; then the control device 101 can process the road information. If the control device 101 finds that there is a risk of collision between the obstacles on the road where the vehicle 100 is currently traveling and the vehicle 100, the control device 101 controls the vehicle. 100 Switch the driving state (for example, switch from the automatic driving state to the state waiting for the user to take over).
  • the control device 101 After the control device 101 controls the vehicle 100 to switch the driving state, the control device 101 detects that the driving state of the vehicle 100 switches from the automatic driving state to the state waiting for the user to take over, and the user needs to be reminded to take over the vehicle, that is, the control device 101 detects the first event. If the vehicle-mounted system is in an overload state, the vehicle-mounted prompt device 102 can be controlled to output first prompt information, and the first prompt information is used to prompt the user of the first event. For example, as shown in FIG. 1B , the vehicle prompt device 102 takes the vehicle central control screen as an example, and the control device 101 can control the vehicle central control screen to display the first prompt message "Please take over". In this way, the user can be informed of the first event in time, which facilitates the user to perform corresponding processing, thereby effectively improving the user's driving experience and the safety of the user's car.
  • the vehicle-mounted sensing device 103 obtains information about the road the vehicle 100 is currently traveling on, and sends the road information to the smart driving domain controller; and then The intelligent driving domain controller processes the information on the road. If the intelligent driving domain controller finds that there is a risk of collision between the obstacles in the road that the vehicle 100 is currently driving and the vehicle 100, the intelligent driving domain controller changes the driving status of the vehicle 100 from The automatic driving state switches to the state waiting for the user to take over.
  • the control device 101 After the intelligent driving domain controller controls the vehicle 100 to switch the driving state, the control device 101 detects that the driving state of the vehicle 100 switches from the automatic driving state to the state waiting for the user to take over, and the user needs to be reminded to take over the vehicle, that is, the control device 101 detects the first event , if the vehicle system is in an overload state at this time, the vehicle prompt device 102 can be controlled to output the first prompt information, and the first prompt information is used to prompt the user of the first event. In this way, the user can be informed of the first event in time, which facilitates the user to perform corresponding processing, thereby effectively improving the user's driving experience and the safety of the user's car.
  • the control device 101 detects the first event. At this time, if the vehicle system is in an overload state, the control device 101 can also send the first prompt information to at least one device 200, and then can output the first prompt information through the at least one device 200. , effectively improving the probability of users learning the first event.
  • at least one device 200 is a non-vehicle prompt device (for example, at least one of a mobile phone, a headset, a wearable device, etc.) provided outside the vehicle 100 .
  • Figure 2 shows a schematic flowchart of a prompting method provided by an embodiment of the present application. This method can be applied to the application scenario shown in Figure 1A. It should be noted that in the following, the control device 101 takes an on-vehicle chip that integrates the intelligent driving domain controller function and the intelligent cockpit domain controller function as an example to describe the technical solution shown in Figure 2 . The method includes:
  • the control device 101 detects the first event.
  • the first event may include an event used to indicate the vehicle status.
  • the above-mentioned vehicle status may include the driving status of the vehicle.
  • the above-mentioned driving status may include an automatic driving status, a user-to-be-takeover status, or a user-takeover status.
  • the autonomous driving state can be understood as the state in which the vehicle is driving automatically under the control of the intelligent driving system
  • the user-to-takeover state can be understood as the state in which the current vehicle requires user control
  • the user-takeover state can be understood as the vehicle in the intelligent driving system. and the state of driving under the control of the user.
  • the first event may be, for example, that the driving state of the vehicle is switched from the automatic driving state to the state waiting for the user to take over, and the user needs to be reminded to take over the vehicle.
  • the vehicle-mounted sensing device 103 obtains information about the road that the vehicle 100 is currently traveling on, and sends the information about the road to the control device 101.
  • the control device 101 processes the information about the road. If the control device 101 If it is found that there is a risk of collision between the vehicle 100 and the obstacles on the road, the control device 101 controls the driving state of the vehicle 100 to switch from the automatic driving state to the state waiting for the user to take over; the control device 101 detects that the driving state of the vehicle 100 changes from the automatic driving state to the automatic driving state. To switch to the state waiting for the user to take over, the user needs to be reminded to take over the vehicle, that is, the control device 101 detects the first event.
  • the first event may be that the vehicle is at risk of collision with a faulty object on the road it is currently traveling on, and the user needs to be reminded to slow down.
  • the first event may be that the vehicle is about to get off a ramp from a highway, and the user needs to be reminded not to miss the ramp.
  • the vehicle-mounted sensing device 103 obtains information about the road that the vehicle 100 is currently traveling on, and sends the information about the road to the control device 101.
  • the control device 101 processes the information about the road, and the control device 101 determines There is a risk of collision between the obstacles on the road that the vehicle 100 is currently traveling on and the vehicle 100 , and the user needs to be reminded to slow down, that is, the control device 101 detects the first event.
  • the vehicle-mounted sensing device 103 obtains information about the road that the vehicle 100 is currently traveling on, and sends the information about the road to the control device 101; the control device 101 processes the information about the road, and the control device 101 determines that the vehicle 100 is about to get off the ramp from the highway. , the user needs to be reminded not to miss the ramp crossing, that is, the control device 101 detects the first event.
  • the first event may also include an event indicating a decrease in reliability of the vehicle-mounted system.
  • the first event may be that the reminder function of the vehicle system itself fails, and the user needs to be reminded of the vehicle status through other devices.
  • the control device 101 detects that the prompt function of the vehicle system fails (for example, the vehicle central control screen is black), and the user needs to be reminded of the vehicle status through other devices, that is, the control device 101 detects the first event.
  • the control device 101 can also obtain the load status of the vehicle system and/or the output of prompt information corresponding to the second event, and determine the output status of the prompt information corresponding to the second event according to the load of the vehicle system.
  • the status and/or the output of prompt information corresponding to the second event determine whether the vehicle system is in an overload state.
  • "prompt information corresponding to the second event” can understand the prompt information currently to be output by the vehicle system.
  • the control device 101 may determine the output status of the prompt information of the second event based on the output duration and/or output result of the prompt information corresponding to the second event.
  • the vehicle-mounted system may include at least one of an image system, a voice system, a vibration management system, or a lighting control system.
  • the control device 101 is a sub-part of the vehicle-mounted system, and the control device 101 may be a vehicle-mounted chip in the vehicle-mounted system. Therefore, the control device 101 can determine the load status of the vehicle system based on the resource usage and/or scheduling of the vehicle chip, image system (display subsystem, DSS), voice system, vibration management system, or lighting control system.
  • vehicle-mounted chips include but are not limited to the central processing unit (CPU), image processing unit (GPU), field programmable gate array (FPGA), and special application integration of the vehicle system. At least one of an application specific integrated circuit (ASIC) or a system on a chip (SoC).
  • CPU central processing unit
  • GPU image processing unit
  • FPGA field programmable gate array
  • ASIC application specific integrated circuit
  • SoC system on a chip
  • control device 101 is a vehicle chip in the vehicle system.
  • the control device 101 detects that the resource usage of its own memory resources or computing resources is greater than 90%, it determines that the vehicle system is in an overload state.
  • the vehicle-mounted system includes an image system and a voice system. If the control device 101 detects that the resource usage of memory resources or computing resources of the image system and voice system is greater than 90%, it determines that the vehicle-mounted system is in an overload state.
  • the vehicle-mounted system includes a vibration management system and a lighting control system.
  • the control device 101 detects that the vibration components associated with the vibration management system and/or the lighting devices associated with the lighting control system have been fully scheduled, and then determines that the vehicle-mounted system The system is in an overloaded state.
  • the vehicle-mounted system includes an image system, a voice system, a vibration management system, and a lighting control system. If the control device 101 detects the resource usage of the memory resources or computing resources of the image system and voice system of the vehicle-mounted system, If it is greater than 90%, and it is detected that the vibration components associated with the vibration management system and/or the lighting devices associated with the lighting control system have been fully dispatched, it is determined that the vehicle system is in an overload state.
  • control device 101 detects that the time it takes for the vehicle system to output the prompt information of the second event is longer than the first preset time, or the control device 101 detects that the vehicle system does not output the prompt information within the second preset time. If the prompt information of the second event is output, it is determined that the vehicle system is in an overload state.
  • control device 101 is a vehicle-mounted chip in the vehicle-mounted system, the control device 101 detects that the resource usage of its own memory resources or computing resources is greater than 80%, and the control device 101 detects that the vehicle-mounted system is in If the prompt information of the second event is not output within the second preset time period, it is determined that the vehicle system is in an overload state.
  • control device 101 controls the first device to output the first prompt information.
  • the first prompt information is used to prompt the user of the first event.
  • the first prompt information may include but is not limited to at least one of image information, voice information, vibration information or photoelectric information.
  • the image information may include text information and/or icon information
  • the voice information may include ringtone information and/or language information
  • the vibration information may include the identification and vibration frequency of the vibrating component
  • the photoelectric information may include light information.
  • the first device may include a vehicle-mounted prompting device and/or a non-vehicle-mounted prompting device.
  • the vehicle-mounted prompt device is the vehicle-mounted prompt device 102 in FIG. 1A
  • the non-vehicle prompt device is at least one device 200 in FIG. 1A .
  • At least one device 200 may include, but is not limited to, at least one of a voice device, an optoelectronic device, or a display device.
  • At least one device 200 may be, for example, a tablet computer, a notebook computer, a handheld computer, a headset, a stereo, a wearable device (such as a smart watch, a smart bracelet, a pedometer, etc.), a virtual reality (VR) device, or a mobile phone. at least one of them.
  • a tablet computer a notebook computer, a handheld computer, a headset, a stereo, a wearable device (such as a smart watch, a smart bracelet, a pedometer, etc.), a virtual reality (VR) device, or a mobile phone. at least one of them.
  • a wearable device such as a smart watch, a smart bracelet, a pedometer, etc.
  • VR virtual reality
  • the vehicle-mounted system is the IVI system.
  • the vehicle system is in an overload state can be understood as a state in which the memory resources or computing resources of the IVI system are insufficient, or the IVI system processes many tasks in parallel, causing its load to be too high.
  • the IVI system may include, but is not limited to, at least one of an image system, a voice system, a vibration management system, or a lighting control system.
  • the specific performance of the IVI system can be at least one of the following situations: the image display is stuck, the image cannot be displayed, the voice playback is stuck, the voice cannot be played, the vibration information cannot be output, or the output cannot be Light information.
  • the control device 101 controls the HUD to display the third image corresponding to the first event. A prompt message.
  • the control device 101 when the IVI system cannot broadcast the voice and the control device 101 determines that the IVI system is in an overload state, the control device 101 will send the first message corresponding to the first event.
  • the prompt information is sent to the mobile phone, and the first prompt information is displayed on the mobile phone.
  • the control device 101 detects the first event, and even if the vehicle system is in an overload state, it can still control the first device to output the first prompt information to prompt the user with the first prompt information. Events enable users to learn vehicle status immediately and without interruption and handle various emergencies, thereby effectively improving the user's driving experience and vehicle driving safety.
  • control device 101 controls the first device to output the first prompt information, including but not limited to the following implementation scenarios:
  • Scenario 1 The overload state of the vehicle system indicates that the first interactive subsystem associated with the vehicle system is in an overload state.
  • the control device 101 can adjust the prompt process of the first interactive subsystem and control the output of the first device based on the adjusted prompt process.
  • First prompt information In scenario one, it can be ensured that the first prompt information is output in a timely manner without interruption, so that the user can learn the first event.
  • scenario one includes but is not limited to the following embodiments:
  • the first interactive subsystem takes the voice system in the vehicle system as an example. If the overload state of the vehicle system indicates that the voice system stops playing the voice or the voice playback is stuck, the control device 101 can control the first device The first voice information corresponding to the first event (that is, the first prompt information) is output. Wherein, the first voice information is pre-stored voice information. Therefore, when the voice system stops playing voice or the voice playback is stuck, the first device is controlled to output the pre-stored first voice information corresponding to the first event, thereby omitting the voice processing process (such as voice decoding, resampling, or mixing). etc.), so that users can be informed of the first event in time.
  • the voice processing process such as voice decoding, resampling, or mixing.
  • the first voice information is pre-stored in the memory of the first device, and the first voice information corresponding to the first event may include voice entry information and/or ringtone information.
  • the first device takes the car audio as an example.
  • the first voice information is pre-stored in the memory of the car audio.
  • the control device 101 detects the first event, it can control the car audio to directly obtain the voice entry information and/or ringtone information from its memory. , and output the voice entry information and/or ringtone information.
  • the first voice information is pre-stored in the control device 101, and the first voice information corresponding to the first event may include voice entry information and/or ringtone information.
  • the first device takes a car audio as an example.
  • the first voice information is pre-stored in the control device 101.
  • the control device 101 detects the first event and sends the voice information entry and/or ringtone information to the car audio, so that the vehicle audio outputs The voice entry information and/or the ringtone information.
  • the first interactive subsystem takes the image system as an example. If the overload state of the above-mentioned vehicle system indicates that the image system displays image freezes, the control device 101 can control the image according to the image where the candidate image corresponding to the first event is located. layer and the layer where the background image carrying the candidate image is located, and controls the first device to output the first prompt information. In this way, when the image system displays an image freeze, the control device 101 can control the first device to output the first prompt information according to the layer where the candidate image corresponding to the first event is located and the layer where the background image carrying the candidate image is located, so that the first prompt information is displayed. The prompt information can be output normally, so that the user can be informed of the first event in time.
  • “candidate image” can be understood as the preset image information corresponding to the first prompt information corresponding to the first event
  • background image carrying the candidate image can be understood as the image system used when displaying the candidate image. Background image.
  • the candidate image may be a static image or a dynamic image.
  • the background image carrying the candidate image may be image information corresponding to the vehicle's navigation information or default background information.
  • the image system displays stuck images can be understood as the time it takes for the image system to display one frame of image longer than the first preset time. For example, the first preset time period is 100 ms. If the time it takes for the image system to display one frame of image is longer than 100 ms, it is considered that the image system is stuck.
  • the background image can be on a different layer or the same layer as the candidate image.
  • the two cases are introduced below.
  • the control device 101 can adjust the parameters of the layer where the background image is located, and control the first device to control the background image based on the adjusted parameters.
  • the layer where the candidate image is located displays the background image, and the first device is controlled to display the candidate image on the layer where the candidate image is located.
  • the memory resources of the image system are tight, the memory resource requirements of the background image are reduced, so that the image system has enough resources to ensure that the candidate image corresponding to the first event (ie, the first prompt information) can be displayed, thereby This enables users to be informed of the first event in time.
  • the parameters of the layer where the background image is adjusted by the control device 101 may include but are not limited to at least one of the following: drawing rate, display rate or refresh frequency.
  • the drawing rate refers to the rate at which the control device 101 draws the layer where the background image is located
  • the display rate refers to the rate at which the image system set by the control device 101 displays the layer where the background image is located (for example, the rate can be an image
  • the refresh frequency refers to the refresh frequency of the layer where the background image is located within the preset time period (for example, the refresh frequency can be that the image system refreshes 2 frames of images within 100ms ).
  • the parameter of the layer where the background image is located adjusted by the control device 101 is the drawing rate of the second layer.
  • the layer where the candidate image is located is the first layer
  • the layer where the background image is located is the second layer.
  • the image system only displays the background image in the first frame image; the image system needs to display the background image and candidate images in the second frame image, the third frame image, and the fourth frame image; and the image system When displaying the second and third frames of images, the display is stuck, and when displaying the fourth frame of images, the display is smooth.
  • FIG. 3 shows the drawing process of the first layer and the second layer.
  • the control device 101 reduces the drawing rate of the second layer and maintains the drawing rate of the second layer.
  • the drawing rate of a layer furthermore, when the first device displays the second frame image and the third frame image, the control device 101 can control the first device to continuously refresh the candidate images (that is, the candidate images are refreshed as "a" and "b” respectively. ), but does not refresh the background image (that is, the background image remains "1"); and when the first device displays the fourth frame image, the control device 101 may control the first device to refresh the candidate image to "c", and to The background image refreshes to "2".
  • (b) in Figure 3 shows the display effect after the synthesis of the first layer and the second layer.
  • only the background image is displayed in the first frame image;
  • the candidate image and the background image used to carry the candidate image are displayed in the second frame image, the third frame image and the fourth frame image, and the candidate image is refreshed in the second frame image, the third frame image and the fourth frame image respectively.
  • the background image is only refreshed to "2" in the fourth frame of the image.
  • the control device 101 can effectively reduce the memory resource requirements of the second layer by reducing the drawing rate of the second layer and maintaining the drawing rate of the first layer, so that the image system has sufficient memory.
  • the resource can ensure that the first layer can be drawn normally, so that when displaying the second frame image, the third frame image, and the fourth frame image, the first device can continuously refresh the candidate image, thereby allowing the candidate image to be displayed in a timely and uninterrupted manner.
  • it helps the user to learn the first event in a timely and uninterrupted manner.
  • the parameter of the layer where the background image is located adjusted by the control device 101 is the refresh rate of the layer.
  • the layer where the candidate image is located is the first layer
  • the layer where the background image is located is the second layer.
  • the image system in the first frame image, the image system only displays the background image; in the second frame image, the third frame image and the fourth frame image, the image system needs to display the background image and the candidate image; and the image The system freezes when displaying the second and third frames of images, and displays smoothly when displaying the fourth frame of images.
  • the control device 101 maintains the refresh frequency of the first layer by reducing the refresh frequency of the second layer; and then when the first device displays the second frame image and the third frame image, the control device 101 can control The first device continues to refresh the candidate images (that is, the candidate images are refreshed as "a” and "b” respectively), but does not refresh the background image (that is, the background image remains as "1"); and, the fourth frame image is displayed on the first device
  • the control device 101 may control the first device to refresh the candidate image to "c" and refresh the background image to "2".
  • the control device 101 can effectively reduce the demand for memory resources of the second layer, so that the image system has enough memory resources to ensure that the first image
  • the layer can be refreshed normally, so that when displaying the second frame image, the third frame image, and the fourth frame image, the first device can continuously refresh the candidate image, so that the candidate image can be presented to the user in a timely and uninterrupted manner, which is helpful. This allows users to be notified of the first event in a timely and uninterrupted manner.
  • the control device 101 can create a new third layer and control the first device to display the candidate image on the third layer. It should be noted that since the candidate image and the background image are on the same layer, this layer has a high demand for memory resources, while the third layer newly created by the control device 101 has a low demand for memory resources, so the image system There are sufficient resources to draw and display the third layer normally, so that the candidate image can be presented to the user in a timely and uninterrupted manner, helping the user to learn the first event in a timely and uninterrupted manner.
  • the candidate image corresponding to the first event is "Please take over”
  • the background image carrying the candidate image is road information
  • the candidate image and the background image are both on the same layer (i.e., the second layer shown in Figure 5) .
  • the image system shows lag when displaying the first and second frame images, and displays smoothly when displaying the third frame image.
  • the first frame image both the candidate image and the background image are in the first frame.
  • the second layer is displayed. Therefore, when displaying the second frame image, the control device 101 creates a new third layer, and controls the first device to display the candidate image "Please take over” on the third layer, and to display the unrefreshed background image on the second layer; And, when displaying the third frame image, the control device 101 controls the first device to display the candidate image "Please take over” on the third layer, and to display the refreshed background image on the second layer. In this way, the candidate image "please take over” can be displayed in a timely manner on the third layer, so that the user can learn the first event in a timely and uninterrupted manner.
  • control device 101 can also adjust the display order (z-order) of the third layer to adjust the stacking order of the third layer and the second layer, so that the third layer Displayed at the top of the image so users can learn about the first event.
  • the control device 101 controls the first device to display the candidate image "Please take over" on the newly created third layer (i.e., the dotted ellipse part), and on The second layer displays the background image.
  • the z-order value of the third layer and the z-order value of the second layer are both 0; in (b) of Figure 6 , the control device 101 Adjust the z-order value of the third layer to 1, and keep the z-order value of the second layer to 0, so that in the stacking order between the third layer and the second layer, the The stacking order of the three layers is the top layer, and the control device 101 can control the first device to display the candidate image on the top layer of the image.
  • the first interactive subsystem takes the image system as an example. If the overload state of the above-mentioned vehicle system indicates that the image system stops displaying images, the control device 101 can control the first device to display the first image on the fourth layer.
  • the fourth layer may be a layer pre-stored in the first device or the control device 101, or may be a cache layer generated by the control device 101 based on the historical prompt information corresponding to the first event displayed by the first device.
  • control device 101 can control the first device to directly output the pre-stored fourth layer, reducing the image drawing process and synthesis process, so that the candidate image can be displayed to the user faster, In this way, the user can learn the first event in time and handle it accordingly.
  • the first interactive subsystem takes a vibration component as an example. If the above-mentioned overload state indicates that the vibration component stops outputting vibration information, the control device 101 can control the first device to output and the first vibration information based on the first vibration instruction.
  • the first vibration information corresponding to the event, the first vibration instruction is a pre-stored vibration instruction.
  • the vibration management system in the vehicle system is used to generate control instructions for vibration components. Therefore, when the vibration management system in the vehicle system fails, the control device 101 can send a pre-stored first vibration command to the first device, and the first device can output the first vibration information based on the first vibration command.
  • the control device 101 can still control the first device to output the first vibration information, so that the user can learn the first event in time.
  • the first device may be a vehicle seat or a steering wheel.
  • Scenario 2 The overload state of the vehicle system indicates that the first interactive subsystem associated with the vehicle system is in an overload state.
  • the control device 101 can control the first device to output the first prompt information in a prompt manner corresponding to the second interactive subsystem associated with the vehicle system.
  • the first prompt information can be output normally, effectively improving the probability that the user learns the first event.
  • scenario two includes but is not limited to the following embodiments:
  • the first interactive subsystem takes the voice system as an example. If the overload state indicates that the voice system stops playing voice or the voice playback is stuck, the control device 101 can control the first device to interact with the second interaction associated with the vehicle system.
  • the prompt mode corresponding to the subsystem outputs the first prompt information.
  • the second interactive subsystem is an interactive system other than the voice system in the vehicle system. In some possible embodiments, the second interactive subsystem may include, but is not limited to, at least one of a vibration component, an image system, or a lighting device.
  • the prompting method corresponding to the second interactive subsystem includes at least one of the vibration prompting method, the image prompting method, or the photoelectric prompting method, and the first prompting information includes the second vibration information, the second image information, or the second photoelectric information. at least one of them.
  • the first interactive subsystem takes the image system as an example. If the overload state of the above-mentioned vehicle system indicates that the image system displays images that are stuck or stops displaying images, the control device 101 can control the first device to use the vehicle system.
  • the associated second interactive subsystem outputs the first prompt information in a corresponding prompt mode.
  • the second interactive subsystem is other interactive systems in the vehicle system except the image system.
  • the second interactive subsystem includes but is not limited to at least one of a vibration component, a voice system, or a lighting device.
  • the prompting method corresponding to the second interactive subsystem includes at least one of a vibration prompting method, a voice prompting method, or a photoelectric prompting method
  • the first prompting information may include but is not limited to second vibration information, second voice information, or At least one of the second photoelectric information.
  • the photoelectric information can be light information
  • different first events can correspond to light information of different colors.
  • the first event is that the driving state of the vehicle switches from the autonomous driving state to the state waiting for the user to take over, and the user needs to be reminded to take over the vehicle
  • the first device is a vehicle-mounted reminder light
  • the control device 101 can control the vehicle-mounted reminder light to display green light.
  • the control device 101 can control the vehicle-mounted reminder light to display yellow light.
  • the first interactive subsystem takes a vibration component as an example. If the overload state indicates that the vehicle system stops outputting vibration information, that is, the first interactive subsystem (vibration component) is in an overload state, the control device 101 controls the first device to output the first interactive subsystem in a prompt manner corresponding to the second interactive subsystem associated with the vehicle system. A prompt message.
  • the second interactive subsystem is other interactive systems in the vehicle system except the vibration components.
  • the second interactive subsystem may include but is not limited to at least one of an image system, a voice system, or a lighting device.
  • the prompting method corresponding to the second interactive subsystem includes at least one of an image prompting method, a voice prompting method, or a photoelectric prompting method
  • the first prompting information may include but is not limited to second image information, second At least one of voice information or second photoelectric information.
  • Scenario 3 All interactive systems associated with the vehicle-mounted system are in an overload state, and the first prompt information can be sent to the non-vehicle prompt device, and the first prompt information can be output through the non-vehicle prompt device. In scenario three, it can be ensured that the first prompt information is output in time, effectively improving the probability that the user will learn the first event.
  • non-vehicle reminder devices can include but are not limited to tablet computers, laptop computers, PDAs, headphones, speakers, wearable devices (such as smart watches, smart bracelets, pedometers, etc.), virtual reality (VR) At least one of the device, or mobile phone.
  • wearable devices such as smart watches, smart bracelets, pedometers, etc.
  • VR virtual reality
  • scenario three includes but is not limited to the following embodiments:
  • the non-vehicle prompting device is a mobile phone.
  • the control device 101 detects that the driving state of the vehicle switches from the autonomous driving state to the state waiting for the user to take over, the control device 101 can send the first prompt information to the mobile phone, and display the first prompt information through the mobile phone to remind the user to take over the vehicle. Therefore, if the user is playing with his mobile phone with his head down, the user can promptly learn the first event through the mobile phone and perform corresponding operations.
  • the non-vehicle prompting device is a mobile phone or a smart watch, corresponding to the first event
  • the first prompt information includes image information and vibration information.
  • the control device 101 detects the first event, the control device 101 can send the image information to the mobile phone and send a vibration control instruction to the smart watch, so that the mobile phone can display the image information and the smart watch can output the vibration information based on the vibration instruction. .
  • the first prompt information is output to the user through multiple devices to facilitate the user to learn the first event.
  • the control device 101 can determine one or more prompt methods based on the first event and the mapping relationship, and based on the current overload state of the vehicle-mounted system, the control device 101 can determine one or more prompt methods based on the current overload state of the vehicle-mounted system.
  • the first prompting mode is determined, and the first device is controlled to output the first prompting information corresponding to the first prompting mode. In this way, the prompting method of the first event is consistent with the load status of the vehicle system, so that the first prompt information can be output in time to facilitate the user to learn the first event.
  • the mapping relationship is the corresponding relationship between the first event and the preset prompting mode. See Table 1, which shows an example of this mapping relationship.
  • the preset prompting methods corresponding to the first event are voice prompting, image prompting, and Vibration prompt method; if the first event is that the vehicle has a risk of collision with a faulty object on the road it is currently traveling on, and the user needs to be reminded to slow down, the preset prompt method corresponding to the first event is a voice prompt method and an image prompt method; if the second event The first event is that the prompt function of the vehicle system itself fails, and the user needs to be reminded of prompt information corresponding to the vehicle status through other devices.
  • the preset prompt methods corresponding to the first event are voice prompts and image prompts.
  • the preset prompting methods corresponding to the first event include image prompting, voice prompting and vibration prompting.
  • Figure 7 also shows detailed information corresponding to each prompting method.
  • the detailed information corresponding to the image prompt mode includes original image information, image data description, image data and other image information.
  • the original image information is used to describe the first event.
  • the original image information may include but is not limited to at least one of the number, size, location, layout, or resource index ID of the pictures (that is, the link address of the candidate image corresponding to the first event).
  • the image data description is used to describe the layer where the candidate image corresponding to the first event is located.
  • the image data description may include the size information, ownership information, Z-Order information, memory address, or physical storage location corresponding to the layer where the candidate image is located. at least one of them.
  • Image data is pre-drawn or synthesized layer data that can be displayed directly through a display device without drawing or compositing processing.
  • image data can be dynamically updated.
  • Other image information may include how the candidate image is displayed and/or a display device identification.
  • the detailed information corresponding to the voice prompt mode includes original voice information, voice data description, voice data, and other voice information.
  • the original voice information is used to describe the first event.
  • the original voice information may include but is not limited to the audio resource file corresponding to the first event and/or the link address of the audio resource file.
  • the voice data description is used to describe the first voice information corresponding to the first event.
  • the voice data description may include but is not limited to at least one of the type, size, address, or storage location of the first voice information.
  • Voice data is voice data that has been preprocessed (for example, audio decoding, resampling, mixing, post-processing, etc.) and can be played directly through a voice device (for example, a speaker or car audio).
  • Other voice information may include but is not limited to the playback method of the first voice information and/or the voice device identification.
  • the voice playback method may include playback times and/or playback periods, for example.
  • the detailed information corresponding to the vibration prompt mode includes vibration component ID and vibration description.
  • the vibration component ID may indicate the vibration component used to prompt the first event.
  • a vibration description is used to describe the vibration frequency and/or vibration time of the associated vibrating component.
  • the first event can correspond to at least one prompting method, and accordingly, the first prompting information can correspond to multiple presentation forms.
  • FIG. 8 shows a schematic diagram of the first event set and the first prompt information set.
  • the prompt method corresponding to the first event includes an image prompt method and a voice prompt method; accordingly, the third event corresponding to the first event
  • a prompt message may include a deceleration sign and a deceleration prompt sound.
  • the prompt method corresponding to the first event includes an image prompt method and a voice prompt method; accordingly, the first prompt information corresponding to the first event can include Lane change icon and lane change prompt sound.
  • the prompting method corresponding to the first event includes an image prompting method, a voice prompting method, and a vibration prompting method; accordingly, the first The first prompt information corresponding to an event may include an alarm icon, a steering wheel icon, a takeover prompt sound, and a vibration reminder.
  • the one or more prompting methods determined by the control device 101 according to the mapping relationship may include at least one of an image prompting method, a voice prompting method, a vibration prompting method, or a photoelectric prompting method.
  • the first prompting method may include one or more prompting methods.
  • the control device 101 determines the voice prompt mode as the first prompt mode, and controls the first device to output the voice information corresponding to the first event in a semantic prompt mode.
  • the prompting mode corresponding to the first event determined by the control device 101 is a voice prompting mode, an image prompting mode, and a vibration prompting mode
  • the current overload status of the vehicle-mounted system indicates that the vehicle-mounted system
  • the control device 101 determines the voice prompt mode and the vibration prompt mode as the first prompt mode.
  • the control device 101 controls the first device to output the voice information corresponding to the first event in a semantic prompt mode, and controls the first device to vibrate.
  • the prompt mode outputs the vibration information corresponding to the first event.
  • control device 101 can also obtain the historical prompting mode of the first event, and update the above-mentioned mapping relationship based on the historical prompting mode.
  • the history prompting method may be an image prompting method, and the image information corresponding to the image prompting method includes a graphic identification, while the image prompting method in the existing mapping relationship only includes a text identification.
  • the control device 101 By updating the mapping relationship, the prompt information corresponding to the image prompt mode in the updated mapping relationship includes graphic logos and text logos. In this way, the mapping relationship is made more complete, and the application of the mapping relationship is further expanded.
  • the control device 101 can update the mapping relationship through deep learning and other technologies.
  • control device 101 is a vehicle-mounted chip that integrates the functions of an intelligent driving domain controller and an intelligent cockpit domain controller.
  • the following control device 101 takes the intelligent cockpit domain controller as an example to further describe the technical solution provided by this application.
  • Figure 9 shows a schematic diagram of another possible scenario applicable to the embodiment of the present application. If the first event is that the vehicle's driving state switches from the automatic driving state to the state waiting for the user to take over, the user needs to be reminded to take over the vehicle.
  • the intelligent driving domain controller can be used to process the information collected by the vehicle-mounted sensing device 103, and decide based on the processing results to adjust the driving state of the vehicle from the automatic driving state to the state waiting for user takeover.
  • the intelligent cockpit domain controller After the intelligent driving domain controller adjusts the status of the vehicle, the intelligent cockpit domain controller detects that the vehicle's driving state switches from the automatic driving state to the state waiting for the user to take over, and the user needs to be reminded to take over the vehicle, that is, the intelligent cockpit domain controller detects to the first event.
  • the smart cockpit domain controller can also determine one or more prompt methods corresponding to the first event based on the preset mapping relationship, and further monitor and analyze its own load status, and combine the overload status of the IVI system to determine the prompt method.
  • the corresponding one or more prompting methods are selected to select a first prompting method, which includes an image prompting method, a voice prompting method, or a vibration prompting method.
  • FIG. 10 shows detailed information related to the prompting mode of the first event.
  • the smart cockpit domain controller can query the information tag corresponding to the first event according to the preset mapping relationship.
  • the information tag can indicate one or more Prompt method.
  • the smart cockpit domain controller cannot query the prompt method corresponding to the first event based on the preset mapping relationship.
  • the smart cockpit domain controller can establish a preset prompt method corresponding to the first event in the current mapping relationship.
  • the smart cockpit domain controller may update the prompt mode corresponding to the first event in the preset mapping relationship.
  • the smart cockpit domain controller can combine the overload status of the IVI system and adjust the parameters of the layer where the background image is located (such as reducing the drawing rate or refresh rate) so that the image system has sufficient memory resources to ensure that the candidate image can be drawn normally or Refresh normally.
  • the smart cockpit domain controller may display the candidate image corresponding to the first event through a pre-stored layer (that is, a cache layer).
  • the smart cockpit domain controller can control the voice device to output the pre-stored voice information corresponding to the first event.
  • the smart cockpit domain controller can control the vibration component to output the vibration information corresponding to the first event based on the pre-stored vibration command.
  • the embodiment of the present application also provides a prompting device for implementing the prompting method described in the above method embodiment, and therefore has the beneficial effects of the above method embodiment.
  • Figure 11 shows a schematic structural diagram of a prompt device provided by an embodiment of the present application.
  • the device can be a field programmable gate array (FPGA), or a dedicated integrated Chip (application specific integrated circuit, ASIC), or central processing unit (central processor unit, CPU), etc.
  • the prompt device 1100 includes:
  • the first processing module 1101 is configured to detect a first event, where the first event includes an event indicating vehicle status;
  • the second processing module 1102 is configured to output first prompt information when the first processing module 1101 detects the first event and the vehicle system is in an overload state, and the first prompt information is used to prompt the first event;
  • the first device includes a vehicle-mounted prompting device and/or a non-vehicle-mounted prompting device.
  • the second processing module 1102 is specifically configured to: when the overload state indicates that the vehicle system stops playing voice, control the first device to output the first voice information corresponding to the first event.
  • the first voice information is pre-stored voice information.
  • the second processing module 1102 is specifically configured to: when the overload state indicates that the vehicle system displays an image that is stuck, the layer where the candidate image corresponding to the first event is located and the layer that carries the The layer where the background image of the candidate image is located controls the first device to output the first prompt information; wherein the stuck display image means that the time taken to display one frame of image is longer than the first preset time.
  • the second processing module 1102 outputs the first prompt information according to the layer where the candidate image is located and the layer where the background image carrying the candidate image is located, including but not limited to the following situations:
  • the first processing module 1101 is also used to adjust the parameters of the layer where the background image is located, and the second processing module 1102 is based on the adjustment.
  • the following parameters are used to control the first device to display the background image on the layer where the background image is located.
  • the first processing module 1101 is also used to create a third layer
  • the second processing module 1102 is also used to control the first device in The third layer displays the candidate images.
  • the parameters of the layer where the background image is located may include, but are not limited to, at least one of the following: drawing rate, display rate, or refresh frequency.
  • the second processing module 1102 can control the first device to display the candidate image corresponding to the first event on the fourth layer.
  • the fourth figure The layer carries the information of the candidate image.
  • the second processing module 1102 can control the first device to output the first vibration information based on the first vibration instruction.
  • the vibration command is a pre-stored vibration command.
  • the second processing module 1102 can control the first device to output second vibration information, second voice information, or photoelectric information. of one or more.
  • the second processing module 1102 may control the first device to output one or more of second vibration information, second image information or photoelectric information.
  • the second processing module 1102 may control the first device to output one or more of second voice information, second image information, or photoelectric information.
  • the first processing module 1101 is specifically configured to: determine one or more prompt methods according to the first event and a mapping relationship, where the mapping relationship is the first event and a preset prompt method. and determine the first prompt mode from the one or more prompt modes according to the current overload status of the vehicle system; the second processing module can be used to control the first device to output the corresponding first prompt mode the first prompt information.
  • the first processing module 1101 is further configured to: obtain a historical prompting mode of the first event; and update the mapping relationship based on the historical prompting mode.
  • the prompt device further includes a communication module 1103.
  • the communication module 1103 Used to send the first prompt information to the first device.
  • the prompt device in the embodiment of the present application can be implemented by software, for example, a computer program or instruction with the above functions.
  • the corresponding computer program or instruction can be stored in the memory inside the terminal and read by the processor.
  • Corresponding computer programs or instructions inside the memory implement the above-mentioned functions of the first processing module 1101 and/or the second processing module 1102, and/or the communication module 1103.
  • the prompt device in the embodiment of the present application can also be implemented by hardware.
  • the first processing module 1101 may be a processor (such as a CPU or a processor in a system chip).
  • An embodiment of the present application also provides a vehicle, which may include the above prompt device 1100.
  • This embodiment of the present application also provides a terminal device, which may include the above prompting device 1100.
  • the terminal device in the embodiment of the present application may be, for example, a vehicle-mounted terminal, a vehicle-mounted controller, a vehicle-mounted module, a vehicle-mounted module, a vehicle-mounted component, a vehicle-mounted chip, a vehicle-mounted unit, a vehicle-mounted radar or a vehicle-mounted camera and other sensors.
  • the vehicle It can be through the vehicle-mounted terminal, vehicle-mounted controller, vehicle-mounted module, vehicle-mounted module, vehicle-mounted component, vehicle-mounted chip or vehicle-mounted unit.
  • An embodiment of the present application also provides a chip system. Please refer to Figure 12.
  • the chip system 1200 includes at least one processor. When the program instructions are executed in at least one processor 1201, the above-mentioned The prompt method is implemented.
  • the chip system also includes a communication interface 1203, which is used to input or output information.
  • the chip system also includes a memory 1202, which is coupled to the processor through the communication interface 1203 and used to store the above instructions, so that the processor can read the instructions stored in the memory through the communication interface 1203.
  • connection medium between the above-mentioned processor 1201, memory 1202, and communication interface 1203 is not limited in this embodiment of the application.
  • the memory 1202, the processor 1201 and the communication interface 1203 are connected through a communication bus 1204 in Figure 12.
  • the bus is represented by a thick line in Figure 12.
  • the connection between other components is only a schematic explanation. , not as a limitation.
  • the bus may include an address bus, a data bus, a control bus, etc. For ease of presentation, only one thick line is used in Figure 12, but it does not mean that there is only one bus or one type of bus, etc.
  • An embodiment of the present application also provides a computer program product including instructions that, when run on the above device, execute the prompting method in the above embodiment.
  • Embodiments of the present application provide a computer-readable storage medium.
  • the computer-readable storage medium stores a computer program.
  • the prompting method in the above embodiment is implemented.
  • the division of modules or units is only a logical functional division. In actual implementation, there may be other divisions, for example, multiple units or components may be combined or integrated into another device, or some features may be Ignore, or do not execute.
  • the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated.
  • the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place, or they may be distributed to multiple different places. . Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in various embodiments of the present application can be integrated into one processing module, each unit can exist physically alone, or two or more units can be integrated into one unit.
  • the above integrated units can be implemented in the form of hardware or software functional units.
  • each functional module in various embodiments of the present application can be integrated into a processor, or can exist physically alone, or two or more modules can be integrated into one module.
  • the above integrated modules can be implemented in the form of hardware or software function modules.
  • the methods provided by the embodiments of this application can be implemented in whole or in part by software, hardware, firmware, or any combination thereof.
  • software When implemented using software, it may be implemented in whole or in part in the form of a computer program product.
  • the computer program product includes one or more computer instructions.
  • the computer program instructions When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part.
  • the computer may be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user equipment, or other programmable device.
  • the computer instructions may be stored in or transmitted from one computer-readable storage medium to another, e.g., the computer instructions may be transferred from a website, computer, server, or data center Transmission to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means.
  • the computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more available media integrated.
  • the available media may be magnetic media (for example, floppy disks, hard disks, magnetic tapes), optical media (for example, digital video discs (DVD for short)), or semiconductor media, etc.
  • the embodiments may refer to each other, for example, the methods and/or terms between the method embodiments may refer to each other, for example, the functions and/or terms between the device embodiments may refer to each other. Or terms may refer to each other, for example, functions and/or terms between apparatus embodiments and method embodiments may refer to each other.

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Human Computer Interaction (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Traffic Control Systems (AREA)

Abstract

一种提示方法,涉及智能驾驶技术领域。包括:检测到第一事件(S201),该第一事件包括用于指示车辆状态的事件;如果车载系统处于过载状态,控制第一装置输出第一提示信息(S202),所述第一提示信息用于向用户提示所述第一事件;其中,所述第一装置包括车载提示装置和/或非车载提示装置。如此,即使车载系统处于过载状态,仍然可以控制第一装置输出用于提示第一事件的第一提示信息,使得用户可以及时获知车辆状态并处理各种突发事件,从而有效提升用户的驾驶体验及车辆行驶的安全性。还涉及一种装置、车辆、计算机可读存储介质及芯片。

Description

一种提示方法、装置及车辆 技术领域
本申请涉及智能驾驶技术领域,特别涉及一种提示方法、装置及车辆。
背景技术
随着智能驾驶技术的蓬勃发展,智能驾驶技术被广泛地应用于车辆。为了让用户获知车辆状态(例如,驾驶状态),车辆配置了车载信息娱乐(in-vehicle infotainment,IVI)系统,并通过IVI系统输出用于提示车辆状态的提示信息。然而,在IVI系统处于高负载的情况下,IVI系统会出现提示信息输出卡顿或者提示信息无法输出的情况,导致用户无法及时获知车辆状态信息,从而会带来一定的安全隐患。
业界关于自动驾驶汽车提出了分级标准,国际自动机工程师学会(society of automotive engineers international,简称SAE International)提出的驾驶自动化分级标准包括L0-L5等六个级别。其中,对于驾驶自动化分级为L1-L2级的车辆,该车辆的驾驶员支持系统能够为驾驶员提供一些支持功能,其中,L1级的支持功能包括转向、制动或加速中的至少一项,L2级的支持功能包括转向、制动、加速、全速自适应巡航、主动车道保持、或限速识别中的至少一项。驾驶自动化分级为L3级的车辆可以实现半自动驾驶,该车辆的自动驾驶系统既能完成某些驾驶任务,也能在某些情况下监控驾驶环境,但驾驶员需要随时准备重新取得驾驶控制权,例如当车辆的驾驶状态由自动驾驶状态切换为待用户接管状态时,驾驶员必须驾驶车辆。因此,对于驾驶自动化分级为L1-L2级的车辆,在车辆出现转向、制动或加速中的任一情况时,若用户未能及时收到相应的提示信息或未收到提示信息,会导致用户的驾驶体验较差。对于驾驶自动化分级为L3级及以上的车辆,若车辆的驾驶状态从自动驾驶状态切换为请求用户接管状态时,若用户没有及时收到相应的提示信息或未收到提示信息,用户可能无法及时进行相应的处理,会导致车辆行驶存在安全隐患。
因此,如何确保将车辆状态即时、不中断地呈现给用户,以便用户及时了解并处理各种突发事件,进而提升用户的驾驶体验及车辆行驶的安全性,是本领域亟需解决的技术问题。
发明内容
本申请实施例提供一种提示方法、装置以及车辆,用于在IVI系统处于过载状态时,将与车辆状态关联的提示信息即时、不中断地呈现给用户,使得用户可以及时获知车辆状态,便于用户及时了解并处理各种突发事件,从而提升用户的驾驶体验及车辆行驶的安全性。
本申请实施例提供的提示方法可以由提示装置执行。提示装置可以被抽象为计算机系统。提示装置可以是整机,也可以是整机中的部分器件,例如:系统芯片或处理芯片。具体地,提示装置可以是诸如车辆中的车载计算平台、车载控制器、车机等这样的终端装置 或车载设备,也可以是能够被设置在车辆或车载设备中的计算机系统中的系统芯片、决策处理芯片或其他类型的芯片等。
第一方面,本申请实施例提供一种提示方法,该方法包括:检测到第一事件,所述第一事件包括用于指示车辆状态的事件;如果车载系统处于过载状态,控制第一装置输出第一提示信息,所述第一提示信息用于向用户提示所述第一事件;其中,所述第一装置包括车载提示装置和/或非车载提示装置。
在本申请实施例中,车载系统可即IVI系统。相应的,车载系统处于过载状态可以理解为IVI系统的内存资源或计算资源不足,或者IVI系统并行处理的任务较多,导致IVI系统负荷过高的状态。应理解,IVI系统处于过载状态时,会出现图像显示卡顿或无法显示、语音播放卡顿或无法播出、振动信息输出不畅或无法输出、或者灯光信息无法输出中的至少一种情况。通过本申请实施例的提供的方法,即使IVI系统处于过载状态,也可以即时、不中断地输出第一事件对应的第一提示信息,使得用户可以及时获知第一事件,从而有效提升用户的驾驶体验和车辆驾驶的安全性。
在本申请实施例中,第一事件包括用于指示车辆状态的事件。在一些可能的实施例中,车辆状态可以包括车辆的驾驶状态,对于驾驶自动化分级标准为L3级及以上的车辆,上述驾驶状态可以包括自动驾驶状态、待用户接管状态或用户接管状态中的至少一种。其中,自动驾驶状态可以理解为车辆在智能驾驶系统的控制下,自动行驶的状态;待用户接管状态可以理解为当前车辆需要用户进行控制的状态;用户接管状态可以理解为车辆在智能驾驶系统和用户的控制下,进行行驶的状态。因此,第一事件例如可以是车辆的驾驶状态由自动驾驶状态切换为待用户接管状态,需要提醒用户接管车辆。
在本申请实施例提供的方法中,检测到第一事件,即使车载系统处于过载状态,仍然可以控制第一装置输出第一提示信息,该第一提示信息可以用于向用户提示第一事件,使得用户可以及时获知车辆状态并处理各种突发事件,从而有效提升用户的驾驶体验及车辆行驶的安全性。
在一种可能的设计中,如果车载系统处于过载状态,控制所述第一装置输出第一提示信息,包括:如果所述过载状态指示车载系统停止播放语音,控制所述第一装置输出所述第一事件对应的第一语音信息,所述第一语音信息为预先存储的语音信息。在本申请实施例中,“车载系统停止播放语音”可以理解IVI系统中的语音系统处于死机或无响应状态。如此,在该设计中,车载系统停止播放语音时,通过将第一事件对应的预先存储的语音信息作为第一提示信息输出,省略了语音系统的语音处理流程(例如语音解码、重采样、或混音等流程),使得第一提示信息可以及时输出,从而使得用户可以及时获知第一事件。
在一种可能的设计中,如果车载系统处于过载状态,控制所述第一装置输出第一提示信息,包括:如果过载状态指示车载系统显示图像卡顿,根据第一事件对应的候选图像所在的图层以及承载候选图像的背景图像所在的图层,控制所述第一装置输出第一提示信息;其中,显示图像卡顿是指显示一帧图像所用的时长大于第一预设时长。在本申请实施例中,“车载系统显示图像卡顿”可以理解用于IVI系统中的图像系统的内存资源不足,导致图像系统显示一帧图像所用的时长大于第一预设时长(即图像显示的时延较大)。“第一事件对应的候选图像”即第一提示信息对应的候选图像。在该设计中,在车载系统显示图像卡顿时,可以根据第一事件对应的候选图像所在的图层以及承载候选图像的背景图像所在的图层,控制所述第一装置输出第一提示信息,使得用户可以及时获知第一事件。
在一种可能的设计中,上述根据候选图像所在的图层以及承载候选图像的背景图像所在的图层,输出第一提示信息,可以包括但不限于以下情况:
情况1,如果候选图像所在的图层和背景图像所在的图层为不同的图层,则调整背景图像所在的图层的参数,并基于调整后的参数,控制第一装置在所述背景图像所在的图层显示背景图像。
可选的,背景图像所在的图层的参数可以包括但不限于以下至少一项:绘制速率,显示速率,或,刷新频率。
在情况1中,通过调整背景图像所在的图层的参数,以及控制所述第一装置基于该调整后的参数,在背景图像所在的图层显示背景图像。如此,在车载系统的内存资源有限的情况下,通过降低背景图像所在的图层对内存资源的需求,可以使得车载系统有足够的内存资源来确保将候选图像显示出来,从而使得用户可以及时获知第一事件。
情况2,所述候选图像所在的图层和所述背景图像所在的图层为同一个图层(第二图层),则新建第三图层,并控制所述第一装置在第三图层显示候选图像。
在情况2中,通过在新建的第三图层显示候选图像(即第一提示信息),使得候选图像可以被显示出来,从而使得用户可以感知到第一事件。
可以理解的是,在控制所述第一装置第三图层显示候选图像所用的第三图层的参数可以是默认的参数或者调整后的参数。相应的,第三图层调整后的参数可以包括但不限于以下至少一项:绘制速率,合成速率,显示速率,刷新频率,或,第三图层和第二图层之间的堆叠顺序。
在一种可能的设计中,如果车载系统处于过载状态,控制所述第一装置输出第一提示信息,包括:如果所述过载状态指示车载系统停止显示图像,控制所述第一装置在第四图层显示第一事件对应的候选图像,其中第四图层承载了候选图像的信息。在本申请实施例中,“车载系统停止显示图像”可以理解IVI系统中的图像系统的内存资源不足,导致图像系统无法显示图像的状态。在该设计中,车载系统停止显示图像时,通过将第一事件对应的预先存储的第四图层作为第一提示信息输出,可以省略图像系统的图像处理流程(例如绘制过程和/或合成过程),使得第一提示信息可以及时输出,从而使得用户可以及时获知第一事件。
在一种可能的设计中,如果车载系统处于过载状态,控制所述第一装置输出第一提示信息,包括:如果过载状态指示车载系统停止输出振动信息,基于第一振动指令,控制所述第一装置输出第一振动信息,第一振动指令为预先存储的振动指令。本申请实施例中,“车载系统停止输出振动信息”可以理解为车载系统中用于控制振动组件的内存资源不足,导致振动组件无法输出振动信息的状态。在该设计中,在车载系统停止输出振动信息时,可以基于预先存储的第一振动指令控制相应的振动组件输出第一振动信息,使得用户可以及时获知第一事件。
在一种可能的设计中,如果车载系统处于过载状态,控制所述第一装置输出第一提示信息,包括:如果上述过载状态指示车载系统显示图像卡顿或停止显示图像,控制所述第一装置输出第二振动信息、第二语音信息或光电信息中的一种或多种。相应的,如果过载状态指示车载系统停止输出语音信息,控制所述第一装置输出第二振动信息、第二图像信息或光电信息中的一种或多种。相应的,如果过载状态指示车载系统停止输出振动信息,控制所述第一装置输出第二语音信息、第二图像信息或光电信息中的一种或多种。在该设 计中,在车载系统的当前提示方式无法实现时,可以通过车载系统的其他提示方式输出第一事件对应的第一提示信息,可以有效提升用户感知到第一事件的概率。
在一种可能的设计中,如果车载系统处于过载状态,控制所述第一装置输出第一提示信息,包括:根据第一事件和映射关系确定一个或多个提示方式,该映射关系为第一事件与预设提示方式之间的对应关系;根据车载系统当前的过载状态从一个或多个提示方式中确定第一提示方式,并控制所述第一装置输出第一提示方式对应的第一提示信息。在该设计中,可以根据第一事件与预设提示方式之间的对应关系、以及车载系统的过载状态,确定第一事件的第一提示方式,控制所述第一装置输出第一提示方式对应的第一提示信息。如此,使得第一事件的提示方式更加符合车载系统的状态,从而进一步提升输出第一事件对应的第一提示信息的及时性,以便于用户及时获知第一事件。
在一种可能的设计中,所述方法还包括:获取第一事件的历史提示方式;基于历史提示方式,对映射关系进行更新。在该设计中,可以基于第一事件的历史提示方式,对上述映射关系进行动态更新,使得该映射关系更加完善。
在一种可能的设计中,所述第一装置为非车载提示装置时,在控制第一装置输出第一提示信息之前,所述方法还包括:向所述第一装置发送所述第一提示信息。在本申请实施例中,非车载提示装置可以包括手机、平板电脑、或智能穿戴设备等,本申请实施例不作具体的限制。在该设计中,通过将第一提示信息发送给非车载提示装置,使得非车载提示装置可以输出第一提示信息,从而进一步提升用户感知到第一事件的概率。
第二方面,本申请实施例还提供了一种提示装置,所述提示装置包括执行上述第一方面、以及第一方面的任意一种可能的设计的方法的模块/单元;这些模块/单元可以通过硬件实现,也可以通过硬件执行相应的软件实现。
示例性的,该提示装置包括:
第一处理模块,用于检测第一事件,所述第一事件包括用于指示车辆状态的事件;
第二处理模块,用于在第一处理模块检测到第一事件时,且车载系统处于过载状态时,控制第一装置输出第一提示信息,所述第一提示信息用于提示所述第一事件;其中,所述第一装置包括车载提示装置和/或非车载提示装置。
在一种可能的设计中,第二处理模块具体用于:在所述过载状态指示所述车载系统停止播放语音时,控制所述第一装置输出所述第一事件对应的第一语音信息,所述第一语音信息为预先存储的语音信息。
在一种可能的设计中,第二处理模块具体用于:在所述过载状态指示所述车载系统显示图像卡顿时,根据所述第一事件对应的候选图像所在的图层以及承载所述候选图像的背景图像所在的图层,控制所述第一装置输出所述第一提示信息;其中,所述显示图像卡顿是指显示一帧图像所用的时长大于第一预设时长。
在一种可能的设计中,第二处理模块根据候选图像所在的图层以及承载所述候选图像的背景图像所在的图层,控制所述第一装置输出所述第一提示信息,包括但不限于以下情况:
情况1,如果候选图像所在的图层和背景图像所在的图层为不同的图层,处理模块还用于调整背景图像所在的图层的参数,第二处理模块基于调整后的参数,控制第一装置在背景图像所在的图层显示所述背景图像。
情况2,如果候选图像所在的图层和背景图像所在的图层为同一个图层,处理模块还 用于新建第三图层,第二处理模块还用于控制第一装置在所述第三图层显示所述候选图像。
在一种可能的设计中,背景图像所在的图层的参数可以包括但不限于以下至少一项:绘制速率,合成速率,显示速率,或刷新频率。
在一种可能的设计中,在过载状态指示所述车载系统停止显示图像时,第二处理模块还可以控制第一装置在第四图层显示所述第一事件对应的候选图像,第四图层承载了所述候选图像的信息。
在一种可能的设计中,在所述过载状态指示所述车载系统停止输出振动信息时,第二处理模块可以基于第一振动指令,控制所述第一装置输出第一振动信息,所述第一振动指令为预先存储的振动指令。
在一种可能的设计中,在过载状态指示所述车载系统显示图像卡顿或停止显示图像时,第二处理模块可以控制所述第一装置输出第二振动信息、第二语音信息或光电信息中的一种或多种。相应的,在所述过载状态指示所述车载系统停止输出语音信息,第二处理模块可以控制所述第一装置输出第二振动信息、第二图像信息或光电信息中的一种或多种。相应的,在如果所述过载状态指示所述车载系统停止输出振动信息,第二处理模块可以控制所述第一装置输出第二语音信息、第二图像信息或光电信息中的一种或多种。
在一种可能的设计中,第一处理模块还用于根据所述第一事件和映射关系确定一个或多个提示方式,所述映射关系为所述第一事件与预设提示方式之间的对应关系;以及根据车载系统当前的过载状态从所述一个或多个提示方式中确定第一提示方式;第二处理模块可以用于控制所述第一装置输出所述第一提示方式对应的所述第一提示信息。
在一种可能的设计中,第一处理模块还用于:获取所述第一事件的历史提示方式;基于所述历史提示方式,对所述映射关系进行更新。
在一种可能的设计中,所述提示装置还包括通信模块,所述第一装置为非车载提示装置时,在第二处理模块控制第一装置输出第一提示信息之前,所述通信模块用于向所述第一装置发送所述第一提示信息。
第三方面,本申请实施例还提供了一种车辆,包括第二方面以及第二方面任一可能的设计中所述的装置,用以实现上述第一方面或第一方面的任一种可能的设计中的方法。
第四方面,本申请提供一种计算设备,包括处理器,处理器与存储器相连,存储器存储计算机程序或指令,处理器用于执行存储器中存储的计算机程序或指令,以使得计算设备执行上述第一方面以及第一方面的任一种可能的设计中所述的方法。
第五方面,本申请提供一种计算机可读存储介质,其上存储有计算机程序或指令,当该计算机程序或指令被执行时,使得计算机执行上述第一方面以及第一方面的任一种可能的设计中所述的方法。
第六方面,本申请提供一种计算机程序产品,当计算机执行计算机程序产品时,使得计算机执行上述第一方面以及第一方面的任一种可能的设计中所述的方法。
第七方面,本申请提供一种芯片,芯片与存储器相连,用于读取并执行存储器中存储的计算机程序或指令,以实现上述第一方面以及第一方面的任一种可能的设计中所述的方法。
对于,第二方面至第七方面的有益效果,请参见第一方面中的相应描述,这里不再赘述。
附图说明
图1A示例性示出本申请实施例适用的一种可能的场景的示意图;
图1B示例性示出本申请实施例提供的一种可能的第一提示信息的示意图;
图2示例性示出本申请实施例提供的一种提示方法的流程示意图;
图3示例性示出本申请实施例提供的第一提示信息的示意图之一;
图4示例性示出本申请实施例提供的第一提示信息的示意图之二;
图5示例性示出本申请实施例提供的第一提示信息的示意图之三;
图6示例性示出本申请实施例提供的第一提示信息的示意图之四;
图7示例性示出本申请实施例提供的映射关系的示意图之一;
图8示例性示出本申请实施例提供的映射关系的示意图之二;
图9示例性示出本申请实施例适用的另一种可能的场景的示意图;
图10示例性示出本申请实施例提供的提示方式的示意图;
图11为本申请实施例提供的一种控制装置的结构示意图;
图12为本申请实施例提供的一种芯片系统的结构示意图。
具体实施方式
下面将结合附图,对本申请实施例进行详细描述。
本申请提供一种提示方法、装置以及车辆。其中,本申请中的提示装置可用于实现本申请实施例提供的提示方法。以及,在一些可能的实施例中,该提示方法可应用于车辆或车载部件或车载芯片。该方法包括:检测到第一事件,该第一事件包括用于指示车辆状态的事件;如果车载系统处于过载状态,控制第一装置输出第一提示信息,该第一提示信息用于向用户提示所述第一事件;其中,所述第一装置包括车载提示装置和/或非车载提示装置。在该方法中,若检测到用于指示车辆状态的第一事件,且车载系统处于过载状态时,可以控制第一装置输出用于提示第一事件的第一提示信息,便于用户及时获知第一事件并进行相应处理,有效提升用户的驾驶体验及车辆行驶的安全性。
可以理解的是,方法和装置是基于同一技术构思的,由于方法及装置解决问题的原理相似,因此装置与方法的实施可以相互参见,重复之处不再赘述。
业界关于自动驾驶汽车提出了分级标准,其中,国际自动机工程师学会(society of automotive engineers international,SAE International)提出的驾驶自动化分级标准包括L0-L5等六个级别。其中,对于驾驶自动化分级为L1-L2级的车辆,驾驶员支持系统能够为驾驶员提供一些支持功能,但是无论车辆的驾驶员支持功能是否已经开启,驾驶员都必须自己驾驶车辆,并且驾驶员需要时刻监督驾驶员支持系统提供的这些支持功能,以及驾驶员需要根据车辆的驾驶情况,控制车辆进行转向、制动、或加速中的任一项,以保证车辆行驶的安全。L0-L2级的支持功能的区别在于:L0级的支持功能仅限于提供警告和瞬时协助,L1级的支持功能为转向、制动或加速中的至少一项,L2级的支持功能为转向、制动、加速、全速自适应巡航、主动车道保持、或限速识别中的至少一项。驾驶自动化分级为L3级的车辆可以实现半自动驾驶,该车辆的自动驾驶系统既能完成某些驾驶任务,也能在某些情况下监控驾驶环境,但驾驶员需要随时准备重新取得驾驶控制权,例如当车辆的驾驶状态由自动驾驶状态切换为待用户接管状态时,驾驶员必须驾驶车辆。驾驶自动化分级为 L4级的车辆可以实现高度自动驾驶,该车辆的自动驾驶系统在某些环境和特定条件下,能够完成驾驶任务并监控驾驶环境。驾驶自动化分级为L5级的车辆可以实现完全自动驾驶,该车辆的自动驾驶系统在所有条件下都能完成的所有驾驶任务。
在一些实施例中,本申请实施例提供的方案用于提示车辆的路线规划信息或者告警信息时,则本申请实施例的方案可以适用于驾驶自动化分级为L0-L5级的车辆。在另一些实施例中,本申请实施例提供的方案用于提示车辆从自动驾驶状态切换为请求用户接管的状态时,则本申请实施例的方案可以适用于驾驶自动化分级为L2级及以上级别的车辆,后文不再赘述。
此外,应理解,本申请实施例的技术方案也可以应用其他需要输出提示信息的设备中,例如,飞行器、移动机器人等其他载具或交通工具,本申请实施例不作具体的限制。
首先,对本申请中的部分用语进行解释说明,以便于本领域技术人员理解。
1)车载系统,是基于车身总线系统和互联网服务而形成的车载综合信息处理系统,也可以称作车载信息娱乐(in-vehicle infotainment,IVI)系统。IVI系统可以实现信息显示(例如,显示导航信息、实时路况、车辆状态等)、人机交互、辅助驾驶、故障检测、车身控制、无线通讯、或在线娱乐功能中的一项或多项应用,极大的提升了车辆的电子化、网络化和智能化水平。在一些可能的实施例中,IVI系统可以包括图像系统、语音系统、振动管理系统或灯光控制系统中的至少一种。在一些可能的实施例中,IVI系统可以用于输出与第一事件对应的第一提示信息。
2)第一事件,可以包括用于指示车辆状态的事件。在一些可能的实施例中,车辆状态可以包括车辆的驾驶状态,对于驾驶自动化分级标准为L3级及以上的车辆,上述驾驶状态可以包括自动驾驶状态、待用户接管状态或用户接管状态中的至少一种。其中,自动驾驶状态可以理解为车辆在智能驾驶系统的控制下,自动进行行驶的状态;待用户接管状态可以理解为当前车辆需要用户进行控制的状态;用户接管状态可以理解为车辆在智能驾驶系统和用户的控制下,进行行驶的状态。因此,第一事件例如可以是车辆的驾驶状态由自动驾驶状态切换为待用户接管状态,需要提醒用户接管车辆。
在另一些可能的实施例中,对于驾驶自动化分级为L0-L5级的车辆,第一事件可以是车辆与其当前行驶的道路中的故障物存在碰撞风险,需要提醒用户减速行驶。又例如,第一事件可以是车辆从高速下匝道,需要提示用户注意不要错过匝道口。
在另一些可能的实施例中,第一事件还可以包括用于指示车载系统的可靠性降低的事件。例如,第一事件可以是车载系统自身的提示功能失效,需要通过其他设备提醒用户车辆状态。
3)第一提示信息,可以理解为用于向用户提示第一事件的提示信息。应理解,第一提示信息可以包括但不限于图像信息、语音信息、振动信息或光电信息中的至少一种。其中,图像信息可以包括文字信息和/或图标信息,语音信息可以包括铃声信息和/或语音词条信息,振动信息可以包括振动组件的标识和振动频率,光电信息可以包括灯光信息。
4)过载状态,可以理解为IVI系统的内存资源或计算资源不足,或者IVI系统并行处理的任务较多,导致IVI系统负荷过高的状态。应理解,IVI系统处于过载状态时,会出现以下至少一种情况:显示图像卡顿、无法显示图像、播放语音卡顿、无法播出语音、无法输出振动信息、或者无法输出灯光信息。通过本申请实施例的提供的方法,即使IVI系 统处于过载状态,也可以即时、不中断地输出第一事件对应的第一提示信息,使得用户可以及时获知第一事件,从而有效提升用户的驾驶体验和车辆驾驶的安全性。
下面结合附图对本申请实施例适用的应用场景进行介绍。
图1A示出了本申请实施例适用的一种场景示意图。在该场景中,车辆100包括控制设备101、车载提示设备102和车载感知设备103。可以理解的是,控制设备101、车载提示设备102和车载感知设备103可以是车载系统的子部分。
需要说明的是,车辆100适用的电子电气架构(electrical/electronic architecture,EEA)可以是分布式ECU架构、域控制器EEA或中央集中式EEA中的任一种。控制设备101在不同电子电气架构中有不同的实现,下面针对不同的电子电气架构进行说明。
架构一、分布式ECU架构。
在分布式ECU架构中,车辆的每个功能由特定的电子控制单元(electronic control unit,ECU)进行控制;相应的,若车辆100的电子电气架构为分布式ECU架构,控制设备101可以为用于控制车载提示设备102的ECU。
架构二、域控制器EEA。
在域控制器EEA中,一些厂商基于不同的域划分对车载控制器的功能进行集成,进而将车载控制器划分为智能驾驶域控制器、动力域控制器、底盘域控制器、车身域控制器和座舱域控制器;另一些厂商将动力域、底盘域和车身域进一步融合为整车控制域,进而将车载控制器划分为整车域控制器、智能驾驶域控制器和智能座舱域控制器;以及,另一些厂商将智能座舱域与智能驾驶域融合,通过单颗车载芯片实现智能驾驶以及对智能座舱的控制。
其中,智能驾驶域控制器通常需要连接车载感知设备103,对车载感知设备103感知到的信息(例如路面信息)进行处理,进行目标定位、路径规划、决策控制、或无线通讯。动力域控制器可以为车辆提供动力来源,实现驱动车辆行驶的目的。底盘域控制器用于控制车辆的制动、转向、或悬架等功能。车身域控制器可以用于控制车头的部分(如前车指示灯)、车中间的部分(如车门、车窗等)和车尾部的部分(如后刹车灯、后位置灯、尾门锁、甚至双撑杆)。智能座舱域控制器可以用于控制与其关联的部件,其关联的部件例如可以是智能座椅、抬头显示(head up display,HUD)、仪表盘(cockpit)和IVI系统中的至少一项。整车域控制器可以采集加速踏板信号、制动踏板信号及其他部件信号,并做出相应判断后,进行驱动力矩控制、制动能量的优化控制、整车的能量管理、控制器局域网络(controller area network,CAN)的维护和管理、故障的诊断和处理、或车辆状态监视中的至少一项。
相应的,若车辆100的电子电气架构为域控制器EEA,控制设备101可以为智能座舱域控制器,或者控制设备101可以为车载芯片,该车载芯片集成了智能驾驶域控制器和智能座舱域控制器的功能。
架构三、中央集中式EEA。
在中央集中式EEA中,设置了车载计算平台,该车载计算平台可以实现对智能驾驶域、智能座舱域、车身域、动力域和底盘域的相关部件的控制。相应的,若车辆100的电子电气架构为中央集中式EEA,控制设备101可以为车载计算平台。
其中,车载提示设备102是用于输出提示信息的车载设备。例如,车载提示设备102 可以输出第一提示信息,该第一提示信息用于向用户提示第一事件。应理解,车载提示设备102可以是一个或多个车载设备,例如可以是车载音箱、车载显示屏(也称作“车载中控屏”)、车载提示灯、HUD、车载座椅、或方向盘中的至少一种。
其中,车载感知设备103可以用于获取车辆100当前行驶的道路的信息。道路的信息例如可以是道路参数、道路上的基建设施或道路上的障碍物对应的图像信息、道路上的障碍物与车辆100的距离信息、或者道路对应的天气信息中的至少一项。其中,车载感知设备103可以是摄像头、激光雷达、或毫米波雷达中的至少一项。
在一种可能的实施方式中,若控制设备101为集成了智能驾驶域控制器功能和智能座舱域控制器功能的车载芯片,车载感知设备103获取车辆100当前行驶的道路的信息,并将该道路的信息发送至控制设备101;进而控制设备101可以对该道路的信息进行处理,若控制设备101发现车辆100当前行驶道路中的障碍物与车辆100存在碰撞的风险,则控制设备101控制车辆100切换驾驶状态(例如从自动驾驶状态切换为待用户接管状态)。在控制设备101控制车辆100切换驾驶状态之后,控制设备101检测到车辆100的驾驶状态从自动驾驶状态切换为待用户接管状态,需要提醒用户接管车辆,即控制设备101检测到第一事件,此时如果车载系统处于过载状态,可以控制车载提示设备102输出第一提示信息,该第一提示信息用于向用户提示所述第一事件。例如,如图1B所示,车载提示设备102以车载中控屏为例,控制设备101可以控制车载中控屏显示第一提示信息“请接管”。如此,使得用户可以及时获知第一事件,便于用户进行相应的处理,从而有效提升用户的驾驶体验和用户用车的安全性。
在另一种可能的实施方式中,若控制设备101为智能座舱域控制器,车载感知设备103获取车辆100当前行驶的道路的信息,并将该道路的信息发送至智能驾驶域控制器;进而智能驾驶域控制器对该道路的信息进行处理,若智能驾驶域控制器发现车辆100当前行驶道路中的障碍物与车辆100存在碰撞的风险,则智能驾驶域控制器将车辆100的驾驶状态从自动驾驶状态切换为待用户接管状态。在智能驾驶域控制器控制车辆100切换驾驶状态之后,控制设备101检测到车辆100的驾驶状态从自动驾驶状态切换为待用户接管状态,需要提醒用户接管车辆,即控制设备101检测到第一事件,此时如果车载系统处于过载状态,可以控制车载提示设备102输出第一提示信息,该第一提示信息用于向用户提示所述第一事件。如此,使得用户可以及时获知第一事件,便于用户进行相应的处理,从而有效提升用户的驾驶体验和用户用车的安全性。
可选的,控制设备101检测到第一事件,此时如果车载系统处于过载状态,控制设备101还可以向至少一个设备200发送第一提示信息,进而可以通过至少一个设备200输出第一提示信息,有效提升用户获知第一事件的概率。其中,至少一个设备200是设置于车辆100之外的非车载提示装置(例如,手机、耳机、或可穿戴设备等中的至少一个)。
下面结合具体的附图对本申请实施例提供的技术方案进行说明。
请参见图2,图2示出了本申请实施例提供的一种提示方法的流程示意图,该方法可以应用于图1A所示的应用场景中。需要说明的是,在下文中,控制设备101是以集成了智能驾驶域控制器功能和智能座舱域控制器功能的车载芯片为例,对图2所示的技术方案进行描述。该方法包括:
S201、控制设备101检测到第一事件。
由前文的描述可知,第一事件,可以包括用于指示车辆状态的事件。
在一些可能的实施例中,上述车辆状态可以包括车辆的驾驶状态,对于驾驶自动化分级标准为L3级及以上的车辆,上述驾驶状态可以包括自动驾驶状态、待用户接管状态或用户接管状态中的至少一种。其中,自动驾驶状态可以理解为车辆在智能驾驶系统的控制下,自动进行行驶的状态;待用户接管状态可以理解为当前车辆需要用户进行控制的状态;用户接管状态可以理解为车辆在智能驾驶系统和用户的控制下,进行行驶的状态。因此,第一事件例如可以是车辆的驾驶状态由自动驾驶状态切换为待用户接管状态,需要提醒用户接管车辆。相应的,在该实施例中,车载感知设备103获取车辆100当前行驶的道路的信息,并将该道路的信息发送至控制设备101,控制设备101对该道路的信息进行处理,若控制设备101发现车辆100与该道路中的障碍物存在碰撞的风险,则控制设备101控制车辆100的驾驶状态由自动驾驶状态切换为待用户接管状态;控制设备101检测到车辆100的驾驶状态由自动驾驶状态切换为待用户接管状态,需要提醒用户接管车辆,即控制设备101检测到第一事件。
在另一些可能的实施例中,对于驾驶自动化分级为L0-L5级的车辆,第一事件可以是车辆与其当前行驶的道路中的故障物存在碰撞风险,需要提醒用户减速行驶。又例如,第一事件可以是车辆即将从高速下匝道,需要提示用户注意不要错过匝道口。相应的,在该实施例中,车载感知设备103获取车辆100当前行驶的道路的信息,并将该道路的信息发送至控制设备101,控制设备101对该道路的信息进行处理,控制设备101确定车辆100当前行驶的道路中的障碍物与车辆100存在碰撞的风险,需要提醒用户减速行驶,即控制设备101检测到第一事件。或者,车载感知设备103获取车辆100当前行驶的道路的信息,并将该道路的信息发送至控制设备101;控制设备101对该道路的信息进行处理,控制设备101确定车辆100即将从高速下匝道,需要提示用户注意不要错过匝道口,即控制设备101检测到第一事件。
在另一些可能的实施例中,第一事件还可以包括用于指示车载系统的可靠性降低的事件。例如,第一事件可以是车载系统自身的提示功能失效,需要通过其他设备提醒用户车辆状态。相应的,在该实施例中,控制设备101检测到车载系统的提示功能失效(例如,车载中控屏黑屏),需要通过其他设备提醒用户车辆状态,即控制设备101检测到第一事件。
在一种可能的实施方式中,控制设备101检测到第一事件之后,控制设备101还可以获取车载系统的负载状态和/或第二事件对应的提示信息的输出情况,并根据车载系统的负载状态和/或第二事件对应的提示信息的输出情况,确定车载系统是否处于过载状态。
本申请实施例中,“第二事件对应的提示信息”可以理解车载系统当前待输出的提示信息。相应的,控制设备101可以根据第二事件对应的提示信息的输出时长和/或输出结果,来确定第二事件的提示信息的输出情况。
由前文描述可知,车载系统可以包括图像系统、语音系统、振动管理系统或灯光控制系统中的至少一种。以及,控制设备101是车载系统的子部分,且控制设备101可以是车载系统中的车载芯片。因此,控制设备101可以根据车载系统的车载芯片、图像系统(display sub system,DSS)、语音系统、振动管理系统、或灯光控制系统的资源使用率和/或调度情况,确定车载系统的负载状态。其中,车载芯片包括但不限于车载系统的中央处理器(central processing unit,CPU)、图像处理器(graphic processing unit,GPU)、现场可编程门阵列(field  programmable gate array,FPGA)、特殊应用集成电路(application specific integrated circuit,ASIC)、或片上系统(system on a chip,SoC)中的至少一种。
在一些可能的实施例中,控制设备101为车载系统中的车载芯片,控制设备101在检测到其自身的内存资源或计算资源的资源使用率大于90%,则确定车载系统处于过载状态。
在另一些可能的实施例中,车载系统包括图像系统和语音系统,控制设备101检测到图像系统和语音系统的内存资源或计算资源的资源使用率大于90%,则确定车载系统处于过载状态。
在另一些可能的实施例中,车载系统包括振动管理系统和灯光控制系统,控制设备101检测到振动管理系统关联的振动组件和/或灯光控制系统关联的灯光装置已被完全调度,则确定车载系统处于过载状态。
在另一些可能的实施例中,车载系统包括图像系统、语音系统、振动管理系统和灯光控制系统,若控制设备101检测到车载系统的图像系统和语音系统的内存资源或计算资源的资源使用率大于90%,以及检测到振动管理系统关联的振动组件和/或灯光控制系统关联的灯光装置已被完全调度,则确定车载系统处于过载状态。
在另一些可能的实施例中,控制设备101检测到车载系统输出第二事件的提示信息所用的时长大于第一预设时长,或者,控制设备101检测到车载系统在第二预设时长内未输出第二事件的提示信息,则确定车载系统处于过载状态。
在另一些可能的实施例中,控制设备101为车载系统中的车载芯片,控制设备101检测到其自身的内存资源或计算资源的资源使用率大于80%,以及控制设备101检测到车载系统在第二预设时长内未输出第二事件的提示信息,则确定车载系统处于过载状态。
S202、如果车载系统处于过载状态,控制设备101控制第一装置输出第一提示信息。
在本申请实施例中,第一提示信息用于向用户提示第一事件。可选的,第一提示信息可以包括但不限于图像信息、语音信息、振动信息或光电信息中的至少一种。其中,图像信息可以包括文字信息和/或图标信息,语音信息可以包括铃声信息和/或语言信息,振动信息可以包括振动组件的标识和振动频率,光电信息可以包括灯光信息。
在本申请实施例中,第一装置可以包括车载提示装置和/或非车载提示装置。请继续参见图1A,车载提示装置即图1A中的车载提示设备102,非车载提示装置即图1A中的至少一个设备200。关于车载提示设备102的具体实现,请参见前文的具体描述,这里不再赘述。至少一个设备200可以包括但不限于语音装置、光电装置、或显示装置中的至少一个。至少一个设备200例如可以是平板电脑、笔记本电脑、掌上电脑、耳机、音响、可穿戴设备(如智能手表,智能手环,计步器等)、虚拟现实(virtual reality,VR)设备、或手机中的至少一个。
由前文的描述可知,车载系统即IVI系统。相应的,“车载系统处于过载状态”可以理解为IVI系统的内存资源或计算资源不足或者IVI系统并行处理的任务较多导致其负载过高的状态。以及,IVI系统可以包括但不限于图像系统、语音系统、振动管理系统或灯光控制系统中的至少一种。相应的,IVI系统处于过载状态时,IVI系统的具体表现可以为以下至少一种情况:显示图像卡顿、无法显示图像、播放语音卡顿、无法播出语音、无法输出振动信息、或者无法输出灯光信息。
在一种可能的实施例中,若第一装置为HUD,在IVI系统的显示图像卡顿时,控制设备101确定IVI系统处于过载状态,则控制设备101控制HUD显示与第一事件相对应的 第一提示信息。
在另一种可能的实施例中,若第一装置为手机,在IVI系统无法播出语音时,控制设备101确定IVI系统处于过载状态,则控制设备101将与第一事件相对应的第一提示信息发送至手机,通过手机显示该第一提示信息。
在图2所示的技术方案中,控制设备101检测到第一事件,即使车载系统处于过载状态,仍然可以控制第一装置输出第一提示信息,以通过该第一提示信息向用户提示第一事件,使得用户可以即时、不中断地获知车辆状态并处理各种突发事件,从而有效提升用户的驾驶体验及车辆行驶的安全性。
需要说明的是,本申请实施例中,在车载系统处于过载状态时,控制设备101控制第一装置输出第一提示信息,包括但不限于以下实现情形:
情形一、车载系统的过载状态指示车载系统关联的第一交互子系统处于过载状态,控制设备101可以对该第一交互子系统的提示流程进行调整,基于调整后的提示流程控制第一装置输出第一提示信息。在情形一中,可以保证第一提示信息及时、不中断地被输出,便于用户获知第一事件。
其中,情形一包括但不限于以下实施例:
在一些可能的实施例中,第一交互子系统以车载系统中的语音系统为例,如果上述车载系统的过载状态指示语音系统停止播放语音或者播放语音卡顿,控制设备101可以控制第一装置输出与第一事件对应的第一语音信息(即第一提示信息)。其中,第一语音信息为预先存储的语音信息。因此,在语音系统停止播放语音或者播放语音卡顿时,通过控制第一装置将第一事件对应的预先存储的第一语音信息输出,省略了语音处理流程(例如语音解码、重采样、或混音等),使得用户可以及时获知第一事件。
在一个可能的实施例中,第一语音信息预先存储在第一装置的内存中,且第一事件对应的第一语音信息可以包括语音词条信息和/或铃声信息。第一装置以车载音响为例,第一语音信息预先存储在车载音响的内存中,控制设备101检测到第一事件,可以控制车载音响直接从其内存中获取语音词条信息和/或铃声信息,并输出该语音词条信息和/或铃声信息。
在另一个可能的实施例中,第一语音信息预先存储于控制设备101中,且第一事件对应的第一语音信息可以包括语音词条信息和/或铃声信息。第一装置以车载音响为例,第一语音信息预先存储在控制设备101中,控制设备101检测到第一事件,向车载音响发送该语音信息词条和/或铃声信息,以使车载音响输出该语音词条信息和/或该铃声信息。
在另一些可能的实施例中,第一交互子系统以图像系统为例,如果上述车载系统的过载状态指示图像系统显示图像卡顿,控制设备101可以根据第一事件对应的候选图像所在的图层以及承载候选图像的背景图像所在的图层,控制第一装置输出第一提示信息。如此,在图像系统显示图像卡顿时,控制设备101可以根据第一事件对应的候选图像所在的图层以及承载候选图像的背景图像所在的图层,控制第一装置输出第一提示信息,使得第一提示信息可以正常输出,从而使得用户可以及时获知第一事件。
在本申请实施例中,“候选图像”可以理解为第一事件对应的第一提示信息对应的预设图像信息,“承载候选图像的背景图像”可以理解为图像系统在显示候选图像时所用的 背景图像。可选的,该候选图像可以是静态图像或者是动态图像。在一些可能的实施例中,该承载候选图像的背景图像可以是车辆的导航信息对应的图像信息或者默认的背景信息。以及,“图像系统显示图像卡顿”可以理解为图像系统显示一帧图像所用的时长大于第一预设时长。例如,第一预设时长以100ms为例,如果图像系统显示一帧图像所用的时长大于100ms,则认为图像系统显示图像卡顿。
需要说明的是,该背景图像可以与候选图像在不同图层或相同图层,以下对这两种情况分别进行介绍。
情况1,如果候选图像所在的图层和背景图像所在的图层为不同的图层,控制设备101可以调整该背景图像所在图层的参数,并控制第一装置基于调整后的参数在背景图像所在的图层显示背景图像,以及控制第一装置在候选图像所在的图层显示候选图像。如此,使得图像系统的内存资源紧张时,降低背景图像对内存资源的需求,从而使得图像系统具备足够的资源来确保第一事件对应的候选图像(即第一提示信息)可以被显示出来,从而使得用户可以及时获知第一事件。
可选的,控制设备101调整的背景图像所在图层的参数可以包括但不限于以下至少一项:绘制速率,显示速率或刷新频率。其中,该绘制速率是指控制设备101绘制背景图像所在的图层的速率;该显示速率是指控制设备101设定的图像系统显示背景图像所在的图层的速率(例如,该速率可以是图像系统在50ms内显示一次背景图像所在的图层);该刷新频率是指背景图像所在的图层在预设时长内的刷新频率(例如,该刷新频率可以是图像系统在100ms内刷新2帧图像)。
在一个可能的实施例中,控制设备101调整的背景图像所在的图层的参数为第二图层的绘制速率。
如图3所示,上述候选图像所在的图层为第一图层,上述背景图像所在的图层为第二图层。以及,在图3中,图像系统在第一帧图像仅显示背景图像;图像系统在第二帧图像、第三帧图像和第四帧图像中,需显示背景图像和候选图像;且图像系统在显示第二帧图像和第三帧图像时显示卡顿,在显示第四帧图像时显示流畅。
图3中的(a)示出了第一图层和第二图层的绘制过程,如图3中的(a)所示,控制设备101通过降低第二图层的绘制速率,以及保持第一图层的绘制速率;进而在第一装置显示第二帧图像和第三帧图像时,控制设备101可以控制第一装置持续刷新候选图像(即候选图像分别刷新为“a”和“b”),但不刷新背景图像(即背景图像保持为“1”);以及,在第一装置显示第四帧图像时,控制设备101可以控制第一装置将候选图像刷新为“c”,以及将背景图像刷新为“2”。
相应的,图3中的(b)示出了第一图层和第二图层合成之后的显示效果,如图3中的(b)所示,在第一帧图像中仅显示背景图像;在第二帧图像、第三帧图像和第四帧图像中显示候选图像和用于承载候选图像的背景图像,且候选图像在第二帧图像、第三帧图像和第四帧图像中分别刷新为“a”、“b”和“c”,背景图像仅在第四帧图像中刷新为“2”。
如此,在图3中,控制设备101通过降低第二图层的绘制速率,以及保持第一图层的绘制速率,可以有效降低第二图层对内存资源的需求,使得图像系统有足够的内存资源可以保证第一图层可以正常绘制,从而使得在显示第二帧图像、第三帧图像和第四帧图像时,第一装置可以持续刷新候选图像,进而使得候选图像可以及时、不中断地呈现给用户,有助于用户及时、不中断地获知第一事件。
在另一个可能的实施例中,控制设备101调整的背景图像所在的图层的参数为该图层的刷新速率。
如图4所示,候选图像所在的图层为第一图层,背景图像所在的图层为第二图层。以及,在图4中,在第一帧图像中,图像系统仅显示背景图像;在第二帧图像、第三帧图像和第四帧图像中,图像系统需显示背景图像和候选图像;且图像系统在显示第二帧图像和第三帧图像时显示卡顿,在显示第四帧图像时显示流畅。
如图4所示,控制设备101通过降低第二图层的刷新频率,保持第一图层的刷新频率;进而在第一装置显示第二帧图像和第三帧图像时,控制设备101可以控制第一装置持续刷新候选图像(即候选图像分别刷新为“a”和“b”),但不刷新背景图像(即背景图像保持为“1”);以及,在第一装置显示第四帧图像时,控制设备101可以控制第一装置将候选图像刷新为“c”,以及将背景图像刷新为“2”。
如此,控制设备101通过降低第二图层的刷新频率,保持第一图层的刷新频率,可以有效降低第二图层对内存资源的需求,使得图像系统有足够的内存资源可以保证第一图层可以正常刷新,从而使得在显示第二帧图像、第三帧图像和第四帧图像时,第一装置可以持续刷新候选图像,进而使得候选图像可以及时、不中断地呈现给用户,有助于用户及时、不中断地获知第一事件。
情况2,如果上述候选图像和背景图像在同一个图层,控制设备101可以新建第三图层,并控制第一装置在第三图层显示候选图像。需要说明的是,由于候选图像和背景图像在同一个图层,导致该图层对内存资源的较高,而控制设备101新建的第三图层的对内存资源的需求较低,从而图像系统有足够资源可以正常绘制并显示第三图层,进而使得候选图像可以及时、不中断地呈现给用户,有助于用户及时、不中断地获知第一事件。
在一个可能的实施例中,若第一事件为车辆的驾驶状态从自动驾驶状态切换为待用户接管状态,需要提醒用户接管车辆。相应的,与第一事件对应的候选图像为“请接管”,承载候选图像的背景图像为道路信息,候选图像和背景图像均在同一个图层(即图5所示的第二图层)。
如图5所示,图像系统在显示第一帧图像和第二帧图像时显示卡顿,在显示第三帧图像时显示流畅,并且在第一帧图像中,候选图像和背景图像均在第二图层显示。因此,在显示第二帧图像时,控制设备101新建了第三图层,并控制第一装置在第三图层显示候选图像“请接管”,在第二图层显示未刷新的背景图像;以及,在显示第三帧图像时,控制设备101控制第一装置在第三图层显示候选图像“请接管”,在第二图层显示刷新后的背景图像。如此,候选图像“请接管”可以在第三图层及时地被显示出来,便于用户及时、不中断地获知第一事件。
进一步的,在一些可能的实施例中,控制设备101还可以调整第三图层的显示顺序(z-order),以调整第三图层和第二图层的堆叠顺序,使得第三图层在图像的顶层显示,便于用户获知第一事件。
请参见图6,若第一事件为车辆的驾驶状态从自动驾驶状态切换为待用户接管状态,需要提醒用户接管车辆。与第一事件对应的候选图像为“请接管”,背景图像为道路信息;控制设备101控制第一装置在新建的第三图层(即虚线椭圆部分)显示候选图像“请接管”,以及在第二图层显示背景图像。在图6中的(a)中,第三图层的z-order的取值和第二图层的z-order的取值均为0;在图6中的(b)中,控制设备101将第三图层的z-order的取 值调整为1,第二图层的z-order的取值保持为0,使得在第三图层和第二图层之间的堆叠顺序中,第三图层的堆叠顺序为顶层,进而控制设备101可以控制第一装置在图像的顶层显示候选图像。
在另一些可能的实施例中,第一交互子系统以图像系统为例,如果上述车载系统的过载状态指示图像系统停止显示图像,控制设备101可以控制第一装置在第四图层显示第一事件对应的候选图像,其中,第四图层承载了候选图像的信息。应理解,第四图层可以是预先存储在第一装置或者控制设备101中的图层,也可以是控制设备101根据第一装置显示第一事件对应的历史提示信息生成的缓存图层。也就是说,在图像系统停止显示图像时,控制设备101可以控制第一装置直接输出预先存储的第四图层,减少了图像的绘制过程和合成过程,使得候选图像可以更快显示给用户,从而用户可以及时获知第一事件,并进行相应的处理。
在另一些可能的实施例中,第一交互子系统以振动组件为例,如果上述过载状态指示振动组件停止输出振动信息,控制设备101可以基于第一振动指令,控制第一装置输出与第一事件对应的第一振动信息,该第一振动指令为预先存储的振动指令。其中,车载系统中的振动管理系统用于生成振动组件的控制指令。因此,车载系统中的振动管理系统故障时,控制设备101可以向第一装置发送预先存储的第一振动指令,进而第一装置可以基于第一振动指令,输出第一振动信息。如此,即使车载系统中的振动管理系统故障,控制设备101仍然可以控制第一装置输出第一振动信息,从而使得用户可以及时获知第一事件。在一些可能的实施例中,第一装置可以为车载座椅或方向盘。
情形二、车载系统的过载状态指示车载系统关联的第一交互子系统处于过载状态,控制设备101可以控制第一装置以车载系统关联的第二交互子系统对应的提示方式输出第一提示信息。在情形二中,可以使得第一提示信息被正常输出,有效提升用户获知第一事件的概率。
其中,情形二包括但不限于以下实施例:
在一些可能的实施例中,第一交互子系统以语音系统为例,如果过载状态指示语音系统停止播放语音或者播放语音卡顿,控制设备101可以控制第一装置以车载系统关联的第二交互子系统对应的提示方式输出第一提示信息。第二交互子系统是车载系统中除语音系统之外的其他交互系统。在一些可能的实施例中,第二交互子系统可以包括但不限于振动组件、图像系统、或灯光装置中的至少一项。相应的,第二交互子系统对应的提示方式包括振动提示方式、图像提示方式、或光电提示方式中的至少一种,第一提示信息包括第二振动信息、第二图像信息或第二光电信息中的至少一种。
在另一些可能的实施例中,第一交互子系统以图像系统为例,如果上述车载系统的过载状态指示图像系统显示图像卡顿或停止显示图像,控制设备101可以控制第一装置以车载系统关联的第二交互子系统对应的提示方式输出第一提示信息。其中,第二交互子系统是车载系统中除图像系统之外的其他交互系统。在一些可能的实施例中,第二交互子系统包括但不限于振动组件、语音系统、或灯光装置中的至少一项。相应的,第二交互子系统对应的提示方式包括振动提示方式、语音提示方式、或光电提示方式中的至少一种,第一 提示信息可以包括但不限于第二振动信息、第二语音信息或第二光电信息中的至少一种。
可以理解的是,光电信息可以是灯光信息,不同的第一事件可以对应不同颜色的灯光信息。例如,若第一事件为车辆的驾驶状态由自动驾驶状态切换为待用户接管状态,需要提醒用户接管车辆,第一装置为车载提示灯,控制设备101可以控制车载提示灯显示绿色灯光。又例如,若第一事件为车辆与其当前行驶的道路中的故障物存在碰撞风险,需要提醒用户减速行驶,控制设备101可以控制车载提示灯显示黄色灯光。
在另一些可能的实施例中,第一交互子系统以振动组件为例。如果所述过载状态指示车载系统停止输出振动信息,即第一交互子系统(振动组件)处于过载状态,控制设备101控制第一装置以车载系统关联的第二交互子系统对应的提示方式输出第一提示信息。其中,第二交互子系统是车载系统中除振动组件之外的其他交互系统。在一些可能的实施例中,第二交互子系统可以包括但不限于图像系统、语音系统、或灯光装置中的至少一项。相应的,相应的,第二交互子系统对应的提示方式包括图像提示方式、语音提示方式、或光电提示方式中的至少一种,第一提示信息可以包括但不限于第二图像信息、第二语音信息或第二光电信息中的至少一种。
情形三、车载系统关联的所有交互系统均处于过载状态,可以向非车载提示装置发送第一提示信息,通过非车载提示装置输出第一提示信息。在情形三中,可以保证第一提示信息及时地被输出,有效提升用户获知第一事件的概率。
其中,非车载提示装置可以包括但不限于平板电脑、笔记本电脑、掌上电脑、耳机、音响、可穿戴设备(如智能手表,智能手环,计步器等)、虚拟现实(virtual reality,VR)设备、或手机中的至少一个。
其中,情形三包括但不限于以下实施例:
在一些可能的实施例中,若第一事件为车辆的驾驶状态从自动驾驶状态切换为待用户接管状态,需提醒用户接管车辆,非车载提示装置为手机。控制设备101检测到车辆的驾驶状态从自动驾驶状态切换为待用户接管状态,可以向手机发送第一提示信息,通过手机显示该第一提示信息,进而提醒用户接管车辆。因此,若用户在低头玩手机,用户通过手机可以及时获知第一事件,并进行相应的操作。
在另一些可能的实施例中,若第一事件为车辆的驾驶状态从自动驾驶状态切换为待用户接管状态,需提醒用户接管车辆,非车载提示装置为手机和智能手表,与第一事件对应的第一提示信息包括图像信息和振动信息。控制设备101检测到第一事件时,控制设备101可以向手机发送该图像信息,以及向智能手表发送振动控制指令,从而手机可以显示该图像信息,智能手表可以基于该振动指令,输出该振动信息。如此,通过多个设备向用户输出第一提示信息,便于用户获知第一事件。
在一种可能的实施方式中,如果车载系统处于过载状态,控制设备101可以根据第一事件和映射关系确定一个或多个提示方式,根据车载系统当前的过载状态,从一个或多个提示方式中确定第一提示方式,并控制第一装置输出第一提示方式对应的第一提示信息。如此,使得第一事件的提示方式与车载系统的负载状态相符合,从而使得第一提示信息可以及时输出,便于用户获知第一事件。
其中,该映射关系是第一事件与预设提示方式之间的对应关系。请参见表1,表1示 出了该映射关系的一种示例。在表1中,若第一事件为车辆的驾驶状态由自动驾驶状态切换为待用户接管状态,需要提醒用户接管车辆,则第一事件对应的预设提示方式为语音提示方式、图像提示方式和振动提示方式;若第一事件为车辆与其当前行驶的道路中的故障物存在碰撞风险,需要提醒用户减速行驶,则第一事件对应的预设提示方式为语音提示方式和图像提示方式;若第一事件为车载系统自身的提示功能失效,需要通过其他设备提醒用户车辆状态对应的提示信息,第一事件对应的预设提示方式为语音提示方式和图像提示方式。
表1
Figure PCTCN2022087488-appb-000001
请参见图7,在图7中,第一事件对应的预设提示方式包括图像提示方式、语音提示方式和振动提示方式。图7还示出了每种提示方式对应的详细信息。
其中,图像提示方式对应的详细信息包括图像原始信息、图像数据描述、图像数据和其他图像信息。图像原始信息用于描述第一事件,图像原始信息可以包括但不限于图片的数量、大小、位置、布局、或资源索引ID(即第一事件对应的候选图像的链接地址)中的至少一项。图像数据描述用于描述第一事件对应的候选图像所在的图层,该图像数据描述可以包括候选图像所在的图层对应的尺寸信息、归属信息、Z-Order信息、内存地址、或物理存储位置中的至少一项。图像数据是预先绘制或合成的图层数据,可以通过显示设备直接进行显示,无需进行绘制处理或合成处理。可选的,图像数据是可以动态更新的。其他图像信息可以包括候选图像的显示方式和/或显示设备标识。
其中,语音提示方式对应的详细信息包括语音原始信息、语音数据描述、语音数据、和其他语音信息。语音原始信息用于描述第一事件,语音原始信息可以包括但不限于第一事件对应的音频资源文件和/或音频资源文件的链接地址。语音数据描述用于描述与第一事件对应的第一语音信息,语音数据描述可以包括但不限于第一语音信息的类型、大小、地址、或存储位置中的至少一项。语音数据是经过预处理(例如,音频解码、重采样、混音、后处理等)的语音数据,可以通过语音设备(例如,扬声器或车载音响)直接进行播放。其他语音信息可以包括但不限于第一语音信息的播放方式和/或语音设备标识。其中,语音播放的方式例如可以包括播放次数和/或播放周期。
其中,振动提示方式对应的详细信息包括振动组件ID和振动描述。其中,振动组件ID可以指示用于提示第一事件的振动组件。振动描述用于描述相关振动组件的振动频率和/或振动时间。
需要说明的是,第一事件可以对应至少一种提示方式,相应的,第一提示信息可以对 应多种表现形式。请参见图8,图8示出了第一事件集合与第一提示信息集合的示意图。若第一事件为车辆与其当前行驶的道路中的故障物存在碰撞风险,需要提醒用户减速行驶,第一事件对应的提示方式包括图像提示方式和语音提示方式;相应的,第一事件对应的第一提示信息可以包括减速标志和减速提示音。若第一事件为车辆从高速下匝道,需要提示用户注意不要错过匝道口,第一事件对应的提示方式包括图像提示方式和语音提示方式;相应的,第一事件对应的第一提示信息可以包括换道图标和换道提示音。若第一事件为车辆的驾驶状态由自动驾驶状态切换为待用户接管状态,需要提醒用户接管车辆,第一事件对应的提示方式包括图像提示方式、语音提示方式和振动提示方式;相应的,第一事件对应的第一提示信息可以包括告警图标、方向盘图标、接管提示音、以及振动提醒。
在本申请实施例中,控制设备101根据映射关系,确定出的一个或多个提示方式可以包括图像提示方式、语音提示方式、振动提示方式、或光电提示方式中的至少一种。以及,第一提示方式可以包括一个或多个提示方式。
在一些可能的实施例中,若控制设备101根据上述映射关系确定出的第一事件对应的提示方式包括语音提示方式和图像提示方式,车载系统当前的过载状态指示车载系统显示图像卡顿,则控制设备101将语音提示方式确定为第一提示方式,控制设备101控制第一装置以语义提示方式输出第一事件对应的语音信息。
在另一些可能的实施例中,若控制设备101根据上述映射关系确定出的第一事件对应的提示方式为语音提示方式、图像提示方式和振动提示方式,车载系统当前的过载状态指示车载系统的显示功能故障,则控制设备101将语音提示方式和振动提示方式确定为第一提示方式,控制设备101控制第一装置以语义提示方式输出第一事件对应的语音信息,以及控制第一装置以振动提示方式输出第一事件对应的振动信息。
进一步的,控制设备101还可以获取第一事件的历史提示方式,并基于历史提示方式,对上述映射关系进行更新。在一些可能的实施例中,历史提示方式可以是图像提示方式,且在该图像提示方式对应的图像信息包括图形标识,而现有的映射关系中的图像提示方式仅包括文字标识,控制设备101通过对映射关系进行更新,使得更新后的映射关系中的图像提示方式对应的提示信息包括图形标识和文字标识。如此,使得该映射关系更加完善,进而使得该映射关系的应用更广泛。可选的,控制设备101可以通过深度学习等技术,实现对映射关系的更新。
以上对于图2所示的实施例的技术方案的描述,是以控制设备101为集成了智能驾驶域控制器和智能座舱域控制器的功能的车载芯片为例。为了便于理解,下面控制设备101以智能座舱域控制器为例,进一步对本申请提供的技术方案进行说明。
图9示出了本申请实施例适用的另一种可能的场景的示意图。若第一事件为车辆的驾驶状态由自动驾驶状态切换为待用户接管状态,需要提醒用户接管车辆。在图10中,智能驾驶域控制器可以用于对车载感知设备103采集到的信息进行处理,根据处理结果决策将车辆的驾驶状态由自动驾驶状态调整为待用户接管状态。在智能驾驶域控制器在对车辆的状态进行调整之后,智能座舱域控制器检测到车辆的驾驶状态由自动驾驶状态切换为待用户接管状态,需要提醒用户接管车辆,即智能座舱域控制器检测到第一事件。智能座舱域控制器还可根据预设的映射关系,确定出第一事件对应的一个或多个提示方式,并进一步对其自身的负载状态进行监控和分析,以及结合IVI系统的过载状态从该对应的一个或 多个提示方式筛选出第一提示方式,该第一提示方式包括图像提示方式、语音提示方式或振动提示方式。
进一步的,图10示出了与第一事件的提示方式相关的细节信息。如图10所示,智能座舱域控制器检测到第一事件之后,智能座舱域控制器可以根据预设的映射关系,查询出第一事件对应的信息标记,该信息标记可以指示一个或多个提示方式。或者,智能座舱域控制器根据预设的映射关系,无法查询出第一事件对应的提示方式,智能座舱域控制器可以在当前映射关系中建立与第一事件对应的预设提示方式。或者,智能座舱域控制器可以对预设的映射关系中与第一事件对应的提示方式进行更新。
由图10可知,若上述信息标记指示第一事件对应的提示方式为图像提示方式时,第一事件存在对应的候选图像,以及用于承载该候选图像的背景图像,且候选图像和背景图像在不同的图层。智能座舱域控制器可以结合IVI系统的过载状态,调整该背景图像所在的图层的参数(例如降低绘制速率或刷新速率),使得图像系统有足够的内存资源来保证候选图像可以被正常绘制或正常刷新。或者,智能座舱域控制器可以通过预先存储的图层(即缓存图层)显示第一事件对应的候选图像。
以及,若上述信息标记指示第一事件对应的提示方式为语音提示方式时,智能座舱域控制器可以控制语音设备输出第一事件对应的预先存储的语音信息。
以及,若上述信息标记指示第一事件对应的提示方式为振动提示方式时,智能座舱域控制器可以基于预先存储的振动指令,控制振动组件输出第一事件对应的振动信息。
基于上述内容和相同构思,本申请实施例还提供一种提示装置,用于实现以上方法实施例介绍的提示方法,因此具备上述方法实施例所具备的有益效果。
示例性的,请参见图11,图11示出了本申请实施例提供的一种提示装置的结构示意图,该装置可以是现场可编程门阵列(field programmable gate array,FPGA),可以是专用集成芯片(application specific integrated circuit,ASIC),还可以是中央处理器(central processor unit,CPU)等。其中,该提示装置1100包括:
第一处理模块1101,用于检测第一事件,所述第一事件包括用于指示车辆状态的事件;
第二处理模块1102,用于在第一处理模块1101检测到第一事件时,且车载系统处于过载状态时,输出第一提示信息,所述第一提示信息用于提示所述第一事件;其中,所述第一装置包括车载提示装置和/或非车载提示装置。
在一种可能的设计中,第二处理模块1102具体用于:在所述过载状态指示所述车载系统停止播放语音时,控制所述第一装置输出所述第一事件对应的第一语音信息,所述第一语音信息为预先存储的语音信息。
在一种可能的设计中,第二处理模块1102具体用于:在所述过载状态指示所述车载系统显示图像卡顿时,根据所述第一事件对应的候选图像所在的图层以及承载所述候选图像的背景图像所在的图层,控制所述第一装置输出所述第一提示信息;其中,所述显示图像卡顿是指显示一帧图像所用的时长大于第一预设时长。
在一种可能的设计中,第二处理模块1102根据候选图像所在的图层以及承载所述候选图像的背景图像所在的图层,输出所述第一提示信息,包括但不限于以下情况:
情况1,如果候选图像所在的图层和背景图像所在的图层为不同的图层,第一处理模块1101还用于调整所述背景图像所在的图层的参数,第二处理模块1102基于调整后的参 数,控制所述第一装置在所述背景图像所在的图层显示所述背景图像。
情况2,如果候选图像所在的图层和背景图像所在的图层为同一个图层,第一处理模块1101还用于新建第三图层,第二处理模块1102还用于控制第一装置在所述第三图层显示所述候选图像。
在一种可能的设计中,背景图像所在的图层的参数可以包括但不限于以下至少一项:绘制速率,显示速率,或,刷新频率。
在一种可能的设计中,在过载状态指示所述车载系统停止显示图像时,第二处理模块1102可以控制第一装置在第四图层显示所述第一事件对应的候选图像,第四图层承载了所述候选图像的信息。
在一种可能的设计中,在所述过载状态指示所述车载系统停止输出振动信息时,第二处理模块1102可以基于第一振动指令,控制第一装置输出第一振动信息,所述第一振动指令为预先存储的振动指令。
在一种可能的设计中,在过载状态指示所述车载系统显示图像卡顿或停止显示图像时,第二处理模块1102可以控制第一装置输出第二振动信息、第二语音信息或光电信息中的一种或多种。相应的,在所述过载状态指示所述车载系统停止输出语音信息,第二处理模块1102可以控制第一装置输出第二振动信息、第二图像信息或光电信息中的一种或多种。相应的,在如果所述过载状态指示所述车载系统停止输出振动信息,第二处理模块1102可以控制第一装置输出第二语音信息、第二图像信息或光电信息中的一种或多种。
在一种可能的设计中,第一处理模块1101具体用于:根据所述第一事件和映射关系确定一个或多个提示方式,所述映射关系为所述第一事件与预设提示方式之间的对应关系;以及根据车载系统当前的过载状态从所述一个或多个提示方式中确定第一提示方式;第二处理模块可以用于控制所述第一装置输出所述第一提示方式对应的所述第一提示信息。
在一种可能的设计中,第一处理模块1101还用于:获取所述第一事件的历史提示方式;基于所述历史提示方式,对所述映射关系进行更新。
在一种可能的设计中,所述提示装置还包括通信模块1103,所述第一装置为非车载提示装置时,在第二处理模块1102控制第一装置输出第一提示信息之前,通信模块1103用于向所述第一装置发送所述第一提示信息。
应理解的是,本申请实施例中的提示装置可以由软件实现,例如,具有上述功能的计算机程序或指令来实现,相应计算机程序或指令可以存储在终端内部的存储器中,通过处理器读取该存储器内部的相应计算机程序或指令来实现第一处理模块1101和/或第二处理模块1102,和/或通信模块1103的上述功能。或者,本申请实施例中的提示装置还可以由硬件来实现。其中,第一处理模块1101可以是处理器(如CPU或系统芯片中的处理器)。
本申请实施例还提供了一种车辆,该车辆可以包括上述提示装置1100。
本申请实施例还提供了一种终端设备,该终端设备可以包括上述提示装置1100。需要说明的是,本申请实施例中的终端设备,例如可以为车载终端、车载控制器、车载模块、车载模组、车载部件、车载芯片、车载单元、车载雷达或车载摄像头等其他传感器,车辆可通过该车载终端、车载控制器、车载模块、车载模组、车载部件、车载芯片或车载单元。
本申请实施例还提供了一种芯片系统,请参见图12,该芯片系统1200包括至少一个处理器,当程序指令在至少一个处理器1201中执行时,使得上述图3所示实施例中的提示方法得以实现。
可选的,该芯片系统还包括通信接口1203,通信接口用于输入或输出信息。
可选的,该芯片系统还包括存储器1202,该存储器1202通过通信接口1203耦合处理器,用于存储上述指令,以便处理器通过通信接口1203读取存储器中存储的指令。
应理解,本申请实施例中不限定上述处理器1201、存储器1202以及通信接口1203之间的连接介质。本申请实施例在图12中以存储器1202、处理器1201以及通信接口1203之间通过通信总线1204连接,总线在图12中以粗线表示,其它部件之间的连接方式,仅是示意性说明,并不作为限定。所述总线可以包括地址总线、数据总线、控制总线等。为了便于表示,图12中仅用一条粗线表示,但并不表示仅有一根总线或一种类型的总线等。
本申请实施例还提供了一种包括指令的计算机程序产品,当其在上述装置上运行时,以执行如上述所示实施例中的提示方法。
本申请实施例提供一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,当计算机程序被运行时,实现如上述实施例中的提示方法。
示意性的,例如,模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个装置,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是一个物理单元或多个物理单元,即可以位于一个地方,或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理模块中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。另外,在本申请各个实施例中的各功能模块可以集成在一个处理器中,也可以是单独物理存在,也可以两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。
本申请实施例提供的方法中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、网络设备、用户设备或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(digital subscriber line,简称DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机可以存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质(例如,软盘、硬盘、磁带)、光介质(例如,数字视频光盘(digital video disc,简称DVD))、或者半导体介质等。
在本申请实施例中,在无逻辑矛盾的前提下,各实施例之间可以相互引用,例如方法 实施例之间的方法和/或术语可以相互引用,例如装置实施例之间的功能和/或术语可以相互引用,例如装置实施例和方法实施例之间的功能和/或术语可以相互引用。
本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的范围。这样,倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内,则本申请也意图包含这些改动和变型在内。

Claims (15)

  1. 一种提示方法,其特征在于,包括:
    检测到第一事件,所述第一事件包括用于指示车辆状态的事件;
    如果车载系统处于过载状态,控制第一装置输出第一提示信息,所述第一提示信息用于向用户提示所述第一事件;
    其中,所述第一装置包括车载提示装置和/或非车载提示装置。
  2. 根据权利要求1所述的方法,其特征在于,如果车载系统处于过载状态,控制第一装置输出第一提示信息,包括:
    如果所述过载状态指示所述车载系统停止播放语音,控制所述第一装置输出所述第一事件对应的第一语音信息,所述第一语音信息为预先存储的语音信息。
  3. 根据权利要求1所述的方法,其特征在于,如果车载系统处于过载状态,控制第一装置输出第一提示信息,包括:
    如果所述过载状态指示所述车载系统显示图像卡顿,根据所述第一事件对应的候选图像所在的图层以及承载所述候选图像的背景图像所在的图层,控制所述第一装置输出所述第一提示信息;其中,所述显示图像卡顿是指显示一帧图像所用的时长大于第一预设时长。
  4. 根据权利要求3所述的方法,其特征在于,所述根据候选图像所在的图层以及承载所述候选图像的背景图像所在的图层,控制所述第一装置输出所述第一提示信息,包括:
    如果所述候选图像所在的图层和所述背景图像所在的图层为不同的图层,则调整所述背景图像所在的图层的参数,并基于调整后的参数,控制所述第一装置在所述背景图像所在的图层显示所述背景图像;或者,
    如果所述候选图像所在的图层和所述背景图像所在的图层为同一个图层,则新建第三图层,并控制所述第一装置在所述第三图层显示所述候选图像。
  5. 根据权利要求4所述的方法,其特征在于,所述背景图像所在的图层的参数包括以下至少一项:绘制速率,显示速率,刷新频率,或,所述候选图像所在的图层和所述背景图像所在的图层的堆叠顺序。
  6. 根据权利要求1所述的方法,其特征在于,如果车载系统处于过载状态,控制第一装置输出第一提示信息,包括:
    如果所述过载状态指示所述车载系统停止显示图像,控制所述第一装置在第四图层显示所述第一事件对应的候选图像,其中所述第四图层承载了所述候选图像的信息。
  7. 根据权利要求1所述的方法,其特征在于,如果车载系统处于过载状态,控制第一装置输出第一提示信息,包括:
    如果所述过载状态指示所述车载系统停止输出振动信息,基于第一振动指令,控制所述第一装置输出第一振动信息,所述第一振动指令为预先存储的振动指令。
  8. 根据权利要求1所述的方法,其特征在于,如果车载系统处于过载状态,控制第一装置输出第一提示信息,包括:
    如果所述过载状态指示所述车载系统显示图像卡顿或停止显示图像,控制所述第一装置输出第二振动信息、第二语音信息或光电信息中的一种或多种。
  9. 根据权利要求1所述的方法,其特征在于,如果车载系统处于过载状态,控制第一装置输出第一提示信息,包括:
    根据所述第一事件和映射关系确定一个或多个提示方式,所述映射关系为所述第一事件与预设提示方式之间的对应关系;
    根据车载系统的过载状态从所述一个或多个提示方式中确定第一提示方式,并控制所述第一装置输出所述第一提示方式对应的所述第一提示信息。
  10. 根据权利要求9所述的方法,其特征在于,所述方法还包括:
    获取所述第一事件的历史提示方式;
    基于所述历史提示方式,对所述映射关系进行更新。
  11. 根据权利要求1-10任一项所述的方法,其特征在于,所述第一装置为非车载提示装置时,在控制第一装置输出第一提示信息之前,所述方法还包括:
    向所述第一装置发送所述第一提示信息。
  12. 一种提示装置,其特征在于,包括用于执行权利要求1-11任一所述方法的模块。
  13. 一种车辆,其特征在于,包括如权利要求12所述的装置。
  14. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质中存储有计算机程序或指令,当所述计算机程序或指令被计算设备执行时,以使得所述计算设备执行如权利要求1至11中任一项所述的方法。
  15. 一种芯片,其特征在于,包括至少一个处理器和接口;
    所述接口,用于为所述至少一个处理器提供计算机程序、指令或者数据;
    所述至少一个处理器用于执行所述计算机程序或指令,以使得如权利要求1至11中任一项所述的方法被执行。
PCT/CN2022/087488 2022-04-18 2022-04-18 一种提示方法、装置及车辆 Ceased WO2023201485A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202280092778.2A CN118804864A (zh) 2022-04-18 2022-04-18 一种提示方法、装置及车辆
PCT/CN2022/087488 WO2023201485A1 (zh) 2022-04-18 2022-04-18 一种提示方法、装置及车辆

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/087488 WO2023201485A1 (zh) 2022-04-18 2022-04-18 一种提示方法、装置及车辆

Publications (1)

Publication Number Publication Date
WO2023201485A1 true WO2023201485A1 (zh) 2023-10-26

Family

ID=88418881

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/087488 Ceased WO2023201485A1 (zh) 2022-04-18 2022-04-18 一种提示方法、装置及车辆

Country Status (2)

Country Link
CN (1) CN118804864A (zh)
WO (1) WO2023201485A1 (zh)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180208060A1 (en) * 2015-07-15 2018-07-26 Lg Electronics Inc. Vehicle control device and method therefor
DE102017215405A1 (de) * 2017-09-04 2019-03-07 Bayerische Motoren Werke Aktiengesellschaft Verfahren, mobiles Anwendergerät, System, Computerprogramm zur Ansteuerung eines mobilen Anwendergeräts eines Insassen eines Fahrzeugs
CN109933062A (zh) * 2017-12-15 2019-06-25 百度(美国)有限责任公司 自动驾驶车辆的报警系统
US20200028736A1 (en) * 2019-08-26 2020-01-23 Lg Electronics Inc. Method and apparatus for determining an error of a vehicle in autonomous driving system
KR20200068770A (ko) * 2018-11-27 2020-06-16 (주)언맨드솔루션 자율주행 긴급제어 시스템
CN112141092A (zh) * 2019-06-11 2020-12-29 现代自动车株式会社 自主驾驶控制设备、具有该设备的车辆及控制车辆的方法
KR20210155596A (ko) * 2020-06-16 2021-12-23 현대자동차주식회사 자동차 및 그 정보 표시 방법
CN113911133A (zh) * 2020-07-07 2022-01-11 罗伯特·博世有限公司 具有故障处理单元的驾驶员辅助系统

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180208060A1 (en) * 2015-07-15 2018-07-26 Lg Electronics Inc. Vehicle control device and method therefor
DE102017215405A1 (de) * 2017-09-04 2019-03-07 Bayerische Motoren Werke Aktiengesellschaft Verfahren, mobiles Anwendergerät, System, Computerprogramm zur Ansteuerung eines mobilen Anwendergeräts eines Insassen eines Fahrzeugs
CN109933062A (zh) * 2017-12-15 2019-06-25 百度(美国)有限责任公司 自动驾驶车辆的报警系统
KR20200068770A (ko) * 2018-11-27 2020-06-16 (주)언맨드솔루션 자율주행 긴급제어 시스템
CN112141092A (zh) * 2019-06-11 2020-12-29 现代自动车株式会社 自主驾驶控制设备、具有该设备的车辆及控制车辆的方法
US20200028736A1 (en) * 2019-08-26 2020-01-23 Lg Electronics Inc. Method and apparatus for determining an error of a vehicle in autonomous driving system
KR20210155596A (ko) * 2020-06-16 2021-12-23 현대자동차주식회사 자동차 및 그 정보 표시 방법
CN113911133A (zh) * 2020-07-07 2022-01-11 罗伯特·博世有限公司 具有故障处理单元的驾驶员辅助系统

Also Published As

Publication number Publication date
CN118804864A (zh) 2024-10-18

Similar Documents

Publication Publication Date Title
US20220355819A1 (en) Autonomous driving vehicle controlling
US12117833B2 (en) Client control for an autonomous vehicle ridesharing service
CN111371875A (zh) 基于双操作系统的电子控制单元及其处理方法
JP7818466B2 (ja) 自律マシン・アプリケーションにおける距離画像マッピングのための信念伝搬
WO2023154199A1 (en) High definition (hd) map content representation and distribution for autonomous vehicles
CN115720253B (zh) 视频处理方法、装置、车辆以及存储介质
US20190315342A1 (en) Preference adjustment of autonomous vehicle performance dynamics
CN115480092A (zh) 自主机器应用中多个频率范围内的电压监测
JP2023135587A (ja) 自律システム及びアプリケーションのための占有グリッドを使用したハザード検出
CN109624985A (zh) 防疲劳驾驶预警方法及装置
CN116279464A (zh) 车辆自适应巡航控制方法、装置及相关设备
JP2023519982A (ja) 自律運転方法および装置
US20240190465A1 (en) Autonomous driving control device and computer readable medium
CN113085898B (zh) 一种激活应用程序的方法和自动驾驶车辆
CN112102584B (zh) 一种车辆的自动驾驶报警方法、装置、车辆和存储介质
CN116985800A (zh) 基于绿波车速控车的方法、装置和车辆
WO2024098393A1 (zh) 一种控制方法、装置、车辆、电子设备及存储介质
CN116039637A (zh) 自动驾驶车辆的能量回收方法、装置及系统
WO2023201485A1 (zh) 一种提示方法、装置及车辆
US10543852B2 (en) Environmental driver comfort feedback for autonomous vehicle
EP4369186A1 (en) Control method and apparatus, device, and storage medium
EP4197873A1 (en) Information processing apparatus and information processing method
EP4365733A1 (en) Management system, method and apparatus, and device and storage medium
CN112677985B (zh) 车辆中控功能激活等级确定方法、装置、电子设备和介质
US20240362011A1 (en) Techniques For Over-The-Air Software Updates

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22937725

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202280092778.2

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22937725

Country of ref document: EP

Kind code of ref document: A1