CN116461544A - Intelligent driving interaction method, intelligent driving interaction system and vehicle - Google Patents
Intelligent driving interaction method, intelligent driving interaction system and vehicle Download PDFInfo
- Publication number
- CN116461544A CN116461544A CN202310222865.1A CN202310222865A CN116461544A CN 116461544 A CN116461544 A CN 116461544A CN 202310222865 A CN202310222865 A CN 202310222865A CN 116461544 A CN116461544 A CN 116461544A
- Authority
- CN
- China
- Prior art keywords
- control instruction
- brain wave
- instruction
- driving
- turning
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000003993 interaction Effects 0.000 title claims abstract description 32
- 210000004556 brain Anatomy 0.000 claims abstract description 111
- 238000012790 confirmation Methods 0.000 claims abstract description 40
- 238000007514 turning Methods 0.000 claims description 30
- 230000008569 process Effects 0.000 claims description 22
- 238000012545 processing Methods 0.000 claims description 16
- 238000007791 dehumidification Methods 0.000 claims description 6
- 230000003213 activating effect Effects 0.000 claims description 3
- 238000010438 heat treatment Methods 0.000 claims description 2
- 230000003247 decreasing effect Effects 0.000 claims 1
- 230000001133 acceleration Effects 0.000 description 9
- 230000009471 action Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 102100034112 Alkyldihydroxyacetonephosphate synthase, peroxisomal Human genes 0.000 description 2
- 101000799143 Homo sapiens Alkyldihydroxyacetonephosphate synthase, peroxisomal Proteins 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 2
- 238000000848 angular dependent Auger electron spectroscopy Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000004378 air conditioning Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000003340 mental effect Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000000337 motor cortex Anatomy 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000005057 refrigeration Methods 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/215—Selection or confirmation of options
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- Transportation (AREA)
- Traffic Control Systems (AREA)
Abstract
The application relates to an intelligent driving interaction method, an interaction system and a vehicle, which comprise the following steps: acquiring brain wave information, and identifying driving intention to generate a control instruction; judging whether the control instruction belongs to a driving safety instruction or not; if the control instruction belongs to the driving safety instruction, prompting the content of the control instruction, acquiring a confirmation result, executing the control instruction when the confirmation result is agreeing, and not executing the control instruction when the confirmation result is disagreeing; if the control command does not belong to the driving safety command, judging whether the control command belongs to a functional command which can be realized by the current cabin system; and if the control instruction belongs to the functional instruction which can be realized by the current cabin system, executing the control instruction, and if the control instruction does not belong to the functional instruction which can be realized by the current cabin system, prompting that the current cabin system cannot realize the content of the control instruction, and exiting. According to the method and the device, the misoperation probability of the automatic driving system of the vehicle caused by misidentification can be reduced, and the potential safety hazard of the automatic driving vehicle is reduced.
Description
Technical Field
The application relates to the technical field of vehicles, in particular to an intelligent driving interaction method, an interaction system and a vehicle.
Background
With the continuous development of the modern automobile industry, people have increasingly high requirements on automobile comfort and operation convenience. A large number of electronic devices are applied to automobiles, and the comfort of the automobiles is greatly improved. The increase of electronic devices means that more buttons are provided on the dashboard of the automobile for controlling sound, air conditioner, GPS, cruise control, navigation, etc. Meanwhile, the larger the display screen of the automobile is, the more and more vehicle information is displayed while the multimedia image video is played. So many functions need different keys to be operated respectively, so that the operation of a user is inconvenient.
In some related art, a user may use the brain-computer interface BMI system to read electrical impulses from the motor cortex of the user's brain, decode continuous neural data feeds, and issue vehicle control commands in real-time or substantially real-time to control some driving functions, such as auto-park. The BMI system may include integrated logic that evaluates the mental focus of the user on the driving maneuver at hand by evaluating the user focus quantified as a user engagement value and using the autonomous vehicle controller to manage aspects of the driving maneuver.
In the related art, although the BMI technology is combined to the vehicle, how to deal with the misoperations of the automatic driving system of the vehicle caused by the misidentification is not mentioned, and the safety hazard of the automatic driving vehicle cannot be avoided.
Disclosure of Invention
The embodiment of the application provides an intelligent driving interaction method, an interaction system and a vehicle, which can reduce the misoperation probability of a vehicle automatic driving system caused by misidentification and reduce the potential safety hazard of the automatic driving vehicle.
In a first aspect, an intelligent driving interaction method is provided, which includes the following steps:
acquiring brain wave information, and identifying driving intention to generate a control instruction;
judging whether the control instruction belongs to a driving safety instruction or not;
if the control instruction belongs to the driving safety instruction, prompting the content of the control instruction, acquiring a confirmation result, executing the control instruction when the confirmation result is agreeing, and not executing the control instruction when the confirmation result is disagreeing;
if the control instruction does not belong to the driving safety instruction, judging whether the control instruction belongs to a functional instruction which can be realized by the current cabin system; and if the control instruction belongs to the functional instruction which can be realized by the current cabin system, executing the control instruction, and if the control instruction does not belong to the functional instruction which can be realized by the current cabin system, prompting that the current cabin system cannot realize the content of the control instruction, and exiting.
In some embodiments, acquiring brain wave information and identifying driving intent to generate control instructions includes the steps of:
acquiring brain wave information and matching the brain wave information with a stored brain wave template set, wherein the brain wave template set comprises brain wave templates formed by different driving safety instructions and different functional instructions which can be realized by the current cabin system;
if the matching is successful, generating a control instruction corresponding to the brain wave template;
if the matching is unsuccessful, a fuzzy algorithm is adopted to process the brain wave information, and the brain wave information is matched with the stored brain wave template set again.
In some embodiments, prompting the content of the control instruction includes the steps of:
displaying the content of the control instruction in a head-up display mode;
and/or broadcasting the content of the control instruction through a voice recognition broadcasting system.
In some embodiments, obtaining the confirmation result includes the steps of:
acquiring brain wave information and matching the brain wave information with a stored brain wave template set, wherein the brain wave template set comprises brain wave templates formed by instructions aiming at agreement and disagreement;
if the matching is successful, generating a control instruction corresponding to the brain wave template;
if the matching is unsuccessful, a fuzzy algorithm is adopted to process the brain wave information, and the brain wave information is matched with the stored brain wave template set again.
In some embodiments, after consent is obtained and before executing the control instruction, the method further comprises the steps of:
judging whether the control instruction violates driving safety;
if the driving safety is not violated, executing the control instruction;
if the traffic safety is violated, the method is not executed.
In some embodiments, prompting that the current cabin system cannot implement the content of the control instruction includes the following steps:
displaying in a head-up display mode;
and/or broadcasting through a voice recognition broadcasting system.
In some embodiments, the driving safety instruction includes at least one of activating the NOA function, turning off the NOA function, turning on navigation, switching a navigation destination, prioritizing a navigation route at a high speed, not routing the navigation route at a high speed, prioritizing a navigation route at a high speed, minimizing a navigation route time, and minimizing a navigation route distance.
In some embodiments, the functional instructions that the current cabin system may implement include at least one of turning on an ambient light, turning off an ambient light, changing an ambient light color, playing music, turning off music, switching music, turning on an air conditioner, turning off an air conditioner, an air conditioner temperature increase, an air conditioner temperature decrease, heating, cooling, turning on defogging, turning off defogging, turning on dehumidification, turning off dehumidification, turning on an inner loop, turning off an inner loop, turning on an outer loop, and turning off an outer loop.
In a second aspect, an intelligent driving interaction system is provided, comprising:
brain wave sensing module, it is used for: acquiring brain wave information, and identifying driving intention to generate a control instruction;
a data processing module for: judging whether the control instruction belongs to a driving safety instruction or not;
a prompt confirmation module for: when the control instruction belongs to a driving safety instruction, prompting the content of the control instruction and waiting for confirmation;
the brain wave sensing module is also used for acquiring a confirmation result;
an execution module for: when the result is confirmed to be agreeable, executing the control instruction, and when the result is not agreeable, not executing the control instruction;
the data processing module is further configured to: when the control instruction does not belong to a driving safety instruction, judging whether the control instruction belongs to a functional instruction which can be realized by the current cabin system;
the execution module is further configured to: executing the control instruction when the control instruction belongs to a functional instruction which can be realized by the current cabin system;
the prompt confirmation module is further configured to: and when the control instruction does not belong to the functional instruction which can be realized by the current cabin system, prompting that the current cabin system cannot realize the content of the control instruction.
In a third aspect, a vehicle is provided comprising an intelligent driving interaction system as described above.
The beneficial effects that technical scheme that this application provided brought include:
according to the intelligent driving interaction method, in the vehicle traveling process, brain wave information is acquired, driving intention is identified, so that a control instruction is generated, whether the control instruction belongs to a driving safety instruction is judged, if the control instruction belongs to the driving safety instruction, the content of the control instruction is prompted, a confirmation result is obtained, when the confirmation result is agreeing, the control instruction is executed, and when the confirmation result is disagreeing, the control instruction is not executed; if the control instruction does not belong to the driving safety instruction, judging whether the control instruction belongs to a functional instruction which can be realized by the current cabin system; and if the control instruction belongs to the functional instruction which can be realized by the current cabin system, executing the control instruction, and if the control instruction does not belong to the functional instruction which can be realized by the current cabin system, prompting that the current cabin system cannot realize the content of the control instruction, and exiting.
According to the vehicle control system and method, brain waves generated by the brain can be converted into control instructions, the vehicle is controlled to realize related functions, and therefore related vehicle equipment of the vehicle is controlled by the hands instead of the hands, the hands can be liberated to a certain extent, the inconvenience of controlling the vehicle equipment in the driving process (especially in high-speed driving) is solved, the driving safety level in the driving process is improved, and the comfort of a driver and passengers in a cabin is improved.
In the vehicle traveling process, after the brain wave information is identified to generate the control instruction, whether the control instruction belongs to a driving safety instruction is judged, if so, the content of the control instruction is prompted for confirmation, and the processing has the advantages that the misoperation probability of a vehicle automatic driving system caused by misoperation identification can be reduced, and the potential safety hazard of an automatic driving vehicle is reduced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flowchart of an intelligent driving interaction method provided in an embodiment of the present application;
fig. 2 is a block diagram of an intelligent driving interaction system according to an embodiment of the present application.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present application based on the embodiments herein.
While driving a vehicle, the occupants can be divided into two categories, i.e., driver and passenger, including passenger sitting in the co-driver and passenger sitting in the rear row, for a car, there is only one rear row, while for an MPV model, there is typically a second row, a third row, etc., so the rear row should include the second row, the third row, etc.
As will be described later, the control instructions include two major categories, namely, instructions related to driving safety and instructions related to functions that can be achieved by the current cabin system, and the driver and the passenger are different in instruction control in that, since the vehicle is driven by the driver and the passenger does not drive the vehicle, in order to prevent the passenger from affecting normal driving and causing traffic accidents, the driver can control both the above two categories of instructions, and the passenger can only control the instructions related to functions that can be achieved by the current cabin system.
The technical scheme of the application is explained with the view angle of a driver.
Referring to fig. 1, an embodiment of the present application provides an intelligent driving interaction method, which includes the following steps:
101: brain wave information of a driver is acquired, and driving intention is recognized to generate a control instruction.
In the process of driving a vehicle, a driver encounters various different situations, such as opening an air conditioner for refrigeration or opening music, at this time, the driver generates brain waves, the brain waves (such as brain waves in a motor imagery pattern or brain waves in a visual stimulus pattern) of the driver can be perceived through electrodes in brain-computer interface equipment (Brain Computer Interface, BCI), and a chip integrated on the brain-computer interface equipment can recognize the intention of the driver after a series of processes such as preprocessing, feature extraction, classification recognition and the like are performed on the collected brain wave information, so that a control instruction is generated. The brain-computer interface device BCI may be a hair mask, a hair band, or other form.
102: judging whether the control instruction belongs to a driving safety instruction or not.
After the OIB/VIU (central controller/regional controller) receives the control command, it first determines whether the control command is related to driving safety.
All control commands can be divided into two main categories.
One type is a command related to driving safety, called a driving safety command, such as activating a NOA (Navigate onAutopilot, automatic assisted navigation driving) function, turning off the NOA function, turning on navigation, switching a navigation destination, prioritizing a navigation route at a high speed, prioritizing a navigation route not to travel at a high speed, prioritizing a navigation route at a large speed, minimizing a navigation route time, minimizing a navigation route distance, and the like.
The other is an instruction related to a function that can be realized by the current cabin system, which is called a function instruction that can be realized by the current cabin system. For example, turn on an atmosphere lamp, turn off an atmosphere lamp, change an atmosphere lamp color, play music, turn off music, switch music, turn on an air conditioner, turn off an air conditioner, increase an air conditioner temperature, decrease an air conditioner temperature, warm, cool, turn on defogging, turn off defogging, turn on dehumidification, turn off dehumidification, turn on an inner cycle, turn off an inner cycle, turn on an outer cycle, turn off an outer cycle.
When the OIB/VIU receives the control command, it is naturally known whether the control command relates to driving safety or to a function that can be achieved by the current cabin system.
103: if the control instruction belongs to the driving safety instruction, prompting the content of the control instruction, acquiring a driver confirmation result, executing the control instruction when the confirmation result is agreeing, and not executing the control instruction when the confirmation result is disagreeing;
for example, if the content of the control instruction identified during the travel of the vehicle driven by the driver is the switch navigation destination, the content of the "switch navigation destination" is presented to the driver, and after the driver knows the "switch navigation destination", the driver confirms again, and when the switch navigation destination is agreed, the control navigation system switches the current destination to the new destination and continues the navigation, and when the switch navigation destination is not agreed, the control instruction is not executed.
104: if the control instruction does not belong to the driving safety instruction, judging whether the control instruction belongs to a functional instruction which can be realized by the current cabin system; and if the control instruction belongs to the functional instruction which can be realized by the current cabin system, executing the control instruction, and if the control instruction does not belong to the functional instruction which can be realized by the current cabin system, prompting that the current cabin system cannot realize the content of the control instruction, and exiting.
For example, if the content of the identified control instruction is to switch the next piece of music during the driving of the vehicle by the driver, the vehicle-mounted entertainment device of the current cabin system directly executes the control instruction and completes the requirement record after receiving the control instruction, and if the content of the identified control instruction is, for example, to collect the current piece of music, the current cabin system cannot realize, that is, does not belong to the function instruction which can be realized by the current cabin system, the current cabin system is directly prompted to fail to realize the content of the control instruction, for example, exit after 3 seconds, record and feed back the requirement to an OEM (Original Equipment Manufacturer, original equipment manufacturer, manufacturer) and wait for the next time of upgrading of OTA (Over-the-Air Technology, which is a Technology for remotely managing mobile terminal equipment and SIM card data through an Air interface of mobile communication).
According to the intelligent driving interaction method, in the process that a driver drives a vehicle to travel, brain wave information of the driver is obtained, driving intention is identified, so that a control instruction is generated, whether the control instruction belongs to a driving safety instruction is judged, if the control instruction belongs to the driving safety instruction, the content of the control instruction is prompted to the driver, a confirmation result of the driver is obtained, when the confirmation result is agreeing, the control instruction is executed, and when the confirmation result is disagreeing, the control instruction is not executed; if the control instruction does not belong to the driving safety instruction, judging whether the control instruction belongs to a functional instruction which can be realized by the current cabin system; and if the control instruction belongs to the functional instruction which can be realized by the current cabin system, executing the control instruction, and if the control instruction does not belong to the functional instruction which can be realized by the current cabin system, prompting that the current cabin system cannot realize the content of the control instruction, and exiting.
According to the vehicle control system and method, brain waves generated by the brain of the driver can be converted into control instructions, the vehicle is controlled to realize related functions, so that the driver is replaced to control related vehicle equipment of the vehicle through two hands, the two hands of the driver can be liberated to a certain extent, the inconvenience that the driver controls the vehicle equipment in the driving process (especially in the high-speed driving process) is solved, the driving safety level in the driving process is improved, and the comfort of the driver and passengers in a cabin is improved.
According to the method and the device, in the running process of the driver driving the vehicle, after the brain wave information of the driver is identified to generate the control instruction, whether the control instruction belongs to the driving safety instruction is judged, if so, the content of the control instruction is prompted to the driver for the driver to confirm, and the processing has the advantages that the misoperation probability of an automatic driving system of the vehicle caused by misidentification can be reduced, and the potential safety hazard of the automatic driving vehicle is reduced.
In the step 101, the brain wave information of the driver is obtained, and the driving intention is identified to generate the control command, including the following steps:
201: and acquiring brain wave information of the driver and matching the brain wave information with a stored brain wave template set, wherein the brain wave template set comprises brain wave templates formed by different driving safety instructions and different functional instructions which can be realized by the current cabin system of the driver.
The brain wave template set is a series of brain wave information which is acquired and stored in advance before a driver drives a vehicle.
Specifically, before driving a vehicle, a driver firstly obtains a plurality of brain wave information of different driving safety instructions of the driver and a plurality of brain wave information of functional instructions which can be realized by different current cabin systems, each brain wave information corresponds to one instruction and is stored as one brain wave template, and all brain wave templates of the driver form a brain wave template set which can be directly stored on a local storage unit of the vehicle.
There may be a difference in brain wave information generated by different persons with respect to the same instruction, and thus, for different drivers, it is necessary to separately acquire and store brain wave information before driving the vehicle.
There are at least two ways to separately collect and store brain wave information for different drivers.
For example, the following manner may be adopted: before driving the vehicle, the brain wave information is temporarily collected and stored, and during collection, the brain wave information of each instruction can be collected and stored according to the prompt broadcasted by the vehicle voice recognition broadcasting system, or by utilizing the prompt of the central control large screen, or by utilizing the prompt of the head-up display module.
As another example, the following may be taken: according to the condition of China family, a vehicle is commonly used by family members, and a plurality of drivers are basically fixed, so that an electroencephalogram template set of each driver can be collected and stored in advance, and then temporary collection is not needed when the vehicle is used.
202: if the matching is successful, a control instruction corresponding to the brain wave template is generated.
203: if the matching is unsuccessful, a fuzzy algorithm is adopted to process the brain wave information, and the brain wave information is matched with the stored brain wave template set again.
In step 203, after matching with the stored brain wave template set again, there may be two results, namely, successful matching and unsuccessful matching.
For the case that the matching is unsuccessful, the following processing method may be adopted: when the matching is continued after the fuzzy algorithm processing is adopted, setting a threshold value of the fuzzy algorithm processing, if the threshold value is exceeded, reporting a prompt similar to 'unsuccessful matching and requesting to issue instructions again' by using a vehicle voice recognition broadcasting system, or displaying a prompt similar to 'unsuccessful matching and requesting to issue instructions again by using a central control large screen, or displaying a prompt similar to' unsuccessful matching and requesting to issue instructions again by using a head-up display module, and continuously collecting brain wave information. For example, the threshold is 2 times, after entering step 203 and after processing by adopting the fuzzy algorithm, the matching result is still unsuccessful, then processing by adopting the fuzzy algorithm and matching again, if still unsuccessful, 2 times arrive, at this time, processing by adopting the fuzzy algorithm is not adopted any more, prompting is directly carried out, and brain wave information is continuously collected.
In step 103, the content of the control instruction is prompted, that is, the content of the control instruction is prompted to the driver, and there are various modes, for example, the content of the control instruction can be sent to the HUD module, and the content is displayed in a head-up display mode to tell the driver that the corresponding function is to be activated and ask the driver to confirm; for another example, the content of the control instruction is broadcasted through a voice recognition broadcasting system, so that the driver is informed that the corresponding function is activated, and the driver is requested to confirm. Alternatively, the two modes are combined.
Therefore, a closed-loop multi-mode interaction system is formed by means of human-computer interface (BCI), head-up display, voice and other man-machine interaction modes, hands of a driver are liberated, and driving safety in the driving process and comfortableness of the driver and passengers in the cabin are improved.
In step 103, a driver confirmation result is obtained, including the steps of:
301: and acquiring brain wave information of the driver and matching the brain wave information with a stored brain wave template set, wherein the brain wave template set comprises brain wave templates formed by the driver aiming at agreeing and disagreeing instructions.
Since the content of the control instruction is prompted to the driver, there are various modes, for example, the content of the control instruction can be displayed in a head-up display mode; for another example, the content of the control instruction is broadcasted through a voice recognition broadcasting system. Alternatively, the two modes are combined.
Therefore, in step 301, if the head-up display mode is adopted for prompting, the brain waves generated under the visual stimulus pattern when the driver looks at the confirmation icon in the HUD module are monitored, and if the voice recognition broadcasting system is adopted for broadcasting, the brain waves generated under the movement imagination pattern when the driver hears the broadcasting are monitored.
302: if the matching is successful, a control instruction corresponding to the brain wave template is generated.
303: if the matching is unsuccessful, a fuzzy algorithm is adopted to process the brain wave information, and the brain wave information is matched with the stored brain wave template set again.
The steps 301 to 303 for obtaining the confirmation result of the driver still are judged by the brain wave form, and the process is similar to the step 101, and will not be described here.
After consent, and before executing the control instructions, the method further comprises the steps of:
401: and judging whether the control instruction violates the driving safety.
After the confirmation result is agreed, the OIB/VIU sends the control instruction to an ADAS system (Advanced DrivingAssistance System ) which judges whether the control instruction violates the driving safety.
402: and if the driving safety is not violated, executing the control instruction.
403: if the traffic safety is violated, the method is not executed.
Specifically, when the above step 401 is performed, if the control command is generated during the running of the vehicle, it is determined whether it is a longitudinal control command, such as acceleration or braking, or a lateral control command.
If it is a longitudinal control command, for example by calculation, the acceleration does not exceed an acceleration threshold value, for example 5m/s 2 (or 80% of full throttle acceleration), it is determined that the vehicle running safety is not violated; for another example, if it is determined that the braking instruction is issued, the deceleration does not exceed a deceleration threshold value such as 3m/s 2 If the deceleration is greater than the deceleration threshold value, such as 3m/s, it is determined that the vehicle safety is not violated 2 Combining front road condition information acquired by the ADAS system, if emergency braking is needed, running safety is not violated, and if emergency braking is not needed, a driver is prompted to give the control instructionPotential safety hazards exist (brain wave signals and brake pedal signals are mutually isolated, and if a driver applies emergency braking through a brake pedal, emergency braking is still performed);
if the control command is a transverse control command, whether the vehicle is safe or not is judged according to the vehicle speed and the transverse acceleration.
Whether the current vehicle runs at a high speed or not is judged firstly, for example, when the vehicle speed is greater than a vehicle speed threshold value, for example, 40km/s, the current vehicle runs at a high speed, and when the vehicle speed is less than or equal to the vehicle speed threshold value, the current vehicle runs at a low speed.
If the lateral acceleration is smaller than the first lateral acceleration threshold value, such as 1.1m/s, during high-speed driving 2 If the traffic safety is not violated, otherwise, the traffic safety is violated.
If the lateral acceleration is less than the second lateral acceleration threshold value, e.g. 1.3m/s, during low speed driving 2 If the traffic safety is not violated, otherwise, the traffic safety is violated.
In step 104, the content of the control command that cannot be implemented by the current cabin system is prompted, and various modes are available, for example, the content is displayed in a head up display mode by using a HUD module; for another example, the broadcast is performed by a voice recognition broadcast system. Alternatively, the two modes are combined.
In the step 104, when the control instruction belongs to a functional instruction that can be implemented by the current cabin system, the driver may be prompted that the corresponding function is to be turned on, and then the control instruction is executed. Various prompting modes are available, for example, a HUD module is utilized to display the prompting modes in a head-up display mode; for another example, the broadcast is performed by a voice recognition broadcast system. Alternatively, the two modes are combined.
The technical proposal of the application is further described with the view angle of passengers.
Since brain waves are perceived through electrodes in brain-computer interface devices (Brain Computer Interface, BCI), each passenger seat side is equipped with a brain-computer interface device.
The passenger uses brain-computer interface equipment to collect and store the brain wave information of instructions related to the functions which can be realized by the current cabin system according to the prompt broadcast by the vehicle voice recognition broadcast system, or the prompt of the central control large screen, or the prompt of the head-up display module.
Above-mentioned when gathering and storing passenger brain wave information, directly do not indicate driving safety instruction, can prevent from the source that the passenger from influencing normal driving, causes the traffic accident.
501: the brain wave information of the passenger is acquired, and the driving intention is recognized to generate a control instruction. The principle of this step is the same as that of the above steps 201 to 203, and will not be described here.
502: judging whether the control instruction belongs to a functional instruction which can be realized by the current cabin system; and if the control instruction belongs to the functional instruction which can be realized by the current cabin system, executing the control instruction, and if the control instruction does not belong to the functional instruction which can be realized by the current cabin system, prompting that the current cabin system cannot realize the content of the control instruction, and exiting.
Referring to fig. 2, the embodiment of the application further provides an intelligent driving interaction system, which includes an electroencephalogram sensing module, a data processing module and a prompt confirmation module, wherein:
brain wave sensing module, it is used for: acquiring brain wave information, and identifying driving intention to generate a control instruction; the brain wave sensing module, namely brain-computer interface device (BCI), can be a hairpiece, a hairband or other forms.
A data processing module for: judging whether the control instruction belongs to a driving safety instruction or not; the data processing module may employ OIB/VIU (central controller/zone controller).
A prompt confirmation module for: when the control instruction belongs to a driving safety instruction, prompting the content of the control instruction and waiting for confirmation; the prompt confirmation module can adopt the HUD module to display in a head-up display mode or adopt a voice recognition broadcasting system to broadcast.
The brain wave sensing module is also used for acquiring a confirmation result and sending the confirmation result to the data processing module.
An execution module for: and executing the control instruction when the result is confirmed to be agreeable, and not executing the control instruction when the result is not agreed. The execution module comprises subsystems in multiple domains, such as an intelligent driving domain, a cabin entertainment domain, a car body domain and the like, and an ECU, wherein the subsystems comprise a NOA function system, a Head Up Display (HUD) system, a sound system, an air conditioning system, an atmosphere lamp system, a central control screen system and the like.
The data processing module is further configured to: and when the control instruction does not belong to the driving safety instruction, judging whether the control instruction belongs to a functional instruction which can be realized by the current cabin system.
The execution module is further configured to: and executing the control instruction when the control instruction belongs to the functional instruction which can be realized by the current cabin system.
The prompt confirmation module is further configured to: and when the control instruction does not belong to the functional instruction which can be realized by the current cabin system, prompting that the current cabin system cannot realize the content of the control instruction.
The embodiment of the application also provides a vehicle, which comprises the intelligent driving interaction system.
In the description of the present application, it should be noted that the azimuth or positional relationship indicated by the terms "upper", "lower", etc. are based on the azimuth or positional relationship shown in the drawings, and are merely for convenience of description of the present application and simplification of the description, and are not indicative or implying that the apparatus or element in question must have a specific azimuth, be configured and operated in a specific azimuth, and thus should not be construed as limiting the present application. Unless specifically stated or limited otherwise, the terms "mounted," "connected," and "coupled" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the terms in this application will be understood by those of ordinary skill in the art as the case may be.
It should be noted that in this application, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing is merely a specific embodiment of the application to enable one skilled in the art to understand or practice the application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. The intelligent driving interaction method is characterized by comprising the following steps of:
acquiring brain wave information, and identifying driving intention to generate a control instruction;
judging whether the control instruction belongs to a driving safety instruction or not;
if the control instruction belongs to the driving safety instruction, prompting the content of the control instruction, acquiring a confirmation result, executing the control instruction when the confirmation result is agreeing, and not executing the control instruction when the confirmation result is disagreeing;
if the control instruction does not belong to the driving safety instruction, judging whether the control instruction belongs to a functional instruction which can be realized by the current cabin system; and if the control instruction belongs to the functional instruction which can be realized by the current cabin system, executing the control instruction, and if the control instruction does not belong to the functional instruction which can be realized by the current cabin system, prompting that the current cabin system cannot realize the content of the control instruction, and exiting.
2. The intelligent driving interaction method according to claim 1, wherein the brain wave information is acquired and the driving intention is recognized to generate the control instruction, comprising the steps of:
acquiring brain wave information and matching the brain wave information with a stored brain wave template set, wherein the brain wave template set comprises brain wave templates formed by different driving safety instructions and different functional instructions which can be realized by the current cabin system;
if the matching is successful, generating a control instruction corresponding to the brain wave template;
if the matching is unsuccessful, a fuzzy algorithm is adopted to process the brain wave information, and the brain wave information is matched with the stored brain wave template set again.
3. The intelligent driving interaction method according to claim 1, wherein prompting the content of the control instruction comprises the steps of:
displaying the content of the control instruction in a head-up display mode;
and/or broadcasting the content of the control instruction through a voice recognition broadcasting system.
4. The intelligent driving interaction method according to claim 1, wherein the obtaining of the confirmation result includes the steps of:
acquiring brain wave information and matching the brain wave information with a stored brain wave template set, wherein the brain wave template set comprises brain wave templates formed by instructions aiming at agreement and disagreement;
if the matching is successful, generating a control instruction corresponding to the brain wave template;
if the matching is unsuccessful, a fuzzy algorithm is adopted to process the brain wave information, and the brain wave information is matched with the stored brain wave template set again.
5. The intelligent driving interaction method according to claim 1, wherein after consent, and before executing the control instruction, the method further comprises the steps of:
judging whether the control instruction violates driving safety;
if the driving safety is not violated, executing the control instruction;
if the traffic safety is violated, the method is not executed.
6. The intelligent driving interaction method according to claim 1, wherein prompting that the current cabin system cannot realize the content of the control instruction comprises the steps of:
displaying in a head-up display mode;
and/or broadcasting through a voice recognition broadcasting system.
7. The intelligent driving interaction method as claimed in claim 1, wherein:
the driving safety instruction comprises at least one of activating the NOA function, closing the NOA function, starting navigation, switching navigation destinations, prioritizing a navigation route at a high speed, prioritizing a navigation route without going at a high speed, prioritizing a navigation route, minimizing navigation route time and minimizing navigation route distance.
8. The intelligent driving interaction method as claimed in claim 1, wherein:
the functional instructions that the current cabin system can realize include at least one of turning on an atmosphere lamp, turning off an atmosphere lamp, changing an atmosphere lamp color, playing music, turning off music, switching music, turning on an air conditioner, turning off an air conditioner, increasing an air conditioner temperature, decreasing an air conditioner temperature, heating, refrigerating, turning on defogging, turning off defogging, turning on dehumidification, turning off dehumidification, turning on an inner cycle, turning off an inner cycle, turning on an outer cycle, and turning off an outer cycle.
9. An intelligent driving interaction system, characterized in that it comprises:
brain wave sensing module, it is used for: acquiring brain wave information, and identifying driving intention to generate a control instruction;
a data processing module for: judging whether the control instruction belongs to a driving safety instruction or not;
a prompt confirmation module for: when the control instruction belongs to a driving safety instruction, prompting the content of the control instruction and waiting for confirmation;
the brain wave sensing module is also used for acquiring a confirmation result;
an execution module for: when the result is confirmed to be agreeable, executing the control instruction, and when the result is not agreeable, not executing the control instruction;
the data processing module is further configured to: when the control instruction does not belong to a driving safety instruction, judging whether the control instruction belongs to a functional instruction which can be realized by the current cabin system;
the execution module is further configured to: executing the control instruction when the control instruction belongs to a functional instruction which can be realized by the current cabin system;
the prompt confirmation module is further configured to: and when the control instruction does not belong to the functional instruction which can be realized by the current cabin system, prompting that the current cabin system cannot realize the content of the control instruction.
10. A vehicle comprising the intelligent driving interaction system of claim 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310222865.1A CN116461544A (en) | 2023-03-09 | 2023-03-09 | Intelligent driving interaction method, intelligent driving interaction system and vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310222865.1A CN116461544A (en) | 2023-03-09 | 2023-03-09 | Intelligent driving interaction method, intelligent driving interaction system and vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116461544A true CN116461544A (en) | 2023-07-21 |
Family
ID=87172454
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310222865.1A Pending CN116461544A (en) | 2023-03-09 | 2023-03-09 | Intelligent driving interaction method, intelligent driving interaction system and vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116461544A (en) |
-
2023
- 2023-03-09 CN CN202310222865.1A patent/CN116461544A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106467106B (en) | System and method for driver assistance | |
| CN106467113B (en) | System and method for driver assistance | |
| JP6287728B2 (en) | In-vehicle system, vehicle control device, and program for vehicle control device | |
| JP6761967B2 (en) | Driving support method and driving support device, automatic driving control device, vehicle, program using it | |
| US20190092169A1 (en) | Gesture and Facial Expressions Control for a Vehicle | |
| JP4305289B2 (en) | VEHICLE CONTROL DEVICE AND VEHICLE CONTROL SYSTEM HAVING THE DEVICE | |
| CN107499311A (en) | Switching method, device and the equipment of driving model | |
| US20050256635A1 (en) | System and method for assigning a level of urgency to navigation cues | |
| US20050107925A1 (en) | Method and divece for outputting data relating to information of a motor vehicle | |
| CN113071417B (en) | Intelligent cabin with multi-screen interaction, control method thereof and vehicle | |
| CN109863060A (en) | For controlling the method for the massage unit for the massage apparatus being arranged in seat, for the seat arrangement in vehicle or vehicle | |
| JP2012198052A (en) | On-vehicle function control device | |
| CN113212273B (en) | Vehicle control method, device, equipment and storage medium | |
| CN116323349A (en) | Vehicle guidance system and method for operating a driving function according to an expected stop duration | |
| CN116461544A (en) | Intelligent driving interaction method, intelligent driving interaction system and vehicle | |
| US20200096356A1 (en) | Method for a user/vehicle interface, and user/vehicle interface | |
| CN111845749A (en) | Control method and system for automatically driving vehicle | |
| EP4339024A1 (en) | Lighting system control method, lighting system and vehicle | |
| KR101713737B1 (en) | Device for contorlling vehicle environment using bluetooth and method for contorlling vehicle environment using the same | |
| CN110774992B (en) | Operation assistance system and operation assistance method | |
| CN111890871A (en) | Bluetooth headset for automobile control, automobile control system and control method | |
| CN210062854U (en) | Vehicle-mounted intelligent voice system | |
| CN116368048A (en) | Vehicle guidance system and method for outputting information about a signal unit | |
| CN112406886A (en) | Vehicle control device and control method, vehicle, and storage medium | |
| CN214689315U (en) | Vehicle-mounted cabin system and vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |