CN112951220B - Voice redundancy braking method and system, computer equipment and readable storage medium thereof - Google Patents

Voice redundancy braking method and system, computer equipment and readable storage medium thereof Download PDF

Info

Publication number
CN112951220B
CN112951220B CN201911170631.7A CN201911170631A CN112951220B CN 112951220 B CN112951220 B CN 112951220B CN 201911170631 A CN201911170631 A CN 201911170631A CN 112951220 B CN112951220 B CN 112951220B
Authority
CN
China
Prior art keywords
voice
braking
vehicle
signal
message
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911170631.7A
Other languages
Chinese (zh)
Other versions
CN112951220A (en
Inventor
李赛赛
黄亮
高靖宇
丁超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Automobile Group Co Ltd
Original Assignee
Guangzhou Automobile Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Automobile Group Co Ltd filed Critical Guangzhou Automobile Group Co Ltd
Priority to CN201911170631.7A priority Critical patent/CN112951220B/en
Publication of CN112951220A publication Critical patent/CN112951220A/en
Application granted granted Critical
Publication of CN112951220B publication Critical patent/CN112951220B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60T—VEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL; ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES
    • B60T7/00—Brake-action initiating means
    • B60T7/02—Brake-action initiating means for personal initiation
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60T—VEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL; ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES
    • B60T8/00—Arrangements for adjusting wheel-braking force to meet varying vehicular or ground-surface conditions, e.g. limiting or varying distribution of braking force
    • B60T8/17—Using electrical or electronic regulation means to control braking
    • B60T8/1755—Brake regulation specially adapted to control the stability of the vehicle, e.g. taking into account yaw rate or transverse acceleration in a curve
    • B60T8/17558—Brake regulation specially adapted to control the stability of the vehicle, e.g. taking into account yaw rate or transverse acceleration in a curve specially adapted for collision avoidance or collision mitigation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00—Speaker identification or verification techniques
    • G10L17/22—Interactive procedures; Man-machine interfaces
    • G10L17/24—Interactive procedures; Man-machine interfaces the user being prompted to utter a password or a predefined phrase
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Computational Linguistics (AREA)
  • Regulating Braking Force (AREA)

Abstract

The invention relates to a voice redundancy braking method and a system thereof, a computer device and a readable storage medium, wherein the method comprises the following steps: during the running process of the vehicle, monitoring whether the braking control function of the ADAS system fails or not in real time; when the braking control function of the ADAS system fails, generating a voice braking start signal; and according to the voice brake starting signal, acquiring in real time and generating a first message for controlling the vehicle brake according to the voice signal of the driver. The system corresponds to the method and is a carrier for realizing the method; the storage medium is a computer readable storage medium having stored thereon a computer program for implementing the method. The computer device includes the system or the storage medium. By implementing the method and the device, the collision risk caused by manual stepping on the brake pedal by the driver after the ADAS function fails can be reduced.

Description

Voice redundancy braking method and system, computer equipment and readable storage medium thereof
Technical Field
The invention relates to the technical field of vehicle safety, in particular to a voice redundancy braking method and a system, computer equipment and a computer readable storage medium thereof.
Background
In the field of advanced driving assistance systems (Advanced Driving Assistant System, abbreviated as ADAS) at present, objects such as vehicles and pedestrians in front of vehicles can be detected through facilities such as radars and cameras arranged in front of the vehicles, and when the distance between the vehicle and the objects is too small, an ADAS system integrating the radars and the cameras can request a brake control system such as an electronic stability control system (Electronic Stability Controller, abbreviated as ESC) and a brake system (eboster) to decelerate and even stop the vehicle. However, after the ADAS function of the fusion radar and the camera fails, when a driver finds that the vehicle does not brake, the driver manually steps on the brake pedal, the process has long time, the driving distance of the vehicle is large during the process, and the collision risk is increased.
Disclosure of Invention
The invention aims to provide a voice redundancy braking method, a system thereof, computer equipment and a computer readable storage medium, so as to reduce the collision risk of manual stepping on a brake pedal by a driver after ADAS function failure to at least a certain extent.
In a first aspect, an embodiment of the present invention provides a method for braking speech redundancy, including:
during the running process of the vehicle, monitoring whether the braking control function of the ADAS system fails or not in real time;
when the braking control function of the ADAS system fails, generating a voice braking start signal;
and according to the voice brake starting signal, acquiring in real time and generating a first message for controlling the vehicle brake according to the voice signal of the driver.
Further, the step of obtaining in real time and generating a first message for controlling braking of the vehicle according to the voice signal of the driver includes:
acquiring an in-vehicle voice signal in real time, analyzing the in-vehicle voice signal to obtain tone characteristics of the in-vehicle voice signal, and comparing the tone characteristics with preset tone characteristics of a driver;
if the tone color characteristics are consistent with the preset tone color characteristics of the driver, decoding the in-vehicle voice signal to obtain voice content;
and generating a first message according to the voice content and sending the first message to a vehicle brake control unit.
Further, the generating the first message according to the voice content includes:
and comparing the voice content with preset voice content, and if the comparison result shows that the voice content is consistent with the preset voice content, generating a first message.
Further, the generating the first message according to the voice content includes:
analyzing the voice signal in the vehicle to obtain the signal intensity and/or the change rate of the voice signal, and determining the braking intensity of braking according to the signal intensity and/or the change rate;
and generating a first message according to the braking strength and the voice content.
Further, the determining the braking strength of the brake according to the signal strength and/or the change rate comprises:
when the vehicle ABS function is not activated, the signal strength and/or the rate of change of the speech signal is proportional to the brake strength of the vehicle brake;
when the ABS function of the vehicle is activated, the braking strength of the vehicle brake is a preset constant value.
Further, the monitoring whether the braking control function of the ADAS system fails in real time includes:
the ADAS system monitors a second message sent to the vehicle brake control unit in real time;
judging whether the braking control function of the ADAS system fails according to the second message, wherein if the second message is lost or the second message is wrong, judging that the braking control function of the ADAS system fails.
In a second aspect, an embodiment of the present invention proposes a redundant speech braking system, configured to implement a redundant speech braking method according to the embodiment of the present invention, including:
the monitoring unit is used for monitoring whether the braking control function of the ADAS system is invalid or not in real time in the running process of the vehicle;
the starting unit is used for receiving the monitoring signal of the monitoring unit, and generating a voice braking starting signal when the received monitoring signal is failure of the braking control function of the ADAS system;
and the voice braking unit is used for acquiring in real time and generating a first message for controlling the vehicle braking according to the voice braking starting signal and the voice signal of the driver.
Wherein, the pronunciation braking unit includes:
the voice signal acquisition unit is used for acquiring the voice signal in the vehicle in real time;
the voice signal analysis unit is used for analyzing the voice signal in the vehicle to obtain tone characteristics, signal strength and/or change rate of the voice signal;
the tone color comparison unit is used for comparing the tone color characteristics with preset driver tone color characteristics, and if the tone color characteristics are consistent with the preset driver tone color characteristics as a comparison result, the in-vehicle voice signals are sent to the decoding unit;
the decoding unit is used for receiving the in-car voice signal of the tone color comparison unit and decoding the in-car voice signal to obtain voice content of the in-car voice signal;
a brake strength determining unit for determining a brake strength of the brake according to the signal strength and/or the change rate;
and the compiling unit is used for generating a first message according to the voice content and the braking strength and sending the first message to the vehicle braking control unit.
In a third aspect, an embodiment of the present invention proposes a computer device, including: according to the voice redundancy braking system disclosed by the embodiment of the invention; or, a memory and a processor, the memory having stored therein computer readable instructions which, when executed by the processor, cause the processor to perform the steps of the speech redundancy braking method according to an embodiment of the present invention.
In a fourth aspect, an embodiment of the present invention proposes a computer readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, implements the steps of the speech redundancy braking method according to the embodiment of the present invention.
The embodiment of the invention provides a voice redundancy braking method, a system thereof, computer equipment and a computer readable storage medium, wherein a braking redundancy backup is provided for a braking control function of an ADAS system which fuses radar and a camera through voice sounding of an owner, specifically, when the braking control function of the ADAS system of a vehicle fails, the voice redundancy braking function is started, a voice signal sent by the owner is obtained in real time, and a first message for controlling the braking of the vehicle is generated according to the voice signal, so that the response time of the owner is shortened, the execution time of a mechanical structure is shortened, the response distance is shortened, and the collision risk of the vehicle is reduced.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings. Of course, it is not necessary for any one product or method of practicing the invention to achieve all of the advantages set forth above at the same time.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of a voice redundancy braking method according to a first embodiment of the invention.
Fig. 2 is a schematic diagram of an ADAS system for implementing a vehicle brake control function.
FIG. 3 is a graph of brake strength versus sound decibels and their rate of change.
Fig. 4 is a schematic diagram of a speech redundancy braking system according to a second embodiment of the present invention.
Fig. 5 is a schematic diagram illustrating an application of a voice redundancy brake system according to a second embodiment of the present invention.
Detailed Description
Various exemplary embodiments, features and aspects of the disclosure will be described in detail below with reference to the drawings. In the drawings, like reference numbers indicate identical or functionally similar elements. Although various aspects of the embodiments are illustrated in the accompanying drawings, the drawings are not necessarily drawn to scale unless specifically indicated.
In addition, numerous specific details are set forth in the following examples in order to provide a better illustration of the invention. It will be understood by those skilled in the art that the present invention may be practiced without some of these specific details. In some instances, well known means have not been described in detail in order to not obscure the present invention.
Example 1
The first embodiment of the invention provides a voice redundancy braking method which is applied to vehicle braking, can add an intelligent voice redundancy braking function for a vehicle and is used as a redundancy braking scheme after the braking control function of an ADAS system fails.
Fig. 1 is a flowchart of a method for voice redundancy braking according to an embodiment, referring to fig. 1, the method according to an embodiment includes steps S101 to S103 as follows:
step S101, monitoring whether a brake control function of an ADAS system fails in real time in the running process of a vehicle;
specifically, the advanced driving assistance system (Advanced Driving Assistant System, ADAS) is to use various sensors (millimeter wave radar, laser radar, single/double camera and satellite navigation) installed on a vehicle to sense surrounding environment at any time during the running of the vehicle, collect data, identify, detect and track static and dynamic objects, and combine with navigator map data to perform systematic operation and analysis, thereby enabling a driver to perceive possible danger in advance, and effectively increasing the comfort and safety of the driving of the vehicle, and the advanced driving assistance system comprises a vehicle brake control function.
Referring to fig. 2, referring to a schematic diagram of an ADAS system for implementing a vehicle brake control function, in a normal working condition, referring to fig. 2, the ADAS system 100 generates a brake command according to sensing signals of sensors such as millimeter wave radar, laser radar, a single/double camera, and the like, and sends the brake command to the vehicle brake control unit 200, where the vehicle brake control unit 200 is, for example, an electronic stability control system (Electronic Stability Controller, abbreviated as ESC) and a brake system (such as eboster ECU, etc.), and the vehicle brake control unit 200 controls a brake actuator 300 to execute the brake command to perform braking according to the brake command, and the brake actuator 300 is, for example, a hydraulic actuator, and uses a caliper, a brake disc, etc. to perform braking.
In this embodiment, whether the braking control function of the ADAS system fails is monitored in real time during the running process of the vehicle, and it can be understood that failure determination can be performed by one or more operation manifestations of the ADAS system, and this embodiment is not limited to a certain determination form.
Step S102, when the braking control function of the ADAS system fails, generating a voice braking start signal;
specifically, when the brake control function of the ADAS system is monitored to be invalid, a voice brake starting signal is generated, and the voice brake starting signal is an enabling signal which is used for activating the voice redundant brake function of the vehicle.
Step S103, according to the voice brake starting signal, a first message for controlling the braking of the vehicle is obtained in real time and generated according to the voice signal of the driver.
Specifically, step S103 is a specific implementation procedure of the voice redundancy braking function of the vehicle, and when the voice redundancy braking function of the vehicle is activated, it is monitored in real time whether a voice signal of the driver is obtained, and when the voice signal of the driver is obtained, a first message for controlling the braking of the vehicle is generated according to the voice signal of the driver.
In order to avoid that other passengers except the driver send a braking instruction to the vehicle in the passenger cabin of the vehicle and interfere with the driving operation of the driver, in step S103, the voice features of the driver may be extracted and stored in advance, before the voice braking is performed, the monitored voice features of the voice signal are compared with the stored voice features, if the comparison result is consistent, it is indicated that the monitored voice signal is sent by the driver, and a first message is further generated according to the specific content of the voice signal, where the first message is the braking instruction for controlling the vehicle to brake.
The first message is in the form of a CAN message, the generated first message is sent to a vehicle brake control unit through a CAN bus of the vehicle, and the vehicle brake control unit controls a brake executing mechanism to execute a brake instruction to brake according to the first message after receiving the first message.
By applying the method of the embodiment, after the ADAS system fails, the response time and the operation time of a driver can be shortened, the braking distance can be shortened, the collision risk and damage can be reduced, and the safety can be improved.
In one embodiment, the step S103 specifically includes:
step S201, acquiring an in-vehicle voice signal in real time, analyzing the in-vehicle voice signal to obtain tone characteristics of the in-vehicle voice signal, and comparing the tone characteristics with preset tone characteristics of a driver;
specifically, before implementation, the method of the embodiment collects the sound of the driver in advance, analyzes the sound of the driver to obtain the tone color characteristics of the driver, and stores the tone color characteristics of the driver in a storage unit of the vehicle for comparison of subsequent tone color characteristics.
After the voice redundant braking function is started, the voice signals in the passenger cabin of the vehicle can be acquired in real time through the corresponding sensing units, and as voice signals sent by other passengers except the driver in the passenger cabin of the vehicle can be generated, the voice signals are required to be distinguished. In this embodiment, one or more in-vehicle voice signals acquired in real time are analyzed to obtain one or more tone characteristics, and then the one or more tone characteristics obtained by analysis are respectively compared with preset driver tone characteristics.
Step S202, if the tone color characteristics are consistent with the preset tone color characteristics of the driver as a comparison result, decoding the in-vehicle voice signal to obtain voice content;
specifically, in step S202, whether to decode the in-vehicle voice signal further or not is determined according to the comparison result in step S201 to obtain the voice content thereof, when the comparison result indicates that the tone characteristic is consistent with the preset driver tone characteristic, the currently obtained in-vehicle voice signal is sent by the driver, and then the in-vehicle voice signal is further decoded to obtain the voice content thereof, so as to determine whether the driver sends a voice control instruction for braking.
And step 203, generating a first message according to the voice content and sending the first message to a vehicle brake control unit.
In an example, the step S203 specifically includes:
comparing the voice content with preset voice content, and if the comparison result shows that the voice content is consistent with the preset voice content, generating a first message; if the comparison result is that the voice content is inconsistent with the preset voice content, the first message is not generated.
Specifically, the preset voice content is content representing a braking instruction, such as "brake", "parking", etc., for example, during running of the vehicle, the ADAS system fails, a voice redundant braking function of the vehicle is started, the driver shouts out of "brake", after the processing in steps S201 to S202, the content of the voice signal in the vehicle is determined to be "brake", which is consistent with the preset voice content "brake", so that it is determined that the driver sends out a voice braking voice instruction, and at this time, a first message is generated.
In another example, the step S203 specifically includes:
step S301, comparing the voice content with preset voice content;
step S302, if the comparison result shows that the voice content is consistent with the preset voice content, acquiring signal intensity and/or change rate of the voice signal in the vehicle, determining braking intensity of braking according to the signal intensity and/or change rate, and generating a first message according to the braking intensity and the voice content; if the comparison result is that the voice content is inconsistent with the preset voice content, the first message is not generated.
Specifically, the preset voice content is the content representing the braking instruction, such as "braking", "braking" and the like, for example, during the running of the vehicle, the ADAS system fails, the voice redundant braking function of the vehicle is started, after the processing of the steps S201 to S202 is performed, the content of the voice signal in the vehicle is determined to be "braking", which is consistent with the preset voice content "braking", so that the driver is determined to send out the voice braking voice instruction, at this time, the signal intensity and/or the change rate of the voice signal in the vehicle are obtained, the braking intensity of the brake is determined according to the signal intensity and/or the change rate, and finally the first message is generated according to the braking intensity and the voice content and sent to the vehicle braking control unit. The vehicle brake control unit controls the vehicle brake actuating mechanism to brake with the brake strength described by the first message after receiving the first message.
It should be noted that, the signal intensity and/or the change rate of the in-vehicle voice signal may be obtained by analyzing the in-vehicle voice signal, where the analyzing process may be that the in-vehicle voice signal is obtained by analyzing the in-vehicle voice signal to obtain a tone characteristic, a signal intensity and/or a change rate, or may be that the in-vehicle voice signal is determined to be a voice braking instruction sent by a driver and then analyzed, where the steps before and after the sequence of steps do not affect the implementation of the embodiment method.
Wherein, determining the braking strength of the brake according to the signal strength and/or the change rate specifically comprises:
when the vehicle ABS function is not activated, the signal strength and/or the rate of change of the speech signal is proportional to the brake strength of the vehicle brake;
when the ABS function of the vehicle is activated, the braking strength of the vehicle brake is a preset constant value.
Specifically, fig. 3 is a schematic diagram of a functional relationship between a braking intensity and a sound dB and a change rate thereof, referring to fig. 3, when an ABS function is not activated, the braking intensity and the sound magnitude (dB) and the change rate (dB/s) thereof are in a linear relationship, but in a real vehicle matching process, fitting and adjusting the functional relationship according to the whole vehicle performance and actual parameters are required; after the ABS function is activated, it means that the vehicle is the safest working condition that the vehicle will not generate dangerous working conditions such as tail flick while fully utilizing the ground adhesion force, so that the braking strength will not rise with the rise of the sound level (dB) and the change rate (dB/s) thereof.
In one embodiment, the step S101 specifically includes:
step S401, a second message sent to a vehicle brake control unit by an ADAS system is monitored in real time;
and step S402, judging whether the braking control function of the ADAS system fails according to the second message, wherein if the second message is lost or the second message is wrong, judging that the braking control function of the ADAS system fails.
Specifically, the ADAS system generates a second message, namely a braking instruction, according to sensing signals of sensors such as millimeter wave radar, laser radar, a single/double camera and the like, and sends the second message to a vehicle braking control unit, and the vehicle braking control unit controls a braking executing mechanism to execute the braking instruction to brake according to the braking instruction. The second message has a predetermined format, such as message type, message version, message length, message entity, and so on. In the step, by monitoring the second message sent by the ADAS system and judging whether the second message sent by the ADAS system is correct, whether the braking control function of the ADAS system is invalid or not can be judged.
Example two
A second embodiment of the present invention provides a redundant speech braking system 400 for implementing the redundant speech braking method according to the first embodiment of the present invention, fig. 4 is a frame diagram of the system according to the second embodiment, fig. 5 is an application schematic diagram of the system according to the second embodiment, and referring to fig. 4-5, the system includes:
the monitoring unit 1 is used for monitoring whether the braking control function of the ADAS system is invalid or not in real time in the running process of the vehicle;
the starting unit 2 is used for receiving the monitoring signal of the monitoring unit, and generating a voice braking starting signal when the received monitoring signal is failure of the braking control function of the ADAS system;
and the voice braking unit 3 is used for acquiring in real time and generating a first message for controlling the vehicle braking according to the voice signal of the driver according to the voice braking starting signal.
In one embodiment, the voice brake unit 3 includes:
a voice signal acquisition unit 31 for acquiring an in-vehicle voice signal in real time;
a voice signal analysis unit 32, configured to analyze the in-vehicle voice signal to obtain a tone characteristic, a signal intensity and/or a change rate thereof;
a tone color comparison unit 33, configured to compare the tone color characteristic with a preset driver tone color characteristic, and if the tone color characteristic is consistent with the preset driver tone color characteristic as a result of the comparison, send the in-vehicle voice signal to a decoding unit;
a decoding unit 34, configured to receive the in-vehicle voice signal of the tone color comparison unit, and decode the in-vehicle voice signal to obtain voice content thereof;
a brake intensity determining unit 35 for determining a brake intensity of the brake according to the signal intensity and/or the change rate;
the compiling unit 36 is configured to generate a first message according to the voice content and the braking strength, and send the first message to the vehicle braking control unit 4.
In an embodiment, the monitoring unit 1 comprises:
the message acquisition unit 11 is used for monitoring a second message sent to the vehicle brake control unit by the ADAS system in real time;
and the message analysis unit 12 is configured to determine whether the braking control function of the ADAS system fails according to the second message, where if the second message is lost or the second message is wrong, it is determined that the braking control function of the ADAS system fails.
The system embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. In addition, in the system embodiment of the present invention, the connection relationship between the modules represents that there is a communication connection between them, and may be specifically implemented as one or more communication buses or signal lines. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
It should be noted that, the system of the second embodiment corresponds to the method of the first embodiment, and therefore, a portion of the system of the second embodiment that is not described in detail may be obtained by referring to the content of the method of the first embodiment, which is not described herein.
Also, the voice redundant brake system, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium.
Example III
An embodiment of the present invention provides a computer device, including: the speech redundant brake system of embodiment two; or, a memory and a processor, the memory having stored therein computer readable instructions which, when executed by the processor, cause the processor to perform the steps of the speech redundancy braking method according to embodiment one.
Of course, the computer device may also have a wired or wireless network interface, a keyboard, an input/output interface, and other components for implementing the functions of the device, which are not described herein.
The computer program may be divided into one or more units, which are stored in the memory and executed by the processor to accomplish the present invention, for example. The one or more elements may be a series of computer program instruction segments capable of performing the specified functions, which instruction segments describe the execution of the computer program in the computer device.
The processor may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like that is a control center of the computer device, connecting various interfaces and lines throughout the various portions of the computer device.
The memory may be used to store the computer program and/or elements, and the processor may implement various functions of the computer device by running or executing the computer program and/or elements stored in the memory, and invoking data stored in the memory. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as a hard disk, memory, plug-in hard disk, smart Media Card (SMC), secure Digital (SD) Card, flash Card (Flash Card), at least one disk storage device, flash memory device, or other volatile solid-state storage device.
Example IV
The fourth embodiment of the present invention provides a computer readable storage medium having a computer program stored thereon, where the computer program when executed by a processor implements the steps of the voice redundancy braking method of the first embodiment.
In particular, the computer-readable storage medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), or the like.
The foregoing description of embodiments of the invention has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the various embodiments described. The terminology used herein was chosen in order to best explain the principles of the embodiments, the practical application, or the technical improvements in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims (10)

1. A method of redundant braking of speech, comprising:
during the running process of the vehicle, monitoring whether the braking control function of the ADAS system fails or not in real time;
when the braking control function of the ADAS system fails, generating a voice braking start signal;
and according to the voice brake starting signal, acquiring in real time and generating a first message for controlling the vehicle brake according to the voice signal of the driver.
2. The method of claim 1, wherein the obtaining in real time and generating a first message for controlling braking of the vehicle based on the driver's voice signal comprises:
acquiring an in-vehicle voice signal in real time, analyzing the in-vehicle voice signal to obtain tone characteristics of the in-vehicle voice signal, and comparing the tone characteristics with preset tone characteristics of a driver;
if the tone color characteristics are consistent with the preset tone color characteristics of the driver, decoding the in-vehicle voice signal to obtain voice content;
and generating a first message according to the voice content and sending the first message to a vehicle brake control unit.
3. The method of claim 2, wherein generating the first message from the voice content comprises:
and comparing the voice content with preset voice content, and if the comparison result shows that the voice content is consistent with the preset voice content, generating a first message.
4. The method of claim 2, wherein generating the first message from the voice content comprises:
analyzing the voice signal in the vehicle to obtain the signal intensity and/or the change rate of the voice signal, and determining the braking intensity of vehicle braking according to the signal intensity and/or the change rate;
and generating a first message according to the braking strength and the voice content.
5. The method of claim 4, wherein said determining a brake strength of a vehicle brake based on said signal strength and/or rate of change comprises:
when the vehicle ABS function is not activated, the signal strength and/or the rate of change of the speech signal is proportional to the brake strength of the vehicle brake;
when the ABS function of the vehicle is activated, the braking strength of the vehicle brake is a preset constant value.
6. The voice redundant braking method of any one of claims 1-5, wherein the real-time monitoring of whether a braking control function of an ADAS system fails comprises:
the ADAS system monitors a second message sent to the vehicle brake control unit in real time;
judging whether the braking control function of the ADAS system fails according to the second message, wherein if the second message is lost or the second message is wrong, judging that the braking control function of the ADAS system fails.
7. A speech redundancy braking system for implementing the speech redundancy braking method of any one of claims 1-6, comprising:
the monitoring unit is used for monitoring whether the braking control function of the ADAS system is invalid or not in real time in the running process of the vehicle;
the starting unit is used for receiving the monitoring signal of the monitoring unit, and generating a voice braking starting signal when the received monitoring signal is failure of the braking control function of the ADAS system;
and the voice braking unit is used for acquiring in real time and generating a first message for controlling the vehicle braking according to the voice braking starting signal and the voice signal of the driver.
8. The speech redundant brake system of claim 7, wherein the speech brake unit comprises:
the voice signal acquisition unit is used for acquiring the voice signal in the vehicle in real time;
the voice signal analysis unit is used for analyzing the voice signal in the vehicle to obtain tone characteristics, signal strength and/or change rate of the voice signal;
the tone color comparison unit is used for comparing the tone color characteristics with preset driver tone color characteristics, and if the tone color characteristics are consistent with the preset driver tone color characteristics as a comparison result, the in-vehicle voice signals are sent to the decoding unit;
the decoding unit is used for receiving the in-car voice signal of the tone color comparison unit and decoding the in-car voice signal to obtain voice content of the in-car voice signal;
a brake strength determining unit for determining a brake strength of the brake according to the signal strength and/or the change rate;
and the compiling unit is used for generating a first message according to the voice content and the braking strength and sending the first message to the vehicle braking control unit.
9. A computer device, comprising: the speech redundant braking system according to any one of claims 7-8; or, a memory and a processor, the memory having stored therein computer readable instructions that, when executed by the processor, cause the processor to perform the steps of the speech redundancy braking method of any of claims 1-6.
10. A computer-readable storage medium having stored thereon a computer program, characterized by: the computer program when executed by a processor implements the steps of the speech redundancy braking method of any one of claims 1-6.
CN201911170631.7A 2019-11-26 2019-11-26 Voice redundancy braking method and system, computer equipment and readable storage medium thereof Active CN112951220B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911170631.7A CN112951220B (en) 2019-11-26 2019-11-26 Voice redundancy braking method and system, computer equipment and readable storage medium thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911170631.7A CN112951220B (en) 2019-11-26 2019-11-26 Voice redundancy braking method and system, computer equipment and readable storage medium thereof

Publications (2)

Publication Number Publication Date
CN112951220A CN112951220A (en) 2021-06-11
CN112951220B true CN112951220B (en) 2024-03-01

Family

ID=76224945

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911170631.7A Active CN112951220B (en) 2019-11-26 2019-11-26 Voice redundancy braking method and system, computer equipment and readable storage medium thereof

Country Status (1)

Country Link
CN (1) CN112951220B (en)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103287362A (en) * 2013-06-25 2013-09-11 安科智慧城市技术（中国）有限公司 Vehicle-mounted voice control system and method and electric automobile
CN204249983U (en) * 2014-11-28 2015-04-08 重庆交通大学 Promptly system of fastening the safety belt is pointed out in motorcoach misfunctioning of brake situation
CN105667475A (en) * 2016-03-18 2016-06-15 戴姆勒股份公司 Automatic brake system for vehicle
CN106143439A (en) * 2016-09-20 2016-11-23 阜南县申通机械制造有限公司 A kind of emergency brake system during brake failure
CN106143452A (en) * 2016-09-24 2016-11-23 华北理工大学 Selectivity acoustic control brake system and method
CN106571133A (en) * 2015-10-12 2017-04-19 百度在线网络技术（北京）有限公司 Speech recognition-based brake instruction generation method and device and vehicle-mounted system
JP2018017294A (en) * 2016-07-27 2018-02-01 本田技研工業株式会社 Controller of vehicle
CN108674404A (en) * 2018-04-02 2018-10-19 戴姆勒股份公司 A kind of method and apparatus for carrying out Redundant Control to motor vehicle braking system
CN109410938A (en) * 2018-11-28 2019-03-01 途客电力科技（天津）有限公司 Control method for vehicle, device and car-mounted terminal
CN110060676A (en) * 2019-04-02 2019-07-26 北京长城华冠汽车科技股份有限公司 Vehicle starting control system and vehicle based on speech recognition technology
WO2019205014A1 (en) * 2018-04-25 2019-10-31 深圳市元征软件开发有限公司 Driving behavior analysis method and driving behavior analysis device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6849705B2 (en) * 2016-06-24 2021-03-24 スイス リインシュランス カンパニー リミテッド Autonomous or partially autonomous vehicles, including automated risk control systems, and corresponding methods

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103287362A (en) * 2013-06-25 2013-09-11 安科智慧城市技术（中国）有限公司 Vehicle-mounted voice control system and method and electric automobile
CN204249983U (en) * 2014-11-28 2015-04-08 重庆交通大学 Promptly system of fastening the safety belt is pointed out in motorcoach misfunctioning of brake situation
CN106571133A (en) * 2015-10-12 2017-04-19 百度在线网络技术（北京）有限公司 Speech recognition-based brake instruction generation method and device and vehicle-mounted system
CN105667475A (en) * 2016-03-18 2016-06-15 戴姆勒股份公司 Automatic brake system for vehicle
JP2018017294A (en) * 2016-07-27 2018-02-01 本田技研工業株式会社 Controller of vehicle
CN106143439A (en) * 2016-09-20 2016-11-23 阜南县申通机械制造有限公司 A kind of emergency brake system during brake failure
CN106143452A (en) * 2016-09-24 2016-11-23 华北理工大学 Selectivity acoustic control brake system and method
CN108674404A (en) * 2018-04-02 2018-10-19 戴姆勒股份公司 A kind of method and apparatus for carrying out Redundant Control to motor vehicle braking system
WO2019205014A1 (en) * 2018-04-25 2019-10-31 深圳市元征软件开发有限公司 Driving behavior analysis method and driving behavior analysis device
CN109410938A (en) * 2018-11-28 2019-03-01 途客电力科技（天津）有限公司 Control method for vehicle, device and car-mounted terminal
CN110060676A (en) * 2019-04-02 2019-07-26 北京长城华冠汽车科技股份有限公司 Vehicle starting control system and vehicle based on speech recognition technology

Also Published As

Publication number Publication date
CN112951220A (en) 2021-06-11

Similar Documents

Publication Publication Date Title
CN108944874B (en) Control method and system for electric automobile remote control driving
CN112109690B (en) Automatic parking control method, device and computer readable storage medium
US8126605B2 (en) Computing platform for multiple intelligent transportation systems in an automotive vehicle
CN110103931B (en) Method and device for detecting abnormal braking of vehicle
CN109969150B (en) Safe driving auxiliary method and system and vehicle
US10747222B2 (en) Traveling control system
US10392029B2 (en) Method and device for the output of haptic information to the driver of a motor vehicle via the brake pedal
CN112298070A (en) Pedal fault diagnosis method and device
US20210089018A1 (en) Method for controlling a motor vehicle remotely
CN110239539B (en) Vehicle control device and vehicle
CN114559957A (en) Vehicle fault tolerance time calculation method, system, medium, and electronic device
CN112389455B (en) Method and system for protecting safe operation of automatic driving vehicle
US11097699B2 (en) Method for activating a parking brake of a motor vehicle, and system for controlling a parking brake of a motor vehicle
CN112951220B (en) Voice redundancy braking method and system, computer equipment and readable storage medium thereof
CN113002554B (en) Redundant braking system, autonomous vehicle, and corresponding methods and media
JP2006527118A (en) Apparatus and method for braking a vehicle
CN112590749A (en) Vehicle brake control method, device, equipment and storage medium
CN114980432B (en) Multi-vehicle atmosphere lamp interaction method and vehicle interaction method
US11108658B2 (en) Method for detecting data, method for updating a scenario catalog, a device, a computer program and a machine-readable memory medium
US20220379856A1 (en) Automatic brake control apparatus for vehicle
CN113859190B (en) Early warning braking method and device for automatic driving vehicle, vehicle and storage medium
KR102643002B1 (en) Communication apparatus for connected autonomous driving and method thereof
CN114056305A (en) Control method and device of vacuum boosting system and storage medium
KR102455977B1 (en) Method, electronic control unit and epb system for controlling bed-in, and computer-readable medium storing program for executing the same
US20210089044A1 (en) Method for controlling a motor vehicle remotely

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant