CN112951227A - Vehicle voice control method - Google Patents

Vehicle voice control method Download PDF

Info

Publication number
CN112951227A
CN112951227A CN202110128255.6A CN202110128255A CN112951227A CN 112951227 A CN112951227 A CN 112951227A CN 202110128255 A CN202110128255 A CN 202110128255A CN 112951227 A CN112951227 A CN 112951227A
Authority
CN
China
Prior art keywords
vehicle
authority
control
instruction
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110128255.6A
Other languages
Chinese (zh)
Other versions
CN112951227B (en
Inventor
席宁
李想
贾雪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Liaoning Petrochemical Vocational and Technical College
Original Assignee
Liaoning Petrochemical Vocational and Technical College
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Liaoning Petrochemical Vocational and Technical College filed Critical Liaoning Petrochemical Vocational and Technical College
Priority to CN202110128255.6A priority Critical patent/CN112951227B/en
Publication of CN112951227A publication Critical patent/CN112951227A/en
Application granted granted Critical
Publication of CN112951227B publication Critical patent/CN112951227B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0216—Noise filtering characterised by the method used for estimating noise
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0216—Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02166—Microphone arrays; Beamforming

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Multimedia (AREA)
  • Automation & Control Theory (AREA)
  • Quality & Reliability (AREA)
  • Signal Processing (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

The invention discloses a vehicle voice control method, which comprises the following steps: step one, determining an area for sending out an audio signal; step two, identifying the audio signal, judging the attribute of a passenger sending the audio signal, and judging a control instruction corresponding to the audio signal; step three, judging whether the control instruction is an executable instruction or not according to an area for sending the audio frequency, the attribute of the passenger sending the audio frequency signal and the control instruction corresponding to the audio frequency signal; and step four, when the control instruction is an executable instruction, controlling the vehicle to execute the control instruction.

Description

Vehicle voice control method
Technical Field
The invention belongs to the technical field of vehicle voice control, and particularly relates to a vehicle voice control method.
Background
Along with the development of vehicle technique, more and more vehicles are equipped with the speech control function for the driver can come control vehicle through pronunciation when the driving, can promote the intelligent degree of vehicle when the guarantee drives safety, can also promote and drive the enjoyment.
In order to implement voice control for a vehicle, manufacturers generally install a microphone in a driving area of the vehicle, so that the vehicle can perform corresponding operations according to an audio signal received by the microphone. However, in practical use, because the microphone is only installed in the driving area, when the passenger or the passenger in the rear row wants to perform voice control, the distance is too far, so that the audio signal cannot be accurately received by the microphone, and situations such as voice recognition failure or recognition error may occur. Therefore, this vehicle voice control method can accurately perform only the uttered audio signal of the driver, and has a poor performance on the uttered audio signals of the passenger in the front and rear seats.
In order to improve the voice control effect of a passenger seat and a rear passenger on a vehicle, microphones are additionally arranged in the passenger seat and the rear passenger respectively, the three microphones are used for receiving audio signals in a cab, and corresponding operation is executed according to the received audio signals, so that the driver, the passenger seat and the rear passenger can accurately control each function of the vehicle through the sent audio signals.
However, the method of adding a microphone improves the voice control effect of the vehicle, and only can receive the audio signal in the cab more accurately, but cannot distinguish the difference between the driver and other passengers in the vehicle. Is slightly deficient in humanization and intelligence. If a passenger in the front of a vehicle or a passenger in the rear row gives an instruction influencing the running of the vehicle during the running process of the vehicle, for example, when the passenger in the front of the vehicle or the passenger in the rear row gives a control instruction such as adjusting a rearview mirror or controlling the swing of a windshield wiper, the vehicle can cause harm to the running safety after the vehicle executes the control instruction.
And present speech control system all is whole journey operation after the vehicle starts, and meet some special circumstances in the vehicle driving process inevitable, lead to the security of vehicle driving to reduce for a short time, if back row passenger or copilot district passenger carries out speech control to the vehicle this moment, carries out some activities that promote travelling comfort or recreational, can influence driver's normal driving, leads to the emergence of dangerous situation.
Disclosure of Invention
One of the objectives of the present invention is to provide a vehicle voice control method, which can determine whether to execute the command according to the issuing area of the audio signal, the passenger attribute of the audio issuing area and the command authority of the area; the voice control of the vehicle can be realized, and meanwhile, the driving safety of the vehicle is guaranteed.
The invention also aims to determine whether the running state of the vehicle meets the full-area control state or not according to the running state index of the vehicle, and neglect control instructions sent by a copilot area and a rear passenger area when the running state of the vehicle does not meet the full-area control state so as to further improve the driving safety of the vehicle.
The technical scheme provided by the invention is as follows:
a vehicle voice control method, comprising:
step one, determining an area for sending out an audio signal;
step two, identifying the audio signal, judging the attribute of a passenger sending the audio signal, and judging a control instruction corresponding to the audio signal;
step three, judging whether the control instruction is an executable instruction or not according to an area for sending the audio frequency, the attribute of the passenger sending the audio frequency signal and the control instruction corresponding to the audio frequency signal;
and step four, when the control instruction is an executable instruction, controlling the vehicle to execute the control instruction.
Preferably, the audio signal emitting region includes a main driving region, a sub-driving region, and a rear passenger region.
Preferably, the passenger attribute information includes a sex and an age of the passenger.
Preferably, before the third step, the method further includes setting instruction permission corresponding to the region sending the audio signal; when the control instruction sent by the area sending the audio signal is within the corresponding instruction authority range, performing a third step; otherwise, the control instruction is ignored.
Preferably, the instruction authority corresponding to the main driving area is a vehicle control authority;
the instruction authority corresponding to the copilot area at least comprises: video/audio playing authority, navigation authority or co-pilot seat adjustment authority;
the instruction authority corresponding to the rear passenger zone at least comprises: video/audio playing authority and back row sound control authority.
Preferably, in the fourth step, the method further includes:
judging whether the running state of the current vehicle meets the full-area control state or not;
when the control instruction is an executable instruction and the vehicle running state meets a full-region control state, controlling the vehicle to execute the control instruction; otherwise, control commands sent by the passenger compartment and the rear passenger compartment are ignored.
Preferably, it is determined whether the driving state of the vehicle satisfies the all-zone control state according to the driving state index of the vehicle;
wherein the driving state index of the vehicle is:
Figure BDA0002924240350000031
wherein δ represents a vehicle centroid deflection angle, V represents a vehicle speed, and V representsmaxRepresenting the maximum vehicle speed, Sr representing the wheel slip ratio, eta representing a correction coefficient, and lambda representing a driving environment coefficient;
when Rs is greater than 0.6, the running state of the vehicle meets the all-region control state;
and when the Rs is less than or equal to 0.6, the form state of the vehicle does not meet the full-region control state.
Preferably, when the value of the | delta | is less than 8, the value range of the eta is 1.15-1.10;
when | delta | ≧ 8, the value range of η is 0.85-0.9.
Preferably, the driving environment coefficient is:
Figure BDA0002924240350000032
in the formula (I), the compound is shown in the specification,λ0representing the reference environment coefficient, I representing the light intensity of the driving environment, I0Indicating the reference light intensity, T indicating the driving environment temperature, T0Indicating the reference temperature.
Preferably, λ is the ratio of the total surface area of the road surface to the total surface area of the road surface0The value range of (A) is 0.5-0.6;
when the road surface is non-ice snow road surface, lambda0The value range of (A) is 0.9-1.0.
The invention has the beneficial effects that:
the vehicle voice control method provided by the invention can determine whether to execute the instruction according to the issuing area of the audio signal, the passenger attribute of the audio issuing area and the instruction authority of the area; the voice control of the vehicle can be realized, and meanwhile, the driving safety of the vehicle is guaranteed.
The vehicle voice control method provided by the invention can determine whether the running state of the vehicle meets the full-area control state or not according to the running state index of the vehicle, and neglects the control command sent by the copilot area and the rear passenger area when the running state of the vehicle does not meet the full-area control state, so as to further improve the driving safety of the vehicle.
Drawings
FIG. 1 is a schematic diagram of a vehicle voice control system according to the present invention.
Detailed Description
The present invention is further described in detail below with reference to the attached drawings so that those skilled in the art can implement the invention by referring to the description text.
The invention provides a vehicle voice control method which is realized based on a vehicle voice control system.
As shown in fig. 1, the vehicle voice control system includes: the microphone comprises a main microphone 102, a secondary microphone 102, a rear microphone 103, a delay processing module 104, a position determination module 105, an audio noise reduction module 106, an audio execution module 107, a software processing module 108, a sound quality distinguishing module 109 and an application execution module 110.
The main microphone 102 is disposed in the main driving area, and is used for recording audio signals and driving noises of passengers. The secondary microphone 102 is disposed in the secondary driving area and is used for recording audio signals and driving noise of passengers. The rear microphone 103 is disposed in the rear passenger area, and is used for recording the audio signal and the driving noise of the passenger.
The delay processing module 104 is configured to perform phase processing on the three recorded sets of audio signals, correct phase delays of the three sets of audio signals, and integrate the phases of the three sets of audio signals into the same phase. Because the distances between the three microphones and the passengers who send out the audio signals are different, the three microphones can generate a sequence when recording the audio signals, so that phase differences occur among three groups of recorded audio signals, phase delay is generated, and a delay processing module is needed for phase processing.
Meanwhile, the delay processing module 104 is further configured to send the phase differences of the three sets of audio signals to the position determining module 105, and send the three sets of audio signals with the same phase after being sorted to the audio noise reduction module 106.
The position determining module 105 is configured to receive the phase difference between the three sets of audio signals, determine, according to the phase difference, an area where a passenger sending the audio signal is located, generate area information according to the determined area, and send the area information to the audio executing module 107.
The audio noise reduction module 106 is configured to receive three sets of audio signals with the same phase, perform noise reduction on the received three sets of audio signals to obtain a pure audio signal, and send the obtained pure audio signal to the audio execution module 107.
The audio executing module 107 is configured to receive the region information and the pure audio signal, send the received region information and the pure audio signal to the software processing module 108, determine whether the pure audio signal needs to be detected according to the region information, and send the pure audio signal to the sound quality distinguishing module 109 if the pure audio signal needs to be detected.
The software processing module 108 is configured to receive the clean audio signal and the region information, and convert the received clean audio signal into a control command recognizable by the vehicle. And transmits the location information and the control instruction to the application execution module 110.
The sound quality distinguishing module 109 is configured to receive and analyze the clean audio signal, obtain attribute information of the uttered passenger, and send the obtained attribute information to the application execution module 110.
The application execution module 110 is configured to receive the area information, the control instruction, and the attribute information of the speaking passenger. And judging whether the control authority of the area comprises an appointed authority or not according to the area information and the control instruction, wherein the appointed authority is the authority for executing the control instruction. If the authority limit is included, comprehensively analyzing the attribute information and the control instruction of the voice passenger, and sending the analysis result to each corresponding execution module of the vehicle, wherein the vehicle execution module comprises a vehicle-mounted sound entertainment unit and a seat adjusting unit, and the like, and the embodiment of the invention is not specifically limited in this respect, wherein the vehicle-mounted sound entertainment unit is used for searching and playing music and the like according to the control instruction, and the embodiment of the invention is also not specifically limited in this respect.
The audio signal is a signal of a voice command issued by a person, and is an electric signal which expresses the tone, the tone intensity and the tone of the voice command issued by the person through frequency, amplitude and phase.
In the embodiment of the invention, the vehicle simultaneously collects the audio signals sent by passengers through three microphones. The three microphones collect audio signals, the range for receiving the audio signals is enlarged, and the purpose that passengers in three different areas can control the vehicle by voice is achieved.
After the three groups of microphones collect audio signals sent by passengers, the collected audio signals are sent to the delay processing module.
The vehicle determines the area where the passenger sending the audio signal is located according to the received audio signal.
The vehicle can judge which microphone receives the audio signal first according to the phase difference of the three groups of audio signals, and can determine the area where the passenger sending the audio signal is located according to the area where the microphone is located. The microphone is arranged in different areas, so that the source areas of the audio signals are distinguished, the aim of distinguishing a driver from other passengers in the vehicle can be fulfilled, the audio signals sent by the passengers are firstly collected by the microphone closest to the passenger, phase differences of three groups of audio signals received by the vehicle can be caused, and the areas can be determined based on the phase differences among the audio signals.
In the embodiment of the invention, after the delay processing module receives the audio signals collected by the three groups of microphones, the phase difference of the three groups of received audio signals is sent to the position judging module, the position judging module judges the region where the passenger of the audio signal is located according to the received phase difference, region information is generated according to the judged region, and the region information is sent to the audio executing module.
Further, because the microphone is gathering audio signal, still can gather the driving noise of vehicle, so in order to promote the vehicle to audio signal's recognition effect, still need to carry out noise reduction to the audio signal who gathers, above-mentioned noise reduction's process is:
after the delay processing module receives the audio signals collected by the three groups of microphones, three groups of audio signals with the same phase are obtained through phase processing. And the delay processing module sends the obtained three groups of audio signals with the same phase to the audio noise reduction module. The audio noise reduction module receives three groups of audio signals with the same phase, superposes the three groups of audio signals to obtain a group of audio signals, and carries out noise reduction on the superposed group of audio signals in a mode of increasing the signal-to-noise ratio, so that the noise reduction effect is achieved, and pure audio signals are obtained.
In an actual scene, in order to better distinguish a driver from other passengers in a vehicle, two different execution modes can be generated according to different areas where the passengers sending audio signals are located, and when the area where the passengers sending the audio signals are located is a passenger area or a rear passenger area, the method specifically comprises the following steps:
when the vehicle determines that the area sending the audio signal is a passenger driving area or a rear passenger area, the audio signal is detected to obtain attribute information of the passenger sending the audio signal.
Wherein the attribute information includes at least gender and age.
At least one of the tone, the intensity, and the pitch of the passenger's voice is determined based on the phase, the frequency, and the intensity of the audio signal, which can be used to distinguish gender or age, so that the attribute information of the passenger can be acquired based on the tone, the intensity, and the pitch. The attribute information is obtained for the purpose of when the audio signal sent by the passenger is a certain type of instruction and has no specific execution content, such as playing music, navigating scenic spots, and the like, and the embodiment of the present invention does not specifically limit the audio signal. The vehicle can analyze the hobbies of the passengers according to the ages and the sexes of the passengers and perform corresponding operations within the hobbies range. For example, when the passenger sends an audio signal of "play music", the vehicle can play songs in the interest range of the passenger according to the acquired attribute information, for example, the vehicle acquires attribute information of the passenger as 5-10 years old female, and preferentially plays the children songs when the instruction of playing songs is correspondingly executed. The voice control function of the vehicle is more intelligent.
In the embodiment of the invention, after the audio execution module receives the regional information and the pure audio signal, when the received regional information shows that the region where the passenger sending the audio signal is located is a passenger driving region or a passenger back row region, the audio execution module sends the received pure audio signal to the tone quality judgment module, and the tone quality judgment module judges the attribute information of the passenger driving the passenger or the passenger back row sending the audio signal according to the received pure audio signal. And after the tone quality judging module judges the attribute information, the attribute information is sent to the application execution module.
Because the audio signals collected by the microphone cannot be identified by each execution module of the vehicle, the vehicle needs to convert the collected audio signals into control instructions which can be identified by each execution module, so that each execution module of the vehicle can execute corresponding operations according to the control instructions, and the voice control function of the vehicle is realized. The control instruction may be a text signal or a program code, which is not specifically limited in this embodiment of the present invention. The process of converting the audio signal into the recognizable control command is as follows:
and the audio execution module sends the received regional information and the pure audio signal to the software processing module. After the software processing module receives the pure audio signal and the regional information, the pure audio signal is analyzed, the audio signal is converted into a control instruction, and then the software processing module sends the received regional information and the control instruction obtained through conversion to the application execution module.
And when the vehicle determines that the control authority of the passenger compartment or the rear passenger compartment comprises the designated authority, controlling the vehicle according to the control instruction corresponding to the audio signal, wherein the designated authority is the authority for executing the control instruction.
In the embodiment of the invention, the vehicle voice control system sets different control authorities for passengers in different regions, the authority in the control authority is the unique authority of the passenger in the region, the authority outside the control authority is the forbidden authority of the passenger in the region, and the control instruction is selectively executed according to the set control authority, so that the driver and other passengers in the vehicle are effectively distinguished, the driving safety is ensured, and the humanization and intelligence aspects are obviously improved.
Wherein the unique authority of the copilot area comprises: video/audio playing authority, navigation authority, passenger seat adjustment authority, and the like, which are not specifically limited in the embodiment of the present invention.
The prohibition authority of the copilot includes: the present invention relates to a vehicle seat control system, and more particularly, to a vehicle seat control system, a vehicle window control system, a rearview mirror control system, and other control systems that affect driving safety, and a vehicle information and vehicle owner information related control system, or a rear audio system related function control system.
The control authority of the rear passenger zone is: video/audio playing authority, back row audio function control authority, and the like, which are not specifically limited in the embodiment of the present invention.
The right to inhibit the rear passenger zone includes: the control authority of the Bluetooth telephone dialing, the navigation authority, the control authority of the main driving seat and the auxiliary driving seat, the control authority of the vehicle window, the rearview mirror and the like which influence the driving safety or the related control authority related to the privacy of the driver such as vehicle information, vehicle owner information and the like are not specifically limited in the embodiment of the invention.
When the vehicle judges that the authority of the control command corresponding to the audio signal sent by the passenger belongs to the exclusive authority of the area, the control command is executed, and the specific process of determining and executing is as follows:
the application execution module stores the unique authority and the forbidden authority of each region in advance, judges according to the received control instruction command and the region information after receiving the attribute information sent by the tone quality judgment module and the region information and the control instruction sent by the software processing module, and comprehensively analyzes the received attribute information, the region information and the control instruction command and correspondingly controls the vehicle according to the analysis result when the authority of the control instruction is within the unique authority of the region.
Further, when information prompt is needed, if the regional information is displayed as an audio signal sent by a copilot region, prompt is carried out on a vehicle-mounted display screen in a text display mode, so that the copilot can accurately acquire prompt information through the vehicle-mounted display screen; if the regional information shows for the audio signal that back row passenger district sent, then adopt on-vehicle stereo set voice broadcast and on-vehicle display screen word display two kinds of modes to indicate. The vehicle information prompting process comprises the following steps: after the vehicle generates the prompt words, when the prompt information needs to be displayed on the copilot, all the prompt words are obtained and are displayed on the vehicle-mounted display screen, and when the prompt information needs to be displayed on the passengers on the back row, the keywords in the prompt words are extracted and are displayed on the vehicle-mounted display screen. Further, during displaying, the keywords can be converted into audio signals, and voice broadcasting is carried out through the vehicle-mounted sound box.
And when the vehicle determines that the control authority of the passenger compartment or the rear passenger compartment does not comprise the specified authority, ignoring the control instruction corresponding to the audio signal.
When the vehicle judges that the authority of the control instruction corresponding to the audio signal sent by the passenger does not belong to the control authority of the area, the authority of the control instruction representing the audio signal is the forbidden authority of the area, and the control instruction is ignored, and the specific process of the determination is as follows:
the application execution module stores the prohibition authority of the copilot area and the rear passenger area in advance, judges according to the received control instruction and the received area information after receiving the attribute information sent by the tone quality judgment module and the area information and the control instruction sent by the software processing module, and does not perform the operation of the corresponding control instruction any more when the authority of the control instruction is within the prohibition authority of the area.
Further, when the vehicle judges that the authority of the control command belongs to the prohibition authority, a corresponding prohibition reason is generated according to the prohibition authority, and the prohibition reason is prompted through a vehicle-mounted display screen and/or a vehicle-mounted sound device and the like.
And when the vehicle determines that the area is the main driving area, executing a step of controlling the vehicle according to the control instruction corresponding to the audio signal.
The main driving has the control authority of the whole vehicle, and the control authority of the main driving comprises the following steps: the present invention relates to a vehicle control system, and more particularly, to a vehicle control system, which includes a video/audio playing authority, a navigation authority, a primary and secondary driver seat adjustment authority, a control authority affecting driving safety such as a vehicle window and a rearview mirror, a related control authority related to driver privacy such as vehicle information and vehicle owner information, or a related function control authority such as front-row and rear-row audio, and the like.
In another embodiment, after the audio execution module receives the region information and the pure audio signal, when the received region information shows that the region where the passenger sending the audio signal is located is the main driving region, the audio execution module sends the received two information to the software processing module. After the software processing module receives the pure audio signal and the region information, the pure audio signal is analyzed, the audio signal is converted into a control instruction which can be identified by the application execution module, and then the software processing module sends the received region information and the control instruction obtained through conversion to the application execution module. Because the main driving has the integral vehicle control authority, the application execution module directly controls the vehicle according to the received control instruction.
After three microphones in the vehicle collect audio signals in a cockpit, an area where a voice passenger is located and the control authority of the area are determined according to the three groups of audio signals, if a control instruction corresponding to the audio signal is within the control authority, the control instruction is executed, and if the control instruction is not within the control authority, the control instruction is not executed. Through carrying out regional division and setting up different control authorities to the region of difference to the realization carries out selective execution to control command, when promoting the speech control effect of vehicle, has carried out effective differentiation to driver in the car again with other passengers, has ensured driving safety, has obvious promotion in the aspect of humanized and intelligence.
Further, when the received audio signal of the main driving is a certain type of instruction and has no specific execution content, the application execution module executes corresponding operation according to the pre-stored interest and hobbies of the main driving.
Still further, when information prompt is needed, if the area is mainly driven, a voice playing mode is adopted for prompting, wherein all prompt characters are obtained for prompting the main driving, all the prompt characters are converted into audio signals, and voice broadcasting is carried out through a vehicle-mounted sound device.
As a further preferred aspect, in an embodiment of the present invention, a vehicle state monitoring and processing module is further included, which acquires new driving state information of the vehicle and driving environment information of the vehicle by installing a sensor on the vehicle or by using a vehicle CAN bus, including: the vehicle state monitoring and processing module is electrically connected with the application execution module 110, and the application execution module 110 integrates vehicle state information, area information for sending audio, control instructions and attribute information of sound-producing passengers to comprehensively judge and execute voice control on the vehicle. The specific method comprises the following steps:
judging whether the running state of the current vehicle meets the full-area control state or not according to the vehicle state; when the audio command can be executed according to the area information for sending the audio, the control command and the attribute information of the passenger sending the audio, and the vehicle running state meets the full-area control state, controlling the vehicle to execute the audio control command; otherwise, control commands sent by the passenger area and the passenger area in the back row are ignored, and the control commands sent by the main driving area can be executed only.
In one embodiment of the present invention, it is determined whether the driving state of the vehicle satisfies the all-zone control state according to a driving state index of the vehicle;
wherein the driving state index of the vehicle is:
Figure BDA0002924240350000101
in the formula, delta represents the deviation angle of the mass center of the vehicle and has the unit of degree; v represents vehicle speed, VmaxRepresents the maximum vehicle speed with the unit of Km/h; sr represents the wheel slip rate, eta is a correction coefficient, and lambda represents a driving environment coefficient. Maximum vehicle speed VmaxCan be set as the speed limit of the road section where the vehicle is located.
When Rs is greater than 0.6, the running state of the vehicle meets the all-region control state; and when the Rs is less than or equal to 0.6, the form state of the vehicle does not meet the full-region control state.
The wheel slip rate calculation method comprises the following steps:
Figure BDA0002924240350000111
where v 'is a theoretical vehicle speed, v is an actual speed, v' ═ rw, r is a radius of a driving wheel of the vehicle, and w is an angular speed of the driving wheel.
When the | delta | is less than 8, the value range of eta is 1.15-1.10; preferably, η is set to 1.15.
When the | delta | is more than or equal to 8, the value range of eta is 0.85-0.9; preferably, η is set to 0.85.
Wherein the driving environment coefficient is:
Figure BDA0002924240350000112
in the formula, λ0Representing the reference environment coefficient, I representing the light intensity of the driving environment, I0Indicating the reference light intensity, T indicating the driving environment temperature, T0The reference temperature is expressed in degrees centigrade.
Wherein, when the road surface is ice and snow, the lambda is0The value range of (A) is 0.5-0.6; when the road surface is non-ice snow road surface, lambda0The value range of (A) is 0.9-1.0. According to experience, I0Has a value range of 150-200 Lux, T0The value range of (A) is 20-25 ℃.
In another embodiment, after the road surface image is collected by the camera whether the road surface is the ice and snow road surface, the road surface image is identified and obtained based on the big data.
In summary, the vehicle voice control method provided by the invention can determine whether to execute the instruction according to the issuing area of the audio signal, the passenger attribute of the audio issuing area and the instruction authority of the area; the voice control of the vehicle can be realized, and meanwhile, the driving safety of the vehicle is guaranteed. The invention can also determine whether the running state of the vehicle meets the full-area control state according to the running state index of the vehicle, and neglect the control commands sent by the copilot area and the rear passenger area when the running state of the vehicle does not meet the full-area control state, so as to further improve the driving safety of the vehicle.
While embodiments of the invention have been described above, it is not limited to the applications set forth in the description and the embodiments, which are fully applicable in various fields of endeavor to which the invention pertains, and further modifications may readily be made by those skilled in the art, it being understood that the invention is not limited to the details shown and described herein without departing from the general concept defined by the appended claims and their equivalents.

Claims (10)

1. A vehicle voice control method, characterized by comprising:
step one, determining an area for sending out an audio signal;
step two, identifying the audio signal, judging the attribute of a passenger sending the audio signal, and judging a control instruction corresponding to the audio signal;
step three, judging whether the control instruction is an executable instruction or not according to an area for sending the audio frequency, the attribute of the passenger sending the audio frequency signal and the control instruction corresponding to the audio frequency signal;
and step four, when the control instruction is an executable instruction, controlling the vehicle to execute the control instruction.
2. The vehicle voice control method according to claim 1, wherein the area from which the audio signal is emitted includes a main driving zone, a sub-driving zone, and a rear passenger zone.
3. The vehicle voice control method according to claim 2, wherein the passenger attribute information includes a sex and an age of the passenger.
4. The vehicle voice control method according to claim 3, characterized by further comprising setting instruction authority corresponding to the region emitting the audio signal before the third step; when the control instruction sent by the area sending the audio signal is within the corresponding instruction authority range, performing a third step; otherwise, the control instruction is ignored.
5. The vehicle voice control method according to claim 4,
the instruction authority corresponding to the main driving area is the control authority of the whole vehicle;
the instruction authority corresponding to the copilot area at least comprises: video/audio playing authority, navigation authority or co-pilot seat adjustment authority;
the instruction authority corresponding to the rear passenger zone at least comprises: video/audio playing authority and back row sound control authority.
6. The vehicle voice control method according to claim 4 or 5, characterized in that in the fourth step, further comprising:
judging whether the running state of the current vehicle meets the full-area control state or not;
when the control instruction is an executable instruction and the vehicle running state meets a full-region control state, controlling the vehicle to execute the control instruction; otherwise, control commands sent by the passenger compartment and the rear passenger compartment are ignored.
7. The vehicle voice control method according to claim 6, characterized in that it is determined whether the running state of the vehicle satisfies the all-zone control state according to a running state index of the vehicle;
wherein the driving state index of the vehicle is:
Figure FDA0002924240340000021
wherein δ represents a vehicle centroid deflection angle, V represents a vehicle speed, and V representsmaxRepresenting the maximum vehicle speed, Sr representing the wheel slip ratio, eta representing a correction coefficient, and lambda representing a driving environment coefficient;
when Rs is greater than 0.6, the running state of the vehicle meets the all-region control state;
and when the Rs is less than or equal to 0.6, the form state of the vehicle does not meet the full-region control state.
8. The vehicle voice control method according to claim 7,
when the | delta | is less than 8, the value range of eta is 1.15-1.10;
when | delta | ≧ 8, the value range of η is 0.85-0.9.
9. The vehicle voice control method according to claim 8, characterized in that the driving environment coefficient is:
Figure FDA0002924240340000022
in the formula, λ0Representing the reference environment coefficient, I representing the light intensity of the driving environment, I0Indicating the reference light intensity, T indicating the driving environment temperature, T0Indicating the reference temperature.
10. The vehicle voice control method according to claim 9,
when the road surface is ice and snow, lambda0The value range of (A) is 0.5-0.6;
when the road surface is non-ice snow road surface, lambda0The value range of (A) is 0.9-1.0.
CN202110128255.6A 2021-01-29 2021-01-29 Vehicle voice control method Active CN112951227B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110128255.6A CN112951227B (en) 2021-01-29 2021-01-29 Vehicle voice control method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110128255.6A CN112951227B (en) 2021-01-29 2021-01-29 Vehicle voice control method

Publications (2)

Publication Number Publication Date
CN112951227A true CN112951227A (en) 2021-06-11
CN112951227B CN112951227B (en) 2023-11-28

Family

ID=76239939

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110128255.6A Active CN112951227B (en) 2021-01-29 2021-01-29 Vehicle voice control method

Country Status (1)

Country Link
CN (1) CN112951227B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115158197A (en) * 2022-07-21 2022-10-11 重庆蓝鲸智联科技有限公司 Control system of on-vehicle intelligent passenger cabin amusement based on sound localization
WO2024031971A1 (en) * 2022-08-09 2024-02-15 中兴通讯股份有限公司 Permission management method, smart cabin, vehicle, and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105867179A (en) * 2016-03-29 2016-08-17 乐视控股（北京）有限公司 Vehicle-borne voice control method, device and equipment
CN108327667A (en) * 2018-02-06 2018-07-27 奇瑞汽车股份有限公司 Vehicle audio control method and device
CN108520747A (en) * 2018-03-29 2018-09-11 浙江吉利汽车研究院有限公司 A kind of on-vehicle control apparatus with speech identifying function
US20180284767A1 (en) * 2017-03-29 2018-10-04 Mazda Motor Corporation Vehicle drive assistance system
CN110154894A (en) * 2019-05-29 2019-08-23 辽宁工业大学 A kind of vehicle security drive method for early warning based on pavement behavior

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105867179A (en) * 2016-03-29 2016-08-17 乐视控股（北京）有限公司 Vehicle-borne voice control method, device and equipment
US20180284767A1 (en) * 2017-03-29 2018-10-04 Mazda Motor Corporation Vehicle drive assistance system
CN108327667A (en) * 2018-02-06 2018-07-27 奇瑞汽车股份有限公司 Vehicle audio control method and device
CN108520747A (en) * 2018-03-29 2018-09-11 浙江吉利汽车研究院有限公司 A kind of on-vehicle control apparatus with speech identifying function
CN110154894A (en) * 2019-05-29 2019-08-23 辽宁工业大学 A kind of vehicle security drive method for early warning based on pavement behavior

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115158197A (en) * 2022-07-21 2022-10-11 重庆蓝鲸智联科技有限公司 Control system of on-vehicle intelligent passenger cabin amusement based on sound localization
WO2024031971A1 (en) * 2022-08-09 2024-02-15 中兴通讯股份有限公司 Permission management method, smart cabin, vehicle, and storage medium

Also Published As

Publication number Publication date
CN112951227B (en) 2023-11-28

Similar Documents

Publication Publication Date Title
US10960816B2 (en) Vehicle engine sound control system and control method based on driver propensity using artificial intelligence
US10170111B2 (en) Adaptive infotainment system based on vehicle surrounding and driver mood and/or behavior
CN112951227A (en) Vehicle voice control method
KR101974871B1 (en) Vehicle control device mounted on vehicle and method for controlling the vehicle
JP5972372B2 (en) Car information system
US6889189B2 (en) Speech recognizer performance in car and home applications utilizing novel multiple microphone configurations
KR102124804B1 (en) Apparatus for controling autonomous vehicle and method for controlling the same
JP4085500B2 (en) Vehicle status grasping device, agent device, and vehicle control device
US10579072B2 (en) Method for controlling vehicle
KR20190030091A (en) Method for platooning of vehicles and vehicle
US9893697B1 (en) System and method for selective volume adjustment in a vehicle
CN106467106A (en) System and method for driver assistance
US20050256635A1 (en) System and method for assigning a level of urgency to navigation cues
KR102011008B1 (en) System and method for detecing a road state
EP3514033B1 (en) Vehicle control device mounted on vehicle and method for controlling the vehicle
US10549779B2 (en) Vehicle control device mounted on vehicle and method for controlling vehicle
CN110366852B (en) Information processing apparatus, information processing method, and recording medium
JP2005099930A (en) Travel control system for vehicle, information center, onboard machine and travel control method for vehicle
CN113711306A (en) Voice control of vehicle systems
KR20220089730A (en) Vehicle control device
JP2019100130A (en) Vehicle control device and computer program
KR102669129B1 (en) Device and method for transferring control authority of autonomous vehicle
JP2010126147A (en) Display device
JP2001039213A (en) Turn signal control system
KR20180024399A (en) A vehicle and manufacture method of the vehicle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant