CN115711077A - Vehicle electric door non-contact control method and system and automobile - Google Patents

Vehicle electric door non-contact control method and system and automobile Download PDF

Info

Publication number
CN115711077A
CN115711077A CN202211510677.0A CN202211510677A CN115711077A CN 115711077 A CN115711077 A CN 115711077A CN 202211510677 A CN202211510677 A CN 202211510677A CN 115711077 A CN115711077 A CN 115711077A
Authority
CN
China
Prior art keywords
vehicle
door
audio
processing module
recognition mode
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211510677.0A
Other languages
Chinese (zh)
Inventor
张迅
彭磊
张正杰
孙澳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing Changan Automobile Co Ltd
Original Assignee
Chongqing Changan Automobile Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing Changan Automobile Co Ltd filed Critical Chongqing Changan Automobile Co Ltd
Priority to CN202211510677.0A priority Critical patent/CN115711077A/en
Publication of CN115711077A publication Critical patent/CN115711077A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

The invention relates to a vehicle electric door non-contact control method, a system and an automobile, wherein the system comprises the following components: the system comprises a door control module, an off-vehicle audio processing module and an online identification processing module which are connected through the door control module, and the method comprises the following steps: the door control module controls the opening and closing of the electric door according to the electric tail door control instruction when acquiring the electric door control instruction sent by the external audio processing module or the online identification processing module; the electric door control command sent by the vehicle exterior audio processing module is output after local model matching is carried out on the vehicle exterior audio picked outside the vehicle; the electric door control command sent by the online identification processing module is output after online model matching is carried out on the vehicle exterior audio picked up outside the vehicle when a trigger signal of the vehicle exterior audio processing module entering the identification mode is received; or when the electric door is in an open state, the audio is output after local model matching is carried out on the audio outside the vehicle, which is picked up in the vehicle.

Description

Vehicle electric door non-contact control method and system and automobile
Technical Field
The invention relates to the field of electric door control, in particular to a vehicle electric door non-contact control method and system and an automobile.
Background
The mode of current vehicle control tail-gate is many, can be through the PE button control tail-gate of tail-gate, can open the tail-gate through the key button through well accuse soft switch in the car or hard switch control tail-gate, also can open the tail-gate through rear bumper capacitive sensing device.
The mode of controlling the tail gate all needs the artificial limbs operation just can reach the purpose that the user wanted, under the scene that user's both hands hold the heavy object, there is comparatively troublesome operation procedure or has the potential safety hazard that falls down among the user operation process in above mode. Therefore, in order to reduce the interaction cost of the user and ensure the safety of the user, the invention provides a way for the user to realize tail gate control without contacting with the vehicle and needing any limb operation outside the vehicle.
The tail gate control mode is different from a control system, a method and a storage medium of CN202110620550.3 offline sound-control electric tail gate, can not be limited to offline control instructions, can receive all speaking modes of a user to the maximum extent, is not limited to simple instructions of ' opening the tail gate ', closing the tail gate ' and the like, can support the user to speak more complicated semantic modes, such as ' i want to use the tail gate ', and is greatly compatible with all user habits. In addition, the tail gate control mode is different from a control system, a control method and a storage medium of an off-line sound-control electric tail gate in CN202110620550.3, the mode has higher safety parameters and voiceprint matching capability, and can judge the attribute of a person issuing an instruction through the voiceprint characteristics of a registered user, so that the risk that an unregistered user can control the tail gate is finally guaranteed.
This tail gate control approach is different from the CN202020958821.7 voice recognition based power tail gate control system, and it can still have a good wake-up rate when the tail gate is opened in the case of using only one microphone. CN202020958821.7 electric tail gate control system based on voice recognition uses microphone 1 to collect sound when the tail gate is not opened, and uses microphone 2 facing away from microphone 1 to collect sound when the tail gate is opened. The control method can be used for recognizing sound through the original voice microphone in the car after the tail gate is opened, so that the cost can be reduced.
The control method of the electric tailgate is different from a method and a device for controlling the electric tailgate of a vehicle in CN 107120020B, a core processing device of the control system is an electric tailgate controller, in an implementation example of the electric tailgate control system and the method, the core of the control system is a vehicle entertainment terminal assembly, the assembly can be communicated with a vehicle-mounted T-Box through a wireless network, and further can apply for analyzing the external audio of a user through the capability of a server at the cloud, so that the control system can identify and process no matter the user has any intention of opening and closing the tailgate outside the vehicle, for example, in a method and a device example for controlling the electric tailgate of the vehicle, the system can only identify an instruction of opening the tailgate, in the example, the system can identify complex and variable methods such as 'the user can not help open the tailgate to him', and the like, and can better accord with the actual use scene of the user.
Disclosure of Invention
In order to enable a user to directly control a vehicle door through a voice instruction under the condition of no-contact vehicle outside a vehicle, the method and the system are simple, convenient and free of operation risk, user experience is improved, and personal safety of the user is guaranteed at the same time, the invention provides a vehicle electric door non-contact control method and system and the vehicle.
The technical scheme of the invention is as follows:
the invention provides a vehicle electric door non-contact control method, which is applied to a vehicle electric door non-contact control system, and the vehicle electric door non-contact control system comprises the following components: the electronic door control method comprises a door control module, an external audio processing module and an online identification processing module which are connected through the door control module, and comprises the following steps:
the door control module controls the opening and closing of the electric door according to the electric tail door control instruction when acquiring the electric door control instruction sent by the outside audio processing module or the online identification processing module;
the electric door control command sent by the vehicle exterior audio processing module is output after local model matching is carried out on the vehicle exterior audio picked outside the vehicle;
and the electric door control command sent by the online identification processing module is output after online model matching is carried out on the vehicle exterior audio picked up outside the vehicle when a trigger signal of the vehicle exterior audio processing module entering the identification mode is received.
Preferably, the electric door control command sent by the online identification processing module may also be:
when the electric door is in an open state, the audio outside the vehicle, which is picked up in the vehicle, is output after local model matching.
Preferably, the local model of the off-board audio processing module comprises:
a locally stored door wake-free word model, a recognition mode wake-up word model, a recognition mode voiceprint model and a local door control word model;
the specific process of the external audio processing module for carrying out local model matching on the external audio picked up outside the vehicle comprises the following steps:
judging whether a voiceprint recognition mode is started or not;
if the voiceprint recognition mode is started, respectively inputting first-time outside-automobile audio picked up outside the automobile into a tail-gate wake-free word model, a recognition mode wake-up word recognition model and a recognition mode voiceprint model for data matching, so that a first electric tail-gate control instruction is directly output by the tail-gate wake-free word model, or a second electric tail-gate control instruction is output by a local tail-gate control word model according to newly input second-time outside-automobile audio after the voiceprint recognition mode is started;
if the voiceprint recognition mode is not opened, the first time of the external audio frequency picked up outside the automobile is respectively input into the door wake-up-free word model and the recognition mode wake-up word recognition model for data matching, so that a first electric door control command is directly output by the door wake-up-free word model, or a third electric door control command is output by the local door control word model according to the newly input second time of the external audio frequency after the external audio frequency enters the recognition mode.
Preferably, if the voiceprint recognition mode is started, the exterior audio processing module enters the recognition mode requirement: matching the awakening words related to the identification mode awakening word identification model from the first off-board audio, and matching the voiceprint of the first off-board audio with one voiceprint of the identification mode voiceprint model;
if the voiceprint recognition mode is not started, the external audio processing module enters the recognition mode requirement: and matching the awakening words associated in the identification mode awakening word identification model from the first off-board audio.
Preferably, after entering the recognition mode, the vehicle exterior audio processing module requests the vehicle exterior user to input feedback information containing the control words through the door control module;
picking up the second secondary off-board audio input again by the off-board user based on the feedback information outside the vehicle;
inputting the secondary outside audio into a local door control word model;
if the control words related to the local door control word model are matched from the second external audio frequency, outputting a second electric door control instruction or a third electric door control instruction;
wherein, the second electric door control command is output when the voiceprint recognition mode is opened; the third electric door control command is output when the voiceprint recognition mode is not opened.
Preferably, the online model of the online identification processing module is: controlling a word model on line;
the specific process of performing online model matching on the off-board audio picked up outside the vehicle by the online identification processing module comprises the following steps:
judging whether a voiceprint recognition mode is started or not;
inputting the secondary off-vehicle audio into the online door control word model;
if the control words related to the online door control word model are matched from the second off-board audio, outputting a fourth electric door control instruction or a fifth electric door control instruction;
wherein, the fourth electric door control command is output when the voiceprint recognition mode is opened; the fifth electric door control command is output when the voiceprint recognition mode is not opened.
Preferably, the voiceprint recognition mode is started, which means that one or more pieces of voiceprint information registered by the user are recorded in the recognition mode voiceprint model;
the voiceprint recognition mode is not started, namely the voiceprint information registered by the user is not recorded in the voiceprint model in the recognition mode.
Preferably, the local model of the online identification processing module is: an in-vehicle door control word model;
the specific process of carrying out local model matching on the outside-vehicle audio picked up in the vehicle by the online identification processing module is as follows:
inputting the outside audio picked up from the inside of the vehicle into the inside door control word model;
and if the control words related to the control word model of the door in the automobile are matched in the audio outside the automobile picked from the automobile, outputting an electric door control command.
Preferably, before the door control module acquires the electric door control instruction sent by the external audio processing module or the online identification processing module, the door control module needs to be wakened by a whole vehicle wakening module of the vehicle electric door contactless control system, and supplies power to the external audio processing module and the online identification processing module after wakening.
Preferably, the electric door is one or more of an electric tail door, an electric front hatch door and an electric skylight door.
The invention also provides a vehicle electric door non-contact control system, comprising:
the online recognition processing module is formed by an in-vehicle voice recognizer, an in-vehicle microphone connected with the in-vehicle voice recognizer and a cloud recognition system;
the door control module is formed by a central control processor, a door controller and a door execution mechanism which are connected in sequence;
the vehicle exterior voice recognizer and the vehicle interior voice recognizer are respectively connected with the central control processor;
the vehicle exterior voice recognizer outputs an electric door control command or judges whether to enter a recognition mode according to the vehicle exterior audio picked by the vehicle exterior microphone;
when the vehicle-exterior voice recognizer enters a recognition mode, the central control processor sends vehicle-exterior audio sent by the vehicle-exterior voice recognizer to the cloud recognition system through the vehicle-interior voice recognizer, the cloud recognition system outputs an electric door control instruction after performing online model matching, and the electric door control instruction is sent to the central control processor through the vehicle-interior voice recognizer;
the in-vehicle voice recognizer outputs an electric door control command according to the out-vehicle audio picked by the in-vehicle microphone;
the central control processor outputs the electric door control command sent by the vehicle exterior voice recognizer or the vehicle interior voice recognizer to the door controller, so that the door controller controls the door actuating mechanism to open and close.
Preferably, the vehicle power door contactless control system further comprises:
the whole vehicle awakening module is formed by connecting a key and a BCM vehicle body controller through Bluetooth;
the BCM vehicle body controller is connected with the central control processor;
and after the BCM automobile body controller passes the key authentication, awakening the central control processor in the dormant state, so that the central control processor supplies power for the automobile exterior voice recognizer and the automobile interior voice recognizer.
The present invention also provides an automobile comprising: the system comprises an external microphone, an external voice recognizer, an internal microphone, a central control processor, a door controller and a door actuating mechanism, wherein the external microphone and the external voice recognizer are connected with each other;
the vehicle exterior voice recognizer and the vehicle interior voice recognizer are respectively connected with the central control processor;
the vehicle exterior voice recognizer outputs an electric door control command or judges whether to enter a recognition mode according to the vehicle exterior audio picked by the vehicle exterior microphone;
when the vehicle-exterior voice recognizer enters a recognition mode, the central control processor sends the vehicle-exterior audio sent by the vehicle-exterior voice recognizer to a cloud recognition system which is connected with the vehicle-exterior audio in advance through the vehicle-interior voice recognizer, so that the cloud recognition system performs online model matching to output an electric door control command and sends the command to the central control processor through the vehicle-interior voice recognizer;
the in-vehicle voice recognizer outputs an electric door control command according to the out-vehicle audio picked by the in-vehicle microphone;
the central control processor outputs the electric door control command sent by the vehicle exterior voice recognizer or the vehicle interior voice recognizer to the door controller, so that the door controller controls the door actuating mechanism to open and close.
The beneficial effects of the invention are as follows:
the method provides various specific application scenes for realizing the control of the opening and closing of the related door of the vehicle in a non-contact way, and realizes the control of the door of the vehicle by utilizing the voice data outside the vehicle. The voice data outside the vehicle is accurately recognized by combining various recognition modes of voiceprint recognition, awakening-free word recognition and control word recognition, and the accuracy of door control of the vehicle is improved.
Drawings
FIG. 1 is a schematic block diagram of a contactless control system for a vehicle electric tailgate in the present embodiment;
FIG. 2 is a block diagram of a contactless control system for a power tailgate of a vehicle according to the present embodiment;
FIG. 3 is a schematic diagram of 2 identification modes of the external audio picked up by the external vehicle according to the embodiment;
FIG. 4 is a schematic diagram of a first path and a second path implemented by the audio outside the vehicle picked up in the embodiment;
FIG. 5 is a schematic diagram of a first path and a third path implemented by the off-board audio picked up off the board in the present embodiment;
FIG. 6 is a schematic diagram of a first path and a fourth path implemented by the audio outside the vehicle picked up in the present embodiment;
FIG. 7 is a schematic diagram of a first path and a fifth path implemented by the off-board audio picked up off-board in the present embodiment;
FIG. 8 is a schematic diagram of a path six implemented using audio outside the vehicle picked up inside the vehicle in the present embodiment;
FIG. 9 is a flowchart of a contactless tail gate control method according to the present embodiment;
in the figure: 1. the system comprises an external microphone, 2, an external voice recognizer, 3, a central control processor, 4, a key, 5, a BCM vehicle body controller, 6, a BDCR controller, 7, a tail gate electric stay bar, 8, an internal audio voice recognizer, 9, a CAN network, 10, a cloud recognition system, 11 and an internal microphone; 12. the system comprises an external audio processing module 13, a tail gate control module 14, an online identification processing module 15 and a whole vehicle awakening module.
Detailed Description
The invention will be further explained with reference to the drawings.
The embodiment of the invention provides a vehicle electric door non-contact control system, wherein the electric door can belong to a door which is opened by an electric mode on a vehicle, and the electric door can be as follows: tail doors and front hatch doors of vehicles, and electric sunroof doors of vehicles. The system can realize the opening and closing control of the electric door by a user in a non-contact mode outside the vehicle.
In the present embodiment, the electric door will be described as an example of an electric tailgate.
As shown in fig. 1, the contactless control system for the power tailgate in the present embodiment includes: the system comprises an external audio processing module 12, a tail gate control module 13, an online identification processing module 14 and a whole vehicle awakening module 15. The external audio processing module 12 comprises an external microphone 1 and an external voice recognizer 2 connected with the external microphone, and the tail gate control module 13 comprises: the central control processor 3, the CAN network 9, the BDCR controller 6 as a door controller and the door electric stay 7 of a door actuating mechanism, wherein the BDCR controller 6 is connected with the central control processor 3 through the CAN network 9; the whole vehicle awakening module 14 includes: a key 4 and a BCM body controller 5; the online identification processing module 14 includes: an in-vehicle microphone 11, an in-vehicle speech recognizer 8 and a cloud recognition system 10.
Wherein: the exterior microphone 1 and the exterior speech recognizer 2 constitute an exterior audio processing module 12. The external microphone 1 is responsible for picking up all sound signals outside the vehicle, the external voice recognizer 2 carries out noise elimination (noise reduction) and gain adjustment on all external sound signals (namely external audio) picked up by the external microphone 1, the external sound signals after being processed and a tail gate wake-free word model in the external audio processing module 12 are compared to generate a corresponding electric tail gate control instruction (the instruction is a serial port instruction) and are sent to the tail gate control module 13, and meanwhile, the external sound signals after being noise reduced are converted into audio analog signals and are sent to the tail gate control module 13.
Wherein: the in-vehicle speech recognizer 8, the cloud recognition system 10 and the in-vehicle microphone 11 form an online recognition processing module 14. The in-vehicle speech recognizer 8 is responsible for receiving the audio analog signal transmitted to the tailgate control module 13 by the out-vehicle audio processing module 12. By means of the storage capacity of the cloud identification system 10 with strong high-speed computing capability, the online identification processing module 14 can process many audio frequencies which cannot be identified by the off-board audio processing module 12, and finally the audio frequencies are processed and corresponding tailgate control instructions are generated and sent to the tailgate control module 13. Meanwhile, the in-vehicle speech recognizer 8 is also responsible for processing the out-vehicle audio signals picked up by the in-vehicle microphone, performing noise elimination (noise reduction) and gain adjustment on the out-vehicle audio signals, recognizing the processed out-vehicle audio signals by using a locally stored in-vehicle tail gate control word model, generating corresponding tail gate control commands and sending the tail gate control commands to the tail gate control module 13.
The central control processor 3, the BDCR controller 6, the CAN network 9, and the tail gate electric stay constitute a tail gate control module 13 in this embodiment, as shown in fig. 2, the tail gate control module 13 is responsible for providing an operating power supply for the vehicle exterior audio processing module 12 and the online identification processing module 14, and is also responsible for converting the vehicle exterior audio digital signal processed by the vehicle exterior audio processing module 12 into a vehicle exterior audio analog signal and transmitting the vehicle exterior audio analog signal to the online identification processing module 14. The tail gate control module 13 is an actual execution layer of the whole system, and the last opening and closing process of the tail gate is executed by the tail gate control module 13.
As shown in fig. 1, the key 4 and the BCM body controller 5 form a whole vehicle wake-up module 15, which is responsible for waking up a whole vehicle at the first time when a user approaches the vehicle, and simultaneously notifying the tailgate control module 13 to enter a working state, so that the user can perform voice control on the tailgate at the first time when the user approaches the vehicle.
In order to implement the contactless control of the power tailgate, as shown in fig. 9, the contactless control method of the power tailgate in this embodiment specifically includes:
and S101, sleeping and awakening the whole vehicle.
In the embodiment, a wake-up mode for sleep wake-up of a whole vehicle is provided.
Specifically, in order to ensure that the dark current of the automobile meets the requirement and reduce the feeding risk of the automobile, the external voice recognizer 2 and the central control processor 3 can be deeply dormant under the condition that the power of the whole automobile is not used, but simultaneously, a low-frequency antenna module in the BCM automobile body controller 5 is still in a working state, and when the key 4 receives a low-frequency antenna signal, a high-frequency signal with self ID authentication is sent to the BCM automobile body controller 5 at the end of the automobile. If the BCM automobile body controller 5 receives the high-frequency signal as the (2), the BCM automobile body controller 5 can carry out the legal verification of the ID in the high-frequency signal;
if the ID check is illegal, the BCM vehicle body controller 5 cannot wake up the whole vehicle;
if the ID is verified to be legal, the BCM vehicle body controller 5 issues a wake-up command to the whole vehicle, and simultaneously, the central control processor 3 is awakened from dormancy.
After the central control processor 3 is awakened, power supply and a clock are provided for the exterior voice recognizer 2, and power supply is provided for the exterior microphone 1, so that the exterior voice recognizer 2 can carry out local recognition.
And S102, picking up the out-of-vehicle audio of the out-of-vehicle user.
For example, a user outside the vehicle can directly say that the wake-up free word of "xx opens the back door" directly controls the opening of the back door; or the external voice recognizer 2 enters the recognition mode by saying 'hello xx' first, and then the tail gate is controlled to be opened by saying command words such as 'please help me open the tail gate', 'open the tail gate', and the like.
In this embodiment, the off-vehicle audio acquisition of the off-vehicle user can be picked up by an off-vehicle microphone 1 arranged outside the vehicle; it is also possible to perform pickup by the in-vehicle microphone 11 disposed in the vehicle when the vehicle tail gate is opened.
Step S103, the outside-vehicle voice recognizer 2 performs awakening word matching or awakening-free word matching on the outside-vehicle audio picked up by the outside-vehicle microphone 1, and judges whether the tail gate control instruction is directly output or the outside-vehicle audio picked up by the outside-vehicle microphone 1 again needs to be recognized after entering the recognition mode so as to output the tail gate control instruction.
The external speech recognizer 2 locally stores four models, specifically: a tail gate wake-free word model, a recognition mode wake-up word model, a recognition mode voiceprint model and a local tail gate control word model.
Wherein, the record has exempted from to awaken up the word in the word model is exempted from to the tail-gate, in case the car outer user directly says and should exempt from to awaken up the word, the car outer speech recognizer 1 can direct output tail-gate control command.
The recognition mode awakening word model records some awakening words for the off-board speech recognizer 2 to enter the recognition mode, the awakening words are pre-stored in the recognition mode awakening word model, and once the off-board user speaks one or more of the awakening words, the off-board speech recognizer 1 can enter the recognition mode or be qualified to enter the recognition mode.
Voiceprint data are not stored in the voiceprint model in the recognition mode in advance, and the voiceprint data need to be actively registered and input by a user. Once the user registers the voiceprint data, the voiceprint data is recorded in the voiceprint model in the recognition mode, namely the voiceprint recognition mode of the vehicle-mounted voice recognizer 2 in the embodiment is started; and when the voiceprint data is not recorded in the recognition mode voiceprint model, the voiceprint recognition mode of the vehicle exterior voice recognizer 2 is closed. When the user starts voiceprint recording by clicking the interface, the central control processor 3 informs the vehicle-exterior voice recognizer 2 to carry out an audio recording mode at the moment, and simultaneously, information for guiding the user to record outside the vehicle is displayed on the interface of the central control processor 3. At this moment, the outer microphone 1 of the vehicle transmits the outer audio frequency of the vehicle to the outer voice recognizer 2 in real time, when the outer audio frequency of the hit awakening word 'hello XX' is recognized, the audio frequency is stored in a voiceprint model of the outer voice recognizer 2 of the vehicle until 5 pieces of awakening audio frequency are continuously stored, and the recording of the hypo-cartilages can be finished.
After the vehicle exterior voice recognizer 2 enters the recognition mode, once one or more control words matched with the control words are recorded in the vehicle exterior audio spoken by the vehicle exterior user again, a tail door control command for opening and closing the tail door can be output.
For the vehicle exterior speech recognizer 2, when the voiceprint recognition mode is closed, if the user has spoken one or more awakening words in the model according to the recognition mode awakening word model, the vehicle exterior speech recognizer 2 directly enters the recognition mode; when the voiceprint recognition mode is started, when one or more awakening words in the recognition mode awakening word model are matched in the vehicle exterior audio, the voiceprint data of the vehicle exterior audio is required to be matched with one piece of voiceprint data in the recognition mode voiceprint model, and then the vehicle exterior voice recognizer 2 can enter the recognition mode.
When the external audio is picked up by the external microphone 1, the external voice recognizer 2 firstly receives the external audio, and firstly carries out noise elimination and gain adjustment on the received external audio and then analyzes the external audio into a digital signal.
With reference to the first path in fig. 3, 4 to 7, the off-board speech recognizer 1 inputs the analyzed off-board audio digital signal into the local wake-up-free word model of the end gate, and the wake-up-free word model of the end gate matches whether the wake-up-free word "xx opens the end gate" or "xx closes the end gate" is recorded in the off-board audio, and if the wake-up-free word is recorded in the off-board audio, the off-board speech recognizer 2 directly outputs a first end gate control instruction for opening or closing the end gate to the central processing unit 3.
As shown in fig. 3, the vehicle exterior speech recognizer 1 needs to select whether to input the analyzed vehicle exterior audio digital signal only to the above recognition mode wakeup word model or to input the processed vehicle exterior audio to both the above recognition mode wakeup word model and the above recognition mode voiceprint model according to whether the voiceprint recognition mode is on while inputting the analyzed vehicle exterior audio digital signal to the local backdoor wakeup word model. Specifically, when the voiceprint recognition mode is turned on, the processed vehicle exterior audio needs to be simultaneously input into the recognition mode wake-up word model and the recognition mode voiceprint model, which corresponds to fig. 4 and 6; when the voiceprint recognition mode is turned on, the processed vehicle exterior audio needs to be input into only the recognition mode wake-up word model described above, which corresponds to fig. 5 and 7.
For the above-mentioned vehicle exterior speech recognizer 2, if it needs to enter the recognition mode first and then recognize the vehicle exterior audio picked up by the vehicle exterior microphone 1 again to output the tail gate control command, at this time, the output tail gate control command may be one of the second tail gate control command to the fifth tail gate control command in fig. 4 to fig. 7.
And step S104, if the step S103 judges that the command is directly output, the exterior voice recognizer 2 directly outputs a first tail gate control command to the central control processor 3, so that the central control processor 3 realizes the tail gate opening and closing control according to the first tail gate control command.
As shown in fig. 3 to fig. 7, the step S104 corresponds to a first path, which enables the issue and execution of the tail gate control command to be performed quickly and conveniently.
If it is determined in step S103 that it is necessary to enter the recognition mode first and then recognize the vehicle exterior audio picked up by the vehicle exterior microphone 1 again to output the tailgate control command, there are two paths from step S105 to step S106.
In step S105, the out-vehicle speech recognizer 2 outputs a second tailgate control instruction.
The step S105 corresponds to the second path in fig. 4, and the specific steps of the step S105 are:
if the voiceprint recognition mode is started, outputting a request for inputting feedback information containing control words by a user outside the vehicle;
when the off-vehicle audio which is picked up by the off-vehicle microphone 1 and input again by the off-vehicle user based on the feedback information is acquired, inputting the picked off-vehicle audio into the local tail gate control word model for matching;
and if the control words in the local tail gate control word model can be matched from the picked-up vehicle exterior audio, outputting the second tail gate control command.
When the voiceprint recognition mode is started, the second path can effectively guarantee the use safety of the user, and meanwhile, the local low transmission path is utilized, and the external audio of the user can be fed back quickly.
In step S106, the out-of-vehicle speech recognizer 2 outputs a third tailgate control instruction.
The step S106 corresponds to the third route in fig. 5, and the specific steps of the step S106 are as follows:
if the voiceprint recognition mode is not started, outputting a request for inputting feedback information containing control words by a user outside the vehicle;
when the vehicle exterior audio which is picked up by the vehicle exterior microphone 1 and input again by the vehicle exterior user based on the feedback information is obtained, inputting the vehicle exterior audio which is picked up again into the local tail gate control word model for matching;
and if the control words in the local tail gate control word model can be matched from the picked-up vehicle exterior audio, outputting the third tail gate control command.
The execution process of the step S105 is the same as that of the step S106, and the difference is that the precondition of the step S105 is that the vehicle exterior speech recognizer 2 enters the recognition mode after the recognition mode wakeup word model and the recognition mode voiceprint model are matched together; the precondition of step S106 is that the off-board speech recognizer 2 can enter the recognition mode by separately matching the recognition mode wakeup word model.
Compared with the step S105, the third path has less voiceprint matching time and recognition mode voiceprint model matching time, so that the wakeup rate and the response speed of the vehicle-external speech recognizer 2 are faster, and the local low transmission path is utilized to perform fast feedback on the instruction of the user, and the response speed of the third path is a fastest response path except for the wakeup-free instruction.
When the local tail gate control word model of the vehicle exterior voice recognizer 2 is used for matching control words, the vehicle exterior voice recognizer 2 converts the vehicle exterior audio frequency which is picked up again into a digital signal from an analog signal and then sends the digital signal to the central control processor 3; the central processor 3 converts the external audio digital signals into analog signals again, and outputs the external audio analog signals to the cloud recognition system 10 through the in-vehicle voice recognizer 8.
In step S107, the in-vehicle speech recognizer 8 outputs a fourth tailgate control instruction.
The step S107 corresponds to the path four in fig. 6, and the specific steps of the step S107 are:
if the voiceprint recognition mode is started, outputting a request for inputting feedback information containing control words by a user outside the vehicle;
when the off-vehicle audio which is picked up by the off-vehicle microphone 1 and input again by the off-vehicle user based on the feedback information is acquired, inputting the picked off-vehicle audio into the local tail gate control word model for matching;
if the control words in the local tail gate control word model cannot be matched from the picked-up outside audio, the picked-up outside audio is transferred to the cloud recognition system 10 through the central control processor 3 and the in-vehicle voice recognizer 8, and the online tail gate control word model of the cloud recognition system 10 is used for matching the control words;
if the control words in the local tail gate control word model can be matched from the picked-up external audio, the cloud recognition system 10 outputs the fourth tail gate control command, and the in-vehicle voice recognizer 8 sends the fourth tail gate control command to the central control processor 3.
For the cloud recognition system 10, the online tail gate control word model records some control words with more control words and richer vocabularies than those in the local tail gate control word model. Since the cloud recognition system 10 stores a huge amount of recognition resources, the cloud recognition system 10 can recognize many control word resources that are not stored in the off-vehicle speech recognizer 2, and therefore the cloud recognition system 10 can recognize more user commands.
The safety of the user can be effectively guaranteed under the fourth path, and all instructions of the user can be recognized by utilizing the high semantic generalization capability of the cloud.
In step S108, the in-vehicle speech recognizer 8 outputs a fifth tailgate control instruction.
The step S108 corresponds to the path five in fig. 7, and the specific steps of the step S108 are:
if the voiceprint recognition mode is not started, outputting a request for inputting feedback information containing control words by a user outside the vehicle;
when the vehicle exterior audio which is picked up by the vehicle exterior microphone 1 and input again by the vehicle exterior user based on the feedback information is obtained, inputting the vehicle exterior audio which is picked up again into the local tail gate control word model for matching;
if the control words in the local tail gate control word model cannot be matched from the picked-up external audio, the picked-up external audio is transferred to the cloud recognition system 10 through the central control processor 3 and the in-vehicle voice recognizer 8, and the online tail gate control word model of the cloud recognition system 10 is used for matching the control words;
if the control words in the local tail gate control word model can be matched from the picked-up external audio, the cloud recognition system 10 outputs the fourth tail gate control command, and the in-vehicle voice recognizer 8 sends the fourth tail gate control command to the central control processor 3.
For the cloud recognition system 10, the online tail gate control word model records some control words with more control words and richer vocabularies than those in the local tail gate control word model. Since the cloud recognition system 10 stores a huge amount of recognition resources, the cloud recognition system 10 can recognize many control word resources that are not stored in the off-board speech recognizer 2, so that the cloud recognition system 10 can recognize more user commands, and can recognize more user commands compared to the above steps S105 and S106.
Meanwhile, compared with the step S107, in the step S108, the matching time of the voiceprint matching and the matching time of the recognition mode voiceprint model are reduced in the path five, so that the wakeup rate and the response speed of the speech recognizer 2 outside the vehicle are quicker, and meanwhile, the instruction of the user can be fed back quickly by using a local low transmission path.
Step S109, the in-vehicle speech recognizer 8 performs control word matching on the outside audio picked up by the outside microphone 1, and outputs a sixth tailgate control instruction.
This step S109 corresponds to the sixth route in fig. 7. The sixth path has a certain opening condition (i.e. on the premise that the tail gate is opened), and mainly plays a role in assisting the wake-up rate.
In order to ensure the success rate of identifying the tail gate control command when the tail gate is opened, when the BDCR controller 6 detects that the state of the tail gate electric stay 7 is an open state (i.e., the tail gate is open), the BDCR controller will inform the central control processor 3 through the CAN network 9, and when the central control processor 3 receives the open state of the tail gate, the BDCR controller identifies the open mode in the vehicle. When the BDCR controller 6 detects that the state of the tail gate electric stay 7 is the non-open state, it will inform the central control processor 3 through the CAN network 9, and when the central control processor 3 receives the non-open state, it will identify the close mode in the vehicle.
Under the condition that the in-vehicle recognition opening mode is opened, if the out-vehicle audio transmitted by the out-vehicle sound source through the in-vehicle microphone 11 hits the on-line tailgate control word model in the in-vehicle voice recognizer 8, the sixth tailgate control instruction is output, and the central control processor 3 judges whether to issue the sixth tailgate control instruction to the BDRC controller 6 through the tailgate opening, the learning state and the running state acquired in real time by the CAN network 9.
The online tailgate control word model in the in-vehicle speech recognizer 8 is masked in the in-vehicle recognition closed mode, and at this time, the tailgate control command in the in-vehicle speech recognizer 8 no longer responds.
In step S110, the central control processor 3 executes the tail gate control instruction.
For the central control processor 3, after receiving the first to sixth tailgate control instructions, the central control processor 3 issues a corresponding tailgate control signal to the CAN network 9, and at this time, when the BDCR controller 6 receives the signal, the BDCR controller directly controls the operation of the tailgate electric stay 7 through the hall signal, thereby finally achieving the purpose of controlling the tailgate.
The embodiment of the invention provides various specific application scenes for realizing the opening and closing control of the vehicle tail gate in a non-contact manner, and realizes the control of the vehicle tail gate by using the voice data outside the vehicle. The voice data outside the vehicle is accurately recognized by combining various recognition modes of voiceprint recognition, awakening-free word recognition and control word recognition, and the accuracy of controlling the tail gate of the vehicle is improved.
The present invention also provides an automobile comprising: the system comprises an external microphone 1, an external voice recognizer 2, an internal voice recognizer 8, an internal microphone 11 connected with the internal voice recognizer 8, a central control processor 3, a door controller and a door actuating mechanism which are sequentially connected;
the vehicle exterior voice recognizer 2 and the vehicle interior voice recognizer 8 are respectively connected with the central control processor 3;
the vehicle exterior voice recognizer 2 outputs an electric door control command or judges whether to enter a recognition mode according to the vehicle exterior audio picked by the vehicle exterior microphone 1;
when the vehicle-exterior voice recognizer 2 enters a recognition mode, the central control processor 3 sends vehicle-exterior audio sent by the vehicle-exterior voice recognizer 2 to a cloud recognition system 10 which is connected with the vehicle-interior voice recognizer in advance through the vehicle-interior voice recognizer 8, so that the cloud recognition system 10 performs online model matching to output an electric door control instruction, and the electric door control instruction is sent to the central control processor 3 through the vehicle-interior voice recognizer 2;
the in-vehicle voice recognizer 8 outputs an electric door control command according to the out-vehicle audio picked up by the in-vehicle microphone 11;
the central control processor 3 outputs an electric door control command transmitted from the vehicle exterior voice recognizer 2 or the vehicle interior voice recognizer 8 to the door controller, and causes the door controller to control the door actuator to perform opening and closing operations.
While the invention has been described in detail in connection with only a limited number of embodiments, the invention is not limited to the specific embodiments shown and described, but is capable of numerous uses and applications in various fields of endeavour to which the invention pertains. Additional modifications, additions and substitutions will readily occur to those skilled in the art, and the invention should not be viewed as limited by the foregoing description, without departing from the general concept defined by the claims and their equivalents.

Claims (13)

1. A vehicle electric door contactless control method is applied to a vehicle electric door contactless control system, and the vehicle electric door contactless control system comprises the following steps: the electric door control method comprises a door control module, an external audio processing module and an online identification processing module which are connected through the door control module, and the electric door control method comprises the following steps:
the door control module controls the opening and closing of the electric door according to the electric tail door control instruction when acquiring the electric door control instruction sent by the external audio processing module or the online identification processing module;
the electric door control command sent by the vehicle exterior audio processing module is output after local model matching is carried out on vehicle exterior audio picked up outside the vehicle;
and the electric door control command sent by the online identification processing module is output after online model matching is carried out on the vehicle exterior audio picked up outside the vehicle when a trigger signal of the vehicle exterior audio processing module entering the identification mode is received.
2. The vehicle electric door contactless control method according to claim 1, wherein the electric door control command sent by the online identification processing module is further:
when the electric door is in an opening state, the audio outside the vehicle, which is picked up in the vehicle, is output after local model matching.
3. The vehicle power door contactless control method of claim 1, wherein the local model of the off-board audio processing module comprises:
a locally stored door wake-free word model, a recognition mode wake-up word model, a recognition mode voiceprint model and a local door control word model;
the specific process of the external audio processing module for carrying out local model matching on the external audio picked up outside the vehicle comprises the following steps:
judging whether a voiceprint recognition mode is started or not;
if the voiceprint recognition mode is started, respectively inputting first-time external voice frequencies picked up outside the automobile into a tail gate wake-free word model, a recognition mode wake-up word recognition model and a recognition mode voiceprint model for data matching, so that a first electric tail gate control instruction is directly output by the tail gate wake-free word model, or a second electric tail gate control instruction is output by a local tail gate control word model according to newly-input second-time external voice frequencies after the voiceprint recognition mode is started;
if the voiceprint recognition mode is not opened, the first time of the external audio frequency picked up outside the automobile is respectively input into the door wake-up-free word model and the recognition mode wake-up word recognition model for data matching, so that a first electric door control command is directly output by the door wake-up-free word model, or a third electric door control command is output by the local door control word model according to the newly input second time of the external audio frequency after the external audio frequency enters the recognition mode.
4. The vehicle power door contactless control method according to claim 3,
if the voiceprint recognition mode is started, the external audio processing module enters the recognition mode requirement: matching the awakening words related to the identification mode awakening word identification model from the first off-board audio, and matching the voiceprint of the first off-board audio with one voiceprint of the identification mode voiceprint model;
if the voiceprint recognition mode is not started, the external audio processing module enters the recognition mode requirement: and matching the awakening words associated in the identification mode awakening word identification model from the first off-board audio.
5. The vehicle electric door contactless control method according to claim 3 or 4, characterized in that after entering the recognition mode, the vehicle exterior audio processing module requests the vehicle exterior user to input feedback information containing control words through the door control module;
picking up the second off-board audio input again by the off-board user based on the feedback information outside the vehicle;
inputting the secondary outside audio into a local door control word model;
if the control words related to the local door control word model are matched from the second external audio frequency, outputting a second electric door control instruction or a third electric door control instruction;
wherein, the second electric door control command is output when the voiceprint recognition mode is opened; the third electric door control command is output when the voiceprint recognition mode is not opened.
6. The vehicle power door contactless control method according to claim 3,
the online model of the online identification processing module is as follows: controlling a word model on line;
the specific process of performing online model matching on the off-board audio picked up outside the vehicle by the online identification processing module comprises the following steps:
judging whether a voiceprint recognition mode is started or not;
inputting the secondary outside audio into the online door control word model;
if the control words related to the online door control word model are matched from the second off-board audio, outputting a fourth electric door control instruction or a fifth electric door control instruction;
wherein, the fourth electric door control command is output when the voiceprint recognition mode is opened; and the fifth electric door control command is output when the voiceprint recognition mode is not opened.
7. The contactless control method of the vehicular electric door according to claim 3, characterized in that the voiceprint recognition mode being on means that one or more pieces of voiceprint information registered by a user are recorded in a recognition mode voiceprint model;
the voiceprint recognition mode is not started, namely the voiceprint information registered by the user is not recorded in the voiceprint model in the recognition mode.
8. The vehicle power door contactless control method according to claim 2,
the local model of the online identification processing module is as follows: a vehicle interior door control word model;
the specific process of carrying out local model matching on the outside-vehicle audio picked up in the vehicle by the online identification processing module is as follows:
inputting the outside audio picked up from the inside of the vehicle into the inside door control word model;
and if the control words related to the control word model of the door in the automobile are matched in the audio outside the automobile picked from the automobile, outputting an electric door control command.
9. The contactless control method for the vehicle electrically operated door according to claim 1, wherein the door control module is first awakened by the whole vehicle awakening module of the contactless control system for the vehicle electrically operated door before acquiring the control command for the electrically operated door sent by the external audio processing module or the online identification processing module, and supplies power to the external audio processing module and the online identification processing module after awakening.
10. The vehicle power door contactless control system of claim 1, wherein the power door is one or more of a power tailgate, a power front hatch door, and a power sunroof door.
11. A vehicle power door contactless control system, comprising:
the online recognition processing module is formed by an in-vehicle voice recognizer, an in-vehicle microphone connected with the in-vehicle voice recognizer and a cloud recognition system;
the door control module is formed by a central control processor, a door controller and a door execution mechanism which are connected in sequence;
the vehicle exterior voice recognizer and the vehicle interior voice recognizer are respectively connected with the central control processor;
the vehicle exterior voice recognizer outputs an electric door control command or judges whether to enter a recognition mode according to the vehicle exterior audio picked by the vehicle exterior microphone;
when the vehicle-exterior voice recognizer enters a recognition mode, the central control processor sends vehicle-exterior audio sent by the vehicle-exterior voice recognizer to the cloud recognition system through the vehicle-interior voice recognizer, and the cloud recognition system outputs an electric door control command after performing online model matching and sends the command to the central control processor through the vehicle-interior voice recognizer;
the in-vehicle voice recognizer outputs an electric door control command according to the out-vehicle audio picked by the in-vehicle microphone;
the central control processor outputs the electric door control command sent by the vehicle exterior voice recognizer or the vehicle interior voice recognizer to the door controller, so that the door controller controls the door actuating mechanism to open and close.
12. The vehicle power door contactless control system of claim 11, further comprising:
the whole vehicle awakening module is formed by connecting a key and a BCM vehicle body controller through Bluetooth;
the BCM vehicle body controller is connected with the central control processor;
and after the BCM vehicle body controller passes the key authentication, awakening the central control processor in the dormant state, so that the central control processor supplies power for the vehicle exterior voice recognizer and the vehicle interior voice recognizer.
13. An automobile, comprising: the system comprises an external microphone, an external voice recognizer, an internal microphone, a central control processor, a door controller and a door actuating mechanism, wherein the external microphone and the external voice recognizer are connected with each other;
the vehicle exterior voice recognizer and the vehicle interior voice recognizer are respectively connected with the central control processor;
the vehicle exterior voice recognizer outputs an electric door control command or judges whether to enter a recognition mode according to the vehicle exterior audio picked by the vehicle exterior microphone;
when the vehicle-exterior voice recognizer enters a recognition mode, the central control processor sends vehicle-exterior audio sent by the vehicle-exterior voice recognizer to a cloud recognition system which is connected with the vehicle-exterior voice recognizer in advance through the vehicle-interior voice recognizer, so that the cloud recognition system carries out online model matching to output an electric door control command and sends the command to the central control processor through the vehicle-interior voice recognizer;
the in-vehicle voice recognizer outputs an electric door control command according to the out-vehicle audio picked by the in-vehicle microphone;
the central control processor outputs the electric door control command sent by the vehicle exterior voice recognizer or the vehicle interior voice recognizer to the door controller, so that the door controller controls the door actuating mechanism to open and close.
CN202211510677.0A 2022-11-29 2022-11-29 Vehicle electric door non-contact control method and system and automobile Pending CN115711077A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211510677.0A CN115711077A (en) 2022-11-29 2022-11-29 Vehicle electric door non-contact control method and system and automobile

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211510677.0A CN115711077A (en) 2022-11-29 2022-11-29 Vehicle electric door non-contact control method and system and automobile

Publications (1)

Publication Number Publication Date
CN115711077A true CN115711077A (en) 2023-02-24

Family

ID=85235271

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211510677.0A Pending CN115711077A (en) 2022-11-29 2022-11-29 Vehicle electric door non-contact control method and system and automobile

Country Status (1)

Country Link
CN (1) CN115711077A (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000080828A (en) * 1998-09-07 2000-03-21 Denso Corp Vehicle control device
JP2019157449A (en) * 2018-03-12 2019-09-19 オムロンオートモーティブエレクトロニクス株式会社 Vehicle control device and door control system
CN110322596A (en) * 2018-03-30 2019-10-11 上海擎感智能科技有限公司 Boot method of controlling switch and system based on position identification and speech recognition
US20200047687A1 (en) * 2018-08-10 2020-02-13 SF Motors Inc. Exterior speech interface for vehicle
CN110843725A (en) * 2019-07-30 2020-02-28 中国第一汽车股份有限公司 Vehicle action control method and automobile
CN111312238A (en) * 2019-07-30 2020-06-19 中国第一汽车股份有限公司 Vehicle action control method and automobile
CN111369992A (en) * 2020-02-27 2020-07-03 Oppo(重庆)智能科技有限公司 Instruction execution method and device, storage medium and electronic equipment
JP2021099406A (en) * 2019-12-20 2021-07-01 日本電産モビリティ株式会社 Vehicle controller, control method of vehicle controller, and vehicle control system
CN113345433A (en) * 2021-05-30 2021-09-03 重庆长安汽车股份有限公司 Voice interaction system outside vehicle
CN113393846A (en) * 2021-06-15 2021-09-14 何治平 Voice control vehicle control system and method thereof

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000080828A (en) * 1998-09-07 2000-03-21 Denso Corp Vehicle control device
JP2019157449A (en) * 2018-03-12 2019-09-19 オムロンオートモーティブエレクトロニクス株式会社 Vehicle control device and door control system
CN110322596A (en) * 2018-03-30 2019-10-11 上海擎感智能科技有限公司 Boot method of controlling switch and system based on position identification and speech recognition
US20200047687A1 (en) * 2018-08-10 2020-02-13 SF Motors Inc. Exterior speech interface for vehicle
CN110843725A (en) * 2019-07-30 2020-02-28 中国第一汽车股份有限公司 Vehicle action control method and automobile
CN111312238A (en) * 2019-07-30 2020-06-19 中国第一汽车股份有限公司 Vehicle action control method and automobile
JP2021099406A (en) * 2019-12-20 2021-07-01 日本電産モビリティ株式会社 Vehicle controller, control method of vehicle controller, and vehicle control system
CN111369992A (en) * 2020-02-27 2020-07-03 Oppo(重庆)智能科技有限公司 Instruction execution method and device, storage medium and electronic equipment
CN113345433A (en) * 2021-05-30 2021-09-03 重庆长安汽车股份有限公司 Voice interaction system outside vehicle
CN113393846A (en) * 2021-06-15 2021-09-14 何治平 Voice control vehicle control system and method thereof

Similar Documents

Publication Publication Date Title
CN113345433B (en) Voice interaction system outside vehicle
US7881929B2 (en) Ambient noise injection for use in speech recognition
US8738368B2 (en) Speech processing responsive to a determined active communication zone in a vehicle
US7202775B2 (en) Key fob with remote control functions
DE102019107624A1 (en) System and method for fulfilling a voice request
CN205354646U (en) Intelligence speech recognition system for mobile unit
CN106164398A (en) Mobile device, vehicle remote operation system, vehicle remote operation method and program
CN210489237U (en) Vehicle-mounted intelligent terminal voice control system
CN110525379A (en) A kind of pure electric automobile speech unlocking system and method
US20130211832A1 (en) Speech signal processing responsive to low noise levels
JP2019183504A (en) Vehicle door control device
WO2018233300A1 (en) Voice recognition method and voice recognition device
KR20140067687A (en) Car system for interactive voice recognition
CN106114518A (en) Cruise system that a kind of phonetic entry is controlled and vehicle
CN115711077A (en) Vehicle electric door non-contact control method and system and automobile
CN109922397A (en) Audio intelligent processing method, storage medium, intelligent terminal and smart bluetooth earphone
CN113228167B (en) Voice control method and device
CN213683665U (en) Electric tail gate control system based on voice recognition
CN112331200A (en) Vehicle-mounted voice control method
CN112053678B (en) Switch lock method and system based on voice recognition, switch lock body and sharing vehicle
CN114758654A (en) Scene-based automobile voice control system and control method
CN108765676B (en) Suitcase that voice control unblanked
CN113113011A (en) Vehicle-mounted voiceprint control device and method
CN110083392A (en) Audio wakes up method, storage medium, terminal and its bluetooth headset pre-recorded
US11955123B2 (en) Speech recognition system and method of controlling the same

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination