WO2021004249A1

WO2021004249A1 - Intelligent vehicle starting method and system based on ear canal recognition

Info

Publication number: WO2021004249A1
Application number: PCT/CN2020/096923
Authority: WO
Inventors: 胡林; 郭广涛; 黄晶; 肖凌云; 王国春
Original assignee: 长沙理工大学
Priority date: 2019-07-09
Filing date: 2020-06-19
Publication date: 2021-01-14
Also published as: CN110341647A

Abstract

Disclosed are an intelligent vehicle starting method and system based on ear canal recognition. The method comprises: step 1, acquiring ear canal information of a user; step 2, performing first identity verification on the user by comparing the received ear canal information with pre-stored ear canal information; step 3, if the first identity verification is successful, starting a vehicle starting module, and determining, according to the internal air temperature of a vehicle, whether to turn on a cooling mode or a heating mode of an air conditioner of the vehicle; step 4, calculating a relative distance using real-time positioning information of the vehicle and the user, and opening a vehicle door when the relative distance is less than a preset vehicle door opening distance, otherwise, repeating step 4; and step 5, performing second identity verification on a person on a driving seat when it is detected that there is a person sitting on the driving seat; and unlocking the vehicle starting module if the second identity verification is successful, otherwise, triggering a vehicle alarm system, and quitting an intelligent vehicle starting process. The intelligent vehicle starting method and system based on ear canal recognition are high in speed and accuracy in terms of identity identification of a user, and make a vehicle more intelligent and safer.

Description

Automobile intelligent starting method and system based on ear canal recognition

Technical field

The invention relates to the field of automobiles, in particular to an intelligent starting method and system for automobiles based on ear canal recognition.

Background technique

With the development of the times, various smart devices gradually influence and change people's lifestyles with their intelligence and convenience, which in turn causes people to put forward intelligent requirements for other surrounding devices. In particular, automobiles have become the preferred mode of transportation for people to travel. Therefore, it is necessary to study an all-round intelligent automobile starting method and system to meet people's high comfort requirements for automobile travel.

Based on the consideration of automobile intelligence and anti-theft safety, the existing technology of automobile door opening adopts various methods, such as the remote control method based on hardware buttons, the character password input method based on encryption and decryption algorithms, the automatic opening method based on biometric recognition, etc. However, the above methods all have the disadvantages of complicated operations and easy leakage of decrypted information. In particular, they require the user to be in close range of the car and require the user to input information to complete the identity matching and open the car door. After fingerprint recognition and face recognition, NEC introduced ear canal recognition technology in 2016. The recognition technology is that the sound waves emitted by the earphone pass through the tympanic membrane of the external auditory canal, reach the middle ear and inner ear, and then reflect back to the tympanic membrane. The resulting acoustic resonance spectrum has individual differences between people, so the user's identity can be judged by sample matching . This technology is not affected by the motion state of the human body, even if the user is active, the user can still be continuously identified.

In recent years, the weather has become extreme, that is, the trend of ultra-cold in winter and ultra-hot in summer. In such severe weather conditions, the existing methods are to turn on the vehicle to preheat or cool the vehicle in advance. The internal temperature can return to the acceptable comfort range of the human body. The existing remote control type, character password input type and fingerprint/iris recognition all require the completion of identity matching within the distance of the car, resulting in insufficient time to turn on the air conditioner to preheat or cool in advance, which is completely inconsistent with people’s comfort for the vehicle. Claim.

Therefore, it is necessary to provide a new intelligent starting method for automobiles that is not affected by the human body motion state, is not affected by the identity matching distance limit, and has high confidentiality, so as to improve the intelligentization and anti-theft safety performance of the automobile and the comfort requirements of the automobile travel .

Summary of the invention

Based on the existing technical problems, the present invention provides a vehicle intelligent starting method and system based on ear canal recognition, which is not affected by the human body motion state and has high confidentiality, thereby improving the intelligentization and anti-theft safety performance of the vehicle and the comfort of the vehicle travel Sexual requirements.

In order to achieve the above technical objectives, the present invention adopts the following technical solutions:

An intelligent starting method of a car based on ear canal recognition includes the following steps:

Step 1. Obtain the user's ear canal information;

Step 2. Perform the first authentication of the user:

Determine whether the user's ear canal information matches the pre-stored ear canal information; if it is, the first authentication is successful, and step 3 is executed; otherwise, the first authentication fails, the car alarm system is triggered, and the car smart start process is exited;

Step 3. Measure the vehicle's internal air temperature: if the vehicle's internal air temperature is greater than the maximum value of the preset temperature range, turn on the vehicle air conditioning cooling mode; if the vehicle interior air temperature is less than the minimum value of the preset temperature range, turn on the vehicle air conditioning heating Mode; otherwise, proceed directly to the next step; step 4, obtain the current positioning information of the car and the user's real-time positioning information, and use the current positioning information of the car and the user's real-time positioning information to calculate the relative distance;

When the relative distance is less than the preset door opening distance, open the door and perform step 5; otherwise, repeat step 4;

Step 5, real-time detection of whether a person is seated in the driving position; when a person is seated in the driving position, the second identity verification is performed on the driving position; if the second identity verification is successful, the car start module is unlocked, otherwise the car is triggered Alarm system, exit the intelligent start process of the car.

Further, the first successful identity verification in step 2 also includes starting the car start module to supply power to the vehicle equipment, but the steering wheel is locked and the vehicle cannot be driven normally.

Further, if the second identity verification in step 5 is successful, unlocking the car activation module includes unlocking the steering wheel.

Further, before performing the second identity verification on the driver’s seat, it also includes: detecting whether the driver’s seat belt is worn: if so, enable the second identity verification device to be effective and allow the second identity verification; otherwise, Keep the second authentication device invalid and not allow the second authentication.

Further, the second identity verification uses a keyboard password to perform the second identity verification on the driving person.

Further, the second identity verification provides N2 verification opportunities, and the specific method for performing the second identity verification is:

Receive password input, compare the received password information with the pre-stored password information, if the two are the same, the second authentication is successful, otherwise you will be prompted to re-enter the password and repeat this step;

If the password information received at the N2th time is still different from the pre-stored password information, the second identity verification fails.

Further, the first identity verification provides N1 verification opportunities, the specific method is:

Receive the ear canal information and compare the received ear canal information with the pre-stored ear canal information: if the two are the same, the first authentication is successful; otherwise, re-acquire the user's ear canal information and repeat this step until the N1th time When the received ear canal information is still different from the pre-stored ear canal information, the first authentication fails.

Further, the ear canal information of the user is acquired by using earphones. The earphones include an audio playback module, a signal acquisition module and a first wireless communication module. The specific process of step 1 is:

The audio playback module sends an audio signal to the user, and the signal acquisition module receives the reflected audio signal; the reflected audio signal refers to the signal reflected by the user's ear canal after receiving the audio signal;

The first wireless communication module uses a synchronous iteration method to denoise the reflected audio signal, calculates the resonance spectrum characteristic information of the reflected audio signal, and wirelessly sends the resonance spectrum characteristic information as ear canal information to the vehicle.

Correspondingly, a vehicle intelligent starting system based on ear canal recognition is also provided, including a headset and a vehicle-side control device;

The headset is used to receive information acquisition instructions from the vehicle-side control device and execute the information acquisition instructions, and send the acquired information to the vehicle-end control device; the information acquisition instruction refers to acquiring user's ear canal information and real-time information Positioning information

The vehicle-side control device includes a first identity verification module, an air conditioner activation module, a car door control module, a second identity verification module, a car alarm module, and a car activation module;

The first identity verification module is used to determine whether the user's ear canal information matches the pre-stored ear canal information, and confirm the match as the first authentication success, and the mismatch as the first authentication failure ；

The air conditioner start module is used to measure the air temperature inside the vehicle when the first authentication is successful, and turn on the vehicle air conditioner cooling mode when the vehicle interior temperature is greater than the maximum value of the preset temperature range, and when the vehicle interior air temperature is less than the preset temperature Turn on the vehicle air-conditioning heating mode at the minimum temperature range, and do not turn on the vehicle air-conditioning cooling mode and heating mode when the internal air temperature of the vehicle is within the preset temperature range;

The door control module is used to obtain the current positioning information of the car and the user's real-time positioning information, and use the current positioning information of the car and the user's real-time positioning information to calculate the relative distance, and open the door when the relative distance is less than the preset door opening distance ；

The second identity verification module is used for real-time detection of whether a person is seated in the driving position, and when a person is seated in the driving position is detected, the second identity verification is performed on the person in the driving position, and the second identity verification is successful Unlock the car start module at time;

The car alarm system is used to give a vehicle alarm prompt when the first identity verification fails or the second identity verification fails.

Further, the headset includes a first wireless communication module, the vehicle end control device includes a second wireless communication module, and the first wireless communication module and the second wireless communication module are used for controlling the headset and the vehicle end. Information acquisition instructions and user information are exchanged between devices.

Further, the vehicle-side control device further includes a seat belt detection module; the seat belt detection module is used to detect whether the driver is wearing a seat belt, and enable the second identity when the seat belt is fastened Verify that the device is valid, and keep the second authentication device invalid without wearing a seat belt.

Beneficial effect

The present invention uses ear canal recognition technology to perform identity verification on the user, no special action is required, which simplifies the operation action of the intelligent opening of the car, and even during exercise and work, it is only necessary to wear a headset with a built-in microphone that matches the vehicle. That is, it is more convenient; the ear canal recognition technology recognizes the vehicle user's identity with fast recognition speed and high accuracy; the ear canal recognition technology is applied to the field of intelligent opening of the car, so that the car has a higher safety performance. It’s more intelligent. The air conditioner is turned on for pre-cooling or pre-heating before the user enters the car, and the car door is automatically opened on the basis of safety; and the car start module can be unlocked after the second identity verification, which further improves Improve the safe driving performance of the car.

In summary, the present invention applies the ear canal recognition technology to the vehicle to perform identity verification and recognition for the car user. The recognition speed is fast and the accuracy is high; only after the ear canal feature recognition is passed, the air conditioner will be turned on in advance to preheat Or pre-cooling, and distance judgment to determine whether to open the door automatically, which makes the car more intelligent and safe, and improves the comfort and convenience of users using the car to travel.

Description of the drawings

Figure 1 is a structural block diagram of the system of the present invention;

Figure 2 is a schematic flow chart of the method of the present invention;

Fig. 3 is a schematic diagram of the distance judging the door opening according to the present invention.

Detailed ways

The embodiments of the present invention will be described in detail below. This embodiment is carried out based on the technical solutions of the present invention, and detailed implementation manners and specific operation procedures are given to further explain the technical solutions of the present invention.

This embodiment provides a method for car smart start based on ear canal recognition, which is applied to a car smart start system, where the car smart start system includes a headset and a vehicle-side control device; wherein the headset includes an audio playback module, a signal acquisition module, and a A wireless communication module and a first positioning module. The vehicle-side control device includes an MCU control module, a second wireless communication module, a feature extraction module, a feature recognition module, a password keyboard, a steering wheel unlocking module, a distance discrimination module, an air conditioning start module, and a pressure sensor , Output drive module, door control module, car start module, second positioning module and car alarm system. The specific car smart start method includes the following steps:

Step 0: When buying a car, specify 1 to 4 owners of the car to obtain the owner’s ear canal information, that is, the owner’s sound resonance spectrum characteristic information is pre-stored in the characteristic recognition module of the vehicle control device, and in the headset Audio signals with a storage capacity of less than 2MB.

Step 1. Obtain the user's ear canal information;

The user presses the power-on switch of the headset worn by the user and presses the button for playing audio, the audio playback module of the headset plays the pre-stored audio signal;

The audio signal is transmitted into the ear canal, and the signal collection module (ie, microphone) in the earphone collects the reflected audio signal; the reflected audio signal refers to the signal reflected by the user's ear canal after receiving the audio signal;

The filter circuit of the first wireless communication module uses the synchronous iteration method to calculate the average value of the reflected audio signal waveform, performs denoising processing, and calculates the resonance spectrum characteristic information;

The first wireless communication module further encodes and modulates the resonance spectrum characteristic information, and then sends it to the vehicle control device.

Step 2. Perform the first identity verification on the user;

Step 2.1: The second communication module of the vehicle control device receives the modulated resonance spectrum characteristic information from the headset, and performs demodulation and decoding;

Step 2.2: After the demodulation and decoding are completed, the feature extraction module extracts the decoded resonance spectrum feature information from the second communication module and sends it to the feature recognition module;

Step 2.3: The feature recognition module compares the resonance spectrum feature information with the pre-stored resonance spectrum feature information to complete the first identity verification of the user: if the resonance spectrum feature information is the same as the pre-stored resonance spectrum feature information, the first time The identity verification is successful, start the car start module. Go to step 3; otherwise, follow step 1 to retrieve the user's ear canal information and return to step 2.1;

If the resonance spectrum characteristic information compared for 3 consecutive times is different from the pre-stored resonance spectrum characteristic information, the first identity verification fails, and the car alarm system is triggered at this time, and the car intelligent start process is exited.

In step 2.3, when reacquiring the user's ear canal information, it specifically refers to: first feedback the information of the first authentication failure to the headset, so that the audio playback module will play the pre-stored audio signal again, and the rest of the process is the same as in step 1 above The process of obtaining ear canal information is the same.

In addition, the wireless communication method between the first wireless communication module of the headset and the second wireless communication module of the vehicle side may be a short-range wireless communication technology or a long-range wireless communication technology, including Zig-Bee, Bluetooth, wireless broadband, and ultra-wideband , NFC, GPRS/CDMA wireless communication technology, digital radio, spread spectrum microwave, wireless bridge, satellite communication and short barge communication, etc. Considering the convenience of the user (the communication distance must be far enough) and the earphones need to meet the requirements of small and light weight, the wireless communication method in the embodiment of the present invention specifically adopts the GPRS wireless communication technology, which is different compared to other wireless communication technologies. Limited by the relative distance between the user and the car, the comfort and convenience of the user in the car are improved; and the GPRS network utilization rate is higher, which makes the method and system of the present invention easier to popularize.

Step 3. After the first authentication is successful, measure the internal air temperature of the vehicle: if the internal air temperature of the vehicle is greater than the maximum value temp _{max of the} preset temperature range, turn on the vehicle air conditioning cooling mode; if the internal air temperature of the vehicle is less than the preset temperature The minimum value temp _{min of the} range, the vehicle air conditioning heating mode is turned on; if the internal air temperature of the vehicle is between the minimum value temp _min and the maximum value temp _max of the preset temperature range, the vehicle air conditioning is not turned on.

Step 4. After the first identity verification is successful, the first positioning module of the headset periodically obtains its own real-time positioning information, that is, the user's real-time positioning information, and sends the real-time positioning information to the vehicle through the first wireless communication module Control device, received and transmitted by the second wireless communication module to the MCU control module;

At the same time, the second positioning module of the vehicle-side control device obtains the current positioning information of the vehicle in real time and transmits it to the MCU control module;

The distance discrimination module of the vehicle-side control device obtains the current positioning information of the vehicle and the real-time positioning information of the user from the MCU control module, and calculates the relative distance D between the user and the vehicle;

When the relative distance D between the user and the vehicle is less than or equal to the preset door opening distance D1, the MCU control module generates a door opening instruction and sends it to the output drive module, drives the door control module to execute the door opening instruction, and then executes step 5; otherwise, repeat the steps 4;

Step 5. When the door is opened, the user enters the car and sits in the driving position; when the pressure sensor in the driving position senses that a person is seated, it detects whether the driver in the driving position is wearing a seat belt: if so, turn on the battery power supply , To display a virtual password keyboard on the display screen, which is equivalent to enabling the second identity verification device, so that the driver can enter the password to enable the second identity verification for the driver; otherwise, the display will not be powered. That is, the second authentication device is kept invalid, and the second authentication is not allowed;

The specific method for the second identity verification of the driver is:

The MCU controller receives the password information entered by the driver's driver through the display screen, and compares the received password information with the pre-stored password information. If the two are the same, the second authentication is successful, otherwise it prompts to re-enter the password and repeat this step ; If the password information re-entered three times in a row is different from the pre-stored password information, the second authentication fails.

When the second identity verification is successful, the MCU control module unlocks the car's starting module through the output drive module, including unlocking the steering wheel, and the driver can operate the car normally;

When the second identity verification fails, the MCU control module triggers the car alarm system through the output drive module, and exits the car's intelligent start process.

The parameter selection requirements involved in this embodiment:

1) Distance discrimination module

As shown in Figure 3, 1 is the position of the car user holding the headset (D≥D1); 2 is the position of the car user holding the headset (D≤D1); 3 is the car; 4 is the position of the car, the coordinates are ( θv,ψv);

The door can be opened as long as it is within a circle with the car as the center and the preset door opening distance D1 as the radius after the first authentication is successful. As shown in Figure 3, if the car user is at position 2, the door will open, and if the car user is at position 1, the door will not open. Therefore, the preset door opening distance D1 must meet this requirement: the car user can see the car exactly when the distance D1 is away from the car. The distance discrimination module will continue to obtain the location information (θu, ψu) of the car user. In this module, the current location information (θv, ψv) of the car is also obtained, where θ represents longitude and ψ represents latitude. The calculation formula for the distance between the user and the car is:

D=2R*arcsin{[sin2((ψv-ψu)/2)+cos(ψv)*cos(ψu)*sin2((θv-θu)/2)]1/2}; where: R is of the earth radius.

2) Air conditioning start module

The air conditioner start module is powered by the battery before starting the car, and realizes the intelligent start of the air conditioner, that is, the vehicle air conditioner determines whether to turn on the air conditioner according to the outside temperature, and whether to turn on the air conditioner to turn on heating or cold air. When the current temperature temp inside the vehicle satisfies: temp≤temp _min , the air conditioner is turned on and the warm air is turned on; when the current temperature temp inside the vehicle satisfies: temp _min ≤temp≤temp _max , the air conditioner does not turn on; When the temperature temp satisfies: temp≥temp _max , the air conditioner is turned on and cold air is turned on. The maximum value temp _max and the minimum value temp _{min of the} preset temperature range can be preset according to the user's personal comfort requirements (the comfortable temperature of the human body is 18-25 degrees Celsius).

The above embodiments are preferred embodiments of the application, and those of ordinary skill in the art can also make various changes or improvements on this basis. Without departing from the general concept of the application, these changes or improvements should belong to the present application. Within the scope of the application for protection.

Claims

An intelligent starting method for a car based on ear canal recognition is characterized in that it comprises the following steps:

Step 1. Obtain the user's ear canal information;

Step 2. Perform the first authentication of the user:

Determine whether the user's ear canal information matches the pre-stored ear canal information; if it is, the first authentication is successful, and step 3 is executed; otherwise, the first authentication fails, the car alarm system is triggered, and the car smart start process is exited;

Step 3. Measure the vehicle's internal air temperature: if the vehicle's internal air temperature is greater than the maximum value of the preset temperature range, turn on the vehicle air conditioning cooling mode; if the vehicle interior air temperature is less than the minimum value of the preset temperature range, turn on the vehicle air conditioning heating Mode; otherwise proceed directly to the next step;

Step 4. Obtain the current positioning information of the car and the real-time positioning information of the user, and use the current positioning information of the car and the real-time positioning information of the user to calculate the relative distance;

When the relative distance is less than the preset door opening distance, open the door and perform step 5; otherwise, repeat step 4;

Step 5, real-time detection of whether a person is seated in the driving position; when a person is seated in the driving position, the second identity verification is performed on the driving position; if the second identity verification is successful, the car start module is unlocked, otherwise the car is triggered Alarm system, exit the intelligent start process of the car.
The method according to claim 1, characterized in that, before performing the second identity verification on the driver's position, it further comprises: detecting whether the driver's position is wearing a seat belt: if so, enabling the second identity verification device to be valid, The second authentication is allowed; otherwise, the device for the second authentication is kept invalid, and the second authentication is not allowed.
The method according to claim 1, wherein the second identity verification uses a keyboard password to perform the second identity verification on the driver in the driving position.
The method according to claim 2, wherein the second identity verification provides N2 verification opportunities, and the specific method for performing the second identity verification is:

Receive password input, compare the received password information with the pre-stored password information, if the two are the same, the second authentication is successful, otherwise you will be prompted to re-enter the password and repeat this step;

If the password information received at the N2th time is still different from the pre-stored password information, the second authentication fails.
The method according to claim 1, wherein the first identity verification provides N1 verification opportunities, and the specific method is:

Receive the ear canal information and compare the received ear canal information with the pre-stored ear canal information: if the two are the same, the first authentication is successful; otherwise, re-acquire the user's ear canal information and repeat this step until the N1th time When the received ear canal information is still different from the pre-stored ear canal information, the first authentication fails.
The method according to claim 1, wherein the ear canal information of the user is acquired by using earphones, the earphones comprising an audio playback module, a signal acquisition module and a first wireless communication module, and the specific process of step 1 is:

The audio playback module sends an audio signal to the user, and the signal acquisition module receives the reflected audio signal; the reflected audio signal refers to the signal reflected by the user's ear canal after receiving the audio signal;

The first wireless communication module uses a synchronous iteration method to denoise the reflected audio signal, calculates the resonance spectrum characteristic information of the reflected audio signal, and wirelessly sends the resonance spectrum characteristic information as ear canal information to the vehicle.
A car intelligent starting system based on ear canal recognition, which is characterized in that it includes a headset and a vehicle-side control device;

The headset is used to receive information acquisition instructions from the vehicle-side control device and execute the information acquisition instructions, and send the acquired information to the vehicle-end control device; the information acquisition instruction refers to acquiring user's ear canal information and real-time information Positioning information

The vehicle-side control device includes a first identity verification module, an air conditioner activation module, a car door control module, a second identity verification module, a car alarm module, and a car activation module;

The first identity verification module is used to determine whether the user's ear canal information matches the pre-stored ear canal information, and confirm the match as the first authentication success, and the mismatch as the first authentication failure ；

The air conditioner start module is used to measure the air temperature inside the vehicle when the first authentication is successful, and turn on the vehicle air conditioner cooling mode when the vehicle interior temperature is greater than the maximum value of the preset temperature range, and when the vehicle interior air temperature is less than the preset temperature Turn on the vehicle air-conditioning heating mode at the minimum temperature range;

The door control module is used to obtain the current positioning information of the car and the user's real-time positioning information, and use the current positioning information of the car and the user's real-time positioning information to calculate the relative distance, and open the door when the relative distance is less than the preset door opening distance ；

The second identity verification module is used for real-time detection of whether a person is seated in the driving position, and when a person is seated in the driving position is detected, the second identity verification is performed on the person in the driving position, and the second identity verification is successful Unlock the car start module at time;

The car alarm system is used to give a vehicle alarm prompt when the first identity verification fails or the second identity verification fails.
The system according to claim 7, wherein the headset includes a first wireless communication module, the vehicle-side control device includes a second wireless communication module, and the first wireless communication module and the second wireless communication module are used for Exchange information acquisition instructions and user information between the headset and the vehicle-side control device.
7. The system according to claim 7, wherein the vehicle-side control device further comprises a seat belt detection module; the seat belt detection module is used to detect whether the driver is wearing a seat belt, and is wearing a safety belt. The device for the second authentication is valid when it is worn, and the device for the second authentication is kept invalid without the seat belt.