CN116061878A - Vehicle keyless entry and starting method, device and storage medium - Google Patents

Vehicle keyless entry and starting method, device and storage medium Download PDF

Info

Publication number
CN116061878A
CN116061878A CN202211642868.2A CN202211642868A CN116061878A CN 116061878 A CN116061878 A CN 116061878A CN 202211642868 A CN202211642868 A CN 202211642868A CN 116061878 A CN116061878 A CN 116061878A
Authority
CN
China
Prior art keywords
depth image
image information
vehicle
processing
door
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211642868.2A
Other languages
Chinese (zh)
Inventor
梅军辉
郭正光
杨杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Shihang Network Technology Co ltd
Original Assignee
Shanghai Shihang Network Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Shihang Network Technology Co ltd filed Critical Shanghai Shihang Network Technology Co ltd
Priority to CN202211642868.2A priority Critical patent/CN116061878A/en
Publication of CN116061878A publication Critical patent/CN116061878A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • B60R25/20Means to switch the anti-theft system on or off
    • B60R25/25Means to switch the anti-theft system on or off using biometry
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/143Sensing or illuminating at different wavelengths
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/40Spoof detection, e.g. liveness detection
    • G06V40/45Detection of the body part being alive
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00Individual registration on entry or exit
    • G07C9/00174Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00563Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Mechanical Engineering (AREA)
  • Collating Specific Patterns (AREA)

Abstract

The invention discloses a keyless entry and starting method of a vehicle, which comprises the following steps: acquiring first depth image information of a person approaching a vehicle door, and performing face detection processing on the first depth image information; performing living body detection processing on the first depth image information according to a face detection processing result, and performing identity verification processing on the first depth image information according to the living body detection processing result; controlling whether the vehicle door is unlocked or not according to the authentication processing result; after the vehicle door is unlocked, second depth image information of a driver of the vehicle is obtained, and face recognition verification processing is carried out on the second depth image information; and controlling whether the vehicle is started or not according to the face recognition verification processing result. A device and a storage medium for implementing the vehicle keyless entry and start method are also disclosed. The invention improves the convenience and safety of unlocking and starting the vehicle.

Description

车辆无钥匙进入与启动方法、装置及存储介质Vehicle keyless entry and start method, device and storage medium

技术领域technical field

本发明涉及车辆识别方法技术领域,尤其涉及一种基于人脸识别的车辆无钥匙进入与启动方法、装置及存储介质。The present invention relates to the technical field of vehicle identification methods, in particular to a face recognition-based keyless vehicle entry and start method, device and storage medium.

背景技术Background technique

随着汽车技术的不断发展和保有量的不断增多,人们对于汽车智能化程序的需求也在不断提高。用户在购买汽车时,除了对汽车驾驶和乘坐舒适性需求外,汽车是否配有智能化设备也是考虑的重点之一。With the continuous development of automobile technology and the continuous increase of car ownership, people's demand for automobile intelligent programs is also increasing. When users buy a car, in addition to the car's driving and riding comfort requirements, whether the car is equipped with intelligent equipment is also one of the key considerations.

无钥匙进入系统已经成为现代汽车的常见配置,一定程度上为车主提供了便利性,也带来了一定的安全性问题。现有大多数的车辆无钥匙进入系统主要是利用车钥匙与车辆之间的双重射频系统匹配,仍然需要车主携带车钥匙,只能省略掏出车钥匙进行解锁的动作。而这种车辆无钥匙进入系统一般也只对车钥匙的合法性进行验证,而不具有对车主身份进行识别验证的功能。当车钥匙丢失时,若被别人捡到,别人一样可以解锁进入车内。而在实际生活中,难免会存在忘记携带车钥匙或者车钥匙丢失或者不便于携带车钥匙而又需要进入车辆并启动车辆的场景。因此,现有的车辆无钥匙进入系统的弊端便显现出来。The keyless entry system has become a common configuration of modern cars, which provides convenience to car owners to a certain extent, but also brings certain safety issues. Most of the existing vehicle keyless entry systems mainly use the dual radio frequency system matching between the car key and the vehicle, and still require the car owner to carry the car key, so the action of taking out the car key to unlock can only be omitted. And this kind of vehicle keyless entry system generally only verifies the legitimacy of the car key, and does not have the function of identifying and verifying the identity of the car owner. When the car key is lost, if it is picked up by others, others can unlock it and enter the car. However, in real life, it is inevitable that there will be scenes where the car key is forgotten or lost, or it is not convenient to carry the car key and it is necessary to enter the vehicle and start the vehicle. Therefore, the disadvantages of the existing keyless entry system for vehicles appear.

为此,本申请人经过有益的探索和研究,找到了解决上述问题的方法,下面将要介绍的技术方案便是在这种背景下产生的。For this reason, the applicant has found a solution to the above-mentioned problems through beneficial exploration and research, and the technical solutions to be introduced below are generated under this background.

发明内容Contents of the invention

本发明所要解决的技术问题之一在于:针对现有技术的不足而提供一种提高车辆解锁和启动的便利性与安全性的基于人脸识别的车辆无钥匙进入与启动方法。One of the technical problems to be solved by the present invention is to provide a keyless vehicle entry and start method based on face recognition that improves the convenience and safety of unlocking and starting the vehicle in view of the deficiencies in the prior art.

本发明所要解决的技术问题之二在于:提供一种实现上述车辆无钥匙进入与启动方法的装置。The second technical problem to be solved by the present invention is to provide a device for realizing the above method for keyless entry and start of a vehicle.

本发明所要解决的技术问题之三在于:提供一种实现上述车辆无钥匙进入与启动方法的存储介质。The third technical problem to be solved by the present invention is to provide a storage medium for realizing the above method for keyless entry and start of a vehicle.

作为本发明第一方面的一种车辆无钥匙进入与启动方法,包括:As a first aspect of the present invention, a keyless entry and start method for a vehicle includes:

获取靠近车门人员的第一深度图像信息,并对所述第一深度图像信息进行人脸检测处理;Acquiring the first depth image information of the person close to the car door, and performing face detection processing on the first depth image information;

根据人脸检测处理结果对所述第一深度图像信息进行活体检测处理,并根据所述活体检测处理结果对所述第一深度图像信息进行身份验证处理;performing live body detection processing on the first depth image information according to the face detection processing result, and performing identity verification processing on the first depth image information according to the live body detection processing result;

根据身份验证处理结果控制车门是否解锁;Control whether the door is unlocked according to the identity verification processing result;

当车门解锁后,获取车辆驾驶座人员的第二深度图像信息,并对所述第二深度图像信息进行人脸识别验证处理;以及After the door is unlocked, acquiring the second depth image information of the driver seat of the vehicle, and performing face recognition verification processing on the second depth image information; and

根据人脸识别验证处理结果控制车辆是否启动。Control whether the vehicle starts according to the face recognition verification processing result.

在本发明的一个优选实施例中,所述获取靠近车门人员的第一深度图像信息,包括:In a preferred embodiment of the present invention, the acquisition of the first depth image information of the person close to the car door includes:

当车辆处于停车锁门状态时,通过安装在车门处的第一TOF相机以待机采集帧率采集车门外的深度图像信息;When the vehicle is in the state of parking and locking the door, the depth image information outside the door is collected by the first TOF camera installed at the door at a standby acquisition frame rate;

对采集到的深度图像信息进行检测处理,以判断是否有人员靠近车门;以及Detecting and processing the collected depth image information to determine whether there is a person approaching the car door; and

若检测到有人员靠近车门,则将所述第一TOF相机以工作采集帧率对靠近车门人员进行图像采集处理,以获取靠近车门人员的第一深度图像信息。If it is detected that there is a person approaching the door, the first TOF camera will perform image acquisition processing on the person approaching the door at a working acquisition frame rate, so as to obtain the first depth image information of the person approaching the door.

在本发明的一个优选实施例中,所述第一深度图像信息包括深度图像和近红外图像。In a preferred embodiment of the present invention, the first depth image information includes a depth image and a near-infrared image.

在本发明的一个优选实施例中,所述对所述第一深度图像信息进行人脸检测处理,包括:In a preferred embodiment of the present invention, performing face detection processing on the first depth image information includes:

获取所述第一深度图像信息中的近红外图像,并对所述近红外图像送入人脸检测模块进行人脸检测处理;以及Obtain a near-infrared image in the first depth image information, and send the near-infrared image to a face detection module for face detection processing; and

根据人脸检测处理结果判断所述近红外图像中是否存在人脸,若检测到人脸,则进行活体检测处理和身份验证处理,若未检测到人脸,则继续通过所述第一TOF相机以工作采集帧率对靠近车门人员进行图像采集并再次进行人脸检测处理,若检测到人员离开,则将所述第一TOF相机的采集帧率调整为待机采集帧率。Judging whether there is a human face in the near-infrared image according to the result of human face detection processing, if a human face is detected, then perform living body detection processing and identity verification processing, if no human face is detected, continue to pass through the first TOF camera At the working acquisition frame rate, image acquisition is performed on the person approaching the car door and the face detection process is performed again. If it is detected that the person leaves, the acquisition frame rate of the first TOF camera is adjusted to the standby acquisition frame rate.

在本发明的一个优选实施例中,所述根据人脸检测处理结果对所述第一深度图像信息进行活体检测处理,包括:In a preferred embodiment of the present invention, performing the living body detection processing on the first depth image information according to the face detection processing result includes:

若人脸检测处理结果为检测到人脸,则分别对所述第一深度图像信息中的深度图像和近红外图像进行图像调整处理;If the face detection processing result is that a human face is detected, image adjustment processing is performed on the depth image and the near-infrared image in the first depth image information respectively;

对经过图像调整处理后的深度图像进行梯度图像处理,得到所述深度图像的水平方向、垂直方向以及中心到边缘方向的梯度图像,并将三张梯度图像合并为三通道深度图像;Gradient image processing is performed on the depth image after image adjustment processing to obtain gradient images in the horizontal direction, vertical direction, and center-to-edge direction of the depth image, and merge the three gradient images into a three-channel depth image;

将经过图像调整处理后的深度图像和近红外图像进行合并处理,得到三通道灰度图像;Combine the depth image and near-infrared image after image adjustment to obtain a three-channel grayscale image;

将所述三通道深度图像送入基于深度图像的活体检测模型计算深度图像模型得分;The three-channel depth image is sent into a depth image-based living body detection model to calculate the depth image model score;

若所述深度图像模型得分高于第一活体阈值,则将所述三通道灰度图像送入基于近红外图像的活体检测模型计算灰度图像模型得分;If the depth image model score is higher than the first living body threshold, the three-channel grayscale image is sent to a living body detection model based on near-infrared images to calculate the grayscale image model score;

若所述灰度图像模型得分高于第二活体阈值,则所述三通道深度图像、三通道灰度图像对应地放入深度图像缓存队列、灰度图像缓存队列内;If the grayscale image model score is higher than the second in vivo threshold, the three-channel depth image and the three-channel grayscale image are correspondingly put into a depth image cache queue and a grayscale image cache queue;

重复计算模型得分直至所述深度图像缓存队列和灰度图像缓存队列的队列长度等于预设值,分别从所述深度图像缓存队列、灰度图像缓存队列中取出的三通道深度图像、三通道灰度图像,并分别清空所述深度图像缓存队列、灰度图像缓存队列;Repeat the calculation of the model score until the queue lengths of the depth image cache queue and the grayscale image cache queue are equal to the preset values, and the three-channel depth image and the three-channel grayscale image respectively taken out from the depth image cache queue and the grayscale image cache queue are degree image, and empty the depth image cache queue and the grayscale image cache queue respectively;

分别计算取出的三通道深度图像、三通道灰度图像的LBP-TOP特征,并将计算得到的三通道深度图像、三通道灰度图像的LBP-TOP特征拼接后放入基于综合特征的时序活体检测模型内计算时序模型得分;以及Calculate the LBP-TOP features of the extracted three-channel depth image and three-channel grayscale image respectively, and splicing the calculated LBP-TOP features of the three-channel depth image and three-channel grayscale image into the time-series living body based on comprehensive features Computing time-series model scores within the detection model; and

若所述时序模型得分大于第三活体阈值,则认定为活体。If the score of the time series model is greater than the third living body threshold, it is determined as a living body.

在本发明的一个优选实施例中,所述分别对所述第一深度图像信息中的深度图像和近红外图像进行图像调整处理,包括:In a preferred embodiment of the present invention, the image adjustment processing of the depth image and the near-infrared image in the first depth image information includes:

分别对所述深度图像和近红外图像进行矫畸调整处理;Performing correction and adjustment processing on the depth image and the near-infrared image respectively;

分别对经过矫畸调整处理的深度图像和近红外图像进行滤波处理;Perform filtering processing on the depth image and the near-infrared image processed by the orthodontic adjustment respectively;

分别对经过滤波处理的深度图像和近红外图像进行动态压缩处理;以及performing dynamic compression processing on the filtered depth image and the near-infrared image respectively; and

分别对经过动态压缩处理的深度图像和近红外图像进行灰度值归一化处理。Normalize the gray value of the depth image and the near-infrared image after dynamic compression processing respectively.

在本发明的一个优选实施例中,所述根据所述活体检测处理结果对所述第一深度图像信息进行身份验证处理,包括:In a preferred embodiment of the present invention, performing identity verification processing on the first depth image information according to the living body detection processing result includes:

若所述活体检测处理结果认定为活体,则获取所述第一深度图像信息中的近红外图像;以及If the living body detection processing result is identified as a living body, acquiring a near-infrared image in the first depth image information; and

将所述近红外图像与本地授权解锁车辆的身份库进行比对处理,若比对通过,则解锁车门。The near-infrared image is compared with the local identity library authorized to unlock the vehicle, and if the comparison is passed, the door is unlocked.

在本发明的一个优选实施例中,所述获取车辆驾驶座人员的第二深度图像信息,并对所述第二深度图像信息进行人脸识别验证处理,包括:In a preferred embodiment of the present invention, the acquisition of the second depth image information of the driver's seat of the vehicle, and performing face recognition and verification processing on the second depth image information includes:

当车门解锁后,通过安装在车辆驾驶位处的第二TOF相机以待机采集帧率采集车辆驾驶位外的深度图像信息;When the door is unlocked, the second TOF camera installed at the driving position of the vehicle is used to collect the depth image information outside the driving position of the vehicle at a standby acquisition frame rate;

对采集到的深度图像信息进行检测处理,以判断是否有人员坐在车辆驾驶座上;Detect and process the collected depth image information to determine whether there is a person sitting in the driver's seat of the vehicle;

若检测到有人员坐在车辆驾驶座上,则将所述第二TOF相机以工作采集帧率对车辆驾驶座人员进行图像采集处理,以获取车辆驾驶座人员的第二深度图像信息;If it is detected that there is a person sitting on the driver's seat of the vehicle, the second TOF camera is used to collect images of the person in the driver's seat of the vehicle at a work acquisition frame rate, so as to obtain the second depth image information of the person in the driver's seat of the vehicle;

将所述第二深度图像信息中的近红外图像送入人脸检测模块进行人脸检测处理;以及Sending the near-infrared image in the second depth image information to the face detection module for face detection processing; and

根据人脸检测处理结果判断是否存在人脸,若检测到人脸,则将所述近红外图像与本地授权启动车辆的身份库进行比对处理,若比对通过,则授权启动车辆。Whether there is a human face is judged according to the result of the face detection process. If a human face is detected, the near-infrared image is compared with the local identity database authorized to start the vehicle. If the comparison is passed, the vehicle is authorized to start.

作为本发明第二方面的一种车辆无钥匙进入与启动装置,包括:A vehicle keyless entry and start device as the second aspect of the present invention includes:

第一TOF相机,所述第一TOF相机安装在车门处,用于采集靠近车门人员的第一深度图像信息;The first TOF camera, the first TOF camera is installed at the car door, and is used to collect the first depth image information of the person close to the car door;

第二TOF相机,所述第二TOF相机安装在车辆驾驶位处,用于采集车辆驾驶位人员的第二深度图像信息;A second TOF camera, the second TOF camera is installed at the driver's seat of the vehicle, and is used to collect the second depth image information of the person in the driver's seat of the vehicle;

第一深度图像信息处理模块,所述第一深度图像信息处理模块用于获取靠近车门人员的第一深度图像信息,并对所述第一深度图像信息进行人脸检测处理;A first depth image information processing module, the first depth image information processing module is used to obtain the first depth image information of the person close to the car door, and perform face detection processing on the first depth image information;

活体检测与身份验证模块,所述活体检测与身份验证模块用于根据人脸检测处理结果对所述第一深度图像信息进行活体检测处理,并根据所述活体检测处理结果对所述第一深度图像信息进行身份验证处理;A live body detection and identity verification module, the live body detection and identity verification module is used to perform live body detection processing on the first depth image information according to the face detection processing result, and to perform live body detection processing on the first depth image information according to the live body detection processing result. Image information for identity verification processing;

车门锁控制模块,所述车门锁控制模块用于根据身份验证处理结果控制车门是否解锁;A door lock control module, the door lock control module is used to control whether the door is unlocked according to the identity verification processing result;

第二深度图像信息处理模块,所述第二深度图像信息处理模块用于当车门解锁后,获取车辆驾驶座人员的第二深度图像信息,并对所述第二深度图像信息进行人脸识别验证处理;以及The second depth image information processing module, the second depth image information processing module is used to obtain the second depth image information of the driver's seat of the vehicle after the door is unlocked, and perform face recognition verification on the second depth image information processing; and

车辆启动控制模块,所述车辆启动控制模块用于根据人脸识别验证处理结果控制车辆是否启动。A vehicle start control module, the vehicle start control module is used to control whether the vehicle starts according to the face recognition verification processing result.

作为本发明第三发明的一种实现上述车辆无钥匙进入与启动方法的存储介质,其上存储有程序,所述程序被处理器执行时实现以下步骤:As a third invention of the present invention, a storage medium for implementing the above keyless vehicle entry and starting method has a program stored thereon, and the following steps are implemented when the program is executed by a processor:

获取靠近车门人员的第一深度图像信息,并对所述第一深度图像信息进行人脸检测处理;Acquiring the first depth image information of the person close to the car door, and performing face detection processing on the first depth image information;

根据人脸检测处理结果对所述第一深度图像信息进行活体检测处理,并根据所述活体检测处理结果对所述第一深度图像信息进行身份验证处理;performing live body detection processing on the first depth image information according to the face detection processing result, and performing identity verification processing on the first depth image information according to the live body detection processing result;

根据身份验证处理结果控制车门是否解锁;Control whether the door is unlocked according to the identity verification processing result;

当车门解锁后,获取车辆驾驶座人员的第二深度图像信息,并对所述第二深度图像信息进行人脸识别验证处理;以及After the door is unlocked, acquiring the second depth image information of the driver seat of the vehicle, and performing face recognition verification processing on the second depth image information; and

根据人脸识别验证处理结果控制车辆是否启动。Control whether the vehicle starts according to the face recognition verification processing result.

由于采用了如上技术方案,本发明的有益效果在于:Owing to adopting above technical scheme, the beneficial effect of the present invention is:

1.本发明采集用户的生物信息,对用户的生物特征进行验证并授权用户对车辆的操作权限,从而实现无钥匙进入并启动汽车。1. The present invention collects the user's biological information, verifies the user's biological characteristics and authorizes the user to operate the vehicle, so as to realize keyless entry and start the car.

2.相比较传统的采用单目或者双目传感器采集人脸进行活体检测,本发明基于TOF传感技术通过单帧即可拿到深度图和IR图,计算量小、实时性高;同时本发明采用主动光源,受环境光的干扰较小可在复杂的环境光条件下使用,且对硬件要求较低,稳定可靠。2. Compared with the traditional use of monocular or binocular sensors to collect faces for liveness detection, the present invention can obtain depth maps and IR maps through a single frame based on TOF sensing technology, with a small amount of calculation and high real-time performance; at the same time, this The invention adopts an active light source, which is less disturbed by ambient light and can be used under complex ambient light conditions, has lower requirements on hardware, and is stable and reliable.

3.相比现在普遍采取的无钥匙进入系统方案,本发明无需用户携带实体钥匙,智能化程度更高,且可有效地防止钥匙丢失或者未携带钥匙时无法进入车辆以及钥匙被盗窃时的财产损失。3. Compared with the current keyless entry system scheme, the present invention does not require the user to carry a physical key, and has a higher degree of intelligence, and can effectively prevent the loss of the key or the inability to enter the vehicle without the key and the property when the key is stolen loss.

4.相比较基于指纹和其他触摸式感应技术的无钥匙进入系统方案,本发明具有活体鉴别和人脸ID双重验证,安全性更高,且无需用户配合和等待。4. Compared with the keyless entry system solutions based on fingerprint and other touch sensing technologies, the present invention has dual authentication of living body identification and face ID, which is more secure and does not require cooperation and waiting of the user.

5.相比较云端身份验证的无钥匙进入系统方案,本发明提供本地离线的身份信息库,可离线设置信息库,所有计算均在本地完成,无需上传云端,确保用户隐私安全性,实时性更好。5. Compared with the keyless entry system scheme of cloud identity verification, the present invention provides a local offline identity information database, which can be set up offline, and all calculations are completed locally without uploading to the cloud, ensuring user privacy and security, and more real-time good.

6.相比较传统的无钥匙进入系统,本发明基于人脸ID的方式,所需硬件较少、功耗低、成本低,系统复杂性不高,随之带来的是更低的故障率,可以给用户带来更好的体验。6. Compared with the traditional keyless entry system, the present invention is based on the face ID method, which requires less hardware, low power consumption, low cost, and low system complexity, which brings a lower failure rate , which can bring a better experience to users.

7.相比较传统的车辆启动逻辑,本发明提出了新的车辆启动授权验证逻辑,未被授权的人员即便解锁车辆也无法启动车辆发动机,可以有效地避免儿童以及其他人员误启动车辆,进一步地提高了安全性能。7. Compared with the traditional vehicle start logic, the present invention proposes a new vehicle start authorization verification logic. Unauthorized personnel cannot start the vehicle engine even if the vehicle is unlocked, which can effectively prevent children and other personnel from starting the vehicle by mistake, and further Improved safety performance.

附图说明Description of drawings

为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

图1是本发明的车辆无钥匙进入与启动方法的流程图。Fig. 1 is a flow chart of the vehicle keyless entry and starting method of the present invention.

图2是本发明的车辆无钥匙进入与启动方法的一种应用实施例的流程图。Fig. 2 is a flowchart of an application embodiment of the vehicle keyless entry and start method of the present invention.

图3是本发明的车辆无钥匙进入与启动方法中活体检测的一种应用实施例的流程图。Fig. 3 is a flow chart of an application embodiment of living body detection in the vehicle keyless entry and starting method of the present invention.

图4是本发明的车辆无钥匙进入与启动装置的结构示意图。Fig. 4 is a structural schematic diagram of the vehicle keyless entry and starting device of the present invention.

具体实施方式Detailed ways

为了使本发明实现的技术手段、创作特征、达成目的与功效易于明白了解,下面结合具体图示,进一步阐述本发明。In order to make the technical means, creative features, goals and effects achieved by the present invention easy to understand, the present invention will be further described below in conjunction with specific illustrations.

参见图1,图中给出的是一种车辆无钥匙进入与启动方法,包括以下步骤:Referring to Figure 1, the figure shows a method for keyless entry and start of a vehicle, including the following steps:

步骤S10,获取靠近车门人员的第一深度图像信息,并对第一深度图像信息进行人脸检测处理;Step S10, acquiring the first depth image information of the person approaching the car door, and performing face detection processing on the first depth image information;

步骤S20,根据人脸检测处理结果对第一深度图像信息进行活体检测处理,并根据活体检测处理结果对第一深度图像信息进行身份验证处理;Step S20, performing live body detection processing on the first depth image information according to the face detection processing result, and performing identity verification processing on the first depth image information according to the live body detection processing result;

步骤S30,根据身份验证处理结果控制车门是否解锁;Step S30, controlling whether the door is unlocked according to the identity verification processing result;

步骤S40,当车门解锁后,获取车辆驾驶座人员的第二深度图像信息,并对第二深度图像信息进行人脸识别验证处理;Step S40, after the door is unlocked, obtain the second depth image information of the driver's seat of the vehicle, and perform face recognition verification processing on the second depth image information;

步骤S50,根据人脸识别验证处理结果控制车辆是否启动。Step S50, control whether the vehicle starts according to the result of the face recognition verification process.

参见图1并结合图2,在步骤S10中,获取靠近车门人员的第一深度图像信息,包括以下步骤:Referring to Fig. 1 and in conjunction with Fig. 2, in step S10, obtaining the first depth image information of the person close to the car door includes the following steps:

步骤S11,当车辆处于停车锁门状态时,通过安装在车门处的第一TOF相机(图2中所示的图像采集单元)以待机采集帧率采集车门外的深度图像信息。其中,待机采集帧率可根据采集需要进行适应性的调整;Step S11, when the vehicle is in the parking lock state, the first TOF camera (image acquisition unit shown in Figure 2) installed at the door is used to collect depth image information outside the door at a standby acquisition frame rate. Among them, the standby acquisition frame rate can be adjusted adaptively according to the acquisition needs;

步骤S12,对采集到的深度图像信息进行检测处理,以判断是否有人员靠近车门;Step S12, detecting and processing the collected depth image information to determine whether there is a person approaching the car door;

步骤S13,若检测到有人员靠近车门,则将第一TOF相机以工作采集帧率对靠近车门人员进行图像采集处理,以获取靠近车门人员的第一深度图像信息,其中,第一深度图像信息包括深度图像和近红外图像。其中,工作采集帧率可根据采集需要进行适应性的调整。近红外图像的成像原理为第一TOF相机采用主动发射波长为850nm或940nm的光,根据反射光的光强处理成近红外图像。Step S13, if it is detected that there is a person approaching the door, the first TOF camera will use the working acquisition frame rate to perform image acquisition processing on the person approaching the door, so as to obtain the first depth image information of the person approaching the door, wherein the first depth image information Including depth images and near-infrared images. Among them, the work collection frame rate can be adaptively adjusted according to the collection needs. The imaging principle of the near-infrared image is that the first TOF camera actively emits light with a wavelength of 850nm or 940nm, and processes it into a near-infrared image according to the intensity of the reflected light.

参见图1并结合图2,在步骤S10中,对第一深度图像信息进行人脸检测处理,包括以下步骤:Referring to Fig. 1 and in conjunction with Fig. 2, in step S10, face detection processing is carried out to the first depth image information, comprises the following steps:

步骤S14,获取第一深度图像信息中的近红外图像,并对近红外图像送入人脸检测模块进行人脸检测处理;Step S14, acquiring the near-infrared image in the first depth image information, and sending the near-infrared image to the face detection module for face detection processing;

步骤S15,根据人脸检测处理结果判断近红外图像中是否存在人脸,若检测到人脸,则进入步骤S20进行活体检测处理和身份验证处理,若未检测到人脸,则进入步骤S16;Step S15, judging whether there is a human face in the near-infrared image according to the result of the human face detection processing, if a human face is detected, then proceed to step S20 for living body detection processing and identity verification processing, if no human face is detected, then proceed to step S16;

步骤S16,返回步骤S13,继续通过第一TOF相机以工作采集帧率对靠近车门人员进行图像采集并再次进行人脸检测处理,若检测到人员离开,则将第一TOF相机的采集帧率调整为待机采集帧率。Step S16, return to step S13, continue to use the first TOF camera to collect images of people close to the car door at the work collection frame rate and perform face detection processing again, if it is detected that the person leaves, adjust the collection frame rate of the first TOF camera Capture frame rate for standby.

参见图3并结合图1和图2,在步骤S20中,根据人脸检测处理结果对第一深度图像信息进行活体检测处理,包括以下步骤:Referring to Fig. 3 and in conjunction with Fig. 1 and Fig. 2, in step S20, according to face detection processing result, carry out living body detection processing to first depth image information, comprise the following steps:

步骤S211,若人脸检测处理结果为检测到人脸,则分别对第一深度图像信息中的深度图像和近红外图像进行图像调整处理;Step S211, if the result of the face detection process is that a face is detected, perform image adjustment processing on the depth image and the near-infrared image in the first depth image information;

步骤S212,对经过图像调整处理后的深度图像进行梯度图像处理,得到深度图像的水平方向、垂直方向以及中心到边缘方向的梯度图像,并将三张梯度图像合并为三通道深度图像D_IMG;Step S212, performing gradient image processing on the depth image after image adjustment processing, obtaining gradient images in the horizontal direction, vertical direction, and center-to-edge direction of the depth image, and merging the three gradient images into a three-channel depth image D_IMG;

步骤S213,将经过图像调整处理后的深度图像和近红外图像进行合并处理,得到三通道灰度图像I_IMG;Step S213, combining the depth image and the near-infrared image after image adjustment processing to obtain a three-channel grayscale image I_IMG;

步骤S214,将三通道深度图像D_IMG送入基于深度图像的活体检测模型D_MODEL计算深度图像模型得分;Step S214, sending the three-channel depth image D_IMG into the depth image-based living body detection model D_MODEL to calculate the depth image model score;

步骤S215,若深度图像模型得分高于第一活体阈值S_D,第一活体阈值S_D根据模型需求而预先设置,则将三通道灰度图像I_IMG送入基于近红外图像的活体检测模型I_MODEL计算灰度图像模型得分;Step S215, if the score of the depth image model is higher than the first living body threshold S_D, which is preset according to the model requirements, then send the three-channel grayscale image I_IMG to the living body detection model I_MODEL based on near-infrared images to calculate the grayscale image model score;

步骤S216,若灰度图像模型得分高于第二活体阈值S_I,第二活体阈值S_I根据模型需求而预先设置,则三通道深度图像D_IMG、三通道灰度图像I_IMG对应地放入深度图像缓存队列Q_D、灰度图像缓存队列Q_I内;Step S216, if the grayscale image model score is higher than the second in vivo threshold S_I, which is preset according to the model requirements, then the three-channel depth image D_IMG and the three-channel grayscale image I_IMG are correspondingly put into the depth image buffer queue In Q_D, the grayscale image cache queue Q_I;

步骤S217,重复计算模型得分(重复执行步骤S24至步骤S26)直至深度图像缓存队列Q_D和灰度图像缓存队列Q_I的队列长度等于预设值,在本实施例中,预设值为3,当然也可以根据模型要求设置为其他数值;再分别从深度图像缓存队列Q_D、灰度图像缓存队列Q_I中取出的三通道深度图像D_IMG、三通道灰度图像I_IMG,同时分别清空深度图像缓存队列Q_D、灰度图像缓存队列Q_I;Step S217, repeatedly calculate the model score (repeatedly execute step S24 to step S26) until the queue length of the depth image buffer queue Q_D and the grayscale image buffer queue Q_I is equal to the preset value, in this embodiment, the preset value is 3, of course It can also be set to other values according to the model requirements; then the three-channel depth image D_IMG and the three-channel grayscale image I_IMG are taken out from the depth image cache queue Q_D and the grayscale image cache queue Q_I respectively, and the depth image cache queue Q_D, Grayscale image cache queue Q_I;

步骤S218,分别计算取出的三通道深度图像D_IMG、三通道灰度图像I_IMG的LBP-TOP特征(Local Binary Patterns from Three Orthogonal Planes),并将计算得到的三通道深度图像D_IMG、三通道灰度图像I_IMG的LBP-TOP特征拼接后放入基于综合特征的时序活体检测模型T_MODEL内计算时序模型得分;Step S218, respectively calculate the LBP-TOP feature (Local Binary Patterns from Three Orthogonal Planes) of the three-channel depth image D_IMG and three-channel grayscale image I_IMG taken out, and calculate the three-channel depth image D_IMG and three-channel grayscale image The LBP-TOP features of I_IMG are spliced and put into T_MODEL, a time-series living body detection model based on comprehensive features, to calculate the time-series model score;

步骤S219,若时序模型得分大于第三活体阈值,则认定为活体,否则未通过活体检测,则返回步骤S217。In step S219, if the score of the time series model is greater than the third living body threshold, it is determined as a living body; otherwise, it fails the living body detection, and returns to step S217.

在步骤S211中,分别对第一深度图像信息中的深度图像和近红外图像进行图像调整处理,包括以下步骤:In step S211, image adjustment processing is performed on the depth image and the near-infrared image in the first depth image information, including the following steps:

步骤S2111,分别对深度图像和近红外图像进行矫畸调整处理;Step S2111, respectively performing correction and adjustment processing on the depth image and the near-infrared image;

步骤S2112,分别对经过矫畸调整处理的深度图像和近红外图像进行滤波处理;Step S2112, performing filtering processing on the depth image and the near-infrared image after the correction adjustment processing;

步骤S2113,根据像素值分别对经过滤波处理的深度图像和近红外图像进行动态压缩处理,在本实施例中,动态压缩至8比特。根据需求将工况距离设置为关心的深度范围,对此距离范围内的深度值进行拉升,提高对比度,对此距离外的深度值进行压缩。根据工况范围内的深度值像素坐标进行查找对应近红外图像上的像素值的最大、最小值坐标,根据坐标查找最大、最小值对近红外图像做动态调整,并压缩到8比特。Step S2113, perform dynamic compression processing on the filtered depth image and near-infrared image respectively according to pixel values, and in this embodiment, dynamically compress to 8 bits. Set the working condition distance to the depth range of interest according to the requirements, increase the depth value within this distance range, improve the contrast, and compress the depth value outside this distance. Find the maximum and minimum value coordinates of the pixel value corresponding to the near-infrared image according to the depth value pixel coordinates within the working condition range, and dynamically adjust the near-infrared image according to the coordinates to find the maximum and minimum values, and compress it to 8 bits.

步骤S2114,分别对经过动态压缩处理的深度图像和近红外图像进行灰度值归一化处理。Step S2114, performing gray value normalization processing on the depth image and the near-infrared image after the dynamic compression processing respectively.

在步骤S20中,根据活体检测处理结果对第一深度图像信息进行身份验证处理,包括以下步骤:In step S20, the identity verification process is performed on the first depth image information according to the living body detection processing result, including the following steps:

步骤S221,若活体检测处理结果认定为活体,则获取第一深度图像信息中的近红外图像;Step S221, if the living body detection processing result is determined to be a living body, then acquire the near-infrared image in the first depth image information;

步骤S221,将近红外图像与本地授权解锁车辆的身份库进行比对处理,若比对通过,则解锁车门,若比对不通过,则返回步骤S10。In step S221, compare the near-infrared image with the local identity database authorized to unlock the vehicle. If the comparison passes, the door is unlocked. If the comparison fails, return to step S10.

在步骤S40中,获取车辆驾驶座人员的第二深度图像信息,并对第二深度图像信息进行人脸识别验证处理,包括:In step S40, the second depth image information of the vehicle driver's seat is acquired, and the face recognition verification process is performed on the second depth image information, including:

步骤S41,当车门解锁后,通过安装在车辆驾驶位处的第二TOF相机以待机采集帧率采集车辆驾驶位外的深度图像信息;Step S41, when the door is unlocked, the second TOF camera installed at the driving position of the vehicle is used to collect depth image information outside the driving position of the vehicle at a standby acquisition frame rate;

步骤S42,对采集到的深度图像信息进行检测处理,以判断是否有人员坐在车辆驾驶座上;Step S42, detecting and processing the collected depth image information to determine whether there is a person sitting on the driver's seat of the vehicle;

步骤S43,若检测到有人员坐在车辆驾驶座上,则将第二TOF相机以工作采集帧率对车辆驾驶座人员进行图像采集处理,以获取车辆驾驶座人员的第二深度图像信息;若未检测到有人员坐在车辆驾驶座上,则返回步骤S41;Step S43, if it is detected that there is a person sitting on the driver's seat of the vehicle, the second TOF camera is used to collect images of the person in the driver's seat of the vehicle at the working acquisition frame rate, so as to obtain the second depth image information of the person in the driver's seat of the vehicle; If it is not detected that there is a person sitting on the driver's seat of the vehicle, then return to step S41;

步骤S44,将第二深度图像信息中的近红外图像送入人脸检测模块进行人脸检测处理;Step S44, sending the near-infrared image in the second depth image information to the face detection module for face detection processing;

步骤S45,根据人脸检测处理结果判断是否存在人脸,若检测到人脸,则进入步骤S46,若未检测到人脸,则返回步骤S41;Step S45, judging whether there is a human face according to the human face detection processing result, if a human face is detected, then enter step S46, if no human face is detected, then return to step S41;

步骤S46,将近红外图像与本地授权启动车辆的身份库进行比对处理;若比对通过,则授权启动车辆;若未比对通过,则返回步骤S41。Step S46, compare the near-infrared image with the local identity database authorized to start the vehicle; if the comparison is passed, the vehicle is authorized to start; if the comparison is not passed, return to step S41.

鉴于传统的无钥匙进入系统的不便利性和安全隐患,本发明通过利用TOF技术的深度传感器采集用户的生物特征,对用户进行活体检测、ID识别验证,验证通过即可进入车辆。若通过驾驶位的ID验证即可获得授权启动车辆。此外本发明为用户提供本地身份信息库,车主可选择性录入授权进入车辆的身份库和授权启动车辆的身份库,为家庭成员进入车辆提供便利性的同时确保未被授权启动车辆的家庭成员如小孩误启动车辆造成安全事故。In view of the inconvenience and potential safety hazards of the traditional keyless entry system, the present invention collects the biological characteristics of the user by using the depth sensor of TOF technology, performs liveness detection and ID identification verification on the user, and can enter the vehicle after passing the verification. If you pass the ID verification of the driver's seat, you can be authorized to start the vehicle. In addition, the present invention provides users with a local identity information database, and the owner can selectively enter the identity database authorized to enter the vehicle and the identity database authorized to start the vehicle, which provides convenience for family members to enter the vehicle while ensuring that family members who are not authorized to start the vehicle such as The child started the vehicle by mistake and caused a safety accident.

参见图2,图中给出的是一种车辆无钥匙进入与启动装置,包括第一TOF相机100、第二TOF相机200、第一深度图像信息处理模块300、活体检测与身份验证模块400、车门锁控制模块500、第二深度图像信息处理模块600以及车辆启动控制模块700。Referring to FIG. 2 , the figure shows a vehicle keyless entry and starting device, including a first TOF camera 100, a second TOF camera 200, a first depth image information processing module 300, a living body detection and identity verification module 400, The door lock control module 500 , the second depth image information processing module 600 and the vehicle start control module 700 .

第一TOF相机100安装在车门处,用于采集靠近车门人员的第一深度图像信息。The first TOF camera 100 is installed at the car door, and is used to collect first depth image information of people approaching the car door.

第二TOF相机200安装在车辆驾驶位处,用于采集车辆驾驶位人员的第二深度图像信息。The second TOF camera 200 is installed at the driving seat of the vehicle, and is used for collecting second depth image information of the person in the driving seat of the vehicle.

第一深度图像信息处理模块300用于获取靠近车门人员的第一深度图像信息,并对第一深度图像信息进行人脸检测处理。The first depth image information processing module 300 is used to acquire the first depth image information of the person approaching the car door, and perform face detection processing on the first depth image information.

活体检测与身份验证模块400用于根据人脸检测处理结果对第一深度图像信息进行活体检测处理,并根据活体检测处理结果对第一深度图像信息进行身份验证处理。The living body detection and identity verification module 400 is configured to perform life detection processing on the first depth image information according to the face detection processing result, and perform identity verification processing on the first depth image information according to the living body detection processing result.

车门锁控制模块500用于根据身份验证处理结果控制车门是否解锁。The car door lock control module 500 is used for controlling whether the car door is unlocked according to the identity verification processing result.

第二深度图像信息处理模块600用于当车门解锁后,获取车辆驾驶座人员的第二深度图像信息,并对第二深度图像信息进行人脸识别验证处理。The second depth image information processing module 600 is used to obtain the second depth image information of the driver seat of the vehicle after the door is unlocked, and perform face recognition verification processing on the second depth image information.

车辆启动控制模块700用于根据人脸识别验证处理结果控制车辆是否启动。The vehicle start control module 700 is used to control whether the vehicle starts according to the face recognition verification processing result.

本发明的车辆无钥匙进入与启动装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于汽车控制系统中的处理器中,也可以以软件形式存储于汽车控制系统的存储器中,以便于处理器调用执行以上各个模块对应的操作。Each module in the vehicle keyless entry and starting device of the present invention can be fully or partially realized by software, hardware and combinations thereof. The above modules can be embedded in or independent of the processor in the vehicle control system in the form of hardware, and can also be stored in the memory of the vehicle control system in the form of software, so that the processor can call and execute the corresponding operations of the above modules.

本发明还提供了一种实现上述车辆无钥匙进入与启动方法的存储介质,其上存储有程序,该程序被处理器执行时实现以下步骤:The present invention also provides a storage medium for realizing the above keyless vehicle entry and starting method, on which a program is stored, and when the program is executed by a processor, the following steps are implemented:

步骤S10,获取靠近车门人员的第一深度图像信息,并对第一深度图像信息进行人脸检测处理;Step S10, acquiring the first depth image information of the person approaching the car door, and performing face detection processing on the first depth image information;

步骤S20,根据人脸检测处理结果对第一深度图像信息进行活体检测处理,并根据活体检测处理结果对第一深度图像信息进行身份验证处理;Step S20, performing live body detection processing on the first depth image information according to the face detection processing result, and performing identity verification processing on the first depth image information according to the live body detection processing result;

步骤S30,根据身份验证处理结果控制车门是否解锁;Step S30, controlling whether the door is unlocked according to the identity verification processing result;

步骤S40,当车门解锁后,获取车辆驾驶座人员的第二深度图像信息,并对第二深度图像信息进行人脸识别验证处理;Step S40, after the door is unlocked, obtain the second depth image information of the driver's seat of the vehicle, and perform face recognition verification processing on the second depth image information;

步骤S50,根据人脸识别验证处理结果控制车辆是否启动。Step S50, control whether the vehicle starts according to the result of the face recognition verification process.

本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过程序来指令相关的硬件来完成,所述的程序可存储于一非易失性计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,本申请所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用,均可包括非易失性和/或易失性存储器。非易失性存储器可包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM)或者外部高速缓冲存储器。作为说明而非局限,RAM以多种形式可得,诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据率SDRAM(DDRSDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink)DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)等。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above-mentioned embodiments can be realized by instructing related hardware through a program, and the program can be stored in a non-volatile computer-readable storage medium , when the program is executed, it may include the procedures of the embodiments of the above-mentioned methods. Wherein, any references to memory, storage, database or other media used in the various embodiments provided in the present application may include non-volatile and/or volatile memory. Nonvolatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Chain Synchlink DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

以上显示和描述了本发明的基本原理和主要特征和本发明的优点。本行业的技术人员应该了解,本发明不受上述实施例的限制,上述实施例和说明书中描述的只是说明本发明的原理,在不脱离本发明精神和范围的前提下,本发明还会有各种变化和改进,这些变化和改进都落入要求保护的本发明范围内。本发明要求保护范围由所附的权利要求书及其等效物界定。The basic principles and main features of the present invention and the advantages of the present invention have been shown and described above. Those skilled in the industry should understand that the present invention is not limited by the above-mentioned embodiments. What are described in the above-mentioned embodiments and the description only illustrate the principle of the present invention. Without departing from the spirit and scope of the present invention, the present invention will also have Variations and improvements are possible, which fall within the scope of the claimed invention. The protection scope of the present invention is defined by the appended claims and their equivalents.

Claims (10)

1.一种车辆无钥匙进入与启动方法,其特征在于,包括:1. A vehicle keyless entry and start method, characterized in that, comprising: 获取靠近车门人员的第一深度图像信息,并对所述第一深度图像信息进行人脸检测处理;Acquiring the first depth image information of the person close to the car door, and performing face detection processing on the first depth image information; 根据人脸检测处理结果对所述第一深度图像信息进行活体检测处理,并根据所述活体检测处理结果对所述第一深度图像信息进行身份验证处理;performing live body detection processing on the first depth image information according to the face detection processing result, and performing identity verification processing on the first depth image information according to the live body detection processing result; 根据身份验证处理结果控制车门是否解锁;Control whether the door is unlocked according to the identity verification processing result; 当车门解锁后,获取车辆驾驶座人员的第二深度图像信息,并对所述第二深度图像信息进行人脸识别验证处理;以及After the door is unlocked, acquiring the second depth image information of the driver seat of the vehicle, and performing face recognition verification processing on the second depth image information; and 根据人脸识别验证处理结果控制车辆是否启动。Control whether the vehicle starts according to the face recognition verification processing result. 2.如权利要求1所述的车辆无钥匙进入与启动方法,其特征在于,所述获取靠近车门人员的第一深度图像信息,包括:2. The method for keyless entry and start of a vehicle according to claim 1, wherein said acquiring the first depth image information of a person close to the vehicle door comprises: 当车辆处于停车锁门状态时,通过安装在车门处的第一TOF相机以待机采集帧率采集车门外的深度图像信息;When the vehicle is in the state of parking and locking the door, the depth image information outside the door is collected by the first TOF camera installed at the door at a standby acquisition frame rate; 对采集到的深度图像信息进行检测处理,以判断是否有人员靠近车门;以及Detecting and processing the collected depth image information to determine whether there is a person approaching the car door; and 若检测到有人员靠近车门,则将所述第一TOF相机以工作采集帧率对靠近车门人员进行图像采集处理,以获取靠近车门人员的第一深度图像信息,所述第一深度图像信息包括深度图像和近红外图像。If it is detected that there is a person approaching the door, the first TOF camera will perform image acquisition processing on the person approaching the door at the work acquisition frame rate, so as to obtain the first depth image information of the person approaching the door, and the first depth image information includes Depth images and near-infrared images. 3.如权利要求2所述的车辆无钥匙进入与启动方法,其特征在于,所述第一深度图像信息包括深度图像和近红外图像。3. The method for keyless entry and start of a vehicle according to claim 2, wherein the first depth image information includes a depth image and a near-infrared image. 4.如权利要求2所述的车辆无钥匙进入与启动方法,其特征在于,所述对所述第一深度图像信息进行人脸检测处理,包括:4. The method for keyless entry and start of a vehicle according to claim 2, wherein said performing face detection processing on said first depth image information comprises: 获取所述第一深度图像信息中的近红外图像,并对所述近红外图像送入人脸检测模块进行人脸检测处理;以及Obtain a near-infrared image in the first depth image information, and send the near-infrared image to a face detection module for face detection processing; and 根据人脸检测处理结果判断所述近红外图像中是否存在人脸,若检测到人脸,则进行活体检测处理和身份验证处理,若未检测到人脸,则继续通过所述第一TOF相机以工作采集帧率对靠近车门人员进行图像采集并再次进行人脸检测处理,若检测到人员离开,则将所述第一TOF相机的采集帧率调整为待机采集帧率。Judging whether there is a human face in the near-infrared image according to the result of human face detection processing, if a human face is detected, then perform living body detection processing and identity verification processing, if no human face is detected, continue to pass through the first TOF camera At the working acquisition frame rate, image acquisition is performed on the person approaching the car door and the face detection process is performed again. If it is detected that the person leaves, the acquisition frame rate of the first TOF camera is adjusted to the standby acquisition frame rate. 5.如权利要求1至4中任一项所述的车辆无钥匙进入与启动方法,其特征在于,所述根据人脸检测处理结果对所述第一深度图像信息进行活体检测处理,包括:5. The vehicle keyless entry and start method according to any one of claims 1 to 4, characterized in that, performing the living body detection processing on the first depth image information according to the face detection processing result, comprising: 若人脸检测处理结果为检测到人脸,则分别对所述第一深度图像信息中的深度图像和近红外图像进行图像调整处理;If the face detection processing result is that a human face is detected, image adjustment processing is performed on the depth image and the near-infrared image in the first depth image information respectively; 对经过图像调整处理后的深度图像进行梯度图像处理,得到所述深度图像的水平方向、垂直方向以及中心到边缘方向的梯度图像,并将三张梯度图像合并为三通道深度图像;Gradient image processing is performed on the depth image after image adjustment processing to obtain gradient images in the horizontal direction, vertical direction, and center-to-edge direction of the depth image, and merge the three gradient images into a three-channel depth image; 将经过图像调整处理后的深度图像和近红外图像进行合并处理,得到三通道灰度图像;Combine the depth image and near-infrared image after image adjustment to obtain a three-channel grayscale image; 将所述三通道深度图像送入基于深度图像的活体检测模型计算深度图像模型得分;The three-channel depth image is sent into a depth image-based living body detection model to calculate the depth image model score; 若所述深度图像模型得分高于第一活体阈值,则将所述三通道灰度图像送入基于近红外图像的活体检测模型计算灰度图像模型得分;If the depth image model score is higher than the first living body threshold, the three-channel grayscale image is sent to a living body detection model based on near-infrared images to calculate the grayscale image model score; 若所述灰度图像模型得分高于第二活体阈值,则所述三通道深度图像、三通道灰度图像对应地放入深度图像缓存队列、灰度图像缓存队列内;If the grayscale image model score is higher than the second in vivo threshold, the three-channel depth image and the three-channel grayscale image are correspondingly put into a depth image cache queue and a grayscale image cache queue; 重复计算模型得分直至所述深度图像缓存队列和灰度图像缓存队列的队列长度等于预设值,分别从所述深度图像缓存队列、灰度图像缓存队列中取出的三通道深度图像、三通道灰度图像,并分别清空所述深度图像缓存队列、灰度图像缓存队列;Repeat the calculation of the model score until the queue lengths of the depth image cache queue and the grayscale image cache queue are equal to the preset values, and the three-channel depth image and the three-channel grayscale image respectively taken out from the depth image cache queue and the grayscale image cache queue are degree image, and empty the depth image cache queue and the grayscale image cache queue respectively; 分别计算取出的三通道深度图像、三通道灰度图像的LBP-TOP特征,并将计算得到的三通道深度图像、三通道灰度图像的LBP-TOP特征拼接后放入基于综合特征的时序活体检测模型内计算时序模型得分;以及Calculate the LBP-TOP features of the extracted three-channel depth image and three-channel grayscale image respectively, and splicing the calculated LBP-TOP features of the three-channel depth image and three-channel grayscale image into the time-series living body based on comprehensive features Computing time-series model scores within the detection model; and 若所述时序模型得分大于第三活体阈值,则认定为活体。If the score of the time series model is greater than the third living body threshold, it is determined as a living body. 6.如权利要求5所述的车辆无钥匙进入与启动方法,其特征在于,所述分别对所述第一深度图像信息中的深度图像和近红外图像进行图像调整处理,包括:6. The method for keyless entry and start of a vehicle according to claim 5, wherein the image adjustment processing of the depth image and the near-infrared image in the first depth image information includes: 分别对所述深度图像和近红外图像进行矫畸调整处理;Performing correction and adjustment processing on the depth image and the near-infrared image respectively; 分别对经过矫畸调整处理的深度图像和近红外图像进行滤波处理;Perform filtering processing on the depth image and the near-infrared image processed by the orthodontic adjustment respectively; 分别对经过滤波处理的深度图像和近红外图像进行动态压缩处理;以及performing dynamic compression processing on the filtered depth image and the near-infrared image respectively; and 分别对经过动态压缩处理的深度图像和近红外图像进行灰度值归一化处理。Normalize the gray value of the depth image and the near-infrared image after dynamic compression processing respectively. 7.如权利要求5所述的车辆无钥匙进入与启动方法,其特征在于,所述根据所述活体检测处理结果对所述第一深度图像信息进行身份验证处理,包括:7. The method for keyless entry and start of a vehicle according to claim 5, wherein said performing identity verification processing on said first depth image information according to said living body detection processing result comprises: 若所述活体检测处理结果认定为活体,则获取所述第一深度图像信息中的近红外图像;以及If the living body detection processing result is identified as a living body, acquiring a near-infrared image in the first depth image information; and 将所述近红外图像与本地授权解锁车辆的身份库进行比对处理,若比对通过,则解锁车门。The near-infrared image is compared with the local identity library authorized to unlock the vehicle, and if the comparison is passed, the door is unlocked. 8.如权利要求1所述的车辆无钥匙进入与启动方法,其特征在于,所述获取车辆驾驶座人员的第二深度图像信息,并对所述第二深度图像信息进行人脸识别验证处理,包括:8. The method for keyless entry and start of a vehicle according to claim 1, wherein the second depth image information of the vehicle driver is acquired, and the face recognition verification process is performed on the second depth image information ,include: 当车门解锁后,通过安装在车辆驾驶位处的第二TOF相机以待机采集帧率采集车辆驾驶位外的深度图像信息;When the door is unlocked, the second TOF camera installed at the driving position of the vehicle is used to collect the depth image information outside the driving position of the vehicle at a standby acquisition frame rate; 对采集到的深度图像信息进行检测处理,以判断是否有人员坐在车辆驾驶座上;Detect and process the collected depth image information to determine whether there is a person sitting in the driver's seat of the vehicle; 若检测到有人员坐在车辆驾驶座上,则将所述第二TOF相机以工作采集帧率对车辆驾驶座人员进行图像采集处理,以获取车辆驾驶座人员的第二深度图像信息;If it is detected that there is a person sitting on the driver's seat of the vehicle, the second TOF camera is used to collect images of the person in the driver's seat of the vehicle at a work acquisition frame rate, so as to obtain the second depth image information of the person in the driver's seat of the vehicle; 将所述第二深度图像信息中的近红外图像送入人脸检测模块进行人脸检测处理;以及Sending the near-infrared image in the second depth image information to the face detection module for face detection processing; and 根据人脸检测处理结果判断是否存在人脸,若检测到人脸,则将所述近红外图像与本地授权启动车辆的身份库进行比对处理,若比对通过,则授权启动车辆。Whether there is a human face is judged according to the result of the face detection process. If a human face is detected, the near-infrared image is compared with the local identity database authorized to start the vehicle. If the comparison is passed, the vehicle is authorized to start. 9.一种车辆无钥匙进入与启动装置,其特征在于,包括:9. A vehicle keyless entry and start device, characterized in that it comprises: 第一TOF相机,所述第一TOF相机安装在车门处,用于采集靠近车门人员的第一深度图像信息;The first TOF camera, the first TOF camera is installed at the car door, and is used to collect the first depth image information of the person close to the car door; 第二TOF相机,所述第二TOF相机安装在车辆驾驶位处,用于采集车辆驾驶位人员的第二深度图像信息;A second TOF camera, the second TOF camera is installed at the driver's seat of the vehicle, and is used to collect the second depth image information of the person in the driver's seat of the vehicle; 第一深度图像信息处理模块,所述第一深度图像信息处理模块用于获取靠近车门人员的第一深度图像信息,并对所述第一深度图像信息进行人脸检测处理;A first depth image information processing module, the first depth image information processing module is used to obtain the first depth image information of the person close to the car door, and perform face detection processing on the first depth image information; 活体检测与身份验证模块,所述活体检测与身份验证模块用于根据人脸检测处理结果对所述第一深度图像信息进行活体检测处理,并根据所述活体检测处理结果对所述第一深度图像信息进行身份验证处理;A live body detection and identity verification module, the live body detection and identity verification module is used to perform live body detection processing on the first depth image information according to the face detection processing result, and to perform live body detection processing on the first depth image information according to the live body detection processing result. Image information for identity verification processing; 车门锁控制模块,所述车门锁控制模块用于根据身份验证处理结果控制车门是否解锁;A door lock control module, the door lock control module is used to control whether the door is unlocked according to the identity verification processing result; 第二深度图像信息处理模块,所述第二深度图像信息处理模块用于当车门解锁后,获取车辆驾驶座人员的第二深度图像信息,并对所述第二深度图像信息进行人脸识别验证处理;以及The second depth image information processing module, the second depth image information processing module is used to obtain the second depth image information of the driver's seat of the vehicle after the door is unlocked, and perform face recognition verification on the second depth image information processing; and 车辆启动控制模块,所述车辆启动控制模块用于根据人脸识别验证处理结果控制车辆是否启动。A vehicle start control module, the vehicle start control module is used to control whether the vehicle starts according to the face recognition verification processing result. 10.一种存储介质,其上存储有程序,其特征在于,所述程序被处理器执行时实现如权利要求1至8中任一项所述的车辆无钥匙进入与启动方法中的步骤。10. A storage medium, on which a program is stored, wherein when the program is executed by a processor, the steps in the method for keyless entry and start of a vehicle according to any one of claims 1 to 8 are realized.
CN202211642868.2A 2022-12-20 2022-12-20 Vehicle keyless entry and starting method, device and storage medium Pending CN116061878A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211642868.2A CN116061878A (en) 2022-12-20 2022-12-20 Vehicle keyless entry and starting method, device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211642868.2A CN116061878A (en) 2022-12-20 2022-12-20 Vehicle keyless entry and starting method, device and storage medium

Publications (1)

Publication Number Publication Date
CN116061878A true CN116061878A (en) 2023-05-05

Family

ID=86179471

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211642868.2A Pending CN116061878A (en) 2022-12-20 2022-12-20 Vehicle keyless entry and starting method, device and storage medium

Country Status (1)

Country Link
CN (1) CN116061878A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102019104675A1 (en) * 2019-02-25 2020-08-27 STC Corporation Co., Ltd. System and method for starting a vehicle using facial recognition data
US20210158509A1 (en) * 2019-11-21 2021-05-27 Samsung Electronics Co., Ltd. Liveness test method and apparatus and biometric authentication method and apparatus
CN113752983A (en) * 2021-09-17 2021-12-07 阳光暖果(北京)科技发展有限公司 Vehicle unlocking control system and method based on face recognition/eye recognition
CN113869244A (en) * 2021-09-30 2021-12-31 重庆长安汽车股份有限公司 Vehicle unlocking and starting method and system based on in vivo detection and storage medium
CN114312666A (en) * 2021-11-22 2022-04-12 江铃汽车股份有限公司 Vehicle control method and device based on face recognition, storage medium and equipment
CN114494208A (en) * 2022-01-28 2022-05-13 上海数迹智能科技有限公司 A method of face liveness detection based on TOF
CN114889554A (en) * 2022-05-24 2022-08-12 东风汽车集团股份有限公司 Automobile intelligent entering and starting system based on face recognition
CN114919532A (en) * 2022-04-29 2022-08-19 东风汽车集团股份有限公司 Vehicle control method and system based on face recognition
US20220374643A1 (en) * 2021-05-21 2022-11-24 Ford Global Technologies, Llc Counterfeit image detection

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102019104675A1 (en) * 2019-02-25 2020-08-27 STC Corporation Co., Ltd. System and method for starting a vehicle using facial recognition data
US20210158509A1 (en) * 2019-11-21 2021-05-27 Samsung Electronics Co., Ltd. Liveness test method and apparatus and biometric authentication method and apparatus
US20220374643A1 (en) * 2021-05-21 2022-11-24 Ford Global Technologies, Llc Counterfeit image detection
CN113752983A (en) * 2021-09-17 2021-12-07 阳光暖果(北京)科技发展有限公司 Vehicle unlocking control system and method based on face recognition/eye recognition
CN113869244A (en) * 2021-09-30 2021-12-31 重庆长安汽车股份有限公司 Vehicle unlocking and starting method and system based on in vivo detection and storage medium
CN114312666A (en) * 2021-11-22 2022-04-12 江铃汽车股份有限公司 Vehicle control method and device based on face recognition, storage medium and equipment
CN114494208A (en) * 2022-01-28 2022-05-13 上海数迹智能科技有限公司 A method of face liveness detection based on TOF
CN114919532A (en) * 2022-04-29 2022-08-19 东风汽车集团股份有限公司 Vehicle control method and system based on face recognition
CN114889554A (en) * 2022-05-24 2022-08-12 东风汽车集团股份有限公司 Automobile intelligent entering and starting system based on face recognition

Similar Documents

Publication Publication Date Title
CN108846924A (en) Vehicle and car door solution lock control method, device and car door system for unlocking
CN208207948U (en) vehicle with face unlocking function
US20190366981A1 (en) Vehicles, vehicle door unlocking control methods and apparatuses, and vehicle door unlocking systems
EP1705085B1 (en) Apparatus for authenticating vehicle driver
CN103935324B (en) Method and apparatus for vehicle access control control
US20200193005A1 (en) Authentication system for vehicle
CN107909040B (en) Car renting verification method and device
CN109559416B (en) A car lock control system based on face recognition and gesture recognition
CN113516034B (en) Keyless entry system and method for vehicle
US20190371099A1 (en) Biometric fusion electronic lock system
KR102093858B1 (en) Biometrics-based vehicle control device and vehicle control method using same
CN105336021A (en) Automobile as well as unlocking system without key and automobile unlocking method without key thereof
CN107444337A (en) Automotive theft proof system with double authentication
CN115396658A (en) Camera Tampering Detection
CN202783103U (en) Pilot certification device based on hand vein image recognition
CN116189334A (en) Face recognition method and device, computer readable storage medium and vehicle
CN116061878A (en) Vehicle keyless entry and starting method, device and storage medium
US20240201790A1 (en) Information processing apparatus, vehicle controlling system, information processing method, and non-transitory computer-readable medium
CN115075690A (en) Method and device for intelligently controlling opening of automobile trunk
US11390249B2 (en) Vehicle vision system
Manikandan et al. A novel system for real time drowsiness warning and engine ignition authorization using face recognition
CN112102548A (en) Access control system based on palm vein recognition and control method thereof
JP2007317116A (en) Vehicle having facial authentication system mounted thereon
KR20230087760A (en) Vehicle and method for controlling the same
Manjula et al. Cloud-Based Biometric Security System for Smart Vehicles

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20230505