WO2019134346A1 - Face recognition method, application server, and computer-readable storage medium - Google Patents

Face recognition method, application server, and computer-readable storage medium Download PDF

Info

Publication number
WO2019134346A1
WO2019134346A1 PCT/CN2018/090908 CN2018090908W WO2019134346A1 WO 2019134346 A1 WO2019134346 A1 WO 2019134346A1 CN 2018090908 W CN2018090908 W CN 2018090908W WO 2019134346 A1 WO2019134346 A1 WO 2019134346A1
Authority
WO
WIPO (PCT)
Prior art keywords
moving object
face
video
image
camera
Prior art date
Application number
PCT/CN2018/090908
Other languages
French (fr)
Chinese (zh)
Inventor
李影
Original Assignee
平安科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技(深圳)有限公司 filed Critical 平安科技(深圳)有限公司
Publication of WO2019134346A1 publication Critical patent/WO2019134346A1/en

Links

Images

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00Individual registration on entry or exit
    • G07C9/00174Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00563Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C1/00Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
    • G07C1/10Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people together with the recording, indicating or registering of other data, e.g. of signs of identity

Definitions

  • the processor 12 may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor, or other data processing chip in some embodiments.
  • the processor 12 is typically used to control the overall operation of the application server 2.
  • the processor 12 is configured to run program code or process data stored in the memory 11, such as running the face recognition system 200 and the like.
  • the obtaining unit 2012 is configured to acquire the video recognition unit 2014 of the moving object collected by the camera.
  • the determining module 203 is configured to compare the face image frame with the sample in the server to determine whether it is a valid image. If yes, the identification is passed, the access control is opened, and if not, the identification fails.
  • the time that is correctly identified is taken as the attendance time of the employee.
  • the determining module 203 is further configured to determine whether the number of times the recognition fails reaches a preset number of times threshold. If not, the trigger extraction module 201 extracts the moving object video collected by the at least one camera, and if so, triggers the alarm module 301 to generate an alarm to prompt the employee to be non-employee.
  • the determining module 203 determines that the employee identification fails within a preset number of times threshold, the system may be faulty, or the recognition of the sample picture fails due to the video shooting angle, and the motion object is re-extracted. Video, then get the face image and compare it with the sample image. If the judging module 203 determines that the threshold number of times exceeds the preset number of times and fails to identify the employee, it indicates that the employee is not likely to be an employee of the company, and an alarm is generated, which causes the attention of the relevant department.
  • a plurality of cameras are mounted on the server.
  • the cameras may be access doors or door accesses.
  • the cameras may be located on different floors.
  • the application is not limited herein.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Image Analysis (AREA)

Abstract

A face recognition method, an application server, and a computer-readable storage medium. The method comprises: extracting a moving object video acquired by at least one camera (400); converting the moving object video into a face image frame (402); comparing the face image frame with a sample in a server to determine whether the image is valid (404); if yes, identity recognition succeeding, and opening the door (406); and if not, the identity recognition failing (408). A moving object video acquired by a camera can be parsed and converted into a face image by means of an execution server, and then the face image is compared with sample data, thereby implementing real-time capture and improving the efficiency of face image acquisition; attendance checking is completed without employees noticing, thereby achieving humanized design and human feeling.

Description

人脸识别方法、应用服务器及计算机可读存储介质Face recognition method, application server and computer readable storage medium
本申请要求于2018年1月8日提交中国专利局,申请号为201810014831.2、发明名称为“人脸识别方法、应用服务器及计算机可读存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims priority to Chinese Patent Application No. 201810014831.2, entitled "Face Recognition Method, Application Server, and Computer Readable Storage Media", filed on January 8, 2018, the entire contents of which are hereby incorporated by reference. The citations are incorporated herein by reference.
技术领域Technical field
本申请涉及人脸识别技术领域,尤其涉及一种人脸识别方法、应用服务器及计算机可读存储介质。The present application relates to the field of face recognition technologies, and in particular, to a face recognition method, an application server, and a computer readable storage medium.
背景技术Background technique
人脸识别技术是基于人的脸部特征信息进行身份识别的一种生物识别技术,主要包括人脸检测和人脸识别两部分。在人脸模式识别领域,人脸识别技术发展较为迅速,已经有相应的实际应用,如基于人脸识别的门禁系统、考勤机、人脸登录等。目前人脸识别的准确率,可以达到90%以上。Face recognition technology is a biometric recognition technology based on human facial feature information, which mainly includes face detection and face recognition. In the field of face pattern recognition, face recognition technology has developed rapidly, and there have been corresponding practical applications, such as face recognition based access control systems, attendance machines, face registration and so on. At present, the accuracy of face recognition can reach more than 90%.
目前,基于人脸识别的考勤中很多是通过固定摄像头固定人脸位置才能采集人脸图片的做法,但是现有的人脸考勤技术中,要求员工在指定位置,以指定姿势才能够采集人脸图像,这就导致客户体验很差,而且人脸的识别效率和准确度也不是很高。At present, many face recognition-based attendances are used to fix face positions by fixing the camera position. However, in the existing face attendance technology, employees are required to collect faces in a specified position. The image, which leads to a poor customer experience, and the recognition efficiency and accuracy of the face is not very high.
发明内容Summary of the invention
有鉴于此,本申请提出一种人脸识别方法、应用服务器及计算机可读存储介质,以解决现有的人脸识别技术出现的客户体验差、识别率和准确率低、以及欠缺智能化的问题。In view of this, the present application provides a face recognition method, an application server, and a computer readable storage medium to solve the problem of poor customer experience, low recognition rate and accuracy, and lack of intelligence in the existing face recognition technology. problem.
首先,为实现上述目的,本申请提出一种人脸识别方法,该方法包括步骤:First, in order to achieve the above object, the present application provides a face recognition method, the method comprising the steps of:
提取至少一个摄像头采集的运动物体视频;Extracting a video of a moving object collected by at least one camera;
转换所述运动物体视频为人脸图像帧;Converting the moving object video into a face image frame;
将所述人脸图像帧与服务器中的样本进行比对,以判断是否为有效图像;Comparing the face image frame with a sample in the server to determine whether it is a valid image;
若是,则身份识别通过,打开门禁;及If yes, the identification is passed and the access control is opened; and
若否,则身份识别失败。If no, the identification fails.
此外,为实现上述目的,本申请还提供一种应用服务器,包括存储器、处理器,所述存储器上存储有可在所述处理器上运行的人脸识别系统,所述人脸识别系统被所述处理器执行时实现如上述的人脸识别方法的步骤。In addition, in order to achieve the above object, the present application further provides an application server, including a memory and a processor, where the memory stores a face recognition system operable on the processor, where the face recognition system is The steps of the face recognition method as described above are implemented when the processor is executed.
进一步地,为实现上述目的,本申请还提供一种计算机可读存储介质,所述计算机可读存储介质存储有人脸识别系统,所述人脸识别系统可被至少一个处理器执行,以使所述至少一个处理器执行如上述的人脸识别方法的步骤。Further, in order to achieve the above object, the present application further provides a computer readable storage medium storing a face recognition system, the face recognition system being executable by at least one processor to The at least one processor performs the steps of the face recognition method as described above.
相较于现有技术,本申请所提出的人脸识别方法、应用服务器及计算机可读存储介质,可以提取至少一个摄像头采集的运动物体视频,转换所述运动物体视频为人脸图像帧,并将所述人脸图像帧与服务器中的样本进行比对,以判断是否为有效图像,若是,则身份识别通过,打开门禁,若否,则身份识别失败。本申请的人脸识别方法是通过执行服务器将摄像头采集的运动物体视频进行解析并转换为人脸图像帧,再与样本数据进行比对的,做到了实时捕捉、提高了人脸图像采集的效率,在员工没有察觉的状态下完成考勤,体现了人性化的设计和感受。Compared with the prior art, the face recognition method, the application server, and the computer readable storage medium provided by the present application may extract a video of a moving object collected by at least one camera, convert the video of the moving object into a face image frame, and The face image frame is compared with the sample in the server to determine whether it is a valid image. If yes, the identity is passed, the access control is opened, and if not, the identity recognition fails. The face recognition method of the present application is to perform a server to parse and convert a video of a moving object collected by a camera into a face image frame, and then compare the sample data with the sample data, thereby realizing real-time capturing and improving the efficiency of face image collection. Completing attendance without the staff's awareness, reflecting the humanized design and feelings.
附图说明DRAWINGS
图1是本申请应用服务器一可选地硬件架构的示意图;1 is a schematic diagram of an optional hardware architecture of an application server of the present application;
图2是本申请人脸识别系统第一实施例的程序模块示意图;2 is a schematic diagram of a program module of a first embodiment of the present applicant's face recognition system;
图3是本申请人脸识别系统第二实施例的程序模块示意图;3 is a schematic diagram of a program module of a second embodiment of the present applicant's face recognition system;
图4是本申请人脸识别方法第一实施例的流程示意图;4 is a schematic flow chart of the first embodiment of the present applicant's face recognition method;
图5是图4中步骤S400细化流程示意图;Figure 5 is a schematic diagram of the refinement process of step S400 in Figure 4;
图6是本申请人脸识别方法第二实施例的流程示意图;6 is a schematic flow chart of a second embodiment of the present applicant's face recognition method;
图7是本申请人脸识别方法第三实施例的流程示意图;7 is a schematic flow chart of a third embodiment of the present applicant's face recognition method;
图8是本发明人脸识别方法第四实施例的流程示意图;8 is a schematic flow chart of a fourth embodiment of a face recognition method according to the present invention;
图9是本发明人脸识别方法第五实施例的流程示意图。FIG. 9 is a schematic flow chart of a fifth embodiment of a face recognition method according to the present invention.
附图标记:Reference mark:
应用服务器application server 22
存储器Memory 1111
处理器processor 1212
网络接口Network Interface 1313
人脸识别系统 Face recognition system 200200
提取模块 Extraction module 201201
转换模块 Conversion module 202202
判断模块 Judgment module 203203
警报模块 Alarm module 301301
本申请目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The implementation, functional features and advantages of the present application will be further described with reference to the accompanying drawings.
具体实施方式Detailed ways
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处所描述的具体实施例仅用以解释本申请,并不用于限定本申请。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the objects, technical solutions, and advantages of the present application more comprehensible, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.
需要说明的是,在本申请中涉及“第一”、“第二”等的描述仅用于描述目的,而不能理解为指示或暗示其相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。另外,各个实施例之间的技术方案可以相互结合,但是必须是以本领域普通技术人员能够实现为基础,当技术方案的结合出现相互矛盾或无法实现时应当认为这种技术方案的结合不存在,也不在本申请要求的保护范围之内。It should be noted that the descriptions of "first", "second" and the like in the present application are for the purpose of description only, and are not to be construed as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. . Thus, features defining "first" or "second" may include at least one of the features, either explicitly or implicitly. In addition, the technical solutions between the various embodiments may be combined with each other, but must be based on the realization of those skilled in the art, and when the combination of the technical solutions is contradictory or impossible to implement, it should be considered that the combination of the technical solutions does not exist. Nor is it within the scope of protection required by this application.
参阅图1所示,是本申请应用服务器2一可选地硬件架构的示意图。Referring to FIG. 1, it is a schematic diagram of an optional hardware architecture of the application server 2 of the present application.
本实施例中,所述应用服务器2可包括,但不仅限于,可通过系统总线相互通信连接存储器11、处理器12、网络接口13。需要指出的是,图1仅示出了具有组件11-13的应用服务器2,但是应理解的是,并不要求实施所有示出的组件,可以替代的实施更多或者更少的组件。In this embodiment, the application server 2 may include, but is not limited to, the memory 11, the processor 12, and the network interface 13 being communicably connected to each other through a system bus. It is pointed out that Figure 1 only shows the application server 2 with components 11-13, but it should be understood that not all illustrated components may be implemented, and more or fewer components may be implemented instead.
其中,所述应用服务器2可以是机架式服务器、刀片式服务器、塔式服务器或机柜式服务器等计算设备,该应用服务器2可以是独立的服务器,也可以是多个服务器所组成的服务器集群。The application server 2 may be a computing device such as a rack server, a blade server, a tower server, or a rack server. The application server 2 may be an independent server or a server cluster composed of multiple servers. .
所述存储器11至少包括一种类型的可读存储介质,所述可读存储介质包括闪存、硬盘、多媒体卡、卡型存储器(例如,SD或DX存储器等)、随机访问存储器(RAM)、静态随机访问存储器(SRAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、可编程只读存储器(PROM)、磁性存储器、磁盘、光盘等。在一些实施例中,所述存储器11可以是所述应用服务器2的内部存储单元,例如该应用服务器2的硬盘或内存。在另一些实施例中,所述存储器11也可以是所述应用服务器2的外部存储设备,例如该应用服务器2上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。当然,所述存储器11还可以既包括所述应用服务器2的内部存储单元也包括其外部存储设备。本实施例 中,所述存储器11通常用于存储安装于所述应用服务器2的操作系统和各类应用软件,例如人脸识别系统200的程序代码等。此外,所述存储器11还可以用于暂时地存储已经输出或者将要输出的各类数据。The memory 11 includes at least one type of readable storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static Random access memory (SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, and the like. In some embodiments, the memory 11 may be an internal storage unit of the application server 2, such as a hard disk or memory of the application server 2. In other embodiments, the memory 11 may also be an external storage device of the application server 2, such as a plug-in hard disk equipped on the application server 2, a smart memory card (SMC), and a secure digital number. (Secure Digital, SD) card, flash card, etc. Of course, the memory 11 can also include both the internal storage unit of the application server 2 and its external storage device. In this embodiment, the memory 11 is generally used to store an operating system installed in the application server 2 and various types of application software, such as program codes of the face recognition system 200. Further, the memory 11 can also be used to temporarily store various types of data that have been output or are to be output.
所述处理器12在一些实施例中可以是中央处理器(Central Processing Unit,CPU)、控制器、微控制器、微处理器、或其他数据处理芯片。该处理器12通常用于控制所述应用服务器2的总体操作。本实施例中,所述处理器12用于运行所述存储器11中存储的程序代码或者处理数据,例如运行所述的人脸识别系统200等。The processor 12 may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor, or other data processing chip in some embodiments. The processor 12 is typically used to control the overall operation of the application server 2. In this embodiment, the processor 12 is configured to run program code or process data stored in the memory 11, such as running the face recognition system 200 and the like.
所述网络接口13可包括无线网络接口或有线网络接口,该网络接口13通常用于在所述应用服务器2与其他电子设备之间建立通信连接。The network interface 13 may comprise a wireless network interface or a wired network interface, which is typically used to establish a communication connection between the application server 2 and other electronic devices.
至此,己经详细介绍了本申请相关设备的硬件结构和功能。下面,将基于上述介绍提出本申请的各个实施例。So far, the hardware structure and functions of the devices related to this application have been described in detail. Hereinafter, various embodiments of the present application will be made based on the above description.
首先,本申请提出一种人脸识别系统200。First, the present application proposes a face recognition system 200.
参阅图2所示,是本申请人脸识别系统200第一实施例的程序模块图。Referring to FIG. 2, it is a program module diagram of the first embodiment of the applicant's face recognition system 200.
本实施例中,所述人脸识别系统200包括一系列的存储于存储器11上的计算机程序指令,当该计算机程序指令被处理器12执行时,可以实现本申请各实施例的人脸识别操作。在一些实施例中,基于该计算机程序指令各部分所实现的特定的操作,人脸识别系统200可以被划分为一个或多个模块。例如,在图2中,所述人脸识别系统200可以被分割成提取模块201、转换模块202、以及判断模块203。其中:In this embodiment, the face recognition system 200 includes a series of computer program instructions stored in the memory 11, and when the computer program instructions are executed by the processor 12, the face recognition operation of the embodiments of the present application can be implemented. . In some embodiments, the face recognition system 200 can be divided into one or more modules based on the particular operations implemented by the various portions of the computer program instructions. For example, in FIG. 2, the face recognition system 200 can be divided into an extraction module 201, a conversion module 202, and a determination module 203. among them:
所述提取模块201,用于提取至少一个摄像头采集的运动物体视频。The extraction module 201 is configured to extract a video of a moving object collected by at least one camera.
所述转换模块202,用于转换所述运动物体视频为人脸图像帧。The conversion module 202 is configured to convert the video of the moving object into a face image frame.
具体地,提取模块201包括:检测单元2011、获取单元2012、判断单元2013以及拍摄单元2014以及识别单元2015。其中:Specifically, the extraction module 201 includes a detection unit 2011, an acquisition unit 2012, a determination unit 2013, and a photographing unit 2014 and an identification unit 2015. among them:
所述检测单元2011,用于检测在摄像头的监测范围内出现的运动物体;The detecting unit 2011 is configured to detect a moving object that appears within a monitoring range of the camera;
获取单元2012,用于获取摄像头采集的所述运动物体的视频识别单元2014。The obtaining unit 2012 is configured to acquire the video recognition unit 2014 of the moving object collected by the camera.
也就是说,当检测单元2011检测在摄像头的监测范围内出现运动物体时,通过获取单元2012获取摄像头采集运动物体的视频,服务器从摄像头获取所述运动物体的视频,识别单元2014转换模块202将运动物体视频转换人脸图像帧。That is, when the detecting unit 2011 detects that a moving object appears within the monitoring range of the camera, the acquiring unit 2012 acquires a video of the moving object collected by the camera, and the server acquires the video of the moving object from the camera, and the identifying unit 2014 conversion module 202 The moving object video converts the face image frame.
判断单元2013,用于判断所述摄像头是否定位到所述运动物体的人脸;若是,则拍摄单元2014,用于拍摄一张或者多张所述人脸图像;若否,则获取单元2012,用于获取摄像头采集的所述运动物体的整体视频;The determining unit 2013 is configured to determine whether the camera is positioned to the face of the moving object; if yes, the shooting unit 2014 is configured to capture one or more of the face images; if not, the acquiring unit 2012, An overall video for acquiring the moving object collected by the camera;
转换模块202,还用于将所述运动物体的整体视频转换成所述运动物体的整体图像;The conversion module 202 is further configured to convert an entire video of the moving object into an overall image of the moving object;
识别单元2015,用于从所述运动物体的整体图像中识别出人脸图像。The recognition unit 2015 is configured to recognize a face image from the entire image of the moving object.
也就是说,当检测单元2011检测在摄像头的监测范围内出现运动物体时,通过摄像头追踪运动物体的人脸,并准确定位人脸范围,可以直接采集一张人脸图像,或者连续采集多张人脸图像。若追踪不到人脸,则获取单元2012通过摄像头获取运动物体的整体视频,转换模块202将运动物体的整体视频转换成整体图像,识别单元2014再从整体图像中识别人脸图像,进而识别运动物体的人脸。That is to say, when the detecting unit 2011 detects that a moving object appears within the monitoring range of the camera, the face of the moving object is tracked by the camera, and the face range is accurately positioned, and a face image can be directly collected, or multiple pieces can be continuously collected. Face image. If the face is not tracked, the acquisition unit 2012 acquires the overall video of the moving object through the camera, the conversion module 202 converts the overall video of the moving object into an overall image, and the recognition unit 2014 recognizes the face image from the overall image, thereby recognizing the motion. The face of the object.
可选地,若从运动物体的视频中识别人脸图像,则转换模块202,具体用于:Optionally, if the face image is recognized from the video of the moving object, the converting module 202 is specifically configured to:
将所述运动物体的视频转换成视频帧;Converting a video of the moving object into a video frame;
识别所述视频帧中的人脸;Identifying a face in the video frame;
获取所述人脸在所述视频帧中的坐标范围;Obtaining a coordinate range of the face in the video frame;
截取所述坐标范围的图像。An image of the coordinate range is intercepted.
可选地,若从运动物体的整体图像中识别人脸图像,则识别单元2015具体用于:Optionally, if the face image is recognized from the overall image of the moving object, the identifying unit 2015 is specifically configured to:
识别所述运动物体的整体图像中的人脸;Identifying a face in the overall image of the moving object;
获取所述人脸在所述整体图像中的坐标范围;Obtaining a coordinate range of the face in the overall image;
截取所述坐标范围的图像。An image of the coordinate range is intercepted.
在本实施例中,当对采集到的图像识别到人脸时,将具有所述人脸的图像标记为人脸图像。采集人脸图像是基于人脸检测算法,其中人脸检测指的是在摄像机获取的一帧图片中寻找人脸,并得到人脸的矩形坐标范围。In the present embodiment, when a face is recognized for the captured image, the image having the face is marked as a face image. The face image is collected based on the face detection algorithm, wherein the face detection refers to finding a face in a frame of images acquired by the camera, and obtaining a rectangular coordinate range of the face.
人脸检测算法至少包括传统机器学习算法(比如SURF Cascade等)以及基于深度学习的算法(比如Faster RCNN,MTCNN等)。The face detection algorithm includes at least a traditional machine learning algorithm (such as SURF Cascade, etc.) and a deep learning based algorithm (such as Faster RCNN, MTCNN, etc.).
在将扫描到的人脸转换为人脸图像时,基于检测人脸时获取人脸的矩形坐标范围,从摄像头的视频帧中按照坐标范围截取矩形区域即可得到人脸图像。When the scanned face is converted into a face image, the face image is obtained by capturing a rectangular area from the video frame of the camera according to the coordinate range based on the rectangular coordinate range of the face when the face is detected.
可选地,服务器上挂载多个摄像头,这些摄像头可以是进门的门禁处,也可以是出门的门禁处,这些摄像头可以位于不同的楼层,本申请在此不作具体限制。Optionally, a plurality of cameras are mounted on the server. The cameras may be access doors or door accesses. The cameras may be located on different floors. The application is not limited herein.
可选地,服务器还与考勤服务器连接,以将考勤数据录入考勤服务器中的考勤数据库中。在考勤数据库中存储每个员工的样本图片,样本图片的数量可以是一张,也可以是多张,多张样本图片可以记录员工各个表情的脸部图像特征。Optionally, the server is further connected to the attendance server to record the attendance data into the attendance database in the attendance server. A sample picture of each employee is stored in the attendance database, and the number of sample pictures may be one or multiple, and multiple sample pictures may record facial image features of each expression of the employee.
可选地,服务器还与显示屏连接,以实时显示考勤信息等,若员工考勤成功,则还显示员工的样本图片。Optionally, the server is also connected to the display screen to display the attendance information in real time, and if the employee attendance is successful, the employee's sample picture is also displayed.
可选地,摄像头采集运动物体的视频时,需要光照亮度不能低于预设的阈值,也就是说,需要人脸受光均匀,并且通过摄像头可以辨识人脸轮廓和五官。Optionally, when the camera captures the video of the moving object, the illumination brightness needs to be lower than a preset threshold, that is, the face needs to be evenly received, and the face contour and the facial features can be recognized by the camera.
可选地,当多个摄像头同时采集到运动物体的视频时,服务器上的执行器处理每一路摄像头的视频,在每一个执行器内部是可以正确得到截取人脸图像的顺序。Optionally, when a plurality of cameras simultaneously capture video of a moving object, the actuator on the server processes the video of each camera, and within each actuator is an order in which the face image can be correctly captured.
可选地,摄像头的采集范围可以由参数设定,可以是摄像机的全画面或者部分画面,画面覆盖范围由摄像机镜头的焦距、分辨率、光照等条件决定,只要员工走入摄像头的采集范围,就可以录制视频,而不限定员工的表情、动作等。另外,本申请也不限制摄像头的角度,也就是说,在获取摄像头采集的运动物体视频时时,可以从不同的方向获取视频,从运动物体的正前方、左侧方或右侧方等,以获得正面人脸图像、左侧面人脸图像或右侧面人脸图像。Optionally, the acquisition range of the camera may be set by a parameter, and may be a full screen or a partial screen of the camera. The coverage of the screen is determined by the focal length, resolution, illumination, and the like of the camera lens. As long as the employee enters the collection range of the camera, You can record videos without limiting your employees' expressions, actions, and more. In addition, the present application does not limit the angle of the camera, that is, when acquiring the video of the moving object collected by the camera, the video can be obtained from different directions, from the front, the left side or the right side of the moving object, etc. Get a frontal face image, a left side face image, or a right side face image.
判断模块203,用于将所述人脸图像帧与服务器中的样本进行比对,以判断是否为有效图像。若是,则身份识别通过,打开门禁,若否,则身份识别失败。The determining module 203 is configured to compare the face image frame with the sample in the server to determine whether it is a valid image. If yes, the identification is passed, the access control is opened, and if not, the identification fails.
具体地,服务器截取人脸图像帧与考勤数据库中的样本图片进行比对,主要是比对人脸图像帧与预先存储的该用户的样本图像的图片相似度,判断图片相似度是否大于预设的阈值,如果是,则确定该人脸图像帧为有效图像,即身份识别通过,打开门禁,相反地,则确定该人脸图像帧为无效图像,即身份识别失败。Specifically, the server intercepts the face image frame and compares the sample images in the attendance database, mainly comparing the similarity between the face image frame and the pre-stored sample image of the user, and determining whether the image similarity is greater than a preset. The threshold value, if yes, determines that the face image frame is a valid image, that is, the identity recognition is passed, the access control is opened, and conversely, the face image frame is determined to be an invalid image, that is, the identity recognition fails.
当判定服务器截取人脸图像为有效图像时,则说明人脸图像被识别,采用本申请,人脸识别一般可以在1秒以内完成,所以对员工出勤时间的影响非常小。When the determination server intercepts the face image as a valid image, it indicates that the face image is recognized. With the present application, the face recognition can be completed within one second, so the impact on the employee's attendance time is very small.
抓取移动网络摄像头的图像帧来比对样本数据库与截取的人脸图像来验证样本库是否包含抓取到的人脸进而进行身份识别和门禁系统关闭。获取到了远程布控、资源有效利用、高效稳定的门禁识别系统服务。达到了质量与扩展双提升的目标。The image frame of the mobile webcam is captured to compare the sample database with the intercepted face image to verify whether the sample library contains the captured face for identification and access control system shutdown. Obtained remote access control, efficient use of resources, efficient and stable access control identification system services. Achieved the goal of both quality and expansion.
可选地,当身份识别通过时,将所述有效图像对应的员工信息录入考勤服务器,员工信息包括:员工姓名、考勤时间、日期、员工部门。Optionally, when the identification is passed, the employee information corresponding to the valid image is recorded into the attendance server, and the employee information includes: an employee name, an attendance time, a date, and an employee department.
可选地,可以通过显示器显示员工的考勤信息。如图X所示,为显示员工考勤信息的照片,在图X中,自上而下分别显示:员工姓名、样本照片、考勤 时间、日期和员工部门。Optionally, the attendance information of the employee can be displayed through the display. As shown in Figure X, in order to display the photo of the employee's attendance information, in Figure X, the top-down shows: employee name, sample photo, attendance time, date, and employee department.
可选地,在显示考勤信息的同时,还对考勤信息进行保存,并与考勤系统连接,以导入考勤数据。Optionally, while the attendance information is displayed, the attendance information is also saved, and is connected to the attendance system to import the attendance data.
该考勤时间可以是指员工的上班时间、下班时间、午休时间、加班时间等。The attendance time can refer to the employee's working hours, off-duty time, lunch break time, overtime hours, and the like.
可选地,将被正确识别的时间作为员工的考勤时间。Optionally, the time that is correctly identified is taken as the attendance time of the employee.
可选地,当多个摄像头采集到同一运动物体(员工)的视频或者图像时,则以先识别出人脸图像为有效图像的时间作为考勤时间。Optionally, when a plurality of cameras capture video or images of the same moving object (employee), the time when the face image is first recognized as the effective image is taken as the attendance time.
当判定服务器截取人脸图像为无效图像时,则说明没有识别出人脸图像,则考勤失败。When it is determined that the server intercepts the face image as an invalid image, it indicates that the face image is not recognized, and the attendance fails.
本实施例提供的应用服务器,通过提取模块201提取至少一个摄像头采集的运动物体视频,转换模块202转换运动物体视频为人脸图像帧,判断模块203将所述人脸图像帧与服务器中的样本进行比对,以判断是否为有效图像,若是,则身份识别通过,打开门禁,若否,则身份识别失败。本申请的应用服务器将摄像头采集的运动物体视频进行解析并转换为人脸图像,再与样本数据进行比对的,做到了实时捕捉、提高了人脸图像采集的效率,在员工没有察觉的状态下完成考勤,体现了人性化的设计和感受。The application server provided in this embodiment extracts the video of the moving object collected by the at least one camera through the extraction module 201, and the conversion module 202 converts the video of the moving object into a face image frame, and the determining module 203 performs the image of the face image and the sample in the server. Alignment to determine whether it is a valid image, and if so, the identification is passed, the access control is opened, and if not, the identification fails. The application server of the present application parses and converts the video of the moving object collected by the camera into a face image, and then compares it with the sample data, so that the real-time capture and the efficiency of the face image collection are improved, and the employee is not aware of the state. Completion of attendance, reflecting the human design and feelings.
参阅图3所示,是本申请人脸识别系统200第二实施例的程序模块图。本实施例中,所述的人脸系统200除了包括第一实施例中的所述提取模块201、转换模块202以及判断模块203之外,还包括警报模块301。Referring to FIG. 3, it is a program module diagram of the second embodiment of the applicant's face recognition system 200. In this embodiment, the face system 200 includes an alarm module 301 in addition to the extraction module 201, the conversion module 202, and the determination module 203 in the first embodiment.
在第二实施例中,判断模块203,还用于判断识别失败的次数是否达到预设的次数阈值。若否,则触发提取模块201提取至少一个摄像头采集的所述运动物体视频,若是,则触发警报模块301,用于产生警报,以提示为非本公司员工。In the second embodiment, the determining module 203 is further configured to determine whether the number of times the recognition fails reaches a preset number of times threshold. If not, the trigger extraction module 201 extracts the moving object video collected by the at least one camera, and if so, triggers the alarm module 301 to generate an alarm to prompt the employee to be non-employee.
具体地,若判断模块203在预设的次数阈值内判断对该员工识别失败,则 可能是系统故障,或者是由于视频拍摄角度的缘故导致与样本图片的识别失败,进而重新提取该运动物体的视频,再获取人脸图像,并与样本图像进行比对。若判断模块203判断超过预设的次数阈值,仍对该员工识别失败,则说明该员工不是本公司职工的可能性很高,则产生警报,引起相关部门的注意。Specifically, if the determining module 203 determines that the employee identification fails within a preset number of times threshold, the system may be faulty, or the recognition of the sample picture fails due to the video shooting angle, and the motion object is re-extracted. Video, then get the face image and compare it with the sample image. If the judging module 203 determines that the threshold number of times exceeds the preset number of times and fails to identify the employee, it indicates that the employee is not likely to be an employee of the company, and an alarm is generated, which causes the attention of the relevant department.
本实施例中的应用服务器,当判断识别失败的次数没有达到预设的次数阈值,则重新提取至少一个摄像头采集的所述运动物体视频,否则,产生警报,以进一步完善应用服务器识别人脸图像。The application server in this embodiment re-extracts the video of the moving object collected by the at least one camera when it is determined that the number of times the recognition fails does not reach the preset number of times threshold, otherwise, an alarm is generated to further improve the application server to recognize the face image. .
此外,本申请还提出一种人脸识别方法。In addition, the present application also proposes a face recognition method.
参阅图4所示,是本申请人脸识别方法第一实施例的流程示意图。在本实施例中,根据不同的需求,图5所示的流程图中的步骤的执行顺序可以改变,某些步骤可以省略。Referring to FIG. 4, it is a schematic flowchart of the first embodiment of the present applicant's face recognition method. In this embodiment, the order of execution of the steps in the flowchart shown in FIG. 5 may be changed according to different requirements, and some steps may be omitted.
步骤S400,提取至少一个摄像头采集的运动物体视频。Step S400, extracting a moving object video collected by at least one camera.
步骤S402,转换所述运动物体视频为人脸图像帧。Step S402, converting the video of the moving object into a face image frame.
具体地,如图5所示,步骤S400进一步包括:Specifically, as shown in FIG. 5, step S400 further includes:
S501,检测在摄像头的监测范围内出现的运动物体;S501: detecting a moving object that appears within a monitoring range of the camera;
S502,获取摄像头采集的所述运动物体的视频。S502. Acquire a video of the moving object collected by a camera.
也就是说,当检测在摄像头的监测范围内出现运动物体时,通过摄像头采集运动物体的视频,服务器从摄像头获取所述运动物体的视频,并将运动物体视频转换人脸图像帧。That is to say, when detecting a moving object appearing within the monitoring range of the camera, the video of the moving object is acquired by the camera, the server acquires the video of the moving object from the camera, and converts the moving object video into the face image frame.
如图6所示,步骤S400还可以包括:As shown in FIG. 6, step S400 may further include:
S601,检测在摄像头的监测范围内出现的运动物体;S601: detecting a moving object that appears within a monitoring range of the camera;
S602,判断所述摄像头是否定位到所述运动物体的人脸;若是,则进入S603,若否,则进入S604;S602, determining whether the camera is positioned to the face of the moving object; if yes, proceed to S603, and if not, proceed to S604;
S603,拍摄一张或者多张所述人脸图像;S603. Take one or more of the face images;
S604,获取摄像头采集的所述运动物体的整体视频;S604. Acquire an overall video of the moving object collected by the camera.
S605,将所述运动物体的整体视频转换成所述运动物体的整体图像;S605. Convert an entire video of the moving object into an overall image of the moving object.
S606,从所述运动物体的整体图像中识别出人脸图像。S606, recognizing a face image from the entire image of the moving object.
也就是说,当检测在摄像头的监测范围内出现运动物体时,通过摄像头追踪运动物体的人脸,并准确定位人脸范围,可以直接采集一张人脸图像,或者连续采集多张人脸图像。若追踪不到人脸,则通过摄像头获取运动物体的整体视频,将运动物体的整体视频转换成整体图像,再从整体图像中识别人脸图像,进而识别运动物体的人脸。That is to say, when detecting a moving object appearing within the monitoring range of the camera, the face of the moving object is tracked by the camera, and the face range is accurately positioned, and a face image can be directly collected, or multiple face images can be continuously collected. . If the face is not tracked, the entire video of the moving object is acquired by the camera, the overall video of the moving object is converted into an overall image, and the face image is recognized from the overall image, thereby identifying the face of the moving object.
如图7所示,若从运动物体的视频中识别人脸图像,其过程如下:As shown in FIG. 7, if a face image is recognized from a video of a moving object, the process is as follows:
S701,将所述运动物体的视频转换成视频帧;S701. Convert a video of the moving object into a video frame.
S702,识别所述视频帧中的人脸;S702. Identify a human face in the video frame.
S703,获取所述人脸在所述视频帧中的坐标范围;S703. Acquire a coordinate range of the face in the video frame.
S704,截取所述坐标范围的图像。S704, intercepting an image of the coordinate range.
如图8所示,若从运动物体的整体图像中识别人脸图像,其过程如下:As shown in FIG. 8, if a face image is recognized from the entire image of the moving object, the process is as follows:
S801,识别所述运动物体的整体图像中的人脸;S801, identifying a face in the overall image of the moving object;
S802,获取所述人脸在所述整体图像中的坐标范围;S802. Acquire a coordinate range of the face in the overall image.
S803,截取所述坐标范围的图像。S803, intercepting an image of the coordinate range.
在本实施例中,当对采集到的图像识别到人脸时,将具有所述人脸的图像标记为人脸图像。采集人脸图像是基于人脸检测算法,其中人脸检测指的是在摄像机获取的一帧图片中寻找人脸,并得到人脸的矩形坐标范围。In the present embodiment, when a face is recognized for the captured image, the image having the face is marked as a face image. The face image is collected based on the face detection algorithm, wherein the face detection refers to finding a face in a frame of images acquired by the camera, and obtaining a rectangular coordinate range of the face.
人脸检测算法至少包括传统机器学习算法(比如SURF Cascade等)以及基于深度学习的算法(比如Faster RCNN,MTCNN等)。The face detection algorithm includes at least a traditional machine learning algorithm (such as SURF Cascade, etc.) and a deep learning based algorithm (such as Faster RCNN, MTCNN, etc.).
在将扫描到的人脸转换为人脸图像时,基于检测人脸时获取人脸的矩形坐标范围,从摄像头的视频帧中按照坐标范围截取矩形区域即可得到人脸图像。When the scanned face is converted into a face image, the face image is obtained by capturing a rectangular area from the video frame of the camera according to the coordinate range based on the rectangular coordinate range of the face when the face is detected.
可选地,服务器上挂载多个摄像头,这些摄像头可以是进门的门禁处,也可以是出门的门禁处,这些摄像头可以位于不同的楼层,本申请在此不作 具体限制。Optionally, a plurality of cameras are mounted on the server. The cameras may be access doors or door accesses. The cameras may be located on different floors. The application is not limited herein.
可选地,服务器还与考勤服务器连接,以将考勤数据录入考勤服务器中的考勤数据库中。在考勤数据库中存储每个员工的样本图片,样本图片的数量可以是一张,也可以是多张,多张样本图片可以记录员工各个表情的脸部图像特征。Optionally, the server is further connected to the attendance server to record the attendance data into the attendance database in the attendance server. A sample picture of each employee is stored in the attendance database, and the number of sample pictures may be one or multiple, and multiple sample pictures may record facial image features of each expression of the employee.
可选地,服务器还与显示屏连接,以实时显示考勤信息等,若员工考勤成功,则还显示员工的样本图片。Optionally, the server is also connected to the display screen to display the attendance information in real time, and if the employee attendance is successful, the employee's sample picture is also displayed.
可选地,摄像头采集运动物体的视频时,需要光照亮度不能低于预设的阈值,也就是说,需要人脸受光均匀,并且通过摄像头可以辨识人脸轮廓和五官。Optionally, when the camera captures the video of the moving object, the illumination brightness needs to be lower than a preset threshold, that is, the face needs to be evenly received, and the face contour and the facial features can be recognized by the camera.
可选地,当多个摄像头同时采集到运动物体的视频时,服务器上的执行器处理每一路摄像头的视频,在每一个执行器内部是可以正确得到截取人脸图像的顺序。Optionally, when a plurality of cameras simultaneously capture video of a moving object, the actuator on the server processes the video of each camera, and within each actuator is an order in which the face image can be correctly captured.
可选地,摄像头的采集范围可以由参数设定,可以是摄像机的全画面或者部分画面,画面覆盖范围由摄像机镜头的焦距、分辨率、光照等条件决定,只要员工走入摄像头的采集范围,就可以录制视频,而不限定员工的表情、动作等。另外,本申请也不限制摄像头的角度,也就是说,在获取摄像头采集的运动物体视频时时,可以从不同的方向获取视频,从运动物体的正前方、左侧方或右侧方等,以获得正面人脸图像、左侧面人脸图像或右侧面人脸图像。Optionally, the acquisition range of the camera may be set by a parameter, and may be a full screen or a partial screen of the camera. The coverage of the screen is determined by the focal length, resolution, illumination, and the like of the camera lens. As long as the employee enters the collection range of the camera, You can record videos without limiting your employees' expressions, actions, and more. In addition, the present application does not limit the angle of the camera, that is, when acquiring the video of the moving object collected by the camera, the video can be obtained from different directions, from the front, the left side or the right side of the moving object, etc. Get a frontal face image, a left side face image, or a right side face image.
步骤S404,将所述人脸图像帧与服务器中的样本进行比对,以判断是否为有效图像。若是,则进入步骤S406,若否,则进入步骤408。Step S404, comparing the face image frame with the sample in the server to determine whether it is a valid image. If yes, go to step S406, if no, go to step 408.
具体地,服务器截取人脸图像帧与考勤数据库中的样本图片进行比对,主要是比对人脸图像帧与预先存储的该用户的样本图像的图片相似度,判断图片相似度是否大于预设的阈值,如果是,则确定该人脸图像帧为有效图像,并进入步骤404,相反地,则确定该人脸图像帧为无效图像,并进入步骤406。Specifically, the server intercepts the face image frame and compares the sample images in the attendance database, mainly comparing the similarity between the face image frame and the pre-stored sample image of the user, and determining whether the image similarity is greater than a preset. The threshold value, if yes, determines that the face image frame is a valid image, and proceeds to step 404, and conversely determines that the face image frame is an invalid image, and proceeds to step 406.
步骤S404,身份识别通过,打开门禁。Step S404, the identity recognition is passed, and the access control is opened.
具体地,当判定服务器截取人脸图像为有效图像时,则说明人脸图像被识别,采用本申请,人脸识别一般可以在1秒以内完成,所以对员工出勤时间的影响非常小。Specifically, when the determination server intercepts the face image as a valid image, it indicates that the face image is recognized. With the present application, the face recognition can be completed within one second, so the impact on the employee's attendance time is very small.
抓取移动网络摄像头的图像帧来比对样本数据库与截取的人脸图像来验证样本库是否包含抓取到的人脸进而进行身份识别和门禁系统关闭。获取到了远程布控、资源有效利用、高效稳定的门禁识别系统服务。达到了质量与扩展双提升的目标。The image frame of the mobile webcam is captured to compare the sample database with the intercepted face image to verify whether the sample library contains the captured face for identification and access control system shutdown. Obtained remote access control, efficient use of resources, efficient and stable access control identification system services. Achieved the goal of both quality and expansion.
可选地,当身份识别通过时,将所述有效图像对应的员工信息录入考勤服务器,员工信息包括:员工姓名、考勤时间、日期、员工部门。Optionally, when the identification is passed, the employee information corresponding to the valid image is recorded into the attendance server, and the employee information includes: an employee name, an attendance time, a date, and an employee department.
可选地,可以通过显示器显示员工的考勤信息。如图X所示,为显示员工考勤信息的照片,在图X中,自上而下分别显示:员工姓名、样本照片、考勤时间、日期和员工部门。Optionally, the attendance information of the employee can be displayed through the display. As shown in Figure X, in order to display the photo of the employee's attendance information, in Figure X, the top-down shows: employee name, sample photo, attendance time, date, and employee department.
可选地,在显示考勤信息的同时,还对考勤信息进行保存,并与考勤系统连接,以导入考勤数据。Optionally, while the attendance information is displayed, the attendance information is also saved, and is connected to the attendance system to import the attendance data.
该考勤时间可以是指员工的上班时间、下班时间、午休时间、加班时间等。The attendance time can refer to the employee's working hours, off-duty time, lunch break time, overtime hours, and the like.
可选地,将被正确识别的时间作为员工的考勤时间。Optionally, the time that is correctly identified is taken as the attendance time of the employee.
可选地,当多个摄像头采集到同一运动物体(员工)的视频或者图像时,则以先识别出人脸图像为有效图像的时间作为考勤时间。Optionally, when a plurality of cameras capture video or images of the same moving object (employee), the time when the face image is first recognized as the effective image is taken as the attendance time.
步骤S406,身份识别失败。In step S406, the identity recognition fails.
具体地,当判定服务器截取人脸图像为无效图像时,则说明没有识别出人脸图像,则考勤失败。Specifically, when it is determined that the server intercepts the face image as an invalid image, it indicates that the face image is not recognized, and the attendance fails.
如图9所示,在步骤406之后,所述方法还包括:As shown in FIG. 9, after step 406, the method further includes:
S901,判断识别失败的次数是否达到预设的次数阈值。若否,则进入S902,若是,则进入S903。S901. Determine whether the number of times the recognition fails reaches a preset number of times threshold. If not, the process proceeds to S902, and if so, the process proceeds to S903.
S902,提取至少一个摄像头采集的所述运动物体视频。S902. Extract the video of the moving object collected by at least one camera.
S903,产生警报,以提示为非本公司员工。S903, an alarm is generated to prompt the employee of the company.
具体地,若在预设的次数阈值内对该员工识别失败,则可能是系统故障,或者是由于视频拍摄角度的缘故导致与样本图片的识别失败,进而重新提取该运动物体的视频,再获取人脸图像,并与样本图像进行比对。若超过预设的次数阈值,仍对该员工识别失败,则说明该员工不是本公司职工的可能性很高,则产生警报,引起相关部门的注意。Specifically, if the employee fails to be identified within the preset number of times threshold, the system may be faulty, or the recognition of the sample picture fails due to the video shooting angle, and the video of the moving object is re-extracted, and then acquired. The face image is compared with the sample image. If the employee exceeds the preset number of thresholds and fails to identify the employee, it indicates that the employee is not likely to be a member of the company, and an alarm is generated, which causes the attention of the relevant department.
本实施例提供的人脸识别方法,通过提取至少一个摄像头采集的运动物体视频,转换运动物体视频为人脸图像帧,将所述人脸图像帧与服务器中的样本进行比对,以判断是否为有效图像,若是,则身份识别通过,打开门禁,若否,则身份识别失败。本申请的人脸识别方法是通过执行服务器将摄像头采集的运动物体视频进行解析并转换为人脸图像,再与样本数据进行比对的,做到了实时捕捉、提高了人脸图像采集的效率,在员工没有察觉的状态下完成考勤,体现了人性化的设计和感受。In the face recognition method provided by the embodiment, the video of the moving object collected by the at least one camera is extracted, the video of the moving object is converted into a face image frame, and the face image frame is compared with the sample in the server to determine whether it is A valid image, if yes, the identity is passed, the access is opened, and if not, the identification fails. The face recognition method of the present application is to perform a server to parse and convert a video of a moving object collected by a camera into a face image, and then compare the sample data with the sample data, thereby realizing real-time capturing and improving the efficiency of face image collection. The employee completed the attendance without being aware of it, reflecting the humanized design and feelings.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the embodiments of the present application are merely for the description, and do not represent the advantages and disadvantages of the embodiments.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本申请各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, the technical solution of the present application, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, The optical disc includes a number of instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the methods described in various embodiments of the present application.
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above is only a preferred embodiment of the present application, and is not intended to limit the scope of the patent application, and the equivalent structure or equivalent process transformations made by the specification and the drawings of the present application, or directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of this application.

Claims (20)

  1. 一种人脸识别方法,应用于应用服务器,其特征在于,所述方法包括步骤:A face recognition method is applied to an application server, and the method includes the steps of:
    提取至少一个摄像头采集的运动物体视频;Extracting a video of a moving object collected by at least one camera;
    转换所述运动物体视频为人脸图像帧;Converting the moving object video into a face image frame;
    将所述人脸图像帧与服务器中的样本进行比对,以判断是否为有效图像;Comparing the face image frame with a sample in the server to determine whether it is a valid image;
    若是,则身份识别通过,打开门禁;及If yes, the identification is passed and the access control is opened; and
    若否,则身份识别失败。If no, the identification fails.
  2. 如权利要求1所述的人脸识别方法,其特征在于,所述提取至少一个摄像头采集的运动物体视频的步骤,具体包括:The method of claim 1 , wherein the step of extracting the video of the moving object collected by the at least one camera comprises:
    检测在摄像头的监测范围内出现的运动物体;Detecting moving objects that appear within the monitoring range of the camera;
    获取摄像头采集的所述运动物体的视频。Obtaining a video of the moving object collected by the camera.
  3. 如权利要求1所述的人脸识别方法,其特征在于,转换所述运动物体视频为人脸图像帧,具体包括:The face recognition method according to claim 1, wherein the converting the video of the moving object to a face image frame comprises:
    将所述运动物体的视频转换成视频帧;Converting a video of the moving object into a video frame;
    识别所述视频帧中的人脸;Identifying a face in the video frame;
    获取所述人脸在所述视频帧中的坐标范围;Obtaining a coordinate range of the face in the video frame;
    截取所述坐标范围的图像。An image of the coordinate range is intercepted.
  4. 如权利要求1所述的人脸识别方法,其特征在于,所述提取至少一个摄像头采集的运动物体视频的步骤,具体包括:The method of claim 1 , wherein the step of extracting the video of the moving object collected by the at least one camera comprises:
    检测在摄像头的监测范围内出现的运动物体;Detecting moving objects that appear within the monitoring range of the camera;
    判断所述摄像头是否定位到所述运动物体的人脸;Determining whether the camera is positioned to a face of the moving object;
    若是,则拍摄一张或者多张所述人脸图像;If yes, take one or more of the face images;
    若否,则获取摄像头采集的所述运动物体的整体视频;If not, acquiring an overall video of the moving object collected by the camera;
    所述转换所述运动物体视频为人脸图像帧的步骤,具体包括:The step of converting the video of the moving object into a face image frame includes:
    将所述运动物体的整体视频转换成所述运动物体的整体图像;Converting an overall video of the moving object into an overall image of the moving object;
    从所述运动物体的整体图像中识别出人脸图像。A face image is recognized from the entire image of the moving object.
  5. 如权利要求4所述的人脸识别方法,其特征在于,从所述运动物体的整体图像中识别出人脸图像的步骤,具体包括:The face recognition method according to claim 4, wherein the step of recognizing the face image from the entire image of the moving object comprises:
    识别所述运动物体的整体图像中的人脸;Identifying a face in the overall image of the moving object;
    获取所述人脸在所述整体图像中的坐标范围;Obtaining a coordinate range of the face in the overall image;
    截取所述坐标范围的图像。An image of the coordinate range is intercepted.
  6. 如权利要求1-5任一项所述的人脸识别方法,其特征在于,将所述人脸图像帧与服务器中的样本进行比对,以判断是否为有效图像,具体包括:The face recognition method according to any one of claims 1 to 5, wherein the face image frame is compared with a sample in the server to determine whether it is a valid image, and specifically includes:
    比对人脸图像帧与预先存储的该用户的样本图像的图片相似度,判断图片相似度是否大于预设的阈值。Comparing the face image frame with the pre-stored picture similarity of the sample image of the user, determining whether the picture similarity is greater than a preset threshold.
  7. 如权利要求6所述的人脸识别方法,其特征在于,该方法在身份识别通过,打开门禁之后,还包括步骤:The face recognition method according to claim 6, wherein the method further comprises the following steps after the identity recognition is passed and the access control is opened:
    将所述有效图像对应的员工信息录入考勤服务器;Entering the employee information corresponding to the valid image into the attendance server;
    通过显示器显示员工的考勤信息。The employee's attendance information is displayed through the display.
  8. 如权利要求6所述的人脸识别方法,其特征在于,该方法在身份识别失败后,还包括步骤:The face recognition method according to claim 6, wherein the method further comprises the following steps after the identity recognition fails:
    判断识别失败的次数是否达到预设的次数阈值;Determining whether the number of failed recognitions reaches a preset number of times threshold;
    若否,则提取至少一个摄像头采集的所述运动物体视频。If not, the video of the moving object collected by at least one camera is extracted.
    若是,则产生警报,以提示为非本公司员工。If yes, an alert is generated to alert the employee who is not a member of the company.
  9. 一种应用服务器,其特征在于,所述应用服务器包括存储器、处理器,所述存储器上存储有可在所述处理器上运行的人脸识别系统,所述人脸识别系统被所述处理器执行时实现如下步骤:An application server, comprising: a memory, a processor, wherein the memory stores a face recognition system operable on the processor, the face recognition system being the processor The following steps are implemented during execution:
    提取至少一个摄像头采集的运动物体视频;Extracting a video of a moving object collected by at least one camera;
    转换所述运动物体视频为人脸图像帧;Converting the moving object video into a face image frame;
    将所述人脸图像帧与服务器中的样本进行比对,以判断是否为有效图像;Comparing the face image frame with a sample in the server to determine whether it is a valid image;
    若是,则身份识别通过,打开门禁;及If yes, the identification is passed and the access control is opened; and
    若否,则身份识别失败。If no, the identification fails.
  10. 如权利要求9所述的应用服务器,其特征在于,所述提取至少一个摄像头采集的运动物体视频的步骤,具体包括:The application server according to claim 9, wherein the step of extracting the video of the moving object collected by the at least one camera comprises:
    检测在摄像头的监测范围内出现的运动物体;Detecting moving objects that appear within the monitoring range of the camera;
    获取摄像头采集的所述运动物体的视频。Obtaining a video of the moving object collected by the camera.
  11. 如权利要求9所述的应用服务器,其特征在于,转换所述运动物体视频为人脸图像帧,具体包括:The application server according to claim 9, wherein the converting the moving object video into a face image frame comprises:
    将所述运动物体的视频转换成视频帧;Converting a video of the moving object into a video frame;
    识别所述视频帧中的人脸;Identifying a face in the video frame;
    获取所述人脸在所述视频帧中的坐标范围;Obtaining a coordinate range of the face in the video frame;
    截取所述坐标范围的图像。An image of the coordinate range is intercepted.
  12. 如权利要求9所述的应用服务器,其特征在于,所述提取至少一个摄像头采集的运动物体视频的步骤,具体包括:The application server according to claim 9, wherein the step of extracting the video of the moving object collected by the at least one camera comprises:
    检测在摄像头的监测范围内出现的运动物体;Detecting moving objects that appear within the monitoring range of the camera;
    判断所述摄像头是否定位到所述运动物体的人脸;Determining whether the camera is positioned to a face of the moving object;
    若是,则拍摄一张或者多张所述人脸图像;If yes, take one or more of the face images;
    若否,则获取摄像头采集的所述运动物体的整体视频;If not, acquiring an overall video of the moving object collected by the camera;
    所述转换所述运动物体视频为人脸图像帧的步骤,具体包括:The step of converting the video of the moving object into a face image frame includes:
    将所述运动物体的整体视频转换成所述运动物体的整体图像;Converting an overall video of the moving object into an overall image of the moving object;
    从所述运动物体的整体图像中识别出人脸图像。A face image is recognized from the entire image of the moving object.
  13. 如权利要求12所述的应用服务器,其特征在于,从所述运动物体的整体图像中识别出人脸图像的步骤,具体包括:The application server according to claim 12, wherein the step of recognizing the face image from the entire image of the moving object comprises:
    识别所述运动物体的整体图像中的人脸;Identifying a face in the overall image of the moving object;
    获取所述人脸在所述整体图像中的坐标范围;Obtaining a coordinate range of the face in the overall image;
    截取所述坐标范围的图像。An image of the coordinate range is intercepted.
  14. 如权利要求9-13任一项所述的应用服务器,其特征在于,将所述人脸图像帧与服务器中的样本进行比对,以判断是否为有效图像,具体包括:The application server according to any one of claims 9 to 13, wherein the comparing the face image frame with the sample in the server to determine whether it is a valid image comprises:
    比对人脸图像帧与预先存储的该用户的样本图像的图片相似度,判断图片相似度是否大于预设的阈值。Comparing the face image frame with the pre-stored picture similarity of the sample image of the user, determining whether the picture similarity is greater than a preset threshold.
  15. 如权利要求14所述的应用服务器,其特征在于,该方法在身份识别通过,打开门禁之后,还包括步骤:The application server according to claim 14, wherein the method further comprises the following steps after the identity recognition is passed and the access control is opened:
    将所述有效图像对应的员工信息录入考勤服务器;Entering the employee information corresponding to the valid image into the attendance server;
    通过显示器显示员工的考勤信息。The employee's attendance information is displayed through the display.
  16. 如权利要求14所述的应用服务器,其特征在于,该方法在身份识别失败后,还包括步骤:The application server according to claim 14, wherein after the identity failure, the method further comprises the steps of:
    判断识别失败的次数是否达到预设的次数阈值;Determining whether the number of failed recognitions reaches a preset number of times threshold;
    若否,则提取至少一个摄像头采集的所述运动物体视频。If not, the video of the moving object collected by at least one camera is extracted.
    若是,则产生警报,以提示为非本公司员工。If yes, an alert is generated to alert the employee who is not a member of the company.
  17. 一种计算机可读存储介质,所述计算机可读存储介质存储有人脸识别系统,所述人脸识别系统可被至少一个处理器执行,以使所述至少一个处理器执行如下步骤:A computer readable storage medium storing a face recognition system, the face recognition system being executable by at least one processor to cause the at least one processor to perform the following steps:
    提取至少一个摄像头采集的运动物体视频;Extracting a video of a moving object collected by at least one camera;
    转换所述运动物体视频为人脸图像帧;Converting the moving object video into a face image frame;
    将所述人脸图像帧与服务器中的样本进行比对,以判断是否为有效图像;Comparing the face image frame with a sample in the server to determine whether it is a valid image;
    若是,则身份识别通过,打开门禁;及If yes, the identification is passed and the access control is opened; and
    若否,则身份识别失败。If no, the identification fails.
  18. 如权利要求17所述的计算机可读存储介质,其特征在于,所述提取至少一个摄像头采集的运动物体视频的步骤,具体包括:The computer readable storage medium according to claim 17, wherein the step of extracting the video of the moving object collected by the at least one camera comprises:
    检测在摄像头的监测范围内出现的运动物体;Detecting moving objects that appear within the monitoring range of the camera;
    获取摄像头采集的所述运动物体的视频。Obtaining a video of the moving object collected by the camera.
  19. 如权利要求17所述的计算机可读存储介质,其特征在于,转换所述 运动物体视频为人脸图像帧,具体包括:The computer readable storage medium according to claim 17, wherein the converting the moving object video to a face image frame comprises:
    将所述运动物体的视频转换成视频帧;Converting a video of the moving object into a video frame;
    识别所述视频帧中的人脸;Identifying a face in the video frame;
    获取所述人脸在所述视频帧中的坐标范围;Obtaining a coordinate range of the face in the video frame;
    截取所述坐标范围的图像。An image of the coordinate range is intercepted.
  20. 如权利要求17所述的计算机可读存储介质,其特征在于,所述提取至少一个摄像头采集的运动物体视频的步骤,具体包括:The computer readable storage medium according to claim 17, wherein the step of extracting the video of the moving object collected by the at least one camera comprises:
    检测在摄像头的监测范围内出现的运动物体;Detecting moving objects that appear within the monitoring range of the camera;
    判断所述摄像头是否定位到所述运动物体的人脸;Determining whether the camera is positioned to a face of the moving object;
    若是,则拍摄一张或者多张所述人脸图像;If yes, take one or more of the face images;
    若否,则获取摄像头采集的所述运动物体的整体视频;If not, acquiring an overall video of the moving object collected by the camera;
    所述转换所述运动物体视频为人脸图像帧的步骤,具体包括:The step of converting the video of the moving object into a face image frame includes:
    将所述运动物体的整体视频转换成所述运动物体的整体图像;Converting an overall video of the moving object into an overall image of the moving object;
    从所述运动物体的整体图像中识别出人脸图像。A face image is recognized from the entire image of the moving object.
PCT/CN2018/090908 2018-01-08 2018-06-12 Face recognition method, application server, and computer-readable storage medium WO2019134346A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810014831.2A CN108269333A (en) 2018-01-08 2018-01-08 Face identification method, application server and computer readable storage medium
CN201810014831.2 2018-01-08

Publications (1)

Publication Number Publication Date
WO2019134346A1 true WO2019134346A1 (en) 2019-07-11

Family

ID=62773203

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/090908 WO2019134346A1 (en) 2018-01-08 2018-06-12 Face recognition method, application server, and computer-readable storage medium

Country Status (2)

Country Link
CN (1) CN108269333A (en)
WO (1) WO2019134346A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111145413A (en) * 2019-12-26 2020-05-12 上海电气集团数字科技有限公司 Intelligent access control system and face recognition method thereof

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109241833A (en) * 2018-07-26 2019-01-18 高新兴科技集团股份有限公司 A kind of method and apparatus of orientation direction
CN109064601B (en) * 2018-07-30 2021-12-07 深圳招商建筑科技有限公司 Intelligent gate sentry robot implementation method
CN109326017B (en) * 2018-08-02 2021-08-17 平安科技(深圳)有限公司 Unmanned storehouse anti-theft method and device, computer equipment and storage medium
CN109325436A (en) * 2018-09-17 2019-02-12 王虹 Face identification system and server
CN109815810A (en) * 2018-12-20 2019-05-28 北京以萨技术股份有限公司 A kind of biopsy method based on single camera
CN109919003A (en) * 2019-01-23 2019-06-21 平安科技(深圳)有限公司 Face identification method, terminal device and computer readable storage medium
CN109829418B (en) * 2019-01-28 2021-01-05 北京影谱科技股份有限公司 Card punching method, device and system based on shadow features
CN109840565A (en) * 2019-01-31 2019-06-04 成都大学 A kind of blink detection method based on eye contour feature point aspect ratio
CN109948456B (en) * 2019-02-26 2020-12-18 北京华夏电通科技股份有限公司 Face recognition method and device applied to digital court
CN110032929A (en) * 2019-03-01 2019-07-19 广东天波信息技术股份有限公司 A kind of Work attendance method and device based on image recognition
CN110458062A (en) * 2019-07-30 2019-11-15 深圳市商汤科技有限公司 Face identification method and device, electronic equipment and storage medium
CN110689652A (en) * 2019-10-28 2020-01-14 上海云赛智联信息科技有限公司 Safety management system and method
CN111161458A (en) * 2019-12-13 2020-05-15 上海聪育智能科技有限公司 Teaching access control management system and method based on portrait recognition
CN113095347A (en) * 2020-01-09 2021-07-09 舜宇光学(浙江)研究院有限公司 Deep learning-based mark recognition method and training method, system and electronic equipment thereof
CN111695445A (en) * 2020-05-25 2020-09-22 深圳丽泽智能科技有限公司 Face recognition method, device, equipment and computer readable storage medium
CN112347832B (en) * 2020-06-12 2024-02-09 深圳Tcl新技术有限公司 Unlocking method, device, equipment and computer storage medium based on face recognition
CN111860357B (en) * 2020-07-23 2024-05-14 中国平安人寿保险股份有限公司 Attendance rate calculating method and device based on living body identification, terminal and storage medium
CN113129492A (en) * 2021-04-16 2021-07-16 腾讯科技(深圳)有限公司 Intelligent access control method and system
CN113239766A (en) * 2021-04-30 2021-08-10 复旦大学 Behavior recognition method based on deep neural network and intelligent alarm device
CN113359496A (en) * 2021-06-28 2021-09-07 平安普惠企业管理有限公司 Intelligent household data control method, device, equipment and storage medium
CN114202818A (en) * 2021-11-12 2022-03-18 珠海大横琴科技发展有限公司 Attendance card punching method and device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1971630A (en) * 2006-12-01 2007-05-30 浙江工业大学 Access control device and check on work attendance tool based on human face identification technique
CN202196458U (en) * 2011-08-24 2012-04-18 苏州飞锐智能科技有限公司 Face recognition system
CN104463117A (en) * 2014-12-02 2015-03-25 苏州科达科技股份有限公司 Sample collection method and system used for face recognition and based on video
KR20170067398A (en) * 2015-12-08 2017-06-16 단국대학교 천안캠퍼스 산학협력단 User interface control method and system using triangular mesh model according to the change in facial motion
CN107506747A (en) * 2017-09-11 2017-12-22 重庆大学 Face identification system and method based on video data characteristic point
CN107524389A (en) * 2017-08-19 2017-12-29 合肥智贤智能化科技有限公司 A kind of hommization highly effective and safe antitheft door

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100347058B1 (en) * 1998-11-18 2002-08-03 주식회사 신테크 Method for photographing and recognizing a face
KR20020032048A (en) * 2000-10-25 2002-05-03 이인동 Face cognition the preservation a means
CN101639891B (en) * 2008-07-28 2012-05-02 汉王科技股份有限公司 Double-camera face identification device and method
CN102332185A (en) * 2011-08-17 2012-01-25 中国铁道科学研究院电子计算技术研究所 L-type passage used for security inspection area face recognition
CN103226694B (en) * 2013-03-28 2016-06-22 赵福辉 A kind of portrait in real time obtains comparison and early warning cloth Ore-controlling Role and using method thereof
CN103606216A (en) * 2013-12-11 2014-02-26 周卫荣 School entrance guard system
CN104091176B (en) * 2014-07-18 2015-10-14 吴建忠 Portrait comparison application technology in video
CN104794459A (en) * 2015-05-07 2015-07-22 北京丰华联合科技有限公司 Video personnel identification method
CN106846578A (en) * 2017-01-20 2017-06-13 贵州财经大学 Face identification system and gate control system
CN107506983A (en) * 2017-08-31 2017-12-22 济南浪潮高新科技投资发展有限公司 A kind of attendance checking system and Work attendance method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1971630A (en) * 2006-12-01 2007-05-30 浙江工业大学 Access control device and check on work attendance tool based on human face identification technique
CN202196458U (en) * 2011-08-24 2012-04-18 苏州飞锐智能科技有限公司 Face recognition system
CN104463117A (en) * 2014-12-02 2015-03-25 苏州科达科技股份有限公司 Sample collection method and system used for face recognition and based on video
KR20170067398A (en) * 2015-12-08 2017-06-16 단국대학교 천안캠퍼스 산학협력단 User interface control method and system using triangular mesh model according to the change in facial motion
CN107524389A (en) * 2017-08-19 2017-12-29 合肥智贤智能化科技有限公司 A kind of hommization highly effective and safe antitheft door
CN107506747A (en) * 2017-09-11 2017-12-22 重庆大学 Face identification system and method based on video data characteristic point

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111145413A (en) * 2019-12-26 2020-05-12 上海电气集团数字科技有限公司 Intelligent access control system and face recognition method thereof

Also Published As

Publication number Publication date
CN108269333A (en) 2018-07-10

Similar Documents

Publication Publication Date Title
WO2019134346A1 (en) Face recognition method, application server, and computer-readable storage medium
CN107978044B (en) High-precision recognition system and recognition method based on face recognition technology and RFID technology
WO2019085403A1 (en) Intelligent face recognition comparison method, electronic device, and computer readable storage medium
WO2019091012A1 (en) Security check method based on facial recognition, application server, and computer readable storage medium
CN109285234B (en) Face recognition attendance checking method and device, computer device and storage medium
JP7359230B2 (en) Face matching system, face matching device, face matching method, and recording medium
WO2019033574A1 (en) Electronic device, dynamic video face recognition method and system, and storage medium
WO2018192448A1 (en) People-credentials comparison authentication method, system and camera
CN111931548B (en) Face recognition system, method for establishing face recognition data and face recognition method
WO2019200872A1 (en) Authentication method and apparatus, and electronic device, computer program, and storage medium
WO2019033575A1 (en) Electronic device, face tracking method and system, and storage medium
TWI798815B (en) Target re-identification method, device, and computer readable storage medium
CN110782228A (en) Working duration obtaining method and device, electronic equipment and storage medium
US9064172B2 (en) System and method for object detection
JP5618295B2 (en) Authentication system and authentication reliability determination method
CN110879986A (en) Face recognition method, apparatus and computer-readable storage medium
CN110929555B (en) Face recognition method and electronic device using same
KR20190047748A (en) Method for object of image and apparatus for the same
WO2020155486A1 (en) Facial recognition optimization method and apparatus, computer device and storage medium
CN108875553A (en) Method, apparatus, system and the computer storage medium that the testimony of a witness is veritified
CN112418063A (en) Face recognition method and device, electronic equipment and storage medium
CN114973135A (en) Head-shoulder-based sequential video sleep post identification method and system and electronic equipment
US20210374385A1 (en) System and method for face recognition
CN111368608B (en) Face recognition method, device and system
CN112686146A (en) Passenger flow analysis method, device and system based on facial feature recognition

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18898658

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12/10/2020)

122 Ep: pct application non-entry in european phase

Ref document number: 18898658

Country of ref document: EP

Kind code of ref document: A1