CN114298081A - Identification method, device, electronic device and storage medium for target behavior - Google Patents

Identification method, device, electronic device and storage medium for target behavior Download PDF

Info

Publication number
CN114298081A
CN114298081A CN202111149623.1A CN202111149623A CN114298081A CN 114298081 A CN114298081 A CN 114298081A CN 202111149623 A CN202111149623 A CN 202111149623A CN 114298081 A CN114298081 A CN 114298081A
Authority
CN
China
Prior art keywords
information
coordinate
identity
behavior
target behavior
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111149623.1A
Other languages
Chinese (zh)
Inventor
施利烽
刘建凯
杨勇
周兴晨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Dahua Technology Co Ltd
Original Assignee
Zhejiang Dahua Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Dahua Technology Co Ltd filed Critical Zhejiang Dahua Technology Co Ltd
Priority to CN202111149623.1A priority Critical patent/CN114298081A/en
Publication of CN114298081A publication Critical patent/CN114298081A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Image Analysis (AREA)

Abstract

The application relates to an identity recognition method, an identity recognition device, electronic equipment and a storage medium for target behaviors, wherein the method comprises the following steps: determining identity coordinate information according to all the face information acquired in the current personnel arrangement mode and target behavior information matched with each face information; the target behavior information comprises behavior coordinates under a camera coordinate system, and the identity coordinate information comprises identities and corresponding behavior coordinates of all personnel under the camera coordinate system; when a face image matched with the current target behavior cannot be identified, acquiring a coordinate position corresponding to the current target behavior in a camera coordinate system; and matching the coordinate position with the identity coordinate information to obtain identity information corresponding to the current target behavior. Through the method and the device, the data volume of the captured effective behaviors is improved, and the accuracy of the analysis result obtained by supporting the data is ensured.

Description

目标行为的身份识别方法、装置、电子设备和存储介质Identification method, device, electronic device and storage medium for target behavior

技术领域technical field

本申请涉及图像处理技术领域,特别是涉及一种目标行为的身份识别方法、装置、电子设备和存储介质。The present application relates to the technical field of image processing, and in particular, to an identification method, apparatus, electronic device and storage medium for target behavior.

背景技术Background technique

随着社会的进步,对用户身份识别的重视程度越来越高。但是在目前的人脸识别场景中,无法通过有效的数据作为支撑来表明识别结果精准度的高低。伴随着科技的发展,通过视频采集、人脸识别和行为识别的技术,可以采集到目标人员的目标行为,通过后台的图像识别,能够快速地判断出目标人员多个维度的信息,用于进行后续应用分析,如应用于安防、考勤和门锁领域。过程一般为:采集到目标人员行为信息以及对应的人脸信息,通过将人脸信息与库中预存的人脸图片做比对,确定行为信息对应的身份,最终保存到数据库中。With the progress of society, more and more attention is paid to user identification. However, in the current face recognition scene, it is impossible to use effective data as a support to indicate the accuracy of the recognition result. With the development of science and technology, through the technology of video collection, face recognition and behavior recognition, the target behavior of the target person can be collected. Follow-up application analysis, such as in the fields of security, attendance and door locks. The process is generally as follows: the behavior information of the target person and the corresponding face information are collected, and the identity corresponding to the behavior information is determined by comparing the face information with the pre-stored face pictures in the database, and finally saved in the database.

通过上述方式进行身份识别时,通过将采集到的人脸图像和设备上预存的人脸图像做比对,若比对成功则记录,比对不成功则舍弃。但是在通常情况下,很多时候会出现采集到行为数据,但是该条行为数据识别的人脸无效的情况,比如某一时间段目标人员低着头。在这种情况下,该条行为数据会丢失,导致采集得到的只是部分数据,最终以该部分数据做统计分析得出的结果精准度较低。When performing identification in the above manner, the collected face image is compared with the pre-stored face image on the device. If the comparison is successful, it will be recorded, and if the comparison is unsuccessful, it will be discarded. However, under normal circumstances, behavior data is collected in many cases, but the face identified by the behavior data is invalid, for example, the target person bows his head in a certain period of time. In this case, the behavior data will be lost, resulting in only part of the data collected, and the final result of statistical analysis with this part of the data is less accurate.

发明内容SUMMARY OF THE INVENTION

本申请实施例提供了一种目标行为的身份识别方法、装置、电子设备和存储介质,以至少解决相关技术中基于目标行为信息进行统计分析精准度低的问题。Embodiments of the present application provide an identification method, device, electronic device, and storage medium for target behavior, so as to at least solve the problem of low accuracy of statistical analysis based on target behavior information in the related art.

第一方面,本申请实施例提供了一种目标行为的身份识别方法,包括:In a first aspect, an embodiment of the present application provides a method for identifying a target behavior, including:

根据当前人员排布方式下采集到的所有人脸信息和各人脸信息匹配的目标行为信息,确定身份坐标信息;所述目标行为信息包括相机坐标系下的行为坐标,所述身份坐标信息包括相机坐标系下各个人员的身份和对应的行为坐标;The identity coordinate information is determined according to all the face information collected under the current personnel arrangement and the target behavior information matched with each face information; the target behavior information includes the behavior coordinates in the camera coordinate system, and the identity coordinate information includes The identity of each person in the camera coordinate system and the corresponding behavioral coordinates;

当存在当前目标行为匹配的人脸图像无法识别时,获取相机坐标系下所述当前目标行为对应的坐标位置;When there is a face image that matches the current target behavior and cannot be recognized, obtain the coordinate position corresponding to the current target behavior in the camera coordinate system;

将所述坐标位置与所述身份坐标信息进行匹配,得到所述当前目标行为对应的身份信息。Matching the coordinate position with the identity coordinate information to obtain identity information corresponding to the current target behavior.

在其中一些实施例中,根据当前人员排布方式下采集到的所有人脸信息和各人脸信息匹配的目标行为信息,确定身份坐标信息包括:In some of these embodiments, according to all the face information collected under the current personnel arrangement and the target behavior information matched with each face information, determining the identity coordinate information includes:

获取当前人员排布方式下的人脸信息,并识别所述人脸信息得到身份信息;Obtain face information in the current personnel arrangement, and identify the face information to obtain identity information;

基于人脸信息匹配的目标行为信息,确定所述人脸信息对应的多个潜在位置坐标;Determine a plurality of potential position coordinates corresponding to the face information based on the target behavior information matched by the face information;

基于所述身份信息和多个所述潜在位置坐标,确定对应所述身份信息的身份坐标信息。Based on the identity information and a plurality of the potential location coordinates, the identity coordinate information corresponding to the identity information is determined.

在其中一些实施例中,基于所述身份信息和多个所述潜在位置坐标,确定对应所述身份信息的身份坐标信息包括:In some of the embodiments, determining the identity coordinate information corresponding to the identity information based on the identity information and a plurality of the potential location coordinates includes:

基于多个所述潜在位置坐标,确定坐标框;determining a coordinate frame based on a plurality of the potential location coordinates;

基于身份信息和所述坐标框所在的坐标区间,确定对应所述身份信息的身份坐标信息。Based on the identity information and the coordinate interval in which the coordinate frame is located, the identity coordinate information corresponding to the identity information is determined.

在其中一些实施例中,基于多个所述潜在位置坐标,确定坐标框包括:In some of these embodiments, determining a coordinate frame based on a plurality of the potential location coordinates includes:

基于多个所述潜在位置坐标确定至少两个第一边界坐标;determining at least two first boundary coordinates based on a plurality of said potential location coordinates;

基于预设偏移值对所述第一边界坐标进行校准,得到对应的第二边界坐标;The first boundary coordinate is calibrated based on the preset offset value to obtain the corresponding second boundary coordinate;

基于所述第二边界坐标划定坐标框。A coordinate box is delineated based on the second boundary coordinates.

在其中一些实施例中,获取相机坐标系下所述当前目标行为对应的坐标位置包括:In some of the embodiments, acquiring the coordinate position corresponding to the current target behavior in the camera coordinate system includes:

获取当前目标行为对应的目标行为信息;Obtain the target behavior information corresponding to the current target behavior;

将所述目标行为信息输入训练好的坐标检测模型,得到与所述人脸图像匹配的当前目标行为对应的坐标位置。The target behavior information is input into the trained coordinate detection model to obtain the coordinate position corresponding to the current target behavior matched with the face image.

在其中一些实施例中,将所述坐标位置与所述身份坐标信息进行匹配,得到所述当前目标行为对应的身份信息包括:In some of the embodiments, matching the coordinate position with the identity coordinate information to obtain the identity information corresponding to the current target behavior includes:

将所述坐标位置与所述身份坐标信息对应的行为坐标进行匹配;matching the coordinate position with the behavior coordinate corresponding to the identity coordinate information;

当所述坐标位置与所述行为坐标匹配时,将所述行为坐标对应的身份信息确定为所述目标行为信息对应的身份信息。When the coordinate position matches the behavior coordinate, the identity information corresponding to the behavior coordinate is determined as the identity information corresponding to the target behavior information.

在其中一些实施例中,所述目标行为信息还包括以下至少之一:In some of these embodiments, the target behavior information further includes at least one of the following:

行为图片、行为标识、行为类型、行为发生时间。Behavior picture, behavior identification, behavior type, behavior occurrence time.

第二方面,本申请实施例提供了一种目标行为身份识别装置,包括:In a second aspect, an embodiment of the present application provides a target behavior identification device, including:

身份坐标信息确定单元,用于根据当前人员排布方式下采集到的所有人脸信息和各人脸信息匹配的目标行为信息,确定身份坐标信息;所述目标行为信息包括相机坐标系下的行为坐标,所述身份坐标信息包括相机坐标系下各个人员的身份和对应的行为坐标;The identity coordinate information determination unit is used to determine the identity coordinate information according to all the face information collected under the current personnel arrangement and the target behavior information matched with each face information; the target behavior information includes the behavior in the camera coordinate system Coordinates, the identity coordinate information includes the identity of each person in the camera coordinate system and the corresponding behavior coordinates;

坐标位置获取单元,用于当存在当前目标行为匹配的人脸图像无法识别时,获取相机坐标系下所述当前目标行为对应的坐标位置;a coordinate position obtaining unit, used for obtaining the coordinate position corresponding to the current target behavior in the camera coordinate system when there is a face image that matches the current target behavior and cannot be recognized;

身份信息识别单元,用于将所述坐标位置与所述身份坐标信息进行匹配,得到所述当前目标行为对应的身份信息。An identity information identification unit, configured to match the coordinate position with the identity coordinate information to obtain identity information corresponding to the current target behavior.

第三方面,本申请实施例提供了一种电子设备,包括存储器、处理器以及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如上述第一方面所述的目标行为的身份识别方法。In a third aspect, an embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, when the processor executes the computer program An identification method for realizing the target behavior described in the first aspect above.

第四方面,本申请实施例提供了一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现如上述第一方面所述的目标行为的身份识别方法。In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, implements the identification method for the target behavior described in the first aspect above.

相比于相关技术,本申请实施例提供的目标行为的身份识别方法,通过根据当前人员排布方式下采集到的所有人脸信息和各人脸信息匹配的目标行为信息确定身份坐标信息,利用了当前人员排布方式下收集的数据确定身份坐标信息,最大限度地挖掘了现有数据的潜在价值。通过当存在当前目标行为匹配的人脸图像无法识别时,获取相机坐标系下所述当前目标行为对应的坐标位置;将所述坐标位置与所述身份坐标信息进行匹配,得到所述当前目标行为对应的身份信息。通过利用身份坐标信息对人脸信息对应的目标行为信息进行匹配,得到对应的身份信息,显著提高了目标行为信息的身份识别率,提高了捕捉到的有效行为的数据量,确保了以该数据做支撑所得出的分析结果的精准度。Compared with the related art, the method for identifying the target behavior provided by the embodiment of the present application determines the identity coordinate information according to all the face information collected under the current personnel arrangement and the target behavior information matched with the face information, and uses The data collected under the current personnel arrangement is used to determine the identity coordinate information, and the potential value of the existing data is maximized. By obtaining the coordinate position corresponding to the current target behavior in the camera coordinate system when there is a face image matching the current target behavior that cannot be recognized; and matching the coordinate position with the identity coordinate information to obtain the current target behavior corresponding identity information. By using the identity coordinate information to match the target behavior information corresponding to the face information, the corresponding identity information is obtained, which significantly improves the identification rate of the target behavior information, increases the amount of data of the captured effective behavior, and ensures that the data The accuracy of the analytical results obtained by doing the support.

本申请的一个或多个实施例的细节在以下附图和描述中提出,以使本申请的其他特征、目的和优点更加简明易懂。The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below in order to make other features, objects and advantages of the application more apparent.

附图说明Description of drawings

此处所说明的附图用来提供对本申请的进一步理解,构成本申请的一部分,本申请的示意性实施例及其说明用于解释本申请,并不构成对本申请的不当限定。在附图中:The drawings described herein are used to provide further understanding of the present application and constitute a part of the present application. The schematic embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation of the present application. In the attached image:

图1是本申请其中一个实施例中目标行为的身份识别方法的流程示意图;1 is a schematic flowchart of an identification method for target behavior in one of the embodiments of the present application;

图2是本申请其中一个实施例中确定身份坐标信息的流程示意图;2 is a schematic flowchart of determining identity coordinate information in one of the embodiments of the present application;

图3是本申请其中一个实施例中确定对应所述身份信息的身份坐标信息的流程示意图;3 is a schematic flowchart of determining the identity coordinate information corresponding to the identity information in one of the embodiments of the present application;

图4是本申请其中一个实施例中目标行为的身份识别装置的结构框图;4 is a structural block diagram of an identification device for target behavior in one of the embodiments of the present application;

图5是本申请其中一个实施例中电子设备的结构示意图。FIG. 5 is a schematic structural diagram of an electronic device in one embodiment of the present application.

附图说明:201、身份坐标信息确定单元;202、坐标位置获取单元;203、身份信息识别单元;30、总线;31、处理器;32、存储器;33、通信接口。Description of the drawings: 201, an identity coordinate information determination unit; 202, a coordinate position acquisition unit; 203, an identity information identification unit; 30, a bus; 31, a processor; 32, a memory; 33, a communication interface.

具体实施方式Detailed ways

为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行描述和说明。应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。基于本申请提供的实施例,本领域普通技术人员在没有作出创造性劳动的前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be described and illustrated below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. Based on the embodiments provided in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

显而易见地,下面描述中的附图仅仅是本申请的一些示例或实施例,对于本领域的普通技术人员而言,在不付出创造性劳动的前提下,还可以根据这些附图将本申请应用于其他类似情景。此外,还可以理解的是,虽然这种开发过程中所作出的努力可能是复杂并且冗长的,然而对于与本申请公开的内容相关的本领域的普通技术人员而言,在本申请揭露的技术内容的基础上进行的一些设计,制造或者生产等变更只是常规的技术手段,不应当理解为本申请公开的内容不充分。Obviously, the accompanying drawings in the following description are only some examples or embodiments of the present application. For those of ordinary skill in the art, the present application can also be applied to the present application according to these drawings without any creative effort. other similar situations. In addition, it will also be appreciated that while such development efforts may be complex and lengthy, for those of ordinary skill in the art to which the present disclosure pertains, the techniques disclosed in this application Some changes in design, manufacture or production based on the content are only conventional technical means, and it should not be understood that the content disclosed in this application is not sufficient.

在本申请中提及“实施例”意味着,结合实施例描述的特定特征、结构或特性可以包含在本申请的至少一个实施例中。在说明书中的各个位置出现该短语并不一定均是指相同的实施例,也不是与其它实施例互斥的独立的或备选的实施例。本领域普通技术人员显式地和隐式地理解的是,本申请所描述的实施例在不冲突的情况下,可以与其它实施例相结合。Reference in this application to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor a separate or alternative embodiment that is mutually exclusive of other embodiments. It is explicitly and implicitly understood by those of ordinary skill in the art that the embodiments described in this application may be combined with other embodiments without conflict.

除非另作定义,本申请所涉及的技术术语或者科学术语应当为本申请所属技术领域内具有一般技能的人士所理解的通常意义。本申请所涉及的“一”、“一个”、“一种”、“该”等类似词语并不表示数量限制,可表示单数或复数。本申请所涉及的术语“包括”、“包含”、“具有”以及它们任何变形,意图在于覆盖不排他的包含;例如包含了一系列步骤或模块(单元)的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元,而是可以还包括没有列出的步骤或单元,或可以还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。本申请所涉及的“连接”、“相连”、“耦接”等类似的词语并非限定于物理的或者机械的连接,而是可以包括电气的连接,不管是直接的还是间接的。本申请所涉及的“多个”是指两个或两个以上。“和/或”描述关联对象的关联关系,表示可以存在三种关系,例如,“A和/或B”可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。本申请所涉及的术语“第一”、“第二”、“第三”等仅仅是区别类似的对象,不代表针对对象的特定排序。Unless otherwise defined, the technical or scientific terms involved in this application shall have the usual meanings understood by those with ordinary skill in the technical field to which this application belongs. Words such as "a", "an", "an", "the" and the like mentioned in this application do not denote a quantitative limitation, and may denote the singular or the plural. The terms "comprising", "comprising", "having" and any of their variants referred to in this application are intended to cover non-exclusive inclusion; for example, a process, method, system, product or process comprising a series of steps or modules (units) The apparatus is not limited to the steps or units listed, but may further include steps or units not listed, or may further include other steps or units inherent to the process, method, product or apparatus. Words like "connected," "connected," "coupled," and the like referred to in this application are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The "plurality" referred to in this application refers to two or more. "And/or" describes the association relationship between associated objects, indicating that there can be three kinds of relationships. For example, "A and/or B" can mean that A exists alone, A and B exist at the same time, and B exists alone. The character "/" generally indicates that the associated objects are an "or" relationship. The terms "first", "second", "third", etc. involved in this application are only to distinguish similar objects, and do not represent a specific order for the objects.

本申请中描述的目标行为的身份识别方法可以应用于各种形式的应用场景中,包括但不限于考勤类、行政管理类以及表演类等,本申请在此不做具体限定。The target behavior identification method described in this application can be applied to various application scenarios, including but not limited to attendance, administration, and performance, which are not specifically limited in this application.

本实施例提供了一种目标行为的身份识别方法。图1是根据本申请实施例的目标行为的身份识别方法的流程图,如图1所示,该流程包括如下步骤:This embodiment provides an identification method for target behavior. FIG. 1 is a flowchart of a method for identifying a target behavior according to an embodiment of the present application. As shown in FIG. 1 , the flowchart includes the following steps:

步骤S11,根据当前人员排布方式下采集到的所有人脸信息和各人脸信息匹配的目标行为信息,确定身份坐标信息;所述目标行为信息包括相机坐标系下的行为坐标,所述身份坐标信息包括相机坐标系下各个人员的身份和对应的行为坐标。Step S11: Determine identity coordinate information according to all face information collected under the current personnel arrangement and target behavior information matched with each face information; the target behavior information includes behavior coordinates in the camera coordinate system, and the identity The coordinate information includes the identity of each person in the camera coordinate system and the corresponding behavioral coordinates.

通常,在固定的人员排布方式下,同一个人在同一个空间下的位置不会有大幅变动,因此人员的目标行为有相对固定的活动范围。为了最大限度地挖掘了现有数据的潜在价值,可以对当前的人员排布方式下的人脸信息和匹配的目标行为信息进行采集,以确定身份坐标信息。其中,所述当前人员排布方式可以是人员排布的固定位置,如座位、队形等;身份坐标信息包括各个人员的身份和对应的坐标信息,通过将身份与对应的坐标信息进行绑定,可作为后续目标行为的身份识别依据。Usually, under the fixed arrangement of personnel, the position of the same person in the same space will not change significantly, so the target behavior of personnel has a relatively fixed range of activities. In order to maximize the potential value of existing data, the face information and matching target behavior information under the current personnel arrangement can be collected to determine the identity coordinate information. The current personnel arrangement may be a fixed position of personnel arrangement, such as seats, formations, etc.; the identity coordinate information includes the identity of each person and the corresponding coordinate information, and the identity and the corresponding coordinate information are bound by binding the identity and the corresponding coordinate information. , which can be used as the identification basis for subsequent target behaviors.

在本实施例中,当采集到人脸信息后,可以通过图像识别技术获取对应的身份信息。同时,获取与所述人脸信息匹配的目标行为信息,目标行为信息包括相机坐标系下的行为坐标,行为坐标可以是人员对应的预设关键点(如头部、嘴巴等)所在坐标,或多个预设关键点(如左右手腕等)对应的所有坐标或坐标均值,可进行自定义配置,本申请在此不做限定。可选地,目标行为信息还包括以下至少之一:行为图片、行为标识(如坐、站立、抬手等)、行为类型 (如姿势、面部朝向等)、行为发生时间等,通过对多维度的行为信息进行识别记录,便于对目标行为进行信息追溯。In this embodiment, after the face information is collected, the corresponding identity information can be obtained through an image recognition technology. At the same time, obtain the target behavior information matching the face information, the target behavior information includes the behavior coordinates in the camera coordinate system, and the behavior coordinates may be the coordinates of the preset key points (such as head, mouth, etc.) corresponding to the person, or All coordinates or coordinate mean values corresponding to multiple preset key points (such as left and right wrists, etc.) can be customized and configured, which is not limited in this application. Optionally, the target behavior information also includes at least one of the following: behavior pictures, behavior signs (such as sitting, standing, raising hands, etc.), behavior types (such as posture, face orientation, etc.), behavior occurrence time, etc. The behavior information is identified and recorded, which is convenient for information traceability of the target behavior.

步骤S12,当存在当前目标行为匹配的人脸图像无法识别时,获取相机坐标系下所述当前目标行为对应的坐标位置。Step S12, when there is a face image that matches the current target behavior and cannot be recognized, obtain the coordinate position corresponding to the current target behavior in the camera coordinate system.

相关技术中,对目标行为信息进行身份识别时,往往出现人脸识别无法得到有效身份的情况(如目标人员低头、侧头或背对摄像头时),使得采集得到的目标行为信息无效。In the related art, when identifying the target behavior information, it often happens that the face recognition cannot obtain an effective identity (for example, when the target person bows his head, turns his head sideways, or turns his back to the camera), so that the collected target behavior information is invalid.

在本实施例中,当存在当前目标行为匹配的人脸图像无法识别时,同样将其作为有效数据并获取相机坐标系下对应的坐标位置。具体的,建立相机采集画面所在的相机坐标系,通过识别分析相机采集的目标图片中的数据信息得到目标行为信息对应的坐标位置。在一些实施例中,坐标位置可以是对应相机坐标系下的行为坐标,从而与身份坐标信息保持一致,以便于与身份坐标信息进行匹配;在另一些实施例中,所述坐标位置也可以是基于当前目标行为得到的其他自定义位置信息,只要能实现与身份坐标信息的匹配对应即可,本申请在此不做限定。In this embodiment, when there is a face image that matches the current target behavior and cannot be recognized, it is also used as valid data and the corresponding coordinate position in the camera coordinate system is obtained. Specifically, a camera coordinate system where the image captured by the camera is located is established, and the coordinate position corresponding to the target behavior information is obtained by identifying and analyzing the data information in the target image captured by the camera. In some embodiments, the coordinate position may be the action coordinate in the corresponding camera coordinate system, so as to be consistent with the identity coordinate information, so as to facilitate matching with the identity coordinate information; in other embodiments, the coordinate position may also be Other self-defined location information obtained based on the current target behavior, as long as it can be matched with the identity coordinate information, is not limited in this application.

步骤S13,将所述坐标位置与所述身份坐标信息进行匹配,得到所述当前目标行为对应的身份信息。Step S13: Match the coordinate position with the identity coordinate information to obtain identity information corresponding to the current target behavior.

具体的,在本实施例中,将所述坐标位置与所述身份坐标信息中的行为坐标进行坐标匹配,将匹配一致时的行为坐标对应的身份信息,确定为所述当前目标行为对应的身份信息。其中,匹配方式可以是坐标完全一致、部分一致或当前目标行为对应的坐标位置落入行为坐标所在坐标区间内,本申请不做具体限定。Specifically, in this embodiment, coordinate matching is performed between the coordinate position and the behavior coordinate in the identity coordinate information, and the identity information corresponding to the behavior coordinate when the matching is consistent is determined as the identity corresponding to the current target behavior information. The matching method may be that the coordinates are completely consistent, partially consistent, or that the coordinate position corresponding to the current target behavior falls within the coordinate range where the behavior coordinates are located, which is not specifically limited in this application.

下面通过优选实施例对本申请实施例进行描述和说明。The embodiments of the present application will be described and illustrated below through preferred embodiments.

综上,本申请实施例提供的目标行为的身份识别方法,通过根据当前人员排布方式下采集到的所有人脸信息和各人脸信息匹配的目标行为信息,确定身份坐标信息,所述身份坐标信息包括相机坐标系下各个人员的身份和对应的坐标信息,利用了当前人员排布方式下收集的数据确定身份坐标信息,最大限度地挖掘了现有数据的潜在价值。通过当存在当前目标行为匹配的人脸图像无法识别时,获取相机坐标系下所述当前目标行为对应的坐标位置;将所述坐标位置与所述身份坐标信息进行匹配,得到所述当前目标行为对应的身份信息。通过利用身份坐标信息对人脸信息对应的目标行为信息进行匹配,得到对应的身份信息,显著提高了目标行为信息的身份识别率,提高了捕捉到的有效行为的数据量,确保了以该数据做支撑所得出的分析结果的精准度。To sum up, the method for identifying the target behavior provided by the embodiment of the present application determines the coordinate information of the identity by determining the coordinate information of the identity according to all the face information collected under the current personnel arrangement and the information of the target behavior matched with the information of each face. The coordinate information includes the identity of each person in the camera coordinate system and the corresponding coordinate information. The data collected under the current personnel arrangement is used to determine the identity coordinate information, which maximizes the potential value of the existing data. By obtaining the coordinate position corresponding to the current target behavior in the camera coordinate system when there is a face image matching the current target behavior that cannot be recognized; and matching the coordinate position with the identity coordinate information to obtain the current target behavior corresponding identity information. By using the identity coordinate information to match the target behavior information corresponding to the face information, the corresponding identity information is obtained, which significantly improves the identification rate of the target behavior information, increases the amount of data of the captured effective behavior, and ensures that the data The accuracy of the analytical results obtained by doing the support.

如图2所示,在上述实施例的基础上,在其中一些实施例中,根据当前人员排布方式下采集到的所有人脸信息和各人脸信息匹配的目标行为信息,确定身份坐标信息包括:As shown in FIG. 2 , on the basis of the above-mentioned embodiments, in some of the embodiments, the identity coordinate information is determined according to all the face information collected under the current personnel arrangement and the target behavior information matched with each face information. include:

步骤S111,获取当前人员排布方式下的人脸信息,并识别所述人脸信息得到身份信息。具体的,可采用基于人脸特征点的识别算法、基于整幅人脸图像的识别算法、基于模板的识别算法、利用神经网络进行识别的算法等进行人脸信息识别。人脸识别算法为通用算法,本申请不对其进行详细的说明及限定。Step S111: Acquire face information in the current personnel arrangement, and identify the face information to obtain identity information. Specifically, a recognition algorithm based on facial feature points, a recognition algorithm based on an entire face image, a recognition algorithm based on a template, an algorithm for recognition using a neural network, etc. can be used for facial information recognition. The face recognition algorithm is a general algorithm, which is not described or limited in detail in this application.

步骤S112,基于人脸信息匹配的目标行为信息,确定所述人脸信息对应的多个潜在位置坐标。具体的,在身份坐标信息的确定后,在所述当前人员排布方式下,每个个体对应的位置坐标难免在一定范围内小幅度变动。因此,为了使识别方法适应人员的微弱移动,对于可以识别出身份信息的人脸信息,可以进一步基于该人脸信息匹配的目标行为信息得到多个潜在位置坐标。其中,潜在位置坐标为同一人脸信息对应的某一目标行为的行为坐标,不同潜在位置坐标的选取和计算方式相同。Step S112: Determine a plurality of potential position coordinates corresponding to the face information based on the target behavior information matched with the face information. Specifically, after the identity coordinate information is determined, under the current arrangement of personnel, the location coordinates corresponding to each individual will inevitably change slightly within a certain range. Therefore, in order to adapt the identification method to the weak movement of the person, for the face information for which the identity information can be identified, a plurality of potential position coordinates can be further obtained based on the target behavior information matched with the face information. Among them, the potential position coordinates are the behavior coordinates of a certain target behavior corresponding to the same face information, and the selection and calculation methods of different potential position coordinates are the same.

步骤S113,基于所述身份信息和多个所述潜在位置坐标,确定对应所述身份信息的身份坐标信息。Step S113: Determine identity coordinate information corresponding to the identity information based on the identity information and a plurality of the potential position coordinates.

具体的,在本实施例中,首先可以基于多个所述潜在位置坐标,计算得到当前目标行为对应的行为坐标。具体计算方法可以直接取多个所述潜在位置坐标的均值得到行为坐标,也可以基于多个所述潜在位置坐标进行进一步数据筛选后计算行为坐标,本实施例在此不做限定。然后基于身份信息和当前目标行为对应的行为坐标,确定身份坐标信息。Specifically, in this embodiment, the behavior coordinates corresponding to the current target behavior may be calculated based on a plurality of the potential position coordinates. The specific calculation method may directly take the mean value of a plurality of the potential position coordinates to obtain the behavior coordinates, or may perform further data screening based on the multiple potential position coordinates to calculate the behavior coordinates, which is not limited in this embodiment. Then, based on the identity information and the behavior coordinates corresponding to the current target behavior, the identity coordinate information is determined.

如图3所示,在上述实施例的基础上,在其中一些实施例中,基于所述身份信息和多个所述潜在位置坐标,确定对应所述身份信息的身份坐标信息包括:As shown in FIG. 3, on the basis of the foregoing embodiments, in some of the embodiments, based on the identity information and a plurality of the potential location coordinates, determining the identity coordinate information corresponding to the identity information includes:

步骤S1131,基于多个所述潜在位置坐标,确定坐标框。Step S1131, determining a coordinate frame based on a plurality of the potential position coordinates.

在本实施例中,基于多个所述潜在位置坐标,可以得到行为坐标所在的坐标区间。具体的,首先基于多个所述潜在位置坐标确定第一边界坐标。根据至少两个所述第一边界坐标可以得到一个坐标区间(P1[x1,y1],P2[x2,y2]),以囊括所有的潜在位置坐标。在一些实施例中,根据两个第一边界坐标即可确定坐标框;在另一些实施例中,从三个或四个第一边界坐标中分别取X向和Y向的最大和最小轴向坐标值,得到对应的坐标区间。例如:当多个所述潜在位置为 (A1[1,0.5]、A2[2,4]、A3[3,2]、A4[4,3])时,则根据A1[1,0.5]、A2[2,4]和A4[4,3] 即可确定坐标框,从三个或四个第一边界坐标中分别取X向和Y向的最大和最小轴向坐标值,得到对应的坐标区间(P1[1,4],P2[4,0.5])。In this embodiment, based on a plurality of the potential position coordinates, the coordinate interval in which the behavior coordinates are located can be obtained. Specifically, firstly, first boundary coordinates are determined based on a plurality of the potential position coordinates. A coordinate interval (P1[x1,y1], P2[x2,y2]) can be obtained according to at least two of the first boundary coordinates, so as to include all potential position coordinates. In some embodiments, the coordinate frame can be determined according to the two first boundary coordinates; in other embodiments, the maximum and minimum axial directions of the X and Y directions are respectively taken from the three or four first boundary coordinates. Coordinate value to get the corresponding coordinate interval. For example: when the multiple potential positions are (A1[1,0.5], A2[2,4], A3[3,2], A4[4,3]), then according to A1[1,0.5], A2[2,4] and A4[4,3] can determine the coordinate frame, and take the maximum and minimum axial coordinate values in the X and Y directions from the three or four first boundary coordinates, respectively, to obtain the corresponding coordinates interval(P1[1,4], P2[4,0.5]).

然后基于预设偏移值对所述第一边界坐标进行校准,得到对应的第二边界坐标,基于所述第二边界坐标划定坐标框。由于基于第一边界坐标划定的坐标区间较粗糙,需要进行偏移处理,来进一步精确坐标区间的范围,保证识别结果的准确度。具体的,在一些实施例中,偏移值取1/4-1/8倍坐标区间的区间宽度时,精准度最高。示例性地,将坐标区间(P1[x1,y1],P2[x2,y2])中x1向右平移(x2-x1)/8,x2向左平移(x2-x1)/8,y1向下平移(y2-y1)/8,y2向上平移(y2-y1)/8。最终坐标区间优化为(P1[x1+(x2-x1)/8,y1+(y2-y1)/8],P2[x2-(x2-x1)/8, y2-(y2-y1)/8])。其中偏移值可自定义配置,偏移值的大小取决于当前人员排布方式下的人员分布情况。Then, the first boundary coordinates are calibrated based on the preset offset value to obtain corresponding second boundary coordinates, and a coordinate frame is delineated based on the second boundary coordinates. Since the coordinate interval delimited based on the first boundary coordinates is relatively rough, an offset process needs to be performed to further refine the range of the coordinate interval and ensure the accuracy of the recognition result. Specifically, in some embodiments, when the offset value takes the interval width of 1/4-1/8 times the coordinate interval, the accuracy is the highest. Exemplarily, in the coordinate interval (P1[x1,y1], P2[x2,y2]), x1 is translated to the right by (x2-x1)/8, x2 is translated to the left by (x2-x1)/8, and y1 is down Translate (y2-y1)/8, y2 translates up (y2-y1)/8. The final coordinate interval is optimized to (P1[x1+(x2-x1)/8, y1+(y2-y1)/8], P2[x2-(x2-x1)/8, y2-(y2-y1)/8]) . The offset value can be customized and configured, and the size of the offset value depends on the distribution of personnel under the current personnel arrangement.

步骤S1132,基于身份信息和所述坐标框所在的坐标区间,确定对应所述身份信息的身份坐标信息。Step S1132: Determine the identity coordinate information corresponding to the identity information based on the identity information and the coordinate interval in which the coordinate frame is located.

在本实施例中,将所述坐标框所在的坐标区间确定为目标行为信息在相机坐标系下的行为坐标,将其与目标行为信息对应的身份信息进行绑定,得到身份坐标信息。In this embodiment, the coordinate interval in which the coordinate frame is located is determined as the behavior coordinate of the target behavior information in the camera coordinate system, and is bound with the identity information corresponding to the target behavior information to obtain the identity coordinate information.

通过上述步骤,通过基于多个所述潜在位置坐标确定坐标框,将坐标框所在的坐标区间作为目标行为信息在相机坐标系下的行为坐标,并将其与目标行为信息对应的身份信息进行绑定,可以适应人员的微弱移动,提高目标行为信息的身份识别率。Through the above steps, a coordinate frame is determined based on a plurality of the potential position coordinates, the coordinate interval where the coordinate frame is located is taken as the behavior coordinate of the target behavior information in the camera coordinate system, and it is bound with the identity information corresponding to the target behavior information. It can adapt to the weak movement of people and improve the identification rate of target behavior information.

在上述实施例的基础上,在其中一些实施例中,获取相机坐标系下所述当前目标行为对应的坐标位置包括:On the basis of the foregoing embodiments, in some of the embodiments, acquiring the coordinate position corresponding to the current target behavior in the camera coordinate system includes:

获取当前目标行为对应的目标行为信息,将所述目标行为信息输入训练好的坐标检测模型,得到与所述人脸图像匹配的当前目标行为对应的坐标位置。Obtain target behavior information corresponding to the current target behavior, input the target behavior information into the trained coordinate detection model, and obtain the coordinate position corresponding to the current target behavior matched with the face image.

在本实施例中,目标行为信息对应的坐标位置可以通过训练好的坐标检测模型进行识别得到。其中,可通过建立包含目标行为信息对应坐标位置标签的视频图像训练样本集,用该训练样本集对预设检测模型进行训练得到坐标检测模型,该预设检测模型为OpenPose、Detectron或AlphaPose模型等开源模型。In this embodiment, the coordinate position corresponding to the target behavior information can be identified through a trained coordinate detection model. Among them, the coordinate detection model can be obtained by establishing a video image training sample set containing the coordinate position labels corresponding to the target behavior information, and using the training sample set to train a preset detection model, and the preset detection model is an OpenPose, Detectron or AlphaPose model, etc. Open source model.

需要说明的是,在上述流程中或者附图的流程图中示出的步骤可以在诸如一组计算机可执行指令的计算机系统中执行,并且,虽然在流程图中示出了逻辑顺序,但是在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤。It should be noted that the steps shown in the above flow or the flow chart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical sequence is shown in the flow chart, in the In some cases, steps shown or described may be performed in an order different from that herein.

本实施例还提供了一种目标行为身份识别装置,该装置用于实现上述实施例及优选实施方式,已经进行过说明的不再赘述。如以下所使用的,术语“模块”、“单元”、“子单元”等可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。This embodiment also provides a target behavior identification device, which is used to implement the above embodiments and preferred implementations, and what has been described will not be repeated. As used below, the terms "module," "unit," "subunit," etc. may be a combination of software and/or hardware that implements a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, implementations in hardware, or a combination of software and hardware, are also possible and contemplated.

图4是根据本申请实施例的目标行为身份识别装置的结构框图,如图4所示,该装置包括:身份坐标信息确定单元201、坐标位置获取单元202和身份信息识别单元203。4 is a structural block diagram of a target behavior identification device according to an embodiment of the present application, as shown in FIG.

身份坐标信息确定单元201,用于根据当前人员排布方式下采集到的所有人脸信息和各人脸信息匹配的目标行为信息,确定身份坐标信息;所述目标行为信息包括相机坐标系下的行为坐标,所述身份坐标信息包括相机坐标系下各个人员的身份和对应的行为坐标;The identity coordinate information determination unit 201 is used to determine the identity coordinate information according to all the face information collected under the current personnel arrangement and the target behavior information matched with each face information; the target behavior information includes the camera coordinate system. Behavior coordinates, the identity coordinate information includes the identity of each person in the camera coordinate system and the corresponding behavior coordinates;

坐标位置获取单元202,用于当存在当前目标行为匹配的人脸图像无法识别时,获取相机坐标系下所述当前目标行为对应的坐标位置;The coordinate position obtaining unit 202 is used to obtain the coordinate position corresponding to the current target behavior under the camera coordinate system when there is a face image that matches the current target behavior and cannot be recognized;

身份信息识别单元203,用于将所述坐标位置与所述身份坐标信息进行匹配,得到所述当前目标行为对应的身份信息。The identity information identification unit 203 is configured to match the coordinate position with the identity coordinate information to obtain identity information corresponding to the current target behavior.

在其中一些实施例中,所述目标行为信息还包括以下至少之一:In some of these embodiments, the target behavior information further includes at least one of the following:

行为图片、行为标识、行为类型、行为发生时间。Behavior picture, behavior identification, behavior type, behavior occurrence time.

在其中一些实施例中,身份坐标信息确定单元201包括:身份信息获取模块、潜在位置坐标获取模块和身份坐标获取模块。In some of these embodiments, the identity coordinate information determination unit 201 includes: an identity information acquisition module, a potential location coordinate acquisition module, and an identity coordinate acquisition module.

身份信息获取模块,用于获取当前人员排布方式下的人脸信息,并识别所述人脸信息得到身份信息;The identity information acquisition module is used to acquire the face information under the current personnel arrangement, and identify the face information to obtain the identity information;

潜在位置坐标获取模块,用于基于人脸信息匹配的目标行为信息,确定所述人脸信息对应的多个潜在位置坐标;A potential position coordinate acquisition module, configured to determine a plurality of potential position coordinates corresponding to the face information based on the target behavior information matched with the face information;

身份坐标获取模块,用于基于所述身份信息和多个所述潜在位置坐标,确定对应所述身份信息的身份坐标信息。An identity coordinate acquisition module, configured to determine identity coordinate information corresponding to the identity information based on the identity information and a plurality of the potential position coordinates.

在其中一些实施例中,身份坐标获取模块包括:坐标框确定模块和身份坐标确定模块。In some of the embodiments, the identity coordinate acquisition module includes: a coordinate frame determination module and an identity coordinate determination module.

坐标框确定模块,用于基于多个所述潜在位置坐标,确定坐标框;a coordinate frame determination module, configured to determine a coordinate frame based on a plurality of the potential position coordinates;

身份坐标确定模块,用于基于身份信息和所述坐标框所在的坐标区间,确定对应所述身份信息的身份坐标信息。The identity coordinate determination module is configured to determine the identity coordinate information corresponding to the identity information based on the identity information and the coordinate interval in which the coordinate frame is located.

在其中一些实施例中,坐标框确定模块包括:第一边界坐标确定模块、第二边界坐标确定模块和坐标框划定模块。In some of these embodiments, the coordinate frame determination module includes: a first boundary coordinate determination module, a second boundary coordinate determination module, and a coordinate frame delineation module.

第一边界坐标确定模块,用于基于多个所述潜在位置坐标确定至少两个第一边界坐标;a first boundary coordinate determination module, configured to determine at least two first boundary coordinates based on a plurality of the potential position coordinates;

第二边界坐标确定模块,用于基于预设偏移值对所述第一边界坐标进行校准,得到对应的第二边界坐标;A second boundary coordinate determination module, configured to calibrate the first boundary coordinate based on a preset offset value to obtain a corresponding second boundary coordinate;

坐标框划定模块,用于基于所述第二边界坐标划定坐标框。A coordinate frame delineation module, configured to delineate a coordinate frame based on the second boundary coordinates.

在其中一些实施例中,坐标位置获取单元202包括:目标行为信息获取模块和坐标位置确定模块。In some of these embodiments, the coordinate position obtaining unit 202 includes: a target behavior information obtaining module and a coordinate position determining module.

目标行为信息获取模块,用于获取与人脸信息匹配的目标行为信息;The target behavior information acquisition module is used to acquire the target behavior information matched with the face information;

坐标位置确定模块,用于将所述目标行为信息输入训练好的坐标检测模型,得到与所述人脸信息匹配的目标行为信息对应的坐标位置。The coordinate position determination module is used for inputting the target behavior information into the trained coordinate detection model to obtain the coordinate position corresponding to the target behavior information matched with the face information.

在其中一些实施例中,身份信息识别单元203包括:匹配模块和身份识别模块。In some of these embodiments, the identity information identification unit 203 includes: a matching module and an identity identification module.

匹配模块,用于将所述坐标位置与所述身份坐标信息对应的行为坐标进行匹配;a matching module, configured to match the coordinate position with the behavioral coordinates corresponding to the identity coordinate information;

身份识别模块,用于当所述坐标位置与所述行为坐标匹配时,将所述行为坐标对应的身份信息确定为所述目标行为信息对应的身份信息。An identity recognition module, configured to determine the identity information corresponding to the behavior coordinate as the identity information corresponding to the target behavior information when the coordinate position matches the behavior coordinate.

需要说明的是,上述各个模块可以是功能模块也可以是程序模块,既可以通过软件来实现,也可以通过硬件来实现。对于通过硬件来实现的模块而言,上述各个模块可以位于同一处理器中;或者上述各个模块还可以按照任意组合的形式分别位于不同的处理器中。It should be noted that each of the above modules may be functional modules or program modules, and may be implemented by software or hardware. For the modules implemented by hardware, the above-mentioned modules may be located in the same processor; or the above-mentioned modules may also be located in different processors in any combination.

另外,结合图1描述的本申请实施例目标行为的身份识别方法可以由电子设备来实现。图5为根据本申请实施例的电子设备的硬件结构示意图。In addition, the method for identifying the target behavior in the embodiment of the present application described in conjunction with FIG. 1 may be implemented by an electronic device. FIG. 5 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.

电子设备可以包括处理器31以及存储有计算机程序指令的存储器32。The electronic device may include a processor 31 and a memory 32 storing computer program instructions.

具体地,上述处理器31可以包括中央处理器(CPU),或者特定集成电路(Application Specific Integrated Circuit,简称为ASIC),或者可以被配置成实施本申请实施例的一个或多个集成电路。Specifically, the above-mentioned processor 31 may include a central processing unit (CPU), or a specific integrated circuit (Application Specific Integrated Circuit, ASIC for short), or may be configured as one or more integrated circuits implementing the embodiments of the present application.

其中,存储器32可以包括用于数据或指令的大容量存储器。举例来说而非限制,存储器32可包括硬盘驱动器(Hard Disk Drive,简称为HDD)、软盘驱动器、固态驱动器(SolidState Drive,简称为SSD)、闪存、光盘、磁光盘、磁带或通用串行总线(Universal SerialBus,简称为USB)驱动器或者两个或更多个以上这些的组合。在合适的情况下,存储器32可包括可移除或不可移除(或固定)的介质。在合适的情况下,存储器32可在数据处理装置的内部或外部。在特定实施例中,存储器32是非易失性(Non-Volatile)存储器。在特定实施例中,存储器32包括只读存储器(Read-Only Memory,简称为ROM)和随机存取存储器(RandomAccess Memory,简称为RAM)。在合适的情况下,该ROM 可以是掩模编程的ROM、可编程ROM(Programmable Read-Only Memory,简称为PROM)、可擦除PROM(Erasable ProgrammableRead-Only Memory,简称为EPROM)、电可擦除PROM(Electrically Erasable ProgrammableRead-Only Memory,简称为EEPROM)、电可改写ROM(Electrically Alterable Read-OnlyMemory,简称为EAROM)或闪存(FLASH)或者两个或更多个以上这些的组合。在合适的情况下,该RAM可以是静态随机存取存储器(Static Random-Access Memory,简称为SRAM)或动态随机存取存储器(Dynamic Random Access Memory,简称为DRAM),其中,DRAM可以是快速页模式动态随机存取存储器(Fast Page Mode Dynamic Random Access Memory,简称为FPMDRAM)、扩展数据输出动态随机存取存储器(Extended Date Out Dynamic RandomAccess Memory,简称为EDODRAM)、同步动态随机存取内存(Synchronous Dynamic Random-Access Memory,简称SDRAM)等。Among other things, the memory 32 may include mass storage for data or instructions. By way of example and not limitation, the memory 32 may include a Hard Disk Drive (HDD), a floppy disk drive, a Solid State Drive (SSD), flash memory, optical disk, magneto-optical disk, magnetic tape, or universal serial bus (Universal SerialBus, abbreviated as USB) drive or a combination of two or more of these. Memory 32 may include removable or non-removable (or fixed) media, as appropriate. Where appropriate, memory 32 may be internal or external to the data processing device. In certain embodiments, the memory 32 is a non-volatile (Non-Volatile) memory. In a specific embodiment, the memory 32 includes a read-only memory (Read-Only Memory, referred to as ROM for short) and a random access memory (Random Access Memory, referred to as RAM for short). In a suitable case, the ROM can be a mask-programmed ROM, a programmable ROM (Programmable Read-Only Memory, referred to as PROM), an erasable PROM (Erasable Programmable Read-Only Memory, referred to as EPROM), an electrically erasable PROM. Except for PROM (Electrically Erasable Programmable Read-Only Memory, referred to as EEPROM), Electrically Rewritable ROM (Electrically Alterable Read-Only Memory, referred to as EAROM) or flash memory (FLASH) or a combination of two or more of these. In appropriate cases, the RAM may be Static Random-Access Memory (SRAM for short) or Dynamic Random Access Memory (DRAM for short), where DRAM may be a fast page Mode dynamic random access memory (Fast Page Mode Dynamic Random Access Memory, referred to as FPMDRAM), Extended Date Out Dynamic Random Access Memory (Extended Date Out Dynamic Random Access Memory, referred to as EDODRAM), Synchronous Dynamic Random Access Memory (Synchronous Dynamic Random Access Memory) Random-Access Memory, referred to as SDRAM) and so on.

存储器32可以用来存储或者缓存需要处理和/或通信使用的各种数据文件,以及处理器31所执行的可能的计算机程序指令。The memory 32 may be used to store or cache various data files required for processing and/or communication use, and possibly computer program instructions executed by the processor 31 .

处理器31通过读取并执行存储器32中存储的计算机程序指令,以实现上述实施例中的任意一种目标行为的身份识别方法。The processor 31 reads and executes the computer program instructions stored in the memory 32 to implement any one of the target behavior identification methods in the foregoing embodiments.

在其中一些实施例中,电子设备还可包括通信接口33和总线30。其中,如图5所示,处理器31、存储器32、通信接口33通过总线30连接并完成相互间的通信。In some of these embodiments, the electronic device may also include a communication interface 33 and a bus 30 . Among them, as shown in FIG. 5 , the processor 31 , the memory 32 , and the communication interface 33 are connected through the bus 30 and complete the mutual communication.

通信接口33用于实现本申请实施例中各模块、装置、单元和/或设备之间的通信。通信接口33还可以实现与其他部件例如:外接设备、图像/数据采集设备、数据库、外部存储以及图像/数据处理工作站等之间进行数据通信。The communication interface 33 is used to implement communication between modules, apparatuses, units, and/or devices in the embodiments of the present application. The communication interface 33 can also implement data communication with other components such as: external devices, image/data acquisition devices, databases, external storage, and image/data processing workstations.

总线30包括硬件、软件或两者,将电子设备的部件彼此耦接在一起。总线 30包括但不限于以下至少之一:数据总线(Data Bus)、地址总线(Address Bus)、控制总线(Control Bus)、扩展总线(Expansion Bus)、局部总线(Local Bus)。举例来说而非限制,总线30可包括图形加速接口(Accelerated Graphics Port,简称为AGP)或其他图形总线、增强工业标准架构(Extended Industry Standard Architecture,简称为EISA)总线、前端总线(Front Side Bus,简称为FSB)、超传输(Hyper Transport,简称为HT)互连、工业标准架构(Industry Standard Architecture,简称为ISA)总线、无线带宽(InfiniBand)互连、低引脚数(Low Pin Count,简称为LPC)总线、存储器总线、微信道架构(Micro ChannelArchitecture,简称为MCA)总线、外围组件互连(Peripheral Component Interconnect,简称为PCI)总线、PCI-Express(PCI-X)总线、串行高级技术附件(Serial AdvancedTechnology Attachment,简称为SATA)总线、视频电子标准协会局部(Video ElectronicsStandards Association Local Bus,简称为VLB)总线或其他合适的总线或者两个或更多个以上这些的组合。在合适的情况下,总线30可包括一个或多个总线。尽管本申请实施例描述和示出了特定的总线,但本申请考虑任何合适的总线或互连。The bus 30 includes hardware, software, or both, coupling the components of the electronic device to each other. The bus 30 includes, but is not limited to, at least one of the following: a data bus (Data Bus), an address bus (Address Bus), a control bus (Control Bus), an expansion bus (Expansion Bus), and a local bus (Local Bus). By way of example and not limitation, the bus 30 may include an Accelerated Graphics Port (AGP) or other graphics buses, an Extended Industry Standard Architecture (EISA) bus, a Front Side Bus (Front Side Bus) , referred to as FSB), Hyper Transport (Hyper Transport, referred to as HT) interconnect, Industry Standard Architecture (Industry Standard Architecture, referred to as ISA) bus, wireless bandwidth (InfiniBand) interconnect, Low Pin Count (Low Pin Count, LPC) bus, memory bus, Micro Channel Architecture (MCA) bus, Peripheral Component Interconnect (PCI) bus, PCI-Express (PCI-X) bus, Serial Advanced Serial Advanced Technology Attachment (SATA) bus, Video Electronics Standards Association Local Bus (VLB) bus or other suitable bus or a combination of two or more of these. Where appropriate, bus 30 may include one or more buses. Although embodiments of this application describe and illustrate a particular bus, this application contemplates any suitable bus or interconnect.

该电子设备可以基于获取到的程序指令,执行本申请实施例中的目标行为的身份识别方法从而实现结合图1描述的目标行为的身份识别方法。The electronic device may execute the method for identifying the target behavior in the embodiment of the present application based on the acquired program instruction, so as to realize the method for identifying the target behavior described in conjunction with FIG. 1 .

另外,结合上述实施例中的目标行为的身份识别方法,本申请实施例可提供一种计算机可读存储介质来实现。该计算机可读存储介质上存储有计算机程序指令;该计算机程序指令被处理器执行时实现上述实施例中的任意一种目标行为的身份识别方法。In addition, in combination with the method for identifying the target behavior in the foregoing embodiments, the embodiment of the present application may provide a computer-readable storage medium for implementation. Computer program instructions are stored on the computer-readable storage medium; when the computer program instructions are executed by the processor, any one of the target behavior identification methods in the foregoing embodiments is implemented.

需要说明的是,本申请所涉及的用户信息(包括但不限于用户设备信息、用户个人信息等)和数据(包括但不限于用于分析的数据、存储的数据、展示的数据等),均为经用户授权或者经过各方充分授权的信息和数据。It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all Information and data authorized by the user or fully authorized by the parties.

以上所述实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above-described embodiments can be combined arbitrarily. For the sake of brevity, all possible combinations of the technical features in the above-described embodiments are not described. However, as long as there is no contradiction between the combinations of these technical features, All should be regarded as the scope described in this specification.

以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请专利的保护范围应以所附权利要求为准。The above-mentioned embodiments only represent several embodiments of the present application, and the descriptions thereof are specific and detailed, but should not be construed as a limitation on the scope of the invention patent. It should be pointed out that for those skilled in the art, without departing from the concept of the present application, several modifications and improvements can be made, which all belong to the protection scope of the present application. Therefore, the scope of protection of the patent of the present application shall be subject to the appended claims.

Claims (10)

1. An identity recognition method for target behaviors, comprising:
determining identity coordinate information according to all the face information acquired in the current personnel arrangement mode and target behavior information matched with each face information; the target behavior information comprises behavior coordinates under a camera coordinate system, and the identity coordinate information comprises identities and corresponding behavior coordinates of all personnel under the camera coordinate system;
when a face image matched with the current target behavior cannot be identified, acquiring a coordinate position corresponding to the current target behavior in a camera coordinate system;
and matching the coordinate position with the identity coordinate information to obtain identity information corresponding to the current target behavior.
2. The method for identifying the identity of the target behavior according to claim 1, wherein determining the identity coordinate information according to all the face information collected in the current people arrangement mode and the target behavior information matched with each face information comprises:
acquiring face information under a current personnel arrangement mode, and identifying the face information to obtain identity information;
determining a plurality of potential position coordinates corresponding to the face information based on the target behavior information matched with the face information;
and determining identity coordinate information corresponding to the identity information based on the identity information and the plurality of potential position coordinates.
3. The method of claim 2, wherein determining identity coordinate information corresponding to the identity information based on the identity information and a plurality of the potential location coordinates comprises:
determining a coordinate frame based on a plurality of the potential location coordinates;
and determining identity coordinate information corresponding to the identity information based on the identity information and the coordinate interval in which the coordinate frame is located.
4. The method of claim 3, wherein determining a coordinate frame based on the plurality of potential location coordinates comprises:
determining at least two first boundary coordinates based on a plurality of the potential location coordinates;
calibrating the first boundary coordinate based on a preset offset value to obtain a corresponding second boundary coordinate;
defining a coordinate frame based on the second boundary coordinates.
5. The method for identifying the identity of the target behavior according to claim 1, wherein obtaining the coordinate position corresponding to the current target behavior in a camera coordinate system comprises:
acquiring target behavior information corresponding to the current target behavior;
and inputting the target behavior information into a trained coordinate detection model to obtain a coordinate position corresponding to the current target behavior matched with the face image.
6. The identity recognition method of the target behavior according to claim 1, wherein matching the coordinate position with the identity coordinate information to obtain the identity information corresponding to the current target behavior comprises:
matching the coordinate position with a behavior coordinate corresponding to the identity coordinate information;
and when the coordinate position is matched with the behavior coordinate, determining the identity information corresponding to the behavior coordinate as the identity information corresponding to the target behavior information.
7. The method for identifying the target behavior according to claim 1, wherein the target behavior information further comprises at least one of the following:
behavior picture, behavior identification, behavior type and behavior occurrence time.
8. An apparatus for identifying a target behavior, comprising:
the identity coordinate information determining unit is used for determining identity coordinate information according to all the face information acquired in the current personnel arrangement mode and target behavior information matched with each face information; the target behavior information comprises behavior coordinates under a camera coordinate system, and the identity coordinate information comprises identities and corresponding behavior coordinates of all personnel under the camera coordinate system;
the coordinate position acquisition unit is used for acquiring a coordinate position corresponding to the current target behavior in a camera coordinate system when a face image matched with the current target behavior cannot be identified;
and the identity information identification unit is used for matching the coordinate position with the identity coordinate information to obtain identity information corresponding to the current target behavior.
9. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, and the processor is configured to execute the computer program to perform the method for identifying an identity of a target activity of any one of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a method of identification of a target activity according to any one of claims 1 to 7.
CN202111149623.1A 2021-09-29 2021-09-29 Identification method, device, electronic device and storage medium for target behavior Pending CN114298081A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111149623.1A CN114298081A (en) 2021-09-29 2021-09-29 Identification method, device, electronic device and storage medium for target behavior

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111149623.1A CN114298081A (en) 2021-09-29 2021-09-29 Identification method, device, electronic device and storage medium for target behavior

Publications (1)

Publication Number Publication Date
CN114298081A true CN114298081A (en) 2022-04-08

Family

ID=80964415

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111149623.1A Pending CN114298081A (en) 2021-09-29 2021-09-29 Identification method, device, electronic device and storage medium for target behavior

Country Status (1)

Country Link
CN (1) CN114298081A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116343102A (en) * 2023-05-30 2023-06-27 深圳酷源数联科技有限公司 Underground personnel safety early warning method, device, system and storage medium
CN117708616A (en) * 2024-02-05 2024-03-15 四川大学华西医院 Person similarity calculation method, device, electronic equipment and computer storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107609517A (en) * 2017-09-15 2018-01-19 华中科技大学 A kind of classroom behavior detecting system based on computer vision
CN109284737A (en) * 2018-10-22 2019-01-29 广东精标科技股份有限公司 A kind of students ' behavior analysis and identifying system for wisdom classroom
CN110969045A (en) * 2018-09-28 2020-04-07 杭州海康威视数字技术股份有限公司 Behavior detection method and device, electronic equipment and storage medium
CN111325082A (en) * 2019-06-28 2020-06-23 杭州海康威视系统技术有限公司 Personnel concentration degree analysis method and device
CN111507283A (en) * 2020-04-21 2020-08-07 浙江蓝鸽科技有限公司 Student behavior identification method and system based on classroom scene

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107609517A (en) * 2017-09-15 2018-01-19 华中科技大学 A kind of classroom behavior detecting system based on computer vision
CN110969045A (en) * 2018-09-28 2020-04-07 杭州海康威视数字技术股份有限公司 Behavior detection method and device, electronic equipment and storage medium
CN109284737A (en) * 2018-10-22 2019-01-29 广东精标科技股份有限公司 A kind of students ' behavior analysis and identifying system for wisdom classroom
CN111325082A (en) * 2019-06-28 2020-06-23 杭州海康威视系统技术有限公司 Personnel concentration degree analysis method and device
CN111507283A (en) * 2020-04-21 2020-08-07 浙江蓝鸽科技有限公司 Student behavior identification method and system based on classroom scene

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116343102A (en) * 2023-05-30 2023-06-27 深圳酷源数联科技有限公司 Underground personnel safety early warning method, device, system and storage medium
CN117708616A (en) * 2024-02-05 2024-03-15 四川大学华西医院 Person similarity calculation method, device, electronic equipment and computer storage medium
CN117708616B (en) * 2024-02-05 2024-05-24 四川大学华西医院 Person similarity calculation method, device, electronic equipment and computer storage medium

Similar Documents

Publication Publication Date Title
WO2019109526A1 (en) Method and device for age recognition of face image, storage medium
JP7235892B2 (en) Image processing method, apparatus, electronic equipment and computer program product
WO2021051547A1 (en) Violent behavior detection method and system
CN107958230B (en) Facial expression recognition method and device
WO2019205369A1 (en) Electronic device, identity recognition method based on human face image and voiceprint information, and storage medium
WO2019120115A1 (en) Facial recognition method, apparatus, and computer apparatus
WO2018028546A1 (en) Key point positioning method, terminal, and computer storage medium
TWI712980B (en) Claim information extraction method and device, and electronic equipment
CN110020592A (en) Object detection model training method, device, computer equipment and storage medium
WO2019085331A1 (en) Fraud possibility analysis method, device, and storage medium
CN109817339B (en) Patient grouping method and device based on big data
CN110717407B (en) Face recognition method, device and storage medium based on lip reading password
CN110688878B (en) Living body identification detection method, living body identification detection device, living body identification detection medium, and electronic device
CN106056083B (en) A kind of information processing method and terminal
CN114298081A (en) Identification method, device, electronic device and storage medium for target behavior
US10423817B2 (en) Latent fingerprint ridge flow map improvement
CN107729928A (en) Information acquisition method and device
CN110796659A (en) Method, device, equipment and storage medium for identifying target detection result
CN110633677A (en) Method and device for face recognition
CN114078271B (en) Threshold determination method, target person identification method, device, equipment and medium
WO2021120589A1 (en) Method and apparatus for abnormal image filtering for use on 3d images, device, and storage medium
JP7675002B2 (en) Authentication device, program, and authentication method
CN111161789B (en) Analysis method and device for key areas of model prediction
CN113920550A (en) Finger authenticity identification method, electronic device and storage medium
CN114550253B (en) Method and device for preprocessing face image in queuing scene

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination