WO2017117879A1 - Personal identification processing method, apparatus and system - Google Patents

Personal identification processing method, apparatus and system Download PDF

Info

Publication number
WO2017117879A1
WO2017117879A1 PCT/CN2016/078901 CN2016078901W WO2017117879A1 WO 2017117879 A1 WO2017117879 A1 WO 2017117879A1 CN 2016078901 W CN2016078901 W CN 2016078901W WO 2017117879 A1 WO2017117879 A1 WO 2017117879A1
Authority
WO
WIPO (PCT)
Prior art keywords
person
identified
monitoring data
data
information
Prior art date
Application number
PCT/CN2016/078901
Other languages
French (fr)
Chinese (zh)
Inventor
刘少麟
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2017117879A1 publication Critical patent/WO2017117879A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/26Government or public services
    • G06Q50/265Personal security, identity or safety
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07Target detection

Definitions

  • the present invention relates to the field of communications, and in particular to a method, device and system for personnel identification processing.
  • the existing methods for reporting missing persons or tracking criminals are limited, and they are basically performed by means of manual search and video recording, or by means of rewards and reports.
  • the artificial method is characterized by high efficiency and low cost; the timeliness is poor. After the information is retrieved or the report is received, the problem has been passed for a period of time, and the problem is that the validity of the data is deteriorated.
  • the invention provides a method, a device and a system for processing a person identification, so as to at least solve the problem that the tracking person has poor timeliness in the related art, and cannot effectively find the tracking person in time.
  • a person identification processing method including:
  • the matching is consistent, it is determined that the monitoring data includes data of the person to be identified.
  • the feature information includes at least one of the following: face feature information, voiceprint information, and identity feature information.
  • the identity feature information includes: a phone number of the person to be identified, an identity card information of the person to be identified, a bank card information of the person to be identified, and a name information of the person to be identified .
  • the method further includes at least one of the following:
  • the pre-stored feature information of the person to be identified further includes: Characteristic information of the joint personnel.
  • the monitoring data includes at least one of the following: video monitoring data, voice monitoring data, card recording data of a bank card, communication data of a telephone network, and communication data of an internet network.
  • the manner of acquiring the monitoring data in the preset area includes: acquiring the monitoring data by a message bus of a cluster mode or a message bus of a high-throughput distributed publishing and subscription message system kafka.
  • matching the feature information of the to-be-identified person to the monitoring data in advance comprises: using different types of data in the feature information and the monitoring data in a distributed streaming processing framework. match.
  • a person identification processing apparatus including:
  • a matching module configured to match pre-stored feature information of the person to be identified with the monitoring data
  • the determining module is configured to determine, in the case that the matching is consistent, the data of the to-be-identified person included in the monitoring data.
  • the feature information includes at least one of the following: face feature information, voiceprint information, and identity feature information.
  • the identity feature information includes: a phone number of the person to be identified, an identity card information of the person to be identified, a bank card information of the person to be identified, and a name information of the person to be identified .
  • the device further includes:
  • a positioning module configured to confirm current location information of the to-be-identified person according to location information in the monitoring data
  • the alarm module is configured to send alarm information, where the alarm information carries data of the to-be-identified person in the monitoring data;
  • a display module configured to display data of the person to be identified in the monitoring data.
  • the feature information of the pre-stored person to be identified further includes: feature information of the associated person of the person to be identified.
  • the monitoring data includes at least one of the following: video monitoring data, voice monitoring data, card recording data of a bank card, communication data of a telephone network, and communication data of an internet network.
  • the manner of acquiring the monitoring data in the preset area includes: acquiring the monitoring data by a message bus of a cluster mode or a message bus of a high-throughput distributed publishing and subscription message system kafka.
  • matching the feature information of the to-be-identified person to the monitoring data in advance comprises: using different types of data in the feature information and the monitoring data in a distributed streaming processing framework. match.
  • a person identification processing system including: tracking a human-computer interaction layer, Tracking acquisition layer, tracking processing layer;
  • the tracking human-machine interaction layer acquires feature information of the person to be identified
  • the tracking acquisition layer acquires monitoring data within a preset area
  • the tracking processing layer matches the feature information of the person to be identified with the monitoring data
  • the tracking processing layer determines, in the case that the matching is consistent, the data of the to-be-identified person included in the monitoring data.
  • the monitoring data in the preset area is obtained; the characteristic information of the pre-stored person to be identified is matched with the monitoring data; and if the matching is consistent, determining that the monitoring data includes the person to be identified
  • the data solves the poor timeliness of the tracking person, can not effectively find the tracking person's problem in time, improves the search efficiency, and the search result is more accurate and timely.
  • FIG. 1 is a flowchart of a person identification processing method according to an embodiment of the present invention.
  • FIG. 2 is a block diagram 1 of a structure of a person identification processing apparatus according to an embodiment of the present invention
  • FIG. 3 is a block diagram 2 of a structure of a person identification processing apparatus according to an embodiment of the present invention.
  • FIG. 4 is a diagram showing an architecture of a person tracking a person in real time through big data according to a preferred embodiment of the present invention
  • FIG. 5 is a flow diagram of system processing in accordance with a preferred embodiment of the present invention.
  • FIG. 1 is a flowchart of a person identification processing method according to an embodiment of the present invention. As shown in FIG. 1, the flow includes the following steps:
  • Step S102 acquiring monitoring data within a preset area
  • Step S104 matching pre-stored feature information of the person to be identified with the monitoring data
  • step S106 if the matching is consistent, it is determined that the monitoring data includes the data of the person to be identified.
  • the monitoring data in the preset area by using the foregoing steps, and matching the pre-stored feature information of the to-be-identified person with the monitoring data; if the matching is consistent, determining that the monitoring data includes the to-be-identified person.
  • the data solves the poor timeliness of the tracking person, can not effectively find the tracking person's problem in time, improves the search efficiency, and the search result is more accurate and timely.
  • the feature information includes at least one of the following: face feature information, voiceprint information, and identity feature information.
  • the voiceprint information mainly collects data from the mobile phone voice call, the network voice call, and the network video call of the person to be identified.
  • the identity feature information includes: a phone number of the person to be identified, identity card information of the person to be identified, bank card information of the person to be identified, and name information of the person to be identified.
  • the phone number includes mobile phone contact, WeChat contact; ID card information includes passport, student ID, military card, etc., and even the bus card; the name information of the person to be identified is not only the name, the nickname of the relatives and friends on weekdays, the net name, etc.
  • the method further includes at least one of the following:
  • the alarm information carries the data of the person to be identified in the monitoring data, and sends an alarm message to prompt the attendant to pay attention to the person to be identified;
  • the data of the to-be-identified person in the monitoring data is displayed, and the display data includes a corresponding matching picture, voice phone content, and the like.
  • the pre-stored feature information of the person to be identified further includes: feature information of the associated person of the person to be identified, and inputting information of a related person who is acquainted with the person to be identified is beneficial to find more The information of the person to be identified promptly identifies the person to be identified.
  • the monitoring data includes at least one of the following: video monitoring data, voice monitoring data, card recording data of a bank card, communication data of a telephone network, communication data of an internet network, and fully utilizing big data in related technologies.
  • video monitoring data voice monitoring data
  • card recording data of a bank card communication data of a telephone network
  • communication data of an internet network communication data of an internet network
  • the manner of acquiring the monitoring data in the preset area includes: acquiring the monitoring data by using a message bus of a cluster mode or a message bus of a high-throughput distributed publishing and subscription message system kafka.
  • matching the pre-stored feature information of the to-be-identified person with the monitoring data includes: matching the feature information with different types of data in the monitoring data by using a distributed streaming processing framework.
  • the distributed streaming framework can be Apache Storm, or Spark Streaming, but is not limited to the above two.
  • a person identification processing device is also provided, which is used to implement the above-mentioned embodiments and preferred embodiments, and has not been described again.
  • the term “module” may implement a combination of software and/or hardware of a predetermined function.
  • the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
  • FIG. 2 is a block diagram of a structure of a person identification processing apparatus according to an embodiment of the present invention. As shown in FIG. 2, the apparatus includes:
  • the obtaining module 22 is configured to acquire monitoring data within a preset area
  • the matching module 24 is connected to the obtaining module 22 and configured to match the pre-stored feature information of the person to be identified with the monitoring data.
  • the determining module 26 is connected to the matching module 24, and is configured to determine that the monitoring data includes the data of the person to be identified when the matching is consistent.
  • the obtaining module 22 acquires the monitoring data in the preset area, and the matching module 24 matches the pre-stored feature information of the person to be identified with the monitoring data, and the determining module 26 determines the matching if the matching is consistent.
  • the monitoring data includes the data of the person to be identified, solves the timeliness of the tracking person, can not effectively find the tracking person in time, improves the search efficiency, and the search result is more accurate and timely.
  • FIG. 3 is a block diagram of a structure of a person identification processing apparatus according to an embodiment of the present invention. As shown in FIG. 3, the apparatus includes, in addition to all the modules shown in FIG.
  • the positioning module 32 is connected to the determining module 26, and configured to confirm the current location information of the to-be-identified person according to the location information in the monitoring data;
  • the alarm module 34 is connected to the determining module 26 and configured to send the alarm information, where the alarm information carries the data of the person to be identified in the monitoring data;
  • the display module 36 is connected to the determining module 26 and configured to display data of the person to be identified in the monitoring data.
  • An embodiment of the present invention further provides a personnel identification processing system, including: a tracking human-computer interaction layer, a tracking acquisition layer, and a tracking processing layer;
  • the tracking human-computer interaction layer acquires feature information of the person to be identified
  • the tracking acquisition layer acquires monitoring data within a preset area
  • the tracking processing layer matches the feature information of the person to be identified with the monitoring data
  • the tracking processing layer determines that the monitoring data includes data of the person to be identified when the matching is consistent.
  • each of the above modules may be implemented by software or hardware.
  • the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the modules are located in multiple In the processor.
  • the preferred embodiment of the present invention relies on face recognition, speech recognition, and other data sources, combined with big data, to realize real-time automated processes such as tracking and warning of criminals and missing persons.
  • the information of the person being followed is entered into the system, the face recognition is the face photo of the tracked person, the voice recognition is the name, nickname, nick number of the tracked person, and the voiceprint identifies the family and society of the tracked person.
  • Real-time face, voice matching module (corresponding to the matching module 24 of the above embodiment). From the information object input by the information input module, combined with the data source from the information collection module, real-time matching of face and voiceprint, or voice recognition, when there is matching data, submit corresponding original data and alarm Give the alarm and information display module module.
  • the information collection module (corresponding to the acquisition module 22 of the above embodiment) is mainly the source of data input.
  • face recognition mainly from banks, supermarkets, communities, traffic intersections, surveillance video, from the video in a certain period of time, such as 5 seconds, the cycle is to obtain a relatively reasonable but effective amount of data, for Each monitoring needs to have a unique tag.
  • voice recognition it is mainly a voice offload of a mobile phone or a fixed phone. When reporting information, it needs to carry the calling and called number.
  • the relevant data is submitted together to the module real-time face and voice matching module.
  • the alarm and information display module (corresponding to the alarm module 34 and the display module 36 of the above embodiment).
  • the real-time face and voice matching module detects the qualified photo and the telephone voice report, the information is displayed on the interface in a prominent manner, and includes related pictures or telephone voices, and the video or voice associated with the alarm.
  • Source data and other data source information are displayed on the interface in a prominent manner, and includes related pictures or telephone voices, and the video or voice associated with the alarm.
  • the information input module, the alarm and the information display module are human-computer interaction modules, and the real-time face, voice matching module and information collection module are real-time internal modules.
  • FIG. 4 is a schematic diagram of a system for tracking people in real time through big data according to a preferred embodiment of the present invention.
  • the relationship between modules in the architecture is as shown in FIG. 4 .
  • the system is generally divided into three layers: a tracking acquisition layer (corresponding to the acquisition module 22 in the above embodiment), a tracking processing layer (corresponding to the matching module 24 in the above embodiment), and a tracking human-computer interaction layer (including the alarm in the above embodiment).
  • the tracking acquisition layer is to determine the collection of information required by the tracking user, mainly to complete the monitoring image reporting, the listening voice reporting and other reports such as WeChat, card recording;
  • tracking processing layer is mainly used for reporting data and
  • the information of the tracked person matches mainly including face recognition and voiceprint recognition. Because of the large amount of data to be processed, it needs to be a distributed stream processing framework, which can be Apache Storm or Spark Streaming, but is not limited to the above two.
  • the tracking human-computer interaction layer mainly completes the entry of the tracked person information and the alarm and display of the information related to the successful determination.
  • Figure 5 is a flow chart showing the system processing of the preferred embodiment of the present invention, as shown in Figure 5.
  • Step S501 the tracked person picture, voiceprint or card information is entered, and the system input module of the human-machine interface provides an operation interface. After the user uploads the picture, voiceprint or card information, the system input module is persistent and transmitted to the system. Matching module, the matching module loads the information of each user into the system, and is used to match one by one in the subsequent matching process;
  • Step S502 monitoring needs to deploy software, and performing periodic image acquisition on the video, such as acquiring 5 seconds in the video.
  • the image of the interval is sent to the matching module through a real-time message.
  • the method can be a message bus in a cluster mode, which can be kafka, but is not limited to such a message bus, avoiding single point of failure and bottlenecks, and reporting the monitoring at the same time.
  • the unique identifier is used to lock the specific location information after the matching; the voice interception needs to listen to the related family relationship of the tracked person, the fixed line of the social relationship person or the mobile phone, and the relevant voice performs the window period acquisition, such as acquiring 5 seconds.
  • the report is also sent in the form of a real-time message.
  • the method can be a message bus in a cluster mode, which can be kafka but not limited to such a message bus, to avoid single point of failure and bottleneck, and to report the report at the same time.
  • the calling number and the called number information of the secondary call; the card monitoring is responsible for recording the bank card information of the tracked person and the card swipe location, and reporting the information to the matching module.
  • Step S503 After receiving the reported information, the matching module determines that it is picture information, card information or voice information.
  • Step S504 After the image information is determined, the face in the list of the person to be tracked is compared with the face. If the condition is not met, the current time ends. If the condition is met, the person, the monitoring indicator, and the report are reported. The picture information is transmitted to the alarm display module.
  • Step S505 After the voice information is determined, the voiceprint is compared with the voiceprint in the list of persons to be tracked. If there is no condition, the current end is ended. If the condition is met, the person and the calling number are reported. The called number and the reported voice information are transmitted to the alarm display module.
  • Step S506 After determining that the card information is used, the card is compared with the identity feature information in the to-be-tracked person list. If the condition is not met, the current time ends. If the condition is met, the person is reported. Card information, the card address is transmitted to the alarm display module.
  • Step S507 After receiving the prompt information, the alarm module manually performs personnel check, and provides a matching contact manner for the surrounding police force for the monitoring mode, and further can directly send an alarm to the surrounding system, and the voice can be based on the mobile phone master. Call the number to perform the triangulation of the base station, obtain the relevant location information, and provide the matching contact information of the surrounding police force. Further, the alarm can be directly sent to the surrounding system to perform the police force transfer in time.
  • the data acquired in step S502 is not persisted in consideration of personal privacy issues, and is uploaded to the human-computer interaction module only when the conditions are matched, thereby avoiding legal risks.
  • the system can be composed of a plurality of components, for example, according to the city, the regional information is provided by all the cities, and each city only needs to report the qualified data and enter the information in various places. Track people and sync to the province's system. That is to say, the system is built up in an administrative-like manner and expanded.
  • Scene 1 Using face recognition to locate lost children and the elderly
  • the loss of the elderly has become an increasingly serious social problem. It is understood that the elderly who are lost are mostly elderly patients with Alzheimer's disease. There have been media analysis that the frequent loss of the elderly is not only related to their own diseases, but also the constant changes in urban construction and lifestyle, which is why they are easily lost. Moreover, there are more and more "empty-nest elderly people". They have single members and no one to take care of in their daily lives. It is difficult to know when they are lost. Due to the existing search methods, it will take a long time to find; at the same time, family members often have to spend a lot of energy, and after the founding, they must prevent this from happening again, and at the same time bring a lot of work to the police. According to the analysis of psychologists, a lost experience will also bring great trauma to the elderly. After using the system, after receiving the 110 alarm, the photos of the relevant lost old people are entered into the system for automatic tracking.
  • Step 11 Access the monitoring equipment of the community, the shopping mall, the supermarket, and the transportation department, and number the monitoring equipment at the same time;
  • Step 12 deploy the system at the 110 alarm station, and when receiving the loss of the child or the elderly, obtain a photo of the lost child or the old person, and enter it into the system for automatic tracking;
  • Step 13 Match the monitoring match with the lost child or old man picture timing (5 seconds). If there is no match, proceed to the next one; the match proceeds to process 4;
  • Step 14 When the matching module matches the monitoring of the lost child or the elderly, the related monitoring identifier and related pictures are reported to the alarm display module;
  • Step 15 The alarm display module displays after receiving the relevant pictures and information.
  • the operator manually checks whether the child is lost or the elderly, and can also send the photo to the parent of the relevant personnel for confirmation, and at the same time coordinate the surrounding police force, because this Timeliness is important;
  • Step 16 Confirm that the police force is not lost or the elderly; if yes, the police force continues the search process.
  • Scenario 2 Using card records to locate criminals
  • Step 21 accessing the card of the bank ATM machine, accessing the POS machine of the shopping mall or the like;
  • Step 22 Entering the ID card information of the criminal in the system, and the system sends the ID information to the matching module;
  • Step 23 The ATM and POS machines that are accessed are reported to the collection module identity card information, and the location of the ATM or POS machine when each transaction is generated;
  • Step 24 After matching the identity card information of the criminal, the matching module reports the alarm to the display module, and carries the location information of the ATM and the POS;
  • Step 25 The alarm display module displays after receiving the relevant information, and performs peripheral police force scheduling according to the location information of the ATM or the POS.
  • the voiceprints of the relevant criminals are entered into the system for automatic tracking.
  • Step 31 Analyze the family relationship and social relationship of the offender, find out the information of the fixed person and the mobile phone of the relevant personnel, and collect the information;
  • Step 32 The collected number is entered into the system, and the voiceprint of the criminal is also recorded into the system, and the system automatically tracks the voice detection. This is an efficient but not comprehensive approach, if you want to fully listen to all voices;
  • Step 33 Performing a report on the listening voice timing (5 seconds), first performing voiceprint matching. If there is no match, proceed to the next one; the match proceeds to process 5;
  • Step 34 and then perform speech recognition, mainly according to the name, nickname, and other name of the criminal, if it is found in the voice to identify the relevant information, then proceeds to process 5;
  • Step 35 When the matching module matches the voiceprint of the criminal or identifies the corresponding person name, nickname, and other name, the voice of the related call, and the related calling and called number and the information thereof are reported to the alarm display module;
  • Step 36 The alarm display module displays after receiving the sound and the information, and the operator manually checks whether the criminal is tracked, and the number is used to locate the number, and the surrounding police force is coordinated;
  • Step 37 After confirming that the offender is not being tracked, withdraw the police force; if yes, the police force continues the search process.
  • Step 41 access the monitoring equipment of the community, the shopping mall, the supermarket, and the transportation department, and number the monitoring equipment at the same time;
  • Step 42 Obtain a photo of the criminal, and enter it into the system for automatic tracking;
  • Step 43 matching the monitoring match with the offender picture timing (5 seconds). If there is no match, proceed to the next one; the match proceeds to process 4;
  • Step 44 When the matching module matches the monitoring of the criminal, the related monitoring identifier and related pictures are reported to the alarm display module.
  • Step 45 The alarm display module displays after receiving the relevant pictures and information, and the operator manually checks whether the criminal is a criminal, and simultaneously coordinates the surrounding police force, because timeliness is important at this time;
  • Step 46 After confirming that it is not a criminal, withdraw the police force; if yes, the police force continues the search process.
  • the preferred embodiment of the present invention performs a system for missing persons and criminals tracking through big data real-time face and speech recognition. Compared with the existing criminal tracking and missing population query, the system is first automated, and the accuracy is greatly improved. Efficiency, followed by real-time characteristics, is more time-efficient in both scenarios, and combined with the current big data technology to improve timeliness, making related information more timely and effective.
  • the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation.
  • the technical solution of the present invention which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk,
  • the optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present invention.
  • Embodiments of the present invention also provide a storage medium.
  • the foregoing storage medium may be configured to store program code for performing the steps of the foregoing embodiments:
  • the storage medium is further arranged to store program code for performing the steps of the above-described embodiments:
  • the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • a mobile hard disk e.g., a hard disk
  • magnetic memory e.g., a hard disk
  • the processor performs the method steps of the foregoing embodiments according to the stored program code in the storage medium.
  • modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein.
  • the steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module.
  • the invention is not limited to any specific combination of hardware and software.
  • the monitoring data in the preset area is acquired; the feature information of the to-be-identified person stored in advance is matched with the monitoring data; and if the matching is consistent, the monitoring data is determined.
  • the data of the person to be identified is included, the timeliness of the tracking person is solved, the problem of tracking the person cannot be effectively found in time, the search efficiency is improved, and the search result is more accurate and timely.

Abstract

A personal identification processing method, apparatus and system. The method comprises: acquiring monitoring data within a pre-set area range (S102); matching pre-stored feature information about a person to be identified with the monitoring data (S104); and in the case of consistent matching, determining that the monitoring data comprises data of the person to be identified (S106). By means of the above-mentioned technical solution, the problems, that timeliness of tracking a person is poor and tracked people cannot be found in time, are effectively solved, and the searching efficiency is improved, and a search result is more accurate and timely.

Description

人员识别处理方法、装置及系统Person identification processing method, device and system 技术领域Technical field
本发明涉及通信领域,具体而言,涉及一种人员识别处理的方法、装置及系统。The present invention relates to the field of communications, and in particular to a method, device and system for personnel identification processing.
背景技术Background technique
现有的对于报案失踪人口或者对于罪犯追踪的方法比较有限,基本都是人工的检索录像的方式进行,或者以有奖举报的方式进行。人工的方式效率低成本高的特点;时效性差,在检索到信息、或者接收到举报之后,离发现已经过了一段时间,带来的问题是数据的有效性变差。The existing methods for reporting missing persons or tracking criminals are limited, and they are basically performed by means of manual search and video recording, or by means of rewards and reports. The artificial method is characterized by high efficiency and low cost; the timeliness is poor. After the information is retrieved or the report is received, the problem has been passed for a period of time, and the problem is that the validity of the data is deteriorated.
针对相关技术中,追踪人的时效性差,不能及时有效找到追踪人的问题,目前还没有有效解决方案。In view of the related technology, the timeliness of the tracking person is poor, and the problem of tracking the person cannot be effectively found in time. There is no effective solution at present.
发明内容Summary of the invention
本发明提供了一种人员识别处理方法、装置及系统,以至少解决相关技术中追踪人的时效性差,不能及时有效找到追踪人的问题。The invention provides a method, a device and a system for processing a person identification, so as to at least solve the problem that the tracking person has poor timeliness in the related art, and cannot effectively find the tracking person in time.
根据本发明的一个实施例,提供了一种人员识别处理方法,包括:According to an embodiment of the present invention, a person identification processing method is provided, including:
获取在预设区域范围内的监控数据;Obtain monitoring data within a preset area;
将预先存储的待识别人员的特征信息与所述监控数据进行匹配;Matching the pre-stored feature information of the person to be identified with the monitoring data;
在匹配一致的情况下,确定所述监控数据中包括所述待识别人员的数据。In case the matching is consistent, it is determined that the monitoring data includes data of the person to be identified.
在本实施例中,所述特征信息包括以下至少之一:人脸特征信息,声纹信息,身份特征信息。In this embodiment, the feature information includes at least one of the following: face feature information, voiceprint information, and identity feature information.
在本实施例中,所述身份特征信息包括:所述待识别人员的电话号码,所述待识别人员的身份证信息,所述待识别人员的银行卡信息,所述待识别人员的名称信息。In this embodiment, the identity feature information includes: a phone number of the person to be identified, an identity card information of the person to be identified, a bank card information of the person to be identified, and a name information of the person to be identified .
在本实施例中,确定所述监控数据中包括所述待识别人员的数据之后,还包括以下至少之一:In this embodiment, after determining that the monitoring data includes the data of the to-be-identified person, the method further includes at least one of the following:
依据所述监控数据中的位置信息确认所述待识别人员的当前位置信息;Confirming current location information of the to-be-identified person according to location information in the monitoring data;
发送告警信息,其中,所述告警信息携带有所述监控数据中所述待识别人员的数据;Sending alarm information, where the alarm information carries data of the to-be-identified person in the monitoring data;
显示所述监控数据中所述待识别人员的数据。Displaying data of the person to be identified in the monitoring data.
在本实施例中,所述预先存储的待识别人员的特征信息中还包括:所述待识别人员的关 联人员的特征信息。In this embodiment, the pre-stored feature information of the person to be identified further includes: Characteristic information of the joint personnel.
在本实施例中,所述监控数据包括以下至少之一:视频监控数据,语音监控数据,银行卡的用卡记录数据,电话网络的通讯数据,互联网网络的通讯数据。In this embodiment, the monitoring data includes at least one of the following: video monitoring data, voice monitoring data, card recording data of a bank card, communication data of a telephone network, and communication data of an internet network.
在本实施例中,获取在预设区域范围内的监控数据的方式包括:通过集群方式的消息总线或高吞吐量的分布式发布订阅消息系统kafka的消息总线获取所述监控数据。In this embodiment, the manner of acquiring the monitoring data in the preset area includes: acquiring the monitoring data by a message bus of a cluster mode or a message bus of a high-throughput distributed publishing and subscription message system kafka.
在本实施例中,将预先存储的待识别人员的特征信息与所述监控数据进行匹配,包括:将所述特征信息与所述监控数据中不同类型的数据采用分布式的流式处理框架进行匹配。In this embodiment, matching the feature information of the to-be-identified person to the monitoring data in advance comprises: using different types of data in the feature information and the monitoring data in a distributed streaming processing framework. match.
根据本发明的另一实施例,提供了一种人员识别处理装置,包括:According to another embodiment of the present invention, a person identification processing apparatus is provided, including:
获取模块,设置为获取在预设区域范围内的监控数据;Obtaining a module, configured to acquire monitoring data within a preset area;
匹配模块,设置为将预先存储的待识别人员的特征信息与所述监控数据进行匹配;a matching module, configured to match pre-stored feature information of the person to be identified with the monitoring data;
确定模块,设置为在匹配一致的情况下,确定所述监控数据中包括所述待识别人员的数据。The determining module is configured to determine, in the case that the matching is consistent, the data of the to-be-identified person included in the monitoring data.
在本实施例中,其中,所述特征信息包括以下至少之一:人脸特征信息,声纹信息,身份特征信息。In this embodiment, the feature information includes at least one of the following: face feature information, voiceprint information, and identity feature information.
在本实施例中,所述身份特征信息包括:所述待识别人员的电话号码,所述待识别人员的身份证信息,所述待识别人员的银行卡信息,所述待识别人员的名称信息。In this embodiment, the identity feature information includes: a phone number of the person to be identified, an identity card information of the person to be identified, a bank card information of the person to be identified, and a name information of the person to be identified .
在本实施例中,所述装置还包括:In this embodiment, the device further includes:
定位模块,设置为依据所述监控数据中的位置信息确认所述待识别人员的当前位置信息;a positioning module, configured to confirm current location information of the to-be-identified person according to location information in the monitoring data;
告警模块,设置为发送告警信息,其中,所述告警信息携带有所述监控数据中所述待识别人员的数据;The alarm module is configured to send alarm information, where the alarm information carries data of the to-be-identified person in the monitoring data;
显示模块,设置为显示所述监控数据中所述待识别人员的数据。a display module configured to display data of the person to be identified in the monitoring data.
在本实施例中,所述预先存储的待识别人员的特征信息中还包括:所述待识别人员的关联人员的特征信息。In this embodiment, the feature information of the pre-stored person to be identified further includes: feature information of the associated person of the person to be identified.
在本实施例中,所述监控数据包括以下至少之一:视频监控数据,语音监控数据,银行卡的用卡记录数据,电话网络的通讯数据,互联网网络的通讯数据。In this embodiment, the monitoring data includes at least one of the following: video monitoring data, voice monitoring data, card recording data of a bank card, communication data of a telephone network, and communication data of an internet network.
在本实施例中,获取在预设区域范围内的监控数据的方式包括:通过集群方式的消息总线或高吞吐量的分布式发布订阅消息系统kafka的消息总线获取所述监控数据。In this embodiment, the manner of acquiring the monitoring data in the preset area includes: acquiring the monitoring data by a message bus of a cluster mode or a message bus of a high-throughput distributed publishing and subscription message system kafka.
在本实施例中,将预先存储的待识别人员的特征信息与所述监控数据进行匹配,包括:将所述特征信息与所述监控数据中不同类型的数据采用分布式的流式处理框架进行匹配。In this embodiment, matching the feature information of the to-be-identified person to the monitoring data in advance comprises: using different types of data in the feature information and the monitoring data in a distributed streaming processing framework. match.
根据本发明的另一实施例还提供了一种人员识别处理系统,包括:跟踪人机交互层、跟 踪采集层、跟踪处理层;According to another embodiment of the present invention, a person identification processing system is provided, including: tracking a human-computer interaction layer, Tracking acquisition layer, tracking processing layer;
所述跟踪人机交互层获取待识别人员的特征信息;The tracking human-machine interaction layer acquires feature information of the person to be identified;
所述跟踪采集层获取在预设区域范围内的监控数据;The tracking acquisition layer acquires monitoring data within a preset area;
所述跟踪处理层将所述待识别人员的特征信息与所述监控数据进行匹配;The tracking processing layer matches the feature information of the person to be identified with the monitoring data;
所述跟踪处理层在匹配一致的情况下,确定所述监控数据中包括所述待识别人员的数据。The tracking processing layer determines, in the case that the matching is consistent, the data of the to-be-identified person included in the monitoring data.
通过本发明,获取在预设区域范围内的监控数据;将预先存储的待识别人员的特征信息与该监控数据进行匹配;在匹配一致的情况下,确定该监控数据中包括该待识别人员的数据,解决了追踪人的时效性差,不能及时有效找到追踪人的问题,提高了搜寻效率,搜索结果更加准确及时。According to the present invention, the monitoring data in the preset area is obtained; the characteristic information of the pre-stored person to be identified is matched with the monitoring data; and if the matching is consistent, determining that the monitoring data includes the person to be identified The data solves the poor timeliness of the tracking person, can not effectively find the tracking person's problem in time, improves the search efficiency, and the search result is more accurate and timely.
附图说明DRAWINGS
此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:
图1是根据本发明实施例的人员识别处理方法的流程图;1 is a flowchart of a person identification processing method according to an embodiment of the present invention;
图2是根据本发明实施例的一种人员识别处理装置的结构框图一;2 is a block diagram 1 of a structure of a person identification processing apparatus according to an embodiment of the present invention;
图3是根据本发明实施例的一种人员识别处理装置的结构框图二;3 is a block diagram 2 of a structure of a person identification processing apparatus according to an embodiment of the present invention;
图4是本发明优选实施例通过大数据实时跟踪人的体系架构图;4 is a diagram showing an architecture of a person tracking a person in real time through big data according to a preferred embodiment of the present invention;
图5是本发明优选实施例的系统处理的流程图。Figure 5 is a flow diagram of system processing in accordance with a preferred embodiment of the present invention.
具体实施方式detailed description
下文中将参考附图并结合实施例来详细说明本发明。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.
需要说明的是,本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。It is to be understood that the terms "first", "second" and the like in the specification and claims of the present invention are used to distinguish similar objects, and are not necessarily used to describe a particular order or order.
在本实施例中提供了一种人员识别处理方法,图1是根据本发明实施例的人员识别处理方法的流程图,如图1所示,该流程包括如下步骤:A person identification processing method is provided in this embodiment. FIG. 1 is a flowchart of a person identification processing method according to an embodiment of the present invention. As shown in FIG. 1, the flow includes the following steps:
步骤S102,获取在预设区域范围内的监控数据;Step S102, acquiring monitoring data within a preset area;
步骤S104,将预先存储的待识别人员的特征信息与该监控数据进行匹配;Step S104, matching pre-stored feature information of the person to be identified with the monitoring data;
步骤S106,在匹配一致的情况下,确定该监控数据中包括该待识别人员的数据。 In step S106, if the matching is consistent, it is determined that the monitoring data includes the data of the person to be identified.
通过上述步骤,获取在预设区域范围内的监控数据;将预先存储的待识别人员的特征信息与该监控数据进行匹配;在匹配一致的情况下,确定该监控数据中包括该待识别人员的数据,解决了追踪人的时效性差,不能及时有效找到追踪人的问题,提高了搜寻效率,搜索结果更加准确及时。Obtaining the monitoring data in the preset area by using the foregoing steps, and matching the pre-stored feature information of the to-be-identified person with the monitoring data; if the matching is consistent, determining that the monitoring data includes the to-be-identified person The data solves the poor timeliness of the tracking person, can not effectively find the tracking person's problem in time, improves the search efficiency, and the search result is more accurate and timely.
在本实施例中,该特征信息包括以下至少之一:人脸特征信息,声纹信息,身份特征信息。声纹信息主要从待识别人员的移动电话语音通话,网络语音通话,网络视频通话中采集数据。In this embodiment, the feature information includes at least one of the following: face feature information, voiceprint information, and identity feature information. The voiceprint information mainly collects data from the mobile phone voice call, the network voice call, and the network video call of the person to be identified.
在本实施例中,该身份特征信息包括:该待识别人员的电话号码,该待识别人员的身份证信息,该待识别人员的银行卡信息,该待识别人员的名称信息。电话号码包括手机联系人,微信联系人;身份证信息包括护照、学生证、军人证等,甚至是公交卡;待识别人员的名称信息不光指名字,平日里亲人朋友的昵称,网名等。In this embodiment, the identity feature information includes: a phone number of the person to be identified, identity card information of the person to be identified, bank card information of the person to be identified, and name information of the person to be identified. The phone number includes mobile phone contact, WeChat contact; ID card information includes passport, student ID, military card, etc., and even the bus card; the name information of the person to be identified is not only the name, the nickname of the relatives and friends on weekdays, the net name, etc.
在本实施例中,确定该监控数据中包括该待识别人员的数据之后,还包括以下至少之一:In this embodiment, after determining that the monitoring data includes the data of the to-be-identified person, the method further includes at least one of the following:
依据该监控数据中的位置信息确认该待识别人员的当前位置信息,在确定为待识别人员后,依据相应监控数据携带的监控地点的唯一标记定位待识别人员;Determining the current location information of the to-be-identified person according to the location information in the monitoring data, and determining the person to be identified according to the unique identifier of the monitoring location carried by the corresponding monitoring data after determining the person to be identified;
发送告警信息,其中,该告警信息携带有该监控数据中该待识别人员的数据,发出告警信息提示值班人员注意有待识别人员出没;Sending the alarm information, where the alarm information carries the data of the person to be identified in the monitoring data, and sends an alarm message to prompt the attendant to pay attention to the person to be identified;
显示该监控数据中该待识别人员的数据,显示数据包含相应的匹配图片、语音电话内容等。The data of the to-be-identified person in the monitoring data is displayed, and the display data includes a corresponding matching picture, voice phone content, and the like.
在本实施例中,该预先存储的待识别人员的特征信息中还包括:该待识别人员的关联人员的特征信息,将与待识别人员相识的相关人员的信息输入有利于找到更多的与待识别人员的信息,及时识别出待识别人。In this embodiment, the pre-stored feature information of the person to be identified further includes: feature information of the associated person of the person to be identified, and inputting information of a related person who is acquainted with the person to be identified is beneficial to find more The information of the person to be identified promptly identifies the person to be identified.
在本实施例中,该监控数据包括以下至少之一:视频监控数据,语音监控数据,银行卡的用卡记录数据,电话网络的通讯数据,互联网网络的通讯数据,充分发挥相关技术中大数据的力量,采集更多的各类数据,快速筛选出有用的信息。In this embodiment, the monitoring data includes at least one of the following: video monitoring data, voice monitoring data, card recording data of a bank card, communication data of a telephone network, communication data of an internet network, and fully utilizing big data in related technologies. The power to collect more types of data and quickly filter out useful information.
在本实施例中,获取在预设区域范围内的监控数据的方式包括:通过集群方式的消息总线或高吞吐量的分布式发布订阅消息系统kafka的消息总线,获取该监控数据。In this embodiment, the manner of acquiring the monitoring data in the preset area includes: acquiring the monitoring data by using a message bus of a cluster mode or a message bus of a high-throughput distributed publishing and subscription message system kafka.
在本实施例中,将预先存储的待识别人员的特征信息与该监控数据进行匹配,包括:将该特征信息与该监控数据中不同类型的数据采用分布式的流式处理框架进行匹配。分布式的流式处理框架可以为Apache Storm,或者,Spark Streaming,但是不限于以上两种。In this embodiment, matching the pre-stored feature information of the to-be-identified person with the monitoring data includes: matching the feature information with different types of data in the monitoring data by using a distributed streaming processing framework. The distributed streaming framework can be Apache Storm, or Spark Streaming, but is not limited to the above two.
在本实施例中还提供了一种人员识别处理装置,该装置用于实现上述实施例及优选实施方式,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。 In this embodiment, a person identification processing device is also provided, which is used to implement the above-mentioned embodiments and preferred embodiments, and has not been described again. As used below, the term "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
图2是根据本发明实施例的一种人员识别处理装置的结构框图一,如图2所示,该装置包括:2 is a block diagram of a structure of a person identification processing apparatus according to an embodiment of the present invention. As shown in FIG. 2, the apparatus includes:
获取模块22,设置为获取在预设区域范围内的监控数据;The obtaining module 22 is configured to acquire monitoring data within a preset area;
匹配模块24,与获取模块22连接,设置为将预先存储的待识别人员的特征信息与该监控数据进行匹配;The matching module 24 is connected to the obtaining module 22 and configured to match the pre-stored feature information of the person to be identified with the monitoring data.
确定模块26,与匹配模块24连接,设置为在匹配一致的情况下,确定该监控数据中包括该待识别人员的数据。The determining module 26 is connected to the matching module 24, and is configured to determine that the monitoring data includes the data of the person to be identified when the matching is consistent.
通过上述步骤,获取模块22获取在预设区域范围内的监控数据,匹配模块24将预先存储的待识别人员的特征信息与该监控数据进行匹配,确定模块26在匹配一致的情况下,确定该监控数据中包括该待识别人员的数据,解决了追踪人的时效性差,不能及时有效找到追踪人的问题,提高了搜寻效率,搜索结果更加准确及时。Through the above steps, the obtaining module 22 acquires the monitoring data in the preset area, and the matching module 24 matches the pre-stored feature information of the person to be identified with the monitoring data, and the determining module 26 determines the matching if the matching is consistent. The monitoring data includes the data of the person to be identified, solves the timeliness of the tracking person, can not effectively find the tracking person in time, improves the search efficiency, and the search result is more accurate and timely.
图3是根据本发明实施例的一种人员识别处理装置的结构框图二,如图3所示,该装置除包括图2所示的所有模块外,还包括:FIG. 3 is a block diagram of a structure of a person identification processing apparatus according to an embodiment of the present invention. As shown in FIG. 3, the apparatus includes, in addition to all the modules shown in FIG.
定位模块32,与确定模块26连接,设置为依据该监控数据中的位置信息确认该待识别人员的当前位置信息;The positioning module 32 is connected to the determining module 26, and configured to confirm the current location information of the to-be-identified person according to the location information in the monitoring data;
告警模块34,与确定模块26连接,设置为发送告警信息,其中,该告警信息携带有该监控数据中该待识别人员的数据;The alarm module 34 is connected to the determining module 26 and configured to send the alarm information, where the alarm information carries the data of the person to be identified in the monitoring data;
显示模块36,与确定模块26连接,设置为显示该监控数据中该待识别人员的数据。The display module 36 is connected to the determining module 26 and configured to display data of the person to be identified in the monitoring data.
本发明的实施例还提供了一种人员识别处理系统,包括:跟踪人机交互层、跟踪采集层、跟踪处理层;An embodiment of the present invention further provides a personnel identification processing system, including: a tracking human-computer interaction layer, a tracking acquisition layer, and a tracking processing layer;
该跟踪人机交互层获取待识别人员的特征信息;The tracking human-computer interaction layer acquires feature information of the person to be identified;
该跟踪采集层获取在预设区域范围内的监控数据;The tracking acquisition layer acquires monitoring data within a preset area;
该跟踪处理层将该待识别人员的特征信息与该监控数据进行匹配;The tracking processing layer matches the feature information of the person to be identified with the monitoring data;
该跟踪处理层在匹配一致的情况下,确定该监控数据中包括该待识别人员的数据。The tracking processing layer determines that the monitoring data includes data of the person to be identified when the matching is consistent.
需要说明的是,上述各个模块是可以通过软件或硬件来实现的,对于后者,可以通过以下方式实现,但不限于此:上述模块均位于同一处理器中;或者,上述模块分别位于多个处理器中。It should be noted that each of the above modules may be implemented by software or hardware. For the latter, the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the modules are located in multiple In the processor.
下面结合优选实施例和实施方式对本发明进行详细说明。The invention will now be described in detail in conjunction with the preferred embodiments and embodiments.
本发明优选实施例依靠人脸识别、语音识别、及其他数据来源,结合大数据,可以实现实时进行罪犯、失踪人口的跟踪,告警等自动化流程。 The preferred embodiment of the present invention relies on face recognition, speech recognition, and other data sources, combined with big data, to realize real-time automated processes such as tracking and warning of criminals and missing persons.
本发明优选实施例所述系统包括以下功能模块:The system described in the preferred embodiment of the invention comprises the following functional modules:
信息录入模块。往系统中录入被关注人的信息,人脸识别的是被跟踪人的面部照片,语音识别的为被跟踪人的姓名、昵称、外号等,声纹识别的是被跟踪人的家庭、社会关系人员的固话、移动电话号码,以及被跟踪人的声纹信息。Information entry module. The information of the person being followed is entered into the system, the face recognition is the face photo of the tracked person, the voice recognition is the name, nickname, nick number of the tracked person, and the voiceprint identifies the family and society of the tracked person. The fixed line of the person in charge, the mobile phone number, and the voiceprint information of the person being tracked.
实时人脸、语音匹配模块(相当于上述实施例的匹配模块24)。从信息录入模块输入的关注对象中,结合来自信息采集模块的数据源,进行实时的人脸和声纹的匹配,或者语音识别,当存在匹配的数据的时候,将相应的原始数据及告警提交给告警及信息显示模块模块。Real-time face, voice matching module (corresponding to the matching module 24 of the above embodiment). From the information object input by the information input module, combined with the data source from the information collection module, real-time matching of face and voiceprint, or voice recognition, when there is matching data, submit corresponding original data and alarm Give the alarm and information display module module.
信息采集模块(相当于上述实施例的获取模块22),主要是数据输入的来源。针对于人脸识别主要来自银行、超市、小区、交通路口的监控录像,从录像中按照一定的周期截取的图片,如5秒为周期,周期是为了获取相对合理但是有效的数据量,针对于每个监控需要有一个唯一标记,上报数据时同时携带自身标记;针对语音识别主要为移动电话或者固定电话的语音分流,上报信息时需要携带主被叫号码。相关数据一起进行提交给模块实时人脸、语音匹配模块。The information collection module (corresponding to the acquisition module 22 of the above embodiment) is mainly the source of data input. For face recognition, mainly from banks, supermarkets, communities, traffic intersections, surveillance video, from the video in a certain period of time, such as 5 seconds, the cycle is to obtain a relatively reasonable but effective amount of data, for Each monitoring needs to have a unique tag. When the data is reported, it also carries its own tag. For voice recognition, it is mainly a voice offload of a mobile phone or a fixed phone. When reporting information, it needs to carry the calling and called number. The relevant data is submitted together to the module real-time face and voice matching module.
告警及信息显示模块(相当于上述实施例的告警模块34和显示模块36)。当实时人脸、语音匹配模块在检测到符合条件的照片及电话语音上报时,将信息以突出的方式展现在界面,同时包含相关的图片或者电话语音等内容,及该告警关联的视频或者语音源数据及其他数据源信息。The alarm and information display module (corresponding to the alarm module 34 and the display module 36 of the above embodiment). When the real-time face and voice matching module detects the qualified photo and the telephone voice report, the information is displayed on the interface in a prominent manner, and includes related pictures or telephone voices, and the video or voice associated with the alarm. Source data and other data source information.
其中信息录入模块、告警及信息显示模块为人机交互模块,实时人脸、语音匹配模块、信息采集模块为实时的内部模块。The information input module, the alarm and the information display module are human-computer interaction modules, and the real-time face, voice matching module and information collection module are real-time internal modules.
图4是本发明优选实施例通过大数据实时跟踪人的体系架构图,架构中各模块之间关系如图4所示。FIG. 4 is a schematic diagram of a system for tracking people in real time through big data according to a preferred embodiment of the present invention. The relationship between modules in the architecture is as shown in FIG. 4 .
系统总体上分为三层:跟踪采集层(相当于上述实施例中获取模块22)、跟踪处理层(相当于上述实施例中匹配模块24)和跟踪人机交互层(包括上述实施例中告警模块34),跟踪采集层就是判定跟踪用户所需信息的采集,主要完成监控图片的上报、侦听语音的上报及其他如微信、用卡记录的上报;跟踪处理层主要是用于上报数据与被跟踪人的信息匹配,主要包含人脸识别、声纹识别,由于所需要处理的数据量大,所以需要是分布式的流式处理框架,可以为Apache Storm、Spark Streaming,但是不限于以上两种;跟踪人机交互层主要完成被跟踪人信息的录入,以及相关判定成功的信息的告警及展示。The system is generally divided into three layers: a tracking acquisition layer (corresponding to the acquisition module 22 in the above embodiment), a tracking processing layer (corresponding to the matching module 24 in the above embodiment), and a tracking human-computer interaction layer (including the alarm in the above embodiment). Module 34), the tracking acquisition layer is to determine the collection of information required by the tracking user, mainly to complete the monitoring image reporting, the listening voice reporting and other reports such as WeChat, card recording; tracking processing layer is mainly used for reporting data and The information of the tracked person matches, mainly including face recognition and voiceprint recognition. Because of the large amount of data to be processed, it needs to be a distributed stream processing framework, which can be Apache Storm or Spark Streaming, but is not limited to the above two. The tracking human-computer interaction layer mainly completes the entry of the tracked person information and the alarm and display of the information related to the successful determination.
图5是本发明优选实施例的系统处理的流程图,如图5所示Figure 5 is a flow chart showing the system processing of the preferred embodiment of the present invention, as shown in Figure 5.
步骤S501:被跟踪人图片、声纹或者卡片信息录入,具体由人机界面的系统录入模块提供操作界面,用户将图片、声纹或者卡片信息上传后,由系统录入模块持久化,并传送给匹配模块,匹配模块将各个用户的信息加载入系统中,用于后续匹配过程中逐个匹配;Step S501: the tracked person picture, voiceprint or card information is entered, and the system input module of the human-machine interface provides an operation interface. After the user uploads the picture, voiceprint or card information, the system input module is persistent and transmitted to the system. Matching module, the matching module loads the information of each user into the system, and is used to match one by one in the subsequent matching process;
步骤S502:监控需要部署软件,将视频进行周期性的图片获取,如获取视频中每个5秒 间隔的图片,将图片通过实时消息发送给匹配模块,方式可以是集群方式的消息总线,可以是kafka但不限于此种消息总线,避免单点故障及瓶颈,上报的时候需要同时上报本监控的唯一标识,用于当匹配之后锁定具体的位置信息;语音侦听需要侦听被跟踪人相关家庭关系、社会关系人员的固话或移动电话,相关语音进行窗口期的获取,如获取5秒这段时间的语音后就上报,上报也为实时消息方式发送,方式可以是集群方式的消息总线,可以是kafka但不限于此种消息总线,避免单点故障及瓶颈,上报的时候需要同时上报本次呼叫的主叫号码、被叫号码信息;用卡监听负责记录被跟踪人的银行刷卡信息和刷卡地点,将信息上报匹配模块。Step S502: monitoring needs to deploy software, and performing periodic image acquisition on the video, such as acquiring 5 seconds in the video. The image of the interval is sent to the matching module through a real-time message. The method can be a message bus in a cluster mode, which can be kafka, but is not limited to such a message bus, avoiding single point of failure and bottlenecks, and reporting the monitoring at the same time. The unique identifier is used to lock the specific location information after the matching; the voice interception needs to listen to the related family relationship of the tracked person, the fixed line of the social relationship person or the mobile phone, and the relevant voice performs the window period acquisition, such as acquiring 5 seconds. After the speech of the segment time is reported, the report is also sent in the form of a real-time message. The method can be a message bus in a cluster mode, which can be kafka but not limited to such a message bus, to avoid single point of failure and bottleneck, and to report the report at the same time. The calling number and the called number information of the secondary call; the card monitoring is responsible for recording the bank card information of the tracked person and the card swipe location, and reporting the information to the matching module.
步骤S503:匹配模块在收到上报的信息之后,判断是图片信息、用卡信息或者语音信息,Step S503: After receiving the reported information, the matching module determines that it is picture information, card information or voice information.
步骤S504:在判断为图片信息之后,与待跟踪人员列表中的图片进行人脸比对,如果没有符合条件的,则本次结束,如果有符合条件的,则上报该人员、监控标识、上报的图片信息传送给告警展示模块。Step S504: After the image information is determined, the face in the list of the person to be tracked is compared with the face. If the condition is not met, the current time ends. If the condition is met, the person, the monitoring indicator, and the report are reported. The picture information is transmitted to the alarm display module.
步骤S505:在判断为语音信息之后,与待跟踪人员列表中的声纹进行声纹比对,如果没有符合条件的,则本次结束,如果有符合条件的,则上报该人员、主叫号码、被叫号码、上报的语音信息传送给告警展示模块。Step S505: After the voice information is determined, the voiceprint is compared with the voiceprint in the list of persons to be tracked. If there is no condition, the current end is ended. If the condition is met, the person and the calling number are reported. The called number and the reported voice information are transmitted to the alarm display module.
步骤S506:在判断为用卡信息之后,与待跟踪人员列表中的身份特征信息进行用卡比对,如果没有符合条件的,则本次结束,如果有符合条件的,则上报该人员的用卡信息,刷卡地址传送给告警展示模块。Step S506: After determining that the card information is used, the card is compared with the identity feature information in the to-be-tracked person list. If the condition is not met, the current time ends. If the condition is met, the person is reported. Card information, the card address is transmitted to the alarm display module.
步骤S507:告警模块在收到提示信息之后,人工进行人员核对,针对于监控方式提供周边警力的调配联系方式,进一步可以直接下发告警去周边的系统中,针对于语音的可以根据手机主被叫号码进行基站三角定位,获取相关位置信息,一样提供周边警力的调配联系方式,进一步可以直接下发告警去周边的系统中以及时的进行警力调动。Step S507: After receiving the prompt information, the alarm module manually performs personnel check, and provides a matching contact manner for the surrounding police force for the monitoring mode, and further can directly send an alarm to the surrounding system, and the voice can be based on the mobile phone master. Call the number to perform the triangulation of the base station, obtain the relevant location information, and provide the matching contact information of the surrounding police force. Further, the alarm can be directly sent to the surrounding system to perform the police force transfer in time.
在步骤S502中获取到的数据,考虑到个人隐私问题,不进行持久化,只有在条件匹配的时候才上传至人机交互模块,避免法律风险。The data acquired in step S502 is not persisted in consideration of personal privacy issues, and is uploaded to the human-computer interaction module only when the conditions are matched, thereby avoiding legal risks.
进一步,当数据量过大的时候,该系统可以由多个组成,如按照市划分省的,省的信息由所有的市进行提供,各个市仅需上报符合条件的数据,在各个地方录入的跟踪人员,同步到全省的系统中。即通过类似行政层级的方式组建该系统,进行扩展。Further, when the amount of data is too large, the system can be composed of a plurality of components, for example, according to the city, the provincial information is provided by all the cities, and each city only needs to report the qualified data and enter the information in various places. Track people and sync to the province's system. That is to say, the system is built up in an administrative-like manner and expanded.
下面结合具体应用场景对本发明进行详细说明。The present invention will be described in detail below in conjunction with specific application scenarios.
场景1:利用人脸识别进行走失儿童、老人的定位Scene 1: Using face recognition to locate lost children and the elderly
儿童由于监护人员的疏忽,经常会发现走失现象,对于家庭的影响冲击很大。往往打110报警之后,由于现有的搜寻方式,导致会有较长时间才能找到,对于家长的心理压力很大。在使用该系统后,当接到110报警之后,将相关遗失儿童的照片进行录入系统进行自动跟踪。由于儿童的遗失一般均在小区、商场、超市发生,所以系统需要接入上述监控系统,同时需 要接入交通部门的监控,以便获取行踪变化的过程。Because of the negligence of guardians, children often find lost, which has a great impact on the family. After the 110 alarm is often used, due to the existing search method, it will take a long time to find, and the psychological pressure on the parents is great. After using the system, after receiving the 110 alarm, the photos of the related lost children are entered into the system for automatic tracking. Since the loss of children generally occurs in the community, shopping malls, supermarkets, the system needs to access the above monitoring system, and at the same time To access the monitoring of the transportation department, in order to obtain the process of change of whereabouts.
老人走失已成为一个越来越严重的社会问题。据了解,走失的老人以老年痴呆症患者居多。曾有媒体分析,老人的频频走失除了与自身疾病有关外,城市建设和生活方式的不断改变,也是让他们容易迷失的原因。而且现在“空巢老人”越来越多,他们日常生活中成员单一、乏人照顾,走失了一时很难知道。由于现有的搜寻方式,导致会有较长时间才能找到;同时家属往往要耗费很多精力,找到后还要防范再次出现这种情况,同时在很大程度给警方带来较大工作量。据心理医生分析,一次走失经历,也会给老人心理上带来很大创伤。在使用该系统后,当接到110报警之后,将相关遗失老人的照片进行录入系统进行自动跟踪。The loss of the elderly has become an increasingly serious social problem. It is understood that the elderly who are lost are mostly elderly patients with Alzheimer's disease. There have been media analysis that the frequent loss of the elderly is not only related to their own diseases, but also the constant changes in urban construction and lifestyle, which is why they are easily lost. Moreover, there are more and more "empty-nest elderly people". They have single members and no one to take care of in their daily lives. It is difficult to know when they are lost. Due to the existing search methods, it will take a long time to find; at the same time, family members often have to spend a lot of energy, and after the founding, they must prevent this from happening again, and at the same time bring a lot of work to the police. According to the analysis of psychologists, a lost experience will also bring great trauma to the elderly. After using the system, after receiving the 110 alarm, the photos of the relevant lost old people are entered into the system for automatic tracking.
具体实施步骤如下:The specific implementation steps are as follows:
步骤11、接入小区、商场、超市及交通部门的监控设备,同时对于监控设备进行编号;Step 11. Access the monitoring equipment of the community, the shopping mall, the supermarket, and the transportation department, and number the monitoring equipment at the same time;
步骤12、在110报警台部署该系统,当接到儿童或老人走失的时候,获取走失儿童或老人的照片,将其录入系统进行自动跟踪;Step 12: deploy the system at the 110 alarm station, and when receiving the loss of the child or the elderly, obtain a photo of the lost child or the old person, and enter it into the system for automatic tracking;
步骤13、在监控匹配与走失儿童或老人图片定时(5秒)进行匹配。如果不匹配则进行下一个;匹配则进入流程4;Step 13. Match the monitoring match with the lost child or old man picture timing (5 seconds). If there is no match, proceed to the next one; the match proceeds to process 4;
步骤14、匹配模块在匹配到走失儿童或老人的监控的时候,将相关的监控标识,及相关的图片上报至告警展示模块;Step 14: When the matching module matches the monitoring of the lost child or the elderly, the related monitoring identifier and related pictures are reported to the alarm display module;
步骤15、告警展示模块在收到相关的图片及信息之后进行展示,操作员人工核对是否为走失儿童或老人,亦可将照片发给相关人员的父母确认,同时进行周边警力的协调,因为此时及时性很重要;Step 15. The alarm display module displays after receiving the relevant pictures and information. The operator manually checks whether the child is lost or the elderly, and can also send the photo to the parent of the relevant personnel for confirmation, and at the same time coordinate the surrounding police force, because this Timeliness is important;
步骤16、确认不是走失儿童或老人后,撤回警力;如果是,则警力继续进行查找过程。Step 16. Confirm that the police force is not lost or the elderly; if yes, the police force continues the search process.
场景2:利用用卡记录进行罪犯的定位Scenario 2: Using card records to locate criminals
具体实施步骤如下:The specific implementation steps are as follows:
步骤21、接入银行ATM机的用卡记录,接入商场等的POS机;Step 21: accessing the card of the bank ATM machine, accessing the POS machine of the shopping mall or the like;
步骤22、在系统中录入罪犯的身份证信息,系统将身份证信息下发给匹配模块;Step 22: Entering the ID card information of the criminal in the system, and the system sends the ID information to the matching module;
步骤23、接入的ATM、POS机在每笔交易产生时,上报给采集模块身份证信息、及ATM或者POS机所在位置;Step 23: The ATM and POS machines that are accessed are reported to the collection module identity card information, and the location of the ATM or POS machine when each transaction is generated;
步骤24、匹配模块在匹配到罪犯身份证信息之后,上报告警给展示模块,同时携带ATM及POS的位置信息;Step 24: After matching the identity card information of the criminal, the matching module reports the alarm to the display module, and carries the location information of the ATM and the POS;
步骤25、告警展示模块在收到相关的信息之后进行展示,同时根据ATM或者POS的位置信息进行周边的警力调度。Step 25: The alarm display module displays after receiving the relevant information, and performs peripheral police force scheduling according to the location information of the ATM or the POS.
场景3:利用声纹识别、语音识别进行罪犯的定位 Scene 3: Using voiceprint recognition and speech recognition to locate criminals
罪犯的追踪现在缺少行之有效的方法,搜索很多时候根据重要程度进行警力投入。悬赏的方式很多时候反应了对罪犯的重要程度,以及手段有限的一种体现。投入很大但是效果不明显是现阶段亟待解决的问题。The tracking of criminals is now lacking effective methods, and the search is often based on the importance of police input. The way of rewarding often reflects the importance of the offender and a manifestation of limited means. The investment is big but the effect is not obvious is the problem that needs to be solved at this stage.
在使用该系统后,将相关罪犯的声纹进行录入系统进行自动跟踪。After using the system, the voiceprints of the relevant criminals are entered into the system for automatic tracking.
具体实施步骤如下:The specific implementation steps are as follows:
步骤31、对罪犯的家庭关系、社会关系进行分析,找出相关人员的固话、移动电话的信息,将其收集;Step 31: Analyze the family relationship and social relationship of the offender, find out the information of the fixed person and the mobile phone of the relevant personnel, and collect the information;
步骤32、将收集的号码进行录入系统,同时将罪犯的声纹也录入系统,系统进行自动跟踪语音侦听。这个是高效但是不全面的方式,如果要全面需要对所有的语音进行侦听;Step 32: The collected number is entered into the system, and the voiceprint of the criminal is also recorded into the system, and the system automatically tracks the voice detection. This is an efficient but not comprehensive approach, if you want to fully listen to all voices;
步骤33、在侦听语音定时(5秒)进行上报,首先进行声纹匹配。如果不匹配则进行下一个;匹配则进入流程5;Step 33: Performing a report on the listening voice timing (5 seconds), first performing voiceprint matching. If there is no match, proceed to the next one; the match proceeds to process 5;
步骤34、然后进行语音识别,主要是根据罪犯的姓名、外号、别称,如果在语音中找到识别出相关信息,则进入流程5;Step 34, and then perform speech recognition, mainly according to the name, nickname, and other name of the criminal, if it is found in the voice to identify the relevant information, then proceeds to process 5;
步骤35、匹配模块在匹配到罪犯的声纹或者是识别出相应的人名、外号、别称的时候,将相关通话的语音,及相关的主被叫号码及其信息上报至告警展示模块;Step 35: When the matching module matches the voiceprint of the criminal or identifies the corresponding person name, nickname, and other name, the voice of the related call, and the related calling and called number and the information thereof are reported to the alarm display module;
步骤36、告警展示模块在收到声音及信息之后进行展示,操作员人工核对是否为所跟踪罪犯,同时由号码进行号码定位,进行周边警力的协调;Step 36: The alarm display module displays after receiving the sound and the information, and the operator manually checks whether the criminal is tracked, and the number is used to locate the number, and the surrounding police force is coordinated;
步骤37、确认不是所跟踪罪犯后,撤回警力;如果是,则警力继续进行查找过程。Step 37: After confirming that the offender is not being tracked, withdraw the police force; if yes, the police force continues the search process.
场景4:利用人脸识别进行罪犯的定位Scene 4: Using face recognition to locate criminals
罪犯的追踪现在缺少行之有效的方法,搜索很多时候根据重要程度进行警力投入。悬赏的方式很多时候反应了对罪犯的重要程度,以及手段有限的一种体现。投入很大但是效果不明显是现阶段亟待解决的问题。The tracking of criminals is now lacking effective methods, and the search is often based on the importance of police input. The way of rewarding often reflects the importance of the offender and a manifestation of limited means. The investment is big but the effect is not obvious is the problem that needs to be solved at this stage.
在使用该系统后,将相关罪犯的照片进行录入系统进行自动跟踪。After using the system, the relevant criminal's photos are entered into the system for automatic tracking.
具体实施步骤如下:The specific implementation steps are as follows:
步骤41、接入小区、商场、超市及交通部门的监控设备,同时对于监控设备进行编号;Step 41: access the monitoring equipment of the community, the shopping mall, the supermarket, and the transportation department, and number the monitoring equipment at the same time;
步骤42、获取罪犯的照片,将其录入系统进行自动跟踪;Step 42: Obtain a photo of the criminal, and enter it into the system for automatic tracking;
步骤43、在监控匹配与罪犯图片定时(5秒)进行匹配。如果不匹配则进行下一个;匹配则进入流程4;Step 43, matching the monitoring match with the offender picture timing (5 seconds). If there is no match, proceed to the next one; the match proceeds to process 4;
步骤44、匹配模块在匹配到罪犯的监控的时候,将相关的监控标识,及相关的图片上报至告警展示模块; Step 44: When the matching module matches the monitoring of the criminal, the related monitoring identifier and related pictures are reported to the alarm display module.
步骤45、告警展示模块在收到相关的图片及信息之后进行展示,操作员人工核对是否为罪犯,同时进行周边警力的协调,因为此时及时性很重要;Step 45: The alarm display module displays after receiving the relevant pictures and information, and the operator manually checks whether the criminal is a criminal, and simultaneously coordinates the surrounding police force, because timeliness is important at this time;
步骤46、确认不是罪犯后,撤回警力;如果是,则警力继续进行查找过程。Step 46: After confirming that it is not a criminal, withdraw the police force; if yes, the police force continues the search process.
本发明优选实施例通过大数据实时人脸及语音识别进行失踪人口、罪犯跟踪的系统,与现有的罪犯追踪、失踪人口查询相比,首先做到了自动化,很大程度的提高了准确性和效率,其次实时的特性,在两种场景下对于时效性较高,同时结合现在的大数据技术提高时效性,使得相关的信息更加及时、有效。The preferred embodiment of the present invention performs a system for missing persons and criminals tracking through big data real-time face and speech recognition. Compared with the existing criminal tracking and missing population query, the system is first automated, and the accuracy is greatly improved. Efficiency, followed by real-time characteristics, is more time-efficient in both scenarios, and combined with the current big data technology to improve timeliness, making related information more timely and effective.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,或者网络设备等)执行本发明各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, The optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present invention.
本发明的实施例还提供了一种存储介质。可选地,在本实施例中,上述存储介质可以被设置为存储用于执行上述实施例步骤的程序代码:Embodiments of the present invention also provide a storage medium. Optionally, in this embodiment, the foregoing storage medium may be configured to store program code for performing the steps of the foregoing embodiments:
可选地,存储介质还被设置为存储用于执行上述实施例步骤的程序代码:Optionally, the storage medium is further arranged to store program code for performing the steps of the above-described embodiments:
可选地,在本实施例中,上述存储介质可以包括但不限于:U盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。Optionally, in this embodiment, the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory. A variety of media that can store program code, such as a disc or a disc.
可选地,在本实施例中,处理器根据存储介质中已存储的程序代码执行上述实施例的方法步骤。Optionally, in this embodiment, the processor performs the method steps of the foregoing embodiments according to the stored program code in the storage medium.
可选地,本实施例中的具体示例可以参考上述实施例及可选实施方式中所描述的示例,本实施例在此不再赘述。For example, the specific examples in this embodiment may refer to the examples described in the foregoing embodiments and the optional embodiments, and details are not described herein again.
显然,本领域的技术人员应该明白,上述的本发明的各模块或各步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,可选地,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,并且在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本发明不限制于任何特定的硬件和软件结合。It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.
以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。 The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.
工业实用性Industrial applicability
基于本发明实施例提供的上述技术方案,获取在预设区域范围内的监控数据;将预先存储的待识别人员的特征信息与该监控数据进行匹配;在匹配一致的情况下,确定该监控数据中包括该待识别人员的数据,解决了追踪人的时效性差,不能及时有效找到追踪人的问题,提高了搜寻效率,搜索结果更加准确及时。 According to the foregoing technical solution provided by the embodiment of the present invention, the monitoring data in the preset area is acquired; the feature information of the to-be-identified person stored in advance is matched with the monitoring data; and if the matching is consistent, the monitoring data is determined. The data of the person to be identified is included, the timeliness of the tracking person is solved, the problem of tracking the person cannot be effectively found in time, the search efficiency is improved, and the search result is more accurate and timely.

Claims (17)

  1. 一种人员识别处理方法,包括:A method for personnel identification processing, comprising:
    获取在预设区域范围内的监控数据;Obtain monitoring data within a preset area;
    将预先存储的待识别人员的特征信息与所述监控数据进行匹配;Matching the pre-stored feature information of the person to be identified with the monitoring data;
    在匹配一致的情况下,确定所述监控数据中包括所述待识别人员的数据。In case the matching is consistent, it is determined that the monitoring data includes data of the person to be identified.
  2. 根据权利要求1所述的方法,其中,其中,所述特征信息包括以下至少之一:The method of claim 1, wherein the feature information comprises at least one of:
    人脸特征信息,声纹信息,身份特征信息。Face feature information, voiceprint information, identity feature information.
  3. 根据权利要求2所述的方法,其中,所述身份特征信息包括:The method of claim 2 wherein said identity characteristic information comprises:
    所述待识别人员的电话号码,所述待识别人员的身份证信息,所述待识别人员的银行卡信息,所述待识别人员的名称信息。The telephone number of the person to be identified, the identity card information of the person to be identified, the bank card information of the person to be identified, and the name information of the person to be identified.
  4. 根据权利要求1所述的方法,其中,确定所述监控数据中包括所述待识别人员的数据之后,还包括以下至少之一:The method according to claim 1, wherein after determining that the monitoring data includes the data of the person to be identified, at least one of the following is further included:
    依据所述监控数据中的位置信息确认所述待识别人员的当前位置信息;Confirming current location information of the to-be-identified person according to location information in the monitoring data;
    发送告警信息,其中,所述告警信息携带有所述监控数据中所述待识别人员的数据;Sending alarm information, where the alarm information carries data of the to-be-identified person in the monitoring data;
    显示所述监控数据中所述待识别人员的数据。Displaying data of the person to be identified in the monitoring data.
  5. 根据权利要求1所述的方法,其中,所述预先存储的待识别人员的特征信息中还包括:The method according to claim 1, wherein the pre-stored feature information of the person to be identified further includes:
    所述待识别人员的关联人员的特征信息。Characteristic information of the associated person of the person to be identified.
  6. 根据权利要求1所述的方法,其中,所述监控数据包括以下至少之一:The method of claim 1 wherein said monitoring data comprises at least one of:
    视频监控数据,语音监控数据,银行卡的用卡记录数据,电话网络的通讯数据,互联网网络的通讯数据。Video surveillance data, voice monitoring data, card recording data for bank cards, communication data for telephone networks, and communication data for Internet networks.
  7. 根据权利要求1所述的方法,其中,获取在预设区域范围内的监控数据的方式包括:The method according to claim 1, wherein the manner of acquiring monitoring data within a preset area includes:
    通过集群方式的消息总线或高吞吐量的分布式发布订阅消息系统kafka的消息总线获取所述监控数据。The monitoring data is obtained by a message bus of a cluster mode or a message bus of a high-throughput distributed publish-subscribe messaging system kafka.
  8. 根据权利要求1至7中任一项所述的方法,其中,将预先存储的待识别人员的特征信息与所述监控数据进行匹配,包括:The method according to any one of claims 1 to 7, wherein matching pre-stored feature information of the person to be identified with the monitoring data comprises:
    将所述特征信息与所述监控数据中不同类型的数据采用分布式的流式处理框架进行匹配。The feature information is matched with different types of data in the monitoring data by a distributed streaming processing framework.
  9. 一种人员识别处理装置,包括:A personnel identification processing device includes:
    获取模块,设置为获取在预设区域范围内的监控数据; Obtaining a module, configured to acquire monitoring data within a preset area;
    匹配模块,设置为将预先存储的待识别人员的特征信息与所述监控数据进行匹配;a matching module, configured to match pre-stored feature information of the person to be identified with the monitoring data;
    确定模块,设置为在匹配一致的情况下,确定所述监控数据中包括所述待识别人员的数据。The determining module is configured to determine, in the case that the matching is consistent, the data of the to-be-identified person included in the monitoring data.
  10. 根据权利要求9所述的装置,其中,其中,所述特征信息包括以下至少之一:The apparatus of claim 9, wherein the feature information comprises at least one of:
    人脸特征信息,声纹信息,身份特征信息。Face feature information, voiceprint information, identity feature information.
  11. 根据权利要求10所述的装置,其中,所述身份特征信息包括:The apparatus of claim 10 wherein said identity characteristic information comprises:
    所述待识别人员的电话号码,所述待识别人员的身份证信息,所述待识别人员的银行卡信息,所述待识别人员的名称信息。The telephone number of the person to be identified, the identity card information of the person to be identified, the bank card information of the person to be identified, and the name information of the person to be identified.
  12. 根据权利要求9所述的装置,其中,所述装置还包括:The apparatus of claim 9 wherein said apparatus further comprises:
    定位模块,设置为依据所述监控数据中的位置信息确认所述待识别人员的当前位置信息;a positioning module, configured to confirm current location information of the to-be-identified person according to location information in the monitoring data;
    告警模块,设置为发送告警信息,其中,所述告警信息携带有所述监控数据中所述待识别人员的数据;The alarm module is configured to send alarm information, where the alarm information carries data of the to-be-identified person in the monitoring data;
    显示模块,设置为显示所述监控数据中所述待识别人员的数据。a display module configured to display data of the person to be identified in the monitoring data.
  13. 根据权利要求9所述的装置,其中,所述预先存储的待识别人员的特征信息中还包括:The device according to claim 9, wherein the pre-stored feature information of the person to be identified further includes:
    所述待识别人员的关联人员的特征信息。Characteristic information of the associated person of the person to be identified.
  14. 根据权利要求9所述的装置,其中,所述监控数据包括以下至少之一:The apparatus of claim 9, wherein the monitoring data comprises at least one of:
    视频监控数据,语音监控数据,银行卡的用卡记录数据,电话网络的通讯数据,互联网网络的通讯数据。Video surveillance data, voice monitoring data, card recording data for bank cards, communication data for telephone networks, and communication data for Internet networks.
  15. 根据权利要求9所述的装置,其中,获取在预设区域范围内的监控数据的方式包括:The apparatus according to claim 9, wherein the manner of acquiring monitoring data within a preset area includes:
    通过集群方式的消息总线或高吞吐量的分布式发布订阅消息系统kafka的消息总线获取所述监控数据。The monitoring data is obtained by a message bus of a cluster mode or a message bus of a high-throughput distributed publish-subscribe messaging system kafka.
  16. 根据权利要求9至15中任一项所述的装置,其中,将预先存储的待识别人员的特征信息与所述监控数据进行匹配,包括:The apparatus according to any one of claims 9 to 15, wherein matching the feature information of the person to be identified that is pre-stored with the monitoring data comprises:
    将所述特征信息与所述监控数据中不同类型的数据采用分布式的流式处理框架进行匹配。The feature information is matched with different types of data in the monitoring data by a distributed streaming processing framework.
  17. 一种人员识别处理的系统,包括:跟踪人机交互层、跟踪采集层、跟踪处理层;A system for personnel identification processing includes: tracking a human-computer interaction layer, tracking an acquisition layer, and tracking a processing layer;
    所述跟踪人机交互层获取待识别人员的特征信息;The tracking human-machine interaction layer acquires feature information of the person to be identified;
    所述跟踪采集层获取在预设区域范围内的监控数据; The tracking acquisition layer acquires monitoring data within a preset area;
    所述跟踪处理层将所述待识别人员的特征信息与所述监控数据进行匹配;The tracking processing layer matches the feature information of the person to be identified with the monitoring data;
    所述跟踪处理层在匹配一致的情况下,确定所述监控数据中包括所述待识别人员的数据。 The tracking processing layer determines, in the case that the matching is consistent, the data of the to-be-identified person included in the monitoring data.
PCT/CN2016/078901 2016-01-08 2016-04-08 Personal identification processing method, apparatus and system WO2017117879A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610015535.5A CN106960172A (en) 2016-01-08 2016-01-08 Personal identification processing method, apparatus and system
CN201610015535.5 2016-01-08

Publications (1)

Publication Number Publication Date
WO2017117879A1 true WO2017117879A1 (en) 2017-07-13

Family

ID=59273205

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/078901 WO2017117879A1 (en) 2016-01-08 2016-04-08 Personal identification processing method, apparatus and system

Country Status (2)

Country Link
CN (1) CN106960172A (en)
WO (1) WO2017117879A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108989999A (en) * 2018-08-09 2018-12-11 速度时空信息科技股份有限公司 A kind of community service information issuing system and method based on mobile base station
CN109446276A (en) * 2018-09-19 2019-03-08 平安科技(深圳)有限公司 Order hold-up interception method, device, equipment and medium based on relational data model
CN110276261A (en) * 2019-05-23 2019-09-24 平安科技(深圳)有限公司 Personnel automatically track monitoring method, device, computer equipment and storage medium
CN110443198A (en) * 2019-08-06 2019-11-12 中国工商银行股份有限公司 Personal identification method and device based on recognition of face
CN110738692A (en) * 2018-07-20 2020-01-31 广州优亿信息科技有限公司 spark cluster-based intelligent video identification method
CN113128286A (en) * 2019-12-31 2021-07-16 航天信息股份有限公司 Face recognition device
CN113438272A (en) * 2021-05-20 2021-09-24 江苏谷德运维信息技术有限公司 Safety monitoring system based on big data
CN114513751A (en) * 2021-03-25 2022-05-17 深圳警圣技术股份有限公司 Personnel identification and positioning tracking system and method based on 5G wireless network
CN114913653A (en) * 2022-04-27 2022-08-16 北京良安科技有限公司 Monitoring method, device, equipment and medium for granary storage safety

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107948524A (en) * 2017-12-21 2018-04-20 重庆金鑫科技产业发展有限公司 A kind of camera
CN108039007A (en) * 2017-12-26 2018-05-15 北斗七星(重庆)物联网技术有限公司 A kind of safety protection method and device
CN108038468A (en) * 2017-12-26 2018-05-15 北斗七星(重庆)物联网技术有限公司 A kind of security terminal based on recognition of face
CN108364442A (en) * 2018-02-14 2018-08-03 成都太航科技有限公司 A kind of combination person of reporting a case to the security authorities information and the alarm system of position positioning
CN108960048B (en) * 2018-05-23 2021-05-25 国政通科技股份有限公司 Big data-based search method and system for scenic spot missing tourists
CN109407829A (en) * 2018-09-18 2019-03-01 孔军民 A kind of man-machine interactive system and exchange method applied to fitness equipment
CN110191170B (en) * 2019-05-24 2022-05-17 山西共致科技有限公司 Live photo broadcasting system with face recognition function and method thereof
CN110569720B (en) * 2019-07-31 2022-06-07 安徽四创电子股份有限公司 Audio and video intelligent identification processing method based on audio and video processing system
CN110909629B (en) * 2019-11-06 2023-04-07 浙江大华技术股份有限公司 Face recognition data processing method and device, computer equipment and storage medium
CN111737309A (en) * 2020-05-22 2020-10-02 深圳市天彦通信股份有限公司 User management method and related product
CN111770310A (en) * 2020-07-02 2020-10-13 广州博冠智能科技有限公司 Lost child identification and positioning method and device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102073849A (en) * 2010-08-06 2011-05-25 中国科学院自动化研究所 Target image identification system and method
CN103051705A (en) * 2012-12-19 2013-04-17 中兴通讯股份有限公司 Method and device for determining target person and mobile terminal
CN103902734A (en) * 2014-04-21 2014-07-02 沈阳汇知网络科技有限公司 Missing person finding system
CN103902964A (en) * 2012-12-31 2014-07-02 深圳先进技术研究院 Face recognition method
CN104580121A (en) * 2013-10-28 2015-04-29 腾讯科技(深圳)有限公司 People search/people information matching and pushing method, system, client and server
CN104657817A (en) * 2015-01-28 2015-05-27 四川君逸易视科技有限公司 Face snapshotting, comparing, identifying, retrieving, and inquiring method for bank counter

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070036395A1 (en) * 2005-08-15 2007-02-15 Okun Sheri L Reverse identity profiling system with alert function
CN101140620A (en) * 2007-10-16 2008-03-12 上海博航信息科技有限公司 Human face recognition system
US8549028B1 (en) * 2008-01-24 2013-10-01 Case Global, Inc. Incident tracking systems and methods
US20100290677A1 (en) * 2009-05-13 2010-11-18 John Kwan Facial and/or Body Recognition with Improved Accuracy
CN102427521A (en) * 2011-09-28 2012-04-25 福州海景科技开发有限公司 Mobile supervision method based on face recognition technology
CN103246869B (en) * 2013-04-19 2016-07-06 福建亿榕信息技术有限公司 Method is monitored in crime based on recognition of face and behavior speech recognition
CN203278900U (en) * 2013-06-18 2013-11-06 西安博宇信息科技有限公司 Space-air-ground integrated Beidou emergency command system
CN104486107A (en) * 2014-12-05 2015-04-01 曙光信息产业(北京)有限公司 Log collection device and method
CN104881429A (en) * 2015-04-09 2015-09-02 电信科学技术第五研究所 Big data based automatic missing children recognition system and recognition method thereof
CN105045914B (en) * 2015-08-18 2018-10-09 瑞达昇科技(大连)有限公司 Information reductive analysis method and device
JP6885682B2 (en) * 2016-07-15 2021-06-16 パナソニックi−PROセンシングソリューションズ株式会社 Monitoring system, management device, and monitoring method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102073849A (en) * 2010-08-06 2011-05-25 中国科学院自动化研究所 Target image identification system and method
CN103051705A (en) * 2012-12-19 2013-04-17 中兴通讯股份有限公司 Method and device for determining target person and mobile terminal
CN103902964A (en) * 2012-12-31 2014-07-02 深圳先进技术研究院 Face recognition method
CN104580121A (en) * 2013-10-28 2015-04-29 腾讯科技(深圳)有限公司 People search/people information matching and pushing method, system, client and server
CN103902734A (en) * 2014-04-21 2014-07-02 沈阳汇知网络科技有限公司 Missing person finding system
CN104657817A (en) * 2015-01-28 2015-05-27 四川君逸易视科技有限公司 Face snapshotting, comparing, identifying, retrieving, and inquiring method for bank counter

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110738692A (en) * 2018-07-20 2020-01-31 广州优亿信息科技有限公司 spark cluster-based intelligent video identification method
CN108989999A (en) * 2018-08-09 2018-12-11 速度时空信息科技股份有限公司 A kind of community service information issuing system and method based on mobile base station
CN109446276B (en) * 2018-09-19 2024-02-02 平安科技(深圳)有限公司 Order interception method, device, equipment and medium based on relational data model
CN109446276A (en) * 2018-09-19 2019-03-08 平安科技(深圳)有限公司 Order hold-up interception method, device, equipment and medium based on relational data model
CN110276261A (en) * 2019-05-23 2019-09-24 平安科技(深圳)有限公司 Personnel automatically track monitoring method, device, computer equipment and storage medium
CN110276261B (en) * 2019-05-23 2024-04-09 平安科技(深圳)有限公司 Personnel automatic tracking and monitoring method and device, computer equipment and storage medium
CN110443198A (en) * 2019-08-06 2019-11-12 中国工商银行股份有限公司 Personal identification method and device based on recognition of face
CN113128286A (en) * 2019-12-31 2021-07-16 航天信息股份有限公司 Face recognition device
CN113128286B (en) * 2019-12-31 2024-02-13 航天信息股份有限公司 Face recognition device
CN114513751A (en) * 2021-03-25 2022-05-17 深圳警圣技术股份有限公司 Personnel identification and positioning tracking system and method based on 5G wireless network
CN113438272A (en) * 2021-05-20 2021-09-24 江苏谷德运维信息技术有限公司 Safety monitoring system based on big data
CN114913653B (en) * 2022-04-27 2023-02-21 北京良安科技有限公司 Monitoring method, device, equipment and medium for granary storage safety
CN114913653A (en) * 2022-04-27 2022-08-16 北京良安科技有限公司 Monitoring method, device, equipment and medium for granary storage safety

Also Published As

Publication number Publication date
CN106960172A (en) 2017-07-18

Similar Documents

Publication Publication Date Title
WO2017117879A1 (en) Personal identification processing method, apparatus and system
US10178537B2 (en) Emergency messaging system and method of responding to an emergency
WO2017193735A1 (en) Trace obtaining method and device for video surveillance system
US8275096B2 (en) System and method for security monitoring and response delivery
JP5747116B1 (en) Security system
US9843611B2 (en) Incident data collection for public protection agencies
CN108540755B (en) Identity recognition method and device
WO2013182101A1 (en) Method, device and mobile terminal for determining target person
CN104205127A (en) Recognition-based security
US11610405B2 (en) System and method for correlating electronic device identifiers and vehicle information
US11778424B2 (en) Evacuation tracking
CN109657025A (en) Inspection of the scene of a crime Information Collection System and inspection of the scene of a crime management system
CN109543566A (en) Information processing method and device, electronic equipment and storage medium
US10484815B1 (en) Managing communications based upon location information associated with electronic files exchanged during the communications
US11044280B1 (en) Location-based controls for remote visitation in controlled-environment facilities
CN111461943A (en) Community correction management terminal system based on artificial intelligence fusion technology
WO2013032919A1 (en) Systems and methods for automatic content communication
US11290753B1 (en) Systems and methods for adaptive livestreaming
CN111372197B (en) Early warning method and related device
CN111489276B (en) Personnel management method and related device
AU2013201326B2 (en) A Method and System for Generating a Report
JP2012027603A (en) Server device, delivery determination method, delivery determination program and recording medium
KR102452918B1 (en) System for providing location based missing person reporting and real-time missing person alarming service
WO2016114378A1 (en) Information collection system, information collection device, information collection terminal, information collection method, and information collection program
US20220237183A1 (en) Method and system for identifying the existence of matched entities in reachable proximity

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16883023

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16883023

Country of ref document: EP

Kind code of ref document: A1