GB2499449A - Surveillance by face recognition using colour display of images - Google Patents
Surveillance by face recognition using colour display of images Download PDFInfo
- Publication number
- GB2499449A GB2499449A GB1202817.1A GB201202817A GB2499449A GB 2499449 A GB2499449 A GB 2499449A GB 201202817 A GB201202817 A GB 201202817A GB 2499449 A GB2499449 A GB 2499449A
- Authority
- GB
- United Kingdom
- Prior art keywords
- face image
- face
- target
- face recognition
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 claims abstract description 48
- 239000003086 colorant Substances 0.000 claims description 2
- 239000007787 solid Substances 0.000 claims description 2
- 230000001960 triggered effect Effects 0.000 abstract 1
- 238000012544 monitoring process Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000006467 substitution reaction Methods 0.000 description 2
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/10—Recognition assisted with metadata
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The method includes the steps of: first building up a face recognition database in a storage medium comprising a plurality of face images S10; taking dynamic videos via an image capture device and showing the dynamic videos in the display device S20; performing face recognition to find the target face image in each dynamic video S30, and then determining the target face image as being matched or non-matched by comparing the target face image with the face images in the database; and finally marking the matched and non-matched face images by different colored frames, respectively S40. In addition, the most similar faces to a non-matched face are displayed in a further colour. Therefore, the method of the present invention can dynamically mark the target face images by images, colored frames and/or text to provide a solution of surveillance with high safety and efficiency. Green may be chosen for the matched cases, and red of the non-matched cases. An alarm may also be triggered by the non-matching cases.
Description
METHOD OF SURVEILLANCE BY FACE RECOGNITION
BACKGROUND OF THE INVENTION
1. Field of the Invention
[0001] The present invention generally relates to a method of surveillance, and more 5 specifically to using face recognition to identify and mark the target face image.
2. The Prior Art
[0002] In general, entrance guard of specific scenes needs some on-site surveillance persons using a video camera to take pictures, and some monitoring operators in the remote site watching a monitor connected to the video camera and examining the pictures shown in
10 the monitor for real-time monitoring. Once specific people such as terrorists, suspected criminals, or missing guys, appearing and found, those monitoring operators may take appropriate measures, such as closing the door to stop suspected people or pushing an alarm button to inform the guards to come over to deal with the situation.
[0003] However, one of the shortcomings in the prior arts is that on-site surveillance 15 persons and monitoring operators all have to focus on taking pictures by video camera and examining the pictures in the monitor for a long time, respectively, and it is easy to cause vision fatigue for them, resulting in personal carelessness. Thus, safety for the specific scenes is seriously challenged.
[0004] Therefore, it is desired to provide a method of surveillance by face recognition 20 along with suitable text or mark to solve the above-mentioned problems.
SUMMARY OF THE INVENTION
[0005] To overcome the above-mentioned shortcomings in the prior arts, a method of surveillance by face recognition is provided. The method in accordance with the present invention comprises the steps of: first building up the face recognition database library in a
25 storage medium comprising a plurality of face recognition data, each face recognition data at last comprising a face image and/or a name of a person previously recognized; taking dynamic videos and show the dynamic videos in the display device; performing face recognition by examining the face image in the dynamic videos and ascertaining the respective identity to identify the target and undetermined face images in the face 30 recognition database library, wherein the target face image is matched with at least one of the face images in the face recognition library; and finally marking the target face image
1
with the green frame showing his/her name, and the undetermined face image with the red frame.
[0006] Therefore, the method of the present invention can dynamically mark the target and undetermined face images by names and/or text to provide a solution of surveillance
5 with high efficiency.
BRIEF DESCRIPTION OF THE DRAWINGS
[0007] The present invention can be understood in more detail by reading the subsequent detailed description in conjunction with the examples and references made to the accompanying drawings, wherein:
10 [0008] FIG. 1 shows the flow chart to illustrate the processes of the method according to the present invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
[0009] The present invention may be embodied in various forms and the details of the preferred embodiments of the present invention will be described in the subsequent content
15 with reference to the accompanying drawings. The drawings (not to scale) show and depict only the preferred embodiments of the invention and shall not be considered as limitations to the scope of the present invention. Modifications of the shape of the present invention shall too be considered to be within the spirit of the present invention.
[0010] The flow chart to illustrate the processes of the method of surveillance by face 20 recognition according to the present invention is depicted in FIG. 1. The method of the present invention comprises the steps S10 to S40 sequentially performed to assist on-site surveillants or guards and monitoring operators to real-time monitor entrance of people for specific scenes.
[0011] First, in the step S10, the method according to the present invention starts with 25 building up a face recognition database library which is stored in a storage medium. The face recognition library comprises a plurality of face recognition data, and each face recognition data may comprises at least one of a face image, name, occupation, age, company, number of entering/leaving, and time of entering/leaving of the person previously recognized. The storage medium comprises at least one of solid state hard drive, hard drive, 30 magnetic tape, and non-volatile memory, such as flash memory.
2
[0012] The above face images in the face recognition database library can be generated by taking pictures of human faces via a camera or video camera, or photos scanned by a scanning device, or by downloading through wire or wireless network.
[0013] Then, in the step S20, dynamic videos are taken of some specific site via an 5 image capture device and shown in a display device. The image capture device can be a video camera, surveillance cameras or a device with an image sensor.
[0014] In the step S30, face recognition is performed to examine the dynamic videos displayed in the display device. The face recognition comprises: finding at least a face image with part of human face characteristics in each dynamic videos as a target face image;
10 and identifying the target face image by a first or second identification process based on an identification option selected.
[0015] The above first identification process is to determine the target face image a matched or mismatched face image by comparing the target face image with the face images in the face recognition database library. Specifically, if the target face image matches one of
15 the face images in the face recognition database library, the target face image is determined as the matched face image; or if the target face image does not match any face image in the face recognition database library, the target face image is determined as the mismatched face image.
[0016] The second identification process is to find a plurality of similar face images in 20 the face recognition database library, which similarly match the target face image, and the most similar face image is determined as the qualified matched target face image. For example, if five similar face images are found for the target face, the most similar face image to the target face is the matched face image. Therefore, in the second identification process, there is always a matched face image and no unqualified face image.
25 [0017] Finally, in the step S40, the target face image is marked in a first or second marking manner according to the first or second identification process used in the step 30, respectively.
[0018] In the first marking manner, the target face image determined as the matched face image in the first identification process is marked by a first colored frame with a first 30 color, and the name of the person corresponding to the matched face image can also be displayed. And, the mismatched face image is marked by a second colored frame with a second color. The second color is selected to be different from the first color. For example, the first color is green and the second color is red.
3
[0019] Additionally, to further mark the matched face image, the occupation, age, company, number of entering/leaving, and time of entering/leaving of the person recognized/identified can also be displayed.
[0020] As for the target face image determined by the second identification process in 5 the step 30, the second marking manner is used to mark the most similar target face image by a third colored frame with a third color which is different from the first and second colors, and to display the name of the person corresponding to the most similar face image, or all corresponding names of the plurality of similar face images found in the second identification process. Similarly, other information for the plurality of similar face images 10 can be displayed for reference.
[0021] The step 40 of the method according to the present invention may further comprise an alarm and/or tracking process after said marking the target face image. The alarm and/or tracking process may comprise a step of triggering an alarm, sending an e-mail, sending a message via a mobile phone, and/or make a call via an alarm system for informing
15 some related people, such as the surveillants or guards nearby. And, the alarm and/or tracking process may further comprise a step of tracking and marking the location of the target face image through a platform with a surveillance program or a three-dimensional spatial model.
[0022] The face recognition in the step S30, the process of marking target face image in 20 the step S40 and other post processes can be implemented by executing a specific program with a single chip controller, computer, remote server or other electronic control devices.
[0023] Additionally, the face recognition data may further comprise a strict level for the face recognition to distinguish different levels of strictness desired in the step S30, or to select all or part of the face recognition data displayed in the step S40.
25 [0024] For example, the strict level can be specified as the high, medium, or low security. As for the high security, the face recognition will further determine if the dynamic videos are the video really taken from a real person or just photos, and all related information will be displayed, such as the occupation, age, company, number of entering/leaving, and time of entering/leaving for the identified/recognized person. For the 30 medium security, both the first colored frame and the name of the identified/recognized person are shown, and for the low security, only the first colored frame is shown. [0025] One of the features provided by the present invention is that the on-spot people for guard entrance can easily and clearly monitor the status of entering/leaving by examining the colored frames along with the text such as the name of the identified person
4
shown in the display device. Therefore, the present invention can improve the efficiency of surveillance and reduce the loading of human resource, and is suitable for the gate of the factory, the entrance of large events, the area of big meetings, the door of the office, the airport, the harbor, the train/bus station, or the intersections of the specific roads.
5 [0026] Another feature provided by the present invention is that the face image and basic information of some specific people such as unwelcomed persons, terrorists, suspected criminals, or missing persons can be previously stored in the face recognition database library, and the face image and basic information can be shown in the display device to remind the surveillance people when specific people appear and are recognized/identified. 10 [0027] Although the present invention has been described with reference to the preferred embodiments, it will be understood that the invention is not limited to the details described thereof. Various substitutions and modifications have been suggested in the foregoing description, and others will occur to those of ordinary skill in the art. Therefore, all such substitutions and modifications are intended to be embraced within the scope of the 15 invention as defined in the appended claims.
5
Claims (9)
1. A method of surveillance by face recognition, comprising steps of:
building up a face recognition database library stored in a storage medium, wherein said face recognition database library comprises a plurality of face recognition data, 5 each face recognition data at last comprising a face image and/or a name of a person previously recognized;
taking dynamic videos of a specific site via an image capturing device and showing the dynamic videos in a display device;
performing face recognition to examine the dynamic videos displayed in the display 10 device, wherein said face recognition comprises steps of:
finding at least a face image with part of human face characteristics in each dynamic video as a target face image; and identifying said target face image by a first or second identification process based on an identification option selected, wherein:
15 said first identification process is to determine said target face image is a matched face image if said target face image matches one of said face images in said face recognition database library, or to determine said target face image is a mismatched face image if said target face image does not match anyone of said face images in said face recognition 20 database library; and said second identification process is to find a plurality of similar face images in said face recognition database library, each similarly matching said target face image, and a most similar face image is determined as matched with said target face image; and 25 marking said target face image in a first or second marking manner according to said first or second identification process used, respectively, wherein:
said first marking manner is to mark said target face image as said matched face image determined in said first identification process by a first colored frame with a first color and to display said name of said person corresponding to 30 said matched face image, and to mark said target face image as said mismatched face image determined in said first identification process by a second colored frame with a second color which is different from said first color; and
6
said second marking manner is to mark said target face image with said most similar face image in the plurality of similar face images by a third colored frame with a third color which is different from said first and second colors when said target face image is determined in said second identification 5 process, and to display the name of said person corresponding to said most similar face image, or all corresponding names of the plurality of similar face images found in said second identification process.
2. The method as claimed in claim 1, wherein said storage medium comprises at least one of solid state hard drive, hard drive, magnetic tape, and non-volatile memory.
10
3. The method as claimed in claim 1, wherein said face recognition data further comprises at least one of occupation, age, company, number of entering/leaving, and time of entering/leaving for said person related to said matched face image, said most similar face image or said similar face images used to display in said display device to mark said matched face image, said most similar face image or said similar face images.
15
4. The method as claimed in claim 1, wherein said image capture device comprises a video camera or surveillance cameras.
5. The method as claimed in claim 1, wherein said first colored frame consists of green lines or curves, and said second colored frame consists of red lines or curves.
6. The method as claimed in claim 1, wherein said face recognition and said marking said
20 target face images are implemented by executing a specific program with a single chip controller or computer or remote server.
7. The method as claimed in claim 1, wherein said face recognition data further comprises a strict level for said face recognition to distinguish different levels of strictness desired or to select all or part of said face recognition data to display.
25
8. The method as claimed in claim 3, wherein said face recognition data further comprises a strict level for said face recognition to distinguish different levels of strictness desired or to select all or part of said face recognition data to display.
9. The method as claimed in claim 1, further comprising an alarm and/or tracking process after said marking said target face image, wherein said alarm process comprises a step of
30 triggering an alarm, sending an e-mail, sending a message via a mobile phone, and/or make a call for informing some related people, and said tracking process comprises a
7
step of tracking and marking a location of said target and/or mismatched face image through a platform with a surveillance program or a three-dimensional spatial model.
8
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| GB1202817.1A GB2499449A (en) | 2012-02-20 | 2012-02-20 | Surveillance by face recognition using colour display of images |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| GB1202817.1A GB2499449A (en) | 2012-02-20 | 2012-02-20 | Surveillance by face recognition using colour display of images |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| GB201202817D0 GB201202817D0 (en) | 2012-04-04 |
| GB2499449A true GB2499449A (en) | 2013-08-21 |
Family
ID=45939832
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| GB1202817.1A Withdrawn GB2499449A (en) | 2012-02-20 | 2012-02-20 | Surveillance by face recognition using colour display of images |
Country Status (1)
| Country | Link |
|---|---|
| GB (1) | GB2499449A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105706446A (en) * | 2016-01-31 | 2016-06-22 | 深圳市博信诺达经贸咨询有限公司 | Monitoring warning method and system for big data |
| CN108229335A (en) * | 2017-12-12 | 2018-06-29 | 深圳市商汤科技有限公司 | It is associated with face identification method and device, electronic equipment, storage medium, program |
| CN109858371A (en) * | 2018-12-29 | 2019-06-07 | 深圳云天励飞技术有限公司 | The method and device of recognition of face |
| WO2021036436A1 (en) * | 2019-08-26 | 2021-03-04 | 苏宁易购集团股份有限公司 | Facial recognition method and apparatus |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110442806B (en) * | 2019-08-05 | 2022-04-26 | 百度在线网络技术（北京）有限公司 | Method and apparatus for recognizing image |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040117638A1 (en) * | 2002-11-21 | 2004-06-17 | Monroe David A. | Method for incorporating facial recognition technology in a multimedia surveillance system |
| US20090074258A1 (en) * | 2007-09-19 | 2009-03-19 | James Cotgreave | Systems and methods for facial recognition |
-
2012
- 2012-02-20 GB GB1202817.1A patent/GB2499449A/en not_active Withdrawn
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040117638A1 (en) * | 2002-11-21 | 2004-06-17 | Monroe David A. | Method for incorporating facial recognition technology in a multimedia surveillance system |
| US20090074258A1 (en) * | 2007-09-19 | 2009-03-19 | James Cotgreave | Systems and methods for facial recognition |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105706446A (en) * | 2016-01-31 | 2016-06-22 | 深圳市博信诺达经贸咨询有限公司 | Monitoring warning method and system for big data |
| WO2017128440A1 (en) * | 2016-01-31 | 2017-08-03 | 深圳市博信诺达经贸咨询有限公司 | Method and system for big data monitoring and reminding |
| CN108229335A (en) * | 2017-12-12 | 2018-06-29 | 深圳市商汤科技有限公司 | It is associated with face identification method and device, electronic equipment, storage medium, program |
| CN109858371A (en) * | 2018-12-29 | 2019-06-07 | 深圳云天励飞技术有限公司 | The method and device of recognition of face |
| WO2021036436A1 (en) * | 2019-08-26 | 2021-03-04 | 苏宁易购集团股份有限公司 | Facial recognition method and apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| GB201202817D0 (en) | 2012-04-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20130216107A1 (en) | Method of surveillance by face recognition | |
| US11158067B1 (en) | Neighborhood alert mode for triggering multi-device recording, multi-camera locating, and multi-camera event stitching for audio/video recording and communication devices | |
| CN109858371B (en) | Face recognition method and device | |
| US20210287469A1 (en) | System and method for provisioning a facial recognition-based system for controlling access to a building | |
| KR101710200B1 (en) | Automatic Attendance System Using Face Recognition and method thereof | |
| KR102152318B1 (en) | Tracking system that can trace object's movement path | |
| WO2020073505A1 (en) | Image processing method, apparatus and device based on image recognition, and storage medium | |
| US10949657B2 (en) | Person's behavior monitoring device and person's behavior monitoring system | |
| JP2013235329A (en) | Face identification monitoring/management method | |
| US20120288165A1 (en) | Surveillance-based high-resolution facial recognition | |
| CN106165391A (en) | The image capturing strengthened | |
| US10419728B2 (en) | Monitoring system having personal information protection function and method thereof | |
| CN109766779A (en) | It hovers personal identification method and Related product | |
| KR101092472B1 (en) | Video indexing system using surveillance camera and the method thereof | |
| CN111401239B (en) | Video analysis method, device, system, equipment and storage medium | |
| CN111091047B (en) | Living body detection method and device, server and face recognition equipment | |
| US10176379B1 (en) | Integrating computer vision and wireless data to provide identification | |
| GB2499449A (en) | Surveillance by face recognition using colour display of images | |
| US20140233854A1 (en) | Real time object scanning using a mobile phone and cloud-based visual search engine | |
| KR102248706B1 (en) | System for intergrated education management based on intelligent image analysis technology and method thereof | |
| CN113538825A (en) | Campus wall-turning event alarm method and system | |
| CN104090656A (en) | Eyesight protecting method and system for smart device | |
| CN103093177A (en) | Face identification, detection and monitoring method | |
| CN113255542A (en) | Illegal object identity recognition method based on illegal behavior recognition | |
| US20190147734A1 (en) | Collaborative media collection analysis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| WAP | Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1) |