CN101763506A - Facial image tracking apparatus and method, computer readable recording medium - Google Patents

Facial image tracking apparatus and method, computer readable recording medium Download PDF

Info

Publication number
CN101763506A
CN101763506A CN 200910261085 CN200910261085A CN101763506A CN 101763506 A CN101763506 A CN 101763506A CN 200910261085 CN200910261085 CN 200910261085 CN 200910261085 A CN200910261085 A CN 200910261085A CN 101763506 A CN101763506 A CN 101763506A
Authority
CN
China
Prior art keywords
face image
image
original image
identifier
face
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200910261085
Other languages
Chinese (zh)
Other versions
CN101763506B (en
Inventor
梅田一秀
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Software Co.,Ltd.
NEC Solution Innovators Ltd
Original Assignee
NEC Software Kyushu Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Software Kyushu Ltd filed Critical NEC Software Kyushu Ltd
Publication of CN101763506A publication Critical patent/CN101763506A/en
Application granted granted Critical
Publication of CN101763506B publication Critical patent/CN101763506B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses a facial image tracking apparatus and method, as well as a computer readable recording medium. The facial image tracking apparatus is characterized by comprising a facial image extracting device for extracting facial image, an identifier conferring device, a facial image storage device, and a position comparison device for computing the distance between the position of the facial image extracted from the original image and the position of the other facial image captured from the period closely before the original image and stored in the facial image storage device. And when the distance is larger than the predetermined reference distance, the identifier conferring device is controlled to confer the identifiers identical with the identifier extracted from the other original image to the facial image extracted from one original image.

Description

Facial image tracking apparatus and method and computer readable recording medium storing program for performing
Technical field
The present invention relates to be used for to discern and follow the tracks of at facial image tracking apparatus, the facial image tracking method of the same people's of a plurality of original images of predetermined period IT face and the computer readable recording medium storing program for performing that has write down program.
Background technology
Cicada is used for being identified in the face of the same people in a plurality of original images that predetermined period catches and tracking and writes down same people's facial image tracking apparatus.For example, substantive examination Japanese patent application KOKAI communique No.2006-133946 (after this being called patent documentation 1) does not disclose a kind of motion object identification equipment, this equipment comprises: being used for extracting can be from the characteristic image characteristic image extraction element partly of moving image designated movement object, be used for detecting in chronological order the position detecting device of positional information of the motion object of moving image, be used for the whether identical judgment means of judging characteristic image section, and be used for based on judging that the motion object that will have the same characteristic features image section is associated with chronological positional information and stores their trace information memory storage.
The motion object identification equipment of patent documentation 1 record is based on chronological characteristic image part and the positional information of the motion object of sign, and if a plurality of motion object appear in the moving image, then provide each to identify the trace information of motion object.
Yet this motion object identification equipment is judged the homogeny of all characteristic images part, and will take a long time in the time will following the tracks of many motion objects and judge homogeny.The real-time follow-up of the processing time that increases for the motion object is a problem.
Summary of the invention
The present invention is in view of the foregoing problems and proposes, and the providing of illustrative purpose of the present invention: be used for discerning at high speed and follow the tracks of in the people's of a plurality of original images of predetermined period IT face and need not facial image tracking apparatus, facial image tracking method than computation machine working load and the computer readable recording medium storing program for performing that has write down program.
In order to solve top problem, facial image tracking apparatus of the present invention is the facial image tracking apparatus that is used for discerning and follow the tracks of the face of the same people in a plurality of original images that predetermined period is caught, it is characterized in that comprising: the face image extraction element, be used for extracting the face image of the face that has caught the people, and calculate the position of face image in original image from original image; Identifier is authorized (grant) device, is used for authorizing the face image that is extracted by the face image extraction element with identifier; The face image memory storage is used for face image is stored with identifier and position; And position comparison means, distance another original image that is used for calculating the position of the face image that extracts from an original image and catches from the cycle before original image of next-door neighbour between the position that extract and that be stored in the face image in the face image memory storage, and when the distance between the position that extract and that be stored in the face image in the face image memory storage in the position of the face image that extracts from an original image and another original image of catching from the cycle before original image of next-door neighbour is not more than predetermined reference range, indicator identifiers is authorized device will authorize the face image that extracts from an original image with the identifier identical identifier of the face image that extracts from another original image.
Facial image tracking method of the present invention is the facial image tracking method that is used for discerning and follow the tracks of the face of the same people in a plurality of original images that predetermined period is caught, it is characterized in that comprising: the face image extraction step, be used for extracting the face image of the face that has caught the people, and calculate the position of face image in original image from original image; Identifier is authorized step, is used for authorizing the face image that is extracted by the face image extraction element with identifier; The face image storing step is used for face image is stored with identifier and position; And position comparison step, distance between that extract another original image that is used for calculating the position of the face image that extracts from an original image and catches from the cycle before original image of next-door neighbour and the position stored face image in the face image storing step, and when extract in the position of the face image that extracts from an original image and another original image of from the cycle before original image of next-door neighbour, catching and when the distance between the position of stored face image in another original image is not more than predetermined reference range in the face image storing step, then authorize in the step and will authorize the face image that extracts from an original image with the identifier identical identifier of the face image that extracts from another original image at identifier.
Computer readable recording medium storing program for performing of the present invention is the computer readable recording medium storing program for performing that has write down program, this program makes computer Recognition and follow the tracks of the face of the same people in a plurality of original images catch and make computing machine be used as in predetermined period: the face image extraction element, be used for extracting the face image of the face that catches the people, and calculate the position of face image in original image from original image; Identifier is authorized device, is used for authorizing the face image that is extracted by the face image extraction element with identifier; The face image memory storage is used for face image is stored with identifier and position; And position comparison means, distance another original image that is used for calculating the position of the face image that extracts from an original image and catches from the cycle before original image of next-door neighbour between the position that extract and that be stored in the face image in the face image memory storage, and when the distance between the position that extract and that be stored in the face image in the face image memory storage in the position of the face image that extracts from an original image and another original image of catching from the cycle before original image of next-door neighbour is not more than predetermined reference range, indicator identifiers is authorized device will authorize the face image that extracts from an original image with the identifier identical identifier of the face image that extracts from another original image.
According to the present invention; When the distance between the position that extract and that be stored in the face image in the face image storage device is not more than predetermined reference range in the position of the face image that extracts from an original image and another original image of catching, then think from an original image face image that extracts and the face image that extracts from another original image it is that same people's face image and identifier are authorized device and be instructed to and will authorize the face image that extracts from an original image by identical identifier with the identifier of the face image that extracts from another original image from the cycle before original image of next-door neighbour. Therefore, with based on the similarity of the feature in the image really locking equipment compare with method, this processing can be to carry out at a high speed.In addition, the computer operation load that has reduced allows to use the computing machine of low performance (be cheap).
Description of drawings
Fig. 1 is the conceptual illustration that illustrates according to the functional structure of the facial image tracking apparatus of the embodiment of the invention.
Fig. 2 shows the conceptual illustration of the structure of face image data piece.
Fig. 3 shows the conceptual illustration of the physical arrangement of facial image tracking apparatus.
Fig. 4 is the key diagram that is used to illustrate based on the primitive rule of the distance tracking face image between the position of the position of the face image that is extracted and the face image of being registered.
Fig. 5 shows the process flow diagram of the summary of face image extraction procedure.
Fig. 6 shows the process flow diagram of the summary of position comparison program.
Fig. 7 be used for illustrating people's the homogeny of the face image that extracts and the face image of registering and the key diagram of the relation between the reference range.
Fig. 8 is the process flow diagram that the summary of similarity comparison program is shown.
Embodiment
Use description to realize embodiments of the present invention below.
Fig. 1 shows the conceptual illustration according to the functional structure of the facial image tracking apparatus 1 of the embodiment of the invention.
As shown in Figure 1, facial image tracking apparatus 1 identification and follow the tracks of that in predetermined period, catch continuously and be stored in the face of the same people in a plurality of original images in the image storage apparatus 3 by camera 2.Here, " a plurality of original images of in predetermined period, catching continuously " moving image not necessarily.For example, " a plurality of original images of catching continuously in predetermined period " comprise the rest image of catching continuously with the interval of several seconds.
Facial image tracking apparatus 1 comprises that face image extracts parts 11, new identifier and authorizes parts 11a, position comparing unit 12, identifier and authorize parts 12a, similarity comparing unit 13, identifier and authorize parts 13a, and face image memory unit 14.
It is such functional modules that face image extracts parts 11, be used for from reading to extract the parts of images (face image) of the face that catches the people from the original image of image storage apparatus 3, when position comparing unit 12 and similarity comparing unit 13 can not be authorized any identifier of face image, the indication new identifier is authorized parts 11a and is authorized new identifier to the face image that extracts, and it is registered in the face image memory unit 14.Be used for for example describing in detail, therefore, will no longer describe in detail here at Japanese patent application No.3307354 from the concrete device of original image extraction face image.
Position comparing unit 12 is such functional modules, be used for reading in the face image (face image of being registered) that extracts and be registered in the original image that the next-door neighbour catches in the cycle before the original image that image storage apparatus 3 is read (next-door neighbour at preceding original image) in the face image memory unit 14, calculate the distance of extracting the face image that parts 11 extract from original image by face image, be the position appears in face image in original image difference, suppose that institute's face image that extracts and the face image of registering are same people's images when distance is not more than predetermined reference range, then indicator identifiers is authorized parts 12a and will be authorized the face image that extracts with the face image identical identifier of being registered, and it is stored in the face image memory unit 14.
Similarity comparing unit 13 is such functional modules, be used for when for all face images of registering that extract at preceding original image from the next-door neighbour, to the distance of the face image that extracts during greater than predetermined reference range, the face image that calculating extracts and register similarity between the face image, suppose when similarity surpasses pre-determined reference value, the face image that is extracted is same people's a image with the face image of registering, then will authorize the face image that extracts, and it will be stored in the face image memory unit 14 with registration face image identical identifier.Be used for calculating the concrete device of similarity and be used to utilize the device of similarity coupling face image for example to describe in detail, therefore, will no longer describe in detail here at Japanese patent gazette No.3976058 and No.4099981.
Face image memory unit 14 is the storage unit that are used to store face image data piece 4, and face image data piece 4 will be lumped together by face image extracts the position of the face image in the face image that extracts (its image information) that parts 11 extract and this original image from the original image of reading from image storage apparatus 3 coordinate and group identifier.
As shown in Figure 2, face image data piece 4 comprises identifier 41, imaging date and time 42, position coordinates 43 and face image data 44.
Identifier 41 is by combination camera identification code 411, record date and time 412 and number 413 formation.Camera identification code 411 is the exclusive codes of camera 2 of having caught the face image that extracts.Record date and time 412 be illustrate date when the face image that is awarded identifier 41 first is hunted down, hour, minute and second data.Numbering 413 is the sequence numbers that give a plurality of new face image that extracts from an original image by extraction order (order that identifier 41 is awarded).
Imaging date and time 42 be the date of the expression face image that extracts when being hunted down, hour, minute and second data.Position coordinates 43 is in the rectangular coordinate system that is fixed on the original image, expression the seat target value of the position of the face image that extracts in original image.
Face image data 44 is the numerical datas that are used to show the face image that extracts.Concrete restricted format, but can select any known format such as GIF and JPEG.Can at random select binary code, GTG and color according to purpose and environment.
Fig. 3 is the conceptual illustration that the physical arrangement of facial image tracking apparatus 1 is shown.Facial image tracking apparatus 1 is realized on computers by specific program is installed.In other words, Fig. 3 shows the physical configuration of the computing machine of realizing facial image tracking apparatus 1.
As shown in Figure 3, facial image tracking apparatus 1 comprises communication interface (I/F) 15, I/O unit 16, arithmetical unit 17 and storage unit 18.
Communication interface 15 is the interfaces that are used for transmission/reception data and signal between facial image tracking apparatus 1 and image storage apparatus 3.Communication interface 15 can also be used for to unshowned external unit transmission data and signal/from unshowned outer equipment receiving data and signal, unshowned external unit for example is used for to the result of computing machine transmission/reception from facial image tracking apparatus 1.
I/O unit 16 is the unit that are used for the result of instruction input facial image tracking apparatus 1 or demonstration facial image tracking apparatus 1, such as keyboard unit, mouse and the display unit such as liquid crystal panel.
Arithmetical unit 17 is the unit that are made of for example CPU (CPU (central processing unit)), and it reads the program in the storage unit 18 that is stored in such as ROM (ROM (read-only memory)) and RAM (random access memory), and working procedure is to carry out predetermined arithmetical operation.The function that aforementioned face image extracts parts 11, position comparing unit 12 and similarity comparing unit 13 realizes by moving aforementioned program.
Storage unit 18 for example is made of RAM or ROM, and is stored on the arithmetical unit 17 program of operation and from the result of arithmetical unit 17.Storage unit 18 is designated as the function of face image memory unit 14 at least in part.
Fig. 4 is used to illustrate that the distance based between the position of the position of extraction face image and the face image of registering follows the tracks of the key diagram of the primitive rule of face image.In Fig. 4, the original image that label 51 to 53 expressions are caught continuously by camera 2.More specifically, original image 51 is caught in first imaging cycle, and original image 52 is caught in next imaging cycle, and original image 53 is caught in follow-up imaging cycle.Original image 51 comprises face image 61 to 63.Original image 52 comprises face image 64 to 66.Original image 53 comprises face image 67 to 69.
In original image, moved limited distance when as shown in Figure 4, the face image that extracts from original image is to next imaging cycle.In other words, if the face image (last face image) that extracts from original image and the face image (back one face image) of catching next imaging cycle are same people's images, then they are very likely closer to each other.Therefore, if the alternate position spike between back face image in the original image and the last face image (i.e. distance) is not more than predetermined reference range, then can infer this two face images that face image is same people.
For example, if the distance between two face images of catching is not more than R in original image 51 to 53, think that then two face images are face images of same people in the tightly adjacent cycle.Then, same people's face image is integrated in the image, thus the image 54 to 56 after having obtained to merge.Image 54 to 56 after the merging comprises face image 61,64 and 67 respectively, face image 62,65 and 68, and face image 63,66 and 69.Circle on the image 54,55 and 56 after the merging comprises that having is the circle of radius centered R with face image 64,65 and 66 respectively.
Fig. 5 is the process flow diagram that is illustrated in the summary of the face image extraction procedure of operation on the arithmetical unit 17.The face image extraction procedure that utilization moves on arithmetical unit 17, arithmetical unit 17 extracts parts 11, new identifier as face image and authorizes parts 11a, position comparing unit 12, identifier and authorize parts 12a, similarity comparing unit 13 and identifier and authorize parts 13a.Below with reference to Fig. 5 the face image extraction procedure is described.
At first, read a frame (step S1) of original image from image storage apparatus 3.From the original image of reading, extract face image (face image that extracts) (step S2).Start position described later comparison program (step S3).
The position comparison program is authorized the face image that extracts with identifier.If the face image that extracts is stored in (step S4 in the face image memory unit 14; Be), then program advances to step S8.If the face image that extracts is not stored in (step S4 in the face image memory unit 14; ), then do not start similarity comparison program described later (step S5).
At step S5, the similarity comparison program is authorized the face image that extracts with identifier.If the face image that extracts is stored in (step S6 in the face image memory unit 14; Be), then program advances to step S8.If the face image that extracts is not stored in (step S6 in the face image memory unit 14; ), think that then the people who is extracted in the face image is different from the people who is followed the tracks of, and the face image that extracts is not awarded new identifier and is stored in (step S7) in the face image memory unit 14.Then, program advances to step S8.
If all included in the original image that reads in step S1 face images all are extracted out (step S8; Be), then process finishes.If there is any face image (the step S8 that is not extracted as yet; ), then program is not returned step S2 and is repeated said process.
Fig. 6 is the process flow diagram that the summary of position comparison program is shown.The position comparison program that reads in arithmetical unit 17 is in the operation of the step S3 place of face image extraction procedure.By the position comparison program of operation on arithmetical unit 17, arithmetical unit 17 is as position comparing unit 12.Below with reference to Fig. 6 the position comparison program is described.
At first, in the face image that face image memory unit 14 is stored, read following face image data piece 4 from face image memory unit 14, it is the face image data piece 4 (step S 11) of the face image (face image of registering) that extracts the original image with the original image next-door neighbour who reads from image storage apparatus 3 in the step S1 of face image extraction procedure, and calculates the distance (step S12) of the face image that extracts.
(step S 13 if the distance that calculates in step S 12 is not more than predetermined reference range; Be), then think the face image that extracts and the face image of registering be same people's image.Therefore, the face image that extracts be awarded with the face image identical identifier of registering and be stored in (step S 14) in the face image memory unit 14.Then, program is returned process shown in Figure 5.
On the other hand, if the distance that in step S12, calculates greater than predetermined reference range (step S13; Not), then program advances to step S15.If all be read from next-door neighbour's the face image of registering to some extent that extracts of original image, in other words, if anyly register all discoveries the face image and extract people in the face image (step S 15 what the original image from the next-door neighbour extracted; Be), then program is returned process shown in Figure 5.If exist any do not read the image of registering (step S15; ), then program is not returned step S11 and is repeated top process.
Fig. 7 be used for illustrating people's the homogeny of the image that extracts and the face image of registering and the key diagram of the relation between the reference range.In Fig. 7, the label 71 expression face images of registering.In the present embodiment, the position of face image is represented with the position of right eye.More specifically, with the corresponding locations of pixels of the right eye of registration face image 71 be considered to the position of the face image of registering 71 in original image.Therefore, use the rectangular coordinate system X-Y of true origin at the right eye place of registration face image 71.
As mentioned above, reference range is the ultimate range that face image can move in imaging cycle.Ultimate range is long-pending corresponding with maximum translational speed and imaging cycle.For example, suppose that the people that wants imaging moves with the maximal rate of 1000mm/s and imaging cycle is 1/10s, then people's transportable ultimate range before following one-period is 100mm.Then, will compare with its size (pixel count) that manifests on original image by the actual size of the object of camera 2 imagings, and calculating and the corresponding number of pixels R of 100mm linear scale.Pixel count between the right eye of the face image of registering and the right eye of the face image that extracts is not more than R, if these face images are images of same people.
In Fig. 7, the right eye of face image 72 is the circle inside of radius centered R in the true origin (right eye of the face image of being registered 71) that has with rectangular coordinate system X-Y.Therefore, think the face image of registering 71 and face image 72 are face images of same people.On the other hand, the right eye of face image 73 is in this circle outside.Therefore, think the face image of registering 71 and face image 73 be not same people's face image.
Pixel count R selects according to the purpose of facial image tracking apparatus 1.For the more important facial image tracking of processing speed, increase pixel count R, so that determine same people's ratio increase and determine that based on similarity same people's ratio reduces based on distance.Otherwise, for the more important facial image tracking of accuracy, then reduce pixel count R, so that reduce and determine same people's ratio increase based on the definite same people's of distance ratio based on similarity.
Can regulate pixel count R according to the number of face image included in the original image.When original image comprises a small amount of face image,, can not reduce the accuracy of determining same people even pixel count R increases yet.Therefore, can increase pixel count R.On the other hand, when original image comprises a large amount of face image,, determine that then same people's accuracy reduces if pixel count R increases.Therefore, should reduce pixel count R.
Fig. 8 is the process flow diagram that the summary of similarity comparison program is shown.The similarity comparison program that reads in arithmetical unit 17 is moved in the step S5 of face image extraction procedure.More specifically, when the position comparison program be can not determine the identifier of the face image that extracts, then start the similarity comparison program.In addition, by the similarity comparison program of operation on arithmetical unit 17, arithmetical unit 17 is as similarity comparing unit 13.Below with reference to Fig. 8 the similarity comparison program is described.
At first, read following face image from face image memory unit 14, its be from among the step S1 of face image extraction procedure, read and write the face image (face image of registering) (step S21) that extracts in the original image of the original image next-door neighbour the face image memory unit 14, and the similarity (step S22) of the calculating and the face image that extracts from image storage apparatus 3.
If the similarity that calculates in step S22 is not less than pre-determined reference value (step S23; Be), then think the face image that extracts and the face image of registering be same people's image.Therefore, the face image that extracts is awarded and the face image identical identifier of registering, and is stored in (step S24) in the face image memory unit 14.Then, program is returned process shown in Figure 5.
On the other hand, if the similarity that in step S22, calculates less than pre-determined reference value (step S23; Not), then program advances to step S25.If all be read from next-door neighbour's the face image of registering to some extent that extracts of original image, in other words, if anyly register all discoveries in the face image and extract people (step S25 in the face image what from next-door neighbour's original image, extract; Be), then program is returned process shown in Figure 5.If exist any without read the face image of registering (step S25; Not), then return step S21 and repeat top process.
As mentioned above, since facial image tracking apparatus 1 at first based on extraction face image and the distance between the face image registered judge the face image that extracts with the face image of registering whether be same people's face image, therefore, compare with judging based on the similarity of face image, facial image tracking apparatus 1 allows high speed processing also to reduce the computer operation load.Then,, then carry out judgement based on the similarity of face image if the above-mentioned distance between the position-based is not found same people's the face image of registering, so accuracy and the reliability of facial image tracking apparatus 1 when having guaranteed definite homogeny.
In addition, same people's face image is awarded same identifier and face image is stored.Therefore, can obtain and follow the tracks of the positional information that specific people moves in chronological order.
14 storages of face image memory unit have the face image data piece 4 at the same identifier 41 of same people's face image.Therefore, can retrieve same people's face image data piece 4.The same people's that can read out by analysis face image data piece 4 calculates this people's track.
Technical scope of the present invention is not limited thereto embodiment.Under the situation that does not break away from the technological thought of setting forth in the patent claims, can carry out various application, modification and change.For example, in the present embodiment, specific program is installed on the arithmetical unit 17 is embodied as software face image is extracted parts 11, position comparing unit 12 and similarity comparing unit 13.Yet, realize that by specialized hardware these parts drop within the technical scope of the present invention.
The cross reference of related application
The application is submit to and Japanese patent application No.2008-326380 that comprise instructions, claims, accompanying drawing and summary of the invention based on Dec 22nd, 2008.The open integral body by reference of above-mentioned Japanese patent application is incorporated into this.

Claims (5)

1. facial image tracking apparatus that is used for discerning and follow the tracks of the face of the same people in a plurality of original images that predetermined period is caught is characterized in that comprising:
The face image extraction element is used for extracting from described original image the face image of the face that has caught the people, and calculates the position of described face image in described original image;
Identifier is authorized device, is used for authorizing the face image that is extracted by described face image extraction element with identifier;
The face image memory storage is used for described face image is stored with described identifier and described position; And
The position comparison means, distance another original image that is used for calculating the position of the face image that extracts from an original image and catches from the cycle before the described original image of next-door neighbour between the position that extract and that be stored in the face image in the described face image memory storage, and when the distance between the described position that extract and that be stored in the face image in the described face image memory storage in the described position of the face image that extracts from a described original image and described another original image of catching from the cycle before the described original image of next-door neighbour is not more than predetermined reference range, indicates described identifier to authorize device and will authorize from a described face image that original image extracts with the identifier identical identifier of the face image that extracts from described another original image.
2. facial image tracking apparatus according to claim 1 is characterized in that comprising:
The similarity comparison means, be used for that the distance between the described position that extract and that be stored in the face image in the described face image memory storage is not less than predetermined reference range the described position of the face image that extracts from a described original image and described another original image of catching from the cycle before the described original image of next-door neighbour, and identifier is not authorized the situation of the face image that extracts from a described original image, similarity between face image that calculating extracts from a described original image and the face image that extracts from described another original image, and when described similarity surpasses pre-determined reference value, indicate described identifier to authorize device and will authorize from a described face image that original image extracts with the identifier identical identifier of the face image that extracts from described another original image.
3. facial image tracking apparatus according to claim 2 is characterized in that comprising:
New identifier is authorized device, is used for can not when the face image that extracts from a described original image is authorized any identifier new identifier being authorized from a described face image that original image extracts when described similarity comparison means.
4. facial image tracking method that is used for discerning and follow the tracks of the face of the same people in a plurality of original images that predetermined period is caught is characterized in that comprising:
The face image extraction step is used for extracting from described original image the face image of the face that has caught the people, and calculates the position of described face image in described original image;
Identifier is authorized step, is used for authorizing the face image that is extracted by described face image extraction element with identifier;
The face image storing step is used for described face image is stored with described identifier and described position; And
The position comparison step, distance another original image that is used for calculating the position of the face image that extracts from an original image and catches from the cycle before the described original image of next-door neighbour between the position that extract and that be stored in the face image in the described face image memory storage, and when extract in the described position of the face image that extracts from a described original image and described another original image of from the cycle before the described original image of next-door neighbour, catching and be stored in distance between the position of face image in described another original image in the described face image memory storage when being not more than predetermined reference range, then authorize in the step and will authorize from a described face image that original image extracts with the identifier identical identifier of the face image that extracts from described another original image at described identifier.
5. computer readable recording medium storing program for performing that writes down program, described program make computer Recognition and follow the tracks of the face of the same people in a plurality of original images of catching and make computing machine be used as in predetermined period:
The face image extraction element is used for extracting from described original image the face image of the face that has caught the people, and calculates the position of described face image in described original image;
Identifier is authorized device, is used for authorizing the face image that is extracted by described face image extraction element with identifier;
The face image memory storage is used for described face image is stored with described identifier and described position; And
The position comparison means, distance another original image that is used for calculating the position of the face image that extracts from an original image and catches from the cycle before the described original image of next-door neighbour between the position that extract and that be stored in the face image in the described face image memory storage, and when the distance between the described position that extract and that be stored in the face image in the described face image memory storage in the described position of the face image that extracts from a described original image and described another original image of catching from the cycle before the described original image of next-door neighbour is not more than predetermined reference range, indicates described identifier to authorize device and will authorize from a described face image that original image extracts with the identifier identical identifier of the face image that extracts from described another original image.
CN 200910261085 2008-12-22 2009-12-22 Facial image tracking apparatus and method Expired - Fee Related CN101763506B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2008326380A JP5441151B2 (en) 2008-12-22 2008-12-22 Facial image tracking device, facial image tracking method, and program
JP2008-326380 2008-12-22

Publications (2)

Publication Number Publication Date
CN101763506A true CN101763506A (en) 2010-06-30
CN101763506B CN101763506B (en) 2013-07-31

Family

ID=42494663

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200910261085 Expired - Fee Related CN101763506B (en) 2008-12-22 2009-12-22 Facial image tracking apparatus and method

Country Status (3)

Country Link
JP (1) JP5441151B2 (en)
CN (1) CN101763506B (en)
HK (1) HK1143883A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016086330A1 (en) * 2014-12-03 2016-06-09 Xiaoou Tang A method and a system for face recognition

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012137861A (en) * 2010-12-24 2012-07-19 Jvc Kenwood Corp Video processing device and video processing method
JP5807695B2 (en) * 2014-03-20 2015-11-10 カシオ計算機株式会社 Subject detection apparatus, subject detection method, and program
JP6769475B2 (en) 2018-12-04 2020-10-14 日本電気株式会社 Information processing system, management method for authentication, and program
CN117151722B (en) * 2023-10-30 2024-02-23 山东大学 Face recognition password verification method and system based on alliance block chain

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6111517A (en) * 1996-12-30 2000-08-29 Visionics Corporation Continuous video monitoring using face recognition for access control
US20090231436A1 (en) * 2001-04-19 2009-09-17 Faltesek Anthony E Method and apparatus for tracking with identification
GB2414616A (en) * 2004-05-28 2005-11-30 Sony Uk Ltd Comparing test image with a set of reference images
JP2006221355A (en) * 2005-02-09 2006-08-24 Hitachi Ltd Monitoring device and monitoring system
WO2007119355A1 (en) * 2006-03-15 2007-10-25 Omron Corporation Tracking device, tracking method, tracking device control program, and computer-readable recording medium
JP4831623B2 (en) * 2007-03-29 2011-12-07 Kddi株式会社 Moving image face index creation apparatus and face image tracking method thereof
CN101221620B (en) * 2007-12-20 2011-04-06 北京中星微电子有限公司 Human face tracing method

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016086330A1 (en) * 2014-12-03 2016-06-09 Xiaoou Tang A method and a system for face recognition
CN107004115A (en) * 2014-12-03 2017-08-01 北京市商汤科技开发有限公司 Method and system for recognition of face
CN107004115B (en) * 2014-12-03 2019-02-15 北京市商汤科技开发有限公司 Method and system for recognition of face

Also Published As

Publication number Publication date
JP2010146522A (en) 2010-07-01
CN101763506B (en) 2013-07-31
JP5441151B2 (en) 2014-03-12
HK1143883A1 (en) 2011-01-14

Similar Documents

Publication Publication Date Title
CN101763506B (en) Facial image tracking apparatus and method
JP6734653B2 (en) Computer vision based process recognition
KR101411058B1 (en) Video analytics test system
US20160062456A1 (en) Method and apparatus for live user recognition
US9811755B2 (en) Object monitoring system, object monitoring method, and monitoring target extraction program
CN110991261A (en) Interactive behavior recognition method and device, computer equipment and storage medium
CN103782251A (en) Computer device operable with user's eye movement and method for operating the computer device
US10664523B2 (en) Information processing apparatus, information processing method, and storage medium
CN107452015A (en) A kind of Target Tracking System with re-detection mechanism
Yang et al. Activity graph based convolutional neural network for human activity recognition using acceleration and gyroscope data
CN111275030A (en) Straight running detection and timing system and method based on face and human body recognition
JPWO2017154655A1 (en) Crowd type identification system, crowd type identification method, and crowd type identification program
US20230125326A1 (en) Recording medium, action determination method, and action determination device
CN113743273A (en) Real-time rope skipping counting method, device and equipment based on video image target detection
CN111178129A (en) Multi-modal personnel identification method based on face and posture
JP2021089778A (en) Information processing apparatus, information processing method, and program
CN116959216A (en) Experimental operation monitoring and early warning method, device and system
JP5170091B2 (en) Object identification device, data processing method, computer program
CN113592902A (en) Target tracking method and device, computer equipment and storage medium
US20220230333A1 (en) Information processing system, information processing method, and program
CN111238829A (en) Method and device for determining moving state, computer equipment and storage medium
CN115019400B (en) Illegal behavior detection method and device
CN114219978B (en) Target multi-part association method and device, terminal and computer readable storage medium
CN111460977B (en) Cross-view personnel re-identification method, device, terminal and storage medium
US20220343681A1 (en) Evaluating method and system for face verification, and computer storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1143883

Country of ref document: HK

C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
REG Reference to a national code

Ref country code: HK

Ref legal event code: GR

Ref document number: 1143883

Country of ref document: HK

ASS Succession or assignment of patent right

Owner name: NEC SOFT, LTD.

Free format text: FORMER OWNER: NEC SOFTWARE KYUSHU, LTD. (JP)

Effective date: 20140911

C41 Transfer of patent application or patent right or utility model
C56 Change in the name or address of the patentee

Owner name: JAPAN ELECTRICAL SCHEME INNOVATION CORPORATION

Free format text: FORMER NAME: NEC SOFT, LTD.

CP01 Change in the name or title of a patent holder

Address after: Tokyo, Japan

Patentee after: NEC SOLUTION INNOVATORS, Ltd.

Address before: Tokyo, Japan

Patentee before: NEC Software Co.,Ltd.

TR01 Transfer of patent right

Effective date of registration: 20140911

Address after: Tokyo, Japan

Patentee after: NEC Software Co.,Ltd.

Address before: Fukuoka Prefecture

Patentee before: NEC SOFTWARE KYUSHU, LTD.

CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130731

Termination date: 20191222

CF01 Termination of patent right due to non-payment of annual fee