US20170262473A1 - Individual verification apparatus, individual verification method and computer-readable recording medium - Google Patents
Individual verification apparatus, individual verification method and computer-readable recording medium Download PDFInfo
- Publication number
- US20170262473A1 US20170262473A1 US15/609,224 US201715609224A US2017262473A1 US 20170262473 A1 US20170262473 A1 US 20170262473A1 US 201715609224 A US201715609224 A US 201715609224A US 2017262473 A1 US2017262473 A1 US 2017262473A1
- Authority
- US
- United States
- Prior art keywords
- image
- individual
- light reception
- reception direction
- brightness value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000012795 verification Methods 0.000 title claims abstract description 189
- 238000000034 method Methods 0.000 title claims description 13
- 238000012545 processing Methods 0.000 claims description 23
- 238000012937 correction Methods 0.000 abstract description 55
- 230000009471 action Effects 0.000 description 24
- 238000010586 diagram Methods 0.000 description 24
- 238000001514 detection method Methods 0.000 description 6
- 238000005286 illumination Methods 0.000 description 6
- 230000008859 change Effects 0.000 description 4
- 239000003086 colorant Substances 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 238000003702 image correction Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000009434 installation Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000006735 deficit Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G06F17/30247—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G06K9/00—
-
- G06K9/00255—
-
- G06K9/036—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/98—Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
- G06V10/993—Evaluation of the quality of the acquired pattern
Definitions
- Certain embodiments relate to an individual verification apparatus, an individual verification method and a non-transitory computer-readable recording medium.
- a copier which is provided with an individual verification system based on a camera.
- the camera takes the image of a face.
- a plurality of face images are registered in a database.
- the system verifies an individual using the image data of the individual and the image data in the database.
- the copier is placed at a certain position which is fixed with respect to a window.
- the angle of view of the camera is fixed.
- the intensity of light varies.
- sunlight comes from different directions with different intensities.
- the brightness around the copier is different at 8.00 am, 12.00 ⁇ m and 5.00 ⁇ m.
- an indoor illuminator instead of the sunlight coming from the window, irradiates the camera.
- the light of an identification lamp irradiates the copier from the window at night.
- the light of a light source comes from different directions and different angles in different seasons.
- the brightness of the light source changes with the weather.
- the brightness, the contrast ratio and the light reception direction of an installed camera change with the surroundings.
- An individual verification apparatus even when used to take the face image of the same person, is different in face recognition precision in different environments.
- FIG. 1 is a block diagram illustrating an individual verification apparatus according to a first embodiment
- FIG. 2 is a functional block diagram illustrating the correction section of the individual verification apparatus according to the first embodiment
- FIG. 3A is a diagram showing an example of an image facing the individual verification apparatus according to the first embodiment
- FIG. 3B is a diagram showing another example of an image facing the individual verification apparatus according to the first embodiment
- FIG. 4 is a diagram illustrating the structure of a copier provided with the individual verification apparatus according to the first embodiment
- FIG. 5 is main flowchart illustrating a verification processing carried out by the individual verification apparatus according to the first embodiment
- FIG. 6 is a flowchart illustrating a background image processing carried out by the individual verification apparatus according to the first embodiment
- FIG. 7 is a diagram showing an example of the image region of the individual verification apparatus according to the first embodiment.
- FIG. 8 is a diagram illustrating a detection method of light reception direction based on the individual verification apparatus according to the first embodiment
- FIG. 9 is a flowchart illustrating a process of registering data in the face image database of the individual verification apparatus according to the first embodiment
- FIG. 10 is a flowchart illustrating a recognition processing carried out by the individual verification apparatus according to the first embodiment.
- FIG. 11A is a diagram showing an example of an image registered in the database of the individual verification apparatus according to the first embodiment.
- FIG. 11B is a diagram showing an example of an image for verification taken by the camera of the individual verification apparatus according to the first embodiment
- FIG. 12A is a diagram showing an image for verification the brightness of which is adjusted by the individual verification apparatus according to the first embodiment
- FIG. 12B is a diagram showing an image for verification the contrast ratio of which is adjusted by the individual verification apparatus according to the first embodiment
- FIG. 12C is a diagram showing an image for verification the light reception direction of which is adjusted by the individual verification apparatus according to the first embodiment.
- FIG. 13 is a block diagram illustrating an individual verification apparatus according to a second embodiment.
- an individual verification apparatus including: a database configured to associate a face image with the personal information of an individual, wherein the face image has the first brightness and the first light reception direction of an image region in which an individual is irradiated by a light source the direction of which varies if observed from a fixed line-of-sight direction; a correction section configured to carry out a correction operation using a correction amount pre-stored for image data for verification, wherein the image data for verification has a second brightness and a second light reception direction; and a verification section configured to verify the individual using the face part in the image data for verification and the face image stored in the database, wherein at least one of the second brightness and the second light reception direction of the face part of the image data for verification is corrected.
- FIG. 1 is a block diagram illustrating an individual verification apparatus involved in the first embodiment.
- An individual verification apparatus 10 verifies, using a face image, the identity of the operator of a copier installed indoors.
- the individual verification apparatus 10 comprises a database 11 , a correction section 12 , a verification section 13 , a camera 14 and a storage section 15 .
- the database 11 associates a face image with personal ID (identification) (personal information) and stores the associated face image and personal ID, wherein the face image having the brightness, the contrast ratio and the light reception direction of an image region in which an individual is irradiated by a light source the direction of which varies if observed from a fixed line-of-sight direction.
- the correction section 12 carries out a correction operation using a correction amount pre-stored for image data for verification which has another brightness, another contrast ratio and another light reception direction.
- the verification section 13 verifies an individual using the face part of the image data for verification and the face image in the database 11 , wherein at least one of the brightness, the contrast ratio and the light reception direction of the face part of the image data for verification is corrected by the correction section 12 .
- the camera 14 separately acquires image data for registration and image data for verification at different timing.
- the image data for registration refers to a user image which is registered in the database 11 before a user is verified.
- the image data for verification refers to a user image which is compared with the image data for registration that serves as a reference.
- the storage section 15 stores first reference values for the brightness, the contrast ratio and the light reception direction of a background image.
- the database 11 associates the face images of a plurality of persons with their personal ID information separately such as their employee numbers.
- the face image is an image taken by the camera 14 from a fixed line-of-sight direction.
- the fixed line-of-sight direction is the line-of-sight direction of the camera 14 fixed on the copier 100 .
- the face image has attribute values including brightness, contrast ratio and light reception direction.
- the light source is sunlight, an indoor illuminator or an outdoor identification lamp.
- FIG. 2 is a functional block diagram illustrating the correction section 12 .
- the reference signs which are illustrated above denote the same components in FIG. 2 .
- the correction section 12 comprises a brightness adjustment portion 25 and a contrast ratio adjustment portion 26 .
- the brightness adjustment portion 25 carries out a brightness adjustment.
- Brightness refers to brightness values of R (red), G (green) and B (blue).
- the brightness of a pixel represents an RGB with a brightness value of, for example, eight bits.
- Each RGB of the plurality of pixels in an image region has a brightness value.
- the brightness adjustment portion 25 adjusts all brightness values of RGB.
- the contrast ratio adjustment portion 26 carries out a contrast ratio adjustment.
- Contrast ratio refers to the black-to-white ratio in an image region. Black refers to the minimal brightness, and white refers to the maximum brightness.
- the correction section 12 is provided with a light reception direction adjustment portion 27 for adjusting a light reception direction.
- FIG. 3A and FIG. 3B show examples of images taken in the morning and at dusk.
- the left-upper area is higher in brightness
- the right-lower area of the image 29 A is lower in brightness, wherein ‘higher’ and ‘lower’ are relative.
- the area between the right top and the right bottom is higher in brightness, and the area between the left top and the left bottom is lower in brightness.
- the light reception direction refers to the direction along which brightness lowers from the brightness of a high-brightness area to that of a low-brightness area in the image data.
- the light reception direction adjustment portion 27 changes the light reception direction of the image region 29 A or 29 B by inclining the perpendicular line of the horizontal centerline of the image region 29 A or 29 B by an angle (degree).
- the correction section 12 shown in FIG. 1 corrects the image data for registration based on the first reference values of the background image. After completing the correction operation based on the first reference values, the correction section 12 registers the face image the brightness, the contrast ratio and the light reception direction of which are updated to second reference values in the database 11 .
- the correction section 12 corrects the image data for verification using the second reference values.
- the verification section 13 compares the face image which is stored in the database 11 after being updated in brightness, contrast ratio and light reception direction with the face image in the image data for verification acquired by the camera 14 .
- the verification section 13 outputs a result representing the success or failure of the face verification according to the result of the comparison.
- FIG. 4 is a diagram illustrating the structure of a copier provided with the individual verification apparatus 10 .
- the reference signs which are described above denote the same elements in FIG. 4 .
- the camera 14 is fixed on the copier 100 at a position where the camera 14 constitutes no obstacle to the user operating the copier 100 .
- the camera 14 which uses a Charge Coupled Device (CCD) image sensor or a Complementary MOS (COMOS) image sensor is positioned with its image sensor panel facing the face of the user.
- CCD Charge Coupled Device
- COMOS Complementary MOS
- the image data for registration has its brightness, contrast ratio and light reception direction.
- the image data for verification also has its brightness, contrast ratio and light reception direction.
- the first reference values stored in the storage section 15 shown in FIG. 1 are values for correcting the face image registered in the database 11 .
- the first reference brightness, the first reference contrast ratio and the first reference light reception direction each have a value of a plurality of bits.
- the storage section 15 uses a storage device 20 which is a hard disk drive or a solid state drive.
- the individual verification apparatus 10 may further comprise a reference value generation section 28 configured to generate first reference values for the brightness, the contrast ratio and the light reception direction of a background image.
- CPU central Processing Unit
- ROM Read Only Memory
- RAM Random Access Memory
- the CPU 17 , the ROM 18 and the RAM 19 execute the functions of the correction section 12 and the verification section 13 .
- the CPU 17 functions as the main controller of the individual verification apparatus 10 .
- the RAM 19 provides a working storage area for the CPU 17 .
- the ROM 18 is a non-transitory computer-readable recording medium for causing the CPU 17 to execute the following processing:
- a processing of correcting image data for registration which as its brightness, contrast and light reception direction based on the first reference values of the background image, associating the face image with personal ID and performing a write access processing on the address of the database 11 , wherein the face image has second reference values in brightness, contrast ratio and light reception direction;
- the bus line 16 is electrically connected with the controller 110 of the copier 100 .
- the copier 100 comprises a scanner 113 , a network interface 114 , a printer section 115 and a controller 110 .
- the scanner 113 scans one side of an original document G using a document feeder 120 .
- the network interface 114 receives printing spool data from a PC 126 through a network 125 .
- the printer section 115 configured to be installed and for a person to perform a user operation prints an image using four printing colors C, M, Y and K and then outputs the printed image.
- the printer section 115 is equipped with four exposers 129 , four image forming portions 131 C, 131 M, 131 Y and 131 K and a belt 130 .
- the exposer 129 modulates an image signal into laser rays using semiconductor laser of each color.
- the belt 130 endlessly travels anticlockwise.
- the image forming portion 131 for yellow color comprises: a drum 132 , a charger 133 , a developer 134 and a transferring device 135 .
- the drum 132 is a photoconductive drum rotating along a clockwise direction T.
- the charger 133 charges the surface of the drum 132 .
- the developer 134 develops the electrostatic latent image on the drum 132 using a toner.
- the transferring device 135 primarily transfers the toner image on the drum 132 onto the belt 130 .
- the image forming portion 131 M for magenta color, the image forming portion 131 C for cyan color and the image forming portion 131 K for black color are substantially structurally identical to the image forming section 131 Y.
- the printer section 115 has a sheet conveying mechanism 136 , a secondary transferring device 137 and a fixer 138 .
- the sheet conveying mechanism 136 takes a sheet P from a tray 139 and guides the sheet P to the printer section 115 .
- the secondary transferring device 137 secondarily transfers toner images of four colors formed by the image forming portions 131 C, 131 M, 131 Y and 131 K onto the sheet P.
- the fixer 138 fixes unfixed toner images on the sheet P.
- An operation panel 117 accepts a user operation.
- the operation panel 117 may display the verification result of the individual verification apparatus 10 on a window 154 on which an operation step may also be displayed.
- the controller 110 is the main controller of the copier 100 .
- a control signal is transmitted between the controller 110 and the CPU 17 (shown in FIG. 1 ) of the individual verification apparatus 10 .
- the individual verification method involved in the embodiment is an image processing method in the three timings carried out by the individual verification apparatus 10 .
- the first timing is the generation timing of first reference values.
- the second timing is the generation timing of image data for registration in database 11 .
- the third timing is a verification timing at which an image for verification is used.
- the individual verification method generates, during the first timing, first reference values for the brightness, the contrast ratio and the light reception direction of the background image in the image region photographed by the camera 14 .
- the individual verification method carries out a correction operation for input of image data for registration using the correction section 12 based on the first reference values of the background image, wherein the background image is relative to the image data for registration, in this way, a face image having second reference values is associated with the ID of an individual and then registered in a database in association with the ID.
- the individual verification method corrects, during the third timing, input image data for verification based on second reference values of image data for verification to generate corrected image data for verification.
- the individual verification method verifies the individual using the face part of the image data for verification and the face image in the database 11 .
- the copier 100 detects a touch on the operation panel 117 .
- the copier 100 displays a dialog box on the operation panel 117 .
- the dialog box displays, for the user, an operational requirement to verify whether the user can use the copier 100 nor not.
- the operation panel 117 requires the user to input a login name and a password. Further, the operation panel 117 starts the face verification of the individual verification apparatus 10 .
- the copier 100 takes a job.
- FIG. 5 is main flowchart illustrating a verification processing carried out by the individual verification apparatus 10 .
- Actions A 1 , A 2 and A 3 are equivalent to the first timing, the second timing and the third timing.
- the first timing is, for example, 8:00 am.
- the second timing is, for example, 12:00 pm.
- the third timing is, for example, 5:00 pm.
- the individual verification apparatus 10 takes the image of a background image and generates three first reference values.
- FIG. 6 is a flowchart illustrating a background image processing carried out by the individual verification apparatus 10 .
- Action B 1 as an imaging signal is generated which indicates the taking of an image at 8:00 am, the camera 14 takes the image of the background image.
- Action B 2 the individual verification apparatus 10 starts to generate a first reference value for the brightness in the background image.
- FIG. 7 is a diagram showing an example of an image region.
- the camera 14 outputs an image region 30 .
- the image region 30 has three areas A, B and C.
- the area A is an area for face verification.
- the areas B and C are both areas recognized for determining first reference values for correction.
- the reference value generation section 28 selects the area B or C as a reference value generation area.
- the reference value generation section 28 selects an area in which the verified object, that is, the verified individual, is not reflected.
- the reference value generation section 28 selects an area, for example, a wall or ceiling, which is always photographed by the camera 14 as a reference value generation area.
- the areas B and C are used for a comparison processing.
- the reference value generation section 28 calculates the brightness of the image region 30 by averaging the values of the colors between the color closest to the whitest color and the color closest to the darkest color.
- the reference value generation section 28 calculates a first reference value for contrast ratio in Act B 3 shown in FIG. 6 .
- the reference value generation section 28 calculates the contrast ratio of the image region 30 by dividing the value closest to the lowest brightness by the value closest to the highest brightness.
- the reference value generation section 28 calculates a first reference value for light reception direction in Act B 4 .
- FIG. 8 is diagram illustrating a light reception direction detection method.
- the image region 31 has a density because of a light source.
- the reference value generation section 28 calculates a light reception direction by comparing the brightness values of the areas 32 - 35 at four corners of the photographed image region 31 .
- the reference value generation section 28 compares the brightness values of the areas 32 and 33 .
- the area 32 is higher in brightness than the area 33 .
- the reference value generation section 28 compares the brightness values of the areas 32 and 34 . As the area 32 is higher in brightness than the area 34 . Thus, it can be determined that in the vertical direction of the reference value generation section 28 , the upper part of the image region is brighter than the lower part of the image region.
- the reference value generation section 28 compares a first difference between the brightness values of the areas 32 and 33 with a second difference between the brightness values of the areas 32 and 34 .
- the reference value generation section 28 determines whether or not one of the first and the second difference is greater or smaller than the other one.
- the reference value generation section 28 pre-stores data or a formula representing the correspondence relationship between the difference component of the first and the second difference and an offset in the ROM 18 .
- An offset presenting the degree by which the light reception direction is deviated from the vertical light reception direction of the camera 14 can be determined based on the result of the foregoing determination.
- the offset presents an in-plane quantity.
- An individual can be recognized more accurately by carrying out the foregoing three processing cooperatively.
- action A 2 the individual verification apparatus 10 compares the taken picture (image) with the first reference values.
- FIG. 9 is flowchart illustrating a process of registering a user image containing a face image in the database of the individual verification apparatus 10 .
- action C 1 the individual verification apparatus 10 matches the brightness of the image with the first reference value for brightness.
- the individual verification apparatus 10 matches the contrast and the light reception direction of the image with the first reference values for contrast ratio and light reception direction (actions C 2 and C 3 ).
- the individual verification apparatus 10 registers the user image having second reference values in the database 11 , wherein the second reference values refer to the adjusted or corrected brightness, contrast ratio and light reception direction.
- the individual verification apparatus 10 carries out an individual verification.
- the image data for verification obtained by the camera 14 is compared with the second reference values.
- FIG. 10 is a flowchart illustrating a recognition processing carried out by the individual verification apparatus 10 .
- action D 1 the individual verification apparatus 10 acquires image data for verification from the camera 14 .
- FIG. 11A is a diagram showing an example of an image registered in the database 11 .
- the image is a registered image on which the processing of action C 4 is performed.
- FIG. 11B is a diagram showing an example of an image for verification taken by the camera 14 .
- the image is a user picture taken at 5:00 pm which is relatively dark as sunlight irradiates the camera obliquely.
- the individual verification apparatus 10 carries out a brightness adjustment based on second reference values.
- FIG. 12A is a diagram showing a brightness-adjusted image for verification.
- the image shown in FIG. 12A is obtained by adjusting the brightness of the image shown in FIG. 11B .
- action D 3 the individual verification apparatus 10 carries out a contrast ratio adjustment.
- FIG. 12B is a diagram showing a contrast ratio-adjusted image for verification. After being adjusted in contrast ratio, the image for verification shown in FIG. 12A is adjusted in brightness and contrast ratio.
- action D 4 the individual verification apparatus 10 carries out a light reception direction adjustment.
- FIG. 12C is a diagram showing an image for verification adjusted in light reception direction. After being adjusted in light reception direction, the image for verification shown in FIG. 12A is adjusted in brightness, contrast ratio and light reception direction.
- the brightness, the contrast ratio and the light reception direction of the image for verification are all matched with the second reference values.
- action D 5 the individual verification apparatus 10 comparatively verifies a face image.
- action D 5 the result of the comparison is ‘matched’.
- action D 6 the individual verification apparatus 10 determines that the verification is successful through an ‘OK’ route.
- action D 7 the individual verification apparatus 10 outputs a positive verification result.
- action D 5 the result of the comparison is ‘unmatched’.
- action D 8 the individual verification apparatus 10 determines that the verification is failed through a ‘NG’ route.
- the individual verification apparatus 10 outputs a negative verification result (action D 7 )
- a specific user is permitted to use the copier 100 .
- An original document G is set through a user operation ( FIG. 4 ), and then the copier 100 copies the original document G.
- the contrast ratio and the light reception direction of an image for verification are adjusted prior to the implementation of an individual verification.
- the adjusted face image is registered in the database 11 . Apart from the influence caused by face data, the influence caused by the background surrounding the individual making a registration is also eliminated.
- the bust picture taken by the camera 14 contains a background, for example, a ceiling or wall, in the areas B and C outside the area A ( FIG. 7 ), the face verification can be completed highly accurately.
- the copier 100 is installed and used.
- the camera 14 generally photographs the same background.
- the individual verification apparatus 10 improves the recognition accuracy.
- the same individual is identified as the same individual, regardless of the brightness of the surroundings.
- An individual can be correctly recognized in the morning or at dusk when sunlight comes from a different direction.
- the individual verification apparatus 10 may also take the image of a background during the period of time within which the copier 100 is used frequently.
- the first reference values are generated based on a plurality of persons and the same time period, thereby obtaining the brightness, the contrast ratio and the light reception direction which are substantially the means of those obtained from the images of the plurality of persons.
- the illumination around the copier 100 changes according to the surroundings, for example, the illumination around the copier 100 changes with sunlight during the day and an illuminator or identification lamp at night.
- the recognition accuracy is guaranteed in any environment. The same person can be recognized correctly in any period of time.
- the copier 100 Provided with an individual verification system for carrying out an individual verification using a face image, the copier 100 achieves a high verification accuracy.
- the first reference values are not used in the second embodiment. After collecting information from an information server through a network, the individual verification apparatus involved in the embodiment carries out an image correction.
- FIG. 13 is a block diagram illustrating an individual verification apparatus involved in the second embodiment.
- An individual verification apparatus 40 carries out an image correction using the information received from an information server 23 .
- the individual verification apparatus 40 is arranged on the copier 100 .
- the individual verification apparatus 40 is provided with a network interface 21 .
- the network interface 21 receives information from the information server 23 through a network 22 .
- the individual verification apparatus 40 has a prediction correction section 41 (correction section) which calculates the magnitudes of the changes of the brightness, the contrast ratio and the light reception direction of a face image.
- the prediction correction section 41 calculates the magnitudes of the changes based on a plurality of sample images taken by the camera 14 at fixed moments of many days.
- the prediction correction section 41 calculates the line-of-sight direction of the camera 14 based on magnitudes of changes, date information and pre-stored sun position information indicating the position of the sun at each moment.
- Date information is mm/dd/yyyy.
- the prediction correction section 41 associates date information with an image taken at the same day.
- the date information is provided by a defaulted function of the CPU 17 .
- the other parts of the individual verification apparatus 40 are substantially structurally identical to the individual verification apparatus 10 shown in FIG. 1 , if not defined particularly.
- the prediction correction section 41 acquires, the daily azimuth and altitude of the sun, that is, the daily position information of the sun through, for example, a download operation. Alternatively, the prediction correction section 41 calculates the azimuth and the altitude of the sun using a calculation formula in which date is used as a variable.
- the prediction correction section 41 causes the camera 14 to take images at fixed moments, for example, causes the camera 14 to take the image of a background at 12:00 pm every Monday.
- the prediction correction section 41 stores a plurality of image samples in the storage device 20 .
- the prediction correction section 41 collects the sample images taken at 12:00 pm every Monday in several past months.
- the prediction correction section 41 extracts the brightness, the contrast ratio and the light reception direction of each sample image. For example, the prediction correction section 41 records the azimuth and the altitude of the sun at 12:00 pm on August 6.
- the prediction correction section 41 accumulates daily sample data for several months.
- the prediction correction section 41 calculates the magnitudes of the changes occurring in brightness, contrast ratio and light reception direction at 12:00 pm of an unknown day.
- the prediction correction section 41 determines, according to brightness values of image data, that the unknown day is darker than the days in August.
- the prediction correction section 41 determines, by comprising the altitude of the sun in the south in august with that of the sun in the south on the unknown day, that the sun in the south on the unknown day is lower in altitude.
- the prediction correction section 41 determines that the time is 12:00 pm on January 10 according to observation information and the position information of the sun.
- the observation information refers to the brightness of the sun, the south azimuth of the sun and the coordinates of the altitude of the sun.
- the prediction correction section 41 detects the line-of-sight direction of the camera 14 based on a specific date and the observation information.
- the prediction correction section 41 can detect the direction the camera 14 faces.
- the individual verification apparatus 40 takes the picture of a user using the camera 14 after 12:00 pm.
- the taken image for registration is input to the individual verification apparatus 40 .
- the individual verification apparatus 40 associates the face image data in the image data for registration with personal ID and then registers the associated face image data and personal ID in the database 11 , without correcting a background image.
- image data for verification is input to the prediction correction section 41 at 4:00 pm, then the image data for verification is corrected using reference values for face images registered in the database 11 .
- the prediction correction section 41 generates image data for verification.
- the verification section 13 verifies the individual using the face part of the image data for verification and the face images in the database 11 .
- the individual verification apparatus 40 can determine the line-of-sight direction of the camera 14 according to the magnitude of the change in the position of the sun at a fixed position.
- the prediction correction section 41 eliminates the influence caused by the shade of a neighboring building or by the reflection from a window on the result of the determination.
- image data for verification can be corrected without using a background image.
- the light reception direction mainly changes with the azimuth of the sun and the altitude of the sun with time going on. This is because sunlight enters a room from a window from different azimuths and different angles at different time.
- the camera 14 In a stationary type copier 100 , the camera 14 is located at a fixed position with respect to a window, facing a fixed direction. The position relationship between the camera 14 and the window is unchanged no matter where the copier 100 is arranged, what the season it is and when the time it is.
- the individual verification apparatus 40 can predict the direction the camera 14 faces.
- Correction values can be determined according to the date on which face image data for registration is taken, without using the first reference values.
- a light source refers to an indoor illuminator.
- the individual verification apparatus 40 may use a building maintenance server managed by a building management corporation as the information server 23 .
- the information server 23 sends the illuminance of the illuminator in each residential room in real time.
- the illuminance is, or example, a Lux value.
- a smart meter is installed in the room.
- the information server 23 collects the real-time power consumption of each room for the individual verification apparatus 40 using a smart system.
- the individual verification apparatus 40 receives the illuminance information of the illuminator in a room from the information server 23 .
- the prediction correction section 41 calculates the brightness of a face image according to the illuminance information of the illuminator in a room received from the information server 23 .
- the prediction correction section 41 calculates the contrast ratio and the brightness of the face image in the same way.
- the prediction correction section 41 calculates the light reception direction of the face image according to pre-stored illuminator information.
- the illuminator information refers to the positions of indoor illuminators, the number of indoor illuminators and the orientations of the indoor illuminators with respect to the camera 14 .
- the information server 23 may be an in-company server provided by a company for the departments of the company.
- the individual verification apparatus 40 acquires image data for registration using the camera 14 at 12:00 pm.
- the individual verification apparatus 40 associates the face image data in the image data for registration with personal ID and then registers the associated face image data and personal ID in the database 11 , without carrying out a correction using a background image.
- the individual verification apparatus 40 corrects input image data for registration using the reference values stored in the database 11 for face images at 4:00 pm.
- the verification section 13 verifies an individual using the face part of the image data for verification and the face images in the database 11 .
- the change in the weather is acquired form the information server 23 .
- the prediction correction section 41 calculates the brightness, the contrast ratio and the light reception direction of a face image according to the weather information indicating a sunny day or a rainy day acquired from the information server 23 .
- the individual verification apparatus 40 can determine the brightness and the contrast ratio of the face image according to the illumination condition and the weather information of the location where the copier 100 is arranged.
- the individual verification apparatus 40 After acquiring illumination information and weather information through the network 22 , the individual verification apparatus 40 corrects the face image.
- the first reference values are not used during the correction process.
- Correction values can be determined by associating registered image data for verification with the illumination condition or weather information.
- the installation location of the copier 100 , the season, the date, the weather and the illumination condition are all stored in the individual verification apparatus 40 .
- the individual verification apparatus reduces the influence from the surroundings when carrying out a face verification.
- FIG. 1 - FIG. 13 are merely exemplary and can be variously modified in structure or step.
- the individual verification apparatus 10 performs a pre-processing if the background is not a single color different from black or a single pattern, for example, if the ceiling or wall is coated by different colors.
- the individual verification apparatus 10 converts an image area (the area B or C) corresponding to a coated part into a white color in advance.
- the individual verification apparatus 10 carries out a verification processing after the ceiling or wall is pre-covered by white paper.
- Reference values can be highly accurately obtained according to the position, for example, the area B or C, where correction values are detected.
- the camera 14 may be an infrared camera or a near-infrared camera.
- a light reception direction is represented by an angle by which the light reception direction is deviated from the perpendicular line of an image area.
- the light reception direction may represent a solid angle using the angle of the deviation of the light reception direction from the center of the view of the camera 14 .
- an image region may be divided into grids, and then the direction along which brightness changes is detected.
- an image region may be divided into a plurality of slits, and then the direction along which brightness changes is detected.
- the camera 14 may be installed at any position of the copier 100 .
- the camera 14 may be immobilized on the body of the copier by a bracket, an arm or a brace.
- Holes may be set on the cover of the copier 100 .
- the camera 14 may be immobilized on an inner side of the cover with its image sensor panel exposed outside the cover from the hole.
- the back of the image sensor panel should not face a light source.
- the individual verification apparatus 10 may be provided with a Bluetooth (registered trademark) interface.
- a wireless camera may send an image to the individual verification apparatus 10 according to a Bluetooth-based communication protocol.
- a wireless camera fixed on the wall or ceiling of a room takes image data for verification and image data for registration. Installation at such a position, the wireless camera gets a wider view and can take an image more freely. Moreover, verification accuracy is improved.
- the wireless camera may be an installed multi-function peripheral.
- a processor-readable recording medium causes a CPU to execute various processing, wherein the recording medium may be a USB memory, a CD-ROM or a DVD-ROM.
- Modified embodiments cause no impairment to the priority of the image forming apparatus, the image forming method and the recording medium involved herein.
Abstract
Certain embodiments provide an individual verification apparatus, comprising: a database configured to associate a face image having the brightness and the light reception direction of an image region with the personal information of an individual; a correction section configured to carry out a correction operation using a correction amount pre-stored for image data for verification having another brightness and another light reception direction; and a verification section configured to verify the individual using the face part in the image data for verification which is corrected in at least one of brightness and light reception direction and the face image in the database.
Description
- This application is a Continuation of application Ser. No. 14/724,923 filed on May 29, 2015, the entire contents of which are incorporated herein by reference.
- Certain embodiments relate to an individual verification apparatus, an individual verification method and a non-transitory computer-readable recording medium.
- A copier is known which is provided with an individual verification system based on a camera.
- The camera takes the image of a face. A plurality of face images are registered in a database. The system verifies an individual using the image data of the individual and the image data in the database.
- The copier is placed at a certain position which is fixed with respect to a window. The angle of view of the camera is fixed.
- However, the intensity of light varies. For the camera, sunlight comes from different directions with different intensities. The brightness around the copier is different at 8.00 am, 12.00 μm and 5.00 μm.
- At night, an indoor illuminator, instead of the sunlight coming from the window, irradiates the camera. The light of an identification lamp irradiates the copier from the window at night.
- For the camera, the light of a light source comes from different directions and different angles in different seasons. The brightness of the light source changes with the weather.
- The brightness, the contrast ratio and the light reception direction of an installed camera change with the surroundings.
- An individual verification apparatus, even when used to take the face image of the same person, is different in face recognition precision in different environments.
-
FIG. 1 is a block diagram illustrating an individual verification apparatus according to a first embodiment; -
FIG. 2 is a functional block diagram illustrating the correction section of the individual verification apparatus according to the first embodiment; -
FIG. 3A is a diagram showing an example of an image facing the individual verification apparatus according to the first embodiment; -
FIG. 3B is a diagram showing another example of an image facing the individual verification apparatus according to the first embodiment; -
FIG. 4 is a diagram illustrating the structure of a copier provided with the individual verification apparatus according to the first embodiment; -
FIG. 5 is main flowchart illustrating a verification processing carried out by the individual verification apparatus according to the first embodiment; -
FIG. 6 is a flowchart illustrating a background image processing carried out by the individual verification apparatus according to the first embodiment; -
FIG. 7 is a diagram showing an example of the image region of the individual verification apparatus according to the first embodiment; -
FIG. 8 is a diagram illustrating a detection method of light reception direction based on the individual verification apparatus according to the first embodiment; -
FIG. 9 is a flowchart illustrating a process of registering data in the face image database of the individual verification apparatus according to the first embodiment; -
FIG. 10 is a flowchart illustrating a recognition processing carried out by the individual verification apparatus according to the first embodiment. -
FIG. 11A is a diagram showing an example of an image registered in the database of the individual verification apparatus according to the first embodiment. -
FIG. 11B is a diagram showing an example of an image for verification taken by the camera of the individual verification apparatus according to the first embodiment; -
FIG. 12A is a diagram showing an image for verification the brightness of which is adjusted by the individual verification apparatus according to the first embodiment; -
FIG. 12B is a diagram showing an image for verification the contrast ratio of which is adjusted by the individual verification apparatus according to the first embodiment; -
FIG. 12C is a diagram showing an image for verification the light reception direction of which is adjusted by the individual verification apparatus according to the first embodiment; and -
FIG. 13 is a block diagram illustrating an individual verification apparatus according to a second embodiment. - Certain embodiments provide an individual verification apparatus, including: a database configured to associate a face image with the personal information of an individual, wherein the face image has the first brightness and the first light reception direction of an image region in which an individual is irradiated by a light source the direction of which varies if observed from a fixed line-of-sight direction; a correction section configured to carry out a correction operation using a correction amount pre-stored for image data for verification, wherein the image data for verification has a second brightness and a second light reception direction; and a verification section configured to verify the individual using the face part in the image data for verification and the face image stored in the database, wherein at least one of the second brightness and the second light reception direction of the face part of the image data for verification is corrected.
- By taking those shown in accompanying drawings as an example, the individual verification apparatus, the individual verification method and the computer-readable recording medium are described below in detail. Moreover, in the accompanying drawings, the same parts are denoted by the same reference signs and are not described repeatedly when presented again.
-
FIG. 1 is a block diagram illustrating an individual verification apparatus involved in the first embodiment. Anindividual verification apparatus 10 verifies, using a face image, the identity of the operator of a copier installed indoors. - The
individual verification apparatus 10 comprises adatabase 11, acorrection section 12, averification section 13, acamera 14 and astorage section 15. - The
database 11 associates a face image with personal ID (identification) (personal information) and stores the associated face image and personal ID, wherein the face image having the brightness, the contrast ratio and the light reception direction of an image region in which an individual is irradiated by a light source the direction of which varies if observed from a fixed line-of-sight direction. - The
correction section 12 carries out a correction operation using a correction amount pre-stored for image data for verification which has another brightness, another contrast ratio and another light reception direction. - The
verification section 13 verifies an individual using the face part of the image data for verification and the face image in thedatabase 11, wherein at least one of the brightness, the contrast ratio and the light reception direction of the face part of the image data for verification is corrected by thecorrection section 12. - The
camera 14 separately acquires image data for registration and image data for verification at different timing. - The image data for registration refers to a user image which is registered in the
database 11 before a user is verified. The image data for verification refers to a user image which is compared with the image data for registration that serves as a reference. - The
storage section 15 stores first reference values for the brightness, the contrast ratio and the light reception direction of a background image. - The
database 11 associates the face images of a plurality of persons with their personal ID information separately such as their employee numbers. - The face image is an image taken by the
camera 14 from a fixed line-of-sight direction. The fixed line-of-sight direction is the line-of-sight direction of thecamera 14 fixed on thecopier 100. - The face image has attribute values including brightness, contrast ratio and light reception direction.
- The light source is sunlight, an indoor illuminator or an outdoor identification lamp.
-
FIG. 2 is a functional block diagram illustrating thecorrection section 12. The reference signs which are illustrated above denote the same components inFIG. 2 . - The
correction section 12 comprises abrightness adjustment portion 25 and a contrastratio adjustment portion 26. - The
brightness adjustment portion 25 carries out a brightness adjustment. - Brightness refers to brightness values of R (red), G (green) and B (blue). The brightness of a pixel represents an RGB with a brightness value of, for example, eight bits. Each RGB of the plurality of pixels in an image region has a brightness value.
- The
brightness adjustment portion 25 adjusts all brightness values of RGB. - The contrast
ratio adjustment portion 26 carries out a contrast ratio adjustment. Contrast ratio refers to the black-to-white ratio in an image region. Black refers to the minimal brightness, and white refers to the maximum brightness. - The
correction section 12 is provided with a light receptiondirection adjustment portion 27 for adjusting a light reception direction. -
FIG. 3A andFIG. 3B show examples of images taken in the morning and at dusk. - In the
image 29A taken by thecamera 14, the left-upper area is higher in brightness, and the right-lower area of theimage 29A is lower in brightness, wherein ‘higher’ and ‘lower’ are relative. - In the
image 29B taken by thecamera 14, the area between the right top and the right bottom is higher in brightness, and the area between the left top and the left bottom is lower in brightness. - The light reception direction refers to the direction along which brightness lowers from the brightness of a high-brightness area to that of a low-brightness area in the image data.
- In the
image region 29A, brightness changes in the direction from the left-upper vertex to the right-lower vertex. - In the
image region 29B, brightness changes in the horizontal direction. - The light reception
direction adjustment portion 27 changes the light reception direction of theimage region image region - The
correction section 12 shown inFIG. 1 corrects the image data for registration based on the first reference values of the background image. After completing the correction operation based on the first reference values, thecorrection section 12 registers the face image the brightness, the contrast ratio and the light reception direction of which are updated to second reference values in thedatabase 11. - The
correction section 12 corrects the image data for verification using the second reference values. - The
verification section 13 compares the face image which is stored in thedatabase 11 after being updated in brightness, contrast ratio and light reception direction with the face image in the image data for verification acquired by thecamera 14. Theverification section 13 outputs a result representing the success or failure of the face verification according to the result of the comparison. -
FIG. 4 is a diagram illustrating the structure of a copier provided with theindividual verification apparatus 10. The reference signs which are described above denote the same elements inFIG. 4 . - The
camera 14 is fixed on thecopier 100 at a position where thecamera 14 constitutes no obstacle to the user operating thecopier 100. - The
camera 14 which uses a Charge Coupled Device (CCD) image sensor or a Complementary MOS (COMOS) image sensor is positioned with its image sensor panel facing the face of the user. - The image data for registration has its brightness, contrast ratio and light reception direction. The image data for verification also has its brightness, contrast ratio and light reception direction.
- The first reference values stored in the
storage section 15 shown inFIG. 1 are values for correcting the face image registered in thedatabase 11. The first reference brightness, the first reference contrast ratio and the first reference light reception direction each have a value of a plurality of bits. - The
storage section 15 uses astorage device 20 which is a hard disk drive or a solid state drive. - The
individual verification apparatus 10 may further comprise a referencevalue generation section 28 configured to generate first reference values for the brightness, the contrast ratio and the light reception direction of a background image. - Further, there is a central Processing Unit (CPU) 17, a Read Only Memory (ROM) 18, a Random Access Memory (RAM) 19 and the
camera 14 on thebus line 16 of theindividual verification apparatus 10. - The
CPU 17, theROM 18 and theRAM 19 execute the functions of thecorrection section 12 and theverification section 13. - The
CPU 17 functions as the main controller of theindividual verification apparatus 10. - The
RAM 19 provides a working storage area for theCPU 17. - The
ROM 18 is a non-transitory computer-readable recording medium for causing theCPU 17 to execute the following processing: - a processing of correcting the brightness, the contrast ratio and the light reception direction of the face image and the background image in an image region;
- a processing of generating first reference values for the brightness, the contrast ratio and the light reception direction of the background image;
- a processing of correcting image data for registration which as its brightness, contrast and light reception direction based on the first reference values of the background image, associating the face image with personal ID and performing a write access processing on the address of the
database 11, wherein the face image has second reference values in brightness, contrast ratio and light reception direction; - a processing of correcting image data for verification having another brightness, another contrast ratio or another light reception direction using the second reference values to generate corrected image data for verification; and
- a processing of verifying an individual using the face part in the image data for verification and the face image in the
database 11. - The
bus line 16 is electrically connected with thecontroller 110 of thecopier 100. - As shown in
FIG. 4 , thecopier 100 comprises ascanner 113, anetwork interface 114, aprinter section 115 and acontroller 110. - The
scanner 113 scans one side of an original document G using adocument feeder 120. - The
network interface 114 receives printing spool data from aPC 126 through anetwork 125. - The
printer section 115 configured to be installed and for a person to perform a user operation prints an image using four printing colors C, M, Y and K and then outputs the printed image. - The
printer section 115 is equipped with fourexposers 129, fourimage forming portions belt 130. - The
exposer 129 modulates an image signal into laser rays using semiconductor laser of each color. Thebelt 130 endlessly travels anticlockwise. - The image forming portion 131 for yellow color comprises: a
drum 132, acharger 133, adeveloper 134 and atransferring device 135. - The
drum 132 is a photoconductive drum rotating along a clockwise direction T. - The
charger 133 charges the surface of thedrum 132. - The
developer 134 develops the electrostatic latent image on thedrum 132 using a toner. - The transferring
device 135 primarily transfers the toner image on thedrum 132 onto thebelt 130. - The
image forming portion 131M for magenta color, theimage forming portion 131C for cyan color and theimage forming portion 131K for black color are substantially structurally identical to theimage forming section 131Y. - Further, the
printer section 115 has asheet conveying mechanism 136, asecondary transferring device 137 and afixer 138. - The
sheet conveying mechanism 136 takes a sheet P from atray 139 and guides the sheet P to theprinter section 115. - The
secondary transferring device 137 secondarily transfers toner images of four colors formed by theimage forming portions - The
fixer 138 fixes unfixed toner images on the sheet P. - An
operation panel 117 accepts a user operation. - The
operation panel 117 may display the verification result of theindividual verification apparatus 10 on awindow 154 on which an operation step may also be displayed. - The
controller 110 is the main controller of thecopier 100. A control signal is transmitted between thecontroller 110 and the CPU 17 (shown inFIG. 1 ) of theindividual verification apparatus 10. - Further, the individual verification method involved in the embodiment is an image processing method in the three timings carried out by the
individual verification apparatus 10. - The first timing is the generation timing of first reference values.
- The second timing is the generation timing of image data for registration in
database 11. - The third timing is a verification timing at which an image for verification is used.
- The individual verification method generates, during the first timing, first reference values for the brightness, the contrast ratio and the light reception direction of the background image in the image region photographed by the
camera 14. - The individual verification method, during the second timing, carries out a correction operation for input of image data for registration using the
correction section 12 based on the first reference values of the background image, wherein the background image is relative to the image data for registration, in this way, a face image having second reference values is associated with the ID of an individual and then registered in a database in association with the ID. - The individual verification method corrects, during the third timing, input image data for verification based on second reference values of image data for verification to generate corrected image data for verification.
- The individual verification method verifies the individual using the face part of the image data for verification and the face image in the
database 11. - Next, the functional actions of the
individual verification apparatus 10 are described below. - The
copier 100 detects a touch on theoperation panel 117. Thecopier 100 displays a dialog box on theoperation panel 117. The dialog box displays, for the user, an operational requirement to verify whether the user can use thecopier 100 nor not. - For example, the
operation panel 117 requires the user to input a login name and a password. Further, theoperation panel 117 starts the face verification of theindividual verification apparatus 10. - As the face verification succeeds, the
copier 100 takes a job. - The registration of a user in the
individual verification apparatus 10 before the face of the user is verified is described below. -
FIG. 5 is main flowchart illustrating a verification processing carried out by theindividual verification apparatus 10. - Actions A1, A2 and A3 are equivalent to the first timing, the second timing and the third timing.
- The first timing is, for example, 8:00 am. The second timing is, for example, 12:00 pm. The third timing is, for example, 5:00 pm.
- In Action A1, the
individual verification apparatus 10 takes the image of a background image and generates three first reference values. -
FIG. 6 is a flowchart illustrating a background image processing carried out by theindividual verification apparatus 10. - In Action B1, as an imaging signal is generated which indicates the taking of an image at 8:00 am, the
camera 14 takes the image of the background image. - In Action B2, the
individual verification apparatus 10 starts to generate a first reference value for the brightness in the background image. -
FIG. 7 is a diagram showing an example of an image region. Thecamera 14 outputs animage region 30. Theimage region 30 has three areas A, B and C. - The area A is an area for face verification.
- The areas B and C are both areas recognized for determining first reference values for correction.
- The reference
value generation section 28 selects the area B or C as a reference value generation area. - The reference
value generation section 28 selects an area in which the verified object, that is, the verified individual, is not reflected. - The reference
value generation section 28 selects an area, for example, a wall or ceiling, which is always photographed by thecamera 14 as a reference value generation area. The areas B and C are used for a comparison processing. - For example, the reference
value generation section 28 calculates the brightness of theimage region 30 by averaging the values of the colors between the color closest to the whitest color and the color closest to the darkest color. - Sequentially, the reference
value generation section 28 calculates a first reference value for contrast ratio in Act B3 shown inFIG. 6 . - For example, the reference
value generation section 28 calculates the contrast ratio of theimage region 30 by dividing the value closest to the lowest brightness by the value closest to the highest brightness. - Further, the reference
value generation section 28 calculates a first reference value for light reception direction in Act B4. -
FIG. 8 is diagram illustrating a light reception direction detection method. Theimage region 31 has a density because of a light source. - The reference
value generation section 28 calculates a light reception direction by comparing the brightness values of the areas 32-35 at four corners of the photographedimage region 31. - The reference
value generation section 28 compares the brightness values of theareas FIG. 8 , thearea 32 is higher in brightness than thearea 33. Thus, it can be determined that in the horizontal direction of the referencevalue generation section 28, the left part of the image region is brighter than the right part of the image region. - Next, the reference
value generation section 28 compares the brightness values of theareas area 32 is higher in brightness than thearea 34. Thus, it can be determined that in the vertical direction of the referencevalue generation section 28, the upper part of the image region is brighter than the lower part of the image region. - Further, the reference
value generation section 28 compares a first difference between the brightness values of theareas areas - The reference
value generation section 28 determines whether or not one of the first and the second difference is greater or smaller than the other one. - As an example, the reference
value generation section 28 pre-stores data or a formula representing the correspondence relationship between the difference component of the first and the second difference and an offset in theROM 18. - An offset presenting the degree by which the light reception direction is deviated from the vertical light reception direction of the
camera 14 can be determined based on the result of the foregoing determination. The offset presents an in-plane quantity. - An individual can be recognized more accurately by carrying out the foregoing three processing cooperatively.
- In action A2 shown in
FIG. 5 , before registering a user in thedatabase 11, theindividual verification apparatus 10 takes an image of the user. - In action A2, the
individual verification apparatus 10 compares the taken picture (image) with the first reference values. -
FIG. 9 is flowchart illustrating a process of registering a user image containing a face image in the database of theindividual verification apparatus 10. - In action C1, the
individual verification apparatus 10 matches the brightness of the image with the first reference value for brightness. - The
individual verification apparatus 10 matches the contrast and the light reception direction of the image with the first reference values for contrast ratio and light reception direction (actions C2 and C3). - Then, adjusted or corrected brightness, contrast ratio and light reception direction are obtained.
- In action C4, the
individual verification apparatus 10 registers the user image having second reference values in thedatabase 11, wherein the second reference values refer to the adjusted or corrected brightness, contrast ratio and light reception direction. - In action A3 shown in
FIG. 5 , theindividual verification apparatus 10 carries out an individual verification. The image data for verification obtained by thecamera 14 is compared with the second reference values. -
FIG. 10 is a flowchart illustrating a recognition processing carried out by theindividual verification apparatus 10. - In action D1, the
individual verification apparatus 10 acquires image data for verification from thecamera 14. -
FIG. 11A is a diagram showing an example of an image registered in thedatabase 11. The image is a registered image on which the processing of action C4 is performed. -
FIG. 11B is a diagram showing an example of an image for verification taken by thecamera 14. The image is a user picture taken at 5:00 pm which is relatively dark as sunlight irradiates the camera obliquely. - Sequentially, in action D2 shown in
FIG. 10 , theindividual verification apparatus 10 carries out a brightness adjustment based on second reference values. -
FIG. 12A is a diagram showing a brightness-adjusted image for verification. The image shown inFIG. 12A is obtained by adjusting the brightness of the image shown inFIG. 11B . - In action D3, the
individual verification apparatus 10 carries out a contrast ratio adjustment. -
FIG. 12B is a diagram showing a contrast ratio-adjusted image for verification. After being adjusted in contrast ratio, the image for verification shown inFIG. 12A is adjusted in brightness and contrast ratio. - In action D4, the
individual verification apparatus 10 carries out a light reception direction adjustment. -
FIG. 12C is a diagram showing an image for verification adjusted in light reception direction. After being adjusted in light reception direction, the image for verification shown inFIG. 12A is adjusted in brightness, contrast ratio and light reception direction. - In this way, the brightness, the contrast ratio and the light reception direction of the image for verification are all matched with the second reference values.
- In action D5, the
individual verification apparatus 10 comparatively verifies a face image. - In action D5, the result of the comparison is ‘matched’. In action D6, the
individual verification apparatus 10 determines that the verification is successful through an ‘OK’ route. - In action D7, the
individual verification apparatus 10 outputs a positive verification result. - In action D5, the result of the comparison is ‘unmatched’. In action D8, the
individual verification apparatus 10 determines that the verification is failed through a ‘NG’ route. Theindividual verification apparatus 10 outputs a negative verification result (action D7) - A specific user is permitted to use the
copier 100. An original document G is set through a user operation (FIG. 4 ), and then thecopier 100 copies the original document G. - As the brightness, the contrast ratio and the light reception direction of an image for verification are adjusted prior to the implementation of an individual verification. The adjusted face image is registered in the
database 11. Apart from the influence caused by face data, the influence caused by the background surrounding the individual making a registration is also eliminated. - Even in a case where the bust picture taken by the
camera 14 contains a background, for example, a ceiling or wall, in the areas B and C outside the area A (FIG. 7 ), the face verification can be completed highly accurately. - The
copier 100 is installed and used. Thecamera 14 generally photographs the same background. - By correcting an image using the pattern and the color of a background, the
individual verification apparatus 10 improves the recognition accuracy. - The same individual is identified as the same individual, regardless of the brightness of the surroundings.
- The accuracy of individual recognition is improved no matter what the contrast ratio in a bright or dark environment is.
- An individual can be correctly recognized in the morning or at dusk when sunlight comes from a different direction.
- Further, the
individual verification apparatus 10 may also take the image of a background during the period of time within which thecopier 100 is used frequently. - The first reference values are generated based on a plurality of persons and the same time period, thereby obtaining the brightness, the contrast ratio and the light reception direction which are substantially the means of those obtained from the images of the plurality of persons.
- The illumination around the
copier 100 changes according to the surroundings, for example, the illumination around thecopier 100 changes with sunlight during the day and an illuminator or identification lamp at night. With the use of theindividual verification apparatus 10, the recognition accuracy is guaranteed in any environment. The same person can be recognized correctly in any period of time. - Provided with an individual verification system for carrying out an individual verification using a face image, the
copier 100 achieves a high verification accuracy. - In the first embodiment, when the user registers at 12:00 pm, an image correction is carried out using the first reference values generated at 8:00 am.
- The first reference values are not used in the second embodiment. After collecting information from an information server through a network, the individual verification apparatus involved in the embodiment carries out an image correction.
-
FIG. 13 is a block diagram illustrating an individual verification apparatus involved in the second embodiment. Anindividual verification apparatus 40 carries out an image correction using the information received from aninformation server 23. - The
individual verification apparatus 40 is arranged on thecopier 100. - The
individual verification apparatus 40 is provided with anetwork interface 21. Thenetwork interface 21 receives information from theinformation server 23 through anetwork 22. - The
individual verification apparatus 40 has a prediction correction section 41 (correction section) which calculates the magnitudes of the changes of the brightness, the contrast ratio and the light reception direction of a face image. - The
prediction correction section 41 calculates the magnitudes of the changes based on a plurality of sample images taken by thecamera 14 at fixed moments of many days. - The
prediction correction section 41 calculates the line-of-sight direction of thecamera 14 based on magnitudes of changes, date information and pre-stored sun position information indicating the position of the sun at each moment. - Date information is mm/dd/yyyy. The
prediction correction section 41 associates date information with an image taken at the same day. The date information is provided by a defaulted function of theCPU 17. - The other parts of the
individual verification apparatus 40 are substantially structurally identical to theindividual verification apparatus 10 shown inFIG. 1 , if not defined particularly. - Next, the functional actions of the
individual verification apparatus 40 having this structure are described below. - (1) First Form
- First, the
prediction correction section 41 acquires, the daily azimuth and altitude of the sun, that is, the daily position information of the sun through, for example, a download operation. Alternatively, theprediction correction section 41 calculates the azimuth and the altitude of the sun using a calculation formula in which date is used as a variable. - The
prediction correction section 41 causes thecamera 14 to take images at fixed moments, for example, causes thecamera 14 to take the image of a background at 12:00 pm every Monday. - The
prediction correction section 41 stores a plurality of image samples in thestorage device 20. - For example, the
prediction correction section 41 collects the sample images taken at 12:00 pm every Monday in several past months. - The
prediction correction section 41 extracts the brightness, the contrast ratio and the light reception direction of each sample image. For example, theprediction correction section 41 records the azimuth and the altitude of the sun at 12:00 pm on August 6. - The
prediction correction section 41 accumulates daily sample data for several months. - The
prediction correction section 41 calculates the magnitudes of the changes occurring in brightness, contrast ratio and light reception direction at 12:00 pm of an unknown day. - The
prediction correction section 41 determines, according to brightness values of image data, that the unknown day is darker than the days in August. - The
prediction correction section 41 determines, by comprising the altitude of the sun in the south in august with that of the sun in the south on the unknown day, that the sun in the south on the unknown day is lower in altitude. - The
prediction correction section 41 determines that the time is 12:00 pm on January 10 according to observation information and the position information of the sun. The observation information refers to the brightness of the sun, the south azimuth of the sun and the coordinates of the altitude of the sun. - Further, the
prediction correction section 41 detects the line-of-sight direction of thecamera 14 based on a specific date and the observation information. Theprediction correction section 41 can detect the direction thecamera 14 faces. - Then, the
individual verification apparatus 40 takes the picture of a user using thecamera 14 after 12:00 pm. The taken image for registration is input to theindividual verification apparatus 40. - The
individual verification apparatus 40 associates the face image data in the image data for registration with personal ID and then registers the associated face image data and personal ID in thedatabase 11, without correcting a background image. - Sequentially, if image data for verification is input to the
prediction correction section 41 at 4:00 pm, then the image data for verification is corrected using reference values for face images registered in thedatabase 11. Theprediction correction section 41 generates image data for verification. - The
verification section 13 verifies the individual using the face part of the image data for verification and the face images in thedatabase 11. - Even if the line-of-sight direction of the
camera 14 is unknown to theprediction correction section 41, theindividual verification apparatus 40 can determine the line-of-sight direction of thecamera 14 according to the magnitude of the change in the position of the sun at a fixed position. - As the line-of-sight direction of the
camera 14 can be determined according to the magnitude of the change in sun position, theprediction correction section 41 eliminates the influence caused by the shade of a neighboring building or by the reflection from a window on the result of the determination. - By using the
individual verification apparatus 40, image data for verification can be corrected without using a background image. - The light reception direction mainly changes with the azimuth of the sun and the altitude of the sun with time going on. This is because sunlight enters a room from a window from different azimuths and different angles at different time.
- In a
stationary type copier 100, thecamera 14 is located at a fixed position with respect to a window, facing a fixed direction. The position relationship between thecamera 14 and the window is unchanged no matter where thecopier 100 is arranged, what the season it is and when the time it is. - By making a determination at a determined time, for example, at 12:00 pm, every other day, the
individual verification apparatus 40 can predict the direction thecamera 14 faces. - Correction values can be determined according to the date on which face image data for registration is taken, without using the first reference values.
- (2) Second Form
- In the second form, a light source refers to an indoor illuminator.
- The
individual verification apparatus 40 may use a building maintenance server managed by a building management corporation as theinformation server 23. - The
information server 23 sends the illuminance of the illuminator in each residential room in real time. The illuminance is, or example, a Lux value. A smart meter is installed in the room. - The
information server 23 collects the real-time power consumption of each room for theindividual verification apparatus 40 using a smart system. - The
individual verification apparatus 40 receives the illuminance information of the illuminator in a room from theinformation server 23. - The
prediction correction section 41 calculates the brightness of a face image according to the illuminance information of the illuminator in a room received from theinformation server 23. - The
prediction correction section 41 calculates the contrast ratio and the brightness of the face image in the same way. - The
prediction correction section 41 calculates the light reception direction of the face image according to pre-stored illuminator information. The illuminator information refers to the positions of indoor illuminators, the number of indoor illuminators and the orientations of the indoor illuminators with respect to thecamera 14. - The
information server 23 may be an in-company server provided by a company for the departments of the company. - The
individual verification apparatus 40 acquires image data for registration using thecamera 14 at 12:00 pm. - The
individual verification apparatus 40 associates the face image data in the image data for registration with personal ID and then registers the associated face image data and personal ID in thedatabase 11, without carrying out a correction using a background image. - The
individual verification apparatus 40 corrects input image data for registration using the reference values stored in thedatabase 11 for face images at 4:00 pm. - The
verification section 13 verifies an individual using the face part of the image data for verification and the face images in thedatabase 11. - (3) Third Form
- In the third form, the change in the weather is acquired form the
information server 23. - The
prediction correction section 41 calculates the brightness, the contrast ratio and the light reception direction of a face image according to the weather information indicating a sunny day or a rainy day acquired from theinformation server 23. - The
individual verification apparatus 40 can determine the brightness and the contrast ratio of the face image according to the illumination condition and the weather information of the location where thecopier 100 is arranged. - After acquiring illumination information and weather information through the
network 22, theindividual verification apparatus 40 corrects the face image. The first reference values are not used during the correction process. - Correction values can be determined by associating registered image data for verification with the illumination condition or weather information.
- As stated above, the installation location of the
copier 100, the season, the date, the weather and the illumination condition are all stored in theindividual verification apparatus 40. - It is not needed to store first reference value information or the image in an unneeded area (the area B or C shown in
FIG. 7 ), thus saving the capacity of thedatabase 11. - In this way, the individual verification apparatus reduces the influence from the surroundings when carrying out a face verification.
- The embodiments shown in
FIG. 1 -FIG. 13 are merely exemplary and can be variously modified in structure or step. - In the light reception detection method illustrated in
FIG. 7 , theindividual verification apparatus 10 performs a pre-processing if the background is not a single color different from black or a single pattern, for example, if the ceiling or wall is coated by different colors. - For example, the
individual verification apparatus 10 converts an image area (the area B or C) corresponding to a coated part into a white color in advance. - Alternatively, the
individual verification apparatus 10 carries out a verification processing after the ceiling or wall is pre-covered by white paper. - Reference values can be highly accurately obtained according to the position, for example, the area B or C, where correction values are detected.
- The
camera 14 may be an infrared camera or a near-infrared camera. - In the foregoing embodiments, a light reception direction is represented by an angle by which the light reception direction is deviated from the perpendicular line of an image area. The light reception direction may represent a solid angle using the angle of the deviation of the light reception direction from the center of the view of the
camera 14. - In the foregoing embodiments, in the detection of a light reception direction, the four corners of an image area are photographed and then compared in brightness.
- In the detection of a light reception direction, an image region may be divided into grids, and then the direction along which brightness changes is detected. Alternatively, in the detection of a light reception direction, an image region may be divided into a plurality of slits, and then the direction along which brightness changes is detected.
- The
camera 14 may be installed at any position of thecopier 100. Thecamera 14 may be immobilized on the body of the copier by a bracket, an arm or a brace. - Holes may be set on the cover of the
copier 100. Thecamera 14 may be immobilized on an inner side of the cover with its image sensor panel exposed outside the cover from the hole. - The back of the image sensor panel should not face a light source.
- Further, the
individual verification apparatus 10 may be provided with a Bluetooth (registered trademark) interface. Alternatively, a wireless camera may send an image to theindividual verification apparatus 10 according to a Bluetooth-based communication protocol. - A wireless camera fixed on the wall or ceiling of a room takes image data for verification and image data for registration. Installation at such a position, the wireless camera gets a wider view and can take an image more freely. Moreover, verification accuracy is improved.
- Apparently, the wireless camera may be an installed multi-function peripheral.
- A processor-readable recording medium causes a CPU to execute various processing, wherein the recording medium may be a USB memory, a CD-ROM or a DVD-ROM.
- Modified embodiments cause no impairment to the priority of the image forming apparatus, the image forming method and the recording medium involved herein.
- While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the invention. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the invention. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the invention.
Claims (9)
1. An individual verification apparatus, comprising:
a camera configured to take an individual and output an image in an image region observed from a fixed line-of-sight direction, the individual being irradiated in different brightness of light and having different directions of receiving irradiation thereto;
a database configured to associate a the face image of the individual in an image for registration from the camera with unique information of the individual; and
a processing unit coupled to the camera and the database, the processing unit facilitating execution of instructions to perform operations comprising:
generating respective reference values for matching a brightness value and a light reception direction of an image for verification from the camera with a brightness value and a light reception of the face image of the individual,
correcting the brightness value and the light reception direction of the image for verification using thus generated reference values, and
verifying the individual using a face part in thus corrected image for verification and the face image stored in the database.
2. The individual verification apparatus according to claim 1 ,
wherein the operations by the processing unit further include:
generating a reference brightness value and a reference light reception direction, respectively for a brightness value and alight reception direction of a background image in the image from the camera,
correcting a brightness value and a light reception direction of the face image for registration from the camera using the reference brightness value and the reference light reception direction of the background image,
registering the face image of the individual in thus corrected face image for registration in the database, and
correcting the image for verification from the camera using the reference brightness value and the reference light reception direction.
3. The individual verification apparatus according to claim 2 , wherein the operations further include:
generating the reference values based on a plurality of persons within the same period of time.
4. The individual verification apparatus according to claim 1 , further comprising:
an interface connected with an information server, wherein the operations further include:
calculating magnitudes of the changes in the brightness value and the light reception direction of the image from the camera according to a plurality of sample images at fixed moments of a plurality of days, and
calculating a value of the line-of-sight direction according to the magnitudes of the changes and sun position information for each day and hour from the information server.
5. The individual verification apparatus according to claim 1 , further comprising:
an interface connected with an information server, wherein the operations further include:
calculating the reference value for the brightness value according to illuminance information, provided from the information server, of an illuminator in a room in which the camera is fixed, and
calculating the reference value for the light reception direction according to pre-stored illuminator information in the room.
6. The individual verification apparatus according to claim 1 , further comprising:
an interface connected with an information server, wherein the operations further include:
calculating the reference values for the brightness value and the light reception direction of the face image according to weather information indicating a sunny day or a rainy day provided from the information server.
7. The individual verification apparatus according to claim 1 , further comprising:
a stationary printer configured to permit the individual to carry out a user-based operation thereto through the verifying.
8. An individual verification method, comprising:
generating, at a first timing, a reference brightness value and a reference light reception direction, respectively for a brightness value and a light reception direction of a background image in an image region in which an individual is observed from a fixed line-of-sight direction;
correcting, at a second timing, a brightness value and a light reception direction of an image for registration in which the individual is observed from the fixed line-of-sight direction, respectively using the reference brightness value and the reference light reception direction, and registering a face image of the individual in thus corrected image for registration in a database, the face image being associated with unique information of the individual;
correcting, at a third timing, a brightness value and a light reception direction of an image for verification in which the individual is observed from the fixed line-of-sight direction, respectively using the reference brightness value and the reference light reception direction; and
verifying the individual using a face part in thus corrected the image data for verification and the face image in the database.
9. A non-transitory computer readable recording medium, the medium storing a program causing a processor to execute the following processing:
generating, at a first timing, a reference brightness value and a reference light reception direction, respectively for a brightness value and a light reception direction of a background image in an image region in which an individual is observed from a fixed line-of-sight direction;
correcting, at a second timing, a brightness value and a light reception direction of an image for registration in which the individual is observed from the fixed line-of-sight direction, respectively using the reference brightness value and the reference light reception direction, and registering a face image of the individual in thus corrected face image for registration in the database, the face image being associated with unique information of the individual;
correcting, at a third timing, a brightness value and a light reception direction of an image for verification in which the individual is observed from the fixed line-of-sight direction, respectively using the reference brightness value and the reference light reception direction; and
verifying the individual using a face part in thus corrected the image data for verification and the face image in the database.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/609,224 US20170262473A1 (en) | 2015-05-29 | 2017-05-31 | Individual verification apparatus, individual verification method and computer-readable recording medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/724,923 US9703805B2 (en) | 2015-05-29 | 2015-05-29 | Individual verification apparatus, individual verification method and computer-readable recording medium |
US15/609,224 US20170262473A1 (en) | 2015-05-29 | 2017-05-31 | Individual verification apparatus, individual verification method and computer-readable recording medium |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/724,923 Continuation US9703805B2 (en) | 2015-05-29 | 2015-05-29 | Individual verification apparatus, individual verification method and computer-readable recording medium |
Publications (1)
Publication Number | Publication Date |
---|---|
US20170262473A1 true US20170262473A1 (en) | 2017-09-14 |
Family
ID=57398640
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/724,923 Expired - Fee Related US9703805B2 (en) | 2015-05-29 | 2015-05-29 | Individual verification apparatus, individual verification method and computer-readable recording medium |
US15/609,224 Abandoned US20170262473A1 (en) | 2015-05-29 | 2017-05-31 | Individual verification apparatus, individual verification method and computer-readable recording medium |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/724,923 Expired - Fee Related US9703805B2 (en) | 2015-05-29 | 2015-05-29 | Individual verification apparatus, individual verification method and computer-readable recording medium |
Country Status (1)
Country | Link |
---|---|
US (2) | US9703805B2 (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107832735A (en) * | 2017-11-24 | 2018-03-23 | 百度在线网络技术(北京)有限公司 | Method and apparatus for identifying face |
CN112041850A (en) * | 2018-03-02 | 2020-12-04 | 维萨国际服务协会 | Dynamic illumination for image-based authentication processing |
CN108391011B (en) * | 2018-03-07 | 2020-07-14 | 维沃移动通信有限公司 | Face recognition method and mobile terminal |
Citations (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5067162A (en) * | 1986-06-30 | 1991-11-19 | Identix Incorporated | Method and apparatus for verifying identity using image correlation |
US5835616A (en) * | 1994-02-18 | 1998-11-10 | University Of Central Florida | Face detection using templates |
US6292575B1 (en) * | 1998-07-20 | 2001-09-18 | Lau Technologies | Real-time facial recognition and verification system |
US20030059124A1 (en) * | 1999-04-16 | 2003-03-27 | Viisage Technology, Inc. | Real-time facial recognition and verification system |
US20040228508A1 (en) * | 2003-05-16 | 2004-11-18 | Canon Kabushiki Kaisha | Signal processing apparatus and controlling method |
US20050271258A1 (en) * | 2004-06-01 | 2005-12-08 | Lumidigm, Inc. | Multispectral imaging biometrics |
US20060078172A1 (en) * | 2004-06-03 | 2006-04-13 | Arizona Board Of Regents, A Body Corporate Of The State Of Arizona | 3D face authentication and recognition based on bilateral symmetry analysis |
US20060120571A1 (en) * | 2004-12-03 | 2006-06-08 | Tu Peter H | System and method for passive face recognition |
US20060126905A1 (en) * | 2004-12-15 | 2006-06-15 | Loo Chee K G | Method and system for verifying the identity of a user |
US20060146062A1 (en) * | 2004-12-30 | 2006-07-06 | Samsung Electronics Co., Ltd. | Method and apparatus for constructing classifiers based on face texture information and method and apparatus for recognizing face using statistical features of face texture information |
US20060153429A1 (en) * | 2002-10-24 | 2006-07-13 | Stefan Gehlen | Method for controlling photographs of people |
US7130454B1 (en) * | 1998-07-20 | 2006-10-31 | Viisage Technology, Inc. | Real-time facial recognition and verification system |
US20070019083A1 (en) * | 2005-07-11 | 2007-01-25 | Fuji Photo Film Co., Ltd. | Image capturing apparatus, photograph quantity management method, and photograph quantity management program |
US7227977B1 (en) * | 2003-01-10 | 2007-06-05 | L-I Identity Solutions, Inc. | Lighting correction for the outdoor environment with extension to the self adjusting algorithm for general lighting conditions |
US20070274592A1 (en) * | 2006-02-10 | 2007-11-29 | Seiko Epson Corporation | Method of generating image provided with face object information, method of correcting color, and apparatus operable to execute the methods |
US20110182482A1 (en) * | 2010-01-27 | 2011-07-28 | Winters Dustin L | Method of person identification using social connections |
US20130070973A1 (en) * | 2011-09-15 | 2013-03-21 | Hiroo SAITO | Face recognizing apparatus and face recognizing method |
US20130182915A1 (en) * | 2007-04-19 | 2013-07-18 | Eyelock, Inc. | Method and system for biometric recognition |
US20130202182A1 (en) * | 2011-08-09 | 2013-08-08 | Lumidigm, Inc. | Methods and systems for estimating genetic characteristics from biometric measurements |
US20130243278A1 (en) * | 2012-03-19 | 2013-09-19 | Hiroo SAITO | Biological information processor |
US20140121637A1 (en) * | 2012-10-30 | 2014-05-01 | Elwha Llc | Systems and methods for generating an injection guide |
US20150055821A1 (en) * | 2013-08-22 | 2015-02-26 | Amazon Technologies, Inc. | Multi-tracker object tracking |
US20160214373A1 (en) * | 2015-01-25 | 2016-07-28 | Ten Media, Llc Dba Ten Ag Tech Co. | Method and system for applying information on food packaging |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005165943A (en) | 2003-12-05 | 2005-06-23 | Toshiba Corp | Face authentication device and passage control device |
-
2015
- 2015-05-29 US US14/724,923 patent/US9703805B2/en not_active Expired - Fee Related
-
2017
- 2017-05-31 US US15/609,224 patent/US20170262473A1/en not_active Abandoned
Patent Citations (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5067162A (en) * | 1986-06-30 | 1991-11-19 | Identix Incorporated | Method and apparatus for verifying identity using image correlation |
US5835616A (en) * | 1994-02-18 | 1998-11-10 | University Of Central Florida | Face detection using templates |
US6292575B1 (en) * | 1998-07-20 | 2001-09-18 | Lau Technologies | Real-time facial recognition and verification system |
US7130454B1 (en) * | 1998-07-20 | 2006-10-31 | Viisage Technology, Inc. | Real-time facial recognition and verification system |
US20030059124A1 (en) * | 1999-04-16 | 2003-03-27 | Viisage Technology, Inc. | Real-time facial recognition and verification system |
US20060153429A1 (en) * | 2002-10-24 | 2006-07-13 | Stefan Gehlen | Method for controlling photographs of people |
US7227977B1 (en) * | 2003-01-10 | 2007-06-05 | L-I Identity Solutions, Inc. | Lighting correction for the outdoor environment with extension to the self adjusting algorithm for general lighting conditions |
US20040228508A1 (en) * | 2003-05-16 | 2004-11-18 | Canon Kabushiki Kaisha | Signal processing apparatus and controlling method |
US20050271258A1 (en) * | 2004-06-01 | 2005-12-08 | Lumidigm, Inc. | Multispectral imaging biometrics |
US20060078172A1 (en) * | 2004-06-03 | 2006-04-13 | Arizona Board Of Regents, A Body Corporate Of The State Of Arizona | 3D face authentication and recognition based on bilateral symmetry analysis |
US20060120571A1 (en) * | 2004-12-03 | 2006-06-08 | Tu Peter H | System and method for passive face recognition |
US20060126905A1 (en) * | 2004-12-15 | 2006-06-15 | Loo Chee K G | Method and system for verifying the identity of a user |
US20060146062A1 (en) * | 2004-12-30 | 2006-07-06 | Samsung Electronics Co., Ltd. | Method and apparatus for constructing classifiers based on face texture information and method and apparatus for recognizing face using statistical features of face texture information |
US20070019083A1 (en) * | 2005-07-11 | 2007-01-25 | Fuji Photo Film Co., Ltd. | Image capturing apparatus, photograph quantity management method, and photograph quantity management program |
US20070274592A1 (en) * | 2006-02-10 | 2007-11-29 | Seiko Epson Corporation | Method of generating image provided with face object information, method of correcting color, and apparatus operable to execute the methods |
US20130182915A1 (en) * | 2007-04-19 | 2013-07-18 | Eyelock, Inc. | Method and system for biometric recognition |
US20110182482A1 (en) * | 2010-01-27 | 2011-07-28 | Winters Dustin L | Method of person identification using social connections |
US20130202182A1 (en) * | 2011-08-09 | 2013-08-08 | Lumidigm, Inc. | Methods and systems for estimating genetic characteristics from biometric measurements |
US20130070973A1 (en) * | 2011-09-15 | 2013-03-21 | Hiroo SAITO | Face recognizing apparatus and face recognizing method |
US20130243278A1 (en) * | 2012-03-19 | 2013-09-19 | Hiroo SAITO | Biological information processor |
US20140121637A1 (en) * | 2012-10-30 | 2014-05-01 | Elwha Llc | Systems and methods for generating an injection guide |
US20150055821A1 (en) * | 2013-08-22 | 2015-02-26 | Amazon Technologies, Inc. | Multi-tracker object tracking |
US20160214373A1 (en) * | 2015-01-25 | 2016-07-28 | Ten Media, Llc Dba Ten Ag Tech Co. | Method and system for applying information on food packaging |
Also Published As
Publication number | Publication date |
---|---|
US9703805B2 (en) | 2017-07-11 |
US20160350582A1 (en) | 2016-12-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9843781B1 (en) | Projector | |
US20180198937A1 (en) | Image inspection apparatus, image inspection system, and method for determining image position | |
US8358946B2 (en) | Image forming apparatus | |
US20170262473A1 (en) | Individual verification apparatus, individual verification method and computer-readable recording medium | |
US9507308B2 (en) | Image forming apparatus and method of image inspection to detect image defect and sheet color | |
US20180338067A1 (en) | Color value correction control method, color value correction control program, and image forming apparatus | |
RU2654002C2 (en) | Apparatus for image formation which generates a conversion condition of a measuring unit and control method of image forming apparatus | |
JP2011237562A (en) | Image inspection device, image forming apparatus, image inspection method, program and recording medium | |
US10338858B2 (en) | Non-transitory recording medium storing scanner profile correcting program, scanner profile correcting method, and printer | |
JP2010283670A (en) | Recording-medium imaging device, and image forming apparatus | |
JP6468905B2 (en) | Image forming apparatus | |
CN107896291A (en) | Image processing system and recording medium | |
JP6880750B2 (en) | Image forming device, image processing device and image processing method | |
JP2006268213A (en) | Image processing method, image processing device, and server device | |
TWI498230B (en) | Image reading apparatus, image forming apparatus and computer-readable medium | |
US8879113B2 (en) | Image forming apparatus forming images in accordance with image forming conditions | |
CN105988320B (en) | Generate the image forming apparatus and its control method of the switch condition of measuring unit | |
JP5766315B2 (en) | Recording medium imaging device and image forming apparatus | |
EP4064670A1 (en) | Chart, image forming apparatus, image processing apparatus, and carrier medium | |
CN102163023A (en) | Image forming apparatus and control method thereof | |
US20130113383A1 (en) | Apparatus and methods for improving illumination uniformity | |
US10142519B2 (en) | Image forming apparatus and method for correcting read signal | |
US7058215B2 (en) | Data processing system, maintenance apparatus and image processing apparatus | |
CN110007573A (en) | Image forming apparatus and method for correcting position | |
JP2001136391A (en) | Image forming device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: TOSHIBA TEC KABUSHIKI KAISHA, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:UEDA, MOTOSHI;REEL/FRAME:042539/0145 Effective date: 20150527 Owner name: KABUSHIKI KAISHA TOSHIBA, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:UEDA, MOTOSHI;REEL/FRAME:042539/0145 Effective date: 20150527 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |