JP6384028B2 - Image processing system and program - Google Patents

Description

  The present invention relates to an image processing system and a program.

  In recent years, with the growing awareness of crime prevention and disaster prevention, the development of information and communication technology that protects people from accidents, disasters, and crimes is required. For example, in offices, there is a demand for the development of a crime prevention system that prevents theft of confidential documents and electronic recording media by unauthorized intruders. In general, in order to prevent theft of confidential documents and electronic recording media, it is very important to use authentication technology.

  As an example of the authentication technique, a face authentication technique for searching a database from a face image of a person imaged by a camera and authenticating whether or not the person is registered in advance in the database can be cited.

  Conventionally, it has been proposed to mount the face authentication technology on an image processing apparatus such as an MFP (Multi Function Peripheral) installed in an office and use the image processing apparatus as a security system (for example, the following) Patent Document 1). According to the MFP described in Patent Document 1 below, use of a predetermined function of the MFP is restricted when it is determined as a result of face authentication processing that a person imaged by the camera is not registered in the database. To do.

  However, in the case of the MFP, face authentication processing is performed for a person who actually operates the MFP in order to limit the use of a predetermined function. That is, face authentication processing has not been performed for persons other than the operator around the operator.

  For this reason, even if there is an unauthorized intruder in the vicinity of the MFP (position other than the operation position of the MFP), it cannot be recognized and is not sufficient as an office crime prevention system.

  This invention is made | formed in view of the said subject, and it aims at improving crime prevention performance in the crime prevention system using the face authentication technique in one side.

An image processing system according to an embodiment of the present invention has the following configuration. That is,
An image processing system comprising an image processing device,
Control means for controlling the camera to take an image while the image processing apparatus is powered on ;
Search means for searching for a storage means for a face image detected from image data captured by the camera;
Authentication is performed when a face image corresponding to the detected face image is not searched in the storage unit by the search unit and the time when the image data is captured does not satisfy a predetermined condition. A determination means for determining an error;
The detection is performed when a face image corresponding to the detected face image is not searched in the storage unit by the search unit and the time when the image data is captured satisfies a predetermined condition. And a data updating means for registering the face image registered in the storage means.

  According to one aspect, it is possible to improve crime prevention performance in a crime prevention system using face authentication technology.

It is a figure which shows the function structure of the image processing apparatus which concerns on embodiment. 1 is a diagram illustrating an external configuration of an image processing apparatus according to an embodiment. It is a figure which shows an example of the operation part of the image processing apparatus which concerns on embodiment. It is a flowchart which shows the flow of the mode switching process by the image processing apparatus which concerns on embodiment. It is a flowchart which shows the flow of the face authentication process by the image processing apparatus which concerns on embodiment. It is a figure which shows an example of the database for face authentication processes of the image processing apparatus which concerns on embodiment. It is a flowchart which shows the other flow of the face authentication process by the image processing apparatus which concerns on embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, the duplicate description is abbreviate | omitted by attaching | subjecting the same code | symbol.

[First Embodiment]
<Functional configuration of image processing apparatus>
First, the functional configuration of the image processing apparatus according to the present embodiment will be described. FIG. 1 is a diagram illustrating a functional configuration of an image processing apparatus 100 according to the present embodiment, which constitutes a crime prevention system. The image processing apparatus 100 is a digital multifunction peripheral called MFP (Multi Function Peripheral) having a print function, a scanner function, a copy function, and a facsimile function.

  As illustrated in FIG. 1, the image processing apparatus 100 includes a network communication unit 101, a printer unit 102, a scanner unit 103, a facsimile communication unit 104, an RTC (Real Time Clock) 105, and a camera unit 106. Further, a CPU (computer) 107, a ROM (Read Only Memory) 108, a RAM (Random Access Memory) 109, a nonvolatile memory 110, a storage device 111, and an operation unit 112 are provided.

  The network communication unit 101 controls communication with an external device connected via a line. The printer unit 102 prints a color image or a monochrome image on a recording sheet using cyan, magenta, yellow, and black toners.

  The scanner unit 103 reads a document image by a color CCD line sensor using a one-dimensionally arranged LED array as a light source. Also, R (Red), G (Green), and B (Blue) analog image signals output from the color CCD line sensor are converted into digital image data by A (Analog) / D (Digital) conversion, respectively, and output. To do.

  The facsimile communication unit 104 performs facsimile transmission / reception with an external apparatus connected via a line.

  The RTC 105 generates current time information. The current time information is used in a mode switching process for switching the security mode on / off based on a condition (time zone) set by the user.

  In the camera unit 106, the light incident through the wide-angle lens is received by the color CCD area sensor. Also, digital image data is generated by A (Analog) / D (Digital) conversion of R (Red), G (Green), and B (Blue) analog image signals output from the color CCD area sensor. . Note that the camera unit 106 is controlled to generate digital image data while the image processing apparatus 100 is powered on.

  The CPU 107 executes various control programs and OS (Operating System) stored in the ROM 108. The control programs stored in the ROM 108 include programs that function as the mode switching unit 121, programs that function as the camera control unit 122, and programs that function as the authentication unit 123 by being executed by the CPU 107.

  Further, the program that functions as the authentication unit 123 includes a program that functions as the face detection unit 131 and a program that functions as the determination unit 132. Furthermore, a program that functions as the notification unit 133 and a program that functions as the data update unit 134 are included.

  The mode switching unit 121 switches the security mode between valid and invalid based on the current time information output from the RTC 105 and the condition (time zone) set by the user.

  In addition, the camera control unit 122 controls the camera unit 106 to perform imaging while the image processing apparatus 100 is powered on. Further, in the authentication unit 123, the face detection unit 131 detects a human face image from the image captured by the camera unit 106. The determination unit 132 compares the face image detected by the face detection unit 131 with the face image stored in the database 124, so that the same person as the person included in the image captured by the camera unit 106 is detected. Determine presence or absence.

  The notification unit 133 notifies the specified destination of the determination result via the network communication unit 101 or the facsimile communication unit 104 according to the determination result in the determination unit 132. The data update unit 134 updates the database 124 according to the determination result in the determination unit 132.

  The RAM 109 is used as a work memory that temporarily stores various data when the CPU 107 executes various control programs.

  The nonvolatile memory 110 is a rewritable memory that retains memory even when the power is turned off, and stores various setting information and the like.

  The storage device 111 is a large-capacity nonvolatile storage device, and stores the address book of the user of the image processing apparatus 100 in addition to print data and image data. Further, a database 124 in which face images searched when executing the face authentication process are stored is stored.

  The operation unit 112 includes a hard key, an LED, a touch panel screen, and the like, and the user inputs various instructions and settings when using the print function, the scanner function, the copy function, and the facsimile function. Also, job history, device status, setting information, and the like, which are internal information of the image processing apparatus 100, are displayed.

<External configuration of image processing apparatus>
Next, the external configuration of the image processing apparatus 100 will be described. FIG. 2 is a diagram illustrating an external configuration of the image processing apparatus 100. As shown in FIG. 2, the camera unit 106 is attached above the housing of the image processing apparatus 100 and images the front area of the image processing apparatus 100. Accordingly, the camera unit 106 can capture a person at a position other than the operation position in addition to the person at the operation position operating the image processing apparatus. However, the mounting position and mounting direction of the camera unit 106 are not limited to this.

<Explanation of operation unit display screen>
Next, display contents displayed on the touch panel screen of the operation unit 112 will be described. FIG. 3 is a diagram illustrating an example of a crime prevention setting screen among various display screens displayed on the touch panel screen of the operation unit 112. The security setting screen is a screen for setting business hours, which is referred to when the security mode is determined to be valid / invalid.

  As shown in FIG. 3, the crime prevention setting screen 300 is provided with an area for inputting the start time of business hours and an area for inputting the end time of business hours. The setting value can be input to each area from a hard key of the operation unit 112 or a soft key displayed on a touch panel screen.

  In the time zone between the start time and the end time of the business time set in the security setting screen 300, the security mode is invalid, and the time zone other than the time zone between the start time and the end time of the business time is The crime prevention mode is activated.

<Mode switching process by mode switching unit>
Next, the flow of mode switching processing by the mode switching unit 121 will be described. FIG. 4 is a flowchart showing the flow of mode switching processing by the mode switching unit 121. When the image processing apparatus 100 is turned on, the processing is automatically started and the image processing apparatus 100 is turned off. Until the process continues.

  In step S401, the business hours set on the crime prevention setting screen 300 are read. In step S402, the current time information generated in the RTC 105 is read.

  In step S403, it is determined whether or not the current time information read in step S402 is included in the business hours read in step S401.

  If it is determined in step S403 that the current time information is not included in the business hours, the process proceeds to step S404, and it is determined that the security mode is valid. On the other hand, if it is determined that the current time information is included in the business hours, the process proceeds to step S405, where it is determined that the security mode is invalid.

  In step S406, it is determined whether or not the business hours set on the crime prevention setting screen 300 have been changed. If it is determined in step S406 that the business time set on the security setting screen 300 has been changed, the process returns to step S401, and the changed business time is read to determine whether the security mode is valid / invalid.

  On the other hand, if it is determined in step S406 that the business time set on the crime prevention setting screen 300 has not been changed, the process proceeds to step S407, where an instruction to turn off the image processing apparatus 100 has been issued. Determine whether or not.

  If it is determined in step S407 that there has been no instruction to turn off the power, the process returns to step S402 to continue the mode switching process. On the other hand, if it is determined in step S407 that there is an instruction to turn off the power, the mode switching process is terminated.

<Flow of face recognition processing>
Next, the flow of face authentication processing by the image processing apparatus 100 will be described. FIG. 5 is a flowchart showing the flow of face authentication processing by the image processing apparatus 100. When the power of the image processing apparatus 100 is turned on, the processing is automatically started and the power of the image processing apparatus 100 is turned off. Until the process continues.

  In step S <b> 501, the camera unit 106 starts imaging under the control of the camera control unit 122. In step S <b> 502, the face detection unit 131 determines whether a face image has been detected from the image data captured by the camera unit 106.

  If the face detection unit 131 does not detect a face image in step S502, the process waits until a face image is detected. On the other hand, if a face image is detected, the process proceeds to step S503.

  In step S <b> 503, the determination unit 132 determines whether the crime prevention mode is currently valid (refers to the timing at which image data in which a face image is detected is captured). Whether the security mode is valid refers to the result determined in the mode switching process by the mode switching unit 121.

  If it is determined in step S503 that the security mode is currently in an effective state, the process proceeds to step S504, and the determination unit 132 searches the database 124 based on the face image detected in step S502.

  In step S505, the determination unit 132 determines whether the face image of the same person as the face image detected in step S502 has been searched in the database 124 as a result of the search in step S504.

  If the face image of the same person is not found as a result of the determination in step S505, it is determined as an authentication error, and the process proceeds to step S506, where it is determined that the person of the face image detected in step S502 is a suspicious person. To do. In step S507, the notification unit 133 notifies the predetermined destination that a suspicious person has been found (authentication error) via the network communication unit 101 or the facsimile communication unit 104, and then returns to step S513. move on.

  Note that the predetermined destination may be, for example, a terminal of an administrator or a person in charge of the office where the image processing apparatus 100 is installed, or a terminal of a security company or the like.

  On the other hand, as a result of the determination in step S505, if a face image of the same person is searched, the process proceeds directly to step S513.

  As described above, when the crime prevention mode is valid, the database 124 is searched each time a face image is detected in the image data captured by the camera unit 106, and the suspicious person is based on the search result. Is determined, a predetermined destination is notified.

  On the other hand, if it is determined in step S503 that the crime prevention mode is currently invalid, the process proceeds to step S508, and the determination unit 132 searches the database 124 based on the face image detected in step S502.

  In step S508, the determination unit 132 determines whether the database 124 has searched for a face image of the same person as the face image detected in step S502 as a result of the search in step S508.

  If the result of determination in step S509 is that no face image of the same person has been found, processing proceeds to step S510. In step S510, the data updating unit 134 registers the face image detected in step S502 as a new face image in the database 124, and then proceeds to step S513. As described above, in the image processing apparatus 100 according to the present embodiment, when the crime prevention mode is invalid, the face images that are not registered in the database 124 among the face images included in the captured image data are newly registered. Register as a face image.

  On the other hand, as a result of the determination in step S509, if a face image of the same person is searched, the process proceeds to step S511. In step S511, the data updating unit 134 updates the face image in the database 124 corresponding to the face image detected in step S502 with the face image detected in step S502. Further, in step S512, the data updating unit 134 deletes the old face image in the database 124 corresponding to the face image detected in step S502 from the database 124, and then proceeds to step S513. Thus, according to the image processing apparatus 100 according to the present embodiment, the face image in the database 124 is always automatically replaced with the latest face image.

  In step S513, it is determined whether an instruction to turn off the image processing apparatus 100 has been issued.

  If it is determined in step S513 that there has been no instruction to turn off the power, the process returns to step S502 and the face authentication process is continued. On the other hand, if it is determined in step S513 that there is an instruction to turn off the power, the process proceeds to step S514, and the camera control unit 122 ends the imaging by the camera unit 106. Further, in step S515, a process for turning off the power of the image processing apparatus 100 is executed, and the face authentication process is terminated.

<Summary>
As is clear from the above description, in the image processing apparatus 100 according to the present embodiment,
The camera is arranged and imaging is continued while the image processing apparatus 100 is powered on.
-Based on the business hours set by the user, the security mode is determined to be valid or invalid.
The database is searched when a face image is detected from the captured image data.
-In the case where the crime prevention mode is valid, if the same person cannot be searched by searching the database, an authentication error is determined, and after determining that the person is a suspicious person, a notification is sent to a predetermined destination.
-If the same person cannot be searched by searching the database when the crime prevention mode is disabled, the detected face image is newly registered in the database, and if the same person can be searched, the detected face The database is updated with images.

  As a result, according to the image processing apparatus 100 according to the present embodiment, face authentication processing is performed for a person other than the operator of the image processing apparatus 100, and if it is determined that the person is a suspicious person, a predetermined destination is notified. It becomes possible to do. In addition, since the crime prevention mode is valid only outside business hours, for example, even if employees or customers of other offices are in the office during business hours, they are erroneously determined as suspicious persons. It becomes possible to avoid the situation. Further, it is possible to always update the face image registered in the database to the latest face image without any load on the user. Furthermore, a face image detected with the crime prevention mode disabled can also be newly registered in the database.

  That is, it is possible to improve the crime prevention performance by applying the image processing apparatus 100 according to this embodiment to the crime prevention system.

[Second Embodiment]
In the first embodiment, the description has been made assuming that only one database 124 is stored in the storage device 111, but the present invention is not limited to this. For example, a plurality of databases may be prepared according to the registered contents of the database, and the content of the face authentication process may be different for each database. Details of this embodiment will be described below. Note that the functional configuration and appearance configuration of the image processing apparatus according to the present embodiment are the same as the functional configuration and appearance configuration of the image processing apparatus according to the first embodiment, and a description thereof will be omitted here.

<Storage device database>
First, a database stored in the storage device 111 of the image processing apparatus according to the present embodiment will be described. FIG. 6 is a diagram illustrating an example of a database stored in the storage device 111 of the image processing apparatus according to the present embodiment.

  As illustrated in FIG. 6, the storage device 111 of the image processing apparatus according to the present embodiment stores a database 601 that stores data related to registered users and a database 602 that stores data related to automatically registered users.

  The registered user refers to a user who is associated with an address book (address book stored in the storage device 111) including a name and a contact among the users whose face images are registered. An auto-registered user is a user who is not associated with an address book including a name and contact information among users whose face images are registered, and in a state where the security mode is invalid (that is, business hours) A user who is captured by the camera unit 106 and automatically registered.

  As described above, in the image processing apparatus 100 according to the present embodiment, even if a user has registered a facial image, the user is associated with personal information such as a name and contact information, and the personal information is associated with the user. It is configured to register separately with no users. Thereby, even if the same person as the person of the face image detected by the face detection unit 131 is detected in the database in the state where the crime prevention mode is enabled, the post-detection process is configured differently. be able to.

<Flow of face recognition processing>
Next, the flow of face authentication processing by the image processing apparatus according to the present embodiment will be described. FIG. 7 is a flowchart showing the flow of face authentication processing by the image processing apparatus according to the present embodiment. Note that the same steps as the face authentication processing by the image processing apparatus according to the first embodiment are denoted by the same reference numerals, and the description thereof is omitted here (the following is a difference from FIG. 5. The description will focus on steps S701, S702, and S710 to S712).

  As a result of the determination in step S505, if a face image of the same person is searched, the process proceeds to step S701. In step S701, the determination unit 132 determines whether the searched database is the database 601 for registered users or the database 602 for automatically registered users.

  If it is determined in step S701 that the database 601 is for a registered user, the process proceeds to step S702. In step S <b> 702, the determination unit 132 stores, in the storage device 111, a log indicating that the person (registered user) has been detected around the image processing apparatus in a state where the crime prevention mode is valid.

  On the other hand, if it is determined in step S701 that the database 602 is for automatically registered users, the process proceeds to step S507. In step S507, the notification unit 133 sends the peripheral of the image processing apparatus to the predetermined destination via the network communication unit 101 or the facsimile communication unit 104 in a state where the person (automatically registered user) is in the crime prevention mode. Notify that detected in. As a result, even a self-registered user who is not a suspicious person but is not associated with an address book is notified to a predetermined destination.

  On the other hand, if it is determined in step S509 that no face image of the same person is found, the process proceeds to step S710. In step S710, the data update unit 134 registers the face image detected in step S502 in the database 602 for automatically registered users as a new face image.

  On the other hand, as a result of the determination in step S509, if a face image of the same person is searched, the process proceeds to step S711. In step S711, the data updating unit 134 updates the face image in the registered user database 601 corresponding to the face image detected in step S502 with the face image detected in step S502.

  In step S712, the data updating unit 134 deletes the old face image in the registered user database 601 corresponding to the face image detected in step S502 from the registered user database 601.

<Summary>
As is clear from the above description, in the image processing apparatus according to the present embodiment, in addition to the configuration of the image processing apparatus according to the first embodiment,
-As a database used for face authentication processing, there are two types of databases: a registered user database in which personal information such as name and contact information is associated, and an unregistered database for automatically registered users. .
-When the crime prevention mode is valid, even if the same person can be searched by searching the database, when searching from the database for automatically registered users, a notification is sent to a predetermined destination.
When the crime prevention mode is invalid and the same person cannot be searched by searching the database, the detected face image is registered in the database for automatically registered users.
When the crime prevention mode is invalid and the same person can be searched by searching the database, the registered user database is updated with the detected face image.

  Thereby, according to the image processing apparatus which concerns on this embodiment, while receiving the effect similar to the image processing apparatus which concerns on the said 1st Embodiment, according to the attribute of the user registered into the database, a process is further performed. The contents can be changed.

  As a result, it is possible to further improve the crime prevention performance of the crime prevention system to which the image processing apparatus is applied.

[Third Embodiment]
In the second embodiment, two types of database for registered users and a database for automatically registered users are arranged. However, the present invention is not limited to this, and three or more types of databases are provided according to attributes. It is good also as a structure which arranges.

  In the second embodiment, the registered user database is configured to register the user associated with the address book. However, the present invention is not limited to this. For example, a person who may be in the office in a state in which the crime prevention mode is valid (ie, outside business hours), such as a security guard of a security company, may be registered in the registered user database. Alternatively, a specific attribute may be attached and registered in another database.

  In the first and second embodiments, the camera unit 106 is arranged in the image processing apparatus. However, the present invention is not limited to this. For example, the camera unit 106 may be separated from the image processing apparatus, and the image processing apparatus may be configured to acquire the output of the camera unit 106 to form an image processing system.

  In the first and second embodiments, the image processing apparatus includes the mode switching unit 121, the camera control unit 122, the authentication unit 123, and the database 124. However, this form does not limit the scope of the present invention. For example, another device may have a part or all of these functions and may be configured to form an image processing system together with the other device. In this case, the number of other devices may be one or more.

  It should be noted that the present invention is not limited to the configuration shown here, such as a combination with other elements in the configuration described in the above embodiment. These points can be changed without departing from the spirit of the present invention, and can be appropriately determined according to the application form.

DESCRIPTION OF SYMBOLS 100 Image processing apparatus 101 Network communication part 102 Printer part 103 Scanner part 104 Facsimile communication part 105 RTC
106 Camera unit 107 CPU
108 ROM
109 RAM
DESCRIPTION OF SYMBOLS 110 Non-volatile memory 111 Storage device 112 Operation part 121 Mode switching part 122 Camera control part 123 Authentication part 124 Database 131 Face detection part 132 Determination part 133 Notification part 134 Data update part 601 Database 602 for registered users Database for automatic registration users

JP 2006-081147 A

Claims (5)

An image processing system comprising an image processing device,
Control means for controlling the camera to take an image while the image processing apparatus is powered on ;
Search means for searching for a storage means for a face image detected from image data captured by the camera;
Authentication is performed when a face image corresponding to the detected face image is not searched in the storage unit by the search unit and the time when the image data is captured does not satisfy a predetermined condition. A determination means for determining an error;
The detection is performed when a face image corresponding to the detected face image is not searched in the storage unit by the search unit and the time when the image data is captured satisfies a predetermined condition. An image processing system comprising: a data updating unit for registering the face image thus registered in the storage unit. The predetermined condition further includes setting means for setting a time zone,
The determination means is a case where a face image corresponding to the detected face image is not searched in the storage means, and the time when the image data was captured is a time zone set by the setting means If not included in the image processing system according to claim 1, wherein determining that an authentication error. The image processing system according to claim 1 , further comprising a notification unit configured to notify the predetermined destination of the authentication error when the determination unit determines that the authentication error has occurred.   When the face image corresponding to the detected face image is searched in the storage unit by the search unit, and the time when the image data is captured satisfies a predetermined condition, the data update is performed. The image processing system according to claim 1, wherein the unit updates the storage unit using the detected face image. The computer of the image processing device
Control means for controlling the camera to take an image while the image processing apparatus is powered on ;
Search means for searching for a storage means for a face image detected from image data captured by the camera;
Authentication is performed when a face image corresponding to the detected face image is not searched in the storage unit by the search unit and the time when the image data is captured does not satisfy a predetermined condition. A determination means for determining an error;
The detection is performed when a face image corresponding to the detected face image is not searched in the storage unit by the search unit and the time when the image data is captured satisfies a predetermined condition. A program for functioning as a data updating means for registering the face image thus registered in the storage means.

Images