JP2022128104A - Information processing apparatus and notification method thereof - Google Patents

Abstract

To provide an information processing apparatus which gives notification necessary for each user without requiring user's log-in authentication operation.SOLUTION: An information processing apparatus includes: a user authentication unit which receives log-in authentication for a user; a user detection unit which detects a user located within a predetermined range before the log-in authentication; a user recognition unit which determines whether the user is a registered user, who has been registered in predetermined user information, on the basis of a result detected by the user detection unit; a notification unit which executes notification to the user; and a control unit which controls the user authentication unit, the user detection unit, the user recognition unit, and the notification unit. The user recognition unit recognizes the user in a method different from that of the log-in authentication. When the user recognition unit recognizes a user, the control unit causes the notification unit to execute notification of contents corresponding to a recognition result.SELECTED DRAWING: Figure 10

Description

The present invention relates to an information processing device and a notification method for the information processing device, and more particularly to an information processing device having a user recognition function such as face recognition and a notification method for the information processing device.

In recent years, in information processing equipment such as smartphones, personal computers, and multifunction devices, biometric features such as the user's face, iris, fingerprints, and voiceprints are detected and matched with pre-registered biometric feature data of registered users. A user authentication function that performs authentication is adopted.

As an invention using such a user authentication technology, face data representing the face of an operator photographed by a camera is registered in a face data storage unit in which face data representing the face of the operator is registered in advance. based on the search result, and if it is determined that it does not belong to the registrant based on the authentication result, only the predetermined functions that can be executed by the person other than the registrant are controlled. An invention of an image forming apparatus has been disclosed (see, for example, Patent Document 1).

JP-A-2006-081147

In such a device that requires user authentication, as a method of notifying the user, there is a method of displaying only a general notification that does not specify the user before user authentication (login), and displaying a notification for a specific user after user authentication. It is commonly taken.

Here, general-purpose notifications include, for example, error notifications such as running out of toner and paper in the image forming apparatus, notifications of fax reception, and the like.

On the other hand, as a notification for a specific user, for example, there is an incoming notification of new arrival data to a specific user.

Further, depending on the contents of the notification, it may be necessary to operate the device, but generally many operations are restricted in the non-authenticated state.
Therefore, a user authentication (login) operation is essential when a user receives a notification directed to him/herself and wants to perform an operation related to the notification of the content.

However, the user authentication operation not only takes time, but there is also a possibility that the user may forget to perform the logout operation after logging in.

Also, in the case of a device shared by registered users and unregistered general users, such as a device placed in a shared space, notifications for only unregistered users can only be displayed on the authentication standby screen.
However, there is also the problem that the registered user sees unnecessary notifications on the pre-authentication screen, which reduces convenience.

In general, in an image forming apparatus, anyone can perform confirmation operations such as confirmation of the progress of a print job and confirmation of the remaining amount of paper without authentication.
However, even if there is a notification directed to the user who has come in front of the device to perform such a confirmation operation, it is common for the user to perform the confirmation operation without authentication. There was also the problem that even if it came, the user would not be able to notice the notification directed to him/herself.

SUMMARY OF THE INVENTION The present invention has been made in consideration of the circumstances as described above, and an object of the present invention is to provide an information processing apparatus and an information processing apparatus capable of providing necessary notifications to each user without requiring the user to perform a login authentication operation. To provide a notification method of

(1) The present invention comprises a user authentication unit that accepts login authentication of a user, a user detection unit that detects a user within a predetermined range before the login authentication, and based on the detection result of the user detection unit, A user recognition unit that determines and recognizes whether the user is a registered user registered in predetermined user information, a notification unit that executes notification to the user, the user authentication unit, the user detection unit, A control unit that controls the user recognition unit and the notification unit, the user recognition unit recognizes the user by a method different from the login authentication, and the control unit recognizes the user by the user recognition unit. In this case, there is provided an information processing apparatus characterized in that the notification unit is caused to notify the contents according to the recognition result.
Further, according to the present invention, a user authentication step of accepting login authentication of a user, a user detection step of detecting a user within a predetermined range before the login authentication, and based on the detection result of the user detection step, a user recognition step of determining and recognizing whether or not a user is a registered user registered in predetermined user information; and a notification step of executing a notification to the user, wherein the login A notification method for an information processing device, characterized in that the user is recognized by a method different from authentication, and if the user is recognized in the user recognition step, a notification of contents according to the recognition result is executed in the notification step. It provides

In the present invention, the "user recognition section" is a section that recognizes and specifies a user by a method different from login authentication.
Regardless of the authentication status of login authentication, the user recognition unit uses pre-registered registrations such as face recognition and beacons based on images obtained by analyzing images obtained by photographing users within a predetermined range. A user who is close to the information processing device is identified based on the information for identifying the user.
“Within a predetermined range” is a range determined for detecting a user who has come to operate or check the information processing device, such as a range within 2 m from the front of the information processing device.
The “user detection unit” detects a user based on analysis results of image data obtained by capturing an image of the user with a camera or the like, for example.
Alternatively, the user may be detected using a beacon signal or the like of a portable terminal possessed by the user.

According to this invention, the user recognition unit recognizes the user by a method different from login authentication, and the notification unit notifies the content according to the recognition result. It is possible to realize an information processing device and a notification method of the information processing device that performs necessary notification to the user.

Furthermore, preferred embodiments of the present invention will be described.

(2) In the information processing apparatus according to the present invention, the user recognition unit can recognize a plurality of users within the range before the login authentication, and the control unit is configured such that the user recognition unit recognizes the plurality of users. When the user recognition unit recognizes the user, the notification unit may be caused to notify different content than when the user recognition unit recognizes only a single user.

In this way, when multiple users are recognized, a notification with different contents is executed than when only a single user is recognized, so a notification for a specific user is made in front of multiple users. Therefore, an information processing apparatus capable of ensuring security can be realized.

(3) In the information processing apparatus according to the present invention, when the user recognition unit recognizes a single user within the range before the login authentication, the control unit controls the user recognition unit to recognize only the user. The notification unit may be configured to notify the user only while the user is performing the notification.

In this way, when a single user is recognized before login authentication, the notification unit executes the notification to the user only while the user is recognized, thereby displaying the notification to other users. It is possible to realize an information processing device that allows only the relevant user to receive the necessary notification at an appropriate timing without being notified.

(4) In the information processing apparatus according to the present invention, when the user recognition unit detects a plurality of users within the range before the login authentication, the control unit causes the user recognition unit to recognize the plurality of users. During this period, the notification unit may be caused to execute only the notification common to the plurality of users.

With this configuration, when the user recognition unit recognizes a plurality of users before login authentication, the notification unit executes only the notification common to the plurality of users while recognizing the plurality of users. Therefore, it is possible to realize an information processing device capable of ensuring security because only notifications related to the plurality of users are executed and notifications for a specific user are not made in front of a plurality of users. .

(5) The information processing apparatus according to the present invention further includes an operation unit that accepts a user's operation, wherein the user authentication unit accepts user login authentication according to a predetermined login operation accepted by the operation unit. The detection unit includes a camera that acquires and detects an image of a user within a predetermined range, and the user recognition unit detects the user's face based on the detection result of the user's face acquired by the user detection unit. It may be recognized by determining whether or not the user is a registered user registered in predetermined user information.

In this way, the user recognition unit recognizes the user by face recognition different from login authentication by operating the operation unit, and the notification unit notifies the user of the content according to the result of recognizing the user by face recognition. , it is possible to realize an information processing apparatus that provides necessary notifications to each user without requiring the user to perform a login authentication operation.

1 is a perspective view showing the appearance of a digital multifunction peripheral according to an embodiment of the present invention; FIG. 2 is a block diagram showing a schematic configuration of the digital MFP of FIG. 1; FIG. FIG. 2 is a table showing an example of a user account information table of the digital multi-function peripheral of FIG. 1; FIG. 2 is a table showing an example of a list of recognized users of the digital multi-function peripheral of FIG. 1; (A) is when no person is recognized, (B) is when only user ZA is recognized, and (C) is recognition when users ZA and YA are recognized at the same time. is an example of a list of users who have been 2 is a table showing an example of a notification management table of the digital multi-function peripheral of FIG. 1; 2 is a table showing an example of a notification list of the digital multi-function peripheral of FIG. 1; (A) is when only user ZA is recognized; (B) is when only user ZB is recognized; (C) is when users ZA and YA are recognized at the same time. (D) is an example of a notification list when the user of user YA is recognized. 2 is a table showing an example of a notification message definition table of the digital multi-function peripheral of FIG. 1; (A) shows an example of notification of content pre-stored in the digital MFP, and (B) shows an example of notification of dynamic content created and registered by a user or an application. FIG. 2 is an example of a notification generation state for each notification target of the digital multi-function peripheral of FIG. 1. FIG. 2 is an explanatory diagram showing an example of user recognition by face recognition of the digital multi-function peripheral of FIG. 1; FIG. (A) shows the case where only one user is recognized, and (B) shows the case where two users are recognized simultaneously. 4 is a flowchart showing an example of user notification processing of the digital multi-function peripheral of FIG. 1; 2 is an example of a login screen displayed on the display unit of the digital multi-function peripheral of FIG. 1; 2 is an example of a user notification display screen displayed on the display unit of the digital multi-function peripheral of FIG. 1; 2 is an example of a user notification display screen displayed on the display unit of the digital multi-function peripheral of FIG. 1; 2 is an example of a user notification display screen displayed on the display unit of the digital multi-function peripheral of FIG. 1; 2 is an example of an initial screen after login displayed on the display unit of the digital multi-function peripheral of FIG. 1; It is an example of a notification display screen for a user displayed on the display unit of the digital multi-function peripheral according to Embodiment 2 of the present invention. It is an example of a notification display screen for a user displayed on the display unit of the digital multi-function peripheral according to Embodiment 3 of the present invention. It is an example of a notification display screen for a user displayed on the display unit of the digital multi-function peripheral according to Embodiment 3 of the present invention.

The present invention will be described in further detail below with reference to the drawings. It should be noted that the following description is illustrative in all respects and should not be construed as limiting the present invention.

[Embodiment 1]
<Schematic Configuration of Digital MFP 1>
A digital multi-function peripheral 1, which is an embodiment of the information processing apparatus of the present invention, will be described with reference to FIGS. 1 and 2. FIG.
FIG. 1 is a perspective view showing the appearance of a digital multifunction peripheral 1 according to Embodiment 1 of the present invention.
FIG. 2 is a block diagram showing a schematic configuration of the digital multi-function peripheral of FIG. 1. As shown in FIG.

As shown in FIG. 1, the digital multifunction peripheral 1 according to the first embodiment of the present invention includes a camera 19 for user recognition attached to the main body.

The digital multifunction peripheral 1 is a device such as an MFP (Multifunction Peripheral) that digitally processes image data and has a copy function, a scanner function, and a facsimile function.

The digital multi-function peripheral 1 executes jobs such as scanning, printing, copying, or image transmission based on instructions received from the user via the operation unit 172 (see FIG. 2).

<Schematic Configuration of Digital MFP 1>
As shown in FIG. 2, the digital multifunction peripheral 1 includes a control unit 10, a document reading unit 11, an image forming unit 12, a storage unit 13, an image processing unit 14, a communication unit 15, a paper feeding unit 16, an operation panel 17, a user An authentication unit 18 , a camera 19 , a user recognition unit 20 and a notification unit 21 are provided.

Each component of the digital multifunction peripheral 1 will be described below.

The control unit 10 integrally controls the digital multifunction peripheral 1, and includes a CPU, a RAM, a ROM, various interface circuits, and the like.
In order to control the overall operation of the digital multifunction machine 1, the control unit 10 monitors and controls all loads such as detection of each sensor, motor, clutch, operation panel 17, and the like.

The document reading unit 11 is a part that detects and reads a document placed on a document platen or a document conveyed from a document tray, and generates image data.

The image forming section 12 is a section that prints out the image data generated by the image processing section 14 on paper, and includes an LSU 121 .
The LSU 121 is a device that forms an electrostatic latent image by irradiating the surface of a photosensitive drum in a charged state with laser light corresponding to image information composed of digital signals acquired by the document reading unit 11 .

The storage unit 13 is an element or a storage medium that stores information necessary for realizing various functions of the digital multifunction peripheral 1, control programs, and the like. For example, semiconductor devices such as RAM (Random Access Memory) and ROM (Read Only Memory), hard disks, flash storage units, SSDs (Solid State Drives) and other storage media are used.
Note that programs and data may be held in different devices, such as a hard disk drive as a data holding area and a flash memory as a program holding area.

The image processing unit 14 converts the document image read by the document reading unit 11 into a proper electric signal to generate image data, and converts the image data input from the document reading unit 11 into the image data according to the command from the operation unit 172. This is a part that performs processing suitable for output such as enlargement/reduction.

The communication unit 15 is a part that communicates with an external device via a wired or wireless network and transmits and receives necessary data.

The paper feed unit 16 is a part that conveys paper stored in a paper feed cassette or a manual feed tray to the image forming unit 12 .

The operation panel 17 includes a display panel made up of a liquid crystal panel or the like, and a touch panel of a capacitive type or the like which is arranged over the display panel and detects a position touched by a finger. A portion 172 is provided.

The display unit 171 is a part that displays various kinds of information.
The display unit 171 is composed of, for example, a CRT display, a liquid crystal display, an EL display, or the like, and is a display device such as a monitor or line display for displaying electronic data such as the processing state of the operating system or application software.
The control unit 10 displays the operation and status of the digital multifunction peripheral 1 through the display unit 171 .

The operation unit 172 is an interface for operating the digital multifunction peripheral 1, and is a part that receives commands from the user.

The user authentication unit 18 compares information such as a login name and a password input from the operation unit 172 with corresponding information recorded in advance in the storage unit 13 to determine whether the user is a legitimate user. This is the part that performs authentication.

The present invention is characterized in that a new "recognition" state of the user is provided between the two states before and after user authentication by normal login operation.

When the user is recognized by face as in the first embodiment, the user's face is also registered at the time of user registration.
In this case, the camera 19 constantly photographs and monitors the face of the person in front of the digital multifunction peripheral 1 to determine whether or not the user is a registered user.

On the other hand, user authentication shall be performed by means other than recognition means (for example, IC card, password, fingerprint, etc.).

By doing so, the digital multi-function peripheral 1 can recognize whether the user approaching the device is a registered user or a non-registered user without the user performing an authentication operation.

It should be noted that user recognition may be performed by means other than the face.
Any technology that identifies the user without bothering the user will suffice.

For example, the user may be identified by using a beacon signal such as Bluetooth (registered trademark) of a portable terminal possessed by the user.

In this case, the user registers the ID of a mobile terminal such as a smartphone compatible with beacons in the user account information in advance.
The digital multifunction peripheral 1 periodically transmits a beacon, and when a mobile terminal is detected nearby, the user is identified by the ID of the mobile terminal.
Alternatively, the portable terminal may be the transmitting side of the beacon, and the digital multi-function peripheral 1 may be the receiving side.

Recognition methods based on the user's voiceprint, fingerprint, etc. can also be used for user recognition if they are not used for login authentication.
However, when adopting these recognition methods, unlike face recognition and beacons, active user actions such as user's utterances and finger touches to predetermined sensors are required.

Here, various schemes can be assigned as user recognition/user authentication methods.
User recognition usually requires no conscious action by the user, or is assigned an action that is simpler than the operation assigned to authentication.

Examples of user authentication methods that recognize users include "face recognition/IC card", "face recognition/password", "face recognition/fingerprint", "beacon/IC card", and "voiceprint/password". There are ways and you are not limited to the examples given above.

Moreover, when a plurality of recognition/authentication methods can be used, a plurality of combinations may be used together.
Furthermore, different combinations may be applied for different users or user groups.

For example, in the digital multi-function peripheral 1 shared by companies Y and Z, company Y's user authentication is "face recognition/fingerprint" and company Z uses "beacon/IC card". may

If an unregistered user is recognized, only notifications for general users will be displayed.
On the other hand, when the registered user is recognized, only the general user suppresses the target notification, and the recognized registered user is notified without waiting for the user's authentication operation.

In addition, the notification may also accept an operation for the notification (instructions such as "OK", "Close", "Print", etc.).
In that case, processing can be performed without authentication operation.

In this way, by providing the "recognition" state in addition to the "authentication" state of the user, it is possible to provide each user with the optimum notification and corresponding operation while ensuring security.

The camera 19, as shown in FIG. 1, is a part that is attached to the digital multifunction peripheral 1 and acquires an image of a predetermined range.
The camera 19 captures an image of the user who has entered a predetermined capturing range, analyzes the acquired image by the image analysis unit, and performs face recognition.

The user recognition section 20 is a section that recognizes and specifies a user based on the image acquired by the image analysis section.

The user recognition unit 20 is not limited to face recognition, and may be anything that can identify a person who is close to the digital multifunction peripheral 1 based on pre-registered information for identifying a registered user, such as a beacon. .

The user recognition unit 20 searches for the user in front of the digital multifunction peripheral 1 in the unauthenticated state.
On the other hand, if the user has already been authenticated (logged in), the user recognition unit 20 may not perform recognition processing.

In addition, when user recognition cannot be performed in a sleep state such as an energy saving mode, user recognition may be started at the sleep return timing using a human sensor or the like (not shown).

Also, the user recognition unit 20 may be configured independently of the digital multifunction peripheral 1 .
For example, when face recognition is performed, the user information in front of the digital multi-function peripheral 1 recognized by the monitoring camera system may be acquired in cooperation with the monitoring camera system in the room.

The notification unit 21 is a part that manages notifications to users recognized by the user recognition unit 20 and notifies them at appropriate timings.

The notification unit 21 notifies the recognized user by, for example, displaying a predetermined notification dialog on the display unit 171 .

Further, the notification unit 21 is not limited to the text display on the display unit 171. For example, notification to the user recognized by voice may be performed through an internal or external speaker (not shown).
Further, the recognized user may be notified by the screen display or voice output of the user's mobile terminal linked with the digital multi-function peripheral 1 .

Furthermore, when there are a plurality of notifications, the notification unit 21 displays the plurality of notifications in a list format, or notifies the notifications with higher priority so as to be superimposed on the top.
In the latter case, priority is given to those with a narrow notification target range.
For example, "user-specific notifications>notifications for groups to which the user belongs>notifications for everyone".
Alternatively, the notification unit 21 may define priorities for the notifications themselves and display the notifications in order according to the priorities.

Note that the notification unit 21 may stop all recognition notifications in the logged-in state.

<Flow of User Notification Processing of Digital MFP 1 According to Embodiment 1 of the Present Invention>
Next, the flow of user notification processing of the digital multi-function peripheral 1 according to the first embodiment of the present invention will be described with reference to FIGS. 3 to 15. FIG.

FIG. 3 is a table showing an example of the user account information table of the digital multifunction peripheral 1 of FIG.
The user account information table is a table for registering and managing information necessary for identifying and managing each user.
Data for each user includes user name, authentication data, recognition data, applicable authority groups, and so on.

When the user recognition unit 20 recognizes the user, the user is specified by matching with the recognition data of the user account information table based on the recognition result.

<User category registration status>
In order to explain the difference in notification by user, the following users are assumed as users of the digital multi-function peripheral 1 placed in the shared space.

In the example of FIG. 3, assume that employees Abe, Baba, Chiba, and Dan with user IDs ZA, ZB, ZC, and ZD are employees of company Z, respectively.
It is also assumed that employees Yamada and Yabuta whose user IDs are YA and YB are employees of Company Y, respectively.
Assume also that the employee whose user ID is SA is the administrator of the digital multi-function peripheral 1, and that he is not an employee of Z company or Y company.
Other general users are treated as unregistered users with a user ID of UN.

In the following description, the employee whose user ID is ZA is referred to as user ZA.
The same applies to other employees.

User authentication is set in the digital multi-function peripheral 1, and after authentication, the user can use the functions permitted by the user.

<Affiliation authority group>
Whether or not each user can access various functions and information of the digital multifunction peripheral 1 is defined by a predetermined "affiliation authority group".
In the first embodiment, it is assumed that four types of belonging authority groups are set: company Z, company Y, administrator, and general.

In the example of FIG. 3, an authority group Z belonging to Z company is defined, and the authority is assigned to users ZA, ZB, ZC, and ZD who are employees of Z company.
Similarly, the belonging authority group Y for Y company is assigned to users YA and YB who are employees of Y company.
An authority group SYS for administrators is assigned to the system administrator SA.
Furthermore, it is assumed that the belonging authority group PUB for general users is automatically applied to the unregistered user UN.

If the presence of the user itself is detected, but the face cannot be determined, even if the user is registered, the user is treated as an unregistered user at the time of recognition.

<Scope of Notifications Users Receive>
Each user receives different notifications depending on the permissions granted to them and the groups they belong to.
Which notification is to be notified to each user is registered as user management information in the "user account information table" shown in FIG. 3 as "notification to be applied".

"Notifications to be applied" can be set manually by the administrator, but in general, it is often used in conjunction with the user's authority group. good too.

In the example of FIG. 3, MsgALL represents the notification to all, MsgSYS represents the notification to the system administrator, and MsgPUB represents the notification to unregistered users.

Even if there are multiple unregistered users, it is always MsgPUB because the system does not distinguish between them in terms of operation.
Registered users receive notifications directed to them, so the notifications received by users ZA, ZB, ZC, ZD, YA, YB, SA are denoted by MsgZA, MsgZB, MsgZC, MsgZD, MsgYA, MsgYB, MsgSA respectively.
Also, as notifications corresponding to authority groups set for operation, the notification to Z company employees is MsgZ, and the notification to Y company employees is MsgY.

Note that in FIG. 3, the recognition data is identification information for face recognition.
Also, the authentication data is a login name, password, and IC card information.
In the example of FIG. 3, the authentication data is identification information for IC card authentication.

<Data for recognition>
When biometric feature information such as a face is used to identify an individual, the biometric feature information is recorded. As a result, only logical ID information that can identify a predetermined individual is acquired.
In such a system configuration, the identification information stored here is the logical ID output by the personal identification system.

FIG. 4 is a table showing an example of a list of recognized users of the digital multifunction peripheral 1 of FIG.

The user recognition unit 20 recognizes who the recognized user is from the list of recognized users as shown in FIG.
The user recognition unit 20 identifies each user by an ID that can identify the user, and records the recognized user ID in a list of recognized users.
Also, when a plurality of users are recognized, the user IDs of all recognized users are recorded.

In addition, the user recognition unit 20 records the unregistered user ID as an "unregistered user" in the case of an unregistered user who is not a registered user or an unconfirmed user whose identification has failed.
It should be noted that, regardless of how many unregistered users are detected, they are treated as one unregistered user.

If the person is not recognized, the list of recognized users will be blank, as shown in FIG. 4(A).

If only user ZA is recognized, "ZA" is stored in the first item in the recognized user list, as shown in FIG. 4B.

When users ZA and YA are recognized at the same time, as shown in FIG. 4C, the first item in the list of recognized users is "ZA" and the second item is "YA". Stored.

FIG. 5 is a table showing an example of the notification management table of the digital multifunction peripheral 1 of FIG.

The notification unit 21 manages notifications to users based on a notification management table as shown in FIG.
The notification unit 21 manages an ID indicating notification of contents and notification target information when a notification to the user is generated or when a notification request to the user is received from the outside.

As shown in FIG. 5, information required for notification is registered in the notification management table in order of occurrence.
In the example of FIG. Item 1 stores "MsgALL" as the notification target classification ID and "SPM001" as the notification message ID.
When the user recognition unit 20 recognizes a user corresponding to the notification target classification ID, the notification unit 21 notifies the corresponding notification message.

In addition, the notification unit 21 deletes the notification that has ended or is no longer necessary from the notification management table.

FIG. 6 is a table showing an example of the notification list of the digital multifunction peripheral 1 of FIG.

The notification list is a table that stores a list of notification requests determined to be necessary based on the current notification request state and the user's recognition state.

The notification unit 21 extracts notifications for users currently recognized by the user recognition unit 20, that is, notifications for users stored in the list of recognized users (FIG. 4) from the notification management table and stores them in the notification list.

FIG. 6A is an example of a notification list when only user ZA is recognized.

If only the user of user ZA is recognized, notifications with notification target classification IDs "MsgALL", "MsgZ", and "MsgZA" are applicable. be notified.

FIG. 6B is an example of a notification list when only user ZB's user is known.

If only user ZB is recognized, notifications with notification target classification IDs "MsgALL", "MsgZ", and "MsgZB" are applicable, so the respective notification messages "SPM001", "MSG200", and "MSG101" are be notified.

FIG. 6C is an example of a notification list when users ZA and YA are recognized at the same time.

When the users ZA and YA are recognized, the notification message "SPM001" is notified because the notification of the notification target classification ID "MsgALL" common to these users applies.

In this case, the notifications with the notification target classification IDs "MsgZ" and "MsgZA" corresponding to user ZA are irrelevant to user YA. can pose a security problem.
Therefore, when the user YA is recognized in addition to the user ZA, the notification specific to the user ZA is not displayed.

Similarly, the notification of the notification target classification ID “MsgYA” corresponding to the user YA is also not displayed on the display unit 171 .

In this way, when multiple user IDs are stored in the list of recognized users, the notification unit 21 extracts only notifications that occur in common to all stored users. .

On the other hand, if one of the users ZA and YA leaves and only one user is recognized, the display unit 171 displays a notification unique to the recognized user.

If three or more users are recognized, the process is similar.
That is, if three or more users are recognized at the same time, only notifications common to all three users are displayed.
Also, if one of the three users leaves and only two users are recognized, only notifications common to the two users are displayed.

FIG. 6D is an example of the notification list when the user YA is recognized.

When only the user of user YA is recognized, in the example of FIG. 5, the notifications of the notification target classification IDs "MsgALL" and "MsgYA" correspond, so the respective notification messages "SPM001" and "MSG102" are notified. be done.

It should be noted that the notification unit 21 only receives notification when the user identification state (list of recognized users) has changed since the previous notification and when the content of the notification (notification management table) has changed since the previous notification was obtained. is preferably executed.
In other words, if there is no change in the user's identification status or the content of the notification, the notification unit 21 does not perform the notification acquisition process and maintains the current notification.

FIG. 7 is a table showing an example of the notification message definition table of the digital multi-function peripheral 1 of FIG.
(A) shows an example of notification of contents pre-stored in the digital multifunction peripheral 1, and (B) shows an example of notification of dynamic contents created and registered by a user or an application.

As shown in FIG. 7, each notification message to the user is managed with a unique notification ID.
For each notification, "notification target range" and "notification content" are defined in advance.

The notification target range is the range of target users to whom the notification should be made.
The number and configuration of users and groups that can be managed by the digital multi-function peripheral 1 may be determined arbitrarily according to usage conditions.

Typical scopes include, for example, individual users, groups that manage usage rights, arbitrarily configured groups, and all users.
For example, it is conceivable to use organizational divisions such as divisions, divisions, and sections, or to use separate notifications for employees and part-time workers.

<Example of notification target>
The notification target range in the first embodiment is everyone, unregistered users, administrators, specific users, Z company, and Y company.
It is assumed that users ZA, ZB, ZC, and ZD, who are employees of company Z, belong to company Z, and users YA, YB, who are employees of company Y, belong to company Y. .

<Example of content notification>
The notification of the contents is not limited to the contents pre-stored in the digital multi-function peripheral 1 as shown in FIG. 7(A). It is also possible to include notifications such as notification sentences that have been sent or notifications dynamically generated by an application or the like.

Note that the notification message definition table may be stored in the digital multifunction peripheral 1, or may be configured to be managed by another management device such as a server on the cloud and referred to by the digital multifunction peripheral 1. .
Alternatively, the notification message definition table may be embedded as attribute information of the message itself.

FIG. 8 shows an example of notification occurrence states for each notification target of the digital multi-function peripheral 1 of FIG.

In the first embodiment, as shown in FIG. 8, it is assumed that a content notification request is made for each predetermined notification target.

FIG. 9 is an explanatory diagram showing an example of user recognition by face recognition of the digital multifunction peripheral 1 of FIG.
(A) shows the case where only one user ZA is recognized, and (B) shows the case where two users ZA and YA are recognized simultaneously.

FIG. 10 is a flow chart showing an example of user notification processing of the digital multi-function peripheral 1 of FIG.

Here, a notification example is shown in which the registered user ZA of the digital multifunction peripheral 1 executes a hold print job from an application such as a PC, goes to the digital multifunction peripheral 1, calls the executed hold print, and prints out. .

User ZA's account information is managed in a user account information table (FIG. 3), and authentication data and recognition data are registered in advance.

In step S1 of FIG. 10, the control unit 10 initializes the already recognized user list (step S1).

Next, in step S2, the control unit 10 causes the display unit 171 to display a predetermined standby screen (login screen) (step S2).

FIG. 11 is an example of a login screen displayed on the display unit 171 of the digital multifunction peripheral 1 of FIG.

Next, in step S3, the control unit 10 determines whether or not a login operation has been performed (step S3).

If no login operation has been performed (No in step S3), the user recognition unit 20 searches for a user in step S4 (step S4).

In step S4, the user recognition unit 20 always performs the user search process, but the user recognition unit 20 does not need to change the notification if the detected user is the same.
In other words, the user recognition unit 20 needs to update the notification only when the recognized user changes.

Next, in step S5, when the user enters the front of the digital multifunction peripheral 1 and is captured by the camera 19, the user recognition unit 20 generates face identification information by face recognition, and stores the user account information table (FIG. 3). User identification processing is performed by collating face identification data of registered users (step S5).

The user recognition unit 20 writes the identification result into the list of currently recognized users (FIG. 4).
When the user recognition unit 20 recognizes the user ZA, it writes the user ID "ZA" into the list of currently recognized users, as shown in FIG. 4(B).

Next, in step S6, the user recognition unit 20 determines whether or not the user recognition state has changed (step S6).

If the user recognition state has changed (if the determination in step S6 is Yes), in step S10, the control unit 10 changes the user state recognized by the user recognition unit 20 (a list of recognized users). It is stored in the storage unit 13 as a list of users (step S10).

Then, when the determination in step S6 is performed next, the saved list of recognized users is compared with the latest list of currently recognized users, and if there is a change (if the determination in step S6 is Yes) ), in step S10, the list of already recognized users is updated to the latest state (step S10).

Thereafter, in step S8, the control unit 10 performs notification acquisition processing (step S8).

Note that the list of already recognized users stored in the storage unit 13 is initialized (deleted) at step S1 when the power of the digital multifunction peripheral 1 is turned on, or when the digital multifunction peripheral 1 is started after returning from the energy-saving mode. and reset to zero recognized users as shown in FIG. 4(A).

On the other hand, when the user recognition state has not changed in step S6 (when the determination in step S6 is No), in step S7, the control unit 10 determines whether or not there is a notification update request (step S7). .

In addition to the aforementioned change in the user's recognition state, the notification update conditions include a change in the state of the notification request itself.
In addition, it may be necessary to update the notification due to a change in the operating state of the digital multi-function peripheral 1 or an external request.

In general, when a necessary notification is generated in each functional processing unit, a notification request event is issued at the same time, or a notification update flag is turned on, thereby requesting update of the notification.

If there is no change in the user's recognition state (if the determination in step S6 is No) and if no notification update request has occurred (if the determination in step S7 is No), updating the notification is unnecessary. 10 returns the process to step S2, holds the current display state, and continues the user search process.

On the other hand, if there is no change in the user's recognition state (when the determination in step S6 is No) and a notification update request has occurred (when the determination in step S7 is Yes), in step S8, the control unit 10 A notice for a currently recognized user, ie, a user stored in the list of recognized users, is extracted from the notice management table and stored in the notice list (step S8).

In subsequent step S9, the display unit 171 performs notification processing (step S9).

After that, the control unit 10 returns the process to step S2.

On the other hand, if a login operation has been performed in step S3 (if the determination in step S3 is Yes), in step S11, the control unit 10 determines whether or not the login has succeeded (step S11).

If the login is not successful (the determination in step S11 is No), the control unit 10 returns the process to step S2.

On the other hand, if the login is successful (the determination in step S11 is Yes), in step S12, the display unit 171 erases the notification to the recognized user (step S12).

Subsequently, in step S13, the display unit 171 displays a predetermined initial screen after login (step S13).

<Example 1>
Next, Example 1 of user notification processing of the digital multi-function peripheral according to Embodiment 1 of the present invention will be described.

As Example 1, it is assumed that a communication request as shown in the table of FIG. 8 has occurred and the notification management table is in the state shown in FIG.
Then, as shown in the list of recognized users in FIG. 4B, it is assumed that user ZA is the only user to be notified.

At this time, the notification to be applied to ZA is "MsgALL, MsgZ, MsgZA" from the user account information table in FIG. 3, so the corresponding notification is extracted from the notification management table in FIG. A notification list for ZA is generated as shown in A).

Then, in the notification process, the display unit 171 displays notifications on the notification list.

Various methods are conceivable as the display form, but in the first embodiment, a method is adopted in which the total number of notifications is displayed numerically on an icon, and only one notification with the highest priority is actually displayed. ing.

12 and 13 show an example of a user notification display screen displayed on the display unit 171 of the digital multi-function peripheral 1 of FIG.

In the example of FIG. 6A, since there are three notifications to user ZA, the display unit 171 displays a balloon icon IC indicating that there is a notification in a predetermined display area, as shown in FIG. , the number of cases "3" is displayed.

Here, the notification priority is set to "user-specific notification>notification to the group to which the user belongs>notification for everyone".
At this time, the priority of the three notifications in FIG. becomes "7 > 4 >1".

Therefore, the display unit 171, as shown in FIG. 7. "There is print data that has not been output. [Print] [Close]" is displayed on the standby screen.

Here, when the user taps the [Print] button, the notification is deleted in the state before login, and the display unit 171 displays the message "Printing accepted. Document 1" as shown in FIG. and print processing is executed.

And management No. 7, management No. 7 is displayed from the notification management table of FIG. 6A. 7 notification is deleted.
At this point, one notification out of three notifications to user ZA has been processed, and the remaining notifications have been processed according to management number. 4, No. Since there are two cases of 1, the number display of the balloon icon IC is "2" as shown in the example of FIG.

Since the operation can be performed even during the printing process, the message is automatically deleted after being displayed for a certain period of time (for example, after 6 seconds).

At this time, the user recognition state remains user ZA, but since the notification management table is updated, notification update is requested, and notification acquisition processing is performed again.

Here, it is assumed that user ZA does not need facsimile output, takes out the previous printed matter, and leaves from the front of digital multifunction peripheral 1 as it is.
Further, since user ZA has not logged in, the digital multi-function peripheral 1 remains in an unauthenticated state, and naturally the logout operation is unnecessary.

At this time, as shown in FIG. 14, the display unit 171 displays the next highest priority management number. Display the notification of 4 "There is fax reception data. [Print] [Close]".

When the user ZA leaves, the user recognition unit 20 stops detecting the user in the user search process.
As a result, the list of recognized users is updated to change to a state of zero recognized users, as shown in FIG. 4(A).

At this time, the notification unit 21 updates the notification list in the notification acquisition process, but since the user is not recognized, there is no notification target to be notified, and the notification list becomes zero.
Therefore, the display unit 171 erases all notifications and returns to the standby screen (login screen) as shown in FIG.

In this way, the notification made by recognizing the user becomes unnecessary when the user leaves. The notification to the recognized user is erased from the display unit 171 .

The user recognition unit 20 normally determines that the user has left the front of the digital multifunction peripheral 1 when the user cannot be detected.

For example, in the case of face recognition by a camera, based on the movement of the user around the digital multifunction peripheral 1 by the camera, and in the case of recognition by a beacon, based on changes in the signal strength of the beacon, the user is detected by the digital multifunction peripheral 1. It is determined whether or not it has departed from the front.

It should be noted that the withdrawal determination may be realized by a technique other than the technique used for user recognition.
For example, in the digital multi-function peripheral 1 equipped with a human sensor, recognition may be performed by face recognition using a camera, and departure may be determined by the human sensor.

Also, even if the user is detected, if it is determined that the user is clearly not involved in the operation or processing of the digital multifunction peripheral 1, it may be treated as "leaving".
For example, the user recognizing unit 20 may determine that the user has left on the condition that "the user has moved away from the front of the digital multi-function peripheral 1 by a predetermined range (eg, 2 meters)."

Since the notification will not disturb or cause confusion if there is no one to see it, the notification is displayed on the display unit 171 for an arbitrary time until the next user comes in front of the digital multifunction peripheral 1. You may make it continue displaying.

Next, the case where the user wants to log in in the notification state by user recognition will also be described.

FIG. 15 is an example of an initial screen after login displayed on the display unit 171 of the digital multifunction peripheral 1 of FIG.

As shown in FIG. 12, it is assumed that the user ZA logs in while the user recognition unit 20 recognizes the user ZA and the display unit 171 displays a notification for ZA on the login screen.

In this case, for example, if IC card authentication is performed as a user authentication method, the user holds the IC card over a predetermined reading unit of the digital multi-function peripheral 1, and after login as shown in FIG. An initial screen is displayed, for example, a home screen displaying the functions authorized for user ZA.

In the example of FIG. 15, the notification for the recognized user is hidden, but the notification for the recognized user may be displayed again on the initial screen after login.

In general, if the user ignores the notification displayed before login and performs the login operation, it is considered that the user does not need to respond to the notification, so the notification displayed before login is It is better to delete it after login.

By doing so, the notification to the recognized user does not interfere with the normal login operation and does not increase the login operation procedure.

As described above, conventionally, management No. The notification and operation of 7 are operations permitted only for user ZA, so they could only be performed after the login operation, but in Example 1, it is possible to print user-specific data without going through the step of login authentication operation. It has become.
Also, since the user has not logged in in the first place, there is no security risk due to forgetting to log out.
As a result, the number of operation steps can be reduced while ensuring security.

As described above, the user recognition unit 20 recognizes the user by a method different from login authentication, and the notification unit 21 executes notification of the content according to the recognition result. It is possible to realize the digital multi-function peripheral 1 that notifies the user as necessary.

Further, since a notification suitable for each user can be automatically sent just by approaching the digital multi-function peripheral 1, the user can easily notice the notification.
Furthermore, if the operation for the notification is accepted even before the login authentication, the process can be completed without the login operation.

(Embodiment 2)
Next, user notification processing of the digital multi-function peripheral 1 according to Embodiment 2 of the present invention will be described.

FIG. 16 is an example of a user notification display screen displayed on the display unit 171 of the digital multi-function peripheral 1 according to Embodiment 2 of the present invention.

In the second embodiment, user notification processing is basically the same as in the first embodiment (FIG. 10).
It is also assumed that the user account information table, the generated notification request, the conditions of the notification management table, etc. (FIGS. 3 to 8) are the same as in the first embodiment.

In the second embodiment, the user who executed the print output is notified of useful information for the job.

Specifically, it is assumed that the registered user ZB of the digital multifunction peripheral 1 executes a print job from an application such as a PC and comes to the front of the digital multifunction peripheral 1 to retrieve printed matter.

Also, the configuration of the digital multi-function peripheral 1 according to the second embodiment is basically the same as that of the first embodiment (FIG. 2), but is provided with a plurality of destination trays.

When a user executes a print job, if the user does not allow the digital multi-function peripheral 1 to automatically select the output destination of the printed matter, and specifies the output destination tray to be output, the user can specify which paper output tray the printed matter is to be output to. Since it is known in advance whether it is on the first tray, the user usually does not get confused about the output destination of the printed matter.

However, even if the user designates a paper discharge destination tray, the user may not be able to grasp the output destination of the paper discharge destination tray.

For example, if the output tray specified by the user is already full of other printed materials and cannot be output, a digital multifunction device with a function to automatically output to the output tray with extra output capacity. There is also 1.

In this case, the user has to find where his or her printed matter is located among the plurality of destination trays.

Conventionally, as a solution to such a problem, it is common to enable confirmation of the destination tray for each print job on the screen.

However, this method has some drawbacks as shown in 1-3 below.

1. When many users perform a lot of printing, a large number of print job results are displayed, and it becomes troublesome to search for one's own job.
2. When operating in authentication mode, it takes time and effort to log in and display your job status.
3. If the job status can be checked without logging in, there is a risk that information such as a file name that the user does not want others to know may be displayed.

Embodiment 2 provides a digital multi-function peripheral 1 capable of notifying the user of the destination tray without the above drawbacks.

In this case, when the user recognition unit 20 detects the user in the user search process and recognizes that the user is user ZB in the user identification process, the user ID "ZB" is written in the currently recognized user list.

At this time, the notification to be applied to user ZB is "MsgALL, MsgZ, MsgZB" from the user account information table. A notification list (FIG. 6(B)) is generated.

The notification processing unit displays the generated notification list (FIG. 6B) on the actual screen.

Here, as in the first embodiment, the priority of notification is set to "notification unique to user>notification to group to which user belongs>notification for all members".
At this time, the priority of the three notifications in FIG. becomes "5 > 4 >1".

Therefore, the display unit 171, as shown in FIG. 5. Display "Output to paper discharge tray 2. Document A [OK]" on the standby screen.

As a result, the user ZB can notice that the printed matter he has come to pick up is in the discharge tray 2 without any voluntary operation.

In the example of FIG. 16, user ZB can see from the balloon icon IC that there are a total of three notifications to him.
If user ZB wants to see other notifications, he can enter Administration No. If the [OK] button of the notification of 5 is tapped, this notification is deleted and the next notification is displayed.

Here, it is assumed that the user ZB does not operate the [OK] button, takes out the printed matter, and leaves the front of the digital multifunction peripheral 1 as it is.
Since the user ZB has not logged in, the digital multi-function peripheral 1 remains in an unauthenticated state and, of course, no logout operation is required.

When the user ZB leaves, the user recognition unit 20 stops detecting the user in the user search process.
As a result, the display unit 171 erases all notifications and returns to the standby screen (login screen) as shown in FIG.

Management No. Although the user did not perform any operation on the notification of 5, the notification itself was executed, so the notification unit 21 deletes the notification from the notification management table.

In this way, the user does not have to operate the digital multifunction peripheral 1 at all, and the information of the processing performed by the digital multifunction peripheral 1 is not displayed to other users, and only the relevant user can access the necessary information at an appropriate timing. A digital multi-function peripheral 1 that can receive notifications can be realized.

(Embodiment 3)
Next, user notification processing of the digital multi-function peripheral 1 according to Embodiment 3 of the present invention will be described.

17 and 18 are examples of user notification display screens displayed on the display unit 171 of the digital multi-function peripheral 1 according to Embodiment 3 of the present invention.

In Embodiment 3, user notification processing is basically the same as in Embodiment 1 (FIG. 10).
It is also assumed that the user account information table, the generated notification request, the conditions of the notification management table, etc. (FIGS. 3 to 8) are the same as in the first embodiment.

In the third embodiment, an example of user notification processing when the user recognition unit 20 recognizes multiple users at the same time will be described.

As an example, as shown in FIG. 9B, it is assumed that the user recognition unit 20 later recognizes user YA while recognizing user ZA.

In this case, when the user recognition unit 20 recognizes the user YA, the display unit 171 erases the notification specific to the user ZA and displays only the message matching both ZA and YA.

After that, when the user recognition unit 20 stops detecting the user YA and returns to the state of recognizing only the user ZA again as shown in FIG. do.

Conversely, when user ZA leaves first and the user recognition unit 20 changes to a state where only user YA is recognized, display unit 171 displays a notification unique to user YA.

First, when the user recognition unit 20 recognizes only the user ZA, the display unit 171 displays only the notification for the user ZA, as in the first embodiment (FIG. 12).

Here, when the user YA comes in front of the digital multi-function peripheral 1, the user recognition unit 20 also detects the user YA by user search processing.
After that, in the user identification process, the user recognition unit 20 specifies that the users are users ZA and YA, and as shown in FIG. and write "YA".

In the notification acquisition process, the notification unit 21 extracts applicable notification types common to all recognized users stored in the recognized user list.

Specifically, in the user account information table, the notification applicable to user ZA is "MsgALL, MsgZ, MsgZA", and the notification applicable to user YA is "MsgALL, MsgY, MsgYA". Therefore, the notification unit 21 extracts only "MsgALL" as an application target common to both.

Next, the notification unit 21 extracts notifications corresponding to "MsgALL" from the notification management table, and generates a notification list as shown in FIG. 6C as targets to be finally notified.
In this case, management No. Only 1 applies.

As shown in FIG. 17, the display unit 171 displays the notification of the generated notification list, that is, the management number. 1 Display "Cannot be used from 12:00 to 13:00 on July 20th for maintenance. [OK]" is displayed on the standby screen.

In this state, if the user YA leaves the digital multifunction peripheral 1, the only user recognized by the user recognition unit 20 is the user ZA again. back to

On the other hand, if the user ZA leaves the digital multifunction peripheral 1 first, the user recognized by the user recognition unit 20 is only the user YA, so the display unit 171 displays only the notification for the user YA.

When only the user YA is recognized, the notification unit 21 generates the notification list shown in FIG. 6D from the notification management table in the notification acquisition process, and the display unit 171 displays the notification of the notification list on the screen. .

Here, as in the first embodiment, the priority of notification is set to "notification unique to user>notification to group to which user belongs>notification for all members".
At this time, the priority in the notification to the user YA is "MsgYA>MsgY>MsgALL", so the priority in the two notifications in FIG. becomes "3 >1".

Therefore, the display unit 171 displays the management No. as shown in FIG. 3 "Output without stapling. [OK]" is displayed on the standby screen, and "2" is displayed as the number of notifications in the balloon icon IC.

In this way, when multiple users are recognized at the same time, by suppressing notifications to users who are not subject to notification, other users and members of other groups can be notified without performing login authentication operations. Since it is possible to prevent a notification that should not be seen from being seen and to continue a trouble-free notification, it is possible to realize a digital multi-function peripheral 1 capable of achieving both security and convenience.

Preferred aspects of the invention also include combinations of any of the aspects described above.
In addition to the embodiments described above, various modifications of the present invention are possible. Those modifications should not be construed as not belonging to the scope of the present invention. The present invention should include all modifications within the scope of the claims, the meaning of equivalents, and the scope.

1: Digital MFP 10: Control Unit 11: Document Reading Unit 12: Image Forming Unit 13: Storage Unit 14: Image Processing Unit 15: Communication Unit 16: Paper Feed Unit 17: Operation Panel 18: User authentication unit 19: Camera 20: User recognition unit 21: Notification unit 121: LSU 171: Display unit 172: Operation unit IC: Balloon icon Admin: Administrator PUB, SYS, Y , Z: belonging authority group, SA: system administrator, YA, YB, ZA, ZB, ZC, ZD: user, UN: unregistered user

Claims (6)

a user authentication unit that accepts user login authentication;
a user detection unit that detects a user within a predetermined range before the login authentication;
a user recognition unit that determines and recognizes whether the user is a registered user registered in predetermined user information based on the detection result of the user detection unit;
a notification unit that performs notification to the user;
A control unit that controls the user authentication unit, the user detection unit, the user recognition unit and the notification unit,
The user recognition unit recognizes the user by a method different from the login authentication,
The information processing apparatus, wherein, when the user recognition unit recognizes the user, the control unit causes the notification unit to perform notification of content according to a recognition result. The user recognition unit is capable of recognizing a plurality of users within the range before the login authentication,
2. The control unit according to claim 1, wherein when the user recognition unit recognizes a plurality of users, the control unit causes the notification unit to perform notification of different content than when the user recognition unit recognizes only a single user. Information processing equipment. When the user recognition unit recognizes a single user within the range before the login authentication, the control unit notifies the user only while the user recognition unit recognizes only the user. 3. The information processing apparatus according to claim 1, wherein the notification unit is caused to execute. When the user recognition unit detects a plurality of users within the range before the login authentication, the control unit controls the plurality of users while the user recognition unit recognizes the plurality of users. 4. The information processing apparatus according to any one of claims 1 to 3, wherein only common notification is executed by said notification unit. It further has an operation unit that accepts user operations,
The user authentication unit accepts user login authentication by a predetermined login operation accepted by the operation unit,
The user detection unit includes a camera that acquires and detects an image of a user within a predetermined range,
3. The user recognition unit determines and recognizes whether the user is a registered user registered in predetermined user information based on the detection result of the user's face acquired by the user detection unit. 5. The information processing device according to any one of 1 to 4. a user authentication step for accepting user login authentication;
a user detection step of detecting a user within a predetermined range before the login authentication;
a user recognition step that determines and recognizes whether the user is a registered user registered in predetermined user information based on the detection result of the user detection step;
and a notification step of performing notification to the user;
in the user recognition step, recognizing the user by a method different from the login authentication;
A notification method for an information processing apparatus, wherein when the user is recognized in the user recognition step, notification of contents corresponding to the recognition result is executed in the notification step.

Images