JP2014110009A - Portable terminal equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To surely protect privacy with a small power consumption without performing any complicate operation.SOLUTION: The portable terminal equipment includes: a casing (1); a sensor (5) installed in the casing (1) for detecting a contact from the outside, and for outputting a detection signal; an in-camera (6) incorporated in the casing (1) for imaging the periphery; a feature storage part (8) for storing the feature image data of the face of a preliminarily registered person; an authentication part (7) for authenticating the face imaged by the in-camera (6) on the basis of a face image imaged by the camera (6) and the feature image data stored in the feature storage part (8); a display part (11) for displaying display information including an icon and a message on a display surface; and an authentication control part (10) for authenticating the face of an operator by controlling the in-camera (6) and the authentication part (7) on the basis of at least one of the detection signal from the sensor (5) and the display state of the display surface.

Description

  The present invention relates to a portable terminal device that can reliably protect privacy with low power consumption.

  Since the portable electronic device can be easily carried, it may be taken away by another person during operation or used by another person when the seat is removed. Therefore, privacy protection is important, and there are an authentication function and a lock function.

  As a portable electronic device having such an authentication function and a lock function, there is a portable terminal disclosed in WO07 / 091436 (Patent Document 1). This portable terminal has an upper housing and a lower housing that are configured to be foldable via a hinge portion, and includes a touch sensor on the back side and the side that the user touches when holding the lower housing.

  And normal operation | movement can be performed while a user's hand is contacting the said touch sensor. On the other hand, when the user's hand is away from the touch sensor for a certain time, the lock mode state is entered. Thereafter, there is contact with the touch sensor again, and when this contact continues for a certain period of time, lock mode release processing such as authentication processing using a personal identification number is executed. Thus, when the lock mode releasing process is successful, the control is shifted to the normal control.

  From the viewpoint of privacy protection, for example, a lock function using a pass code is a common means. However, if the terminal is placed on a desk or the like during operation of the mobile terminal, it is in a state displayed on the display unit and unlocked, and may be seen by others. There is sex.

  Further, in the conventional portable terminal disclosed in Patent Document 1, when the user once leaves the portable terminal and tries to operate again, the lock mode release process is required even for the user himself / herself. There is a problem that it is complicated. Furthermore, since the non-contact state to the touch sensor needs to continue for a certain time or more in order to shift to the lock mode state, the lock function may not function well when the mobile terminal is suddenly taken away. There is also a problem.

  In addition, recent mobile terminal devices tend to consume a large amount of power due to a large screen, high-definition display, and high functions, and there is a demand for reducing power consumption. For example, always starting user authentication by the fingerprint sensor function or camera function is an effective means to ensure privacy, but power consumption increases to always perform user authentication. There is a problem from the point.

WO07 / 091436

  Accordingly, an object of the present invention is to provide a mobile terminal device that can securely protect privacy without performing complicated operations and with low power consumption.

In order to solve the above problems, the mobile terminal device of the present invention is:
The body,
A sensor provided on the housing for detecting a contact from the outside and outputting a detection signal;
An in-camera that is built into the housing and images the surroundings;
A feature storage unit for storing feature image data of a person's face registered in advance;
An authentication unit that performs authentication of the face imaged by the in-camera based on the face image imaged by the in-camera and the feature image data stored in the feature storage unit;
A display unit for displaying display information including an icon and a message on the display screen;
An authentication control unit that controls the in-camera and the authentication unit based on at least one of a detection signal from the sensor and a display state of the display screen to authenticate an operator's face. It is a feature.

  As is clear from the above, according to the present invention, the face authentication by the authentication unit is performed based on at least one of a detection signal indicating contact with the sensor from the outside and a display state of the display screen. When the portable terminal device is left on the desk without applying the lock function, or when the portable terminal device is put into another person's hand without applying the lock function, it can be confirmed whether or not the operator is a user. Therefore, when the operator's face confirmation result is bad, the state of the display screen can be changed to a state corresponding to “recognition failure”.

  That is, according to the present invention, even if the portable terminal device is left on the desk without applying the lock function, or even if it is in the hands of another person without applying the lock function, the complicated operation is performed. In addition, it is possible to prevent a person other than the user from seeing the display content of the display screen of the portable terminal device or starting an application, and to ensure privacy.

  At that time, since the authentication of the face by the authentication unit is performed based on at least one of the detection signal from the sensor and the display state of the display screen, it is not necessary to always start the authentication unit, and power consumption is reduced. Reduction can be achieved.

It is an external view in the portable terminal device of this invention. It is a block diagram which shows the function structure of the portable terminal device shown in FIG. It is a flowchart of a user authentication processing operation. It is a figure which shows the example of a display of the touchscreen in "authentication failure processing". It is a flowchart of a touch pattern change detection process. It is a figure which shows a mode that this mobile terminal device passes from the user A to the user B. FIG. 4 is a flowchart of a user authentication processing operation different from FIG. 3. FIG. FIG. 8 is a flowchart of a user authentication processing operation different from those in FIGS. 3 and 7. FIG. FIG. 9 is a flowchart of a user authentication processing operation different from those in FIGS. 3, 7, and 8. It is a figure which shows the example of a display displayed on a display device according to an authentication state.

  Hereinafter, the present invention will be described in detail with reference to the illustrated embodiments.

-1st Embodiment FIG. 1: is an external view in the portable terminal device of this 1st Embodiment.

  The mobile terminal device is a smartphone (trade name), and includes a housing 1 and a touch panel 2 disposed on the surface of the housing 1 as shown in FIG.

  The touch panel 2 has a display function and an input function, and can be operated by touching a touch key such as an icon displayed on the touch panel 2 (hereinafter also referred to as a soft key) with a finger. Yes. A call microphone 3 is disposed below the touch panel 2, and a call speaker 4 is disposed above the touch panel 2. An in-camera 6 (only a lens is displayed) is built in on the side of the call speaker 4, and a touch-type side sensor 5 extending along the touch panel 2 is installed on the right side of the touch panel 2. ing.

  FIG. 2 is a block diagram showing a functional configuration of the mobile terminal device shown in FIG. In FIG. 2, the mobile terminal device includes a touch panel 2, a side sensor 5, an in-camera 6, an authentication unit 7, a storage unit 8, a communication unit 9, and a control unit 10.

  The touch panel 2 has a display function and an input function. For example, the display device 11 as a display unit such as an LCD (Liquid Crystal Display) panel and a transparent position input device 12 are stacked. Then, the display content of the display device 11 can be seen through the position input device 12. The display device 11 displays a software keyboard, an input guide, an icon, and the like.

  The side sensor 5 as the sensor detects a contact / non-contact from the outside and outputs a detection signal. As will be described in detail later, the mobile terminal device is locked on based on a detection signal from the side sensor 5. Here, since the side sensor 5 is installed on the right side of the housing 1, a part of the operator's hand (such as a finger) that wraps around the side of the portable terminal device always touches the side sensor 5. It is in a state.

  The in-camera 6 is a camera built in the portable terminal device, and is used for the face authentication of the operator. The authentication unit 7 compares the facial image data representing the features extracted from the facial image captured by the in-camera 6 with the facial image data of the user stored in the storage unit 8, whereby the portable terminal device Perform user authentication (face authentication). In that case, if face authentication is always performed using the in-camera 6, power consumption increases. Therefore, in the present embodiment, the in-camera 6 is activated and the face authentication is performed by the authentication unit 7 at a necessary timing to save power.

  The storage unit 8 stores various data information including a program for executing various functions and feature image data (face image data) extracted from the user's face image. The communication unit 9 transmits / receives a signal to / from a telephone station or the like via a wireless device (not shown).

  The control unit 10 receives signals from the position input device 12, the microphone 3, the side sensor 5, the in-camera 6, the authentication unit 7, the storage unit 8, the communication unit 9 and the like of the touch panel 2, and performs various processes to perform the touch panel. 2 outputs a signal to the display device 11, the speaker 4, the storage unit 8, the communication unit 9, and the like.

  That is, in the present embodiment, the feature storage unit is configured by the storage unit 8, and the authentication control unit is configured by the control unit 10.

  Hereinafter, the user authentication processing operation in the portable terminal device having the above-described configuration will be described in detail.

  FIG. 3 is a flowchart of the user authentication processing operation executed under the control of the control unit 10. This flowchart shows the user authentication processing operation when the user or the like holds the portable terminal device once placed on a desk or the like and the display screen of the touch panel 2 disappears.

  In step S1, based on the detection signal from the side sensor 5, it is determined whether or not contact with the side sensor 5 (hereinafter referred to as side sensor input) has been detected. As a result, if detected, the process proceeds to step S2. In step S2, the in-camera 6 is driven (turned on). In step S3, the face image data captured by the in-camera 6 is sent to the authentication unit 7 for user authentication.

  In step S4, upon receiving the user authentication result by the authentication unit 7, it is determined whether or not the user authentication result is “good”. As a result, if “good”, the process proceeds to step S6, whereas if “bad”, the process proceeds to step S5. In step S5, after the display device 11 is controlled and an authentication failure process as an example of the lock-on process as described in detail below is executed, the process proceeds to step S6. In step S6, the in-camera 6 is stopped (turned off). After that, the user authentication processing operation is terminated.

In the present embodiment, the “authentication failure processing” executed in step S5 of the user authentication processing operation shown in FIG. 3 is not specified, but the “passcode input screen” display and “data access restriction” Or starting an authentication failure processing operation in which “function restriction” is set.

  FIG. 4 shows a display example of the touch panel 2 in the “authentication failure processing”. In FIG. 4A, the display screen of the touch panel 2 is simply turned off to prevent others from seeing the display contents. In FIG. 4B, a passcode input screen is displayed to request the input of a passcode. In FIG.4 (c), after displaying the message which cannot be used, the display screen is turned off. In FIG. 4D, in the icon display of the application, the “phone” and “mail” icons are painted black with respect to the normal display of FIG. In FIG. 4 (e), the “phone” and “mail” icons are deleted to limit functions.

  As described above, in the present embodiment, when the input to the side sensor 5 and the face authentication by the authentication unit 7 are combined, the portable terminal device is left on the desk without being locked. Even if the lock function is applied to another person's hand, the user authentication result is “bad” and the authentication failure process is executed. Therefore, it is possible to prevent a person other than the user from seeing the display content of the display screen of the portable terminal device or starting the application, and to ensure privacy.

  At that time, since the face authentication by the authentication unit 7 is performed when an input to the side sensor 5 occurs (when a person holds the portable terminal device), it is not necessary to always start the authentication unit 7. Thus, power consumption can be reduced.

  In the case of the user authentication processing operation shown in FIG. 3, the user authentication processing operation is performed when “side sensor input” is detected in step S1, but “touch pattern to side sensor 5” is detected in step S1. The same flowchart as in FIG. 3 can be applied also when the “change in” is detected. Here, the “change in the touch pattern on the side sensor 5” is a change in the way of touching the side sensor 5 that occurs when the operator A changes from the operator A to the operator B or when the handle is changed by the same user. is there.

  FIG. 5 is a flowchart of the touch pattern change detection process for detecting the “change in the touch pattern to the side sensor 5”. FIG. 6 shows a state in which the mobile terminal device is transferred from the operator A to the operator B. Hereinafter, the touch pattern change detection process will be described with reference to FIGS. 5 and 6.

  In step S1-1, it is determined based on the detection signal from the side sensor 5 whether a side sensor input has been detected. As a result, if detected, the process proceeds to step S1-2. In step S1-2, based on the detection signal from the side sensor 5, the touch position (A) by the operator A indicated by the arrow A in FIG. 6 (a) is stored in the work memory or the like in the storage unit 8. In step S1-3, it is determined whether or not side sensor input at the touch position (A) is continued. If it is continued, the process proceeds to step S1-4. If it is not continued, the process returns to step S1-1. In step S1-4, it is determined whether or not there is a side sensor input at a new touch position (B) other than the touch position (A). As a result, if there is, the process proceeds to step S1-5, and if not, the process returns to step S1-3.

  In this case, the new touch position (B) is a touch position by the operator B indicated by an arrow B in FIG.

  In step S1-5, it is determined whether or not the side sensor input at the touch position (A) and the touch position (B) is continued. If not continued, the process proceeds to step S1-6. On the other hand, if it is continued, it waits until it is not continued. In step S1-6, it is determined whether or not side sensor input at the touch position (A) is continued. As a result, if it is continued, the process returns to step S1-3. If it is not continued, the process proceeds to step S1-7.

  In step S1-7, it is determined whether or not side sensor input at the touch position (B) is continued. As a result, if it is continued, the process proceeds to step S1-8. If it is not continued, the process returns to step S1-1. In step S1-8, since the touch position has changed from the touch position (A) to the touch position (B), it is recognized that the operator has changed from the operator A to the operator B as shown in FIG. The After that, the touch pattern change detection process is terminated.

  Thus, since the operator of the portable terminal device has changed from the operator A to the operator B, if the steps S2 to S6 in the flowchart of the user authentication processing operation shown in FIG. It is possible to prevent the operator B from seeing the display content of the mobile terminal device and starting up the application.

  In the above description, it is assumed that the operator has changed from the operator A to the operator B, but the same applies to the case where the portable terminal device is taken away from the user A by another person B. Further, the flowchart of the touch pattern change detection process shown in FIG. 5 is not limited to the case where the operator changes strictly. For example, it may be considered that the same user changes the portable terminal device from the left hand to the right hand. However, even if it is the latter, even if it is the same user by subsequent user verification processing, it is possible to continue operation without trouble. Therefore, in the flowchart of FIG. 5, there is no particular problem even if it is not strictly distinguished whether or not the operator changes.

Second Embodiment In the first embodiment, the portable terminal device is temporarily placed on a desk or the like and the display screen of the touch panel 2 disappears. explained. The second embodiment relates to a user authentication processing operation when the portable terminal device that the user has held is removed from the hand.

  Since the configuration of the mobile terminal device in the present embodiment is the same as that in the first embodiment, the description thereof is omitted.

  FIG. 7 is a flowchart of a user authentication processing operation that is executed under the control of the control unit 10 when the user removes the portable terminal device from the hand.

  In step S11, based on the detection signal from the side sensor 5, it is determined whether or not a side sensor input has been detected. As a result, if it is not detected, the process proceeds to step S12. In step S12, it is determined whether or not the screen of the display device 11 on the touch panel 2 is in a display state (display screen is on). As a result, if the screen display is on, the process proceeds to step S13. On the other hand, if the screen display is not on, the process proceeds to step S17.

  In step S13 to step S17, in the same manner as step S2 to step S6 of the flowchart shown in FIG. 3 in the first embodiment, the driving (ON) of the in-camera 6, the user authentication, and the user authentication result are “bad”. In this case, authentication failure processing and stop (off) of the in-camera 6 are executed. However, in this user authentication processing operation, if the user authentication result is determined to be “good” in step S15, the process returns to step S12 to continue user authentication. After that, the user authentication processing operation is terminated.

  As described above, in the present embodiment, when the user removes the portable terminal device from the hand and the screen of the touch panel 2 is in the display state, the display content of the touch panel 2 is viewed by others. There is a possibility that. Therefore, in that case, priority is given to privacy protection, and user authentication by the in-camera 6 is always performed.

  However, the user authentication processing operation is immediately terminated when the user's leaving time with respect to the portable terminal device exceeds a predetermined time and the screen display of the display device 11 is not displayed. Therefore, in this embodiment, an increase in power consumption more than necessary can be suppressed.

-3rd Embodiment In the said 2nd Embodiment, the case where this portable terminal device which the user had in hand was removed from the hand was demonstrated. In the third embodiment, the user when the mobile terminal device placed on a desk or the like and the display screen of the touch panel 2 disappears displays the screen of the touch panel 2 without touching the side sensor 5. It relates to the authentication processing operation.

  Since the configuration of the mobile terminal device in the present embodiment is the same as that in the first embodiment, the description thereof is omitted.

  FIG. 8 is a flowchart of the user authentication processing operation executed under the control of the control unit 10 in the portable terminal device placed on a desk or the like and the display screen of the touch panel 2 disappears.

  In step S21, it is determined whether or not the display screen of the display device 11 on the touch panel 2 is in a display state. If the screen display is changed from the non-display state (off) to the display state (on) without touching the side sensor 5, the process proceeds to step S22.

  In steps S22 to S26, in-camera 6 driving (ON), user authentication, user authentication result pass / fail judgment, authentication, in the same manner as steps S2 to S6 of the flowchart shown in FIG. 3 in the first embodiment. Defect processing and stop (off) of the in-camera 6 are executed. After that, the user authentication processing operation is terminated.

  As described above, in the present embodiment, the mobile terminal device that is placed on a desk or the like and the display screen of the touch panel 2 disappears displays the screen of the touch panel 2 without touching the side sensor 5. In some cases, the current user is completely unknown. Therefore, in that case, user authentication by the in-camera 6 is always performed.

  As described above, when the screen of the touch panel 2 changes from the non-display state to the display state, the authentication unit 7 performs user authentication unconditionally. Bad processing can be performed to protect user privacy. Furthermore, it is not necessary to always start the authentication unit 7, and power consumption can be reduced.

  By the way, as in the case of the present embodiment, the mobile terminal device that is placed on a desk or the like and the display screen of the touch panel 2 has disappeared suddenly displays the screen of the touch panel 2 without touching the side sensor 5. For example, the following cases can be considered.

(1) When a power button (not shown) provided on the portable terminal device is pressed. The power button is an operation button (key) other than the soft keys displayed on the touch panel 2.
(2) When the touch panel 2 is touched.
(3) When an event such as an alarm occurs and the screen is automatically displayed for user notification.

  Here, in the case of the occurrence of the event (3), a flowchart of the user authentication processing operation in the “state where the display screen of the touch panel 2 disappears after being placed on a desk or the like” shown in FIG. The flowchart can be modified as follows.

  FIG. 9 is a flowchart of a user authentication processing operation that is executed under the control of the control unit 10 when a mail reception event occurs when the display screen of the touch panel 2 disappears while being placed on a desk or the like. .

  In step S31, it is determined whether an event has occurred. As a result, if it occurs, the process proceeds to step S32. In step S32, the in-camera 6 is driven. In step S33, the facial image data captured by the in-camera 6 is sent to the authentication unit 7, and user authentication is performed.

  In step S34, upon receiving the user authentication result by the authentication unit 7, it is determined whether or not the user authentication result is “good”. As a result, if “good”, the process proceeds to step S35, and if “bad”, the process proceeds to step S36. In step S35, the “authentication good state” in which the user authentication result is “good” is stored in the work memory or the like in the storage unit 8. After that, the process proceeds to step S37. In step S 36, the “authentication failure state” in which the user authentication result is “bad” is stored in the work memory or the like in the storage unit 8.

  In step S37, the in-camera 6 is stopped. In step S 38, the display screen of the touch panel 2 is turned on, and a screen corresponding to the “authentication state” stored in the work memory or the like is displayed on the display device 11. After that, the user authentication processing operation is terminated.

  FIG. 10 shows a display example of the screen displayed on the display device 11 according to the “authentication state” in step S38 in the user authentication processing operation shown in FIG. However, FIG. 10A is a screen displayed when the “authentication state” stored in the work memory or the like is the “authentication good state”. In this case, since the user is holding the portable terminal device, the received mail information is displayed as it is. FIG. 10B is a screen displayed when the “authentication state” is “authentication failure state”. In this case, since it is not the user who holds the portable terminal device, only the incoming mail is displayed and the content is not displayed.

  As described above, when the screen of the touch panel 2 is changed from the non-display state to the display state due to the occurrence of the event, the event occurrence occurs in the case of the “authentication failure state” according to the result of the user authentication by the authentication unit 7. The user's privacy can be protected by displaying only the cause of the error and not displaying the content.

  In each of the above-described embodiments, each mobile terminal device is described as being different from each other. However, it may be a different subroutine in the user authentication processing operation in one mobile terminal device.

As described above, the portable terminal device of the present invention is
Enclosure 1 and
A sensor 5 provided on the housing 1 for detecting a contact from the outside and outputting a detection signal;
An in-camera 6 built in the housing 1 for imaging the surroundings;
A feature storage unit 8 for storing feature image data of a person's face registered in advance;
An authentication unit 7 for authenticating the face imaged by the in-camera 6 based on the face image imaged by the in-camera 6 and the feature image data stored in the feature storage unit 8;
A display unit 11 for displaying display information including an icon and a message on the display screen;
An authentication control unit 10 that controls the in-camera 6 and the authentication unit 7 to authenticate an operator's face based on at least one of a detection signal from the sensor 5 and a display state of the display screen. It is characterized by having prepared.

  According to the above configuration, since the authentication unit 7 performs face authentication based on at least one of the detection signal indicating contact with the sensor 5 from the outside and the display state of the display screen, the mobile terminal device Whether the operator is a user can be confirmed when left on the desk without applying the lock function or when the user enters the other person's hand without applying the lock function. Therefore, if the result of the user's confirmation is bad, the state of the display screen is changed to a state corresponding to “recognition failure”, that is, the display screen is not displayed or a passcode input request screen is displayed. It is possible to display a message display screen that cannot be used, a function restriction screen for icons, or a display screen that displays only “incoming mail”.

  That is, according to the present invention, even if the portable terminal device is left on the desk without applying the lock function, or even if it is in the hands of another person without applying the lock function, the complicated operation is performed. In addition, it is possible to prevent a person other than the user from seeing the display content of the display screen of the portable terminal device or starting an application, and to ensure privacy.

  At this time, since the face authentication by the authentication unit 7 is performed based on at least one of the detection signal from the sensor 5 and the display state of the display screen, it is not necessary to always start the authentication unit 7 and power consumption Can be reduced.

In the portable terminal device according to the embodiment,
When the detection signal from the sensor 5 is a signal indicating contact with the sensor 5 or when the detection signal from the sensor 5 is a signal indicating that the manner of contact with the sensor 5 has changed. Authentication of the operator's face is performed.

  According to this embodiment, when the detection signal from the sensor 5 is a signal representing contact with the sensor 5, for example, the mobile phone in a state where the display screen disappears once placed on a desk or the like. When the operator holds the terminal device and the detection signal becomes a signal indicating contact with the sensor 5, authentication of the operator's face is performed. Alternatively, when the detection signal from the sensor 5 is a signal indicating that the manner of contact with the sensor 5 has changed, for example, when the operator changes from the operator A to the operator B or the same user has When the hand is changed, authentication of the operator's face is performed.

  Therefore, when the operator picks up the mobile terminal device once placed on a desk or the like and the display screen disappears, or the mobile terminal device is put into another person's hand (taken by another person) ) Even in this case, privacy can be surely protected.

In the portable terminal device according to the embodiment,
The authentication control unit 10 authenticates the operator's face when the detection signal from the sensor 5 is a signal indicating non-contact with the sensor 5 and the display screen is in a display state. It has become.

  According to this embodiment, when the detection signal from the sensor 5 is a signal indicating non-contact with the sensor 5 and the display screen is in a display state, for example, the user can connect the portable terminal device. When the user's hand is released and the display screen is in a display state, the operator's face is authenticated.

  Therefore, even when the user removes the mobile terminal device from his hand and the display screen is in the display state, privacy can be reliably protected.

In the portable terminal device according to the embodiment,
When the detection signal from the sensor 5 is a signal indicating non-contact with the sensor 5 and the display screen is changed from a non-display state to a display state, the authentication control unit 10 Authentication is to be performed.

  According to this embodiment, when the display screen changes from the non-display state to the display state, for example, the portable terminal device in a state where the display screen disappears by being placed on a desk or the like is the sensor 5 When the display screen is in a display state without touching, the operator's face is authenticated.

  Therefore, when the mobile terminal device is placed on a desk or the like and the display screen disappears, the display screen is in a display state by pressing the power button, touching the touch panel 2 or generating an event. Even if there is, we can definitely protect privacy.

In the portable terminal device according to the embodiment,
When the authentication result of the authentication unit 7 is defective, the authentication control unit 10 controls the display unit 11 to change the state of the display screen according to the authentication result. .

  According to this embodiment, when the authentication result of the authentication unit 7 is defective, the display unit 11 is controlled to change the state of the display screen according to the authentication result. It is possible to hide the screen, make it a passcode input request screen, make it a message display screen that can not be used, make it an icon function restriction screen, or make it a display screen only for `` incoming mail '' Become.

  That is, according to this embodiment, when the authentication result of the authentication unit 7 is bad, a person other than the user can view the display content of the display screen of the mobile terminal device or start the application. Can be protected and privacy can be surely protected.

1 ...
2. Touch panel,
3 ... Mic for call,
4 ... Speaker for call,
5 ... side sensor,
6 ... In-camera,
7 ... Authentication part,
8 ... Memory part,
9… Communication Department
10 ... control unit,
11 ... display device,
12: Position input device.

Claims (5)

The body,
A sensor provided on the housing for detecting a contact from the outside and outputting a detection signal;
An in-camera that is built into the housing and images the surroundings;
A feature storage unit for storing feature image data of a person's face registered in advance;
An authentication unit that performs authentication of the face imaged by the in-camera based on the face image imaged by the in-camera and the feature image data stored in the feature storage unit;
A display unit for displaying display information including an icon and a message on the display screen;
An authentication control unit that controls the in-camera and the authentication unit based on at least one of a detection signal from the sensor and a display state of the display screen to authenticate an operator's face. A portable terminal device. The mobile terminal device according to claim 1,
When the detection signal from the sensor is a signal indicating contact with the sensor, or when the detection signal from the sensor is a signal indicating that the manner of contact with the sensor has changed, A portable terminal device characterized by performing face authentication. The mobile terminal device according to claim 1,
The authentication control unit authenticates the operator's face when the detection signal from the sensor is a signal representing non-contact with the sensor and the display screen is in a display state. A mobile terminal device. The mobile terminal device according to claim 1,
The authentication control unit authenticates the operator's face when the detection signal from the sensor is a signal representing non-contact with the sensor and the display screen is changed from a non-display state to a display state. A mobile terminal device characterized in that the mobile terminal device is configured to perform. In the portable terminal device according to any one of claims 1 to 4,
When the authentication result of the authentication unit is defective, the authentication control unit controls the display unit to change the state of the display screen according to the authentication result. A portable terminal device.

Images