WO2016016997A1

WO2016016997A1 - Mobile information terminal, method for controlling mobile information terminal, and communication system

Info

Publication number: WO2016016997A1
Application number: PCT/JP2014/070216
Authority: WO
Inventors: 吉澤　和彦; 益岡　信夫; 鈴木　基之; 橋本　康宣
Original assignee: 日立マクセル株式会社
Priority date: 2014-07-31
Filing date: 2014-07-31
Publication date: 2016-02-04

Abstract

Provided is a mobile information terminal that can execute a plurality of authentication processes for releasing a function lock state in which the operations of various functions are restricted. This personal information terminal has a primary control unit that selects one authentication process from among the plurality of authentication processes, in accordance with the detected surrounding conditions of the mobile information terminal, and executes the selected authentication process.

Description

Portable information terminal, method for controlling portable information terminal, and communication system

The present invention relates to a portable information terminal, a method for controlling the portable information terminal, and a communication system.

In recent years, the spread of portable information terminals such as smartphones and tablet terminals has progressed, and many people have portable information terminals. With the evolution of hardware, portable information terminals can hold a lot of personal information. Furthermore, money transactions and various settlement processes using a portable information terminal have become possible. For this reason, when a portable information terminal is used without permission by a person other than the operator, personal information may be leaked or financial damage may occur.

In order to prevent the occurrence of such damage, it has become common to have a terminal lock function that puts the mobile information terminal into a terminal lock state in which functions that can be used are restricted. Also, it is common to have an authentication function for releasing the terminal lock state by authenticating a regular user. Many recent portable information terminals include a plurality of authentication processes required for the authentication function.

Japanese Patent Application Laid-Open No. 2007-49304 (Patent Document 1) describes “an imaging unit for photographing a subject, a feature information storage unit that preliminarily stores feature information extracted from a face image as registered feature information, Feature information is extracted from an image captured by the imaging means, and the authentication information is compared by comparing the feature information with the registered feature information, and the authentication means is controlled by controlling the imaging means and the authentication processing means. When the authentication fails in the processing, the image capturing is performed again, and the authentication processing based on the captured image is performed, thereby including a continuous authentication unit that performs a series of authentication processing. The authentication process is terminated on the condition that the extraction of the feature information has failed in the predetermined number of authentication processes ”.

Also, Patent Document 1 describes that “when the above termination condition is satisfied and the authentication process is completed, the authentication process is performed by inputting the personal identification number”.

JP 2007-49304 A

In the technique described in Patent Document 1, the authentication process based on the photographed image is executed even in an environment where the authentication process based on the photographed image cannot succeed (for example, an environment where the amount of light is insufficient). In the technique described in Patent Document 1, after the authentication process based on the photographed image fails, the authentication process based on the password input is executed again. For this reason, there is a problem in that it is troublesome to perform the authentication process based on the captured image and the authentication process based on the password.

An object of the present invention is to provide a technique for improving the usability of a portable information terminal.

The technology described in the claims is used as means for solving the above-mentioned problems.

For example, a plurality of authentication processes for releasing a function lock state in which operations of various functions are restricted can be executed, and a plurality of authentication processes can be executed according to the detected surrounding conditions of the mobile information terminal. One authentication process is selected from the authentication processes, and the selected authentication process is executed.

Among the inventions disclosed in the present application, effects obtained by typical ones will be briefly described as follows.

According to one embodiment of the present invention, it becomes possible to improve the usability of the portable information terminal.

1 is a diagram illustrating an outline of a configuration example of a communication system according to a first embodiment. 1 is a hardware configuration diagram of a portable information terminal according to Embodiment 1. FIG. 1 is a software configuration diagram of a portable information terminal according to Embodiment 1. FIG. (A) And (b) is an external view of the portable information terminal which concerns on Example 1, (a) is a front view of a portable information terminal, (b) is a rear view of a portable information terminal. 6 is a state transition diagram of the portable information terminal according to Embodiment 1. FIG. It is a figure which shows the outline | summary of the authentication processing operation | movement of the portable information terminal which concerns on Example 1. FIG. It is a figure which shows the outline | summary of the authentication processing operation | movement of the portable information terminal which concerns on Example 1. FIG. It is a figure which shows the outline | summary of the authentication processing operation | movement of the portable information terminal which concerns on Example 1. FIG. It is a figure which shows the outline | summary of the authentication process operation | movement of the portable information terminal which concerns on Example 2. FIG. It is a figure which shows the outline | summary of the authentication processing operation | movement of the portable information terminal which concerns on Example 3. FIG. It is a figure which shows the outline | summary of the authentication processing operation | movement of the portable information terminal which concerns on Example 3. FIG. It is a figure which shows the outline | summary of the authentication process operation | movement of the portable information terminal which concerns on Example 4. FIG. It is a figure which shows the outline | summary of the authentication processing operation | movement of the portable information terminal which concerns on Example 5. FIG. FIG. 10 is a diagram illustrating an outline of a configuration example of a communication system according to a sixth embodiment. It is a figure which shows the outline | summary of the structural example of the authentication server which concerns on Example 6. FIG. FIG. 10 is a software configuration diagram of a portable information terminal according to a sixth embodiment. It is a figure which shows the outline | summary of the authentication processing operation | movement of the portable information terminal which concerns on Example 6. FIG.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that components having the same function are denoted by the same reference symbols throughout the drawings for describing the embodiment, and the repetitive description thereof will be omitted.

The portable information terminal according to the first embodiment can execute a plurality of authentication processes and has an illuminance sensor that detects an illuminance level of illuminance around the portable information terminal. Then, when the illuminance level detected by the illuminance sensor is greater than or equal to a predetermined value, an authentication process based on face authentication is selected from a plurality of authentication processes. On the other hand, when the illuminance level detected by the sensor unit is less than a predetermined value, an authentication process for checking information (PIN (Personal Identification Number) code) received from the operator from a plurality of authentication processes is selected. As a result, when face authentication is possible, authentication processing by face authentication is executed, and even when face recognition is difficult, authentication processing for collating a PIN code can be selected and executed. Therefore, even in a situation where it is difficult to perform authentication processing using face authentication, it is possible to execute only authentication processing for verifying a PIN code without executing authentication processing for face authentication and authentication processing for verifying a PIN code. As a result, the usability of the portable information terminal can be improved.

[Example 1]
<System configuration>
FIG. 1 is a diagram illustrating an outline of a configuration example of a communication system according to the first embodiment. As shown in FIG. 1, the communication system includes a portable information terminal 100, an access point 200a, a mobile phone communication network base station 300b, a mobile phone communication server 300, and an application server 400.

The access point 200a, the mobile telephone communication server 300, and the application server 400 are connected to each other via the Internet 200. The Internet 200 corresponds to, for example, a broadband network.

The portable information terminal 100 is connected to the access point 200a via wireless communication. The access point 200a is connected to the Internet 200 via wireless communication or wired communication. Thereby, the portable information terminal 100 is connected to the Internet 200 via the access point 200a.

Also, the portable information terminal 100 is connected to the base station 300b of the mobile telephone communication network via wireless communication. Base station 300b is connected to mobile telephone communication server 300 via wireless communication. Mobile telephone communication server 300 is connected to the Internet 200 via wireless communication or wired communication. As a result, the portable information terminal 100 is connected to the Internet 200 via the mobile phone communication network base station 300 b and the mobile phone communication server 300. Thereby, the portable information terminal 100 transmits / receives data to / from the telephone communication server 300 and the application server 400 via the Internet 200.

The mobile telephone communication server 300 manages telephone communication (call) and data transmission / reception via the mobile telephone communication network of the portable information terminal 100.

The application server 400 stores general applications, operation programs, contents, and the like. The application server 400 also distributes various stored data. A plurality of application servers 400 may exist.

The portable information terminal 100 (for example, a mobile phone, a smartphone, or a tablet terminal) has a terminal lock function for switching to a terminal lock state in which use of various functions is restricted. Moreover, the portable information terminal 100 is provided with the authentication function which cancels | releases the terminal lock state by a terminal lock function by authenticating a regular user.

Note that the portable information terminal 100 may be a PDA (Personal Digital Assistants), a notebook PC (Personal Computer), an electronic book reader, or the like. Further, it may be a digital still camera, a video camera capable of shooting moving images, a portable game machine, or other portable digital devices.

<Hardware configuration of portable information terminal>
FIG. 2A is a hardware configuration diagram of the portable information terminal 100 according to the first embodiment. As shown in FIG. 2A, the portable information terminal 100 includes a main control unit 101, a system bus 102, a ROM 103, a RAM 104, a storage unit 110, a communication processing unit 120, an extension interface unit (in the figure, an extension interface unit). I / F unit) 124, an operation unit 130, an image processing unit 140, a sound processing unit 150, and a sensor unit 160.

The main control unit 101 is a microprocessor unit that controls the entire portable information terminal 100 in accordance with a predetermined operation program.

The system bus 102 includes operation blocks (ROM 103, RAM 104, storage unit 110, communication processing unit 120, expansion interface unit 124, operation unit 130, image processing unit 140, audio processing unit in the main control unit 101 and the portable information terminal 100. 150, a data communication path for transmitting and receiving data to and from the sensor unit 160).

A ROM (Read Only Memory) 103 is a memory in which a basic operation program such as an operating system and other operation programs are stored. For example, a rewritable ROM such as an EEPROM (Electrically Erasable Programmable ROM) or a flash ROM is used. It is done.

A RAM (Random Access Memory) 104 serves as a work area for executing a basic operation program and other operation programs.

Note that the ROM 103 and the RAM 104 may be configured integrally with the main control unit 101. Further, the ROM 103 may not use an independent configuration as shown in FIG. 2A but may use a part of the storage area of the storage unit 110.

The storage unit 110 stores operation setting values and operation programs of the portable information terminal 100. The storage unit 110 also stores personal information of the user of the portable information terminal 100, authentication information for confirming whether or not the operator of the portable information terminal 100 is a legitimate user, and the like.

In addition, the storage unit 110 stores an operation program downloaded via the Internet 200 and various data created by the operation program. Furthermore, the storage unit 110 stores content such as moving images, still images, and audio downloaded via the Internet 200.

It should be noted that some or all of the functions of the ROM 103 may be substituted with a partial area of the storage unit 110. Here, the storage unit 110 needs to hold the stored information even when power is not supplied to the portable information terminal 100 from the outside. Therefore, for example, a semiconductor element memory such as a flash ROM or SSD (Solid State Drive), or a magnetic disk drive such as an HDD (Hard Disc Drive) is used for the storage unit 110.

Also, by downloading from each server device connected via the Internet 200, each operation program stored in the ROM 103 or the storage unit 110 can be updated and function expanded.

The communication processing unit 120 includes a LAN (Local Area Network) communication unit 121, a telephone network communication unit 122, and an NFC (Near Field Communication) communication unit 123.

The LAN communication unit 121 is connected to the Internet 200 via the access point 200a. The LAN communication unit 121 transmits / receives data to / from each server device on the Internet 200. The LAN communication unit 121 and the access point 200a are connected via a wireless connection such as Wi-Fi (registered trademark).

The telephone network communication unit 122 performs telephone communication (call) and data transmission / reception by wireless communication with the base station 300b of the mobile telephone communication network.

The NFC communication unit 123 performs wireless communication when close to the corresponding reader / writer.

The LAN communication unit 121, the telephone network communication unit 122, and the NFC communication unit 123 each include a coding circuit, a decoding circuit, an antenna, and the like. The communication processing unit 120 may further include other communication units such as a BlueTooth (registered trademark) communication unit and an infrared communication unit.

The extension interface unit 124 is an interface group for extending the functions of the portable information terminal 100. In this embodiment, the extension interface unit 124 includes a video / audio interface, a USB (Universal Serial Bus) interface, a memory interface, and the like. The video / audio interface performs input of video signals / audio signals from external video / audio output devices, output of video signals / audio signals to external video / audio input devices, and the like. The USB interface is connected to a PC or the like to transmit / receive data. The USB interface may be connected to a keyboard or other USB device to transmit / receive data. The memory interface transmits and receives data by connecting a memory card and other memory media.

The operation unit 130 is an instruction input unit that receives an operation instruction input to the portable information terminal 100. In the present embodiment, the operation unit 130 includes operation keys in which a touch panel and button switches arranged on the display unit 141 are arranged. Note that the operation unit 130 may be configured with only one of a touch panel and operation keys. Further, an operation instruction input to the portable information terminal 100 may be received using a keyboard or the like connected to the extension interface unit 124. Furthermore, an input of an operation instruction for the portable information terminal 100 may be received using a separate portable information terminal device connected via wired communication or wireless communication. Further, the display unit 141 may be provided with a touch panel function.

The image processing unit 140 includes a display unit 141, an image signal processing unit 142, a first image input unit 143, and a second image input unit 144.

The display unit 141 is a display device such as a liquid crystal panel, for example, and provides the image data processed by the image signal processing unit 142 to the user of the portable information terminal 100.

The image signal processing unit 142 includes a video RAM (not shown). The display unit 141 is driven based on the image data input to the video RAM. Further, the image signal processing unit 142 performs format conversion as necessary. In addition, the image signal processing unit 142 performs a process of superimposing a menu or other OSD (On Screen Display) signal.

The first image input unit 143 and the second image input unit 144 are, for example, cameras. The first image input unit 143 and the second image input unit 144 convert the light input from the lens into an electrical signal using an electronic device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) sensor. By doing so, the image data of the periphery and the object are input.

The audio processing unit 150 includes an audio output unit 151, an audio signal processing unit 152, and an audio input unit 153.

The audio output unit 151 is a speaker, and provides the audio signal processed by the audio signal processing unit 152 to the user of the portable information terminal 100. The voice input unit 153 is a microphone, which converts a user's voice and the like into voice data and inputs the voice data.

The sensor unit 160 is a sensor group for detecting the state of the portable information terminal 100. In this embodiment, the GPS (Global Positioning System) receiving unit 161, the gyro sensor 162, the geomagnetic sensor 163, and the acceleration sensor 164 are used. And an illuminance sensor 165 and a proximity sensor 166. These sensor groups can detect the position, tilt, direction, movement, ambient illuminance, and the like of the portable information terminal 100. Note that the portable information terminal 100 may further include another sensor such as an atmospheric pressure sensor.

The main control unit 101 detects the state of the portable information terminal 100 based on the data transmitted from the sensor unit 160. The main control unit 101 selects one authentication process from a plurality of authentication processes according to the detected state of the portable information terminal 100. Then, the main control unit 101 executes the selected authentication process.

Note that the configuration example of the portable information terminal 100 shown in FIG. 2A includes a number of configurations that are not essential to the present embodiment, but even if the configuration is not provided, the effects of the present embodiment are impaired. There is no. In addition, a configuration (not shown) such as a digital broadcast receiving function and an electronic money settlement function may be further added.

<Software configuration of portable information terminal>
FIG. 2B is a software configuration diagram of the portable information terminal 100 according to the first embodiment. As shown in FIG. 2B, the ROM 103 stores a basic operation program 1001 and other operation programs. Further, the storage unit 110 stores a terminal lock control program 1002, an authentication processing program 1003, and other operation programs.

Further, the storage unit 110 has an authentication information storage area (authentication information in the figure) 1011 and various information storage areas (various information in the figure) 1019. The authentication information storage area 1011 stores authentication information for confirming whether or not the operator of the portable information terminal 100 is an authorized user. In the various information storage area 1019, other information is stored.

The main control unit 101 expands the basic operation program 1001 stored in the ROM 103 in the RAM 104. Then, the main control unit 101 executes the basic operation program 1001 expanded in the RAM 104. Thus, the basic operation execution unit 1101 is configured. In the following, in order to simplify the explanation, it is assumed that the main control unit 101 develops the basic operation program 1001 stored in the ROM 103 to the RAM 104 and executes it to control each operation block. The unit 1101 may be described as performing control of each operation block.

The main control unit 101 expands the terminal lock control program 1002 stored in the storage unit 110 in the RAM 104. Then, the main control unit 101 executes the terminal lock control program 1002 expanded in the RAM 104. Thus, the terminal lock control execution unit 1102 is configured. In the following description, the main control unit 101 performs a process for controlling each operation block by developing the terminal lock control program 1002 stored in the storage unit 110 in the RAM 104 and executing the program, and the terminal lock control execution unit 1102. However, there is a case where each operation block is controlled.

In addition, the main control unit 101 expands the authentication processing program 1003 stored in the storage unit 110 in the RAM 104. Then, the main control unit 101 executes an authentication processing program 1003 developed in the RAM 104. As a result, the authentication processing execution unit 1103 is configured. In the following, the main control unit 101 controls each operation block by expanding the authentication processing program 1003 stored in the storage unit 110 to the RAM 104 and executing it, and the authentication processing execution unit 1103 It may be described that the operation block is controlled.

The RAM 104 includes a temporary storage area 1109 that temporarily holds data created when each operation program is executed as necessary.

The terminal lock control execution unit 1102 sets the operation state of the portable information terminal 100 to a function lock state in which operations of various functions of the portable information terminal 100 are restricted, or allows the operations of various functions of the portable information terminal 100 to be permitted. Controls whether to be unlocked.

Here, the function lock state is a state in which no operation instruction other than the operation for turning on / off the mobile information terminal 100, setting and releasing the sleep mode, and releasing the function lock state is accepted. Alternatively, the function lock state is a state in which even if the operation unit 130 receives an operation instruction from the user, the main control unit 101 or the like is not performed according to the operation instruction by invalidating the operation instruction. It may be. Note that the function lock state may be allowed as appropriate for various functions that are automatically executed, such as search for access points and base stations in the power-on state, mail check, and so on. Further, the terminal lock control execution unit 1102 does not necessarily limit the operation of all functions of the portable information terminal 100 in the function lock state, and may limit only a part of the functions.

The authentication processing execution unit 1103 executes an authentication processing operation (described later, FIGS. 4A to 4C) for confirming whether or not the operator of the portable information terminal 100 is a legitimate user. In the portable information terminal 100, the authentication process execution unit 1103 can execute an authentication process based on PIN verification, an authentication process based on face recognition, and an authentication process based on voice recognition. That is, based on the control of the authentication processing execution unit 1103, the portable information terminal 100 appropriately selects one of authentication processing from PIN verification, face recognition, and voice recognition according to the situation. And perform the authentication process.

Each operation program may be stored in the ROM 103 and / or the storage unit 110 in advance at the time of product shipment. Further, after the product is shipped, it may be obtained from the other application server 400 on the Internet 200 via the LAN communication unit 121 or the telephone network communication unit 122. In addition, each operation program stored in a memory card, an optical disk, or the like may be acquired via the expansion interface unit 124 or the like.

<Overview of portable information terminal>
2C (a) and 2C (b) are external views of the portable information terminal 100 according to the first embodiment. FIG. 2C (a) is a front view of the portable information terminal 100. FIG. 2C (b) 2 is a rear view of the portable information terminal 100. FIG. In addition, the figure shows the example in case the portable information terminal 100 is a smart phone etc., and illustration is abbreviate | omitted regarding the left side surface and the right side surface, and the top | upper surface and the bottom surface.

As shown in FIGS. 2C (a) and 2C (b), the portable information terminal 100 includes a power key 130k1, a home key 130k2, a display unit 141, and a first image input unit 143 (for example, a camera). And a second image input unit 144 (for example, a camera), an audio output unit 151 (for example, a speaker), and an audio input unit 153 (for example, a microphone).

Further, as shown in FIG. 2C (a), the first image input unit 143 is located on the same plane (front surface) as the display unit 141.

Further, as shown in FIG. 2C (b), the second image input unit 144 is located on the opposite surface (rear surface) of the display unit 141.

If the second image input unit 144 is not flush with the first image input unit 143, the second image input unit 144 may be positioned other than the back surface. For example, the second image input unit 144 may be positioned on any one of the left side, the right side, the point plane, and the bottom side.

Further, the second image input unit 144 may be provided in a separate terminal. For example, the second image input unit 144 and the portable information terminal 100 may be connected to each other via wired communication or wireless communication. The portable information terminal 100 may have only one of the first image input unit 143 and the second image input unit 144. Further, when the portable information terminal 100 is a digital still camera, the appearance may be different from that in FIG. 2C.

Hereinafter, the first image input unit 143 located on the same plane as the display unit 141 may be referred to as “in camera”, and the second image input unit 144 located on the opposite side of the display unit 141 may be referred to as “out camera”. is there.

The power key 130k1 is an operation key that accepts input of turning on / off the main power of the portable information terminal 100 and setting / canceling the sleep mode.

The home key 130k2 is an operation key for receiving an input for displaying a basic screen on the display unit 141 during execution of an arbitrary application program.

<Operational state transition of portable information terminal>
FIG. 3 is a state transition diagram for explaining an example of the transition state of the operation state in the portable information terminal 100 of the present embodiment.

As shown in FIG. 3, the operating state of the portable information terminal 100 in which the terminal lock function is disabled includes the normal operation state T100 in the state in which the terminal lock function is disabled, and the terminal lock function is disabled. There are a sleep state T101 when the terminal is locked and a power-off state T102 when the terminal lock function is disabled. In addition, as an operation state of the portable information terminal 100 in which the terminal lock function is enabled, a normal operation state T110 in a state in which the terminal lock function is enabled and a sleep in a state in which the terminal lock function is enabled There are a state T111 and a power-off state T112 in a state where the terminal lock function is enabled. Furthermore, the operation state of the portable information terminal 100 includes an authentication process operation state T113 in which an authentication process is being performed.

In a state where the terminal lock function is disabled, the operation state of the portable information terminal 100 transitions from the sleep state T101 or the power-off state T102 to the normal operation state T100 without passing through the authentication processing operation state T113.

On the other hand, in the state where the terminal lock function is enabled, the operation state of the portable information terminal 100 transits from the sleep state T101 or the power-off state T102 to the normal operation state T100 via the authentication processing operation state T113.

The portable information terminal 100 receives an input for selecting whether to enable or disable the terminal lock function, for example, by operating a function setting menu.

That is, when the terminal lock function is set in the normal operation state T100 in a state where the terminal lock function is disabled, the operation state of the portable information terminal 100 is the state in which the terminal lock function is enabled. Transition to the normal operation state T110.

On the other hand, when the terminal lock function is released in the normal operation state T110 in the state where the terminal lock function is enabled, the operation state of the portable information terminal 100 is the state in which the terminal lock function is disabled. Transition to the normal operation state T100.

In the normal operation state T100 in a state where the terminal lock function is disabled, when the mobile information terminal 100 has not been operated for a predetermined time or more, the operation state of the mobile information terminal 100 is that the terminal lock function is disabled. Transition to the sleep state T101 in the state of being.

In addition, in the normal operation state T100 in a state where the terminal lock function is disabled, when an input for transition from the operator to the sleep state T101 is received, the operation state of the portable information terminal 100 is determined by the terminal lock function. Transition to the sleep state T101 in the invalidated state.

Further, in the normal operation state T100 when the terminal lock function is disabled, when an input to turn off the power is received from the operator, the operation state of the portable information terminal 100 is that the terminal lock function is disabled. Transition to the power-off state T102 in the current state.

When an input for canceling the sleep state is received from the operator in the sleep state T101 in a state where the terminal lock function is disabled, the operation state of the portable information terminal 100 is a state where the terminal lock function is disabled Transition to the normal operation state T100.

In the power-off state T102 when the terminal lock function is disabled, when an input to turn on the power is received from the operator, the operation state of the portable information terminal 100 is the state in which the terminal lock function is disabled. Transition to the normal operation state T100.

In the normal operation state T110 in a state where the terminal lock function is enabled, when a predetermined time or more has passed without the mobile information terminal 100 being operated, the operation state of the mobile information terminal 100 is that the terminal lock function is enabled. The state transits to the sleep state T111.

Further, in the normal operation state T110 in a state where the terminal lock function is enabled, when an input for transition from the operator to the sleep state T111 is received, the operation state of the portable information terminal 100 is determined by the terminal lock function. Transition to the sleep state T111 in the enabled state.

Further, in the normal operation state T110 in a state where the terminal lock function is enabled, when an input for turning off the power is received from the operator, the operation state of the portable information terminal 100 is that the terminal lock function is enabled. Transition to the power-off state T112 in the state of being present.

In the sleep state T111 in a state where the terminal lock function is enabled, when an input for canceling the sleep state is received from the operator, the operation state of the portable information terminal 100 transitions to the authentication processing operation state T113, An authentication processing operation is executed.

In the power-off state T112 in the state where the terminal lock function is enabled, when an input for power-on is received from the operator, the operation state of the portable information terminal 100 transitions to the authentication processing operation state T113, and authentication is performed. Processing operations are performed.

In the authentication processing operation in the authentication processing operation state T113, when the operator is successfully authenticated, the operation state of the portable information terminal 100 transitions to the normal operation state T110 in the state where the terminal lock function is enabled. To do. On the other hand, when the operator authentication fails, the operating state of the portable information terminal 100 transits to the sleep state T111 in a state where the terminal lock function is enabled.

<Authentication processing operation>
The portable information terminal 100 according to the present embodiment can execute a plurality of authentication processes. From the plurality of authentication processes according to the situation around the portable information terminal 100 confirmed by a sensor or the like, the state of the operator, the operation setting, and the like. One of the authentication processes is selected, and the selected authentication process is executed.

The authentication processing operation in the portable information terminal 100 according to the first embodiment is controlled by the authentication processing execution unit 1103, the terminal lock control execution unit 1102, and the basic operation execution unit 1101.

Note that the mobile information terminal 100 may further include hardware blocks that implement the same operations as the authentication processing execution unit 1103 and the terminal lock control execution unit 1102 in hardware. In that case, each hardware block executes the operation of the portable information terminal 100 in place of the authentication processing execution unit 1103 and the terminal lock control execution unit 1102.

Hereinafter, the authentication processing operation of the portable information terminal 100 according to the first embodiment will be described with reference to FIGS. 4A to 4C.

First, an authentication process operation for selecting an authentication process to be executed according to the illuminance level around the portable information terminal 100 will be described with reference to FIG. 4A.

First, in S101, the basic operation execution unit 1101 recognizes the requested function lock release request. If the basic operation executing unit 1101 does not recognize the basic unlock request in S101 (S101-No), the process proceeds to S101. On the other hand, if the basic operation executing unit 1101 recognizes the function lock release request in S101 (S101-Yes), the process proceeds to S102.

In addition, when an input for canceling the sleep state is received from the operator in the sleep state T111 in the state in which the terminal lock function is enabled (described above, FIG. 3), the basic operation executing unit 1101 instructs the sleep state cancellation. Is detected. Then, the basic operation execution unit 1101 recognizes the detected sleep state release instruction as a function lock state release request.

In addition, upon receiving an input for turning on the power from the operator in the power-off state T112 (described above, FIG. 3) in a state where the terminal lock function is enabled, the basic operation executing unit 1101 detects a power-on instruction. To do. Then, the basic operation executing unit 1101 recognizes the detected power-on instruction as a function lock state release request.

Next, in S102, the basic operation execution unit 1101 validates the illuminance sensor 165.

Next, in S103, the illuminance sensor 165 detects the illuminance around the portable information terminal 100.

Next, in S104, the basic operation execution unit 1101 determines whether the illuminance level of the illuminance detected in S103 is equal to or higher than a predetermined value. If the basic operation executing unit 1101 determines in S104 that the illuminance level is greater than or equal to a predetermined value (S104-Yes), the process proceeds to S107. On the other hand, when the basic operation executing unit 1101 determines in S104 that the illuminance level is less than the predetermined value (S104-No), the process proceeds to S105.

Next, in S105, the basic operation execution unit 1101 displays a PIN input screen on the display unit 141. Then, the operation unit 130 of the portable information terminal 100 receives an input of a numeric string (PIN code) from the operator.

Next, in S106, the PIN authentication unit 1103a of the authentication process execution unit 1103 executes an authentication process (authentication process by PIN verification) for verifying the digit string received in S105. Then, the PIN authentication unit 1103a determines whether the operator of the portable information terminal 100 is a regular user. As a result, even when the illuminance level is less than the predetermined value and face recognition is difficult, it is possible to execute an authentication process for collating the PIN code and determine whether the operator of the portable information terminal 100 is an authorized user. . After S106, the process proceeds to S109.

It should be noted that the authentication process for verifying the numeric string may be performed using a known technique, and thus detailed description thereof is omitted. For example, the PIN authentication unit 1103a determines whether or not the number string received by the operation unit 130 of the portable information terminal 100 matches the number string registered by being specified by the authorized user in the authentication information storage area 1011. Determine.

On the other hand, if Yes in S104 (when the ambient illuminance level is equal to or higher than a predetermined value and face authentication is possible), in S107, the basic operation executing unit 1101 activates the first image input unit 143 (in-camera). Enable.

Next, in S108, the face authentication unit 1103b of the authentication process execution unit 1103 executes an authentication process by face authentication. Then, the face authentication unit 1103b determines whether the operator of the portable information terminal 100 is a regular user. Note that the authentication process based on face recognition may use a known technique, and thus detailed description thereof is omitted. For example, the face authentication unit 1103b extracts feature points from the face image data of the operator of the portable information terminal 100 captured by the first image input unit 143, and the regular user registered in the authentication information storage area 1011 in advance. By confirming the degree of coincidence with the feature points of the face image data, authentication processing by face authentication is executed.

Next, in S109, it is determined whether or not the operator of the portable information terminal 100 is a legitimate user and the authentication is successful. When it is determined that the operator of the portable information terminal 100 is not an authorized user as a result of the authentication process by PIN verification in S106 or the authentication process by face authentication in S108 (S109-No), the function lock state of the portable information terminal 100 is The process returns to S101 without being canceled. On the other hand, if it is determined that the operator of the portable information terminal 100 is a legitimate user as a result of the authentication process by PIN verification in S106 or the authentication process by face authentication in S108 (S109-Yes), the process proceeds to S110.

Next, in S110, the mobile lock control execution unit 1102 releases the function lock state of the mobile information terminal 100. Then, the operating state of the portable information terminal 100 transitions from the sleep state T111 or the power-off state T112 to the normal operating state T110.

Through the above processing, the portable information terminal 100 according to the present embodiment can select the authentication processing to be executed according to the surrounding illuminance level, and can improve the usability of the portable information terminal 100. .

Note that the authentication process executed in S106 is not limited to the authentication process based on the PIN verification unless the authentication process is executed based on the image. For example, the operation unit 130 may receive an input of a password from the operator, and collate whether or not a password that has been input matches a password stored in advance. In addition, the operation unit 130 receives an input to the operation key a plurality of times, and checks whether the combination of the operation key that has received the input and the operation order matches the combination of the operation key and the operation order that are stored in advance. You may make it do.

Further, the authentication process executed in S108 is not limited to the authentication process based on face authentication. For example, when performing authentication processing based on an image captured by a camera, authentication processing based on an iris pattern, palm print authentication, or the like may be applied.

Next, a modified example of the authentication processing operation for selecting the authentication processing to be executed according to the illuminance level around the portable information terminal 100 will be described using FIG. 4B. In the authentication processing operation described with reference to FIG. 4A, when the illuminance level around the portable information terminal is insufficient, the authentication processing for verifying the PIN code is executed. 4B is different in that the display unit 141 is used as an auxiliary light source when the illuminance level around the portable information terminal 100 is insufficient. Further, when the illuminance level after using the auxiliary light source is insufficient, an authentication process for collating the PIN code is executed.

Note that S201 to S204 in FIG. 4B correspond to S101 to S104 in FIG. 4A. Further, S208 to S213 in FIG. 4B correspond to S105 to S110 in FIG. 4A. That is, the authentication processing operation of FIG. 4B differs from the authentication processing operation of FIG. 4A in that it includes the processing of S205 to S207.

First, in S201, the basic operation execution unit 1101 recognizes the requested function lock release request. In S201, if the basic operation executing unit 1101 does not recognize the basic unlock request (S201-No), the process proceeds to S201. On the other hand, if the basic operation executing unit 1101 recognizes the function lock release request in S201 (S201-Yes), the process proceeds to S202.

Next, in S202, the basic operation execution unit 1101 validates the illuminance sensor 165.

Next, in S203, the illuminance sensor 165 detects the illuminance around the portable information terminal 100.

Next, in S204, the basic operation execution unit 1101 determines whether the illuminance level of the illuminance detected in S203 is equal to or higher than a predetermined value. If the basic operation execution unit 1101 determines in S204 that the illuminance level is greater than or equal to a predetermined value (S204—Yes), the process proceeds to S208. On the other hand, if the basic operation executing unit 1101 determines in S204 that the illuminance level is less than the predetermined value (S204—No), the process proceeds to S205.

Next, in S205, the basic operation execution unit 1101 controls the display unit 141 so that the display unit 141 can be used as an auxiliary light source. For example, the basic operation execution unit 1101 changes the color of light emitted from the backlight of the display unit 141 to white. Note that the basic operation execution unit 1101 may set the luminance of the light emitted from the backlight of the display unit 141 to the maximum luminance or the luminance according to the ambient illuminance level detected in S204. The basic operation execution unit 1101 may increase the intensity of light emitted from the backlight of the display unit 141.

Next, in S206, the illuminance sensor 165 detects the illuminance around the portable information terminal 100 after the display unit 141 becomes usable as an auxiliary light source.

Next, in S207, the basic operation execution unit 1101 determines whether the illuminance level of the illuminance detected in S206 is equal to or higher than a predetermined value. If the basic operation executing unit 1101 determines in S207 that the illuminance level is greater than or equal to a predetermined value (S207—Yes), the process proceeds to S208. On the other hand, if the basic operation execution unit 1101 determines in S207 that the illuminance level is less than the predetermined value (S207—No), the process proceeds to S210.

Next, in S210, the basic operation execution unit 1101 displays a PIN input screen on the display unit 141. Then, the operation unit 130 of the portable information terminal 100 receives an input of a numeric string (PIN code) from the operator.

Next, in S211, the PIN authentication unit 1103a of the authentication process execution unit 1103 executes an authentication process (authentication process by PIN verification) for verifying the digit string received in S210. Then, the PIN authentication unit 1103a determines whether the operator of the portable information terminal 100 is a regular user. As a result, even when the illuminance level is less than the predetermined value and face recognition is difficult, it is possible to execute an authentication process for collating the PIN code and determine whether the operator of the portable information terminal 100 is an authorized user. . After S211, the process proceeds to S212.

On the other hand, if Yes in S204, or Yes in S207 (when the surrounding illuminance level is equal to or higher than a predetermined value and face authentication is possible), in S208, the basic action execution unit 1101 One image input unit 143 (in-camera) is activated.

Next, in S209, the face authentication unit 1103b of the authentication process execution unit 1103 executes an authentication process by face authentication. Then, the face authentication unit 1103b determines whether the operator of the portable information terminal 100 is a regular user. After S209, the process proceeds to S212.

Next, in S212, it is determined whether or not the operator of the portable information terminal 100 is an authorized user and the authentication has succeeded. When it is determined that the operator of the portable information terminal 100 is not a legitimate user as a result of the authentication process by PIN verification in S209 or the authentication process by face authentication in S211 (S212-No), the function lock state of the portable information terminal 100 is Return to S201 without being released. On the other hand, if it is determined that the operator of the portable information terminal 100 is a legitimate user as a result of the authentication process by PIN verification in S209 or the authentication process by face authentication in S211 (S212-Yes), the process proceeds to S213.

Next, in S213, the portable lock control execution unit 1102 releases the function lock state of the portable information terminal 100. Then, the operating state of the portable information terminal 100 transitions from the sleep state T111 or the power-off state T112 to the normal operating state T110.

It should be noted that an item such as “Use LCD monitor as auxiliary light source during authentication” is prepared in the function setting menu, etc., and when this item is set off, the authentication processing operation described in FIG. When the setting is on, the portable information terminal 100 may be controlled to execute the authentication processing operation described with reference to FIG. 4B.

Next, with reference to FIG. 4C, a modification of the authentication processing operation for selecting the authentication processing to be executed according to the illuminance level around the portable information terminal 100 will be described. In the authentication processing operation described with reference to FIG. 4A, the illuminance sensor 165 detects the illuminance around the portable information terminal 100. On the other hand, the authentication processing operation in FIG. 4C is different in that the illuminance around the portable information terminal 100 is detected using the first image input unit 143 (in-camera).

Note that S301 and S303 to S306 in FIG. 4C correspond to S101 and S103 to S106 in FIG. 4A. Further, S307 to S309 in FIG. 4C correspond to S108 to S110 in FIG. 4A.

First, in S301, the basic operation execution unit 1101 recognizes the requested function lock release request. In S301, if the basic operation executing unit 1101 does not recognize the basic unlock request (S301-No), the process proceeds to S301. On the other hand, if the basic operation executing unit 1101 recognizes the function lock release request in S301 (S301-Yes), the process proceeds to S302.

Next, in S302, the basic operation execution unit 1101 validates the first image input unit 143 (in-camera).

Next, in S303, the first image input unit 143 detects the illuminance around the portable information terminal 100 by capturing an image around the portable information terminal 100. Specifically, the first image input unit 143 calculates the average luminance of each pixel included in the captured image, and detects the calculated average luminance as the illuminance level around the portable information terminal 100.

Next, in S304, the basic operation execution unit 1101 determines whether the illuminance level of the illuminance detected in S303 is equal to or higher than a predetermined value. If the basic operation executing unit 1101 determines in S304 that the illuminance level is greater than or equal to a predetermined value (S304—Yes), the process proceeds to S307. On the other hand, when the basic operation executing unit 1101 determines in S304 that the illuminance level is less than the predetermined value (S304—No), the process proceeds to S305.

Next, in S305, the basic operation execution unit 1101 displays a PIN input screen on the display unit 141. Then, the operation unit 130 of the portable information terminal 100 receives an input of a numeric string (PIN code) from the operator.

Next, in S306, the PIN authentication unit 1103a of the authentication process execution unit 1103 executes an authentication process (authentication process by PIN verification) for verifying the digit string received in S305. Then, the PIN authentication unit 1103a determines whether the operator of the portable information terminal 100 is a regular user. As a result, even when the illuminance level is less than the predetermined value and face recognition is difficult, it is possible to execute an authentication process for collating the PIN code and determine whether the operator of the portable information terminal 100 is an authorized user. . After S306, the process proceeds to S308.

On the other hand, if Yes in S304 (when the surrounding illuminance level is equal to or higher than a predetermined value and face authentication is possible), in S307, the face authentication unit 1103b of the authentication process execution unit 1103 performs authentication processing by face authentication. Execute. Then, the face authentication unit 1103b determines whether the operator of the portable information terminal 100 is a regular user.

Next, in S308, it is determined whether or not the operator of the portable information terminal 100 is a legitimate user and the authentication is successful. When it is determined that the operator of the portable information terminal 100 is not a legitimate user as a result of the authentication process by PIN verification in S306 or the authentication process by face authentication in S307 (S308-No), the function lock state of the portable information terminal 100 is Return to S301 without being released. On the other hand, if it is determined that the operator of the portable information terminal 100 is a legitimate user as a result of the authentication process based on PIN verification in S306 or the authentication process based on face authentication in S307 (S308-Yes), the process proceeds to S309.

Next, in S309, the portable lock control execution unit 1102 releases the function lock state of the portable information terminal 100. Then, the operating state of the portable information terminal 100 transitions from the sleep state T111 or the power-off state T112 to the normal operating state T110.

Note that the terminal lock function of the present embodiment controls to accept only an operation instruction for turning on / off the mobile information terminal 100, setting / canceling the sleep mode, and releasing the function lock state. However, this is merely an example, and it may be controlled not to accept only an operation instruction related to a predetermined application. For example, the portable information terminal 100 further includes an electronic money payment function. When the function is locked, various operation functions other than the electronic money payment function are accepted as usual, and operation instructions related to the electronic money payment function are accepted. You may control so that it may not exist. Further, when the operator of the portable information terminal 100 tries to start the application of the electronic money payment function, the start instruction of the application of the electronic money payment function is recognized as a request for releasing the function lock state, and thereafter, the above-described FIG. The authentication processing operation in FIG. 4C may be performed. Also in this case, the portable information terminal 100 of the present embodiment can realize a more convenient control method that can select an authentication process to be executed according to the surrounding illuminance level.

<Effect of Example 1>
According to the first embodiment described above, one authentication process is selected from a plurality of authentication processes in accordance with the detected situation around the portable information terminal 100, and the selected authentication process is executed. The usability of 100 can be improved.

Further, when the illuminance level detected by the sensor unit 160 is a predetermined value or more, the face authentication can be accurately performed by selecting the authentication process by the face authentication from the plurality of authentication processes and executing the selected authentication process. It is possible to execute authentication processing by face authentication in a difficult situation.

Further, when the illuminance level detected by the sensor unit 160 is less than a predetermined value, an authentication process for collating information received from the operator from a plurality of authentication processes is selected, and the selected pre-proof process is executed. Thus, even when face recognition is difficult, an authentication process for collating the PIN code can be executed.

[Example 2]
The system configuration in the second embodiment, the hardware configuration of the portable information terminal 100, the software configuration, and the like are the same as those in the first embodiment. For this reason, in the following, different authentication processing operations in the second embodiment and the first embodiment will be mainly described, and descriptions of other common points will be omitted as much as possible.

Example 2 differs from Example 1 in that Example 2 selects an authentication process to be executed according to the presence or absence of a person other than the operator around the operator. In other words, in the second embodiment, when there is a person other than the operator around the portable information terminal 100, an authentication process other than the authentication process in which the operation unit 130 receives an input from the operator (for example, around the portable information terminal 100) Authentication processing that does not cause a disadvantage when the portable information terminal 100 is looked into by a person other than the operator who is present at the same time. On the other hand, when there is no person other than the operator around the portable information terminal 100, the operation unit 130 selects an authentication process for receiving input from the operator.

As a result, only when there is no person other than the operator around the portable information terminal 100 and there is no possibility that the number string input to the portable information terminal 100 is viewed by a person other than the operator. The operation unit 130 can execute an authentication process for receiving an input. Hereinafter, the authentication processing operation of the portable information terminal 100 according to the second embodiment will be described with reference to FIG.

<Authentication processing operation>
First, in S401, the basic operation executing unit 1101 recognizes the requested function lock release request. If the basic operation executing unit 1101 does not recognize the basic unlock request in S401 (S401-No), the process proceeds to S401. On the other hand, when the basic operation executing unit 1101 recognizes the function lock release request in S401 (S401-Yes), the process proceeds to S402.

Next, in S402, the basic operation execution unit 1101 validates the first image input unit 143 (in-camera).

Next, in S <b> 403, the first image input unit 143 captures an image around the portable information terminal 100. Then, the basic operation execution unit 1101 analyzes the image captured by the first image input unit 143 to detect whether a person other than the operator exists around the portable information terminal 100. For example, a known face extraction technique may be used to detect whether there is a person other than the operator around the portable information terminal 100 by analyzing the image. For example, when only one face image is extracted from the peripheral image captured by the first image input unit 143, no person other than the operator is detected. On the other hand, when two or more face images are extracted from the peripheral image captured by the first image input unit 143, the basic operation executing unit 1101 has a person other than the operator around the portable information terminal 100. Is detected.

Next, in S404, the basic operation execution unit 1101 determines whether it is detected in S403 that there is a person other than the operator around the portable information terminal 100. If the basic operation item unit 1101 determines in S404 that a person other than the operator is detected in S403 (S404-Yes), the process proceeds to S407. On the other hand, if it is determined in S404 that the basic action execution unit 1101 has not detected that there is a person other than the operator in S403 (S404-No), the process proceeds to S405.

Next, in S405, the basic operation execution unit 1101 displays a PIN input screen on the display unit 141. Then, the operation unit 130 of the portable information terminal 100 receives an input of a numeric string (PIN code) from the operator.

Next, in S406, the PIN authentication unit 1103a of the authentication process execution unit 1103 executes an authentication process (authentication process by PIN verification) for verifying the digit string received in S405. Then, the PIN authentication unit 1103a determines whether the operator of the mobile terminal 100 is a regular user. As a result, the PIN code is used only when there is no person other than the operator in the vicinity of the portable information terminal 100 and there is no possibility that the number string input to the portable information terminal 100 is viewed by a person other than the operator. Authentication processing to be verified can be executed. After S406, the process proceeds to S408.

On the other hand, if Yes in S404 (if there is a possibility that the number string input to the portable information terminal 100 may be removed by a person other than the operator existing around the portable information terminal 100), the authentication is performed in S407. The face authentication unit 1103b of the process execution unit 1103 executes authentication processing by face authentication.

Next, in S408, it is determined whether or not the operator of the portable information terminal 100 is an authorized user and the authentication has succeeded. When it is determined that the operator of the portable information terminal 100 is not a legitimate user as a result of the authentication process by PIN verification in S406 or the authentication process by face authentication in S407 (S408-No), the function lock state of the portable information terminal 100 is The process returns to S401 without being released. On the other hand, if it is determined that the operator of the portable information terminal 100 is a legitimate user as a result of the authentication process based on PIN verification in S406 or the authentication process based on face authentication in S407 (S408-Yes), the process proceeds to S409.

Next, in S409, the portable lock control execution unit 1102 releases the function lock state of the portable information terminal 100. Then, the operating state of the portable information terminal 100 transitions from the sleep state T111 or the power-off state T112 to the normal operating state T110.

Through the above processing, the portable information terminal 100 according to the present embodiment can select the authentication processing depending on whether or not a person other than the operator exists in the vicinity, and improves the usability of the portable information terminal 100. To be able to.

Note that the authentication process executed in S407 is not limited to the authentication process based on face recognition. In other words, any authentication process that does not cause a disadvantage when the portable information terminal 100 is viewed by a person other than the operator existing in the vicinity may be used. Instead of the authentication process using face authentication, for example, an authentication process based on an iris pattern may be executed in S407. In S407, an authentication process using biometric authentication (for example, an authentication process using fingerprint authentication or an authentication process using vein authentication) may be executed.

Further, the authentication process executed in S406 is not limited to the authentication process based on PIN verification. Instead of the authentication process by PIN verification, for example, an authentication process by accepting input of a password, an authentication process to authenticate whether the operation keys are operated in a predetermined order, or the like may be executed.

In S402, the operation execution unit 1101 may validate the first image input unit 143 (in-camera) and the second image input unit 144 (out-camera). In this case, in S403, the first image input unit 143 (in-camera) and the second image input unit 144 (out-camera) capture images around the portable information terminal 100, and the basic operation execution unit 1101 is captured. By analyzing the obtained image, it is detected whether a person other than the operator exists around the portable information terminal 100.

<Effect of Example 2>
According to the second embodiment described above, when a person other than the operator is detected by the sensor unit 160, an authentication process other than the authentication process for collating information received from the operator from a plurality of authentication processes is selected. To do. As a result, when a person other than the operator exists around the portable information terminal 100, it is possible to execute an authentication process that does not cause a disadvantage when the portable information terminal 100 is looked into.

[Example 3]
The system configuration in the third embodiment, the hardware configuration of the portable information terminal 100, the software configuration, and the like are the same as those in the first embodiment. For this reason, in the following, the authentication processing operation that differs between the third embodiment and the first embodiment will be mainly described, and description of other common points will be omitted as much as possible.

Example 3 is different from Example 1 in that Example 3 selects an authentication process to be executed according to the volume level of surrounding sounds. That is, in the third embodiment, when the volume level of the surrounding sound is equal to or higher than a predetermined value, an authentication process other than the authentication process based on the voice recognition is selected. On the other hand, when the volume level of the surrounding voice is less than a predetermined value, the authentication process by voice recognition is selected. As a result, authentication processing by voice recognition can be executed in a quiet environment suitable for voice recognition. Hereinafter, the authentication processing operation of the portable information terminal 100 according to the third embodiment will be described with reference to FIGS. 6A and 6B.

<Authentication processing operation>
First, with reference to FIG. 6A, an authentication processing operation for selecting an authentication process according to the volume level around the portable information terminal 100 will be described.

First, in S501, the basic operation execution unit 1101 recognizes the requested function lock release request. In S501, if the basic operation executing unit 1101 does not recognize the basic unlock request (S501-No), the process proceeds to S501. On the other hand, if the basic operation executing unit 1101 recognizes the function lock release request in S501 (S501-Yes), the process proceeds to S502.

Next, in S502, the basic operation execution unit 1101 validates the voice input unit 153 (microphone).

Next, in S503, the voice input unit 153 collects voice around the portable information terminal 100. Then, the voice input unit detects the voice level of the collected voice.

Next, in S504, the basic operation execution unit 1101 determines whether the sound level of the sound collected in S503 is less than a predetermined value. If the basic operation executing unit 1101 determines in S504 that the sound level is less than the predetermined value (S504—Yes), the process proceeds to S507. On the other hand, when the basic operation executing unit 1101 determines in S504 that the sound level is equal to or higher than the predetermined value (S504-No), the process proceeds to S505.

Next, in S505, the basic operation execution unit 1101 causes the display unit 141 to display a PIN input screen. Then, the operation unit 130 of the portable information terminal 100 receives an input of a numeric string (PIN code) from the operator.

Next, in S506, the PIN authentication unit 1103a of the authentication process execution unit 1103 executes an authentication process (authentication process by PIN verification) for verifying the digit string received in S505. Then, the PIN authentication unit 1103a determines whether the operator of the mobile terminal 100 is a regular user. As a result, even when the volume around the portable information terminal 100 is high and speech recognition is difficult, authentication processing for collating the PIN code can be performed without executing authentication processing by speech recognition. .

On the other hand, if Yes in S504 (when the volume level of the voice around the portable information terminal 100 is less than the predetermined value and authentication processing by voice recognition is possible), the voice of the authentication processing execution unit 1103 in S507. The authentication unit 1103c executes authentication processing by voice recognition. A known technique may be used for the authentication process by voice recognition. For example, the voice of the operator of the portable information terminal 100 input from the voice input unit 153 (microphone) is converted into digital data, and the converted digital data and the authentication information storage area 1011 are stored in advance. The authentication processing by voice recognition is executed by comparing the digital data of the voice of the regular user and confirming the matching degree of the pattern.

Next, in S508, it is determined whether or not the operator of the portable information terminal 100 is a regular user and the authentication has succeeded. When it is determined that the operator of the portable information terminal 100 is not a legitimate user as a result of the authentication process by PIN verification in S506 or the authentication process by voice recognition in S507 (S508-No), the function lock state of the portable information terminal 100 is Return to S501 without being released. On the other hand, if it is determined that the operator of the portable information terminal 100 is a legitimate user as a result of the authentication process by PIN verification in S506 or the authentication process by voice recognition in S507 (S508-Yes), the process proceeds to S509.

Next, in S509, the portable lock control execution unit 1102 releases the function lock state of the portable information terminal 100. Then, the operating state of the portable information terminal 100 transitions from the sleep state T111 or the power-off state T112 to the normal operating state T110.

Through the above process, the portable information terminal 100 according to the present embodiment can select the authentication process according to the volume level of surrounding sounds, and can improve the usability of the portable information terminal 100. .

Note that the authentication process executed in S506 is not limited to the authentication process by voice recognition. That is, what is necessary is just to perform an authentication process based on the audio | voice data of the audio | voice collected with the microphone. For example, in S506, voiceprint authentication or authentication processing for comparing the degree of coincidence with a predetermined music as a key sound may be executed.

Also, the authentication process executed in S506 may not be an authentication process based on voice authentication. For example, instead of the authentication process by PIN verification, an authentication process by accepting an input of a password or an authentication process for authenticating whether the operation keys are operated in a predetermined order may be executed in S506.

Next, a modified example of the authentication processing operation for selecting the authentication processing to be executed in accordance with the volume level around the portable information terminal 100 will be described using FIG. 6B. 6A, in the authentication processing operation in FIG. 6B, only when the operation setting state of the portable information terminal 100 is not the manner mode setting state in which the manner mode (silent mode) is set. It is different in that the voice input unit 153 (microphone) is activated and sounds around the portable information terminal 100 are collected.

Note that the manner mode means a mode in which when an incoming call or mail is received, an incoming call is not output and the operator is notified by operating a vibrator or the like. The manner mode is mainly set in a place that is not suitable for outputting sound.

Further, S601 and S603 to S610 in FIG. 6B correspond to S501 to S509 in FIG. 6A. That is, the authentication processing operation of FIG. 6B differs from the authentication processing operation of FIG. 6A in that it includes the processing of S602.

First, in S601, the basic operation executing unit 1101 recognizes the requested function lock release request. In S601, when the basic operation executing unit 1101 does not recognize the basic unlock request (S601-No), the process proceeds to S601. On the other hand, if the basic operation executing unit 1101 recognizes the function lock release request in S601 (S601-Yes), the process proceeds to S602.

Next, in S602, the basic operation execution unit 1101 refers to the setting value of the function setting menu to determine whether the operation setting state of the portable information terminal 100 is the manner mode setting state. If the basic operation executing unit 1101 determines in S602 that the operation setting state of the portable information terminal 100 is the manner mode setting state (S602-On), the process proceeds to S606. On the other hand, if the basic operation executing unit 1101 determines in S602 that the operation setting state of the portable information terminal 100 is not the manner mode setting state (S602-Off), the process proceeds to S603.

Next, in S603, the basic operation execution unit 1101 activates the voice input unit 153 (microphone).

Next, in S604, the voice input unit 153 collects the voice around the portable information terminal 100. Then, the voice input unit detects the voice level of the collected voice.

Next, in S605, the basic operation execution unit 1101 determines whether the sound level of the sound collected in S604 is less than a predetermined value. If the basic operation execution unit 1101 determines in S605 that the audio level is less than the predetermined value (S605-Yes), the process proceeds to S608. On the other hand, if the basic operation executing unit 1101 determines in S605 that the sound level is equal to or higher than the predetermined value (S605-No), the process proceeds to S606.

Next, in S606, the basic operation execution unit 1101 causes the display unit 141 to display a PIN input screen. Then, the operation unit 130 of the portable information terminal 100 receives an input of a numeric string (PIN code) from the operator.

Next, in S607, the PIN authentication unit 1103a of the authentication process execution unit 1103 executes an authentication process (authentication process by PIN verification) for verifying the number string received in S606. Then, the PIN authentication unit 1103a determines whether the operator of the mobile terminal 100 is a regular user.

On the other hand, if Yes in S605 (when the volume level of the sound around the portable information terminal 100 is less than the predetermined value and authentication processing by voice recognition is possible), the voice of the authentication processing execution unit 1103 in S608. The authentication unit 1103c executes authentication processing by voice recognition.

Next, in S609, it is determined whether or not the operator of the portable information terminal 100 is an authorized user and the authentication has succeeded. When it is determined that the operator of the portable information terminal 100 is not a legitimate user as a result of the authentication process by PIN verification in S607 or the authentication process by voice recognition in S608 (S609-No), the function lock state of the portable information terminal 100 is Return to S601 without being released. On the other hand, if it is determined that the operator of the portable information terminal 100 is a legitimate user as a result of the authentication process based on PIN verification in S607 or the authentication process based on voice recognition in S608 (S609-Yes), the process proceeds to S610.

Next, in S610, the portable lock control execution unit 1102 releases the function lock state of the portable information terminal 100. Then, the operating state of the portable information terminal 100 transitions from the sleep state T111 or the power-off state T112 to the normal operating state T110.

As described above, when it is determined in S602 that the operation setting state of the portable information terminal 100 is the manner mode setting state, the processing of S606 to S608 is performed without performing the processing of S603 to S605. That is, when the operation setting state of the portable information terminal 100 is set to the manner mode, it is determined that the portable information terminal 100 is present in a place that is not suitable for emitting sound, and the volume around the portable information terminal 100 is determined. Regardless of the level, authentication processing by PIN verification is selected.

That is, the portable information terminal 100 according to the present embodiment selects an authentication process to be executed according to the surrounding sound volume level and the manner mode setting state (operation setting state) of the portable information terminal 100. As a result, it is possible to select an authentication process other than the authentication process based on the voice recognition at a place that is not suitable for producing a voice, and the usability of the portable information terminal 100 can be improved.

<Effect of Example 3>
According to the third embodiment described above, when the sound volume level detected by the sensor unit 160 is less than a predetermined value, the authentication process by voice is selected from a plurality of authentication processes, and the selected authentication process is executed. It becomes possible to execute authentication processing by voice recognition in a quiet environment suitable for voice recognition.

Further, when the volume level detected by the sensor unit 160 is equal to or higher than a predetermined value, an authentication process for collating information received from an operator from a plurality of authentication processes is selected and the selected authentication process is executed. Thus, in a noisy environment that is not suitable for voice recognition, authentication processing by PIN verification can be executed without executing authentication processing by voice recognition.

Further, when the operation setting state of the portable information terminal 100 is the manner mode, an authentication process other than the voice authentication process is selected from a plurality of authentication processes, and the selected authentication process is executed, so that it is suitable for emitting a voice. In an environment where no authentication is performed, it is possible to select an authentication process other than the authentication process based on the voice recognition without executing the authentication process based on the voice recognition.

[Example 4]
The system configuration in the fourth embodiment, the hardware configuration of the portable information terminal 100, the software configuration, and the like are the same as those in the first embodiment. For this reason, in the following, authentication processing operations that are different between the fourth embodiment and the first embodiment will be mainly described, and descriptions of other common points will be omitted as much as possible.

The fourth embodiment is different from the first embodiment in that the fourth embodiment performs an authentication process that is executed depending on whether or not the operator holding the portable information terminal 100 is moving (for example, walking). It is a point to choose. Here, when the operator holding the portable information terminal 100 is moving, it is not preferable for the operator to perform an operation while gazing at the operation unit 130 or the like of the portable information terminal 100. For this reason, in the fourth embodiment, when the operator is moving, an authentication process based on voice recognition is selected. On the other hand, when the operator is not moving, an authentication process for checking the PIN code is selected.

This allows the moving operator to input authentication information while confirming the direction of travel. In addition, the moving operator can be prevented from walking while gazing at the operation unit 130 of the portable information terminal 100 or the like. Hereinafter, the authentication processing operation of the portable information terminal 100 according to the fourth embodiment will be described with reference to FIG.

<Authentication processing operation>
First, in S701, the basic operation execution unit 1101 recognizes the requested function lock release request. In S701, if the basic operation executing unit 1101 does not recognize the basic unlock request (S701-No), the process proceeds to S701. On the other hand, if the basic operation executing unit 1101 recognizes the function lock release request in S701 (S701-Yes), the process proceeds to S702.

Next, in S702, the basic operation execution unit 1101 enables the gyro sensor 162 and the acceleration sensor 164.

Next, in S703, the gyro sensor 162 detects the attitude of the portable information terminal 100. The acceleration sensor 164 detects the acceleration of the mobile phone terminal 100.

Next, in S704, the basic motion execution unit 1101 is moving the operator holding the portable information terminal 100 based on the attitude (inclination) and acceleration of the portable information terminal 100 detected in S703 (for example, , During walking). If the basic operation executing unit 1101 determines in S704 that the operator is moving (Yes in S704), the process proceeds to S707. On the other hand, if the basic operation executing unit 1101 determines in S704 that the operator is not moving (S704-No), the process proceeds to S705. A known technique is used to determine whether the operator is moving. For example, by comparing the inclination and acceleration of the portable information terminal 100 detected from the gyro sensor 162 and the acceleration sensor 164 every predetermined time with the inclination and acceleration patterns during walking stored in advance, It is determined whether the operator is moving.

Next, in S705, the basic operation executing unit 1101 displays a PIN input screen on the display unit 141. Then, the operation unit 130 of the portable information terminal 100 receives an input of a numeric string (PIN code) from the operator.

Next, in S706, the PIN authentication unit 1103a of the authentication process execution unit 1103 executes an authentication process (authentication process by PIN verification) for verifying the digit string received in S705. Then, the PIN authentication unit 1103a determines whether the operator of the mobile terminal 100 is a regular user.

On the other hand, if Yes in S704 (when the operator is moving and authentication processing by voice recognition is suitable), in S707, the voice authentication unit 1103c of the authentication processing execution unit 1103 performs authentication by voice recognition. Execute the process.

Next, in S708, it is determined whether or not the operator of the portable information terminal 100 is an authorized user and the authentication has succeeded. When it is determined that the operator of the portable information terminal 100 is not a legitimate user as a result of the authentication process by PIN verification in S706 or the authentication process by voice recognition in S707 (S708-No), the function lock state of the portable information terminal 100 is Return to S701 without being released. On the other hand, if it is determined that the operator of the portable information terminal 100 is a legitimate user as a result of the authentication process by PIN verification in S706 or the authentication process by voice recognition in S707 (S708-Yes), the process proceeds to S709.

Next, in S709, the portable lock control execution unit 1102 releases the function lock state of the portable information terminal 100. Then, the operating state of the portable information terminal 100 transitions from the sleep state T111 or the power-off state T112 to the normal operating state T110.

Through the above processing, the portable information terminal 100 according to the present embodiment can select an authentication process to be executed depending on whether or not the operator is moving, thereby improving the usability of the portable information terminal 100. become able to.

Note that the authentication process executed in S706 is not limited to the authentication process by voice recognition. That is, what is necessary is just to perform an authentication process based on the audio | voice data of the audio | voice collected with the microphone. For example, in S706, voice print authentication or authentication processing for comparing the degree of coincidence using a predetermined music as a key sound may be executed.

Also, the authentication process executed in S706 may not be an authentication process based on voice authentication. Instead of the authentication process by PIN verification, for example, an authentication process by accepting input of a password, an authentication process to authenticate whether the operation keys are operated in a predetermined order, or the like may be executed.

This makes it possible to select an authentication process to be executed depending on whether the operator is moving or not, and improve the usability of the portable information terminal 100.

<Effect of Example 4>
According to the fourth embodiment described above, when the operator is moving, by selecting a voice authentication process from a plurality of authentication processes and executing the selected authentication process, the moving operator It is possible to suppress operation while gazing at the operation unit 130 of the portable information terminal 100.

[Example 5]
The system configuration in the fifth embodiment, the hardware configuration of the portable information terminal 100, the software configuration, and the like are the same as those in the first embodiment. For this reason, in the following, different authentication processing operations in the fifth embodiment and the first embodiment will be mainly described, and descriptions of other common points will be omitted as much as possible.

The fifth embodiment is different from the first embodiment in that the PIN code is collated in the fifth embodiment when the illuminance level around the portable information terminal 100 is insufficient and the volume level of the surrounding voice is equal to or higher than a predetermined value. The authentication process to be performed is selected. This makes it possible to select an authentication process to be executed according to the surrounding illuminance level and the surrounding volume level.

<Authentication processing operation>
First, in S801, the basic operation execution unit 1101 recognizes the requested function lock release request. In S801, if the basic operation executing unit 1101 does not recognize the basic unlock request (S801-No), the process proceeds to S801. On the other hand, if the basic operation executing unit 1101 recognizes the function lock release request in S801 (S801-Yes), the process proceeds to S802.

Next, in S802, the basic operation execution unit 1101 enables the illuminance sensor 165.

Next, in S803, the illuminance sensor 165 detects the illuminance around the portable information terminal 100.

Next, in S804, the basic operation execution unit 1101 determines whether the illuminance level of the illuminance detected in S803 is a predetermined value or more. If the basic operation executing unit 1101 determines in S804 that the illuminance level is greater than or equal to a predetermined value (S804-Yes), the process proceeds to S810. On the other hand, if the basic operation executing unit 1101 determines in S804 that the illuminance level is less than the predetermined value (No in S804), the process proceeds to S805.

Next, in S805, the basic operation execution unit 1101 activates the voice input unit 153 (microphone).

Next, in S806, the voice input unit 153 collects the voice around the portable information terminal 100. Then, the voice input unit detects the voice level of the collected voice.

Next, in S807, the basic operation execution unit 1101 determines whether the sound level of the sound collected in S806 is less than a predetermined value. If the basic operation executing unit 1101 determines in S807 that the sound level is less than the predetermined value (S807—Yes), the process proceeds to S812. On the other hand, if the basic operation executing unit 1101 determines in S807 that the sound level is equal to or higher than the predetermined value (S807-No), the process proceeds to S808.

Next, in S808, the basic operation execution unit 1101 causes the display unit 141 to display a PIN input screen. Then, the operation unit 130 of the portable information terminal 100 receives an input of a numeric string (PIN code) from the operator.

Next, in S809, the PIN authentication unit 1103a of the authentication process execution unit 1103 executes an authentication process (authentication process by PIN verification) for verifying the digit string received in S805. Then, the PIN authentication unit 1103a determines whether the operator of the mobile terminal 100 is a regular user. After S809, the process proceeds to S813.

If Yes in S804 (if the ambient illuminance level is greater than or equal to a predetermined value and face authentication is possible), in S810, the basic action execution unit 1101 validates the first image input unit 143 (in-camera). To do.

Next, in S811, the face authentication unit 1103b of the authentication processing execution unit 1103 executes authentication processing by face authentication. Then, the face authentication unit 1103b determines whether the operator of the portable information terminal 100 is a regular user. After S811, the process proceeds to S813.

If Yes in S807 (if the volume level of the voice around the portable information terminal 100 is less than the predetermined value and authentication processing by voice recognition is possible), the voice authentication unit of the authentication processing execution unit 1103 in S812 1103c executes an authentication process by voice recognition.

Next, in S813, it is determined whether or not the operator of the portable information terminal 100 is a regular user and the authentication has succeeded. If it is determined that the operator of the portable information terminal 100 is not an authorized user as a result of the authentication process based on PIN verification in S808, the authentication process based on face authentication in S811 or the authentication process based on voice recognition in S812 (S813-No) The function lock state of the information terminal 100 is returned to S801 without being released. On the other hand, when it is determined that the operator of the portable information terminal 100 is an authorized user as a result of the authentication process based on PIN verification in S808, the authentication process based on face authentication in S811 or the authentication process based on voice recognition in S812 (S813-Yes) ), Go to S814.

Next, in S814, the portable lock control execution unit 1102 releases the function lock state of the portable information terminal 100. Then, the operating state of the portable information terminal 100 transitions from the sleep state T111 or the power-off state T112 to the normal operating state T110.

Through the above processing, the portable information terminal 100 according to the present embodiment can select the authentication process according to the surrounding illuminance level and the surrounding volume level, and can improve the usability of the portable information terminal 100. It becomes like this.

The fifth embodiment is a combination of the authentication processing operation of the first embodiment (described above, FIG. 4A) and the authentication processing operation of the third embodiment (described above, FIG. 6A). The authentication processing operation processes of the first to fifth embodiments may be appropriately combined.

In the authentication processing operation according to the fifth embodiment, as the priority of selection of each authentication process, first, the selection of the authentication process based on the face recognition is considered, then the selection of the authentication process based on the voice recognition is considered, and finally the PIN is selected. We are considering authentication processing by verification. However, the priority of selection is merely an example, and selection of each authentication process may be considered with different priorities.

In addition, when an authentication process with a low priority is selected according to a detection result of a sensor or the like included in the portable information terminal 100, the reason why the authentication process with a high priority is not selected is displayed on the display unit 141 or the like. Anyway. Alternatively, when a predetermined authentication process is selected according to a detection result of a sensor or the like included in the portable information terminal 100, the reason why the selected authentication process is selected may be displayed on the display unit 141 or the like. . In this way, usability of the portable information terminal 100 can be further improved.

Further, the portable information terminal 100 may be controlled so that an authentication process not exemplified in the first to fifth embodiments is appropriately selected. For example, the portable information terminal 100 is controlled so that a suitable authentication process according to the situation around the portable information terminal 100 or the state of the operator is appropriately selected according to the detection result of the sensor or the like included in the portable information terminal 100. You may make it do.

<Effect of Example 5>
According to the fifth embodiment described above, when the illuminance level around the portable information terminal 100 is insufficient and the volume level of the surrounding sound is equal to or higher than a predetermined value, the authentication process for collating the PIN code is selected. By executing the selected authentication process, the authentication process according to the surrounding illuminance level and the surrounding sound volume level can be executed.

[Example 6]
The system configuration, the hardware configuration of the portable information terminal 100, the software configuration, etc. in the sixth embodiment are the same as those in the first embodiment unless otherwise specified. Therefore, in the following, authentication processing operations that are different between the sixth embodiment and the first embodiment will be mainly described, and description of other common points will be omitted as much as possible.

The sixth embodiment is different from the first embodiment in that the sixth embodiment includes an authentication server 500 that receives authentication information transmitted from the portable information terminal 100 and performs authentication processing based on the received authentication information. is there. As a result, authentication processing based on a vast amount of information stored in the authentication server 500 is possible, and the accuracy of the authentication processing can be improved.

<System configuration>
FIG. 9 is a diagram illustrating an outline of a configuration example of a communication system according to the sixth embodiment. As shown in FIG. 9, the communication system includes a portable information terminal 100, an access point 200a, a mobile phone communication network base station 300b, a mobile phone communication server 300, an application server 400, and an authentication server 500. And have.

The authentication server 500 is connected to the Internet 200 via wireless communication or wired communication. The authentication server 500 transmits / receives data to / from the portable information terminal 100 via the Internet 200.

The portable information terminal 100 transmits authentication information necessary for the authentication processing operation to the authentication server 500 via the Internet 200. The authentication server 500 receives the authentication information transmitted from the portable information terminal 100, and performs an authentication process based on the received authentication information.

Specifically, the authentication server 500 transmits authentication information for authentication processing by PIN verification, authentication information for authentication processing by face recognition, and authentication information for authentication processing by voice recognition transmitted from the portable information terminal 100. And verify the received authentication information.

<Configuration of authentication server>
FIG. 10 is a diagram illustrating an outline of a configuration example of the authentication server according to the sixth embodiment. As illustrated in FIG. 10, the authentication server 500 includes a main control unit 501, a RAM 504, a storage unit 510, and a LAN communication unit 521.

The main control unit 501, the RAM 504, the storage unit 510, and the LAN communication unit 521 are connected to each other via the system bus 502.

The main control unit 501 is a microprocessor unit that controls the entire authentication server 500 in accordance with a predetermined operation program.

The system bus 502 is a data communication path for transmitting and receiving data between the main control unit 501 and each operation block (RAM 504, storage unit 510, LAN communication unit 521) in the authentication server 500.

The LAN communication unit 521 includes a coding circuit, a decoding circuit, and the like. The LAN communication unit 521 is connected to the Internet 200 and executes a process for receiving authentication information from the portable information terminal 100 and a process for transmitting an authentication result to the portable information terminal 100.

The RAM 504 serves as a work area when the basic operation program and other operation programs are executed. Note that the RAM 504 may be configured integrally with the main control unit 101.

The storage unit 510 stores a basic operation program 5001 and an authentication processing program 5002. The authentication information storage area 5011 of the storage unit 510 stores authentication information for confirming whether or not the operator of the portable information terminal 100 is an authorized user. The main control unit 501 expands the basic operation program 5001 and the authentication processing program 5002 stored in the storage unit 510 in the RAM 504. Then, the main control unit 101 executes the basic operation program 5001 expanded in the RAM 504. Thus, a basic operation execution unit 5101 is configured.

Further, the main control unit 501 expands the authentication processing program 5002 stored in the storage unit 510 in the RAM 504. Then, the main control unit 101 executes the authentication processing program 5002 expanded in the RAM 504. As a result, an authentication processing execution unit 5102 is configured. In the following description, the authentication processing execution unit 5102 performs processing for controlling each operation block by the main control unit 501 expanding and executing the authentication processing program 5002 stored in the storage unit 510 in the RAM 504. It may be described that each operation block is controlled.

The authentication processing execution unit 5102 performs an authentication processing operation (described later, FIG. 12) for confirming whether or not the operator of the mobile information terminal 100 is an authorized user based on the authentication information received from the mobile information terminal 100. Execute.

Authentication information for authentication processing by PIN verification, authentication information for authentication processing by face recognition, authentication information for authentication processing by voice recognition, and authentication information storage area 5011 transmitted from the portable information terminal 100 are stored. Check the authentication information. That is, the authentication server 500 performs an authentication process by referring to the authentication information storage area 5011 according to the type of authentication information transmitted from the portable information terminal 100.

Note that each operation program stored in the storage unit 510 can be updated and expanded in function.

Further, each operation program may be stored in the storage unit 510 in advance. Alternatively, it may be acquired from another application server 400 on the Internet 200 via the LAN communication unit 521. In addition, each operation program stored in a memory card, an optical disk, or the like may be acquired via an extension interface unit (not shown).

<Software configuration of portable information terminal>
FIG. 11 is a software configuration diagram of the portable information terminal 100 according to the sixth embodiment. As shown in FIG. 11, the ROM 103 stores a basic operation program 1001 and other operation programs. Further, the storage unit 110 stores a terminal lock control program 1002, an authentication data transmission / reception program 1004, and other operation programs. Further, the storage unit 110 has various information storage areas (various information in the figure) 1019 in which other information is stored.

The main control unit 101 expands the basic operation program 1001 stored in the ROM 103 in the RAM 104. Then, the main control unit 101 executes the basic operation program 1001 expanded in the RAM 104. Thus, the basic operation execution unit 1101 is configured.

The main control unit 101 expands the terminal lock control program 1002 stored in the storage unit 110 in the RAM 104. Then, the main control unit 101 executes the terminal lock control program 1002 expanded in the RAM 104. Thus, the terminal lock control execution unit 1102 is configured.

The main control unit 101 expands the authentication data transmission / reception program 1004 stored in the storage unit 110 in the RAM 104. Then, the main control unit 101 executes the authentication data transmission / reception program 1004 expanded in the RAM 104. Thus, the authentication data transmission / reception execution unit 1104 is configured. In the following description, the main control unit 101 performs processing for controlling each operation block by expanding and executing the authentication data transmission / reception program 1004 stored in the storage unit 110 in the RAM 104 and executing the authentication data transmission / reception execution unit 1104. However, there is a case where each operation block is controlled.

The authentication data transmission / reception execution unit 1104 executes processing for transmitting authentication information necessary for the authentication server 500 to check whether or not the operator of the portable information terminal 100 is a legitimate user. Further, the authentication data transmission / reception execution unit 1104 executes processing for receiving an authentication result transmitted from the authentication server 500.

<Authentication processing operation>
The communication system according to the sixth embodiment includes a plurality of authentication processes, and any one of a plurality of authentication processes is selected according to the surrounding conditions of the portable information terminal 100 confirmed by a sensor or the like, the state of the operator, the operation setting, and the like. A process is selected, and authentication information corresponding to the selected authentication process is acquired. Then, the portable information terminal 100 transmits the acquired authentication information to the authentication server 500 and causes the authentication server 500 to perform an authentication process.

Further, the authentication processing operation according to the sixth embodiment includes the authentication data transmission / reception execution unit 1104, the terminal lock control execution unit 1102, and the basic operation execution unit 1101 of the portable information terminal 100 illustrated in FIG. Control is performed by an authentication processing execution unit 5102 and a basic operation execution unit 5151 of the authentication server 500 shown in FIG.

Note that the portable information terminal 100 may further include hardware blocks that implement operations equivalent to those of the authentication data transmission / reception execution unit 1104 and the terminal lock control execution unit 1102 in hardware. In that case, each hardware block executes the operation of the portable information terminal 100 in place of the authentication data transmission / reception execution unit 1104 and the terminal lock control execution unit 1102.

Hereinafter, the authentication processing operation according to the sixth embodiment will be described with reference to FIG. In the authentication processing operation shown in FIG. 12, the authentication processing to be executed is selected according to the illuminance level around portable information terminal 100.

First, in S901, the basic operation execution unit 1101 recognizes the requested function lock release request. In S901, if the basic operation executing unit 1101 does not recognize the basic unlock request (S901-No), the process proceeds to S901. On the other hand, if the basic operation executing unit 1101 recognizes the function lock release request in S901 (S901-Yes), the process proceeds to S902.

Next, in S902, the basic operation execution unit 1101 enables the illuminance sensor 165.

Next, in S903, the illuminance sensor 165 detects the illuminance around the portable information terminal 100.

Next, in step S904, the basic operation execution unit 1101 determines whether the illuminance level of the illuminance detected in step S903 is greater than or equal to a predetermined value. If the basic operation executing unit 1101 determines in S904 that the illuminance level is greater than or equal to a predetermined value (S904-Yes), the process proceeds to S907. On the other hand, if the basic operation executing unit 1101 determines in S904 that the illuminance level is less than the predetermined value (No in S904), the process proceeds to S905.

Next, in S905, the basic operation executing unit 1101 displays a PIN input screen on the display unit 141.

Next, in S906, the operation unit 130 of the portable information terminal 100 receives an input of a numeric string (PIN code) from the operator.

On the other hand, if Yes in S904 (when the surrounding illuminance level is equal to or higher than the predetermined value and face authentication is possible), in S907, the basic operation executing unit 1101 sets the first image input unit 143 (in-camera). Activate.

Next, in S908, the first image input unit 143 images the face image of the operator.

Next, in S909, the authentication data transmission / reception execution unit 1104 transmits the authentication information to the authentication server 500. Specifically, the authentication data transmission / reception execution unit 1104 transmits to the authentication server 500 the number string received in S906 or the face image data captured in S908.

Next, in S910, the LAN communication unit 521 of the authentication server 500 receives the authentication information transmitted in S909. Then, the authentication processing execution unit 5102 to the authentication server 500 executes an authentication process based on the received authentication information.

Here, when the authentication information transmitted in S909 is a character string that has been input in S906, the authentication process execution unit 5102 executes an authentication process (authentication process by PIN verification) for verifying a numeric string. Then, the authentication processing execution unit 5102 determines whether the operator of the portable information terminal 100 is a regular user.

On the other hand, when the authentication information transmitted in S909 is the face image data imaged in S908, the authentication process execution unit 5102 executes an authentication process based on face authentication. Then, the authentication processing execution unit 5102 determines whether the operator of the portable information terminal 100 is a regular user.

Next, in S911, the LAN communication unit 521 of the authentication process execution unit 5102 transmits the result of the authentication process executed in S910 to the portable information terminal 100.

Next, in S912, the basic operation execution unit 1101 determines whether or not the authentication is successful based on the authentication result transmitted in S911. If the basic operation execution unit 1101 determines that the authentication is not successful and the operator of the portable information terminal 100 is not a regular user in S912 (S912-No), the function lock state of the portable information terminal 100 is released. Instead, the process returns to S901. On the other hand, if the basic operation executing unit 1101 determines in S912 that the operator of the portable information terminal 100 is an authorized user (S912-Yes), the process proceeds to S913.

Next, in S913, the portable lock control execution unit 1102 releases the function lock state of the portable information terminal 100. Then, the operating state of the portable information terminal 100 transitions from the sleep state T111 or the power-off state T112 to the normal operating state T110.

Note that the authentication processing operation shown in FIG. 12 is realized by the mobile information terminal 100 and the authentication server 500 constituting the communication system, which are equivalent to the authentication processing operation shown in FIG. 4A described above. Then, processing equivalent to the other authentication processing operations described in the first to fifth embodiments may be realized by the portable information terminal 100 and the authentication server 500 constituting the communication system of the sixth embodiment.

Further, the authentication process executed in S906 is not limited to the authentication process based on the PIN verification unless the authentication process is executed based on the image. For example, the operation unit 130 may receive an input of a password from the operator, and collate whether or not a password that has been input matches a password stored in advance. In addition, the operation unit 130 receives an input to the operation key a plurality of times, and checks whether the combination of the operation key that has received the input and the operation order matches the combination of the operation key and the operation order that are stored in advance. You may make it do.

Further, the authentication process executed in S908 is not limited to the authentication process by face authentication. For example, when performing authentication processing based on an image captured by a camera, authentication processing based on an iris pattern, palm print authentication, or the like may be applied.

The software described above may be stored in advance in the ROM 103 or the storage unit 110 of the portable information terminal 100 at the time of product shipment. Further, after the product is shipped, it may be obtained from the other application server 400 on the Internet 200 via the LAN communication unit 121 or the telephone network communication unit 122. In addition, each operation program stored in a memory card, an optical disk, or the like may be acquired via the expansion interface unit 124 or the like.

<Effect of Example 6>
According to the sixth embodiment described above, the authentication server 500 receives the transmitted authentication information and collates the received authentication information, thereby enabling an authentication process based on a vast amount of information accumulated in the authentication server 500. Thus, the accuracy of the authentication process can be improved.

The embodiment of the present invention has been specifically described with reference to Examples 1 to 6. However, the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the present invention. Needless to say, it can be changed. For example, a part of the configuration of one embodiment may be replaced with the configuration of another embodiment. Further, the configuration of another embodiment may be added to the configuration of a certain embodiment. These all belong to the category of the present invention.

In addition, numerical values and messages appearing in sentences and drawings are merely examples, and different ones may be applied.

Moreover, the portable information terminal includes all portable information terminals of various forms such as a smartphone in addition to the tablet terminal.

Also, the functions and the like of the present invention described above may be realized by hardware by designing a part or all of them with, for example, an integrated circuit. Alternatively, the microprocessor unit or the like may be realized by software by interpreting and executing a program that realizes each function or the like. Moreover, you may use hardware and software together.

Also, the control lines and information lines shown in the figure are those that are considered necessary for the explanation, and not all control lines and information lines on the product are necessarily shown. And you may comprise so that all the structures may be mutually connected.

DESCRIPTION OF SYMBOLS 100 ... Portable information terminal, 101 ... Main control part, 102 ... System bus, 103 ... ROM, 104 ... RAM, 110 ... Storage part, 120 ... Communication processing part, 121 ... LAN communication part, 122 ... Mobile telephone network communication part , 123 ... NFC communication unit, 124 ... expansion interface unit, 130 ... operation unit, 140 ... image processing unit, 141 ... display unit, 142 ... image signal processing unit, 143 ... first image input unit, 144 ... second image input 150: Audio processing unit, 151 ... Audio output unit, 152 ... Audio signal processing unit, 153 ... Audio input unit, 160 ... Sensor unit, 161 ... GPS reception unit, 162 ... Gyro sensor, 163 ... Geomagnetic sensor, 164 ... Acceleration sensor, 165... Illuminance sensor, 166.

Claims

A portable information terminal capable of executing a plurality of authentication processes for releasing a function lock state in which operations of various functions are restricted,
A portable information terminal comprising: a main control unit that selects one authentication process from a plurality of the authentication processes according to a detected situation around the portable information terminal and executes the selected authentication process.
A portable information terminal capable of executing a plurality of authentication processes for releasing a function lock state in which operations of various functions are restricted,
One of a plurality of authentication processes is selected according to at least one of the detected situation around the portable information terminal, the state of the operator who operates the portable information terminal, and the operation setting state of the portable information terminal. A portable information terminal comprising: a main control unit that selects one authentication process and executes the selected authentication process.
The portable information terminal according to claim 2,
A sensor unit for detecting an illuminance level of illuminance around the portable information terminal;
The portable information terminal can execute authentication processing by face authentication,
The main control unit, when the illuminance level detected by the sensor unit is a predetermined value or more, selects the authentication process by the face authentication from a plurality of the authentication processes, and executes the selected authentication process.
Mobile information terminal.
The portable information terminal according to claim 2,
A sensor unit for detecting an illuminance level of illuminance around the portable information terminal;
The portable information terminal can execute an authentication process for collating information received from an operator,
When the illuminance level detected by the sensor unit is less than a predetermined value, the main control unit selects and selects an authentication process for collating information received from the operator from a plurality of the authentication processes. Execute the authentication process,
Mobile information terminal.
The portable information terminal according to claim 2,
A sensor unit for detecting a person other than the operator around the portable information terminal;
The portable information terminal can execute an authentication process for collating information received from an operator,
The main control unit selects the authentication process other than the authentication process for collating information received from the operator from a plurality of the authentication processes when a person other than the operator is detected by the sensor unit. And execute the selected authentication process,
Mobile information terminal.
The portable information terminal according to claim 2,
A sensor unit for detecting a volume level of sound around the portable information terminal;
The portable information terminal is capable of executing voice authentication processing,
The main control unit, when the volume level detected by the sensor unit is less than a predetermined value, selects the authentication process by voice from a plurality of the authentication process, and executes the selected authentication process;
Mobile information terminal.
The portable information terminal according to claim 2,
A sensor unit for detecting a volume level of sound around the portable information terminal;
The portable information terminal can execute an authentication process for collating information received from an operator,
The main control unit selects and selects an authentication process for collating information received from the operator from a plurality of the authentication processes when the volume level detected by the sensor unit is a predetermined value or more. Execute the authentication process,
Mobile information terminal.
The portable information terminal according to claim 2,
The portable information terminal is capable of executing voice authentication processing,
The main control unit selects an authentication process other than the voice authentication process from a plurality of the authentication processes when the operation setting state of the portable information terminal is a manner mode, and executes the selected authentication process.
Mobile information terminal.
The portable information terminal according to claim 2,
A sensor unit that detects at least one of the attitude and acceleration of the portable information terminal;
The portable information terminal is capable of executing voice authentication processing,
The main control unit determines whether the operator of the portable information terminal is moving based on at least one of the posture and the acceleration detected by the sensor unit, and the operator When it is determined that the user is moving, the voice authentication process is selected from a plurality of the authentication processes, and the selected authentication process is executed.
Mobile information terminal.
A method for controlling a portable information terminal capable of executing a plurality of authentication processes for releasing a function lock state in which operations of various functions are restricted,
An authentication process selection step in which the main control unit selects one of the authentication processes from a plurality of the authentication processes according to the surrounding situation of the mobile information terminal that has been issued;
An authentication process execution step in which the main control unit executes the selected authentication process;
A method for controlling a portable information terminal.
A method for controlling a portable information terminal capable of executing a plurality of authentication processes for releasing a function lock state in which operations of various functions are restricted,
The main control unit has a plurality of states according to at least one of the detected situation around the portable information terminal, the state of the operator who operates the portable information terminal, and the operation setting state of the portable information terminal. An authentication process selection step of selecting one of the authentication processes from the authentication process;
An authentication process execution step in which the main control unit executes the selected authentication process;
A method for controlling a portable information terminal.
In the control method of the portable information terminal according to claim 11,
The sensor unit further includes a detection step of detecting an illuminance level of illuminance around the portable information terminal,
In the authentication process selection step, when the illuminance level detected in the detection step is a predetermined value or more, the main control unit selects an authentication process by face authentication from a plurality of the authentication processes.
Control method of portable information terminal.
In the control method of the portable information terminal according to claim 11,
The sensor unit further includes a detection step of detecting an illuminance level of illuminance around the portable information terminal,
In the authentication process selection step, when the illuminance level detected in the detection step is less than a predetermined value, the main control unit collates information received from an operator from a plurality of authentication processes. Select the authentication process,
Control method of portable information terminal.
In the control method of the portable information terminal according to claim 11,
The sensor unit further includes a detection step of detecting a person other than the operator around the portable information terminal,
The authentication process selection step includes an authentication process in which the main control unit collates information received from an operator from a plurality of the authentication processes when a person other than the operator is detected in the detection step. Choose an authentication process other than
Control method of portable information terminal.
In the control method of the portable information terminal according to claim 11,
The sensor unit further includes a detection step of detecting a volume level of sound around the portable information terminal,
In the authentication process selection step, when the volume level detected in the detection step is less than a predetermined value, the main control unit selects a voice authentication process from a plurality of the authentication processes.
Control method of portable information terminal.
In the control method of the portable information terminal according to claim 11,
The sensor unit further includes a detection step of detecting a volume level of sound around the portable information terminal,
In the authentication process selection step, the main control unit performs authentication for collating information received from an operator from a plurality of authentication processes when the volume level detected in the detection step is equal to or higher than a predetermined value. Select a treatment,
Control method of portable information terminal.
In the control method of the portable information terminal according to claim 11,
In the authentication process selection step, when the operation setting state of the portable information terminal is a manner mode, the main control unit selects an authentication process other than a voice authentication process from the plurality of authentication processes, and selects the selected authentication process. Execute authentication process,
Mobile information terminal.
In the control method of the portable information terminal according to claim 11,
A detection step in which the sensor unit detects at least one of an attitude and acceleration of the portable information terminal;
A determination step of determining whether or not the operator of the portable information terminal is moving based on the information detected in the detection step;
Further comprising
In the authentication process selection step, when the main control unit determines that the operator is moving, the voice authentication process is selected from a plurality of the authentication processes.
Control method of portable information terminal.
A communication system having an authentication server capable of executing a plurality of authentication processes for releasing a function lock state in which operations of various functions are restricted, and a portable information terminal connected to the authentication server via a network,
The portable information terminal
A main control unit that selects one authentication process from a plurality of the authentication processes according to the detected situation around the portable information terminal;
A communication processing unit that transmits authentication information corresponding to the authentication processing selected by the main control unit to the authentication server;
Have
The authentication server is
Receiving the transmitted authentication information and verifying the received authentication information;
Communications system.