JP2021036460A - Calling method for portable information terminal - Google Patents

Abstract

To provide a portable information terminal which offers improved input operation functions through effective use of hardware resources, and a control method therefor.SOLUTION: A portable information terminal is provided, comprising a first input unit, a second input unit disposed at a position different from the first input unit, and a control unit configured to execute one process using a first input signal entered from the first input unit and a second input signal entered from the second input unit.SELECTED DRAWING: None

Description

The present invention relates to a mobile information terminal and a control method thereof.

Mobile information terminals such as smart phones and tablet terminals are becoming widespread. As an example of such an input unit of a personal digital assistant, Patent Document 1 states that "the bezel arranged around the touch screen of the tablet terminal is provided with a physical characteristic structure that can be perceived by touch. When the touch sensor detects a touch operation in the characteristic structure of the above, a predefined input can be performed (summary excerpt). ”The configuration is disclosed.

Japanese Unexamined Patent Publication No. 2016-126363

In the tablet terminal of Patent Document 1, the touch screen and the bezel are used independently. Mobile information terminals, including tablet terminals, have restrictions on the size of the housing from the viewpoint of ensuring portability, and the number of input units cannot be increased unnecessarily. Therefore, users can efficiently use a limited number of input units. There is a fact that there is a need for ingenuity to further improve convenience.

The present invention has been made in view of the above circumstances, and is to provide a technique for improving an input operation function by effectively utilizing hardware resources in a mobile information terminal.

As a means for solving the above-mentioned problems, the technique described in the claims is used.

To give an example, the portable information terminal includes a first input unit, a second input unit provided at a position different from the first input unit, a first input signal input from the first input unit, and a first input signal. It is characterized by including a control unit that executes one process using the second input signal input from the second input unit.

By using the technique of the present invention, it is possible to provide a technique for improving the function of input operation by effectively utilizing hardware resources in a mobile information terminal. Issues, configurations, and effects other than those described above will be clarified by the following description of the embodiments.

The hardware configuration diagram of the mobile information terminal of the first embodiment. The front appearance view of the mobile information terminal of 1st Embodiment. The rear view of the mobile information terminal of the first embodiment. The software configuration diagram of the mobile information terminal of the first embodiment. The operation state transition diagram of the mobile information terminal of the first embodiment. The flowchart of the user authentication processing of the mobile information terminal of 1st Embodiment. The screen display figure of the PIN input screen at the time of the user authentication processing of 1st Embodiment. The conceptual diagram of the PIN input operation at the time of the user authentication processing of 1st Embodiment. The flowchart of the user authentication processing of the mobile information terminal of 1st Embodiment. The screen display figure of the PIN input screen at the time of the user authentication processing of 1st Embodiment. The conceptual diagram of the PIN input operation at the time of the user authentication processing of 1st Embodiment. A side view of the mobile information terminal of the first embodiment. The front appearance view of the mobile information terminal of 1st Embodiment. The flowchart of the user authentication process of the mobile information terminal of the 2nd Embodiment. The conceptual diagram of the PIN input operation at the time of the user authentication processing of 2nd Embodiment. The conceptual diagram of the PIN input operation at the time of the user authentication processing of 2nd Embodiment. The screen display figure of the character input screen at the time of the character input processing of the 3rd Embodiment. The flowchart of the character input processing of the mobile information terminal of the 3rd Embodiment. The conceptual diagram of the character input operation at the time of the character input processing of the 3rd Embodiment. The conceptual diagram of the character input operation at the time of the character input processing of the 3rd Embodiment. The conceptual diagram of the character input operation at the time of the character input processing of the 3rd Embodiment. The hardware configuration diagram of the mobile information terminal of the fourth embodiment. The front view of the mobile information terminal of the 4th embodiment. The side view of the mobile information terminal of the 4th embodiment. The system block diagram of the communication system including the mobile information terminal of 4th Embodiment. The software configuration diagram of the mobile information terminal of the 4th embodiment. The flowchart of the call processing of the mobile information terminal of the 4th embodiment. The flowchart of the call processing of the mobile information terminal of the 4th embodiment. The screen display figure of the SIM selection screen at the time of the initial setting of 4th Embodiment. The screen display figure of the basic screen of 4th Embodiment. The screen display figure of the call function screen of 4th Embodiment.

Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings.

<First Embodiment>
The present embodiment relates to a mobile information terminal that executes one process by using two input signals from a plurality of input units (first input unit and second input unit) when performing an input operation of the mobile information terminal. As one of the merits of using the input signals from a plurality of input units, in the first embodiment, the validity / invalidity of the acquisition of the input signals from the first input unit is controlled by the input signals from the second input unit. Can be given.

In general, a mobile information terminal can store a large amount of personal information, and also has functions such as money transactions and various payment processes. Therefore, if the mobile information terminal is used without the permission of a third party, personal information leakage damage or financial damage may occur. In order to prevent the damage, the mobile information terminal is provided with a terminal lock function for limiting the terminal function and a user authentication function for authenticating a legitimate user who can set / release the terminal lock function.

As the user authentication processing method, a face authentication method, a fingerprint authentication method, a PIN (Personal Identification Number) input method, a password input method, a pattern input method, and the like are often adopted. Comparing the above methods, the face authentication method and the fingerprint authentication method are excellent in terms of security, but are disadvantageous in terms of cost such as many false authentications and omissions of authentication and the need for dedicated hardware. On the other hand, the PIN input method, password input method, and pattern input method are simple, there are few false authentications and omissions of authentication, and smartphones and tablet terminals equipped with a keyboard and touch screen in advance do not require dedicated hardware. Excellent in terms of cost. However, there is a risk that these confidential information will be revealed to a third party by being snooped when entering the PIN code, password, or pattern.

Therefore, in the first embodiment, the validity / invalidity of the input operation of the first input unit is controlled by the input signal of the second input unit to perform one process, for example, the PIN code input process, so that the first input unit can be used. Even if the input operation is peeped, the PIN code input process cannot be performed only by reproducing the peeped input operation, thereby improving the security. Hereinafter, the first embodiment will be described in detail.

The mobile information terminal 100 according to the present embodiment includes a terminal lock function that appropriately restricts the use of various terminal functions and a user authentication function that authenticates a legitimate user who can set / release the terminal lock function. The mobile information terminal 100 may be a mobile phone, a smart phone, a tablet terminal, or the like. It may be a PDA (Personal Digital Assistants), a notebook PC (Personal Computer), an electronic book reader, or the like. Further, it may be a digital still camera, a video camera capable of shooting a moving image, a portable game machine, or other digital device.

[Hardware configuration example of mobile information terminal]
FIG. 1A is a hardware configuration diagram showing an example of the internal configuration of the mobile information terminal 100. The mobile information terminal 100 includes a main control unit 101, a system bus 102, a ROM 103, a RAM 104, a storage unit 110, an operation input unit 120, an image processing unit 130, a voice processing unit 140, a sensor unit 150, a communication unit 160, and an extended interface unit. Consists of including 170.

The main control unit 101 is a microprocessor unit that controls the entire mobile information terminal 100 according to a predetermined operation program. The system bus 102 is a data communication path for transmitting and receiving various commands and data between the main control unit 101 and each operation block in the personal digital assistant 100.

The ROM (Read Only Memory) 103 is a memory in which a basic operation program such as an operating system and other operation programs (applications, the same applies hereinafter) are stored, and is rewritten as, for example, an EEPROM (Electrically Erasable Program ROM) or a flash ROM. A possible ROM is used. The RAM (Random Access Memory) 104 serves as a work area for executing a basic operation program and other operation programs. The ROM 103 and the RAM 104 may be integrated with the main control unit 101. Further, the ROM 103 may not have an independent configuration as shown in FIG. 1A, but may use a partial storage area in the storage unit 110.

The storage unit 110 stores the operation program and operation setting value of the mobile information terminal 100, the personal information and authentication information of the user of the mobile information terminal 100, and the like. In addition, it is possible to store an operation program downloaded from the network and various data created by the operation program. In addition, contents such as moving images, still images, and sounds downloaded from the network can be stored. A part of the function of the ROM 103 may be replaced by a part of the storage unit 110. Further, the storage unit 110 needs to hold the stored information even when the mobile information terminal 100 is not supplied with power from the outside. Therefore, for example, a device such as a semiconductor element memory such as a flash ROM or SSD (Solid State Drive), a magnetic disk drive such as an HDD (Hard Disk Drive), or the like is used.

The operation programs stored in the ROM 103 and the storage unit 110 can be updated and expanded in function by a download process from each server device on the network.

The operation input unit 120 is an instruction input unit for inputting an operation instruction to the mobile information terminal 100. The operation input unit 120 includes an operation key 121 in which button switches and the like are arranged, a touch sensor 122 that detects that a user's finger touches based on a change in capacitance, and a touch panel 123 that is superposed on the display unit 131. Consists of. Other operating devices may be further provided. The mobile information terminal 100 may be operated by using a keyboard or the like connected to the extended interface unit 170. The mobile information terminal 100 may be operated by using a separate mobile terminal device connected by wired communication or wireless communication.

The image processing unit 130 includes a display unit 131, an image signal processing unit 132, a first image input unit 133, and a second image input unit 134. The display unit 131 is a display device such as a liquid crystal panel, and provides the image data processed by the image signal processing unit 132 to the user of the mobile information terminal 100. The image signal processing unit 132 includes a video RAM (not shown). The display unit 131 is driven based on the image data input to the video RAM. Further, the image signal processing unit 132 has a function of performing decoding processing of a coded video signal, format conversion processing, superimposition processing of menus and other OSD (On Screen Display) signals, and the like, if necessary. The first image input unit 133 and the second image input unit 134 convert the light input from the lens into an electric signal by using an electronic device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Sensor) sensor. , A camera unit that inputs image data of surroundings and objects.

The voice processing unit 140 includes a voice output unit 141, a voice signal processing unit 144, and a voice input unit 145. The voice output unit 141 is a speaker, and provides the user of the mobile information terminal 100 with the voice signal processed by the voice signal processing unit 144. In particular, the monaural speaker 142 outputs monaural sound during a voice call or the like, and the stereo speaker 143 outputs stereo sound during music reproduction or the like. The audio signal processing unit 144 has a function of decoding a coded audio signal and the like, if necessary. The voice input unit 145 is a microphone, which converts a user's voice or the like into voice data and inputs it.

The sensor unit 150 is a group of sensors for detecting the state of the mobile information terminal 100. The sensor unit 150 includes a GPS (Global Positioning System) receiving unit 151, a gyro sensor 152, a geomagnetic sensor 153, an acceleration sensor 154, an illuminance sensor 155, and a proximity sensor 156. With these sensor groups, it is possible to detect the position, tilt, direction, movement, ambient brightness, proximity status of surrounding objects, and the like of the portable information terminal 100. Further, the portable information terminal 100 may further include other sensors such as a barometric pressure sensor.

The communication unit 160 includes a LAN (Local Area Network) communication unit 161, a telephone network communication unit 162, and an NFC (Near Field Communication) unit 163. The LAN communication unit 161 is connected to a network such as the Internet via an access point or the like, and transmits / receives data to / from each server device on the network. The connection with the access point or the like may be made by a wireless connection such as Wi-Fi (registered trademark). The telephone network communication unit 162 performs telephone communication (call) and data transmission / reception by wireless communication with a base station or the like of a mobile telephone communication network. Communication with the base station or the like may be performed by a W-CDMA (Wideband Code Division Multiple Access) (registered trademark) method, an LTE (Long Term Evolution) method, or the like. The NFC unit 163 performs wireless communication when it is in close proximity to the corresponding reader / writer. The LAN communication unit 161, the telephone network communication unit 162, and the NFC unit 163 each include a coding circuit, a decoding circuit, an antenna, and the like. Further, the communication unit 160 may further include other communication units such as a Bluetooth (registered trademark) communication unit and an infrared communication unit.

The extended interface unit 170 is a group of interfaces for expanding the functions of the mobile information terminal 100. The extended interface unit 170 includes a video / audio interface, a USB (Universal Serial Bus) interface, a memory interface, and the like. The video / audio interface inputs video / audio signals from an external video / audio output device, outputs video / audio signals to an external video / audio input device, and the like. The USB interface connects to a PC or the like to send and receive data. You may also connect a keyboard or other USB device. The memory interface connects a memory card or other memory medium to send and receive data.

The configuration example of the mobile information terminal 100 shown in FIG. 1A includes many configurations that are not essential to the present embodiment, but even if these configurations are not provided, the effect of the present embodiment is impaired. There is no. Further, configurations (not shown) such as a digital broadcast reception function and an electronic money payment function may be further added.

[Example of appearance of mobile information terminal]
FIG. 1B is a front external view showing an example of the appearance of the mobile information terminal 100. FIG. 1C is a rear external view showing an example of the appearance of the mobile information terminal 100. Note that the figure shows an example of a front (front) view and a back (back) view of the mobile information terminal 100 when the mobile information terminal 100 is a smartphone or the like, and the left and right side surfaces, the top and bottom, etc. are shown. Is omitted.

An operation indicator 124, a first image input unit 133, a monaural speaker 142, and a touch screen 180 are provided on the front surface of the mobile information terminal 100. The operation indicator 124 notifies the operation state of the mobile information terminal 100 depending on whether or not the LED is lit / blinking. The touch screen 180 includes a touch panel 123 and a display unit 131. A touch sensor 122, a second image input unit 134, an auxiliary light emitter 135, and a stereo speaker 143 are provided on the back surface of the mobile information terminal 100. The auxiliary light emitter 135 can emit auxiliary light for compensating for the insufficient amount of light when inputting an image from the second image input unit 134. A power key 121p, which is one of the operation keys 121, is provided on the upper surface of the mobile information terminal 100. A voice input unit 145 and a μ-USB input unit 170u, which is one of the extended interface units 170, are provided on the lower surface of the mobile information terminal 100.

As shown in the figure, the first image input unit 133 is arranged on the front surface, and the second image input unit 134 is arranged on the back surface which is a surface different from the first image input unit 133. Hereinafter, the first image input unit 133 may be referred to as an “in-camera” and the second image input unit 134 may be referred to as an “out-camera”.

In this example, the touch sensor 122 is provided on the back surface, but the installation position of the touch sensor 122 is not limited to the back surface, and is different from the touch screen 180 at a position different from that of the touch screen 180, for example, the left and right sides, the top and bottom, and the front surface. It may be a part.

[Software configuration example of mobile information terminal]
FIG. 1D is a software configuration diagram of the mobile information terminal 100, and shows an example of the software configuration in the storage unit 110 (or ROM 103, the same applies hereinafter) and the RAM 104. The storage unit 110 stores a basic operation program 1001, a lock control program 1002, a user authentication program 1003, and other operation programs 1009. Further, the storage unit 110 includes an authentication information storage area 1011 for storing the authentication information of the user of the mobile information terminal 100, and various information storage areas 1019 for storing other information.

The basic operation program 1001 stored in the storage unit 110 is expanded in the RAM 104, and the main control unit 101 further executes the expanded basic operation program to form the basic operation unit 1101. Similarly, the lock control program 1002, the user authentication program 1003, and the other operation programs 1009 are expanded in the RAM 104, respectively, and the main control unit 101 executes each of the expanded operation programs to execute the lock control unit 1102 and the user. It constitutes the authentication unit 1103 and other operation units 1109. Further, the RAM 104 includes a temporary storage area 1200 that temporarily stores the data created at the time of executing each operation program as needed.

In the following, in order to simplify the explanation, the main control unit 101 basically expands the basic operation program 1001 stored in the storage unit 110 into the RAM 104 and executes it to control each operation block. It is described as assuming that the operation unit 1101 controls each operation block. The same description is made for other operation programs.

The lock control unit 1102 sets the operating state of the mobile information terminal 100 to a function lock state in which the operation of various functions of the mobile information terminal 100 is restricted, or the operation of various functions of the mobile information terminal 100 is permitted. It mainly controls whether to unlock the state. The function lock state accepts operation instructions of power on / off of the mobile information terminal 100, on / off of sleep operation, and user authentication processing for releasing the function lock state, and accepts other operation instructions. Indicates no state. However, functions automatically executed by the terminal system, such as searching for access points and base stations and checking emails, may be allowed as appropriate. Further, even in the function-locked state, the operation of substantially all the functions of the mobile information terminal 100 is not necessarily restricted, and only some of the functions may be restricted.

The user authentication unit 1103 mainly controls the user authentication process for confirming whether or not the operator of the mobile information terminal 100 is a legitimate user. In the present embodiment, the user authentication unit 1103 controls PIN verification as a user authentication process. Other authentication methods such as password verification and pattern verification may be used to perform user authentication processing by instructing an operation on the touch screen.

The operation programs may be stored in the storage unit 110 and / or the ROM 103 in advance at the time of product shipment. After the product is shipped, it may be acquired from each server device on the network via the LAN communication unit 161 or the telephone network communication unit 162 or the like. Further, each of the operation programs stored in the memory card, the optical disk, or the like may be acquired via the expansion interface unit 170 or the like.

[Example of operating state transition of mobile information terminal]
FIG. 2 is an operation state transition diagram illustrating an example of the transition state of the operation state of the mobile information terminal 100.

The mobile information terminal 100 can set (enable) / cancel (disable) the terminal lock function by operating instructions for the function menu or the like. That is, according to the operation instruction for setting / releasing the terminal lock function, the mobile information terminal 100 has a normal operation state T100 in a state where the terminal lock function is disabled and a normal operation in a state where the terminal lock function is enabled. The state T110 can be switched. At this time, the user authentication process may be requested.

Further, in the state where the terminal lock function is disabled, the mobile information terminal 100 in the normal operating state T100 sleeps when a predetermined time or more has elapsed without any operation or when the operator instructs the transition to the sleep state. Transition to the state T101. Further, when the operator instructs the power off in the normal operation state T100 or the sleep state T101, the mobile information terminal 100 transitions to the power off state T102. When the operator instructs the sleep state T101 to release the sleep state, or when the operator instructs the power on in the power off state T102, the mobile information terminal 100 transitions to the normal operation state T100.

On the other hand, in the state where the terminal lock function is enabled, the mobile information terminal 100 in the normal operating state T110 sleeps when a predetermined time or more has elapsed without any operation or when the operator instructs the transition to the sleep state. Transition to the state T111. Further, when the operator instructs the power off in the normal operation state T110 or the sleep state T111, the mobile information terminal 100 transitions to the power off state T112. When the operator instructs the sleep state T111 to release the sleep state, or when the operator instructs the power on in the power off state T112, the mobile information terminal 100 executes the user authentication process (T113). When the operator is successfully authenticated in the user authentication process (T113), the mobile information terminal 100 transitions to the normal operating state T110. If the operator authentication fails in the user authentication process (T113), the mobile information terminal 100 transitions to the sleep state T111.

[Operation control example 1 of user authentication processing]
Hereinafter, an operation control example of the user authentication process of the mobile information terminal 100 will be described.

In the mobile information terminal 100, as a user authentication process, a multi-digit number string obtained by continuously touching (selecting) the numbers on the number keyboard displayed on the touch screen 180 is a preset number string of authentication information. The PIN input method that authenticates the user based on whether or not they match is executed. Further, the personal digital assistant 100 controls whether the touch operation to the numbers on the number keyboard is valid or invalid according to the contact state of the fingers with the touch sensor 122.

FIG. 3A is a flowchart of an example of the user authentication process by the PIN input method.

When the user gives an instruction to wake up from sleep in the sleep state T111, or when the user gives an instruction to turn on the power in the power off state T112, the user authentication unit 1103 first displays the touch screen 180 (display unit 131). The PIN input screen 180a is displayed (S101). Subsequently, it is confirmed whether or not the user touches the touch screen 180 (touch panel 123) (S102). If there is no touch operation on the touch screen 180 (S103: No), the process returns to the process of S102. If there is a touch operation on the touch screen 180 (S103: Yes), the process proceeds to S104. Even if there is a touch operation on the touch screen 180, if the touch operation is on an area other than the numerical keyboard area 180a1 described later, the process returns to the process of S102.

Next, the contact state of the user's finger with the touch sensor 122 is confirmed (S104). When the user's finger is not in contact with the touch sensor 122 (S105: No), the user's touch operation in the process of S102 is set to "invalid", and the process returns to the process of S102. When the user's finger is in contact with the touch sensor 122 (S105: Yes), the user's touch operation in the process of S102 is set to "valid", and the number touched by the user is stored in the temporary storage area 1200 (S106).

Next, the user authentication unit 1103 confirms the number of characters in the number string stored in the temporary storage area 1200 (S107). If the number of characters in the number string confirmed in the process of S107 does not match the number of characters of the authentication information set in advance by the user and stored in the authentication information storage area 1011 (S108: No), the process returns to the process of S102. When the number of characters in the number string confirmed in the process of S107 matches the number of characters of the authentication information set in advance by the user and stored in the authentication information storage area 1011 (S108: Yes), the process proceeds to the process of S109.

In the process of S109, the user authentication unit 1103 compares the numerical string stored in the temporary storage area 1200 with the authentication information preset by the user and stored in the authentication information storage area 1011 and compares the result with the lock control unit. It is transmitted to 1102 (S109).

The lock control unit 1102 matches the number string stored in the temporary storage area 1200 with the authentication information stored in the authentication information storage area 1011 preset by the user according to the transmitted comparison result (S110). : Yes), as the authentication is successful, the operating state of the mobile information terminal 100 is changed to the normal operating state T110 (S111). If the number string stored in the temporary storage area 1200 and the authentication information set in advance by the user and stored in the authentication information storage area 1011 do not match (S110: No), the operation state of the mobile information terminal 100 is regarded as an authentication failure. Is returned to the sleep state T111 (S112).

FIG. 3B is a screen display diagram of an example of the PIN input screen displayed by the processing of the flowchart shown in FIG. 3A.

The PIN input screen 180a includes a numeric keyboard area 180a1, an input result display area 180a2, and other information display areas 180a3. The numeric keyboard area 180a1 is an effective area for touch operation during PIN input. The input result display area 180a2 is an area for displaying the result of the user's touch operation on the numeric keyboard area 180a1. When the user touches the numeric keyboard area 180a1, characters such as "." Are displayed to notify that the mobile information terminal 100 has received the user's operation instruction. The other information display area 180a3 is an area for displaying general information such as time information and weather information. Characters such as "・" displayed in the input result display area 180a2 are displayed regardless of whether the touch operation of the user in the processing of S102 is valid or invalid (or whether or not the user's finger touches in the processing of S104). You can do it. Further, it may be displayed only when it is valid (or there is contact with fingers).

FIG. 3C is an operation conceptual diagram of an example of the operation flow of the user authentication process by the PIN input method in the flowchart shown in FIG. 3A.

As shown in the figure, the user touching the touch screen 180 is performed in the order of "1", "8", "2", "9", "3", and "4". Further, when the user touches the touch screen 180 and touches "1", "2", "3", and "4", the user's finger is in contact with the touch sensor 122. It is assumed that the user's finger does not touch the touch sensor 122 during the touch operation of "8" and "9". In this case, among the user's touch operations on the touch screen 180, the touch operations on "1", "2", "3", and "4" are "valid", and the above-mentioned numbers are stored in the temporary storage area 1200. It will be remembered. It should be noted that the storage of the numbers in the temporary storage area 1200 is performed by appending (stacking) instead of overwriting.

When the authentication information preset by the user and stored in the authentication information storage area 1011 is a 4-digit number string, the touch-operated number "4" is stored in the temporary storage area 1200 and stored in the temporary storage area 1200. When the number of characters in the stored number string reaches four digits, the number string is compared.

As described above, the mobile information terminal 100 accepts the PIN code input operation by using both the contact with the touch screen 180 and the contact with the touch sensor 122 in combination. As a result, it is possible to control the operation of the user authentication process by the PIN input method to enable or disable the user's touch operation on the touch screen 180 according to the contact state of the user's finger on the touch sensor 122. is there. Therefore, even when a third party looks into the user's touch operation on the touch screen 180, it is not possible to confirm the contact of the finger with the touch sensor 122 on the back surface, so that it is difficult to accurately grasp the PIN. That is, the security of the mobile information terminal 100 is improved, and the usability is improved. The above-mentioned control is also effective in the case of the user authentication process of the password input method or the pattern input method.

[Operation control example 2 of user authentication processing]
FIG. 4A is a flowchart of an example of the user authentication process by the PIN input method.

When the user gives an instruction to wake up from sleep in the sleep state T111, or when the user gives an instruction to turn on the power in the power off state T112, the user authentication unit 1103 first displays the touch screen 180 (display unit 131). The PIN input screen 180b is displayed (S201). Subsequently, it is confirmed whether or not the user touches the touch screen 180 (touch panel 123) (S202). If there is no touch operation on the touch screen 180 (S203: No), the process returns to the process of S202. If there is a touch operation on the touch screen 180 (S203: Yes), the process proceeds to S204. Even if there is a touch operation on the touch screen 180, if the touch operation is on an area other than the numerical keyboard area 180b1 described later, the process returns to the process of S202.

Next, the touch position of the user's touch operation is confirmed (S204). When the touch position of the user's touch operation is a "number" (S205: number), the process proceeds to S206. If the touch position of the user's touch operation is "OK" (S205: OK), the process proceeds to S209. When the touch position of the user's touch operation is "Cancel" (not shown), the user authentication process is interrupted and the operating state of the mobile information terminal 100 is returned to the sleep state T111.

In the process of S206, the contact state of the user's finger with the touch sensor 122 is confirmed (S206). When the user's finger is not in contact with the touch sensor 122 (S207: No), the user's touch operation in the process of S202 is set to "invalid", and the process returns to the process of S202. When the user's finger is in contact with the touch sensor 122 (S207: Yes), the user's touch operation in the process of S202 is set to "valid", and the number touched by the user is stored in the temporary storage area 1200 (S208). After that, the process returns to S202.

In the process of S209, the user authentication unit 1103 compares the numerical string stored in the temporary storage area 1200 with the authentication information preset by the user and stored in the authentication information storage area 1011 and compares the result with the lock control unit 1102. (S209).

The lock control unit 1102 matches the number string stored in the temporary storage area 1200 with the authentication information stored in the authentication information storage area 1011 preset by the user according to the transmitted comparison result (S210). : Yes), as the authentication is successful, the operating state of the mobile information terminal 100 is changed to the normal operating state T110 (S211). When the numerical string stored in the temporary storage area 1200 and the authentication information stored in the authentication information storage area 1011 set in advance by the user do not match (S210: No), the operation state of the mobile information terminal 100 is regarded as an authentication failure. Is returned to the sleep state T111 (S212).

FIG. 4B is a screen display diagram of an example of the PIN input screen displayed by the processing of the flowchart shown in FIG. 4A.

The PIN input screen 180b includes a numeric keyboard area 180b1, an input result display area 180b2, and other information display area 180b3. The numeric keyboard area 180b1 is an effective area for touch operation at the time of PIN input, and there are "OK" display 180b4 and "Cancel" display.

FIG. 4C is an operation conceptual diagram of an example of the operation flow of the user authentication process by the PIN input method in the flowchart shown in FIG. 4A.

As shown in the figure, the user touches the touch screen 180 in the order of "1", "2", "3", "4", "8", and "OK". Further, when the user touches the touch screen 180 and touches "1", "2", "3", and "4", the user's finger is in contact with the touch sensor 122. It is assumed that the user's finger is not in contact with the touch sensor 122 during the touch operation to "8". In this case, among the user's touch operations on the touch screen 180, the touch operations on "1", "2", "3", and "4" are "valid", and the above-mentioned numbers are stored in the temporary storage area 1200. It will be remembered. At this time, the storage of the numbers in the temporary storage area 1200 is performed by appending (stacking) instead of overwriting.

The touch operation to "OK" may be "effective" only when the user's finger is in contact with the touch sensor 122, or is "effective" regardless of whether or not the user's finger is in contact with the touch sensor 122. May be. In this operation control example, the comparison of the number strings is performed not when the numbers of characters in the number strings match but when "OK" is touched, which is different from the above-described operation control example.

[Modification example]
The touch sensor 122 may be a fingerprint sensor capable of reading a fingerprint pattern. In this case, even if the user's finger is in contact with the touch sensor 122 in the process of S104 (or S206), the process of S102 (or S202) is performed only when the fingerprint pattern of the finger registered in advance matches. Control is performed so that the touch operation of the user is "enabled". For example, when the user's finger in contact with the touch sensor 122 is the index finger of the left hand, the user's touch operation is treated as "valid", and the user's finger in contact with the touch sensor 122 is the index finger of the left hand. In cases other than the above, or when the user's finger is not in contact with the touch sensor 122, control may be performed so that the user's touch operation is processed as "invalid".

The position where the touch sensor 122 is arranged is not limited to the back surface of the mobile information terminal 100. FIG. 5A is a side view of a modified example of the mobile information terminal 100. As shown in the figure, the touch sensor 122 may be arranged on the side surface of the mobile information terminal 100. It may be arranged on either the upper or lower surface. It is preferable to arrange the mobile information terminal 100 in a place where the user's fingers can easily come into contact with the handheld information terminal 100. Alternatively, the touch sensor 122 may be a separate device connected to the mobile information terminal 100 by wired communication or wireless communication. It is preferable that the touch sensor 122 has an arrangement / configuration that is not visible at the same time as the touch screen 180.

The PIN input in the user authentication process is not limited to the one performed via the touch screen 180, and may be performed via the operation key 121. FIG. 5B is a front external view of a modified example of the mobile information terminal 100. The keyboard 121k is one of the operation keys 121 composed of hard buttons. Character input is possible by pressing each key of the keyboard 121k. Even when the PIN input is performed via the keyboard 121k, it may be controlled whether the character input by pressing each key of the keyboard 121k is valid or invalid according to the contact state of the user's finger on the touch sensor 122.

<Second Embodiment>
Hereinafter, the second embodiment of the present invention will be described. The basic configuration of the second embodiment is the same as that of the first embodiment. Hereinafter, the differences between the present embodiment and the first embodiment will be mainly described, and the common parts are to avoid duplication. The explanation is omitted as much as possible.

Conventionally, the touch sensor is used for fingerprint authentication and transition to the home screen, while the touch screen is mainly used for inputting numbers and characters, and an input operation combining these is not performed. Therefore, in the present embodiment, not only a plurality of input units are used individually, but also a plurality of input units are used in combination to realize more input operations using the same number of input units and effectively utilize hardware resources. I will aim for it.

In the mobile information terminal 100 of the present embodiment, as a user authentication process, authentication information in which a plurality of digits obtained by continuously touching (selecting) the numbers of the number keyboard displayed on the touch screen 180 is set in advance. The PIN input method that authenticates the user based on whether or not it matches the number string of is executed. Further, the mobile information terminal 100 controls the function restriction state after the transition to the normal operation state T110 according to the contact state of the finger with the touch sensor 122.

[Example of operation control of user authentication processing]
FIG. 6A is a flowchart of an example of the user authentication process by the PIN input method.

The user authentication process of this embodiment is basically performed in the same procedure as the flowchart shown in FIG. 3A. The processes of S301 to S304 perform the same operations as the processes of S101 to S104. In the process of S306, the number touched by the user in the process of S302 is stored in the temporary storage area 1200 together with the contact state of the user's finger confirmed in S304. For example, the flag area 1201 is provided in association with the number of the temporary storage area 1200. And if the finger is in contact when the number is input (if the touch to the touch sensor is confirmed), the flag "1" is set, and if the finger is not in contact (the touch to the touch sensor can be confirmed). B) The flag "0" is stored in the flag area 1201. The processes of S307 to S312 perform the same operations as the processes of S107 to S112.

6B and 6C are operation conceptual diagrams of an example of the operation flow of the user authentication process by the PIN input method in the flowchart shown in FIG. 6A.

As shown in the figure, the user's touch operation on the touch screen 180 is performed in the order of "1", "2", "3", and "4". Further, when the user touches the touch screen 180 and the user's finger touches the touch sensor 122 during the touch operation of "1", "2", "3", and "4" (FIG. FIG. In 6B), control is performed so that all the functions provided in the mobile information terminal 100 can be used in the normal operating state T110 after the successful user authentication process. On the other hand, when the user's finger touches the touch sensor 122 only when the user touches the touch screen 180 and touches "2" and "3" (FIG. 6C), the user is authenticated. In the normal operating state T110 after the processing is successful, control is performed so that only a part of the functions of the mobile information terminal 100 can be used.

That is, when the user's finger touches the touch sensor 122 for all the touch operations of the numbers constituting the PIN, all the functions of the mobile information terminal 100 are enabled. When the user's finger touches the touch sensor 122 only for a part of the touch operation of the numbers constituting the PIN, only a part of the functions of the mobile information terminal 100 is used. Make it possible. For example, when performing monetary transactions or various payment processes using the mobile information terminal 100, PIN input (user authentication process) according to the procedure shown in FIG. 6B is required, and when performing free video playback or the like. Can be used properly, such as PIN input (user authentication processing) in the procedure shown in FIG. 6C.

In the mobile information terminal 100 of the present embodiment, the success or failure of the user authentication process is determined by the number string stored in the temporary storage area 1200 and the authentication information set in advance by the user and stored in the authentication information storage area 1011. The comparison is performed, and it does not depend on the contact state of the user's fingers with the touch sensor 122. All user touch operations on the touch screen 180 are treated as "effective" regardless of the user's finger contact with the touch sensor 122.

As described above, the mobile information terminal 100 can be used after the transition to the normal operating state T110 according to the contact state of the user's finger with the touch sensor 122 during the operation of the user authentication process by the PIN input method. It is possible to control the limited status of various functions. That is, the usability of the mobile information terminal 100 is improved. The above-mentioned control is also effective in the case of the user authentication process of the password input method or the pattern input method.

[Modification example]
When the number of digits of the number string of the authentication information stored in the authentication information storage area 1011 set in advance by the user is four, the number of numbers required to be input in the PIN input process is four. In this case, the limited status of the functions that can be used after the transition to the normal operating state T110 is determined according to the number of times the user's finger touches the touch sensor 122 for four touch operations on the touch screen 180. You may control it.

For example, when the application that can be executed by the mobile information terminal 100 is divided into four groups, and the user's finger touches the touch sensor 122 only once for four touch operations on the touch screen 180, the application is divided into four groups. Only applications belonging to the first group can be used. When the user's finger touches the touch sensor 122 twice, only the applications belonging to the first group and the second group can be used. When the user's finger touches the touch sensor 122 three times, only the applications belonging to the first group, the second group, and the third group can be used. When the user's finger touches the touch sensor 122 four times, the applications belonging to all the groups can be used.

Alternatively, for example, when the application that can be executed by the mobile information terminal 100 is divided into four groups, and the user's finger touches the touch sensor 122 only once for four touch operations on the touch screen 180. Allows only applications belonging to the first group to be used. When the user's finger touches the touch sensor 122 twice, only the application belonging to the second group can be used. When the user's finger touches the touch sensor 122 three times, only the application belonging to the third group can be used. When the user's finger touches the touch sensor 122 four times, only the application belonging to the fourth group can be used.

Alternatively, for example, the application that can be executed by the mobile information terminal 100 may be divided into four groups and controlled as follows according to the operation on the touch screen 180 and the contact with the touch sensor 122. In the case where the user's finger touches the touch sensor 122 only once for four touch operations on the touch screen 180, the user's finger touch on the touch sensor 122 is the first contact with the touch screen 180. When performed in conjunction with the touch operation, only the applications belonging to the first group can be used. When the user's finger touches the touch sensor 122 only once and the user's finger touches the touch sensor 122 in conjunction with the second touch operation on the touch screen 180, the first step is made. Only applications belonging to the second group can be used. When the user's finger touches the touch sensor 122 only once and the user's finger touches the touch sensor 122 in conjunction with the third touch operation on the touch screen 180, the third touch. Only applications belonging to group 3 can be used. When the user's finger touches the touch sensor 122 only once and the user's finger touches the touch sensor 122 in conjunction with the fourth touch operation on the touch screen 180, the third Only applications belonging to group 4 can be used. When the user's finger touches the touch sensor 122 twice or three times, the same control as described above may be performed.

Further, when the user stores two types of authentication information in the authentication information storage area 1011 in advance and the touch sensor 122 touches the user's finger, the user authentication process is performed by comparing with the first authentication information. If the user does not touch the user's finger, the user authentication process may be controlled by comparing with the second authentication information. Further, in the normal operating state T110 after the successful user authentication process by comparison with the first authentication information, control is performed so that all the functions provided in the mobile information terminal 100 can be used, and the second authentication is performed. In the normal operating state T110 after the successful user authentication process by comparison with the information, control may be performed so that only a part of the functions included in the portable information terminal 100 can be used.

Further, when the touch sensor 122 is used as a fingerprint sensor, the user stores three types of authentication information in advance in the authentication information storage area 1011 and the finger in contact with the touch sensor 122 is the user's first finger. The user authentication process is performed by comparing with the first authentication information, and in the case of the second finger, the user authentication process is performed by comparing with the second authentication information, and the touch sensor 122 is touched by the user's finger. If not, control may be performed so that the user authentication process is performed by comparing with the third authentication information. In this case, the function that can be used in the normal operating state T110 after the success of the user authentication process may be controlled depending on which authentication information is compared. Further, the first authentication information and the second authentication information may be stored in association with the fingerprint pattern information of the first finger and the fingerprint pattern information of the second finger, respectively.

<Third Embodiment>
Hereinafter, a third embodiment of the present invention will be described. The basic configuration of the third embodiment is the same as that of the first embodiment. Hereinafter, the differences between the present embodiment and the first embodiment will be mainly described, and the common parts are to avoid duplication. The explanation is omitted as much as possible.

Conventionally, for example, the uppercase and lowercase letters of the alphabet have been switched by operating the "Caps Lock" button or the Shift button. In that case, only the touch panel was used as the input unit, and the character type was changed before the character input or by pressing the Shift button and the character key at the same time. This embodiment aims at effective utilization of hardware resources by using hardware different from the touch panel when changing the input character type. Therefore, the mobile information terminal 100 according to the present embodiment controls the input character type according to the contact state of the finger with the touch sensor 122 when inputting characters using the software keyboard.

[Example of operation control of character input processing]
FIG. 7A is a screen display diagram of an example of a character input screen displayed when character input is performed on the mobile information terminal 100.

The character input screen 180c includes a software keyboard area 180c1 and a text display area 180c2. Character input is performed based on touch operations on each character key and other control keys in the software keyboard area 180c1. The result is displayed in the text display area 180c2. Each character key in the software keyboard area 180c1 is displayed in a lowercase alphabet in the initial display state. Also, by touching the "Shift" key, the display of each character key is changed from lowercase letters to uppercase letters, and uppercase alphabets can be input.

FIG. 7B is a flowchart of an example of the character input process.

When the user starts the application for inputting characters, the character input screen 180c is first displayed (S401). Subsequently, it is confirmed whether or not the user touches the touch screen 180 (touch panel 123) (S402). If there is no touch operation on the touch screen 180 (S403: No), the process returns to the process of S402. If there is a touch operation on the touch screen 180 (S403: Yes), the process proceeds to S404. Even if there is a touch operation on the touch screen 180, if the touch operation is on an area other than the software keyboard area 180c1, the process returns to S402.

Next, the touch position of the user's touch operation is confirmed (S404). When the touch position of the user's touch operation is the "control key" (S405: control key), the process proceeds to S406. When the touch position of the user's touch operation is the "character key" (S405: character key), the process proceeds to S407. In the process of S406, a predetermined control is executed according to the type of the touched control key (S406). For example, when the touched control key is the "Shift" key, the character type of each character key displayed in the software keyboard area 180c1 is changed to uppercase.

In the process of S407, the contact state of the user's finger with the touch sensor 122 is confirmed (S407). When the user's finger is not in contact with the touch sensor 122 (S408: No), the character input by the user's touch operation in the process of S402 is displayed in the text display area 180c2 in the same character type (S410). When the user's finger is in contact with the touch sensor 122 (S408: Yes), the character type of the character input by the user's touch operation in the processing of S402 is changed (S409) and displayed in the text display area 180c2 (S410). ).

7C to 7E are operation conceptual diagrams of an example of the operation flow of the character input processing in the flowchart shown in FIG. 7B.

When the user inputs a lowercase letter of the alphabet, the character key of each alphabet in the initial display state may be touched (FIG. 7C). In this case, the operation instruction may be given once. When the user inputs an uppercase letter of the alphabet, first, the "Shift" key in the initial display state is touched. Then, the display of each character key of the alphabet in the software keyboard area 180c1 is changed from lowercase letters to uppercase letters. Subsequently, the user may touch the character keys of each alphabet (Fig. 7D). In this case, two operation instructions are required.

On the other hand, when the user inputs the uppercase letters of the alphabet, the character keys of each alphabet in the initial display state may be touched while the user's fingers are in contact with the touch sensor 122 (FIG. 7E). In this case, only one operation instruction is required. The display of each character key of the alphabet in the software keyboard area 180c1 remains lowercase, but the character input result displayed in the text display area 180c2 is controlled to be displayed in uppercase.

That is, in the mobile information terminal 100 of the present embodiment, it is possible to control the change of the character type by touching the character key in the software keyboard area 180c1 while the user's finger is in contact with the touch sensor 122. .. That is, the usability of the mobile information terminal 100 is improved.

[Modification example]
The character decoration may be controlled according to the presence or absence of the user's finger contact with the touch sensor 122. For example, when a touch operation is performed on the software keyboard area 180c1 without the user's finger touching the touch sensor 122, input is performed as a standard character type, and the user's finger touching the touch sensor 122 is present. When a touch operation is performed on the software keyboard area 180c1, the input characters are controlled to be decorated in diagonal characters, bold characters, or the like. You may decorate such as underline and strikethrough. The font type and size (number of points) may be controlled.

Further, the touch sensor 122 may be used as a fingerprint sensor, and the change of the character type and the decoration may be controlled according to the type of the finger of the user who comes into contact with the touch sensor 122. For example, if the finger in contact with the touch sensor 122 is the user's first finger, it is changed to uppercase, if it is the second finger, it is decorated with an oblique letter, and if it is the third finger. May be underlined and controlled so that the touch sensor 122 is input with standard characters (lowercase letters) when the user does not touch the finger. In this case, which finger corresponds to what kind of change / decoration control is stored in advance in various information storage areas 1019 as a table.

This control can also be applied to Japanese input, and may be changed to voiced sound or handakuon.

<Fourth Embodiment>
Hereinafter, a fourth embodiment of the present invention will be described. The basic configuration of the fourth embodiment is the same as that of the first embodiment. Hereinafter, the differences between the present embodiment and the first embodiment will be mainly described, and the common parts are to avoid duplication. The explanation is omitted as much as possible.

The mobile information terminal 100 of the present embodiment controls the telephone communication (call) function according to the contact state of the finger with the touch sensor 122. In particular, in a mobile information terminal that can use a plurality of SIMs, if the SIM selection operation is performed only on the touch screen, it is necessary to transition from the SIM selection operation screen to the telephone communication function screen, which is troublesome to operate the screen. Therefore, in the present embodiment, the operability of the SIM selection operation is improved by effectively utilizing the hardware.

[Hardware configuration example of mobile information terminal]
FIG. 8A is a hardware configuration diagram showing an example of the internal configuration of the mobile information terminal 100. The mobile information terminal 100 of the present embodiment includes a first SIM connection unit 171 and a second SIM connection unit 172 in the expansion interface unit 170. The first SIM connection unit 171 and the second SIM connection unit 172 are provided with contractor information and the like issued by a telecommunications carrier such as SIM (Subscriber Identity Module) and UIM (User Identity Module) (hereinafter referred to as SIMs), respectively. The recorded card can be connected. When the mobile information terminal 100 makes a call or the like via the mobile telephone communication network, the telephone number is specified based on the contractor information or the like recorded in the SIMs. In addition to the contractor information and the like, the SIMs may further record private information such as a telephone directory (address book) and personal identification information for credit card settlement.

Further, the telephone network communication unit 162 may include a first telephone network communication unit and a second telephone network communication unit corresponding to the first SIM connection unit 171 and the second SIM connection unit 172, respectively. Only one telephone network communication unit 162 may selectively correspond to the first SIM connection unit 171 and the second SIM connection unit 172.

[Example of appearance of mobile information terminal]
FIG. 8B is a front external view showing an example of the appearance of the mobile information terminal 100. FIG. 8C is a side view showing an example of the appearance of the mobile information terminal 100.

The first SIM connection unit 171 and the second SIM connection unit 172 are provided with insertion ports on the side surfaces of the mobile information terminal 100. By inserting the SIMs into the insertion slot, it is possible to connect with the SIMs. However, the arrangement of the first SIM connection unit 171 and the second SIM connection unit 172 on the housing of the mobile information terminal 100 may be on the upper and lower surfaces, and is not limited to the above example.

[System configuration example including mobile information terminal]
FIG. 8D is a system configuration diagram showing an example of a communication system including the mobile information terminal 100.

The communication system includes a mobile information terminal 100, a wide area public network such as the Internet 200, an ISP (Internet Service Provider) 300 and its wireless communication access point 301, a first mobile telephone communication network 400 and its base station 401, and the like. 2. The mobile telephone communication network 410 and its base station 411 are included.

The mobile information terminal 100 includes two SIM connection units (first SIM connection unit 171 and second SIM connection unit 172), and can arbitrarily switch / select a network. That is, it is possible to arbitrarily switch / select the telephone number specified by each SIM or the like to make a call. When the first SIMs connected to the first SIM connection unit 171 are activated, telephone communication (call) is executed via the first mobile telephone communication network 400 and its base station 401. The first SIMs are SIMs issued by the operator of the first mobile telephone communication network 400. When the second SIMs connected to the second SIM connection unit 172 are activated, telephone communication (call) is executed via the second mobile telephone communication network 410 and its base station 411. The second SIMs are SIMs issued by the operator of the second mobile telephone communication network 410.

[Software configuration example of mobile information terminal]
FIG. 8E is a software configuration diagram of the mobile information terminal 100, and shows an example of the software configuration in the storage unit 110 (or ROM 103, the same applies hereinafter) and the RAM 104. The storage unit 110 stores the basic operation program 1001, the SIM control program 1004, the call program 1005, and other operation programs 1009. Further, the SIM control program 1004 and the call program 1005 stored in the storage unit 110 are expanded in the RAM 104, respectively, and the main control unit 101 further executes each of the expanded operation programs to execute the SIM control unit 1104 and the call unit. It constitutes 1105.

The SIM control unit 1104 controls the setting of which of the first SIMs connected to the first SIM connection unit 171 and the second SIMs connected to the second SIM connection unit 172 is enabled. Alternatively, if both the first SIMs connected to the first SIM connection 171 and the second SIMs connected to the second SIM connection 172 are enabled, which SIMs are prioritized. Controls the setting of SIMs to be used. The call unit 1105 manages a telephone directory at the time of a call, controls input / selection of a destination telephone number, controls outgoing / incoming call processing, and the like.

[Example of call processing operation control]
9A and 9B are flowcharts of an example of operation control when making a call using the mobile information terminal 100.

As the initial setting (S500), the following procedure shown in FIG. 9A is performed in advance.

In the initial setting process, the user first connects the first SIM connection unit 171 and / or the second SIM connection unit 172 to the operator of the first mobile telephone communication network 400, the second mobile telephone communication network 410, or the like. The issued SIMs are inserted (S501). Subsequently, the SIM control unit 1104 of the mobile information terminal 100 detects the insertion of the SIMs into the first SIM connection unit 171 and / or the second SIM connection unit 172, and activates the SIM connection unit into which the SIMs are inserted. To become. Further, the number of inserted SIMs is confirmed (S502).

When the number of inserted SIMs is one (S503: Yes), the inserted SIMs are set as the SIMs (main SIM) to be used preferentially (S504). On the other hand, when the number of inserted SIMs is not one (S503: No), the SIM selection screen 180d is displayed on the touch screen 180 (display unit 131) (S505). On the SIM selection screen 180d, it is possible to select and set which of the SIMs inserted in the process of S501 is to be used preferentially (main SIM). The SIMs that are not selected are set as SIMs (secondary SIMs) that are not preferentially used. When the user selects one of the SIMs by touching the touch screen 180 (touch panel 123) (S506), the selected SIMs are set as the main SIM (S507).

FIG. 9C is a screen display diagram of an example of the SIM selection screen displayed by the processing of the flowchart shown in FIG. 9A.

The SIM selection screen 180d includes a SIM availability display area 180d1, a priority SIM setting area 180d2, and a SIM information display area 180d3. The SIM availability display area 180d1 displays the connection status of SIMs to the first SIM connection unit 171 and the second SIM connection unit 172 as "usable" / "unusable" / "not inserted" or the like. In the priority SIM setting area 180d2, it is possible to select which of the SIMs inserted in the first SIM connection unit 171 and the second SIM connection unit 172 is the main SIM. The SIM information display area 180d3 displays information such as a specified telephone number and the name of the operator of the mobile telephone communication network for each of the SIMs inserted in the first SIM connection unit 171 and the second SIM connection unit 172. Will be done.

In the call processing (S510), the following procedure shown in FIG. 9B is performed.

When making a call, the user first touches the telephone icon displayed on the basic screen 180e to select a call function (S511). Then, the call unit 1105 of the mobile information terminal 100 displays the call function screen 180f on the touch screen 180 (S512). Subsequently, the user selects a method for designating the destination telephone number (S513). When the method of specifying the selected destination telephone number is "phone book" (S514: telephone directory), the process proceeds to S515. When the method of specifying the selected destination telephone number is "direct input" (S514: direct input), the process proceeds to S518.

In the process of S515, the user first selects the "phone book" icon displayed on the call function screen 180f. Then, the call unit 1105 reads out the user's telephone directory stored in the various information storage areas 1019 and the like, and displays the telephone directory screen (not shown) on the touch screen 180 (S515). Next, the user selects a destination by touching the displayed telephone directory screen (S516). Then, the call unit 1105 displays the telephone number of the destination selected by the user in the telephone number display area 180f3 of the call function screen 180f (S517).

In the process of S518, the user directly inputs the telephone number of the call destination by touching the number key area 180f1 of the call function screen 180f (S518). The telephone unit 1105 displays the touch-input numbers in the telephone number display area 180f3 in response to the user's touch operation (S519). The processing of S518 to S519 is repeated for the number of digits of the telephone number.

After the call destination telephone number designation process by the user, the call unit 1105 confirms whether or not there is a touch operation on the call key 180f4 on the call function screen 180f (S520). If there is no touch operation (S521: No), the system waits as it is. When there is a touch operation (S521: Yes), different calling processes are executed according to the number of SIMs inserted in the first SIM connection unit 171 and the second SIM connection unit 172.

When the number of inserted SIMs is one (S522: Yes), the one inserted SIM is set as the main SIM, and the sub SIM does not exist. Therefore, the call processing is executed based on the information recorded in the main SIM (S523).

When the inserted SIMs are not one (S522: No), the call unit 1105 makes contact with the touch sensor 122 by the user's finger when the call key 180f4 is touched in the process of S520. It is confirmed whether or not it was present (S524). When the user's finger does not touch the touch sensor 122 (S525: No), the calling process is executed based on the information recorded in the SIMs set in the main SIM in the initial setting process S500 (S523). ). When the user's finger touches the touch sensor 122 (S525: Yes), the call processing is executed based on the information recorded in the SIMs set in the sub SIM in the initial setting process S500 (S526). ).

FIG. 9D is a screen display diagram of an example of the basic screen displayed by the processing of the flowchart shown in FIG. 9B.

The basic screen 180e includes a main function icon display area 180e1, a general icon display area 180e2, and other information display areas 180e3. The main function icon display area 180e1 is an icon display area associated with a main application often used in the mobile information terminal 100. Phone icons are displayed in this area. The general icon display area 180e2 is an icon display area associated with other applications. The other information display area 180e3 is an area for displaying general information such as time information and weather information.

FIG. 9E is a screen display diagram of an example of the call function screen displayed by the processing of the flowchart shown in FIG. 9B.

The call function screen 180f includes a number key area 180f1, a function menu area 180f2, a telephone number display area 180f3, and a calling key 180f4. In the number key area 180f1, numbers and characters such as "*" and "#" are displayed. By performing a touch operation on the number key area 180f1, the telephone number can be directly input. In the function menu area 180f2, a menu for calling the telephone directory screen, the outgoing call history screen, and the incoming call history screen is displayed. In the telephone number display area 180f3, a telephone number designated by direct input or selection from the telephone directory is displayed. When the destination is selected from the telephone directory, other information (name, etc.) associated with the selected telephone number may also be displayed. The call key 180f4 is an icon for executing the call process. The call processing is started with the touch operation of the call key 180f4 as a trigger.

The mobile information terminal 100 of the present embodiment can easily select the SIMs to be used according to the contact state of the fingers with the touch sensor 122 when making a call. That is, it is possible to make a call while switching the caller's telephone number (own telephone number) with a simple operation. That is, the usability of the mobile information terminal 100 is improved.

[Modification example]
The process of confirming the contact state of the finger with the touch sensor 122 may be performed at the time of the touch operation on the calling key 180f4 as described above. Further, it may be performed at the time of the selection process of the call function. This may be performed when selecting a destination from the phonebook. This may be done when directly entering the destination telephone number. That is, if there is a finger contact with the touch sensor 122 at any timing of the call processing S510, the call processing is performed based on the information recorded in the SIMs set in the sub SIM, and if there is no contact, the call processing is performed. , The call processing may be performed based on the information recorded in the SIMs set in the main SIM.

Switching between the call processing based on the information recorded in the SIMs set in the main SIM and the call processing based on the information recorded in the SIMs set in the sub SIM can be used for outgoing call history and incoming calls. It may also be done during a history-based call. In this case, the calling process is performed using a telephone number different from the telephone number recorded in the outgoing call history or the incoming call history.

Further, the touch sensor 122 is used as a fingerprint sensor, private SIMs are set as the main SIM, and business SIMs are set as the sub SIM. In this case, the call processing based on the information or the like recorded in the private SIMs can be performed without the need for finger contact with the touch sensor 122. On the other hand, the call processing based on the information recorded in the SIMs for business use can be performed by requiring the contact of the finger with the touch sensor 122. At this time, since the touch sensor 122 is used as a fingerprint sensor, it is possible to improve the security of the call processing based on the information recorded in the SIMs for business use.

Although examples of the embodiments of the present invention have been described above using the first to fourth embodiments, it goes without saying that the configuration for realizing the technique of the present invention is not limited to the above-described embodiments, and various modified examples are available. Conceivable. For example, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. All of these belong to the category of the present invention. In addition, numerical values and messages appearing in sentences and figures are merely examples, and the effects of the present invention may not be impaired even if different ones are used.

The above-mentioned functions of the present invention and the like may be realized by hardware, for example, by designing a part or all of them by an integrated circuit. Further, it may be realized by software by interpreting and executing a program in which a microprocessor unit or the like realizes each function or the like. Hardware and software may be used together. The software may be stored in the ROM 103 of the mobile information terminal 100, the storage unit 110, or the like in advance at the time of product shipment. After the product is shipped, it may be acquired from various server devices on the Internet. Further, the software provided by a memory card, an optical disk, or the like may be acquired.

In addition, the control lines and information lines shown in the figure indicate those considered necessary for explanation, and do not necessarily indicate all the control lines and information lines on the product. In practice, it can be considered that almost all configurations are interconnected.

Further, in the above description, a hardware button, for example, a button switch may be used instead of the touch sensor.

100 ... Mobile information terminal, 101 ... Main control unit, 102 ... System bus, 103 ... ROM, 104 ... RAM, 110 ... Storage unit, 120 ... Operation input unit, 121 ... Operation keys, 122 ... Touch sensor, 123 ... Touch panel, 130 ... image processing unit, 131 ... display unit, 132 ... image signal processing unit, 133 ... first image input unit, 134 ... second image input unit, 140 ... audio processing unit, 150 ... sensor unit, 160 ... communication unit, 170 ... Extended interface unit, 171 ... 1st SIM connection unit, 172 ... 2nd SIM connection unit, 180 ... Touch screen, 1101 ... Basic operation unit, 1102 ... Lock control unit, 1103 ... User authentication unit, 1104 ... SIM control unit, 1105 … Call section

For example, it is a method of calling a mobile information terminal, that is, a first contractor information acquisition step for acquiring the first contractor information stored in the first storage unit, and a second storage unit for acquiring the first contractor information. A second contractor information acquisition step for acquiring the second contractor information and a call destination designation step for detecting a touch operation for designating a call destination performed on the first touch area of the operation input unit. A call request step for detecting a touch operation for requesting a call performed on the second touch area of the operation input unit, and the first touch area and the second touch area of the operation input unit. For the third touch area different from the touch area, perform a call processing based on the first contractor information acquired in the first contractor information acquisition step, or perform the call processing based on the first contractor information acquisition step, or perform the call processing acquired in the second contractor information acquisition step. (Ii) The contractor information determination operation confirmation step for confirming the presence or absence of a touch operation for deciding whether to perform the call processing based on the contractor information, and the touch operation for requesting the call in the call request step. When detected, it is designated in the call destination designation step based on the first contractor information acquired in the first contractor information acquisition step according to the result of the confirmation process in the contractor information determination operation confirmation step. Call processing is performed for the called destination, or the call is made to the called destination specified in the called destination designation step based on the second contractor information acquired in the second contractor information acquisition step. It is characterized by including a calling step of performing or performing a call processing .

Claims (11)

The first input unit, the second input unit provided at a position different from the first input unit, and
A control unit that executes one process using the first input signal input from the first input unit and the second input signal input from the second input unit.
A mobile information terminal characterized by being equipped with. In the mobile information terminal according to claim 1,
An input signal storage unit for storing the first input signal is further provided.
When the control unit acquires the second input signal when the first input signal is acquired, the control unit adds the first input signal to the input signal storage unit in the acquisition order.
A mobile information terminal characterized by that. In the mobile information terminal according to claim 2.
Further provided with a main body unit incorporating the control unit
The first input unit is provided on the first surface of the main body unit.
The second input unit is provided on a second surface different from the first surface of the main body unit.
A mobile information terminal characterized by that. In the mobile information terminal according to claim 3.
An authentication information storage unit that stores user authentication information defined using at least one or more numbers or characters,
A user authentication unit that performs user authentication processing based on the result of comparing the numbers or characters included in the first input signal and the user authentication information is further provided.
When the user authentication unit determines whether the number of numbers or characters stored in the input signal storage unit is the same as the number of numbers or characters included in the user authentication information, and determines that the number is the same. Compares the numbers or characters stored in the input signal storage unit with the user authentication information.
A mobile information terminal characterized by that. In the mobile information terminal according to claim 3.
An authentication information storage unit that stores user authentication information defined using at least one or more numbers or characters,
A user authentication unit that performs user authentication processing based on the result of comparing the numbers or characters included in the first input signal and the user authentication information is further provided.
A third input unit that receives an input of a start signal for starting the user authentication process by the user authentication unit is further provided.
When the user authentication unit acquires the start signal, the user authentication unit compares the numbers or characters stored in the input signal storage unit with the user authentication information.
A mobile information terminal characterized by that. In the mobile information terminal according to claim 5.
A display unit provided on one surface of the main body unit and a touch panel laminated on the display unit are further provided.
The first input unit is an input area for a number string or a character string in the touch panel.
The third input unit is an input confirmation button area in the touch panel.
A mobile information terminal characterized by that. In the mobile information terminal according to claim 2.
It also has a fingerprint information storage unit that stores the user's fingerprint information.
The second input unit is a touch sensor that reads the user's fingerprint information.
The control unit collates the fingerprint information of the user read by the touch sensor with the fingerprint information stored in the fingerprint information storage unit, and if they match, the first input signal is added to the input signal storage unit.
A mobile information terminal characterized by that. In the mobile information terminal according to claim 3.
The first input unit is a hard button provided on the first surface.
A mobile information terminal characterized by that. It is a control method of a mobile information terminal provided with a first input unit and a second input unit provided at a position different from the first input unit.
A step of acquiring a first input signal input from the first input unit and a second input signal input from the second input unit, and
A step of executing one process based on the first input signal and the second input signal, and
A method for controlling a mobile information terminal, which comprises. In the control method of the mobile information terminal according to claim 9,
When the first input signal and the second input signal are acquired, the one process is a process of adding the first input signal to the storage area included in the mobile information terminal in the order of acquisition.
A method of controlling a mobile information terminal, which is characterized in that. A mobile information terminal with a terminal lock function
A touch screen that accepts the input of authentication information for releasing the terminal lock function, and
With a touch sensor
With a control unit,
The control unit
When the authentication information is input to the touch screen, if the user's finger touches the touch sensor, the input authentication information is treated as valid.
When the authentication information is input to the touch screen, if the user's finger does not touch the touch sensor, control is performed so that the input authentication information is treated as invalid. Mobile information terminal.

Images