JP5958319B2 - Information processing apparatus, program, and method - Google Patents

Description

  Some embodiments relate to an information processing apparatus, a program, and a method.

  The fingerprint sensor is mounted on an information processing apparatus such as a mobile phone and is widely used for user authentication. The fingerprint sensor includes, for example, a surface type that detects a fingerprint by touching the belly of the finger with a sensor surface and a sweep type that detects a fingerprint by sliding the finger on the sensor surface.

  The sweep type fingerprint sensor has, for example, a small area imaging surface, and continuously captures a plurality of partial images of the fingerprint of the finger while moving the finger on the imaging surface, and the captured partial image The whole image of the fingerprint of the finger is reconstructed from this and used for authentication. The sweep type fingerprint sensor has a smaller installation area than the surface type fingerprint sensor, and is therefore widely used in PCs, small devices, mobile phones, and the like. In addition to authentication, there is a technique for executing functions such as a mailer and a browser using a fingerprint sensor.

  In this regard, a technique for providing a pointing device with good operability is known in which a threshold value can be appropriately set even with a wet finger or a dry finger. In addition, when a sweep type fingerprint sensor is employed, a technique for expanding the number of functions executed in association with input biometric information while maintaining authentication performance is known. Furthermore, there is known a technique for reliably discriminating a non-living body from a living body and for surely eliminating unauthorized use due to impersonation using a counterfeit fingerprint or the like. A technique related to gesturing by a multipoint sensing device is known. (For example, see Patent Document 1, Patent Document 2, Patent Document 3, and Patent Document 4)

JP 2007-189395 A JP 2010-61577 A International Publication WO / 2005/069212 Special table 2009-525538

  However, there has been no technology that can improve the estimation accuracy of the finger movement direction when estimating the finger movement direction when the fingerprint image is captured by the fingerprint sensor based on the fingerprint image captured by the fingerprint sensor.

  An information processing apparatus according to an aspect of the present invention is based on a fingerprint sensor that captures a fingerprint of a finger to acquire a fingerprint image, and a fingerprint image captured by the fingerprint sensor while moving the finger on the fingerprint sensor. A first estimation unit that estimates a finger movement direction when a fingerprint image is captured, a rotational motion sensor that detects a rotational motion associated with the movement of the finger on the fingerprint sensor, and a rotational motion sensor when a fingerprint image is captured Based on the rotational motion detected by the first estimation unit, a second estimation unit that estimates a finger movement direction when imaging a fingerprint image, a finger movement direction estimated by the first estimation unit, and a second estimation unit A determination unit that determines whether or not the finger movement direction matches, and an execution unit that executes a function corresponding to the finger movement direction when it is determined that the determination unit matches.

  According to the above-described aspect, when estimating the finger movement direction when the fingerprint sensor captures a fingerprint based on the fingerprint image captured by the fingerprint sensor, it is possible to improve the estimation accuracy of the finger movement direction.

It is a figure explaining the execution instruction of the function by the fingerprint sensor concerning some embodiments. It is a figure which illustrates the function execution information which concerns on some embodiment. It is a figure which illustrates the functional block structure of the information processing apparatus which concerns on some embodiment. It is a figure which illustrates the rotating shaft of the rotational motion of the information processing apparatus detected by the rotational motion sensor with which the information processing apparatus was equipped. It is a figure which illustrates the rotational motion which arises in information processing apparatus when inputting the execution instruction of a function via the fingerprint sensor which concerns on one Embodiment. It is a figure which illustrates the rotational motion which arises in information processing apparatus, when the execution instruction of a function is input via the fingerprint sensor which concerns on another embodiment. It is a figure explaining sampling of the rotational motion which arises in an information processor according to the movement direction of a finger when inputting the execution instruction of a function. It is a figure which illustrates the movement rotation corresponding | compatible information which concerns on some embodiment. It is an operation | movement flowchart of the execution process of the function via the fingerprint sensor which the control part of the information processing apparatus which concerns on 1st Embodiment performs. It is an operation | movement flowchart of the analysis process of the angular velocity which concerns on embodiment. It is an operation | movement flowchart of the execution process of the function which concerns on embodiment. It is a figure explaining specification of the input period of the execution instruction of a function via a fingerprint sensor concerning a 2nd embodiment. It is an operation | movement flowchart of the execution process of the function via the fingerprint sensor which the control part of the information processing apparatus which concerns on 2nd Embodiment performs. It is a figure which illustrates the hardware constitutions of the computer for implement | achieving the information processing apparatus which concerns on some embodiment.

Hereinafter, some embodiments of the present invention will be described in detail with reference to the drawings. In addition, the same code | symbol was attached | subjected to the corresponding element in several drawing.
In recent years, for example, information processing apparatuses such as smartphones, mobile phones, PDAs, electronic notebooks, and tablet PCs (personal computers) are equipped with fingerprint sensors. In these information processing apparatuses, the fingerprint sensor is used for authenticating a user, for example. In addition, the fingerprint sensor may be used to execute a function included in an information processing apparatus such as a mailer or a browser. However, for example, the finger moving speed is too fast when inputting fingerprint information to the fingerprint sensor, or the finger position is depending on the edge of the imaging area of the fingerprint sensor when inputting fingerprint information to the fingerprint sensor. In some cases, sufficient information is not input to the fingerprint sensor. As a result, for example, a function that is different from the function that the user intends to execute via the fingerprint sensor may be executed. Therefore, there is a demand for a technique that can verify the certainty of the determination made based on the information input to the fingerprint sensor when the function is executed via the fingerprint sensor. Therefore, in the information processing apparatus according to some embodiments, the rotational motion of the information processing apparatus that occurs while the fingerprint image is captured by the fingerprint sensor is detected using a rotational motion sensor such as an angular velocity sensor. Based on the detected rotational motion, the probability of the finger moving direction on the fingerprint sensor estimated based on the fingerprint image acquired by the fingerprint sensor is verified.

  FIG. 1 is a diagram for explaining a function execution instruction by the fingerprint sensor 3 according to some embodiments. FIG. 1 shows an information processing apparatus 1. The information processing apparatus 1 is an apparatus including a fingerprint sensor 3 such as a smartphone, a mobile phone, a PDA, an electronic notebook, or a tablet PC (personal computer). The fingerprint sensor 3 may be, for example, a sweep type fingerprint sensor. The information processing device 1 also includes a rotational motion sensor 2 that detects the rotational motion of the information processing device 1 (FIG. 1a). The rotational motion sensor 2 is an angular velocity sensor, for example.

  In such an information processing apparatus 1, the user sweeps the finger 5 on the fingerprint sensor 3, inputs fingerprint information into the information processing apparatus 1, and performs authentication by fingerprint (FIG. 1b). If the authentication by the fingerprint is successful, the information processing apparatus 1 is unlocked. Note that the lock of the information processing apparatus 1 is, for example, a state of the information processing apparatus 1 that restricts functions that can be used to prevent unauthorized use of the information processing apparatus 1 by other users.

  The fingerprint sensor 3 of the information processing apparatus 1 can also be used to estimate the moving direction of the finger 5 moved on the fingerprint sensor 3 by the user. For example, a plurality of images of the finger 5 are acquired by the fingerprint sensor 3, the movement of the finger 5 is converted into a motion vector based on the difference between the acquired images, and the movement direction of the finger 5 is changed by accumulating the acquired motion vector. Can be estimated. Alternatively, for example, fingerprint images are continuously captured at a predetermined frame rate, and fingerprint feature points are extracted from the captured fingerprint images. The movement direction of the finger 5 moved by the user with respect to the fingerprint sensor 3 can be estimated by tracking the movement of the feature point of the fingerprint in the image captured in each frame. The feature points of the fingerprint are, for example, a central point that is the center of the fingerprint pattern, a branch point that is a branch of the convex pattern of the fingerprint, an end point that is a dead end of the convex pattern of the fingerprint, and a gathering from three directions of the fingerprint pattern Including deltas that are. In addition, the feature points of the fingerprint may include junction points, island lines, sweat pores, end points, and the like.

  Then, for example, by assigning execution of the function of the information processing apparatus 1 to the movement direction of the finger 5 estimated based on the fingerprint image captured by the fingerprint sensor 3, when the fingerprint image is captured by the fingerprint sensor 3. A corresponding function can be executed according to the moving direction of the finger 5.

  FIG. 2 is a diagram illustrating function execution information 200 according to some embodiments. The function execution information 200 includes a moving direction 201 of the finger 5 and a function 202 included in the information processing apparatus 1, which are associated with each other. For example, by referring to such function execution information 200, the information processing apparatus 1 can execute a function corresponding to the movement direction of the finger 5 estimated based on the fingerprint image captured by the fingerprint sensor 3. That is, for example, the information processing apparatus 1 acquires from the function execution information 200 the function 202 associated with the movement direction 201 that matches the movement direction of the finger 5 estimated based on the fingerprint image captured by the fingerprint sensor 3. Then, the function 202 is executed. For example, when the moving direction of the finger 5 estimated based on the fingerprint image captured by the fingerprint sensor 3 is upward, the information processing apparatus 1 performs the function 202 “activate phone book” from the function execution information 200. Get and execute phone book activation.

  Therefore, the user moves the finger 5 on the fingerprint sensor 3 in the movement direction 201 associated with the function 202 having the function desired to be executed, and causes the fingerprint sensor 3 to capture the fingerprint image. Can perform the functions. In other words, the user can input an execution instruction for a target function to the information processing apparatus 1 according to the moving direction of the finger 5 that is moved when the fingerprint image is captured by the fingerprint sensor 3. Such an input of a function execution instruction using the fingerprint sensor 3 enables a quick execution of the function and is very convenient.

  However, for example, there is a case where the moving direction of the finger 5 when the fingerprint image is taken into the fingerprint sensor 3 cannot be accurately estimated because the moving speed of the finger 5 when the fingerprint image is taken in by the fingerprint sensor 3 is too fast. . Alternatively, when the fingerprint image is captured by the fingerprint sensor 3, the position of the finger 5 depends on the edge of the imaging area of the fingerprint sensor 3, so that the moving direction of the finger 5 when capturing the fingerprint image into the fingerprint sensor 3 is accurately estimated. There are cases where it is not possible. As a result, for example, there is a situation where a function different from the function that the user intends to execute via the fingerprint sensor 3 is executed.

  FIG. 1 c shows an example in which the finger 5 is caught by the edge of the imaging area of the fingerprint sensor 3 when inputting a function execution instruction by the fingerprint sensor 3 as described above. As shown in FIG. 1c, after unlocking the information processing apparatus 1 by fingerprint authentication (FIG. 1b), the finger 5 is moved in the upper right direction with respect to the fingerprint sensor 3 to execute the function execution instruction. Is entered. During the unlocking operation (FIG. 1 b), the finger 5 is in a state where it is arranged at substantially the center of the left and right width of the fingerprint sensor 3. Therefore, following the unlocking operation, the finger 5 is moved in the upper right direction of the fingerprint sensor 3, so that the finger 5 approaches the end of the fingerprint sensor 3 when inputting a function execution instruction. (Frame 20 in FIG. 1c). As described above, for example, when a function execution instruction is input to the fingerprint sensor 3 of the information processing apparatus 1 subsequent to the unlocking, a situation in which the finger 5 is caught by the end of the fingerprint sensor 3 during the input is likely to occur. In particular, when the fingerprint sensor 3 is provided on the back surface of the information processing apparatus 1, there is a situation in which the user inputs fingerprint information without viewing the fingerprint sensor 3. In such a situation, It becomes difficult to prevent the finger 5 from being caught by the edge of the fingerprint sensor 3.

  When the fingerprint sensor 3 captures a fingerprint image, if the position of the finger 5 is shifted by the edge of the imaging area of the fingerprint sensor 3, the fingerprint is only partially captured in the obtained fingerprint image. When the direction of movement of the finger 5 is estimated using a fingerprint image that contains only a small amount of fingerprint information, for example, the feature points in the fingerprint may not be sufficiently specified. A movement direction different from the movement direction of the finger 5 moved by the user may be estimated. Alternatively, in another example, when the fingerprint sensor 3 captures a fingerprint image, the finger 5 is moved quickly, so that the number of fingerprint images that can be acquired at the frame rate set in the fingerprint sensor 3 is reduced. There is. Then, when the moving direction of the finger 5 is estimated from a small number of fingerprint images, it is not possible to sufficiently track the temporal change in the movement of the fingerprint, and as a result, the movement is different from the moving direction of the finger 5 actually moved by the user. The direction may be estimated. When a function is executed based on the direction of movement of the finger 5 estimated in the wrong direction, a function different from the function intended by the user is executed, which impairs user convenience.

  In this regard, for example, when a fingerprint image that can provide sufficient reliability for estimating the moving direction cannot be captured from the fingerprint sensor 3, the function is not executed via the fingerprint sensor 3. It is also possible. However, in this case, since the function is not executed even when the estimated movement direction of the finger 5 is correct, the convenience for the user is also impaired. Therefore, there is a demand for a technique capable of verifying the accuracy of the moving direction of the finger 5 estimated based on the fingerprint image captured by the fingerprint sensor 3 when executing the function via the fingerprint sensor 3.

  In some embodiments, when the function is executed via the fingerprint sensor 3, the accuracy of the moving direction of the finger 5 estimated based on the fingerprint image captured by the fingerprint sensor 3 is calculated from the rotational motion sensor 2. Verification is performed based on the information on the rotational movement of the information processing apparatus 1 obtained. Therefore, it is possible to prevent a function different from that intended by the user from being executed based on the erroneously estimated movement direction of the finger 5.

  FIG. 3 is a diagram illustrating a functional block configuration of the information processing apparatus 1 according to some embodiments. The information processing apparatus 1 includes a control unit 300 and a storage unit 320, for example. The control unit 300 includes functional units 310 such as an authentication unit 311, a first estimation unit 312, a second estimation unit 313, a determination unit 314, and an execution unit 315. The storage unit 320 of the information processing apparatus 1 stores, for example, information 322 such as a program 321, function execution information 200, and movement rotation correspondence information 800 described later. The control unit 300 of the information processing apparatus 1 functions as the functional unit 310 such as the authentication unit 311, the first estimation unit 312, the second estimation unit 313, the determination unit 314, and the execution unit 315 by reading and executing the program 321. To do. Details of these functional units 310 and details of the information 322 stored in the storage unit 320 will be described later.

  Hereinafter, with reference to FIG. 4 to FIG. 11, the verification process of the execution instruction of the function input to the fingerprint sensor 3 according to the first embodiment will be described. FIG. 4 is a diagram illustrating a rotational axis of the rotational motion of the information processing device 1 detected by the rotational motion sensor 2 provided in the information processing device 1. As an example for description, the following three axes that are orthogonal to the information processing apparatus 1 are defined: a pitch axis 401, a yaw axis 402, and a roll axis 403.

  First, let the axis in the same direction as the short side of the display screen 6 of the information processing apparatus 1 be the pitch axis 401. Then, when the direction in which the right screw advances is matched with the direction from the left to the right (the direction of the arrow of the pitch axis 401) toward the display screen 6, the rotation direction of the axis that matches the rotation direction of the right screw is pitched. The rotation direction is the positive rotation direction, and the reverse rotation direction is the negative rotation direction of the pitch rotation.

  An axis in the same direction as the long side of the display screen 6 of the information processing apparatus 1 is a yaw axis 402. Then, when the direction in which the right screw advances is matched with the direction from the bottom to the top of the display screen 6 (the direction of the arrow of the yaw axis 402), the rotation direction of the axis that coincides with the rotation direction of the right screw A positive rotation direction is set, and a reverse rotation direction is set as a negative rotation direction of the yaw rotation.

  A direction perpendicular to the display screen 6 is a roll axis 403. For example, the side on which the display screen 6 of the information processing apparatus 1 is provided is the front surface, and the opposite surface is the back surface. In this case, when the direction in which the right screw advances is matched with the direction from the back surface to the front surface of the information processing apparatus 1 (the direction of the arrow of the roll shaft 403), the rotation direction of the axis that matches the rotation direction of the right screw is The positive rotation direction of the roll rotation is set, and the reverse rotation direction is set as the negative rotation direction of the roll rotation. Note that the vertical and horizontal directions of the display screen 6 of the information processing apparatus 1 may coincide with the vertical and horizontal directions of the display screen 6 assumed for the information processing apparatus 1 at the design stage, for example.

  For example, the pitch axis 401, the yaw axis 402, and the roll axis 403 determined as described above are used for the description of the rotational movement of the information processing apparatus 1 below. However, the embodiment is not limited to this, and for example, the pitch axis 401, the yaw axis 402, and the roll axis 403 described above may be interchanged. Alternatively, the orientations of the pitch axis 401, the yaw axis 402, and the roll axis 403 may be set in different directions with respect to the information processing apparatus 1. Further, for example, the positive and negative rotation directions around the pitch axis 401, the yaw axis 402, and the roll axis 403 may be reversed.

  FIG. 5 is a diagram illustrating a rotational motion that occurs in the information processing apparatus 1 when a function execution instruction is input via the fingerprint sensor 3 according to an embodiment. 5A to 5C show the information processing apparatus 1 and the user's finger 5 when inputting a function execution instruction to the fingerprint sensor 3 of the information processing apparatus 1. In addition, although the case where the fingerprint sensor 3 is provided on the back surface of the information processing apparatus 1 will be described as an example, the position where the fingerprint sensor 3 is provided is not limited thereto. For example, the fingerprint sensor 3 may be provided at an arbitrary position such as the surface of the information processing apparatus 1.

  FIG. 5 a shows a state immediately before starting to capture a fingerprint image when a finger 5 is placed on the fingerprint sensor 3 of the information processing apparatus 1 and a function execution instruction is input via the fingerprint sensor 3. Yes. FIG. 5 b shows a state in which a fingerprint image is captured while sliding the finger 5 downward with respect to the fingerprint sensor 3. In FIG. 5 b, when capturing a fingerprint image, the user moves while pressing the finger 5 against the fingerprint sensor 3. Therefore, a force is applied to the information processing apparatus 1 from the finger 5 in the direction of the arrow 51, and an angular velocity 52 around the pitch axis 401 is generated in the information processing apparatus 1 due to the force. Further, in this state, FIG. 5C illustrates a case where the fingerprint image capturing by the fingerprint sensor 3 is completed and the user releases the finger 5 from the back surface of the information processing apparatus 1. In FIG. 5 c, an angular velocity 53 around the pitch axis 401 is generated by a reaction in which the back surface of the information processing apparatus 1 is released from the force of the finger 5.

  FIG. 6 is a diagram illustrating a rotational motion that occurs in the information processing apparatus 1 when a function execution instruction is input via the fingerprint sensor 3 according to another embodiment. 6A and 6B show the information processing apparatus 1 and the user's finger 5 when a function execution instruction is input to the fingerprint sensor 3 of the information processing apparatus 1 via the fingerprint sensor 3. FIG. 6 a shows a state immediately before starting to capture a fingerprint image when a finger 5 is placed on the fingerprint sensor 3 of the information processing apparatus 1 and a function execution instruction is input via the fingerprint sensor 3. Yes. FIG. 6B shows a state where the finger 5 is slid in the upper left direction with respect to the fingerprint sensor 3 to capture the fingerprint image, and the capture is completed. As shown in the figure, the information processing apparatus 1 rotates in a roll with the finger 5 supporting the information processing apparatus 1 as a fulcrum by the reaction of sliding the finger 5 in the upper left direction with respect to the fingerprint sensor 3.

  For example, as described above, a force is applied to the information processing device 1 according to the moving direction of the finger 5 when inputting a function execution instruction to the information processing device 1, and the information processing is performed according to the direction of the force. The device 1 has a rotational movement. This rotational motion shows a tendency according to the moving direction of the finger 5 when inputting a function execution instruction. For example, in the example described with reference to FIG. 5, the movement direction of the finger 5 when inputting a function execution instruction to the fingerprint sensor 3 is along the yaw axis 402 direction. In this case, for example, the information processing apparatus 1 tends to cause pitch rotation. In addition, since the moving direction of the finger 5 is along the direction of one axis, other yaw rotation and roll rotation tend not to occur easily. As another example, when the finger 5 is moved left or right from the center on the fingerprint sensor 3 with the left and right sides of the information processing apparatus 1 being sandwiched between fingers, the direction of movement of the finger 5 is along the pitch axis direction. ing. In this case, for example, the information processing apparatus 1 tends to cause yaw rotation. Further, in the example described with reference to FIG. 6, the moving direction of the finger 5 when inputting a function execution instruction to the fingerprint sensor 3, the position of the finger 5 (fulcrum) when the user holds the information processing apparatus 1, and Depending on the shape and weight of the information processing apparatus 1, the rotational motion generated in the information processing apparatus 1 shows a predetermined tendency. Therefore, by creating information that associates the movement direction of the finger 5 when inputting a function execution instruction with the tendency of the rotational movement that occurs in the movement direction, the execution of the function from the rotational movement that has occurred in the information processing apparatus 1 It is possible to estimate the moving direction of the finger 5 at the time of the instruction.

  Therefore, in the first embodiment, information is created that associates the movement direction of the finger 5 when inputting a function execution instruction with the tendency of the rotational motion that occurs in the movement direction. FIG. 7 is a diagram for explaining sampling of the rotational motion that occurs in the information processing apparatus 1 according to the moving direction of the finger 5 when inputting a function execution instruction. FIG. 7 shows an example in which the rotational motion generated in the information processing device 1 according to the moving direction of the finger 5 when the function execution instruction is input to the information processing device 1 is sampled by the rotational motion sensor 2. 7a to 7c, the vertical axis represents angular velocity (degree / sec), and the horizontal axis represents sampling time (msec). Further, as an example, FIGS. 7 a to 7 c show a threshold 70 indicating a predetermined threshold, which will be described later. The sampling period on the horizontal axis is set so as to include a period from when the fingerprint sensor 3 starts to capture a fingerprint image (start point 71) to when it ends (end point 72). Sampling is performed at intervals of 10 msec over 1000 msec as an example, but the embodiment is not limited to this, and other sampling conditions may be used. 7a shows an example in which the rotational motion around the pitch axis 401 is sampled, FIG. 7b shows an example in which the rotational motion around the yaw axis 402 is sampled, and FIG. 7c shows an example in which the rotational motion around the roll axis 403 is sampled. ing. In the example shown in FIG. 7, the fingerprint image is input to the fingerprint sensor 3 while moving the finger 5 from the bottom to the top of the information processing apparatus 1, and the moving direction of the finger 5 is substantially along the direction of the yaw axis 402. ing. Therefore, the information processing apparatus 1 tends to cause pitch rotation during the fingerprint image capturing period by the fingerprint sensor 3, and the pitch rotation is also performed in the example shown in FIG. Moreover, in the example shown in FIG. 7, as shown in the figure, other yaw rotations and roll rotations are not so much generated.

  For example, such sampling is performed for each movement direction of the finger 5 assigned to the input of the function execution instruction by the fingerprint sensor 3. In one embodiment, sampling is executed a plurality of times for each movement direction set in the movement direction 201 of the function execution information 200. Then, from the sampling result, the tendency of the rotational motion generated in the information processing apparatus 1 corresponding to the moving direction of the finger 5 when inputting the function execution instruction by the fingerprint sensor 3 is acquired as a pattern.

  FIG. 8 is a diagram exemplifying movement / rotation correspondence information 800 for associating the rotational movement pattern acquired by the above sampling with the movement direction of the finger 5. The movement / rotation correspondence information 800 is stored in the storage unit 320 of the information processing apparatus 1 in one embodiment. The movement / rotation correspondence information 800 includes a movement direction 801 and a rotational movement pattern 802, and these pieces of information are associated with each other. A moving direction 801 represents the moving direction of the finger 5 when a fingerprint image is input to the fingerprint sensor 3. The rotational motion pattern 802 is information including a rotational motion pattern corresponding to the moving direction 801 obtained by the sampling described above. In the example of FIG. 8, the rotational motion pattern 802 includes a pitch rotation 803, a yaw rotation 804, and a roll rotation 805. It is out.

  In one embodiment, information about positive and negative of the rotation direction at the time of sampling may be stored in the pitch rotation 803, the yaw rotation 804, and the roll rotation 805 as the pattern of the rotational movement. In this case, for example, a predetermined threshold 70 is set for the angular velocity as illustrated in FIG. 7 in order to extract information about positive and negative in the rotational direction at the time of sampling as a pattern of rotational motion. And when the information processing apparatus 1 rotates exceeding the threshold 70, the code | symbol is acquired as a pattern of rotational motion. For example, when a fingerprint image is input to the fingerprint sensor 3 while moving the finger 5 from the bottom to the top of the information processing apparatus 1 in FIG. 7, the information processing apparatus 1 has an angular velocity exceeding the threshold 70 as shown in FIG. The pitch is rotated in the positive direction. Therefore, “positive” may be stored in the pitch rotation 803. 7b and 7c, since the yaw rotation and the roll rotation are not performed at an angular velocity exceeding the threshold 70, “none” may be stored in the yaw rotation 804 and the roll rotation 805. That is, in this case, as the rotational motion pattern 802 corresponding to the upper direction of movement 801 of the movement / rotation correspondence information 800 of FIG. 8, there is a pattern of pitch rotation 803: positive, yaw rotation 804: none, roll rotation 805: none. Stored. In other words, in one embodiment, in each of the pitch axis 401, the yaw axis 402, and the roll axis 403, the value of the angular velocity around the axis is positive, and the absolute value of the angular velocity value has a predetermined threshold value. If it exceeds, “Positive” is stored as the pattern of rotational movement of the axis. Further, in each of the pitch axis 401, the yaw axis 402, and the roll axis 403, the angular velocity value around the axis is negative and the absolute value of the angular velocity value exceeds a predetermined threshold value. Stores “negative” as the pattern of rotational movement of that axis. Further, when the absolute value of the angular velocity value is equal to or less than a predetermined threshold value in each of the pitch axis 401, the yaw axis 402, and the roll axis 403, “none” is stored as the rotational motion pattern of the axis. To do. For example, the rotational motion patterns of the pitch axis 401, the yaw axis 402, and the roll axis 403 may be acquired as described above.

  Further, as in the example described with reference to FIG. 5, when inputting a function execution instruction via the fingerprint sensor 3, the information processing apparatus 1 may be rotated in the negative direction after being rotated in the positive direction. Exists. For example, in such a case, if the absolute values of the angular velocities of the positive and negative pitch rotations both exceed the threshold value 70, for example, the change in the direction of pitch rotation in time series, such as “positive / negative”. The pattern may be stored in the pitch rotation 803. In another embodiment, the threshold value 70 may be provided for the rotation amount of the information processing apparatus 1 instead of the angular velocity. That is, for example, the threshold value 70 may be set for the integrated value of the graph of angular velocity in FIG. Further, as in the example described in FIG. 5, when the information processing apparatus 1 rotates in both the positive direction and the negative direction, the integration is performed separately for each of positive and negative, and positive and negative You may comprise so that rotation amount may be calculated | required and compared with the threshold value 70, respectively.

  Information stored in the rotational movement pattern 802 (that is, for example, pitch rotation 803, yaw rotation 804, and roll rotation 805) is not limited to this. For example, as long as the information can distinguish the finger moving direction when inputting a function execution instruction through the fingerprint sensor 3 based on the angular velocity of the information processing apparatus 1 detected in the moving direction, It may be information. For example, information stored as the rotational motion pattern 802 includes time information indicating the timing at which the angular velocity shifts from positive to negative, time waveform indicating the waveform of the angular velocity graph, the maximum value of the angular velocity, and the timing at which the maximum value of the angular velocity is reached. It may be. In the example of FIG. 8, an example is described in which the rotational movement pattern 802 includes information on the pitch rotation 803, the yaw rotation 804, and the roll rotation 805. However, the embodiment is not limited to this. For example, if it is possible to distinguish the moving direction of the finger when inputting a function execution instruction via the fingerprint sensor 3 based on the angular velocity detected by the rotational motion sensor 2, the pitch rotation 803, the yaw rotation 804, Information on some axes of the roll rotation 805 may not be included.

  FIG. 9 is a diagram illustrating a function execution process via the fingerprint sensor 3 executed by the control unit 300 of the information processing apparatus 1 according to the first embodiment. The operation flow of the function execution process of FIG. 9 is implemented, for example, when the control unit 300 of the information processing apparatus 1 reads and executes the program 321 stored in the storage unit 320. In one embodiment, the operation flow of FIG. 9 starts when fingerprint information is input to the fingerprint sensor 3 of the information processing apparatus 1 while the information processing apparatus 1 is locked. In step S <b> 901, the control unit 300 of the information processing apparatus 1 reads a fingerprint image with the fingerprint sensor 3. In step S <b> 902, the control unit 300 authenticates the user by determining whether the read fingerprint image matches the user's fingerprint registered in the information processing apparatus 1, for example. Note that the fingerprint information of the user of the information processing apparatus 1 may be stored in advance in the storage unit 320, for example. If the read fingerprint image does not match the user's fingerprint of the information processing apparatus 1 and the user authentication is not successful (No in step S902), the operation flow ends.

  On the other hand, when the read fingerprint image matches the fingerprint of the user registered in the information processing apparatus 1, the flow proceeds to step S903. In step S <b> 903, the control unit 300 unlocks the information processing apparatus 1. In step S904, the control unit 300 receives a fingerprint input to the fingerprint sensor 3 over a predetermined period. In step S905, the control unit 300 activates the rotational motion sensor 2 provided in the information processing apparatus 1.

  In step S906, the control unit 300 estimates the moving direction of the finger 5 based on a plurality of fingerprint images captured by the fingerprint sensor 3 when a fingerprint image is input to the fingerprint sensor 3 within a predetermined period. Then, it is determined whether or not the moving direction of the finger 5 has been estimated. When the moving direction of the finger 5 cannot be estimated (No in step S906), the operation flow ends. In step S904, since the direction of movement of the finger 5 cannot be estimated even when there is no input of fingerprint information for a predetermined period after the start of accepting fingerprint input to the fingerprint sensor 3, step S906 is No. The operation flow is terminated.

  On the other hand, when the moving direction of the finger 5 can be estimated (step S906 is Yes), the flow proceeds to step S907. In step S907, a rotational motion analysis process is executed. In the rotational motion analysis process, the rotational motion sensor 2 detects the rotational motion that occurs with the movement of the finger on the fingerprint sensor when the fingerprint image is input to the fingerprint sensor 3 that has been accepted in step S904. Then, based on the detected rotational motion, the moving direction of the finger 5 at the time of inputting the fingerprint image to the fingerprint sensor 3 performed in a predetermined period is estimated. The details of the rotational motion analysis process will be described later with reference to FIG. In step S908, the controller 300 determines the direction of movement of the finger 5 estimated based on the fingerprint image input to the fingerprint sensor 3 in step S906 and the finger estimated based on the rotational movement of the information processing apparatus 1 in step S907. It is determined whether or not the moving direction in FIG. If the movement direction of the finger 5 does not match (No in step S908), the operation flow ends. On the other hand, when the moving directions of the finger 5 match (Yes in step S908), the flow proceeds to step S909. In step S909, the control unit 300 executes the function execution process, executes the function of the information processing apparatus 1 associated with the moving direction of the finger 5, and the operation flow ends. Details of the function execution process will be described later with reference to FIG.

  In the operation flow of FIG. 9 described above, in the processing from step S901 to step S903, the control unit 300 of the information processing apparatus 1 functions as the authentication unit 311, for example. Further, in the processing of step S904 and step S906, the control unit 300 of the information processing apparatus 1 functions as, for example, the first estimation unit 312. In the processing of step S905 and step S907, the control unit 300 of the information processing device 1 functions as the second estimation unit 313, for example. In the process of step S908, the control unit 300 of the information processing apparatus 1 functions as the determination unit 314, for example. In the process of step S909, for example, the control unit 300 of the information processing apparatus 1 functions as the execution unit 315.

  Next, with reference to FIG. 10, details of the rotational motion analysis process executed in step S907 of FIG. 9 will be described. The operation flow illustrated in FIG. 10 is implemented, for example, when the control unit 300 of the information processing apparatus 1 reads and executes the program 321 stored in the storage unit 320. In the embodiment, when the process proceeds to step S907 in the operation flow in FIG. 9, the operation flow in FIG. 10 starts. In step S <b> 1001, the control unit 300 rotates the information about the rotational movement accompanying the movement of the finger on the fingerprint sensor that is generated when the fingerprint image is input to the fingerprint sensor 3 during a predetermined period, which has been started in step S <b> 905. Acquired by the motion sensor 2. The information about the rotational motion acquired by the rotational motion sensor 2 is, for example, data of angular velocities around the pitch axis 401, the yaw axis 402, and the roll axis 403 of the information processing apparatus 1.

  In step S <b> 1002, the control unit 300 identifies a rotational motion pattern from the acquired information about the rotational motion, and determines whether the identified pattern is registered in the movement / rotation correspondence information 800. In one embodiment, this determination is based on whether or not the detected time-series tendency of the angular velocity of the rotational motion corresponds to (for example, is similar to) the rotational motion pattern 802 registered in the motion / rotation correspondence information 800. This is done by determining whether or not. This determination may be performed as follows, for example. First, it is assumed that the rotational motion pattern 802 of the movement / rotation correspondence information 800 stores information about positive and negative in the rotational direction of the rotational motion or no rotation, as illustrated above. In step S <b> 1002, the control unit 300 compares the detected angular speeds of pitch rotation, yaw rotation, and roll rotation with the threshold 70, and determines whether the information processing apparatus 1 is rotating beyond the threshold 70. judge. Thereby, for each of the detected angular speeds of pitch rotation, yaw rotation, and roll rotation, it is determined whether the rotation direction is “positive”, “negative”, or “none”. A pattern of rotational movement that occurs when an instruction to execute a function input in a predetermined period is specified. Here, for example, a rotational motion pattern such as “pitch rotation: positive, yaw rotation: none, roll rotation: none” is specified. Then, the control unit 300 determines whether or not the specified rotational motion pattern such as “pitch rotation: positive, yaw rotation: none, roll rotation: none” is registered in the rotational motion pattern 802 of the movement / rotation correspondence information 800. Determine. For example, the determination in step S1002 may be executed as described above. As described above, the information specified as the rotational movement pattern is not limited to information indicating whether the rotation direction is “positive”, “negative”, or “none”. For example, other information such as the amount of rotation and the timing of reaching the maximum value of the angular velocity may be used for specifying the pattern.

  In step S1002, when the identified rotational movement pattern is registered in the rotational movement pattern 802 of the movement / rotation correspondence information 800 (step S1002 is Yes), the flow proceeds to step S1003. In step S1003, the control unit 300 acquires the movement direction 801 associated with the rotational movement pattern 802 that matches the rotational movement pattern specified in step S1002, from the movement / rotation correspondence information 800. Then, the control unit 300 returns the acquired moving direction 801 to the calling source step S907, and the operation flow ends.

  On the other hand, in step S1002, when the identified rotational motion pattern is not registered in the rotational motion pattern 802 of the movement / rotation correspondence information 800 (step S1002 is No), the flow proceeds to step S1004. In step S1004, the control unit 300 returns a determination abnormality notification indicating that the identified rotational movement pattern is not registered in the movement / rotation correspondence information 800 to the calling source step S907, and the operation flow ends. .

  Note that the moving direction 801 returned from step S1003 to step S907 is used for comparison of the moving direction in the subsequent step S908. If a notification of determination abnormality is returned from step S1004 to step S907, the subsequent step S908 is determined No, and the operation flow of FIG. 9 ends.

  In the operation flow of FIG. 10 described above, in the processing from step S1001 to step S1004, the control unit 300 of the information processing apparatus 1 functions as the second estimation unit 313, for example.

  Next, details of the function execution process executed in step S909 of FIG. 9 will be described with reference to FIG. The operation flow illustrated in FIG. 11 is implemented, for example, when the control unit 300 of the information processing apparatus 1 reads and executes the program 321 stored in the storage unit 320. In one embodiment, when the process proceeds to step S909 in the operation flow in FIG. 9, the operation flow in FIG. 11 starts. In step S <b> 1101, the control unit 300 determines whether the movement direction of the finger 5 determined to match in step S <b> 908 is registered in the function execution information 200. When the moving direction of the finger 5 is not registered in the function execution information 200 (No in step S1101), this operation flow ends. On the other hand, when the moving direction of the finger 5 is registered in the function execution information 200 (Yes in step S1101), the flow proceeds to step S1102. In step S1102, the control unit 300 executes the function associated with the moving direction of the finger 5 determined to be the same in step S908 in the function execution information 200, and the operation flow ends.

  In the operation flow of FIG. 11 described above, in the processing from step S1101 to step S1102, the control unit 300 of the information processing apparatus 1 functions as the execution unit 315, for example.

  9 to 11 described above, the control unit 300 of the information processing apparatus 1 performs fingerprint authentication based on the fingerprint image captured by the fingerprint sensor 3, and if the authentication can be performed, the information processing apparatus Unlock 1 When the lock is released, the control unit 300 accepts the fingerprint input to the fingerprint sensor 3 over a predetermined period by the fingerprint sensor 3 and activates the rotational motion sensor 2. When fingerprint information is input to the fingerprint sensor 3 within a predetermined period, the control unit 300 estimates the moving direction of the finger 5 based on the fingerprint image captured by the fingerprint sensor 3. In addition, the control unit 300 detects the rotational motion generated in the information processing apparatus 1 with the movement of the finger on the fingerprint sensor at the time of capturing the fingerprint image by the rotational motion sensor 2, and the finger based on the detected rotational motion. 5 direction of movement is estimated. Then, the movement direction of the finger 5 estimated based on the fingerprint image matches the movement direction of the finger 5 estimated based on the rotation movement of the information processing apparatus 1 detected by the rotation movement sensor 2 when the fingerprint image is captured. It is determined whether or not to do. Thereby, the certainty of the moving direction of the finger 5 estimated based on the fingerprint image can be verified. If the movement directions do not match, the movement direction of the finger 5 estimated based on the fingerprint image may be incorrect, so the function corresponding to the movement direction of the finger 5 is not executed. On the other hand, if the movement directions match, there is a high possibility that the movement direction of the finger 5 estimated based on the fingerprint image is correct. Therefore, a function corresponding to the movement direction of the finger 5 is executed.

  As described above, in the first embodiment, the accuracy of the moving direction of the finger 5 estimated based on the fingerprint image is verified based on the rotational motion generated in the information processing apparatus 1 when the fingerprint image is captured. Therefore, the accuracy of estimating the moving direction of the finger 5 can be improved. Therefore, when the movement direction of the finger 5 estimated based on the fingerprint image is incorrect, a function different from the user's intention is executed based on the erroneously estimated movement direction of the finger 5. Can be prevented.

  Moreover, in 1st Embodiment, it is comprised so that the rotational motion sensor 2 may be started with cancellation | release of a lock | rock. In other words, the activation of the rotational motion sensor 2 in the information processing apparatus 1 is restricted when the lock is released. This is because, for example, when the information processing apparatus 1 is in a locked state, the information processing apparatus 1 may be used illegally unless the user is authenticated, so that the user is not authenticated. This is because there is a situation where it is not necessary to activate the function using the fingerprint sensor 3. For example, with this configuration, the time for starting the rotational motion sensor 2 is limited, which leads to the power saving effect of the information processing apparatus 1.

  In the first embodiment, a period during which a function execution instruction can be input via the fingerprint sensor 3 is limited to a predetermined period after the lock is released. This is because, for example, in the information processing apparatus 1, there is a possibility that a rotational motion other than the movement of the finger 5 on the fingerprint sensor 3 at the time of inputting a function execution instruction may occur. This is because the motion is also detected by the rotational motion sensor 2. For this reason, the period during which the function execution instruction can be input via the fingerprint sensor 3 is limited to a predetermined period after the lock is released, and the information processing apparatus is caused by the input of the function execution instruction via the fingerprint sensor 3. The rotational motion generated in 1 can be specified. In other words, in the first embodiment, for example, a rotational motion caused by inputting a function execution instruction via the fingerprint sensor 3 is specified as a rotational motion that occurs in the information processing apparatus 1 immediately after unlocking.

  In addition, regarding the limitation on the period during which a function execution instruction can be input via the fingerprint sensor 3, as another aspect, the user can perform an authentication operation using a fingerprint using the fingerprint sensor 3 as long as the lock is released. It is not necessary to perform. In addition, there is a case where it is possible to input a function execution instruction through another device such as a touch panel provided in the information processing device 1 as long as the lock is released. In such a situation, it may not be necessary to input a function execution instruction via the fingerprint sensor 3. Therefore, in the first embodiment, the period during which a function execution instruction can be input via the fingerprint sensor 3 is limited to a predetermined period after the lock is released. However, the embodiment is not limited to this. In the second embodiment to be described later, a case where a period during which a function execution instruction can be input via the fingerprint sensor 3 is not limited is illustrated.

  Hereinafter, the second embodiment will be described with reference to FIGS. 12 and 13. In the second embodiment, among the rotational motion data of the information processing apparatus 1 detected by the rotational motion sensor 2, rotational motion data during a period in which a fingerprint image is captured by the fingerprint sensor 3 is used. FIG. 12 is a diagram for explaining identification of a period during which a function execution instruction is input via the fingerprint sensor 3 according to the second embodiment. In the second embodiment, the rotational motion sensor 2 may always be activated while the information processing apparatus 1 is activated.

  When the moving direction of the finger 5 can be estimated based on the fingerprint image captured by the fingerprint sensor 3, the moving amount of the finger 5 on the fingerprint sensor 3 can also be specified based on the fingerprint image. FIG. 12 a shows the amount of movement of the finger 5 when the finger 5 is moved from the bottom to the top of the information processing apparatus 1 to input a fingerprint image to the fingerprint sensor 3 and a function execution instruction is input to the information processing apparatus 1. It is a figure which illustrates time change. In FIG. 12a, the vertical axis represents the movement amount of the finger 5 detected based on the fingerprint image. In addition, the horizontal axis represents the time including the period during which the fingerprint image was captured by the fingerprint sensor 3. In FIG. 12a, during a period when the function execution instruction is input via the fingerprint sensor 3, for example, from when the movement amount of the finger 5 starts to increase (increase start point 1201) until the increase stops (increase end point 1202). Can be specified as a period of time. In the second embodiment, the rotational motion of the information processing device 1 detected by the rotational motion sensor 2 is detected in the moving direction of the finger 5 during the period when the function execution instruction is input via the specified fingerprint sensor 3. Used to estimate For example, FIG. 12b shows a change in the angular velocity of pitch rotation detected by the rotational motion sensor 2 in the same period as FIG. 12a. Then, in FIG. 12b, for example, the angular velocity in the same period as the period from when the movement amount of the finger 5 in FIG. 12a starts to increase (increase start point 1201) to when the increase stops (increase end point 1202) is specified. The direction of movement of the finger 5 is estimated based on the angular velocity at.

  FIG. 13 is a diagram illustrating a function execution process via the fingerprint sensor 3 executed by the control unit 300 of the information processing apparatus 1 according to the second embodiment. The operation flow of the function execution process of FIG. 13 is implemented, for example, when the control unit 300 of the information processing apparatus 1 reads and executes the program 321 stored in the storage unit 320. In one embodiment, the operation flow of FIG. 13 starts when fingerprint information is input to the fingerprint sensor 3 of the information processing apparatus 1 while the information processing apparatus 1 is not locked. In step S1301, the control unit 300 estimates the moving direction of the finger 5 with respect to the input fingerprint image. In step S1302, the control unit 300 determines whether the movement direction of the finger 5 has been estimated from the input fingerprint image. When the moving direction of the finger 5 cannot be estimated from the input fingerprint image (No in step S1302), the operation flow ends.

  On the other hand, when the moving direction of the finger 5 can be estimated from the input fingerprint image (Yes in step S1302), the flow proceeds to step S1303. In step S <b> 1303, the control unit 300 acquires rotational motion data of the information processing apparatus 1 detected by the rotational motion sensor 2 during a period in which a fingerprint image is captured by the fingerprint sensor 3. The period during which the fingerprint image is captured by the fingerprint sensor 3 is, for example, from when the movement amount of the finger 5 estimated based on the fingerprint image starts to increase until the increase stops as described with reference to FIG. It may be specified as a period. Note that the rotational motion acquired by the rotational motion sensor 2 in step S1303 is, for example, an angular velocity around the pitch axis 401, the yaw axis 402, and the roll axis 403 of the information processing apparatus 1.

  In step S1304, the control unit 300 identifies a rotational motion pattern from the acquired rotational motion data, and determines whether or not the identified pattern is registered in the movement / rotation correspondence information 800. In one embodiment, this determination is based on whether or not the detected time-series tendency of the angular velocity of the rotational motion corresponds to (for example, is similar to) the rotational motion pattern 802 registered in the motion / rotation correspondence information 800. It is done by judging. For example, this determination may be performed in the same manner as in step S1002.

  In step S1304, when the identified rotational movement pattern is registered in the rotational movement pattern 802 of the movement / rotation correspondence information 800 (step S1304 is Yes), the flow proceeds to step S1305. In step S1305, the control unit 300 acquires the movement direction 801 associated with the rotational movement pattern 802 that matches the rotational movement pattern specified in step S1304 from the movement rotation correspondence information 800. Accordingly, the control unit 300 estimates the moving direction of the finger 5 when inputting a function execution instruction to the fingerprint sensor 3. If the controller 300 estimates the moving direction of the finger when inputting a function execution instruction to the fingerprint sensor 3 based on the rotational motion, the flow proceeds to step S1307.

  On the other hand, in step S1304, when the identified rotational motion pattern is not registered in the rotational motion pattern 802 of the movement / rotation correspondence information 800 (step S1304 is No), the flow proceeds to step S1306. In step S1306, the control unit 300 returns a determination abnormality notification indicating that the identified rotational movement pattern is not registered in the movement / rotation correspondence information 800 to the subsequent step S1307, and the flow proceeds to step S1307.

  In step S1307, the controller 300 determines that the movement direction 801 estimated based on the rotational motion acquired in step S1305 is the movement direction of the finger 5 estimated based on the fingerprint image input to the fingerprint sensor 3 in step S1302. It is determined whether or not they match. If the movement direction of the finger 5 does not match (No in step S1307), the operation flow ends. On the other hand, when the movement directions of the finger 5 match (Yes in step S1307), the flow proceeds to step S1308. If a notification of determination abnormality is returned from step S1306 to step S1307, the subsequent step S1307 is determined as No, and this operation flow ends. In step S1308, the control unit 300 executes the function execution process, executes the function of the information processing apparatus 1 associated with the moving direction of the finger 5, and the operation flow ends. In one embodiment, the function execution process of step S1308 may be executed according to the operation flow of FIG.

  In the operation flow of FIG. 13 described above, in the processing from step S1301 to step S1302, the control unit 300 of the information processing apparatus 1 functions as, for example, the first estimation unit 312. In the processing from step S1303 to step S1306, the control unit 300 of the information processing apparatus 1 functions as, for example, the second estimation unit 313. In the process of step S1307, the control unit 300 of the information processing apparatus 1 functions as the determination unit 314, for example. In the process of step S1308, for example, the control unit 300 of the information processing apparatus 1 functions as the execution unit 315.

  13, the control unit 300 of the information processing apparatus 1 estimates the moving direction of the finger 5 based on the fingerprint image input to the fingerprint sensor 3. The control unit 300 inputs a function execution instruction to the fingerprint sensor 3 based on the rotational motion of the information processing apparatus 1 detected by the rotational motion sensor 2 during the period when the fingerprint image is captured by the fingerprint sensor 3. The moving direction of the finger 5 at the time of performing is estimated. Then, the movement direction of the finger 5 estimated based on the fingerprint image matches the movement direction of the finger 5 estimated based on the rotation movement of the information processing apparatus 1 detected by the rotation movement sensor 2 when the fingerprint image is captured. It is determined whether or not to do. Thereby, the certainty of the moving direction of the finger 5 estimated based on the fingerprint image can be verified. If the movement directions do not match, the movement direction of the finger 5 estimated based on the fingerprint image may be incorrect, so the function corresponding to the movement direction of the finger 5 is not executed. On the other hand, if the movement directions match, there is a high possibility that the movement direction of the finger 5 estimated based on the fingerprint image is correct. Therefore, a function corresponding to the movement direction of the finger 5 is executed.

  As described above, in the second embodiment, the accuracy of the moving direction of the finger 5 estimated based on the fingerprint image is verified based on the rotational motion generated in the information processing apparatus 1 when the fingerprint image is captured. Therefore, the accuracy of estimating the moving direction of the finger 5 can be improved. Therefore, when the movement direction of the finger 5 estimated based on the fingerprint image is incorrect, a function different from the user's intention is executed based on the erroneously estimated movement direction of the finger 5. Can be prevented.

  Further, in the information processing apparatus 1, there is a possibility that a rotational motion occurs due to other than the movement of the finger 5 on the fingerprint sensor 3 when inputting a function execution instruction. Such a rotational motion is also rotated. It is detected by the motion sensor 2. Therefore, in order to estimate the moving direction of the finger 5 on the fingerprint sensor 3 when inputting a function execution instruction based on the rotational motion detected by the rotational motion sensor 2, the function via the fingerprint sensor 3 is estimated. It is necessary to specify the rotational motion that occurs in the information processing apparatus 1 due to the input of the execution instruction. In the second embodiment, for example, a period from when the movement amount of the finger 5 estimated based on the fingerprint image starts to increase until the increase stops is specified as a period during which the fingerprint image is captured by the fingerprint sensor 3. The rotational movement in the period is used for estimating the moving direction of the finger 5. Therefore, in the second embodiment, the period during which a function execution instruction can be input via the fingerprint sensor 3 may not be limited to a predetermined period.

  Subsequently, a hardware configuration example of the information processing apparatus 1 will be described. FIG. 14 is a diagram illustrating a hardware configuration of a computer 1400 for realizing the information processing apparatus 1 according to some embodiments. The hardware configuration for realizing the information processing apparatus 1 in FIG. 14 includes, for example, a processor 1401, a memory 1402, a storage device 1403, a reading device 1404, and a communication interface 1406. Furthermore, the hardware configuration for realizing the information processing apparatus 1 of FIG. 14 includes an input / output interface 1407, a rotational motion sensor 1408, and a fingerprint sensor 1409. Note that the processor 1401, the memory 1402, the storage device 1403, the reading device 1404, the communication interface 1406, and the input / output interface 1407 are connected to each other via a bus 1420, for example.

  The processor 1401 provides a part or all of the functions of each functional unit 310 described above by executing the program 321 describing the procedure of the above-described operation flow using the memory 1402. The control unit 300 of the information processing apparatus 1 is, for example, a processor 1401, and the storage unit 320 is, for example, a memory 1402, a storage device 1403, and a removable storage medium 1405. For example, the processor 1401 functions as the authentication unit 311, the first estimation unit 312, the second estimation unit 313, the determination unit 314, and the execution unit 315 by reading and executing the program 321 stored in the storage device 1403. . For example, the function execution information 200 and the movement / rotation correspondence information 800 are stored in the storage device 1403 of the computer 1400.

  The memory 1402 is a semiconductor memory, for example, and includes a RAM area and a ROM area. The storage device 1403 is, for example, a hard disk, a semiconductor memory such as a flash memory (SSD (Solid State Drive) or the like), or an external storage device. The reading device 1404 accesses the removable storage medium 1405 according to instructions from the processor 1401. The detachable storage medium 1405 is, for example, a semiconductor device (USB memory or the like), a medium (information such as a magnetic disk) to which information is input / output by a magnetic action, For example, a DVD).

  The communication interface 1406 transmits and receives data via the network 1430 in accordance with instructions from the processor 1401. The communication interface 1406 is connected to a wireless communication device that performs calculations related to communication processing such as band processing of a signal from an antenna (RF), and transmits and receives data via the antenna (RF). The input / output interface 1407 corresponds to an interface between an input device such as a microphone, a keyboard, and a mouse, and an output device such as a display device and a speaker. The input / output interface 1407 is connected to, for example, a rotational motion sensor 1408 and a fingerprint sensor 1409. For example, the input / output interface 1407 outputs a signal input from the processor 1401 to the rotational motion sensor 1408 and the fingerprint sensor 1409. In addition, the input / output interface 1407 passes, for example, signals input from the rotational motion sensor 1408 and the fingerprint sensor 1409 to the processor 1401 or the memory 1402.

  The fingerprint sensor 3 of the information processing apparatus 1 is a fingerprint sensor 1409, for example. The fingerprint sensor 1409 includes a sensor for reading a fingerprint such as a sweep type fingerprint sensor, for example, and outputs an image of the captured fingerprint to the input / output interface 1407, for example. The rotational motion sensor 2 of the information processing apparatus 1 is a rotational motion sensor 1408, for example. The rotational motion sensor 1408 is, for example, an angular velocity sensor that detects an angular velocity, and outputs the detected angular velocity to the input / output interface 1407.

The program 321 according to the embodiment is provided to the information processing apparatus 1 in the following form, for example.
(1) Installed in advance in the storage device 1403.
(2) Provided by the removable storage medium 1405.
(3) Provided from a server 1440 such as a program server.

  In the above, several embodiments have been described. However, the embodiments according to the present invention are not limited to the above-described embodiments, but should be understood as including various modifications and alternative forms of the above-described embodiments. For example, it will be understood that various embodiments can be embodied by modifying the components without departing from the spirit and scope thereof. Further, it will be understood that various embodiments according to the present invention can be formed by appropriately combining a plurality of constituent elements disclosed in the above-described embodiments. Alternatively, various implementations according to the present invention may be made by deleting or replacing some components from all the components shown in the embodiment, or adding some components to the components shown in the embodiment. One skilled in the art will appreciate that the form may be implemented.

DESCRIPTION OF SYMBOLS 1 Information processing apparatus 2 Rotational motion sensor 3 Fingerprint sensor 5 Finger 300 Control part 311 Authentication part 312 1st estimation part 313 2nd estimation part 314 Determination part 315 Execution part 320 Storage part 1400 Computer 1401 Processor 1402 Memory 1403 Storage apparatus 1404 Reading apparatus 1405 Removable storage medium 1406 Communication interface 1407 Input / output interface 1408 Rotational motion sensor 1409 Fingerprint sensor 1420 Bus 1430 Network 1440 Server

Claims (7)

A fingerprint sensor that captures a fingerprint of a finger and obtains a fingerprint image;
A first estimation unit that estimates a moving direction of the finger when the fingerprint image is captured based on a fingerprint image captured by the fingerprint sensor while moving the finger on the fingerprint sensor;
A rotational motion sensor for detecting rotational motion associated with movement of the finger on the fingerprint sensor;
A second estimation unit configured to estimate a moving direction of the finger when the fingerprint image is captured based on the rotational motion detected by the rotational motion sensor when capturing the fingerprint image;
A determination unit that determines whether or not the finger movement direction estimated by the first estimation unit matches the finger movement direction estimated by the second estimation unit;
An execution unit that executes a function corresponding to the direction of movement of the finger when the determination unit determines that they match;
An information processing apparatus comprising:   The second estimation unit is configured to detect the rotational motion of the information processing apparatus detected by the rotational motion sensor when the fingerprint image is captured in the movement / rotation correspondence information in which the movement direction is associated with the pattern of the rotational motion. The information processing apparatus according to claim 1, wherein the movement direction of the finger is estimated by acquiring a movement direction associated with a pattern of rotational motion to which.   The rotational movement pattern included in the movement / rotation correspondence information is obtained when the pitch axis, yaw axis, and roll axis, which are three axes orthogonal to each other, are defined as the rotation axes of the information processing apparatus. The shaft and the roll shaft each include information indicating whether a rotation direction around the axis is a positive direction, a negative direction, or no rotation. Information processing device. The rotational motion sensor is an angular velocity sensor;
The second estimator is configured in each of the pitch axis, the yaw axis, and the roll axis of the information processing apparatus,
When the angular velocity value detected by the angular velocity sensor when capturing the fingerprint image is positive, and the absolute value of the angular velocity value exceeds a predetermined threshold value, the positive direction is determined.
When the angular velocity value detected by the angular velocity sensor when capturing the fingerprint image is negative, and the absolute value of the angular velocity value exceeds a predetermined threshold, the negative direction is determined.
When the absolute value of the angular velocity value detected by the angular velocity sensor when capturing the fingerprint image is equal to or less than the predetermined threshold, it is determined that there is no rotation.
The information processing apparatus according to claim 3, wherein a pattern of a rotational motion generated in the information processing apparatus when the fingerprint image is captured is specified.   The execution unit acquires and executes a function corresponding to the finger movement direction determined to be the same by the determination unit from function information that associates a finger movement direction with a function. Item 5. The information processing apparatus according to any one of Items 1 to 4. Obtaining a fingerprint image captured by the fingerprint sensor while moving a finger on the fingerprint sensor provided in the computer,
Based on the fingerprint image, estimate the moving direction of the finger when capturing the fingerprint image,
A rotational motion sensor that detects a rotational motion associated with the movement of the finger on the fingerprint sensor acquires a rotational motion of the computer that is detected when the fingerprint image is captured;
Based on the rotational movement of the computer, estimate the direction of movement of the finger when capturing the fingerprint image,
When the movement direction of the finger estimated based on the fingerprint image matches the movement direction of the finger estimated based on the rotational movement of the computer, a function corresponding to the movement direction of the finger is executed. To
A program that causes a computer to execute processing. Obtaining a fingerprint image captured by the fingerprint sensor while moving a finger on the fingerprint sensor provided in the information processing apparatus;
Estimating the moving direction of the finger when capturing the fingerprint image based on the fingerprint image;
Obtaining a rotational motion of the information processing device detected when the fingerprint image is captured by a rotational motion sensor that detects a rotational motion associated with movement of the finger on the fingerprint sensor;
Estimating the direction of movement of the finger when capturing the fingerprint image based on the rotational movement of the information processing apparatus;
A function corresponding to the direction of movement of the finger when the direction of movement of the finger estimated based on the fingerprint image matches the direction of movement of the finger estimated based on the rotational movement of the information processing apparatus; A step of executing
A method executed by the information processing apparatus.