JP6272069B2 - Information processing apparatus, information processing method, computer program, and recording medium - Google Patents

Description

  The present invention relates to a technique for displaying a GUI object operated by a user in an information processing apparatus having a GUI (Graphics User Interface).

  A user often operates a portable information processing apparatus having a touch panel such as a smartphone while holding it with one hand. For example, the user operates the GUI object displayed on the display screen of the touch panel with the thumb, and supports the information processing apparatus main body with the other fingers. When an operation is performed with one hand, an area where the user's thumb is difficult to reach may occur on the touch panel depending on the size of the user's hand and how the information processing apparatus is held. In this case, it becomes difficult for the user to operate the GUI object displayed in the region where the thumb is difficult to reach. In order to facilitate user operations, techniques such as Patent Documents 1 and 2 have been proposed.

  Patent Document 1 discloses an information processing apparatus in which a user determines a movable range of a finger by performing a drawing operation on a touch panel with a finger or the like, and displays a GUI object within the range. Patent Document 2 specifies an area that is easy for a user to operate based on an average curvature radius and a curvature center coordinate of a trajectory of a finger touch position by a drag operation or a flick operation, and displays a GUI object in the area. An information processing apparatus is disclosed.

JP 2007-274136 A JP 2012-108674 A

  In Patent Document 1, a GUI object is displayed in an area explicitly designated by the user. In Patent Document 2, there is no explicit area instruction from the user. However, it is necessary to perform a drag operation or a flick operation in advance. As described above, in any technique, after the user performs an input operation on the touch panel, control is performed on the display position of the GUI object, and the initial operation may be troublesome for the user.

  In order to solve the above problems, it is a main object of the present invention to provide a portable information processing terminal with improved operability when operated with one hand.

An information processing apparatus of the present invention that solves the above problem is a touch panel that is a display screen for displaying an object, and includes an operation receiving unit that receives a user's operation instruction and a first image that represents biological information of the user's finger. A holding means for holding; a sensor for reading biometric information of the user's finger; acquiring a second image representing the read biometric information; and the second image and the first image read by the sensor A collation means for collating features; and, as a result of collation by the collation means, if it is considered that the features of the first image and the second image match, the second image with respect to the first image rotation angle on the basis to identify the direction of the finger operating the sensor, is displayed on the distance a position closer than the initial state of the said object on said display screen based on the direction of the specified finger finger Characterized by comprising determination means for determining the display area of the object so that, and a display control means for displaying the object in the display area.

  According to the present invention, since the display area of the object is determined based on the direction of the finger that operated the operation means, it is possible to improve the operability when operating the information processing apparatus with one hand.

(A)-(c) is a figure showing the structure of information processing apparatus. The flowchart showing a fingerprint registration process. Explanatory drawing of a fingerprint registration process. The flowchart showing a lock release process. (A), (b) is a figure showing operation | movement at the time of lock release. The functional block diagram of information processing apparatus. The flowchart showing the process which registers a display area. (A) is an illustration figure of guidance, (b) is explanatory drawing of the calculation process of a display area.

  Hereinafter, embodiments will be described in detail with reference to the drawings. However, the components described in the present embodiment are merely examples, and are not intended to limit the scope of the present invention only to them.

  In the present embodiment, a portable information processing apparatus including a touch panel and a home button having a fingerprint reading sensor will be described. The “home button” is an operation unit operated to return the information processing apparatus in the sleep state to the operation state. Also, an instruction to return from an individual application execution screen to a so-called home screen (an initial screen that can be changed to a setting menu of an application or various functions) is input by an operation of pressing the home button. A smartphone or a tablet PC (Personal Computer) can be used for such an information processing apparatus.

  Generally, this type of information processing apparatus is locked when the operation is not performed for a certain period of time and enters a sleep state. The information processing apparatus that is “locked” does not accept user operations unless user authentication is performed. The information processing apparatus according to the present embodiment uses a fingerprint authentication technique for user authentication. A fingerprint reading sensor for acquiring a fingerprint is provided on the home button. When the user presses the home button, the fingerprint reading sensor reads the user's fingerprint. The information processing apparatus can perform user authentication by fingerprint authentication based on the fingerprint image read by the fingerprint reading sensor. When the user authentication is completed, the information processing apparatus releases the lock and displays the GUI object on the display screen of the touch panel. FIG. 1 is a diagram illustrating the configuration of such an information processing apparatus 100.

  FIG. 1A is a hardware configuration diagram of the information processing apparatus 100. The information processing apparatus 100 is a computer including a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, and a RAM (Random Access Memory) 103. The CPU 101 reads the computer program stored in the ROM 102 and executes the RAM 103 as a work area, thereby controlling the operation of the information processing apparatus 100. The computer program may be stored in an HDD (Hard Disk Drive) 104. In addition to this, the HDD 104 stores electronic data such as fingerprint image data representing the fingerprint image of the user.

  Note that the computer program and electronic data may be stored in an external storage device. The external storage device can be realized by, for example, a medium (recording medium) and an external storage drive for realizing access to the medium in addition to a device connected to the information processing apparatus 100 via a network. . As such a medium, for example, a flexible disk (FD), a CD-ROM, a DVD, a USB memory, an MO, a flash memory, or the like can be used.

  In addition, the information processing apparatus 100 includes a fingerprint reading sensor 105, a touch panel 107, and a button operation unit 108. The fingerprint reading sensor 105 is provided on the home button, reads a user's fingerprint, and acquires data (fingerprint image data) of the image (fingerprint image). The fingerprint reading sensor 105 of the present embodiment is a capacitive type, reads a change in charge due to fingerprint irregularities, and acquires fingerprint image data from the amount of charge. The fingerprint image data is a digital signal and is used for image processing such as fingerprint collation processing described later. Note that the fingerprint reading sensor is not limited to the capacitive method, and may be a pressure-sensitive method or an optical method. In the present embodiment, the fingerprint reading sensor 105 is installed on the surface of the home button.

  The touch panel 107 includes a display and a pointing device that detects a touch position. The touch panel 107 displays an image such as a GUI object on a display. The pointing device is, for example, a transparent sheet, and is superimposed on the display screen of the display. When the user touches the display, the pointing device detects the touch position and transmits the detected touch position to the CPU 101. For example, the CPU 101 specifies a GUI object displayed at a position on the display screen corresponding to the touch position transmitted from the pointing device, and executes a process associated with the specified GUI object. In the present embodiment, the touch panel 107 is a capacitive method, but is not limited thereto, and may be a pressure-sensitive method or an optical method, for example.

  The button operation unit 108 is a physical button such as a home button. When the button is operated (pressed) by the user, an operation instruction associated with the button is received and input to the CPU 101. The CPU 101 executes processing according to the operation instruction. For example, when the home button is pressed, an instruction to return from the sleep state or to change to the home screen is input to the CPU 101. In this embodiment, if the information processing apparatus 100 is in a locked state when the home button is pressed, a release instruction for releasing the locked state is input based on fingerprint data acquired by the fingerprint reading sensor 105 when the home button is pressed. Is done.

  FIG. 1B is a functional block diagram of the information processing apparatus 100. When the CPU 101 executes the computer program, the functional blocks of the acquisition unit 109, the collation unit 110, the identification unit 111, the display control unit 112, the storage unit 113, and the operation detection unit 114 are realized in the information processing apparatus 100. Each functional block may be configured by hardware in addition to being realized by software processing as described above. In that case, each functional block is realized by combining arithmetic circuits and the like.

  The acquisition unit 109 acquires fingerprint image data from the fingerprint reading sensor 105. The collation unit 110 registers the fingerprint image data acquired by the acquisition unit 109 as a fingerprint image of a user permitted to operate the information processing apparatus 100 and stores the fingerprint image data in the storage unit 113. The collation unit 110 collates the fingerprint image data acquired by the acquisition unit 109 when the lock is applied and the fingerprint image data stored in the storage unit 113. In this embodiment, the matching process is performed by a minutia matching method that has a high use record in fingerprint matching. In the minutia matching method, minutiae (feature points) are first extracted from a fingerprint image. The feature points are, for example, the center point of the fingerprint pattern, the branch point of the fingerprint convex line, the end point of the fingerprint convex line, and the like. The collation unit 110 associates feature points extracted from each of the fingerprint images represented by the two fingerprint image data to be collated one by one. The collation unit 110 uses the number of points that can be matched as the similarity, and determines that the two fingerprint images match if the similarity is equal to or greater than a threshold value. When the collation unit 110 determines that the two fingerprint images match, the specifying unit 111 operates the information processing apparatus 100 based on the rotation angle of the collated fingerprint image with respect to the registered fingerprint image. Specify the finger direction. The display control unit 112 generates a display image and displays it on the display of the touch panel 107. The display control unit 112 determines an area for displaying the GUI object according to the direction of the finger specified by the specifying unit 111. The storage unit 113 stores data used for processing in each functional block. For example, the storage unit 113 stores fingerprint image data registered in advance by the user for use in the collation processing, data indicating the correspondence between the fingerprint image used for the processing for specifying the finger direction and the direction of the finger, and configuration data for the image displayed on the display Memorize etc. The operation detection unit 114 detects an instruction input by the user operating the button operation unit 108 such as a home button or the touch panel 107. For example, the operation detection unit 114 detects a return instruction from a sleep state or an instruction to transition to the home screen transmitted from the home button when the home button is pressed. In the present embodiment, if the information processing apparatus 100 is in a locked state when the home button is pressed, a release instruction for releasing the locked state is further detected based on fingerprint data.

  FIG. 1C is an external view of the information processing apparatus 100. The information processing apparatus 100 includes a home button provided with a fingerprint reading sensor 105 in the lower surface of the touch panel 107. When the user operates the information processing apparatus 100 with one hand, the touch panel 107 and the home button are touched with the thumb of one hand. In addition, since the user who releases the lock by pressing the home button starts the touch operation on the touch panel 107 immediately after that, the user is unlikely to change the way of holding the information processing apparatus 100 during that time. In this embodiment, since the positional relationship between the home button and the touch panel 107 is fixed, the movable range of the user's finger on the touch panel 107 is estimated based on the orientation of the user's finger when the home button is pressed. It becomes possible. Note that the arrangement of the home button is not limited to the lower part of the touch panel 107 as long as the positional relationship between the touch panel 107 and the home button can be specified.

  FIG. 2 is a flowchart showing processing for registering a user's fingerprint in the information processing apparatus 100. The information processing apparatus 100 has, for example, an application program for registering a fingerprint, and the user's fingerprint can be registered by starting this application program. When the application program is activated, the display control unit 112 displays a guidance image for explaining a fingerprint registration method to the user on the display of the touch panel 107 (S201). FIG. 3 is an explanatory diagram of the fingerprint registration process. A guidance image 401 instructs the user how to register a fingerprint.

  The information processing apparatus 100 displaying the guidance image 401 waits for the user to press the home button with the thumb 402 in accordance with the instruction of the guidance image 401 (S202). When the user presses the home button (S202: Y), the fingerprint reading sensor 105 reads the user's fingerprint. The acquisition unit 109 acquires fingerprint image data of the fingerprint read by the fingerprint reading sensor 105 (S203). When the fingerprint image data is acquired, the display control unit 112 displays the fingerprint image on the touch panel 107 based on the acquired fingerprint image data (S204). Along with the fingerprint image, the display control unit 112 displays an “OK” button for registering the fingerprint image and a “redo” button for rereading the fingerprint image on the touch panel 107.

  The user confirms the fingerprint image and presses the “OK” button or the “Redo” button (S205). When the operation detection unit 114 detects that the user has pressed the “Redo” button (S205: N), the display control unit 112 displays the guidance image 401 on the touch panel 107 again (S201). When the operation detection unit 114 detects that the user has pressed the “OK” button (S205: Y), the collation unit 110 uses the fingerprint image data of the displayed fingerprint image to allow the user to operate the information processing apparatus 100. Is registered as a fingerprint image and stored in the storage unit 113 (S206). In this way, registration of the user's fingerprint is completed.

  At the time of registering the fingerprint, the home button is pressed in a state where the direction of the straight line 403 passing from the base of the thumb 402 to the straight line 404 passing from the lower end of the surface of the touch panel 107 to the upper end coincides. In the present embodiment, the rotation angle of the orientation (straight line 403) of the thumb 402 in the registered state with respect to the straight line 404 is “0 degree”.

  FIG. 4 is a flowchart showing a process of releasing the lock by performing user authentication by fingerprint authentication from a state where the information processing apparatus 100 is locked. The unlocking process is performed when the user presses the home button and the fingerprint reading sensor 105 reads the user's fingerprint. The acquisition unit 109 acquires fingerprint image data of the fingerprint image read by the fingerprint reading sensor 105 (S301). This fingerprint image is an authentication fingerprint image (hereinafter referred to as “authentication fingerprint image”) to be compared with a fingerprint image already registered in the storage unit 113 (hereinafter referred to as “special fingerprint image”). . When the fingerprint image data of the authentication fingerprint image is acquired by the acquisition unit 109, the collation unit 110 reads the fingerprint image data of the registered fingerprint image stored in the storage unit 113, and extracts the feature points of each of the registration fingerprint image and the authentication fingerprint image. Extract (S302). As described above, the feature points are, for example, the center point of the fingerprint pattern, the branch point of the fingerprint convex line, the end point of the fingerprint convex line, and the like.

  The collation unit 110 corrects the position and rotation deviation of each feature point of the authentication fingerprint image based on the positional relationship between the extracted feature points (S303). Specifically, the collation unit 110 performs parallel movement and rotation of the feature points of the authentication fingerprint image so that the coincidence of the position coordinates of each feature point of the registered fingerprint image and the authentication fingerprint image is enhanced. The collation unit 110 associates the feature points of the registered fingerprint image and the feature points of the authentication fingerprint image one by one after correcting the position and rotation deviation of each feature point (S304). The collation unit 110 collates the registered fingerprint image and the authentication fingerprint image by associating feature points having the same position coordinates. The collation unit 110 counts the number of feature points associated with each other, and determines whether the count value is equal to or greater than a threshold value (S305). If the count value of the associated feature point is less than the threshold (S305: N), the collation unit 110 determines that the authentication fingerprint image and the registered fingerprint image do not match as a result of the collation and the user authentication cannot be performed. To finish the process. If the number of associated feature points is equal to or greater than the threshold value (S305: Y), the collation unit 110 determines that the authentication fingerprint image and the registered fingerprint image coincide with each other as a result of collation, and user authentication has been performed. Since the information processing apparatus 100 determines that the user authentication is successful, the information processing apparatus 100 releases the lock (S306).

  After the user authentication, the specifying unit 111 specifies the direction of the finger of the hand performing the operation based on the angle obtained by rotating the specific point of the authentication fingerprint image in step S303 (S307). The display control unit 112 determines a display area on the touch panel 107 based on the direction of the finger of the hand specified by the specifying unit 111, and displays a GUI object in the display area (S308). Thereby, the GUI object is displayed at a position where the user can easily operate with a finger. The processing in steps S301 to S306 is similar to the normal unlocking processing, and the user does not need to perform any special operation. Since the direction of the finger is specified based on the rotation angle of the specific point obtained by such normal processing, the GUI object is displayed at a position where it can be easily operated by the user's finger without impairing the user's operability. The

  In the present embodiment, the storage unit 113 stores information on the display area of the GUI object determined in a stepwise manner in association with the finger direction (rotation angle). Therefore, the display control unit 112 can determine the display area associated with the specified finger direction as the display area of the GUI object based on this information stored in the storage unit 113. Specifically, the display area is determined such that the area where the GUI object is displayed on the touch panel 107 becomes narrower as the absolute value of the rotation angle “−180 degrees to 180 degrees” is smaller. If there is no display area associated with the identified finger direction, the display area associated with the finger direction close to the identified finger direction or the finger whose rotation angle is smaller than the identified finger direction The display area associated with the direction is determined as the GUI object display area. In the present embodiment, the direction of the thumb 402 in FIG. 3 (the angle formed by the straight line 403 and the straight line 404) is set to “0 degree”, and “0 degree when rotated clockwise within the range of −180 degrees to 180 degrees”. Is used as information indicating the direction of the finger.

  FIG. 5 is a diagram illustrating an operation when the information processing apparatus 100 is unlocked by the user. FIG. 5A and FIG. 5B differ in the position where the user has the information processing apparatus 100. The hand shown in FIG. 5A holds the information processing apparatus 100 deeper than the hand shown in FIG. 5B. For this reason, the thumb 502 in FIG. 5A has a wider reach on the display than the thumb 504 in FIG. 5B.

  In FIG. 5A, the angle formed between the straight line 505 passing through the tip from the base of the thumb 502 and the straight line 403 passing through the tip from the base of the thumb when registering the fingerprint image (see FIG. 3) is “90 degrees. It is. That is, the straight line 505 is rotated “90 degrees” with respect to the straight line 404 passing through the upper end from the lower end of the surface of the touch panel 107 parallel to the straight line 403. The fingerprint image acquired from the thumb 502 is rotated in the clockwise direction by “−90 degrees”, so that the image has the same orientation as the registered fingerprint image registered in the storage unit 113. In the process of step S <b> 303 in FIG. 4, the collation unit 110 rotates the authentication fingerprint image acquired from the thumb 502 by “−90 degrees” clockwise.

  In FIG. 5B, the angle formed between the straight line 506 passing through the tip from the base of the thumb 504 and the straight line 403 passing through the tip from the base of the thumb when registering the fingerprint image (see FIG. 3) is “60 degrees. It is. That is, the straight line 506 is rotated by “60 degrees” with respect to the straight line 404 passing through the upper end from the lower end of the surface of the touch panel 107 parallel to the straight line 403. The fingerprint image acquired from the thumb 504 is rotated in the clockwise direction by “−60 degrees”, so that the image has the same orientation as the registered fingerprint image registered in the storage unit 113. In the process of step S303 in FIG. 4, the collation unit 110 rotates the authentication fingerprint image acquired from the thumb 502 “−60 degrees” clockwise.

  As shown in FIG. 5A, when the angle formed by the straight line 505 and the straight line 404 is “90 degrees”, the reachable range of the thumb 502 is represented by a boundary line 501. The GUI object is displayed in an area within the boundary line 501. As shown in FIG. 5B, when the angle formed by the straight line 506 and the straight line 404 is “60 degrees”, the range that the thumb can reach is represented by a boundary line 503. The GUI object is displayed in an area within the boundary line 503. That is, the larger the angle formed with the straight line 404, the larger the range that the thumb can reach, and the larger the displayable range of the GUI object.

  As described above, the area for displaying the GUI object can be determined by the essential operation of unlocking the information processing apparatus 100 by fingerprint authentication of the thumb. The user can change the display area of the GUI object according to the direction of the hand at the time of fingerprint authentication (the direction of the thumb), and the operability when operating the information processing apparatus 100 with one hand is improved.

  In this embodiment, an example of specifying the direction of the finger of the hand holding the information processing apparatus 100 based on the direction of the finger (fingerprint) when the home button is pressed using the fingerprint reading sensor 105 provided on the home button. Explained. Instead of the fingerprint, biometric information about other hands can be used. In this case, the home button is provided with a sensor that acquires biometric information as an image (biological image). For example, the direction of the finger of a hand can be specified using an image of a finger vein or the like. Even when a biometric image other than a fingerprint image is used in this way, it is possible to improve the operability by setting the display area of the GUI object within the reach of the thumb of one hand only by an essential operation of unlocking. it can.

<Modification>
If the user sets in advance the direction of the finger pressing the home button and the movable range of the finger on the touch panel 107 at that time, it corresponds to the size of the user's hand and the habit of holding the information processing apparatus 100. Therefore, the operability can be further improved. Hereinafter, a case where the user sets the display area of the GUI object in advance will be described.

  FIG. 6 is a functional block diagram of the information processing apparatus 100 in this case. These functional blocks are realized by the CPU 101 executing a computer program, and are configured by adding an area setting unit 601 to the configuration of FIG. The description of the same functional block is omitted. The area setting unit 601 sets the display area of the GUI object based on the locus of the user tracing the display screen of the touch panel 107 with a finger. For example, the area setting unit 601 registers, as a GUI object display area, a range on the home button side from the locus traced by the user on the display screen of the touch panel 107.

  FIG. 7 is a flowchart showing processing for registering the display area of the GUI object by such an information processing apparatus 100. The information processing apparatus 100 has an application program for registering a main body setting and a display area. When this application program is activated, the display area of the GUI object can be registered by the user. When the application program is activated, the display control unit 112 displays a guidance image for explaining a method for setting the display area of the GUI object to the user on the display of the touch panel 107 (S701). FIG. 8A is an exemplary diagram of a guidance image 801 to be displayed. The guidance image 801 instructs the user how to register the display area of the GUI object. In addition to the guidance image 801, the display control unit 112 displays an “OK” button and a “Cancel” button.

  When the user traces the display screen of the display with the thumb 802 in accordance with the instruction of the guidance image 801, the display area of the GUI object is registered. The locus traced with the thumb 802 represents a boundary line 803 within a range where the thumb 802 can reach. When the user traces the display screen of the display with the thumb 802 and presses the “OK” button, the operation detection unit 114 detects the boundary line 803 (S702: Y). The user presses the home button when tracing the display screen. The area setting unit 601 registers the display area of the GUI object on the touch panel 107 based on the boundary line 803 detected by the operation detection unit 114 (S703). Thereby, the display area of the GUI object is stored in the storage unit 113 in association with the rotation angle of the fingerprint image acquired by the fingerprint reading sensor 105 when the home button is pressed. When the “Cancel” button is pressed, the operation detection unit 114 ends the process without registering the display area (S702: N).

  In the present embodiment, the locus traced by the user on the display screen of the display is regarded as a boundary line 803 that the user can comfortably touch with the thumb 802 while holding the information processing apparatus 100. A range closer to the home button than the boundary line 803 is a display area of the GUI object. The user performs such processing a plurality of times while changing the direction of the hand holding the information processing apparatus 100. For example, the user traces on the display screen of the display like the boundary lines 501 and 503 in FIG. As a result, the information processing apparatus 100 stores display areas of a plurality of GUI objects corresponding to the locus of the thumb 802 tracing the display screen of the display. The information processing apparatus 100 that stores the display areas of a plurality of GUI objects can calculate the optimum display area from the stored display areas according to the direction of the thumb when unlocking. FIG. 8B is an explanatory diagram of the calculation process of the display area of the optimal GUI object.

  A boundary line 811 represents a locus traced by the user on the display screen of the display in the state of FIG. A boundary line 812 represents a locus traced by the user on the display screen in the state of FIG. The display area of the GUI object by the boundary lines 811 and 812 is stored in advance in the storage unit 113 in association with the rotation angle of the thumb at that time. When the unlocking operation is performed from this state and the acquisition unit 109 acquires the authentication fingerprint image from the fingerprint reading sensor 105, the region setting unit 601 calculates the display region of the GUI object based on the authentication fingerprint image. The area setting unit 601 confirms the rotation angle of the rotation process performed in step S303 of FIG. 4 on the authentication fingerprint image, and reads the display area of the GUI object associated with the rotation angle from the storage unit 113. If there is no associated GUI object display area, a rotation angle close to the confirmed rotation angle is specified from the stored rotation angle, and the GUI object display area is calculated from the specified rotation angle. For example, the boundary line 813 is located between the boundary lines 811 and 812, but the display area of the associated GUI object is not stored in the storage unit 113. In this case, the display area of the GUI object is calculated from the relationship between the boundary lines 811 and 812 and the boundary line 813.

  As described above, the GUI object display area is set based on the rotation angle of the thumb of one hand. Accordingly, it is possible to cope with the difference in the size of the hand for each user and the habit of how to support the information processing apparatus 100 and to improve the operability. Further, by calculating a region of values that are not set from preset values, it is possible to reduce the user's troublesomeness of repeating the setting operation finely.

<Other embodiments>
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the above-described embodiment is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads and executes the program. It is processing.

  DESCRIPTION OF SYMBOLS 105 ... Fingerprint reading sensor 107 ... Touch panel 108 ... Button operation part 109 ... Acquisition part 110 ... Collation part 111 ... Identification part 112 ... Display control part 113 ... Storage part 114 ... Operation detection part 601 ... Area setting section

Claims (12)

An operation receiving means for receiving a user operation instruction, which is a touch panel that is a display screen for displaying an object;
Holding means for holding a first image representing biometric information of the user's finger;
A sensor that reads biometric information of the user's finger and acquires a second image representing the read biometric information;
Collating means for collating characteristics of the second image read by the sensor and the first image;
As a result of collation by the collating means, when it is considered that the characteristics of the first image and the second image match, based on the rotation angle of the second image with respect to the first image, The direction of the finger operating the sensor is specified, and the display area of the object is displayed so that the distance between the object and the finger on the display screen is closer to the initial state based on the specified finger direction. A decision means to decide;
Display control means for displaying the object in the display area,
Information processing device. The holding means holds an image acquired by the sensor from a finger facing a predetermined direction as the first image.
The information processing apparatus according to claim 1. The determination means narrows the display area as the angle formed by the predetermined direction and the specified finger direction is smaller.
The information processing apparatus according to claim 2. The holding unit holds a plurality of finger directions and a plurality of display areas in association with each other,
The determining means refers to the holding means to determine a display area associated with the identified finger direction,
The information processing apparatus according to claim 1. The holding means holds the display area of the object based on a locus of the user tracing the display screen with a finger in association with the direction of the finger,
The determining means refers to the holding means to determine a display area associated with the identified finger direction,
The information processing apparatus according to claim 4. If the display unit associated with the specified finger direction is not held by the holding unit, the determining unit is configured to display the display region associated with the finger direction close to the identified finger direction. , Determining the display area,
The information processing apparatus according to claim 5. The collating means calculates the rotation angle by extracting a feature point from each of the first image and the second image, correcting the position and rotation shift of each feature point, and calculating the first rotation angle. The user authentication is performed by comparing the feature point of the image and the feature point of the second image,
The display control means displays the object in the display area when a user is authenticated as a result of the user authentication.
The information processing apparatus according to claim 1. The holding unit holds an image of the user's fingerprint as the first image,
The sensor acquires an image of the user's fingerprint as the second image,
The information processing apparatus according to claim 1. The sensor is characterized in that provided in the near vicinity of the operation acceptance means,
The information processing apparatus according to claim 1. A touch panel that is a display screen for displaying an object, an operation receiving unit that receives a user's operation instruction, a holding unit that holds a first image representing the biological information of the user's finger, and the biological information of the user's finger And a sensor that acquires a second image representing the read biological information, and is executed by an information processing apparatus comprising:
Collating features of the first image and the second image;
As a result of the collation, when it is considered that the features of the first image and the second image match, the sensor is operated based on the rotation angle of the second image with respect to the first image. Identifying the direction of the finger;
Based on the specified finger direction, the display area of the object is determined so that the distance between the object and the finger on the display screen is closer to the initial state, and the object is displayed in the determined display area. And a step of displaying
Information processing method. A touch panel that is a display screen for displaying an object, an operation receiving unit that receives a user operation instruction, a sensor that reads the biological information of the user's finger, and acquires a second image representing the read biological information; A computer with
Holding means for holding a first image representing biometric information of the user's finger;
Collation means for collating characteristics of the second image read by the sensor and the first image;
As a result of collation by the collating means, when it is considered that the characteristics of the first image and the second image match, based on the rotation angle of the second image with respect to the first image, The direction of the finger operating the sensor is specified, and the display area of the object is displayed so that the distance between the object and the finger on the display screen is closer to the initial state based on the specified finger direction. Decision means to decide,
Display control means for displaying the object in the display area;
Computer program to function as.   A computer-readable recording medium on which the computer program according to claim 11 is recorded.

Images